-- Logs begin at Sat 2022-05-14 20:01:12 UTC, end at Sat 2022-05-14 22:44:18 UTC. -- May 14 20:48:38.551176 ncdv-master-1 systemd[1]: Starting Devstack devstack@keystone.service... May 14 20:48:38.559379 ncdv-master-1 devstack@keystone.service[91094]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 14 20:48:38.561570 ncdv-master-1 devstack@keystone.service[91094]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat May 14 20:48:38 2022] *** May 14 20:48:38.561570 ncdv-master-1 devstack@keystone.service[91094]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 14 20:48:38.561570 ncdv-master-1 devstack@keystone.service[91094]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 14 20:48:38.561570 ncdv-master-1 devstack@keystone.service[91094]: nodename: ncdv-master-1 May 14 20:48:38.561570 ncdv-master-1 devstack@keystone.service[91094]: machine: x86_64 May 14 20:48:38.561570 ncdv-master-1 devstack@keystone.service[91094]: clock source: unix May 14 20:48:38.561570 ncdv-master-1 devstack@keystone.service[91094]: pcre jit disabled May 14 20:48:38.561570 ncdv-master-1 devstack@keystone.service[91094]: detected number of CPU cores: 4 May 14 20:48:38.561570 ncdv-master-1 devstack@keystone.service[91094]: current working directory: / May 14 20:48:38.561570 ncdv-master-1 devstack@keystone.service[91094]: detected binary path: /usr/bin/uwsgi-core May 14 20:48:38.561570 ncdv-master-1 devstack@keystone.service[91094]: your processes number limit is 47680 May 14 20:48:38.562157 ncdv-master-1 devstack@keystone.service[91094]: your memory page size is 4096 bytes May 14 20:48:38.562157 ncdv-master-1 devstack@keystone.service[91094]: detected max file descriptor number: 2048 May 14 20:48:38.562157 ncdv-master-1 devstack@keystone.service[91094]: lock engine: pthread robust mutexes May 14 20:48:38.562157 ncdv-master-1 devstack@keystone.service[91094]: thunder lock: enabled May 14 20:48:38.562157 ncdv-master-1 devstack@keystone.service[91094]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 14 20:48:38.562157 ncdv-master-1 devstack@keystone.service[91094]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 14 20:48:38.611212 ncdv-master-1 devstack@keystone.service[91094]: Python main interpreter initialized at 0x5559888cb9c0 May 14 20:48:38.611212 ncdv-master-1 devstack@keystone.service[91094]: python threads support enabled May 14 20:48:38.611212 ncdv-master-1 devstack@keystone.service[91094]: your server socket listen backlog is limited to 100 connections May 14 20:48:38.611212 ncdv-master-1 devstack@keystone.service[91094]: your mercy for graceful operations on workers is 90 seconds May 14 20:48:38.611635 ncdv-master-1 devstack@keystone.service[91094]: mapped 403077 bytes (393 KB) for 2 cores May 14 20:48:38.611712 ncdv-master-1 devstack@keystone.service[91094]: *** Operational MODE: preforking *** May 14 20:48:38.611920 ncdv-master-1 devstack@keystone.service[91094]: *** uWSGI is running in multiple interpreter mode *** May 14 20:48:38.611920 ncdv-master-1 devstack@keystone.service[91094]: spawned uWSGI master process (pid: 91094) May 14 20:48:38.612125 ncdv-master-1 systemd[1]: Started Devstack devstack@keystone.service. May 14 20:48:38.615519 ncdv-master-1 devstack@keystone.service[91094]: spawned uWSGI worker 1 (pid: 91106, cores: 1) May 14 20:48:38.615519 ncdv-master-1 devstack@keystone.service[91094]: spawned uWSGI worker 2 (pid: 91107, cores: 1) May 14 20:48:38.615519 ncdv-master-1 devstack@keystone.service[91094]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 14 20:48:44.448717 ncdv-master-1 devstack@keystone.service[91107]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 14 20:48:44.448717 ncdv-master-1 devstack@keystone.service[91107]: from cryptography.utils import int_from_bytes May 14 20:48:44.449511 ncdv-master-1 devstack@keystone.service[91107]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 14 20:48:44.449511 ncdv-master-1 devstack@keystone.service[91107]: from cryptography.utils import int_from_bytes May 14 20:48:44.455791 ncdv-master-1 devstack@keystone.service[91106]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 14 20:48:44.455791 ncdv-master-1 devstack@keystone.service[91106]: from cryptography.utils import int_from_bytes May 14 20:48:44.456281 ncdv-master-1 devstack@keystone.service[91106]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 14 20:48:44.456281 ncdv-master-1 devstack@keystone.service[91106]: from cryptography.utils import int_from_bytes May 14 20:48:44.504545 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 14 20:48:44.504749 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 14 20:48:44.504904 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] command line args: [] {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 14 20:48:44.505168 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 14 20:48:44.505343 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] ================================================================================ {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 14 20:48:44.505592 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] admin_token = **** {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.505835 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] config_dir = [] {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.506022 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.506202 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] config_source = [] {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.506381 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] debug = True {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.506581 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.507965 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.507965 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] insecure_debug = False {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.507965 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.507965 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.507965 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] list_limit = None {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.508292 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] log_config_append = None {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.508292 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.508441 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] log_dir = None {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.508620 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] log_file = None {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.508855 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.509099 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.509344 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.509590 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.509765 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.509940 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.510190 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.510434 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.510666 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.510896 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.511125 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.511353 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.511621 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.511866 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] notification_format = cadf {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.512140 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.512899 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.52/identity {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.512899 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] publish_errors = False {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.513055 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.513237 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.513600 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.513755 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.513893 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.514034 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 14 20:48:44.514168 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] standard_threads = False {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.514304 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 14 20:48:44.514304 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] command line args: [] {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 14 20:48:44.514557 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] strict_password_check = False {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.514557 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.514822 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 14 20:48:44.514964 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] use_eventlog = False {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.515094 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] ================================================================================ {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 14 20:48:44.515231 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] use_journal = False {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.515362 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] admin_token = **** {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.515524 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] use_json = False {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.515524 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] use_stderr = False {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.515841 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] config_dir = [] {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.515977 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] use_syslog = False {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.516108 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.516108 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] config_source = [] {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.516359 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] watch_log_file = False {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.516503 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] debug = True {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.516642 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.516784 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.516941 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.517081 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.517211 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.517341 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] insecure_debug = False {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.517470 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.517601 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.517737 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.517880 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.518011 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.518148 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] list_limit = None {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.518288 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.518434 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] log_config_append = None {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.518434 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.518692 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.518835 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] log_dir = None {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.518966 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.519096 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] log_file = None {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.519231 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.519382 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.519616 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.519756 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.519887 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.520017 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.520147 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.520290 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.520290 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.520557 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.520695 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.520835 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.521005 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.521177 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.521328 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.521532 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.521717 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.521908 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.522100 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.522277 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.523100 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.523280 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.523467 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.523702 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.523918 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.524073 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.524209 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] notification_format = cadf {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.524345 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.524511 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.524642 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.524642 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.524944 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.52/identity {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.525136 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.525334 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] publish_errors = False {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.525528 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.525705 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.525940 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.526131 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.526310 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.526512 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.526721 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.526926 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.527067 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.527196 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.527353 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.527524 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] standard_threads = False {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.527783 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.527978 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] strict_password_check = False {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.528159 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.528350 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.528350 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] use_eventlog = False {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.528691 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.528889 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] use_journal = False {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.529075 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.529261 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] use_json = False {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.529261 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] use_stderr = False {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.529625 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.529825 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] use_syslog = False {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.529974 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.530106 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] watch_log_file = False {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 20:48:44.530277 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.530408 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.530537 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.530715 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.530914 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.531097 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.531276 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.531453 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.531688 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.531688 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.532042 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.532244 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.532446 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.532636 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.532826 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.533007 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.533177 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.533322 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.533452 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.533580 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.533716 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.533854 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.533983 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.534110 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.534244 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.534374 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.534503 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.534653 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.534782 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.534916 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.535044 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.535178 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.535307 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.535445 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.535646 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.535787 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.535923 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.536053 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.536182 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.536322 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.536462 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.536591 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.536720 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.536849 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.536977 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.537120 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.537120 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.537365 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.537505 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.537636 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.537765 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.537902 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.538755 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.538967 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.539209 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.539407 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.539575 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.539717 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.539717 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.539980 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.540111 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.540241 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.540370 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.540506 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.540650 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.540782 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.540912 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.541053 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.541189 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.541319 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.541319 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.541582 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.541720 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] cache.enabled = True {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.541850 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.541980 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.542109 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.542250 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.542380 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.542515 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.542644 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.542783 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.542970 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.543114 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.543251 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.543382 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.543565 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.543703 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.543834 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.544038 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.544172 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.544308 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.544444 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.544583 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.544713 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.544862 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.544993 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.545123 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.545260 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.545392 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.545528 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.545666 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.545796 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.545927 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.546056 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.546186 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.546316 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.546454 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.546584 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.546723 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.546853 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.546989 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.547119 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.547261 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.547404 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.547564 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.547699 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.547699 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.547945 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.548076 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.548213 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.548350 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.548487 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.548630 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.548760 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.548890 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.549029 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.549160 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.549290 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.549428 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.549559 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.549771 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.549947 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] auth.external = None {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.550081 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.550211 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] auth.mapped = None {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.550346 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.550495 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.550634 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.550773 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.550904 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.551035 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] auth.password = None {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.551165 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.551294 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] auth.token = None {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.551423 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.551600 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.551733 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.551864 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] catalog.caching = True {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.551993 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.552123 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.552268 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.552408 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.552539 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.552668 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.552927 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] cache.enabled = True {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.553064 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.553194 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.553333 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.553464 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.553600 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] credential.caching = True {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.553770 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.553997 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] credential.driver = sql {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.554216 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.554387 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.554531 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.554661 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.554791 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.554921 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.555055 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.555194 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.555325 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.555455 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.555675 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.555807 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.555937 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.556077 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.556208 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.556364 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.556515 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.556647 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.556784 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.556915 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.557045 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.557185 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.557316 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.557448 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.557578 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.557714 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.557845 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.557983 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.558114 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.558253 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] federation.caching = True {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.558383 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.558514 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.558643 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.558785 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] federation.driver = sql {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.558922 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.559053 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.559189 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.559325 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.559456 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.559723 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.559865 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.560002 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.560134 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.560274 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.560405 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.560543 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.560676 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.560818 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.560950 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.561080 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.561210 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] auth.external = None {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.561359 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.561500 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] auth.mapped = None {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.561632 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] identity.caching = True {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.561762 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.561894 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.562035 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.562174 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.562306 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] auth.password = None {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.562437 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.562567 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] auth.token = None {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.562699 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.562829 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.562968 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] identity.driver = sql {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.563100 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] catalog.caching = True {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.563231 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.563361 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.563510 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.563647 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.563790 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.563936 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.564066 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.564196 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.564325 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.564464 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.564595 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.564726 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] credential.caching = True {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.564856 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.564987 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] credential.driver = sql {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.565117 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.565117 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.565380 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.565517 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.565663 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.565795 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.565926 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.566065 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.566201 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.566201 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.566446 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.566446 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.566691 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.566829 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.566962 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.567091 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.567221 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.567352 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.567546 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.567700 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.567833 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.567964 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.568094 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.568225 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.568355 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.568493 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.568624 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.568754 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.568884 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.569015 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.569145 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] federation.caching = True {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.569378 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.569608 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.569819 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.569984 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] federation.driver = sql {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.570127 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.570259 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.570402 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.570534 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.570664 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.570794 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.570925 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.571056 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.571202 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.571202 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] ldap.password = **** {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.571466 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.571629 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.571760 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.571889 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.572032 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.572165 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.572295 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.572432 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.572562 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.572692 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.572830 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] identity.caching = True {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.572961 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.573091 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.573222 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.573371 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.573507 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.573653 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.573790 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.573932 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.574069 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.574207 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] identity.driver = sql {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.574343 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.574489 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.574625 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.574762 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.574898 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.575035 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.575186 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.575333 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.575471 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] ldap.user = None {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.575637 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.575774 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.575911 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.576047 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.576195 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.576335 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.576471 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.576608 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.576744 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.576889 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.577027 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.577173 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.577310 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.577447 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.577584 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.577729 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.577866 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.578070 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.578246 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.578393 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.578531 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.578676 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.578813 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.578950 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.579097 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.579234 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.579370 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.579552 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.579698 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.579921 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.580064 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.580201 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.580339 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.580484 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.580623 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.580759 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.580896 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.581046 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.581198 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.581343 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.581343 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.581605 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.581741 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.581878 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.582014 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.582158 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.582295 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.582431 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.582574 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.582712 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.582848 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.582992 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.583139 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] policy.driver = sql {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.583276 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] ldap.password = **** {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.583412 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.583573 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.583713 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.583861 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.583998 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.584135 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.584271 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] receipt.caching = True {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.584407 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.584543 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.584689 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.585344 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.585542 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.585793 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.585984 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.586126 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.586273 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.586411 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.586548 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.586691 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] resource.caching = True {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.586830 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.586967 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.587179 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.587319 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] resource.driver = sql {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.587462 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.587658 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.587808 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.587947 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.588095 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.588233 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.588370 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] ldap.user = None {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.588506 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] revoke.caching = True {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.588643 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.588780 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.588927 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.589327 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.589471 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.589607 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] role.cache_time = None {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.589800 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.589943 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] role.caching = True {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.590099 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.590237 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] role.driver = sql {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.590237 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] role.list_limit = None {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.590497 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.590633 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.590776 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.590776 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.591045 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.591183 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.591320 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.591467 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.591631 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.591781 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.591929 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.592068 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.592205 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.592342 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.592492 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.592631 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.592767 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.592767 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.593026 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.593163 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.593308 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.593446 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.593583 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.593720 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.593868 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.594004 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.594151 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.594151 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.594411 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.594547 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.594683 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.594820 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.594965 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.595103 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.595240 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.595377 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.595576 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.595731 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.595880 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.596026 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.596164 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.596302 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] policy.driver = sql {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.596439 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.596576 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.596719 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.596857 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.596994 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.597130 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.597268 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.597405 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] receipt.caching = True {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.597550 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.597700 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.597838 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.597975 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.598111 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.598254 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.598401 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.598538 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.598675 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.598811 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.598947 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.599083 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] resource.caching = True {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.599228 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.599367 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.599544 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] token.cache_time = None {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.599711 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] resource.driver = sql {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.599883 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] token.caching = True {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.600020 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.600166 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.600303 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.600502 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] token.provider = fernet {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.601204 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.601440 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.601665 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] revoke.caching = True {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.601821 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.601962 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.602098 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.602235 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.602382 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.602521 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] role.cache_time = None {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.602667 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.602805 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] role.caching = True {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.602941 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.603078 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] role.driver = sql {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.603221 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] trust.driver = sql {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.603359 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] role.list_limit = None {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.603534 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.603681 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.603819 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.603955 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.604093 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.604230 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.604386 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.604524 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.604667 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.604804 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.604941 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.605087 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.605225 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.605362 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.605499 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.605636 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.605774 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] database.connection = **** {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.605924 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.606071 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.606226 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.606364 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.606501 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.606638 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.606638 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.606899 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.607045 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.607183 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.607320 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.607320 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.607625 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.607766 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.607915 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.608053 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.608200 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.608338 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.608338 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.608597 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.608742 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.608881 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.609017 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.609154 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.609290 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.609454 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.609601 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.609739 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.609878 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.610024 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.610161 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.610306 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.610444 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.610582 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.610718 ncdv-master-1 devstack@keystone.service[91107]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 14 20:48:44.610856 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.610856 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.610856 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.610856 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.610856 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.610856 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.610856 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.610856 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] token.cache_time = None {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.610856 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] token.caching = True {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.612038 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.612038 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] token.provider = fernet {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.612038 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.612038 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.612038 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.612038 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.612038 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.612038 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.612038 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] trust.driver = sql {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.613224 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.613224 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.613224 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.613224 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.613224 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.613224 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.613224 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.613224 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.613224 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] database.connection = **** {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.614370 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.614370 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.614370 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.614370 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.614370 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.614370 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.614370 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.614370 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.614370 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.615533 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.615533 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.615533 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.615533 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.615533 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.615533 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.615533 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.615533 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.615533 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 20:48:44.617002 ncdv-master-1 devstack@keystone.service[91106]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 14 20:48:44.620709 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=91107) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 20:48:44.621203 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=91107) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 20:48:44.621423 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=91107) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 20:48:44.627260 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=91106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 20:48:44.627536 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=91106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 20:48:44.627755 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=91106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 20:48:44.629976 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=91107) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 20:48:44.636901 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=91106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 20:48:44.659312 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=91107) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 20:48:44.659563 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=91107) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 20:48:44.663817 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=91106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 20:48:44.664056 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=91106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 20:48:44.713013 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=91106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 20:48:44.713795 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=91107) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 20:48:44.763118 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=91107) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 20:48:44.763341 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=91107) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 20:48:44.764896 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=91106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 20:48:44.765141 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=91106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 20:48:44.833655 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 20:48:44.833846 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91107) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 20:48:44.833949 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=91106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 20:48:44.834031 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=91107) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 20:48:44.834107 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=91106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 20:48:44.834242 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=91107) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 20:48:44.834329 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=91106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 20:48:44.834465 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=91107) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 20:48:44.834566 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=91106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 20:48:44.834683 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=91107) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 20:48:44.834767 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=91106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 20:48:44.834996 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=91107) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 20:48:44.858455 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 20:48:44.858704 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=91106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 20:48:44.858916 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=91106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 20:48:44.859118 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91107) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 20:48:44.859204 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=91106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 20:48:44.859353 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=91107) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 20:48:44.859449 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=91106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 20:48:44.859597 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=91106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 20:48:44.859682 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=91107) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 20:48:44.859817 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=91107) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 20:48:44.859899 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 20:48:44.860034 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=91107) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 20:48:44.860249 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=91107) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 20:48:44.860465 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91107) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 20:48:44.872197 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=91107) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 20:48:44.873046 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=91106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 20:48:44.884842 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91107) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 20:48:44.885077 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=91107) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 20:48:44.885296 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=91107) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 20:48:44.885381 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 20:48:44.885516 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=91107) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 20:48:44.885600 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=91106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 20:48:44.885731 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=91107) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 20:48:44.885816 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=91106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 20:48:44.885945 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=91107) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 20:48:44.886029 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=91106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 20:48:44.886160 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91107) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 20:48:44.886254 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=91106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 20:48:44.886377 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=91106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 20:48:44.886599 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 20:48:44.903254 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:44.903461 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 14 20:48:44.903815 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:44.903991 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:44.904079 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 14 20:48:44.904172 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 14 20:48:44.904267 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:44.904492 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:44.904586 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:44.904694 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 14 20:48:44.904777 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:44.904964 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:44.905046 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:44.905227 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:44.905490 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:44.905748 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:44.916256 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:44.916530 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:44.916798 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:44.917137 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:44.917348 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:44.917629 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:44.917900 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:44.918183 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:44.925346 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=91107) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 14 20:48:44.926501 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=91106) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 14 20:48:44.929169 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=91107) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 14 20:48:44.929469 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:44.929727 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:44.930002 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:44.930275 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:44.930530 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:44.930613 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=91106) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 14 20:48:44.930792 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:44.930884 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:44.931057 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:44.931139 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:44.931319 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:44.931401 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:44.931608 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:44.931706 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:44.931875 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:44.931959 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:44.932163 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:44.932439 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:44.932712 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:44.932986 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:44.933256 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:44.958522 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:44.959826 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:44.960180 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=91107) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 14 20:48:44.960529 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:44.961461 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=91106) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 14 20:48:44.961742 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:44.965816 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=91107) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 14 20:48:44.966048 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:44.966440 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:44.967027 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=91106) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 14 20:48:44.967314 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:44.967741 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:44.973708 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=91107) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 14 20:48:44.973979 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:44.975086 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=91106) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 14 20:48:44.975370 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:44.978965 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=91107) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 14 20:48:44.979245 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:44.979543 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:44.979825 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:44.980096 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:44.980365 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:44.980605 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=91106) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 14 20:48:44.980690 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:44.980883 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:44.980966 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:44.981170 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:44.981453 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:44.981729 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:44.982003 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:44.982276 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:44.982546 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:44.999776 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.000048 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.001757 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.002039 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.004542 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=91107) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 14 20:48:45.006636 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=91106) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 14 20:48:45.008316 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.008607 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.010394 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.010691 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.013737 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=91107) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 14 20:48:45.015820 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=91106) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 14 20:48:45.017331 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=91107) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 14 20:48:45.019436 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=91106) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 14 20:48:45.021039 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.021337 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.021618 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.021899 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.022171 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.023254 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.023753 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.024054 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.024340 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.024635 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.024917 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.025213 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.043433 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=91107) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 14 20:48:45.043737 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.044004 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.044264 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.045030 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=91106) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 14 20:48:45.045315 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.045585 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.045851 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.052147 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.053832 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.053982 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.054378 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.055580 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.055862 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.057579 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=91107) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 14 20:48:45.057853 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.058131 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.058419 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.058692 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.059052 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=91106) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 14 20:48:45.059330 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.059647 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.059941 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.060229 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.072198 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=91107) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 14 20:48:45.072474 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.072749 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.073025 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.073304 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.073678 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.073952 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.074104 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=91106) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 14 20:48:45.074387 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.074670 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.074955 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.075237 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.075634 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.075917 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.092232 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=91107) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 14 20:48:45.094430 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=91106) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 14 20:48:45.095448 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=91107) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 14 20:48:45.097755 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=91106) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 14 20:48:45.098736 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.101675 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.102372 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.103436 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.104042 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=91107) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 14 20:48:45.104316 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.104592 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.105097 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=91106) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 14 20:48:45.105384 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.105673 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.112132 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.113446 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.113946 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=91107) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 14 20:48:45.115097 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=91106) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 14 20:48:45.117516 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.117796 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.118194 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.118470 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.122519 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.122812 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.125243 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.125583 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.130135 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=91107) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 14 20:48:45.130586 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.131018 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.138653 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=91106) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 14 20:48:45.138951 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.139236 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.139908 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=91107) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 14 20:48:45.140188 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.140466 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.140782 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.141264 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.141797 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.142085 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.142357 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.142643 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.142916 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.143198 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.143468 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.143758 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.144325 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=91107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.149918 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=91106) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 14 20:48:45.150197 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.150479 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.150759 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.151045 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.151427 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.151749 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.152035 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.152317 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.152593 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.152868 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.153148 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.153428 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.153709 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=91106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 20:48:45.185712 ncdv-master-1 devstack@keystone.service[91107]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5559888cb9c0 pid: 91107 (default app) May 14 20:48:45.189154 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183fb6e4-fd9f-4a98-83ce-a4288e172f58 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:48:45.189451 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183fb6e4-fd9f-4a98-83ce-a4288e172f58 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:48:45.189723 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183fb6e4-fd9f-4a98-83ce-a4288e172f58 None None] PATH_INFO: `/v3` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:48:45.192678 ncdv-master-1 devstack@keystone.service[91106]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5559888cb9c0 pid: 91106 (default app) May 14 20:48:45.193879 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1/1] 10.222.0.52 () {50 vars in 791 bytes} [Sat May 14 20:48:45 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:48:54.182387 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96747c9c-3ac9-4a9a-b26b-5c62cf2d9eb2 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:48:54.182922 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96747c9c-3ac9-4a9a-b26b-5c62cf2d9eb2 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:48:54.182922 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96747c9c-3ac9-4a9a-b26b-5c62cf2d9eb2 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:48:54.187155 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1/2] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:48:54 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:48:54.192424 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c99223b-5930-42d2-92aa-15741fa5755c None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:48:54.193055 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c99223b-5930-42d2-92aa-15741fa5755c None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:48:54.193055 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c99223b-5930-42d2-92aa-15741fa5755c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:48:54.223718 ncdv-master-1 devstack@keystone.service[91107]: DEBUG oslo_db.sqlalchemy.engines [None req-3c99223b-5930-42d2-92aa-15741fa5755c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91107) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 14 20:48:54.410905 ncdv-master-1 devstack@keystone.service[91107]: DEBUG passlib.handlers.bcrypt [None req-3c99223b-5930-42d2-92aa-15741fa5755c None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=91107) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 14 20:48:54.411315 ncdv-master-1 devstack@keystone.service[91107]: DEBUG passlib.handlers.bcrypt [None req-3c99223b-5930-42d2-92aa-15741fa5755c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=91107) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 14 20:48:54.467195 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-3c99223b-5930-42d2-92aa-15741fa5755c None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:48:54.468767 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-3c99223b-5930-42d2-92aa-15741fa5755c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:48:54.706085 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2/3] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:48:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 515 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 14 20:48:54.890556 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96747c9c-3ac9-4a9a-b26b-5c62cf2d9eb2 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:48:54.925464 ncdv-master-1 devstack@keystone.service[91106]: DEBUG oslo_db.sqlalchemy.engines [None req-96747c9c-3ac9-4a9a-b26b-5c62cf2d9eb2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91106) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 14 20:48:55.052686 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96747c9c-3ac9-4a9a-b26b-5c62cf2d9eb2 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:48:55.057092 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdbbd67-c19a-4389-aedf-273d1e6f771e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:48:55.057744 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbbd67-c19a-4389-aedf-273d1e6f771e admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:48:55.058028 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbbd67-c19a-4389-aedf-273d1e6f771e admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:48:55.058304 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbbd67-c19a-4389-aedf-273d1e6f771e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:48:55.066528 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdbbd67-c19a-4389-aedf-273d1e6f771e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:48:55.119257 ncdv-master-1 devstack@keystone.service[91106]: WARNING keystone.common.rbac_enforcer.enforcer [None req-0cdbbd67-c19a-4389-aedf-273d1e6f771e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 14 20:48:55.119616 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdbbd67-c19a-4389-aedf-273d1e6f771e admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:48:55.129430 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2/4] 10.222.0.52 () {58 vars in 1324 bytes} [Sat May 14 20:48:54 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 14 20:48:55.136056 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c99223b-5930-42d2-92aa-15741fa5755c None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:48:55.151189 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c99223b-5930-42d2-92aa-15741fa5755c None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:48:55.155493 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f895a0-866c-4c47-bd17-a7f6f27ffed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:48:55.156613 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f895a0-866c-4c47-bd17-a7f6f27ffed4 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:48:55.156895 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f895a0-866c-4c47-bd17-a7f6f27ffed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:48:55.157167 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f895a0-866c-4c47-bd17-a7f6f27ffed4 admin admin] PATH_INFO: `/v3/projects/96a027574eeb4536a94751bde54cf3b1` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:48:55.158761 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f895a0-866c-4c47-bd17-a7f6f27ffed4 admin admin] RBAC: Authorizing `identity:get_project(project_id=96a027574eeb4536a94751bde54cf3b1)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:48:55.211976 ncdv-master-1 devstack@keystone.service[91107]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b5f895a0-866c-4c47-bd17-a7f6f27ffed4 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 14 20:48:55.212511 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f895a0-866c-4c47-bd17-a7f6f27ffed4 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:48:55.216775 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3/5] 10.222.0.52 () {56 vars in 1207 bytes} [Sat May 14 20:48:55 2022] GET /identity/v3/projects/96a027574eeb4536a94751bde54cf3b1 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:48:57.534112 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8fdd2d-3b2e-4885-af5f-4f37664221ad None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:48:57.534651 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8fdd2d-3b2e-4885-af5f-4f37664221ad None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:48:57.534651 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8fdd2d-3b2e-4885-af5f-4f37664221ad None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:48:57.539277 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3/6] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:48:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:48:57.544857 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc9c6a-59cd-4a22-9983-91f004cce013 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:48:57.545324 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc9c6a-59cd-4a22-9983-91f004cce013 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:48:57.545420 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc9c6a-59cd-4a22-9983-91f004cce013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:48:57.564158 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-74fc9c6a-59cd-4a22-9983-91f004cce013 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:48:57.565664 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-74fc9c6a-59cd-4a22-9983-91f004cce013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:48:57.573705 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4/7] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:48:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 14 20:48:57.597137 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8fdd2d-3b2e-4885-af5f-4f37664221ad None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:48:57.609524 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8fdd2d-3b2e-4885-af5f-4f37664221ad None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:48:57.613626 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617d931a-6c0c-43cb-9d66-528405e5102e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:48:57.614241 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d931a-6c0c-43cb-9d66-528405e5102e admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:48:57.614524 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d931a-6c0c-43cb-9d66-528405e5102e admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:48:57.614798 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d931a-6c0c-43cb-9d66-528405e5102e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:48:57.623357 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617d931a-6c0c-43cb-9d66-528405e5102e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:48:57.625152 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617d931a-6c0c-43cb-9d66-528405e5102e admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:48:57.633867 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4/8] 10.222.0.52 () {58 vars in 1324 bytes} [Sat May 14 20:48:57 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 14 20:48:57.639197 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fc9c6a-59cd-4a22-9983-91f004cce013 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:48:57.648340 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fc9c6a-59cd-4a22-9983-91f004cce013 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:48:57.652746 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7becf78-1c8d-4df3-aff0-867feaebcf49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:48:57.653598 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7becf78-1c8d-4df3-aff0-867feaebcf49 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:48:57.653886 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7becf78-1c8d-4df3-aff0-867feaebcf49 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:48:57.654168 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7becf78-1c8d-4df3-aff0-867feaebcf49 admin admin] PATH_INFO: `/v3/users/9e6b0e25d0144f868beb29eb9540ea7e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:48:57.655588 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7becf78-1c8d-4df3-aff0-867feaebcf49 admin admin] RBAC: Authorizing `identity:get_user(user_id=9e6b0e25d0144f868beb29eb9540ea7e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:48:57.657417 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7becf78-1c8d-4df3-aff0-867feaebcf49 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:48:57.658972 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 5/9] 10.222.0.52 () {56 vars in 1198 bytes} [Sat May 14 20:48:57 2022] GET /identity/v3/users/9e6b0e25d0144f868beb29eb9540ea7e => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:00.005926 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce92fdc7-96e8-43bb-8ea9-032f1484fb4c None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:00.006461 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce92fdc7-96e8-43bb-8ea9-032f1484fb4c None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:00.006672 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce92fdc7-96e8-43bb-8ea9-032f1484fb4c None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:00.008053 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 5/10] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:49:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:49:00.013234 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f10a198-125c-49b6-9c7f-deb579695505 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:00.013636 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f10a198-125c-49b6-9c7f-deb579695505 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:00.013912 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f10a198-125c-49b6-9c7f-deb579695505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:00.030833 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-7f10a198-125c-49b6-9c7f-deb579695505 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:49:00.032022 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-7f10a198-125c-49b6-9c7f-deb579695505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:49:00.069748 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a78508-3184-4d42-b90a-3b8a70b9ccc6 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:00.070039 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a78508-3184-4d42-b90a-3b8a70b9ccc6 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:00.070321 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a78508-3184-4d42-b90a-3b8a70b9ccc6 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:00.071703 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 6/11] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:49:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 14 20:49:00.076859 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be606ca3-9e9f-4dca-b514-03520f058fe6 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:00.077154 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be606ca3-9e9f-4dca-b514-03520f058fe6 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:00.077437 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be606ca3-9e9f-4dca-b514-03520f058fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:00.110286 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 6/12] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:49:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 20:49:00.117217 ncdv-master-1 devstack@keystone.service[91106]: DEBUG passlib.handlers.bcrypt [None req-be606ca3-9e9f-4dca-b514-03520f058fe6 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=91106) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 14 20:49:00.117643 ncdv-master-1 devstack@keystone.service[91106]: DEBUG passlib.handlers.bcrypt [None req-be606ca3-9e9f-4dca-b514-03520f058fe6 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=91106) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 14 20:49:00.134783 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f10a198-125c-49b6-9c7f-deb579695505 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:00.165333 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-be606ca3-9e9f-4dca-b514-03520f058fe6 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:49:00.166981 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-be606ca3-9e9f-4dca-b514-03520f058fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:49:00.230961 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f10a198-125c-49b6-9c7f-deb579695505 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:00.264484 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d016ca51-3dfe-4ef0-b660-273ea2c82822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:00.265351 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d016ca51-3dfe-4ef0-b660-273ea2c82822 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:00.265635 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d016ca51-3dfe-4ef0-b660-273ea2c82822 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:00.265912 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d016ca51-3dfe-4ef0-b660-273ea2c82822 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:00.268423 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 7/13] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:49:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 14 20:49:00.280438 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d016ca51-3dfe-4ef0-b660-273ea2c82822 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:49:00.292122 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-d016ca51-3dfe-4ef0-b660-273ea2c82822 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 14 20:49:00.292122 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:49:00.292122 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:49:00.292122 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:49:00.292122 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:49:00.292122 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:49:00.292122 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:49:00.292122 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:49:00.292122 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:49:00.292122 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:49:00.292122 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:49:00.292122 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:49:00.292122 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:49:00.292122 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:49:00.292122 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:49:00.292122 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:49:00.293049 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:49:00.293049 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:49:00.293049 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:49:00.293049 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:49:00.293049 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:49:00.293049 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:49:00.293049 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:49:00.293049 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:49:00.293049 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:49:00.293049 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:49:00.293049 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:49:00.293049 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:49:00.293049 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:49:00.293049 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:49:00.293049 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:49:00.293049 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:49:00.293870 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:49:00.293870 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:49:00.293870 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:49:00.293870 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:49:00.293870 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:49:00.293870 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:49:00.293870 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:49:00.293870 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:49:00.293870 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:49:00.293870 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:49:00.293870 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 14 20:49:00.293870 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:49:00.294684 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be606ca3-9e9f-4dca-b514-03520f058fe6 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:00.295631 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 7/14] 10.222.0.52 () {56 vars in 1096 bytes} [Sat May 14 20:49:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 20:49:00.298745 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d016ca51-3dfe-4ef0-b660-273ea2c82822 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:00.391992 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be606ca3-9e9f-4dca-b514-03520f058fe6 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:00.393410 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d016ca51-3dfe-4ef0-b660-273ea2c82822 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:00.424511 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf81939-639c-4bda-8b04-6abd1bbaef67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:00.425448 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286943e8-fefc-46ff-9fbc-8f4ececac60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:00.425564 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf81939-639c-4bda-8b04-6abd1bbaef67 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:00.425754 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf81939-639c-4bda-8b04-6abd1bbaef67 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:00.426034 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf81939-639c-4bda-8b04-6abd1bbaef67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:00.426135 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286943e8-fefc-46ff-9fbc-8f4ececac60a None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:00.426380 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286943e8-fefc-46ff-9fbc-8f4ececac60a None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:00.426763 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286943e8-fefc-46ff-9fbc-8f4ececac60a None admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:00.427401 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286943e8-fefc-46ff-9fbc-8f4ececac60a None admin] RBAC: Adding query filter params (name=admin) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:49:00.427738 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286943e8-fefc-46ff-9fbc-8f4ececac60a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:00.430526 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286943e8-fefc-46ff-9fbc-8f4ececac60a None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:00.441914 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 8/15] 10.222.0.52 () {56 vars in 1099 bytes} [Sat May 14 20:49:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:49:00.448380 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286943e8-fefc-46ff-9fbc-8f4ececac60a None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:00.496914 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf81939-639c-4bda-8b04-6abd1bbaef67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:00.498724 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf81939-639c-4bda-8b04-6abd1bbaef67 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:00.557451 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286943e8-fefc-46ff-9fbc-8f4ececac60a None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:00.596670 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c29b17-20ea-4043-815d-d46f8b391300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:00.597871 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c29b17-20ea-4043-815d-d46f8b391300 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:00.598254 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c29b17-20ea-4043-815d-d46f8b391300 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:00.598536 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c29b17-20ea-4043-815d-d46f8b391300 None admin] PATH_INFO: `/v3/users/9e6b0e25d0144f868beb29eb9540ea7e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:00.600129 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c29b17-20ea-4043-815d-d46f8b391300 None admin] RBAC: Authorizing `identity:get_user(user_id=9e6b0e25d0144f868beb29eb9540ea7e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:00.602657 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c29b17-20ea-4043-815d-d46f8b391300 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:00.610130 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 9/16] 10.222.0.52 () {56 vars in 1177 bytes} [Sat May 14 20:49:00 2022] GET /identity/v3/users/9e6b0e25d0144f868beb29eb9540ea7e => generated 247 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:49:00.612068 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c29b17-20ea-4043-815d-d46f8b391300 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:00.623288 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 8/17] 10.222.0.52 () {58 vars in 1282 bytes} [Sat May 14 20:49:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 14 20:49:00.630264 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf81939-639c-4bda-8b04-6abd1bbaef67 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:00.727141 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c29b17-20ea-4043-815d-d46f8b391300 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:00.748936 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf81939-639c-4bda-8b04-6abd1bbaef67 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:00.767038 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e15fa83-363a-44cc-8abd-84bb038bb736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:00.768324 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e15fa83-363a-44cc-8abd-84bb038bb736 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:00.768762 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e15fa83-363a-44cc-8abd-84bb038bb736 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:00.769225 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e15fa83-363a-44cc-8abd-84bb038bb736 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:00.770777 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e15fa83-363a-44cc-8abd-84bb038bb736 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:00.772469 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e15fa83-363a-44cc-8abd-84bb038bb736 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:00.774320 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 10/18] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:49:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:49:00.780004 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e15fa83-363a-44cc-8abd-84bb038bb736 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:00.783306 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597c2abd-799c-43d3-92a7-3838bd3a1e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:00.784215 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c2abd-799c-43d3-92a7-3838bd3a1e21 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:00.784499 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c2abd-799c-43d3-92a7-3838bd3a1e21 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:00.784772 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c2abd-799c-43d3-92a7-3838bd3a1e21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:00.802791 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597c2abd-799c-43d3-92a7-3838bd3a1e21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:00.804931 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597c2abd-799c-43d3-92a7-3838bd3a1e21 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:00.825456 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-597c2abd-799c-43d3-92a7-3838bd3a1e21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:49:00.825456 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:49:00.825456 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:49:00.825456 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:49:00.825456 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:49:00.825456 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:49:00.825456 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:49:00.825456 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:49:00.825456 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:49:00.825456 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:49:00.825456 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:49:00.825456 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:49:00.825456 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:49:00.825456 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:49:00.825456 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:49:00.826328 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:49:00.826328 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:49:00.826328 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:49:00.826328 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:49:00.826328 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:49:00.826328 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:49:00.826328 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:49:00.826328 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:49:00.826328 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:49:00.826328 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:49:00.826328 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:49:00.826328 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:49:00.826328 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:49:00.826328 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:49:00.826328 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:49:00.826328 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:49:00.826328 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:49:00.827129 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 20:49:00.827129 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:49:00.827129 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:49:00.827129 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:49:00.827129 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 9/19] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:49:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 20:49:00.832397 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597c2abd-799c-43d3-92a7-3838bd3a1e21 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:00.875932 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e15fa83-363a-44cc-8abd-84bb038bb736 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:00.908998 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b35bd53-30c6-409d-8cd1-a5ef581c5096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:00.909648 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b35bd53-30c6-409d-8cd1-a5ef581c5096 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:00.909933 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b35bd53-30c6-409d-8cd1-a5ef581c5096 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:00.910210 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b35bd53-30c6-409d-8cd1-a5ef581c5096 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:00.911034 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b35bd53-30c6-409d-8cd1-a5ef581c5096 None admin] RBAC: Adding query filter params (role.id=24c463e2b4d44dd28cd2723a69a8ed2e, scope.domain.id=default, user.id=9e6b0e25d0144f868beb29eb9540ea7e) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:49:00.911344 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b35bd53-30c6-409d-8cd1-a5ef581c5096 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:00.912851 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b35bd53-30c6-409d-8cd1-a5ef581c5096 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:00.919552 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 11/20] 10.222.0.52 () {56 vars in 1322 bytes} [Sat May 14 20:49:00 2022] GET /identity/v3/role_assignments?user.id=9e6b0e25d0144f868beb29eb9540ea7e&scope.domain.id=default&role.id=24c463e2b4d44dd28cd2723a69a8ed2e => generated 233 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:49:00.929653 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597c2abd-799c-43d3-92a7-3838bd3a1e21 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:00.967205 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef2a6f-bb7c-431a-a54a-b97e5b2bb0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:00.967910 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef2a6f-bb7c-431a-a54a-b97e5b2bb0ef None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:00.968199 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef2a6f-bb7c-431a-a54a-b97e5b2bb0ef None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:00.968480 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef2a6f-bb7c-431a-a54a-b97e5b2bb0ef None admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:00.969213 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddef2a6f-bb7c-431a-a54a-b97e5b2bb0ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:49:00.969524 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddef2a6f-bb7c-431a-a54a-b97e5b2bb0ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:00.970931 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddef2a6f-bb7c-431a-a54a-b97e5b2bb0ef None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:00.991944 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 10/21] 10.222.0.52 () {56 vars in 1109 bytes} [Sat May 14 20:49:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:49:03.655724 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8df449-f18c-4e3e-874e-a0ede5f0c5bc None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:03.656694 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8df449-f18c-4e3e-874e-a0ede5f0c5bc None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:03.657196 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8df449-f18c-4e3e-874e-a0ede5f0c5bc None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:03.659039 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 12/22] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:49:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:49:03.664244 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f47ad-a0b6-4062-8229-71366edfc988 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:03.665050 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f47ad-a0b6-4062-8229-71366edfc988 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:03.665546 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f47ad-a0b6-4062-8229-71366edfc988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:03.692540 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-2a9f47ad-a0b6-4062-8229-71366edfc988 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:49:03.694348 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-2a9f47ad-a0b6-4062-8229-71366edfc988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:49:03.767622 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 11/23] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:49:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 20:49:03.788645 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8df449-f18c-4e3e-874e-a0ede5f0c5bc None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:03.899967 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8df449-f18c-4e3e-874e-a0ede5f0c5bc None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:03.934584 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67480974-a52b-4c2d-863a-b7ab26ef83e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:03.935381 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67480974-a52b-4c2d-863a-b7ab26ef83e6 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:03.935694 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67480974-a52b-4c2d-863a-b7ab26ef83e6 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:03.935967 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67480974-a52b-4c2d-863a-b7ab26ef83e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:03.947410 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67480974-a52b-4c2d-863a-b7ab26ef83e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:49:03.955004 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-67480974-a52b-4c2d-863a-b7ab26ef83e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 14 20:49:03.955004 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:49:03.955004 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:49:03.955004 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:49:03.955004 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:49:03.955004 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:49:03.955004 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:49:03.955004 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:49:03.955004 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:49:03.955004 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:49:03.955004 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:49:03.955004 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:49:03.955004 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:49:03.955004 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:49:03.955004 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:49:03.955004 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:49:03.955870 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:49:03.955870 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:49:03.955870 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:49:03.955870 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:49:03.955870 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:49:03.955870 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:49:03.955870 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:49:03.955870 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:49:03.955870 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:49:03.955870 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:49:03.955870 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:49:03.955870 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:49:03.955870 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:49:03.955870 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:49:03.955870 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:49:03.955870 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:49:03.956626 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:49:03.956626 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:49:03.956626 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:49:03.956626 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:49:03.956626 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:49:03.956626 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:49:03.956626 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:49:03.956626 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:49:03.956626 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:49:03.956626 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:49:03.956626 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 14 20:49:03.956626 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:49:03.960944 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 13/24] 10.222.0.52 () {56 vars in 1096 bytes} [Sat May 14 20:49:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:49:03.962347 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9f47ad-a0b6-4062-8229-71366edfc988 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:04.061206 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9f47ad-a0b6-4062-8229-71366edfc988 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:04.095502 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7971590a-43be-437e-ac77-a8c8f549c4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:04.096184 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971590a-43be-437e-ac77-a8c8f549c4f1 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:04.096465 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971590a-43be-437e-ac77-a8c8f549c4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:04.096740 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971590a-43be-437e-ac77-a8c8f549c4f1 None admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:04.097485 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7971590a-43be-437e-ac77-a8c8f549c4f1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:49:04.097855 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7971590a-43be-437e-ac77-a8c8f549c4f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:04.099240 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7971590a-43be-437e-ac77-a8c8f549c4f1 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:04.118130 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 12/25] 10.222.0.52 () {56 vars in 1099 bytes} [Sat May 14 20:49:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:04.119463 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67480974-a52b-4c2d-863a-b7ab26ef83e6 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:04.164616 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe1c8e-221e-4daf-a4a4-23f840e059ab None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:04.164927 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe1c8e-221e-4daf-a4a4-23f840e059ab None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:04.165152 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe1c8e-221e-4daf-a4a4-23f840e059ab None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:04.167856 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 13/26] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:49:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 14 20:49:04.169648 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ea55a-201b-4e15-bf29-899e67035786 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:04.170290 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ea55a-201b-4e15-bf29-899e67035786 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:04.170762 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ea55a-201b-4e15-bf29-899e67035786 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:04.173267 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 14/27] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:49:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:49:04.174665 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b1c25b-b3d7-48ee-8457-98b2b8713a2e None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:04.175547 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b1c25b-b3d7-48ee-8457-98b2b8713a2e None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:04.176247 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b1c25b-b3d7-48ee-8457-98b2b8713a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:04.301733 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67480974-a52b-4c2d-863a-b7ab26ef83e6 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:04.322378 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-b4b1c25b-b3d7-48ee-8457-98b2b8713a2e None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:49:04.324255 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b4b1c25b-b3d7-48ee-8457-98b2b8713a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:49:04.377583 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e2201f-b8bb-46cf-85e9-f0881a051df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:04.378459 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2201f-b8bb-46cf-85e9-f0881a051df0 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:04.378746 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2201f-b8bb-46cf-85e9-f0881a051df0 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:04.379031 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2201f-b8bb-46cf-85e9-f0881a051df0 None admin] PATH_INFO: `/v3/users/9e6b0e25d0144f868beb29eb9540ea7e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:04.383533 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e2201f-b8bb-46cf-85e9-f0881a051df0 None admin] RBAC: Authorizing `identity:get_user(user_id=9e6b0e25d0144f868beb29eb9540ea7e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:04.385025 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e2201f-b8bb-46cf-85e9-f0881a051df0 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:04.387021 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 14/28] 10.222.0.52 () {56 vars in 1177 bytes} [Sat May 14 20:49:04 2022] GET /identity/v3/users/9e6b0e25d0144f868beb29eb9540ea7e => generated 247 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:04.388472 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b913d3-dae8-45a3-96f7-51142a0624b3 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:04.388887 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b913d3-dae8-45a3-96f7-51142a0624b3 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:04.389289 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b913d3-dae8-45a3-96f7-51142a0624b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:04.405863 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 15/29] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:49:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 20:49:04.407105 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b1c25b-b3d7-48ee-8457-98b2b8713a2e None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:04.422092 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-e1b913d3-dae8-45a3-96f7-51142a0624b3 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:49:04.423369 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e1b913d3-dae8-45a3-96f7-51142a0624b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:49:04.509067 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b1c25b-b3d7-48ee-8457-98b2b8713a2e None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:04.520397 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 15/30] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:49:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 20:49:04.522215 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b913d3-dae8-45a3-96f7-51142a0624b3 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:04.549289 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3042e4-1681-4e3d-9385-aabb4256e8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:04.552096 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3042e4-1681-4e3d-9385-aabb4256e8f4 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:04.554715 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3042e4-1681-4e3d-9385-aabb4256e8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:04.556221 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3042e4-1681-4e3d-9385-aabb4256e8f4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:04.558358 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3042e4-1681-4e3d-9385-aabb4256e8f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:04.560572 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3042e4-1681-4e3d-9385-aabb4256e8f4 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:04.563555 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 16/31] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:49:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:04.564988 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf85ea0-ba2e-473b-8d94-8832d011cfe5 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:04.565455 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf85ea0-ba2e-473b-8d94-8832d011cfe5 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:04.565896 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf85ea0-ba2e-473b-8d94-8832d011cfe5 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:04.567799 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 17/32] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:49:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:49:04.574820 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf85ea0-ba2e-473b-8d94-8832d011cfe5 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:04.645543 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b913d3-dae8-45a3-96f7-51142a0624b3 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:04.681692 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f81d33e-b7d2-4cfc-9fbd-94b18af07ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:04.683301 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f81d33e-b7d2-4cfc-9fbd-94b18af07ae0 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:04.683827 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f81d33e-b7d2-4cfc-9fbd-94b18af07ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:04.684306 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f81d33e-b7d2-4cfc-9fbd-94b18af07ae0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:04.694237 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf85ea0-ba2e-473b-8d94-8832d011cfe5 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:04.696129 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f81d33e-b7d2-4cfc-9fbd-94b18af07ae0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:04.697909 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f81d33e-b7d2-4cfc-9fbd-94b18af07ae0 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:04.717127 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-0f81d33e-b7d2-4cfc-9fbd-94b18af07ae0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:49:04.717127 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:49:04.717127 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:49:04.717127 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:49:04.717127 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:49:04.717127 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:49:04.717127 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:49:04.717127 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:49:04.717127 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:49:04.717127 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:49:04.717127 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:49:04.717127 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:49:04.717127 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:49:04.717127 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:49:04.717127 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:49:04.718002 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:49:04.718002 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:49:04.718002 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:49:04.718002 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:49:04.718002 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:49:04.718002 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:49:04.718002 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:49:04.718002 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:49:04.718002 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:49:04.718002 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:49:04.718002 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:49:04.718002 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:49:04.718002 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:49:04.718002 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:49:04.718002 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:49:04.718002 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:49:04.718002 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:49:04.718804 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 20:49:04.718804 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:49:04.718804 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:49:04.718804 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:49:04.721225 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 16/33] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:49:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:49:04.722409 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f81d33e-b7d2-4cfc-9fbd-94b18af07ae0 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:04.732115 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61107981-b062-4c6d-9f22-bbd2376652e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:04.733418 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61107981-b062-4c6d-9f22-bbd2376652e1 None admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:04.733722 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61107981-b062-4c6d-9f22-bbd2376652e1 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:04.734002 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61107981-b062-4c6d-9f22-bbd2376652e1 None admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:04.734781 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61107981-b062-4c6d-9f22-bbd2376652e1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:04.736295 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61107981-b062-4c6d-9f22-bbd2376652e1 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:04.828332 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f81d33e-b7d2-4cfc-9fbd-94b18af07ae0 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:04.863318 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a039873f-0885-4ac6-a414-b84083cf3a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:04.864266 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a039873f-0885-4ac6-a414-b84083cf3a1a None admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:04.864547 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a039873f-0885-4ac6-a414-b84083cf3a1a None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:04.864823 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a039873f-0885-4ac6-a414-b84083cf3a1a None admin] PATH_INFO: `/v3/domains/default/users/9e6b0e25d0144f868beb29eb9540ea7e/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:04.867521 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a039873f-0885-4ac6-a414-b84083cf3a1a None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=9e6b0e25d0144f868beb29eb9540ea7e, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:04.869037 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a039873f-0885-4ac6-a414-b84083cf3a1a None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:04.957394 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 18/34] 10.222.0.52 () {60 vars in 1131 bytes} [Sat May 14 20:49:04 2022] POST /identity/v3/roles => generated 225 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 20:49:04.959279 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d228bc-9ab6-4974-a6ad-6ce10bca0276 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:04.959610 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d228bc-9ab6-4974-a6ad-6ce10bca0276 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:04.959898 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d228bc-9ab6-4974-a6ad-6ce10bca0276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:04.978834 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-13d228bc-9ab6-4974-a6ad-6ce10bca0276 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:49:04.980458 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-13d228bc-9ab6-4974-a6ad-6ce10bca0276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:49:05.057562 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 19/35] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:49:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 20:49:05.058511 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d228bc-9ab6-4974-a6ad-6ce10bca0276 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:05.093564 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 17/36] 10.222.0.52 () {58 vars in 1361 bytes} [Sat May 14 20:49:04 2022] PUT /identity/v3/domains/default/users/9e6b0e25d0144f868beb29eb9540ea7e/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 20:49:05.095880 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d1580e-36a1-4a1f-bc86-ee3f62347e0e None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:05.096409 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d1580e-36a1-4a1f-bc86-ee3f62347e0e None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:05.096900 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d1580e-36a1-4a1f-bc86-ee3f62347e0e None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:05.103309 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 18/37] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:49:05 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:49:05.108757 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d1580e-36a1-4a1f-bc86-ee3f62347e0e None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:05.220217 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d228bc-9ab6-4974-a6ad-6ce10bca0276 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:05.239871 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d1580e-36a1-4a1f-bc86-ee3f62347e0e None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:05.265777 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a889d072-bdcf-4e2c-b627-c26e8eb1500b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:05.266460 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a889d072-bdcf-4e2c-b627-c26e8eb1500b None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:05.266753 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a889d072-bdcf-4e2c-b627-c26e8eb1500b None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:05.267039 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a889d072-bdcf-4e2c-b627-c26e8eb1500b None admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:05.267831 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a889d072-bdcf-4e2c-b627-c26e8eb1500b None admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:49:05.268149 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a889d072-bdcf-4e2c-b627-c26e8eb1500b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:05.269698 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a889d072-bdcf-4e2c-b627-c26e8eb1500b None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:05.279410 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c9e048-dd13-439f-908e-ad55c9886187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:05.280143 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c9e048-dd13-439f-908e-ad55c9886187 None admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:05.280429 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c9e048-dd13-439f-908e-ad55c9886187 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:05.280707 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c9e048-dd13-439f-908e-ad55c9886187 None admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:05.281517 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c9e048-dd13-439f-908e-ad55c9886187 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:05.282599 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 20/38] 10.222.0.52 () {56 vars in 1109 bytes} [Sat May 14 20:49:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:05.283345 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c9e048-dd13-439f-908e-ad55c9886187 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:05.284024 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f2750-38a9-455e-8580-4a949a836d79 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:05.284326 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f2750-38a9-455e-8580-4a949a836d79 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:05.284612 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f2750-38a9-455e-8580-4a949a836d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:05.306009 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-d31f2750-38a9-455e-8580-4a949a836d79 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:49:05.314080 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d31f2750-38a9-455e-8580-4a949a836d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:49:05.387604 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 21/39] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:49:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 20:49:05.387604 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31f2750-38a9-455e-8580-4a949a836d79 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:05.398154 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 19/40] 10.222.0.52 () {60 vars in 1131 bytes} [Sat May 14 20:49:05 2022] POST /identity/v3/roles => generated 219 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 20:49:05.413636 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c9e048-dd13-439f-908e-ad55c9886187 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:05.597495 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31f2750-38a9-455e-8580-4a949a836d79 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:05.621168 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c9e048-dd13-439f-908e-ad55c9886187 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:05.657972 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acdfd6a-377e-4b44-9591-4355843ebac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:05.658572 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acdfd6a-377e-4b44-9591-4355843ebac0 None admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:05.658858 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acdfd6a-377e-4b44-9591-4355843ebac0 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:05.659137 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acdfd6a-377e-4b44-9591-4355843ebac0 None admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:05.659883 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acdfd6a-377e-4b44-9591-4355843ebac0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:05.661348 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acdfd6a-377e-4b44-9591-4355843ebac0 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:05.669910 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fdc390-a45d-4de5-882f-eb681138e548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:05.669910 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fdc390-a45d-4de5-882f-eb681138e548 None admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:05.669910 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fdc390-a45d-4de5-882f-eb681138e548 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:05.669910 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fdc390-a45d-4de5-882f-eb681138e548 None admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:05.671253 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fdc390-a45d-4de5-882f-eb681138e548 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:05.674688 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fdc390-a45d-4de5-882f-eb681138e548 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:05.750196 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 20/41] 10.222.0.52 () {60 vars in 1131 bytes} [Sat May 14 20:49:05 2022] POST /identity/v3/roles => generated 223 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 20:49:05.751848 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd5e81-d1d1-4d84-8ee2-194079bc2a02 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:05.752143 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd5e81-d1d1-4d84-8ee2-194079bc2a02 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:05.752422 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd5e81-d1d1-4d84-8ee2-194079bc2a02 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:05.753787 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 21/42] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:49:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:49:05.759738 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa637425-0bd3-4fb1-993e-c07be066de09 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:05.760094 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa637425-0bd3-4fb1-993e-c07be066de09 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:05.760315 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa637425-0bd3-4fb1-993e-c07be066de09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:05.779436 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-aa637425-0bd3-4fb1-993e-c07be066de09 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:49:05.781200 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-aa637425-0bd3-4fb1-993e-c07be066de09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:49:05.796046 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 22/43] 10.222.0.52 () {60 vars in 1141 bytes} [Sat May 14 20:49:05 2022] POST /identity/v3/projects => generated 301 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 20:49:05.866947 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 22/44] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:49:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 14 20:49:05.892026 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acdfd6a-377e-4b44-9591-4355843ebac0 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:06.024966 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acdfd6a-377e-4b44-9591-4355843ebac0 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:06.059765 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9c2546-fb4b-4363-a6f8-43bb32ab731c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:06.060623 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c2546-fb4b-4363-a6f8-43bb32ab731c None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:06.067511 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c2546-fb4b-4363-a6f8-43bb32ab731c None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:06.067511 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c2546-fb4b-4363-a6f8-43bb32ab731c None admin] PATH_INFO: `/v3/domains/default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:06.067511 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9c2546-fb4b-4363-a6f8-43bb32ab731c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:06.067511 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9c2546-fb4b-4363-a6f8-43bb32ab731c None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:06.067511 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 23/45] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:49:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:06.071287 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa637425-0bd3-4fb1-993e-c07be066de09 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:06.165586 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa637425-0bd3-4fb1-993e-c07be066de09 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:06.197080 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f904b2-07f8-4930-a377-e1a56df15856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:06.197670 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f904b2-07f8-4930-a377-e1a56df15856 None admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:06.197952 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f904b2-07f8-4930-a377-e1a56df15856 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:06.198227 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f904b2-07f8-4930-a377-e1a56df15856 None admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:06.198936 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f904b2-07f8-4930-a377-e1a56df15856 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:06.200420 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f904b2-07f8-4930-a377-e1a56df15856 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:06.294081 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 23/46] 10.222.0.52 () {60 vars in 1141 bytes} [Sat May 14 20:49:06 2022] POST /identity/v3/projects => generated 312 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 20:49:07.546367 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1c31f-3be5-435c-8354-4a8d4eef54ae None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:07.546892 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1c31f-3be5-435c-8354-4a8d4eef54ae None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:07.547002 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1c31f-3be5-435c-8354-4a8d4eef54ae None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:07.548348 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 24/47] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:49:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:49:07.554416 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500c346a-ffe6-4948-b137-64a82e410242 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:07.554834 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500c346a-ffe6-4948-b137-64a82e410242 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:07.555011 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500c346a-ffe6-4948-b137-64a82e410242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:07.571938 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-500c346a-ffe6-4948-b137-64a82e410242 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:49:07.573139 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-500c346a-ffe6-4948-b137-64a82e410242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:49:07.637872 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 24/48] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:49:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 20:49:07.662045 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b1c31f-3be5-435c-8354-4a8d4eef54ae None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:07.761748 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b1c31f-3be5-435c-8354-4a8d4eef54ae None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:07.792888 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316eec50-da26-438c-90c8-946873a5a4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:07.793674 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316eec50-da26-438c-90c8-946873a5a4e8 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:07.793964 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316eec50-da26-438c-90c8-946873a5a4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:07.794246 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316eec50-da26-438c-90c8-946873a5a4e8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:07.805975 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316eec50-da26-438c-90c8-946873a5a4e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:49:07.814621 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-316eec50-da26-438c-90c8-946873a5a4e8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 14 20:49:07.814621 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:49:07.814621 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:49:07.814621 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:49:07.814621 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:49:07.814621 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:49:07.814621 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:49:07.814621 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:49:07.814621 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:49:07.814621 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:49:07.814621 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:49:07.814621 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:49:07.814621 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:49:07.814621 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:49:07.814621 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:49:07.814621 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:49:07.815452 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:49:07.815452 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:49:07.815452 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:49:07.815452 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:49:07.815452 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:49:07.815452 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:49:07.815452 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:49:07.815452 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:49:07.815452 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:49:07.815452 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:49:07.815452 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:49:07.815452 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:49:07.815452 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:49:07.815452 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:49:07.815452 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:49:07.815452 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:49:07.816228 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:49:07.816228 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:49:07.816228 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:49:07.816228 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:49:07.816228 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:49:07.816228 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:49:07.816228 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:49:07.816228 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:49:07.816228 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:49:07.816228 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:49:07.816228 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 14 20:49:07.816228 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:49:07.816228 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 25/49] 10.222.0.52 () {56 vars in 1096 bytes} [Sat May 14 20:49:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:49:07.822249 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500c346a-ffe6-4948-b137-64a82e410242 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:07.917603 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500c346a-ffe6-4948-b137-64a82e410242 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:07.951497 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5521be-1169-4ab6-91d2-81a443da4d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:07.952177 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5521be-1169-4ab6-91d2-81a443da4d21 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:07.952469 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5521be-1169-4ab6-91d2-81a443da4d21 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:07.952756 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5521be-1169-4ab6-91d2-81a443da4d21 None admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:07.953509 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5521be-1169-4ab6-91d2-81a443da4d21 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:49:07.953821 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5521be-1169-4ab6-91d2-81a443da4d21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:07.955378 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5521be-1169-4ab6-91d2-81a443da4d21 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:07.963413 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 25/50] 10.222.0.52 () {56 vars in 1099 bytes} [Sat May 14 20:49:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:07.969041 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316eec50-da26-438c-90c8-946873a5a4e8 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:08.066107 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316eec50-da26-438c-90c8-946873a5a4e8 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:08.098707 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d439bc9a-7aa6-4dbf-ae94-3c73e31b70fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:08.100543 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439bc9a-7aa6-4dbf-ae94-3c73e31b70fa None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:08.100761 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439bc9a-7aa6-4dbf-ae94-3c73e31b70fa None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:08.101042 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439bc9a-7aa6-4dbf-ae94-3c73e31b70fa None admin] PATH_INFO: `/v3/users/9e6b0e25d0144f868beb29eb9540ea7e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:08.102489 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d439bc9a-7aa6-4dbf-ae94-3c73e31b70fa None admin] RBAC: Authorizing `identity:get_user(user_id=9e6b0e25d0144f868beb29eb9540ea7e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:08.103982 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d439bc9a-7aa6-4dbf-ae94-3c73e31b70fa None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:08.105675 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 26/51] 10.222.0.52 () {56 vars in 1177 bytes} [Sat May 14 20:49:07 2022] GET /identity/v3/users/9e6b0e25d0144f868beb29eb9540ea7e => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:08.111057 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5521be-1169-4ab6-91d2-81a443da4d21 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:08.208514 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5521be-1169-4ab6-91d2-81a443da4d21 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:08.242307 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6f5eab-2ee8-4974-955c-b5c6cf28fc21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:08.243102 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f5eab-2ee8-4974-955c-b5c6cf28fc21 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:08.243387 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f5eab-2ee8-4974-955c-b5c6cf28fc21 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:08.243695 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f5eab-2ee8-4974-955c-b5c6cf28fc21 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:08.244866 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6f5eab-2ee8-4974-955c-b5c6cf28fc21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:08.246654 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6f5eab-2ee8-4974-955c-b5c6cf28fc21 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:08.248513 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 26/52] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:49:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:08.253992 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d439bc9a-7aa6-4dbf-ae94-3c73e31b70fa None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:08.351238 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d439bc9a-7aa6-4dbf-ae94-3c73e31b70fa None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:08.384441 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e7bb75-52ca-4e4d-a4ee-13574d00f5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:08.385115 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e7bb75-52ca-4e4d-a4ee-13574d00f5f9 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:08.385408 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e7bb75-52ca-4e4d-a4ee-13574d00f5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:08.385685 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e7bb75-52ca-4e4d-a4ee-13574d00f5f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:08.386526 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e7bb75-52ca-4e4d-a4ee-13574d00f5f9 None admin] RBAC: Adding query filter params (role.id=24c463e2b4d44dd28cd2723a69a8ed2e, scope.domain.id=default, user.id=9e6b0e25d0144f868beb29eb9540ea7e) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:49:08.386840 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e7bb75-52ca-4e4d-a4ee-13574d00f5f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:08.388358 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e7bb75-52ca-4e4d-a4ee-13574d00f5f9 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:08.399538 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 27/53] 10.222.0.52 () {56 vars in 1322 bytes} [Sat May 14 20:49:08 2022] GET /identity/v3/role_assignments?user.id=9e6b0e25d0144f868beb29eb9540ea7e&scope.domain.id=default&role.id=24c463e2b4d44dd28cd2723a69a8ed2e => generated 530 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:08.600920 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af42ff85-6771-42db-b2e3-6f30c6946a02 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:08.601493 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af42ff85-6771-42db-b2e3-6f30c6946a02 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:08.601493 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af42ff85-6771-42db-b2e3-6f30c6946a02 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:08.602818 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 27/54] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:49:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:49:08.608395 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d55007-0385-48c9-ad2f-8a3775866c90 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:08.608816 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d55007-0385-48c9-ad2f-8a3775866c90 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:08.608995 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d55007-0385-48c9-ad2f-8a3775866c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:08.625937 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-34d55007-0385-48c9-ad2f-8a3775866c90 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:49:08.627110 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-34d55007-0385-48c9-ad2f-8a3775866c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:49:08.690833 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 28/55] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:49:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 20:49:08.716212 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af42ff85-6771-42db-b2e3-6f30c6946a02 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:08.814321 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af42ff85-6771-42db-b2e3-6f30c6946a02 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:08.846568 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300a978e-7bd7-4816-a70b-2f60ccf8ae8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:08.847347 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a978e-7bd7-4816-a70b-2f60ccf8ae8b None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:08.847666 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a978e-7bd7-4816-a70b-2f60ccf8ae8b None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:08.847948 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a978e-7bd7-4816-a70b-2f60ccf8ae8b None admin] PATH_INFO: `/v3/domains/default` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:08.849120 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300a978e-7bd7-4816-a70b-2f60ccf8ae8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:08.850612 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300a978e-7bd7-4816-a70b-2f60ccf8ae8b None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:08.852293 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 28/56] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:49:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:08.857843 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d55007-0385-48c9-ad2f-8a3775866c90 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:08.952042 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d55007-0385-48c9-ad2f-8a3775866c90 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:08.984534 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df36352c-8418-42f3-8630-b247ab9421a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:08.985188 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36352c-8418-42f3-8630-b247ab9421a4 None admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:08.985479 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36352c-8418-42f3-8630-b247ab9421a4 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:08.985761 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36352c-8418-42f3-8630-b247ab9421a4 None admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:08.986474 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df36352c-8418-42f3-8630-b247ab9421a4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:08.987970 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df36352c-8418-42f3-8630-b247ab9421a4 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:09.070097 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 29/57] 10.222.0.52 () {60 vars in 1140 bytes} [Sat May 14 20:49:08 2022] POST /identity/v3/projects => generated 298 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 20:49:11.416944 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a07e6f-208a-4ba9-a2d1-3fecd12bdf26 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:11.417450 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a07e6f-208a-4ba9-a2d1-3fecd12bdf26 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:11.417450 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a07e6f-208a-4ba9-a2d1-3fecd12bdf26 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:11.418769 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 29/58] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:49:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:49:11.423855 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e187ac-a61a-4a53-bdae-ed93281c5dc0 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:11.424261 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e187ac-a61a-4a53-bdae-ed93281c5dc0 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:11.424411 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e187ac-a61a-4a53-bdae-ed93281c5dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:11.442020 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-67e187ac-a61a-4a53-bdae-ed93281c5dc0 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:49:11.443863 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-67e187ac-a61a-4a53-bdae-ed93281c5dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:49:11.506410 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 30/59] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:49:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 20:49:11.531165 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a07e6f-208a-4ba9-a2d1-3fecd12bdf26 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:11.628328 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a07e6f-208a-4ba9-a2d1-3fecd12bdf26 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:11.660686 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce909f-c122-46c9-9c98-2ac56f7d4c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:11.661493 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce909f-c122-46c9-9c98-2ac56f7d4c0c None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:11.661784 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce909f-c122-46c9-9c98-2ac56f7d4c0c None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:11.662063 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce909f-c122-46c9-9c98-2ac56f7d4c0c None admin] PATH_INFO: `/v3/domains/default` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:11.663241 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cce909f-c122-46c9-9c98-2ac56f7d4c0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:11.664711 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cce909f-c122-46c9-9c98-2ac56f7d4c0c None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:11.666311 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 30/60] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:49:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:11.671720 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e187ac-a61a-4a53-bdae-ed93281c5dc0 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:11.764382 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e187ac-a61a-4a53-bdae-ed93281c5dc0 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:11.796160 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b7c429-6328-48a4-b272-0bba8c690dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:11.796816 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b7c429-6328-48a4-b272-0bba8c690dad None admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:11.797103 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b7c429-6328-48a4-b272-0bba8c690dad None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:11.797378 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b7c429-6328-48a4-b272-0bba8c690dad None admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:11.798073 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b7c429-6328-48a4-b272-0bba8c690dad None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:11.799532 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b7c429-6328-48a4-b272-0bba8c690dad None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:11.897779 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 31/61] 10.222.0.52 () {60 vars in 1132 bytes} [Sat May 14 20:49:11 2022] POST /identity/v3/users => generated 275 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 20:49:15.752023 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d67025-69d2-4c45-95cf-33f92184d2fb None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:15.752888 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d67025-69d2-4c45-95cf-33f92184d2fb None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:15.753307 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d67025-69d2-4c45-95cf-33f92184d2fb None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:15.754810 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 31/62] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:49:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:49:15.761093 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fcac9b-1358-42b0-a06a-cf2170c53408 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:15.762006 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fcac9b-1358-42b0-a06a-cf2170c53408 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:15.762494 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fcac9b-1358-42b0-a06a-cf2170c53408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:15.771390 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e95ce5-647a-48fe-8409-fa854547c56b None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:15.772064 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e95ce5-647a-48fe-8409-fa854547c56b None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:15.772549 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e95ce5-647a-48fe-8409-fa854547c56b None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:15.774528 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 32/63] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:49:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:49:15.783634 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-c3fcac9b-1358-42b0-a06a-cf2170c53408 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:49:15.784852 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c3fcac9b-1358-42b0-a06a-cf2170c53408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:49:15.793053 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e10f5-1944-41c8-92d5-97743b4c7db1 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:15.793662 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e10f5-1944-41c8-92d5-97743b4c7db1 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:15.794173 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e10f5-1944-41c8-92d5-97743b4c7db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:15.814625 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-aa9e10f5-1944-41c8-92d5-97743b4c7db1 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:49:15.816187 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-aa9e10f5-1944-41c8-92d5-97743b4c7db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:49:15.877176 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 32/64] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:49:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 20:49:15.878788 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f235b32-e98e-4a15-ab54-037e7c08c134 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:15.879086 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f235b32-e98e-4a15-ab54-037e7c08c134 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:15.879553 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f235b32-e98e-4a15-ab54-037e7c08c134 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:15.882904 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 33/65] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:49:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:49:15.889941 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f364a-f6bf-401e-a464-85a49d778334 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:15.890465 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f364a-f6bf-401e-a464-85a49d778334 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:15.891085 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f364a-f6bf-401e-a464-85a49d778334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:15.900676 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 33/66] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:49:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 14 20:49:15.903272 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9e10f5-1944-41c8-92d5-97743b4c7db1 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:15.919727 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-379f364a-f6bf-401e-a464-85a49d778334 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:49:15.921216 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-379f364a-f6bf-401e-a464-85a49d778334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:49:16.001702 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 34/67] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:49:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 20:49:16.002921 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379f364a-f6bf-401e-a464-85a49d778334 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:16.048729 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9e10f5-1944-41c8-92d5-97743b4c7db1 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:16.092241 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9077da0c-a7c3-45c6-840f-18fd57c94015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:16.093324 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9077da0c-a7c3-45c6-840f-18fd57c94015 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:16.093773 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9077da0c-a7c3-45c6-840f-18fd57c94015 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:16.094195 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9077da0c-a7c3-45c6-840f-18fd57c94015 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:16.106304 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9077da0c-a7c3-45c6-840f-18fd57c94015 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:49:16.107088 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379f364a-f6bf-401e-a464-85a49d778334 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:16.115755 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-9077da0c-a7c3-45c6-840f-18fd57c94015 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 14 20:49:16.115755 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:49:16.115755 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:49:16.115755 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:49:16.115755 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:49:16.115755 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:49:16.115755 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:49:16.115755 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:49:16.115755 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:49:16.115755 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:49:16.115755 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:49:16.115755 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:49:16.115755 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:49:16.115755 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:49:16.115755 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:49:16.115755 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:49:16.116640 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:49:16.116640 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:49:16.116640 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:49:16.116640 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:49:16.116640 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:49:16.116640 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:49:16.116640 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:49:16.116640 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:49:16.116640 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:49:16.116640 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:49:16.116640 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:49:16.116640 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:49:16.116640 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:49:16.116640 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:49:16.116640 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:49:16.116640 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:49:16.117391 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:49:16.117391 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:49:16.117391 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:49:16.117391 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:49:16.117391 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:49:16.117391 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:49:16.117391 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:49:16.117391 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:49:16.117391 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:49:16.117391 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:49:16.117391 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 14 20:49:16.117391 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:49:16.117956 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 34/68] 10.222.0.52 () {56 vars in 1099 bytes} [Sat May 14 20:49:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:49:16.118620 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9077da0c-a7c3-45c6-840f-18fd57c94015 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:16.152666 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a0c432-9f3c-4b92-8a3b-8d26e657738e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:16.153555 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a0c432-9f3c-4b92-8a3b-8d26e657738e None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:16.153848 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a0c432-9f3c-4b92-8a3b-8d26e657738e None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:16.154123 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a0c432-9f3c-4b92-8a3b-8d26e657738e None admin] PATH_INFO: `/v3/roles/member` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:16.164347 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a0c432-9f3c-4b92-8a3b-8d26e657738e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:49:16.172042 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-c7a0c432-9f3c-4b92-8a3b-8d26e657738e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 14 20:49:16.172042 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:49:16.172042 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:49:16.172042 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:49:16.172042 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:49:16.172042 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:49:16.172042 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:49:16.172042 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:49:16.172042 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:49:16.172042 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:49:16.172042 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:49:16.172042 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:49:16.172042 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:49:16.172042 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:49:16.172042 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:49:16.172042 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:49:16.172885 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:49:16.172885 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:49:16.172885 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:49:16.172885 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:49:16.172885 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:49:16.172885 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:49:16.172885 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:49:16.172885 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:49:16.172885 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:49:16.172885 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:49:16.172885 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:49:16.172885 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:49:16.172885 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:49:16.172885 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:49:16.172885 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:49:16.172885 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:49:16.173630 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:49:16.173630 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:49:16.173630 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:49:16.173630 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:49:16.173630 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:49:16.173630 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:49:16.173630 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:49:16.173630 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:49:16.173630 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:49:16.173630 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:49:16.173630 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 14 20:49:16.173630 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:49:16.173630 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 35/69] 10.222.0.52 () {56 vars in 1099 bytes} [Sat May 14 20:49:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:49:16.174796 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c80e97-78c4-4905-be8e-754d735cef91 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:16.174796 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c80e97-78c4-4905-be8e-754d735cef91 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:16.175027 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c80e97-78c4-4905-be8e-754d735cef91 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:16.176464 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 36/70] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:49:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:49:16.178220 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c80e97-78c4-4905-be8e-754d735cef91 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:16.234118 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9077da0c-a7c3-45c6-840f-18fd57c94015 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:16.267834 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21287a01-e9bd-447a-82f1-91afebc99276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:16.268557 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21287a01-e9bd-447a-82f1-91afebc99276 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:16.268849 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21287a01-e9bd-447a-82f1-91afebc99276 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:16.269132 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21287a01-e9bd-447a-82f1-91afebc99276 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:16.279107 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c80e97-78c4-4905-be8e-754d735cef91 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:16.280881 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21287a01-e9bd-447a-82f1-91afebc99276 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:49:16.288706 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-21287a01-e9bd-447a-82f1-91afebc99276 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 14 20:49:16.288706 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:49:16.288706 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:49:16.288706 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:49:16.288706 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:49:16.288706 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:49:16.288706 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:49:16.288706 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:49:16.288706 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:49:16.288706 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:49:16.288706 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:49:16.288706 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:49:16.288706 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:49:16.288706 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:49:16.288706 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:49:16.288706 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:49:16.289571 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:49:16.289571 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:49:16.289571 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:49:16.289571 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:49:16.289571 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:49:16.289571 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:49:16.289571 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:49:16.289571 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:49:16.289571 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:49:16.289571 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:49:16.289571 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:49:16.289571 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:49:16.289571 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:49:16.289571 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:49:16.289571 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:49:16.289571 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:49:16.290304 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:49:16.290304 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:49:16.290304 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:49:16.290304 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:49:16.290304 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:49:16.290304 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:49:16.290304 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:49:16.290304 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:49:16.290304 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:49:16.290304 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:49:16.290304 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 14 20:49:16.290304 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:49:16.290304 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 35/71] 10.222.0.52 () {56 vars in 1096 bytes} [Sat May 14 20:49:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:49:16.290914 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21287a01-e9bd-447a-82f1-91afebc99276 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:16.316542 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37391839-b75f-41e2-9a7a-aa2119230987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:16.317548 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37391839-b75f-41e2-9a7a-aa2119230987 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:16.319101 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37391839-b75f-41e2-9a7a-aa2119230987 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:16.319672 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37391839-b75f-41e2-9a7a-aa2119230987 None admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:16.320456 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37391839-b75f-41e2-9a7a-aa2119230987 None admin] RBAC: Adding query filter params (name=member) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:49:16.320912 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37391839-b75f-41e2-9a7a-aa2119230987 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:16.322516 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37391839-b75f-41e2-9a7a-aa2119230987 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:16.332103 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 37/72] 10.222.0.52 () {56 vars in 1101 bytes} [Sat May 14 20:49:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:16.334915 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896488b1-b335-40f2-8b1e-6fc6903e9244 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:16.335227 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896488b1-b335-40f2-8b1e-6fc6903e9244 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:16.335511 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896488b1-b335-40f2-8b1e-6fc6903e9244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:16.352727 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-896488b1-b335-40f2-8b1e-6fc6903e9244 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:49:16.354001 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-896488b1-b335-40f2-8b1e-6fc6903e9244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:49:16.406221 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21287a01-e9bd-447a-82f1-91afebc99276 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:16.420661 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 38/73] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:49:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 20:49:16.422363 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896488b1-b335-40f2-8b1e-6fc6903e9244 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:16.454987 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8eda70-b3ca-48c0-88a8-b147d51ea67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:16.455692 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8eda70-b3ca-48c0-88a8-b147d51ea67c None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:16.455983 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8eda70-b3ca-48c0-88a8-b147d51ea67c None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:16.456267 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8eda70-b3ca-48c0-88a8-b147d51ea67c None admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:16.457022 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8eda70-b3ca-48c0-88a8-b147d51ea67c None admin] RBAC: Adding query filter params (name=member) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:49:16.457355 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8eda70-b3ca-48c0-88a8-b147d51ea67c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:16.458781 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8eda70-b3ca-48c0-88a8-b147d51ea67c None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:16.467581 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 36/74] 10.222.0.52 () {56 vars in 1101 bytes} [Sat May 14 20:49:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:16.468410 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8eda70-b3ca-48c0-88a8-b147d51ea67c None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:16.527386 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896488b1-b335-40f2-8b1e-6fc6903e9244 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:16.559908 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55e4004-0285-4224-a0b9-af10eeb27df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:16.560570 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e4004-0285-4224-a0b9-af10eeb27df0 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:16.560858 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e4004-0285-4224-a0b9-af10eeb27df0 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:16.561138 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e4004-0285-4224-a0b9-af10eeb27df0 None admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:16.561879 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55e4004-0285-4224-a0b9-af10eeb27df0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:49:16.562190 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55e4004-0285-4224-a0b9-af10eeb27df0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:16.563584 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55e4004-0285-4224-a0b9-af10eeb27df0 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:16.568406 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8eda70-b3ca-48c0-88a8-b147d51ea67c None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:16.571657 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 39/75] 10.222.0.52 () {56 vars in 1099 bytes} [Sat May 14 20:49:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:16.572452 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55e4004-0285-4224-a0b9-af10eeb27df0 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:16.601880 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e285ac-8dbc-4030-a8b5-9bdfcc873074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:16.602742 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e285ac-8dbc-4030-a8b5-9bdfcc873074 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:16.603026 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e285ac-8dbc-4030-a8b5-9bdfcc873074 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:16.603302 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e285ac-8dbc-4030-a8b5-9bdfcc873074 None admin] PATH_INFO: `/v3/users/1f1ad598c0eb49f9a6bda831fba1c4e6` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:16.616024 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e285ac-8dbc-4030-a8b5-9bdfcc873074 None admin] RBAC: Authorizing `identity:get_user(user_id=1f1ad598c0eb49f9a6bda831fba1c4e6)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:16.617475 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e285ac-8dbc-4030-a8b5-9bdfcc873074 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:16.619129 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 37/76] 10.222.0.52 () {56 vars in 1177 bytes} [Sat May 14 20:49:16 2022] GET /identity/v3/users/1f1ad598c0eb49f9a6bda831fba1c4e6 => generated 275 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:16.619912 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e285ac-8dbc-4030-a8b5-9bdfcc873074 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:16.673196 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55e4004-0285-4224-a0b9-af10eeb27df0 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:16.704748 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126a2967-112c-4dc5-a2f9-694074fa94a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:16.705555 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a2967-112c-4dc5-a2f9-694074fa94a2 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:16.705839 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a2967-112c-4dc5-a2f9-694074fa94a2 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:16.706121 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a2967-112c-4dc5-a2f9-694074fa94a2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:16.714734 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e285ac-8dbc-4030-a8b5-9bdfcc873074 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:16.716489 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126a2967-112c-4dc5-a2f9-694074fa94a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:49:16.724637 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-126a2967-112c-4dc5-a2f9-694074fa94a2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 14 20:49:16.724637 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:49:16.724637 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:49:16.724637 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:49:16.724637 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:49:16.724637 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:49:16.724637 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:49:16.724637 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:49:16.724637 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:49:16.724637 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:49:16.724637 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:49:16.724637 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:49:16.724637 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:49:16.724637 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:49:16.724637 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:49:16.724637 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:49:16.731542 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:49:16.731542 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:49:16.731542 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:49:16.731542 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:49:16.731542 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:49:16.731542 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:49:16.731542 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:49:16.731542 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:49:16.731542 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:49:16.731542 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:49:16.731542 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:49:16.731542 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:49:16.731542 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:49:16.731542 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:49:16.731542 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:49:16.731542 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:49:16.732491 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:49:16.732491 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:49:16.732491 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:49:16.732491 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:49:16.732491 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:49:16.732491 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:49:16.732491 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:49:16.732491 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:49:16.732491 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:49:16.732491 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:49:16.732491 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 14 20:49:16.732491 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:49:16.732491 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 40/77] 10.222.0.52 () {56 vars in 1114 bytes} [Sat May 14 20:49:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:49:16.732491 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b81a0-c8f2-403a-8fe6-7399fd668f41 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:16.733246 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b81a0-c8f2-403a-8fe6-7399fd668f41 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:16.733246 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b81a0-c8f2-403a-8fe6-7399fd668f41 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:16.733246 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 41/78] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:49:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:49:16.733246 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49b81a0-c8f2-403a-8fe6-7399fd668f41 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:16.752303 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a11b1f-c139-424c-aed6-03fc09d0e02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:16.753176 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a11b1f-c139-424c-aed6-03fc09d0e02a None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:16.753463 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a11b1f-c139-424c-aed6-03fc09d0e02a None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:16.753752 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a11b1f-c139-424c-aed6-03fc09d0e02a None admin] PATH_INFO: `/v3/users/1f1ad598c0eb49f9a6bda831fba1c4e6` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:16.755060 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a11b1f-c139-424c-aed6-03fc09d0e02a None admin] RBAC: Authorizing `identity:get_user(user_id=1f1ad598c0eb49f9a6bda831fba1c4e6)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:16.756640 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a11b1f-c139-424c-aed6-03fc09d0e02a None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:16.758276 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 38/79] 10.222.0.52 () {56 vars in 1177 bytes} [Sat May 14 20:49:16 2022] GET /identity/v3/users/1f1ad598c0eb49f9a6bda831fba1c4e6 => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:16.759043 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a11b1f-c139-424c-aed6-03fc09d0e02a None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:16.832144 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49b81a0-c8f2-403a-8fe6-7399fd668f41 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:16.855390 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a11b1f-c139-424c-aed6-03fc09d0e02a None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:16.866058 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c8883-2e0a-4fd7-b734-d2fb8347c4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:16.867070 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c8883-2e0a-4fd7-b734-d2fb8347c4f0 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:16.867354 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c8883-2e0a-4fd7-b734-d2fb8347c4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:16.867667 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c8883-2e0a-4fd7-b734-d2fb8347c4f0 None admin] PATH_INFO: `/v3/users/9e6b0e25d0144f868beb29eb9540ea7e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:16.868931 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4c8883-2e0a-4fd7-b734-d2fb8347c4f0 None admin] RBAC: Authorizing `identity:get_user(user_id=9e6b0e25d0144f868beb29eb9540ea7e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:16.870391 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4c8883-2e0a-4fd7-b734-d2fb8347c4f0 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:16.872309 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 42/80] 10.222.0.52 () {56 vars in 1177 bytes} [Sat May 14 20:49:16 2022] GET /identity/v3/users/9e6b0e25d0144f868beb29eb9540ea7e => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:16.873069 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c8883-2e0a-4fd7-b734-d2fb8347c4f0 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:16.889525 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8996fae-ab9a-4ad9-a353-42fd4a081a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:16.890357 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8996fae-ab9a-4ad9-a353-42fd4a081a54 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:16.890649 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8996fae-ab9a-4ad9-a353-42fd4a081a54 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:16.890931 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8996fae-ab9a-4ad9-a353-42fd4a081a54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:16.957921 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8996fae-ab9a-4ad9-a353-42fd4a081a54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:16.959687 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8996fae-ab9a-4ad9-a353-42fd4a081a54 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:16.969083 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c8883-2e0a-4fd7-b734-d2fb8347c4f0 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:17.002646 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca515d9-b53b-4f79-89a5-c65934e8d266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:17.003310 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca515d9-b53b-4f79-89a5-c65934e8d266 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:17.003634 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca515d9-b53b-4f79-89a5-c65934e8d266 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:17.003917 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca515d9-b53b-4f79-89a5-c65934e8d266 None admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:17.004683 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca515d9-b53b-4f79-89a5-c65934e8d266 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:49:17.004996 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca515d9-b53b-4f79-89a5-c65934e8d266 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:17.007236 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca515d9-b53b-4f79-89a5-c65934e8d266 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:17.015003 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 43/81] 10.222.0.52 () {56 vars in 1111 bytes} [Sat May 14 20:49:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:17.016204 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda4bfa-8463-4b44-86b9-2794440fa9dd None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:17.016494 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda4bfa-8463-4b44-86b9-2794440fa9dd None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:17.016774 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda4bfa-8463-4b44-86b9-2794440fa9dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:17.032323 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-8fda4bfa-8463-4b44-86b9-2794440fa9dd None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:49:17.033508 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-8fda4bfa-8463-4b44-86b9-2794440fa9dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:49:17.058681 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 39/82] 10.222.0.52 () {58 vars in 1282 bytes} [Sat May 14 20:49:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 14 20:49:17.059551 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8996fae-ab9a-4ad9-a353-42fd4a081a54 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:17.099626 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 44/83] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:49:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 20:49:17.100682 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda4bfa-8463-4b44-86b9-2794440fa9dd None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:17.155406 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8996fae-ab9a-4ad9-a353-42fd4a081a54 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:17.187739 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea8e03d-e024-4f6c-9858-d75ee74bd6e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:17.188381 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea8e03d-e024-4f6c-9858-d75ee74bd6e9 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:17.188666 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea8e03d-e024-4f6c-9858-d75ee74bd6e9 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:17.188944 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea8e03d-e024-4f6c-9858-d75ee74bd6e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:17.195165 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda4bfa-8463-4b44-86b9-2794440fa9dd None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:17.227630 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e9bba1-67fe-499a-bbc0-5542a580cf5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:17.228277 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9bba1-67fe-499a-bbc0-5542a580cf5f None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:17.228566 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9bba1-67fe-499a-bbc0-5542a580cf5f None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:17.228848 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9bba1-67fe-499a-bbc0-5542a580cf5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:17.253452 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea8e03d-e024-4f6c-9858-d75ee74bd6e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:17.254935 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea8e03d-e024-4f6c-9858-d75ee74bd6e9 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:17.292918 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e9bba1-67fe-499a-bbc0-5542a580cf5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:17.294397 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e9bba1-67fe-499a-bbc0-5542a580cf5f None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:17.347394 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 40/84] 10.222.0.52 () {58 vars in 1282 bytes} [Sat May 14 20:49:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 14 20:49:17.348053 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea8e03d-e024-4f6c-9858-d75ee74bd6e9 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:17.393600 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 45/85] 10.222.0.52 () {58 vars in 1282 bytes} [Sat May 14 20:49:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 14 20:49:17.394209 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e9bba1-67fe-499a-bbc0-5542a580cf5f None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:17.441461 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea8e03d-e024-4f6c-9858-d75ee74bd6e9 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:17.473233 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ce366b-cbc4-440f-a294-7d161832818e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:17.474672 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ce366b-cbc4-440f-a294-7d161832818e None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:17.474960 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ce366b-cbc4-440f-a294-7d161832818e None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:17.475234 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ce366b-cbc4-440f-a294-7d161832818e None admin] PATH_INFO: `/v3/users/1f1ad598c0eb49f9a6bda831fba1c4e6` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:17.476449 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ce366b-cbc4-440f-a294-7d161832818e None admin] RBAC: Authorizing `identity:get_user(user_id=1f1ad598c0eb49f9a6bda831fba1c4e6)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:17.477903 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ce366b-cbc4-440f-a294-7d161832818e None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:17.479549 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 41/86] 10.222.0.52 () {56 vars in 1177 bytes} [Sat May 14 20:49:17 2022] GET /identity/v3/users/1f1ad598c0eb49f9a6bda831fba1c4e6 => generated 275 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:17.480304 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ce366b-cbc4-440f-a294-7d161832818e None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:17.491004 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e9bba1-67fe-499a-bbc0-5542a580cf5f None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:17.523822 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ba140-dfc4-4365-8247-ca2cb55cfc2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:17.524736 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ba140-dfc4-4365-8247-ca2cb55cfc2c None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:17.525042 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ba140-dfc4-4365-8247-ca2cb55cfc2c None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:17.525318 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ba140-dfc4-4365-8247-ca2cb55cfc2c None admin] PATH_INFO: `/v3/projects/c377a7cb474f47c8861e1c13e61ee22d` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:17.526520 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36ba140-dfc4-4365-8247-ca2cb55cfc2c None admin] RBAC: Authorizing `identity:get_project(project_id=c377a7cb474f47c8861e1c13e61ee22d)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:17.528009 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36ba140-dfc4-4365-8247-ca2cb55cfc2c None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:17.529693 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 46/87] 10.222.0.52 () {56 vars in 1186 bytes} [Sat May 14 20:49:17 2022] GET /identity/v3/projects/c377a7cb474f47c8861e1c13e61ee22d => generated 298 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:17.530451 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ba140-dfc4-4365-8247-ca2cb55cfc2c None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:17.573881 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ce366b-cbc4-440f-a294-7d161832818e None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:17.606113 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a76bb-7660-40f5-90a2-8317daea68ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:17.606886 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a76bb-7660-40f5-90a2-8317daea68ea None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:17.607169 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a76bb-7660-40f5-90a2-8317daea68ea None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:17.607447 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a76bb-7660-40f5-90a2-8317daea68ea None admin] PATH_INFO: `/v3/domains/default` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:17.608645 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298a76bb-7660-40f5-90a2-8317daea68ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:17.610082 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298a76bb-7660-40f5-90a2-8317daea68ea None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:17.611717 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 42/88] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:49:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:17.612467 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a76bb-7660-40f5-90a2-8317daea68ea None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:17.624698 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ba140-dfc4-4365-8247-ca2cb55cfc2c None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:17.657336 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2b0524-948e-4dcb-8edd-2e312ea2e98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:17.658127 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b0524-948e-4dcb-8edd-2e312ea2e98f None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:17.658415 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b0524-948e-4dcb-8edd-2e312ea2e98f None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:17.658693 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b0524-948e-4dcb-8edd-2e312ea2e98f None admin] PATH_INFO: `/v3/projects/f9f026156997408398ed32333f3c1d43` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:17.659909 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2b0524-948e-4dcb-8edd-2e312ea2e98f None admin] RBAC: Authorizing `identity:get_project(project_id=f9f026156997408398ed32333f3c1d43)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:17.661358 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2b0524-948e-4dcb-8edd-2e312ea2e98f None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:17.663635 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 47/89] 10.222.0.52 () {56 vars in 1186 bytes} [Sat May 14 20:49:17 2022] GET /identity/v3/projects/f9f026156997408398ed32333f3c1d43 => generated 312 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:17.664401 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2b0524-948e-4dcb-8edd-2e312ea2e98f None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:17.708212 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a76bb-7660-40f5-90a2-8317daea68ea None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:17.740010 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bdd558-10e6-4da0-8362-b4323c63c2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:17.740986 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bdd558-10e6-4da0-8362-b4323c63c2b2 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:17.741275 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bdd558-10e6-4da0-8362-b4323c63c2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:17.741553 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bdd558-10e6-4da0-8362-b4323c63c2b2 None admin] PATH_INFO: `/v3/projects/c377a7cb474f47c8861e1c13e61ee22d` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:17.742734 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bdd558-10e6-4da0-8362-b4323c63c2b2 None admin] RBAC: Authorizing `identity:get_project(project_id=c377a7cb474f47c8861e1c13e61ee22d)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:17.744224 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bdd558-10e6-4da0-8362-b4323c63c2b2 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:17.746154 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 43/90] 10.222.0.52 () {56 vars in 1186 bytes} [Sat May 14 20:49:17 2022] GET /identity/v3/projects/c377a7cb474f47c8861e1c13e61ee22d => generated 298 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:17.746923 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bdd558-10e6-4da0-8362-b4323c63c2b2 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:17.758487 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2b0524-948e-4dcb-8edd-2e312ea2e98f None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:17.791264 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11620e91-6f4b-498f-8d82-92ed417320e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:17.792052 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11620e91-6f4b-498f-8d82-92ed417320e1 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:17.792340 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11620e91-6f4b-498f-8d82-92ed417320e1 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:17.792618 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11620e91-6f4b-498f-8d82-92ed417320e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:17.841206 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bdd558-10e6-4da0-8362-b4323c63c2b2 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:17.856876 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11620e91-6f4b-498f-8d82-92ed417320e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:17.858348 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11620e91-6f4b-498f-8d82-92ed417320e1 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:17.873966 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3353da64-f0b7-4d23-a29f-66bb55a7f80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:17.874622 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3353da64-f0b7-4d23-a29f-66bb55a7f80c None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:17.874910 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3353da64-f0b7-4d23-a29f-66bb55a7f80c None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:17.875191 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3353da64-f0b7-4d23-a29f-66bb55a7f80c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:17.876052 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3353da64-f0b7-4d23-a29f-66bb55a7f80c None admin] RBAC: Adding query filter params (role.id=4f4cbb0efdc1410294a05a7ba44f9320, scope.project.id=c377a7cb474f47c8861e1c13e61ee22d, user.id=1f1ad598c0eb49f9a6bda831fba1c4e6) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:49:17.876368 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3353da64-f0b7-4d23-a29f-66bb55a7f80c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:17.877809 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3353da64-f0b7-4d23-a29f-66bb55a7f80c None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:17.883946 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 44/91] 10.222.0.52 () {56 vars in 1374 bytes} [Sat May 14 20:49:17 2022] GET /identity/v3/role_assignments?user.id=1f1ad598c0eb49f9a6bda831fba1c4e6&scope.project.id=c377a7cb474f47c8861e1c13e61ee22d&role.id=4f4cbb0efdc1410294a05a7ba44f9320 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:17.884707 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3353da64-f0b7-4d23-a29f-66bb55a7f80c None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:17.970065 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 48/92] 10.222.0.52 () {58 vars in 1282 bytes} [Sat May 14 20:49:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 14 20:49:17.970065 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11620e91-6f4b-498f-8d82-92ed417320e1 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:18.016422 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3353da64-f0b7-4d23-a29f-66bb55a7f80c None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:18.051968 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bdd655-8e10-4f07-ac10-f71b66da32ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:18.053207 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bdd655-8e10-4f07-ac10-f71b66da32ff None admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:18.053486 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bdd655-8e10-4f07-ac10-f71b66da32ff None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:18.053760 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bdd655-8e10-4f07-ac10-f71b66da32ff None admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:18.054490 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bdd655-8e10-4f07-ac10-f71b66da32ff None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:18.056001 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bdd655-8e10-4f07-ac10-f71b66da32ff None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:18.070827 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11620e91-6f4b-498f-8d82-92ed417320e1 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:18.104445 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a35fc26-5ac3-47cb-8d6a-7f951074ddbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:18.105113 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a35fc26-5ac3-47cb-8d6a-7f951074ddbe None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:18.105400 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a35fc26-5ac3-47cb-8d6a-7f951074ddbe None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:18.105678 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a35fc26-5ac3-47cb-8d6a-7f951074ddbe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:18.106499 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a35fc26-5ac3-47cb-8d6a-7f951074ddbe None admin] RBAC: Adding query filter params (role.id=4f4cbb0efdc1410294a05a7ba44f9320, scope.project.id=f9f026156997408398ed32333f3c1d43, user.id=1f1ad598c0eb49f9a6bda831fba1c4e6) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:49:18.106871 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a35fc26-5ac3-47cb-8d6a-7f951074ddbe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:18.108342 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a35fc26-5ac3-47cb-8d6a-7f951074ddbe None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:18.113763 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 49/93] 10.222.0.52 () {56 vars in 1374 bytes} [Sat May 14 20:49:17 2022] GET /identity/v3/role_assignments?user.id=1f1ad598c0eb49f9a6bda831fba1c4e6&scope.project.id=f9f026156997408398ed32333f3c1d43&role.id=4f4cbb0efdc1410294a05a7ba44f9320 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:18.115105 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a35fc26-5ac3-47cb-8d6a-7f951074ddbe None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:18.145651 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 45/94] 10.222.0.52 () {60 vars in 1132 bytes} [Sat May 14 20:49:17 2022] POST /identity/v3/users => generated 289 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 20:49:18.147179 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bdd655-8e10-4f07-ac10-f71b66da32ff None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:18.236417 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a35fc26-5ac3-47cb-8d6a-7f951074ddbe None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:18.263198 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bdd655-8e10-4f07-ac10-f71b66da32ff None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:18.275306 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed11941-e26f-4c02-9d31-5c84588dc42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:18.276353 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed11941-e26f-4c02-9d31-5c84588dc42e None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:18.276808 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed11941-e26f-4c02-9d31-5c84588dc42e None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:18.278736 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed11941-e26f-4c02-9d31-5c84588dc42e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:18.278736 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed11941-e26f-4c02-9d31-5c84588dc42e None admin] RBAC: Adding query filter params (role.id=24c463e2b4d44dd28cd2723a69a8ed2e, scope.project.id=c377a7cb474f47c8861e1c13e61ee22d, user.id=9e6b0e25d0144f868beb29eb9540ea7e) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:49:18.278736 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed11941-e26f-4c02-9d31-5c84588dc42e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:18.280650 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed11941-e26f-4c02-9d31-5c84588dc42e None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:18.287820 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 50/95] 10.222.0.52 () {56 vars in 1374 bytes} [Sat May 14 20:49:18 2022] GET /identity/v3/role_assignments?user.id=9e6b0e25d0144f868beb29eb9540ea7e&scope.project.id=c377a7cb474f47c8861e1c13e61ee22d&role.id=24c463e2b4d44dd28cd2723a69a8ed2e => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:18.305266 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab78a1d-ee73-4731-8726-70aea0f6e7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:18.316787 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab78a1d-ee73-4731-8726-70aea0f6e7be None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:18.316787 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab78a1d-ee73-4731-8726-70aea0f6e7be None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:18.316787 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab78a1d-ee73-4731-8726-70aea0f6e7be None admin] PATH_INFO: `/v3/projects/c377a7cb474f47c8861e1c13e61ee22d` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:18.316787 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab78a1d-ee73-4731-8726-70aea0f6e7be None admin] RBAC: Authorizing `identity:get_project(project_id=c377a7cb474f47c8861e1c13e61ee22d)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:18.316787 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab78a1d-ee73-4731-8726-70aea0f6e7be None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:18.316787 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 46/96] 10.222.0.52 () {56 vars in 1186 bytes} [Sat May 14 20:49:18 2022] GET /identity/v3/projects/c377a7cb474f47c8861e1c13e61ee22d => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:18.319210 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed11941-e26f-4c02-9d31-5c84588dc42e None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:18.437128 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed11941-e26f-4c02-9d31-5c84588dc42e None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:18.474880 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216bdaa1-740b-4434-bf58-2ba8f4612554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:18.476008 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216bdaa1-740b-4434-bf58-2ba8f4612554 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:18.476521 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216bdaa1-740b-4434-bf58-2ba8f4612554 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:18.477007 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216bdaa1-740b-4434-bf58-2ba8f4612554 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:18.478070 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216bdaa1-740b-4434-bf58-2ba8f4612554 None admin] RBAC: Adding query filter params (role.id=274f900b5153444b84117bc9919443fc, scope.project.id=c377a7cb474f47c8861e1c13e61ee22d, user.id=1f1ad598c0eb49f9a6bda831fba1c4e6) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:49:18.478603 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216bdaa1-740b-4434-bf58-2ba8f4612554 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:18.480357 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216bdaa1-740b-4434-bf58-2ba8f4612554 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:18.494023 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 51/97] 10.222.0.52 () {56 vars in 1374 bytes} [Sat May 14 20:49:18 2022] GET /identity/v3/role_assignments?user.id=1f1ad598c0eb49f9a6bda831fba1c4e6&scope.project.id=c377a7cb474f47c8861e1c13e61ee22d&role.id=274f900b5153444b84117bc9919443fc => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:20.806652 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfcfdda-97b7-4b04-90e3-70122a66c96c None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:20.807745 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfcfdda-97b7-4b04-90e3-70122a66c96c None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:20.808258 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfcfdda-97b7-4b04-90e3-70122a66c96c None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:20.810173 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 47/98] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:49:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:49:20.814984 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3272ad7c-231a-4ab2-871c-78d20204935b None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:20.815897 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3272ad7c-231a-4ab2-871c-78d20204935b None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:20.816404 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3272ad7c-231a-4ab2-871c-78d20204935b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:20.837315 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-3272ad7c-231a-4ab2-871c-78d20204935b None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:49:20.838831 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-3272ad7c-231a-4ab2-871c-78d20204935b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:49:20.930436 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 52/99] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:49:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 20:49:20.978495 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfcfdda-97b7-4b04-90e3-70122a66c96c None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:21.050321 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9668814d-d8b9-47bc-962d-075ecd54e830 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:21.050984 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9668814d-d8b9-47bc-962d-075ecd54e830 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:21.051467 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9668814d-d8b9-47bc-962d-075ecd54e830 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:21.053608 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 53/100] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:49:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 14 20:49:21.064310 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d28e92-5db8-45ae-93ca-f1a5c4bd2f97 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:21.064310 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d28e92-5db8-45ae-93ca-f1a5c4bd2f97 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:21.064310 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d28e92-5db8-45ae-93ca-f1a5c4bd2f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:21.088843 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-f6d28e92-5db8-45ae-93ca-f1a5c4bd2f97 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:49:21.090046 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-f6d28e92-5db8-45ae-93ca-f1a5c4bd2f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:49:21.161227 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfcfdda-97b7-4b04-90e3-70122a66c96c None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:21.257371 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 54/101] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:49:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 14 20:49:21.260019 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b0c05b-5739-4ae3-8919-0bf5b5668b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:21.261053 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0c05b-5739-4ae3-8919-0bf5b5668b37 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:21.261541 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0c05b-5739-4ae3-8919-0bf5b5668b37 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:21.262024 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0c05b-5739-4ae3-8919-0bf5b5668b37 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:21.282119 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b0c05b-5739-4ae3-8919-0bf5b5668b37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:49:21.290697 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-75b0c05b-5739-4ae3-8919-0bf5b5668b37 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 14 20:49:21.290697 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:49:21.290697 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:49:21.290697 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:49:21.290697 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:49:21.290697 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:49:21.290697 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:49:21.290697 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:49:21.290697 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:49:21.290697 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:49:21.290697 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:49:21.290697 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:49:21.290697 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:49:21.290697 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:49:21.290697 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:49:21.290697 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:49:21.291672 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:49:21.291672 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:49:21.291672 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:49:21.291672 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:49:21.291672 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:49:21.291672 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:49:21.291672 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:49:21.291672 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:49:21.291672 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:49:21.291672 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:49:21.291672 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:49:21.291672 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:49:21.291672 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:49:21.291672 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:49:21.291672 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:49:21.291672 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:49:21.292437 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:49:21.292437 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:49:21.292437 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:49:21.292437 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:49:21.292437 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:49:21.292437 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:49:21.292437 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:49:21.292437 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:49:21.292437 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:49:21.292437 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:49:21.292437 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 14 20:49:21.292437 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:49:21.294821 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 48/102] 10.222.0.52 () {56 vars in 1099 bytes} [Sat May 14 20:49:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:49:21.300469 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d28e92-5db8-45ae-93ca-f1a5c4bd2f97 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:21.311134 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b0c05b-5739-4ae3-8919-0bf5b5668b37 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:21.447272 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d28e92-5db8-45ae-93ca-f1a5c4bd2f97 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:21.483321 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f336ced7-56f9-4ae0-a3fd-f0bad5002d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:21.484388 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f336ced7-56f9-4ae0-a3fd-f0bad5002d38 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:21.484885 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f336ced7-56f9-4ae0-a3fd-f0bad5002d38 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:21.485356 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f336ced7-56f9-4ae0-a3fd-f0bad5002d38 None admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:21.486332 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f336ced7-56f9-4ae0-a3fd-f0bad5002d38 None admin] RBAC: Adding query filter params (name=member) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:49:21.486842 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f336ced7-56f9-4ae0-a3fd-f0bad5002d38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:21.489076 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f336ced7-56f9-4ae0-a3fd-f0bad5002d38 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:21.500355 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 55/103] 10.222.0.52 () {56 vars in 1101 bytes} [Sat May 14 20:49:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:21.502062 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc1cac-7846-4fc2-a1dd-8356bc355c54 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:21.502578 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc1cac-7846-4fc2-a1dd-8356bc355c54 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:21.503059 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc1cac-7846-4fc2-a1dd-8356bc355c54 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:21.504532 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 56/104] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:49:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:49:21.513609 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aea302-1540-4521-be06-e4282a05a784 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:21.514271 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aea302-1540-4521-be06-e4282a05a784 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:21.514756 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aea302-1540-4521-be06-e4282a05a784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:21.522400 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b0c05b-5739-4ae3-8919-0bf5b5668b37 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:21.537652 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-f8aea302-1540-4521-be06-e4282a05a784 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:49:21.539357 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-f8aea302-1540-4521-be06-e4282a05a784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:49:21.603846 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c76ec05-8990-49bf-8d5d-2ea126938b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:21.604701 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76ec05-8990-49bf-8d5d-2ea126938b81 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:21.613415 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76ec05-8990-49bf-8d5d-2ea126938b81 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:21.613415 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76ec05-8990-49bf-8d5d-2ea126938b81 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:21.617790 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 57/105] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:49:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 20:49:21.619060 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aea302-1540-4521-be06-e4282a05a784 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:21.632143 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c76ec05-8990-49bf-8d5d-2ea126938b81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:49:21.643879 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-2c76ec05-8990-49bf-8d5d-2ea126938b81 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 14 20:49:21.643879 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:49:21.643879 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:49:21.643879 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:49:21.643879 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:49:21.643879 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:49:21.643879 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:49:21.643879 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:49:21.643879 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:49:21.643879 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:49:21.643879 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:49:21.643879 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:49:21.643879 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:49:21.643879 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:49:21.643879 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:49:21.643879 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:49:21.644876 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:49:21.644876 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:49:21.644876 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:49:21.644876 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:49:21.644876 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:49:21.644876 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:49:21.644876 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:49:21.644876 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:49:21.644876 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:49:21.644876 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:49:21.644876 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:49:21.644876 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:49:21.644876 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:49:21.644876 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:49:21.644876 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:49:21.644876 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:49:21.645615 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:49:21.645615 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:49:21.645615 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:49:21.645615 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:49:21.645615 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:49:21.645615 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:49:21.645615 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:49:21.645615 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:49:21.645615 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:49:21.645615 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:49:21.645615 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 14 20:49:21.645615 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:49:21.645615 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 49/106] 10.222.0.52 () {56 vars in 1099 bytes} [Sat May 14 20:49:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:49:21.648671 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c76ec05-8990-49bf-8d5d-2ea126938b81 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:21.750860 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aea302-1540-4521-be06-e4282a05a784 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:21.785662 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556ca8a1-4f7c-4cef-abf9-6107d85aac34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:21.786628 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ca8a1-4f7c-4cef-abf9-6107d85aac34 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:21.786908 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ca8a1-4f7c-4cef-abf9-6107d85aac34 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:21.787169 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ca8a1-4f7c-4cef-abf9-6107d85aac34 None admin] PATH_INFO: `/v3/users/1f1ad598c0eb49f9a6bda831fba1c4e6` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:21.788429 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556ca8a1-4f7c-4cef-abf9-6107d85aac34 None admin] RBAC: Authorizing `identity:get_user(user_id=1f1ad598c0eb49f9a6bda831fba1c4e6)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:21.789875 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556ca8a1-4f7c-4cef-abf9-6107d85aac34 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:21.791862 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 58/107] 10.222.0.52 () {56 vars in 1177 bytes} [Sat May 14 20:49:21 2022] GET /identity/v3/users/1f1ad598c0eb49f9a6bda831fba1c4e6 => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:21.792623 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556ca8a1-4f7c-4cef-abf9-6107d85aac34 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:21.845991 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c76ec05-8990-49bf-8d5d-2ea126938b81 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:21.895520 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318824d9-16e3-4cf0-ad1d-f76b785c97eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:21.895520 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318824d9-16e3-4cf0-ad1d-f76b785c97eb None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:21.895520 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318824d9-16e3-4cf0-ad1d-f76b785c97eb None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:21.895520 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318824d9-16e3-4cf0-ad1d-f76b785c97eb None admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:21.896408 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318824d9-16e3-4cf0-ad1d-f76b785c97eb None admin] RBAC: Adding query filter params (name=member) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:49:21.896408 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318824d9-16e3-4cf0-ad1d-f76b785c97eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:21.897362 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318824d9-16e3-4cf0-ad1d-f76b785c97eb None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:21.910656 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 50/108] 10.222.0.52 () {56 vars in 1101 bytes} [Sat May 14 20:49:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:21.912213 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318824d9-16e3-4cf0-ad1d-f76b785c97eb None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:21.923543 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556ca8a1-4f7c-4cef-abf9-6107d85aac34 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:21.966738 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb9cb7-dfcf-4ddd-b262-863aa4f204b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:21.968040 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb9cb7-dfcf-4ddd-b262-863aa4f204b4 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:21.968645 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb9cb7-dfcf-4ddd-b262-863aa4f204b4 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:21.968931 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb9cb7-dfcf-4ddd-b262-863aa4f204b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:21.983497 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bb9cb7-dfcf-4ddd-b262-863aa4f204b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:49:21.988556 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-72bb9cb7-dfcf-4ddd-b262-863aa4f204b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 14 20:49:21.988556 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:49:21.988556 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:49:21.988556 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:49:21.988556 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:49:21.988556 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:49:21.988556 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:49:21.988556 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:49:21.988556 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:49:21.988556 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:49:21.988556 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:49:21.988556 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:49:21.988556 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:49:21.988556 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:49:21.988556 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:49:21.988556 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:49:21.989913 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:49:21.989913 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:49:21.989913 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:49:21.989913 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:49:21.989913 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:49:21.989913 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:49:21.989913 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:49:21.989913 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:49:21.989913 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:49:21.989913 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:49:21.989913 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:49:21.989913 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:49:21.989913 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:49:21.989913 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:49:21.989913 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:49:21.989913 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:49:21.991106 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:49:21.991106 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:49:21.991106 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:49:21.991106 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:49:21.991106 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:49:21.991106 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:49:21.991106 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:49:21.991106 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:49:21.991106 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:49:21.991106 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:49:21.991106 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 14 20:49:21.991106 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:49:21.991106 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 59/109] 10.222.0.52 () {56 vars in 1096 bytes} [Sat May 14 20:49:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:49:21.991778 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb9cb7-dfcf-4ddd-b262-863aa4f204b4 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:22.050010 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318824d9-16e3-4cf0-ad1d-f76b785c97eb None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:22.085466 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27481e6c-f2cc-4d44-802c-43be95a32604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:22.086306 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27481e6c-f2cc-4d44-802c-43be95a32604 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:22.086593 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27481e6c-f2cc-4d44-802c-43be95a32604 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:22.086871 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27481e6c-f2cc-4d44-802c-43be95a32604 None admin] PATH_INFO: `/v3/projects/c377a7cb474f47c8861e1c13e61ee22d` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:22.088169 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27481e6c-f2cc-4d44-802c-43be95a32604 None admin] RBAC: Authorizing `identity:get_project(project_id=c377a7cb474f47c8861e1c13e61ee22d)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:22.089656 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27481e6c-f2cc-4d44-802c-43be95a32604 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:22.091526 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 51/110] 10.222.0.52 () {56 vars in 1186 bytes} [Sat May 14 20:49:21 2022] GET /identity/v3/projects/c377a7cb474f47c8861e1c13e61ee22d => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:22.093066 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec07eb7-791d-41a3-9061-4a7528ad52ac None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:22.093379 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec07eb7-791d-41a3-9061-4a7528ad52ac None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:22.093647 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec07eb7-791d-41a3-9061-4a7528ad52ac None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:22.094915 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 52/111] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:49:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:49:22.095716 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec07eb7-791d-41a3-9061-4a7528ad52ac None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:22.106285 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb9cb7-dfcf-4ddd-b262-863aa4f204b4 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:22.147525 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c38691-66c1-4f5e-9977-eb6668e4f889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:22.148423 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c38691-66c1-4f5e-9977-eb6668e4f889 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:22.148703 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c38691-66c1-4f5e-9977-eb6668e4f889 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:22.149070 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c38691-66c1-4f5e-9977-eb6668e4f889 None admin] PATH_INFO: `/v3/users/1f1ad598c0eb49f9a6bda831fba1c4e6` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:22.150373 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c38691-66c1-4f5e-9977-eb6668e4f889 None admin] RBAC: Authorizing `identity:get_user(user_id=1f1ad598c0eb49f9a6bda831fba1c4e6)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:22.151939 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c38691-66c1-4f5e-9977-eb6668e4f889 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:22.153629 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 60/112] 10.222.0.52 () {56 vars in 1177 bytes} [Sat May 14 20:49:21 2022] GET /identity/v3/users/1f1ad598c0eb49f9a6bda831fba1c4e6 => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:22.154367 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c38691-66c1-4f5e-9977-eb6668e4f889 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:22.217254 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec07eb7-791d-41a3-9061-4a7528ad52ac None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:22.252266 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73beeeb-b691-4703-b38d-a9392791080c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:22.252945 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73beeeb-b691-4703-b38d-a9392791080c None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:22.253236 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73beeeb-b691-4703-b38d-a9392791080c None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:22.253517 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73beeeb-b691-4703-b38d-a9392791080c None admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:22.254268 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73beeeb-b691-4703-b38d-a9392791080c None admin] RBAC: Adding query filter params (name=admin) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:49:22.254578 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73beeeb-b691-4703-b38d-a9392791080c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:22.256548 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73beeeb-b691-4703-b38d-a9392791080c None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:22.259017 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c38691-66c1-4f5e-9977-eb6668e4f889 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:22.265853 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 53/113] 10.222.0.52 () {56 vars in 1099 bytes} [Sat May 14 20:49:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:22.267256 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c890d9e-c550-407c-81a4-c9a4735b855f None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:22.267577 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c890d9e-c550-407c-81a4-c9a4735b855f None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:22.267864 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c890d9e-c550-407c-81a4-c9a4735b855f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:22.284764 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-4c890d9e-c550-407c-81a4-c9a4735b855f None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:49:22.285968 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-4c890d9e-c550-407c-81a4-c9a4735b855f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:49:22.300509 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7c13b6-d85f-451e-a9c3-4ef307283071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:22.301417 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7c13b6-d85f-451e-a9c3-4ef307283071 None admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:22.301707 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7c13b6-d85f-451e-a9c3-4ef307283071 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:22.302780 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7c13b6-d85f-451e-a9c3-4ef307283071 None admin] PATH_INFO: `/v3/projects/c377a7cb474f47c8861e1c13e61ee22d/users/1f1ad598c0eb49f9a6bda831fba1c4e6/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:22.305106 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7c13b6-d85f-451e-a9c3-4ef307283071 None admin] RBAC: Authorizing `identity:create_grant(project_id=c377a7cb474f47c8861e1c13e61ee22d, user_id=1f1ad598c0eb49f9a6bda831fba1c4e6, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:22.306759 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7c13b6-d85f-451e-a9c3-4ef307283071 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:22.355093 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 54/114] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:49:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 20:49:22.356052 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c890d9e-c550-407c-81a4-c9a4735b855f None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:22.383750 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 61/115] 10.222.0.52 () {58 vars in 1439 bytes} [Sat May 14 20:49:22 2022] PUT /identity/v3/projects/c377a7cb474f47c8861e1c13e61ee22d/users/1f1ad598c0eb49f9a6bda831fba1c4e6/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 20:49:22.384602 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7c13b6-d85f-451e-a9c3-4ef307283071 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:22.467796 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c890d9e-c550-407c-81a4-c9a4735b855f None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:22.494633 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7c13b6-d85f-451e-a9c3-4ef307283071 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:22.504412 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f0a0d7-e9d9-4342-82d0-d415d524f3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:22.505435 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f0a0d7-e9d9-4342-82d0-d415d524f3dc None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:22.506039 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f0a0d7-e9d9-4342-82d0-d415d524f3dc None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:22.506176 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f0a0d7-e9d9-4342-82d0-d415d524f3dc None admin] PATH_INFO: `/v3/projects/f9f026156997408398ed32333f3c1d43` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:22.507435 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f0a0d7-e9d9-4342-82d0-d415d524f3dc None admin] RBAC: Authorizing `identity:get_project(project_id=f9f026156997408398ed32333f3c1d43)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:22.508983 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f0a0d7-e9d9-4342-82d0-d415d524f3dc None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:22.510717 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 55/116] 10.222.0.52 () {56 vars in 1186 bytes} [Sat May 14 20:49:22 2022] GET /identity/v3/projects/f9f026156997408398ed32333f3c1d43 => generated 312 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:22.512112 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa75ec6-dbd9-43b3-a987-90e59caac071 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:22.512402 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa75ec6-dbd9-43b3-a987-90e59caac071 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:22.512681 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa75ec6-dbd9-43b3-a987-90e59caac071 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:22.514203 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 56/117] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:49:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:49:22.515145 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7755b2d-a935-4e85-a874-b15c70b483ad None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:22.515803 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7755b2d-a935-4e85-a874-b15c70b483ad None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:22.516098 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7755b2d-a935-4e85-a874-b15c70b483ad None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:22.517446 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 57/118] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:49:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:49:22.518023 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7755b2d-a935-4e85-a874-b15c70b483ad None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:22.540987 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58435db6-641f-4aa2-be52-1f357b862c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:22.542000 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58435db6-641f-4aa2-be52-1f357b862c83 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:22.542270 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58435db6-641f-4aa2-be52-1f357b862c83 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:22.542549 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58435db6-641f-4aa2-be52-1f357b862c83 None admin] PATH_INFO: `/v3/users/9e6b0e25d0144f868beb29eb9540ea7e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:22.543845 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58435db6-641f-4aa2-be52-1f357b862c83 None admin] RBAC: Authorizing `identity:get_user(user_id=9e6b0e25d0144f868beb29eb9540ea7e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:22.545325 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58435db6-641f-4aa2-be52-1f357b862c83 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:22.547002 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 62/119] 10.222.0.52 () {56 vars in 1177 bytes} [Sat May 14 20:49:22 2022] GET /identity/v3/users/9e6b0e25d0144f868beb29eb9540ea7e => generated 247 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:22.547798 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58435db6-641f-4aa2-be52-1f357b862c83 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:22.633984 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7755b2d-a935-4e85-a874-b15c70b483ad None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:22.661635 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58435db6-641f-4aa2-be52-1f357b862c83 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:22.666864 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f7f279-61b5-4b92-aeca-0496855850ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:22.667690 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7f279-61b5-4b92-aeca-0496855850ed None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:22.668053 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7f279-61b5-4b92-aeca-0496855850ed None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:22.668397 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7f279-61b5-4b92-aeca-0496855850ed None admin] PATH_INFO: `/v3/domains/default` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:22.669647 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f7f279-61b5-4b92-aeca-0496855850ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:22.671108 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f7f279-61b5-4b92-aeca-0496855850ed None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:22.672768 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 58/120] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:49:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:22.677352 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d77823-4406-4707-a0c0-4e18c1d3125e None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:22.678610 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d77823-4406-4707-a0c0-4e18c1d3125e None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:22.678900 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d77823-4406-4707-a0c0-4e18c1d3125e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:22.699023 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55509f2-c582-4799-a208-ff6093356732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:22.699250 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-76d77823-4406-4707-a0c0-4e18c1d3125e None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:49:22.699941 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55509f2-c582-4799-a208-ff6093356732 None admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:22.700229 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55509f2-c582-4799-a208-ff6093356732 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:22.700642 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55509f2-c582-4799-a208-ff6093356732 None admin] PATH_INFO: `/v3/projects/f9f026156997408398ed32333f3c1d43/users/1f1ad598c0eb49f9a6bda831fba1c4e6/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:22.700739 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-76d77823-4406-4707-a0c0-4e18c1d3125e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:49:22.702650 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55509f2-c582-4799-a208-ff6093356732 None admin] RBAC: Authorizing `identity:create_grant(project_id=f9f026156997408398ed32333f3c1d43, user_id=1f1ad598c0eb49f9a6bda831fba1c4e6, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:22.704106 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55509f2-c582-4799-a208-ff6093356732 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:22.765774 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 59/121] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:49:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 20:49:22.766888 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a8894-4e80-4607-9975-2c6cca895899 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:22.767182 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a8894-4e80-4607-9975-2c6cca895899 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:22.767461 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a8894-4e80-4607-9975-2c6cca895899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:22.783695 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-1e8a8894-4e80-4607-9975-2c6cca895899 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:49:22.784885 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-1e8a8894-4e80-4607-9975-2c6cca895899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:49:22.812783 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 63/122] 10.222.0.52 () {58 vars in 1439 bytes} [Sat May 14 20:49:22 2022] PUT /identity/v3/projects/f9f026156997408398ed32333f3c1d43/users/1f1ad598c0eb49f9a6bda831fba1c4e6/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 20:49:22.814512 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55509f2-c582-4799-a208-ff6093356732 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:22.862346 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 60/123] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:49:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 20:49:22.863886 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8a8894-4e80-4607-9975-2c6cca895899 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:22.938918 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55509f2-c582-4799-a208-ff6093356732 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:22.974779 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8a8894-4e80-4607-9975-2c6cca895899 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:22.978526 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8616bf3-8b54-47c4-8998-9859fc0142aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:22.979784 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8616bf3-8b54-47c4-8998-9859fc0142aa None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:22.980284 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8616bf3-8b54-47c4-8998-9859fc0142aa None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:22.980745 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8616bf3-8b54-47c4-8998-9859fc0142aa None admin] PATH_INFO: `/v3/projects/c377a7cb474f47c8861e1c13e61ee22d` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:22.982278 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8616bf3-8b54-47c4-8998-9859fc0142aa None admin] RBAC: Authorizing `identity:get_project(project_id=c377a7cb474f47c8861e1c13e61ee22d)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:22.984017 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8616bf3-8b54-47c4-8998-9859fc0142aa None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:22.986420 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 64/124] 10.222.0.52 () {56 vars in 1186 bytes} [Sat May 14 20:49:22 2022] GET /identity/v3/projects/c377a7cb474f47c8861e1c13e61ee22d => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:22.987448 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8616bf3-8b54-47c4-8998-9859fc0142aa None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:23.015898 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca851d7-02b8-4f12-b0b6-bd3eb470b298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:23.016098 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca851d7-02b8-4f12-b0b6-bd3eb470b298 None admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:23.017081 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca851d7-02b8-4f12-b0b6-bd3eb470b298 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:23.017081 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca851d7-02b8-4f12-b0b6-bd3eb470b298 None admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:23.017307 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca851d7-02b8-4f12-b0b6-bd3eb470b298 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:23.018745 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca851d7-02b8-4f12-b0b6-bd3eb470b298 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:23.103026 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 61/125] 10.222.0.52 () {60 vars in 1141 bytes} [Sat May 14 20:49:22 2022] POST /identity/v3/projects => generated 302 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 20:49:23.104137 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca851d7-02b8-4f12-b0b6-bd3eb470b298 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:23.108089 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8616bf3-8b54-47c4-8998-9859fc0142aa None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:23.171411 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b65b1c6-b474-424e-9af6-44778f6d27ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:23.172240 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b65b1c6-b474-424e-9af6-44778f6d27ef None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:23.172526 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b65b1c6-b474-424e-9af6-44778f6d27ef None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:23.172804 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b65b1c6-b474-424e-9af6-44778f6d27ef None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:23.194000 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b65b1c6-b474-424e-9af6-44778f6d27ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:49:23.207986 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-8b65b1c6-b474-424e-9af6-44778f6d27ef None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 14 20:49:23.207986 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:49:23.207986 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:49:23.207986 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:49:23.207986 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:49:23.207986 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:49:23.207986 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:49:23.207986 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:49:23.207986 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:49:23.207986 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:49:23.207986 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:49:23.207986 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:49:23.207986 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:49:23.207986 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:49:23.207986 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:49:23.207986 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:49:23.209484 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:49:23.209484 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:49:23.209484 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:49:23.209484 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:49:23.209484 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:49:23.209484 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:49:23.209484 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:49:23.209484 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:49:23.209484 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:49:23.209484 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:49:23.209484 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:49:23.209484 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:49:23.209484 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:49:23.209484 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:49:23.209484 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:49:23.209484 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:49:23.210258 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:49:23.210258 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:49:23.210258 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:49:23.210258 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:49:23.210258 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:49:23.210258 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:49:23.210258 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:49:23.210258 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:49:23.210258 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:49:23.210258 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:49:23.210258 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 14 20:49:23.210258 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:49:23.211654 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 65/126] 10.222.0.52 () {56 vars in 1099 bytes} [Sat May 14 20:49:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:49:23.211654 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b65b1c6-b474-424e-9af6-44778f6d27ef None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:23.300840 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca851d7-02b8-4f12-b0b6-bd3eb470b298 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:23.345350 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8652095-e324-4f27-a073-6f9bf453e9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:23.346317 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8652095-e324-4f27-a073-6f9bf453e9cb None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:23.346605 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8652095-e324-4f27-a073-6f9bf453e9cb None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:23.346885 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8652095-e324-4f27-a073-6f9bf453e9cb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:23.362684 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8652095-e324-4f27-a073-6f9bf453e9cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:49:23.372097 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-e8652095-e324-4f27-a073-6f9bf453e9cb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 14 20:49:23.372097 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:49:23.372097 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:49:23.372097 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:49:23.372097 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:49:23.372097 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:49:23.372097 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:49:23.372097 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:49:23.372097 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:49:23.372097 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:49:23.372097 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:49:23.372097 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:49:23.372097 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:49:23.372097 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:49:23.372097 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:49:23.372097 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:49:23.373020 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:49:23.373020 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:49:23.373020 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:49:23.373020 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:49:23.373020 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:49:23.373020 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:49:23.373020 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:49:23.373020 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:49:23.373020 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:49:23.373020 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:49:23.373020 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:49:23.373020 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:49:23.373020 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:49:23.373020 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:49:23.373020 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:49:23.373020 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:49:23.373783 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:49:23.373783 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:49:23.373783 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:49:23.373783 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:49:23.373783 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:49:23.373783 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:49:23.373783 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:49:23.373783 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:49:23.373783 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:49:23.373783 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:49:23.373783 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 14 20:49:23.373783 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:49:23.373783 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 62/127] 10.222.0.52 () {56 vars in 1114 bytes} [Sat May 14 20:49:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:49:23.374429 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8652095-e324-4f27-a073-6f9bf453e9cb None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:23.404467 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b65b1c6-b474-424e-9af6-44778f6d27ef None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:23.450875 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c59b98f-1d58-454a-b432-56320cbd2793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:23.451565 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59b98f-1d58-454a-b432-56320cbd2793 None admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:23.451909 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59b98f-1d58-454a-b432-56320cbd2793 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:23.452273 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59b98f-1d58-454a-b432-56320cbd2793 None admin] PATH_INFO: `/v3/projects/c377a7cb474f47c8861e1c13e61ee22d/users/9e6b0e25d0144f868beb29eb9540ea7e/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:23.454999 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c59b98f-1d58-454a-b432-56320cbd2793 None admin] RBAC: Authorizing `identity:create_grant(project_id=c377a7cb474f47c8861e1c13e61ee22d, user_id=9e6b0e25d0144f868beb29eb9540ea7e, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:23.456946 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c59b98f-1d58-454a-b432-56320cbd2793 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:23.503315 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8652095-e324-4f27-a073-6f9bf453e9cb None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:23.534524 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 66/128] 10.222.0.52 () {58 vars in 1439 bytes} [Sat May 14 20:49:23 2022] PUT /identity/v3/projects/c377a7cb474f47c8861e1c13e61ee22d/users/9e6b0e25d0144f868beb29eb9540ea7e/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 20:49:23.535722 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c59b98f-1d58-454a-b432-56320cbd2793 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:23.554610 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd0df89-376f-40a1-a2b4-021ca76e7e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:23.555728 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0df89-376f-40a1-a2b4-021ca76e7e2c None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:23.556231 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0df89-376f-40a1-a2b4-021ca76e7e2c None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:23.556720 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0df89-376f-40a1-a2b4-021ca76e7e2c None admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:23.557742 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd0df89-376f-40a1-a2b4-021ca76e7e2c None admin] RBAC: Adding query filter params (name=reader) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:49:23.558247 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd0df89-376f-40a1-a2b4-021ca76e7e2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:23.560013 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd0df89-376f-40a1-a2b4-021ca76e7e2c None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:23.570762 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 63/129] 10.222.0.52 () {56 vars in 1101 bytes} [Sat May 14 20:49:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:23.580135 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd0df89-376f-40a1-a2b4-021ca76e7e2c None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:23.714569 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c59b98f-1d58-454a-b432-56320cbd2793 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:23.753113 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daa54e4-0462-4c1e-a5f9-8f4786f085df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:23.753791 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa54e4-0462-4c1e-a5f9-8f4786f085df None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:23.754078 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa54e4-0462-4c1e-a5f9-8f4786f085df None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:23.754418 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa54e4-0462-4c1e-a5f9-8f4786f085df None admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:23.755945 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daa54e4-0462-4c1e-a5f9-8f4786f085df None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:49:23.756218 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daa54e4-0462-4c1e-a5f9-8f4786f085df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:23.759509 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daa54e4-0462-4c1e-a5f9-8f4786f085df None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:23.766696 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 67/130] 10.222.0.52 () {56 vars in 1111 bytes} [Sat May 14 20:49:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:23.772534 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daa54e4-0462-4c1e-a5f9-8f4786f085df None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:23.829170 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd0df89-376f-40a1-a2b4-021ca76e7e2c None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:23.895363 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0291bc4f-b2d9-49e0-93a6-cc20db9afff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:23.897547 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291bc4f-b2d9-49e0-93a6-cc20db9afff4 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:23.897978 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291bc4f-b2d9-49e0-93a6-cc20db9afff4 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:23.898397 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291bc4f-b2d9-49e0-93a6-cc20db9afff4 None admin] PATH_INFO: `/v3/users/ef29df6a67ab46cd9a34f4e37fe63bb8` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:23.932281 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0291bc4f-b2d9-49e0-93a6-cc20db9afff4 None admin] RBAC: Authorizing `identity:get_user(user_id=ef29df6a67ab46cd9a34f4e37fe63bb8)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:23.934583 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0291bc4f-b2d9-49e0-93a6-cc20db9afff4 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:23.936525 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 64/131] 10.222.0.52 () {56 vars in 1177 bytes} [Sat May 14 20:49:23 2022] GET /identity/v3/users/ef29df6a67ab46cd9a34f4e37fe63bb8 => generated 289 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:23.936996 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daa54e4-0462-4c1e-a5f9-8f4786f085df None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:23.960569 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0291bc4f-b2d9-49e0-93a6-cc20db9afff4 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:23.990499 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a935813b-95d2-47bc-9bc0-4be975f20a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:23.991563 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935813b-95d2-47bc-9bc0-4be975f20a40 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:23.991861 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935813b-95d2-47bc-9bc0-4be975f20a40 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:23.992143 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935813b-95d2-47bc-9bc0-4be975f20a40 None admin] PATH_INFO: `/v3/users/1f1ad598c0eb49f9a6bda831fba1c4e6` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:23.994886 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a935813b-95d2-47bc-9bc0-4be975f20a40 None admin] RBAC: Authorizing `identity:get_user(user_id=1f1ad598c0eb49f9a6bda831fba1c4e6)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:23.996620 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a935813b-95d2-47bc-9bc0-4be975f20a40 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:24.002722 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 68/132] 10.222.0.52 () {56 vars in 1177 bytes} [Sat May 14 20:49:23 2022] GET /identity/v3/users/1f1ad598c0eb49f9a6bda831fba1c4e6 => generated 275 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:49:24.003591 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a935813b-95d2-47bc-9bc0-4be975f20a40 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:24.135064 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0291bc4f-b2d9-49e0-93a6-cc20db9afff4 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:24.173487 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9f81bf-72b6-40c0-8a52-09de68382542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:24.174137 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f81bf-72b6-40c0-8a52-09de68382542 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:24.174421 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f81bf-72b6-40c0-8a52-09de68382542 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:24.174699 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f81bf-72b6-40c0-8a52-09de68382542 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:24.191033 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a935813b-95d2-47bc-9bc0-4be975f20a40 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:24.256367 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e82e405-c2d7-427c-a048-2d6ac95e0b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:24.257165 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e82e405-c2d7-427c-a048-2d6ac95e0b5f None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:24.257455 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e82e405-c2d7-427c-a048-2d6ac95e0b5f None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:24.257737 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e82e405-c2d7-427c-a048-2d6ac95e0b5f None admin] PATH_INFO: `/v3/projects/c377a7cb474f47c8861e1c13e61ee22d` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:24.258997 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e82e405-c2d7-427c-a048-2d6ac95e0b5f None admin] RBAC: Authorizing `identity:get_project(project_id=c377a7cb474f47c8861e1c13e61ee22d)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:24.260477 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e82e405-c2d7-427c-a048-2d6ac95e0b5f None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:24.262183 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 69/133] 10.222.0.52 () {56 vars in 1186 bytes} [Sat May 14 20:49:24 2022] GET /identity/v3/projects/c377a7cb474f47c8861e1c13e61ee22d => generated 298 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:24.267846 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e82e405-c2d7-427c-a048-2d6ac95e0b5f None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:24.273148 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9f81bf-72b6-40c0-8a52-09de68382542 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:24.274629 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9f81bf-72b6-40c0-8a52-09de68382542 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:24.384547 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 65/134] 10.222.0.52 () {58 vars in 1282 bytes} [Sat May 14 20:49:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 14 20:49:24.391300 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9f81bf-72b6-40c0-8a52-09de68382542 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:24.471233 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e82e405-c2d7-427c-a048-2d6ac95e0b5f None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:24.540882 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7538d9f3-f455-416b-9450-43881fa834c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:24.541706 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7538d9f3-f455-416b-9450-43881fa834c1 None admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:24.541992 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7538d9f3-f455-416b-9450-43881fa834c1 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:24.542355 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7538d9f3-f455-416b-9450-43881fa834c1 None admin] PATH_INFO: `/v3/projects/c377a7cb474f47c8861e1c13e61ee22d/users/1f1ad598c0eb49f9a6bda831fba1c4e6/roles/274f900b5153444b84117bc9919443fc` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:24.548323 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7538d9f3-f455-416b-9450-43881fa834c1 None admin] RBAC: Authorizing `identity:create_grant(project_id=c377a7cb474f47c8861e1c13e61ee22d, user_id=1f1ad598c0eb49f9a6bda831fba1c4e6, role_id=274f900b5153444b84117bc9919443fc)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:24.551270 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7538d9f3-f455-416b-9450-43881fa834c1 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:24.570981 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9f81bf-72b6-40c0-8a52-09de68382542 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:24.608421 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf99ee16-c64f-4d5d-b8c5-a2060b367f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:24.609282 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99ee16-c64f-4d5d-b8c5-a2060b367f48 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:24.609570 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99ee16-c64f-4d5d-b8c5-a2060b367f48 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:24.609855 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99ee16-c64f-4d5d-b8c5-a2060b367f48 None admin] PATH_INFO: `/v3/projects/c377a7cb474f47c8861e1c13e61ee22d` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:24.611043 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf99ee16-c64f-4d5d-b8c5-a2060b367f48 None admin] RBAC: Authorizing `identity:get_project(project_id=c377a7cb474f47c8861e1c13e61ee22d)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:24.612535 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf99ee16-c64f-4d5d-b8c5-a2060b367f48 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:24.615135 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 66/135] 10.222.0.52 () {56 vars in 1186 bytes} [Sat May 14 20:49:24 2022] GET /identity/v3/projects/c377a7cb474f47c8861e1c13e61ee22d => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:24.620385 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf99ee16-c64f-4d5d-b8c5-a2060b367f48 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:24.635553 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 70/136] 10.222.0.52 () {58 vars in 1439 bytes} [Sat May 14 20:49:24 2022] PUT /identity/v3/projects/c377a7cb474f47c8861e1c13e61ee22d/users/1f1ad598c0eb49f9a6bda831fba1c4e6/roles/274f900b5153444b84117bc9919443fc => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 20:49:24.771233 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf99ee16-c64f-4d5d-b8c5-a2060b367f48 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:24.817553 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee6bad8-63c3-4ce4-af36-987832bbbfb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:24.818411 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6bad8-63c3-4ce4-af36-987832bbbfb8 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:24.818770 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6bad8-63c3-4ce4-af36-987832bbbfb8 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:24.819119 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6bad8-63c3-4ce4-af36-987832bbbfb8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:24.820303 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee6bad8-63c3-4ce4-af36-987832bbbfb8 None admin] RBAC: Adding query filter params (role.id=eecceaafa26e4f31a69165cbb855b327, scope.project.id=c377a7cb474f47c8861e1c13e61ee22d, user.id=ef29df6a67ab46cd9a34f4e37fe63bb8) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:49:24.820700 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee6bad8-63c3-4ce4-af36-987832bbbfb8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:24.822299 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee6bad8-63c3-4ce4-af36-987832bbbfb8 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:24.829211 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 67/137] 10.222.0.52 () {56 vars in 1374 bytes} [Sat May 14 20:49:24 2022] GET /identity/v3/role_assignments?user.id=ef29df6a67ab46cd9a34f4e37fe63bb8&scope.project.id=c377a7cb474f47c8861e1c13e61ee22d&role.id=eecceaafa26e4f31a69165cbb855b327 => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:25.122034 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d474f461-0bd5-4c01-85ae-cbe9604777ba None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:25.122692 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d474f461-0bd5-4c01-85ae-cbe9604777ba None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:25.122692 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d474f461-0bd5-4c01-85ae-cbe9604777ba None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:25.124231 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 71/138] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:49:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:49:25.131190 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8688238a-cd02-41c4-95dc-932db5fd4ac7 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:25.131762 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8688238a-cd02-41c4-95dc-932db5fd4ac7 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:25.131912 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8688238a-cd02-41c4-95dc-932db5fd4ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:25.149331 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-8688238a-cd02-41c4-95dc-932db5fd4ac7 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:49:25.150515 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8688238a-cd02-41c4-95dc-932db5fd4ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:49:25.223349 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 68/139] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:49:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 20:49:25.248161 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d474f461-0bd5-4c01-85ae-cbe9604777ba None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:25.365837 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d474f461-0bd5-4c01-85ae-cbe9604777ba None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:25.407520 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bbbd4c-10f3-4a58-98e1-92d4e7609e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:25.408253 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bbbd4c-10f3-4a58-98e1-92d4e7609e2e None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:25.408544 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bbbd4c-10f3-4a58-98e1-92d4e7609e2e None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:25.408824 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bbbd4c-10f3-4a58-98e1-92d4e7609e2e None admin] PATH_INFO: `/v3/roles/member` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:25.424351 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bbbd4c-10f3-4a58-98e1-92d4e7609e2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:49:25.432274 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-a6bbbd4c-10f3-4a58-98e1-92d4e7609e2e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 14 20:49:25.432274 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:49:25.432274 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:49:25.432274 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:49:25.432274 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:49:25.432274 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:49:25.432274 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:49:25.432274 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:49:25.432274 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:49:25.432274 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:49:25.432274 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:49:25.432274 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:49:25.432274 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:49:25.432274 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:49:25.432274 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:49:25.432274 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:49:25.434349 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:49:25.434349 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:49:25.434349 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:49:25.434349 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:49:25.434349 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:49:25.434349 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:49:25.434349 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:49:25.434349 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:49:25.434349 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:49:25.434349 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:49:25.434349 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:49:25.434349 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:49:25.434349 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:49:25.434349 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:49:25.434349 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:49:25.434349 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:49:25.436306 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:49:25.436306 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:49:25.436306 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:49:25.436306 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:49:25.436306 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:49:25.436306 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:49:25.436306 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:49:25.436306 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:49:25.436306 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:49:25.436306 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:49:25.436306 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 14 20:49:25.436306 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:49:25.436306 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 72/140] 10.222.0.52 () {56 vars in 1099 bytes} [Sat May 14 20:49:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:49:25.443591 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8688238a-cd02-41c4-95dc-932db5fd4ac7 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:25.579512 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8688238a-cd02-41c4-95dc-932db5fd4ac7 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:25.626973 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa99b82-1b49-4b1b-8413-ab5447ddfb21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:25.627918 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa99b82-1b49-4b1b-8413-ab5447ddfb21 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:25.628346 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa99b82-1b49-4b1b-8413-ab5447ddfb21 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:25.628785 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa99b82-1b49-4b1b-8413-ab5447ddfb21 None admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:25.629675 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa99b82-1b49-4b1b-8413-ab5447ddfb21 None admin] RBAC: Adding query filter params (name=member) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:49:25.630721 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa99b82-1b49-4b1b-8413-ab5447ddfb21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:25.632318 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa99b82-1b49-4b1b-8413-ab5447ddfb21 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:25.641284 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 69/141] 10.222.0.52 () {56 vars in 1101 bytes} [Sat May 14 20:49:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:25.647270 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bbbd4c-10f3-4a58-98e1-92d4e7609e2e None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:25.768732 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bbbd4c-10f3-4a58-98e1-92d4e7609e2e None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:25.813548 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b688e26-b511-4e54-bd09-2d36bbb1c622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:25.814659 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b688e26-b511-4e54-bd09-2d36bbb1c622 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:25.815076 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b688e26-b511-4e54-bd09-2d36bbb1c622 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:25.815538 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b688e26-b511-4e54-bd09-2d36bbb1c622 None admin] PATH_INFO: `/v3/users/1f1ad598c0eb49f9a6bda831fba1c4e6` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:25.820373 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b688e26-b511-4e54-bd09-2d36bbb1c622 None admin] RBAC: Authorizing `identity:get_user(user_id=1f1ad598c0eb49f9a6bda831fba1c4e6)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:25.822036 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b688e26-b511-4e54-bd09-2d36bbb1c622 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:25.823875 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 73/142] 10.222.0.52 () {56 vars in 1177 bytes} [Sat May 14 20:49:25 2022] GET /identity/v3/users/1f1ad598c0eb49f9a6bda831fba1c4e6 => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:25.829465 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa99b82-1b49-4b1b-8413-ab5447ddfb21 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:25.957614 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa99b82-1b49-4b1b-8413-ab5447ddfb21 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:25.998975 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fb6f3f-2b98-4be8-aeb3-28b952815f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:25.999664 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb6f3f-2b98-4be8-aeb3-28b952815f93 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:26.000055 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb6f3f-2b98-4be8-aeb3-28b952815f93 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:26.000341 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb6f3f-2b98-4be8-aeb3-28b952815f93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:26.080058 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fb6f3f-2b98-4be8-aeb3-28b952815f93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:26.080058 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fb6f3f-2b98-4be8-aeb3-28b952815f93 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:26.178235 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 70/143] 10.222.0.52 () {58 vars in 1282 bytes} [Sat May 14 20:49:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 14 20:49:26.184561 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b688e26-b511-4e54-bd09-2d36bbb1c622 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:26.265775 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91316db-9fcf-4ec9-8bf6-ed433146536a None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:26.266090 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91316db-9fcf-4ec9-8bf6-ed433146536a None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:26.266344 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91316db-9fcf-4ec9-8bf6-ed433146536a None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:26.267741 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 71/144] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:49:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 14 20:49:26.274279 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936b4bc-3d47-433c-9a3f-da0dea395b20 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:26.274570 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936b4bc-3d47-433c-9a3f-da0dea395b20 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:26.274853 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936b4bc-3d47-433c-9a3f-da0dea395b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:26.312536 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-6936b4bc-3d47-433c-9a3f-da0dea395b20 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:49:26.313739 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-6936b4bc-3d47-433c-9a3f-da0dea395b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:49:26.379867 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b688e26-b511-4e54-bd09-2d36bbb1c622 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:26.465241 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6860727c-d323-4f5d-afe1-9f7d86b010f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:26.465736 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 72/145] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:49:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 14 20:49:26.466726 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6860727c-d323-4f5d-afe1-9f7d86b010f2 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:26.467214 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6860727c-d323-4f5d-afe1-9f7d86b010f2 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:26.467720 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6860727c-d323-4f5d-afe1-9f7d86b010f2 None admin] PATH_INFO: `/v3/projects/c377a7cb474f47c8861e1c13e61ee22d` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:26.469160 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6860727c-d323-4f5d-afe1-9f7d86b010f2 None admin] RBAC: Authorizing `identity:get_project(project_id=c377a7cb474f47c8861e1c13e61ee22d)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:26.470817 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6860727c-d323-4f5d-afe1-9f7d86b010f2 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:26.472736 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 74/146] 10.222.0.52 () {56 vars in 1186 bytes} [Sat May 14 20:49:26 2022] GET /identity/v3/projects/c377a7cb474f47c8861e1c13e61ee22d => generated 298 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:26.478995 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6936b4bc-3d47-433c-9a3f-da0dea395b20 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:26.517758 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6860727c-d323-4f5d-afe1-9f7d86b010f2 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:26.675266 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6936b4bc-3d47-433c-9a3f-da0dea395b20 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:26.729468 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6860727c-d323-4f5d-afe1-9f7d86b010f2 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:26.730023 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a916b8d-6b4f-415c-bc85-b1870ec86b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:26.730692 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a916b8d-6b4f-415c-bc85-b1870ec86b61 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:26.730982 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a916b8d-6b4f-415c-bc85-b1870ec86b61 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:26.731266 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a916b8d-6b4f-415c-bc85-b1870ec86b61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:26.732195 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a916b8d-6b4f-415c-bc85-b1870ec86b61 None admin] RBAC: Adding query filter params (role.id=4f4cbb0efdc1410294a05a7ba44f9320, scope.project.id=c377a7cb474f47c8861e1c13e61ee22d, user.id=1f1ad598c0eb49f9a6bda831fba1c4e6) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:49:26.732459 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a916b8d-6b4f-415c-bc85-b1870ec86b61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:26.734018 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a916b8d-6b4f-415c-bc85-b1870ec86b61 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:26.745676 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 73/147] 10.222.0.52 () {56 vars in 1374 bytes} [Sat May 14 20:49:26 2022] GET /identity/v3/role_assignments?user.id=1f1ad598c0eb49f9a6bda831fba1c4e6&scope.project.id=c377a7cb474f47c8861e1c13e61ee22d&role.id=4f4cbb0efdc1410294a05a7ba44f9320 => generated 608 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:26.747249 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e72518-e9c8-478a-89d3-0a39d73675cf None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:26.751745 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e72518-e9c8-478a-89d3-0a39d73675cf None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:26.751745 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e72518-e9c8-478a-89d3-0a39d73675cf None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:26.751745 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 74/148] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:49:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:49:26.757232 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab7a5f1-174f-474f-963b-28cf3e9add78 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:26.757527 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab7a5f1-174f-474f-963b-28cf3e9add78 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:26.757816 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab7a5f1-174f-474f-963b-28cf3e9add78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:26.787676 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70c6c8d-7499-44d4-a1ef-fbac7f50f5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:26.788846 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70c6c8d-7499-44d4-a1ef-fbac7f50f5e5 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:26.789329 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70c6c8d-7499-44d4-a1ef-fbac7f50f5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:26.790068 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70c6c8d-7499-44d4-a1ef-fbac7f50f5e5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:26.796599 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70c6c8d-7499-44d4-a1ef-fbac7f50f5e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:26.796814 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-5ab7a5f1-174f-474f-963b-28cf3e9add78 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:49:26.798065 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-5ab7a5f1-174f-474f-963b-28cf3e9add78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:49:26.798865 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70c6c8d-7499-44d4-a1ef-fbac7f50f5e5 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:26.800884 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 75/149] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:49:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:49:26.807225 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70c6c8d-7499-44d4-a1ef-fbac7f50f5e5 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:26.896972 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 75/150] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:49:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 14 20:49:26.939069 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70c6c8d-7499-44d4-a1ef-fbac7f50f5e5 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:26.940229 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab7a5f1-174f-474f-963b-28cf3e9add78 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:26.982168 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d5e8c-1e96-4516-a07a-c5f15c382ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:26.983235 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d5e8c-1e96-4516-a07a-c5f15c382ca4 None admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:26.983796 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d5e8c-1e96-4516-a07a-c5f15c382ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:26.984299 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d5e8c-1e96-4516-a07a-c5f15c382ca4 None admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:26.985219 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17d5e8c-1e96-4516-a07a-c5f15c382ca4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:26.986859 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17d5e8c-1e96-4516-a07a-c5f15c382ca4 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:27.064377 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab7a5f1-174f-474f-963b-28cf3e9add78 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:27.104761 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 76/151] 10.222.0.52 () {60 vars in 1132 bytes} [Sat May 14 20:49:26 2022] POST /identity/v3/users => generated 283 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 20:49:27.108812 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0193041c-0e0c-4594-9c77-ceb3d0810d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:27.110299 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0193041c-0e0c-4594-9c77-ceb3d0810d07 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:27.110781 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0193041c-0e0c-4594-9c77-ceb3d0810d07 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:27.112186 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0193041c-0e0c-4594-9c77-ceb3d0810d07 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:27.125492 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0193041c-0e0c-4594-9c77-ceb3d0810d07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:49:27.134241 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-0193041c-0e0c-4594-9c77-ceb3d0810d07 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 14 20:49:27.134241 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:49:27.134241 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:49:27.134241 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:49:27.134241 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:49:27.134241 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:49:27.134241 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:49:27.134241 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:49:27.134241 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:49:27.134241 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:49:27.134241 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:49:27.134241 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:49:27.134241 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:49:27.134241 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:49:27.134241 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:49:27.134241 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:49:27.135169 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:49:27.135169 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:49:27.135169 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:49:27.135169 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:49:27.135169 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:49:27.135169 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:49:27.135169 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:49:27.135169 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:49:27.135169 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:49:27.135169 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:49:27.135169 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:49:27.135169 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:49:27.135169 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:49:27.135169 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:49:27.135169 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:49:27.135169 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:49:27.136116 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:49:27.136116 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:49:27.136116 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:49:27.136116 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:49:27.136116 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:49:27.136116 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:49:27.136116 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:49:27.136116 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:49:27.136116 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:49:27.136116 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:49:27.136116 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 14 20:49:27.136116 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:49:27.136116 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 76/152] 10.222.0.52 () {56 vars in 1099 bytes} [Sat May 14 20:49:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 20:49:27.144592 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d5e8c-1e96-4516-a07a-c5f15c382ca4 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:27.210553 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e4cdff-fa8e-4cac-b142-0e105eb3cc40 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:27.211171 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e4cdff-fa8e-4cac-b142-0e105eb3cc40 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:27.211171 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e4cdff-fa8e-4cac-b142-0e105eb3cc40 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:27.212551 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 77/153] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:49:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 14 20:49:27.220109 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5172eb57-f042-4eab-a7b8-2922ad923f25 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:27.220412 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5172eb57-f042-4eab-a7b8-2922ad923f25 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:27.220679 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5172eb57-f042-4eab-a7b8-2922ad923f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:27.252226 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-5172eb57-f042-4eab-a7b8-2922ad923f25 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:49:27.253472 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-5172eb57-f042-4eab-a7b8-2922ad923f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:49:27.352732 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d5e8c-1e96-4516-a07a-c5f15c382ca4 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:27.378000 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 78/154] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:49:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 14 20:49:27.395278 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1f9c0e-b1ef-44d7-a7e6-71e471cbd1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:27.397362 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f9c0e-b1ef-44d7-a7e6-71e471cbd1b4 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:27.397801 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f9c0e-b1ef-44d7-a7e6-71e471cbd1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:27.398222 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f9c0e-b1ef-44d7-a7e6-71e471cbd1b4 None admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:27.399136 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1f9c0e-b1ef-44d7-a7e6-71e471cbd1b4 None admin] RBAC: Adding query filter params (name=member) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:49:27.400803 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1f9c0e-b1ef-44d7-a7e6-71e471cbd1b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:27.402335 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1f9c0e-b1ef-44d7-a7e6-71e471cbd1b4 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:27.411226 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5172eb57-f042-4eab-a7b8-2922ad923f25 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:27.413621 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 77/155] 10.222.0.52 () {56 vars in 1101 bytes} [Sat May 14 20:49:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:27.419375 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1f9c0e-b1ef-44d7-a7e6-71e471cbd1b4 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:27.528159 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5172eb57-f042-4eab-a7b8-2922ad923f25 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:27.534903 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1f9c0e-b1ef-44d7-a7e6-71e471cbd1b4 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:27.567658 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a6831b-9820-4e24-8067-c74332ca0dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:27.568466 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6831b-9820-4e24-8067-c74332ca0dec None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:27.568756 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6831b-9820-4e24-8067-c74332ca0dec None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:27.569036 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6831b-9820-4e24-8067-c74332ca0dec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:27.576290 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf9cd9-58af-498e-b20c-857bb423c32b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:27.577213 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf9cd9-58af-498e-b20c-857bb423c32b None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:27.577440 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf9cd9-58af-498e-b20c-857bb423c32b None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:27.577713 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf9cd9-58af-498e-b20c-857bb423c32b None admin] PATH_INFO: `/v3/users/1f1ad598c0eb49f9a6bda831fba1c4e6` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:27.578978 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bf9cd9-58af-498e-b20c-857bb423c32b None admin] RBAC: Authorizing `identity:get_user(user_id=1f1ad598c0eb49f9a6bda831fba1c4e6)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:27.580508 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bf9cd9-58af-498e-b20c-857bb423c32b None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:27.582195 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 78/156] 10.222.0.52 () {56 vars in 1177 bytes} [Sat May 14 20:49:27 2022] GET /identity/v3/users/1f1ad598c0eb49f9a6bda831fba1c4e6 => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:49:27.582547 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a6831b-9820-4e24-8067-c74332ca0dec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:49:27.588481 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf9cd9-58af-498e-b20c-857bb423c32b None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:27.590576 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-41a6831b-9820-4e24-8067-c74332ca0dec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 14 20:49:27.590576 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:49:27.590576 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:49:27.590576 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:49:27.590576 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:49:27.590576 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:49:27.590576 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:49:27.590576 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:49:27.590576 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:49:27.590576 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:49:27.590576 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:49:27.590576 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:49:27.590576 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:49:27.590576 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:49:27.590576 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:49:27.590576 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:49:27.591403 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:49:27.591403 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:49:27.591403 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:49:27.591403 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:49:27.591403 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:49:27.591403 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:49:27.591403 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:49:27.591403 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:49:27.591403 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:49:27.591403 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:49:27.591403 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:49:27.591403 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:49:27.591403 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:49:27.591403 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:49:27.591403 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:49:27.591403 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:49:27.592203 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:49:27.592203 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:49:27.592203 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:49:27.592203 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:49:27.592203 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:49:27.592203 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:49:27.592203 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:49:27.592203 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:49:27.592203 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:49:27.592203 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:49:27.592203 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 14 20:49:27.592203 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:49:27.592203 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 79/157] 10.222.0.52 () {56 vars in 1096 bytes} [Sat May 14 20:49:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 20:49:27.597368 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a6831b-9820-4e24-8067-c74332ca0dec None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:27.712962 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a6831b-9820-4e24-8067-c74332ca0dec None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:27.730297 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf9cd9-58af-498e-b20c-857bb423c32b None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:27.767875 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588b478f-4c98-406a-ab14-94d7ccf00dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:27.768927 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b478f-4c98-406a-ab14-94d7ccf00dc4 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:27.769564 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b478f-4c98-406a-ab14-94d7ccf00dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:27.769841 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b478f-4c98-406a-ab14-94d7ccf00dc4 None admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:27.771159 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588b478f-4c98-406a-ab14-94d7ccf00dc4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:49:27.771462 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588b478f-4c98-406a-ab14-94d7ccf00dc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:27.772871 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588b478f-4c98-406a-ab14-94d7ccf00dc4 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:27.782266 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 80/158] 10.222.0.52 () {56 vars in 1099 bytes} [Sat May 14 20:49:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:49:27.788251 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588b478f-4c98-406a-ab14-94d7ccf00dc4 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:27.788951 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b2416e-84a3-436c-be26-3a4270c2862b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:27.789914 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b2416e-84a3-436c-be26-3a4270c2862b None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:27.790407 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b2416e-84a3-436c-be26-3a4270c2862b None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:27.791097 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b2416e-84a3-436c-be26-3a4270c2862b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:27.919680 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588b478f-4c98-406a-ab14-94d7ccf00dc4 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:27.952611 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b2416e-84a3-436c-be26-3a4270c2862b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:27.954333 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b2416e-84a3-436c-be26-3a4270c2862b None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:27.958600 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1eafc5-c5b5-40ef-a69a-67ba4063eff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:27.960509 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1eafc5-c5b5-40ef-a69a-67ba4063eff8 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:27.960930 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1eafc5-c5b5-40ef-a69a-67ba4063eff8 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:27.961313 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1eafc5-c5b5-40ef-a69a-67ba4063eff8 None admin] PATH_INFO: `/v3/users/9e6b0e25d0144f868beb29eb9540ea7e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:27.962697 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1eafc5-c5b5-40ef-a69a-67ba4063eff8 None admin] RBAC: Authorizing `identity:get_user(user_id=9e6b0e25d0144f868beb29eb9540ea7e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:27.964402 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1eafc5-c5b5-40ef-a69a-67ba4063eff8 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:27.966167 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 81/159] 10.222.0.52 () {56 vars in 1177 bytes} [Sat May 14 20:49:27 2022] GET /identity/v3/users/9e6b0e25d0144f868beb29eb9540ea7e => generated 247 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:49:27.972678 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1eafc5-c5b5-40ef-a69a-67ba4063eff8 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:28.089876 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1eafc5-c5b5-40ef-a69a-67ba4063eff8 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:28.139622 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb5343-58f4-4417-8985-c23c289011e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:28.139970 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 79/160] 10.222.0.52 () {58 vars in 1282 bytes} [Sat May 14 20:49:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 14 20:49:28.140292 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb5343-58f4-4417-8985-c23c289011e1 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:28.140587 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb5343-58f4-4417-8985-c23c289011e1 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:28.140869 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb5343-58f4-4417-8985-c23c289011e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:28.141297 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d948ca82-495e-41b7-a20d-5d753e26b756 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:28.141591 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d948ca82-495e-41b7-a20d-5d753e26b756 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:28.141870 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d948ca82-495e-41b7-a20d-5d753e26b756 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:28.143323 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 80/161] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:49:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:49:28.147881 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d948ca82-495e-41b7-a20d-5d753e26b756 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:28.224844 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fb5343-58f4-4417-8985-c23c289011e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:28.226709 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fb5343-58f4-4417-8985-c23c289011e1 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:28.254252 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d948ca82-495e-41b7-a20d-5d753e26b756 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:28.291258 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48661122-3872-4618-8b0a-e55a6e90f35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:28.292419 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48661122-3872-4618-8b0a-e55a6e90f35e None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:28.292856 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48661122-3872-4618-8b0a-e55a6e90f35e None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:28.293277 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48661122-3872-4618-8b0a-e55a6e90f35e None admin] PATH_INFO: `/v3/projects/f9f026156997408398ed32333f3c1d43` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:28.294643 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48661122-3872-4618-8b0a-e55a6e90f35e None admin] RBAC: Authorizing `identity:get_project(project_id=f9f026156997408398ed32333f3c1d43)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:28.296265 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48661122-3872-4618-8b0a-e55a6e90f35e None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:28.298132 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 81/162] 10.222.0.52 () {56 vars in 1186 bytes} [Sat May 14 20:49:28 2022] GET /identity/v3/projects/f9f026156997408398ed32333f3c1d43 => generated 312 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:28.299504 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a402e-6c5c-4b0f-a2c8-67228d263f18 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:28.299943 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a402e-6c5c-4b0f-a2c8-67228d263f18 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:28.300366 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a402e-6c5c-4b0f-a2c8-67228d263f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:28.321131 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-f77a402e-6c5c-4b0f-a2c8-67228d263f18 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:49:28.322564 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-f77a402e-6c5c-4b0f-a2c8-67228d263f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:49:28.341792 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 82/163] 10.222.0.52 () {58 vars in 1282 bytes} [Sat May 14 20:49:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 14 20:49:28.342765 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb5343-58f4-4417-8985-c23c289011e1 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:28.408844 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 82/164] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:49:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 20:49:28.410701 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c5c01-33f8-4b81-a33e-b234276e4188 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:28.411557 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c5c01-33f8-4b81-a33e-b234276e4188 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:28.411832 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c5c01-33f8-4b81-a33e-b234276e4188 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:28.413129 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 83/165] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:49:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:49:28.414067 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2c5c01-33f8-4b81-a33e-b234276e4188 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:28.467650 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb5343-58f4-4417-8985-c23c289011e1 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:28.504325 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de2b09-901b-4c10-a7ef-4dc8cc949dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:28.505020 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de2b09-901b-4c10-a7ef-4dc8cc949dbc None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:28.505302 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de2b09-901b-4c10-a7ef-4dc8cc949dbc None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:28.505577 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de2b09-901b-4c10-a7ef-4dc8cc949dbc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:28.506403 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06de2b09-901b-4c10-a7ef-4dc8cc949dbc None admin] RBAC: Adding query filter params (role.id=4f4cbb0efdc1410294a05a7ba44f9320, scope.project.id=f9f026156997408398ed32333f3c1d43, user.id=1f1ad598c0eb49f9a6bda831fba1c4e6) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:49:28.506710 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06de2b09-901b-4c10-a7ef-4dc8cc949dbc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:28.508213 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06de2b09-901b-4c10-a7ef-4dc8cc949dbc None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:28.514278 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 83/166] 10.222.0.52 () {56 vars in 1374 bytes} [Sat May 14 20:49:28 2022] GET /identity/v3/role_assignments?user.id=1f1ad598c0eb49f9a6bda831fba1c4e6&scope.project.id=f9f026156997408398ed32333f3c1d43&role.id=4f4cbb0efdc1410294a05a7ba44f9320 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:28.516179 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d3fbe-bb5e-4427-ab20-11e50d70c11b None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:28.516461 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d3fbe-bb5e-4427-ab20-11e50d70c11b None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:28.516734 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d3fbe-bb5e-4427-ab20-11e50d70c11b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:28.534771 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-0e9d3fbe-bb5e-4427-ab20-11e50d70c11b None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:49:28.536182 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-0e9d3fbe-bb5e-4427-ab20-11e50d70c11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:49:28.542348 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2c5c01-33f8-4b81-a33e-b234276e4188 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:28.584244 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec45b006-cc7b-495b-954b-dfe337463b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:28.585491 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec45b006-cc7b-495b-954b-dfe337463b23 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:28.585929 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec45b006-cc7b-495b-954b-dfe337463b23 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:28.586357 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec45b006-cc7b-495b-954b-dfe337463b23 None admin] PATH_INFO: `/v3/projects/c377a7cb474f47c8861e1c13e61ee22d` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:28.587907 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec45b006-cc7b-495b-954b-dfe337463b23 None admin] RBAC: Authorizing `identity:get_project(project_id=c377a7cb474f47c8861e1c13e61ee22d)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:28.589526 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec45b006-cc7b-495b-954b-dfe337463b23 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:28.592312 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 84/167] 10.222.0.52 () {56 vars in 1186 bytes} [Sat May 14 20:49:28 2022] GET /identity/v3/projects/c377a7cb474f47c8861e1c13e61ee22d => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:28.593336 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec45b006-cc7b-495b-954b-dfe337463b23 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:28.616601 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 84/168] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:49:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 20:49:28.620358 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9d3fbe-bb5e-4427-ab20-11e50d70c11b None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:28.733874 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec45b006-cc7b-495b-954b-dfe337463b23 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:28.774739 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc903ff-9da3-4de7-abd0-80f85468fc1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:28.776294 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc903ff-9da3-4de7-abd0-80f85468fc1d None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:28.776752 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc903ff-9da3-4de7-abd0-80f85468fc1d None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:28.777167 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc903ff-9da3-4de7-abd0-80f85468fc1d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:28.790176 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc903ff-9da3-4de7-abd0-80f85468fc1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:49:28.799841 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-8dc903ff-9da3-4de7-abd0-80f85468fc1d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 14 20:49:28.799841 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:49:28.799841 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:49:28.799841 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:49:28.799841 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:49:28.799841 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:49:28.799841 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:49:28.799841 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:49:28.799841 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:49:28.799841 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:49:28.799841 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:49:28.799841 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:49:28.799841 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:49:28.799841 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:49:28.799841 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:49:28.799841 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:49:28.800784 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:49:28.800784 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:49:28.800784 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:49:28.800784 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:49:28.800784 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:49:28.800784 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:49:28.800784 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:49:28.800784 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:49:28.800784 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:49:28.800784 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:49:28.800784 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:49:28.800784 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:49:28.800784 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:49:28.800784 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:49:28.800784 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:49:28.800784 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:49:28.802107 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:49:28.802107 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:49:28.802107 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:49:28.802107 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:49:28.802107 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:49:28.802107 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:49:28.802107 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:49:28.802107 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:49:28.802107 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:49:28.802107 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:49:28.802107 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 14 20:49:28.802107 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:49:28.804866 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 85/169] 10.222.0.52 () {56 vars in 1114 bytes} [Sat May 14 20:49:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:49:28.806091 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc903ff-9da3-4de7-abd0-80f85468fc1d None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:28.880903 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9d3fbe-bb5e-4427-ab20-11e50d70c11b None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:28.917507 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fded84-735f-4a78-bc61-7836c72b58f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:28.918342 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fded84-735f-4a78-bc61-7836c72b58f4 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:28.918725 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fded84-735f-4a78-bc61-7836c72b58f4 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:28.919102 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fded84-735f-4a78-bc61-7836c72b58f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:28.920098 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fded84-735f-4a78-bc61-7836c72b58f4 None admin] RBAC: Adding query filter params (role.id=24c463e2b4d44dd28cd2723a69a8ed2e, scope.project.id=c377a7cb474f47c8861e1c13e61ee22d, user.id=9e6b0e25d0144f868beb29eb9540ea7e) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:49:28.920618 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fded84-735f-4a78-bc61-7836c72b58f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:28.922082 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fded84-735f-4a78-bc61-7836c72b58f4 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:28.927156 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc903ff-9da3-4de7-abd0-80f85468fc1d None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:28.930599 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 85/170] 10.222.0.52 () {56 vars in 1374 bytes} [Sat May 14 20:49:28 2022] GET /identity/v3/role_assignments?user.id=9e6b0e25d0144f868beb29eb9540ea7e&scope.project.id=c377a7cb474f47c8861e1c13e61ee22d&role.id=24c463e2b4d44dd28cd2723a69a8ed2e => generated 608 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:28.931129 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fded84-735f-4a78-bc61-7836c72b58f4 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:28.973313 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f384a11-3a19-4e8e-bde6-bdfab2473ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:28.975004 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f384a11-3a19-4e8e-bde6-bdfab2473ab1 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:28.975428 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f384a11-3a19-4e8e-bde6-bdfab2473ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:28.975864 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f384a11-3a19-4e8e-bde6-bdfab2473ab1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:28.989028 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f384a11-3a19-4e8e-bde6-bdfab2473ab1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:49:28.997654 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-4f384a11-3a19-4e8e-bde6-bdfab2473ab1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 14 20:49:28.997654 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:49:28.997654 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:49:28.997654 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:49:28.997654 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:49:28.997654 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:49:28.997654 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:49:28.997654 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:49:28.997654 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:49:28.997654 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:49:28.997654 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:49:28.997654 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:49:28.997654 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:49:28.997654 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:49:28.997654 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:49:28.997654 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:49:28.998788 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:49:28.998788 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:49:28.998788 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:49:28.998788 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:49:28.998788 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:49:28.998788 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:49:28.998788 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:49:28.998788 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:49:28.998788 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:49:28.998788 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:49:28.998788 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:49:28.998788 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:49:28.998788 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:49:28.998788 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:49:28.998788 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:49:28.998788 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:49:28.999809 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:49:28.999809 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:49:28.999809 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:49:28.999809 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:49:28.999809 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:49:28.999809 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:49:28.999809 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:49:28.999809 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:49:28.999809 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:49:28.999809 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:49:28.999809 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 14 20:49:28.999809 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:49:29.002468 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 86/171] 10.222.0.52 () {56 vars in 1099 bytes} [Sat May 14 20:49:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:49:29.009999 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f384a11-3a19-4e8e-bde6-bdfab2473ab1 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:29.153925 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fded84-735f-4a78-bc61-7836c72b58f4 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:29.224620 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f384a11-3a19-4e8e-bde6-bdfab2473ab1 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:29.231888 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a885f8-2fc0-4da1-8172-e990a1f4fb60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:29.233184 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a885f8-2fc0-4da1-8172-e990a1f4fb60 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:29.233671 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a885f8-2fc0-4da1-8172-e990a1f4fb60 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:29.234152 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a885f8-2fc0-4da1-8172-e990a1f4fb60 None admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:29.235089 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a885f8-2fc0-4da1-8172-e990a1f4fb60 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:49:29.235612 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a885f8-2fc0-4da1-8172-e990a1f4fb60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:29.237177 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a885f8-2fc0-4da1-8172-e990a1f4fb60 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:29.250324 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 86/172] 10.222.0.52 () {56 vars in 1111 bytes} [Sat May 14 20:49:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:29.258846 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a885f8-2fc0-4da1-8172-e990a1f4fb60 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:29.307668 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bcebc5-cbf9-437b-a08e-cb855d44efd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:29.308347 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bcebc5-cbf9-437b-a08e-cb855d44efd0 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:29.308641 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bcebc5-cbf9-437b-a08e-cb855d44efd0 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:29.308918 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bcebc5-cbf9-437b-a08e-cb855d44efd0 None admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:29.310073 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bcebc5-cbf9-437b-a08e-cb855d44efd0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:49:29.310073 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bcebc5-cbf9-437b-a08e-cb855d44efd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:29.311350 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bcebc5-cbf9-437b-a08e-cb855d44efd0 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:29.326529 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 87/173] 10.222.0.52 () {56 vars in 1101 bytes} [Sat May 14 20:49:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:49:29.332207 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bcebc5-cbf9-437b-a08e-cb855d44efd0 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:29.407855 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a885f8-2fc0-4da1-8172-e990a1f4fb60 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:29.437782 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bcebc5-cbf9-437b-a08e-cb855d44efd0 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:29.445073 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b1fa03-d5e3-444d-80f9-8554917c517d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:29.445957 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b1fa03-d5e3-444d-80f9-8554917c517d None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:29.446240 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b1fa03-d5e3-444d-80f9-8554917c517d None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:29.446514 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b1fa03-d5e3-444d-80f9-8554917c517d None admin] PATH_INFO: `/v3/users/1f1ad598c0eb49f9a6bda831fba1c4e6` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:29.448041 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b1fa03-d5e3-444d-80f9-8554917c517d None admin] RBAC: Authorizing `identity:get_user(user_id=1f1ad598c0eb49f9a6bda831fba1c4e6)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:29.449513 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b1fa03-d5e3-444d-80f9-8554917c517d None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:29.451158 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 87/174] 10.222.0.52 () {56 vars in 1177 bytes} [Sat May 14 20:49:29 2022] GET /identity/v3/users/1f1ad598c0eb49f9a6bda831fba1c4e6 => generated 275 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:29.457386 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b1fa03-d5e3-444d-80f9-8554917c517d None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:29.501632 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dcd2ae-168b-46df-88b0-cafdcd8e9504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:29.502517 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dcd2ae-168b-46df-88b0-cafdcd8e9504 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:29.502802 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dcd2ae-168b-46df-88b0-cafdcd8e9504 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:29.503077 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dcd2ae-168b-46df-88b0-cafdcd8e9504 None admin] PATH_INFO: `/v3/users/ef29df6a67ab46cd9a34f4e37fe63bb8` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:29.506884 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dcd2ae-168b-46df-88b0-cafdcd8e9504 None admin] RBAC: Authorizing `identity:get_user(user_id=ef29df6a67ab46cd9a34f4e37fe63bb8)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:29.510472 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dcd2ae-168b-46df-88b0-cafdcd8e9504 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:29.512528 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 88/175] 10.222.0.52 () {56 vars in 1177 bytes} [Sat May 14 20:49:29 2022] GET /identity/v3/users/ef29df6a67ab46cd9a34f4e37fe63bb8 => generated 289 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:29.521363 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dcd2ae-168b-46df-88b0-cafdcd8e9504 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:29.650642 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b1fa03-d5e3-444d-80f9-8554917c517d None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:29.700643 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dcd2ae-168b-46df-88b0-cafdcd8e9504 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:29.733711 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f7cca-53f0-4e40-a0bc-aaee7875702a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:29.734356 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f7cca-53f0-4e40-a0bc-aaee7875702a None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:29.734634 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f7cca-53f0-4e40-a0bc-aaee7875702a None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:29.734909 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f7cca-53f0-4e40-a0bc-aaee7875702a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:29.755384 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad84be0d-89b2-4f4e-a4bd-f00b523cafe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:29.756268 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84be0d-89b2-4f4e-a4bd-f00b523cafe6 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:29.756546 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84be0d-89b2-4f4e-a4bd-f00b523cafe6 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:29.756818 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84be0d-89b2-4f4e-a4bd-f00b523cafe6 None admin] PATH_INFO: `/v3/projects/c377a7cb474f47c8861e1c13e61ee22d` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:29.759273 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad84be0d-89b2-4f4e-a4bd-f00b523cafe6 None admin] RBAC: Authorizing `identity:get_project(project_id=c377a7cb474f47c8861e1c13e61ee22d)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:29.760733 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad84be0d-89b2-4f4e-a4bd-f00b523cafe6 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:29.764041 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 89/176] 10.222.0.52 () {56 vars in 1186 bytes} [Sat May 14 20:49:29 2022] GET /identity/v3/projects/c377a7cb474f47c8861e1c13e61ee22d => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:49:29.769943 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad84be0d-89b2-4f4e-a4bd-f00b523cafe6 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:29.854718 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88f7cca-53f0-4e40-a0bc-aaee7875702a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:29.856264 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88f7cca-53f0-4e40-a0bc-aaee7875702a None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:29.941030 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad84be0d-89b2-4f4e-a4bd-f00b523cafe6 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:30.019031 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 88/177] 10.222.0.52 () {58 vars in 1282 bytes} [Sat May 14 20:49:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 14 20:49:30.023786 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6befa0-1e74-4ee7-a5f9-586ffb8c4957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:30.024700 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6befa0-1e74-4ee7-a5f9-586ffb8c4957 None admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:30.024987 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6befa0-1e74-4ee7-a5f9-586ffb8c4957 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:30.025263 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6befa0-1e74-4ee7-a5f9-586ffb8c4957 None admin] PATH_INFO: `/v3/projects/c377a7cb474f47c8861e1c13e61ee22d/users/ef29df6a67ab46cd9a34f4e37fe63bb8/roles/eecceaafa26e4f31a69165cbb855b327` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:30.026961 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f7cca-53f0-4e40-a0bc-aaee7875702a None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:30.036531 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6befa0-1e74-4ee7-a5f9-586ffb8c4957 None admin] RBAC: Authorizing `identity:create_grant(project_id=c377a7cb474f47c8861e1c13e61ee22d, user_id=ef29df6a67ab46cd9a34f4e37fe63bb8, role_id=eecceaafa26e4f31a69165cbb855b327)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:30.037983 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6befa0-1e74-4ee7-a5f9-586ffb8c4957 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:30.132681 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f7cca-53f0-4e40-a0bc-aaee7875702a None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:30.149516 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 90/178] 10.222.0.52 () {58 vars in 1439 bytes} [Sat May 14 20:49:29 2022] PUT /identity/v3/projects/c377a7cb474f47c8861e1c13e61ee22d/users/ef29df6a67ab46cd9a34f4e37fe63bb8/roles/eecceaafa26e4f31a69165cbb855b327 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 20:49:30.183290 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f35ea9-d1ec-4e60-ad89-ac0d103c648d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:30.184220 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f35ea9-d1ec-4e60-ad89-ac0d103c648d None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:30.184504 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f35ea9-d1ec-4e60-ad89-ac0d103c648d None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:30.184770 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f35ea9-d1ec-4e60-ad89-ac0d103c648d None admin] PATH_INFO: `/v3/projects/c377a7cb474f47c8861e1c13e61ee22d` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:30.186067 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f35ea9-d1ec-4e60-ad89-ac0d103c648d None admin] RBAC: Authorizing `identity:get_project(project_id=c377a7cb474f47c8861e1c13e61ee22d)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:30.187595 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f35ea9-d1ec-4e60-ad89-ac0d103c648d None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:30.189557 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 89/179] 10.222.0.52 () {56 vars in 1186 bytes} [Sat May 14 20:49:30 2022] GET /identity/v3/projects/c377a7cb474f47c8861e1c13e61ee22d => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:30.196110 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6befa0-1e74-4ee7-a5f9-586ffb8c4957 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:30.316514 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6befa0-1e74-4ee7-a5f9-586ffb8c4957 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:30.359260 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc196a9-9dc8-41e8-ae7b-4ce693e29cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:30.359961 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc196a9-9dc8-41e8-ae7b-4ce693e29cac None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:30.360244 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc196a9-9dc8-41e8-ae7b-4ce693e29cac None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:30.360517 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc196a9-9dc8-41e8-ae7b-4ce693e29cac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:30.361365 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc196a9-9dc8-41e8-ae7b-4ce693e29cac None admin] RBAC: Adding query filter params (role.id=274f900b5153444b84117bc9919443fc, scope.project.id=c377a7cb474f47c8861e1c13e61ee22d, user.id=1f1ad598c0eb49f9a6bda831fba1c4e6) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:49:30.361675 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc196a9-9dc8-41e8-ae7b-4ce693e29cac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:30.363143 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc196a9-9dc8-41e8-ae7b-4ce693e29cac None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:30.370568 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 91/180] 10.222.0.52 () {56 vars in 1374 bytes} [Sat May 14 20:49:30 2022] GET /identity/v3/role_assignments?user.id=1f1ad598c0eb49f9a6bda831fba1c4e6&scope.project.id=c377a7cb474f47c8861e1c13e61ee22d&role.id=274f900b5153444b84117bc9919443fc => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:30.611653 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63d25e-f469-4067-bbec-85f50dff82cd None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:30.611653 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63d25e-f469-4067-bbec-85f50dff82cd None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:30.611653 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63d25e-f469-4067-bbec-85f50dff82cd None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:30.612974 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 90/181] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:49:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:49:30.618887 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac000412-1ab0-4742-be33-73e67f1875c5 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:30.619516 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac000412-1ab0-4742-be33-73e67f1875c5 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:30.619516 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac000412-1ab0-4742-be33-73e67f1875c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:30.643556 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-ac000412-1ab0-4742-be33-73e67f1875c5 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:49:30.644748 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ac000412-1ab0-4742-be33-73e67f1875c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:49:30.723087 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 92/182] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:49:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 20:49:30.748362 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a63d25e-f469-4067-bbec-85f50dff82cd None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:30.867698 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a63d25e-f469-4067-bbec-85f50dff82cd None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:30.912416 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2170c09f-96a8-45e3-b5f1-91c81b271fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:30.913220 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170c09f-96a8-45e3-b5f1-91c81b271fdd None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:30.913503 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170c09f-96a8-45e3-b5f1-91c81b271fdd None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:30.913783 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170c09f-96a8-45e3-b5f1-91c81b271fdd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:30.939341 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2170c09f-96a8-45e3-b5f1-91c81b271fdd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:49:30.949960 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-2170c09f-96a8-45e3-b5f1-91c81b271fdd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 14 20:49:30.949960 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:49:30.949960 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:49:30.949960 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:49:30.949960 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:49:30.949960 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:49:30.949960 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:49:30.949960 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:49:30.949960 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:49:30.949960 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:49:30.949960 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:49:30.949960 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:49:30.949960 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:49:30.949960 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:49:30.949960 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:49:30.949960 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:49:30.952440 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:49:30.952440 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:49:30.952440 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:49:30.952440 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:49:30.952440 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:49:30.952440 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:49:30.952440 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:49:30.952440 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:49:30.952440 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:49:30.952440 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:49:30.952440 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:49:30.952440 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:49:30.952440 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:49:30.952440 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:49:30.952440 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:49:30.952440 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:49:30.959656 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:49:30.959656 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:49:30.959656 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:49:30.959656 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:49:30.959656 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:49:30.959656 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:49:30.959656 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:49:30.959656 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:49:30.959656 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:49:30.959656 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:49:30.959656 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 14 20:49:30.959656 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:49:30.959656 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 91/183] 10.222.0.52 () {56 vars in 1096 bytes} [Sat May 14 20:49:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:49:30.965299 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac000412-1ab0-4742-be33-73e67f1875c5 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:31.072558 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac000412-1ab0-4742-be33-73e67f1875c5 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:31.106427 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9422570c-a4a6-49ef-b538-e9f5cc82c470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:31.107098 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9422570c-a4a6-49ef-b538-e9f5cc82c470 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:31.107374 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9422570c-a4a6-49ef-b538-e9f5cc82c470 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:31.107673 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9422570c-a4a6-49ef-b538-e9f5cc82c470 None admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:31.108416 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9422570c-a4a6-49ef-b538-e9f5cc82c470 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:49:31.108717 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9422570c-a4a6-49ef-b538-e9f5cc82c470 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:31.110097 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9422570c-a4a6-49ef-b538-e9f5cc82c470 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:31.119126 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 93/184] 10.222.0.52 () {56 vars in 1099 bytes} [Sat May 14 20:49:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:31.124492 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2170c09f-96a8-45e3-b5f1-91c81b271fdd None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:31.214338 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9250bf73-e548-46f1-98ec-cc6397bef1cd None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:31.214631 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9250bf73-e548-46f1-98ec-cc6397bef1cd None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:31.215064 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9250bf73-e548-46f1-98ec-cc6397bef1cd None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:31.216584 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 94/185] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:49:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 14 20:49:31.221711 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e96c7-b989-4ccb-a9d0-74e72487f2db None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:31.222069 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e96c7-b989-4ccb-a9d0-74e72487f2db None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:31.222467 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e96c7-b989-4ccb-a9d0-74e72487f2db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:31.237509 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2170c09f-96a8-45e3-b5f1-91c81b271fdd None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:31.238842 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-513e96c7-b989-4ccb-a9d0-74e72487f2db None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:49:31.240926 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-513e96c7-b989-4ccb-a9d0-74e72487f2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:49:31.275763 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c16c7bb-3b90-4bb9-b9ad-da1a21aab218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:31.276744 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c16c7bb-3b90-4bb9-b9ad-da1a21aab218 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:31.277093 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c16c7bb-3b90-4bb9-b9ad-da1a21aab218 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:31.277423 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c16c7bb-3b90-4bb9-b9ad-da1a21aab218 None admin] PATH_INFO: `/v3/users/a8697253c4354c368024114b347a1c96` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:31.292705 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c16c7bb-3b90-4bb9-b9ad-da1a21aab218 None admin] RBAC: Authorizing `identity:get_user(user_id=a8697253c4354c368024114b347a1c96)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:31.294113 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c16c7bb-3b90-4bb9-b9ad-da1a21aab218 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:31.296221 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 92/186] 10.222.0.52 () {56 vars in 1177 bytes} [Sat May 14 20:49:31 2022] GET /identity/v3/users/a8697253c4354c368024114b347a1c96 => generated 283 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:31.301278 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c16c7bb-3b90-4bb9-b9ad-da1a21aab218 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:31.336313 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 95/187] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:49:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 14 20:49:31.363295 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e96c7-b989-4ccb-a9d0-74e72487f2db None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:31.412692 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c16c7bb-3b90-4bb9-b9ad-da1a21aab218 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:31.447645 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db5cc3c-dd6c-4ed0-86e9-874d22ba438b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:31.448294 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5cc3c-dd6c-4ed0-86e9-874d22ba438b None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:31.448576 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5cc3c-dd6c-4ed0-86e9-874d22ba438b None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:31.448853 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5cc3c-dd6c-4ed0-86e9-874d22ba438b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:31.466878 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e96c7-b989-4ccb-a9d0-74e72487f2db None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:31.500237 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e96bd-1180-414b-9954-d19bff940643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:31.501034 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e96bd-1180-414b-9954-d19bff940643 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:31.501313 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e96bd-1180-414b-9954-d19bff940643 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:31.501582 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e96bd-1180-414b-9954-d19bff940643 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:31.512288 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2e96bd-1180-414b-9954-d19bff940643 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:49:31.514952 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db5cc3c-dd6c-4ed0-86e9-874d22ba438b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:31.516462 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db5cc3c-dd6c-4ed0-86e9-874d22ba438b None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:31.520283 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-2b2e96bd-1180-414b-9954-d19bff940643 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 14 20:49:31.520283 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:49:31.520283 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:49:31.520283 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:49:31.520283 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:49:31.520283 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:49:31.520283 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:49:31.520283 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:49:31.520283 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:49:31.520283 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:49:31.520283 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:49:31.520283 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:49:31.520283 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:49:31.520283 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:49:31.520283 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:49:31.520283 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:49:31.521602 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:49:31.521602 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:49:31.521602 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:49:31.521602 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:49:31.521602 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:49:31.521602 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:49:31.521602 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:49:31.521602 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:49:31.521602 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:49:31.521602 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:49:31.521602 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:49:31.521602 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:49:31.521602 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:49:31.521602 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:49:31.521602 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:49:31.521602 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:49:31.522397 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:49:31.522397 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:49:31.522397 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:49:31.522397 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:49:31.522397 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:49:31.522397 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:49:31.522397 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:49:31.522397 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:49:31.522397 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:49:31.522397 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:49:31.522397 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 14 20:49:31.522397 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:49:31.522397 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 96/188] 10.222.0.52 () {56 vars in 1114 bytes} [Sat May 14 20:49:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 20:49:31.527441 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8c4aa8-0aae-4b27-a7c0-9ff267bc1feb None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:31.527751 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8c4aa8-0aae-4b27-a7c0-9ff267bc1feb None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:31.528034 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8c4aa8-0aae-4b27-a7c0-9ff267bc1feb None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:31.529330 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 97/189] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:49:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:49:31.529330 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8c4aa8-0aae-4b27-a7c0-9ff267bc1feb None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:31.631124 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 93/190] 10.222.0.52 () {58 vars in 1282 bytes} [Sat May 14 20:49:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 14 20:49:31.631124 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b9c98-e57f-4002-9d44-6ef0dd7eef37 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:31.631124 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b9c98-e57f-4002-9d44-6ef0dd7eef37 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:31.631124 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b9c98-e57f-4002-9d44-6ef0dd7eef37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:31.646956 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8c4aa8-0aae-4b27-a7c0-9ff267bc1feb None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:31.649801 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-850b9c98-e57f-4002-9d44-6ef0dd7eef37 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:49:31.650982 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-850b9c98-e57f-4002-9d44-6ef0dd7eef37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:49:31.681417 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcda3890-bdcc-4afc-942f-9642769280ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:31.682089 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda3890-bdcc-4afc-942f-9642769280ec None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:31.682372 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda3890-bdcc-4afc-942f-9642769280ec None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:31.682655 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda3890-bdcc-4afc-942f-9642769280ec None admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:31.683401 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcda3890-bdcc-4afc-942f-9642769280ec None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:49:31.683738 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcda3890-bdcc-4afc-942f-9642769280ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:31.685109 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcda3890-bdcc-4afc-942f-9642769280ec None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:31.693621 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 98/191] 10.222.0.52 () {56 vars in 1111 bytes} [Sat May 14 20:49:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:31.693621 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcda3890-bdcc-4afc-942f-9642769280ec None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:31.722009 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 94/192] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:49:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 20:49:31.722649 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850b9c98-e57f-4002-9d44-6ef0dd7eef37 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:31.805875 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcda3890-bdcc-4afc-942f-9642769280ec None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:31.822012 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850b9c98-e57f-4002-9d44-6ef0dd7eef37 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:31.840219 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4e131f-1610-433f-8ce7-7f45864871c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:31.841079 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e131f-1610-433f-8ce7-7f45864871c9 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:31.841365 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e131f-1610-433f-8ce7-7f45864871c9 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:31.841888 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e131f-1610-433f-8ce7-7f45864871c9 None admin] PATH_INFO: `/v3/projects/95e730a9930947c491bac8f909cc59c8` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:31.842832 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4e131f-1610-433f-8ce7-7f45864871c9 None admin] RBAC: Authorizing `identity:get_project(project_id=95e730a9930947c491bac8f909cc59c8)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:31.844300 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4e131f-1610-433f-8ce7-7f45864871c9 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:31.851606 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 99/193] 10.222.0.52 () {56 vars in 1186 bytes} [Sat May 14 20:49:31 2022] GET /identity/v3/projects/95e730a9930947c491bac8f909cc59c8 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:31.851606 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4e131f-1610-433f-8ce7-7f45864871c9 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:31.860129 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeab0bf-0c57-4bab-9e40-f02870dfae42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:31.861124 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeab0bf-0c57-4bab-9e40-f02870dfae42 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:31.861416 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeab0bf-0c57-4bab-9e40-f02870dfae42 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:31.861688 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeab0bf-0c57-4bab-9e40-f02870dfae42 None admin] PATH_INFO: `/v3/users/a8697253c4354c368024114b347a1c96` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:31.862871 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeab0bf-0c57-4bab-9e40-f02870dfae42 None admin] RBAC: Authorizing `identity:get_user(user_id=a8697253c4354c368024114b347a1c96)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:31.864380 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeab0bf-0c57-4bab-9e40-f02870dfae42 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:31.866186 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 95/194] 10.222.0.52 () {56 vars in 1177 bytes} [Sat May 14 20:49:31 2022] GET /identity/v3/users/a8697253c4354c368024114b347a1c96 => generated 283 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:31.866936 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeab0bf-0c57-4bab-9e40-f02870dfae42 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:31.951876 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4e131f-1610-433f-8ce7-7f45864871c9 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:31.967780 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeab0bf-0c57-4bab-9e40-f02870dfae42 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:31.986621 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2646efb1-341b-4505-864c-f40d9b0684fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:31.987794 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646efb1-341b-4505-864c-f40d9b0684fd None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:31.988662 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646efb1-341b-4505-864c-f40d9b0684fd None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:31.990381 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646efb1-341b-4505-864c-f40d9b0684fd None admin] PATH_INFO: `/v3/domains/default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:31.992212 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2646efb1-341b-4505-864c-f40d9b0684fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:31.994351 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2646efb1-341b-4505-864c-f40d9b0684fd None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:31.997168 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 100/195] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:49:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:31.998184 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2646efb1-341b-4505-864c-f40d9b0684fd None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:32.004467 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f9599f-a16e-44a5-ae76-58cd23839412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:32.005203 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f9599f-a16e-44a5-ae76-58cd23839412 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:32.005483 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f9599f-a16e-44a5-ae76-58cd23839412 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:32.005758 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f9599f-a16e-44a5-ae76-58cd23839412 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:32.006585 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f9599f-a16e-44a5-ae76-58cd23839412 None admin] RBAC: Adding query filter params (role.id=24c463e2b4d44dd28cd2723a69a8ed2e, scope.project.id=95e730a9930947c491bac8f909cc59c8, user.id=a8697253c4354c368024114b347a1c96) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:49:32.006898 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f9599f-a16e-44a5-ae76-58cd23839412 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:32.008388 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f9599f-a16e-44a5-ae76-58cd23839412 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:32.014332 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 96/196] 10.222.0.52 () {56 vars in 1374 bytes} [Sat May 14 20:49:31 2022] GET /identity/v3/role_assignments?user.id=a8697253c4354c368024114b347a1c96&scope.project.id=95e730a9930947c491bac8f909cc59c8&role.id=24c463e2b4d44dd28cd2723a69a8ed2e => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:32.024841 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f9599f-a16e-44a5-ae76-58cd23839412 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:32.125354 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2646efb1-341b-4505-864c-f40d9b0684fd None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:32.156152 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f9599f-a16e-44a5-ae76-58cd23839412 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:32.162731 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe46fde7-1145-4e87-881c-ed48236f5a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:32.163741 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe46fde7-1145-4e87-881c-ed48236f5a37 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:32.164213 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe46fde7-1145-4e87-881c-ed48236f5a37 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:32.164669 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe46fde7-1145-4e87-881c-ed48236f5a37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:32.203379 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc8e03c-2fce-4760-b169-26525e266a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:32.204008 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc8e03c-2fce-4760-b169-26525e266a46 None admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:32.204297 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc8e03c-2fce-4760-b169-26525e266a46 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:32.204576 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc8e03c-2fce-4760-b169-26525e266a46 None admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:32.205299 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc8e03c-2fce-4760-b169-26525e266a46 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:32.206768 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc8e03c-2fce-4760-b169-26525e266a46 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:32.240669 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe46fde7-1145-4e87-881c-ed48236f5a37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:32.242124 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe46fde7-1145-4e87-881c-ed48236f5a37 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:32.342332 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 101/197] 10.222.0.52 () {58 vars in 1282 bytes} [Sat May 14 20:49:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 14 20:49:32.347895 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe46fde7-1145-4e87-881c-ed48236f5a37 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:32.355867 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 97/198] 10.222.0.52 () {60 vars in 1132 bytes} [Sat May 14 20:49:32 2022] POST /identity/v3/users => generated 297 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 20:49:32.467132 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe46fde7-1145-4e87-881c-ed48236f5a37 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:32.509944 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d94fabc-a1b3-4b2a-bab2-18d0015635c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:32.511181 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94fabc-a1b3-4b2a-bab2-18d0015635c0 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:32.511722 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94fabc-a1b3-4b2a-bab2-18d0015635c0 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:32.512211 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94fabc-a1b3-4b2a-bab2-18d0015635c0 None admin] PATH_INFO: `/v3/projects/95e730a9930947c491bac8f909cc59c8` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:32.513705 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d94fabc-a1b3-4b2a-bab2-18d0015635c0 None admin] RBAC: Authorizing `identity:get_project(project_id=95e730a9930947c491bac8f909cc59c8)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:32.515370 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d94fabc-a1b3-4b2a-bab2-18d0015635c0 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:32.523629 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 102/199] 10.222.0.52 () {56 vars in 1186 bytes} [Sat May 14 20:49:32 2022] GET /identity/v3/projects/95e730a9930947c491bac8f909cc59c8 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:49:32.525604 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc8e03c-2fce-4760-b169-26525e266a46 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:32.636147 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc8e03c-2fce-4760-b169-26525e266a46 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:32.672326 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bd91bc-483c-476c-9f20-30d9d0529e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:32.673332 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd91bc-483c-476c-9f20-30d9d0529e3c None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:32.673817 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd91bc-483c-476c-9f20-30d9d0529e3c None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:32.674311 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd91bc-483c-476c-9f20-30d9d0529e3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:32.675337 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bd91bc-483c-476c-9f20-30d9d0529e3c None admin] RBAC: Adding query filter params (role.id=274f900b5153444b84117bc9919443fc, scope.project.id=95e730a9930947c491bac8f909cc59c8, user.id=a8697253c4354c368024114b347a1c96) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:49:32.675692 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bd91bc-483c-476c-9f20-30d9d0529e3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:32.677351 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bd91bc-483c-476c-9f20-30d9d0529e3c None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:32.686070 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 98/200] 10.222.0.52 () {56 vars in 1374 bytes} [Sat May 14 20:49:32 2022] GET /identity/v3/role_assignments?user.id=a8697253c4354c368024114b347a1c96&scope.project.id=95e730a9930947c491bac8f909cc59c8&role.id=274f900b5153444b84117bc9919443fc => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:32.824187 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5740349-6813-4060-9a4d-81eafa7bb71f None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:32.824682 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5740349-6813-4060-9a4d-81eafa7bb71f None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:32.824682 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5740349-6813-4060-9a4d-81eafa7bb71f None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:32.826276 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 103/201] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:49:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:49:32.831928 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8e7a1-86cd-436b-8096-289e4ae9059a None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:32.832237 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8e7a1-86cd-436b-8096-289e4ae9059a None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:32.832491 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8e7a1-86cd-436b-8096-289e4ae9059a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:32.851205 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-e6d8e7a1-86cd-436b-8096-289e4ae9059a None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:49:32.852446 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e6d8e7a1-86cd-436b-8096-289e4ae9059a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:49:32.933242 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 99/202] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:49:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 20:49:32.972840 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5740349-6813-4060-9a4d-81eafa7bb71f None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:33.097219 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5740349-6813-4060-9a4d-81eafa7bb71f None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:33.138184 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4644fd78-1be8-4bc8-b73a-98f297c089cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:33.138997 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4644fd78-1be8-4bc8-b73a-98f297c089cc None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:33.139278 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4644fd78-1be8-4bc8-b73a-98f297c089cc None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:33.139574 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4644fd78-1be8-4bc8-b73a-98f297c089cc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:33.157111 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4644fd78-1be8-4bc8-b73a-98f297c089cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:49:33.165723 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-4644fd78-1be8-4bc8-b73a-98f297c089cc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 14 20:49:33.165723 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:49:33.165723 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:49:33.165723 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:49:33.165723 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:49:33.165723 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:49:33.165723 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:49:33.165723 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:49:33.165723 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:49:33.165723 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:49:33.165723 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:49:33.165723 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:49:33.165723 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:49:33.165723 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:49:33.165723 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:49:33.165723 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:49:33.166643 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:49:33.166643 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:49:33.166643 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:49:33.166643 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:49:33.166643 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:49:33.166643 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:49:33.166643 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:49:33.166643 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:49:33.166643 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:49:33.166643 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:49:33.166643 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:49:33.166643 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:49:33.166643 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:49:33.166643 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:49:33.166643 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:49:33.166643 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:49:33.167435 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:49:33.167435 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:49:33.167435 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:49:33.167435 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:49:33.167435 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:49:33.167435 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:49:33.167435 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:49:33.167435 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:49:33.167435 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:49:33.167435 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:49:33.167435 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 14 20:49:33.167435 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:49:33.167435 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 104/203] 10.222.0.52 () {56 vars in 1099 bytes} [Sat May 14 20:49:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:49:33.173214 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d8e7a1-86cd-436b-8096-289e4ae9059a None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:33.299077 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d8e7a1-86cd-436b-8096-289e4ae9059a None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:33.342928 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d71d7c3-8649-44db-90f0-88c68e2889bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:33.343626 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d71d7c3-8649-44db-90f0-88c68e2889bb None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:33.343911 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d71d7c3-8649-44db-90f0-88c68e2889bb None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:33.344185 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d71d7c3-8649-44db-90f0-88c68e2889bb None admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:33.344937 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d71d7c3-8649-44db-90f0-88c68e2889bb None admin] RBAC: Adding query filter params (name=reader) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:49:33.345240 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d71d7c3-8649-44db-90f0-88c68e2889bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:33.346624 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d71d7c3-8649-44db-90f0-88c68e2889bb None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:33.356457 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 100/204] 10.222.0.52 () {56 vars in 1101 bytes} [Sat May 14 20:49:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:33.361811 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4644fd78-1be8-4bc8-b73a-98f297c089cc None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:33.500561 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4644fd78-1be8-4bc8-b73a-98f297c089cc None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:33.535394 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a1d081-2076-4331-af37-d273427293bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:33.537297 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a1d081-2076-4331-af37-d273427293bd None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:33.537576 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a1d081-2076-4331-af37-d273427293bd None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:33.537848 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a1d081-2076-4331-af37-d273427293bd None admin] PATH_INFO: `/v3/users/ef29df6a67ab46cd9a34f4e37fe63bb8` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:33.539059 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a1d081-2076-4331-af37-d273427293bd None admin] RBAC: Authorizing `identity:get_user(user_id=ef29df6a67ab46cd9a34f4e37fe63bb8)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:33.540620 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a1d081-2076-4331-af37-d273427293bd None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:33.544411 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 105/205] 10.222.0.52 () {56 vars in 1177 bytes} [Sat May 14 20:49:33 2022] GET /identity/v3/users/ef29df6a67ab46cd9a34f4e37fe63bb8 => generated 289 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:33.547767 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d71d7c3-8649-44db-90f0-88c68e2889bb None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:33.667855 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d71d7c3-8649-44db-90f0-88c68e2889bb None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:33.709829 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbb14d0-97cb-4b61-9a5b-f4bc2278e402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:33.710474 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb14d0-97cb-4b61-9a5b-f4bc2278e402 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:33.710753 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb14d0-97cb-4b61-9a5b-f4bc2278e402 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:33.711023 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb14d0-97cb-4b61-9a5b-f4bc2278e402 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:33.798782 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbb14d0-97cb-4b61-9a5b-f4bc2278e402 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:33.800268 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbb14d0-97cb-4b61-9a5b-f4bc2278e402 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:33.945839 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 101/206] 10.222.0.52 () {58 vars in 1282 bytes} [Sat May 14 20:49:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 14 20:49:33.951391 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a1d081-2076-4331-af37-d273427293bd None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:34.101662 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a1d081-2076-4331-af37-d273427293bd None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:34.143204 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b5134-3582-4fed-94bc-3b2905af14fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:34.144107 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b5134-3582-4fed-94bc-3b2905af14fc None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:34.144390 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b5134-3582-4fed-94bc-3b2905af14fc None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:34.144668 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b5134-3582-4fed-94bc-3b2905af14fc None admin] PATH_INFO: `/v3/projects/c377a7cb474f47c8861e1c13e61ee22d` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:34.146432 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15b5134-3582-4fed-94bc-3b2905af14fc None admin] RBAC: Authorizing `identity:get_project(project_id=c377a7cb474f47c8861e1c13e61ee22d)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:34.147906 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15b5134-3582-4fed-94bc-3b2905af14fc None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:34.149605 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 106/207] 10.222.0.52 () {56 vars in 1186 bytes} [Sat May 14 20:49:33 2022] GET /identity/v3/projects/c377a7cb474f47c8861e1c13e61ee22d => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:34.155390 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbb14d0-97cb-4b61-9a5b-f4bc2278e402 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:34.335002 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbb14d0-97cb-4b61-9a5b-f4bc2278e402 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:34.383692 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c0eeed-10c7-4baa-b22e-86ef0415b881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:34.384787 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c0eeed-10c7-4baa-b22e-86ef0415b881 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:34.385285 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c0eeed-10c7-4baa-b22e-86ef0415b881 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:34.385801 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c0eeed-10c7-4baa-b22e-86ef0415b881 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:34.386916 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c0eeed-10c7-4baa-b22e-86ef0415b881 None admin] RBAC: Adding query filter params (role.id=eecceaafa26e4f31a69165cbb855b327, scope.project.id=c377a7cb474f47c8861e1c13e61ee22d, user.id=ef29df6a67ab46cd9a34f4e37fe63bb8) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:49:34.387454 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c0eeed-10c7-4baa-b22e-86ef0415b881 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:34.389238 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c0eeed-10c7-4baa-b22e-86ef0415b881 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:34.400778 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 102/208] 10.222.0.52 () {56 vars in 1374 bytes} [Sat May 14 20:49:34 2022] GET /identity/v3/role_assignments?user.id=ef29df6a67ab46cd9a34f4e37fe63bb8&scope.project.id=c377a7cb474f47c8861e1c13e61ee22d&role.id=eecceaafa26e4f31a69165cbb855b327 => generated 608 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:34.593173 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc512ad-51d7-4d16-a95f-0f470f81aac8 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:34.593361 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc512ad-51d7-4d16-a95f-0f470f81aac8 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:34.593630 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc512ad-51d7-4d16-a95f-0f470f81aac8 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:34.595071 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 107/209] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:49:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:49:34.601341 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a81a4d0-0c9e-468d-a933-f2e1333014c5 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:34.602004 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a81a4d0-0c9e-468d-a933-f2e1333014c5 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:34.602531 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a81a4d0-0c9e-468d-a933-f2e1333014c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:34.627375 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-4a81a4d0-0c9e-468d-a933-f2e1333014c5 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:49:34.628985 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-4a81a4d0-0c9e-468d-a933-f2e1333014c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:49:34.717705 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 103/210] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:49:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 14 20:49:34.742463 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc512ad-51d7-4d16-a95f-0f470f81aac8 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:34.853359 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc512ad-51d7-4d16-a95f-0f470f81aac8 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:34.889034 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfa467c-7ef7-4803-a45a-1ab417956669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:34.890212 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfa467c-7ef7-4803-a45a-1ab417956669 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:34.890712 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfa467c-7ef7-4803-a45a-1ab417956669 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:34.891157 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfa467c-7ef7-4803-a45a-1ab417956669 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:34.904063 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfa467c-7ef7-4803-a45a-1ab417956669 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:49:34.912226 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-acfa467c-7ef7-4803-a45a-1ab417956669 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 14 20:49:34.912226 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:49:34.912226 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:49:34.912226 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:49:34.912226 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:49:34.912226 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:49:34.912226 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:49:34.912226 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:49:34.912226 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:49:34.912226 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:49:34.912226 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:49:34.912226 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:49:34.912226 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:49:34.912226 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:49:34.912226 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:49:34.912226 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:49:34.913097 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:49:34.913097 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:49:34.913097 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:49:34.913097 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:49:34.913097 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:49:34.913097 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:49:34.913097 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:49:34.913097 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:49:34.913097 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:49:34.913097 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:49:34.913097 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:49:34.913097 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:49:34.913097 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:49:34.913097 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:49:34.913097 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:49:34.913097 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:49:34.913891 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:49:34.913891 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:49:34.913891 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:49:34.913891 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:49:34.913891 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:49:34.913891 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:49:34.913891 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:49:34.913891 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:49:34.913891 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:49:34.913891 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:49:34.913891 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 14 20:49:34.913891 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:49:34.916520 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 108/211] 10.222.0.52 () {56 vars in 1096 bytes} [Sat May 14 20:49:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:49:34.922288 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a81a4d0-0c9e-468d-a933-f2e1333014c5 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:35.025427 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a81a4d0-0c9e-468d-a933-f2e1333014c5 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:35.060244 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2236a4e4-54d6-49a8-855d-9de4abfb5b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:35.060920 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2236a4e4-54d6-49a8-855d-9de4abfb5b86 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:35.061197 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2236a4e4-54d6-49a8-855d-9de4abfb5b86 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:35.061466 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2236a4e4-54d6-49a8-855d-9de4abfb5b86 None admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:35.062207 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2236a4e4-54d6-49a8-855d-9de4abfb5b86 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:49:35.062508 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2236a4e4-54d6-49a8-855d-9de4abfb5b86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:35.063923 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2236a4e4-54d6-49a8-855d-9de4abfb5b86 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:35.073247 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 104/212] 10.222.0.52 () {56 vars in 1099 bytes} [Sat May 14 20:49:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:35.078861 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfa467c-7ef7-4803-a45a-1ab417956669 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:35.185307 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfa467c-7ef7-4803-a45a-1ab417956669 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:35.223008 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97b7f0b-5d9b-444a-b75b-fd00f3c79993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:35.224603 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b7f0b-5d9b-444a-b75b-fd00f3c79993 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:35.224880 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b7f0b-5d9b-444a-b75b-fd00f3c79993 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:35.225152 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b7f0b-5d9b-444a-b75b-fd00f3c79993 None admin] PATH_INFO: `/v3/users/a8697253c4354c368024114b347a1c96` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:35.226689 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97b7f0b-5d9b-444a-b75b-fd00f3c79993 None admin] RBAC: Authorizing `identity:get_user(user_id=a8697253c4354c368024114b347a1c96)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:35.228318 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97b7f0b-5d9b-444a-b75b-fd00f3c79993 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:35.230149 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 109/213] 10.222.0.52 () {56 vars in 1177 bytes} [Sat May 14 20:49:35 2022] GET /identity/v3/users/a8697253c4354c368024114b347a1c96 => generated 283 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:35.236011 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2236a4e4-54d6-49a8-855d-9de4abfb5b86 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:35.340179 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2236a4e4-54d6-49a8-855d-9de4abfb5b86 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:35.374749 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc954518-97e2-42bd-94df-837b85fc86ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:35.375652 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc954518-97e2-42bd-94df-837b85fc86ba None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:35.375931 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc954518-97e2-42bd-94df-837b85fc86ba None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:35.376204 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc954518-97e2-42bd-94df-837b85fc86ba None admin] PATH_INFO: `/v3/projects/95e730a9930947c491bac8f909cc59c8` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:35.377386 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc954518-97e2-42bd-94df-837b85fc86ba None admin] RBAC: Authorizing `identity:get_project(project_id=95e730a9930947c491bac8f909cc59c8)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:35.378908 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc954518-97e2-42bd-94df-837b85fc86ba None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:35.380945 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 105/214] 10.222.0.52 () {56 vars in 1186 bytes} [Sat May 14 20:49:35 2022] GET /identity/v3/projects/95e730a9930947c491bac8f909cc59c8 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:35.386628 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97b7f0b-5d9b-444a-b75b-fd00f3c79993 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:35.413719 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc3cde2-87eb-406e-95bc-12364fe79843 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:35.414061 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc3cde2-87eb-406e-95bc-12364fe79843 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:35.414276 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc3cde2-87eb-406e-95bc-12364fe79843 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:35.416287 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 106/215] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:49:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 14 20:49:35.422529 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e8ec68-db88-40e2-b5ca-897998e4d6ca None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:35.423064 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e8ec68-db88-40e2-b5ca-897998e4d6ca None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:35.423587 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e8ec68-db88-40e2-b5ca-897998e4d6ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:35.441224 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-e0e8ec68-db88-40e2-b5ca-897998e4d6ca None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:49:35.443220 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e0e8ec68-db88-40e2-b5ca-897998e4d6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:49:35.499649 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97b7f0b-5d9b-444a-b75b-fd00f3c79993 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:35.515696 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 107/216] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:49:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 14 20:49:35.521324 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a93b1f-8116-4543-966f-4d55fc6cbbb8 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:35.522040 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a93b1f-8116-4543-966f-4d55fc6cbbb8 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:35.522507 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a93b1f-8116-4543-966f-4d55fc6cbbb8 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:35.524544 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 108/217] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:49:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:49:35.530091 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c7573-f61b-4e98-b8a7-764348d6452f None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:35.530378 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c7573-f61b-4e98-b8a7-764348d6452f None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:35.530650 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c7573-f61b-4e98-b8a7-764348d6452f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:35.541648 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a8740-d894-4857-bc37-63469a4b91f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:35.542971 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a8740-d894-4857-bc37-63469a4b91f2 None admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:35.543260 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a8740-d894-4857-bc37-63469a4b91f2 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:35.543573 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a8740-d894-4857-bc37-63469a4b91f2 None admin] PATH_INFO: `/v3/projects/95e730a9930947c491bac8f909cc59c8/users/a8697253c4354c368024114b347a1c96/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:35.545740 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44a8740-d894-4857-bc37-63469a4b91f2 None admin] RBAC: Authorizing `identity:create_grant(project_id=95e730a9930947c491bac8f909cc59c8, user_id=a8697253c4354c368024114b347a1c96, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:35.547188 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44a8740-d894-4857-bc37-63469a4b91f2 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:35.547674 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-aa5c7573-f61b-4e98-b8a7-764348d6452f None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:49:35.548832 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-aa5c7573-f61b-4e98-b8a7-764348d6452f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:49:35.607014 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 110/218] 10.222.0.52 () {58 vars in 1439 bytes} [Sat May 14 20:49:35 2022] PUT /identity/v3/projects/95e730a9930947c491bac8f909cc59c8/users/a8697253c4354c368024114b347a1c96/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 20:49:35.607746 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a8740-d894-4857-bc37-63469a4b91f2 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:35.625578 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 109/219] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:49:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 14 20:49:35.652166 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba11778-e550-4150-b6a1-87c303def1dc None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:35.652670 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba11778-e550-4150-b6a1-87c303def1dc None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:35.653188 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba11778-e550-4150-b6a1-87c303def1dc None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:35.655206 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 110/220] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:49:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 14 20:49:35.656276 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba11778-e550-4150-b6a1-87c303def1dc None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:35.732956 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a8740-d894-4857-bc37-63469a4b91f2 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:35.768781 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba11778-e550-4150-b6a1-87c303def1dc None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:35.772010 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a946c5-6bb8-4f06-9485-7c31a499f045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:35.773101 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a946c5-6bb8-4f06-9485-7c31a499f045 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:35.773582 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a946c5-6bb8-4f06-9485-7c31a499f045 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:35.774041 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a946c5-6bb8-4f06-9485-7c31a499f045 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:35.785403 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a946c5-6bb8-4f06-9485-7c31a499f045 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:49:35.794438 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-54a946c5-6bb8-4f06-9485-7c31a499f045 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 14 20:49:35.794438 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:49:35.794438 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:49:35.794438 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:49:35.794438 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:49:35.794438 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:49:35.794438 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:49:35.794438 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:49:35.794438 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:49:35.794438 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:49:35.794438 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:49:35.794438 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:49:35.794438 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:49:35.794438 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:49:35.794438 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:49:35.794438 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:49:35.795344 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:49:35.795344 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:49:35.795344 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:49:35.795344 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:49:35.795344 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:49:35.795344 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:49:35.795344 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:49:35.795344 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:49:35.795344 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:49:35.795344 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:49:35.795344 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:49:35.795344 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:49:35.795344 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:49:35.795344 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:49:35.795344 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:49:35.795344 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:49:35.796203 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:49:35.796203 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:49:35.796203 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:49:35.796203 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:49:35.796203 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:49:35.796203 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:49:35.796203 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:49:35.796203 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:49:35.796203 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:49:35.796203 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:49:35.796203 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 14 20:49:35.796203 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:49:35.796869 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 111/221] 10.222.0.52 () {56 vars in 1114 bytes} [Sat May 14 20:49:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:49:35.797614 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5142ef69-9685-49d9-b141-30307e923788 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:35.797907 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5142ef69-9685-49d9-b141-30307e923788 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:35.798192 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5142ef69-9685-49d9-b141-30307e923788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:35.813590 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfd4564-d2fc-443e-81be-82fcc393cf2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:35.814614 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd4564-d2fc-443e-81be-82fcc393cf2c None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:35.814897 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd4564-d2fc-443e-81be-82fcc393cf2c None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:35.815152 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd4564-d2fc-443e-81be-82fcc393cf2c None admin] PATH_INFO: `/v3/roles/member` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:35.816336 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-5142ef69-9685-49d9-b141-30307e923788 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:49:35.818085 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-5142ef69-9685-49d9-b141-30307e923788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:49:35.828782 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfd4564-d2fc-443e-81be-82fcc393cf2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:49:35.837458 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-fbfd4564-d2fc-443e-81be-82fcc393cf2c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 14 20:49:35.837458 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:49:35.837458 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:49:35.837458 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:49:35.837458 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:49:35.837458 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:49:35.837458 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:49:35.837458 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:49:35.837458 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:49:35.837458 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:49:35.837458 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:49:35.837458 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:49:35.837458 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:49:35.837458 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:49:35.837458 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:49:35.837458 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:49:35.838337 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:49:35.838337 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:49:35.838337 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:49:35.838337 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:49:35.838337 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:49:35.838337 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:49:35.838337 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:49:35.838337 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:49:35.838337 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:49:35.838337 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:49:35.838337 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:49:35.838337 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:49:35.838337 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:49:35.838337 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:49:35.838337 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:49:35.838337 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:49:35.839153 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:49:35.839153 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:49:35.839153 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:49:35.839153 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:49:35.839153 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:49:35.839153 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:49:35.839153 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:49:35.839153 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:49:35.839153 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:49:35.839153 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:49:35.839153 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 14 20:49:35.839153 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:49:35.839153 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 111/222] 10.222.0.52 () {56 vars in 1099 bytes} [Sat May 14 20:49:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:49:35.840382 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfd4564-d2fc-443e-81be-82fcc393cf2c None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:35.887887 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 112/223] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:49:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 20:49:35.889010 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5142ef69-9685-49d9-b141-30307e923788 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:35.961764 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfd4564-d2fc-443e-81be-82fcc393cf2c None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:35.996261 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5142ef69-9685-49d9-b141-30307e923788 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:36.005253 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f79b1e7-7d17-4876-8258-84b75c9171ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:36.005927 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79b1e7-7d17-4876-8258-84b75c9171ab None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:36.006213 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79b1e7-7d17-4876-8258-84b75c9171ab None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:36.006491 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79b1e7-7d17-4876-8258-84b75c9171ab None admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:36.007650 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f79b1e7-7d17-4876-8258-84b75c9171ab None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:49:36.007966 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f79b1e7-7d17-4876-8258-84b75c9171ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:36.009990 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f79b1e7-7d17-4876-8258-84b75c9171ab None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:36.020214 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 112/224] 10.222.0.52 () {56 vars in 1111 bytes} [Sat May 14 20:49:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:36.024944 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f79b1e7-7d17-4876-8258-84b75c9171ab None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:36.035717 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5668535f-2efd-443c-a7af-75eb568d0411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:36.036553 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5668535f-2efd-443c-a7af-75eb568d0411 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:36.036838 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5668535f-2efd-443c-a7af-75eb568d0411 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:36.037115 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5668535f-2efd-443c-a7af-75eb568d0411 None admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:36.037859 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5668535f-2efd-443c-a7af-75eb568d0411 None admin] RBAC: Adding query filter params (name=member) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:49:36.038164 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5668535f-2efd-443c-a7af-75eb568d0411 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:36.039565 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5668535f-2efd-443c-a7af-75eb568d0411 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:36.047880 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 113/225] 10.222.0.52 () {56 vars in 1101 bytes} [Sat May 14 20:49:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:36.047880 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5668535f-2efd-443c-a7af-75eb568d0411 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:36.132042 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f79b1e7-7d17-4876-8258-84b75c9171ab None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:36.148965 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5668535f-2efd-443c-a7af-75eb568d0411 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:36.168128 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8928062b-d414-43ca-b4c0-46d118c14b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:36.168918 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8928062b-d414-43ca-b4c0-46d118c14b5f None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:36.169199 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8928062b-d414-43ca-b4c0-46d118c14b5f None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:36.169470 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8928062b-d414-43ca-b4c0-46d118c14b5f None admin] PATH_INFO: `/v3/domains/default` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:36.170631 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8928062b-d414-43ca-b4c0-46d118c14b5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:36.172106 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8928062b-d414-43ca-b4c0-46d118c14b5f None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:36.179065 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 113/226] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:49:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:36.179065 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8928062b-d414-43ca-b4c0-46d118c14b5f None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:36.189469 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb0882-8e1c-4318-8e4d-249bdf9f4474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:36.190343 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb0882-8e1c-4318-8e4d-249bdf9f4474 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:36.190628 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb0882-8e1c-4318-8e4d-249bdf9f4474 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:36.190903 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb0882-8e1c-4318-8e4d-249bdf9f4474 None admin] PATH_INFO: `/v3/users/a8697253c4354c368024114b347a1c96` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:36.192699 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbb0882-8e1c-4318-8e4d-249bdf9f4474 None admin] RBAC: Authorizing `identity:get_user(user_id=a8697253c4354c368024114b347a1c96)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:36.194136 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbb0882-8e1c-4318-8e4d-249bdf9f4474 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:36.195950 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 114/227] 10.222.0.52 () {56 vars in 1177 bytes} [Sat May 14 20:49:36 2022] GET /identity/v3/users/a8697253c4354c368024114b347a1c96 => generated 283 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:36.196611 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb0882-8e1c-4318-8e4d-249bdf9f4474 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:36.295133 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8928062b-d414-43ca-b4c0-46d118c14b5f None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:36.295305 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb0882-8e1c-4318-8e4d-249bdf9f4474 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:36.328164 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1904a9ab-365d-400d-8cdf-093484dd2314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:36.328835 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1904a9ab-365d-400d-8cdf-093484dd2314 None admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:36.329121 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1904a9ab-365d-400d-8cdf-093484dd2314 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:36.329396 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1904a9ab-365d-400d-8cdf-093484dd2314 None admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:36.330153 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1904a9ab-365d-400d-8cdf-093484dd2314 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:36.331822 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1904a9ab-365d-400d-8cdf-093484dd2314 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:36.335008 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab14b098-2604-415f-81d4-9e1453698833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:36.336133 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14b098-2604-415f-81d4-9e1453698833 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:36.336623 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14b098-2604-415f-81d4-9e1453698833 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:36.337100 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14b098-2604-415f-81d4-9e1453698833 None admin] PATH_INFO: `/v3/users/5fa64f3849cb4726a0ba6e7aa88f134d` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:36.354775 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab14b098-2604-415f-81d4-9e1453698833 None admin] RBAC: Authorizing `identity:get_user(user_id=5fa64f3849cb4726a0ba6e7aa88f134d)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:36.356264 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab14b098-2604-415f-81d4-9e1453698833 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:36.357976 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 114/228] 10.222.0.52 () {56 vars in 1177 bytes} [Sat May 14 20:49:36 2022] GET /identity/v3/users/5fa64f3849cb4726a0ba6e7aa88f134d => generated 297 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:36.359927 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab14b098-2604-415f-81d4-9e1453698833 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:36.440970 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 115/229] 10.222.0.52 () {60 vars in 1132 bytes} [Sat May 14 20:49:36 2022] POST /identity/v3/users => generated 297 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 20:49:36.453041 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1904a9ab-365d-400d-8cdf-093484dd2314 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:36.461162 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab14b098-2604-415f-81d4-9e1453698833 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:36.499657 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093af812-1780-49c1-b2da-4fa68630ce61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:36.500553 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093af812-1780-49c1-b2da-4fa68630ce61 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:36.500835 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093af812-1780-49c1-b2da-4fa68630ce61 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:36.501107 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093af812-1780-49c1-b2da-4fa68630ce61 None admin] PATH_INFO: `/v3/projects/95e730a9930947c491bac8f909cc59c8` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:36.502481 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093af812-1780-49c1-b2da-4fa68630ce61 None admin] RBAC: Authorizing `identity:get_project(project_id=95e730a9930947c491bac8f909cc59c8)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:36.504122 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093af812-1780-49c1-b2da-4fa68630ce61 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:36.511751 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 115/230] 10.222.0.52 () {56 vars in 1186 bytes} [Sat May 14 20:49:36 2022] GET /identity/v3/projects/95e730a9930947c491bac8f909cc59c8 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:36.512673 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093af812-1780-49c1-b2da-4fa68630ce61 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:36.573392 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1904a9ab-365d-400d-8cdf-093484dd2314 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:36.610959 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f9e287-1a42-4678-9504-5fe86d61be22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:36.612084 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9e287-1a42-4678-9504-5fe86d61be22 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:36.612593 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9e287-1a42-4678-9504-5fe86d61be22 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:36.613086 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9e287-1a42-4678-9504-5fe86d61be22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:36.621201 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093af812-1780-49c1-b2da-4fa68630ce61 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:36.662584 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29d7a03-d378-4367-95ae-bc58a9916dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:36.663532 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d7a03-d378-4367-95ae-bc58a9916dae None admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:36.663813 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d7a03-d378-4367-95ae-bc58a9916dae None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:36.664089 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d7a03-d378-4367-95ae-bc58a9916dae None admin] PATH_INFO: `/v3/projects/95e730a9930947c491bac8f909cc59c8/users/a8697253c4354c368024114b347a1c96/roles/274f900b5153444b84117bc9919443fc` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:36.669163 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29d7a03-d378-4367-95ae-bc58a9916dae None admin] RBAC: Authorizing `identity:create_grant(project_id=95e730a9930947c491bac8f909cc59c8, user_id=a8697253c4354c368024114b347a1c96, role_id=274f900b5153444b84117bc9919443fc)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:36.670633 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29d7a03-d378-4367-95ae-bc58a9916dae None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:36.687134 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f9e287-1a42-4678-9504-5fe86d61be22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:36.688984 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f9e287-1a42-4678-9504-5fe86d61be22 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:36.741004 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 116/231] 10.222.0.52 () {58 vars in 1439 bytes} [Sat May 14 20:49:36 2022] PUT /identity/v3/projects/95e730a9930947c491bac8f909cc59c8/users/a8697253c4354c368024114b347a1c96/roles/274f900b5153444b84117bc9919443fc => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 20:49:36.799772 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 116/232] 10.222.0.52 () {58 vars in 1282 bytes} [Sat May 14 20:49:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 14 20:49:36.806532 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29d7a03-d378-4367-95ae-bc58a9916dae None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:36.927826 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29d7a03-d378-4367-95ae-bc58a9916dae None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:36.969596 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99134f84-f9df-48ea-a84d-becc37834b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:36.970529 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99134f84-f9df-48ea-a84d-becc37834b4a None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:36.970808 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99134f84-f9df-48ea-a84d-becc37834b4a None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:36.971076 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99134f84-f9df-48ea-a84d-becc37834b4a None admin] PATH_INFO: `/v3/projects/95e730a9930947c491bac8f909cc59c8` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:36.972314 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99134f84-f9df-48ea-a84d-becc37834b4a None admin] RBAC: Authorizing `identity:get_project(project_id=95e730a9930947c491bac8f909cc59c8)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:36.974631 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99134f84-f9df-48ea-a84d-becc37834b4a None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:36.976397 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 117/233] 10.222.0.52 () {56 vars in 1186 bytes} [Sat May 14 20:49:36 2022] GET /identity/v3/projects/95e730a9930947c491bac8f909cc59c8 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:36.982329 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f9e287-1a42-4678-9504-5fe86d61be22 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:37.105954 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f9e287-1a42-4678-9504-5fe86d61be22 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:37.162923 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9499b23a-caee-4541-9e03-8520728c7f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:37.164359 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9499b23a-caee-4541-9e03-8520728c7f56 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:37.164817 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9499b23a-caee-4541-9e03-8520728c7f56 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:37.165261 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9499b23a-caee-4541-9e03-8520728c7f56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:37.166252 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9499b23a-caee-4541-9e03-8520728c7f56 None admin] RBAC: Adding query filter params (role.id=4f4cbb0efdc1410294a05a7ba44f9320, scope.project.id=95e730a9930947c491bac8f909cc59c8, user.id=5fa64f3849cb4726a0ba6e7aa88f134d) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:49:37.166733 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9499b23a-caee-4541-9e03-8520728c7f56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:37.168378 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9499b23a-caee-4541-9e03-8520728c7f56 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:37.179965 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 117/234] 10.222.0.52 () {56 vars in 1374 bytes} [Sat May 14 20:49:36 2022] GET /identity/v3/role_assignments?user.id=5fa64f3849cb4726a0ba6e7aa88f134d&scope.project.id=95e730a9930947c491bac8f909cc59c8&role.id=4f4cbb0efdc1410294a05a7ba44f9320 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:37.975828 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04b5ca-544a-479c-a0b0-55944131ada6 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:37.976360 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04b5ca-544a-479c-a0b0-55944131ada6 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:37.976360 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04b5ca-544a-479c-a0b0-55944131ada6 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:37.977988 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 118/235] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:49:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:49:37.983324 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc2361-04fa-447c-a110-62d9b7fe7bb9 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:37.983668 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc2361-04fa-447c-a110-62d9b7fe7bb9 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:37.983957 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc2361-04fa-447c-a110-62d9b7fe7bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:38.008787 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-b3dc2361-04fa-447c-a110-62d9b7fe7bb9 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:49:38.009990 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b3dc2361-04fa-447c-a110-62d9b7fe7bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:49:38.108588 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 118/236] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:49:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 20:49:38.145590 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab04b5ca-544a-479c-a0b0-55944131ada6 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:38.289450 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab04b5ca-544a-479c-a0b0-55944131ada6 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:38.337546 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef853e00-96e0-464f-9f38-3e4aa2ed9a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:38.338352 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef853e00-96e0-464f-9f38-3e4aa2ed9a12 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:38.338636 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef853e00-96e0-464f-9f38-3e4aa2ed9a12 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:38.338911 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef853e00-96e0-464f-9f38-3e4aa2ed9a12 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:38.353470 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef853e00-96e0-464f-9f38-3e4aa2ed9a12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:49:38.361301 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-ef853e00-96e0-464f-9f38-3e4aa2ed9a12 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 14 20:49:38.361301 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:49:38.361301 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:49:38.361301 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:49:38.361301 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:49:38.361301 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:49:38.361301 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:49:38.361301 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:49:38.361301 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:49:38.361301 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:49:38.361301 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:49:38.361301 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:49:38.361301 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:49:38.361301 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:49:38.361301 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:49:38.361301 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:49:38.362171 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:49:38.362171 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:49:38.362171 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:49:38.362171 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:49:38.362171 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:49:38.362171 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:49:38.362171 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:49:38.362171 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:49:38.362171 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:49:38.362171 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:49:38.362171 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:49:38.362171 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:49:38.362171 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:49:38.362171 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:49:38.362171 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:49:38.362171 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:49:38.362962 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:49:38.362962 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:49:38.362962 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:49:38.362962 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:49:38.362962 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:49:38.362962 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:49:38.362962 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:49:38.362962 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:49:38.362962 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:49:38.362962 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:49:38.362962 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 14 20:49:38.362962 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:49:38.367067 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 119/237] 10.222.0.52 () {56 vars in 1096 bytes} [Sat May 14 20:49:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:49:38.368490 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dc2361-04fa-447c-a110-62d9b7fe7bb9 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:38.521395 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dc2361-04fa-447c-a110-62d9b7fe7bb9 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:38.566920 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaabc9a-a07b-4c13-a336-af82f0662a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:38.568043 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaabc9a-a07b-4c13-a336-af82f0662a8f None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:38.568545 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaabc9a-a07b-4c13-a336-af82f0662a8f None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:38.569014 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaabc9a-a07b-4c13-a336-af82f0662a8f None admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:38.569950 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaabc9a-a07b-4c13-a336-af82f0662a8f None admin] RBAC: Adding query filter params (name=admin) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:49:38.570459 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaabc9a-a07b-4c13-a336-af82f0662a8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:38.572099 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaabc9a-a07b-4c13-a336-af82f0662a8f None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:38.585002 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 119/238] 10.222.0.52 () {56 vars in 1099 bytes} [Sat May 14 20:49:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:38.590785 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef853e00-96e0-464f-9f38-3e4aa2ed9a12 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:38.714612 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef853e00-96e0-464f-9f38-3e4aa2ed9a12 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:38.754997 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6534d26-844b-476e-abb6-fc116952390f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:38.755904 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6534d26-844b-476e-abb6-fc116952390f None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:38.756184 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6534d26-844b-476e-abb6-fc116952390f None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:38.756460 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6534d26-844b-476e-abb6-fc116952390f None admin] PATH_INFO: `/v3/users/a8697253c4354c368024114b347a1c96` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:38.757685 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6534d26-844b-476e-abb6-fc116952390f None admin] RBAC: Authorizing `identity:get_user(user_id=a8697253c4354c368024114b347a1c96)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:38.759162 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6534d26-844b-476e-abb6-fc116952390f None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:38.761123 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 120/239] 10.222.0.52 () {56 vars in 1177 bytes} [Sat May 14 20:49:38 2022] GET /identity/v3/users/a8697253c4354c368024114b347a1c96 => generated 283 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:38.766718 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaabc9a-a07b-4c13-a336-af82f0662a8f None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:38.894023 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaabc9a-a07b-4c13-a336-af82f0662a8f None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:38.936504 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59164c78-b27e-4499-b891-d58f43100a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:38.937172 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59164c78-b27e-4499-b891-d58f43100a32 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:38.937458 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59164c78-b27e-4499-b891-d58f43100a32 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:38.937737 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59164c78-b27e-4499-b891-d58f43100a32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:39.035034 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59164c78-b27e-4499-b891-d58f43100a32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:39.036976 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59164c78-b27e-4499-b891-d58f43100a32 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:39.170313 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 120/240] 10.222.0.52 () {58 vars in 1282 bytes} [Sat May 14 20:49:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 14 20:49:39.176206 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6534d26-844b-476e-abb6-fc116952390f None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:39.336787 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6534d26-844b-476e-abb6-fc116952390f None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:39.388848 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a36edd-79b4-4b88-9e03-34c9456c8b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:39.389720 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a36edd-79b4-4b88-9e03-34c9456c8b3a None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:39.390009 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a36edd-79b4-4b88-9e03-34c9456c8b3a None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:39.390287 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a36edd-79b4-4b88-9e03-34c9456c8b3a None admin] PATH_INFO: `/v3/projects/95e730a9930947c491bac8f909cc59c8` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:39.396212 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a36edd-79b4-4b88-9e03-34c9456c8b3a None admin] RBAC: Authorizing `identity:get_project(project_id=95e730a9930947c491bac8f909cc59c8)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:39.397740 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a36edd-79b4-4b88-9e03-34c9456c8b3a None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:39.399761 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 121/241] 10.222.0.52 () {56 vars in 1186 bytes} [Sat May 14 20:49:39 2022] GET /identity/v3/projects/95e730a9930947c491bac8f909cc59c8 => generated 302 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:39.405862 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59164c78-b27e-4499-b891-d58f43100a32 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:39.453246 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2a0f2-c4b6-4e75-9bac-10551afdf101 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:39.453590 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2a0f2-c4b6-4e75-9bac-10551afdf101 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:39.453808 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2a0f2-c4b6-4e75-9bac-10551afdf101 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:39.455263 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 122/242] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:49:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 14 20:49:39.486423 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940d6d7-e4dd-40bc-badf-6a630451e20b None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:39.486726 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940d6d7-e4dd-40bc-badf-6a630451e20b None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:39.486984 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940d6d7-e4dd-40bc-badf-6a630451e20b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:39.517615 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-a940d6d7-e4dd-40bc-badf-6a630451e20b None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:49:39.518825 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-a940d6d7-e4dd-40bc-badf-6a630451e20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:49:39.542052 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59164c78-b27e-4499-b891-d58f43100a32 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:39.578881 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784268e5-5f89-4220-a156-5835348fbd6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:39.581682 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784268e5-5f89-4220-a156-5835348fbd6a None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:39.581985 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784268e5-5f89-4220-a156-5835348fbd6a None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:39.582270 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784268e5-5f89-4220-a156-5835348fbd6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:39.583423 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784268e5-5f89-4220-a156-5835348fbd6a None admin] RBAC: Adding query filter params (role.id=24c463e2b4d44dd28cd2723a69a8ed2e, scope.project.id=95e730a9930947c491bac8f909cc59c8, user.id=a8697253c4354c368024114b347a1c96) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:49:39.583764 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784268e5-5f89-4220-a156-5835348fbd6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:39.587593 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784268e5-5f89-4220-a156-5835348fbd6a None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:39.599259 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 121/243] 10.222.0.52 () {56 vars in 1374 bytes} [Sat May 14 20:49:39 2022] GET /identity/v3/role_assignments?user.id=a8697253c4354c368024114b347a1c96&scope.project.id=95e730a9930947c491bac8f909cc59c8&role.id=24c463e2b4d44dd28cd2723a69a8ed2e => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:39.637725 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 123/244] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:49:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 14 20:49:39.646517 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20fbd1-9a16-4332-b9ee-dcfa7b87a406 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:39.646806 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20fbd1-9a16-4332-b9ee-dcfa7b87a406 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:39.647081 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20fbd1-9a16-4332-b9ee-dcfa7b87a406 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:39.661738 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 122/245] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:49:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:49:39.661951 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd0b82a-aeb5-48de-9c28-b82e02e7dc60 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:39.661951 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd0b82a-aeb5-48de-9c28-b82e02e7dc60 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:39.661951 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd0b82a-aeb5-48de-9c28-b82e02e7dc60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:39.672442 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20fbd1-9a16-4332-b9ee-dcfa7b87a406 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:39.686084 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-8cd0b82a-aeb5-48de-9c28-b82e02e7dc60 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:49:39.687357 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8cd0b82a-aeb5-48de-9c28-b82e02e7dc60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:49:39.775682 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 124/246] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:49:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 20:49:39.800466 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd0b82a-aeb5-48de-9c28-b82e02e7dc60 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:39.869179 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20fbd1-9a16-4332-b9ee-dcfa7b87a406 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:39.909470 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f8f587-5494-4870-9229-a065896da7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:39.910582 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8f587-5494-4870-9229-a065896da7ce None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:39.911046 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8f587-5494-4870-9229-a065896da7ce None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:39.911517 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8f587-5494-4870-9229-a065896da7ce None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:39.923913 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f8f587-5494-4870-9229-a065896da7ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:49:39.932422 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-a6f8f587-5494-4870-9229-a065896da7ce None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 14 20:49:39.932422 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:49:39.932422 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:49:39.932422 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:49:39.932422 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:49:39.932422 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:49:39.932422 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:49:39.932422 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:49:39.932422 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:49:39.932422 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:49:39.932422 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:49:39.932422 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:49:39.932422 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:49:39.932422 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:49:39.932422 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:49:39.932422 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:49:39.933327 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:49:39.933327 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:49:39.933327 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:49:39.933327 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:49:39.933327 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:49:39.933327 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:49:39.933327 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:49:39.933327 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:49:39.933327 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:49:39.933327 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:49:39.933327 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:49:39.933327 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:49:39.933327 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:49:39.933327 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:49:39.933327 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:49:39.933327 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:49:39.934609 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:49:39.934609 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:49:39.934609 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:49:39.934609 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:49:39.934609 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:49:39.934609 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:49:39.934609 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:49:39.934609 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:49:39.934609 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:49:39.934609 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:49:39.934609 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 14 20:49:39.934609 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:49:39.935204 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd0b82a-aeb5-48de-9c28-b82e02e7dc60 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:39.938621 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 123/247] 10.222.0.52 () {56 vars in 1099 bytes} [Sat May 14 20:49:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 20:49:39.943583 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4372968-489e-4430-9dc6-5f6b5ab5eef8 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:39.943583 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4372968-489e-4430-9dc6-5f6b5ab5eef8 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:39.943583 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4372968-489e-4430-9dc6-5f6b5ab5eef8 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:39.943583 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 124/248] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:49:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:49:39.943908 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4372968-489e-4430-9dc6-5f6b5ab5eef8 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:39.981044 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4419136d-01d6-4678-9a01-f4e8abeb74eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:39.981855 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4419136d-01d6-4678-9a01-f4e8abeb74eb None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:39.984694 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4419136d-01d6-4678-9a01-f4e8abeb74eb None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:39.984694 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4419136d-01d6-4678-9a01-f4e8abeb74eb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:39.995146 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4419136d-01d6-4678-9a01-f4e8abeb74eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:49:40.003542 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-4419136d-01d6-4678-9a01-f4e8abeb74eb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 14 20:49:40.003542 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:49:40.003542 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:49:40.003542 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:49:40.003542 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:49:40.003542 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:49:40.003542 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:49:40.003542 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:49:40.003542 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:49:40.003542 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:49:40.003542 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:49:40.003542 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:49:40.003542 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:49:40.003542 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:49:40.003542 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:49:40.003542 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:49:40.004589 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:49:40.004589 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:49:40.004589 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:49:40.004589 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:49:40.004589 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:49:40.004589 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:49:40.004589 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:49:40.004589 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:49:40.004589 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:49:40.004589 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:49:40.004589 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:49:40.004589 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:49:40.004589 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:49:40.004589 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:49:40.004589 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:49:40.004589 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:49:40.005486 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:49:40.005486 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:49:40.005486 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:49:40.005486 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:49:40.005486 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:49:40.005486 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:49:40.005486 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:49:40.005486 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:49:40.005486 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:49:40.005486 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:49:40.005486 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 14 20:49:40.005486 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:49:40.005486 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 125/249] 10.222.0.52 () {56 vars in 1114 bytes} [Sat May 14 20:49:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 20:49:40.008643 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0323b0-9416-47ab-a0a0-be3ff7de14d4 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:40.008940 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0323b0-9416-47ab-a0a0-be3ff7de14d4 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:40.009504 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0323b0-9416-47ab-a0a0-be3ff7de14d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:40.026363 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-8e0323b0-9416-47ab-a0a0-be3ff7de14d4 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:49:40.027444 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8e0323b0-9416-47ab-a0a0-be3ff7de14d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:49:40.059973 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4372968-489e-4430-9dc6-5f6b5ab5eef8 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:40.096055 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d6cac-ef05-4924-8c53-be9d0e4cee7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:40.096719 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d6cac-ef05-4924-8c53-be9d0e4cee7c None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:40.097025 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d6cac-ef05-4924-8c53-be9d0e4cee7c None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:40.097303 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d6cac-ef05-4924-8c53-be9d0e4cee7c None admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:40.098596 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736d6cac-ef05-4924-8c53-be9d0e4cee7c None admin] RBAC: Adding query filter params (name=reader) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:49:40.098907 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736d6cac-ef05-4924-8c53-be9d0e4cee7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:40.100348 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736d6cac-ef05-4924-8c53-be9d0e4cee7c None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:40.101905 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 126/250] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:49:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 20:49:40.102826 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0323b0-9416-47ab-a0a0-be3ff7de14d4 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:40.119319 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 125/251] 10.222.0.52 () {56 vars in 1101 bytes} [Sat May 14 20:49:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:40.124273 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d6cac-ef05-4924-8c53-be9d0e4cee7c None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:40.205025 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0323b0-9416-47ab-a0a0-be3ff7de14d4 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:40.229325 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d6cac-ef05-4924-8c53-be9d0e4cee7c None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:40.242346 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b4e415-1ea8-4cf0-9312-34a9d2b8ad92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:40.243137 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b4e415-1ea8-4cf0-9312-34a9d2b8ad92 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:40.243513 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b4e415-1ea8-4cf0-9312-34a9d2b8ad92 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:40.243808 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b4e415-1ea8-4cf0-9312-34a9d2b8ad92 None admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:40.244559 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b4e415-1ea8-4cf0-9312-34a9d2b8ad92 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:49:40.244869 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b4e415-1ea8-4cf0-9312-34a9d2b8ad92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:40.246533 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b4e415-1ea8-4cf0-9312-34a9d2b8ad92 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:40.255406 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 127/252] 10.222.0.52 () {56 vars in 1111 bytes} [Sat May 14 20:49:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:40.256420 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b4e415-1ea8-4cf0-9312-34a9d2b8ad92 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:40.264926 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c5ad39-c222-4db1-be9d-99a5cec9178a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:40.265785 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5ad39-c222-4db1-be9d-99a5cec9178a None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:40.266068 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5ad39-c222-4db1-be9d-99a5cec9178a None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:40.266341 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5ad39-c222-4db1-be9d-99a5cec9178a None admin] PATH_INFO: `/v3/users/4a8d109e64a0433c96c2cb994f277d9d` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:40.281468 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c5ad39-c222-4db1-be9d-99a5cec9178a None admin] RBAC: Authorizing `identity:get_user(user_id=4a8d109e64a0433c96c2cb994f277d9d)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:40.282845 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c5ad39-c222-4db1-be9d-99a5cec9178a None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:40.284588 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 126/253] 10.222.0.52 () {56 vars in 1177 bytes} [Sat May 14 20:49:40 2022] GET /identity/v3/users/4a8d109e64a0433c96c2cb994f277d9d => generated 297 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:49:40.286605 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9b8f5-ebd6-4640-a49d-3931304313ac None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:40.286605 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9b8f5-ebd6-4640-a49d-3931304313ac None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:40.286945 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9b8f5-ebd6-4640-a49d-3931304313ac None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:40.288309 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 127/254] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:49:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:49:40.289029 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e9b8f5-ebd6-4640-a49d-3931304313ac None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:40.356221 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b4e415-1ea8-4cf0-9312-34a9d2b8ad92 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:40.389522 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5b48e4-02fa-4aaf-86da-ea3f96787723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:40.390437 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b48e4-02fa-4aaf-86da-ea3f96787723 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:40.390717 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b48e4-02fa-4aaf-86da-ea3f96787723 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:40.390989 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b48e4-02fa-4aaf-86da-ea3f96787723 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:40.392053 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e9b8f5-ebd6-4640-a49d-3931304313ac None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:40.392187 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5b48e4-02fa-4aaf-86da-ea3f96787723 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:40.393627 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5b48e4-02fa-4aaf-86da-ea3f96787723 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:40.395269 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 128/255] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:49:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:40.396173 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5b48e4-02fa-4aaf-86da-ea3f96787723 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:40.427299 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004f5971-108b-453e-911a-c05a0d0e702e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:40.428191 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f5971-108b-453e-911a-c05a0d0e702e None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:40.428468 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f5971-108b-453e-911a-c05a0d0e702e None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:40.428738 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f5971-108b-453e-911a-c05a0d0e702e None admin] PATH_INFO: `/v3/users/a8697253c4354c368024114b347a1c96` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:40.429915 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004f5971-108b-453e-911a-c05a0d0e702e None admin] RBAC: Authorizing `identity:get_user(user_id=a8697253c4354c368024114b347a1c96)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:40.431338 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004f5971-108b-453e-911a-c05a0d0e702e None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:40.437356 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 128/256] 10.222.0.52 () {56 vars in 1177 bytes} [Sat May 14 20:49:40 2022] GET /identity/v3/users/a8697253c4354c368024114b347a1c96 => generated 283 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:40.437356 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7517ad-1b5e-4da8-9842-77dd502a8e38 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:40.437356 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7517ad-1b5e-4da8-9842-77dd502a8e38 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:40.437356 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7517ad-1b5e-4da8-9842-77dd502a8e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:40.450481 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-ff7517ad-1b5e-4da8-9842-77dd502a8e38 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:49:40.451670 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ff7517ad-1b5e-4da8-9842-77dd502a8e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:49:40.491964 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5b48e4-02fa-4aaf-86da-ea3f96787723 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:40.515705 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 129/257] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:49:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 20:49:40.516957 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7517ad-1b5e-4da8-9842-77dd502a8e38 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:40.529599 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2395d000-6904-4a34-8d71-798e8dc2e73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:40.530253 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395d000-6904-4a34-8d71-798e8dc2e73c None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:40.530544 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395d000-6904-4a34-8d71-798e8dc2e73c None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:40.530826 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395d000-6904-4a34-8d71-798e8dc2e73c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:40.596799 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2395d000-6904-4a34-8d71-798e8dc2e73c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:40.598939 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2395d000-6904-4a34-8d71-798e8dc2e73c None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:40.613599 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7517ad-1b5e-4da8-9842-77dd502a8e38 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:40.648229 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a243f698-cc87-4809-95cb-4b197e826d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:40.648900 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243f698-cc87-4809-95cb-4b197e826d9f None admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:40.649186 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243f698-cc87-4809-95cb-4b197e826d9f None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:40.649459 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243f698-cc87-4809-95cb-4b197e826d9f None admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:40.650156 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a243f698-cc87-4809-95cb-4b197e826d9f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:40.651641 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a243f698-cc87-4809-95cb-4b197e826d9f None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:40.694949 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 129/258] 10.222.0.52 () {58 vars in 1282 bytes} [Sat May 14 20:49:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 14 20:49:40.695810 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2395d000-6904-4a34-8d71-798e8dc2e73c None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:40.755118 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 130/259] 10.222.0.52 () {60 vars in 1132 bytes} [Sat May 14 20:49:40 2022] POST /identity/v3/users => generated 293 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 20:49:40.763752 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a243f698-cc87-4809-95cb-4b197e826d9f None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:40.796716 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2395d000-6904-4a34-8d71-798e8dc2e73c None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:40.838674 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c1f832-97f1-4170-997d-025471c27b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:40.839381 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c1f832-97f1-4170-997d-025471c27b46 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:40.839747 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c1f832-97f1-4170-997d-025471c27b46 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:40.840068 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c1f832-97f1-4170-997d-025471c27b46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:40.881843 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a243f698-cc87-4809-95cb-4b197e826d9f None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:40.916881 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c1f832-97f1-4170-997d-025471c27b46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:40.919325 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c1f832-97f1-4170-997d-025471c27b46 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:40.923906 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd46010c-acd2-467f-8359-92a870a3c702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:40.924786 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46010c-acd2-467f-8359-92a870a3c702 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:40.925267 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46010c-acd2-467f-8359-92a870a3c702 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:40.925549 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46010c-acd2-467f-8359-92a870a3c702 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:40.938378 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd46010c-acd2-467f-8359-92a870a3c702 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:49:40.946909 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-bd46010c-acd2-467f-8359-92a870a3c702 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 14 20:49:40.946909 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:49:40.946909 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:49:40.946909 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:49:40.946909 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:49:40.946909 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:49:40.946909 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:49:40.946909 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:49:40.946909 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:49:40.946909 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:49:40.946909 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:49:40.946909 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:49:40.946909 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:49:40.946909 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:49:40.946909 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:49:40.946909 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:49:40.947986 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:49:40.947986 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:49:40.947986 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:49:40.947986 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:49:40.947986 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:49:40.947986 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:49:40.947986 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:49:40.947986 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:49:40.947986 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:49:40.947986 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:49:40.947986 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:49:40.947986 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:49:40.947986 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:49:40.947986 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:49:40.947986 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:49:40.947986 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:49:40.948772 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:49:40.948772 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:49:40.948772 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:49:40.948772 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:49:40.948772 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:49:40.948772 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:49:40.948772 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:49:40.948772 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:49:40.948772 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:49:40.948772 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:49:40.948772 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 14 20:49:40.948772 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:49:40.954994 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 131/260] 10.222.0.52 () {56 vars in 1099 bytes} [Sat May 14 20:49:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:49:40.954994 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd46010c-acd2-467f-8359-92a870a3c702 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:41.031535 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 130/261] 10.222.0.52 () {58 vars in 1282 bytes} [Sat May 14 20:49:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 14 20:49:41.032985 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c1f832-97f1-4170-997d-025471c27b46 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:41.080630 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd46010c-acd2-467f-8359-92a870a3c702 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:41.122295 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c66bde-54e7-4ebd-93f9-d49eed8362f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:41.123157 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c66bde-54e7-4ebd-93f9-d49eed8362f5 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:41.123443 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c66bde-54e7-4ebd-93f9-d49eed8362f5 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:41.123757 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c66bde-54e7-4ebd-93f9-d49eed8362f5 None admin] PATH_INFO: `/v3/projects/95e730a9930947c491bac8f909cc59c8` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:41.124962 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c66bde-54e7-4ebd-93f9-d49eed8362f5 None admin] RBAC: Authorizing `identity:get_project(project_id=95e730a9930947c491bac8f909cc59c8)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:41.126532 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c66bde-54e7-4ebd-93f9-d49eed8362f5 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:41.128461 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 132/262] 10.222.0.52 () {56 vars in 1186 bytes} [Sat May 14 20:49:40 2022] GET /identity/v3/projects/95e730a9930947c491bac8f909cc59c8 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:41.129075 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c66bde-54e7-4ebd-93f9-d49eed8362f5 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:41.150000 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c1f832-97f1-4170-997d-025471c27b46 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:41.194212 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36cb6f2-55b3-435e-b24b-ad6b7ab02512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:41.195714 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36cb6f2-55b3-435e-b24b-ad6b7ab02512 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:41.196477 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36cb6f2-55b3-435e-b24b-ad6b7ab02512 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:41.196952 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36cb6f2-55b3-435e-b24b-ad6b7ab02512 None admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:41.198354 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36cb6f2-55b3-435e-b24b-ad6b7ab02512 None admin] RBAC: Adding query filter params (name=member) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:49:41.199151 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36cb6f2-55b3-435e-b24b-ad6b7ab02512 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:41.200769 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36cb6f2-55b3-435e-b24b-ad6b7ab02512 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:41.212622 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 131/263] 10.222.0.52 () {56 vars in 1101 bytes} [Sat May 14 20:49:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:41.214630 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36cb6f2-55b3-435e-b24b-ad6b7ab02512 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:41.239512 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c66bde-54e7-4ebd-93f9-d49eed8362f5 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:41.274023 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ba7eb4-5497-4eab-b601-4eb1f3a4a48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:41.274901 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba7eb4-5497-4eab-b601-4eb1f3a4a48d None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:41.275410 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba7eb4-5497-4eab-b601-4eb1f3a4a48d None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:41.275538 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba7eb4-5497-4eab-b601-4eb1f3a4a48d None admin] PATH_INFO: `/v3/projects/95e730a9930947c491bac8f909cc59c8` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:41.276757 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ba7eb4-5497-4eab-b601-4eb1f3a4a48d None admin] RBAC: Authorizing `identity:get_project(project_id=95e730a9930947c491bac8f909cc59c8)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:41.278183 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ba7eb4-5497-4eab-b601-4eb1f3a4a48d None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:41.279900 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 133/264] 10.222.0.52 () {56 vars in 1186 bytes} [Sat May 14 20:49:41 2022] GET /identity/v3/projects/95e730a9930947c491bac8f909cc59c8 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:41.280891 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ba7eb4-5497-4eab-b601-4eb1f3a4a48d None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:41.343385 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36cb6f2-55b3-435e-b24b-ad6b7ab02512 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:41.384612 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ba7eb4-5497-4eab-b601-4eb1f3a4a48d None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:41.386816 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f868b4b-bb27-4061-b4fe-93dcfd8383b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:41.388236 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f868b4b-bb27-4061-b4fe-93dcfd8383b3 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:41.388529 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f868b4b-bb27-4061-b4fe-93dcfd8383b3 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:41.388807 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f868b4b-bb27-4061-b4fe-93dcfd8383b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:41.389663 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f868b4b-bb27-4061-b4fe-93dcfd8383b3 None admin] RBAC: Adding query filter params (role.id=eecceaafa26e4f31a69165cbb855b327, scope.project.id=95e730a9930947c491bac8f909cc59c8, user.id=4a8d109e64a0433c96c2cb994f277d9d) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:49:41.389973 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f868b4b-bb27-4061-b4fe-93dcfd8383b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:41.391445 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f868b4b-bb27-4061-b4fe-93dcfd8383b3 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:41.400614 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 132/265] 10.222.0.52 () {56 vars in 1374 bytes} [Sat May 14 20:49:41 2022] GET /identity/v3/role_assignments?user.id=4a8d109e64a0433c96c2cb994f277d9d&scope.project.id=95e730a9930947c491bac8f909cc59c8&role.id=eecceaafa26e4f31a69165cbb855b327 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:41.401685 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f868b4b-bb27-4061-b4fe-93dcfd8383b3 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:41.445914 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e070443-8397-42a8-9622-3dc36c86dc61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:41.446931 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e070443-8397-42a8-9622-3dc36c86dc61 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:41.447217 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e070443-8397-42a8-9622-3dc36c86dc61 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:41.447516 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e070443-8397-42a8-9622-3dc36c86dc61 None admin] PATH_INFO: `/v3/users/5fa64f3849cb4726a0ba6e7aa88f134d` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:41.448849 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e070443-8397-42a8-9622-3dc36c86dc61 None admin] RBAC: Authorizing `identity:get_user(user_id=5fa64f3849cb4726a0ba6e7aa88f134d)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:41.450371 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e070443-8397-42a8-9622-3dc36c86dc61 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:41.460995 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 134/266] 10.222.0.52 () {56 vars in 1177 bytes} [Sat May 14 20:49:41 2022] GET /identity/v3/users/5fa64f3849cb4726a0ba6e7aa88f134d => generated 297 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:41.466082 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e070443-8397-42a8-9622-3dc36c86dc61 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:41.538924 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f868b4b-bb27-4061-b4fe-93dcfd8383b3 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:41.584094 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eef3f85-4e79-469f-801f-a5fb521f1967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:41.584094 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef3f85-4e79-469f-801f-a5fb521f1967 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:41.584094 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef3f85-4e79-469f-801f-a5fb521f1967 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:41.584094 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef3f85-4e79-469f-801f-a5fb521f1967 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:41.584523 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eef3f85-4e79-469f-801f-a5fb521f1967 None admin] RBAC: Adding query filter params (role.id=274f900b5153444b84117bc9919443fc, scope.project.id=95e730a9930947c491bac8f909cc59c8, user.id=a8697253c4354c368024114b347a1c96) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:49:41.584523 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eef3f85-4e79-469f-801f-a5fb521f1967 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:41.589137 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eef3f85-4e79-469f-801f-a5fb521f1967 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:41.604983 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 133/267] 10.222.0.52 () {56 vars in 1374 bytes} [Sat May 14 20:49:41 2022] GET /identity/v3/role_assignments?user.id=a8697253c4354c368024114b347a1c96&scope.project.id=95e730a9930947c491bac8f909cc59c8&role.id=274f900b5153444b84117bc9919443fc => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:41.658016 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e070443-8397-42a8-9622-3dc36c86dc61 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:41.705906 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362c6ea9-3b4e-4390-8a00-3692155d9072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:41.706790 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c6ea9-3b4e-4390-8a00-3692155d9072 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:41.707075 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c6ea9-3b4e-4390-8a00-3692155d9072 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:41.707427 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c6ea9-3b4e-4390-8a00-3692155d9072 None admin] PATH_INFO: `/v3/projects/95e730a9930947c491bac8f909cc59c8` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:41.709062 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362c6ea9-3b4e-4390-8a00-3692155d9072 None admin] RBAC: Authorizing `identity:get_project(project_id=95e730a9930947c491bac8f909cc59c8)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:41.710574 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362c6ea9-3b4e-4390-8a00-3692155d9072 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:41.712387 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 135/268] 10.222.0.52 () {56 vars in 1186 bytes} [Sat May 14 20:49:41 2022] GET /identity/v3/projects/95e730a9930947c491bac8f909cc59c8 => generated 302 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:49:41.718437 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eef3f85-4e79-469f-801f-a5fb521f1967 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:41.862291 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eef3f85-4e79-469f-801f-a5fb521f1967 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:41.896690 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1859a498-bfdc-4051-9edb-082b1679e919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:41.897573 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1859a498-bfdc-4051-9edb-082b1679e919 None admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:41.897856 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1859a498-bfdc-4051-9edb-082b1679e919 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:41.898135 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1859a498-bfdc-4051-9edb-082b1679e919 None admin] PATH_INFO: `/v3/projects/95e730a9930947c491bac8f909cc59c8/users/5fa64f3849cb4726a0ba6e7aa88f134d/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:41.900253 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1859a498-bfdc-4051-9edb-082b1679e919 None admin] RBAC: Authorizing `identity:create_grant(project_id=95e730a9930947c491bac8f909cc59c8, user_id=5fa64f3849cb4726a0ba6e7aa88f134d, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:41.901717 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1859a498-bfdc-4051-9edb-082b1679e919 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:41.997853 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 134/269] 10.222.0.52 () {58 vars in 1439 bytes} [Sat May 14 20:49:41 2022] PUT /identity/v3/projects/95e730a9930947c491bac8f909cc59c8/users/5fa64f3849cb4726a0ba6e7aa88f134d/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 20:49:43.302908 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f4f5df-557c-4044-b7c7-a97d17d3e095 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:43.303406 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f4f5df-557c-4044-b7c7-a97d17d3e095 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:43.303406 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f4f5df-557c-4044-b7c7-a97d17d3e095 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:43.305411 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 136/270] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:49:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:49:43.306077 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ba38f-fade-49b1-b4d6-bbff1ad14f51 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:43.306456 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ba38f-fade-49b1-b4d6-bbff1ad14f51 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:43.306648 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ba38f-fade-49b1-b4d6-bbff1ad14f51 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:43.308107 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 135/271] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:49:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 14 20:49:43.311203 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6fb647-941a-4455-b443-e413d1c4e601 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:43.311507 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6fb647-941a-4455-b443-e413d1c4e601 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:43.311935 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6fb647-941a-4455-b443-e413d1c4e601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:43.313012 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d60b483-7555-4b85-971f-279640f3b905 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:43.313303 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d60b483-7555-4b85-971f-279640f3b905 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:43.313585 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d60b483-7555-4b85-971f-279640f3b905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:43.329746 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-4c6fb647-941a-4455-b443-e413d1c4e601 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:49:43.330940 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-4c6fb647-941a-4455-b443-e413d1c4e601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:49:43.331146 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-5d60b483-7555-4b85-971f-279640f3b905 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:49:43.333051 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-5d60b483-7555-4b85-971f-279640f3b905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:49:43.402266 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 136/272] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:49:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 14 20:49:43.417037 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 137/273] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:49:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 14 20:49:43.428795 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d60b483-7555-4b85-971f-279640f3b905 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:43.443368 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6fb647-941a-4455-b443-e413d1c4e601 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:43.530212 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d60b483-7555-4b85-971f-279640f3b905 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:43.545195 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6fb647-941a-4455-b443-e413d1c4e601 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:43.564796 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf3877-44a0-4eef-9cf3-97a9d94df07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:43.565554 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf3877-44a0-4eef-9cf3-97a9d94df07f None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:43.565838 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf3877-44a0-4eef-9cf3-97a9d94df07f None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:43.566127 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf3877-44a0-4eef-9cf3-97a9d94df07f None admin] PATH_INFO: `/v3/domains/default` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:43.567362 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bf3877-44a0-4eef-9cf3-97a9d94df07f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:43.568849 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bf3877-44a0-4eef-9cf3-97a9d94df07f None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:43.570489 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 137/274] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:49:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:43.575785 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf3877-44a0-4eef-9cf3-97a9d94df07f None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:43.586019 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a758f7-5551-49d3-9ec8-acd696b46867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:43.586815 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a758f7-5551-49d3-9ec8-acd696b46867 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:43.587103 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a758f7-5551-49d3-9ec8-acd696b46867 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:43.587380 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a758f7-5551-49d3-9ec8-acd696b46867 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:43.597950 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a758f7-5551-49d3-9ec8-acd696b46867 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:49:43.605631 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-15a758f7-5551-49d3-9ec8-acd696b46867 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 14 20:49:43.605631 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:49:43.605631 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:49:43.605631 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:49:43.605631 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:49:43.605631 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:49:43.605631 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:49:43.605631 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:49:43.605631 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:49:43.605631 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:49:43.605631 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:49:43.605631 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:49:43.605631 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:49:43.605631 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:49:43.605631 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:49:43.605631 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:49:43.607721 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:49:43.607721 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:49:43.607721 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:49:43.607721 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:49:43.607721 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:49:43.607721 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:49:43.607721 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:49:43.607721 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:49:43.607721 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:49:43.607721 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:49:43.607721 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:49:43.607721 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:49:43.607721 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:49:43.607721 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:49:43.607721 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:49:43.607721 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:49:43.609656 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:49:43.609656 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:49:43.609656 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:49:43.609656 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:49:43.609656 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:49:43.609656 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:49:43.609656 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:49:43.609656 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:49:43.609656 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:49:43.609656 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:49:43.609656 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 14 20:49:43.609656 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:49:43.619543 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 138/275] 10.222.0.52 () {56 vars in 1099 bytes} [Sat May 14 20:49:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:49:43.619543 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a758f7-5551-49d3-9ec8-acd696b46867 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:43.676893 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf3877-44a0-4eef-9cf3-97a9d94df07f None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:43.712036 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f739206-df21-41f8-b86d-5ad001b76ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:43.713157 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f739206-df21-41f8-b86d-5ad001b76ec3 None admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:43.713572 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f739206-df21-41f8-b86d-5ad001b76ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:43.713856 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f739206-df21-41f8-b86d-5ad001b76ec3 None admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:43.714576 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f739206-df21-41f8-b86d-5ad001b76ec3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:43.715456 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a758f7-5551-49d3-9ec8-acd696b46867 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:43.716108 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f739206-df21-41f8-b86d-5ad001b76ec3 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:43.754702 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8404f9af-d905-40bf-b57e-51f8173f523a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:43.755639 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8404f9af-d905-40bf-b57e-51f8173f523a None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:43.756060 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8404f9af-d905-40bf-b57e-51f8173f523a None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:43.756407 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8404f9af-d905-40bf-b57e-51f8173f523a None admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:43.757240 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8404f9af-d905-40bf-b57e-51f8173f523a None admin] RBAC: Adding query filter params (name=member) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:49:43.757619 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8404f9af-d905-40bf-b57e-51f8173f523a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:43.759120 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8404f9af-d905-40bf-b57e-51f8173f523a None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:43.767973 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 139/276] 10.222.0.52 () {56 vars in 1101 bytes} [Sat May 14 20:49:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:49:43.774363 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8404f9af-d905-40bf-b57e-51f8173f523a None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:43.791952 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 138/277] 10.222.0.52 () {60 vars in 1132 bytes} [Sat May 14 20:49:43 2022] POST /identity/v3/users => generated 293 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 20:49:43.893004 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8404f9af-d905-40bf-b57e-51f8173f523a None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:43.935504 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e2d4b-b70a-4bbe-a58e-d2551e0164e9 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:43.935504 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e2d4b-b70a-4bbe-a58e-d2551e0164e9 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:43.935504 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e2d4b-b70a-4bbe-a58e-d2551e0164e9 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:43.936332 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173fe3c1-805e-41cf-9fa6-915cd3ee0417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:43.936428 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 139/278] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:49:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 14 20:49:43.936497 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173fe3c1-805e-41cf-9fa6-915cd3ee0417 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:43.936497 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173fe3c1-805e-41cf-9fa6-915cd3ee0417 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:43.936497 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173fe3c1-805e-41cf-9fa6-915cd3ee0417 None admin] PATH_INFO: `/v3/users/24bbfa3f865847a1a2295a2e1f582db6` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:43.940410 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0891d40e-396b-422d-aaa9-58791eebc3a7 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:43.940698 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0891d40e-396b-422d-aaa9-58791eebc3a7 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:43.940982 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0891d40e-396b-422d-aaa9-58791eebc3a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:43.953502 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173fe3c1-805e-41cf-9fa6-915cd3ee0417 None admin] RBAC: Authorizing `identity:get_user(user_id=24bbfa3f865847a1a2295a2e1f582db6)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:43.956250 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173fe3c1-805e-41cf-9fa6-915cd3ee0417 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:43.958841 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 140/279] 10.222.0.52 () {56 vars in 1177 bytes} [Sat May 14 20:49:43 2022] GET /identity/v3/users/24bbfa3f865847a1a2295a2e1f582db6 => generated 293 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:49:43.965035 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-0891d40e-396b-422d-aaa9-58791eebc3a7 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:49:43.965219 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173fe3c1-805e-41cf-9fa6-915cd3ee0417 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:43.966762 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-0891d40e-396b-422d-aaa9-58791eebc3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:49:44.066198 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 140/280] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:49:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 14 20:49:44.082919 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173fe3c1-805e-41cf-9fa6-915cd3ee0417 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:44.090269 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0891d40e-396b-422d-aaa9-58791eebc3a7 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:44.128128 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c91cac-c8bd-4aa0-a730-0d4618ac56ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:44.128787 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c91cac-c8bd-4aa0-a730-0d4618ac56ee None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:44.129605 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c91cac-c8bd-4aa0-a730-0d4618ac56ee None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:44.129866 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c91cac-c8bd-4aa0-a730-0d4618ac56ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:44.130816 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c91cac-c8bd-4aa0-a730-0d4618ac56ee None admin] RBAC: Adding query filter params (role.id=4f4cbb0efdc1410294a05a7ba44f9320, user.id=24bbfa3f865847a1a2295a2e1f582db6, scope.system=all) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:49:44.131124 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c91cac-c8bd-4aa0-a730-0d4618ac56ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:44.132590 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c91cac-c8bd-4aa0-a730-0d4618ac56ee None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:44.138067 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 141/281] 10.222.0.52 () {56 vars in 1308 bytes} [Sat May 14 20:49:43 2022] GET /identity/v3/role_assignments?user.id=24bbfa3f865847a1a2295a2e1f582db6&scope.system=all&role.id=4f4cbb0efdc1410294a05a7ba44f9320 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:49:44.223431 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0891d40e-396b-422d-aaa9-58791eebc3a7 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:44.263605 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc852cfe-22f8-4864-bd0c-449b1b74c6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:44.264356 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc852cfe-22f8-4864-bd0c-449b1b74c6ee None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:44.264636 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc852cfe-22f8-4864-bd0c-449b1b74c6ee None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:44.264914 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc852cfe-22f8-4864-bd0c-449b1b74c6ee None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:44.277608 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc852cfe-22f8-4864-bd0c-449b1b74c6ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:49:44.285803 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-bc852cfe-22f8-4864-bd0c-449b1b74c6ee None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 14 20:49:44.285803 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:49:44.285803 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:49:44.285803 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:49:44.285803 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:49:44.285803 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:49:44.285803 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:49:44.285803 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:49:44.285803 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:49:44.285803 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:49:44.285803 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:49:44.285803 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:49:44.285803 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:49:44.285803 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:49:44.285803 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:49:44.285803 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:49:44.286769 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:49:44.286769 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:49:44.286769 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:49:44.286769 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:49:44.286769 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:49:44.286769 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:49:44.286769 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:49:44.286769 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:49:44.286769 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:49:44.286769 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:49:44.286769 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:49:44.286769 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:49:44.286769 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:49:44.286769 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:49:44.286769 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:49:44.286769 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:49:44.287774 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:49:44.287774 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:49:44.287774 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:49:44.287774 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:49:44.287774 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:49:44.287774 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:49:44.287774 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:49:44.287774 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:49:44.287774 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:49:44.287774 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:49:44.287774 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 14 20:49:44.287774 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:49:44.287774 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 141/282] 10.222.0.52 () {56 vars in 1099 bytes} [Sat May 14 20:49:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 20:49:44.293634 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c91cac-c8bd-4aa0-a730-0d4618ac56ee None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:44.402710 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f9c8c1-68e1-406d-a942-d5a1f5e71bf5 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:44.403213 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f9c8c1-68e1-406d-a942-d5a1f5e71bf5 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:44.403289 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f9c8c1-68e1-406d-a942-d5a1f5e71bf5 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:44.404381 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c91cac-c8bd-4aa0-a730-0d4618ac56ee None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:44.406186 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 142/283] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:49:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 14 20:49:44.416483 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3759307-4ba0-4f3a-b7d4-fa34614e6d28 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:44.416912 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3759307-4ba0-4f3a-b7d4-fa34614e6d28 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:44.417322 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3759307-4ba0-4f3a-b7d4-fa34614e6d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:44.436143 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-a3759307-4ba0-4f3a-b7d4-fa34614e6d28 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:49:44.437461 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-a3759307-4ba0-4f3a-b7d4-fa34614e6d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:49:44.447517 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6042a817-3a3e-4c96-ab91-0a40a921a383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:44.448240 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6042a817-3a3e-4c96-ab91-0a40a921a383 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:44.448523 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6042a817-3a3e-4c96-ab91-0a40a921a383 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:44.448796 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6042a817-3a3e-4c96-ab91-0a40a921a383 None admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:44.449544 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6042a817-3a3e-4c96-ab91-0a40a921a383 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:49:44.449849 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6042a817-3a3e-4c96-ab91-0a40a921a383 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:44.455726 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6042a817-3a3e-4c96-ab91-0a40a921a383 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:44.465045 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 142/284] 10.222.0.52 () {56 vars in 1101 bytes} [Sat May 14 20:49:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:44.470204 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6042a817-3a3e-4c96-ab91-0a40a921a383 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:44.509552 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 143/285] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:49:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 20:49:44.535628 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3759307-4ba0-4f3a-b7d4-fa34614e6d28 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:44.640397 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3759307-4ba0-4f3a-b7d4-fa34614e6d28 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:44.678456 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9cc070-de7c-48cd-be97-f8d6b6269fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:44.679513 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9cc070-de7c-48cd-be97-f8d6b6269fdf None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:44.679800 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9cc070-de7c-48cd-be97-f8d6b6269fdf None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:44.681838 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6042a817-3a3e-4c96-ab91-0a40a921a383 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:44.683302 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9cc070-de7c-48cd-be97-f8d6b6269fdf None admin] PATH_INFO: `/v3/roles/member` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:44.706731 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9cc070-de7c-48cd-be97-f8d6b6269fdf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:49:44.717807 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-9f9cc070-de7c-48cd-be97-f8d6b6269fdf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 14 20:49:44.717807 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:49:44.717807 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:49:44.717807 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:49:44.717807 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:49:44.717807 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:49:44.717807 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:49:44.717807 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:49:44.717807 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:49:44.717807 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:49:44.717807 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:49:44.717807 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:49:44.717807 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:49:44.717807 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:49:44.717807 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:49:44.717807 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:49:44.718857 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:49:44.718857 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:49:44.718857 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:49:44.718857 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:49:44.718857 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:49:44.718857 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:49:44.718857 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:49:44.718857 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:49:44.718857 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:49:44.718857 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:49:44.718857 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:49:44.718857 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:49:44.718857 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:49:44.718857 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:49:44.718857 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:49:44.718857 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:49:44.719708 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:49:44.719708 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:49:44.719708 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:49:44.719708 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:49:44.719708 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:49:44.719708 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:49:44.719708 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:49:44.719708 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:49:44.719708 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:49:44.719708 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:49:44.719708 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 14 20:49:44.719708 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:49:44.725118 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 144/286] 10.222.0.52 () {56 vars in 1099 bytes} [Sat May 14 20:49:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:49:44.740588 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9cc070-de7c-48cd-be97-f8d6b6269fdf None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:44.768325 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ad424c-3407-4e47-8d47-d968507c94d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:44.769180 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ad424c-3407-4e47-8d47-d968507c94d3 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:44.769469 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ad424c-3407-4e47-8d47-d968507c94d3 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:44.769768 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ad424c-3407-4e47-8d47-d968507c94d3 None admin] PATH_INFO: `/v3/users/4a8d109e64a0433c96c2cb994f277d9d` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:44.771202 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ad424c-3407-4e47-8d47-d968507c94d3 None admin] RBAC: Authorizing `identity:get_user(user_id=4a8d109e64a0433c96c2cb994f277d9d)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:44.772705 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ad424c-3407-4e47-8d47-d968507c94d3 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:44.774665 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 143/287] 10.222.0.52 () {56 vars in 1177 bytes} [Sat May 14 20:49:44 2022] GET /identity/v3/users/4a8d109e64a0433c96c2cb994f277d9d => generated 297 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:49:44.783508 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ad424c-3407-4e47-8d47-d968507c94d3 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:44.871372 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9cc070-de7c-48cd-be97-f8d6b6269fdf None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:44.906909 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83dad14-1ab5-4b3e-b3f3-65c9a1f8eb4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:44.907824 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83dad14-1ab5-4b3e-b3f3-65c9a1f8eb4c None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:44.908112 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83dad14-1ab5-4b3e-b3f3-65c9a1f8eb4c None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:44.908387 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83dad14-1ab5-4b3e-b3f3-65c9a1f8eb4c None admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:44.909134 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83dad14-1ab5-4b3e-b3f3-65c9a1f8eb4c None admin] RBAC: Adding query filter params (name=member) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:49:44.909441 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83dad14-1ab5-4b3e-b3f3-65c9a1f8eb4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:44.911575 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83dad14-1ab5-4b3e-b3f3-65c9a1f8eb4c None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:44.929760 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 145/288] 10.222.0.52 () {56 vars in 1101 bytes} [Sat May 14 20:49:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:49:44.940515 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83dad14-1ab5-4b3e-b3f3-65c9a1f8eb4c None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:44.968943 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ad424c-3407-4e47-8d47-d968507c94d3 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:45.021072 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494b0f8c-75ff-4ec5-a139-f730b916a80d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:45.022543 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b0f8c-75ff-4ec5-a139-f730b916a80d None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:45.023023 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b0f8c-75ff-4ec5-a139-f730b916a80d None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:45.023534 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b0f8c-75ff-4ec5-a139-f730b916a80d None admin] PATH_INFO: `/v3/projects/95e730a9930947c491bac8f909cc59c8` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:45.025559 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494b0f8c-75ff-4ec5-a139-f730b916a80d None admin] RBAC: Authorizing `identity:get_project(project_id=95e730a9930947c491bac8f909cc59c8)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:45.027681 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494b0f8c-75ff-4ec5-a139-f730b916a80d None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:45.029719 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 144/289] 10.222.0.52 () {56 vars in 1186 bytes} [Sat May 14 20:49:44 2022] GET /identity/v3/projects/95e730a9930947c491bac8f909cc59c8 => generated 302 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:45.040552 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494b0f8c-75ff-4ec5-a139-f730b916a80d None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:45.093223 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83dad14-1ab5-4b3e-b3f3-65c9a1f8eb4c None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:45.134588 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d804739-c025-4893-8c52-d9c1d536ad2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:45.135465 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d804739-c025-4893-8c52-d9c1d536ad2f None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:45.135972 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d804739-c025-4893-8c52-d9c1d536ad2f None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:45.136252 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d804739-c025-4893-8c52-d9c1d536ad2f None admin] PATH_INFO: `/v3/users/5fa64f3849cb4726a0ba6e7aa88f134d` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:45.138110 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d804739-c025-4893-8c52-d9c1d536ad2f None admin] RBAC: Authorizing `identity:get_user(user_id=5fa64f3849cb4726a0ba6e7aa88f134d)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:45.139604 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d804739-c025-4893-8c52-d9c1d536ad2f None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:45.141431 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 146/290] 10.222.0.52 () {56 vars in 1177 bytes} [Sat May 14 20:49:44 2022] GET /identity/v3/users/5fa64f3849cb4726a0ba6e7aa88f134d => generated 297 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:45.148719 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d804739-c025-4893-8c52-d9c1d536ad2f None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:45.214903 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494b0f8c-75ff-4ec5-a139-f730b916a80d None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:45.251301 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c423f9-b0ef-45e1-8546-f8e6a64f69ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:45.252621 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c423f9-b0ef-45e1-8546-f8e6a64f69ce None admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:45.252908 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c423f9-b0ef-45e1-8546-f8e6a64f69ce None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:45.253189 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c423f9-b0ef-45e1-8546-f8e6a64f69ce None admin] PATH_INFO: `/v3/projects/95e730a9930947c491bac8f909cc59c8/users/4a8d109e64a0433c96c2cb994f277d9d/roles/eecceaafa26e4f31a69165cbb855b327` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:45.255243 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c423f9-b0ef-45e1-8546-f8e6a64f69ce None admin] RBAC: Authorizing `identity:create_grant(project_id=95e730a9930947c491bac8f909cc59c8, user_id=4a8d109e64a0433c96c2cb994f277d9d, role_id=eecceaafa26e4f31a69165cbb855b327)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:45.257019 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c423f9-b0ef-45e1-8546-f8e6a64f69ce None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:45.305588 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d804739-c025-4893-8c52-d9c1d536ad2f None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:45.342239 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 145/291] 10.222.0.52 () {58 vars in 1439 bytes} [Sat May 14 20:49:45 2022] PUT /identity/v3/projects/95e730a9930947c491bac8f909cc59c8/users/4a8d109e64a0433c96c2cb994f277d9d/roles/eecceaafa26e4f31a69165cbb855b327 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 20:49:45.348544 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a7aa29-a68e-4b7a-b87a-9bcb0d16a889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:45.349219 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a7aa29-a68e-4b7a-b87a-9bcb0d16a889 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:45.349503 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a7aa29-a68e-4b7a-b87a-9bcb0d16a889 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:45.349778 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a7aa29-a68e-4b7a-b87a-9bcb0d16a889 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:45.434575 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a7aa29-a68e-4b7a-b87a-9bcb0d16a889 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:45.436116 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a7aa29-a68e-4b7a-b87a-9bcb0d16a889 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:45.548189 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 147/292] 10.222.0.52 () {58 vars in 1282 bytes} [Sat May 14 20:49:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 14 20:49:45.553916 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c423f9-b0ef-45e1-8546-f8e6a64f69ce None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:45.690823 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c423f9-b0ef-45e1-8546-f8e6a64f69ce None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:45.735507 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373a9791-e0aa-43d1-a7b4-f664a1c9d45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:45.736478 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373a9791-e0aa-43d1-a7b4-f664a1c9d45f None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:45.736705 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373a9791-e0aa-43d1-a7b4-f664a1c9d45f None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:45.736986 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373a9791-e0aa-43d1-a7b4-f664a1c9d45f None admin] PATH_INFO: `/v3/projects/95e730a9930947c491bac8f909cc59c8` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:45.738189 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373a9791-e0aa-43d1-a7b4-f664a1c9d45f None admin] RBAC: Authorizing `identity:get_project(project_id=95e730a9930947c491bac8f909cc59c8)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:45.740250 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373a9791-e0aa-43d1-a7b4-f664a1c9d45f None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:45.742313 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 146/293] 10.222.0.52 () {56 vars in 1186 bytes} [Sat May 14 20:49:45 2022] GET /identity/v3/projects/95e730a9930947c491bac8f909cc59c8 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:45.748332 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a7aa29-a68e-4b7a-b87a-9bcb0d16a889 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:45.888982 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a7aa29-a68e-4b7a-b87a-9bcb0d16a889 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:45.936113 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a1f661-4d4d-44c4-882a-0a9c9fef756c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:45.936765 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1f661-4d4d-44c4-882a-0a9c9fef756c None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:45.937046 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1f661-4d4d-44c4-882a-0a9c9fef756c None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:45.937320 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1f661-4d4d-44c4-882a-0a9c9fef756c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:45.938136 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a1f661-4d4d-44c4-882a-0a9c9fef756c None admin] RBAC: Adding query filter params (role.id=4f4cbb0efdc1410294a05a7ba44f9320, scope.project.id=95e730a9930947c491bac8f909cc59c8, user.id=5fa64f3849cb4726a0ba6e7aa88f134d) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:49:45.938441 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a1f661-4d4d-44c4-882a-0a9c9fef756c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:45.939895 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a1f661-4d4d-44c4-882a-0a9c9fef756c None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:45.946474 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 148/294] 10.222.0.52 () {56 vars in 1374 bytes} [Sat May 14 20:49:45 2022] GET /identity/v3/role_assignments?user.id=5fa64f3849cb4726a0ba6e7aa88f134d&scope.project.id=95e730a9930947c491bac8f909cc59c8&role.id=4f4cbb0efdc1410294a05a7ba44f9320 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:46.752976 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c741a-43fb-4b72-b782-ab6f356c15fa None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:46.753482 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c741a-43fb-4b72-b782-ab6f356c15fa None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:46.753556 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c741a-43fb-4b72-b782-ab6f356c15fa None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:46.755897 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 147/295] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:49:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:49:46.761440 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8ff33-52c4-4b0b-9acc-7689d34283e3 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:46.761865 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8ff33-52c4-4b0b-9acc-7689d34283e3 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:46.762040 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8ff33-52c4-4b0b-9acc-7689d34283e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:46.782133 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-aaf8ff33-52c4-4b0b-9acc-7689d34283e3 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:49:46.783321 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-aaf8ff33-52c4-4b0b-9acc-7689d34283e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:49:46.823593 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5caba-4152-4d70-8cad-22ff6d9b6cb6 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:46.823897 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5caba-4152-4d70-8cad-22ff6d9b6cb6 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:46.824146 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5caba-4152-4d70-8cad-22ff6d9b6cb6 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:46.825492 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 148/296] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:49:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 14 20:49:46.830510 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e827c9-f117-4374-8bbf-d5f3961cfe40 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:46.830789 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e827c9-f117-4374-8bbf-d5f3961cfe40 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:46.831065 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e827c9-f117-4374-8bbf-d5f3961cfe40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:46.850168 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-29e827c9-f117-4374-8bbf-d5f3961cfe40 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:49:46.851447 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-29e827c9-f117-4374-8bbf-d5f3961cfe40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:49:46.863522 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 149/297] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:49:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 20:49:46.889240 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf8ff33-52c4-4b0b-9acc-7689d34283e3 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:46.926950 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 149/298] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:49:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 14 20:49:46.950438 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e827c9-f117-4374-8bbf-d5f3961cfe40 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:46.993798 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf8ff33-52c4-4b0b-9acc-7689d34283e3 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:47.032637 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2574f5-6f95-4e3a-a51b-893c2d20b1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:47.033440 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2574f5-6f95-4e3a-a51b-893c2d20b1e9 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:47.033793 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2574f5-6f95-4e3a-a51b-893c2d20b1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:47.034134 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2574f5-6f95-4e3a-a51b-893c2d20b1e9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:47.045971 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2574f5-6f95-4e3a-a51b-893c2d20b1e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:49:47.056083 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-7d2574f5-6f95-4e3a-a51b-893c2d20b1e9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 14 20:49:47.056083 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:49:47.056083 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:49:47.056083 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:49:47.056083 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:49:47.056083 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:49:47.056083 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:49:47.056083 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:49:47.056083 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:49:47.056083 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:49:47.056083 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:49:47.056083 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:49:47.056083 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:49:47.056083 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:49:47.056083 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:49:47.056083 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:49:47.057910 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:49:47.057910 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:49:47.057910 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:49:47.057910 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:49:47.057910 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:49:47.057910 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:49:47.057910 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:49:47.057910 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:49:47.057910 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:49:47.057910 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:49:47.057910 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:49:47.057910 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:49:47.057910 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:49:47.057910 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:49:47.057910 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:49:47.057910 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:49:47.059780 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:49:47.059780 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:49:47.059780 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:49:47.059780 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:49:47.059780 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:49:47.059780 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:49:47.059780 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:49:47.059780 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:49:47.059780 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:49:47.059780 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:49:47.059780 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 14 20:49:47.059780 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:49:47.063523 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 150/299] 10.222.0.52 () {56 vars in 1099 bytes} [Sat May 14 20:49:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 20:49:47.063819 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e827c9-f117-4374-8bbf-d5f3961cfe40 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:47.064287 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343711fe-8e9c-47f6-b498-715ecd9cb5da None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:47.064576 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343711fe-8e9c-47f6-b498-715ecd9cb5da None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:47.064854 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343711fe-8e9c-47f6-b498-715ecd9cb5da None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:47.067316 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 151/300] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:49:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:49:47.071457 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343711fe-8e9c-47f6-b498-715ecd9cb5da None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:47.105168 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef502eb-cf35-4d01-9890-0809b07806d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:47.105967 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef502eb-cf35-4d01-9890-0809b07806d7 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:47.106249 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef502eb-cf35-4d01-9890-0809b07806d7 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:47.106522 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef502eb-cf35-4d01-9890-0809b07806d7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:47.118816 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef502eb-cf35-4d01-9890-0809b07806d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:49:47.126774 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-bef502eb-cf35-4d01-9890-0809b07806d7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 14 20:49:47.126774 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:49:47.126774 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:49:47.126774 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:49:47.126774 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:49:47.126774 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:49:47.126774 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:49:47.126774 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:49:47.126774 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:49:47.126774 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:49:47.126774 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:49:47.126774 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:49:47.126774 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:49:47.126774 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:49:47.126774 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:49:47.126774 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:49:47.127697 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:49:47.127697 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:49:47.127697 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:49:47.127697 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:49:47.127697 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:49:47.127697 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:49:47.127697 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:49:47.127697 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:49:47.127697 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:49:47.127697 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:49:47.127697 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:49:47.127697 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:49:47.127697 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:49:47.127697 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:49:47.127697 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:49:47.127697 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:49:47.128800 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:49:47.128800 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:49:47.128800 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:49:47.128800 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:49:47.128800 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:49:47.128800 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:49:47.128800 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:49:47.128800 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:49:47.128800 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:49:47.128800 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:49:47.128800 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 14 20:49:47.128800 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:49:47.128800 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 150/301] 10.222.0.52 () {56 vars in 1099 bytes} [Sat May 14 20:49:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 20:49:47.130297 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a35fcb-171d-4482-8eb2-08e0c7636ac1 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:47.130460 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a35fcb-171d-4482-8eb2-08e0c7636ac1 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:47.130737 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a35fcb-171d-4482-8eb2-08e0c7636ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:47.148230 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-57a35fcb-171d-4482-8eb2-08e0c7636ac1 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:49:47.149403 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-57a35fcb-171d-4482-8eb2-08e0c7636ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:49:47.185290 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343711fe-8e9c-47f6-b498-715ecd9cb5da None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:47.216771 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 151/302] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:49:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 20:49:47.217412 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a35fcb-171d-4482-8eb2-08e0c7636ac1 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:47.226557 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05abc149-cfdf-472b-8170-f949f9ad302c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:47.227968 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05abc149-cfdf-472b-8170-f949f9ad302c None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:47.228775 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05abc149-cfdf-472b-8170-f949f9ad302c None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:47.229527 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05abc149-cfdf-472b-8170-f949f9ad302c None admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:47.230482 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05abc149-cfdf-472b-8170-f949f9ad302c None admin] RBAC: Adding query filter params (name=reader) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:49:47.231166 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05abc149-cfdf-472b-8170-f949f9ad302c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:47.233477 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05abc149-cfdf-472b-8170-f949f9ad302c None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:47.245424 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 152/303] 10.222.0.52 () {56 vars in 1101 bytes} [Sat May 14 20:49:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:49:47.246697 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05abc149-cfdf-472b-8170-f949f9ad302c None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:47.318230 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a35fcb-171d-4482-8eb2-08e0c7636ac1 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:47.345773 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05abc149-cfdf-472b-8170-f949f9ad302c None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:47.351007 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be971f7f-b8a3-4081-8f2e-2c13064b2ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:47.351710 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be971f7f-b8a3-4081-8f2e-2c13064b2ae3 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:47.351998 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be971f7f-b8a3-4081-8f2e-2c13064b2ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:47.352273 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be971f7f-b8a3-4081-8f2e-2c13064b2ae3 None admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:47.353018 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be971f7f-b8a3-4081-8f2e-2c13064b2ae3 None admin] RBAC: Adding query filter params (name=member) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:49:47.353321 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be971f7f-b8a3-4081-8f2e-2c13064b2ae3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:47.354684 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be971f7f-b8a3-4081-8f2e-2c13064b2ae3 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:47.362817 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 152/304] 10.222.0.52 () {56 vars in 1101 bytes} [Sat May 14 20:49:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:47.364513 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be971f7f-b8a3-4081-8f2e-2c13064b2ae3 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:47.390217 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e22f1a-fe7d-4657-9c05-0d54b12850af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:47.391009 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e22f1a-fe7d-4657-9c05-0d54b12850af None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:47.391290 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e22f1a-fe7d-4657-9c05-0d54b12850af None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:47.391594 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e22f1a-fe7d-4657-9c05-0d54b12850af None admin] PATH_INFO: `/v3/domains/default` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:47.392756 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e22f1a-fe7d-4657-9c05-0d54b12850af None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:47.394192 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e22f1a-fe7d-4657-9c05-0d54b12850af None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:47.396751 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 153/305] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:49:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:47.397521 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e22f1a-fe7d-4657-9c05-0d54b12850af None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:47.474489 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be971f7f-b8a3-4081-8f2e-2c13064b2ae3 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:47.498069 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e22f1a-fe7d-4657-9c05-0d54b12850af None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:47.508375 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e548a72-11bf-4399-9417-f920b5b269ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:47.509250 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e548a72-11bf-4399-9417-f920b5b269ba None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:47.509534 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e548a72-11bf-4399-9417-f920b5b269ba None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:47.509808 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e548a72-11bf-4399-9417-f920b5b269ba None admin] PATH_INFO: `/v3/users/26265afb531a4e79b8ed3951e85a0927` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:47.524291 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e548a72-11bf-4399-9417-f920b5b269ba None admin] RBAC: Authorizing `identity:get_user(user_id=26265afb531a4e79b8ed3951e85a0927)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:47.525783 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e548a72-11bf-4399-9417-f920b5b269ba None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:47.532052 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 153/306] 10.222.0.52 () {56 vars in 1177 bytes} [Sat May 14 20:49:47 2022] GET /identity/v3/users/26265afb531a4e79b8ed3951e85a0927 => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:47.532052 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e548a72-11bf-4399-9417-f920b5b269ba None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:47.537720 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29da161-bd9d-4dae-9cd0-5bfdade38680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:47.538600 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29da161-bd9d-4dae-9cd0-5bfdade38680 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:47.538882 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29da161-bd9d-4dae-9cd0-5bfdade38680 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:47.539152 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29da161-bd9d-4dae-9cd0-5bfdade38680 None admin] PATH_INFO: `/v3/users/24bbfa3f865847a1a2295a2e1f582db6` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:47.540415 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29da161-bd9d-4dae-9cd0-5bfdade38680 None admin] RBAC: Authorizing `identity:get_user(user_id=24bbfa3f865847a1a2295a2e1f582db6)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:47.541856 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29da161-bd9d-4dae-9cd0-5bfdade38680 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:47.543573 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 154/307] 10.222.0.52 () {56 vars in 1177 bytes} [Sat May 14 20:49:47 2022] GET /identity/v3/users/24bbfa3f865847a1a2295a2e1f582db6 => generated 293 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:47.548717 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29da161-bd9d-4dae-9cd0-5bfdade38680 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:47.635627 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e548a72-11bf-4399-9417-f920b5b269ba None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:47.649775 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29da161-bd9d-4dae-9cd0-5bfdade38680 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:47.671887 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87429b14-41d6-4994-9659-9e81a0dc6bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:47.672555 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87429b14-41d6-4994-9659-9e81a0dc6bc7 None admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:47.672839 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87429b14-41d6-4994-9659-9e81a0dc6bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:47.673112 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87429b14-41d6-4994-9659-9e81a0dc6bc7 None admin] PATH_INFO: `/v3/groups` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:47.673800 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87429b14-41d6-4994-9659-9e81a0dc6bc7 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:47.675229 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87429b14-41d6-4994-9659-9e81a0dc6bc7 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:47.685619 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b8ef4-71ab-4f6c-9d7c-07e893164794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:47.690673 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b8ef4-71ab-4f6c-9d7c-07e893164794 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:47.690673 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b8ef4-71ab-4f6c-9d7c-07e893164794 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:47.690673 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b8ef4-71ab-4f6c-9d7c-07e893164794 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:47.690673 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7b8ef4-71ab-4f6c-9d7c-07e893164794 None admin] RBAC: Adding query filter params (role.id=eecceaafa26e4f31a69165cbb855b327, user.id=26265afb531a4e79b8ed3951e85a0927, scope.system=all) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:49:47.690673 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7b8ef4-71ab-4f6c-9d7c-07e893164794 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:47.690673 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7b8ef4-71ab-4f6c-9d7c-07e893164794 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:47.694583 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 155/308] 10.222.0.52 () {56 vars in 1308 bytes} [Sat May 14 20:49:47 2022] GET /identity/v3/role_assignments?user.id=26265afb531a4e79b8ed3951e85a0927&scope.system=all&role.id=eecceaafa26e4f31a69165cbb855b327 => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:47.696449 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b8ef4-71ab-4f6c-9d7c-07e893164794 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:47.744995 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 154/309] 10.222.0.52 () {60 vars in 1134 bytes} [Sat May 14 20:49:47 2022] POST /identity/v3/groups => generated 229 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 20:49:47.818722 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b8ef4-71ab-4f6c-9d7c-07e893164794 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:47.859288 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc17227-eb36-4214-b717-5872db122d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:47.860227 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc17227-eb36-4214-b717-5872db122d15 None admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:47.860505 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc17227-eb36-4214-b717-5872db122d15 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:47.860783 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc17227-eb36-4214-b717-5872db122d15 None admin] PATH_INFO: `/v3/system/users/24bbfa3f865847a1a2295a2e1f582db6/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:47.862444 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc17227-eb36-4214-b717-5872db122d15 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=24bbfa3f865847a1a2295a2e1f582db6, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:47.864280 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc17227-eb36-4214-b717-5872db122d15 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:47.961196 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 156/310] 10.222.0.52 () {58 vars in 1334 bytes} [Sat May 14 20:49:47 2022] PUT /identity/v3/system/users/24bbfa3f865847a1a2295a2e1f582db6/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 20:49:48.085949 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5d812-da39-4cc4-89f0-a786c92d5a93 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:48.086493 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5d812-da39-4cc4-89f0-a786c92d5a93 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:48.086493 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5d812-da39-4cc4-89f0-a786c92d5a93 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:48.088186 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 155/311] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:49:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:49:48.094024 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a312fbf-3e16-441e-96ea-6ce6cdfb7f65 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:48.094321 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a312fbf-3e16-441e-96ea-6ce6cdfb7f65 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:48.094588 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a312fbf-3e16-441e-96ea-6ce6cdfb7f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:48.113070 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-0a312fbf-3e16-441e-96ea-6ce6cdfb7f65 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:49:48.114650 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-0a312fbf-3e16-441e-96ea-6ce6cdfb7f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:49:48.186186 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 157/312] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:49:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 20:49:48.210944 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a5d812-da39-4cc4-89f0-a786c92d5a93 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:48.315946 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a5d812-da39-4cc4-89f0-a786c92d5a93 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:48.354113 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee0b3b8-a1fe-4996-b32f-b032f726014c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:48.355264 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0b3b8-a1fe-4996-b32f-b032f726014c None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:48.355790 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0b3b8-a1fe-4996-b32f-b032f726014c None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:48.356284 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0b3b8-a1fe-4996-b32f-b032f726014c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:48.370077 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee0b3b8-a1fe-4996-b32f-b032f726014c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:49:48.378757 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-3ee0b3b8-a1fe-4996-b32f-b032f726014c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 14 20:49:48.378757 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:49:48.378757 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:49:48.378757 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:49:48.378757 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:49:48.378757 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:49:48.378757 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:49:48.378757 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:49:48.378757 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:49:48.378757 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:49:48.378757 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:49:48.378757 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:49:48.378757 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:49:48.378757 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:49:48.378757 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:49:48.378757 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:49:48.380767 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:49:48.380767 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:49:48.380767 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:49:48.380767 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:49:48.380767 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:49:48.380767 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:49:48.380767 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:49:48.380767 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:49:48.380767 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:49:48.380767 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:49:48.380767 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:49:48.380767 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:49:48.380767 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:49:48.380767 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:49:48.380767 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:49:48.380767 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:49:48.381572 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:49:48.381572 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:49:48.381572 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:49:48.381572 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:49:48.381572 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:49:48.381572 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:49:48.381572 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:49:48.381572 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:49:48.381572 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:49:48.381572 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:49:48.381572 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 14 20:49:48.381572 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:49:48.384341 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 156/313] 10.222.0.52 () {56 vars in 1099 bytes} [Sat May 14 20:49:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:49:48.392804 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a312fbf-3e16-441e-96ea-6ce6cdfb7f65 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:48.492695 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a312fbf-3e16-441e-96ea-6ce6cdfb7f65 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:48.530418 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f840b41f-9f03-4414-a95b-2f7c7c9d5bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:48.531099 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f840b41f-9f03-4414-a95b-2f7c7c9d5bb6 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:48.531385 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f840b41f-9f03-4414-a95b-2f7c7c9d5bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:48.531696 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f840b41f-9f03-4414-a95b-2f7c7c9d5bb6 None admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:48.532451 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f840b41f-9f03-4414-a95b-2f7c7c9d5bb6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:49:48.532760 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f840b41f-9f03-4414-a95b-2f7c7c9d5bb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:48.534152 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f840b41f-9f03-4414-a95b-2f7c7c9d5bb6 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:48.543252 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 158/314] 10.222.0.52 () {56 vars in 1101 bytes} [Sat May 14 20:49:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:48.548377 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee0b3b8-a1fe-4996-b32f-b032f726014c None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:48.652943 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee0b3b8-a1fe-4996-b32f-b032f726014c None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:48.686804 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abd2401-61ef-487b-9c08-0ebb0f6ee1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:48.687700 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd2401-61ef-487b-9c08-0ebb0f6ee1b2 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:48.687980 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd2401-61ef-487b-9c08-0ebb0f6ee1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:48.688251 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd2401-61ef-487b-9c08-0ebb0f6ee1b2 None admin] PATH_INFO: `/v3/users/4a8d109e64a0433c96c2cb994f277d9d` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:48.689453 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abd2401-61ef-487b-9c08-0ebb0f6ee1b2 None admin] RBAC: Authorizing `identity:get_user(user_id=4a8d109e64a0433c96c2cb994f277d9d)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:48.691036 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abd2401-61ef-487b-9c08-0ebb0f6ee1b2 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:48.693514 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 157/315] 10.222.0.52 () {56 vars in 1177 bytes} [Sat May 14 20:49:48 2022] GET /identity/v3/users/4a8d109e64a0433c96c2cb994f277d9d => generated 297 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:48.698936 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f840b41f-9f03-4414-a95b-2f7c7c9d5bb6 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:48.803059 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f840b41f-9f03-4414-a95b-2f7c7c9d5bb6 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:48.836741 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cf5abf-96c1-4d71-b027-8ccb5c6e7fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:48.837395 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf5abf-96c1-4d71-b027-8ccb5c6e7fd9 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:48.837662 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf5abf-96c1-4d71-b027-8ccb5c6e7fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:48.837935 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf5abf-96c1-4d71-b027-8ccb5c6e7fd9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:48.911174 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cf5abf-96c1-4d71-b027-8ccb5c6e7fd9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:48.912677 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cf5abf-96c1-4d71-b027-8ccb5c6e7fd9 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:49.011846 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 159/316] 10.222.0.52 () {58 vars in 1282 bytes} [Sat May 14 20:49:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 14 20:49:49.017792 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abd2401-61ef-487b-9c08-0ebb0f6ee1b2 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:49.118399 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abd2401-61ef-487b-9c08-0ebb0f6ee1b2 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:49.152890 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef4f4f6-da0e-4d41-bb88-39ab8262f00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:49.153748 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4f4f6-da0e-4d41-bb88-39ab8262f00c None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:49.154024 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4f4f6-da0e-4d41-bb88-39ab8262f00c None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:49.154294 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4f4f6-da0e-4d41-bb88-39ab8262f00c None admin] PATH_INFO: `/v3/projects/95e730a9930947c491bac8f909cc59c8` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:49.155498 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef4f4f6-da0e-4d41-bb88-39ab8262f00c None admin] RBAC: Authorizing `identity:get_project(project_id=95e730a9930947c491bac8f909cc59c8)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:49.156927 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef4f4f6-da0e-4d41-bb88-39ab8262f00c None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:49.158911 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 158/317] 10.222.0.52 () {56 vars in 1186 bytes} [Sat May 14 20:49:49 2022] GET /identity/v3/projects/95e730a9930947c491bac8f909cc59c8 => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:49.165197 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cf5abf-96c1-4d71-b027-8ccb5c6e7fd9 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:49.263175 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cf5abf-96c1-4d71-b027-8ccb5c6e7fd9 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:49.296308 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff11ef1-7ce2-422b-9a93-0bda2f9f8968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:49.296956 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff11ef1-7ce2-422b-9a93-0bda2f9f8968 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:49.297233 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff11ef1-7ce2-422b-9a93-0bda2f9f8968 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:49.297502 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff11ef1-7ce2-422b-9a93-0bda2f9f8968 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:49.298307 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff11ef1-7ce2-422b-9a93-0bda2f9f8968 None admin] RBAC: Adding query filter params (role.id=eecceaafa26e4f31a69165cbb855b327, scope.project.id=95e730a9930947c491bac8f909cc59c8, user.id=4a8d109e64a0433c96c2cb994f277d9d) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:49:49.298613 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff11ef1-7ce2-422b-9a93-0bda2f9f8968 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:49.300064 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff11ef1-7ce2-422b-9a93-0bda2f9f8968 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:49.306491 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 160/318] 10.222.0.52 () {56 vars in 1374 bytes} [Sat May 14 20:49:49 2022] GET /identity/v3/role_assignments?user.id=4a8d109e64a0433c96c2cb994f277d9d&scope.project.id=95e730a9930947c491bac8f909cc59c8&role.id=eecceaafa26e4f31a69165cbb855b327 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:50.107970 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3031c-2bce-4bab-87a0-959849c9d6ba None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:50.108334 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3031c-2bce-4bab-87a0-959849c9d6ba None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:50.108603 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3031c-2bce-4bab-87a0-959849c9d6ba None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:50.110038 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 159/319] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:49:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:49:50.115822 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19505b-a892-40ad-a422-37e2cd5129ab None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:50.116264 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19505b-a892-40ad-a422-37e2cd5129ab None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:50.116443 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19505b-a892-40ad-a422-37e2cd5129ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:50.132807 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-5f19505b-a892-40ad-a422-37e2cd5129ab None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:49:50.133987 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-5f19505b-a892-40ad-a422-37e2cd5129ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:49:50.204211 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 161/320] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:49:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 20:49:50.219813 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3bc949-0860-43e8-ab86-7ba4a5e4f51f None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:50.220306 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3bc949-0860-43e8-ab86-7ba4a5e4f51f None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:50.220379 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3bc949-0860-43e8-ab86-7ba4a5e4f51f None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:50.221854 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 160/321] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:49:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:49:50.227426 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1802d293-7e25-4452-ba1c-8cc6fc22ee87 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:50.227650 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3bc949-0860-43e8-ab86-7ba4a5e4f51f None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:50.227745 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1802d293-7e25-4452-ba1c-8cc6fc22ee87 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:50.228097 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1802d293-7e25-4452-ba1c-8cc6fc22ee87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:50.244654 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-1802d293-7e25-4452-ba1c-8cc6fc22ee87 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:49:50.245826 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-1802d293-7e25-4452-ba1c-8cc6fc22ee87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:49:50.316206 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 162/322] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:49:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 20:49:50.329135 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3bc949-0860-43e8-ab86-7ba4a5e4f51f None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:50.340317 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1802d293-7e25-4452-ba1c-8cc6fc22ee87 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:50.363165 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e5052-2a04-4e78-ae55-becd84e291ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:50.364196 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e5052-2a04-4e78-ae55-becd84e291ed None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:50.364481 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e5052-2a04-4e78-ae55-becd84e291ed None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:50.364755 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e5052-2a04-4e78-ae55-becd84e291ed None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:50.377262 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1e5052-2a04-4e78-ae55-becd84e291ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:49:50.385507 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-da1e5052-2a04-4e78-ae55-becd84e291ed None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 14 20:49:50.385507 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:49:50.385507 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:49:50.385507 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:49:50.385507 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:49:50.385507 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:49:50.385507 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:49:50.385507 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:49:50.385507 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:49:50.385507 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:49:50.385507 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:49:50.385507 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:49:50.385507 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:49:50.385507 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:49:50.385507 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:49:50.385507 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:49:50.386655 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:49:50.386655 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:49:50.386655 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:49:50.386655 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:49:50.386655 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:49:50.386655 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:49:50.386655 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:49:50.386655 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:49:50.386655 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:49:50.386655 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:49:50.386655 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:49:50.386655 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:49:50.386655 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:49:50.386655 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:49:50.386655 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:49:50.386655 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:49:50.387667 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:49:50.387667 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:49:50.387667 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:49:50.387667 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:49:50.387667 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:49:50.387667 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:49:50.387667 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:49:50.387667 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:49:50.387667 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:49:50.387667 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:49:50.387667 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 14 20:49:50.387667 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:49:50.387667 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 161/323] 10.222.0.52 () {56 vars in 1099 bytes} [Sat May 14 20:49:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 20:49:50.388517 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c87e2e-80c2-4dbe-80d9-97a37613b32a None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:50.388599 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c87e2e-80c2-4dbe-80d9-97a37613b32a None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:50.388861 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c87e2e-80c2-4dbe-80d9-97a37613b32a None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:50.393917 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 162/324] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:49:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:49:50.393917 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c87e2e-80c2-4dbe-80d9-97a37613b32a None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:50.444003 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1802d293-7e25-4452-ba1c-8cc6fc22ee87 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:50.477394 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c56dd4-989a-4361-a636-cb7a267bf6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:50.478115 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c56dd4-989a-4361-a636-cb7a267bf6f1 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:50.478403 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c56dd4-989a-4361-a636-cb7a267bf6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:50.478675 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c56dd4-989a-4361-a636-cb7a267bf6f1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:50.479865 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c56dd4-989a-4361-a636-cb7a267bf6f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:50.481309 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c56dd4-989a-4361-a636-cb7a267bf6f1 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:50.483130 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 163/325] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:49:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:49:50.484212 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326f74e-a3c7-43ed-9306-346f33668320 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:50.484505 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326f74e-a3c7-43ed-9306-346f33668320 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:50.484785 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326f74e-a3c7-43ed-9306-346f33668320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:50.491584 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c87e2e-80c2-4dbe-80d9-97a37613b32a None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:50.500789 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-8326f74e-a3c7-43ed-9306-346f33668320 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:49:50.501976 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8326f74e-a3c7-43ed-9306-346f33668320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:49:50.524473 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a006752-2138-45d3-b5ac-fe5e6d55234a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:50.525154 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a006752-2138-45d3-b5ac-fe5e6d55234a None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:50.525440 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a006752-2138-45d3-b5ac-fe5e6d55234a None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:50.525719 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a006752-2138-45d3-b5ac-fe5e6d55234a None admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:50.526461 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a006752-2138-45d3-b5ac-fe5e6d55234a None admin] RBAC: Adding query filter params (name=reader) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:49:50.526799 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a006752-2138-45d3-b5ac-fe5e6d55234a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:50.528192 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a006752-2138-45d3-b5ac-fe5e6d55234a None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:50.537416 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 163/326] 10.222.0.52 () {56 vars in 1101 bytes} [Sat May 14 20:49:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:49:50.542357 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a006752-2138-45d3-b5ac-fe5e6d55234a None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:50.567057 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 164/327] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:49:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 20:49:50.567990 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8326f74e-a3c7-43ed-9306-346f33668320 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:50.637722 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a006752-2138-45d3-b5ac-fe5e6d55234a None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:50.662167 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8326f74e-a3c7-43ed-9306-346f33668320 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:50.670206 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421228c5-9d2a-4d7c-88d8-3cd0f71270fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:50.670892 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421228c5-9d2a-4d7c-88d8-3cd0f71270fb None admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:50.671171 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421228c5-9d2a-4d7c-88d8-3cd0f71270fb None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:50.671442 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421228c5-9d2a-4d7c-88d8-3cd0f71270fb None admin] PATH_INFO: `/v3/groups` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:50.672153 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421228c5-9d2a-4d7c-88d8-3cd0f71270fb None admin] RBAC: Authorizing `identity:create_group()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:50.673570 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421228c5-9d2a-4d7c-88d8-3cd0f71270fb None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:50.694976 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b3734-d2b3-4a0a-b286-f88c781b7e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:50.695864 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b3734-d2b3-4a0a-b286-f88c781b7e80 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:50.696149 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b3734-d2b3-4a0a-b286-f88c781b7e80 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:50.696425 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b3734-d2b3-4a0a-b286-f88c781b7e80 None admin] PATH_INFO: `/v3/users/26265afb531a4e79b8ed3951e85a0927` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:50.697592 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0b3734-d2b3-4a0a-b286-f88c781b7e80 None admin] RBAC: Authorizing `identity:get_user(user_id=26265afb531a4e79b8ed3951e85a0927)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:50.699027 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0b3734-d2b3-4a0a-b286-f88c781b7e80 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:50.700740 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 165/328] 10.222.0.52 () {56 vars in 1177 bytes} [Sat May 14 20:49:50 2022] GET /identity/v3/users/26265afb531a4e79b8ed3951e85a0927 => generated 293 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:50.701498 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b3734-d2b3-4a0a-b286-f88c781b7e80 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:50.776513 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 164/329] 10.222.0.52 () {60 vars in 1134 bytes} [Sat May 14 20:49:50 2022] POST /identity/v3/groups => generated 226 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 20:49:50.777229 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421228c5-9d2a-4d7c-88d8-3cd0f71270fb None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:50.802906 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b3734-d2b3-4a0a-b286-f88c781b7e80 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:50.841255 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43511e1b-f5bc-4473-b4b1-30e09912a4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:50.842211 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43511e1b-f5bc-4473-b4b1-30e09912a4cd None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:50.842561 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43511e1b-f5bc-4473-b4b1-30e09912a4cd None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:50.842914 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43511e1b-f5bc-4473-b4b1-30e09912a4cd None admin] PATH_INFO: `/v3/roles/member` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:50.855415 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43511e1b-f5bc-4473-b4b1-30e09912a4cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:49:50.864059 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-43511e1b-f5bc-4473-b4b1-30e09912a4cd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 14 20:49:50.864059 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:49:50.864059 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:49:50.864059 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:49:50.864059 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:49:50.864059 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:49:50.864059 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:49:50.864059 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:49:50.864059 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:49:50.864059 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:49:50.864059 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:49:50.864059 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:49:50.864059 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:49:50.864059 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:49:50.864059 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:49:50.864059 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:49:50.865362 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:49:50.865362 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:49:50.865362 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:49:50.865362 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:49:50.865362 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:49:50.865362 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:49:50.865362 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:49:50.865362 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:49:50.865362 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:49:50.865362 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:49:50.865362 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:49:50.865362 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:49:50.865362 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:49:50.865362 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:49:50.865362 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:49:50.865362 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:49:50.866189 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:49:50.866189 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:49:50.866189 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:49:50.866189 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:49:50.866189 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:49:50.866189 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:49:50.866189 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:49:50.866189 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:49:50.866189 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:49:50.866189 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:49:50.866189 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 14 20:49:50.866189 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:49:50.866189 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 166/330] 10.222.0.52 () {56 vars in 1099 bytes} [Sat May 14 20:49:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:49:50.871649 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43511e1b-f5bc-4473-b4b1-30e09912a4cd None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:50.892424 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421228c5-9d2a-4d7c-88d8-3cd0f71270fb None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:50.936046 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0ebc86-86d9-4a5b-ad6f-025ac9881320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:50.937235 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ebc86-86d9-4a5b-ad6f-025ac9881320 None admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:50.937681 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ebc86-86d9-4a5b-ad6f-025ac9881320 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:50.938092 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ebc86-86d9-4a5b-ad6f-025ac9881320 None admin] PATH_INFO: `/v3/system/users/26265afb531a4e79b8ed3951e85a0927/roles/eecceaafa26e4f31a69165cbb855b327` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:50.940111 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0ebc86-86d9-4a5b-ad6f-025ac9881320 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=26265afb531a4e79b8ed3951e85a0927, role_id=eecceaafa26e4f31a69165cbb855b327)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:50.941573 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0ebc86-86d9-4a5b-ad6f-025ac9881320 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:50.985560 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43511e1b-f5bc-4473-b4b1-30e09912a4cd None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:51.001283 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 165/331] 10.222.0.52 () {58 vars in 1334 bytes} [Sat May 14 20:49:50 2022] PUT /identity/v3/system/users/26265afb531a4e79b8ed3951e85a0927/roles/eecceaafa26e4f31a69165cbb855b327 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 20:49:51.021369 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dbdc8c-5978-489f-a750-ea0bd4f030f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:51.022069 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dbdc8c-5978-489f-a750-ea0bd4f030f6 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:51.022855 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dbdc8c-5978-489f-a750-ea0bd4f030f6 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:51.022855 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dbdc8c-5978-489f-a750-ea0bd4f030f6 None admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:51.026326 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dbdc8c-5978-489f-a750-ea0bd4f030f6 None admin] RBAC: Adding query filter params (name=member) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:49:51.026326 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dbdc8c-5978-489f-a750-ea0bd4f030f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:51.026326 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dbdc8c-5978-489f-a750-ea0bd4f030f6 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:51.040925 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 167/332] 10.222.0.52 () {56 vars in 1101 bytes} [Sat May 14 20:49:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:51.041515 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0ebc86-86d9-4a5b-ad6f-025ac9881320 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:51.164527 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0ebc86-86d9-4a5b-ad6f-025ac9881320 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:51.203004 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7681af5-e6f8-4e69-8818-ff12c8cc532c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:51.203920 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7681af5-e6f8-4e69-8818-ff12c8cc532c None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:51.204211 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7681af5-e6f8-4e69-8818-ff12c8cc532c None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:51.204494 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7681af5-e6f8-4e69-8818-ff12c8cc532c None admin] PATH_INFO: `/v3/users/24bbfa3f865847a1a2295a2e1f582db6` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:51.205731 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7681af5-e6f8-4e69-8818-ff12c8cc532c None admin] RBAC: Authorizing `identity:get_user(user_id=24bbfa3f865847a1a2295a2e1f582db6)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:51.207838 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7681af5-e6f8-4e69-8818-ff12c8cc532c None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:51.209936 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 166/333] 10.222.0.52 () {56 vars in 1177 bytes} [Sat May 14 20:49:51 2022] GET /identity/v3/users/24bbfa3f865847a1a2295a2e1f582db6 => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:51.215957 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dbdc8c-5978-489f-a750-ea0bd4f030f6 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:51.329825 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dbdc8c-5978-489f-a750-ea0bd4f030f6 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:51.365318 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a6540f-7c97-464e-824c-6e222c6e921e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:51.365978 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6540f-7c97-464e-824c-6e222c6e921e None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:51.366264 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6540f-7c97-464e-824c-6e222c6e921e None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:51.366545 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6540f-7c97-464e-824c-6e222c6e921e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:51.367372 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a6540f-7c97-464e-824c-6e222c6e921e None admin] RBAC: Adding query filter params (role.id=4f4cbb0efdc1410294a05a7ba44f9320, user.id=24bbfa3f865847a1a2295a2e1f582db6, scope.system=all) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:49:51.367719 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a6540f-7c97-464e-824c-6e222c6e921e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:51.369161 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a6540f-7c97-464e-824c-6e222c6e921e None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:51.382665 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 168/334] 10.222.0.52 () {56 vars in 1308 bytes} [Sat May 14 20:49:51 2022] GET /identity/v3/role_assignments?user.id=24bbfa3f865847a1a2295a2e1f582db6&scope.system=all&role.id=4f4cbb0efdc1410294a05a7ba44f9320 => generated 510 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:53.547395 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca5445-8529-4350-a66f-df8bec139f97 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:53.548025 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca5445-8529-4350-a66f-df8bec139f97 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:53.548111 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca5445-8529-4350-a66f-df8bec139f97 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:53.549482 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 167/335] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:49:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:49:53.556352 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db22dc39-f7b4-4f77-9eac-4c88b801bf44 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:53.556969 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db22dc39-f7b4-4f77-9eac-4c88b801bf44 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:53.556969 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db22dc39-f7b4-4f77-9eac-4c88b801bf44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:53.584679 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-db22dc39-f7b4-4f77-9eac-4c88b801bf44 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:49:53.585918 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-db22dc39-f7b4-4f77-9eac-4c88b801bf44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:49:53.679172 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 169/336] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:49:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 20:49:53.737469 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ca5445-8529-4350-a66f-df8bec139f97 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:53.892304 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ca5445-8529-4350-a66f-df8bec139f97 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:53.944238 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1385834d-1e33-45c8-9a97-010ab87f5cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:53.945073 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1385834d-1e33-45c8-9a97-010ab87f5cd7 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:53.945360 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1385834d-1e33-45c8-9a97-010ab87f5cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:53.945637 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1385834d-1e33-45c8-9a97-010ab87f5cd7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:53.962984 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1385834d-1e33-45c8-9a97-010ab87f5cd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:49:53.971867 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-1385834d-1e33-45c8-9a97-010ab87f5cd7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 14 20:49:53.971867 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:49:53.971867 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:49:53.971867 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:49:53.971867 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:49:53.971867 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:49:53.971867 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:49:53.971867 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:49:53.971867 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:49:53.971867 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:49:53.971867 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:49:53.971867 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:49:53.971867 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:49:53.971867 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:49:53.971867 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:49:53.971867 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:49:53.973361 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:49:53.973361 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:49:53.973361 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:49:53.973361 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:49:53.973361 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:49:53.973361 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:49:53.973361 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:49:53.973361 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:49:53.973361 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:49:53.973361 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:49:53.973361 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:49:53.973361 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:49:53.973361 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:49:53.973361 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:49:53.973361 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:49:53.973361 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:49:53.974157 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:49:53.974157 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:49:53.974157 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:49:53.974157 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:49:53.974157 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:49:53.974157 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:49:53.974157 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:49:53.974157 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:49:53.974157 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:49:53.974157 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:49:53.974157 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 14 20:49:53.974157 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:49:53.977643 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 168/337] 10.222.0.52 () {56 vars in 1114 bytes} [Sat May 14 20:49:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 20:49:53.979950 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db22dc39-f7b4-4f77-9eac-4c88b801bf44 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:54.014117 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa4b450-c908-4428-a416-f35ee5a829ba None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:54.014545 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa4b450-c908-4428-a416-f35ee5a829ba None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:54.014712 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa4b450-c908-4428-a416-f35ee5a829ba None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:54.017641 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 169/338] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:49:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:49:54.024547 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d695c-51dd-411b-abe1-29f064891c25 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:54.025023 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d695c-51dd-411b-abe1-29f064891c25 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:54.025377 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d695c-51dd-411b-abe1-29f064891c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:54.058170 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-628d695c-51dd-411b-abe1-29f064891c25 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:49:54.059399 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-628d695c-51dd-411b-abe1-29f064891c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:49:54.147151 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db22dc39-f7b4-4f77-9eac-4c88b801bf44 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:54.185371 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 170/339] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:49:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 14 20:49:54.186847 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3282d471-b6f6-4472-aa27-643874cf8ea7 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:54.187137 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3282d471-b6f6-4472-aa27-643874cf8ea7 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:54.187445 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3282d471-b6f6-4472-aa27-643874cf8ea7 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:54.189259 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 171/340] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:49:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:49:54.190947 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6917ca7a-b360-43d4-a48d-d0c6abad9887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:54.191706 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6917ca7a-b360-43d4-a48d-d0c6abad9887 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:54.191989 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6917ca7a-b360-43d4-a48d-d0c6abad9887 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:54.192269 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6917ca7a-b360-43d4-a48d-d0c6abad9887 None admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:54.193156 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6917ca7a-b360-43d4-a48d-d0c6abad9887 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:49:54.193417 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6917ca7a-b360-43d4-a48d-d0c6abad9887 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:54.195192 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6917ca7a-b360-43d4-a48d-d0c6abad9887 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:54.204908 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110b848-773c-4fc2-8ff1-1b06a94611b4 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:54.211059 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110b848-773c-4fc2-8ff1-1b06a94611b4 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:54.211059 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110b848-773c-4fc2-8ff1-1b06a94611b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:54.211430 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 170/341] 10.222.0.52 () {56 vars in 1111 bytes} [Sat May 14 20:49:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:54.219065 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6917ca7a-b360-43d4-a48d-d0c6abad9887 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:54.236836 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-9110b848-773c-4fc2-8ff1-1b06a94611b4 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:49:54.238110 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-9110b848-773c-4fc2-8ff1-1b06a94611b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:49:54.339615 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 172/342] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:49:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 14 20:49:54.344321 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9110b848-773c-4fc2-8ff1-1b06a94611b4 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:54.414933 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6917ca7a-b360-43d4-a48d-d0c6abad9887 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:54.481681 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9110b848-773c-4fc2-8ff1-1b06a94611b4 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:54.485520 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b779e5-c0a3-4184-952c-c83ffd59ba51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:54.486480 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b779e5-c0a3-4184-952c-c83ffd59ba51 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:54.486979 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b779e5-c0a3-4184-952c-c83ffd59ba51 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:54.487557 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b779e5-c0a3-4184-952c-c83ffd59ba51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:54.526954 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb2e2f1-cc15-4555-aa7e-1882a7d262bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:54.527934 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2e2f1-cc15-4555-aa7e-1882a7d262bd None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:54.528215 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2e2f1-cc15-4555-aa7e-1882a7d262bd None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:54.528489 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2e2f1-cc15-4555-aa7e-1882a7d262bd None admin] PATH_INFO: `/v3/roles/member` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:54.544526 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb2e2f1-cc15-4555-aa7e-1882a7d262bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:49:54.555820 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-eeb2e2f1-cc15-4555-aa7e-1882a7d262bd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 14 20:49:54.555820 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:49:54.555820 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:49:54.555820 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:49:54.555820 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:49:54.555820 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:49:54.555820 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:49:54.555820 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:49:54.555820 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:49:54.555820 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:49:54.555820 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:49:54.555820 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:49:54.555820 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:49:54.555820 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:49:54.555820 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:49:54.555820 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:49:54.557713 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:49:54.557713 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:49:54.557713 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:49:54.557713 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:49:54.557713 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:49:54.557713 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:49:54.557713 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:49:54.557713 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:49:54.557713 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:49:54.557713 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:49:54.557713 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:49:54.557713 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:49:54.557713 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:49:54.557713 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:49:54.557713 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:49:54.557713 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:49:54.558580 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:49:54.558580 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:49:54.558580 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:49:54.558580 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:49:54.558580 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:49:54.558580 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:49:54.558580 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:49:54.558580 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:49:54.558580 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:49:54.558580 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:49:54.558580 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 14 20:49:54.558580 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:49:54.558580 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 173/343] 10.222.0.52 () {56 vars in 1099 bytes} [Sat May 14 20:49:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:49:54.558580 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb2e2f1-cc15-4555-aa7e-1882a7d262bd None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:54.582925 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b779e5-c0a3-4184-952c-c83ffd59ba51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:54.585879 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b779e5-c0a3-4184-952c-c83ffd59ba51 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:54.666415 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb2e2f1-cc15-4555-aa7e-1882a7d262bd None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:54.696770 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 171/344] 10.222.0.52 () {58 vars in 1282 bytes} [Sat May 14 20:49:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 14 20:49:54.698435 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31736611-9ef6-407e-b46c-cd760a933e05 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:54.698951 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31736611-9ef6-407e-b46c-cd760a933e05 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:54.699436 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31736611-9ef6-407e-b46c-cd760a933e05 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:54.701450 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 172/345] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:49:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:49:54.702402 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31736611-9ef6-407e-b46c-cd760a933e05 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:54.706438 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9ac8a1-9cc3-4382-b057-7fbbdda9c847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:54.708385 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ac8a1-9cc3-4382-b057-7fbbdda9c847 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:54.708385 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ac8a1-9cc3-4382-b057-7fbbdda9c847 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:54.708560 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ac8a1-9cc3-4382-b057-7fbbdda9c847 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:54.722916 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9ac8a1-9cc3-4382-b057-7fbbdda9c847 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:49:54.730658 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-cb9ac8a1-9cc3-4382-b057-7fbbdda9c847 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 14 20:49:54.730658 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:49:54.730658 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:49:54.730658 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:49:54.730658 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:49:54.730658 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:49:54.730658 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:49:54.730658 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:49:54.730658 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:49:54.730658 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:49:54.730658 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:49:54.730658 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:49:54.730658 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:49:54.730658 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:49:54.730658 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:49:54.730658 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:49:54.732430 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:49:54.732430 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:49:54.732430 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:49:54.732430 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:49:54.732430 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:49:54.732430 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:49:54.732430 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:49:54.732430 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:49:54.732430 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:49:54.732430 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:49:54.732430 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:49:54.732430 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:49:54.732430 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:49:54.732430 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:49:54.732430 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:49:54.732430 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:49:54.733313 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:49:54.733313 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:49:54.733313 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:49:54.733313 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:49:54.733313 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:49:54.733313 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:49:54.733313 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:49:54.733313 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:49:54.733313 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:49:54.733313 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:49:54.733313 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 14 20:49:54.733313 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:49:54.733313 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 174/346] 10.222.0.52 () {56 vars in 1099 bytes} [Sat May 14 20:49:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:49:54.733313 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9ac8a1-9cc3-4382-b057-7fbbdda9c847 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:54.820575 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31736611-9ef6-407e-b46c-cd760a933e05 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:54.838853 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9ac8a1-9cc3-4382-b057-7fbbdda9c847 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:54.859117 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd10c5c6-93e2-4d5d-9411-ce830eaf57e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:54.860230 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd10c5c6-93e2-4d5d-9411-ce830eaf57e3 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:54.860733 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd10c5c6-93e2-4d5d-9411-ce830eaf57e3 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:54.861212 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd10c5c6-93e2-4d5d-9411-ce830eaf57e3 None admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:54.862181 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd10c5c6-93e2-4d5d-9411-ce830eaf57e3 None admin] RBAC: Adding query filter params (name=member) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:49:54.862713 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd10c5c6-93e2-4d5d-9411-ce830eaf57e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:54.865007 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd10c5c6-93e2-4d5d-9411-ce830eaf57e3 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:54.874937 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 173/347] 10.222.0.52 () {56 vars in 1101 bytes} [Sat May 14 20:49:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:54.876742 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96456584-9284-4e89-a0b1-aa9b0b2a4139 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:54.877280 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96456584-9284-4e89-a0b1-aa9b0b2a4139 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:54.877813 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96456584-9284-4e89-a0b1-aa9b0b2a4139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:54.880378 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd4075d-eb39-4207-80a3-6c6376e3e2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:54.881336 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd4075d-eb39-4207-80a3-6c6376e3e2d5 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:54.881717 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd4075d-eb39-4207-80a3-6c6376e3e2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:54.882086 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd4075d-eb39-4207-80a3-6c6376e3e2d5 None admin] PATH_INFO: `/v3/projects/c377a7cb474f47c8861e1c13e61ee22d` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:54.883394 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd4075d-eb39-4207-80a3-6c6376e3e2d5 None admin] RBAC: Authorizing `identity:get_project(project_id=c377a7cb474f47c8861e1c13e61ee22d)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:54.884955 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd4075d-eb39-4207-80a3-6c6376e3e2d5 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:54.886910 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 175/348] 10.222.0.52 () {56 vars in 1186 bytes} [Sat May 14 20:49:54 2022] GET /identity/v3/projects/c377a7cb474f47c8861e1c13e61ee22d => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:54.887657 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd4075d-eb39-4207-80a3-6c6376e3e2d5 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:54.899154 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-96456584-9284-4e89-a0b1-aa9b0b2a4139 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:49:54.901474 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-96456584-9284-4e89-a0b1-aa9b0b2a4139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:49:54.991758 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 174/349] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:49:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 20:49:54.992893 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96456584-9284-4e89-a0b1-aa9b0b2a4139 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:55.002646 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd4075d-eb39-4207-80a3-6c6376e3e2d5 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:55.048645 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e81be-3a17-4778-b027-962b9ea445c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:55.049619 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e81be-3a17-4778-b027-962b9ea445c3 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:55.049619 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e81be-3a17-4778-b027-962b9ea445c3 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:55.049850 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e81be-3a17-4778-b027-962b9ea445c3 None admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:55.051427 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8e81be-3a17-4778-b027-962b9ea445c3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:49:55.053162 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8e81be-3a17-4778-b027-962b9ea445c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:55.054611 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8e81be-3a17-4778-b027-962b9ea445c3 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:55.065540 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 176/350] 10.222.0.52 () {56 vars in 1101 bytes} [Sat May 14 20:49:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:55.067170 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e81be-3a17-4778-b027-962b9ea445c3 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:55.099747 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96456584-9284-4e89-a0b1-aa9b0b2a4139 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:55.135753 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed340f-fe8c-47b9-98a9-eb99d9583c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:55.136730 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed340f-fe8c-47b9-98a9-eb99d9583c9a None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:55.137194 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed340f-fe8c-47b9-98a9-eb99d9583c9a None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:55.137651 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed340f-fe8c-47b9-98a9-eb99d9583c9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:55.174250 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e81be-3a17-4778-b027-962b9ea445c3 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:55.208431 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ed340f-fe8c-47b9-98a9-eb99d9583c9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:55.208894 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07caa25-1613-4653-b4f5-0db12db599ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:55.209752 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07caa25-1613-4653-b4f5-0db12db599ab None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:55.210030 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07caa25-1613-4653-b4f5-0db12db599ab None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:55.210301 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07caa25-1613-4653-b4f5-0db12db599ab None admin] PATH_INFO: `/v3/groups/a693717c1949441889c4d85bf923c47f` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:55.211191 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ed340f-fe8c-47b9-98a9-eb99d9583c9a None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:55.217632 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07caa25-1613-4653-b4f5-0db12db599ab None admin] RBAC: Authorizing `identity:get_group(group_id=a693717c1949441889c4d85bf923c47f)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:55.219120 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07caa25-1613-4653-b4f5-0db12db599ab None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:55.221609 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 177/351] 10.222.0.52 () {56 vars in 1180 bytes} [Sat May 14 20:49:55 2022] GET /identity/v3/groups/a693717c1949441889c4d85bf923c47f => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:55.223372 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07caa25-1613-4653-b4f5-0db12db599ab None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:55.325001 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 175/352] 10.222.0.52 () {58 vars in 1282 bytes} [Sat May 14 20:49:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 14 20:49:55.325844 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed340f-fe8c-47b9-98a9-eb99d9583c9a None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:55.342697 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07caa25-1613-4653-b4f5-0db12db599ab None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:55.380307 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d7cd01-7c74-4634-ad7a-7b35aaf61f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:55.381634 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7cd01-7c74-4634-ad7a-7b35aaf61f95 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:55.382147 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7cd01-7c74-4634-ad7a-7b35aaf61f95 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:55.382627 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7cd01-7c74-4634-ad7a-7b35aaf61f95 None admin] PATH_INFO: `/v3/users/26265afb531a4e79b8ed3951e85a0927` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:55.384121 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d7cd01-7c74-4634-ad7a-7b35aaf61f95 None admin] RBAC: Authorizing `identity:get_user(user_id=26265afb531a4e79b8ed3951e85a0927)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:55.385783 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d7cd01-7c74-4634-ad7a-7b35aaf61f95 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:55.388495 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 178/353] 10.222.0.52 () {56 vars in 1177 bytes} [Sat May 14 20:49:55 2022] GET /identity/v3/users/26265afb531a4e79b8ed3951e85a0927 => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:55.389892 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d7cd01-7c74-4634-ad7a-7b35aaf61f95 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:55.446382 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed340f-fe8c-47b9-98a9-eb99d9583c9a None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:55.494068 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce036f5c-b379-4fe9-ac28-f88a924be928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:55.494787 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce036f5c-b379-4fe9-ac28-f88a924be928 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:55.495064 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce036f5c-b379-4fe9-ac28-f88a924be928 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:55.495363 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce036f5c-b379-4fe9-ac28-f88a924be928 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:55.505280 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d7cd01-7c74-4634-ad7a-7b35aaf61f95 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:55.509429 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce036f5c-b379-4fe9-ac28-f88a924be928 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:49:55.518866 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-ce036f5c-b379-4fe9-ac28-f88a924be928 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 14 20:49:55.518866 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:49:55.518866 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:49:55.518866 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:49:55.518866 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:49:55.518866 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:49:55.518866 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:49:55.518866 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:49:55.518866 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:49:55.518866 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:49:55.518866 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:49:55.518866 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:49:55.518866 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:49:55.518866 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:49:55.518866 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:49:55.518866 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:49:55.520401 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:49:55.520401 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:49:55.520401 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:49:55.520401 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:49:55.520401 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:49:55.520401 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:49:55.520401 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:49:55.520401 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:49:55.520401 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:49:55.520401 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:49:55.520401 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:49:55.520401 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:49:55.520401 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:49:55.520401 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:49:55.520401 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:49:55.520401 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:49:55.521302 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:49:55.521302 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:49:55.521302 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:49:55.521302 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:49:55.521302 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:49:55.521302 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:49:55.521302 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:49:55.521302 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:49:55.521302 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:49:55.521302 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:49:55.521302 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 14 20:49:55.521302 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:49:55.521302 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 176/354] 10.222.0.52 () {56 vars in 1099 bytes} [Sat May 14 20:49:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:49:55.522053 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce036f5c-b379-4fe9-ac28-f88a924be928 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:55.561353 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024d14aa-b797-4614-bbb2-dd79a8d36762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:55.561917 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d14aa-b797-4614-bbb2-dd79a8d36762 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:55.561917 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d14aa-b797-4614-bbb2-dd79a8d36762 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:55.562231 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d14aa-b797-4614-bbb2-dd79a8d36762 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:55.562984 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024d14aa-b797-4614-bbb2-dd79a8d36762 None admin] RBAC: Adding query filter params (group.id=a693717c1949441889c4d85bf923c47f, role.id=274f900b5153444b84117bc9919443fc, scope.project.id=c377a7cb474f47c8861e1c13e61ee22d) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:49:55.563472 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024d14aa-b797-4614-bbb2-dd79a8d36762 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:55.565205 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024d14aa-b797-4614-bbb2-dd79a8d36762 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:55.574910 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 179/355] 10.222.0.52 () {56 vars in 1376 bytes} [Sat May 14 20:49:55 2022] GET /identity/v3/role_assignments?group.id=a693717c1949441889c4d85bf923c47f&scope.project.id=c377a7cb474f47c8861e1c13e61ee22d&role.id=274f900b5153444b84117bc9919443fc => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:55.575785 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024d14aa-b797-4614-bbb2-dd79a8d36762 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:55.657361 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce036f5c-b379-4fe9-ac28-f88a924be928 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:55.703343 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103c1342-ca50-4849-95b9-f569ad785a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:55.704294 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c1342-ca50-4849-95b9-f569ad785a83 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:55.704833 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c1342-ca50-4849-95b9-f569ad785a83 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:55.704833 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c1342-ca50-4849-95b9-f569ad785a83 None admin] PATH_INFO: `/v3/projects/c377a7cb474f47c8861e1c13e61ee22d` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:55.706103 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103c1342-ca50-4849-95b9-f569ad785a83 None admin] RBAC: Authorizing `identity:get_project(project_id=c377a7cb474f47c8861e1c13e61ee22d)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:55.708392 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103c1342-ca50-4849-95b9-f569ad785a83 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:55.709270 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024d14aa-b797-4614-bbb2-dd79a8d36762 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:55.710877 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 177/356] 10.222.0.52 () {56 vars in 1186 bytes} [Sat May 14 20:49:55 2022] GET /identity/v3/projects/c377a7cb474f47c8861e1c13e61ee22d => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:55.711734 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103c1342-ca50-4849-95b9-f569ad785a83 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:55.768081 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0a5e46-b542-4fc9-97cd-fbfeb0c5730c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:55.770163 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a5e46-b542-4fc9-97cd-fbfeb0c5730c None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:55.770663 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a5e46-b542-4fc9-97cd-fbfeb0c5730c None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:55.771423 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a5e46-b542-4fc9-97cd-fbfeb0c5730c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:55.772548 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0a5e46-b542-4fc9-97cd-fbfeb0c5730c None admin] RBAC: Adding query filter params (role.id=eecceaafa26e4f31a69165cbb855b327, user.id=26265afb531a4e79b8ed3951e85a0927, scope.system=all) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:49:55.773214 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0a5e46-b542-4fc9-97cd-fbfeb0c5730c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:55.775235 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0a5e46-b542-4fc9-97cd-fbfeb0c5730c None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:55.791615 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 180/357] 10.222.0.52 () {56 vars in 1308 bytes} [Sat May 14 20:49:55 2022] GET /identity/v3/role_assignments?user.id=26265afb531a4e79b8ed3951e85a0927&scope.system=all&role.id=eecceaafa26e4f31a69165cbb855b327 => generated 510 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:55.793284 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a6483-7cef-4d7d-9c65-648598a09541 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:55.793770 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a6483-7cef-4d7d-9c65-648598a09541 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:55.794260 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a6483-7cef-4d7d-9c65-648598a09541 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:55.795877 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 181/358] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:49:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:49:55.797014 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2a6483-7cef-4d7d-9c65-648598a09541 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:55.876904 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103c1342-ca50-4849-95b9-f569ad785a83 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:55.915742 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d2c734-547c-4ead-9885-61a8786e08ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:55.916860 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2c734-547c-4ead-9885-61a8786e08ee None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:55.917366 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2c734-547c-4ead-9885-61a8786e08ee None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:55.917841 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2c734-547c-4ead-9885-61a8786e08ee None admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:55.918826 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d2c734-547c-4ead-9885-61a8786e08ee None admin] RBAC: Adding query filter params (name=member) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:49:55.919356 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d2c734-547c-4ead-9885-61a8786e08ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:55.921011 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d2c734-547c-4ead-9885-61a8786e08ee None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:55.931535 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 178/359] 10.222.0.52 () {56 vars in 1101 bytes} [Sat May 14 20:49:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:55.933116 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9896745-c751-4398-8762-6a9af5816e21 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:55.933613 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9896745-c751-4398-8762-6a9af5816e21 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:55.934089 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9896745-c751-4398-8762-6a9af5816e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:55.952173 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-d9896745-c751-4398-8762-6a9af5816e21 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:49:55.954740 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2a6483-7cef-4d7d-9c65-648598a09541 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:55.955020 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-d9896745-c751-4398-8762-6a9af5816e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:49:55.991600 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338926e2-c3c7-49b6-a4d3-42d1234274da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:55.992583 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338926e2-c3c7-49b6-a4d3-42d1234274da None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:55.992869 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338926e2-c3c7-49b6-a4d3-42d1234274da None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:55.993229 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338926e2-c3c7-49b6-a4d3-42d1234274da None admin] PATH_INFO: `/v3/groups/a693717c1949441889c4d85bf923c47f` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:55.994482 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338926e2-c3c7-49b6-a4d3-42d1234274da None admin] RBAC: Authorizing `identity:get_group(group_id=a693717c1949441889c4d85bf923c47f)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:55.996290 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338926e2-c3c7-49b6-a4d3-42d1234274da None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:55.998226 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 182/360] 10.222.0.52 () {56 vars in 1180 bytes} [Sat May 14 20:49:55 2022] GET /identity/v3/groups/a693717c1949441889c4d85bf923c47f => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:55.998841 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338926e2-c3c7-49b6-a4d3-42d1234274da None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:56.037171 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 179/361] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:49:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 20:49:56.038489 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9896745-c751-4398-8762-6a9af5816e21 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:56.111010 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338926e2-c3c7-49b6-a4d3-42d1234274da None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:56.145276 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9896745-c751-4398-8762-6a9af5816e21 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:56.147022 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490a0614-c7cf-4fef-ad77-a7acdfa4c049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:56.147707 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a0614-c7cf-4fef-ad77-a7acdfa4c049 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:56.147994 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a0614-c7cf-4fef-ad77-a7acdfa4c049 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:56.148275 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a0614-c7cf-4fef-ad77-a7acdfa4c049 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:56.185008 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc297cb-0661-482b-978e-c9b16d08cb60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:56.186038 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc297cb-0661-482b-978e-c9b16d08cb60 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:56.186524 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc297cb-0661-482b-978e-c9b16d08cb60 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:56.187016 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc297cb-0661-482b-978e-c9b16d08cb60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:56.188087 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc297cb-0661-482b-978e-c9b16d08cb60 None admin] RBAC: Adding query filter params (group.id=a693717c1949441889c4d85bf923c47f, role.id=4f4cbb0efdc1410294a05a7ba44f9320, scope.project.id=c377a7cb474f47c8861e1c13e61ee22d) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:49:56.188618 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc297cb-0661-482b-978e-c9b16d08cb60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:56.190447 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc297cb-0661-482b-978e-c9b16d08cb60 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:56.196940 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 180/362] 10.222.0.52 () {56 vars in 1376 bytes} [Sat May 14 20:49:56 2022] GET /identity/v3/role_assignments?group.id=a693717c1949441889c4d85bf923c47f&scope.project.id=c377a7cb474f47c8861e1c13e61ee22d&role.id=4f4cbb0efdc1410294a05a7ba44f9320 => generated 260 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:56.198148 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc297cb-0661-482b-978e-c9b16d08cb60 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:56.223694 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490a0614-c7cf-4fef-ad77-a7acdfa4c049 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:56.225278 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490a0614-c7cf-4fef-ad77-a7acdfa4c049 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:56.308550 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc297cb-0661-482b-978e-c9b16d08cb60 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:56.338475 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 183/363] 10.222.0.52 () {58 vars in 1282 bytes} [Sat May 14 20:49:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 14 20:49:56.339837 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d99fa-8076-48f9-87b5-3bcb502ac220 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:56.340130 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d99fa-8076-48f9-87b5-3bcb502ac220 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:56.340411 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d99fa-8076-48f9-87b5-3bcb502ac220 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:56.341711 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 184/364] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:49:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:49:56.347855 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d99fa-8076-48f9-87b5-3bcb502ac220 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:56.350235 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7590498-a9fa-4cf1-b1b8-0bc718afc519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:56.351156 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7590498-a9fa-4cf1-b1b8-0bc718afc519 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:56.351565 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7590498-a9fa-4cf1-b1b8-0bc718afc519 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:56.351920 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7590498-a9fa-4cf1-b1b8-0bc718afc519 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:56.369906 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7590498-a9fa-4cf1-b1b8-0bc718afc519 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:49:56.383081 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-e7590498-a9fa-4cf1-b1b8-0bc718afc519 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 14 20:49:56.383081 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:49:56.383081 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:49:56.383081 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:49:56.383081 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:49:56.383081 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:49:56.383081 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:49:56.383081 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:49:56.383081 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:49:56.383081 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:49:56.383081 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:49:56.383081 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:49:56.383081 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:49:56.383081 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:49:56.383081 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:49:56.383081 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:49:56.384110 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:49:56.384110 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:49:56.384110 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:49:56.384110 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:49:56.384110 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:49:56.384110 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:49:56.384110 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:49:56.384110 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:49:56.384110 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:49:56.384110 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:49:56.384110 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:49:56.384110 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:49:56.384110 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:49:56.384110 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:49:56.384110 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:49:56.384110 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:49:56.384927 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:49:56.384927 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:49:56.384927 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:49:56.384927 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:49:56.384927 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:49:56.384927 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:49:56.384927 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:49:56.384927 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:49:56.384927 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:49:56.384927 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:49:56.384927 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 14 20:49:56.384927 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:49:56.388334 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 181/365] 10.222.0.52 () {56 vars in 1114 bytes} [Sat May 14 20:49:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:49:56.390830 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d39ae-a087-4ee5-9940-1dc441d5e1f4 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:56.391586 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d39ae-a087-4ee5-9940-1dc441d5e1f4 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:56.392452 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d39ae-a087-4ee5-9940-1dc441d5e1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:56.414899 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-c54d39ae-a087-4ee5-9940-1dc441d5e1f4 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:49:56.418367 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c54d39ae-a087-4ee5-9940-1dc441d5e1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:49:56.489032 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d99fa-8076-48f9-87b5-3bcb502ac220 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:56.496383 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 182/366] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:49:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 20:49:56.497523 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d39ae-a087-4ee5-9940-1dc441d5e1f4 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:56.541243 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ce2f1-2702-4149-80ed-41cbda0dccb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:56.542175 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ce2f1-2702-4149-80ed-41cbda0dccb4 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:56.542459 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ce2f1-2702-4149-80ed-41cbda0dccb4 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:56.542732 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ce2f1-2702-4149-80ed-41cbda0dccb4 None admin] PATH_INFO: `/v3/projects/95e730a9930947c491bac8f909cc59c8` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:56.543977 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0ce2f1-2702-4149-80ed-41cbda0dccb4 None admin] RBAC: Authorizing `identity:get_project(project_id=95e730a9930947c491bac8f909cc59c8)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:56.545429 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0ce2f1-2702-4149-80ed-41cbda0dccb4 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:56.547612 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 185/367] 10.222.0.52 () {56 vars in 1186 bytes} [Sat May 14 20:49:56 2022] GET /identity/v3/projects/95e730a9930947c491bac8f909cc59c8 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:56.548545 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ce2f1-2702-4149-80ed-41cbda0dccb4 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:56.611682 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d39ae-a087-4ee5-9940-1dc441d5e1f4 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:56.658942 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cddfe6d-5753-4687-a002-c6813b94cb85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:56.659755 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cddfe6d-5753-4687-a002-c6813b94cb85 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:56.661291 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cddfe6d-5753-4687-a002-c6813b94cb85 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:56.662827 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cddfe6d-5753-4687-a002-c6813b94cb85 None admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:56.663615 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cddfe6d-5753-4687-a002-c6813b94cb85 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:49:56.663929 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cddfe6d-5753-4687-a002-c6813b94cb85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:56.665481 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cddfe6d-5753-4687-a002-c6813b94cb85 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:56.675062 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ce2f1-2702-4149-80ed-41cbda0dccb4 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:56.678712 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 183/368] 10.222.0.52 () {56 vars in 1111 bytes} [Sat May 14 20:49:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:56.679069 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cddfe6d-5753-4687-a002-c6813b94cb85 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:56.715441 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12635fdb-0f9a-499e-a4a7-3a53961badb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:56.716686 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12635fdb-0f9a-499e-a4a7-3a53961badb8 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:56.717079 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12635fdb-0f9a-499e-a4a7-3a53961badb8 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:56.717435 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12635fdb-0f9a-499e-a4a7-3a53961badb8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:56.729129 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12635fdb-0f9a-499e-a4a7-3a53961badb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:49:56.736883 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-12635fdb-0f9a-499e-a4a7-3a53961badb8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 14 20:49:56.736883 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:49:56.736883 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:49:56.736883 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:49:56.736883 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:49:56.736883 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:49:56.736883 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:49:56.736883 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:49:56.736883 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:49:56.736883 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:49:56.736883 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:49:56.736883 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:49:56.736883 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:49:56.736883 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:49:56.736883 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:49:56.736883 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:49:56.738464 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:49:56.738464 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:49:56.738464 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:49:56.738464 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:49:56.738464 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:49:56.738464 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:49:56.738464 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:49:56.738464 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:49:56.738464 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:49:56.738464 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:49:56.738464 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:49:56.738464 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:49:56.738464 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:49:56.738464 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:49:56.738464 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:49:56.738464 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:49:56.739683 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:49:56.739683 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:49:56.739683 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:49:56.739683 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:49:56.739683 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:49:56.739683 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:49:56.739683 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:49:56.739683 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:49:56.739683 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:49:56.739683 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:49:56.739683 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 14 20:49:56.739683 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:49:56.739683 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 186/369] 10.222.0.52 () {56 vars in 1096 bytes} [Sat May 14 20:49:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:49:56.739683 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12635fdb-0f9a-499e-a4a7-3a53961badb8 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:56.809226 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cddfe6d-5753-4687-a002-c6813b94cb85 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:56.856096 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6cf296-11c7-488f-839d-566ce313d875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:56.859526 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6cf296-11c7-488f-839d-566ce313d875 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:56.859526 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6cf296-11c7-488f-839d-566ce313d875 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:56.859526 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6cf296-11c7-488f-839d-566ce313d875 None admin] PATH_INFO: `/v3/groups/a693717c1949441889c4d85bf923c47f` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:56.859526 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6cf296-11c7-488f-839d-566ce313d875 None admin] RBAC: Authorizing `identity:get_group(group_id=a693717c1949441889c4d85bf923c47f)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:56.860464 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6cf296-11c7-488f-839d-566ce313d875 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:56.862291 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12635fdb-0f9a-499e-a4a7-3a53961badb8 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:56.862407 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 184/370] 10.222.0.52 () {56 vars in 1180 bytes} [Sat May 14 20:49:56 2022] GET /identity/v3/groups/a693717c1949441889c4d85bf923c47f => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:56.863267 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6cf296-11c7-488f-839d-566ce313d875 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:56.902925 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e64c8-0153-4ab5-a74b-748c31171d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:56.904063 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e64c8-0153-4ab5-a74b-748c31171d5a None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:56.904544 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e64c8-0153-4ab5-a74b-748c31171d5a None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:56.905123 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e64c8-0153-4ab5-a74b-748c31171d5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:56.995825 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869e64c8-0153-4ab5-a74b-748c31171d5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:56.997899 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869e64c8-0153-4ab5-a74b-748c31171d5a None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:57.008144 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6cf296-11c7-488f-839d-566ce313d875 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:57.049129 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01065378-f530-4de4-a21f-951054c8318c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:57.049820 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01065378-f530-4de4-a21f-951054c8318c None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:57.050109 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01065378-f530-4de4-a21f-951054c8318c None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:57.050429 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01065378-f530-4de4-a21f-951054c8318c None admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:57.051179 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01065378-f530-4de4-a21f-951054c8318c None admin] RBAC: Adding query filter params (name=admin) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:49:57.051521 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01065378-f530-4de4-a21f-951054c8318c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:57.052891 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01065378-f530-4de4-a21f-951054c8318c None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:57.067099 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 185/371] 10.222.0.52 () {56 vars in 1099 bytes} [Sat May 14 20:49:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:57.068772 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01065378-f530-4de4-a21f-951054c8318c None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:57.107910 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 187/372] 10.222.0.52 () {58 vars in 1282 bytes} [Sat May 14 20:49:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 14 20:49:57.108885 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e64c8-0153-4ab5-a74b-748c31171d5a None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:57.191923 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01065378-f530-4de4-a21f-951054c8318c None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:57.221984 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e64c8-0153-4ab5-a74b-748c31171d5a None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:57.230425 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52736990-8a88-48fd-9c72-3afe814ff5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:57.231360 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52736990-8a88-48fd-9c72-3afe814ff5a6 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:57.231884 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52736990-8a88-48fd-9c72-3afe814ff5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:57.232361 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52736990-8a88-48fd-9c72-3afe814ff5a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:57.233401 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52736990-8a88-48fd-9c72-3afe814ff5a6 None admin] RBAC: Adding query filter params (group.id=a693717c1949441889c4d85bf923c47f, role.id=4f4cbb0efdc1410294a05a7ba44f9320, scope.project.id=95e730a9930947c491bac8f909cc59c8) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:49:57.233932 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52736990-8a88-48fd-9c72-3afe814ff5a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:57.235610 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52736990-8a88-48fd-9c72-3afe814ff5a6 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:57.241945 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 186/373] 10.222.0.52 () {56 vars in 1376 bytes} [Sat May 14 20:49:57 2022] GET /identity/v3/role_assignments?group.id=a693717c1949441889c4d85bf923c47f&scope.project.id=95e730a9930947c491bac8f909cc59c8&role.id=4f4cbb0efdc1410294a05a7ba44f9320 => generated 260 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:57.243044 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52736990-8a88-48fd-9c72-3afe814ff5a6 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:57.259139 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa62f0-0dda-4969-b2b8-6c59f73c36de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:57.259840 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa62f0-0dda-4969-b2b8-6c59f73c36de None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:57.260121 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa62f0-0dda-4969-b2b8-6c59f73c36de None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:57.260395 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa62f0-0dda-4969-b2b8-6c59f73c36de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:57.334430 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fa62f0-0dda-4969-b2b8-6c59f73c36de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:57.336042 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fa62f0-0dda-4969-b2b8-6c59f73c36de None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:57.353708 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52736990-8a88-48fd-9c72-3afe814ff5a6 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:57.391130 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9165c2c4-d63e-4d09-ae8f-e4fe19bd4a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:57.392422 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165c2c4-d63e-4d09-ae8f-e4fe19bd4a56 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:57.392938 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165c2c4-d63e-4d09-ae8f-e4fe19bd4a56 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:57.393416 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165c2c4-d63e-4d09-ae8f-e4fe19bd4a56 None admin] PATH_INFO: `/v3/projects/95e730a9930947c491bac8f909cc59c8` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:57.395201 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9165c2c4-d63e-4d09-ae8f-e4fe19bd4a56 None admin] RBAC: Authorizing `identity:get_project(project_id=95e730a9930947c491bac8f909cc59c8)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:57.396957 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9165c2c4-d63e-4d09-ae8f-e4fe19bd4a56 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:57.399023 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 187/374] 10.222.0.52 () {56 vars in 1186 bytes} [Sat May 14 20:49:57 2022] GET /identity/v3/projects/95e730a9930947c491bac8f909cc59c8 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:57.405032 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9165c2c4-d63e-4d09-ae8f-e4fe19bd4a56 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:57.478692 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 188/375] 10.222.0.52 () {58 vars in 1282 bytes} [Sat May 14 20:49:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 14 20:49:57.484612 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa62f0-0dda-4969-b2b8-6c59f73c36de None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:57.594978 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9165c2c4-d63e-4d09-ae8f-e4fe19bd4a56 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:57.629591 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa62f0-0dda-4969-b2b8-6c59f73c36de None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:57.643731 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea98c87-f7b5-4b9c-8631-4444b872e70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:57.644844 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea98c87-f7b5-4b9c-8631-4444b872e70f None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:57.645242 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea98c87-f7b5-4b9c-8631-4444b872e70f None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:57.645655 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea98c87-f7b5-4b9c-8631-4444b872e70f None admin] PATH_INFO: `/v3/groups/a693717c1949441889c4d85bf923c47f` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:57.652274 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea98c87-f7b5-4b9c-8631-4444b872e70f None admin] RBAC: Authorizing `identity:get_group(group_id=a693717c1949441889c4d85bf923c47f)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:57.655094 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea98c87-f7b5-4b9c-8631-4444b872e70f None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:57.657612 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 188/376] 10.222.0.52 () {56 vars in 1180 bytes} [Sat May 14 20:49:57 2022] GET /identity/v3/groups/a693717c1949441889c4d85bf923c47f => generated 226 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:57.665693 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea98c87-f7b5-4b9c-8631-4444b872e70f None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:57.708582 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781ad4a7-661c-4019-893f-e3bc6fe9ad0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:57.710100 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ad4a7-661c-4019-893f-e3bc6fe9ad0d None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:57.710602 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ad4a7-661c-4019-893f-e3bc6fe9ad0d None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:57.711059 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ad4a7-661c-4019-893f-e3bc6fe9ad0d None admin] PATH_INFO: `/v3/projects/96a027574eeb4536a94751bde54cf3b1` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:57.712856 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781ad4a7-661c-4019-893f-e3bc6fe9ad0d None admin] RBAC: Authorizing `identity:get_project(project_id=96a027574eeb4536a94751bde54cf3b1)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:57.714864 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781ad4a7-661c-4019-893f-e3bc6fe9ad0d None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:57.719596 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 189/377] 10.222.0.52 () {56 vars in 1186 bytes} [Sat May 14 20:49:57 2022] GET /identity/v3/projects/96a027574eeb4536a94751bde54cf3b1 => generated 344 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:57.724763 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781ad4a7-661c-4019-893f-e3bc6fe9ad0d None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:57.858746 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea98c87-f7b5-4b9c-8631-4444b872e70f None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:57.909189 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781ad4a7-661c-4019-893f-e3bc6fe9ad0d None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:57.914321 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b5ec3a-435b-46ef-918d-47a8f515881a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:57.914992 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b5ec3a-435b-46ef-918d-47a8f515881a None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:57.915278 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b5ec3a-435b-46ef-918d-47a8f515881a None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:57.915584 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b5ec3a-435b-46ef-918d-47a8f515881a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:57.916436 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b5ec3a-435b-46ef-918d-47a8f515881a None admin] RBAC: Adding query filter params (group.id=a693717c1949441889c4d85bf923c47f, role.id=274f900b5153444b84117bc9919443fc, scope.project.id=95e730a9930947c491bac8f909cc59c8) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:49:57.916751 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b5ec3a-435b-46ef-918d-47a8f515881a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:57.918202 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b5ec3a-435b-46ef-918d-47a8f515881a None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:57.933564 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 189/378] 10.222.0.52 () {56 vars in 1376 bytes} [Sat May 14 20:49:57 2022] GET /identity/v3/role_assignments?group.id=a693717c1949441889c4d85bf923c47f&scope.project.id=95e730a9930947c491bac8f909cc59c8&role.id=274f900b5153444b84117bc9919443fc => generated 260 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:49:57.973924 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89d9e47-ff58-47c0-9f4a-08783078239d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:57.974800 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d9e47-ff58-47c0-9f4a-08783078239d None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:57.975077 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d9e47-ff58-47c0-9f4a-08783078239d None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:57.975398 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d9e47-ff58-47c0-9f4a-08783078239d None admin] PATH_INFO: `/v3/groups/d7d8e7c727ea429697f25fc7a3c599d6` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:57.985355 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89d9e47-ff58-47c0-9f4a-08783078239d None admin] RBAC: Authorizing `identity:get_group(group_id=d7d8e7c727ea429697f25fc7a3c599d6)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:57.986835 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89d9e47-ff58-47c0-9f4a-08783078239d None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:57.989469 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 190/379] 10.222.0.52 () {56 vars in 1180 bytes} [Sat May 14 20:49:57 2022] GET /identity/v3/groups/d7d8e7c727ea429697f25fc7a3c599d6 => generated 229 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:57.995215 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b5ec3a-435b-46ef-918d-47a8f515881a None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:58.114935 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b5ec3a-435b-46ef-918d-47a8f515881a None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:58.156988 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad2b07e-c963-438b-b832-8f76f36d088b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:58.157657 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad2b07e-c963-438b-b832-8f76f36d088b None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:58.157938 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad2b07e-c963-438b-b832-8f76f36d088b None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:58.158209 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad2b07e-c963-438b-b832-8f76f36d088b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:58.159037 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad2b07e-c963-438b-b832-8f76f36d088b None admin] RBAC: Adding query filter params (group.id=d7d8e7c727ea429697f25fc7a3c599d6, role.id=24c463e2b4d44dd28cd2723a69a8ed2e, scope.project.id=96a027574eeb4536a94751bde54cf3b1) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:49:58.159343 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad2b07e-c963-438b-b832-8f76f36d088b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:58.160949 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad2b07e-c963-438b-b832-8f76f36d088b None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:58.172431 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 190/380] 10.222.0.52 () {56 vars in 1376 bytes} [Sat May 14 20:49:57 2022] GET /identity/v3/role_assignments?group.id=d7d8e7c727ea429697f25fc7a3c599d6&scope.project.id=96a027574eeb4536a94751bde54cf3b1&role.id=24c463e2b4d44dd28cd2723a69a8ed2e => generated 260 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:58.785390 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd415ad-ed31-4dae-a41e-2192a5d170ed None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:58.786031 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd415ad-ed31-4dae-a41e-2192a5d170ed None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:58.786031 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd415ad-ed31-4dae-a41e-2192a5d170ed None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:58.787534 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 191/381] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:49:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:49:58.793025 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac1acfb-606e-455c-933a-5982712f164c None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:58.793476 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac1acfb-606e-455c-933a-5982712f164c None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:58.793654 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac1acfb-606e-455c-933a-5982712f164c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:58.816833 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-4ac1acfb-606e-455c-933a-5982712f164c None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:49:58.818082 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-4ac1acfb-606e-455c-933a-5982712f164c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:49:58.901983 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 191/382] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:49:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 20:49:58.934729 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd415ad-ed31-4dae-a41e-2192a5d170ed None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:59.061265 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd415ad-ed31-4dae-a41e-2192a5d170ed None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:59.102623 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8d71ea-6ee6-4b0a-b6f1-605a4aeb573a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:59.103432 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d71ea-6ee6-4b0a-b6f1-605a4aeb573a None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:59.103737 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d71ea-6ee6-4b0a-b6f1-605a4aeb573a None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:59.104011 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d71ea-6ee6-4b0a-b6f1-605a4aeb573a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:59.117591 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8d71ea-6ee6-4b0a-b6f1-605a4aeb573a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:49:59.126169 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-8b8d71ea-6ee6-4b0a-b6f1-605a4aeb573a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 14 20:49:59.126169 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:49:59.126169 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:49:59.126169 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:49:59.126169 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:49:59.126169 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:49:59.126169 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:49:59.126169 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:49:59.126169 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:49:59.126169 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:49:59.126169 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:49:59.126169 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:49:59.126169 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:49:59.126169 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:49:59.126169 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:49:59.126169 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:49:59.127075 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:49:59.127075 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:49:59.127075 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:49:59.127075 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:49:59.127075 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:49:59.127075 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:49:59.127075 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:49:59.127075 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:49:59.127075 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:49:59.127075 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:49:59.127075 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:49:59.127075 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:49:59.127075 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:49:59.127075 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:49:59.127075 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:49:59.127075 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:49:59.127892 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:49:59.127892 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:49:59.127892 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:49:59.127892 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:49:59.127892 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:49:59.127892 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:49:59.127892 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:49:59.127892 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:49:59.127892 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:49:59.127892 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:49:59.127892 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 14 20:49:59.127892 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:49:59.127892 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 192/383] 10.222.0.52 () {56 vars in 1114 bytes} [Sat May 14 20:49:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:49:59.136328 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac1acfb-606e-455c-933a-5982712f164c None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:59.275072 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac1acfb-606e-455c-933a-5982712f164c None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:59.294845 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871327b-4813-4559-a978-a33a8a4b1dbe None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:59.295158 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871327b-4813-4559-a978-a33a8a4b1dbe None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:59.295419 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871327b-4813-4559-a978-a33a8a4b1dbe None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:59.298090 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 193/384] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:49:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:49:59.303051 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b72cd-fc46-4e75-9424-e756d23a156f None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:59.303336 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b72cd-fc46-4e75-9424-e756d23a156f None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:59.303666 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b72cd-fc46-4e75-9424-e756d23a156f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:59.324803 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2937138e-359a-48ac-a38d-ff36bc4c7c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:59.325422 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2937138e-359a-48ac-a38d-ff36bc4c7c68 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:59.325703 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2937138e-359a-48ac-a38d-ff36bc4c7c68 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:59.325978 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2937138e-359a-48ac-a38d-ff36bc4c7c68 None admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:59.326731 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2937138e-359a-48ac-a38d-ff36bc4c7c68 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:49:59.327038 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2937138e-359a-48ac-a38d-ff36bc4c7c68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:59.328487 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2937138e-359a-48ac-a38d-ff36bc4c7c68 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:59.336513 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-dd6b72cd-fc46-4e75-9424-e756d23a156f None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:49:59.337707 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-dd6b72cd-fc46-4e75-9424-e756d23a156f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:49:59.337983 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 192/385] 10.222.0.52 () {56 vars in 1111 bytes} [Sat May 14 20:49:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:59.344467 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2937138e-359a-48ac-a38d-ff36bc4c7c68 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:59.448377 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2937138e-359a-48ac-a38d-ff36bc4c7c68 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:59.478275 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 194/386] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:49:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 20:49:59.489944 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b3eb8-179c-442b-bbce-f545d6a914b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:59.490809 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b3eb8-179c-442b-bbce-f545d6a914b2 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:59.491098 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b3eb8-179c-442b-bbce-f545d6a914b2 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:59.491370 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b3eb8-179c-442b-bbce-f545d6a914b2 None admin] PATH_INFO: `/v3/groups/a693717c1949441889c4d85bf923c47f` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:59.492588 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946b3eb8-179c-442b-bbce-f545d6a914b2 None admin] RBAC: Authorizing `identity:get_group(group_id=a693717c1949441889c4d85bf923c47f)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:59.494038 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946b3eb8-179c-442b-bbce-f545d6a914b2 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:59.495712 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 193/387] 10.222.0.52 () {56 vars in 1180 bytes} [Sat May 14 20:49:59 2022] GET /identity/v3/groups/a693717c1949441889c4d85bf923c47f => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:59.501681 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b72cd-fc46-4e75-9424-e756d23a156f None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:59.536170 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b3eb8-179c-442b-bbce-f545d6a914b2 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:59.646342 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b3eb8-179c-442b-bbce-f545d6a914b2 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:59.681736 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b72cd-fc46-4e75-9424-e756d23a156f None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:59.694641 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815f1f7f-31b7-4c11-915f-630491cf7ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:59.695896 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f1f7f-31b7-4c11-915f-630491cf7ece None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:59.696178 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f1f7f-31b7-4c11-915f-630491cf7ece None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:59.696452 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f1f7f-31b7-4c11-915f-630491cf7ece None admin] PATH_INFO: `/v3/roles/member` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:59.713099 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815f1f7f-31b7-4c11-915f-630491cf7ece None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:49:59.724034 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-815f1f7f-31b7-4c11-915f-630491cf7ece None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 14 20:49:59.724034 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:49:59.724034 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:49:59.724034 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:49:59.724034 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:49:59.724034 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:49:59.724034 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:49:59.724034 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:49:59.724034 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:49:59.724034 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:49:59.724034 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:49:59.724034 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:49:59.724034 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:49:59.724034 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:49:59.724034 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:49:59.724034 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:49:59.725008 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:49:59.725008 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:49:59.725008 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:49:59.725008 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:49:59.725008 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:49:59.725008 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:49:59.725008 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:49:59.725008 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:49:59.725008 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:49:59.725008 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:49:59.725008 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:49:59.725008 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:49:59.725008 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:49:59.725008 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:49:59.725008 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:49:59.725008 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:49:59.725816 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:49:59.725816 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:49:59.725816 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:49:59.725816 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:49:59.725816 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:49:59.725816 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:49:59.725816 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:49:59.725816 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:49:59.725816 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:49:59.725816 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:49:59.725816 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 14 20:49:59.725816 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:49:59.727666 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 194/388] 10.222.0.52 () {56 vars in 1099 bytes} [Sat May 14 20:49:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 20:49:59.730797 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94fdfed-1e35-4e36-8ffe-5bf70b53414c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:59.732418 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94fdfed-1e35-4e36-8ffe-5bf70b53414c None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:59.732958 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94fdfed-1e35-4e36-8ffe-5bf70b53414c None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:59.733411 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815f1f7f-31b7-4c11-915f-630491cf7ece None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:59.733692 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94fdfed-1e35-4e36-8ffe-5bf70b53414c None admin] PATH_INFO: `/v3/projects/c377a7cb474f47c8861e1c13e61ee22d` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:59.735367 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94fdfed-1e35-4e36-8ffe-5bf70b53414c None admin] RBAC: Authorizing `identity:get_project(project_id=c377a7cb474f47c8861e1c13e61ee22d)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:59.737098 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94fdfed-1e35-4e36-8ffe-5bf70b53414c None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:59.739228 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 195/389] 10.222.0.52 () {56 vars in 1186 bytes} [Sat May 14 20:49:59 2022] GET /identity/v3/projects/c377a7cb474f47c8861e1c13e61ee22d => generated 298 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:49:59.747027 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94fdfed-1e35-4e36-8ffe-5bf70b53414c None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:49:59.896856 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94fdfed-1e35-4e36-8ffe-5bf70b53414c None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:59.924758 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815f1f7f-31b7-4c11-915f-630491cf7ece None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:49:59.969384 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f8f45-4c83-4aa3-ba74-aba3634fa106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:59.970696 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f8f45-4c83-4aa3-ba74-aba3634fa106 None admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:59.972981 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f8f45-4c83-4aa3-ba74-aba3634fa106 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:59.973730 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f8f45-4c83-4aa3-ba74-aba3634fa106 None admin] PATH_INFO: `/v3/projects/c377a7cb474f47c8861e1c13e61ee22d/groups/a693717c1949441889c4d85bf923c47f/roles/274f900b5153444b84117bc9919443fc` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:59.978654 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7f8f45-4c83-4aa3-ba74-aba3634fa106 None admin] RBAC: Authorizing `identity:create_grant(project_id=c377a7cb474f47c8861e1c13e61ee22d, group_id=a693717c1949441889c4d85bf923c47f, role_id=274f900b5153444b84117bc9919443fc)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:59.981047 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7f8f45-4c83-4aa3-ba74-aba3634fa106 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:49:59.994655 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06909b22-431b-4099-b657-abbb303ff55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:49:59.995618 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06909b22-431b-4099-b657-abbb303ff55b None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:49:59.996350 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06909b22-431b-4099-b657-abbb303ff55b None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:49:59.996804 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06909b22-431b-4099-b657-abbb303ff55b None admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:49:59.997752 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06909b22-431b-4099-b657-abbb303ff55b None admin] RBAC: Adding query filter params (name=member) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:49:59.998238 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06909b22-431b-4099-b657-abbb303ff55b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:49:59.999824 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06909b22-431b-4099-b657-abbb303ff55b None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:00.009485 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 195/390] 10.222.0.52 () {56 vars in 1101 bytes} [Sat May 14 20:49:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:00.014545 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06909b22-431b-4099-b657-abbb303ff55b None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:00.120845 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06909b22-431b-4099-b657-abbb303ff55b None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:00.158161 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d37597-7f9d-43c9-b6e9-f4b3eea2c34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:00.158947 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d37597-7f9d-43c9-b6e9-f4b3eea2c34e None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:00.159233 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d37597-7f9d-43c9-b6e9-f4b3eea2c34e None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:00.159577 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d37597-7f9d-43c9-b6e9-f4b3eea2c34e None admin] PATH_INFO: `/v3/groups/a693717c1949441889c4d85bf923c47f` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:00.161594 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d37597-7f9d-43c9-b6e9-f4b3eea2c34e None admin] RBAC: Authorizing `identity:get_group(group_id=a693717c1949441889c4d85bf923c47f)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:00.164083 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d37597-7f9d-43c9-b6e9-f4b3eea2c34e None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:00.166178 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 196/391] 10.222.0.52 () {56 vars in 1180 bytes} [Sat May 14 20:50:00 2022] GET /identity/v3/groups/a693717c1949441889c4d85bf923c47f => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:50:00.172231 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d37597-7f9d-43c9-b6e9-f4b3eea2c34e None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:00.222593 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 196/392] 10.222.0.52 () {58 vars in 1442 bytes} [Sat May 14 20:49:59 2022] PUT /identity/v3/projects/c377a7cb474f47c8861e1c13e61ee22d/groups/a693717c1949441889c4d85bf923c47f/roles/274f900b5153444b84117bc9919443fc => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 20:50:00.290503 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d37597-7f9d-43c9-b6e9-f4b3eea2c34e None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:00.329272 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a17c7-11a6-444e-b1c3-14b63f434622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:00.330146 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a17c7-11a6-444e-b1c3-14b63f434622 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:00.330431 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a17c7-11a6-444e-b1c3-14b63f434622 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:00.330708 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a17c7-11a6-444e-b1c3-14b63f434622 None admin] PATH_INFO: `/v3/projects/c377a7cb474f47c8861e1c13e61ee22d` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:00.336459 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a17c7-11a6-444e-b1c3-14b63f434622 None admin] RBAC: Authorizing `identity:get_project(project_id=c377a7cb474f47c8861e1c13e61ee22d)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:00.337952 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a17c7-11a6-444e-b1c3-14b63f434622 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:00.339803 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 197/393] 10.222.0.52 () {56 vars in 1186 bytes} [Sat May 14 20:50:00 2022] GET /identity/v3/projects/c377a7cb474f47c8861e1c13e61ee22d => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:50:00.345822 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f8f45-4c83-4aa3-ba74-aba3634fa106 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:00.473361 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e91832-3575-4b3f-8c97-674dc677c108 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:00.473686 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e91832-3575-4b3f-8c97-674dc677c108 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:00.473848 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e91832-3575-4b3f-8c97-674dc677c108 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:00.475797 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 198/394] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:50:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:50:00.482655 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6889e792-67ca-4396-8a80-a232ffb48062 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:00.483316 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6889e792-67ca-4396-8a80-a232ffb48062 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:00.483824 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6889e792-67ca-4396-8a80-a232ffb48062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:00.494054 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f8f45-4c83-4aa3-ba74-aba3634fa106 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:00.510891 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-6889e792-67ca-4396-8a80-a232ffb48062 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:50:00.513091 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-6889e792-67ca-4396-8a80-a232ffb48062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:50:00.561439 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a748773-8a7a-4bc9-91e8-cede2e2c4534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:00.563369 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a748773-8a7a-4bc9-91e8-cede2e2c4534 None admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:00.563875 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a748773-8a7a-4bc9-91e8-cede2e2c4534 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:00.564469 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a748773-8a7a-4bc9-91e8-cede2e2c4534 None admin] PATH_INFO: `/v3/projects/c377a7cb474f47c8861e1c13e61ee22d/groups/a693717c1949441889c4d85bf923c47f/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:00.568252 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a748773-8a7a-4bc9-91e8-cede2e2c4534 None admin] RBAC: Authorizing `identity:create_grant(project_id=c377a7cb474f47c8861e1c13e61ee22d, group_id=a693717c1949441889c4d85bf923c47f, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:00.570509 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a748773-8a7a-4bc9-91e8-cede2e2c4534 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:00.616578 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 199/395] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:50:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 14 20:50:00.635563 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 197/396] 10.222.0.52 () {58 vars in 1442 bytes} [Sat May 14 20:50:00 2022] PUT /identity/v3/projects/c377a7cb474f47c8861e1c13e61ee22d/groups/a693717c1949441889c4d85bf923c47f/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 20:50:00.642111 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6889e792-67ca-4396-8a80-a232ffb48062 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:00.762345 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6889e792-67ca-4396-8a80-a232ffb48062 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:00.839515 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1534f335-d0db-4599-98b4-329fad91ab63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:00.839515 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534f335-d0db-4599-98b4-329fad91ab63 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:00.839515 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534f335-d0db-4599-98b4-329fad91ab63 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:00.839515 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534f335-d0db-4599-98b4-329fad91ab63 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:00.872727 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1534f335-d0db-4599-98b4-329fad91ab63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:50:00.881669 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-1534f335-d0db-4599-98b4-329fad91ab63 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 14 20:50:00.881669 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:00.881669 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:00.881669 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:00.881669 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:00.881669 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:00.881669 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:00.881669 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:00.881669 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:00.881669 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:00.881669 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:00.881669 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:00.881669 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:50:00.881669 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:50:00.881669 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:50:00.881669 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:50:00.882617 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:50:00.882617 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:50:00.882617 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:50:00.882617 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:50:00.882617 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:00.882617 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:00.882617 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:00.882617 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:00.882617 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:00.882617 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:00.882617 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:00.882617 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:50:00.882617 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:00.882617 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:00.882617 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:00.882617 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:00.888231 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:00.888231 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:00.888231 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:00.888231 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:00.888231 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:50:00.888231 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:50:00.888231 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:50:00.888231 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:50:00.888231 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:50:00.888231 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:50:00.888231 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 14 20:50:00.888231 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:00.888231 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 200/397] 10.222.0.52 () {56 vars in 1099 bytes} [Sat May 14 20:50:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:00.900129 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a748773-8a7a-4bc9-91e8-cede2e2c4534 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:01.040496 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a748773-8a7a-4bc9-91e8-cede2e2c4534 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:01.085758 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb322830-e6e0-44a8-bc92-f7eb55dab0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:01.086432 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb322830-e6e0-44a8-bc92-f7eb55dab0c6 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:01.086713 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb322830-e6e0-44a8-bc92-f7eb55dab0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:01.086984 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb322830-e6e0-44a8-bc92-f7eb55dab0c6 None admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:01.087847 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb322830-e6e0-44a8-bc92-f7eb55dab0c6 None admin] RBAC: Adding query filter params (name=member) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:01.088153 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb322830-e6e0-44a8-bc92-f7eb55dab0c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:01.089531 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb322830-e6e0-44a8-bc92-f7eb55dab0c6 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:01.100065 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 198/398] 10.222.0.52 () {56 vars in 1101 bytes} [Sat May 14 20:50:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:01.106044 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1534f335-d0db-4599-98b4-329fad91ab63 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:01.232627 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8345a7fc-c7d5-40f5-a2c1-68d3c3db1d0b None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:01.232908 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8345a7fc-c7d5-40f5-a2c1-68d3c3db1d0b None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:01.233089 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8345a7fc-c7d5-40f5-a2c1-68d3c3db1d0b None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:01.235043 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 199/399] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:50:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:50:01.247387 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66fd133-2a20-43f2-aecc-9caa95180d7b None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:01.248060 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66fd133-2a20-43f2-aecc-9caa95180d7b None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:01.248560 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66fd133-2a20-43f2-aecc-9caa95180d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:01.271028 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1534f335-d0db-4599-98b4-329fad91ab63 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:01.284669 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-a66fd133-2a20-43f2-aecc-9caa95180d7b None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:50:01.286317 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-a66fd133-2a20-43f2-aecc-9caa95180d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:50:01.315590 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268033ef-4ef0-43cc-88c2-6faa327557ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:01.315590 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268033ef-4ef0-43cc-88c2-6faa327557ad None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:01.315590 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268033ef-4ef0-43cc-88c2-6faa327557ad None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:01.315590 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268033ef-4ef0-43cc-88c2-6faa327557ad None admin] PATH_INFO: `/v3/groups/a693717c1949441889c4d85bf923c47f` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:01.316521 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268033ef-4ef0-43cc-88c2-6faa327557ad None admin] RBAC: Authorizing `identity:get_group(group_id=a693717c1949441889c4d85bf923c47f)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:01.317467 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268033ef-4ef0-43cc-88c2-6faa327557ad None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:01.324201 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 201/400] 10.222.0.52 () {56 vars in 1180 bytes} [Sat May 14 20:50:01 2022] GET /identity/v3/groups/a693717c1949441889c4d85bf923c47f => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:01.325818 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268033ef-4ef0-43cc-88c2-6faa327557ad None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:01.443165 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268033ef-4ef0-43cc-88c2-6faa327557ad None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:01.489866 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ec2126-1a99-4f61-97d0-4685bc78144a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:01.491510 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec2126-1a99-4f61-97d0-4685bc78144a None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:01.491714 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec2126-1a99-4f61-97d0-4685bc78144a None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:01.492008 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec2126-1a99-4f61-97d0-4685bc78144a None admin] PATH_INFO: `/v3/projects/95e730a9930947c491bac8f909cc59c8` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:01.493253 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ec2126-1a99-4f61-97d0-4685bc78144a None admin] RBAC: Authorizing `identity:get_project(project_id=95e730a9930947c491bac8f909cc59c8)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:01.494716 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ec2126-1a99-4f61-97d0-4685bc78144a None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:01.503338 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 202/401] 10.222.0.52 () {56 vars in 1186 bytes} [Sat May 14 20:50:01 2022] GET /identity/v3/projects/95e730a9930947c491bac8f909cc59c8 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:01.505947 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70785c0c-3a0a-42ef-9b8b-d51de80b45ae None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:01.506238 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70785c0c-3a0a-42ef-9b8b-d51de80b45ae None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:01.506515 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70785c0c-3a0a-42ef-9b8b-d51de80b45ae None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:01.508590 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 203/402] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:50:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:50:01.509175 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70785c0c-3a0a-42ef-9b8b-d51de80b45ae None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:01.517792 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 200/403] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:50:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 20:50:01.519502 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3880be-4714-4679-bcd2-d0aa83d15a50 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:01.519849 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3880be-4714-4679-bcd2-d0aa83d15a50 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:01.520127 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3880be-4714-4679-bcd2-d0aa83d15a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:01.538847 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-3f3880be-4714-4679-bcd2-d0aa83d15a50 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:50:01.540115 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-3f3880be-4714-4679-bcd2-d0aa83d15a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:50:01.624035 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 201/404] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:50:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 20:50:01.624989 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3880be-4714-4679-bcd2-d0aa83d15a50 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:01.662038 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70785c0c-3a0a-42ef-9b8b-d51de80b45ae None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:01.697467 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94763796-6ded-426b-b097-f068e7c7bcf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:01.698355 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94763796-6ded-426b-b097-f068e7c7bcf3 None admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:01.698641 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94763796-6ded-426b-b097-f068e7c7bcf3 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:01.698920 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94763796-6ded-426b-b097-f068e7c7bcf3 None admin] PATH_INFO: `/v3/projects/95e730a9930947c491bac8f909cc59c8/groups/a693717c1949441889c4d85bf923c47f/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:01.700934 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94763796-6ded-426b-b097-f068e7c7bcf3 None admin] RBAC: Authorizing `identity:create_grant(project_id=95e730a9930947c491bac8f909cc59c8, group_id=a693717c1949441889c4d85bf923c47f, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:01.702384 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94763796-6ded-426b-b097-f068e7c7bcf3 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:01.752230 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3880be-4714-4679-bcd2-d0aa83d15a50 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:01.783818 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 204/405] 10.222.0.52 () {58 vars in 1442 bytes} [Sat May 14 20:50:01 2022] PUT /identity/v3/projects/95e730a9930947c491bac8f909cc59c8/groups/a693717c1949441889c4d85bf923c47f/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 20:50:01.784879 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94763796-6ded-426b-b097-f068e7c7bcf3 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:01.799862 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de42631a-da15-410a-9b6d-68d5cb2d22f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:01.801390 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de42631a-da15-410a-9b6d-68d5cb2d22f5 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:01.801679 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de42631a-da15-410a-9b6d-68d5cb2d22f5 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:01.801956 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de42631a-da15-410a-9b6d-68d5cb2d22f5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:01.826349 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de42631a-da15-410a-9b6d-68d5cb2d22f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:50:01.844314 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-de42631a-da15-410a-9b6d-68d5cb2d22f5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 14 20:50:01.844314 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:01.844314 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:01.844314 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:01.844314 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:01.844314 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:01.844314 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:01.844314 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:01.844314 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:01.844314 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:01.844314 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:01.844314 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:01.844314 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:50:01.844314 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:50:01.844314 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:50:01.844314 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:50:01.846525 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:50:01.846525 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:50:01.846525 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:50:01.846525 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:50:01.846525 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:01.846525 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:01.846525 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:01.846525 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:01.846525 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:01.846525 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:01.846525 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:01.846525 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:50:01.846525 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:01.846525 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:01.846525 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:01.846525 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:01.848646 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:01.848646 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:01.848646 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:01.848646 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:01.848646 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:50:01.848646 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:50:01.848646 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:50:01.848646 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:50:01.848646 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:50:01.848646 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:50:01.848646 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 14 20:50:01.848646 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:01.851565 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 202/406] 10.222.0.52 () {56 vars in 1114 bytes} [Sat May 14 20:50:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:01.854261 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de42631a-da15-410a-9b6d-68d5cb2d22f5 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:01.987309 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94763796-6ded-426b-b097-f068e7c7bcf3 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:02.034297 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d326f1-dbc2-4f33-9348-c558273be4ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:02.035931 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d326f1-dbc2-4f33-9348-c558273be4ff None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:02.036221 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d326f1-dbc2-4f33-9348-c558273be4ff None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:02.036493 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d326f1-dbc2-4f33-9348-c558273be4ff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:02.047931 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d326f1-dbc2-4f33-9348-c558273be4ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:50:02.056482 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-f1d326f1-dbc2-4f33-9348-c558273be4ff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 14 20:50:02.056482 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:02.056482 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:02.056482 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:02.056482 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:02.056482 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:02.056482 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:02.056482 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:02.056482 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:02.056482 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:02.056482 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:02.056482 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:02.056482 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:50:02.056482 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:50:02.056482 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:50:02.056482 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:50:02.058982 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:50:02.058982 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:50:02.058982 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:50:02.058982 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:50:02.058982 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:02.058982 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:02.058982 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:02.058982 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:02.058982 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:02.058982 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:02.058982 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:02.058982 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:50:02.058982 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:02.058982 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:02.058982 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:02.058982 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:02.061224 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:02.061224 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:02.061224 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:02.061224 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:02.061224 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:50:02.061224 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:50:02.061224 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:50:02.061224 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:50:02.061224 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:50:02.061224 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:50:02.061224 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 14 20:50:02.061224 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:02.061224 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 205/407] 10.222.0.52 () {56 vars in 1096 bytes} [Sat May 14 20:50:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:02.066376 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d326f1-dbc2-4f33-9348-c558273be4ff None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:02.080494 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de42631a-da15-410a-9b6d-68d5cb2d22f5 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:02.139302 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe7704-3546-4ef6-bb04-1b62a1c5adea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:02.139998 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe7704-3546-4ef6-bb04-1b62a1c5adea None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:02.140283 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe7704-3546-4ef6-bb04-1b62a1c5adea None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:02.140565 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe7704-3546-4ef6-bb04-1b62a1c5adea None admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:02.141316 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abe7704-3546-4ef6-bb04-1b62a1c5adea None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:02.141627 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abe7704-3546-4ef6-bb04-1b62a1c5adea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:02.143010 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abe7704-3546-4ef6-bb04-1b62a1c5adea None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:02.157720 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 203/408] 10.222.0.52 () {56 vars in 1111 bytes} [Sat May 14 20:50:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:02.163068 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe7704-3546-4ef6-bb04-1b62a1c5adea None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:02.174289 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d326f1-dbc2-4f33-9348-c558273be4ff None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:02.215367 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2061f25b-ebfd-45f8-baf2-0cf30576a16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:02.215995 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061f25b-ebfd-45f8-baf2-0cf30576a16e None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:02.216285 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061f25b-ebfd-45f8-baf2-0cf30576a16e None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:02.216555 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061f25b-ebfd-45f8-baf2-0cf30576a16e None admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:02.217315 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2061f25b-ebfd-45f8-baf2-0cf30576a16e None admin] RBAC: Adding query filter params (name=admin) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:02.217626 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2061f25b-ebfd-45f8-baf2-0cf30576a16e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:02.219022 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2061f25b-ebfd-45f8-baf2-0cf30576a16e None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:02.229239 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 206/409] 10.222.0.52 () {56 vars in 1099 bytes} [Sat May 14 20:50:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:02.240842 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2061f25b-ebfd-45f8-baf2-0cf30576a16e None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:02.321712 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe7704-3546-4ef6-bb04-1b62a1c5adea None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:02.375190 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2061f25b-ebfd-45f8-baf2-0cf30576a16e None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:02.377215 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ce0872-822b-46e5-9f4d-fa90b1153362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:02.378085 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce0872-822b-46e5-9f4d-fa90b1153362 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:02.378608 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce0872-822b-46e5-9f4d-fa90b1153362 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:02.379252 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce0872-822b-46e5-9f4d-fa90b1153362 None admin] PATH_INFO: `/v3/groups/a693717c1949441889c4d85bf923c47f` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:02.380556 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ce0872-822b-46e5-9f4d-fa90b1153362 None admin] RBAC: Authorizing `identity:get_group(group_id=a693717c1949441889c4d85bf923c47f)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:02.382288 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ce0872-822b-46e5-9f4d-fa90b1153362 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:02.384304 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 204/410] 10.222.0.52 () {56 vars in 1180 bytes} [Sat May 14 20:50:02 2022] GET /identity/v3/groups/a693717c1949441889c4d85bf923c47f => generated 226 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:50:02.392377 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ce0872-822b-46e5-9f4d-fa90b1153362 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:02.415111 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f7fcc3-7739-48e7-9851-b234aef016c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:02.416015 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7fcc3-7739-48e7-9851-b234aef016c8 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:02.416304 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7fcc3-7739-48e7-9851-b234aef016c8 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:02.416581 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7fcc3-7739-48e7-9851-b234aef016c8 None admin] PATH_INFO: `/v3/groups/d7d8e7c727ea429697f25fc7a3c599d6` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:02.417779 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f7fcc3-7739-48e7-9851-b234aef016c8 None admin] RBAC: Authorizing `identity:get_group(group_id=d7d8e7c727ea429697f25fc7a3c599d6)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:02.419242 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f7fcc3-7739-48e7-9851-b234aef016c8 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:02.427888 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 207/411] 10.222.0.52 () {56 vars in 1180 bytes} [Sat May 14 20:50:02 2022] GET /identity/v3/groups/d7d8e7c727ea429697f25fc7a3c599d6 => generated 229 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:02.428840 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f7fcc3-7739-48e7-9851-b234aef016c8 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:02.503700 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ce0872-822b-46e5-9f4d-fa90b1153362 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:02.540536 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369b24de-8f5e-4289-b01f-7985f46240c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:02.541402 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b24de-8f5e-4289-b01f-7985f46240c1 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:02.541686 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b24de-8f5e-4289-b01f-7985f46240c1 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:02.541963 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b24de-8f5e-4289-b01f-7985f46240c1 None admin] PATH_INFO: `/v3/projects/95e730a9930947c491bac8f909cc59c8` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:02.543334 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369b24de-8f5e-4289-b01f-7985f46240c1 None admin] RBAC: Authorizing `identity:get_project(project_id=95e730a9930947c491bac8f909cc59c8)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:02.544806 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369b24de-8f5e-4289-b01f-7985f46240c1 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:02.546817 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 205/412] 10.222.0.52 () {56 vars in 1186 bytes} [Sat May 14 20:50:02 2022] GET /identity/v3/projects/95e730a9930947c491bac8f909cc59c8 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:02.552763 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369b24de-8f5e-4289-b01f-7985f46240c1 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:02.585852 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f7fcc3-7739-48e7-9851-b234aef016c8 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:02.637115 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942ed7ba-66a4-467e-88f0-fd0b39862e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:02.637985 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ed7ba-66a4-467e-88f0-fd0b39862e03 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:02.638264 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ed7ba-66a4-467e-88f0-fd0b39862e03 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:02.638539 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ed7ba-66a4-467e-88f0-fd0b39862e03 None admin] PATH_INFO: `/v3/projects/96a027574eeb4536a94751bde54cf3b1` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:02.644995 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942ed7ba-66a4-467e-88f0-fd0b39862e03 None admin] RBAC: Authorizing `identity:get_project(project_id=96a027574eeb4536a94751bde54cf3b1)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:02.646467 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942ed7ba-66a4-467e-88f0-fd0b39862e03 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:02.648490 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 208/413] 10.222.0.52 () {56 vars in 1186 bytes} [Sat May 14 20:50:02 2022] GET /identity/v3/projects/96a027574eeb4536a94751bde54cf3b1 => generated 344 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:02.653546 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942ed7ba-66a4-467e-88f0-fd0b39862e03 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:02.687325 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369b24de-8f5e-4289-b01f-7985f46240c1 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:02.757175 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cecf4e8-3793-4e23-9b4d-8d74b57604c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:02.757989 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cecf4e8-3793-4e23-9b4d-8d74b57604c2 None admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:02.758269 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cecf4e8-3793-4e23-9b4d-8d74b57604c2 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:02.758538 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cecf4e8-3793-4e23-9b4d-8d74b57604c2 None admin] PATH_INFO: `/v3/projects/95e730a9930947c491bac8f909cc59c8/groups/a693717c1949441889c4d85bf923c47f/roles/274f900b5153444b84117bc9919443fc` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:02.760862 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cecf4e8-3793-4e23-9b4d-8d74b57604c2 None admin] RBAC: Authorizing `identity:create_grant(project_id=95e730a9930947c491bac8f909cc59c8, group_id=a693717c1949441889c4d85bf923c47f, role_id=274f900b5153444b84117bc9919443fc)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:02.762292 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cecf4e8-3793-4e23-9b4d-8d74b57604c2 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:02.789761 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942ed7ba-66a4-467e-88f0-fd0b39862e03 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:02.826002 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10cf603-e784-44ac-96ae-424d72c3a806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:02.827250 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10cf603-e784-44ac-96ae-424d72c3a806 None admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:02.827926 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10cf603-e784-44ac-96ae-424d72c3a806 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:02.828400 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10cf603-e784-44ac-96ae-424d72c3a806 None admin] PATH_INFO: `/v3/projects/96a027574eeb4536a94751bde54cf3b1/groups/d7d8e7c727ea429697f25fc7a3c599d6/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:02.830630 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10cf603-e784-44ac-96ae-424d72c3a806 None admin] RBAC: Authorizing `identity:create_grant(project_id=96a027574eeb4536a94751bde54cf3b1, group_id=d7d8e7c727ea429697f25fc7a3c599d6, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:02.832553 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10cf603-e784-44ac-96ae-424d72c3a806 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:02.855637 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 206/414] 10.222.0.52 () {58 vars in 1442 bytes} [Sat May 14 20:50:02 2022] PUT /identity/v3/projects/95e730a9930947c491bac8f909cc59c8/groups/a693717c1949441889c4d85bf923c47f/roles/274f900b5153444b84117bc9919443fc => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 20:50:02.942365 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 209/415] 10.222.0.52 () {58 vars in 1442 bytes} [Sat May 14 20:50:02 2022] PUT /identity/v3/projects/96a027574eeb4536a94751bde54cf3b1/groups/d7d8e7c727ea429697f25fc7a3c599d6/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 20:50:03.554001 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b45dc-6ff3-48a5-aadb-a3492af02901 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:03.554930 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b45dc-6ff3-48a5-aadb-a3492af02901 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:03.555420 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b45dc-6ff3-48a5-aadb-a3492af02901 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:03.557275 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 207/416] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:50:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:50:03.562156 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dbe97e-460e-4922-b6cd-8f818f356555 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:03.562926 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dbe97e-460e-4922-b6cd-8f818f356555 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:03.563406 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dbe97e-460e-4922-b6cd-8f818f356555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:03.581288 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-87dbe97e-460e-4922-b6cd-8f818f356555 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:50:03.582819 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-87dbe97e-460e-4922-b6cd-8f818f356555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:50:03.654953 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 210/417] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:50:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 20:50:03.692153 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8b45dc-6ff3-48a5-aadb-a3492af02901 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:03.757487 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136459f1-9429-475f-974c-250b03c85fee None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:03.758121 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136459f1-9429-475f-974c-250b03c85fee None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:03.758683 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136459f1-9429-475f-974c-250b03c85fee None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:03.760355 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 211/418] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:50:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 14 20:50:03.765220 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d1befc-ce67-4342-b57e-32540136105c None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:03.765753 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d1befc-ce67-4342-b57e-32540136105c None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:03.766235 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d1befc-ce67-4342-b57e-32540136105c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:03.795182 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-b5d1befc-ce67-4342-b57e-32540136105c None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:50:03.796731 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b5d1befc-ce67-4342-b57e-32540136105c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:50:03.824272 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8b45dc-6ff3-48a5-aadb-a3492af02901 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:03.881303 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 212/419] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:50:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 20:50:03.898506 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa637be-2b98-40af-9e87-7e14afda2cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:03.899322 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa637be-2b98-40af-9e87-7e14afda2cb8 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:03.899627 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa637be-2b98-40af-9e87-7e14afda2cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:03.899902 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa637be-2b98-40af-9e87-7e14afda2cb8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:03.920438 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa637be-2b98-40af-9e87-7e14afda2cb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:50:03.931867 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d1befc-ce67-4342-b57e-32540136105c None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:03.932298 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-bfa637be-2b98-40af-9e87-7e14afda2cb8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 14 20:50:03.932298 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:03.932298 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:03.932298 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:03.932298 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:03.932298 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:03.932298 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:03.932298 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:03.932298 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:03.932298 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:03.932298 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:03.932298 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:03.932298 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:50:03.932298 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:50:03.932298 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:50:03.932298 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:50:03.933225 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:50:03.933225 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:50:03.933225 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:50:03.933225 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:50:03.933225 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:03.933225 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:03.933225 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:03.933225 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:03.933225 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:03.933225 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:03.933225 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:03.933225 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:50:03.933225 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:03.933225 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:03.933225 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:03.933225 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:03.935100 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:03.935100 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:03.935100 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:03.935100 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:03.935100 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:50:03.935100 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:50:03.935100 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:50:03.935100 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:50:03.935100 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:50:03.935100 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:50:03.935100 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 14 20:50:03.935100 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:03.935100 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 208/420] 10.222.0.52 () {56 vars in 1114 bytes} [Sat May 14 20:50:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:03.938928 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa637be-2b98-40af-9e87-7e14afda2cb8 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:04.050636 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d1befc-ce67-4342-b57e-32540136105c None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:04.091284 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e904001c-4887-4746-b415-8a8e0d2d98ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:04.092470 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904001c-4887-4746-b415-8a8e0d2d98ed None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:04.092978 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904001c-4887-4746-b415-8a8e0d2d98ed None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:04.093452 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904001c-4887-4746-b415-8a8e0d2d98ed None admin] PATH_INFO: `/v3/roles/member` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:04.106603 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e904001c-4887-4746-b415-8a8e0d2d98ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:50:04.116922 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-e904001c-4887-4746-b415-8a8e0d2d98ed None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 14 20:50:04.116922 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:04.116922 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:04.116922 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:04.116922 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:04.116922 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:04.116922 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:04.116922 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:04.116922 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:04.116922 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:04.116922 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:04.116922 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:04.116922 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:50:04.116922 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:50:04.116922 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:50:04.116922 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:50:04.117879 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:50:04.117879 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:50:04.117879 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:50:04.117879 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:50:04.117879 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:04.117879 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:04.117879 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:04.117879 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:04.117879 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:04.117879 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:04.117879 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:04.117879 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:50:04.117879 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:04.117879 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:04.117879 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:04.117879 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:04.118681 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:04.118681 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:04.118681 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:04.118681 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:04.118681 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:50:04.118681 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:50:04.118681 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:50:04.118681 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:50:04.118681 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:50:04.118681 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:50:04.118681 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 14 20:50:04.118681 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:04.122301 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 213/421] 10.222.0.52 () {56 vars in 1099 bytes} [Sat May 14 20:50:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 20:50:04.131969 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e904001c-4887-4746-b415-8a8e0d2d98ed None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:04.158355 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa637be-2b98-40af-9e87-7e14afda2cb8 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:04.229428 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbd1003-8c0a-48cd-8043-e8890f038876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:04.230468 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd1003-8c0a-48cd-8043-e8890f038876 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:04.230981 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd1003-8c0a-48cd-8043-e8890f038876 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:04.231459 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd1003-8c0a-48cd-8043-e8890f038876 None admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:04.232752 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbd1003-8c0a-48cd-8043-e8890f038876 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:04.233269 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbd1003-8c0a-48cd-8043-e8890f038876 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:04.234838 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbd1003-8c0a-48cd-8043-e8890f038876 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:04.246239 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 209/422] 10.222.0.52 () {56 vars in 1111 bytes} [Sat May 14 20:50:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:50:04.252780 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbd1003-8c0a-48cd-8043-e8890f038876 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:04.318301 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e904001c-4887-4746-b415-8a8e0d2d98ed None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:04.359245 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbd1003-8c0a-48cd-8043-e8890f038876 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:04.389666 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce7da32-2811-4dc7-b971-c722226fd7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:04.390304 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7da32-2811-4dc7-b971-c722226fd7eb None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:04.390598 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7da32-2811-4dc7-b971-c722226fd7eb None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:04.390877 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7da32-2811-4dc7-b971-c722226fd7eb None admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:04.391682 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce7da32-2811-4dc7-b971-c722226fd7eb None admin] RBAC: Adding query filter params (name=member) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:04.391974 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce7da32-2811-4dc7-b971-c722226fd7eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:04.393769 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce7da32-2811-4dc7-b971-c722226fd7eb None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:04.403996 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b8ae1-b28a-433a-abb6-f6098785bf01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:04.404934 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b8ae1-b28a-433a-abb6-f6098785bf01 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:04.405421 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b8ae1-b28a-433a-abb6-f6098785bf01 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:04.405901 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b8ae1-b28a-433a-abb6-f6098785bf01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:04.415000 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 214/423] 10.222.0.52 () {56 vars in 1101 bytes} [Sat May 14 20:50:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:04.420434 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce7da32-2811-4dc7-b971-c722226fd7eb None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:04.550119 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12b8ae1-b28a-433a-abb6-f6098785bf01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:04.552750 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12b8ae1-b28a-433a-abb6-f6098785bf01 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:04.633672 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce7da32-2811-4dc7-b971-c722226fd7eb None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:04.690670 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 210/424] 10.222.0.52 () {58 vars in 1282 bytes} [Sat May 14 20:50:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 14 20:50:04.697991 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b8ae1-b28a-433a-abb6-f6098785bf01 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:04.726798 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c9095a-03f6-433b-bf35-566eb248954b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:04.727645 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9095a-03f6-433b-bf35-566eb248954b None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:04.728027 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9095a-03f6-433b-bf35-566eb248954b None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:04.728702 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9095a-03f6-433b-bf35-566eb248954b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:04.811149 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b8ae1-b28a-433a-abb6-f6098785bf01 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:04.813444 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c9095a-03f6-433b-bf35-566eb248954b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:04.815865 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c9095a-03f6-433b-bf35-566eb248954b None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:04.846343 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa4b1c6-ad72-4c76-80c5-2337509eb92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:04.848551 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa4b1c6-ad72-4c76-80c5-2337509eb92d None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:04.849158 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa4b1c6-ad72-4c76-80c5-2337509eb92d None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:04.849584 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa4b1c6-ad72-4c76-80c5-2337509eb92d None admin] PATH_INFO: `/v3/projects/c377a7cb474f47c8861e1c13e61ee22d` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:04.851569 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa4b1c6-ad72-4c76-80c5-2337509eb92d None admin] RBAC: Authorizing `identity:get_project(project_id=c377a7cb474f47c8861e1c13e61ee22d)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:04.853966 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa4b1c6-ad72-4c76-80c5-2337509eb92d None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:04.860960 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 211/425] 10.222.0.52 () {56 vars in 1186 bytes} [Sat May 14 20:50:04 2022] GET /identity/v3/projects/c377a7cb474f47c8861e1c13e61ee22d => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:04.861094 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd715fe-c303-4653-9626-6c446b88567f None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:04.863805 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd715fe-c303-4653-9626-6c446b88567f None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:04.864307 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd715fe-c303-4653-9626-6c446b88567f None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:04.866248 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 212/426] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:50:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:50:04.867181 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd715fe-c303-4653-9626-6c446b88567f None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:04.954038 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 215/427] 10.222.0.52 () {58 vars in 1282 bytes} [Sat May 14 20:50:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 14 20:50:04.956150 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4fbfde-3d5b-4fac-baa5-53d8be4fc68f None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:04.956621 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4fbfde-3d5b-4fac-baa5-53d8be4fc68f None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:04.957043 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4fbfde-3d5b-4fac-baa5-53d8be4fc68f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:04.976658 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-4b4fbfde-3d5b-4fac-baa5-53d8be4fc68f None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:50:04.977647 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-4b4fbfde-3d5b-4fac-baa5-53d8be4fc68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:50:05.015517 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd715fe-c303-4653-9626-6c446b88567f None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:05.054163 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bf1bde-78df-43cf-bd75-a36f1c985ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:05.055226 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf1bde-78df-43cf-bd75-a36f1c985ff0 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:05.055536 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf1bde-78df-43cf-bd75-a36f1c985ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:05.055890 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf1bde-78df-43cf-bd75-a36f1c985ff0 None admin] PATH_INFO: `/v3/groups/a693717c1949441889c4d85bf923c47f` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:05.057206 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bf1bde-78df-43cf-bd75-a36f1c985ff0 None admin] RBAC: Authorizing `identity:get_group(group_id=a693717c1949441889c4d85bf923c47f)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:05.058783 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bf1bde-78df-43cf-bd75-a36f1c985ff0 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:05.065515 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 213/428] 10.222.0.52 () {56 vars in 1180 bytes} [Sat May 14 20:50:04 2022] GET /identity/v3/groups/a693717c1949441889c4d85bf923c47f => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:05.065515 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bf1bde-78df-43cf-bd75-a36f1c985ff0 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:05.085899 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 216/429] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:50:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 20:50:05.087429 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4fbfde-3d5b-4fac-baa5-53d8be4fc68f None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:05.180312 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bf1bde-78df-43cf-bd75-a36f1c985ff0 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:05.203538 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4fbfde-3d5b-4fac-baa5-53d8be4fc68f None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:05.222025 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131e46c9-6f9e-40dd-b77e-288aa02392c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:05.223297 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e46c9-6f9e-40dd-b77e-288aa02392c5 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:05.223780 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e46c9-6f9e-40dd-b77e-288aa02392c5 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:05.224233 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e46c9-6f9e-40dd-b77e-288aa02392c5 None admin] PATH_INFO: `/v3/projects/c377a7cb474f47c8861e1c13e61ee22d` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:05.225654 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131e46c9-6f9e-40dd-b77e-288aa02392c5 None admin] RBAC: Authorizing `identity:get_project(project_id=c377a7cb474f47c8861e1c13e61ee22d)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:05.227273 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131e46c9-6f9e-40dd-b77e-288aa02392c5 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:05.229326 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 214/430] 10.222.0.52 () {56 vars in 1186 bytes} [Sat May 14 20:50:05 2022] GET /identity/v3/projects/c377a7cb474f47c8861e1c13e61ee22d => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:05.230320 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131e46c9-6f9e-40dd-b77e-288aa02392c5 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:05.241150 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3513229-10ab-44c0-baae-5a23ec257343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:05.241810 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3513229-10ab-44c0-baae-5a23ec257343 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:05.242092 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3513229-10ab-44c0-baae-5a23ec257343 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:05.242367 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3513229-10ab-44c0-baae-5a23ec257343 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:05.243363 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3513229-10ab-44c0-baae-5a23ec257343 None admin] RBAC: Adding query filter params (group.id=a693717c1949441889c4d85bf923c47f, role.id=274f900b5153444b84117bc9919443fc, scope.project.id=c377a7cb474f47c8861e1c13e61ee22d) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:05.243512 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3513229-10ab-44c0-baae-5a23ec257343 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:05.245063 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3513229-10ab-44c0-baae-5a23ec257343 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:05.255590 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 217/431] 10.222.0.52 () {56 vars in 1376 bytes} [Sat May 14 20:50:05 2022] GET /identity/v3/role_assignments?group.id=a693717c1949441889c4d85bf923c47f&scope.project.id=c377a7cb474f47c8861e1c13e61ee22d&role.id=274f900b5153444b84117bc9919443fc => generated 611 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:05.255590 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3513229-10ab-44c0-baae-5a23ec257343 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:05.379887 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3513229-10ab-44c0-baae-5a23ec257343 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:05.416506 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131e46c9-6f9e-40dd-b77e-288aa02392c5 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:05.428294 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afaad7b-ec1f-4c18-bd45-aa7474e6002a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:05.429482 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afaad7b-ec1f-4c18-bd45-aa7474e6002a None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:05.429944 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afaad7b-ec1f-4c18-bd45-aa7474e6002a None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:05.430361 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afaad7b-ec1f-4c18-bd45-aa7474e6002a None admin] PATH_INFO: `/v3/groups/a693717c1949441889c4d85bf923c47f` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:05.434509 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afaad7b-ec1f-4c18-bd45-aa7474e6002a None admin] RBAC: Authorizing `identity:get_group(group_id=a693717c1949441889c4d85bf923c47f)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:05.436242 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afaad7b-ec1f-4c18-bd45-aa7474e6002a None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:05.438444 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 218/432] 10.222.0.52 () {56 vars in 1180 bytes} [Sat May 14 20:50:05 2022] GET /identity/v3/groups/a693717c1949441889c4d85bf923c47f => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:05.444942 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afaad7b-ec1f-4c18-bd45-aa7474e6002a None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:05.506074 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbd7359-5e95-4e24-b106-51a15d17cd1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:05.508360 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd7359-5e95-4e24-b106-51a15d17cd1a None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:05.509407 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd7359-5e95-4e24-b106-51a15d17cd1a None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:05.510956 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd7359-5e95-4e24-b106-51a15d17cd1a None admin] PATH_INFO: `/v3/roles/member` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:05.535282 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbd7359-5e95-4e24-b106-51a15d17cd1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:50:05.547353 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-bdbd7359-5e95-4e24-b106-51a15d17cd1a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 14 20:50:05.547353 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:05.547353 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:05.547353 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:05.547353 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:05.547353 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:05.547353 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:05.547353 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:05.547353 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:05.547353 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:05.547353 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:05.547353 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:05.547353 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:50:05.547353 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:50:05.547353 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:50:05.547353 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:50:05.548542 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:50:05.548542 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:50:05.548542 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:50:05.548542 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:50:05.548542 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:05.548542 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:05.548542 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:05.548542 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:05.548542 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:05.548542 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:05.548542 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:05.548542 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:50:05.548542 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:05.548542 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:05.548542 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:05.548542 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:05.549558 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:05.549558 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:05.549558 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:05.549558 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:05.549558 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:50:05.549558 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:50:05.549558 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:50:05.549558 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:50:05.549558 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:50:05.549558 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:50:05.549558 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 14 20:50:05.549558 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:05.549558 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 215/433] 10.222.0.52 () {56 vars in 1099 bytes} [Sat May 14 20:50:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:05.554422 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbd7359-5e95-4e24-b106-51a15d17cd1a None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:05.613569 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afaad7b-ec1f-4c18-bd45-aa7474e6002a None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:05.660331 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daf2728-2db8-4a18-9790-14fe04e84396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:05.661206 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf2728-2db8-4a18-9790-14fe04e84396 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:05.661608 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf2728-2db8-4a18-9790-14fe04e84396 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:05.661889 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf2728-2db8-4a18-9790-14fe04e84396 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:05.662721 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daf2728-2db8-4a18-9790-14fe04e84396 None admin] RBAC: Adding query filter params (group.id=a693717c1949441889c4d85bf923c47f, role.id=4f4cbb0efdc1410294a05a7ba44f9320, scope.project.id=c377a7cb474f47c8861e1c13e61ee22d) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:05.663029 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daf2728-2db8-4a18-9790-14fe04e84396 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:05.664485 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daf2728-2db8-4a18-9790-14fe04e84396 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:05.670854 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 219/434] 10.222.0.52 () {56 vars in 1376 bytes} [Sat May 14 20:50:05 2022] GET /identity/v3/role_assignments?group.id=a693717c1949441889c4d85bf923c47f&scope.project.id=c377a7cb474f47c8861e1c13e61ee22d&role.id=4f4cbb0efdc1410294a05a7ba44f9320 => generated 611 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:05.672298 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f40c2-30e4-40f7-87eb-db77d615b62b None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:05.672586 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f40c2-30e4-40f7-87eb-db77d615b62b None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:05.672861 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f40c2-30e4-40f7-87eb-db77d615b62b None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:05.675972 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 220/435] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:50:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:50:05.680165 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dea4ce-db7c-4ab6-a113-67d776f875bd None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:05.680444 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dea4ce-db7c-4ab6-a113-67d776f875bd None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:05.680717 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dea4ce-db7c-4ab6-a113-67d776f875bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:05.691464 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbd7359-5e95-4e24-b106-51a15d17cd1a None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:05.699562 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-f3dea4ce-db7c-4ab6-a113-67d776f875bd None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:50:05.700881 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-f3dea4ce-db7c-4ab6-a113-67d776f875bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:50:05.727944 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f7a70-6df6-4b61-9de5-9c1364a1587b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:05.728636 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f7a70-6df6-4b61-9de5-9c1364a1587b None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:05.728929 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f7a70-6df6-4b61-9de5-9c1364a1587b None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:05.729209 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f7a70-6df6-4b61-9de5-9c1364a1587b None admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:05.729972 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9f7a70-6df6-4b61-9de5-9c1364a1587b None admin] RBAC: Adding query filter params (name=member) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:05.730282 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9f7a70-6df6-4b61-9de5-9c1364a1587b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:05.731739 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9f7a70-6df6-4b61-9de5-9c1364a1587b None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:05.741134 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 216/436] 10.222.0.52 () {56 vars in 1101 bytes} [Sat May 14 20:50:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:05.742579 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e72c4-1c5a-4f8c-8ef3-34bbdbfb1991 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:05.742878 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e72c4-1c5a-4f8c-8ef3-34bbdbfb1991 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:05.743161 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e72c4-1c5a-4f8c-8ef3-34bbdbfb1991 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:05.748760 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 217/437] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:50:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:50:05.748760 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4e72c4-1c5a-4f8c-8ef3-34bbdbfb1991 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:05.778523 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 221/438] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:50:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 20:50:05.780205 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671cf293-2179-49e4-858c-974035ad2e11 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:05.780559 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671cf293-2179-49e4-858c-974035ad2e11 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:05.780907 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671cf293-2179-49e4-858c-974035ad2e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:05.802708 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-671cf293-2179-49e4-858c-974035ad2e11 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:50:05.804658 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-671cf293-2179-49e4-858c-974035ad2e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:50:05.870442 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4e72c4-1c5a-4f8c-8ef3-34bbdbfb1991 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:05.883214 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 222/439] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:50:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 20:50:05.884173 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671cf293-2179-49e4-858c-974035ad2e11 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:05.922742 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56f9da7-f9a8-491e-b3bf-47ae50b2d390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:05.923389 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f9da7-f9a8-491e-b3bf-47ae50b2d390 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:05.923696 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f9da7-f9a8-491e-b3bf-47ae50b2d390 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:05.925813 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f9da7-f9a8-491e-b3bf-47ae50b2d390 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:06.001274 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671cf293-2179-49e4-858c-974035ad2e11 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:06.002549 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56f9da7-f9a8-491e-b3bf-47ae50b2d390 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:06.005715 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56f9da7-f9a8-491e-b3bf-47ae50b2d390 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:06.037820 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779c9a68-e1e2-475d-89ec-106cc4444501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:06.038553 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c9a68-e1e2-475d-89ec-106cc4444501 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:06.038999 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c9a68-e1e2-475d-89ec-106cc4444501 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:06.039306 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c9a68-e1e2-475d-89ec-106cc4444501 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:06.052865 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779c9a68-e1e2-475d-89ec-106cc4444501 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:50:06.060968 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-779c9a68-e1e2-475d-89ec-106cc4444501 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 14 20:50:06.060968 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:06.060968 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:06.060968 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:06.060968 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:06.060968 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:06.060968 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:06.060968 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:06.060968 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:06.060968 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:06.060968 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:06.060968 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:06.060968 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:50:06.060968 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:50:06.060968 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:50:06.060968 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:50:06.061938 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:50:06.061938 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:50:06.061938 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:50:06.061938 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:50:06.061938 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:06.061938 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:06.061938 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:06.061938 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:06.061938 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:06.061938 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:06.061938 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:06.061938 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:50:06.061938 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:06.061938 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:06.061938 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:06.061938 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:06.062736 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:06.062736 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:06.062736 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:06.062736 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:06.062736 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:50:06.062736 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:50:06.062736 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:50:06.062736 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:50:06.062736 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:50:06.062736 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:50:06.062736 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 14 20:50:06.062736 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:06.062736 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 223/440] 10.222.0.52 () {56 vars in 1114 bytes} [Sat May 14 20:50:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:06.063401 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779c9a68-e1e2-475d-89ec-106cc4444501 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:06.121778 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 218/441] 10.222.0.52 () {58 vars in 1282 bytes} [Sat May 14 20:50:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 14 20:50:06.126091 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56f9da7-f9a8-491e-b3bf-47ae50b2d390 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:06.182428 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779c9a68-e1e2-475d-89ec-106cc4444501 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:06.218888 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e759df57-d1d7-47f8-810c-73ef6aae17f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:06.219785 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e759df57-d1d7-47f8-810c-73ef6aae17f8 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:06.220065 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e759df57-d1d7-47f8-810c-73ef6aae17f8 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:06.220335 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e759df57-d1d7-47f8-810c-73ef6aae17f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:06.232525 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e759df57-d1d7-47f8-810c-73ef6aae17f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:50:06.236604 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56f9da7-f9a8-491e-b3bf-47ae50b2d390 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:06.241736 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-e759df57-d1d7-47f8-810c-73ef6aae17f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 14 20:50:06.241736 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:06.241736 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:06.241736 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:06.241736 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:06.241736 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:06.241736 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:06.241736 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:06.241736 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:06.241736 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:06.241736 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:06.241736 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:06.241736 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:50:06.241736 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:50:06.241736 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:50:06.241736 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:50:06.249546 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:50:06.249546 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:50:06.249546 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:50:06.249546 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:50:06.249546 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:06.249546 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:06.249546 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:06.249546 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:06.249546 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:06.249546 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:06.249546 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:06.249546 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:50:06.249546 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:06.249546 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:06.249546 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:06.249546 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:06.250352 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:06.250352 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:06.250352 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:06.250352 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:06.250352 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:50:06.250352 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:50:06.250352 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:50:06.250352 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:50:06.250352 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:50:06.250352 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:50:06.250352 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 14 20:50:06.250352 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:06.250352 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 224/442] 10.222.0.52 () {56 vars in 1096 bytes} [Sat May 14 20:50:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:06.250352 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e759df57-d1d7-47f8-810c-73ef6aae17f8 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:06.271286 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60de4e5-364a-479f-9420-967cd2507a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:06.273565 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60de4e5-364a-479f-9420-967cd2507a6b None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:06.273565 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60de4e5-364a-479f-9420-967cd2507a6b None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:06.273565 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60de4e5-364a-479f-9420-967cd2507a6b None admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:06.273565 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60de4e5-364a-479f-9420-967cd2507a6b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:06.273565 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60de4e5-364a-479f-9420-967cd2507a6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:06.274862 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60de4e5-364a-479f-9420-967cd2507a6b None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:06.282435 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 219/443] 10.222.0.52 () {56 vars in 1111 bytes} [Sat May 14 20:50:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:06.283896 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60de4e5-364a-479f-9420-967cd2507a6b None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:06.341368 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e759df57-d1d7-47f8-810c-73ef6aae17f8 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:06.374576 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f455ec-36c9-4c30-a8de-2193572799b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:06.375425 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f455ec-36c9-4c30-a8de-2193572799b3 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:06.375744 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f455ec-36c9-4c30-a8de-2193572799b3 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:06.376021 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f455ec-36c9-4c30-a8de-2193572799b3 None admin] PATH_INFO: `/v3/projects/95e730a9930947c491bac8f909cc59c8` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:06.377201 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f455ec-36c9-4c30-a8de-2193572799b3 None admin] RBAC: Authorizing `identity:get_project(project_id=95e730a9930947c491bac8f909cc59c8)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:06.378680 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f455ec-36c9-4c30-a8de-2193572799b3 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:06.380395 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 225/444] 10.222.0.52 () {56 vars in 1186 bytes} [Sat May 14 20:50:06 2022] GET /identity/v3/projects/95e730a9930947c491bac8f909cc59c8 => generated 302 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:06.381151 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f455ec-36c9-4c30-a8de-2193572799b3 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:06.384401 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60de4e5-364a-479f-9420-967cd2507a6b None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:06.416680 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9145ed-2ce9-481c-a597-a1cba802d4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:06.417330 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9145ed-2ce9-481c-a597-a1cba802d4fc None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:06.417613 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9145ed-2ce9-481c-a597-a1cba802d4fc None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:06.417887 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9145ed-2ce9-481c-a597-a1cba802d4fc None admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:06.418615 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9145ed-2ce9-481c-a597-a1cba802d4fc None admin] RBAC: Adding query filter params (name=admin) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:06.418921 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9145ed-2ce9-481c-a597-a1cba802d4fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:06.420314 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9145ed-2ce9-481c-a597-a1cba802d4fc None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:06.432692 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 220/445] 10.222.0.52 () {56 vars in 1099 bytes} [Sat May 14 20:50:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:06.432692 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9145ed-2ce9-481c-a597-a1cba802d4fc None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:06.478500 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f455ec-36c9-4c30-a8de-2193572799b3 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:06.511207 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc020c2f-6348-4eda-8b0a-cf6f8bebfd42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:06.511888 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc020c2f-6348-4eda-8b0a-cf6f8bebfd42 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:06.512176 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc020c2f-6348-4eda-8b0a-cf6f8bebfd42 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:06.512450 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc020c2f-6348-4eda-8b0a-cf6f8bebfd42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:06.522846 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9145ed-2ce9-481c-a597-a1cba802d4fc None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:06.555130 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265ec8d6-aeda-4418-aab7-449721e508fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:06.555998 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ec8d6-aeda-4418-aab7-449721e508fd None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:06.556282 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ec8d6-aeda-4418-aab7-449721e508fd None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:06.556556 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ec8d6-aeda-4418-aab7-449721e508fd None admin] PATH_INFO: `/v3/groups/a693717c1949441889c4d85bf923c47f` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:06.557730 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265ec8d6-aeda-4418-aab7-449721e508fd None admin] RBAC: Authorizing `identity:get_group(group_id=a693717c1949441889c4d85bf923c47f)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:06.559156 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265ec8d6-aeda-4418-aab7-449721e508fd None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:06.560788 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 221/446] 10.222.0.52 () {56 vars in 1180 bytes} [Sat May 14 20:50:06 2022] GET /identity/v3/groups/a693717c1949441889c4d85bf923c47f => generated 226 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:06.561540 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265ec8d6-aeda-4418-aab7-449721e508fd None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:06.576930 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc020c2f-6348-4eda-8b0a-cf6f8bebfd42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:06.578397 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc020c2f-6348-4eda-8b0a-cf6f8bebfd42 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:06.659292 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265ec8d6-aeda-4418-aab7-449721e508fd None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:06.671989 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 226/447] 10.222.0.52 () {58 vars in 1282 bytes} [Sat May 14 20:50:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 14 20:50:06.672815 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc020c2f-6348-4eda-8b0a-cf6f8bebfd42 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:06.692990 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26941cfc-8222-429d-a07f-d8b13073c520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:06.693637 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26941cfc-8222-429d-a07f-d8b13073c520 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:06.693925 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26941cfc-8222-429d-a07f-d8b13073c520 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:06.694207 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26941cfc-8222-429d-a07f-d8b13073c520 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:06.759624 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26941cfc-8222-429d-a07f-d8b13073c520 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:06.761096 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26941cfc-8222-429d-a07f-d8b13073c520 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:06.767367 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc020c2f-6348-4eda-8b0a-cf6f8bebfd42 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:06.798907 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8651ecd-af0c-4e2c-94e7-91ee21fc4e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:06.799580 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8651ecd-af0c-4e2c-94e7-91ee21fc4e4a None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:06.800366 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8651ecd-af0c-4e2c-94e7-91ee21fc4e4a None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:06.800759 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8651ecd-af0c-4e2c-94e7-91ee21fc4e4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:06.801741 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8651ecd-af0c-4e2c-94e7-91ee21fc4e4a None admin] RBAC: Adding query filter params (group.id=a693717c1949441889c4d85bf923c47f, role.id=4f4cbb0efdc1410294a05a7ba44f9320, scope.project.id=95e730a9930947c491bac8f909cc59c8) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:06.802091 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8651ecd-af0c-4e2c-94e7-91ee21fc4e4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:06.803595 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8651ecd-af0c-4e2c-94e7-91ee21fc4e4a None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:06.809222 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 227/448] 10.222.0.52 () {56 vars in 1376 bytes} [Sat May 14 20:50:06 2022] GET /identity/v3/role_assignments?group.id=a693717c1949441889c4d85bf923c47f&scope.project.id=95e730a9930947c491bac8f909cc59c8&role.id=4f4cbb0efdc1410294a05a7ba44f9320 => generated 611 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:06.809993 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8651ecd-af0c-4e2c-94e7-91ee21fc4e4a None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:06.860875 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 222/449] 10.222.0.52 () {58 vars in 1282 bytes} [Sat May 14 20:50:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 14 20:50:06.867342 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26941cfc-8222-429d-a07f-d8b13073c520 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:06.915584 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8651ecd-af0c-4e2c-94e7-91ee21fc4e4a None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:06.952217 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1e853e-bcfe-4b16-814e-12f79ff75b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:06.953453 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e853e-bcfe-4b16-814e-12f79ff75b79 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:06.954082 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e853e-bcfe-4b16-814e-12f79ff75b79 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:06.954552 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e853e-bcfe-4b16-814e-12f79ff75b79 None admin] PATH_INFO: `/v3/projects/95e730a9930947c491bac8f909cc59c8` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:06.956060 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1e853e-bcfe-4b16-814e-12f79ff75b79 None admin] RBAC: Authorizing `identity:get_project(project_id=95e730a9930947c491bac8f909cc59c8)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:06.957727 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1e853e-bcfe-4b16-814e-12f79ff75b79 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:06.959759 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 228/450] 10.222.0.52 () {56 vars in 1186 bytes} [Sat May 14 20:50:06 2022] GET /identity/v3/projects/95e730a9930947c491bac8f909cc59c8 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:06.965273 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1e853e-bcfe-4b16-814e-12f79ff75b79 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:06.983920 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26941cfc-8222-429d-a07f-d8b13073c520 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:07.027077 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a759699-b232-4581-833a-d423ec63d099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:07.027983 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a759699-b232-4581-833a-d423ec63d099 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:07.028269 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a759699-b232-4581-833a-d423ec63d099 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:07.028549 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a759699-b232-4581-833a-d423ec63d099 None admin] PATH_INFO: `/v3/projects/96a027574eeb4536a94751bde54cf3b1` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:07.029810 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a759699-b232-4581-833a-d423ec63d099 None admin] RBAC: Authorizing `identity:get_project(project_id=96a027574eeb4536a94751bde54cf3b1)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:07.031528 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a759699-b232-4581-833a-d423ec63d099 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:07.033190 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 223/451] 10.222.0.52 () {56 vars in 1186 bytes} [Sat May 14 20:50:06 2022] GET /identity/v3/projects/96a027574eeb4536a94751bde54cf3b1 => generated 344 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:50:07.038774 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a759699-b232-4581-833a-d423ec63d099 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:07.082302 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1e853e-bcfe-4b16-814e-12f79ff75b79 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:07.127450 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8414438-2a0d-4c19-aa14-027b241714e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:07.128585 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8414438-2a0d-4c19-aa14-027b241714e3 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:07.128731 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8414438-2a0d-4c19-aa14-027b241714e3 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:07.128932 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8414438-2a0d-4c19-aa14-027b241714e3 None admin] PATH_INFO: `/v3/groups/a693717c1949441889c4d85bf923c47f` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:07.131299 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8414438-2a0d-4c19-aa14-027b241714e3 None admin] RBAC: Authorizing `identity:get_group(group_id=a693717c1949441889c4d85bf923c47f)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:07.132846 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8414438-2a0d-4c19-aa14-027b241714e3 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:07.134577 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 229/452] 10.222.0.52 () {56 vars in 1180 bytes} [Sat May 14 20:50:06 2022] GET /identity/v3/groups/a693717c1949441889c4d85bf923c47f => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:50:07.140428 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8414438-2a0d-4c19-aa14-027b241714e3 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:07.162733 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a759699-b232-4581-833a-d423ec63d099 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:07.202692 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f743a5-43fb-4713-ac74-9272884b8b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:07.203333 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f743a5-43fb-4713-ac74-9272884b8b35 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:07.203677 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f743a5-43fb-4713-ac74-9272884b8b35 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:07.203956 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f743a5-43fb-4713-ac74-9272884b8b35 None admin] PATH_INFO: `/v3/groups/d7d8e7c727ea429697f25fc7a3c599d6` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:07.205324 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f743a5-43fb-4713-ac74-9272884b8b35 None admin] RBAC: Authorizing `identity:get_group(group_id=d7d8e7c727ea429697f25fc7a3c599d6)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:07.206831 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f743a5-43fb-4713-ac74-9272884b8b35 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:07.208498 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 224/453] 10.222.0.52 () {56 vars in 1180 bytes} [Sat May 14 20:50:07 2022] GET /identity/v3/groups/d7d8e7c727ea429697f25fc7a3c599d6 => generated 229 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:07.214082 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f743a5-43fb-4713-ac74-9272884b8b35 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:07.246718 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8414438-2a0d-4c19-aa14-027b241714e3 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:07.279714 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4345b94b-b9fc-47ce-ae61-3b5d1b360855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:07.280363 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345b94b-b9fc-47ce-ae61-3b5d1b360855 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:07.280646 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345b94b-b9fc-47ce-ae61-3b5d1b360855 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:07.280921 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345b94b-b9fc-47ce-ae61-3b5d1b360855 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:07.281772 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4345b94b-b9fc-47ce-ae61-3b5d1b360855 None admin] RBAC: Adding query filter params (group.id=a693717c1949441889c4d85bf923c47f, role.id=274f900b5153444b84117bc9919443fc, scope.project.id=95e730a9930947c491bac8f909cc59c8) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:07.282082 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4345b94b-b9fc-47ce-ae61-3b5d1b360855 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:07.283561 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4345b94b-b9fc-47ce-ae61-3b5d1b360855 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:07.303509 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 230/454] 10.222.0.52 () {56 vars in 1376 bytes} [Sat May 14 20:50:07 2022] GET /identity/v3/role_assignments?group.id=a693717c1949441889c4d85bf923c47f&scope.project.id=95e730a9930947c491bac8f909cc59c8&role.id=274f900b5153444b84117bc9919443fc => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:50:07.309315 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f743a5-43fb-4713-ac74-9272884b8b35 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:07.345575 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a46f986-b11f-4492-ac53-c33a20ed7718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:07.346236 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46f986-b11f-4492-ac53-c33a20ed7718 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:07.346516 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46f986-b11f-4492-ac53-c33a20ed7718 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:07.346870 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46f986-b11f-4492-ac53-c33a20ed7718 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:07.347736 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a46f986-b11f-4492-ac53-c33a20ed7718 None admin] RBAC: Adding query filter params (group.id=d7d8e7c727ea429697f25fc7a3c599d6, role.id=24c463e2b4d44dd28cd2723a69a8ed2e, scope.project.id=96a027574eeb4536a94751bde54cf3b1) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:07.348048 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a46f986-b11f-4492-ac53-c33a20ed7718 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:07.349602 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a46f986-b11f-4492-ac53-c33a20ed7718 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:07.356332 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 225/455] 10.222.0.52 () {56 vars in 1376 bytes} [Sat May 14 20:50:07 2022] GET /identity/v3/role_assignments?group.id=d7d8e7c727ea429697f25fc7a3c599d6&scope.project.id=96a027574eeb4536a94751bde54cf3b1&role.id=24c463e2b4d44dd28cd2723a69a8ed2e => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:50:10.199723 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a13d9-b37b-4851-93e9-44c2d9e86a15 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:10.200709 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a13d9-b37b-4851-93e9-44c2d9e86a15 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:10.201196 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a13d9-b37b-4851-93e9-44c2d9e86a15 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:10.202752 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 231/456] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:50:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:50:10.208129 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20800fce-bddf-4f44-8b83-a2397734b465 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:10.208532 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20800fce-bddf-4f44-8b83-a2397734b465 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:10.208699 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20800fce-bddf-4f44-8b83-a2397734b465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:10.232456 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-20800fce-bddf-4f44-8b83-a2397734b465 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:50:10.233653 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-20800fce-bddf-4f44-8b83-a2397734b465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:50:10.309196 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 226/457] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:50:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 14 20:50:10.349295 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511a13d9-b37b-4851-93e9-44c2d9e86a15 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:10.482188 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73a9cd3-0dd9-40bf-92b5-9fef01064829 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:10.482400 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73a9cd3-0dd9-40bf-92b5-9fef01064829 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:10.482834 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73a9cd3-0dd9-40bf-92b5-9fef01064829 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:10.484711 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 227/458] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:50:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:50:10.489365 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511a13d9-b37b-4851-93e9-44c2d9e86a15 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:10.490358 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a9f63-7832-4462-bc6e-88fb7323a4fb None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:10.490654 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a9f63-7832-4462-bc6e-88fb7323a4fb None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:10.490931 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a9f63-7832-4462-bc6e-88fb7323a4fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:10.512506 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-583a9f63-7832-4462-bc6e-88fb7323a4fb None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:50:10.513695 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-583a9f63-7832-4462-bc6e-88fb7323a4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:50:10.538319 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2ff689-6a52-448a-9a77-702a4ef7bbaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:10.539115 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2ff689-6a52-448a-9a77-702a4ef7bbaa None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:10.539395 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2ff689-6a52-448a-9a77-702a4ef7bbaa None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:10.539702 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2ff689-6a52-448a-9a77-702a4ef7bbaa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:10.557266 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2ff689-6a52-448a-9a77-702a4ef7bbaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:10.558729 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2ff689-6a52-448a-9a77-702a4ef7bbaa None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:10.594097 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-df2ff689-6a52-448a-9a77-702a4ef7bbaa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:10.594097 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:10.594097 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:10.594097 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:10.594097 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:10.594097 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:10.594097 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:10.594097 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:10.594097 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:10.594097 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:10.594097 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:10.594097 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:10.594097 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:50:10.594097 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:50:10.594097 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:50:10.595017 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:50:10.595017 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:10.595017 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:10.595017 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:10.595017 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:10.595017 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:10.595017 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:10.595017 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:10.595017 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:50:10.595017 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:10.595017 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:10.595017 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:10.595017 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:10.595017 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:10.595017 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:10.595017 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:10.595017 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:10.595929 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 20:50:10.595929 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:50:10.595929 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:10.595929 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:10.598515 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 232/459] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:50:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:10.604374 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2ff689-6a52-448a-9a77-702a4ef7bbaa None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:10.669234 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 228/460] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:50:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 14 20:50:10.710003 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2ff689-6a52-448a-9a77-702a4ef7bbaa None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:10.725344 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583a9f63-7832-4462-bc6e-88fb7323a4fb None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:10.749785 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a7a129-7fef-490f-896f-f30016046472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:10.750377 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a7a129-7fef-490f-896f-f30016046472 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:10.750819 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a7a129-7fef-490f-896f-f30016046472 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:10.751673 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a7a129-7fef-490f-896f-f30016046472 None admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:10.752563 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a7a129-7fef-490f-896f-f30016046472 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:10.753849 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a7a129-7fef-490f-896f-f30016046472 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:10.755534 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a7a129-7fef-490f-896f-f30016046472 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:10.786562 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 233/461] 10.222.0.52 () {56 vars in 1109 bytes} [Sat May 14 20:50:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:50:10.793612 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a7a129-7fef-490f-896f-f30016046472 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:10.933715 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583a9f63-7832-4462-bc6e-88fb7323a4fb None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:10.939559 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a7a129-7fef-490f-896f-f30016046472 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:10.975358 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f543928-2b97-4fee-bf7b-9fb89a51e548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:10.976420 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f543928-2b97-4fee-bf7b-9fb89a51e548 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:10.976706 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f543928-2b97-4fee-bf7b-9fb89a51e548 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:10.977089 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f543928-2b97-4fee-bf7b-9fb89a51e548 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:10.989551 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7a19a3-2309-4c57-acf9-a77ff290f8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:10.990181 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f543928-2b97-4fee-bf7b-9fb89a51e548 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:10.991222 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7a19a3-2309-4c57-acf9-a77ff290f8c8 None admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:10.991762 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7a19a3-2309-4c57-acf9-a77ff290f8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:10.992011 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f543928-2b97-4fee-bf7b-9fb89a51e548 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:10.992332 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7a19a3-2309-4c57-acf9-a77ff290f8c8 None admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:10.993435 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7a19a3-2309-4c57-acf9-a77ff290f8c8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:10.995596 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7a19a3-2309-4c57-acf9-a77ff290f8c8 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:11.010815 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-2f543928-2b97-4fee-bf7b-9fb89a51e548 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:11.010815 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:11.010815 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:11.010815 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:11.010815 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:11.010815 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:11.010815 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:11.010815 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:11.010815 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:11.010815 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:11.010815 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:11.010815 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:11.010815 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:50:11.010815 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:50:11.010815 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:50:11.011764 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:50:11.011764 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:11.011764 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:11.011764 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:11.011764 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:11.011764 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:11.011764 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:11.011764 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:11.011764 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:50:11.011764 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:11.011764 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:11.011764 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:11.011764 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:11.011764 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:11.011764 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:11.011764 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:11.011764 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:11.012629 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 20:50:11.012629 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:50:11.012629 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:11.012629 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:11.012629 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 229/462] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:50:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 20:50:11.013681 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13746387-7bd6-4558-8d8f-c2dd41ee98d1 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:11.014016 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13746387-7bd6-4558-8d8f-c2dd41ee98d1 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:11.014301 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13746387-7bd6-4558-8d8f-c2dd41ee98d1 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:11.015695 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 230/463] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:50:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:50:11.020473 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13746387-7bd6-4558-8d8f-c2dd41ee98d1 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:11.110067 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 234/464] 10.222.0.52 () {60 vars in 1132 bytes} [Sat May 14 20:50:10 2022] POST /identity/v3/users => generated 246 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 20:50:11.111382 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd763f5-9114-48e1-9a3f-7f51c4740d14 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:11.111708 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd763f5-9114-48e1-9a3f-7f51c4740d14 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:11.111991 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd763f5-9114-48e1-9a3f-7f51c4740d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:11.133974 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13746387-7bd6-4558-8d8f-c2dd41ee98d1 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:11.141040 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-8fd763f5-9114-48e1-9a3f-7f51c4740d14 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:50:11.142440 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8fd763f5-9114-48e1-9a3f-7f51c4740d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:50:11.182825 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0752788-7e66-4e25-b161-b1664b321d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:11.184492 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0752788-7e66-4e25-b161-b1664b321d20 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:11.185283 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0752788-7e66-4e25-b161-b1664b321d20 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:11.185809 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0752788-7e66-4e25-b161-b1664b321d20 None admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:11.186989 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0752788-7e66-4e25-b161-b1664b321d20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:11.187594 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0752788-7e66-4e25-b161-b1664b321d20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:11.189164 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0752788-7e66-4e25-b161-b1664b321d20 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:11.205486 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 231/465] 10.222.0.52 () {56 vars in 1109 bytes} [Sat May 14 20:50:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:11.207380 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f898058-b26a-474e-9637-574b8cb18dba None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:11.207870 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f898058-b26a-474e-9637-574b8cb18dba None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:11.208322 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f898058-b26a-474e-9637-574b8cb18dba None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:11.210646 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 232/466] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:50:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:50:11.211762 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f898058-b26a-474e-9637-574b8cb18dba None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:11.239504 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 235/467] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:50:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 20:50:11.239504 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1129e51a-4c1f-4c73-be59-37d3cc30626a None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:11.239504 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1129e51a-4c1f-4c73-be59-37d3cc30626a None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:11.239504 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1129e51a-4c1f-4c73-be59-37d3cc30626a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:11.269317 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-1129e51a-4c1f-4c73-be59-37d3cc30626a None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:50:11.270555 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-1129e51a-4c1f-4c73-be59-37d3cc30626a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:50:11.356859 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f898058-b26a-474e-9637-574b8cb18dba None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:11.364156 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 236/468] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:50:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 20:50:11.372291 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1129e51a-4c1f-4c73-be59-37d3cc30626a None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:11.405444 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27e7148-a579-4a6c-a4cf-e9887e2a229d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:11.406113 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e7148-a579-4a6c-a4cf-e9887e2a229d None admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:11.407118 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e7148-a579-4a6c-a4cf-e9887e2a229d None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:11.407403 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e7148-a579-4a6c-a4cf-e9887e2a229d None admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:11.408145 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27e7148-a579-4a6c-a4cf-e9887e2a229d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:11.410424 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27e7148-a579-4a6c-a4cf-e9887e2a229d None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:11.482503 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 233/469] 10.222.0.52 () {60 vars in 1132 bytes} [Sat May 14 20:50:11 2022] POST /identity/v3/users => generated 248 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 20:50:11.483541 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27e7148-a579-4a6c-a4cf-e9887e2a229d None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:11.492248 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1129e51a-4c1f-4c73-be59-37d3cc30626a None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:11.564845 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5f36d0-1748-42f0-8689-8058f52ab0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:11.565645 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f36d0-1748-42f0-8689-8058f52ab0c4 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:11.565930 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f36d0-1748-42f0-8689-8058f52ab0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:11.566206 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f36d0-1748-42f0-8689-8058f52ab0c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:11.590821 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5f36d0-1748-42f0-8689-8058f52ab0c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:11.592357 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5f36d0-1748-42f0-8689-8058f52ab0c4 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:11.628407 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-fa5f36d0-1748-42f0-8689-8058f52ab0c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:11.628407 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:11.628407 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:11.628407 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:11.628407 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:11.628407 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:11.628407 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:11.628407 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:11.628407 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:11.628407 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:11.628407 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:11.628407 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:11.628407 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:50:11.628407 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:50:11.628407 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:50:11.629397 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:50:11.629397 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:11.629397 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:11.629397 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:11.629397 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:11.629397 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:11.629397 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:11.629397 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:11.629397 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:50:11.629397 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:11.629397 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:11.629397 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:11.629397 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:11.629397 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:11.629397 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:11.629397 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:11.629397 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:11.630269 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 20:50:11.630269 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:50:11.630269 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:11.630269 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:11.630269 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 237/470] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:50:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:11.637130 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5f36d0-1748-42f0-8689-8058f52ab0c4 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:11.649058 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27e7148-a579-4a6c-a4cf-e9887e2a229d None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:11.684817 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ba1f69-2e6c-485a-9e20-817289c70ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:11.685615 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba1f69-2e6c-485a-9e20-817289c70ece None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:11.685896 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba1f69-2e6c-485a-9e20-817289c70ece None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:11.686171 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba1f69-2e6c-485a-9e20-817289c70ece None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:11.698230 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ba1f69-2e6c-485a-9e20-817289c70ece None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:11.699740 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ba1f69-2e6c-485a-9e20-817289c70ece None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:11.718173 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-15ba1f69-2e6c-485a-9e20-817289c70ece None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:11.718173 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:11.718173 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:11.718173 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:11.718173 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:11.718173 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:11.718173 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:11.718173 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:11.718173 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:11.718173 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:11.718173 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:11.718173 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:11.718173 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:50:11.718173 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:50:11.718173 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:50:11.720333 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:50:11.720333 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:11.720333 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:11.720333 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:11.720333 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:11.720333 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:11.720333 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:11.720333 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:11.720333 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:50:11.720333 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:11.720333 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:11.720333 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:11.720333 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:11.720333 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:11.720333 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:11.720333 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:11.720333 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:11.722492 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 20:50:11.722492 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:50:11.722492 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:11.722492 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:11.724349 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 234/471] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:50:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:11.725584 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ba1f69-2e6c-485a-9e20-817289c70ece None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:11.811107 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5f36d0-1748-42f0-8689-8058f52ab0c4 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:11.845285 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ba1f69-2e6c-485a-9e20-817289c70ece None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:11.851820 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a258a99-bf92-4c59-86a9-9905e6671077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:11.853249 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a258a99-bf92-4c59-86a9-9905e6671077 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:11.853764 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a258a99-bf92-4c59-86a9-9905e6671077 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:11.854255 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a258a99-bf92-4c59-86a9-9905e6671077 None admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:11.855522 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a258a99-bf92-4c59-86a9-9905e6671077 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:11.856356 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a258a99-bf92-4c59-86a9-9905e6671077 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:11.858362 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a258a99-bf92-4c59-86a9-9905e6671077 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:11.875187 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 238/472] 10.222.0.52 () {56 vars in 1109 bytes} [Sat May 14 20:50:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:50:11.876890 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b672679-af6a-4358-9f99-b08d05250cd5 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:11.877184 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b672679-af6a-4358-9f99-b08d05250cd5 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:11.877466 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b672679-af6a-4358-9f99-b08d05250cd5 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:11.878976 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 239/473] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:50:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:50:11.884050 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b672679-af6a-4358-9f99-b08d05250cd5 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:11.885703 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f847a5-aab1-45f1-aae1-c8f2d2d848c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:11.886597 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f847a5-aab1-45f1-aae1-c8f2d2d848c9 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:11.887238 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f847a5-aab1-45f1-aae1-c8f2d2d848c9 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:11.888620 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f847a5-aab1-45f1-aae1-c8f2d2d848c9 None admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:11.889577 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f847a5-aab1-45f1-aae1-c8f2d2d848c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:11.890090 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f847a5-aab1-45f1-aae1-c8f2d2d848c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:11.891703 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f847a5-aab1-45f1-aae1-c8f2d2d848c9 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:11.908766 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 235/474] 10.222.0.52 () {56 vars in 1109 bytes} [Sat May 14 20:50:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:11.911627 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea6fea-0b58-47dc-82bd-f7ec3dc5aa49 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:11.912304 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea6fea-0b58-47dc-82bd-f7ec3dc5aa49 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:11.912794 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea6fea-0b58-47dc-82bd-f7ec3dc5aa49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:11.938713 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-b6ea6fea-0b58-47dc-82bd-f7ec3dc5aa49 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:50:11.941190 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b6ea6fea-0b58-47dc-82bd-f7ec3dc5aa49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:50:11.999245 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b672679-af6a-4358-9f99-b08d05250cd5 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:12.013147 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 236/475] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:50:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 20:50:12.020434 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea6fea-0b58-47dc-82bd-f7ec3dc5aa49 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:12.040611 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978abe8a-7c5d-4fce-9fd3-3e56fb5419f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:12.041725 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978abe8a-7c5d-4fce-9fd3-3e56fb5419f4 None admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:12.042224 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978abe8a-7c5d-4fce-9fd3-3e56fb5419f4 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:12.042847 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978abe8a-7c5d-4fce-9fd3-3e56fb5419f4 None admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:12.043852 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978abe8a-7c5d-4fce-9fd3-3e56fb5419f4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:12.046062 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978abe8a-7c5d-4fce-9fd3-3e56fb5419f4 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:12.139762 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea6fea-0b58-47dc-82bd-f7ec3dc5aa49 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:12.165767 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 240/476] 10.222.0.52 () {60 vars in 1132 bytes} [Sat May 14 20:50:11 2022] POST /identity/v3/users => generated 249 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 20:50:12.168040 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978abe8a-7c5d-4fce-9fd3-3e56fb5419f4 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:12.199228 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c01ae6-cdd6-4ef3-acbe-a729e1f53eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:12.199968 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c01ae6-cdd6-4ef3-acbe-a729e1f53eae None admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:12.200258 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c01ae6-cdd6-4ef3-acbe-a729e1f53eae None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:12.200588 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c01ae6-cdd6-4ef3-acbe-a729e1f53eae None admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:12.201569 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c01ae6-cdd6-4ef3-acbe-a729e1f53eae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:12.203018 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c01ae6-cdd6-4ef3-acbe-a729e1f53eae None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:12.293171 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978abe8a-7c5d-4fce-9fd3-3e56fb5419f4 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:12.303065 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 237/477] 10.222.0.52 () {60 vars in 1132 bytes} [Sat May 14 20:50:12 2022] POST /identity/v3/users => generated 248 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 20:50:12.335925 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeadb3d-7642-4784-a6eb-affe9bd903eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:12.337091 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeadb3d-7642-4784-a6eb-affe9bd903eb None admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:12.337643 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeadb3d-7642-4784-a6eb-affe9bd903eb None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:12.338133 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeadb3d-7642-4784-a6eb-affe9bd903eb None admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:12.339218 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeadb3d-7642-4784-a6eb-affe9bd903eb None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:12.341050 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeadb3d-7642-4784-a6eb-affe9bd903eb None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:12.377327 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.sql.core [None req-bdeadb3d-7642-4784-a6eb-affe9bd903eb None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 14 20:50:12.377327 ncdv-master-1 devstack@keystone.service[91107]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 14 20:50:12.377327 ncdv-master-1 devstack@keystone.service[91107]: [parameters: {'id': 'cb0f22ae50fd49ebba5015882a7460bc', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 14 20:50:12.377327 ncdv-master-1 devstack@keystone.service[91107]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91107) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 14 20:50:12.397261 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-bdeadb3d-7642-4784-a6eb-affe9bd903eb None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 14 20:50:12.397261 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:12.397261 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 14 20:50:12.397261 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application self.dialect.do_execute( May 14 20:50:12.397261 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 14 20:50:12.397261 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 14 20:50:12.397261 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 14 20:50:12.397261 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application result = self._query(query) May 14 20:50:12.397261 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 14 20:50:12.397261 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application conn.query(q) May 14 20:50:12.397261 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 14 20:50:12.397261 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 14 20:50:12.397261 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 14 20:50:12.397261 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application result.read() May 14 20:50:12.397261 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 14 20:50:12.398198 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 14 20:50:12.398198 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 14 20:50:12.398198 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application packet.raise_for_error() May 14 20:50:12.398198 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 14 20:50:12.398198 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 14 20:50:12.398198 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 14 20:50:12.398198 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 14 20:50:12.398198 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 14 20:50:12.398198 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:12.398198 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 14 20:50:12.398198 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:12.398198 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:12.398198 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 14 20:50:12.398198 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 14 20:50:12.398198 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 14 20:50:12.398198 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return ref.to_dict() May 14 20:50:12.398198 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 14 20:50:12.398198 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application next(self.gen) May 14 20:50:12.399092 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 14 20:50:12.399092 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application yield resource May 14 20:50:12.399092 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 14 20:50:12.399092 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application next(self.gen) May 14 20:50:12.399092 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 14 20:50:12.399092 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application self.session.rollback() May 14 20:50:12.399092 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 14 20:50:12.399092 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application self.force_reraise() May 14 20:50:12.399092 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 14 20:50:12.399092 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise self.value May 14 20:50:12.399092 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 14 20:50:12.399092 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 14 20:50:12.399092 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 14 20:50:12.399092 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application session.commit() May 14 20:50:12.399092 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 14 20:50:12.399092 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 14 20:50:12.399092 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 14 20:50:12.400632 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application self._prepare_impl() May 14 20:50:12.400632 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 14 20:50:12.400632 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application self.session.flush() May 14 20:50:12.400632 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 14 20:50:12.400632 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application self._flush(objects) May 14 20:50:12.400632 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 14 20:50:12.400632 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 14 20:50:12.400632 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 14 20:50:12.400632 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application compat.raise_( May 14 20:50:12.400632 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 14 20:50:12.400632 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception May 14 20:50:12.400632 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 14 20:50:12.400632 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application flush_context.execute() May 14 20:50:12.400632 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 14 20:50:12.400632 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rec.execute(self) May 14 20:50:12.400632 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 14 20:50:12.400632 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 14 20:50:12.401584 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 14 20:50:12.401584 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application _emit_insert_statements( May 14 20:50:12.401584 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 14 20:50:12.401584 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application c = connection._execute_20( May 14 20:50:12.401584 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 14 20:50:12.401584 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 14 20:50:12.401584 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 14 20:50:12.401584 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 14 20:50:12.401584 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 14 20:50:12.401584 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ret = self._execute_context( May 14 20:50:12.401584 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 14 20:50:12.401584 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 14 20:50:12.401584 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 14 20:50:12.401584 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 14 20:50:12.401584 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 14 20:50:12.401584 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception May 14 20:50:12.402397 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 14 20:50:12.402397 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application self.dialect.do_execute( May 14 20:50:12.402397 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 14 20:50:12.402397 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 14 20:50:12.402397 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 14 20:50:12.402397 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application result = self._query(query) May 14 20:50:12.402397 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 14 20:50:12.402397 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application conn.query(q) May 14 20:50:12.402397 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 14 20:50:12.402397 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 14 20:50:12.402397 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 14 20:50:12.402397 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application result.read() May 14 20:50:12.402397 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 14 20:50:12.402397 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 14 20:50:12.402397 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 14 20:50:12.402397 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application packet.raise_for_error() May 14 20:50:12.403185 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 14 20:50:12.403185 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 14 20:50:12.403185 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 14 20:50:12.403185 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 14 20:50:12.403185 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 14 20:50:12.403185 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 14 20:50:12.403185 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [parameters: {'id': 'cb0f22ae50fd49ebba5015882a7460bc', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 14 20:50:12.403185 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 14 20:50:12.403185 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:12.403185 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 20:50:12.403185 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:12.403185 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:12.403185 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:12.403185 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:12.403185 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:12.403185 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:12.405462 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:12.405462 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:12.405462 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:12.405462 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:12.405462 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:12.405462 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:12.405462 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 14 20:50:12.405462 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 14 20:50:12.405462 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:12.405462 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:12.405462 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 14 20:50:12.405462 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 14 20:50:12.405462 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 14 20:50:12.405462 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 14 20:50:12.405462 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 14 20:50:12.405462 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:12.407513 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 241/478] 10.222.0.52 () {60 vars in 1131 bytes} [Sat May 14 20:50:12 2022] POST /identity/v3/roles => generated 144 bytes in 230 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:12.407659 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c01ae6-cdd6-4ef3-acbe-a729e1f53eae None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:12.525230 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c01ae6-cdd6-4ef3-acbe-a729e1f53eae None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:12.572223 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92eccb6-2a98-46c6-8ad5-25bb942bfff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:12.573047 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92eccb6-2a98-46c6-8ad5-25bb942bfff9 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:12.573331 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92eccb6-2a98-46c6-8ad5-25bb942bfff9 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:12.573611 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92eccb6-2a98-46c6-8ad5-25bb942bfff9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:12.585730 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92eccb6-2a98-46c6-8ad5-25bb942bfff9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:50:12.593853 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-e92eccb6-2a98-46c6-8ad5-25bb942bfff9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 14 20:50:12.593853 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:12.593853 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:12.593853 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:12.593853 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:12.593853 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:12.593853 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:12.593853 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:12.593853 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:12.593853 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:12.593853 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:12.593853 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:12.593853 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:50:12.593853 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:50:12.593853 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:50:12.593853 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:50:12.594786 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:50:12.594786 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:50:12.594786 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:50:12.594786 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:50:12.594786 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:12.594786 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:12.594786 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:12.594786 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:12.594786 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:12.594786 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:12.594786 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:12.594786 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:50:12.594786 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:12.594786 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:12.594786 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:12.594786 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:12.595639 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:12.595639 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:12.595639 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:12.595639 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:12.595639 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:50:12.595639 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:50:12.595639 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:50:12.595639 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:50:12.595639 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:50:12.595639 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:50:12.595639 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 14 20:50:12.595639 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:12.595639 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 238/479] 10.222.0.52 () {56 vars in 1114 bytes} [Sat May 14 20:50:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:12.603649 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeadb3d-7642-4784-a6eb-affe9bd903eb None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:12.714207 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeadb3d-7642-4784-a6eb-affe9bd903eb None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:12.754147 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c906c5d5-a071-4f30-9a25-53c39c060fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:12.754819 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c906c5d5-a071-4f30-9a25-53c39c060fbf None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:12.755098 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c906c5d5-a071-4f30-9a25-53c39c060fbf None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:12.755371 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c906c5d5-a071-4f30-9a25-53c39c060fbf None admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:12.756144 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c906c5d5-a071-4f30-9a25-53c39c060fbf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:12.756445 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c906c5d5-a071-4f30-9a25-53c39c060fbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:12.757821 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c906c5d5-a071-4f30-9a25-53c39c060fbf None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:12.766612 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 242/480] 10.222.0.52 () {56 vars in 1111 bytes} [Sat May 14 20:50:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:50:13.753957 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e7a39-e5b4-4332-a276-6f4a9ad3a59d None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:13.754516 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e7a39-e5b4-4332-a276-6f4a9ad3a59d None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:13.754516 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e7a39-e5b4-4332-a276-6f4a9ad3a59d None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:13.756197 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 239/481] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:50:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:50:13.761484 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98144bbe-38b8-4829-8553-56ad2a31432d None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:13.761883 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98144bbe-38b8-4829-8553-56ad2a31432d None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:13.762068 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98144bbe-38b8-4829-8553-56ad2a31432d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:13.780511 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-98144bbe-38b8-4829-8553-56ad2a31432d None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:50:13.781701 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-98144bbe-38b8-4829-8553-56ad2a31432d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:50:13.861153 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 243/482] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:50:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 20:50:13.896199 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e7a39-e5b4-4332-a276-6f4a9ad3a59d None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:14.060184 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e7a39-e5b4-4332-a276-6f4a9ad3a59d None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:14.106805 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b26183-580e-42dc-a4c5-a1414935d658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:14.111676 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b26183-580e-42dc-a4c5-a1414935d658 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:14.112765 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b26183-580e-42dc-a4c5-a1414935d658 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:14.113465 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b26183-580e-42dc-a4c5-a1414935d658 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:14.126301 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b26183-580e-42dc-a4c5-a1414935d658 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:50:14.137525 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-81b26183-580e-42dc-a4c5-a1414935d658 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 14 20:50:14.137525 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:14.137525 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:14.137525 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:14.137525 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:14.137525 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:14.137525 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:14.137525 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:14.137525 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:14.137525 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:14.137525 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:14.137525 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:14.137525 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:50:14.137525 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:50:14.137525 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:50:14.137525 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:50:14.142996 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:50:14.142996 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:50:14.142996 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:50:14.142996 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:50:14.142996 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:14.142996 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:14.142996 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:14.142996 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:14.142996 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:14.142996 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:14.142996 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:14.142996 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:50:14.142996 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:14.142996 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:14.142996 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:14.142996 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:14.143875 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:14.143875 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:14.143875 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:14.143875 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:14.143875 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:50:14.143875 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:50:14.143875 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:50:14.143875 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:50:14.143875 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:50:14.143875 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:50:14.143875 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 14 20:50:14.143875 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:14.143875 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 240/483] 10.222.0.52 () {56 vars in 1102 bytes} [Sat May 14 20:50:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:14.147828 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98144bbe-38b8-4829-8553-56ad2a31432d None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:14.200454 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a911b-35b8-4c15-8dbd-e71b74bb2064 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:14.201089 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a911b-35b8-4c15-8dbd-e71b74bb2064 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:14.201593 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a911b-35b8-4c15-8dbd-e71b74bb2064 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:14.206038 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 241/484] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:50:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 14 20:50:14.210941 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef24bb-5412-43c1-8442-a8992778dad8 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:14.211491 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef24bb-5412-43c1-8442-a8992778dad8 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:14.211980 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef24bb-5412-43c1-8442-a8992778dad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:14.240190 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-ccef24bb-5412-43c1-8442-a8992778dad8 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:50:14.247325 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ccef24bb-5412-43c1-8442-a8992778dad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:50:14.260815 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98144bbe-38b8-4829-8553-56ad2a31432d None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:14.296473 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e3810e-daa3-4ad8-878e-6befb6782dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:14.297148 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e3810e-daa3-4ad8-878e-6befb6782dcc None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:14.297425 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e3810e-daa3-4ad8-878e-6befb6782dcc None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:14.297695 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e3810e-daa3-4ad8-878e-6befb6782dcc None admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:14.298434 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e3810e-daa3-4ad8-878e-6befb6782dcc None admin] RBAC: Adding query filter params (name=service) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:14.298740 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e3810e-daa3-4ad8-878e-6befb6782dcc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:14.300669 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e3810e-daa3-4ad8-878e-6befb6782dcc None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:14.320968 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 244/485] 10.222.0.52 () {56 vars in 1103 bytes} [Sat May 14 20:50:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:14.325642 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e3810e-daa3-4ad8-878e-6befb6782dcc None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:14.374120 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 242/486] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:50:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 20:50:14.415420 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccef24bb-5412-43c1-8442-a8992778dad8 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:14.479809 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e3810e-daa3-4ad8-878e-6befb6782dcc None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:14.547708 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675ca8ac-5495-440e-9f3b-899b37c8b549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:14.548746 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ca8ac-5495-440e-9f3b-899b37c8b549 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:14.549204 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ca8ac-5495-440e-9f3b-899b37c8b549 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:14.549728 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ca8ac-5495-440e-9f3b-899b37c8b549 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:14.567963 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675ca8ac-5495-440e-9f3b-899b37c8b549 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:14.570256 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675ca8ac-5495-440e-9f3b-899b37c8b549 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:14.579293 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccef24bb-5412-43c1-8442-a8992778dad8 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:14.597401 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-675ca8ac-5495-440e-9f3b-899b37c8b549 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:14.597401 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:14.597401 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:14.597401 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:14.597401 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:14.597401 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:14.597401 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:14.597401 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:14.597401 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:14.597401 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:14.597401 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:14.597401 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:14.597401 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:50:14.597401 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:50:14.597401 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:50:14.598381 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:50:14.598381 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:14.598381 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:14.598381 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:14.598381 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:14.598381 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:14.598381 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:14.598381 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:14.598381 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:50:14.598381 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:14.598381 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:14.598381 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:14.598381 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:14.598381 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:14.598381 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:14.598381 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:14.598381 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:14.599243 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 20:50:14.599243 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:50:14.599243 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:14.599243 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:14.599243 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 245/487] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:50:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 20:50:14.605257 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675ca8ac-5495-440e-9f3b-899b37c8b549 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:14.623946 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6719cbf8-8b4e-4144-a7be-6688fd5a18c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:14.626866 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6719cbf8-8b4e-4144-a7be-6688fd5a18c7 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:14.629179 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6719cbf8-8b4e-4144-a7be-6688fd5a18c7 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:14.629666 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6719cbf8-8b4e-4144-a7be-6688fd5a18c7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:14.648552 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6719cbf8-8b4e-4144-a7be-6688fd5a18c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:50:14.660407 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-6719cbf8-8b4e-4144-a7be-6688fd5a18c7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 14 20:50:14.660407 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:14.660407 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:14.660407 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:14.660407 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:14.660407 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:14.660407 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:14.660407 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:14.660407 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:14.660407 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:14.660407 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:14.660407 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:14.660407 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:50:14.660407 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:50:14.660407 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:50:14.660407 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:50:14.661313 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:50:14.661313 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:50:14.661313 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:50:14.661313 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:50:14.661313 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:14.661313 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:14.661313 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:14.661313 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:14.661313 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:14.661313 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:14.661313 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:14.661313 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:50:14.661313 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:14.661313 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:14.661313 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:14.661313 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:14.662134 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:14.662134 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:14.662134 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:14.662134 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:14.662134 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:50:14.662134 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:50:14.662134 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:50:14.662134 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:50:14.662134 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:50:14.662134 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:50:14.662134 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 14 20:50:14.662134 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:14.668310 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 243/488] 10.222.0.52 () {56 vars in 1102 bytes} [Sat May 14 20:50:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 20:50:14.672878 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6719cbf8-8b4e-4144-a7be-6688fd5a18c7 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:14.803555 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675ca8ac-5495-440e-9f3b-899b37c8b549 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:14.842169 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6719cbf8-8b4e-4144-a7be-6688fd5a18c7 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:14.882824 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f554a669-f769-4a10-8c92-e417d040c424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:14.883522 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f554a669-f769-4a10-8c92-e417d040c424 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:14.883815 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f554a669-f769-4a10-8c92-e417d040c424 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:14.884097 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f554a669-f769-4a10-8c92-e417d040c424 None admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:14.884828 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f554a669-f769-4a10-8c92-e417d040c424 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:14.885138 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f554a669-f769-4a10-8c92-e417d040c424 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:14.886529 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f554a669-f769-4a10-8c92-e417d040c424 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:14.900263 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9228d0d3-645f-461c-84dd-00befaad35a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:14.900958 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228d0d3-645f-461c-84dd-00befaad35a0 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:14.901248 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228d0d3-645f-461c-84dd-00befaad35a0 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:14.901528 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228d0d3-645f-461c-84dd-00befaad35a0 None admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:14.902310 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9228d0d3-645f-461c-84dd-00befaad35a0 None admin] RBAC: Adding query filter params (name=service) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:14.902619 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9228d0d3-645f-461c-84dd-00befaad35a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:14.904094 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9228d0d3-645f-461c-84dd-00befaad35a0 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:14.918779 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 246/489] 10.222.0.52 () {56 vars in 1109 bytes} [Sat May 14 20:50:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:14.921061 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 244/490] 10.222.0.52 () {56 vars in 1103 bytes} [Sat May 14 20:50:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:14.923512 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f554a669-f769-4a10-8c92-e417d040c424 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:14.925994 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9228d0d3-645f-461c-84dd-00befaad35a0 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:15.082662 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f554a669-f769-4a10-8c92-e417d040c424 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:15.120376 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9228d0d3-645f-461c-84dd-00befaad35a0 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:15.129970 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c976a5b-0683-41a4-9b42-9ae0910563e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:15.130757 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c976a5b-0683-41a4-9b42-9ae0910563e6 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:15.131035 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c976a5b-0683-41a4-9b42-9ae0910563e6 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:15.131385 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c976a5b-0683-41a4-9b42-9ae0910563e6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:15.139170 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c976a5b-0683-41a4-9b42-9ae0910563e6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:15.140673 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c976a5b-0683-41a4-9b42-9ae0910563e6 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:15.161038 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-4c976a5b-0683-41a4-9b42-9ae0910563e6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 14 20:50:15.161038 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:15.161038 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:15.161038 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:15.161038 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:15.161038 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:15.161038 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:15.161038 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:15.161038 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:15.161038 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:15.161038 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:15.161038 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:15.161038 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 14 20:50:15.161038 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_user(user_id) May 14 20:50:15.161038 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 14 20:50:15.161038 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 14 20:50:15.162024 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:15.162024 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:15.162024 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 20:50:15.162024 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 20:50:15.162024 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 14 20:50:15.162024 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 20:50:15.162024 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:15.162024 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:15.162024 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:15.162024 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:15.162024 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:15.162024 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:50:15.162024 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:15.162024 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:15.162024 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:15.162024 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:15.162024 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:15.162024 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:15.162952 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:15.162952 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:15.162952 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 14 20:50:15.162952 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 14 20:50:15.162952 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 14 20:50:15.162952 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 14 20:50:15.162952 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 14 20:50:15.162952 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 14 20:50:15.162952 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 14 20:50:15.162952 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:15.166751 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 247/491] 10.222.0.52 () {56 vars in 1093 bytes} [Sat May 14 20:50:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:15.167111 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6fab1a-79a8-4a63-ba06-b5d6019287f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:15.168067 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26123eef-b431-4657-a784-54202699ddb7 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:15.168348 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26123eef-b431-4657-a784-54202699ddb7 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:15.168624 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26123eef-b431-4657-a784-54202699ddb7 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:15.168736 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6fab1a-79a8-4a63-ba06-b5d6019287f3 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:15.169216 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6fab1a-79a8-4a63-ba06-b5d6019287f3 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:15.169719 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6fab1a-79a8-4a63-ba06-b5d6019287f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:15.174342 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 248/492] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:50:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:50:15.175689 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26123eef-b431-4657-a784-54202699ddb7 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:15.183465 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6fab1a-79a8-4a63-ba06-b5d6019287f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:15.185745 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6fab1a-79a8-4a63-ba06-b5d6019287f3 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:15.210326 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-ea6fab1a-79a8-4a63-ba06-b5d6019287f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:15.210326 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:15.210326 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:15.210326 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:15.210326 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:15.210326 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:15.210326 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:15.210326 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:15.210326 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:15.210326 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:15.210326 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:15.210326 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:15.210326 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:50:15.210326 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:50:15.210326 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:50:15.211257 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:50:15.211257 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:15.211257 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:15.211257 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:15.211257 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:15.211257 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:15.211257 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:15.211257 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:15.211257 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:50:15.211257 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:15.211257 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:15.211257 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:15.211257 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:15.211257 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:15.211257 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:15.211257 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:15.211257 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:15.212492 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 20:50:15.212492 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:50:15.212492 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:15.212492 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:15.215683 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 245/493] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:50:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 20:50:15.217485 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c6d60-f3db-41d8-9e51-8a2f998277a0 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:15.217770 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c6d60-f3db-41d8-9e51-8a2f998277a0 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:15.218047 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c6d60-f3db-41d8-9e51-8a2f998277a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:15.239138 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-101c6d60-f3db-41d8-9e51-8a2f998277a0 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:50:15.240365 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-101c6d60-f3db-41d8-9e51-8a2f998277a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:50:15.315824 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 246/494] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:50:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 20:50:15.315824 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101c6d60-f3db-41d8-9e51-8a2f998277a0 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:15.316996 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26123eef-b431-4657-a784-54202699ddb7 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:15.370327 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff83b54-4458-4a04-9b95-131dc9ce5701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:15.371711 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff83b54-4458-4a04-9b95-131dc9ce5701 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:15.372190 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff83b54-4458-4a04-9b95-131dc9ce5701 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:15.372685 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff83b54-4458-4a04-9b95-131dc9ce5701 None admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:15.373724 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff83b54-4458-4a04-9b95-131dc9ce5701 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:15.374276 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff83b54-4458-4a04-9b95-131dc9ce5701 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:15.375940 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff83b54-4458-4a04-9b95-131dc9ce5701 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:15.411246 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101c6d60-f3db-41d8-9e51-8a2f998277a0 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:15.416914 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 249/495] 10.222.0.52 () {56 vars in 1133 bytes} [Sat May 14 20:50:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:15.418142 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff83b54-4458-4a04-9b95-131dc9ce5701 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:15.448154 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96f5d74-0986-411e-b909-5cf3f574dfc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:15.448816 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f5d74-0986-411e-b909-5cf3f574dfc9 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:15.449101 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f5d74-0986-411e-b909-5cf3f574dfc9 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:15.449374 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f5d74-0986-411e-b909-5cf3f574dfc9 None admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:15.450091 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96f5d74-0986-411e-b909-5cf3f574dfc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:15.450491 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96f5d74-0986-411e-b909-5cf3f574dfc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:15.452096 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96f5d74-0986-411e-b909-5cf3f574dfc9 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:15.468258 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 247/496] 10.222.0.52 () {56 vars in 1109 bytes} [Sat May 14 20:50:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:15.468258 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75397bd-f0c6-4a09-9cba-c73111d301b6 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:15.468258 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75397bd-f0c6-4a09-9cba-c73111d301b6 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:15.468258 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75397bd-f0c6-4a09-9cba-c73111d301b6 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:15.468258 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 248/497] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:50:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:50:15.468258 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75397bd-f0c6-4a09-9cba-c73111d301b6 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:15.533183 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff83b54-4458-4a04-9b95-131dc9ce5701 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:15.568163 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd29c5e-16cb-4965-93d1-d133b5efb103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:15.569229 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd29c5e-16cb-4965-93d1-d133b5efb103 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:15.569516 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd29c5e-16cb-4965-93d1-d133b5efb103 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:15.569862 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd29c5e-16cb-4965-93d1-d133b5efb103 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:15.571326 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75397bd-f0c6-4a09-9cba-c73111d301b6 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:15.581991 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd29c5e-16cb-4965-93d1-d133b5efb103 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:50:15.592019 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-bcd29c5e-16cb-4965-93d1-d133b5efb103 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 14 20:50:15.592019 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:15.592019 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:15.592019 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:15.592019 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:15.592019 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:15.592019 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:15.592019 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:15.592019 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:15.592019 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:15.592019 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:15.592019 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:15.592019 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:50:15.592019 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:50:15.592019 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:50:15.592019 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:50:15.592904 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:50:15.592904 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:50:15.592904 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:50:15.592904 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:50:15.592904 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:15.592904 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:15.592904 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:15.592904 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:15.592904 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:15.592904 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:15.592904 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:15.592904 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:50:15.592904 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:15.592904 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:15.592904 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:15.592904 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:15.593695 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:15.593695 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:15.593695 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:15.593695 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:15.593695 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:50:15.593695 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:50:15.593695 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:50:15.593695 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:50:15.593695 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:50:15.593695 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:50:15.593695 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 14 20:50:15.593695 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:15.594301 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 250/498] 10.222.0.52 () {56 vars in 1102 bytes} [Sat May 14 20:50:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:15.594855 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd29c5e-16cb-4965-93d1-d133b5efb103 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:15.605995 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c33759d-64f7-4051-be86-64f5704ae8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:15.606643 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33759d-64f7-4051-be86-64f5704ae8b4 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:15.606932 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33759d-64f7-4051-be86-64f5704ae8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:15.607215 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33759d-64f7-4051-be86-64f5704ae8b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:15.679697 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c33759d-64f7-4051-be86-64f5704ae8b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:15.681166 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c33759d-64f7-4051-be86-64f5704ae8b4 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:15.699688 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd29c5e-16cb-4965-93d1-d133b5efb103 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:15.734540 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea0e031-84e2-41a1-93e3-bc214e8345dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:15.735709 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea0e031-84e2-41a1-93e3-bc214e8345dd None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:15.736217 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea0e031-84e2-41a1-93e3-bc214e8345dd None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:15.736686 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea0e031-84e2-41a1-93e3-bc214e8345dd None admin] PATH_INFO: `/v3/users/glance` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:15.745781 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea0e031-84e2-41a1-93e3-bc214e8345dd None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:15.747536 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea0e031-84e2-41a1-93e3-bc214e8345dd None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:15.761610 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-7ea0e031-84e2-41a1-93e3-bc214e8345dd None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 14 20:50:15.761610 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:15.761610 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:15.761610 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:15.761610 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:15.761610 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:15.761610 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:15.761610 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:15.761610 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:15.761610 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:15.761610 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:15.761610 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:15.761610 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 14 20:50:15.761610 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_user(user_id) May 14 20:50:15.761610 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 14 20:50:15.761610 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 14 20:50:15.762514 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:15.762514 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:15.762514 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 20:50:15.762514 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 20:50:15.762514 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 14 20:50:15.762514 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 20:50:15.762514 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:15.762514 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:15.762514 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:15.762514 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:15.762514 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:15.762514 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:50:15.762514 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:15.762514 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:15.762514 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:15.762514 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:15.762514 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:15.762514 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:15.763432 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:15.763432 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:15.763432 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 14 20:50:15.763432 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 14 20:50:15.763432 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 14 20:50:15.763432 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 14 20:50:15.763432 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 14 20:50:15.763432 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 14 20:50:15.763432 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 14 20:50:15.763432 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:15.763432 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 251/499] 10.222.0.52 () {56 vars in 1099 bytes} [Sat May 14 20:50:15 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:15.764017 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0b575-1357-4494-89dd-31eb934e4133 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:15.764227 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0b575-1357-4494-89dd-31eb934e4133 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:15.764508 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0b575-1357-4494-89dd-31eb934e4133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:15.784748 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-68e0b575-1357-4494-89dd-31eb934e4133 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:50:15.785942 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-68e0b575-1357-4494-89dd-31eb934e4133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:50:15.796777 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 249/500] 10.222.0.52 () {58 vars in 1282 bytes} [Sat May 14 20:50:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 14 20:50:15.796777 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c33759d-64f7-4051-be86-64f5704ae8b4 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:15.852064 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 252/501] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:50:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 20:50:15.852920 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e0b575-1357-4494-89dd-31eb934e4133 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:15.890830 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c33759d-64f7-4051-be86-64f5704ae8b4 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:15.924413 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a31a46-3b30-430b-b07c-6db4beb6b952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:15.925233 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a31a46-3b30-430b-b07c-6db4beb6b952 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:15.925528 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a31a46-3b30-430b-b07c-6db4beb6b952 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:15.925806 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a31a46-3b30-430b-b07c-6db4beb6b952 None admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:15.926555 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a31a46-3b30-430b-b07c-6db4beb6b952 None admin] RBAC: Adding query filter params (name=service) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:15.926866 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a31a46-3b30-430b-b07c-6db4beb6b952 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:15.928273 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a31a46-3b30-430b-b07c-6db4beb6b952 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:15.936333 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 250/502] 10.222.0.52 () {56 vars in 1103 bytes} [Sat May 14 20:50:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:15.937067 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a31a46-3b30-430b-b07c-6db4beb6b952 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:15.947927 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e0b575-1357-4494-89dd-31eb934e4133 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:15.981577 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be825b82-86a6-4fac-bebb-425d19175cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:15.982239 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be825b82-86a6-4fac-bebb-425d19175cca None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:15.982523 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be825b82-86a6-4fac-bebb-425d19175cca None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:15.982796 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be825b82-86a6-4fac-bebb-425d19175cca None admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:15.983646 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be825b82-86a6-4fac-bebb-425d19175cca None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:15.983954 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be825b82-86a6-4fac-bebb-425d19175cca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:15.985402 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be825b82-86a6-4fac-bebb-425d19175cca None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:16.008627 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 253/503] 10.222.0.52 () {56 vars in 1137 bytes} [Sat May 14 20:50:15 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:16.010002 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1bdaba-6660-4f58-9748-ec843ef046f0 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:16.010295 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1bdaba-6660-4f58-9748-ec843ef046f0 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:16.010576 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1bdaba-6660-4f58-9748-ec843ef046f0 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:16.012180 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 254/504] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:50:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:50:16.012886 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1bdaba-6660-4f58-9748-ec843ef046f0 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:16.043508 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a31a46-3b30-430b-b07c-6db4beb6b952 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:16.075879 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba591f-e402-4a02-b663-004d836449eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:16.076660 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba591f-e402-4a02-b663-004d836449eb None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:16.076946 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba591f-e402-4a02-b663-004d836449eb None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:16.077223 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba591f-e402-4a02-b663-004d836449eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:16.088218 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ba591f-e402-4a02-b663-004d836449eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:16.089651 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ba591f-e402-4a02-b663-004d836449eb None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:16.107090 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-c5ba591f-e402-4a02-b663-004d836449eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:16.107090 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:16.107090 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:16.107090 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:16.107090 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:16.107090 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:16.107090 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:16.107090 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:16.107090 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:16.107090 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:16.107090 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:16.107090 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:16.107090 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:50:16.107090 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:50:16.107090 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:50:16.108409 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:50:16.108409 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:16.108409 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:16.108409 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:16.108409 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:16.108409 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:16.108409 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:16.108409 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:16.108409 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:50:16.108409 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:16.108409 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:16.108409 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:16.108409 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:16.108409 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:16.108409 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:16.108409 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:16.108409 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:16.109273 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 20:50:16.109273 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:50:16.109273 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:16.109273 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:16.109273 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 251/505] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:50:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:16.109273 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba591f-e402-4a02-b663-004d836449eb None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:16.117068 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1bdaba-6660-4f58-9748-ec843ef046f0 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:16.155217 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171b905c-1b42-48c9-8406-82641d028dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:16.156033 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b905c-1b42-48c9-8406-82641d028dc5 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:16.156319 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b905c-1b42-48c9-8406-82641d028dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:16.156597 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b905c-1b42-48c9-8406-82641d028dc5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:16.166427 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171b905c-1b42-48c9-8406-82641d028dc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:50:16.174112 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-171b905c-1b42-48c9-8406-82641d028dc5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 14 20:50:16.174112 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:16.174112 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:16.174112 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:16.174112 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:16.174112 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:16.174112 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:16.174112 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:16.174112 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:16.174112 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:16.174112 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:16.174112 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:16.174112 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:50:16.174112 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:50:16.174112 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:50:16.174112 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:50:16.175059 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:50:16.175059 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:50:16.175059 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:50:16.175059 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:50:16.175059 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:16.175059 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:16.175059 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:16.175059 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:16.175059 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:16.175059 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:16.175059 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:16.175059 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:50:16.175059 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:16.175059 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:16.175059 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:16.175059 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:16.175918 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:16.175918 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:16.175918 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:16.175918 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:16.175918 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:50:16.175918 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:50:16.175918 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:50:16.175918 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:50:16.175918 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:50:16.175918 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:50:16.175918 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 14 20:50:16.175918 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:16.176607 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 255/506] 10.222.0.52 () {56 vars in 1102 bytes} [Sat May 14 20:50:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:16.177030 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171b905c-1b42-48c9-8406-82641d028dc5 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:16.222900 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba591f-e402-4a02-b663-004d836449eb None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:16.255193 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa225c3-e748-4a93-b119-a0b5b6016474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:16.256000 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa225c3-e748-4a93-b119-a0b5b6016474 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:16.256281 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa225c3-e748-4a93-b119-a0b5b6016474 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:16.256564 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa225c3-e748-4a93-b119-a0b5b6016474 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:16.266559 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa225c3-e748-4a93-b119-a0b5b6016474 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:16.268063 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa225c3-e748-4a93-b119-a0b5b6016474 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:16.273250 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171b905c-1b42-48c9-8406-82641d028dc5 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:16.285076 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-0fa225c3-e748-4a93-b119-a0b5b6016474 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:16.285076 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:16.285076 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:16.285076 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:16.285076 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:16.285076 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:16.285076 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:16.285076 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:16.285076 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:16.285076 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:16.285076 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:16.285076 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:16.285076 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:50:16.285076 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:50:16.285076 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:50:16.285976 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:50:16.285976 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:16.285976 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:16.285976 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:16.285976 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:16.285976 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:16.285976 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:16.285976 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:16.285976 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:50:16.285976 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:16.285976 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:16.285976 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:16.285976 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:16.285976 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:16.285976 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:16.285976 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:16.285976 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:16.286834 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 20:50:16.286834 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:50:16.286834 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:16.286834 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:16.286834 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 252/507] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:50:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:16.287678 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34cfd9a-ed38-420d-8df6-bd9211e3145e None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:16.287872 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34cfd9a-ed38-420d-8df6-bd9211e3145e None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:16.288150 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34cfd9a-ed38-420d-8df6-bd9211e3145e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:16.304949 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-e34cfd9a-ed38-420d-8df6-bd9211e3145e None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:50:16.306136 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e34cfd9a-ed38-420d-8df6-bd9211e3145e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:50:16.308156 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95177b9e-474c-4626-bdcf-6ae40c281edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:16.308797 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95177b9e-474c-4626-bdcf-6ae40c281edc None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:16.309082 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95177b9e-474c-4626-bdcf-6ae40c281edc None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:16.309357 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95177b9e-474c-4626-bdcf-6ae40c281edc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:16.370903 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 253/508] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:50:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 20:50:16.372052 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34cfd9a-ed38-420d-8df6-bd9211e3145e None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:16.380281 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95177b9e-474c-4626-bdcf-6ae40c281edc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:16.381823 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95177b9e-474c-4626-bdcf-6ae40c281edc None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:16.467282 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34cfd9a-ed38-420d-8df6-bd9211e3145e None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:16.478536 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 256/509] 10.222.0.52 () {58 vars in 1282 bytes} [Sat May 14 20:50:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 14 20:50:16.479300 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95177b9e-474c-4626-bdcf-6ae40c281edc None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:16.501083 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b2ff75-476b-4c6a-91ba-04823a78a654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:16.501741 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b2ff75-476b-4c6a-91ba-04823a78a654 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:16.502102 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b2ff75-476b-4c6a-91ba-04823a78a654 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:16.512767 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b2ff75-476b-4c6a-91ba-04823a78a654 None admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:16.512767 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b2ff75-476b-4c6a-91ba-04823a78a654 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:16.512767 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b2ff75-476b-4c6a-91ba-04823a78a654 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:16.512767 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b2ff75-476b-4c6a-91ba-04823a78a654 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:16.515650 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 254/510] 10.222.0.52 () {56 vars in 1109 bytes} [Sat May 14 20:50:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:16.516448 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b2ff75-476b-4c6a-91ba-04823a78a654 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:16.576834 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95177b9e-474c-4626-bdcf-6ae40c281edc None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:16.609580 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63202b8c-7d11-4e28-8e46-1dd03c0dd337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:16.610160 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b2ff75-476b-4c6a-91ba-04823a78a654 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:16.610263 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63202b8c-7d11-4e28-8e46-1dd03c0dd337 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:16.610551 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63202b8c-7d11-4e28-8e46-1dd03c0dd337 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:16.610824 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63202b8c-7d11-4e28-8e46-1dd03c0dd337 None admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:16.611590 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63202b8c-7d11-4e28-8e46-1dd03c0dd337 None admin] RBAC: Adding query filter params (name=service) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:16.611894 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63202b8c-7d11-4e28-8e46-1dd03c0dd337 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:16.613306 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63202b8c-7d11-4e28-8e46-1dd03c0dd337 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:16.620968 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 257/511] 10.222.0.52 () {56 vars in 1103 bytes} [Sat May 14 20:50:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:16.622055 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63202b8c-7d11-4e28-8e46-1dd03c0dd337 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:16.644054 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3afda1-5d0b-477f-bdfb-e50a802db0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:16.644743 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3afda1-5d0b-477f-bdfb-e50a802db0b0 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:16.645031 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3afda1-5d0b-477f-bdfb-e50a802db0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:16.645306 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3afda1-5d0b-477f-bdfb-e50a802db0b0 None admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:16.646013 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3afda1-5d0b-477f-bdfb-e50a802db0b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:16.646319 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3afda1-5d0b-477f-bdfb-e50a802db0b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:16.647705 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3afda1-5d0b-477f-bdfb-e50a802db0b0 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:16.660946 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 255/512] 10.222.0.52 () {56 vars in 1109 bytes} [Sat May 14 20:50:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:16.661859 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3afda1-5d0b-477f-bdfb-e50a802db0b0 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:16.731023 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63202b8c-7d11-4e28-8e46-1dd03c0dd337 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:16.759119 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3afda1-5d0b-477f-bdfb-e50a802db0b0 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:16.763802 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2983a75-ba5f-47a7-b404-b6b8125f7812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:16.764590 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2983a75-ba5f-47a7-b404-b6b8125f7812 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:16.764872 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2983a75-ba5f-47a7-b404-b6b8125f7812 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:16.765145 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2983a75-ba5f-47a7-b404-b6b8125f7812 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:16.775793 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2983a75-ba5f-47a7-b404-b6b8125f7812 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:16.777229 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2983a75-ba5f-47a7-b404-b6b8125f7812 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:16.792182 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7fe6bd-27d9-4192-84e1-4efa893c651e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:16.792954 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7fe6bd-27d9-4192-84e1-4efa893c651e None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:16.793232 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7fe6bd-27d9-4192-84e1-4efa893c651e None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:16.793503 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7fe6bd-27d9-4192-84e1-4efa893c651e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:16.794157 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-a2983a75-ba5f-47a7-b404-b6b8125f7812 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:16.794157 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:16.794157 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:16.794157 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:16.794157 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:16.794157 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:16.794157 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:16.794157 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:16.794157 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:16.794157 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:16.794157 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:16.794157 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:16.794157 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:50:16.794157 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:50:16.794157 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:50:16.795106 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:50:16.795106 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:16.795106 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:16.795106 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:16.795106 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:16.795106 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:16.795106 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:16.795106 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:16.795106 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:50:16.795106 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:16.795106 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:16.795106 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:16.795106 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:16.795106 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:16.795106 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:16.795106 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:16.795106 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:16.796164 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 20:50:16.796164 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:50:16.796164 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:16.796164 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:16.796164 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 258/513] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:50:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:16.796477 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2983a75-ba5f-47a7-b404-b6b8125f7812 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:16.808169 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7fe6bd-27d9-4192-84e1-4efa893c651e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:16.809599 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7fe6bd-27d9-4192-84e1-4efa893c651e None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:16.826745 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-ac7fe6bd-27d9-4192-84e1-4efa893c651e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:16.826745 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:16.826745 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:16.826745 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:16.826745 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:16.826745 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:16.826745 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:16.826745 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:16.826745 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:16.826745 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:16.826745 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:16.826745 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:16.826745 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:50:16.826745 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:50:16.826745 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:50:16.827756 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:50:16.827756 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:16.827756 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:16.827756 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:16.827756 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:16.827756 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:16.827756 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:16.827756 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:16.827756 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:50:16.827756 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:16.827756 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:16.827756 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:16.827756 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:16.827756 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:16.827756 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:16.827756 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:16.827756 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:16.828843 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 20:50:16.828843 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:50:16.828843 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:16.828843 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:16.828843 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 256/514] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:50:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:16.829248 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7fe6bd-27d9-4192-84e1-4efa893c651e None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:16.894988 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2983a75-ba5f-47a7-b404-b6b8125f7812 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:16.923606 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7fe6bd-27d9-4192-84e1-4efa893c651e None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:16.926804 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da927a2-4455-48db-aeea-7269a2e1b855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:16.927645 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da927a2-4455-48db-aeea-7269a2e1b855 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:16.927932 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da927a2-4455-48db-aeea-7269a2e1b855 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:16.928209 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da927a2-4455-48db-aeea-7269a2e1b855 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:16.934897 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da927a2-4455-48db-aeea-7269a2e1b855 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:16.936383 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da927a2-4455-48db-aeea-7269a2e1b855 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:16.951275 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-2da927a2-4455-48db-aeea-7269a2e1b855 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 14 20:50:16.951275 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:16.951275 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:16.951275 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:16.951275 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:16.951275 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:16.951275 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:16.951275 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:16.951275 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:16.951275 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:16.951275 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:16.951275 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:16.951275 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 14 20:50:16.951275 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_project(project_id) May 14 20:50:16.951275 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 14 20:50:16.952154 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 14 20:50:16.952154 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:16.952154 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:16.952154 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:16.952154 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:16.952154 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:16.952154 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:16.952154 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:16.952154 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:50:16.952154 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:16.952154 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:16.952154 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:16.952154 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:16.952154 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:16.952154 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:16.952154 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:16.952154 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:16.953010 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 14 20:50:16.953010 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 14 20:50:16.953010 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 20:50:16.953010 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 20:50:16.953010 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 20:50:16.953010 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 20:50:16.953010 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 14 20:50:16.953010 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:16.953010 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 259/515] 10.222.0.52 () {56 vars in 1111 bytes} [Sat May 14 20:50:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:16.953515 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da927a2-4455-48db-aeea-7269a2e1b855 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:16.961465 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fc70a1-b85e-4e63-a3cf-19cf29b27109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:16.962251 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc70a1-b85e-4e63-a3cf-19cf29b27109 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:16.962531 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc70a1-b85e-4e63-a3cf-19cf29b27109 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:16.962802 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc70a1-b85e-4e63-a3cf-19cf29b27109 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:16.973626 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fc70a1-b85e-4e63-a3cf-19cf29b27109 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:16.975042 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fc70a1-b85e-4e63-a3cf-19cf29b27109 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:16.992543 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-59fc70a1-b85e-4e63-a3cf-19cf29b27109 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:16.992543 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:16.992543 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:16.992543 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:16.992543 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:16.992543 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:16.992543 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:16.992543 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:16.992543 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:16.992543 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:16.992543 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:16.992543 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:16.992543 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:50:16.992543 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:50:16.992543 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:50:16.993482 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:50:16.993482 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:16.993482 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:16.993482 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:16.993482 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:16.993482 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:16.993482 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:16.993482 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:16.993482 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:50:16.993482 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:16.993482 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:16.993482 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:16.993482 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:16.993482 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:16.993482 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:16.993482 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:16.993482 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:16.994323 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 20:50:16.994323 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:50:16.994323 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:16.994323 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:16.994323 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 257/516] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:50:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:16.994816 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fc70a1-b85e-4e63-a3cf-19cf29b27109 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:17.057347 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da927a2-4455-48db-aeea-7269a2e1b855 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:17.091765 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81626c06-5b93-4e7c-84bb-2afb7a33fdc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:17.092081 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fc70a1-b85e-4e63-a3cf-19cf29b27109 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:17.092556 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81626c06-5b93-4e7c-84bb-2afb7a33fdc3 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:17.092839 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81626c06-5b93-4e7c-84bb-2afb7a33fdc3 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:17.093142 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81626c06-5b93-4e7c-84bb-2afb7a33fdc3 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:17.100627 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81626c06-5b93-4e7c-84bb-2afb7a33fdc3 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:17.102089 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81626c06-5b93-4e7c-84bb-2afb7a33fdc3 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:17.117170 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-81626c06-5b93-4e7c-84bb-2afb7a33fdc3 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 14 20:50:17.117170 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:17.117170 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:17.117170 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:17.117170 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:17.117170 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:17.117170 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:17.117170 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:17.117170 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:17.117170 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:17.117170 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:17.117170 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:17.117170 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 14 20:50:17.117170 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_user(user_id) May 14 20:50:17.117170 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 14 20:50:17.117170 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 14 20:50:17.118313 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:17.118313 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:17.118313 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 20:50:17.118313 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 20:50:17.118313 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 14 20:50:17.118313 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 20:50:17.118313 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:17.118313 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:17.118313 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:17.118313 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:17.118313 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:17.118313 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:50:17.118313 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:17.118313 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:17.118313 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:17.118313 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:17.118313 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:17.118313 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:17.119436 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:17.119436 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:17.119436 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 14 20:50:17.119436 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 14 20:50:17.119436 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 14 20:50:17.119436 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 14 20:50:17.119436 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 14 20:50:17.119436 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 14 20:50:17.119436 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 14 20:50:17.119436 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:17.123350 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 260/517] 10.222.0.52 () {56 vars in 1102 bytes} [Sat May 14 20:50:16 2022] GET /identity/v3/users/neutron => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:17.124121 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81626c06-5b93-4e7c-84bb-2afb7a33fdc3 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:17.126349 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1412463-96f5-4991-879a-32e5d9396850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:17.127008 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1412463-96f5-4991-879a-32e5d9396850 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:17.127294 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1412463-96f5-4991-879a-32e5d9396850 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:17.128530 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1412463-96f5-4991-879a-32e5d9396850 None admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:17.128644 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1412463-96f5-4991-879a-32e5d9396850 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:17.128925 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1412463-96f5-4991-879a-32e5d9396850 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:17.130297 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1412463-96f5-4991-879a-32e5d9396850 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:17.141323 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 258/518] 10.222.0.52 () {56 vars in 1109 bytes} [Sat May 14 20:50:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:17.142112 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1412463-96f5-4991-879a-32e5d9396850 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:17.220681 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81626c06-5b93-4e7c-84bb-2afb7a33fdc3 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:17.251522 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1412463-96f5-4991-879a-32e5d9396850 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:17.255296 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f7da6-da63-474b-942c-1f645ed0a399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:17.255981 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f7da6-da63-474b-942c-1f645ed0a399 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:17.256267 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f7da6-da63-474b-942c-1f645ed0a399 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:17.256538 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f7da6-da63-474b-942c-1f645ed0a399 None admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:17.257247 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20f7da6-da63-474b-942c-1f645ed0a399 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:17.257552 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20f7da6-da63-474b-942c-1f645ed0a399 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:17.258935 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20f7da6-da63-474b-942c-1f645ed0a399 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:17.270195 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 261/519] 10.222.0.52 () {56 vars in 1109 bytes} [Sat May 14 20:50:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:17.270982 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f7da6-da63-474b-942c-1f645ed0a399 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:17.284610 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa71b50f-11eb-4d55-9341-73fa82c33886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:17.285257 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71b50f-11eb-4d55-9341-73fa82c33886 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:17.285538 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71b50f-11eb-4d55-9341-73fa82c33886 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:17.285809 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71b50f-11eb-4d55-9341-73fa82c33886 None admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:17.286583 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa71b50f-11eb-4d55-9341-73fa82c33886 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:17.286887 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa71b50f-11eb-4d55-9341-73fa82c33886 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:17.288332 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa71b50f-11eb-4d55-9341-73fa82c33886 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:17.305439 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 259/520] 10.222.0.52 () {56 vars in 1148 bytes} [Sat May 14 20:50:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:17.306232 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa71b50f-11eb-4d55-9341-73fa82c33886 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:17.378064 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f7da6-da63-474b-942c-1f645ed0a399 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:17.402186 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa71b50f-11eb-4d55-9341-73fa82c33886 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:17.411647 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ef6abe-f1e1-404a-9d33-aceb5da15271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:17.412315 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef6abe-f1e1-404a-9d33-aceb5da15271 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:17.412599 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef6abe-f1e1-404a-9d33-aceb5da15271 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:17.412879 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef6abe-f1e1-404a-9d33-aceb5da15271 None admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:17.413596 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ef6abe-f1e1-404a-9d33-aceb5da15271 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:17.413903 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ef6abe-f1e1-404a-9d33-aceb5da15271 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:17.415275 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ef6abe-f1e1-404a-9d33-aceb5da15271 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:17.426720 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 262/521] 10.222.0.52 () {56 vars in 1109 bytes} [Sat May 14 20:50:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:17.427497 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ef6abe-f1e1-404a-9d33-aceb5da15271 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:17.435180 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc806f-4c3a-445e-b97f-de67f8dec9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:17.435973 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc806f-4c3a-445e-b97f-de67f8dec9f3 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:17.436249 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc806f-4c3a-445e-b97f-de67f8dec9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:17.436519 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc806f-4c3a-445e-b97f-de67f8dec9f3 None admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:17.437335 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cc806f-4c3a-445e-b97f-de67f8dec9f3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:17.437647 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cc806f-4c3a-445e-b97f-de67f8dec9f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:17.439048 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cc806f-4c3a-445e-b97f-de67f8dec9f3 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:17.475275 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 260/522] 10.222.0.52 () {56 vars in 1139 bytes} [Sat May 14 20:50:17 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:17.476132 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc806f-4c3a-445e-b97f-de67f8dec9f3 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:17.528022 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ef6abe-f1e1-404a-9d33-aceb5da15271 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:17.560493 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb6c23d-bc3c-44e7-8377-9f018cbb26cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:17.561157 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6c23d-bc3c-44e7-8377-9f018cbb26cb None admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:17.561442 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6c23d-bc3c-44e7-8377-9f018cbb26cb None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:17.561720 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6c23d-bc3c-44e7-8377-9f018cbb26cb None admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:17.562413 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb6c23d-bc3c-44e7-8377-9f018cbb26cb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:17.563887 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb6c23d-bc3c-44e7-8377-9f018cbb26cb None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:17.568702 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc806f-4c3a-445e-b97f-de67f8dec9f3 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:17.601253 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c81867-2ba7-46ec-9798-45c4cf251bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:17.602030 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c81867-2ba7-46ec-9798-45c4cf251bb1 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:17.602310 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c81867-2ba7-46ec-9798-45c4cf251bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:17.602580 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c81867-2ba7-46ec-9798-45c4cf251bb1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:17.608973 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c81867-2ba7-46ec-9798-45c4cf251bb1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:17.610404 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c81867-2ba7-46ec-9798-45c4cf251bb1 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:17.624313 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-02c81867-2ba7-46ec-9798-45c4cf251bb1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 14 20:50:17.624313 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:17.624313 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:17.624313 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:17.624313 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:17.624313 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:17.624313 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:17.624313 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:17.624313 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:17.624313 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:17.624313 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:17.624313 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:17.624313 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 14 20:50:17.624313 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_project(project_id) May 14 20:50:17.624313 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 14 20:50:17.625311 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 14 20:50:17.625311 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:17.625311 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:17.625311 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:17.625311 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:17.625311 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:17.625311 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:17.625311 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:17.625311 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:50:17.625311 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:17.625311 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:17.625311 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:17.625311 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:17.625311 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:17.625311 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:17.625311 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:17.625311 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:17.626409 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 14 20:50:17.626409 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 14 20:50:17.626409 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 20:50:17.626409 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 20:50:17.626409 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 20:50:17.626409 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 20:50:17.626409 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 14 20:50:17.626409 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:17.626409 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 261/523] 10.222.0.52 () {56 vars in 1111 bytes} [Sat May 14 20:50:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:17.626409 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c81867-2ba7-46ec-9798-45c4cf251bb1 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:17.667253 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 263/524] 10.222.0.52 () {60 vars in 1132 bytes} [Sat May 14 20:50:17 2022] POST /identity/v3/users => generated 247 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 20:50:17.667253 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb6c23d-bc3c-44e7-8377-9f018cbb26cb None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:17.741371 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c81867-2ba7-46ec-9798-45c4cf251bb1 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:17.767703 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb6c23d-bc3c-44e7-8377-9f018cbb26cb None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:17.777146 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e57714-feba-4cab-ba70-95bd5fb5731f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:17.777806 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e57714-feba-4cab-ba70-95bd5fb5731f None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:17.778154 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e57714-feba-4cab-ba70-95bd5fb5731f None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:17.778366 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e57714-feba-4cab-ba70-95bd5fb5731f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:17.779187 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e57714-feba-4cab-ba70-95bd5fb5731f None admin] RBAC: Adding query filter params (role.id=998d6a3451be42a89d4cff277851ad70, scope.project.id=0911a024287e430ea6ee015389f0c440, user.id=0f1b0e2b025d4eceaa90e1616d0a9db8) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:17.779824 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e57714-feba-4cab-ba70-95bd5fb5731f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:17.780967 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e57714-feba-4cab-ba70-95bd5fb5731f None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:17.799856 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 262/525] 10.222.0.52 () {56 vars in 1374 bytes} [Sat May 14 20:50:17 2022] GET /identity/v3/role_assignments?user.id=0f1b0e2b025d4eceaa90e1616d0a9db8&scope.project.id=0911a024287e430ea6ee015389f0c440&role.id=998d6a3451be42a89d4cff277851ad70 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:17.800685 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e57714-feba-4cab-ba70-95bd5fb5731f None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:17.805083 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883deec3-3fa5-4a2d-8201-38cdabe69725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:17.806043 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883deec3-3fa5-4a2d-8201-38cdabe69725 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:17.806430 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883deec3-3fa5-4a2d-8201-38cdabe69725 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:17.806808 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883deec3-3fa5-4a2d-8201-38cdabe69725 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:17.816121 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883deec3-3fa5-4a2d-8201-38cdabe69725 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:17.817856 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883deec3-3fa5-4a2d-8201-38cdabe69725 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:17.834507 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-883deec3-3fa5-4a2d-8201-38cdabe69725 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 14 20:50:17.834507 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:17.834507 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:17.834507 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:17.834507 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:17.834507 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:17.834507 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:17.834507 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:17.834507 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:17.834507 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:17.834507 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:17.834507 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:17.834507 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 14 20:50:17.834507 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_user(user_id) May 14 20:50:17.834507 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 14 20:50:17.834507 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 14 20:50:17.835689 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:17.835689 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:17.835689 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 20:50:17.835689 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 20:50:17.835689 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 14 20:50:17.835689 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 20:50:17.835689 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:17.835689 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:17.835689 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:17.835689 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:17.835689 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:17.835689 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:50:17.835689 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:17.835689 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:17.835689 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:17.835689 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:17.835689 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:17.835689 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:17.836802 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:17.836802 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:17.836802 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 14 20:50:17.836802 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 14 20:50:17.836802 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 14 20:50:17.836802 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 14 20:50:17.836802 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 14 20:50:17.836802 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 14 20:50:17.836802 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 14 20:50:17.836802 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:17.839921 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 264/526] 10.222.0.52 () {56 vars in 1099 bytes} [Sat May 14 20:50:17 2022] GET /identity/v3/users/cinder => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:17.840626 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883deec3-3fa5-4a2d-8201-38cdabe69725 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:17.925728 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e57714-feba-4cab-ba70-95bd5fb5731f None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:17.965842 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b8da90-115c-4e5e-96f6-2c70dfea98ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:17.966499 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b8da90-115c-4e5e-96f6-2c70dfea98ce None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:17.966775 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b8da90-115c-4e5e-96f6-2c70dfea98ce None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:17.967046 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b8da90-115c-4e5e-96f6-2c70dfea98ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:17.971677 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883deec3-3fa5-4a2d-8201-38cdabe69725 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:18.008826 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9036581e-b939-4e1c-89be-f4135f045622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:18.009910 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9036581e-b939-4e1c-89be-f4135f045622 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:18.010397 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9036581e-b939-4e1c-89be-f4135f045622 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:18.010926 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9036581e-b939-4e1c-89be-f4135f045622 None admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:18.011998 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9036581e-b939-4e1c-89be-f4135f045622 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:18.012516 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9036581e-b939-4e1c-89be-f4135f045622 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:18.014283 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9036581e-b939-4e1c-89be-f4135f045622 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:18.033788 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 265/527] 10.222.0.52 () {56 vars in 1148 bytes} [Sat May 14 20:50:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:18.035173 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9036581e-b939-4e1c-89be-f4135f045622 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:18.044617 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b8da90-115c-4e5e-96f6-2c70dfea98ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:18.046011 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b8da90-115c-4e5e-96f6-2c70dfea98ce None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:18.141458 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9036581e-b939-4e1c-89be-f4135f045622 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:18.148250 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 263/528] 10.222.0.52 () {58 vars in 1282 bytes} [Sat May 14 20:50:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 14 20:50:18.149244 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b8da90-115c-4e5e-96f6-2c70dfea98ce None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:18.177463 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1652b24-8bb2-4522-9ed7-99b1dd7ba91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:18.178535 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1652b24-8bb2-4522-9ed7-99b1dd7ba91d None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:18.179043 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1652b24-8bb2-4522-9ed7-99b1dd7ba91d None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:18.179555 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1652b24-8bb2-4522-9ed7-99b1dd7ba91d None admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:18.180616 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1652b24-8bb2-4522-9ed7-99b1dd7ba91d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:18.181132 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1652b24-8bb2-4522-9ed7-99b1dd7ba91d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:18.182968 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1652b24-8bb2-4522-9ed7-99b1dd7ba91d None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:18.204194 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 266/529] 10.222.0.52 () {56 vars in 1137 bytes} [Sat May 14 20:50:18 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:18.210007 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1652b24-8bb2-4522-9ed7-99b1dd7ba91d None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:18.249481 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b8da90-115c-4e5e-96f6-2c70dfea98ce None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:18.284664 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2059ae1e-d179-49a9-92c0-8714366fed50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:18.284998 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2059ae1e-d179-49a9-92c0-8714366fed50 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:18.285283 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2059ae1e-d179-49a9-92c0-8714366fed50 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:18.285559 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2059ae1e-d179-49a9-92c0-8714366fed50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:18.286371 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2059ae1e-d179-49a9-92c0-8714366fed50 None admin] RBAC: Adding query filter params (role.id=998d6a3451be42a89d4cff277851ad70, scope.project.id=0911a024287e430ea6ee015389f0c440, user.id=7b5cb86f190f4fcfb06d66cb8f14643f) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:18.286682 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2059ae1e-d179-49a9-92c0-8714366fed50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:18.288147 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2059ae1e-d179-49a9-92c0-8714366fed50 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:18.293916 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 264/530] 10.222.0.52 () {56 vars in 1374 bytes} [Sat May 14 20:50:18 2022] GET /identity/v3/role_assignments?user.id=7b5cb86f190f4fcfb06d66cb8f14643f&scope.project.id=0911a024287e430ea6ee015389f0c440&role.id=998d6a3451be42a89d4cff277851ad70 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:18.300800 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2059ae1e-d179-49a9-92c0-8714366fed50 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:18.319310 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1652b24-8bb2-4522-9ed7-99b1dd7ba91d None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:18.366359 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6cd12-37e9-4852-b294-d3666533d3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:18.367777 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6cd12-37e9-4852-b294-d3666533d3a2 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:18.368545 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6cd12-37e9-4852-b294-d3666533d3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:18.369023 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6cd12-37e9-4852-b294-d3666533d3a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:18.394404 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b6cd12-37e9-4852-b294-d3666533d3a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:18.397243 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b6cd12-37e9-4852-b294-d3666533d3a2 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:18.438614 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-b4b6cd12-37e9-4852-b294-d3666533d3a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:18.438614 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:18.438614 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:18.438614 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:18.438614 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:18.438614 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:18.438614 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:18.438614 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:18.438614 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:18.438614 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:18.438614 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:18.438614 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:18.438614 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:50:18.438614 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:50:18.438614 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:50:18.439585 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:50:18.439585 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:18.439585 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:18.439585 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:18.439585 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:18.439585 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:18.439585 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:18.439585 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:18.439585 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:50:18.439585 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:18.439585 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:18.439585 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:18.439585 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:18.439585 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:18.439585 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:18.439585 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:18.439585 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:18.441092 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 20:50:18.441092 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:50:18.441092 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:18.441092 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:18.444431 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 267/531] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:50:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:18.451501 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6cd12-37e9-4852-b294-d3666533d3a2 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:18.521971 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2059ae1e-d179-49a9-92c0-8714366fed50 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:18.560786 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6cd12-37e9-4852-b294-d3666533d3a2 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:18.592252 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3508bae-3a44-4807-9eba-64f9ae292512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:18.592912 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3508bae-3a44-4807-9eba-64f9ae292512 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:18.593195 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3508bae-3a44-4807-9eba-64f9ae292512 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:18.593470 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3508bae-3a44-4807-9eba-64f9ae292512 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:18.605359 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543802b2-e43c-446c-96f8-6bf344039133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:18.606174 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543802b2-e43c-446c-96f8-6bf344039133 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:18.606591 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543802b2-e43c-446c-96f8-6bf344039133 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:18.606965 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543802b2-e43c-446c-96f8-6bf344039133 None admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:18.607827 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543802b2-e43c-446c-96f8-6bf344039133 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:18.608232 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543802b2-e43c-446c-96f8-6bf344039133 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:18.609713 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543802b2-e43c-446c-96f8-6bf344039133 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:18.622702 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 268/532] 10.222.0.52 () {56 vars in 1109 bytes} [Sat May 14 20:50:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:18.629199 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543802b2-e43c-446c-96f8-6bf344039133 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:18.731158 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543802b2-e43c-446c-96f8-6bf344039133 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:18.733477 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3508bae-3a44-4807-9eba-64f9ae292512 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:18.735096 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3508bae-3a44-4807-9eba-64f9ae292512 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:18.784350 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f152db7-3d51-4f4d-8e38-40bdae66d0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:18.785557 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f152db7-3d51-4f4d-8e38-40bdae66d0f8 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:18.786268 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f152db7-3d51-4f4d-8e38-40bdae66d0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:18.787268 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f152db7-3d51-4f4d-8e38-40bdae66d0f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:18.798464 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f152db7-3d51-4f4d-8e38-40bdae66d0f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:18.800652 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f152db7-3d51-4f4d-8e38-40bdae66d0f8 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:18.823866 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-6f152db7-3d51-4f4d-8e38-40bdae66d0f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 14 20:50:18.823866 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:18.823866 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:18.823866 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:18.823866 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:18.823866 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:18.823866 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:18.823866 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:18.823866 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:18.823866 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:18.823866 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:18.823866 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:18.823866 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 14 20:50:18.823866 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_project(project_id) May 14 20:50:18.823866 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 14 20:50:18.824933 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 14 20:50:18.824933 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:18.824933 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:18.824933 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:18.824933 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:18.824933 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:18.824933 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:18.824933 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:18.824933 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:50:18.824933 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:18.824933 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:18.824933 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:18.824933 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:18.824933 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:18.824933 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:18.824933 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:18.824933 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:18.825993 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 14 20:50:18.825993 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 14 20:50:18.825993 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 20:50:18.825993 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 20:50:18.825993 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 20:50:18.825993 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 20:50:18.825993 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 14 20:50:18.825993 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:18.832034 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 269/533] 10.222.0.52 () {56 vars in 1111 bytes} [Sat May 14 20:50:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 20:50:18.845211 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f152db7-3d51-4f4d-8e38-40bdae66d0f8 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:18.882086 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 265/534] 10.222.0.52 () {58 vars in 1282 bytes} [Sat May 14 20:50:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 587 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 14 20:50:18.888055 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3508bae-3a44-4807-9eba-64f9ae292512 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:19.013978 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3508bae-3a44-4807-9eba-64f9ae292512 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:19.054190 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a13e000-c2f7-48d6-9228-69e72337ed02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:19.055221 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13e000-c2f7-48d6-9228-69e72337ed02 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:19.055681 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13e000-c2f7-48d6-9228-69e72337ed02 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:19.056201 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13e000-c2f7-48d6-9228-69e72337ed02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:19.068560 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a13e000-c2f7-48d6-9228-69e72337ed02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:19.070405 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a13e000-c2f7-48d6-9228-69e72337ed02 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:19.091766 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-3a13e000-c2f7-48d6-9228-69e72337ed02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:19.091766 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:19.091766 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:19.091766 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:19.091766 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:19.091766 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:19.091766 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:19.091766 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:19.091766 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:19.091766 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:19.091766 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:19.091766 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:19.091766 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:50:19.091766 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:50:19.091766 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:50:19.092842 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:50:19.092842 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:19.092842 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:19.092842 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:19.092842 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:19.092842 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:19.092842 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:19.092842 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:19.092842 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:50:19.092842 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:19.092842 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:19.092842 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:19.092842 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:19.092842 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:19.092842 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:19.092842 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:19.092842 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:19.093900 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 20:50:19.093900 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:50:19.093900 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:19.093900 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:19.095823 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 266/535] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:50:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 20:50:19.102177 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a13e000-c2f7-48d6-9228-69e72337ed02 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:19.111876 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f152db7-3d51-4f4d-8e38-40bdae66d0f8 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:19.191974 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f70f6d1-d28e-432f-ab72-5085140927b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:19.193308 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70f6d1-d28e-432f-ab72-5085140927b2 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:19.194042 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70f6d1-d28e-432f-ab72-5085140927b2 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:19.194473 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70f6d1-d28e-432f-ab72-5085140927b2 None admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:19.195612 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f70f6d1-d28e-432f-ab72-5085140927b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:19.196176 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f70f6d1-d28e-432f-ab72-5085140927b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:19.197955 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f70f6d1-d28e-432f-ab72-5085140927b2 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:19.211189 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 270/536] 10.222.0.52 () {56 vars in 1148 bytes} [Sat May 14 20:50:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:50:19.216738 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f70f6d1-d28e-432f-ab72-5085140927b2 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:19.329644 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a13e000-c2f7-48d6-9228-69e72337ed02 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:19.332836 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f70f6d1-d28e-432f-ab72-5085140927b2 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:19.370390 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb7e980-5473-4157-aaa8-200b6a48c498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:19.372032 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7e980-5473-4157-aaa8-200b6a48c498 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:19.372488 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7e980-5473-4157-aaa8-200b6a48c498 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:19.375706 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7e980-5473-4157-aaa8-200b6a48c498 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:19.375706 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb7e980-5473-4157-aaa8-200b6a48c498 None admin] RBAC: Adding query filter params (role.id=998d6a3451be42a89d4cff277851ad70, scope.project.id=0911a024287e430ea6ee015389f0c440, user.id=99ed32a6d699453bb7e088540e8fc980) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:19.375706 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb7e980-5473-4157-aaa8-200b6a48c498 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:19.375706 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb7e980-5473-4157-aaa8-200b6a48c498 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:19.383354 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 271/537] 10.222.0.52 () {56 vars in 1374 bytes} [Sat May 14 20:50:19 2022] GET /identity/v3/role_assignments?user.id=99ed32a6d699453bb7e088540e8fc980&scope.project.id=0911a024287e430ea6ee015389f0c440&role.id=998d6a3451be42a89d4cff277851ad70 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:50:19.429615 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda44cc4-1e64-4a0d-a501-c0c405075964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:19.430298 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda44cc4-1e64-4a0d-a501-c0c405075964 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:19.430581 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda44cc4-1e64-4a0d-a501-c0c405075964 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:19.430857 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda44cc4-1e64-4a0d-a501-c0c405075964 None admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:19.431612 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda44cc4-1e64-4a0d-a501-c0c405075964 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:19.431921 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda44cc4-1e64-4a0d-a501-c0c405075964 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:19.433303 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda44cc4-1e64-4a0d-a501-c0c405075964 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:19.455170 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 267/538] 10.222.0.52 () {56 vars in 1109 bytes} [Sat May 14 20:50:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:19.461877 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb7e980-5473-4157-aaa8-200b6a48c498 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:19.587422 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb7e980-5473-4157-aaa8-200b6a48c498 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:19.624042 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30beca35-9ee5-4e2a-9551-3ca41d26407f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:19.624833 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30beca35-9ee5-4e2a-9551-3ca41d26407f None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:19.625124 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30beca35-9ee5-4e2a-9551-3ca41d26407f None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:19.625403 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30beca35-9ee5-4e2a-9551-3ca41d26407f None admin] PATH_INFO: `/v3/projects/service` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:19.632568 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30beca35-9ee5-4e2a-9551-3ca41d26407f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:19.634149 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30beca35-9ee5-4e2a-9551-3ca41d26407f None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:19.649235 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-30beca35-9ee5-4e2a-9551-3ca41d26407f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 14 20:50:19.649235 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:19.649235 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:19.649235 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:19.649235 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:19.649235 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:19.649235 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:19.649235 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:19.649235 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:19.649235 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:19.649235 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:19.649235 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:19.649235 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 14 20:50:19.649235 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_project(project_id) May 14 20:50:19.649235 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 14 20:50:19.650147 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 14 20:50:19.650147 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:19.650147 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:19.650147 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:19.650147 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:19.650147 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:19.650147 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:19.650147 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:19.650147 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:50:19.650147 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:19.650147 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:19.650147 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:19.650147 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:19.650147 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:19.650147 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:19.650147 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:19.650147 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:19.650983 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 14 20:50:19.650983 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 14 20:50:19.650983 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 20:50:19.650983 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 20:50:19.650983 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 20:50:19.650983 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 20:50:19.650983 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 14 20:50:19.650983 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:19.650983 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 272/539] 10.222.0.52 () {56 vars in 1111 bytes} [Sat May 14 20:50:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:19.660652 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda44cc4-1e64-4a0d-a501-c0c405075964 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:19.790920 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda44cc4-1e64-4a0d-a501-c0c405075964 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:19.826245 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d150fe85-f320-4def-b958-b10ebb9175f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:19.827293 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d150fe85-f320-4def-b958-b10ebb9175f5 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:19.827821 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d150fe85-f320-4def-b958-b10ebb9175f5 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:19.828319 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d150fe85-f320-4def-b958-b10ebb9175f5 None admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:19.829291 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d150fe85-f320-4def-b958-b10ebb9175f5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:19.829797 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d150fe85-f320-4def-b958-b10ebb9175f5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:19.831993 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d150fe85-f320-4def-b958-b10ebb9175f5 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:19.845800 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 268/540] 10.222.0.52 () {56 vars in 1148 bytes} [Sat May 14 20:50:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:19.852044 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30beca35-9ee5-4e2a-9551-3ca41d26407f None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:19.985049 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30beca35-9ee5-4e2a-9551-3ca41d26407f None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:20.032017 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86ea960-805c-4c73-93ca-b31a4bade39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:20.033074 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ea960-805c-4c73-93ca-b31a4bade39f None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:20.033557 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ea960-805c-4c73-93ca-b31a4bade39f None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:20.034561 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ea960-805c-4c73-93ca-b31a4bade39f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:20.035744 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86ea960-805c-4c73-93ca-b31a4bade39f None admin] RBAC: Adding query filter params (role.id=998d6a3451be42a89d4cff277851ad70, scope.project.id=0911a024287e430ea6ee015389f0c440, user.id=198271d1c0d44cb58bace41a65f4b94c) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:20.036266 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86ea960-805c-4c73-93ca-b31a4bade39f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:20.038046 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86ea960-805c-4c73-93ca-b31a4bade39f None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:20.044330 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 273/541] 10.222.0.52 () {56 vars in 1374 bytes} [Sat May 14 20:50:19 2022] GET /identity/v3/role_assignments?user.id=198271d1c0d44cb58bace41a65f4b94c&scope.project.id=0911a024287e430ea6ee015389f0c440&role.id=998d6a3451be42a89d4cff277851ad70 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:20.285857 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e716661-369c-4476-bde4-ee1cc9ba3cc3 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:20.286836 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e716661-369c-4476-bde4-ee1cc9ba3cc3 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:20.287323 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e716661-369c-4476-bde4-ee1cc9ba3cc3 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:20.289228 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 269/542] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:50:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:50:20.294589 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59188c8-88fe-4c06-b08f-543a98eb466e None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:20.295417 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59188c8-88fe-4c06-b08f-543a98eb466e None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:20.295919 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59188c8-88fe-4c06-b08f-543a98eb466e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:20.320464 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-c59188c8-88fe-4c06-b08f-543a98eb466e None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:50:20.321985 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c59188c8-88fe-4c06-b08f-543a98eb466e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:50:20.340344 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec529444-d5b9-48de-b467-379e9fc502fd None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:20.340939 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec529444-d5b9-48de-b467-379e9fc502fd None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:20.341394 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec529444-d5b9-48de-b467-379e9fc502fd None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:20.343169 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 270/543] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:50:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 14 20:50:20.355319 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af62a8-3e07-4446-bc6b-0af518d14150 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:20.355956 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af62a8-3e07-4446-bc6b-0af518d14150 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:20.356426 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af62a8-3e07-4446-bc6b-0af518d14150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:20.382131 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-a2af62a8-3e07-4446-bc6b-0af518d14150 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:50:20.383300 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-a2af62a8-3e07-4446-bc6b-0af518d14150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:50:20.421456 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 274/544] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:50:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 20:50:20.466065 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59188c8-88fe-4c06-b08f-543a98eb466e None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:20.472770 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 271/545] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:50:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 20:50:20.493969 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2af62a8-3e07-4446-bc6b-0af518d14150 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:20.601430 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59188c8-88fe-4c06-b08f-543a98eb466e None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:20.633171 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2af62a8-3e07-4446-bc6b-0af518d14150 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:20.651767 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d33d4e-7aa4-4e45-9209-f54bd890fded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:20.652625 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d33d4e-7aa4-4e45-9209-f54bd890fded None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:20.652907 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d33d4e-7aa4-4e45-9209-f54bd890fded None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:20.653175 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d33d4e-7aa4-4e45-9209-f54bd890fded None admin] PATH_INFO: `/v3/roles/service` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:20.672668 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d33d4e-7aa4-4e45-9209-f54bd890fded None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:50:20.680604 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-b2d33d4e-7aa4-4e45-9209-f54bd890fded None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 14 20:50:20.680604 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:20.680604 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:20.680604 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:20.680604 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:20.680604 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:20.680604 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:20.680604 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:20.680604 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:20.680604 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:20.680604 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:20.680604 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:20.680604 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:50:20.680604 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:50:20.680604 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:50:20.680604 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:50:20.681510 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:50:20.681510 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:50:20.681510 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:50:20.681510 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:50:20.681510 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:20.681510 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:20.681510 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:20.681510 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:20.681510 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:20.681510 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:20.681510 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:20.681510 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:50:20.681510 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:20.681510 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:20.681510 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:20.681510 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:20.682568 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:20.682568 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:20.682568 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:20.682568 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:20.682568 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:50:20.682568 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:50:20.682568 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:50:20.682568 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:50:20.682568 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:50:20.682568 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:50:20.682568 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 14 20:50:20.682568 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:20.682568 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 275/546] 10.222.0.52 () {56 vars in 1102 bytes} [Sat May 14 20:50:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 20:50:20.687391 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d33d4e-7aa4-4e45-9209-f54bd890fded None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:20.712221 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3db1e32-986a-4d0c-a1a8-83e41d66a8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:20.713021 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db1e32-986a-4d0c-a1a8-83e41d66a8e9 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:20.713298 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db1e32-986a-4d0c-a1a8-83e41d66a8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:20.713761 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db1e32-986a-4d0c-a1a8-83e41d66a8e9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:20.735498 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3db1e32-986a-4d0c-a1a8-83e41d66a8e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:50:20.748069 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-b3db1e32-986a-4d0c-a1a8-83e41d66a8e9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 14 20:50:20.748069 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:20.748069 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:20.748069 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:20.748069 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:20.748069 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:20.748069 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:20.748069 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:20.748069 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:20.748069 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:20.748069 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:20.748069 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:20.748069 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:50:20.748069 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:50:20.748069 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:50:20.748069 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:50:20.750290 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:50:20.750290 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:50:20.750290 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:50:20.750290 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:50:20.750290 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:20.750290 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:20.750290 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:20.750290 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:20.750290 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:20.750290 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:20.750290 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:20.750290 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:50:20.750290 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:20.750290 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:20.750290 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:20.750290 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:20.752886 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:20.752886 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:20.752886 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:20.752886 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:20.752886 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:50:20.752886 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:50:20.752886 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:50:20.752886 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:50:20.752886 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:50:20.752886 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:50:20.752886 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 14 20:50:20.752886 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:20.757896 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 272/547] 10.222.0.52 () {56 vars in 1102 bytes} [Sat May 14 20:50:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 20:50:20.763005 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3db1e32-986a-4d0c-a1a8-83e41d66a8e9 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:20.888514 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3db1e32-986a-4d0c-a1a8-83e41d66a8e9 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:20.905382 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d33d4e-7aa4-4e45-9209-f54bd890fded None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:20.932290 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7569994-0cce-4c72-a26a-9cbb40cc2bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:20.933222 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7569994-0cce-4c72-a26a-9cbb40cc2bee None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:20.933614 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7569994-0cce-4c72-a26a-9cbb40cc2bee None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:20.933995 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7569994-0cce-4c72-a26a-9cbb40cc2bee None admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:20.934856 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7569994-0cce-4c72-a26a-9cbb40cc2bee None admin] RBAC: Adding query filter params (name=service) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:20.935429 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7569994-0cce-4c72-a26a-9cbb40cc2bee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:20.937352 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7569994-0cce-4c72-a26a-9cbb40cc2bee None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:20.947451 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 273/548] 10.222.0.52 () {56 vars in 1103 bytes} [Sat May 14 20:50:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:20.958382 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7569994-0cce-4c72-a26a-9cbb40cc2bee None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:20.989683 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba544b0f-9aa8-41b9-ac3d-c86bc4af8008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:20.990706 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba544b0f-9aa8-41b9-ac3d-c86bc4af8008 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:20.991138 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba544b0f-9aa8-41b9-ac3d-c86bc4af8008 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:20.991635 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba544b0f-9aa8-41b9-ac3d-c86bc4af8008 None admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:20.992666 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba544b0f-9aa8-41b9-ac3d-c86bc4af8008 None admin] RBAC: Adding query filter params (name=service) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:20.994342 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba544b0f-9aa8-41b9-ac3d-c86bc4af8008 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:20.997296 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba544b0f-9aa8-41b9-ac3d-c86bc4af8008 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:21.015516 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 276/549] 10.222.0.52 () {56 vars in 1103 bytes} [Sat May 14 20:50:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:21.019489 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba544b0f-9aa8-41b9-ac3d-c86bc4af8008 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:21.149958 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba544b0f-9aa8-41b9-ac3d-c86bc4af8008 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:21.197415 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7569994-0cce-4c72-a26a-9cbb40cc2bee None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:21.204183 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51116be3-72b2-416c-bf07-f620eba957f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:21.205089 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51116be3-72b2-416c-bf07-f620eba957f6 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:21.205277 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51116be3-72b2-416c-bf07-f620eba957f6 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:21.205598 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51116be3-72b2-416c-bf07-f620eba957f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:21.217382 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51116be3-72b2-416c-bf07-f620eba957f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:21.218839 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51116be3-72b2-416c-bf07-f620eba957f6 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:21.239495 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb81e6-d3b7-49f5-93e8-bd6794501ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:21.240844 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb81e6-d3b7-49f5-93e8-bd6794501ed6 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:21.241128 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb81e6-d3b7-49f5-93e8-bd6794501ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:21.241404 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb81e6-d3b7-49f5-93e8-bd6794501ed6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:21.256254 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-51116be3-72b2-416c-bf07-f620eba957f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:21.256254 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:21.256254 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:21.256254 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:21.256254 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:21.256254 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:21.256254 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:21.256254 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:21.256254 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:21.256254 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:21.256254 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:21.256254 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:21.256254 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:50:21.256254 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:50:21.256254 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:50:21.257186 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:50:21.257186 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:21.257186 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:21.257186 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:21.257186 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:21.257186 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:21.257186 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:21.257186 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:21.257186 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:50:21.257186 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:21.257186 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:21.257186 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:21.257186 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:21.257186 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:21.257186 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:21.257186 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:21.257186 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:21.258065 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 20:50:21.258065 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:50:21.258065 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:21.258065 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:21.258065 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 277/550] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:50:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:21.263873 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51116be3-72b2-416c-bf07-f620eba957f6 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:21.267624 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cb81e6-d3b7-49f5-93e8-bd6794501ed6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:21.269358 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cb81e6-d3b7-49f5-93e8-bd6794501ed6 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:21.303737 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-64cb81e6-d3b7-49f5-93e8-bd6794501ed6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:21.303737 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:21.303737 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:21.303737 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:21.303737 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:21.303737 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:21.303737 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:21.303737 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:21.303737 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:21.303737 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:21.303737 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:21.303737 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:21.303737 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:50:21.303737 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:50:21.303737 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:50:21.305077 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:50:21.305077 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:21.305077 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:21.305077 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:21.305077 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:21.305077 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:21.305077 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:21.305077 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:21.305077 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:50:21.305077 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:21.305077 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:21.305077 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:21.305077 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:21.305077 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:21.305077 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:21.305077 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:21.305077 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:21.305918 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 20:50:21.305918 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:50:21.305918 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:21.305918 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:21.306429 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 274/551] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:50:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 20:50:21.312495 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb81e6-d3b7-49f5-93e8-bd6794501ed6 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:21.400803 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51116be3-72b2-416c-bf07-f620eba957f6 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:21.446607 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192fbbee-f00e-400f-8ff4-883920e1c045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:21.447698 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192fbbee-f00e-400f-8ff4-883920e1c045 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:21.448149 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192fbbee-f00e-400f-8ff4-883920e1c045 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:21.448736 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192fbbee-f00e-400f-8ff4-883920e1c045 None admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:21.449999 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192fbbee-f00e-400f-8ff4-883920e1c045 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:21.450459 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192fbbee-f00e-400f-8ff4-883920e1c045 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:21.452429 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192fbbee-f00e-400f-8ff4-883920e1c045 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:21.468877 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 278/552] 10.222.0.52 () {56 vars in 1109 bytes} [Sat May 14 20:50:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:21.469797 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb81e6-d3b7-49f5-93e8-bd6794501ed6 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:21.470738 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea3796-186c-4080-903b-736b138b4cda None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:21.471262 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea3796-186c-4080-903b-736b138b4cda None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:21.471928 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea3796-186c-4080-903b-736b138b4cda None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:21.473467 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 279/553] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:50:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:50:21.474380 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea3796-186c-4080-903b-736b138b4cda None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:21.511382 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47965b37-b80a-4431-b1af-92b59da07d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:21.512164 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47965b37-b80a-4431-b1af-92b59da07d59 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:21.512518 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47965b37-b80a-4431-b1af-92b59da07d59 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:21.512861 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47965b37-b80a-4431-b1af-92b59da07d59 None admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:21.513644 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47965b37-b80a-4431-b1af-92b59da07d59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:21.514181 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47965b37-b80a-4431-b1af-92b59da07d59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:21.516392 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47965b37-b80a-4431-b1af-92b59da07d59 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:21.536921 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 275/554] 10.222.0.52 () {56 vars in 1109 bytes} [Sat May 14 20:50:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:21.536921 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5b1a8-2c96-4a53-84b2-221b9a1374a7 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:21.537179 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5b1a8-2c96-4a53-84b2-221b9a1374a7 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:21.537846 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5b1a8-2c96-4a53-84b2-221b9a1374a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:21.557429 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-c3f5b1a8-2c96-4a53-84b2-221b9a1374a7 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:50:21.558587 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c3f5b1a8-2c96-4a53-84b2-221b9a1374a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:50:21.598496 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea3796-186c-4080-903b-736b138b4cda None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:21.631619 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 276/555] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:50:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 20:50:21.632515 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f5b1a8-2c96-4a53-84b2-221b9a1374a7 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:21.639131 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32761980-0a6b-444c-81a9-a70024529b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:21.640978 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32761980-0a6b-444c-81a9-a70024529b04 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:21.641487 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32761980-0a6b-444c-81a9-a70024529b04 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:21.641964 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32761980-0a6b-444c-81a9-a70024529b04 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:21.649996 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32761980-0a6b-444c-81a9-a70024529b04 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:21.651766 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32761980-0a6b-444c-81a9-a70024529b04 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:21.671183 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-32761980-0a6b-444c-81a9-a70024529b04 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 14 20:50:21.671183 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:21.671183 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:21.671183 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:21.671183 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:21.671183 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:21.671183 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:21.671183 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:21.671183 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:21.671183 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:21.671183 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:21.671183 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:21.671183 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 14 20:50:21.671183 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_user(user_id) May 14 20:50:21.671183 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 14 20:50:21.671183 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 14 20:50:21.672174 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:21.672174 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:21.672174 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 20:50:21.672174 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 20:50:21.672174 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 14 20:50:21.672174 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 20:50:21.672174 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:21.672174 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:21.672174 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:21.672174 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:21.672174 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:21.672174 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:50:21.672174 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:21.672174 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:21.672174 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:21.672174 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:21.672174 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:21.672174 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:21.673064 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:21.673064 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:21.673064 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 14 20:50:21.673064 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 14 20:50:21.673064 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 14 20:50:21.673064 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 14 20:50:21.673064 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 14 20:50:21.673064 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 14 20:50:21.673064 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 14 20:50:21.673064 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:21.675775 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 280/556] 10.222.0.52 () {56 vars in 1096 bytes} [Sat May 14 20:50:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:21.676815 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32761980-0a6b-444c-81a9-a70024529b04 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:21.774126 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f5b1a8-2c96-4a53-84b2-221b9a1374a7 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:21.784312 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32761980-0a6b-444c-81a9-a70024529b04 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:21.818110 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f86918c-2fa5-4461-b2b6-beb05fba4d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:21.819425 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86918c-2fa5-4461-b2b6-beb05fba4d11 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:21.819900 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86918c-2fa5-4461-b2b6-beb05fba4d11 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:21.820198 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e5a290-d8c2-4154-8866-86f2cb5eccfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:21.820581 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86918c-2fa5-4461-b2b6-beb05fba4d11 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:21.821110 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e5a290-d8c2-4154-8866-86f2cb5eccfa None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:21.821479 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e5a290-d8c2-4154-8866-86f2cb5eccfa None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:21.821832 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e5a290-d8c2-4154-8866-86f2cb5eccfa None admin] PATH_INFO: `/v3/roles/service` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:21.829933 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f86918c-2fa5-4461-b2b6-beb05fba4d11 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:21.832563 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f86918c-2fa5-4461-b2b6-beb05fba4d11 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:21.833289 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e5a290-d8c2-4154-8866-86f2cb5eccfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:50:21.841155 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-65e5a290-d8c2-4154-8866-86f2cb5eccfa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 14 20:50:21.841155 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:21.841155 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:21.841155 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:21.841155 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:21.841155 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:21.841155 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:21.841155 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:21.841155 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:21.841155 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:21.841155 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:21.841155 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:21.841155 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:50:21.841155 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:50:21.841155 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:50:21.841155 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:50:21.842255 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:50:21.842255 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:50:21.842255 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:50:21.842255 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:50:21.842255 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:21.842255 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:21.842255 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:21.842255 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:21.842255 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:21.842255 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:21.842255 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:21.842255 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:50:21.842255 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:21.842255 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:21.842255 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:21.842255 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:21.843227 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:21.843227 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:21.843227 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:21.843227 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:21.843227 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:50:21.843227 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:50:21.843227 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:50:21.843227 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:50:21.843227 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:50:21.843227 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:50:21.843227 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 14 20:50:21.843227 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:21.850279 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 281/557] 10.222.0.52 () {56 vars in 1102 bytes} [Sat May 14 20:50:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:21.851193 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e5a290-d8c2-4154-8866-86f2cb5eccfa None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:21.852880 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-2f86918c-2fa5-4461-b2b6-beb05fba4d11 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 14 20:50:21.852880 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:21.852880 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:21.852880 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:21.852880 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:21.852880 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:21.852880 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:21.852880 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:21.852880 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:21.852880 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:21.852880 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:21.852880 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:21.852880 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 14 20:50:21.852880 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_user(user_id) May 14 20:50:21.852880 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 14 20:50:21.852880 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 14 20:50:21.853750 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:21.853750 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:21.853750 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 20:50:21.853750 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 20:50:21.853750 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 14 20:50:21.853750 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 20:50:21.853750 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:21.853750 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:21.853750 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:21.853750 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:21.853750 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:21.853750 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:50:21.853750 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:21.853750 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:21.853750 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:21.853750 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:21.853750 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:21.853750 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:21.854636 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:21.854636 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:21.854636 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 14 20:50:21.854636 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 14 20:50:21.854636 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 14 20:50:21.854636 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 14 20:50:21.854636 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 14 20:50:21.854636 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 14 20:50:21.854636 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 14 20:50:21.854636 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:21.862115 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 277/558] 10.222.0.52 () {56 vars in 1093 bytes} [Sat May 14 20:50:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:21.863661 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f86918c-2fa5-4461-b2b6-beb05fba4d11 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:21.972779 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e5a290-d8c2-4154-8866-86f2cb5eccfa None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:21.984024 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f86918c-2fa5-4461-b2b6-beb05fba4d11 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:22.009611 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9997a1e5-1d72-41a1-93f9-0e3ba79d543e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:22.010442 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997a1e5-1d72-41a1-93f9-0e3ba79d543e None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:22.010826 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997a1e5-1d72-41a1-93f9-0e3ba79d543e None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:22.011454 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997a1e5-1d72-41a1-93f9-0e3ba79d543e None admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:22.012176 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9997a1e5-1d72-41a1-93f9-0e3ba79d543e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:22.012592 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9997a1e5-1d72-41a1-93f9-0e3ba79d543e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:22.014148 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9997a1e5-1d72-41a1-93f9-0e3ba79d543e None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:22.028531 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73a1dc9-0afa-4cbc-b4f5-f3bd37eb350b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:22.030322 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a1dc9-0afa-4cbc-b4f5-f3bd37eb350b None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:22.031111 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a1dc9-0afa-4cbc-b4f5-f3bd37eb350b None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:22.031562 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a1dc9-0afa-4cbc-b4f5-f3bd37eb350b None admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:22.032442 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73a1dc9-0afa-4cbc-b4f5-f3bd37eb350b None admin] RBAC: Adding query filter params (name=service) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:22.032887 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73a1dc9-0afa-4cbc-b4f5-f3bd37eb350b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:22.034606 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73a1dc9-0afa-4cbc-b4f5-f3bd37eb350b None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:22.038154 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 282/559] 10.222.0.52 () {56 vars in 1135 bytes} [Sat May 14 20:50:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:22.039162 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9997a1e5-1d72-41a1-93f9-0e3ba79d543e None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:22.045548 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 278/560] 10.222.0.52 () {56 vars in 1103 bytes} [Sat May 14 20:50:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:22.046648 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73a1dc9-0afa-4cbc-b4f5-f3bd37eb350b None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:22.155410 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9997a1e5-1d72-41a1-93f9-0e3ba79d543e None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:22.170556 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73a1dc9-0afa-4cbc-b4f5-f3bd37eb350b None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:22.200119 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edce093a-ddfe-4e88-91e3-937e62a77a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:22.201235 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce093a-ddfe-4e88-91e3-937e62a77a40 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:22.202062 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce093a-ddfe-4e88-91e3-937e62a77a40 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:22.202624 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce093a-ddfe-4e88-91e3-937e62a77a40 None admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:22.203786 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edce093a-ddfe-4e88-91e3-937e62a77a40 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:22.207988 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edce093a-ddfe-4e88-91e3-937e62a77a40 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:22.207988 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edce093a-ddfe-4e88-91e3-937e62a77a40 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:22.214536 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277da9ea-3a02-478b-90e8-c441b0310fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:22.215221 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277da9ea-3a02-478b-90e8-c441b0310fc5 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:22.215765 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277da9ea-3a02-478b-90e8-c441b0310fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:22.216052 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277da9ea-3a02-478b-90e8-c441b0310fc5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:22.228637 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 283/561] 10.222.0.52 () {56 vars in 1133 bytes} [Sat May 14 20:50:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:22.229889 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edce093a-ddfe-4e88-91e3-937e62a77a40 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:22.296501 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277da9ea-3a02-478b-90e8-c441b0310fc5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:22.297951 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277da9ea-3a02-478b-90e8-c441b0310fc5 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:22.336913 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edce093a-ddfe-4e88-91e3-937e62a77a40 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:22.374816 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0fe6ef-136a-4035-b477-a77128964ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:22.376008 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0fe6ef-136a-4035-b477-a77128964ecd None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:22.376598 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0fe6ef-136a-4035-b477-a77128964ecd None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:22.377083 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0fe6ef-136a-4035-b477-a77128964ecd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:22.387996 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0fe6ef-136a-4035-b477-a77128964ecd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:22.389522 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0fe6ef-136a-4035-b477-a77128964ecd None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:22.401706 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 279/562] 10.222.0.52 () {58 vars in 1282 bytes} [Sat May 14 20:50:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 14 20:50:22.401706 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277da9ea-3a02-478b-90e8-c441b0310fc5 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:22.412742 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-6c0fe6ef-136a-4035-b477-a77128964ecd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:22.412742 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:22.412742 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:22.412742 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:22.412742 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:22.412742 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:22.412742 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:22.412742 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:22.412742 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:22.412742 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:22.412742 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:22.412742 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:22.412742 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:50:22.412742 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:50:22.412742 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:50:22.414127 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:50:22.414127 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:22.414127 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:22.414127 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:22.414127 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:22.414127 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:22.414127 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:22.414127 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:22.414127 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:50:22.414127 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:22.414127 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:22.414127 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:22.414127 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:22.414127 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:22.414127 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:22.414127 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:22.414127 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:22.415198 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 20:50:22.415198 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:50:22.415198 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:22.415198 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:22.418401 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 284/563] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:50:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:22.419886 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10bfa6c-5cab-4ed3-946b-6e8cb3f73719 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:22.420179 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10bfa6c-5cab-4ed3-946b-6e8cb3f73719 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:22.420465 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10bfa6c-5cab-4ed3-946b-6e8cb3f73719 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:22.421931 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 285/564] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:50:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:50:22.422704 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10bfa6c-5cab-4ed3-946b-6e8cb3f73719 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:22.514815 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277da9ea-3a02-478b-90e8-c441b0310fc5 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:22.541174 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10bfa6c-5cab-4ed3-946b-6e8cb3f73719 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:22.552406 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8109561c-7560-4d37-8072-ab5acff67c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:22.553388 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109561c-7560-4d37-8072-ab5acff67c87 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:22.553840 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109561c-7560-4d37-8072-ab5acff67c87 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:22.554278 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109561c-7560-4d37-8072-ab5acff67c87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:22.567244 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8109561c-7560-4d37-8072-ab5acff67c87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:22.569386 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8109561c-7560-4d37-8072-ab5acff67c87 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:22.574193 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcfffeb-7ea0-4416-870b-defcb4547355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:22.574973 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcfffeb-7ea0-4416-870b-defcb4547355 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:22.575254 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcfffeb-7ea0-4416-870b-defcb4547355 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:22.575549 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcfffeb-7ea0-4416-870b-defcb4547355 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:22.585922 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcfffeb-7ea0-4416-870b-defcb4547355 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:22.587352 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcfffeb-7ea0-4416-870b-defcb4547355 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:22.588421 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-8109561c-7560-4d37-8072-ab5acff67c87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:22.588421 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:22.588421 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:22.588421 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:22.588421 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:22.588421 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:22.588421 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:22.588421 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:22.588421 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:22.588421 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:22.588421 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:22.588421 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:22.588421 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:50:22.588421 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:50:22.588421 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:50:22.589489 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:50:22.589489 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:22.589489 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:22.589489 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:22.589489 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:22.589489 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:22.589489 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:22.589489 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:22.589489 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:50:22.589489 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:22.589489 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:22.589489 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:22.589489 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:22.589489 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:22.589489 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:22.589489 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:22.589489 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:22.590611 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 20:50:22.590611 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:50:22.590611 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:22.590611 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:22.592526 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 280/565] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:50:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:22.593459 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8109561c-7560-4d37-8072-ab5acff67c87 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:22.607231 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-7fcfffeb-7ea0-4416-870b-defcb4547355 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:22.607231 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:22.607231 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:22.607231 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:22.607231 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:22.607231 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:22.607231 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:22.607231 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:22.607231 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:22.607231 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:22.607231 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:22.607231 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:22.607231 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:50:22.607231 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:50:22.607231 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:50:22.608467 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:50:22.608467 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:22.608467 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:22.608467 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:22.608467 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:22.608467 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:22.608467 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:22.608467 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:22.608467 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:50:22.608467 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:22.608467 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:22.608467 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:22.608467 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:22.608467 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:22.608467 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:22.608467 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:22.608467 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:22.609571 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 20:50:22.609571 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:50:22.609571 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:22.609571 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:22.613091 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 286/566] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:50:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:22.614358 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2c4a5-73d9-46ca-81c5-b53f4c8898ec None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:22.614645 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2c4a5-73d9-46ca-81c5-b53f4c8898ec None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:22.614917 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2c4a5-73d9-46ca-81c5-b53f4c8898ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:22.631583 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-35a2c4a5-73d9-46ca-81c5-b53f4c8898ec None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:50:22.632746 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-35a2c4a5-73d9-46ca-81c5-b53f4c8898ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:50:22.696254 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 287/567] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:50:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 20:50:22.696929 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8109561c-7560-4d37-8072-ab5acff67c87 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:22.697129 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a2c4a5-73d9-46ca-81c5-b53f4c8898ec None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:22.731401 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1907947b-27cf-4acc-8471-53266a31ef1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:22.732085 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1907947b-27cf-4acc-8471-53266a31ef1f None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:22.732374 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1907947b-27cf-4acc-8471-53266a31ef1f None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:22.732648 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1907947b-27cf-4acc-8471-53266a31ef1f None admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:22.733364 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1907947b-27cf-4acc-8471-53266a31ef1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:22.733668 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1907947b-27cf-4acc-8471-53266a31ef1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:22.735034 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1907947b-27cf-4acc-8471-53266a31ef1f None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:22.750627 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 281/568] 10.222.0.52 () {56 vars in 1109 bytes} [Sat May 14 20:50:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:22.750627 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1907947b-27cf-4acc-8471-53266a31ef1f None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:22.801120 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a2c4a5-73d9-46ca-81c5-b53f4c8898ec None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:22.833235 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add05387-7a4e-4589-82ca-07113931790d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:22.833888 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add05387-7a4e-4589-82ca-07113931790d None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:22.834171 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add05387-7a4e-4589-82ca-07113931790d None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:22.834444 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add05387-7a4e-4589-82ca-07113931790d None admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:22.835149 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add05387-7a4e-4589-82ca-07113931790d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:22.835451 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add05387-7a4e-4589-82ca-07113931790d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:22.836856 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add05387-7a4e-4589-82ca-07113931790d None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:22.844216 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1907947b-27cf-4acc-8471-53266a31ef1f None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:22.849288 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 288/569] 10.222.0.52 () {56 vars in 1109 bytes} [Sat May 14 20:50:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:22.850346 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35dd1bb-4fa1-4522-9bf6-851f6931fa3c None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:22.850634 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35dd1bb-4fa1-4522-9bf6-851f6931fa3c None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:22.850910 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35dd1bb-4fa1-4522-9bf6-851f6931fa3c None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:22.852283 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 289/570] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:50:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:50:22.853923 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35dd1bb-4fa1-4522-9bf6-851f6931fa3c None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:22.877851 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255332f3-e423-407d-9bb2-c2fc5916fb35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:22.878511 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255332f3-e423-407d-9bb2-c2fc5916fb35 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:22.878798 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255332f3-e423-407d-9bb2-c2fc5916fb35 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:22.879079 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255332f3-e423-407d-9bb2-c2fc5916fb35 None admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:22.879829 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255332f3-e423-407d-9bb2-c2fc5916fb35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:22.880140 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255332f3-e423-407d-9bb2-c2fc5916fb35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:22.881503 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255332f3-e423-407d-9bb2-c2fc5916fb35 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:22.892730 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 282/571] 10.222.0.52 () {56 vars in 1109 bytes} [Sat May 14 20:50:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:22.894080 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255332f3-e423-407d-9bb2-c2fc5916fb35 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:22.955081 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35dd1bb-4fa1-4522-9bf6-851f6931fa3c None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:22.987340 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a25dd38-85a2-4db6-882d-e64d24ea36a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:22.988166 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a25dd38-85a2-4db6-882d-e64d24ea36a5 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:22.988438 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a25dd38-85a2-4db6-882d-e64d24ea36a5 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:22.988706 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a25dd38-85a2-4db6-882d-e64d24ea36a5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:22.988805 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255332f3-e423-407d-9bb2-c2fc5916fb35 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:22.998870 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a25dd38-85a2-4db6-882d-e64d24ea36a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:50:23.006763 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-4a25dd38-85a2-4db6-882d-e64d24ea36a5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 14 20:50:23.006763 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:23.006763 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:23.006763 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:23.006763 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:23.006763 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:23.006763 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:23.006763 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:23.006763 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:23.006763 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:23.006763 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:23.006763 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:23.006763 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:50:23.006763 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:50:23.006763 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:50:23.006763 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:50:23.007708 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:50:23.007708 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:50:23.007708 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:50:23.007708 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:50:23.007708 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:23.007708 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:23.007708 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:23.007708 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:23.007708 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:23.007708 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:23.007708 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:23.007708 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:50:23.007708 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:23.007708 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:23.007708 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:23.007708 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:23.009017 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:23.009017 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:23.009017 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:23.009017 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:23.009017 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:50:23.009017 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:50:23.009017 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:50:23.009017 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:50:23.009017 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:50:23.009017 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:50:23.009017 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 14 20:50:23.009017 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:23.009017 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 290/572] 10.222.0.52 () {56 vars in 1102 bytes} [Sat May 14 20:50:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:23.009017 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a25dd38-85a2-4db6-882d-e64d24ea36a5 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:23.021700 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a531629-420c-4d2c-9dc4-b7267ac53aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:23.022483 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a531629-420c-4d2c-9dc4-b7267ac53aee None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:23.022765 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a531629-420c-4d2c-9dc4-b7267ac53aee None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:23.023033 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a531629-420c-4d2c-9dc4-b7267ac53aee None admin] PATH_INFO: `/v3/users/glance` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:23.029842 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a531629-420c-4d2c-9dc4-b7267ac53aee None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:23.031258 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a531629-420c-4d2c-9dc4-b7267ac53aee None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:23.045546 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-7a531629-420c-4d2c-9dc4-b7267ac53aee None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 14 20:50:23.045546 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:23.045546 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:23.045546 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:23.045546 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:23.045546 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:23.045546 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:23.045546 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:23.045546 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:23.045546 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:23.045546 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:23.045546 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:23.045546 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 14 20:50:23.045546 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_user(user_id) May 14 20:50:23.045546 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 14 20:50:23.045546 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 14 20:50:23.046530 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:23.046530 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:23.046530 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 20:50:23.046530 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 20:50:23.046530 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 14 20:50:23.046530 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 20:50:23.046530 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:23.046530 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:23.046530 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:23.046530 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:23.046530 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:23.046530 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:50:23.046530 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:23.046530 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:23.046530 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:23.046530 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:23.046530 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:23.046530 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:23.047510 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:23.047510 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:23.047510 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 14 20:50:23.047510 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 14 20:50:23.047510 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 14 20:50:23.047510 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 14 20:50:23.047510 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 14 20:50:23.047510 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 14 20:50:23.047510 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 14 20:50:23.047510 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:23.047510 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 283/573] 10.222.0.52 () {56 vars in 1099 bytes} [Sat May 14 20:50:22 2022] GET /identity/v3/users/glance => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:23.048204 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d4f61-9869-43b9-88f3-bdf713b2f2f2 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:23.048204 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d4f61-9869-43b9-88f3-bdf713b2f2f2 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:23.048850 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d4f61-9869-43b9-88f3-bdf713b2f2f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:23.064653 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-f38d4f61-9869-43b9-88f3-bdf713b2f2f2 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:50:23.065888 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-f38d4f61-9869-43b9-88f3-bdf713b2f2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:50:23.107429 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a25dd38-85a2-4db6-882d-e64d24ea36a5 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:23.129711 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 284/574] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:50:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 20:50:23.130649 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38d4f61-9869-43b9-88f3-bdf713b2f2f2 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:23.139515 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836dca6c-7e3d-416b-a7f6-210b42d66cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:23.140302 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836dca6c-7e3d-416b-a7f6-210b42d66cd7 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:23.140582 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836dca6c-7e3d-416b-a7f6-210b42d66cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:23.140853 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836dca6c-7e3d-416b-a7f6-210b42d66cd7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:23.147463 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836dca6c-7e3d-416b-a7f6-210b42d66cd7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:23.148930 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836dca6c-7e3d-416b-a7f6-210b42d66cd7 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:23.163202 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-836dca6c-7e3d-416b-a7f6-210b42d66cd7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 14 20:50:23.163202 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:23.163202 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:23.163202 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:23.163202 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:23.163202 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:23.163202 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:23.163202 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:23.163202 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:23.163202 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:23.163202 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:23.163202 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:23.163202 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 14 20:50:23.163202 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_project(project_id) May 14 20:50:23.163202 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 14 20:50:23.164329 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 14 20:50:23.164329 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:23.164329 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:23.164329 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:23.164329 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:23.164329 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:23.164329 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:23.164329 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:23.164329 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:50:23.164329 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:23.164329 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:23.164329 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:23.164329 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:23.164329 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:23.164329 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:23.164329 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:23.164329 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:23.165277 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 14 20:50:23.165277 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 14 20:50:23.165277 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 20:50:23.165277 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 20:50:23.165277 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 20:50:23.165277 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 20:50:23.165277 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 14 20:50:23.165277 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:23.165277 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 291/575] 10.222.0.52 () {56 vars in 1111 bytes} [Sat May 14 20:50:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:23.165864 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836dca6c-7e3d-416b-a7f6-210b42d66cd7 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:23.234131 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38d4f61-9869-43b9-88f3-bdf713b2f2f2 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:23.259861 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836dca6c-7e3d-416b-a7f6-210b42d66cd7 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:23.266569 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a7558b-1668-41b8-a62e-e59f328deb8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:23.267351 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a7558b-1668-41b8-a62e-e59f328deb8d None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:23.267667 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a7558b-1668-41b8-a62e-e59f328deb8d None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:23.268519 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a7558b-1668-41b8-a62e-e59f328deb8d None admin] PATH_INFO: `/v3/projects/service` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:23.274969 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a7558b-1668-41b8-a62e-e59f328deb8d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:23.276443 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a7558b-1668-41b8-a62e-e59f328deb8d None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:23.292519 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66219f9f-1dbe-44d1-ac70-a7b0a20028e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:23.293174 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66219f9f-1dbe-44d1-ac70-a7b0a20028e7 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:23.293420 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-90a7558b-1668-41b8-a62e-e59f328deb8d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 14 20:50:23.293420 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:23.293420 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:23.293420 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:23.293420 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:23.293420 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:23.293420 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:23.293420 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:23.293420 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:23.293420 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:23.293420 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:23.293420 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:23.293420 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 14 20:50:23.293420 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_project(project_id) May 14 20:50:23.293420 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 14 20:50:23.294321 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 14 20:50:23.294321 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:23.294321 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:23.294321 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:23.294321 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:23.294321 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:23.294321 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:23.294321 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:23.294321 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:50:23.294321 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:23.294321 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:23.294321 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:23.294321 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:23.294321 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:23.294321 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:23.294321 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:23.294321 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:23.295460 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 14 20:50:23.295460 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 14 20:50:23.295460 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 20:50:23.295460 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 20:50:23.295460 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 20:50:23.295460 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 20:50:23.295460 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 14 20:50:23.295460 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:23.296085 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66219f9f-1dbe-44d1-ac70-a7b0a20028e7 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:23.296085 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66219f9f-1dbe-44d1-ac70-a7b0a20028e7 None admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:23.296085 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66219f9f-1dbe-44d1-ac70-a7b0a20028e7 None admin] RBAC: Adding query filter params (name=service) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:23.296085 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66219f9f-1dbe-44d1-ac70-a7b0a20028e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:23.296323 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 285/576] 10.222.0.52 () {56 vars in 1111 bytes} [Sat May 14 20:50:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:23.296323 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a7558b-1668-41b8-a62e-e59f328deb8d None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:23.296454 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66219f9f-1dbe-44d1-ac70-a7b0a20028e7 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:23.304416 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 292/577] 10.222.0.52 () {56 vars in 1103 bytes} [Sat May 14 20:50:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:23.305217 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66219f9f-1dbe-44d1-ac70-a7b0a20028e7 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:23.394281 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a7558b-1668-41b8-a62e-e59f328deb8d None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:23.400562 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66219f9f-1dbe-44d1-ac70-a7b0a20028e7 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:23.425572 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40c4ef1-2b6e-45eb-ac11-20c7f7e13ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:23.426220 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c4ef1-2b6e-45eb-ac11-20c7f7e13ff1 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:23.426496 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c4ef1-2b6e-45eb-ac11-20c7f7e13ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:23.426766 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c4ef1-2b6e-45eb-ac11-20c7f7e13ff1 None admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:23.427608 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40c4ef1-2b6e-45eb-ac11-20c7f7e13ff1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:23.427912 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40c4ef1-2b6e-45eb-ac11-20c7f7e13ff1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:23.429325 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40c4ef1-2b6e-45eb-ac11-20c7f7e13ff1 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:23.432766 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a44bb9-fde6-47fa-91d9-2fe15c9b1657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:23.433544 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a44bb9-fde6-47fa-91d9-2fe15c9b1657 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:23.433825 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a44bb9-fde6-47fa-91d9-2fe15c9b1657 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:23.434098 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a44bb9-fde6-47fa-91d9-2fe15c9b1657 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:23.444249 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a44bb9-fde6-47fa-91d9-2fe15c9b1657 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:50:23.445792 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 286/578] 10.222.0.52 () {56 vars in 1137 bytes} [Sat May 14 20:50:23 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:23.446578 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40c4ef1-2b6e-45eb-ac11-20c7f7e13ff1 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:23.452415 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-18a44bb9-fde6-47fa-91d9-2fe15c9b1657 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 14 20:50:23.452415 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:23.452415 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:23.452415 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:23.452415 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:23.452415 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:23.452415 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:23.452415 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:23.452415 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:23.452415 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:23.452415 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:23.452415 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:23.452415 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:50:23.452415 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:50:23.452415 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:50:23.452415 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:50:23.453497 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:50:23.453497 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:50:23.453497 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:50:23.453497 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:50:23.453497 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:23.453497 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:23.453497 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:23.453497 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:23.453497 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:23.453497 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:23.453497 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:23.453497 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:50:23.453497 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:23.453497 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:23.453497 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:23.453497 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:23.454700 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:23.454700 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:23.454700 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:23.454700 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:23.454700 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:50:23.454700 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:50:23.454700 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:50:23.454700 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:50:23.454700 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:50:23.454700 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:50:23.454700 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 14 20:50:23.454700 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:23.454700 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 293/579] 10.222.0.52 () {56 vars in 1102 bytes} [Sat May 14 20:50:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:23.454700 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a44bb9-fde6-47fa-91d9-2fe15c9b1657 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:23.544280 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40c4ef1-2b6e-45eb-ac11-20c7f7e13ff1 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:23.560287 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a44bb9-fde6-47fa-91d9-2fe15c9b1657 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:23.576418 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14bdb68-8425-4d24-adde-3492148f3376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:23.577067 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14bdb68-8425-4d24-adde-3492148f3376 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:23.577346 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14bdb68-8425-4d24-adde-3492148f3376 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:23.577621 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14bdb68-8425-4d24-adde-3492148f3376 None admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:23.578384 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14bdb68-8425-4d24-adde-3492148f3376 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:23.578689 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14bdb68-8425-4d24-adde-3492148f3376 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:23.580204 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14bdb68-8425-4d24-adde-3492148f3376 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:23.592074 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 287/580] 10.222.0.52 () {56 vars in 1148 bytes} [Sat May 14 20:50:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:23.592957 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14bdb68-8425-4d24-adde-3492148f3376 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:23.598805 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2382ba-61b1-4691-9812-4c7f17d1042b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:23.599466 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2382ba-61b1-4691-9812-4c7f17d1042b None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:23.599797 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2382ba-61b1-4691-9812-4c7f17d1042b None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:23.600072 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2382ba-61b1-4691-9812-4c7f17d1042b None admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:23.600848 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2382ba-61b1-4691-9812-4c7f17d1042b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:23.601157 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2382ba-61b1-4691-9812-4c7f17d1042b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:23.602584 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2382ba-61b1-4691-9812-4c7f17d1042b None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:23.614735 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 294/581] 10.222.0.52 () {56 vars in 1148 bytes} [Sat May 14 20:50:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:23.615647 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2382ba-61b1-4691-9812-4c7f17d1042b None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:23.689059 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14bdb68-8425-4d24-adde-3492148f3376 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:23.710328 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2382ba-61b1-4691-9812-4c7f17d1042b None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:23.722222 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47391fc-2220-48c7-b82d-d4b9bebf40fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:23.723012 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47391fc-2220-48c7-b82d-d4b9bebf40fd None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:23.723296 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47391fc-2220-48c7-b82d-d4b9bebf40fd None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:23.723602 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47391fc-2220-48c7-b82d-d4b9bebf40fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:23.733692 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47391fc-2220-48c7-b82d-d4b9bebf40fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:23.735131 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47391fc-2220-48c7-b82d-d4b9bebf40fd None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:23.744012 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd121e9d-2a71-4989-a49e-eb7f4f754dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:23.744920 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd121e9d-2a71-4989-a49e-eb7f4f754dd7 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:23.745200 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd121e9d-2a71-4989-a49e-eb7f4f754dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:23.745635 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd121e9d-2a71-4989-a49e-eb7f4f754dd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:23.751837 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-e47391fc-2220-48c7-b82d-d4b9bebf40fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:23.751837 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:23.751837 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:23.751837 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:23.751837 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:23.751837 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:23.751837 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:23.751837 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:23.751837 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:23.751837 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:23.751837 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:23.751837 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:23.751837 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:50:23.751837 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:50:23.751837 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:50:23.753884 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:50:23.753884 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:23.753884 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:23.753884 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:23.753884 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:23.753884 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:23.753884 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:23.753884 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:23.753884 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:50:23.753884 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:23.753884 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:23.753884 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:23.753884 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:23.753884 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:23.753884 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:23.753884 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:23.753884 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:23.754813 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 20:50:23.754813 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:50:23.754813 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:23.754813 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:23.754813 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 288/582] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:50:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:23.754813 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47391fc-2220-48c7-b82d-d4b9bebf40fd None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:23.757723 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd121e9d-2a71-4989-a49e-eb7f4f754dd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:23.759170 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd121e9d-2a71-4989-a49e-eb7f4f754dd7 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:23.776997 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-bd121e9d-2a71-4989-a49e-eb7f4f754dd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:23.776997 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:23.776997 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:23.776997 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:23.776997 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:23.776997 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:23.776997 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:23.776997 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:23.776997 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:23.776997 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:23.776997 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:23.776997 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:23.776997 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:50:23.776997 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:50:23.776997 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:50:23.777917 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:50:23.777917 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:23.777917 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:23.777917 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:23.777917 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:23.777917 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:23.777917 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:23.777917 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:23.777917 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:50:23.777917 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:23.777917 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:23.777917 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:23.777917 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:23.777917 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:23.777917 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:23.777917 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:23.777917 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:23.778809 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 20:50:23.778809 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:50:23.778809 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:23.778809 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:23.778809 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 295/583] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:50:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:23.779200 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd121e9d-2a71-4989-a49e-eb7f4f754dd7 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:23.856367 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47391fc-2220-48c7-b82d-d4b9bebf40fd None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:23.874762 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd121e9d-2a71-4989-a49e-eb7f4f754dd7 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:23.888535 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc46b8a4-3094-4915-aa1f-e8264f7f099a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:23.889275 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46b8a4-3094-4915-aa1f-e8264f7f099a None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:23.889562 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46b8a4-3094-4915-aa1f-e8264f7f099a None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:23.889840 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46b8a4-3094-4915-aa1f-e8264f7f099a None admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:23.890576 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc46b8a4-3094-4915-aa1f-e8264f7f099a None admin] RBAC: Adding query filter params (name=service) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:23.890883 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc46b8a4-3094-4915-aa1f-e8264f7f099a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:23.892276 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc46b8a4-3094-4915-aa1f-e8264f7f099a None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:23.900551 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 289/584] 10.222.0.52 () {56 vars in 1103 bytes} [Sat May 14 20:50:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:23.901331 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc46b8a4-3094-4915-aa1f-e8264f7f099a None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:23.911727 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a9172c-0665-4f28-975c-5759c768bede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:23.912618 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a9172c-0665-4f28-975c-5759c768bede None admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:23.912898 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a9172c-0665-4f28-975c-5759c768bede None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:23.913172 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a9172c-0665-4f28-975c-5759c768bede None admin] PATH_INFO: `/v3/projects/0911a024287e430ea6ee015389f0c440/users/0f1b0e2b025d4eceaa90e1616d0a9db8/roles/998d6a3451be42a89d4cff277851ad70` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:23.927764 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a9172c-0665-4f28-975c-5759c768bede None admin] RBAC: Authorizing `identity:create_grant(project_id=0911a024287e430ea6ee015389f0c440, user_id=0f1b0e2b025d4eceaa90e1616d0a9db8, role_id=998d6a3451be42a89d4cff277851ad70)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:23.929213 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a9172c-0665-4f28-975c-5759c768bede None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:23.981926 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 296/585] 10.222.0.52 () {58 vars in 1439 bytes} [Sat May 14 20:50:23 2022] PUT /identity/v3/projects/0911a024287e430ea6ee015389f0c440/users/0f1b0e2b025d4eceaa90e1616d0a9db8/roles/998d6a3451be42a89d4cff277851ad70 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 20:50:23.982693 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a9172c-0665-4f28-975c-5759c768bede None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:23.998928 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc46b8a4-3094-4915-aa1f-e8264f7f099a None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:24.036429 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb37ccc9-887d-4c30-9e75-14476a74c22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:24.037089 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37ccc9-887d-4c30-9e75-14476a74c22b None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:24.037375 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37ccc9-887d-4c30-9e75-14476a74c22b None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:24.037654 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37ccc9-887d-4c30-9e75-14476a74c22b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:24.038496 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb37ccc9-887d-4c30-9e75-14476a74c22b None admin] RBAC: Adding query filter params (role.id=998d6a3451be42a89d4cff277851ad70, scope.project.id=0911a024287e430ea6ee015389f0c440, user.id=c781fe7f4a014f0d8b5e7385b20b348c) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:24.038811 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb37ccc9-887d-4c30-9e75-14476a74c22b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:24.040331 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb37ccc9-887d-4c30-9e75-14476a74c22b None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:24.055518 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 290/586] 10.222.0.52 () {56 vars in 1374 bytes} [Sat May 14 20:50:23 2022] GET /identity/v3/role_assignments?user.id=c781fe7f4a014f0d8b5e7385b20b348c&scope.project.id=0911a024287e430ea6ee015389f0c440&role.id=998d6a3451be42a89d4cff277851ad70 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:24.055518 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb37ccc9-887d-4c30-9e75-14476a74c22b None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:24.099711 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a9172c-0665-4f28-975c-5759c768bede None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:24.168226 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53fae7b-46de-45cc-8c7c-d78c81a8ec92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:24.168915 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53fae7b-46de-45cc-8c7c-d78c81a8ec92 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:24.169263 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53fae7b-46de-45cc-8c7c-d78c81a8ec92 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:24.169544 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53fae7b-46de-45cc-8c7c-d78c81a8ec92 None admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:24.170366 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53fae7b-46de-45cc-8c7c-d78c81a8ec92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:24.170730 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53fae7b-46de-45cc-8c7c-d78c81a8ec92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:24.172230 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53fae7b-46de-45cc-8c7c-d78c81a8ec92 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:24.174261 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb37ccc9-887d-4c30-9e75-14476a74c22b None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:24.186953 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 297/587] 10.222.0.52 () {56 vars in 1109 bytes} [Sat May 14 20:50:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:24.187909 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53fae7b-46de-45cc-8c7c-d78c81a8ec92 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:24.213181 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47759987-68eb-4488-95d5-6b47ce982adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:24.213878 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47759987-68eb-4488-95d5-6b47ce982adf None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:24.214161 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47759987-68eb-4488-95d5-6b47ce982adf None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:24.214431 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47759987-68eb-4488-95d5-6b47ce982adf None admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:24.215153 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47759987-68eb-4488-95d5-6b47ce982adf None admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:24.215913 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47759987-68eb-4488-95d5-6b47ce982adf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:24.219666 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47759987-68eb-4488-95d5-6b47ce982adf None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:24.230130 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 291/588] 10.222.0.52 () {56 vars in 1109 bytes} [Sat May 14 20:50:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:24.231005 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47759987-68eb-4488-95d5-6b47ce982adf None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:24.309713 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53fae7b-46de-45cc-8c7c-d78c81a8ec92 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:24.335072 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47759987-68eb-4488-95d5-6b47ce982adf None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:24.343791 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8de424a-68a8-4ef1-9a36-2357f2f2711d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:24.344676 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de424a-68a8-4ef1-9a36-2357f2f2711d None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:24.345030 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de424a-68a8-4ef1-9a36-2357f2f2711d None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:24.345377 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de424a-68a8-4ef1-9a36-2357f2f2711d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:24.356492 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8de424a-68a8-4ef1-9a36-2357f2f2711d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:24.358107 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8de424a-68a8-4ef1-9a36-2357f2f2711d None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:24.373128 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83209a8-2c9c-4e13-9131-20c39f37f873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:24.374062 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83209a8-2c9c-4e13-9131-20c39f37f873 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:24.374421 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83209a8-2c9c-4e13-9131-20c39f37f873 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:24.374774 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83209a8-2c9c-4e13-9131-20c39f37f873 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:24.376469 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-d8de424a-68a8-4ef1-9a36-2357f2f2711d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:24.376469 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:24.376469 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:24.376469 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:24.376469 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:24.376469 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:24.376469 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:24.376469 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:24.376469 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:24.376469 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:24.376469 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:24.376469 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:24.376469 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:50:24.376469 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:50:24.376469 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:50:24.377885 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:50:24.377885 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:24.377885 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:24.377885 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:24.377885 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:24.377885 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:24.377885 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:24.377885 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:24.377885 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:50:24.377885 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:24.377885 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:24.377885 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:24.377885 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:24.377885 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:24.377885 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:24.377885 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:24.377885 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:24.379334 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 20:50:24.379334 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:50:24.379334 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:24.379334 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:24.379334 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 298/589] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:50:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:24.379918 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8de424a-68a8-4ef1-9a36-2357f2f2711d None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:24.387987 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83209a8-2c9c-4e13-9131-20c39f37f873 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:24.390088 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83209a8-2c9c-4e13-9131-20c39f37f873 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:24.412077 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-a83209a8-2c9c-4e13-9131-20c39f37f873 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 14 20:50:24.412077 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:24.412077 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:24.412077 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:24.412077 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:24.412077 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:24.412077 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:24.412077 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:24.412077 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:24.412077 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:24.412077 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:24.412077 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:24.412077 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 14 20:50:24.412077 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_user(user_id) May 14 20:50:24.412077 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 14 20:50:24.412077 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 14 20:50:24.414649 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:24.414649 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:24.414649 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 20:50:24.414649 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 20:50:24.414649 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 14 20:50:24.414649 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 20:50:24.414649 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:24.414649 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:24.414649 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:24.414649 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:24.414649 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:24.414649 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:50:24.414649 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:24.414649 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:24.414649 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:24.414649 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:24.414649 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:24.414649 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:24.416954 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:24.416954 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:24.416954 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 14 20:50:24.416954 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 14 20:50:24.416954 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 14 20:50:24.416954 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 14 20:50:24.416954 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 14 20:50:24.416954 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 14 20:50:24.416954 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 14 20:50:24.416954 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:24.416954 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 292/590] 10.222.0.52 () {56 vars in 1102 bytes} [Sat May 14 20:50:24 2022] GET /identity/v3/users/neutron => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:24.416954 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83209a8-2c9c-4e13-9131-20c39f37f873 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:24.487684 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8de424a-68a8-4ef1-9a36-2357f2f2711d None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:24.524501 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150226d9-ccb7-47cc-99b7-4fc8ca99d065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:24.525753 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150226d9-ccb7-47cc-99b7-4fc8ca99d065 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:24.526047 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150226d9-ccb7-47cc-99b7-4fc8ca99d065 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:24.526331 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150226d9-ccb7-47cc-99b7-4fc8ca99d065 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:24.536274 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150226d9-ccb7-47cc-99b7-4fc8ca99d065 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:24.538216 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150226d9-ccb7-47cc-99b7-4fc8ca99d065 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:24.541304 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83209a8-2c9c-4e13-9131-20c39f37f873 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:24.556612 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-150226d9-ccb7-47cc-99b7-4fc8ca99d065 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 14 20:50:24.556612 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:24.556612 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:24.556612 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:24.556612 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:24.556612 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:24.556612 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:24.556612 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:24.556612 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:24.556612 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:24.556612 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:24.556612 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:24.556612 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 14 20:50:24.556612 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_project(project_id) May 14 20:50:24.556612 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 14 20:50:24.558721 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 14 20:50:24.558721 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:24.558721 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:24.558721 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:24.558721 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:24.558721 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:24.558721 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:24.558721 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:24.558721 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:50:24.558721 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:24.558721 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:24.558721 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:24.558721 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:24.558721 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:24.558721 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:24.558721 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:24.558721 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:24.560920 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 14 20:50:24.560920 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 14 20:50:24.560920 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 20:50:24.560920 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 20:50:24.560920 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 20:50:24.560920 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 20:50:24.560920 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 14 20:50:24.560920 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:24.560920 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 299/591] 10.222.0.52 () {56 vars in 1111 bytes} [Sat May 14 20:50:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:24.560920 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150226d9-ccb7-47cc-99b7-4fc8ca99d065 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:24.580627 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53586bc-5f35-4ee6-9bfb-77b72cee2701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:24.581298 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53586bc-5f35-4ee6-9bfb-77b72cee2701 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:24.581583 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53586bc-5f35-4ee6-9bfb-77b72cee2701 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:24.581861 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53586bc-5f35-4ee6-9bfb-77b72cee2701 None admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:24.582587 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53586bc-5f35-4ee6-9bfb-77b72cee2701 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:24.582894 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53586bc-5f35-4ee6-9bfb-77b72cee2701 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:24.584367 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53586bc-5f35-4ee6-9bfb-77b72cee2701 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:24.598917 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 293/592] 10.222.0.52 () {56 vars in 1109 bytes} [Sat May 14 20:50:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:24.599897 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53586bc-5f35-4ee6-9bfb-77b72cee2701 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:24.685024 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150226d9-ccb7-47cc-99b7-4fc8ca99d065 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:24.709886 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53586bc-5f35-4ee6-9bfb-77b72cee2701 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:24.728785 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963db158-6cd1-42b6-9256-20fe7118351f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:24.729456 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963db158-6cd1-42b6-9256-20fe7118351f None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:24.729744 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963db158-6cd1-42b6-9256-20fe7118351f None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:24.730024 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963db158-6cd1-42b6-9256-20fe7118351f None admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:24.731281 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963db158-6cd1-42b6-9256-20fe7118351f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:24.731630 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963db158-6cd1-42b6-9256-20fe7118351f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:24.733549 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963db158-6cd1-42b6-9256-20fe7118351f None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:24.745346 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c237bcfd-3ca4-4f53-a5f0-b8fe853b5796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:24.746009 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c237bcfd-3ca4-4f53-a5f0-b8fe853b5796 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:24.746564 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c237bcfd-3ca4-4f53-a5f0-b8fe853b5796 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:24.746843 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c237bcfd-3ca4-4f53-a5f0-b8fe853b5796 None admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:24.747801 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c237bcfd-3ca4-4f53-a5f0-b8fe853b5796 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:24.748181 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c237bcfd-3ca4-4f53-a5f0-b8fe853b5796 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:24.749616 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c237bcfd-3ca4-4f53-a5f0-b8fe853b5796 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:24.759574 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 300/593] 10.222.0.52 () {56 vars in 1139 bytes} [Sat May 14 20:50:24 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:24.760609 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963db158-6cd1-42b6-9256-20fe7118351f None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:24.771573 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 294/594] 10.222.0.52 () {56 vars in 1148 bytes} [Sat May 14 20:50:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:24.772488 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c237bcfd-3ca4-4f53-a5f0-b8fe853b5796 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:24.882014 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c237bcfd-3ca4-4f53-a5f0-b8fe853b5796 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:24.886037 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963db158-6cd1-42b6-9256-20fe7118351f None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:24.927585 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53bb8b0-9211-4afe-b097-c26ba48fe4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:24.928391 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53bb8b0-9211-4afe-b097-c26ba48fe4a7 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:24.929185 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53bb8b0-9211-4afe-b097-c26ba48fe4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:24.929185 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53bb8b0-9211-4afe-b097-c26ba48fe4a7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:24.930824 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ba49eb-6839-4e1e-b9aa-86bbf7aad0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:24.931731 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba49eb-6839-4e1e-b9aa-86bbf7aad0c5 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:24.932015 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba49eb-6839-4e1e-b9aa-86bbf7aad0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:24.932292 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba49eb-6839-4e1e-b9aa-86bbf7aad0c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:24.937820 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53bb8b0-9211-4afe-b097-c26ba48fe4a7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:24.939824 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53bb8b0-9211-4afe-b097-c26ba48fe4a7 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:24.943211 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ba49eb-6839-4e1e-b9aa-86bbf7aad0c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:24.944706 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ba49eb-6839-4e1e-b9aa-86bbf7aad0c5 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:24.958766 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-b53bb8b0-9211-4afe-b097-c26ba48fe4a7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 14 20:50:24.958766 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:24.958766 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:24.958766 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:24.958766 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:24.958766 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:24.958766 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:24.958766 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:24.958766 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:24.958766 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:24.958766 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:24.958766 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:24.958766 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 14 20:50:24.958766 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_user(user_id) May 14 20:50:24.958766 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 14 20:50:24.958766 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 14 20:50:24.961011 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:24.961011 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:24.961011 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 20:50:24.961011 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 20:50:24.961011 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 14 20:50:24.961011 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 20:50:24.961011 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:24.961011 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:24.961011 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:24.961011 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:24.961011 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:24.961011 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:50:24.961011 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:24.961011 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:24.961011 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:24.961011 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:24.961011 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:24.961011 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:24.963302 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:24.963302 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:24.963302 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 14 20:50:24.963302 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 14 20:50:24.963302 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 14 20:50:24.963302 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 14 20:50:24.963302 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 14 20:50:24.963302 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 14 20:50:24.963302 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 14 20:50:24.963302 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:24.963302 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 301/595] 10.222.0.52 () {56 vars in 1099 bytes} [Sat May 14 20:50:24 2022] GET /identity/v3/users/cinder => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:24.963302 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53bb8b0-9211-4afe-b097-c26ba48fe4a7 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:24.964856 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-d0ba49eb-6839-4e1e-b9aa-86bbf7aad0c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:24.964856 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:24.964856 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:24.964856 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:24.964856 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:24.964856 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:24.964856 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:24.964856 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:24.964856 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:24.964856 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:24.964856 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:24.964856 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:24.964856 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:50:24.964856 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:50:24.964856 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:50:24.976754 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:50:24.976754 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:24.976754 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:24.976754 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:24.976754 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:24.976754 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:24.976754 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:24.976754 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:24.976754 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:50:24.976754 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:24.976754 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:24.976754 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:24.976754 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:24.976754 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:24.976754 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:24.976754 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:24.976754 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:24.978886 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 20:50:24.978886 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:50:24.978886 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:24.978886 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:24.978886 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 295/596] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:50:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:24.978886 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ba49eb-6839-4e1e-b9aa-86bbf7aad0c5 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:25.066216 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53bb8b0-9211-4afe-b097-c26ba48fe4a7 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:25.073368 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ba49eb-6839-4e1e-b9aa-86bbf7aad0c5 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:25.102286 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc46e2d-2246-4642-ae3a-b6a36b2714fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:25.103621 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc46e2d-2246-4642-ae3a-b6a36b2714fc None admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:25.104110 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc46e2d-2246-4642-ae3a-b6a36b2714fc None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:25.104586 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc46e2d-2246-4642-ae3a-b6a36b2714fc None admin] PATH_INFO: `/v3/projects/0911a024287e430ea6ee015389f0c440/users/7b5cb86f190f4fcfb06d66cb8f14643f/roles/998d6a3451be42a89d4cff277851ad70` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:25.108820 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff1b981-e573-4901-af22-7361692e4d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:25.109485 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff1b981-e573-4901-af22-7361692e4d90 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:25.109770 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff1b981-e573-4901-af22-7361692e4d90 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:25.110046 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff1b981-e573-4901-af22-7361692e4d90 None admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:25.110757 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff1b981-e573-4901-af22-7361692e4d90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:25.112297 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff1b981-e573-4901-af22-7361692e4d90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:25.112624 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff1b981-e573-4901-af22-7361692e4d90 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:25.124063 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 296/597] 10.222.0.52 () {56 vars in 1109 bytes} [Sat May 14 20:50:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:25.127896 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff1b981-e573-4901-af22-7361692e4d90 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:25.153673 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc46e2d-2246-4642-ae3a-b6a36b2714fc None admin] RBAC: Authorizing `identity:create_grant(project_id=0911a024287e430ea6ee015389f0c440, user_id=7b5cb86f190f4fcfb06d66cb8f14643f, role_id=998d6a3451be42a89d4cff277851ad70)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:25.155112 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc46e2d-2246-4642-ae3a-b6a36b2714fc None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:25.235737 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 302/598] 10.222.0.52 () {58 vars in 1439 bytes} [Sat May 14 20:50:24 2022] PUT /identity/v3/projects/0911a024287e430ea6ee015389f0c440/users/7b5cb86f190f4fcfb06d66cb8f14643f/roles/998d6a3451be42a89d4cff277851ad70 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 20:50:25.238541 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc46e2d-2246-4642-ae3a-b6a36b2714fc None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:25.266605 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff1b981-e573-4901-af22-7361692e4d90 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:25.355582 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf32b75-c414-4413-b59c-c4aa6f35d94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:25.355987 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf32b75-c414-4413-b59c-c4aa6f35d94a None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:25.356787 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf32b75-c414-4413-b59c-c4aa6f35d94a None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:25.356787 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf32b75-c414-4413-b59c-c4aa6f35d94a None admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:25.357375 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf32b75-c414-4413-b59c-c4aa6f35d94a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:25.357692 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf32b75-c414-4413-b59c-c4aa6f35d94a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:25.359151 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf32b75-c414-4413-b59c-c4aa6f35d94a None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:25.389272 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc46e2d-2246-4642-ae3a-b6a36b2714fc None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:25.399709 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 297/599] 10.222.0.52 () {56 vars in 1137 bytes} [Sat May 14 20:50:25 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:25.404733 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf32b75-c414-4413-b59c-c4aa6f35d94a None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:25.431712 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7d5308-778e-4b45-bb7c-7f995fae1673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:25.432930 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d5308-778e-4b45-bb7c-7f995fae1673 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:25.433628 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d5308-778e-4b45-bb7c-7f995fae1673 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:25.435673 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d5308-778e-4b45-bb7c-7f995fae1673 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:25.448387 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7d5308-778e-4b45-bb7c-7f995fae1673 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:25.452965 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7d5308-778e-4b45-bb7c-7f995fae1673 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:25.473960 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-cb7d5308-778e-4b45-bb7c-7f995fae1673 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 14 20:50:25.473960 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:25.473960 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:25.473960 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:25.473960 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:25.473960 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:25.473960 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:25.473960 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:25.473960 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:25.473960 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:25.473960 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:25.473960 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:25.473960 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 14 20:50:25.473960 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_project(project_id) May 14 20:50:25.473960 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 14 20:50:25.474887 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 14 20:50:25.474887 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:25.474887 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:25.474887 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:25.474887 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:25.474887 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:25.474887 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:25.474887 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:25.474887 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:50:25.474887 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:25.474887 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:25.474887 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:25.474887 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:25.474887 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:25.474887 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:25.474887 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:25.474887 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:25.475825 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 14 20:50:25.475825 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 14 20:50:25.475825 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 20:50:25.475825 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 20:50:25.475825 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 20:50:25.475825 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 20:50:25.475825 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 14 20:50:25.475825 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:25.478011 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 303/600] 10.222.0.52 () {56 vars in 1111 bytes} [Sat May 14 20:50:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:25.483766 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7d5308-778e-4b45-bb7c-7f995fae1673 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:25.556984 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf32b75-c414-4413-b59c-c4aa6f35d94a None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:25.594693 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7d5308-778e-4b45-bb7c-7f995fae1673 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:25.608220 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac6163-b5da-48ac-a589-f63db402dba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:25.609333 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac6163-b5da-48ac-a589-f63db402dba5 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:25.609615 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac6163-b5da-48ac-a589-f63db402dba5 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:25.610177 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac6163-b5da-48ac-a589-f63db402dba5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:25.632016 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ac6163-b5da-48ac-a589-f63db402dba5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:25.633485 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ac6163-b5da-48ac-a589-f63db402dba5 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:25.649578 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05292e4-e2c2-40df-adba-bf58f99f6ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:25.650292 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05292e4-e2c2-40df-adba-bf58f99f6ecd None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:25.650578 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05292e4-e2c2-40df-adba-bf58f99f6ecd None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:25.650855 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05292e4-e2c2-40df-adba-bf58f99f6ecd None admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:25.651665 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05292e4-e2c2-40df-adba-bf58f99f6ecd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:25.651976 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05292e4-e2c2-40df-adba-bf58f99f6ecd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:25.653864 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05292e4-e2c2-40df-adba-bf58f99f6ecd None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:25.670243 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-f4ac6163-b5da-48ac-a589-f63db402dba5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:25.670243 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:25.670243 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:25.670243 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:25.670243 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:25.670243 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:25.670243 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:25.670243 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:25.670243 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:25.670243 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:25.670243 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:25.670243 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:25.670243 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:50:25.670243 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:50:25.670243 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:50:25.671136 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:50:25.671136 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:25.671136 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:25.671136 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:25.671136 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:25.671136 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:25.671136 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:25.671136 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:25.671136 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:50:25.671136 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:25.671136 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:25.671136 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:25.671136 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:25.671136 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:25.671136 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:25.671136 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:25.671136 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:25.672064 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 20:50:25.672064 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:50:25.672064 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:25.672064 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:25.672064 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 298/601] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:50:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 20:50:25.677799 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac6163-b5da-48ac-a589-f63db402dba5 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:25.685147 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 304/602] 10.222.0.52 () {56 vars in 1148 bytes} [Sat May 14 20:50:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:25.689005 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05292e4-e2c2-40df-adba-bf58f99f6ecd None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:25.828999 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05292e4-e2c2-40df-adba-bf58f99f6ecd None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:25.866207 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c600d188-b626-4750-9863-a7a29a160ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:25.867094 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c600d188-b626-4750-9863-a7a29a160ca0 None admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:25.867379 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c600d188-b626-4750-9863-a7a29a160ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:25.867689 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c600d188-b626-4750-9863-a7a29a160ca0 None admin] PATH_INFO: `/v3/projects/0911a024287e430ea6ee015389f0c440/users/99ed32a6d699453bb7e088540e8fc980/roles/998d6a3451be42a89d4cff277851ad70` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:25.870263 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac6163-b5da-48ac-a589-f63db402dba5 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:25.896890 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c600d188-b626-4750-9863-a7a29a160ca0 None admin] RBAC: Authorizing `identity:create_grant(project_id=0911a024287e430ea6ee015389f0c440, user_id=99ed32a6d699453bb7e088540e8fc980, role_id=998d6a3451be42a89d4cff277851ad70)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:25.898468 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c600d188-b626-4750-9863-a7a29a160ca0 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:25.919498 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2201fc-7342-4f79-b5ff-a2c72ba8c2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:25.920356 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2201fc-7342-4f79-b5ff-a2c72ba8c2c3 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:25.920575 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2201fc-7342-4f79-b5ff-a2c72ba8c2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:25.920858 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2201fc-7342-4f79-b5ff-a2c72ba8c2c3 None admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:25.921593 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2201fc-7342-4f79-b5ff-a2c72ba8c2c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:25.921899 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2201fc-7342-4f79-b5ff-a2c72ba8c2c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:25.923373 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2201fc-7342-4f79-b5ff-a2c72ba8c2c3 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:25.942686 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 299/603] 10.222.0.52 () {56 vars in 1109 bytes} [Sat May 14 20:50:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:50:25.946693 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2201fc-7342-4f79-b5ff-a2c72ba8c2c3 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:25.999025 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 305/604] 10.222.0.52 () {58 vars in 1439 bytes} [Sat May 14 20:50:25 2022] PUT /identity/v3/projects/0911a024287e430ea6ee015389f0c440/users/99ed32a6d699453bb7e088540e8fc980/roles/998d6a3451be42a89d4cff277851ad70 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 20:50:26.082365 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2201fc-7342-4f79-b5ff-a2c72ba8c2c3 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:26.123194 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded30ea2-0751-4fe4-9390-de1564c08b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:26.124017 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded30ea2-0751-4fe4-9390-de1564c08b4d None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:26.124301 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded30ea2-0751-4fe4-9390-de1564c08b4d None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:26.124574 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded30ea2-0751-4fe4-9390-de1564c08b4d None admin] PATH_INFO: `/v3/projects/service` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:26.140947 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded30ea2-0751-4fe4-9390-de1564c08b4d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:26.142435 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded30ea2-0751-4fe4-9390-de1564c08b4d None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:26.164999 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-ded30ea2-0751-4fe4-9390-de1564c08b4d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 14 20:50:26.164999 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:26.164999 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:26.164999 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:26.164999 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:26.164999 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:26.164999 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:26.164999 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:26.164999 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:26.164999 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:26.164999 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:26.164999 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:26.164999 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 14 20:50:26.164999 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_project(project_id) May 14 20:50:26.164999 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 14 20:50:26.165975 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 14 20:50:26.165975 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:26.165975 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:26.165975 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:26.165975 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:26.165975 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:26.165975 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:26.165975 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:26.165975 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:50:26.165975 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:26.165975 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:26.165975 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:26.165975 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:26.165975 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:26.165975 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:26.165975 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:26.165975 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:26.166888 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 14 20:50:26.166888 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 14 20:50:26.166888 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 20:50:26.166888 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 20:50:26.166888 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 20:50:26.166888 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 20:50:26.166888 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 14 20:50:26.166888 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:26.166888 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 300/605] 10.222.0.52 () {56 vars in 1111 bytes} [Sat May 14 20:50:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:26.172257 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c600d188-b626-4750-9863-a7a29a160ca0 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:26.285028 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c600d188-b626-4750-9863-a7a29a160ca0 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:26.325178 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4658d37-5783-4386-b8f3-b207e9fc8e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:26.325870 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4658d37-5783-4386-b8f3-b207e9fc8e76 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:26.326146 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4658d37-5783-4386-b8f3-b207e9fc8e76 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:26.326473 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4658d37-5783-4386-b8f3-b207e9fc8e76 None admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:26.327277 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4658d37-5783-4386-b8f3-b207e9fc8e76 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:26.327627 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4658d37-5783-4386-b8f3-b207e9fc8e76 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:26.329086 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4658d37-5783-4386-b8f3-b207e9fc8e76 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:26.342656 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 306/606] 10.222.0.52 () {56 vars in 1148 bytes} [Sat May 14 20:50:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:50:26.348939 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded30ea2-0751-4fe4-9390-de1564c08b4d None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:26.472914 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded30ea2-0751-4fe4-9390-de1564c08b4d None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:26.515906 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43872e08-4f9b-40e5-8349-fb38f646ec0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:26.516783 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43872e08-4f9b-40e5-8349-fb38f646ec0a None admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:26.517060 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43872e08-4f9b-40e5-8349-fb38f646ec0a None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:26.517333 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43872e08-4f9b-40e5-8349-fb38f646ec0a None admin] PATH_INFO: `/v3/projects/0911a024287e430ea6ee015389f0c440/users/198271d1c0d44cb58bace41a65f4b94c/roles/998d6a3451be42a89d4cff277851ad70` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:26.524366 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaddb498-4a83-4042-bb90-f87a9c465bef None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:26.524654 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaddb498-4a83-4042-bb90-f87a9c465bef None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:26.524913 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaddb498-4a83-4042-bb90-f87a9c465bef None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:26.526522 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 307/607] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:50:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:50:26.533475 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa98d47-ddcf-4686-b857-26591125db4a None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:26.533475 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa98d47-ddcf-4686-b857-26591125db4a None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:26.533475 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa98d47-ddcf-4686-b857-26591125db4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:26.539499 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43872e08-4f9b-40e5-8349-fb38f646ec0a None admin] RBAC: Authorizing `identity:create_grant(project_id=0911a024287e430ea6ee015389f0c440, user_id=198271d1c0d44cb58bace41a65f4b94c, role_id=998d6a3451be42a89d4cff277851ad70)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:26.539499 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43872e08-4f9b-40e5-8349-fb38f646ec0a None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:26.557993 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-8aa98d47-ddcf-4686-b857-26591125db4a None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:50:26.559192 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8aa98d47-ddcf-4686-b857-26591125db4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:50:26.611377 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 301/608] 10.222.0.52 () {58 vars in 1439 bytes} [Sat May 14 20:50:26 2022] PUT /identity/v3/projects/0911a024287e430ea6ee015389f0c440/users/198271d1c0d44cb58bace41a65f4b94c/roles/998d6a3451be42a89d4cff277851ad70 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 20:50:26.639302 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 308/609] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:50:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 20:50:26.656421 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e6b4a9-c944-49cb-9837-12497852a0cd None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:26.656756 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e6b4a9-c944-49cb-9837-12497852a0cd None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:26.656978 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e6b4a9-c944-49cb-9837-12497852a0cd None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:26.659258 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 302/610] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:50:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:50:26.664791 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225996b0-aa55-42b4-8e2e-516490eb2f4c None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:26.665087 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225996b0-aa55-42b4-8e2e-516490eb2f4c None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:26.665368 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225996b0-aa55-42b4-8e2e-516490eb2f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:26.676140 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e6b4a9-c944-49cb-9837-12497852a0cd None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:26.684618 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-225996b0-aa55-42b4-8e2e-516490eb2f4c None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:50:26.685941 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-225996b0-aa55-42b4-8e2e-516490eb2f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:50:26.813120 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 309/611] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:50:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 20:50:26.852648 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225996b0-aa55-42b4-8e2e-516490eb2f4c None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:26.874362 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e6b4a9-c944-49cb-9837-12497852a0cd None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:26.940830 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d488c886-5bea-4353-8692-9aea9e0ef48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:26.941637 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d488c886-5bea-4353-8692-9aea9e0ef48f None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:26.941920 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d488c886-5bea-4353-8692-9aea9e0ef48f None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:26.942195 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d488c886-5bea-4353-8692-9aea9e0ef48f None admin] PATH_INFO: `/v3/roles/service` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:26.966872 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d488c886-5bea-4353-8692-9aea9e0ef48f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:50:26.978975 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-d488c886-5bea-4353-8692-9aea9e0ef48f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 14 20:50:26.978975 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:26.978975 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:26.978975 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:26.978975 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:26.978975 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:26.978975 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:26.978975 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:26.978975 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:26.978975 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:26.978975 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:26.978975 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:26.978975 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:50:26.978975 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:50:26.978975 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:50:26.978975 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:50:26.979987 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:50:26.979987 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:50:26.979987 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:50:26.979987 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:50:26.979987 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:26.979987 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:26.979987 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:26.979987 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:26.979987 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:26.979987 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:26.979987 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:26.979987 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:50:26.979987 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:26.979987 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:26.979987 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:26.979987 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:26.980834 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:26.980834 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:26.980834 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:26.980834 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:26.980834 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:50:26.980834 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:50:26.980834 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:50:26.980834 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:50:26.980834 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:50:26.980834 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:50:26.980834 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 14 20:50:26.980834 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:26.987211 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 303/612] 10.222.0.52 () {56 vars in 1102 bytes} [Sat May 14 20:50:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 20:50:26.992710 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d488c886-5bea-4353-8692-9aea9e0ef48f None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:27.017327 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225996b0-aa55-42b4-8e2e-516490eb2f4c None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:27.112974 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7750e1-e1c0-4778-8fc4-a0bbdaa1dcb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:27.113548 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7750e1-e1c0-4778-8fc4-a0bbdaa1dcb6 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:27.113828 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7750e1-e1c0-4778-8fc4-a0bbdaa1dcb6 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:27.114098 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7750e1-e1c0-4778-8fc4-a0bbdaa1dcb6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:27.124663 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d488c886-5bea-4353-8692-9aea9e0ef48f None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:27.144442 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7750e1-e1c0-4778-8fc4-a0bbdaa1dcb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:50:27.156716 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-0d7750e1-e1c0-4778-8fc4-a0bbdaa1dcb6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 14 20:50:27.156716 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:27.156716 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:27.156716 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:27.156716 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:27.156716 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:27.156716 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:27.156716 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:27.156716 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:27.156716 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:27.156716 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:27.156716 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:27.156716 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:50:27.156716 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:50:27.156716 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:50:27.156716 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:50:27.158450 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:50:27.158450 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:50:27.158450 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:50:27.158450 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:50:27.158450 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:27.158450 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:27.158450 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:27.158450 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:27.158450 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:27.158450 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:27.158450 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:27.158450 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:50:27.158450 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:27.158450 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:27.158450 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:27.158450 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:27.160097 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:27.160097 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:27.160097 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:27.160097 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:27.160097 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:50:27.160097 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:50:27.160097 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:50:27.160097 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:50:27.160097 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:50:27.160097 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:50:27.160097 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 14 20:50:27.160097 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:27.166639 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 310/613] 10.222.0.52 () {56 vars in 1102 bytes} [Sat May 14 20:50:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 20:50:27.175607 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7750e1-e1c0-4778-8fc4-a0bbdaa1dcb6 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:27.177688 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748b504e-172d-402a-bf85-a07f11df2506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:27.179813 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b504e-172d-402a-bf85-a07f11df2506 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:27.183657 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b504e-172d-402a-bf85-a07f11df2506 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:27.184222 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b504e-172d-402a-bf85-a07f11df2506 None admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:27.185236 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748b504e-172d-402a-bf85-a07f11df2506 None admin] RBAC: Adding query filter params (name=service) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:27.186641 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748b504e-172d-402a-bf85-a07f11df2506 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:27.188469 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748b504e-172d-402a-bf85-a07f11df2506 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:27.202736 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 304/614] 10.222.0.52 () {56 vars in 1103 bytes} [Sat May 14 20:50:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:50:27.207008 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748b504e-172d-402a-bf85-a07f11df2506 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:27.364745 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7750e1-e1c0-4778-8fc4-a0bbdaa1dcb6 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:27.385552 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748b504e-172d-402a-bf85-a07f11df2506 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:27.427337 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9bcc4-e3dc-4f68-8c22-e5a1ea7b3a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:27.428396 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9bcc4-e3dc-4f68-8c22-e5a1ea7b3a44 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:27.428876 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9bcc4-e3dc-4f68-8c22-e5a1ea7b3a44 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:27.429350 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9bcc4-e3dc-4f68-8c22-e5a1ea7b3a44 None admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:27.430316 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd9bcc4-e3dc-4f68-8c22-e5a1ea7b3a44 None admin] RBAC: Adding query filter params (name=service) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:27.430815 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd9bcc4-e3dc-4f68-8c22-e5a1ea7b3a44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:27.432400 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd9bcc4-e3dc-4f68-8c22-e5a1ea7b3a44 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:27.446448 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 311/615] 10.222.0.52 () {56 vars in 1103 bytes} [Sat May 14 20:50:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:27.448272 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239b40fc-0835-4ef4-9bdd-2c0ee0f312e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:27.449611 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b40fc-0835-4ef4-9bdd-2c0ee0f312e5 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:27.450115 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b40fc-0835-4ef4-9bdd-2c0ee0f312e5 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:27.451105 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9bcc4-e3dc-4f68-8c22-e5a1ea7b3a44 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:27.451613 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b40fc-0835-4ef4-9bdd-2c0ee0f312e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:27.473261 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239b40fc-0835-4ef4-9bdd-2c0ee0f312e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:27.474823 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239b40fc-0835-4ef4-9bdd-2c0ee0f312e5 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:27.498991 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-239b40fc-0835-4ef4-9bdd-2c0ee0f312e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:27.498991 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:27.498991 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:27.498991 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:27.498991 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:27.498991 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:27.498991 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:27.498991 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:27.498991 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:27.498991 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:27.498991 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:27.498991 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:27.498991 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:50:27.498991 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:50:27.498991 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:50:27.500000 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:50:27.500000 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:27.500000 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:27.500000 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:27.500000 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:27.500000 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:27.500000 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:27.500000 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:27.500000 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:50:27.500000 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:27.500000 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:27.500000 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:27.500000 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:27.500000 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:27.500000 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:27.500000 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:27.500000 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:27.500900 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 20:50:27.500900 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:50:27.500900 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:27.500900 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:27.512628 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 305/616] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:50:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:27.514031 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239b40fc-0835-4ef4-9bdd-2c0ee0f312e5 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:27.577932 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9bcc4-e3dc-4f68-8c22-e5a1ea7b3a44 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:27.633778 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8576ad10-a0fc-4405-bcf3-501289ab965f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:27.634494 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576ad10-a0fc-4405-bcf3-501289ab965f None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:27.634779 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576ad10-a0fc-4405-bcf3-501289ab965f None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:27.635057 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576ad10-a0fc-4405-bcf3-501289ab965f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:27.655525 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8576ad10-a0fc-4405-bcf3-501289ab965f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:27.657020 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8576ad10-a0fc-4405-bcf3-501289ab965f None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:27.690356 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-8576ad10-a0fc-4405-bcf3-501289ab965f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:27.690356 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:27.690356 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:27.690356 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:27.690356 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:27.690356 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:27.690356 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:27.690356 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:27.690356 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:27.690356 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:27.690356 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:27.690356 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:27.690356 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:50:27.690356 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:50:27.690356 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:50:27.691397 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:50:27.691397 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:27.691397 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:27.691397 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:27.691397 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:27.691397 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:27.691397 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:27.691397 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:27.691397 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:50:27.691397 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:27.691397 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:27.691397 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:27.691397 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:27.691397 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:27.691397 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:27.691397 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:27.691397 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:27.692349 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 20:50:27.692349 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:50:27.692349 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:27.692349 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:27.693166 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 312/617] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:50:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:27.698627 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8576ad10-a0fc-4405-bcf3-501289ab965f None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:27.735357 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239b40fc-0835-4ef4-9bdd-2c0ee0f312e5 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:27.804081 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a1e647-0f6c-45a1-b47c-f4ae9cfea08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:27.804746 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1e647-0f6c-45a1-b47c-f4ae9cfea08c None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:27.805032 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1e647-0f6c-45a1-b47c-f4ae9cfea08c None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:27.805313 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1e647-0f6c-45a1-b47c-f4ae9cfea08c None admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:27.806033 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a1e647-0f6c-45a1-b47c-f4ae9cfea08c None admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:27.806342 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a1e647-0f6c-45a1-b47c-f4ae9cfea08c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:27.807749 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a1e647-0f6c-45a1-b47c-f4ae9cfea08c None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:27.833409 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 306/618] 10.222.0.52 () {56 vars in 1109 bytes} [Sat May 14 20:50:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:50:27.838742 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a1e647-0f6c-45a1-b47c-f4ae9cfea08c None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:27.860393 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8576ad10-a0fc-4405-bcf3-501289ab965f None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:27.895189 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19310389-6519-4c38-bacf-55f1c40d9462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:27.895808 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19310389-6519-4c38-bacf-55f1c40d9462 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:27.896095 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19310389-6519-4c38-bacf-55f1c40d9462 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:27.896379 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19310389-6519-4c38-bacf-55f1c40d9462 None admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:27.897101 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19310389-6519-4c38-bacf-55f1c40d9462 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:27.897408 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19310389-6519-4c38-bacf-55f1c40d9462 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:27.898780 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19310389-6519-4c38-bacf-55f1c40d9462 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:27.910815 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 313/619] 10.222.0.52 () {56 vars in 1109 bytes} [Sat May 14 20:50:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:27.916193 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19310389-6519-4c38-bacf-55f1c40d9462 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:27.944250 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a1e647-0f6c-45a1-b47c-f4ae9cfea08c None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:27.978408 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709657b7-d797-4195-a737-397b082a9e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:27.979208 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709657b7-d797-4195-a737-397b082a9e10 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:27.979504 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709657b7-d797-4195-a737-397b082a9e10 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:27.979790 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709657b7-d797-4195-a737-397b082a9e10 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:27.988019 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709657b7-d797-4195-a737-397b082a9e10 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:27.989468 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709657b7-d797-4195-a737-397b082a9e10 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:28.004667 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-709657b7-d797-4195-a737-397b082a9e10 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 14 20:50:28.004667 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:28.004667 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:28.004667 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:28.004667 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:28.004667 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:28.004667 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:28.004667 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:28.004667 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:28.004667 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:28.004667 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:28.004667 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:28.004667 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 14 20:50:28.004667 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_user(user_id) May 14 20:50:28.004667 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 14 20:50:28.004667 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 14 20:50:28.005665 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:28.005665 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:28.005665 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 20:50:28.005665 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 20:50:28.005665 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 14 20:50:28.005665 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 20:50:28.005665 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:28.005665 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:28.005665 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:28.005665 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:28.005665 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:28.005665 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:50:28.005665 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:28.005665 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:28.005665 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:28.005665 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:28.005665 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:28.005665 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:28.006590 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:28.006590 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:28.006590 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 14 20:50:28.006590 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 14 20:50:28.006590 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 14 20:50:28.006590 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 14 20:50:28.006590 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 14 20:50:28.006590 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 14 20:50:28.006590 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 14 20:50:28.006590 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:28.006590 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 307/620] 10.222.0.52 () {56 vars in 1096 bytes} [Sat May 14 20:50:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:28.011769 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709657b7-d797-4195-a737-397b082a9e10 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:28.024435 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19310389-6519-4c38-bacf-55f1c40d9462 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:28.072851 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac9e896-6a16-4ed1-8634-f83ea2058eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:28.073623 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac9e896-6a16-4ed1-8634-f83ea2058eae None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:28.073936 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac9e896-6a16-4ed1-8634-f83ea2058eae None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:28.074184 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac9e896-6a16-4ed1-8634-f83ea2058eae None admin] PATH_INFO: `/v3/users/nova` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:28.082490 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac9e896-6a16-4ed1-8634-f83ea2058eae None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:28.092230 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac9e896-6a16-4ed1-8634-f83ea2058eae None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:28.116705 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-2ac9e896-6a16-4ed1-8634-f83ea2058eae None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 14 20:50:28.116705 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:28.116705 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:28.116705 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:28.116705 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:28.116705 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:28.116705 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:28.116705 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:28.116705 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:28.116705 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:28.116705 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:28.116705 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:28.116705 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 14 20:50:28.116705 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_user(user_id) May 14 20:50:28.116705 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 14 20:50:28.116705 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 14 20:50:28.119005 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:28.119005 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:28.119005 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 20:50:28.119005 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 20:50:28.119005 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 14 20:50:28.119005 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 20:50:28.119005 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:28.119005 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:28.119005 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:28.119005 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:28.119005 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:28.119005 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:50:28.119005 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:28.119005 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:28.119005 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:28.119005 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:28.119005 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:28.119005 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:28.121672 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:28.121672 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:28.121672 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 14 20:50:28.121672 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 14 20:50:28.121672 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 14 20:50:28.121672 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 14 20:50:28.121672 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 14 20:50:28.121672 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 14 20:50:28.121672 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 14 20:50:28.121672 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:28.121672 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 314/621] 10.222.0.52 () {56 vars in 1093 bytes} [Sat May 14 20:50:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:28.123069 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709657b7-d797-4195-a737-397b082a9e10 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:28.127673 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac9e896-6a16-4ed1-8634-f83ea2058eae None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:28.156335 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d6043-fd94-4f66-9a08-95639ce7cf7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:28.156930 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d6043-fd94-4f66-9a08-95639ce7cf7d None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:28.157216 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d6043-fd94-4f66-9a08-95639ce7cf7d None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:28.157493 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d6043-fd94-4f66-9a08-95639ce7cf7d None admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:28.158390 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99d6043-fd94-4f66-9a08-95639ce7cf7d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:28.158819 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99d6043-fd94-4f66-9a08-95639ce7cf7d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:28.160274 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99d6043-fd94-4f66-9a08-95639ce7cf7d None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:28.178227 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 308/622] 10.222.0.52 () {56 vars in 1135 bytes} [Sat May 14 20:50:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:50:28.183623 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d6043-fd94-4f66-9a08-95639ce7cf7d None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:28.303365 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac9e896-6a16-4ed1-8634-f83ea2058eae None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:28.318871 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d6043-fd94-4f66-9a08-95639ce7cf7d None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:28.347980 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daca53ca-b6a1-4b4e-857e-898402191e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:28.349717 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca53ca-b6a1-4b4e-857e-898402191e75 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:28.350527 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca53ca-b6a1-4b4e-857e-898402191e75 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:28.351000 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca53ca-b6a1-4b4e-857e-898402191e75 None admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:28.352067 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daca53ca-b6a1-4b4e-857e-898402191e75 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:28.352578 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daca53ca-b6a1-4b4e-857e-898402191e75 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:28.354050 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4848c5-264d-4e1a-9e35-a648d44ebb00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:28.354574 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daca53ca-b6a1-4b4e-857e-898402191e75 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:28.354837 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4848c5-264d-4e1a-9e35-a648d44ebb00 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:28.355130 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4848c5-264d-4e1a-9e35-a648d44ebb00 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:28.355411 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4848c5-264d-4e1a-9e35-a648d44ebb00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:28.365911 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4848c5-264d-4e1a-9e35-a648d44ebb00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:28.367372 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4848c5-264d-4e1a-9e35-a648d44ebb00 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:28.378104 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 315/623] 10.222.0.52 () {56 vars in 1133 bytes} [Sat May 14 20:50:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:50:28.380124 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcfd95e-471a-4220-a6b6-ecdf91dd4fe5 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:28.380611 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcfd95e-471a-4220-a6b6-ecdf91dd4fe5 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:28.381107 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcfd95e-471a-4220-a6b6-ecdf91dd4fe5 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:28.386622 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 316/624] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:50:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:50:28.387143 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-6d4848c5-264d-4e1a-9e35-a648d44ebb00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:28.387143 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:28.387143 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:28.387143 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:28.387143 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:28.387143 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:28.387143 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:28.387143 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:28.387143 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:28.387143 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:28.387143 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:28.387143 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:28.387143 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:50:28.387143 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:50:28.387143 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:50:28.388020 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:50:28.388020 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:28.388020 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:28.388020 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:28.388020 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:28.388020 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:28.388020 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:28.388020 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:28.388020 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:50:28.388020 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:28.388020 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:28.388020 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:28.388020 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:28.388020 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:28.388020 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:28.388020 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:28.388020 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:28.388902 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 20:50:28.388902 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:50:28.388902 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:28.388902 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:28.388902 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 309/625] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:50:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 20:50:28.390077 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcfd95e-471a-4220-a6b6-ecdf91dd4fe5 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:28.394512 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3e945f-76ea-476a-ab43-4c129b4d3eee None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:28.395088 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3e945f-76ea-476a-ab43-4c129b4d3eee None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:28.395634 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3e945f-76ea-476a-ab43-4c129b4d3eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:28.413329 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-5d3e945f-76ea-476a-ab43-4c129b4d3eee None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:50:28.414439 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-5d3e945f-76ea-476a-ab43-4c129b4d3eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:50:28.490878 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 310/626] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:50:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 20:50:28.494477 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3e945f-76ea-476a-ab43-4c129b4d3eee None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:28.538424 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcfd95e-471a-4220-a6b6-ecdf91dd4fe5 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:28.584806 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ce23f-4176-4a4c-82f4-d66c72f9f024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:28.585464 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ce23f-4176-4a4c-82f4-d66c72f9f024 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:28.585751 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ce23f-4176-4a4c-82f4-d66c72f9f024 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:28.586030 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ce23f-4176-4a4c-82f4-d66c72f9f024 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:28.613978 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3e945f-76ea-476a-ab43-4c129b4d3eee None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:28.652807 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ac44aa-b1a1-4044-84d9-886676a2b96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:28.653844 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac44aa-b1a1-4044-84d9-886676a2b96a None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:28.654435 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac44aa-b1a1-4044-84d9-886676a2b96a None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:28.654901 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac44aa-b1a1-4044-84d9-886676a2b96a None admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:28.655810 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ac44aa-b1a1-4044-84d9-886676a2b96a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:28.656277 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ac44aa-b1a1-4044-84d9-886676a2b96a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:28.661981 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ac44aa-b1a1-4044-84d9-886676a2b96a None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:28.671176 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 311/627] 10.222.0.52 () {56 vars in 1109 bytes} [Sat May 14 20:50:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:28.672428 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ac44aa-b1a1-4044-84d9-886676a2b96a None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:28.679857 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361ce23f-4176-4a4c-82f4-d66c72f9f024 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:28.681338 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361ce23f-4176-4a4c-82f4-d66c72f9f024 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:28.794386 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 317/628] 10.222.0.52 () {58 vars in 1282 bytes} [Sat May 14 20:50:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 14 20:50:28.795848 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ce23f-4176-4a4c-82f4-d66c72f9f024 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:28.801786 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ac44aa-b1a1-4044-84d9-886676a2b96a None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:28.839816 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f4bc8-b88b-4527-8eb4-23ae9b68f6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:28.840715 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f4bc8-b88b-4527-8eb4-23ae9b68f6f5 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:28.841003 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f4bc8-b88b-4527-8eb4-23ae9b68f6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:28.841276 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f4bc8-b88b-4527-8eb4-23ae9b68f6f5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:28.852413 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136f4bc8-b88b-4527-8eb4-23ae9b68f6f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:50:28.860302 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-136f4bc8-b88b-4527-8eb4-23ae9b68f6f5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 14 20:50:28.860302 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:28.860302 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:28.860302 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:28.860302 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:28.860302 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:28.860302 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:28.860302 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:28.860302 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:28.860302 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:28.860302 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:28.860302 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:28.860302 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:50:28.860302 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:50:28.860302 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:50:28.860302 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:50:28.862346 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:50:28.862346 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:50:28.862346 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:50:28.862346 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:50:28.862346 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:28.862346 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:28.862346 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:28.862346 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:28.862346 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:28.862346 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:28.862346 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:28.862346 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:50:28.862346 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:28.862346 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:28.862346 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:28.862346 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:28.863453 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:28.863453 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:28.863453 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:28.863453 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:28.863453 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:50:28.863453 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:50:28.863453 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:50:28.863453 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:50:28.863453 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:50:28.863453 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:50:28.863453 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 14 20:50:28.863453 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:28.867126 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 312/629] 10.222.0.52 () {56 vars in 1102 bytes} [Sat May 14 20:50:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:28.868537 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd57df7-e479-4c99-8d39-0e926302f2ef None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:28.868828 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd57df7-e479-4c99-8d39-0e926302f2ef None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:28.869105 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd57df7-e479-4c99-8d39-0e926302f2ef None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:28.870400 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 313/630] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:50:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:50:28.871331 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd57df7-e479-4c99-8d39-0e926302f2ef None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:28.905158 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ce23f-4176-4a4c-82f4-d66c72f9f024 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:28.946885 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3f5a65-4058-46b7-a7e0-295b57ffc673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:28.947708 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f5a65-4058-46b7-a7e0-295b57ffc673 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:28.947987 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f5a65-4058-46b7-a7e0-295b57ffc673 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:28.948259 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f5a65-4058-46b7-a7e0-295b57ffc673 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:28.954876 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3f5a65-4058-46b7-a7e0-295b57ffc673 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:28.956436 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3f5a65-4058-46b7-a7e0-295b57ffc673 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:28.969727 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-cf3f5a65-4058-46b7-a7e0-295b57ffc673 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 14 20:50:28.969727 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:28.969727 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:28.969727 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:28.969727 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:28.969727 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:28.969727 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:28.969727 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:28.969727 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:28.969727 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:28.969727 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:28.969727 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:28.969727 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 14 20:50:28.969727 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_project(project_id) May 14 20:50:28.969727 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 14 20:50:28.970667 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 14 20:50:28.970667 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:28.970667 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:28.970667 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:28.970667 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:28.970667 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:28.970667 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:28.970667 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:28.970667 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:50:28.970667 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:28.970667 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:28.970667 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:28.970667 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:28.970667 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:28.970667 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:28.970667 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:28.970667 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:28.972511 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 14 20:50:28.972511 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 14 20:50:28.972511 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 20:50:28.972511 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 20:50:28.972511 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 20:50:28.972511 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 20:50:28.972511 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 14 20:50:28.972511 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:28.972511 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 318/631] 10.222.0.52 () {56 vars in 1111 bytes} [Sat May 14 20:50:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:28.972511 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3f5a65-4058-46b7-a7e0-295b57ffc673 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:28.984234 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd57df7-e479-4c99-8d39-0e926302f2ef None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:29.018803 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4873a5b1-66cb-4aab-bac0-f2d11a1b2b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:29.019616 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873a5b1-66cb-4aab-bac0-f2d11a1b2b98 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:29.019902 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873a5b1-66cb-4aab-bac0-f2d11a1b2b98 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:29.020212 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873a5b1-66cb-4aab-bac0-f2d11a1b2b98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:29.030362 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4873a5b1-66cb-4aab-bac0-f2d11a1b2b98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:29.031825 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4873a5b1-66cb-4aab-bac0-f2d11a1b2b98 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:29.049487 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-4873a5b1-66cb-4aab-bac0-f2d11a1b2b98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:29.049487 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:29.049487 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:29.049487 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:29.049487 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:29.049487 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:29.049487 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:29.049487 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:29.049487 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:29.049487 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:29.049487 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:29.049487 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:29.049487 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:50:29.049487 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:50:29.049487 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:50:29.050611 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:50:29.050611 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:29.050611 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:29.050611 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:29.050611 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:29.050611 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:29.050611 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:29.050611 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:29.050611 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:50:29.050611 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:29.050611 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:29.050611 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:29.050611 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:29.050611 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:29.050611 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:29.050611 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:29.050611 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:29.051548 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 20:50:29.051548 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:50:29.051548 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:29.051548 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:29.052627 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 314/632] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:50:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:29.053796 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54976812-d474-49a2-9a3b-5f1fe3c629ad None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:29.054082 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54976812-d474-49a2-9a3b-5f1fe3c629ad None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:29.054356 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54976812-d474-49a2-9a3b-5f1fe3c629ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:29.071809 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-54976812-d474-49a2-9a3b-5f1fe3c629ad None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:50:29.073351 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-54976812-d474-49a2-9a3b-5f1fe3c629ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:50:29.078512 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3f5a65-4058-46b7-a7e0-295b57ffc673 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:29.113617 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030fbc11-434a-40ea-8639-c7a3974f737d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:29.114281 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030fbc11-434a-40ea-8639-c7a3974f737d None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:29.114552 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030fbc11-434a-40ea-8639-c7a3974f737d None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:29.114828 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030fbc11-434a-40ea-8639-c7a3974f737d None admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:29.115608 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030fbc11-434a-40ea-8639-c7a3974f737d None admin] RBAC: Adding query filter params (name=service) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:29.115912 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030fbc11-434a-40ea-8639-c7a3974f737d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:29.117280 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030fbc11-434a-40ea-8639-c7a3974f737d None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:29.125601 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 319/633] 10.222.0.52 () {56 vars in 1103 bytes} [Sat May 14 20:50:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:29.126395 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030fbc11-434a-40ea-8639-c7a3974f737d None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:29.145539 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 315/634] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:50:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 20:50:29.147359 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54976812-d474-49a2-9a3b-5f1fe3c629ad None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:29.235310 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030fbc11-434a-40ea-8639-c7a3974f737d None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:29.263850 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54976812-d474-49a2-9a3b-5f1fe3c629ad None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:29.275629 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f6f988-27ab-4a10-bf36-509081809373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:29.276302 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f6f988-27ab-4a10-bf36-509081809373 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:29.276581 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f6f988-27ab-4a10-bf36-509081809373 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:29.276855 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f6f988-27ab-4a10-bf36-509081809373 None admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:29.277630 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f6f988-27ab-4a10-bf36-509081809373 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:29.277934 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f6f988-27ab-4a10-bf36-509081809373 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:29.279355 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f6f988-27ab-4a10-bf36-509081809373 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:29.292371 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 320/635] 10.222.0.52 () {56 vars in 1148 bytes} [Sat May 14 20:50:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:29.293249 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f6f988-27ab-4a10-bf36-509081809373 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:29.304224 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bb1d75-5977-47d7-b503-75c97d1a4f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:29.304884 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb1d75-5977-47d7-b503-75c97d1a4f87 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:29.305163 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb1d75-5977-47d7-b503-75c97d1a4f87 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:29.305448 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb1d75-5977-47d7-b503-75c97d1a4f87 None admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:29.306153 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bb1d75-5977-47d7-b503-75c97d1a4f87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:29.306454 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bb1d75-5977-47d7-b503-75c97d1a4f87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:29.307862 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bb1d75-5977-47d7-b503-75c97d1a4f87 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:29.323572 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 316/636] 10.222.0.52 () {56 vars in 1109 bytes} [Sat May 14 20:50:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:29.323572 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bb1d75-5977-47d7-b503-75c97d1a4f87 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:29.395612 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f6f988-27ab-4a10-bf36-509081809373 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:29.420609 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bb1d75-5977-47d7-b503-75c97d1a4f87 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:29.428944 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37253e36-9f7a-4452-a776-aeeff405e0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:29.429734 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37253e36-9f7a-4452-a776-aeeff405e0da None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:29.430020 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37253e36-9f7a-4452-a776-aeeff405e0da None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:29.430299 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37253e36-9f7a-4452-a776-aeeff405e0da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:29.440725 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37253e36-9f7a-4452-a776-aeeff405e0da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:29.442185 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37253e36-9f7a-4452-a776-aeeff405e0da None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:29.453229 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e68060-a7df-4992-8763-53f0d0e2225b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:29.454024 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e68060-a7df-4992-8763-53f0d0e2225b None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:29.454310 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e68060-a7df-4992-8763-53f0d0e2225b None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:29.454589 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e68060-a7df-4992-8763-53f0d0e2225b None admin] PATH_INFO: `/v3/roles/service` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:29.459762 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-37253e36-9f7a-4452-a776-aeeff405e0da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:29.459762 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:29.459762 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:29.459762 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:29.459762 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:29.459762 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:29.459762 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:29.459762 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:29.459762 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:29.459762 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:29.459762 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:29.459762 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:29.459762 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:50:29.459762 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:50:29.459762 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:50:29.460736 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:50:29.460736 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:29.460736 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:29.460736 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:29.460736 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:29.460736 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:29.460736 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:29.460736 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:29.460736 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:50:29.460736 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:29.460736 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:29.460736 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:29.460736 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:29.460736 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:29.460736 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:29.460736 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:29.460736 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:29.461629 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 20:50:29.461629 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:50:29.461629 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:29.461629 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:29.461629 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 321/637] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:50:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:29.461910 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37253e36-9f7a-4452-a776-aeeff405e0da None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:29.469159 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e68060-a7df-4992-8763-53f0d0e2225b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:50:29.476970 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-31e68060-a7df-4992-8763-53f0d0e2225b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 14 20:50:29.476970 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:29.476970 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:29.476970 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:29.476970 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:29.476970 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:29.476970 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:29.476970 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:29.476970 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:29.476970 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:29.476970 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:29.476970 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:29.476970 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:50:29.476970 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:50:29.476970 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:50:29.476970 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:50:29.477984 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:50:29.477984 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:50:29.477984 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:50:29.477984 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:50:29.477984 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:29.477984 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:29.477984 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:29.477984 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:29.477984 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:29.477984 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:29.477984 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:29.477984 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:50:29.477984 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:29.477984 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:29.477984 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:29.477984 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:29.478843 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:29.478843 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:29.478843 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:29.478843 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:29.478843 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:50:29.478843 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:50:29.478843 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:50:29.478843 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:50:29.478843 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:50:29.478843 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:50:29.478843 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 14 20:50:29.478843 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:29.478843 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 317/638] 10.222.0.52 () {56 vars in 1102 bytes} [Sat May 14 20:50:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:29.479550 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e68060-a7df-4992-8763-53f0d0e2225b None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:29.581435 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e68060-a7df-4992-8763-53f0d0e2225b None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:29.616380 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59125b2f-d8fa-485b-a7b2-a598f94d5d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:29.617175 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59125b2f-d8fa-485b-a7b2-a598f94d5d99 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:29.617460 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59125b2f-d8fa-485b-a7b2-a598f94d5d99 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:29.617737 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59125b2f-d8fa-485b-a7b2-a598f94d5d99 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:29.624882 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59125b2f-d8fa-485b-a7b2-a598f94d5d99 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:29.626325 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59125b2f-d8fa-485b-a7b2-a598f94d5d99 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:29.640390 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-59125b2f-d8fa-485b-a7b2-a598f94d5d99 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 14 20:50:29.640390 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:29.640390 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:29.640390 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:29.640390 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:29.640390 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:29.640390 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:29.640390 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:29.640390 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:29.640390 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:29.640390 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:29.640390 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:29.640390 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 14 20:50:29.640390 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_project(project_id) May 14 20:50:29.640390 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 14 20:50:29.641513 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 14 20:50:29.641513 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:29.641513 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:29.641513 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:29.641513 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:29.641513 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:29.641513 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:29.641513 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:29.641513 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:50:29.641513 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:29.641513 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:29.641513 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:29.641513 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:29.641513 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:29.641513 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:29.641513 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:29.641513 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:29.642445 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 14 20:50:29.642445 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 14 20:50:29.642445 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 20:50:29.642445 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 20:50:29.642445 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 20:50:29.642445 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 20:50:29.642445 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 14 20:50:29.642445 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:29.642445 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 318/639] 10.222.0.52 () {56 vars in 1111 bytes} [Sat May 14 20:50:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:29.642985 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b6f9c-09e1-4806-bd75-1aa34c72436f None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:29.643063 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b6f9c-09e1-4806-bd75-1aa34c72436f None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:29.643426 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b6f9c-09e1-4806-bd75-1aa34c72436f None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:29.644671 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 319/640] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:50:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:50:29.645367 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4b6f9c-09e1-4806-bd75-1aa34c72436f None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:29.684816 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37253e36-9f7a-4452-a776-aeeff405e0da None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:29.715660 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474aab4c-1f11-41b9-8478-ff9b03eb4536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:29.716524 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474aab4c-1f11-41b9-8478-ff9b03eb4536 None admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:29.716805 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474aab4c-1f11-41b9-8478-ff9b03eb4536 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:29.717076 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474aab4c-1f11-41b9-8478-ff9b03eb4536 None admin] PATH_INFO: `/v3/projects/0911a024287e430ea6ee015389f0c440/users/c781fe7f4a014f0d8b5e7385b20b348c/roles/998d6a3451be42a89d4cff277851ad70` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:29.731222 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474aab4c-1f11-41b9-8478-ff9b03eb4536 None admin] RBAC: Authorizing `identity:create_grant(project_id=0911a024287e430ea6ee015389f0c440, user_id=c781fe7f4a014f0d8b5e7385b20b348c, role_id=998d6a3451be42a89d4cff277851ad70)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:29.732675 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474aab4c-1f11-41b9-8478-ff9b03eb4536 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:29.743018 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4b6f9c-09e1-4806-bd75-1aa34c72436f None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:29.780008 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29ffcbb-d8b8-49fe-841b-afbec7d3edd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:29.780647 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ffcbb-d8b8-49fe-841b-afbec7d3edd4 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:29.780963 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ffcbb-d8b8-49fe-841b-afbec7d3edd4 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:29.781235 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ffcbb-d8b8-49fe-841b-afbec7d3edd4 None admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:29.781936 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29ffcbb-d8b8-49fe-841b-afbec7d3edd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:29.782237 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29ffcbb-d8b8-49fe-841b-afbec7d3edd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:29.784363 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29ffcbb-d8b8-49fe-841b-afbec7d3edd4 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:29.795181 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 320/641] 10.222.0.52 () {56 vars in 1109 bytes} [Sat May 14 20:50:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:29.795985 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29ffcbb-d8b8-49fe-841b-afbec7d3edd4 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:29.850832 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 322/642] 10.222.0.52 () {58 vars in 1439 bytes} [Sat May 14 20:50:29 2022] PUT /identity/v3/projects/0911a024287e430ea6ee015389f0c440/users/c781fe7f4a014f0d8b5e7385b20b348c/roles/998d6a3451be42a89d4cff277851ad70 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 20:50:29.851619 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474aab4c-1f11-41b9-8478-ff9b03eb4536 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:29.898195 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29ffcbb-d8b8-49fe-841b-afbec7d3edd4 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:29.940177 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0068adb9-f4a3-48f4-95ca-f6f2236a0f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:29.940769 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0068adb9-f4a3-48f4-95ca-f6f2236a0f98 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:29.941053 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0068adb9-f4a3-48f4-95ca-f6f2236a0f98 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:29.941328 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0068adb9-f4a3-48f4-95ca-f6f2236a0f98 None admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:29.942115 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0068adb9-f4a3-48f4-95ca-f6f2236a0f98 None admin] RBAC: Adding query filter params (name=service) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:29.942423 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0068adb9-f4a3-48f4-95ca-f6f2236a0f98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:29.943856 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0068adb9-f4a3-48f4-95ca-f6f2236a0f98 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:29.957627 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 321/643] 10.222.0.52 () {56 vars in 1103 bytes} [Sat May 14 20:50:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:29.957627 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b1ccfe-8be3-4dfa-9e76-e8481d9912ea None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:29.957627 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b1ccfe-8be3-4dfa-9e76-e8481d9912ea None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:29.957627 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b1ccfe-8be3-4dfa-9e76-e8481d9912ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:29.958720 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474aab4c-1f11-41b9-8478-ff9b03eb4536 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:29.973581 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-d2b1ccfe-8be3-4dfa-9e76-e8481d9912ea None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:50:29.974815 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d2b1ccfe-8be3-4dfa-9e76-e8481d9912ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:50:29.995969 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05de051f-fe9b-46ff-9891-c0af7ad2922f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:29.996901 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de051f-fe9b-46ff-9891-c0af7ad2922f None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:29.997181 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de051f-fe9b-46ff-9891-c0af7ad2922f None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:29.997454 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de051f-fe9b-46ff-9891-c0af7ad2922f None admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:29.998241 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05de051f-fe9b-46ff-9891-c0af7ad2922f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:29.998540 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05de051f-fe9b-46ff-9891-c0af7ad2922f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:30.000028 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05de051f-fe9b-46ff-9891-c0af7ad2922f None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:30.018233 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 323/644] 10.222.0.52 () {56 vars in 1148 bytes} [Sat May 14 20:50:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:30.018233 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05de051f-fe9b-46ff-9891-c0af7ad2922f None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:30.048115 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 322/645] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:50:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 20:50:30.050054 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b1ccfe-8be3-4dfa-9e76-e8481d9912ea None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:30.120273 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05de051f-fe9b-46ff-9891-c0af7ad2922f None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:30.149760 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b1ccfe-8be3-4dfa-9e76-e8481d9912ea None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:30.153925 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da106459-9c4e-44f8-9cb0-87bcd72634b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:30.154723 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da106459-9c4e-44f8-9cb0-87bcd72634b2 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:30.155008 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da106459-9c4e-44f8-9cb0-87bcd72634b2 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:30.155287 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da106459-9c4e-44f8-9cb0-87bcd72634b2 None admin] PATH_INFO: `/v3/users/glance` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:30.163001 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da106459-9c4e-44f8-9cb0-87bcd72634b2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:30.164491 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da106459-9c4e-44f8-9cb0-87bcd72634b2 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:30.178965 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-da106459-9c4e-44f8-9cb0-87bcd72634b2 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 14 20:50:30.178965 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:30.178965 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:30.178965 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:30.178965 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:30.178965 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:30.178965 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:30.178965 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:30.178965 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:30.178965 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:30.178965 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:30.178965 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:30.178965 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 14 20:50:30.178965 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_user(user_id) May 14 20:50:30.178965 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 14 20:50:30.178965 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 14 20:50:30.180149 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:30.180149 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:30.180149 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 20:50:30.180149 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 20:50:30.180149 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 14 20:50:30.180149 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 20:50:30.180149 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:30.180149 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:30.180149 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:30.180149 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:30.180149 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:30.180149 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:50:30.180149 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:30.180149 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:30.180149 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:30.180149 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:30.180149 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:30.180149 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:30.181204 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:30.181204 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:30.181204 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 14 20:50:30.181204 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 14 20:50:30.181204 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 14 20:50:30.181204 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 14 20:50:30.181204 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 14 20:50:30.181204 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 14 20:50:30.181204 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 14 20:50:30.181204 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:30.181204 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 324/646] 10.222.0.52 () {56 vars in 1099 bytes} [Sat May 14 20:50:30 2022] GET /identity/v3/users/glance => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:30.181204 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da106459-9c4e-44f8-9cb0-87bcd72634b2 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:30.194097 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a054a3-a122-4c51-b41b-8653a77d5670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:30.195160 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a054a3-a122-4c51-b41b-8653a77d5670 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:30.195645 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a054a3-a122-4c51-b41b-8653a77d5670 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:30.196085 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a054a3-a122-4c51-b41b-8653a77d5670 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:30.206386 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a054a3-a122-4c51-b41b-8653a77d5670 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:30.208073 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a054a3-a122-4c51-b41b-8653a77d5670 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:30.228275 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-17a054a3-a122-4c51-b41b-8653a77d5670 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:30.228275 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:30.228275 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:30.228275 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:30.228275 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:30.228275 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:30.228275 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:30.228275 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:30.228275 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:30.228275 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:30.228275 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:30.228275 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:30.228275 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:50:30.228275 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:50:30.228275 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:50:30.229336 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:50:30.229336 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:30.229336 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:30.229336 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:30.229336 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:30.229336 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:30.229336 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:30.229336 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:30.229336 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:50:30.229336 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:30.229336 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:30.229336 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:30.229336 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:30.229336 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:30.229336 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:30.229336 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:30.229336 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:30.230214 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 20:50:30.230214 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:50:30.230214 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:30.230214 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:30.230447 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 323/647] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:50:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:30.231068 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a054a3-a122-4c51-b41b-8653a77d5670 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:30.292622 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da106459-9c4e-44f8-9cb0-87bcd72634b2 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:30.326893 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d4f88d-b37a-41cf-9ae6-e92cca0e9982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:30.327574 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d4f88d-b37a-41cf-9ae6-e92cca0e9982 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:30.327863 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d4f88d-b37a-41cf-9ae6-e92cca0e9982 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:30.328146 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d4f88d-b37a-41cf-9ae6-e92cca0e9982 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:30.329060 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d4f88d-b37a-41cf-9ae6-e92cca0e9982 None admin] RBAC: Adding query filter params (role.id=998d6a3451be42a89d4cff277851ad70, scope.project.id=0911a024287e430ea6ee015389f0c440, user.id=0f1b0e2b025d4eceaa90e1616d0a9db8) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:30.329365 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d4f88d-b37a-41cf-9ae6-e92cca0e9982 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:30.331297 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d4f88d-b37a-41cf-9ae6-e92cca0e9982 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:30.333633 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a054a3-a122-4c51-b41b-8653a77d5670 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:30.347508 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 325/648] 10.222.0.52 () {56 vars in 1374 bytes} [Sat May 14 20:50:30 2022] GET /identity/v3/role_assignments?user.id=0f1b0e2b025d4eceaa90e1616d0a9db8&scope.project.id=0911a024287e430ea6ee015389f0c440&role.id=998d6a3451be42a89d4cff277851ad70 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:30.347508 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d4f88d-b37a-41cf-9ae6-e92cca0e9982 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:30.380609 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52c2bfc-3984-41b1-bd00-f37cd8d11741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:30.381881 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c2bfc-3984-41b1-bd00-f37cd8d11741 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:30.382175 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c2bfc-3984-41b1-bd00-f37cd8d11741 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:30.382748 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c2bfc-3984-41b1-bd00-f37cd8d11741 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:30.398005 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52c2bfc-3984-41b1-bd00-f37cd8d11741 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:50:30.408145 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-b52c2bfc-3984-41b1-bd00-f37cd8d11741 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 14 20:50:30.408145 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:30.408145 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:30.408145 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:30.408145 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:30.408145 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:30.408145 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:30.408145 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:30.408145 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:30.408145 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:30.408145 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:30.408145 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:30.408145 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:50:30.408145 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:50:30.408145 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:50:30.408145 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:50:30.409192 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:50:30.409192 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:50:30.409192 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:50:30.409192 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:50:30.409192 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:30.409192 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:30.409192 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:30.409192 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:30.409192 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:30.409192 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:30.409192 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:30.409192 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:50:30.409192 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:30.409192 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:30.409192 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:30.409192 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:30.410131 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:30.410131 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:30.410131 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:30.410131 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:30.410131 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:50:30.410131 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:50:30.410131 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:50:30.410131 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:50:30.410131 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:50:30.410131 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:50:30.410131 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 14 20:50:30.410131 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:30.410777 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 324/649] 10.222.0.52 () {56 vars in 1102 bytes} [Sat May 14 20:50:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:30.415593 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52c2bfc-3984-41b1-bd00-f37cd8d11741 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:30.469433 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d4f88d-b37a-41cf-9ae6-e92cca0e9982 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:30.512967 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1982b21b-ed72-4e25-aeed-6e00207aadf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:30.514227 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982b21b-ed72-4e25-aeed-6e00207aadf5 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:30.514511 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982b21b-ed72-4e25-aeed-6e00207aadf5 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:30.515080 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982b21b-ed72-4e25-aeed-6e00207aadf5 None admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:30.516075 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1982b21b-ed72-4e25-aeed-6e00207aadf5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:30.516548 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1982b21b-ed72-4e25-aeed-6e00207aadf5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:30.519163 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1982b21b-ed72-4e25-aeed-6e00207aadf5 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:30.541991 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 326/650] 10.222.0.52 () {56 vars in 1137 bytes} [Sat May 14 20:50:30 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:30.543180 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1982b21b-ed72-4e25-aeed-6e00207aadf5 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:30.561609 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52c2bfc-3984-41b1-bd00-f37cd8d11741 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:30.603264 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aabb56-8f44-44ea-9a88-85568e2460af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:30.604286 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aabb56-8f44-44ea-9a88-85568e2460af None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:30.604730 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aabb56-8f44-44ea-9a88-85568e2460af None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:30.605014 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aabb56-8f44-44ea-9a88-85568e2460af None admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:30.605736 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aabb56-8f44-44ea-9a88-85568e2460af None admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:30.606043 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aabb56-8f44-44ea-9a88-85568e2460af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:30.607409 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aabb56-8f44-44ea-9a88-85568e2460af None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:30.622628 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 325/651] 10.222.0.52 () {56 vars in 1109 bytes} [Sat May 14 20:50:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:30.623502 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aabb56-8f44-44ea-9a88-85568e2460af None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:30.665727 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1982b21b-ed72-4e25-aeed-6e00207aadf5 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:30.706503 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db3c551-f131-44fa-b696-44765fef24dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:30.707361 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db3c551-f131-44fa-b696-44765fef24dd None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:30.707769 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db3c551-f131-44fa-b696-44765fef24dd None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:30.708643 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db3c551-f131-44fa-b696-44765fef24dd None admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:30.709503 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db3c551-f131-44fa-b696-44765fef24dd None admin] RBAC: Adding query filter params (name=service) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:30.709910 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db3c551-f131-44fa-b696-44765fef24dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:30.711774 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db3c551-f131-44fa-b696-44765fef24dd None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:30.723304 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 327/652] 10.222.0.52 () {56 vars in 1103 bytes} [Sat May 14 20:50:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:30.724591 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db3c551-f131-44fa-b696-44765fef24dd None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:30.734937 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aabb56-8f44-44ea-9a88-85568e2460af None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:30.778105 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd09d21-d9a7-4e3a-8097-b7fefe8c5733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:30.778917 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd09d21-d9a7-4e3a-8097-b7fefe8c5733 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:30.779698 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd09d21-d9a7-4e3a-8097-b7fefe8c5733 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:30.780082 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd09d21-d9a7-4e3a-8097-b7fefe8c5733 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:30.843457 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db3c551-f131-44fa-b696-44765fef24dd None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:30.858393 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd09d21-d9a7-4e3a-8097-b7fefe8c5733 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:30.860216 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd09d21-d9a7-4e3a-8097-b7fefe8c5733 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:30.890708 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5181ebd-c2b8-4d50-8197-2ec25df445eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:30.891832 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5181ebd-c2b8-4d50-8197-2ec25df445eb None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:30.892118 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5181ebd-c2b8-4d50-8197-2ec25df445eb None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:30.892400 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5181ebd-c2b8-4d50-8197-2ec25df445eb None admin] PATH_INFO: `/v3/users/neutron` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:30.902204 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5181ebd-c2b8-4d50-8197-2ec25df445eb None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:30.904065 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5181ebd-c2b8-4d50-8197-2ec25df445eb None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:30.929876 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-f5181ebd-c2b8-4d50-8197-2ec25df445eb None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 14 20:50:30.929876 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:30.929876 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:30.929876 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:30.929876 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:30.929876 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:30.929876 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:30.929876 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:30.929876 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:30.929876 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:30.929876 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:30.929876 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:30.929876 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 14 20:50:30.929876 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_user(user_id) May 14 20:50:30.929876 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 14 20:50:30.929876 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 14 20:50:30.930833 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:30.930833 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:30.930833 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 20:50:30.930833 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 20:50:30.930833 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 14 20:50:30.930833 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 20:50:30.930833 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:30.930833 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:30.930833 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:30.930833 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:30.930833 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:30.930833 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:50:30.930833 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:30.930833 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:30.930833 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:30.930833 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:30.930833 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:30.930833 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:30.936591 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:30.936591 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:30.936591 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 14 20:50:30.936591 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 14 20:50:30.936591 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 14 20:50:30.936591 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 14 20:50:30.936591 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 14 20:50:30.936591 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 14 20:50:30.936591 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 14 20:50:30.936591 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:30.936591 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 328/653] 10.222.0.52 () {56 vars in 1102 bytes} [Sat May 14 20:50:30 2022] GET /identity/v3/users/neutron => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:30.936591 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5181ebd-c2b8-4d50-8197-2ec25df445eb None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:30.979167 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 326/654] 10.222.0.52 () {58 vars in 1282 bytes} [Sat May 14 20:50:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 14 20:50:30.980867 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd09d21-d9a7-4e3a-8097-b7fefe8c5733 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:31.057729 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5181ebd-c2b8-4d50-8197-2ec25df445eb None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:31.085956 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd09d21-d9a7-4e3a-8097-b7fefe8c5733 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:31.099902 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32459338-8662-42c7-8fcc-87f97572d934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:31.100897 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32459338-8662-42c7-8fcc-87f97572d934 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:31.101188 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32459338-8662-42c7-8fcc-87f97572d934 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:31.101467 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32459338-8662-42c7-8fcc-87f97572d934 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:31.115031 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32459338-8662-42c7-8fcc-87f97572d934 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:31.117268 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32459338-8662-42c7-8fcc-87f97572d934 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:31.124429 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c024145b-0b11-49f8-be79-324bf584c445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:31.125369 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c024145b-0b11-49f8-be79-324bf584c445 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:31.132165 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c024145b-0b11-49f8-be79-324bf584c445 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:31.132165 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c024145b-0b11-49f8-be79-324bf584c445 None admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:31.132165 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c024145b-0b11-49f8-be79-324bf584c445 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:31.132165 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c024145b-0b11-49f8-be79-324bf584c445 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:31.132165 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c024145b-0b11-49f8-be79-324bf584c445 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:31.139362 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-32459338-8662-42c7-8fcc-87f97572d934 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:31.139362 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:31.139362 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:31.139362 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:31.139362 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:31.139362 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:31.139362 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:31.139362 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:31.139362 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:31.139362 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:31.139362 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:31.139362 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:31.139362 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:50:31.139362 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:50:31.139362 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:50:31.140281 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:50:31.140281 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:31.140281 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:31.140281 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:31.140281 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:31.140281 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:31.140281 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:31.140281 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:31.140281 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:50:31.140281 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:31.140281 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:31.140281 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:31.140281 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:31.140281 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:31.140281 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:31.140281 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:31.140281 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:31.141771 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 20:50:31.141771 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:50:31.141771 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:31.141771 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:31.141771 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 329/655] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:50:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:31.141771 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32459338-8662-42c7-8fcc-87f97572d934 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:31.155802 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 327/656] 10.222.0.52 () {56 vars in 1139 bytes} [Sat May 14 20:50:30 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:31.157014 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c024145b-0b11-49f8-be79-324bf584c445 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:31.250713 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32459338-8662-42c7-8fcc-87f97572d934 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:31.258047 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c024145b-0b11-49f8-be79-324bf584c445 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:31.290566 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec35fc6e-f9b6-4ba4-a1be-025995759cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:31.291805 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35fc6e-f9b6-4ba4-a1be-025995759cbb None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:31.292299 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35fc6e-f9b6-4ba4-a1be-025995759cbb None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:31.292777 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35fc6e-f9b6-4ba4-a1be-025995759cbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:31.300287 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e9c2e5-f945-48f8-9b9b-6b874c3130e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:31.300952 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9c2e5-f945-48f8-9b9b-6b874c3130e5 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:31.301597 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9c2e5-f945-48f8-9b9b-6b874c3130e5 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:31.301597 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9c2e5-f945-48f8-9b9b-6b874c3130e5 None admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:31.302211 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e9c2e5-f945-48f8-9b9b-6b874c3130e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:31.302517 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e9c2e5-f945-48f8-9b9b-6b874c3130e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:31.304024 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e9c2e5-f945-48f8-9b9b-6b874c3130e5 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:31.306072 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec35fc6e-f9b6-4ba4-a1be-025995759cbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:31.307770 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec35fc6e-f9b6-4ba4-a1be-025995759cbb None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:31.316050 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 328/657] 10.222.0.52 () {56 vars in 1109 bytes} [Sat May 14 20:50:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:31.316950 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e9c2e5-f945-48f8-9b9b-6b874c3130e5 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:31.326957 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-ec35fc6e-f9b6-4ba4-a1be-025995759cbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:31.326957 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:31.326957 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:31.326957 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:31.326957 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:31.326957 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:31.326957 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:31.326957 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:31.326957 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:31.326957 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:31.326957 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:31.326957 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:31.326957 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:50:31.326957 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:50:31.326957 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:50:31.327922 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:50:31.327922 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:31.327922 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:31.327922 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:31.327922 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:31.327922 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:31.327922 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:31.327922 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:31.327922 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:50:31.327922 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:31.327922 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:31.327922 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:31.327922 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:31.327922 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:31.327922 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:31.327922 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:31.327922 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:31.328837 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 20:50:31.328837 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:50:31.328837 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:31.328837 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:31.331254 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 330/658] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:50:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:31.332466 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec35fc6e-f9b6-4ba4-a1be-025995759cbb None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:31.423539 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e9c2e5-f945-48f8-9b9b-6b874c3130e5 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:31.440706 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec35fc6e-f9b6-4ba4-a1be-025995759cbb None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:31.459026 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b42ae68-268b-4e24-88c7-3a692ed5f8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:31.459780 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42ae68-268b-4e24-88c7-3a692ed5f8db None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:31.460073 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42ae68-268b-4e24-88c7-3a692ed5f8db None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:31.460335 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42ae68-268b-4e24-88c7-3a692ed5f8db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:31.476532 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1933ad2-da79-4a2f-9a2e-e58e55791575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:31.477713 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1933ad2-da79-4a2f-9a2e-e58e55791575 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:31.478212 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1933ad2-da79-4a2f-9a2e-e58e55791575 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:31.478755 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1933ad2-da79-4a2f-9a2e-e58e55791575 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:31.487390 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1933ad2-da79-4a2f-9a2e-e58e55791575 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:31.489345 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1933ad2-da79-4a2f-9a2e-e58e55791575 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:31.507007 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-c1933ad2-da79-4a2f-9a2e-e58e55791575 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 14 20:50:31.507007 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:31.507007 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:31.507007 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:31.507007 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:31.507007 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:31.507007 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:31.507007 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:31.507007 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:31.507007 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:31.507007 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:31.507007 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:31.507007 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 14 20:50:31.507007 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_user(user_id) May 14 20:50:31.507007 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 14 20:50:31.507007 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 14 20:50:31.508519 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:31.508519 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:31.508519 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 20:50:31.508519 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 20:50:31.508519 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 14 20:50:31.508519 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 20:50:31.508519 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:31.508519 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:31.508519 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:31.508519 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:31.508519 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:31.508519 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:50:31.508519 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:31.508519 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:31.508519 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:31.508519 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:31.508519 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:31.508519 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:31.509484 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:31.509484 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:31.509484 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 14 20:50:31.509484 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 14 20:50:31.509484 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 14 20:50:31.509484 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 14 20:50:31.509484 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 14 20:50:31.509484 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 14 20:50:31.509484 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 14 20:50:31.509484 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:31.510971 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 331/659] 10.222.0.52 () {56 vars in 1099 bytes} [Sat May 14 20:50:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:31.512134 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1933ad2-da79-4a2f-9a2e-e58e55791575 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:31.529498 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b42ae68-268b-4e24-88c7-3a692ed5f8db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:31.530966 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b42ae68-268b-4e24-88c7-3a692ed5f8db None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:31.625794 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1933ad2-da79-4a2f-9a2e-e58e55791575 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:31.637146 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 329/660] 10.222.0.52 () {58 vars in 1282 bytes} [Sat May 14 20:50:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 14 20:50:31.637146 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b42ae68-268b-4e24-88c7-3a692ed5f8db None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:31.673123 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2142db60-01b8-47b9-bdf2-71d84fabed9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:31.674340 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142db60-01b8-47b9-bdf2-71d84fabed9a None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:31.674628 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142db60-01b8-47b9-bdf2-71d84fabed9a None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:31.674904 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142db60-01b8-47b9-bdf2-71d84fabed9a None admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:31.675661 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2142db60-01b8-47b9-bdf2-71d84fabed9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:31.675968 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2142db60-01b8-47b9-bdf2-71d84fabed9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:31.677505 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2142db60-01b8-47b9-bdf2-71d84fabed9a None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:31.693673 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 332/661] 10.222.0.52 () {56 vars in 1109 bytes} [Sat May 14 20:50:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:31.694528 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2142db60-01b8-47b9-bdf2-71d84fabed9a None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:31.749659 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b42ae68-268b-4e24-88c7-3a692ed5f8db None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:31.790081 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10a74be-0327-4819-935b-ece1bbf2d004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:31.791565 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a74be-0327-4819-935b-ece1bbf2d004 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:31.792084 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a74be-0327-4819-935b-ece1bbf2d004 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:31.792902 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a74be-0327-4819-935b-ece1bbf2d004 None admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:31.794225 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10a74be-0327-4819-935b-ece1bbf2d004 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:31.794722 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10a74be-0327-4819-935b-ece1bbf2d004 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:31.796815 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10a74be-0327-4819-935b-ece1bbf2d004 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:31.816764 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2142db60-01b8-47b9-bdf2-71d84fabed9a None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:31.825844 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 330/662] 10.222.0.52 () {56 vars in 1137 bytes} [Sat May 14 20:50:31 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:31.825844 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10a74be-0327-4819-935b-ece1bbf2d004 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:31.854371 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe625664-d6d5-435d-a0ec-b67c18ad123c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:31.855157 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe625664-d6d5-435d-a0ec-b67c18ad123c None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:31.855438 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe625664-d6d5-435d-a0ec-b67c18ad123c None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:31.855738 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe625664-d6d5-435d-a0ec-b67c18ad123c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:31.866129 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe625664-d6d5-435d-a0ec-b67c18ad123c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:31.867605 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe625664-d6d5-435d-a0ec-b67c18ad123c None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:31.886078 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-fe625664-d6d5-435d-a0ec-b67c18ad123c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:31.886078 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:31.886078 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:31.886078 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:31.886078 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:31.886078 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:31.886078 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:31.886078 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:31.886078 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:31.886078 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:31.886078 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:31.886078 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:31.886078 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:50:31.886078 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:50:31.886078 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:50:31.887014 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:50:31.887014 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:31.887014 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:31.887014 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:31.887014 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:31.887014 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:31.887014 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:31.887014 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:31.887014 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:50:31.887014 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:31.887014 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:31.887014 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:31.887014 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:31.887014 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:31.887014 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:31.887014 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:31.887014 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:31.888578 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 20:50:31.888578 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:50:31.888578 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:31.888578 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:31.888578 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 333/663] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:50:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:31.888578 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe625664-d6d5-435d-a0ec-b67c18ad123c None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:31.957528 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10a74be-0327-4819-935b-ece1bbf2d004 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:31.991426 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe625664-d6d5-435d-a0ec-b67c18ad123c None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:32.007836 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4630560d-8567-42b1-8861-914621f45c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:32.009344 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4630560d-8567-42b1-8861-914621f45c0a None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:32.010092 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4630560d-8567-42b1-8861-914621f45c0a None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:32.010523 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4630560d-8567-42b1-8861-914621f45c0a None admin] PATH_INFO: `/v3/projects/service` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:32.019983 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4630560d-8567-42b1-8861-914621f45c0a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:32.022468 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4630560d-8567-42b1-8861-914621f45c0a None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:32.027061 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a76a94-291b-4acb-9473-d3338f21f14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:32.027852 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a76a94-291b-4acb-9473-d3338f21f14d None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:32.028245 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a76a94-291b-4acb-9473-d3338f21f14d None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:32.028619 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a76a94-291b-4acb-9473-d3338f21f14d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:32.039410 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-4630560d-8567-42b1-8861-914621f45c0a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 14 20:50:32.039410 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:32.039410 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:32.039410 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:32.039410 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:32.039410 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:32.039410 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:32.039410 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:32.039410 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:32.039410 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:32.039410 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:32.039410 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:32.039410 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 14 20:50:32.039410 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_project(project_id) May 14 20:50:32.039410 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 14 20:50:32.040547 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 14 20:50:32.040547 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:32.040547 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:32.040547 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:32.040547 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:32.040547 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:32.040547 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:32.040547 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:32.040547 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:50:32.040547 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:32.040547 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:32.040547 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:32.040547 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:32.040547 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:32.040547 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:32.040547 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:32.040547 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:32.041661 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 14 20:50:32.041661 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 14 20:50:32.041661 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 20:50:32.041661 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 20:50:32.041661 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 20:50:32.041661 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 20:50:32.041661 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 14 20:50:32.041661 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:32.044423 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 331/664] 10.222.0.52 () {56 vars in 1111 bytes} [Sat May 14 20:50:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:32.045402 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4630560d-8567-42b1-8861-914621f45c0a None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:32.115890 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a76a94-291b-4acb-9473-d3338f21f14d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:32.117593 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a76a94-291b-4acb-9473-d3338f21f14d None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:32.157645 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4630560d-8567-42b1-8861-914621f45c0a None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:32.197150 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eca751-5454-4930-bcf6-bfbc74f9e2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:32.197972 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eca751-5454-4930-bcf6-bfbc74f9e2bf None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:32.198353 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eca751-5454-4930-bcf6-bfbc74f9e2bf None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:32.199097 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eca751-5454-4930-bcf6-bfbc74f9e2bf None admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:32.200001 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eca751-5454-4930-bcf6-bfbc74f9e2bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:32.200407 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eca751-5454-4930-bcf6-bfbc74f9e2bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:32.202546 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eca751-5454-4930-bcf6-bfbc74f9e2bf None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:32.218357 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 332/665] 10.222.0.52 () {56 vars in 1109 bytes} [Sat May 14 20:50:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:32.219461 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eca751-5454-4930-bcf6-bfbc74f9e2bf None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:32.228998 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 334/666] 10.222.0.52 () {58 vars in 1282 bytes} [Sat May 14 20:50:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 14 20:50:32.230127 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a76a94-291b-4acb-9473-d3338f21f14d None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:32.333177 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eca751-5454-4930-bcf6-bfbc74f9e2bf None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:32.345237 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a76a94-291b-4acb-9473-d3338f21f14d None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:32.366933 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f92c5ee-66d9-4a45-bcea-64da41b27507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:32.367622 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92c5ee-66d9-4a45-bcea-64da41b27507 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:32.367912 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92c5ee-66d9-4a45-bcea-64da41b27507 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:32.368192 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92c5ee-66d9-4a45-bcea-64da41b27507 None admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:32.368976 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f92c5ee-66d9-4a45-bcea-64da41b27507 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:32.369285 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f92c5ee-66d9-4a45-bcea-64da41b27507 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:32.370710 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f92c5ee-66d9-4a45-bcea-64da41b27507 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:32.381609 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee216036-c62e-48d4-8414-5eb19a03fb2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:32.382620 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 333/667] 10.222.0.52 () {56 vars in 1148 bytes} [Sat May 14 20:50:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:32.382961 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee216036-c62e-48d4-8414-5eb19a03fb2f None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:32.383443 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f92c5ee-66d9-4a45-bcea-64da41b27507 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:32.383577 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee216036-c62e-48d4-8414-5eb19a03fb2f None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:32.384136 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee216036-c62e-48d4-8414-5eb19a03fb2f None admin] PATH_INFO: `/v3/projects/service` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:32.393973 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee216036-c62e-48d4-8414-5eb19a03fb2f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:32.395805 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee216036-c62e-48d4-8414-5eb19a03fb2f None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:32.411698 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-ee216036-c62e-48d4-8414-5eb19a03fb2f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 14 20:50:32.411698 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:32.411698 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:32.411698 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:32.411698 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:32.411698 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:32.411698 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:32.411698 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:32.411698 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:32.411698 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:32.411698 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:32.411698 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:32.411698 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 14 20:50:32.411698 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_project(project_id) May 14 20:50:32.411698 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 14 20:50:32.412595 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 14 20:50:32.412595 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:32.412595 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:32.412595 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:32.412595 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:32.412595 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:32.412595 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:32.412595 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:32.412595 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:50:32.412595 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:32.412595 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:32.412595 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:32.412595 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:32.412595 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:32.412595 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:32.412595 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:32.412595 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:32.413563 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 14 20:50:32.413563 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 14 20:50:32.413563 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 20:50:32.413563 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 20:50:32.413563 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 20:50:32.413563 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 20:50:32.413563 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 14 20:50:32.413563 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:32.415681 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 335/668] 10.222.0.52 () {56 vars in 1111 bytes} [Sat May 14 20:50:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:32.417103 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac10ce-0519-4e12-816c-e109fa23cf2b None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:32.417393 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac10ce-0519-4e12-816c-e109fa23cf2b None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:32.417668 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac10ce-0519-4e12-816c-e109fa23cf2b None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:32.422371 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 336/669] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:50:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:50:32.422371 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffac10ce-0519-4e12-816c-e109fa23cf2b None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:32.494988 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f92c5ee-66d9-4a45-bcea-64da41b27507 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:32.522393 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffac10ce-0519-4e12-816c-e109fa23cf2b None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:32.531459 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9afdf3-2041-43c5-9f69-28308d374a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:32.532280 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9afdf3-2041-43c5-9f69-28308d374a0f None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:32.532561 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9afdf3-2041-43c5-9f69-28308d374a0f None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:32.532836 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9afdf3-2041-43c5-9f69-28308d374a0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:32.544729 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9afdf3-2041-43c5-9f69-28308d374a0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:32.546168 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9afdf3-2041-43c5-9f69-28308d374a0f None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:32.558183 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b38e927-2b94-4ed2-ada9-b590c9ebdde9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:32.559064 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38e927-2b94-4ed2-ada9-b590c9ebdde9 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:32.559584 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38e927-2b94-4ed2-ada9-b590c9ebdde9 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:32.560042 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38e927-2b94-4ed2-ada9-b590c9ebdde9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:32.561034 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b38e927-2b94-4ed2-ada9-b590c9ebdde9 None admin] RBAC: Adding query filter params (role.id=998d6a3451be42a89d4cff277851ad70, scope.project.id=0911a024287e430ea6ee015389f0c440, user.id=7b5cb86f190f4fcfb06d66cb8f14643f) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:32.561541 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b38e927-2b94-4ed2-ada9-b590c9ebdde9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:32.562826 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-ad9afdf3-2041-43c5-9f69-28308d374a0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:32.562826 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:32.562826 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:32.562826 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:32.562826 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:32.562826 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:32.562826 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:32.562826 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:32.562826 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:32.562826 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:32.562826 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:32.562826 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:32.562826 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:50:32.562826 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:50:32.562826 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:50:32.563715 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:50:32.563715 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:32.563715 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:32.563715 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:32.563715 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:32.563715 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:32.563715 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:32.563715 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:32.563715 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:50:32.563715 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:32.563715 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:32.563715 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:32.563715 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:32.563715 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:32.563715 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:32.563715 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:32.563715 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:32.564879 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 20:50:32.564879 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:50:32.564879 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:32.564879 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:32.564879 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 334/670] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:50:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:32.565523 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b38e927-2b94-4ed2-ada9-b590c9ebdde9 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:32.565619 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9afdf3-2041-43c5-9f69-28308d374a0f None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:32.573512 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 337/671] 10.222.0.52 () {56 vars in 1374 bytes} [Sat May 14 20:50:32 2022] GET /identity/v3/role_assignments?user.id=7b5cb86f190f4fcfb06d66cb8f14643f&scope.project.id=0911a024287e430ea6ee015389f0c440&role.id=998d6a3451be42a89d4cff277851ad70 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:32.574736 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8188a7-159e-468d-a204-0f9c37637244 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:32.575018 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8188a7-159e-468d-a204-0f9c37637244 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:32.575287 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8188a7-159e-468d-a204-0f9c37637244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:32.601026 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-bf8188a7-159e-468d-a204-0f9c37637244 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:50:32.602492 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-bf8188a7-159e-468d-a204-0f9c37637244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:50:32.711939 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 338/672] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:50:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 20:50:32.712970 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8188a7-159e-468d-a204-0f9c37637244 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:32.723197 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9afdf3-2041-43c5-9f69-28308d374a0f None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:32.770880 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683a88f0-74e0-4505-b509-84b1f21b443b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:32.771997 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683a88f0-74e0-4505-b509-84b1f21b443b None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:32.773316 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683a88f0-74e0-4505-b509-84b1f21b443b None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:32.773794 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683a88f0-74e0-4505-b509-84b1f21b443b None admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:32.774755 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683a88f0-74e0-4505-b509-84b1f21b443b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:32.775218 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683a88f0-74e0-4505-b509-84b1f21b443b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:32.776912 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683a88f0-74e0-4505-b509-84b1f21b443b None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:32.794956 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 335/673] 10.222.0.52 () {56 vars in 1148 bytes} [Sat May 14 20:50:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:32.796744 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683a88f0-74e0-4505-b509-84b1f21b443b None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:32.846978 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8188a7-159e-468d-a204-0f9c37637244 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:32.895372 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca0b20d-f60b-47d9-981b-3a926ba023e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:32.896565 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca0b20d-f60b-47d9-981b-3a926ba023e3 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:32.896677 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca0b20d-f60b-47d9-981b-3a926ba023e3 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:32.897007 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca0b20d-f60b-47d9-981b-3a926ba023e3 None admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:32.897730 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca0b20d-f60b-47d9-981b-3a926ba023e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:32.898035 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca0b20d-f60b-47d9-981b-3a926ba023e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:32.899686 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca0b20d-f60b-47d9-981b-3a926ba023e3 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:32.912117 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 339/674] 10.222.0.52 () {56 vars in 1109 bytes} [Sat May 14 20:50:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:32.913024 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca0b20d-f60b-47d9-981b-3a926ba023e3 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:32.921458 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683a88f0-74e0-4505-b509-84b1f21b443b None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:32.964782 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f6a66b-6037-44d3-96f0-19fb362f666a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:32.965591 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f6a66b-6037-44d3-96f0-19fb362f666a None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:32.965870 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f6a66b-6037-44d3-96f0-19fb362f666a None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:32.966307 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f6a66b-6037-44d3-96f0-19fb362f666a None admin] PATH_INFO: `/v3/roles/service` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:32.977595 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f6a66b-6037-44d3-96f0-19fb362f666a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:50:32.985543 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-54f6a66b-6037-44d3-96f0-19fb362f666a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 14 20:50:32.985543 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:32.985543 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:32.985543 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:32.985543 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:32.985543 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:32.985543 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:32.985543 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:32.985543 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:32.985543 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:32.985543 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:32.985543 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:32.985543 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:50:32.985543 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:50:32.985543 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:50:32.985543 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:50:32.987358 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:50:32.987358 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:50:32.987358 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:50:32.987358 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:50:32.987358 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:32.987358 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:32.987358 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:32.987358 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:32.987358 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:32.987358 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:32.987358 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:32.987358 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:50:32.987358 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:32.987358 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:32.987358 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:32.987358 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:32.988817 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:32.988817 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:32.988817 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:32.988817 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:32.988817 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:50:32.988817 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:50:32.988817 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:50:32.988817 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:50:32.988817 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:50:32.988817 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:50:32.988817 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 14 20:50:32.988817 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:32.988817 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 336/675] 10.222.0.52 () {56 vars in 1102 bytes} [Sat May 14 20:50:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:32.988817 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8789f30-a425-498e-8661-636c599bc0a0 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:32.990543 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8789f30-a425-498e-8661-636c599bc0a0 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:32.990543 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8789f30-a425-498e-8661-636c599bc0a0 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:32.990835 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 337/676] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:50:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:50:32.991466 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8789f30-a425-498e-8661-636c599bc0a0 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:33.031787 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca0b20d-f60b-47d9-981b-3a926ba023e3 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:33.067155 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377342a5-80ec-45ab-af3a-f97abf47e956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:33.067831 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377342a5-80ec-45ab-af3a-f97abf47e956 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:33.068111 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377342a5-80ec-45ab-af3a-f97abf47e956 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:33.068383 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377342a5-80ec-45ab-af3a-f97abf47e956 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:33.069196 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377342a5-80ec-45ab-af3a-f97abf47e956 None admin] RBAC: Adding query filter params (role.id=998d6a3451be42a89d4cff277851ad70, scope.project.id=0911a024287e430ea6ee015389f0c440, user.id=99ed32a6d699453bb7e088540e8fc980) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:33.069566 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377342a5-80ec-45ab-af3a-f97abf47e956 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:33.070994 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377342a5-80ec-45ab-af3a-f97abf47e956 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:33.076749 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 340/677] 10.222.0.52 () {56 vars in 1374 bytes} [Sat May 14 20:50:32 2022] GET /identity/v3/role_assignments?user.id=99ed32a6d699453bb7e088540e8fc980&scope.project.id=0911a024287e430ea6ee015389f0c440&role.id=998d6a3451be42a89d4cff277851ad70 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:33.077540 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377342a5-80ec-45ab-af3a-f97abf47e956 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:33.115591 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8789f30-a425-498e-8661-636c599bc0a0 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:33.167885 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed462ff3-6ab7-4d92-a951-9a85cbf628bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:33.169082 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed462ff3-6ab7-4d92-a951-9a85cbf628bb None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:33.169983 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed462ff3-6ab7-4d92-a951-9a85cbf628bb None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:33.170471 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed462ff3-6ab7-4d92-a951-9a85cbf628bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:33.181259 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed462ff3-6ab7-4d92-a951-9a85cbf628bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:33.183705 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed462ff3-6ab7-4d92-a951-9a85cbf628bb None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:33.197743 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377342a5-80ec-45ab-af3a-f97abf47e956 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:33.204464 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-ed462ff3-6ab7-4d92-a951-9a85cbf628bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 14 20:50:33.204464 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:33.204464 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:33.204464 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:33.204464 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:33.204464 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:33.204464 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:33.204464 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:33.204464 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:33.204464 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:33.204464 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:33.204464 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:33.204464 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 14 20:50:33.204464 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_project(project_id) May 14 20:50:33.204464 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 14 20:50:33.206116 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 14 20:50:33.206116 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:33.206116 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:33.206116 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:33.206116 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:33.206116 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:33.206116 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:33.206116 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:33.206116 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:50:33.206116 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:33.206116 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:33.206116 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:33.206116 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:33.206116 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:33.206116 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:33.206116 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:33.206116 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:33.207024 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 14 20:50:33.207024 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 14 20:50:33.207024 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 20:50:33.207024 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 20:50:33.207024 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 20:50:33.207024 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 20:50:33.207024 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 14 20:50:33.207024 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:33.213688 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 338/678] 10.222.0.52 () {56 vars in 1111 bytes} [Sat May 14 20:50:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:33.213688 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb49f35b-8211-4e26-9b3c-65cd15b06262 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:33.213688 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb49f35b-8211-4e26-9b3c-65cd15b06262 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:33.213688 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb49f35b-8211-4e26-9b3c-65cd15b06262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:33.235469 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-fb49f35b-8211-4e26-9b3c-65cd15b06262 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:50:33.237754 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-fb49f35b-8211-4e26-9b3c-65cd15b06262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:50:33.244248 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a62bd2-e291-4848-89c3-d878e50b80b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:33.245098 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a62bd2-e291-4848-89c3-d878e50b80b2 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:33.245475 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a62bd2-e291-4848-89c3-d878e50b80b2 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:33.245844 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a62bd2-e291-4848-89c3-d878e50b80b2 None admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:33.247022 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a62bd2-e291-4848-89c3-d878e50b80b2 None admin] RBAC: Adding query filter params (name=service) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:33.247426 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a62bd2-e291-4848-89c3-d878e50b80b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:33.249077 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a62bd2-e291-4848-89c3-d878e50b80b2 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:33.258948 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 341/679] 10.222.0.52 () {56 vars in 1103 bytes} [Sat May 14 20:50:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:33.260226 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a62bd2-e291-4848-89c3-d878e50b80b2 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:33.324965 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 339/680] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:50:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 20:50:33.325786 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb49f35b-8211-4e26-9b3c-65cd15b06262 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:33.383518 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a62bd2-e291-4848-89c3-d878e50b80b2 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:33.422568 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ed27bc-3ff6-4376-8791-d7f6a3877759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:33.423153 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed27bc-3ff6-4376-8791-d7f6a3877759 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:33.423436 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed27bc-3ff6-4376-8791-d7f6a3877759 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:33.423831 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed27bc-3ff6-4376-8791-d7f6a3877759 None admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:33.424818 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ed27bc-3ff6-4376-8791-d7f6a3877759 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:33.425130 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ed27bc-3ff6-4376-8791-d7f6a3877759 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:33.427259 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ed27bc-3ff6-4376-8791-d7f6a3877759 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:33.447786 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 342/681] 10.222.0.52 () {56 vars in 1148 bytes} [Sat May 14 20:50:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:33.447786 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ed27bc-3ff6-4376-8791-d7f6a3877759 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:33.469158 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb49f35b-8211-4e26-9b3c-65cd15b06262 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:33.513537 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba06598-f66d-460a-a07a-e27f687d056f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:33.514788 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba06598-f66d-460a-a07a-e27f687d056f None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:33.515070 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba06598-f66d-460a-a07a-e27f687d056f None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:33.515342 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba06598-f66d-460a-a07a-e27f687d056f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:33.528374 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba06598-f66d-460a-a07a-e27f687d056f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:33.530483 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba06598-f66d-460a-a07a-e27f687d056f None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:33.553280 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-9ba06598-f66d-460a-a07a-e27f687d056f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:33.553280 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:33.553280 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:33.553280 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:33.553280 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:33.553280 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:33.553280 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:33.553280 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:33.553280 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:33.553280 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:33.553280 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:33.553280 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:33.553280 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:50:33.553280 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:50:33.553280 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:50:33.554277 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:50:33.554277 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:33.554277 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:33.554277 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:33.554277 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:33.554277 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:33.554277 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:33.554277 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:33.554277 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:50:33.554277 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:33.554277 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:33.554277 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:33.554277 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:33.554277 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:33.554277 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:33.554277 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:33.554277 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:33.555208 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 20:50:33.555208 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:50:33.555208 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:33.555208 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:33.555208 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 340/682] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:50:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:33.555949 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba06598-f66d-460a-a07a-e27f687d056f None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:33.571031 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ed27bc-3ff6-4376-8791-d7f6a3877759 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:33.614817 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31759dc5-9be2-4972-a20c-33e66f9aea5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:33.616195 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31759dc5-9be2-4972-a20c-33e66f9aea5e None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:33.617002 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31759dc5-9be2-4972-a20c-33e66f9aea5e None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:33.617504 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31759dc5-9be2-4972-a20c-33e66f9aea5e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:33.635843 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31759dc5-9be2-4972-a20c-33e66f9aea5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:50:33.646673 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-31759dc5-9be2-4972-a20c-33e66f9aea5e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 14 20:50:33.646673 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:33.646673 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:33.646673 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:33.646673 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:33.646673 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:33.646673 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:33.646673 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:33.646673 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:33.646673 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:33.646673 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:33.646673 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:33.646673 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:50:33.646673 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:50:33.646673 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:50:33.646673 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:50:33.647748 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:50:33.647748 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:50:33.647748 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:50:33.647748 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:50:33.647748 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:33.647748 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:33.647748 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:33.647748 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:33.647748 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:33.647748 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:33.647748 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:33.647748 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:50:33.647748 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:33.647748 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:33.647748 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:33.647748 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:33.648591 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:33.648591 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:33.648591 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:33.648591 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:33.648591 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:50:33.648591 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:50:33.648591 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:50:33.648591 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:50:33.648591 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:50:33.648591 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:50:33.648591 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 14 20:50:33.648591 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:33.656573 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 343/683] 10.222.0.52 () {56 vars in 1096 bytes} [Sat May 14 20:50:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:33.656573 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31759dc5-9be2-4972-a20c-33e66f9aea5e None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:33.695921 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba06598-f66d-460a-a07a-e27f687d056f None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:33.733701 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334d0e6c-8013-4519-96dc-84db98817418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:33.734702 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d0e6c-8013-4519-96dc-84db98817418 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:33.734702 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d0e6c-8013-4519-96dc-84db98817418 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:33.734993 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d0e6c-8013-4519-96dc-84db98817418 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:33.735852 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334d0e6c-8013-4519-96dc-84db98817418 None admin] RBAC: Adding query filter params (role.id=998d6a3451be42a89d4cff277851ad70, scope.project.id=0911a024287e430ea6ee015389f0c440, user.id=198271d1c0d44cb58bace41a65f4b94c) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:33.736781 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334d0e6c-8013-4519-96dc-84db98817418 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:33.738274 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334d0e6c-8013-4519-96dc-84db98817418 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:33.751870 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 341/684] 10.222.0.52 () {56 vars in 1374 bytes} [Sat May 14 20:50:33 2022] GET /identity/v3/role_assignments?user.id=198271d1c0d44cb58bace41a65f4b94c&scope.project.id=0911a024287e430ea6ee015389f0c440&role.id=998d6a3451be42a89d4cff277851ad70 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:33.753535 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334d0e6c-8013-4519-96dc-84db98817418 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:33.792609 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31759dc5-9be2-4972-a20c-33e66f9aea5e None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:33.840904 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee043487-ed47-49ab-a374-5f0c307ac47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:33.841581 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee043487-ed47-49ab-a374-5f0c307ac47b None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:33.841862 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee043487-ed47-49ab-a374-5f0c307ac47b None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:33.842143 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee043487-ed47-49ab-a374-5f0c307ac47b None admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:33.842868 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee043487-ed47-49ab-a374-5f0c307ac47b None admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:33.843175 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee043487-ed47-49ab-a374-5f0c307ac47b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:33.845765 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee043487-ed47-49ab-a374-5f0c307ac47b None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:33.873956 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 344/685] 10.222.0.52 () {56 vars in 1109 bytes} [Sat May 14 20:50:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:33.880326 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee043487-ed47-49ab-a374-5f0c307ac47b None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:33.975557 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334d0e6c-8013-4519-96dc-84db98817418 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:34.024501 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee043487-ed47-49ab-a374-5f0c307ac47b None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:34.046832 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0417af9-b661-4661-9099-60da34445447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:34.047513 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0417af9-b661-4661-9099-60da34445447 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:34.047801 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0417af9-b661-4661-9099-60da34445447 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:34.048072 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0417af9-b661-4661-9099-60da34445447 None admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:34.048911 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0417af9-b661-4661-9099-60da34445447 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:34.049416 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0417af9-b661-4661-9099-60da34445447 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:34.050964 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0417af9-b661-4661-9099-60da34445447 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:34.059445 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 342/686] 10.222.0.52 () {56 vars in 1099 bytes} [Sat May 14 20:50:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:34.065034 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0417af9-b661-4661-9099-60da34445447 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:34.067174 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef2ae36-80f7-4a7b-a35c-6e0a9ce14420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:34.068025 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef2ae36-80f7-4a7b-a35c-6e0a9ce14420 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:34.068488 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef2ae36-80f7-4a7b-a35c-6e0a9ce14420 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:34.068770 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef2ae36-80f7-4a7b-a35c-6e0a9ce14420 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:34.078056 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef2ae36-80f7-4a7b-a35c-6e0a9ce14420 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:34.079697 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef2ae36-80f7-4a7b-a35c-6e0a9ce14420 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:34.102811 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-aef2ae36-80f7-4a7b-a35c-6e0a9ce14420 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 14 20:50:34.102811 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:34.102811 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:34.102811 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:34.102811 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:34.102811 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:34.102811 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:34.102811 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:34.102811 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:34.102811 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:34.102811 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:34.102811 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:34.102811 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 14 20:50:34.102811 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_user(user_id) May 14 20:50:34.102811 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 14 20:50:34.102811 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 14 20:50:34.103926 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:34.103926 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:34.103926 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 20:50:34.103926 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 20:50:34.103926 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 14 20:50:34.103926 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 20:50:34.103926 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:34.103926 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:34.103926 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:34.103926 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:34.103926 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:34.103926 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:50:34.103926 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:34.103926 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:34.103926 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:34.103926 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:34.103926 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:34.103926 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:34.104873 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:34.104873 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:34.104873 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 14 20:50:34.104873 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 14 20:50:34.104873 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 14 20:50:34.104873 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 14 20:50:34.104873 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 14 20:50:34.104873 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 14 20:50:34.104873 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 14 20:50:34.104873 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:34.105418 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 345/687] 10.222.0.52 () {56 vars in 1096 bytes} [Sat May 14 20:50:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:34.110375 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef2ae36-80f7-4a7b-a35c-6e0a9ce14420 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:34.205762 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0417af9-b661-4661-9099-60da34445447 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:34.231587 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef2ae36-80f7-4a7b-a35c-6e0a9ce14420 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:34.256646 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068458c8-1a60-440e-b5ac-b55bfa5cb896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:34.257457 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068458c8-1a60-440e-b5ac-b55bfa5cb896 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:34.257736 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068458c8-1a60-440e-b5ac-b55bfa5cb896 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:34.258006 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068458c8-1a60-440e-b5ac-b55bfa5cb896 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:34.277683 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068458c8-1a60-440e-b5ac-b55bfa5cb896 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:34.279191 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068458c8-1a60-440e-b5ac-b55bfa5cb896 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:34.282905 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144dd881-339a-46d0-a403-c9a923083907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:34.284162 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144dd881-339a-46d0-a403-c9a923083907 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:34.284445 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144dd881-339a-46d0-a403-c9a923083907 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:34.284718 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144dd881-339a-46d0-a403-c9a923083907 None admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:34.285559 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144dd881-339a-46d0-a403-c9a923083907 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:34.285864 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144dd881-339a-46d0-a403-c9a923083907 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:34.288042 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144dd881-339a-46d0-a403-c9a923083907 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:34.300385 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-068458c8-1a60-440e-b5ac-b55bfa5cb896 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:34.300385 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:34.300385 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:34.300385 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:34.300385 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:34.300385 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:34.300385 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:34.300385 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:34.300385 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:34.300385 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:34.300385 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:34.300385 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:34.300385 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:50:34.300385 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:50:34.300385 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:50:34.301433 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:50:34.301433 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:34.301433 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:34.301433 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:34.301433 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:34.301433 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:34.301433 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:34.301433 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:34.301433 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:50:34.301433 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:34.301433 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:34.301433 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:34.301433 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:34.301433 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:34.301433 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:34.301433 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:34.301433 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:34.302335 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 20:50:34.302335 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:50:34.302335 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:34.302335 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:34.302561 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 343/688] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:50:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:34.309570 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068458c8-1a60-440e-b5ac-b55bfa5cb896 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:34.329600 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 346/689] 10.222.0.52 () {56 vars in 1135 bytes} [Sat May 14 20:50:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:50:34.337259 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144dd881-339a-46d0-a403-c9a923083907 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:34.480200 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068458c8-1a60-440e-b5ac-b55bfa5cb896 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:34.519363 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7d831f-4450-4f09-a13d-45ef7a362a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:34.519968 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d831f-4450-4f09-a13d-45ef7a362a6f None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:34.520249 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d831f-4450-4f09-a13d-45ef7a362a6f None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:34.520545 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d831f-4450-4f09-a13d-45ef7a362a6f None admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:34.523503 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7d831f-4450-4f09-a13d-45ef7a362a6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:34.523503 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7d831f-4450-4f09-a13d-45ef7a362a6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:34.523503 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7d831f-4450-4f09-a13d-45ef7a362a6f None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:34.542458 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 344/690] 10.222.0.52 () {56 vars in 1109 bytes} [Sat May 14 20:50:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:34.548549 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144dd881-339a-46d0-a403-c9a923083907 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:34.550849 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7d831f-4450-4f09-a13d-45ef7a362a6f None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:34.617561 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9311642a-f601-4719-ad7d-1d2cbe7d0d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:34.618597 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9311642a-f601-4719-ad7d-1d2cbe7d0d5f None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:34.619090 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9311642a-f601-4719-ad7d-1d2cbe7d0d5f None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:34.619644 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9311642a-f601-4719-ad7d-1d2cbe7d0d5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:34.692659 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7d831f-4450-4f09-a13d-45ef7a362a6f None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:34.741043 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9311642a-f601-4719-ad7d-1d2cbe7d0d5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:34.742505 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9311642a-f601-4719-ad7d-1d2cbe7d0d5f None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:34.754626 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a06f86-6911-4d66-bb9a-f9d9f06f8ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:34.755571 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a06f86-6911-4d66-bb9a-f9d9f06f8ff7 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:34.755856 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a06f86-6911-4d66-bb9a-f9d9f06f8ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:34.756133 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a06f86-6911-4d66-bb9a-f9d9f06f8ff7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:34.764791 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a06f86-6911-4d66-bb9a-f9d9f06f8ff7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:34.766235 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a06f86-6911-4d66-bb9a-f9d9f06f8ff7 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:34.780793 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-73a06f86-6911-4d66-bb9a-f9d9f06f8ff7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 14 20:50:34.780793 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:34.780793 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:34.780793 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:34.780793 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:34.780793 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:34.780793 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:34.780793 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:34.780793 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:34.780793 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:34.780793 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:34.780793 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:34.780793 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 14 20:50:34.780793 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_user(user_id) May 14 20:50:34.780793 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 14 20:50:34.780793 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 14 20:50:34.781750 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:34.781750 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:34.781750 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 20:50:34.781750 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 20:50:34.781750 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 14 20:50:34.781750 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 20:50:34.781750 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:34.781750 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:34.781750 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:34.781750 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:34.781750 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:34.781750 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:50:34.781750 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:34.781750 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:34.781750 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:34.781750 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:34.781750 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:34.781750 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:34.782691 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:34.782691 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:34.782691 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 14 20:50:34.782691 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 14 20:50:34.782691 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 14 20:50:34.782691 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 14 20:50:34.782691 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 14 20:50:34.782691 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 14 20:50:34.782691 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 14 20:50:34.782691 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:34.782691 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 345/691] 10.222.0.52 () {56 vars in 1093 bytes} [Sat May 14 20:50:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:34.789785 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a06f86-6911-4d66-bb9a-f9d9f06f8ff7 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:34.922794 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a06f86-6911-4d66-bb9a-f9d9f06f8ff7 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:34.968686 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e60b36-3ec6-44e4-bad0-d0842bf6665c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:34.969367 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e60b36-3ec6-44e4-bad0-d0842bf6665c None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:34.969650 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e60b36-3ec6-44e4-bad0-d0842bf6665c None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:34.969927 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e60b36-3ec6-44e4-bad0-d0842bf6665c None admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:34.970978 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e60b36-3ec6-44e4-bad0-d0842bf6665c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:34.971360 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e60b36-3ec6-44e4-bad0-d0842bf6665c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:34.974445 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e60b36-3ec6-44e4-bad0-d0842bf6665c None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:34.993663 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 347/692] 10.222.0.52 () {58 vars in 1282 bytes} [Sat May 14 20:50:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 658 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 14 20:50:35.002435 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9311642a-f601-4719-ad7d-1d2cbe7d0d5f None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:35.016462 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 346/693] 10.222.0.52 () {56 vars in 1133 bytes} [Sat May 14 20:50:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:35.024436 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e60b36-3ec6-44e4-bad0-d0842bf6665c None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:35.183789 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9311642a-f601-4719-ad7d-1d2cbe7d0d5f None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:35.223727 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c89475d-f949-4e32-963d-a6d38be16c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:35.225510 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c89475d-f949-4e32-963d-a6d38be16c29 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:35.225793 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c89475d-f949-4e32-963d-a6d38be16c29 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:35.226068 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c89475d-f949-4e32-963d-a6d38be16c29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:35.242431 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e60b36-3ec6-44e4-bad0-d0842bf6665c None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:35.253355 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c89475d-f949-4e32-963d-a6d38be16c29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:35.254839 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c89475d-f949-4e32-963d-a6d38be16c29 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:35.280542 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-2c89475d-f949-4e32-963d-a6d38be16c29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:35.280542 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:35.280542 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:35.280542 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:35.280542 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:35.280542 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:35.280542 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:35.280542 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:35.280542 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:35.280542 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:35.280542 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:35.280542 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:35.280542 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:50:35.280542 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:50:35.280542 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:50:35.281503 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:50:35.281503 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:35.281503 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:35.281503 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:35.281503 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:35.281503 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:35.281503 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:35.281503 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:35.281503 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:50:35.281503 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:35.281503 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:35.281503 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:35.281503 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:35.281503 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:35.281503 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:35.281503 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:35.281503 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:35.282396 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 20:50:35.282396 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:50:35.282396 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:35.282396 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:35.282396 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 348/694] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:50:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:35.292733 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c89475d-f949-4e32-963d-a6d38be16c29 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:35.304428 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c292cab-7835-4ba8-935b-bd1ee97406cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:35.305968 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c292cab-7835-4ba8-935b-bd1ee97406cf None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:35.306691 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c292cab-7835-4ba8-935b-bd1ee97406cf None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:35.307175 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c292cab-7835-4ba8-935b-bd1ee97406cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:35.450482 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c292cab-7835-4ba8-935b-bd1ee97406cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:35.451904 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c292cab-7835-4ba8-935b-bd1ee97406cf None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:35.467529 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c89475d-f949-4e32-963d-a6d38be16c29 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:35.510249 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7a1f72-c999-447e-b6d1-1c6ce9f3f188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:35.510921 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a1f72-c999-447e-b6d1-1c6ce9f3f188 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:35.511205 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a1f72-c999-447e-b6d1-1c6ce9f3f188 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:35.511541 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a1f72-c999-447e-b6d1-1c6ce9f3f188 None admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:35.512511 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7a1f72-c999-447e-b6d1-1c6ce9f3f188 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:35.512821 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7a1f72-c999-447e-b6d1-1c6ce9f3f188 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:35.514652 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7a1f72-c999-447e-b6d1-1c6ce9f3f188 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:35.529681 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 349/695] 10.222.0.52 () {56 vars in 1109 bytes} [Sat May 14 20:50:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:35.531181 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aedb59-0a52-4bab-bd58-5757c6878064 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:35.531498 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aedb59-0a52-4bab-bd58-5757c6878064 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:35.531843 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aedb59-0a52-4bab-bd58-5757c6878064 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:35.533891 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 350/696] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:50:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:50:35.538823 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5bdb4-fa77-4fc1-a27d-def1a62b9fbb None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:35.539328 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5bdb4-fa77-4fc1-a27d-def1a62b9fbb None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:35.542321 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5bdb4-fa77-4fc1-a27d-def1a62b9fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:35.557443 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-0db5bdb4-fa77-4fc1-a27d-def1a62b9fbb None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:50:35.559097 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-0db5bdb4-fa77-4fc1-a27d-def1a62b9fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:50:35.573532 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 347/697] 10.222.0.52 () {58 vars in 1282 bytes} [Sat May 14 20:50:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 14 20:50:35.578586 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c292cab-7835-4ba8-935b-bd1ee97406cf None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:35.632306 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 351/698] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:50:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 14 20:50:35.633262 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db5bdb4-fa77-4fc1-a27d-def1a62b9fbb None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:35.686330 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c292cab-7835-4ba8-935b-bd1ee97406cf None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:35.721160 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ae00f8-9486-4b0e-a3b0-6057b1fdf082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:35.722188 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae00f8-9486-4b0e-a3b0-6057b1fdf082 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:35.722473 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae00f8-9486-4b0e-a3b0-6057b1fdf082 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:35.722754 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae00f8-9486-4b0e-a3b0-6057b1fdf082 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:35.729451 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ae00f8-9486-4b0e-a3b0-6057b1fdf082 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:35.730566 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db5bdb4-fa77-4fc1-a27d-def1a62b9fbb None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:35.730875 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ae00f8-9486-4b0e-a3b0-6057b1fdf082 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:35.744306 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-39ae00f8-9486-4b0e-a3b0-6057b1fdf082 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 14 20:50:35.744306 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:35.744306 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:35.744306 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:35.744306 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:35.744306 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:35.744306 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:35.744306 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:35.744306 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:35.744306 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:35.744306 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:35.744306 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:35.744306 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 14 20:50:35.744306 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_project(project_id) May 14 20:50:35.744306 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 14 20:50:35.745230 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 14 20:50:35.745230 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:35.745230 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:35.745230 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:35.745230 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:35.745230 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:35.745230 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:35.745230 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:35.745230 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:50:35.745230 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:35.745230 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:35.745230 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:35.745230 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:35.745230 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:35.745230 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:35.745230 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:35.745230 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:35.746511 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 14 20:50:35.746511 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 14 20:50:35.746511 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 20:50:35.746511 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 20:50:35.746511 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 20:50:35.746511 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 20:50:35.746511 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 14 20:50:35.746511 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:35.746511 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 348/699] 10.222.0.52 () {56 vars in 1111 bytes} [Sat May 14 20:50:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:35.747488 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746eabe-c1bf-47e1-a66f-93b9bea489f2 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:35.747777 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746eabe-c1bf-47e1-a66f-93b9bea489f2 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:35.748048 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746eabe-c1bf-47e1-a66f-93b9bea489f2 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:35.749427 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 349/700] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:50:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:50:35.749968 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9746eabe-c1bf-47e1-a66f-93b9bea489f2 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:35.774963 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07e958d-e23c-4535-95f7-19db7166cc1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:35.775788 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e958d-e23c-4535-95f7-19db7166cc1f None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:35.776079 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e958d-e23c-4535-95f7-19db7166cc1f None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:35.776355 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e958d-e23c-4535-95f7-19db7166cc1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:35.786358 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07e958d-e23c-4535-95f7-19db7166cc1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:35.787938 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07e958d-e23c-4535-95f7-19db7166cc1f None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:35.805424 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-c07e958d-e23c-4535-95f7-19db7166cc1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:35.805424 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:35.805424 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:35.805424 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:35.805424 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:35.805424 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:35.805424 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:35.805424 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:35.805424 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:35.805424 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:35.805424 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:35.805424 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:35.805424 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:50:35.805424 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:50:35.805424 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:50:35.806372 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:50:35.806372 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:35.806372 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:35.806372 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:35.806372 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:35.806372 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:35.806372 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:35.806372 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:35.806372 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:50:35.806372 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:35.806372 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:35.806372 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:35.806372 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:35.806372 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:35.806372 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:35.806372 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:35.806372 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:35.807262 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 20:50:35.807262 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:50:35.807262 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:35.807262 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:35.810949 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 352/701] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:50:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:35.812205 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd35097-30bd-4fbf-92c4-0c644bf4875a None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:35.812493 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd35097-30bd-4fbf-92c4-0c644bf4875a None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:35.812767 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd35097-30bd-4fbf-92c4-0c644bf4875a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:35.830275 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-dbd35097-30bd-4fbf-92c4-0c644bf4875a None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:50:35.831587 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-dbd35097-30bd-4fbf-92c4-0c644bf4875a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:50:35.855179 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9746eabe-c1bf-47e1-a66f-93b9bea489f2 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:35.888208 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81320b8e-2e15-4328-abb7-f7be3f3ee178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:35.888996 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81320b8e-2e15-4328-abb7-f7be3f3ee178 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:35.889281 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81320b8e-2e15-4328-abb7-f7be3f3ee178 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:35.889563 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81320b8e-2e15-4328-abb7-f7be3f3ee178 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:35.899965 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81320b8e-2e15-4328-abb7-f7be3f3ee178 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:35.901406 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81320b8e-2e15-4328-abb7-f7be3f3ee178 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:35.915890 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 353/702] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:50:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 20:50:35.915890 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd35097-30bd-4fbf-92c4-0c644bf4875a None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:35.937048 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-81320b8e-2e15-4328-abb7-f7be3f3ee178 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:35.937048 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:35.937048 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:35.937048 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:35.937048 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:35.937048 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:35.937048 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:35.937048 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:35.937048 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:35.937048 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:35.937048 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:35.937048 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:35.937048 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:50:35.937048 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:50:35.937048 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:50:35.937950 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:50:35.937950 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:35.937950 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:35.937950 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:35.937950 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:35.937950 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:35.937950 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:35.937950 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:35.937950 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:50:35.937950 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:35.937950 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:35.937950 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:35.937950 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:35.937950 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:35.937950 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:35.937950 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:35.937950 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:35.938890 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 20:50:35.938890 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:50:35.938890 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:35.938890 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:35.938890 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 350/703] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:50:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:35.939954 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81320b8e-2e15-4328-abb7-f7be3f3ee178 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:36.010031 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd35097-30bd-4fbf-92c4-0c644bf4875a None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:36.041461 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81320b8e-2e15-4328-abb7-f7be3f3ee178 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:36.044698 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2a8f5d-4f84-4472-a08e-f801754440b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:36.045363 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a8f5d-4f84-4472-a08e-f801754440b0 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:36.045648 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a8f5d-4f84-4472-a08e-f801754440b0 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:36.046155 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a8f5d-4f84-4472-a08e-f801754440b0 None admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:36.046948 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2a8f5d-4f84-4472-a08e-f801754440b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:36.047261 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2a8f5d-4f84-4472-a08e-f801754440b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:36.048861 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2a8f5d-4f84-4472-a08e-f801754440b0 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:36.065940 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 354/704] 10.222.0.52 () {56 vars in 1148 bytes} [Sat May 14 20:50:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:36.065940 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2a8f5d-4f84-4472-a08e-f801754440b0 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:36.082005 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d297b346-2a1d-47f9-b6f8-9edcd2eb6aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:36.082782 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d297b346-2a1d-47f9-b6f8-9edcd2eb6aa1 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:36.083077 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d297b346-2a1d-47f9-b6f8-9edcd2eb6aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:36.083356 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d297b346-2a1d-47f9-b6f8-9edcd2eb6aa1 None admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:36.084160 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d297b346-2a1d-47f9-b6f8-9edcd2eb6aa1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:36.084446 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d297b346-2a1d-47f9-b6f8-9edcd2eb6aa1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:36.085818 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d297b346-2a1d-47f9-b6f8-9edcd2eb6aa1 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:36.099270 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 351/705] 10.222.0.52 () {56 vars in 1109 bytes} [Sat May 14 20:50:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:36.100136 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d297b346-2a1d-47f9-b6f8-9edcd2eb6aa1 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:36.164875 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2a8f5d-4f84-4472-a08e-f801754440b0 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:36.199883 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a5fd33-fa92-4457-82d8-f833b33437c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:36.200678 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a5fd33-fa92-4457-82d8-f833b33437c1 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:36.200962 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a5fd33-fa92-4457-82d8-f833b33437c1 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:36.201265 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a5fd33-fa92-4457-82d8-f833b33437c1 None admin] PATH_INFO: `/v3/services/network` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:36.201943 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a5fd33-fa92-4457-82d8-f833b33437c1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:36.203309 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a5fd33-fa92-4457-82d8-f833b33437c1 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:36.206166 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d297b346-2a1d-47f9-b6f8-9edcd2eb6aa1 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:36.217251 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-81a5fd33-fa92-4457-82d8-f833b33437c1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 14 20:50:36.217251 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:36.217251 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 14 20:50:36.217251 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 14 20:50:36.217251 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 14 20:50:36.217251 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 14 20:50:36.217251 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 14 20:50:36.217251 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 20:50:36.217251 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 14 20:50:36.217251 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:36.217251 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 20:50:36.217251 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:36.217251 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:36.217251 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:36.217251 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:36.217251 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:36.217251 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:36.218332 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:36.218332 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:36.218332 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:36.218332 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:36.218332 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:36.218332 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:36.218332 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 14 20:50:36.218332 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_service(service_id) May 14 20:50:36.218332 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 14 20:50:36.218332 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 14 20:50:36.218332 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:36.218332 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:36.218332 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:36.218332 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:36.218332 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:36.218332 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:36.219203 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:36.219203 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:50:36.219203 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:36.219203 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:36.219203 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:36.219203 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:36.219203 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:36.219203 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:36.219203 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:36.219203 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:36.219203 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 14 20:50:36.219203 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 20:50:36.219203 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 14 20:50:36.219203 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:36.219203 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 355/706] 10.222.0.52 () {56 vars in 1111 bytes} [Sat May 14 20:50:36 2022] GET /identity/v3/services/network => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:36.221267 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a5fd33-fa92-4457-82d8-f833b33437c1 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:36.243999 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93252bf-e854-4d2e-b3b3-fb520fab9c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:36.244660 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93252bf-e854-4d2e-b3b3-fb520fab9c94 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:36.244941 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93252bf-e854-4d2e-b3b3-fb520fab9c94 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:36.245217 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93252bf-e854-4d2e-b3b3-fb520fab9c94 None admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:36.245930 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93252bf-e854-4d2e-b3b3-fb520fab9c94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:36.246503 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93252bf-e854-4d2e-b3b3-fb520fab9c94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:36.247884 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93252bf-e854-4d2e-b3b3-fb520fab9c94 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:36.264386 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 352/707] 10.222.0.52 () {56 vars in 1109 bytes} [Sat May 14 20:50:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:36.264386 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93252bf-e854-4d2e-b3b3-fb520fab9c94 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:36.323827 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a5fd33-fa92-4457-82d8-f833b33437c1 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:36.362019 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a5f749-1f9d-4a90-a7bf-629bd6c71f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:36.363088 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a5f749-1f9d-4a90-a7bf-629bd6c71f6a None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:36.363385 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a5f749-1f9d-4a90-a7bf-629bd6c71f6a None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:36.363693 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a5f749-1f9d-4a90-a7bf-629bd6c71f6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:36.364526 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a5f749-1f9d-4a90-a7bf-629bd6c71f6a None admin] RBAC: Adding query filter params (role.id=998d6a3451be42a89d4cff277851ad70, scope.project.id=0911a024287e430ea6ee015389f0c440, user.id=c781fe7f4a014f0d8b5e7385b20b348c) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:36.364887 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a5f749-1f9d-4a90-a7bf-629bd6c71f6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:36.366343 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a5f749-1f9d-4a90-a7bf-629bd6c71f6a None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:36.370767 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93252bf-e854-4d2e-b3b3-fb520fab9c94 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:36.383756 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 356/708] 10.222.0.52 () {56 vars in 1374 bytes} [Sat May 14 20:50:36 2022] GET /identity/v3/role_assignments?user.id=c781fe7f4a014f0d8b5e7385b20b348c&scope.project.id=0911a024287e430ea6ee015389f0c440&role.id=998d6a3451be42a89d4cff277851ad70 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:36.383756 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a5f749-1f9d-4a90-a7bf-629bd6c71f6a None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:36.431003 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd9fcf-da2a-47f5-a28b-c65ea7ab74ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:36.431956 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd9fcf-da2a-47f5-a28b-c65ea7ab74ed None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:36.432331 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd9fcf-da2a-47f5-a28b-c65ea7ab74ed None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:36.433152 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd9fcf-da2a-47f5-a28b-c65ea7ab74ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:36.444437 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fd9fcf-da2a-47f5-a28b-c65ea7ab74ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:36.446032 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fd9fcf-da2a-47f5-a28b-c65ea7ab74ed None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:36.471671 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-93fd9fcf-da2a-47f5-a28b-c65ea7ab74ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 14 20:50:36.471671 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:36.471671 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:36.471671 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:36.471671 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:36.471671 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:36.471671 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:36.471671 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:36.471671 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:36.471671 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:36.471671 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:36.471671 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:36.471671 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 14 20:50:36.471671 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_project(project_id) May 14 20:50:36.471671 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 14 20:50:36.472633 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 14 20:50:36.472633 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:36.472633 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:36.472633 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:36.472633 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:36.472633 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:36.472633 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:36.472633 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:36.472633 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:50:36.472633 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:36.472633 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:36.472633 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:36.472633 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:36.472633 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:36.472633 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:36.472633 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:36.472633 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:36.473555 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 14 20:50:36.473555 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 14 20:50:36.473555 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 20:50:36.473555 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 20:50:36.473555 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 20:50:36.473555 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 20:50:36.473555 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 14 20:50:36.473555 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:36.473555 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 353/709] 10.222.0.52 () {56 vars in 1111 bytes} [Sat May 14 20:50:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:36.474038 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd9fcf-da2a-47f5-a28b-c65ea7ab74ed None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:36.492244 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a5f749-1f9d-4a90-a7bf-629bd6c71f6a None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:36.531205 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ace364b-04f7-43c6-8da2-263015a1b123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:36.531840 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace364b-04f7-43c6-8da2-263015a1b123 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:36.532125 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace364b-04f7-43c6-8da2-263015a1b123 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:36.532402 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace364b-04f7-43c6-8da2-263015a1b123 None admin] PATH_INFO: `/v3/services` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:36.533785 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ace364b-04f7-43c6-8da2-263015a1b123 None admin] RBAC: Adding query filter params (name=network) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:36.534094 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ace364b-04f7-43c6-8da2-263015a1b123 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:36.535788 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ace364b-04f7-43c6-8da2-263015a1b123 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:36.541104 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 357/710] 10.222.0.52 () {56 vars in 1112 bytes} [Sat May 14 20:50:36 2022] GET /identity/v3/services?name=network => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:36.541851 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ace364b-04f7-43c6-8da2-263015a1b123 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:36.601914 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd9fcf-da2a-47f5-a28b-c65ea7ab74ed None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:36.642321 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab50dd8-abf2-408d-b82e-2a6747a20169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:36.643031 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab50dd8-abf2-408d-b82e-2a6747a20169 None admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:36.643348 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab50dd8-abf2-408d-b82e-2a6747a20169 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:36.643643 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab50dd8-abf2-408d-b82e-2a6747a20169 None admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:36.644348 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab50dd8-abf2-408d-b82e-2a6747a20169 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:36.646486 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab50dd8-abf2-408d-b82e-2a6747a20169 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:36.660041 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ace364b-04f7-43c6-8da2-263015a1b123 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:36.694080 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3589dd7-f20d-4eb6-a4e1-5ffd7f3bdcf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:36.694744 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3589dd7-f20d-4eb6-a4e1-5ffd7f3bdcf2 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:36.695033 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3589dd7-f20d-4eb6-a4e1-5ffd7f3bdcf2 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:36.695314 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3589dd7-f20d-4eb6-a4e1-5ffd7f3bdcf2 None admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:36.696136 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3589dd7-f20d-4eb6-a4e1-5ffd7f3bdcf2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:36.699797 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3589dd7-f20d-4eb6-a4e1-5ffd7f3bdcf2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:36.699797 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3589dd7-f20d-4eb6-a4e1-5ffd7f3bdcf2 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:36.711324 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 358/711] 10.222.0.52 () {56 vars in 1148 bytes} [Sat May 14 20:50:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:36.713494 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688ba95-19d2-4917-a335-540af0ef91ed None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:36.713790 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688ba95-19d2-4917-a335-540af0ef91ed None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:36.714070 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688ba95-19d2-4917-a335-540af0ef91ed None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:36.715586 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 359/712] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:50:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:50:36.716037 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7688ba95-19d2-4917-a335-540af0ef91ed None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:36.748619 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 354/713] 10.222.0.52 () {60 vars in 1132 bytes} [Sat May 14 20:50:36 2022] POST /identity/v3/users => generated 254 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 20:50:36.749804 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab50dd8-abf2-408d-b82e-2a6747a20169 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:36.858280 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7688ba95-19d2-4917-a335-540af0ef91ed None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:36.873406 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab50dd8-abf2-408d-b82e-2a6747a20169 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:36.905079 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72d6e37-5695-455d-b23f-21ed3053625b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:36.905758 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d6e37-5695-455d-b23f-21ed3053625b None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:36.906039 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d6e37-5695-455d-b23f-21ed3053625b None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:36.906309 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d6e37-5695-455d-b23f-21ed3053625b None admin] PATH_INFO: `/v3/services` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:36.907389 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72d6e37-5695-455d-b23f-21ed3053625b None admin] RBAC: Adding query filter params (type=network) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:36.908616 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72d6e37-5695-455d-b23f-21ed3053625b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:36.910155 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72d6e37-5695-455d-b23f-21ed3053625b None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:36.913220 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e073596d-3e79-4e47-ae18-bab6461d9eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:36.914260 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e073596d-3e79-4e47-ae18-bab6461d9eb2 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:36.914758 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e073596d-3e79-4e47-ae18-bab6461d9eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:36.915239 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e073596d-3e79-4e47-ae18-bab6461d9eb2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:36.916365 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e073596d-3e79-4e47-ae18-bab6461d9eb2 None admin] RBAC: Adding query filter params (role.id=24c463e2b4d44dd28cd2723a69a8ed2e, scope.project.id=0911a024287e430ea6ee015389f0c440, user.id=0f1b0e2b025d4eceaa90e1616d0a9db8) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:36.916904 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 360/714] 10.222.0.52 () {56 vars in 1112 bytes} [Sat May 14 20:50:36 2022] GET /identity/v3/services?type=network => generated 124 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:36.917176 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e073596d-3e79-4e47-ae18-bab6461d9eb2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:36.918296 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a48c6-bc9a-4fcc-bb64-c664b8f8313c None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:36.918588 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a48c6-bc9a-4fcc-bb64-c664b8f8313c None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:36.918862 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a48c6-bc9a-4fcc-bb64-c664b8f8313c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:36.919798 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e073596d-3e79-4e47-ae18-bab6461d9eb2 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:36.934500 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 355/715] 10.222.0.52 () {56 vars in 1374 bytes} [Sat May 14 20:50:36 2022] GET /identity/v3/role_assignments?user.id=0f1b0e2b025d4eceaa90e1616d0a9db8&scope.project.id=0911a024287e430ea6ee015389f0c440&role.id=24c463e2b4d44dd28cd2723a69a8ed2e => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:36.939042 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-620a48c6-bc9a-4fcc-bb64-c664b8f8313c None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:50:36.943549 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-620a48c6-bc9a-4fcc-bb64-c664b8f8313c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:50:37.031693 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 361/716] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:50:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 20:50:37.050530 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e073596d-3e79-4e47-ae18-bab6461d9eb2 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:37.167586 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e073596d-3e79-4e47-ae18-bab6461d9eb2 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:37.204506 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c60d448-1760-47d3-aa2f-dcd1a4c3315f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:37.205414 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c60d448-1760-47d3-aa2f-dcd1a4c3315f None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:37.205689 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c60d448-1760-47d3-aa2f-dcd1a4c3315f None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:37.205987 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c60d448-1760-47d3-aa2f-dcd1a4c3315f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:37.206597 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c60d448-1760-47d3-aa2f-dcd1a4c3315f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:37.207988 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c60d448-1760-47d3-aa2f-dcd1a4c3315f None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:37.223240 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-4c60d448-1760-47d3-aa2f-dcd1a4c3315f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 14 20:50:37.223240 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:37.223240 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 14 20:50:37.223240 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 14 20:50:37.223240 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 14 20:50:37.223240 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 14 20:50:37.223240 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 14 20:50:37.223240 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 20:50:37.223240 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 14 20:50:37.223240 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:37.223240 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 20:50:37.223240 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:37.223240 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:37.223240 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:37.223240 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:37.223240 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:37.224270 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:37.224270 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:37.224270 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:37.224270 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:37.224270 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:37.224270 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:37.224270 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:37.224270 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 14 20:50:37.224270 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_service(service_id) May 14 20:50:37.224270 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 14 20:50:37.224270 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 14 20:50:37.224270 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:37.224270 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:37.224270 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:37.224270 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:37.224270 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:37.225121 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:37.225121 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:37.225121 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:50:37.225121 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:37.225121 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:37.225121 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:37.225121 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:37.225121 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:37.225121 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:37.225121 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:37.225121 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:37.225121 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 14 20:50:37.225121 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 20:50:37.225121 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 14 20:50:37.225121 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:37.225121 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 356/717] 10.222.0.52 () {56 vars in 1129 bytes} [Sat May 14 20:50:37 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:37.230429 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620a48c6-bc9a-4fcc-bb64-c664b8f8313c None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:37.339438 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620a48c6-bc9a-4fcc-bb64-c664b8f8313c None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:37.376892 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec10ba8f-4471-4036-bd9a-3e8073fb7a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:37.377731 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10ba8f-4471-4036-bd9a-3e8073fb7a63 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:37.378009 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10ba8f-4471-4036-bd9a-3e8073fb7a63 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:37.378278 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10ba8f-4471-4036-bd9a-3e8073fb7a63 None admin] PATH_INFO: `/v3/services` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:37.378984 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec10ba8f-4471-4036-bd9a-3e8073fb7a63 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:37.379286 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec10ba8f-4471-4036-bd9a-3e8073fb7a63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:37.380715 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec10ba8f-4471-4036-bd9a-3e8073fb7a63 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:37.389793 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 362/718] 10.222.0.52 () {56 vars in 1124 bytes} [Sat May 14 20:50:37 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:37.391277 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c60d448-1760-47d3-aa2f-dcd1a4c3315f None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:37.515778 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c60d448-1760-47d3-aa2f-dcd1a4c3315f None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:37.560558 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e74f178-f739-4eef-8a5c-481aaa51fd31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:37.561215 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e74f178-f739-4eef-8a5c-481aaa51fd31 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:37.561496 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e74f178-f739-4eef-8a5c-481aaa51fd31 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:37.561769 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e74f178-f739-4eef-8a5c-481aaa51fd31 None admin] PATH_INFO: `/v3/services` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:37.562469 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e74f178-f739-4eef-8a5c-481aaa51fd31 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:37.562772 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e74f178-f739-4eef-8a5c-481aaa51fd31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:37.564733 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e74f178-f739-4eef-8a5c-481aaa51fd31 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:37.572422 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 357/719] 10.222.0.52 () {56 vars in 1124 bytes} [Sat May 14 20:50:37 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:39.094032 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd3cba-0387-4671-8d75-72895990ec66 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:39.094742 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd3cba-0387-4671-8d75-72895990ec66 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:39.094742 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd3cba-0387-4671-8d75-72895990ec66 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:39.096828 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 363/720] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:50:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:50:39.104327 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0b89e-e862-4e04-b824-99db9b2a677a None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:39.104327 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0b89e-e862-4e04-b824-99db9b2a677a None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:39.104327 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0b89e-e862-4e04-b824-99db9b2a677a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:39.125277 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-18b0b89e-e862-4e04-b824-99db9b2a677a None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:50:39.126825 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-18b0b89e-e862-4e04-b824-99db9b2a677a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:50:39.213911 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 358/721] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:50:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 20:50:39.249878 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cd3cba-0387-4671-8d75-72895990ec66 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:39.393125 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cd3cba-0387-4671-8d75-72895990ec66 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:39.430933 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe47be33-8323-4400-a664-cb88f07abf5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:39.431747 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe47be33-8323-4400-a664-cb88f07abf5c None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:39.432028 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe47be33-8323-4400-a664-cb88f07abf5c None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:39.433367 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe47be33-8323-4400-a664-cb88f07abf5c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:39.452144 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe47be33-8323-4400-a664-cb88f07abf5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:50:39.461287 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-fe47be33-8323-4400-a664-cb88f07abf5c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 14 20:50:39.461287 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:39.461287 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:39.461287 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:39.461287 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:39.461287 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:39.461287 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:39.461287 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:39.461287 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:39.461287 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:39.461287 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:39.461287 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:39.461287 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:50:39.461287 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:50:39.461287 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:50:39.461287 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:50:39.464476 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:50:39.464476 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:50:39.464476 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:50:39.464476 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:50:39.464476 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:39.464476 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:39.464476 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:39.464476 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:39.464476 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:39.464476 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:39.464476 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:39.464476 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:50:39.464476 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:39.464476 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:39.464476 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:39.464476 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:39.465393 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:39.465393 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:39.465393 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:39.465393 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:39.465393 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:50:39.465393 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:50:39.465393 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:50:39.465393 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:50:39.465393 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:50:39.465393 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:50:39.465393 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 14 20:50:39.465393 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:39.467180 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 364/722] 10.222.0.52 () {56 vars in 1096 bytes} [Sat May 14 20:50:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:39.468546 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b0b89e-e862-4e04-b824-99db9b2a677a None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:39.643272 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b0b89e-e862-4e04-b824-99db9b2a677a None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:39.691022 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860385d6-daa2-469c-a7b3-43ef5438519a None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:39.691358 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860385d6-daa2-469c-a7b3-43ef5438519a None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:39.691667 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860385d6-daa2-469c-a7b3-43ef5438519a None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:39.694590 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 365/723] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:50:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:50:39.696528 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47e7bab-e65d-45e3-a70c-daf6799fbdcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:39.697198 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e7bab-e65d-45e3-a70c-daf6799fbdcf None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:39.697488 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e7bab-e65d-45e3-a70c-daf6799fbdcf None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:39.697764 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e7bab-e65d-45e3-a70c-daf6799fbdcf None admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:39.698526 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47e7bab-e65d-45e3-a70c-daf6799fbdcf None admin] RBAC: Adding query filter params (name=admin) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:39.698835 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47e7bab-e65d-45e3-a70c-daf6799fbdcf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:39.699018 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de95596-ca30-4ccc-a89c-62bb9f625b89 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:39.699303 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de95596-ca30-4ccc-a89c-62bb9f625b89 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:39.699620 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de95596-ca30-4ccc-a89c-62bb9f625b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:39.700265 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47e7bab-e65d-45e3-a70c-daf6799fbdcf None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:39.710130 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 359/724] 10.222.0.52 () {56 vars in 1099 bytes} [Sat May 14 20:50:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:39.716908 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47e7bab-e65d-45e3-a70c-daf6799fbdcf None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:39.736421 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-8de95596-ca30-4ccc-a89c-62bb9f625b89 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:50:39.737620 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8de95596-ca30-4ccc-a89c-62bb9f625b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:50:39.862513 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 366/725] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:50:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 20:50:39.873162 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47e7bab-e65d-45e3-a70c-daf6799fbdcf None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:39.886210 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de95596-ca30-4ccc-a89c-62bb9f625b89 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:39.934329 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7ade62-3438-4916-bccc-77a0e478f293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:39.935775 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ade62-3438-4916-bccc-77a0e478f293 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:39.937237 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ade62-3438-4916-bccc-77a0e478f293 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:39.938320 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ade62-3438-4916-bccc-77a0e478f293 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:39.953706 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7ade62-3438-4916-bccc-77a0e478f293 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:39.955872 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7ade62-3438-4916-bccc-77a0e478f293 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:39.978820 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-fb7ade62-3438-4916-bccc-77a0e478f293 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:39.978820 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:39.978820 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:39.978820 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:39.978820 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:39.978820 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:39.978820 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:39.978820 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:39.978820 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:39.978820 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:39.978820 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:39.978820 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:39.978820 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:50:39.978820 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:50:39.978820 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:50:39.979800 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:50:39.979800 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:39.979800 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:39.979800 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:39.979800 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:39.979800 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:39.979800 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:39.979800 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:39.979800 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:50:39.979800 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:39.979800 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:39.979800 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:39.979800 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:39.979800 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:39.979800 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:39.979800 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:39.979800 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:39.980714 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 20:50:39.980714 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:50:39.980714 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:39.980714 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:39.980714 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 360/726] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:50:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 20:50:39.986898 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d2e6c-e406-47ac-b4c3-546343e404ee None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:39.987249 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d2e6c-e406-47ac-b4c3-546343e404ee None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:39.987621 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d2e6c-e406-47ac-b4c3-546343e404ee None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:39.989248 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 361/727] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:50:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:50:39.994026 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d2e6c-e406-47ac-b4c3-546343e404ee None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:40.019582 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de95596-ca30-4ccc-a89c-62bb9f625b89 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:40.070096 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef4a49-8014-4fd4-86bb-356a4ed07f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:40.071783 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef4a49-8014-4fd4-86bb-356a4ed07f8e None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:40.072275 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef4a49-8014-4fd4-86bb-356a4ed07f8e None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:40.072751 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef4a49-8014-4fd4-86bb-356a4ed07f8e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:40.087321 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ef4a49-8014-4fd4-86bb-356a4ed07f8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:50:40.098151 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d2e6c-e406-47ac-b4c3-546343e404ee None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:40.098761 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-d2ef4a49-8014-4fd4-86bb-356a4ed07f8e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 14 20:50:40.098761 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:40.098761 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:40.098761 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:40.098761 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:40.098761 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:40.098761 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:40.098761 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:40.098761 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:40.098761 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:40.098761 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:40.098761 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:40.098761 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:50:40.098761 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:50:40.098761 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:50:40.098761 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:50:40.100035 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:50:40.100035 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:50:40.100035 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:50:40.100035 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:50:40.100035 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:40.100035 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:40.100035 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:40.100035 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:40.100035 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:40.100035 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:40.100035 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:40.100035 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:50:40.100035 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:40.100035 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:40.100035 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:40.100035 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:40.100875 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:40.100875 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:40.100875 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:40.100875 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:40.100875 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:50:40.100875 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:50:40.100875 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:50:40.100875 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:50:40.100875 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:50:40.100875 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:50:40.100875 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 14 20:50:40.100875 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:40.104317 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 367/728] 10.222.0.52 () {56 vars in 1096 bytes} [Sat May 14 20:50:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 20:50:40.105749 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7e564-ab12-4891-8d1d-548212d8afbf None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:40.106201 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7e564-ab12-4891-8d1d-548212d8afbf None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:40.106627 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7e564-ab12-4891-8d1d-548212d8afbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:40.124128 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-16b7e564-ab12-4891-8d1d-548212d8afbf None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:50:40.125567 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-16b7e564-ab12-4891-8d1d-548212d8afbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:50:40.138304 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad62118-df4d-43d9-933e-7dbf2afcb0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:40.138973 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad62118-df4d-43d9-933e-7dbf2afcb0e8 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:40.139250 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad62118-df4d-43d9-933e-7dbf2afcb0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:40.139554 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad62118-df4d-43d9-933e-7dbf2afcb0e8 None admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:40.140283 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad62118-df4d-43d9-933e-7dbf2afcb0e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:40.140591 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad62118-df4d-43d9-933e-7dbf2afcb0e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:40.141959 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad62118-df4d-43d9-933e-7dbf2afcb0e8 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:40.158905 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 362/729] 10.222.0.52 () {56 vars in 1109 bytes} [Sat May 14 20:50:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:40.158905 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad62118-df4d-43d9-933e-7dbf2afcb0e8 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:40.203534 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 368/730] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:50:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 20:50:40.203534 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855bd6f-2f0f-4c57-8329-e20f01907356 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:40.203534 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855bd6f-2f0f-4c57-8329-e20f01907356 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:40.203534 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855bd6f-2f0f-4c57-8329-e20f01907356 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:40.203534 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 369/731] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:50:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:50:40.203534 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a855bd6f-2f0f-4c57-8329-e20f01907356 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:40.258757 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad62118-df4d-43d9-933e-7dbf2afcb0e8 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:40.292369 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f16c4d8-676a-4310-b045-b393e0fed745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:40.293049 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f16c4d8-676a-4310-b045-b393e0fed745 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:40.293338 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f16c4d8-676a-4310-b045-b393e0fed745 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:40.293614 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f16c4d8-676a-4310-b045-b393e0fed745 None admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:40.294375 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f16c4d8-676a-4310-b045-b393e0fed745 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:40.294682 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f16c4d8-676a-4310-b045-b393e0fed745 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:40.296142 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f16c4d8-676a-4310-b045-b393e0fed745 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:40.305586 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 363/732] 10.222.0.52 () {56 vars in 1099 bytes} [Sat May 14 20:50:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:40.307309 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df4b71-08d7-4076-b6b5-3e451f17e246 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:40.307881 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df4b71-08d7-4076-b6b5-3e451f17e246 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:40.308385 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df4b71-08d7-4076-b6b5-3e451f17e246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:40.311865 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a855bd6f-2f0f-4c57-8329-e20f01907356 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:40.327855 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-53df4b71-08d7-4076-b6b5-3e451f17e246 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:50:40.329054 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-53df4b71-08d7-4076-b6b5-3e451f17e246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:50:40.349955 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312c8795-8e77-418c-9d02-9ec57063b254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:40.350750 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c8795-8e77-418c-9d02-9ec57063b254 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:40.351036 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c8795-8e77-418c-9d02-9ec57063b254 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:40.351313 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c8795-8e77-418c-9d02-9ec57063b254 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:40.358976 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312c8795-8e77-418c-9d02-9ec57063b254 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:40.360598 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312c8795-8e77-418c-9d02-9ec57063b254 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:40.375897 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-312c8795-8e77-418c-9d02-9ec57063b254 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 14 20:50:40.375897 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:40.375897 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:40.375897 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:40.375897 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:40.375897 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:40.375897 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:40.375897 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:40.375897 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:40.375897 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:40.375897 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:40.375897 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:40.375897 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 14 20:50:40.375897 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_user(user_id) May 14 20:50:40.375897 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 14 20:50:40.375897 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 14 20:50:40.377710 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:40.377710 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:40.377710 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 20:50:40.377710 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 20:50:40.377710 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 14 20:50:40.377710 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 20:50:40.377710 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:40.377710 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:40.377710 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:40.377710 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:40.377710 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:40.377710 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:50:40.377710 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:40.377710 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:40.377710 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:40.377710 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:40.377710 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:40.377710 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:40.379094 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:40.379094 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:40.379094 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 14 20:50:40.379094 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 14 20:50:40.379094 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 14 20:50:40.379094 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 14 20:50:40.379094 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 14 20:50:40.379094 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 14 20:50:40.379094 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 14 20:50:40.379094 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:40.379094 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 370/733] 10.222.0.52 () {56 vars in 1096 bytes} [Sat May 14 20:50:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:40.379094 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312c8795-8e77-418c-9d02-9ec57063b254 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:40.402055 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 364/734] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:50:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 20:50:40.403305 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53df4b71-08d7-4076-b6b5-3e451f17e246 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:40.488905 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312c8795-8e77-418c-9d02-9ec57063b254 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:40.504520 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53df4b71-08d7-4076-b6b5-3e451f17e246 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:40.526332 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f6a19d-9ea9-412a-85d7-e640188c91c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:40.526920 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f6a19d-9ea9-412a-85d7-e640188c91c4 None admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:40.527201 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f6a19d-9ea9-412a-85d7-e640188c91c4 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:40.527488 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f6a19d-9ea9-412a-85d7-e640188c91c4 None admin] PATH_INFO: `/v3/services` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:40.528220 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f6a19d-9ea9-412a-85d7-e640188c91c4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:40.529579 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f6a19d-9ea9-412a-85d7-e640188c91c4 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:40.538347 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d923b94-2150-46dc-be79-e1ca8979fbec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:40.539126 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d923b94-2150-46dc-be79-e1ca8979fbec None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:40.539408 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d923b94-2150-46dc-be79-e1ca8979fbec None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:40.539708 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d923b94-2150-46dc-be79-e1ca8979fbec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:40.549456 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d923b94-2150-46dc-be79-e1ca8979fbec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:40.550900 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d923b94-2150-46dc-be79-e1ca8979fbec None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:40.568765 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-6d923b94-2150-46dc-be79-e1ca8979fbec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:40.568765 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:40.568765 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:40.568765 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:40.568765 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:40.568765 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:40.568765 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:40.568765 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:40.568765 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:40.568765 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:40.568765 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:40.568765 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:40.568765 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:50:40.568765 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:50:40.568765 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:50:40.572614 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:50:40.572614 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:40.572614 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:40.572614 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:40.572614 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:40.572614 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:40.572614 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:40.572614 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:40.572614 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:50:40.572614 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:40.572614 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:40.572614 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:40.572614 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:40.572614 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:40.572614 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:40.572614 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:40.572614 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:40.573763 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 20:50:40.573763 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:50:40.573763 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:40.573763 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:40.573763 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 365/735] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:50:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:40.573763 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d923b94-2150-46dc-be79-e1ca8979fbec None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:40.622922 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 371/736] 10.222.0.52 () {60 vars in 1141 bytes} [Sat May 14 20:50:40 2022] POST /identity/v3/services => generated 240 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 20:50:40.624148 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f6a19d-9ea9-412a-85d7-e640188c91c4 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:40.675092 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d923b94-2150-46dc-be79-e1ca8979fbec None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:40.727060 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d091c9cd-d315-4f60-b961-1c32c5afdc9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:40.727835 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d091c9cd-d315-4f60-b961-1c32c5afdc9a None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:40.728127 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d091c9cd-d315-4f60-b961-1c32c5afdc9a None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:40.728405 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d091c9cd-d315-4f60-b961-1c32c5afdc9a None admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:40.729245 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d091c9cd-d315-4f60-b961-1c32c5afdc9a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:40.729638 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d091c9cd-d315-4f60-b961-1c32c5afdc9a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:40.731091 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d091c9cd-d315-4f60-b961-1c32c5afdc9a None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:40.751309 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 366/737] 10.222.0.52 () {56 vars in 1135 bytes} [Sat May 14 20:50:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:40.753614 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5d11d-6af8-42ff-830a-ebada9cbc122 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:40.753974 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5d11d-6af8-42ff-830a-ebada9cbc122 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:40.754324 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5d11d-6af8-42ff-830a-ebada9cbc122 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:40.760270 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 367/738] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:50:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:50:40.760270 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db5d11d-6af8-42ff-830a-ebada9cbc122 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:40.763278 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f6a19d-9ea9-412a-85d7-e640188c91c4 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:40.800702 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08026b84-ff3e-44bc-b4bc-736dd5e07f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:40.801418 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08026b84-ff3e-44bc-b4bc-736dd5e07f2e None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:40.801695 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08026b84-ff3e-44bc-b4bc-736dd5e07f2e None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:40.801965 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08026b84-ff3e-44bc-b4bc-736dd5e07f2e None admin] PATH_INFO: `/v3/roles/service` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:40.812933 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08026b84-ff3e-44bc-b4bc-736dd5e07f2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:50:40.821283 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-08026b84-ff3e-44bc-b4bc-736dd5e07f2e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 14 20:50:40.821283 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:40.821283 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:40.821283 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:40.821283 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:40.821283 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:40.821283 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:40.821283 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:40.821283 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:40.821283 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:40.821283 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:40.821283 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:40.821283 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:50:40.821283 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:50:40.821283 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:50:40.821283 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:50:40.822296 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:50:40.822296 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:50:40.822296 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:50:40.822296 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:50:40.822296 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:40.822296 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:40.822296 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:40.822296 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:40.822296 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:40.822296 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:40.822296 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:40.822296 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:50:40.822296 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:40.822296 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:40.822296 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:40.822296 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:40.823285 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:40.823285 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:40.823285 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:40.823285 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:40.823285 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:50:40.823285 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:50:40.823285 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:50:40.823285 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:50:40.823285 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:50:40.823285 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:50:40.823285 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 14 20:50:40.823285 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:40.823285 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 372/739] 10.222.0.52 () {56 vars in 1102 bytes} [Sat May 14 20:50:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:40.827649 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08026b84-ff3e-44bc-b4bc-736dd5e07f2e None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:40.876058 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db5d11d-6af8-42ff-830a-ebada9cbc122 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:40.910907 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23917300-b3d8-4562-ad3b-ea9ffae285a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:40.911617 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23917300-b3d8-4562-ad3b-ea9ffae285a4 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:40.911898 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23917300-b3d8-4562-ad3b-ea9ffae285a4 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:40.912168 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23917300-b3d8-4562-ad3b-ea9ffae285a4 None admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:40.912877 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23917300-b3d8-4562-ad3b-ea9ffae285a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:40.913179 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23917300-b3d8-4562-ad3b-ea9ffae285a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:40.914526 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23917300-b3d8-4562-ad3b-ea9ffae285a4 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:40.928270 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 368/740] 10.222.0.52 () {56 vars in 1109 bytes} [Sat May 14 20:50:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:40.928270 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e3c0db-1fa4-46e0-9128-c1d2d5b4300c None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:40.928538 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e3c0db-1fa4-46e0-9128-c1d2d5b4300c None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:40.928775 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e3c0db-1fa4-46e0-9128-c1d2d5b4300c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:40.942360 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08026b84-ff3e-44bc-b4bc-736dd5e07f2e None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:40.948490 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-58e3c0db-1fa4-46e0-9128-c1d2d5b4300c None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:50:40.950290 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-58e3c0db-1fa4-46e0-9128-c1d2d5b4300c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:50:40.980634 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ff8c0-a8c4-40a4-98cb-b80735b74940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:40.981745 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ff8c0-a8c4-40a4-98cb-b80735b74940 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:40.982154 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ff8c0-a8c4-40a4-98cb-b80735b74940 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:40.982535 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ff8c0-a8c4-40a4-98cb-b80735b74940 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:41.019549 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 369/741] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:50:40 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 20:50:41.019549 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e3c0db-1fa4-46e0-9128-c1d2d5b4300c None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:41.065809 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326ff8c0-a8c4-40a4-98cb-b80735b74940 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:41.067599 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326ff8c0-a8c4-40a4-98cb-b80735b74940 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:41.118615 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e3c0db-1fa4-46e0-9128-c1d2d5b4300c None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:41.154343 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2592a9-84c4-45be-b512-b8cee74acf09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:41.155089 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2592a9-84c4-45be-b512-b8cee74acf09 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:41.155276 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2592a9-84c4-45be-b512-b8cee74acf09 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:41.155571 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2592a9-84c4-45be-b512-b8cee74acf09 None admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:41.156311 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2592a9-84c4-45be-b512-b8cee74acf09 None admin] RBAC: Adding query filter params (name=service) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:41.156875 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2592a9-84c4-45be-b512-b8cee74acf09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:41.158136 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2592a9-84c4-45be-b512-b8cee74acf09 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:41.170865 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 373/742] 10.222.0.52 () {58 vars in 1282 bytes} [Sat May 14 20:50:40 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 14 20:50:41.170865 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ff8c0-a8c4-40a4-98cb-b80735b74940 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:41.171442 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 370/743] 10.222.0.52 () {56 vars in 1103 bytes} [Sat May 14 20:50:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:41.171731 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2592a9-84c4-45be-b512-b8cee74acf09 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:41.263925 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ff8c0-a8c4-40a4-98cb-b80735b74940 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:41.270404 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2592a9-84c4-45be-b512-b8cee74acf09 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:41.298177 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce89db7-1f02-4bcf-8183-fa51140f93e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:41.298982 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce89db7-1f02-4bcf-8183-fa51140f93e6 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:41.299347 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce89db7-1f02-4bcf-8183-fa51140f93e6 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:41.299653 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce89db7-1f02-4bcf-8183-fa51140f93e6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:41.304623 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d86eeb4-a6aa-491f-8d28-c4b4b5e29478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:41.305289 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d86eeb4-a6aa-491f-8d28-c4b4b5e29478 None admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:41.305576 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d86eeb4-a6aa-491f-8d28-c4b4b5e29478 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:41.305857 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d86eeb4-a6aa-491f-8d28-c4b4b5e29478 None admin] PATH_INFO: `/v3/services` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:41.306579 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d86eeb4-a6aa-491f-8d28-c4b4b5e29478 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:41.306775 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce89db7-1f02-4bcf-8183-fa51140f93e6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:41.308025 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d86eeb4-a6aa-491f-8d28-c4b4b5e29478 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:41.308231 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce89db7-1f02-4bcf-8183-fa51140f93e6 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:41.324021 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-8ce89db7-1f02-4bcf-8183-fa51140f93e6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 14 20:50:41.324021 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:41.324021 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:41.324021 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:41.324021 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:41.324021 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:41.324021 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:41.324021 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:41.324021 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:41.324021 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:41.324021 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:41.324021 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:41.324021 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 14 20:50:41.324021 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_user(user_id) May 14 20:50:41.324021 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 14 20:50:41.324021 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 14 20:50:41.325015 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:41.325015 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:41.325015 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 20:50:41.325015 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 20:50:41.325015 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 14 20:50:41.325015 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 20:50:41.325015 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:41.325015 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:41.325015 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:41.325015 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:41.325015 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:41.325015 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:50:41.325015 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:41.325015 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:41.325015 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:41.325015 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:41.325015 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:41.325015 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:41.326515 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:41.326515 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:41.326515 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 14 20:50:41.326515 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 14 20:50:41.326515 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 14 20:50:41.326515 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 14 20:50:41.326515 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 14 20:50:41.326515 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 14 20:50:41.326515 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 14 20:50:41.326515 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:41.326515 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 374/744] 10.222.0.52 () {56 vars in 1093 bytes} [Sat May 14 20:50:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:41.326515 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce89db7-1f02-4bcf-8183-fa51140f93e6 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:41.405662 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 371/745] 10.222.0.52 () {60 vars in 1141 bytes} [Sat May 14 20:50:41 2022] POST /identity/v3/services => generated 251 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 20:50:41.406418 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d86eeb4-a6aa-491f-8d28-c4b4b5e29478 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:41.441741 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce89db7-1f02-4bcf-8183-fa51140f93e6 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:41.493554 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab79bfbc-e102-4b24-b5bf-7061417893f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:41.494702 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79bfbc-e102-4b24-b5bf-7061417893f6 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:41.495201 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79bfbc-e102-4b24-b5bf-7061417893f6 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:41.495705 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79bfbc-e102-4b24-b5bf-7061417893f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:41.509455 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab79bfbc-e102-4b24-b5bf-7061417893f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:41.511325 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab79bfbc-e102-4b24-b5bf-7061417893f6 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:41.525629 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d86eeb4-a6aa-491f-8d28-c4b4b5e29478 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:41.531760 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-ab79bfbc-e102-4b24-b5bf-7061417893f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:41.531760 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:41.531760 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:41.531760 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:41.531760 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:41.531760 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:41.531760 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:41.531760 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:41.531760 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:41.531760 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:41.531760 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:41.531760 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:41.531760 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:50:41.531760 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:50:41.531760 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:50:41.532774 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:50:41.532774 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:41.532774 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:41.532774 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:41.532774 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:41.532774 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:41.532774 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:41.532774 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:41.532774 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:50:41.532774 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:41.532774 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:41.532774 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:41.532774 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:41.532774 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:41.532774 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:41.532774 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:41.532774 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:41.533866 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 20:50:41.533866 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:50:41.533866 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:41.533866 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:41.539901 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 375/746] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:50:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:41.541140 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab79bfbc-e102-4b24-b5bf-7061417893f6 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:41.562997 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b640c47-c8f8-475c-bc44-81240cd30669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:41.564115 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b640c47-c8f8-475c-bc44-81240cd30669 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:41.564279 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b640c47-c8f8-475c-bc44-81240cd30669 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:41.564399 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b640c47-c8f8-475c-bc44-81240cd30669 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:41.576178 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b640c47-c8f8-475c-bc44-81240cd30669 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:41.577557 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b640c47-c8f8-475c-bc44-81240cd30669 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:41.596434 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-7b640c47-c8f8-475c-bc44-81240cd30669 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:41.596434 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:41.596434 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:41.596434 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:41.596434 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:41.596434 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:41.596434 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:41.596434 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:41.596434 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:41.596434 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:41.596434 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:41.596434 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:41.596434 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:50:41.596434 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:50:41.596434 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:50:41.597422 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:50:41.597422 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:41.597422 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:41.597422 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:41.597422 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:41.597422 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:41.597422 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:41.597422 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:41.597422 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:50:41.597422 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:41.597422 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:41.597422 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:41.597422 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:41.597422 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:41.597422 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:41.597422 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:41.597422 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:41.599048 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 20:50:41.599048 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:50:41.599048 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:41.599048 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:41.599048 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 372/747] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:50:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:41.599048 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b640c47-c8f8-475c-bc44-81240cd30669 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:41.656301 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab79bfbc-e102-4b24-b5bf-7061417893f6 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:41.704985 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916e02a1-20e6-4ae5-91aa-2402f6827661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:41.705986 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e02a1-20e6-4ae5-91aa-2402f6827661 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:41.706543 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e02a1-20e6-4ae5-91aa-2402f6827661 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:41.706826 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e02a1-20e6-4ae5-91aa-2402f6827661 None admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:41.707747 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916e02a1-20e6-4ae5-91aa-2402f6827661 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:41.708151 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916e02a1-20e6-4ae5-91aa-2402f6827661 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:41.708364 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b640c47-c8f8-475c-bc44-81240cd30669 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:41.709608 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916e02a1-20e6-4ae5-91aa-2402f6827661 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:41.733339 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 376/748] 10.222.0.52 () {56 vars in 1133 bytes} [Sat May 14 20:50:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:41.734310 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916e02a1-20e6-4ae5-91aa-2402f6827661 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:41.750809 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ad5920-c204-4c68-b920-2a45ba87e4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:41.752234 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad5920-c204-4c68-b920-2a45ba87e4e9 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:41.752498 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad5920-c204-4c68-b920-2a45ba87e4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:41.753202 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad5920-c204-4c68-b920-2a45ba87e4e9 None admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:41.754204 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ad5920-c204-4c68-b920-2a45ba87e4e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:41.754517 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ad5920-c204-4c68-b920-2a45ba87e4e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:41.756476 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ad5920-c204-4c68-b920-2a45ba87e4e9 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:41.773742 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 373/749] 10.222.0.52 () {56 vars in 1109 bytes} [Sat May 14 20:50:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:41.774689 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ad5920-c204-4c68-b920-2a45ba87e4e9 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:41.854976 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916e02a1-20e6-4ae5-91aa-2402f6827661 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:41.894520 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ad5920-c204-4c68-b920-2a45ba87e4e9 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:41.896656 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c10a275-e704-4b48-a680-ac239dfa63d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:41.898152 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10a275-e704-4b48-a680-ac239dfa63d2 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:41.898441 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10a275-e704-4b48-a680-ac239dfa63d2 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:41.898720 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10a275-e704-4b48-a680-ac239dfa63d2 None admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:41.899453 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c10a275-e704-4b48-a680-ac239dfa63d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:41.899789 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c10a275-e704-4b48-a680-ac239dfa63d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:41.901174 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c10a275-e704-4b48-a680-ac239dfa63d2 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:41.921325 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 377/750] 10.222.0.52 () {56 vars in 1109 bytes} [Sat May 14 20:50:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:41.922405 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c10a275-e704-4b48-a680-ac239dfa63d2 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:41.941880 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2bba3a-9b11-4800-901b-b52fe3af7beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:41.942683 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2bba3a-9b11-4800-901b-b52fe3af7beb None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:41.942967 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2bba3a-9b11-4800-901b-b52fe3af7beb None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:41.943248 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2bba3a-9b11-4800-901b-b52fe3af7beb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:41.953619 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2bba3a-9b11-4800-901b-b52fe3af7beb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:41.955350 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2bba3a-9b11-4800-901b-b52fe3af7beb None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:41.978979 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-4e2bba3a-9b11-4800-901b-b52fe3af7beb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:41.978979 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:41.978979 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:41.978979 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:41.978979 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:41.978979 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:41.978979 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:41.978979 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:41.978979 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:41.978979 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:41.978979 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:41.978979 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:41.978979 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:50:41.978979 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:50:41.978979 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:50:41.980146 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:50:41.980146 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:41.980146 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:41.980146 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:41.980146 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:41.980146 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:41.980146 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:41.980146 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:41.980146 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:50:41.980146 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:41.980146 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:41.980146 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:41.980146 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:41.980146 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:41.980146 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:41.980146 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:41.980146 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:41.981136 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 20:50:41.981136 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:50:41.981136 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:41.981136 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:41.983558 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 374/751] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:50:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:41.984579 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2bba3a-9b11-4800-901b-b52fe3af7beb None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:42.050573 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c10a275-e704-4b48-a680-ac239dfa63d2 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:42.087239 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2bba3a-9b11-4800-901b-b52fe3af7beb None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:42.093225 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f105ab5-80c6-4fbb-ae66-45895463e0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:42.094025 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f105ab5-80c6-4fbb-ae66-45895463e0aa None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:42.094315 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f105ab5-80c6-4fbb-ae66-45895463e0aa None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:42.094588 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f105ab5-80c6-4fbb-ae66-45895463e0aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:42.104388 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f105ab5-80c6-4fbb-ae66-45895463e0aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:42.106183 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f105ab5-80c6-4fbb-ae66-45895463e0aa None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:42.122518 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-9f105ab5-80c6-4fbb-ae66-45895463e0aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 14 20:50:42.122518 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:42.122518 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:42.122518 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:42.122518 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:42.122518 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:42.122518 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:42.122518 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:42.122518 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:42.122518 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:42.122518 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:42.122518 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:42.122518 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 14 20:50:42.122518 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_project(project_id) May 14 20:50:42.122518 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 14 20:50:42.124121 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 14 20:50:42.124121 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:42.124121 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:42.124121 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:42.124121 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:42.124121 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:42.124121 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:42.124121 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:42.124121 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:50:42.124121 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:42.124121 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:42.124121 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:42.124121 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:42.124121 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:42.124121 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:42.124121 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:42.124121 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:42.125220 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 14 20:50:42.125220 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 14 20:50:42.125220 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 20:50:42.125220 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 20:50:42.125220 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 20:50:42.125220 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 20:50:42.125220 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 14 20:50:42.125220 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:42.125220 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 378/752] 10.222.0.52 () {56 vars in 1111 bytes} [Sat May 14 20:50:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:42.125220 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f105ab5-80c6-4fbb-ae66-45895463e0aa None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:42.127053 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bbdf3a-97bc-4aca-85f2-31daaa5a8769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:42.128106 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bbdf3a-97bc-4aca-85f2-31daaa5a8769 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:42.128541 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bbdf3a-97bc-4aca-85f2-31daaa5a8769 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:42.128960 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bbdf3a-97bc-4aca-85f2-31daaa5a8769 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:42.136382 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bbdf3a-97bc-4aca-85f2-31daaa5a8769 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:42.137827 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bbdf3a-97bc-4aca-85f2-31daaa5a8769 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:42.153006 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-d7bbdf3a-97bc-4aca-85f2-31daaa5a8769 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 14 20:50:42.153006 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:42.153006 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:42.153006 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:42.153006 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:42.153006 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:42.153006 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:42.153006 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:42.153006 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:42.153006 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:42.153006 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:42.153006 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:42.153006 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 14 20:50:42.153006 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_user(user_id) May 14 20:50:42.153006 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 14 20:50:42.153006 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 14 20:50:42.153963 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:42.153963 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:42.153963 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 20:50:42.153963 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 20:50:42.153963 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 14 20:50:42.153963 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 20:50:42.153963 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:42.153963 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:42.153963 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:42.153963 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:42.153963 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:42.153963 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:50:42.153963 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:42.153963 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:42.153963 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:42.153963 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:42.153963 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:42.153963 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:42.155453 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:42.155453 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:42.155453 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 14 20:50:42.155453 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 14 20:50:42.155453 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 14 20:50:42.155453 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 14 20:50:42.155453 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 14 20:50:42.155453 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 14 20:50:42.155453 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 14 20:50:42.155453 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:42.159577 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 375/753] 10.222.0.52 () {56 vars in 1117 bytes} [Sat May 14 20:50:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:42.160425 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bbdf3a-97bc-4aca-85f2-31daaa5a8769 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:42.259464 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f105ab5-80c6-4fbb-ae66-45895463e0aa None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:42.261179 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bbdf3a-97bc-4aca-85f2-31daaa5a8769 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:42.296735 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e331fa3a-0c01-448b-8f6f-0c4c06fbfc80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:42.296972 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9548fdb-dd1d-4e12-9e93-c2666e8775b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:42.297392 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e331fa3a-0c01-448b-8f6f-0c4c06fbfc80 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:42.297720 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e331fa3a-0c01-448b-8f6f-0c4c06fbfc80 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:42.297998 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e331fa3a-0c01-448b-8f6f-0c4c06fbfc80 None admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:42.298698 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9548fdb-dd1d-4e12-9e93-c2666e8775b8 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:42.299195 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9548fdb-dd1d-4e12-9e93-c2666e8775b8 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:42.299302 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e331fa3a-0c01-448b-8f6f-0c4c06fbfc80 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:42.299590 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e331fa3a-0c01-448b-8f6f-0c4c06fbfc80 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:42.300010 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9548fdb-dd1d-4e12-9e93-c2666e8775b8 None admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:42.300931 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9548fdb-dd1d-4e12-9e93-c2666e8775b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:42.301037 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e331fa3a-0c01-448b-8f6f-0c4c06fbfc80 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:42.301545 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9548fdb-dd1d-4e12-9e93-c2666e8775b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:42.303107 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9548fdb-dd1d-4e12-9e93-c2666e8775b8 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:42.313354 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 376/754] 10.222.0.52 () {56 vars in 1148 bytes} [Sat May 14 20:50:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:42.314437 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e331fa3a-0c01-448b-8f6f-0c4c06fbfc80 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:42.319962 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 379/755] 10.222.0.52 () {56 vars in 1109 bytes} [Sat May 14 20:50:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:42.321115 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9548fdb-dd1d-4e12-9e93-c2666e8775b8 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:42.417570 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e331fa3a-0c01-448b-8f6f-0c4c06fbfc80 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:42.432742 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9548fdb-dd1d-4e12-9e93-c2666e8775b8 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:42.451908 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bea097-c98e-4dcc-ae08-ebf1e286bfc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:42.452573 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bea097-c98e-4dcc-ae08-ebf1e286bfc4 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:42.452857 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bea097-c98e-4dcc-ae08-ebf1e286bfc4 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:42.453133 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bea097-c98e-4dcc-ae08-ebf1e286bfc4 None admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:42.453972 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bea097-c98e-4dcc-ae08-ebf1e286bfc4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:42.454363 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bea097-c98e-4dcc-ae08-ebf1e286bfc4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:42.456501 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bea097-c98e-4dcc-ae08-ebf1e286bfc4 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:42.474382 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b157db-9a38-4bcd-8f33-bb8bd3540f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:42.474382 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b157db-9a38-4bcd-8f33-bb8bd3540f13 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:42.474382 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b157db-9a38-4bcd-8f33-bb8bd3540f13 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:42.474382 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b157db-9a38-4bcd-8f33-bb8bd3540f13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:42.474808 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b157db-9a38-4bcd-8f33-bb8bd3540f13 None admin] RBAC: Adding query filter params (role.id=24c463e2b4d44dd28cd2723a69a8ed2e, scope.project.id=0911a024287e430ea6ee015389f0c440, user.id=c781fe7f4a014f0d8b5e7385b20b348c) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:42.474808 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b157db-9a38-4bcd-8f33-bb8bd3540f13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:42.475174 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b157db-9a38-4bcd-8f33-bb8bd3540f13 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:42.479745 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 377/756] 10.222.0.52 () {56 vars in 1149 bytes} [Sat May 14 20:50:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:42.480666 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bea097-c98e-4dcc-ae08-ebf1e286bfc4 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:42.487643 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 380/757] 10.222.0.52 () {56 vars in 1374 bytes} [Sat May 14 20:50:42 2022] GET /identity/v3/role_assignments?user.id=c781fe7f4a014f0d8b5e7385b20b348c&scope.project.id=0911a024287e430ea6ee015389f0c440&role.id=24c463e2b4d44dd28cd2723a69a8ed2e => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:42.488778 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b157db-9a38-4bcd-8f33-bb8bd3540f13 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:42.591469 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bea097-c98e-4dcc-ae08-ebf1e286bfc4 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:42.634095 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bde6762-2c65-4edd-87a9-bdf538e60b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:42.634957 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde6762-2c65-4edd-87a9-bdf538e60b06 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:42.635240 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde6762-2c65-4edd-87a9-bdf538e60b06 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:42.635544 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde6762-2c65-4edd-87a9-bdf538e60b06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:42.649302 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bde6762-2c65-4edd-87a9-bdf538e60b06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:42.650771 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bde6762-2c65-4edd-87a9-bdf538e60b06 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:42.675998 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-3bde6762-2c65-4edd-87a9-bdf538e60b06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 14 20:50:42.675998 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:42.675998 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:42.675998 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:42.675998 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:42.675998 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:42.675998 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:42.675998 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:42.675998 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:42.675998 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:42.675998 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:42.675998 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:42.675998 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 14 20:50:42.675998 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_project(project_id) May 14 20:50:42.675998 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 14 20:50:42.676956 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 14 20:50:42.676956 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:42.676956 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:42.676956 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:42.676956 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:42.676956 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:42.676956 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:42.676956 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:42.676956 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:50:42.676956 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:42.676956 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:42.676956 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:42.676956 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:42.676956 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:42.676956 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:42.676956 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:42.676956 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:42.677884 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 14 20:50:42.677884 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 14 20:50:42.677884 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 20:50:42.677884 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 20:50:42.677884 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 20:50:42.677884 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 20:50:42.677884 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 14 20:50:42.677884 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:42.680942 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 378/758] 10.222.0.52 () {56 vars in 1111 bytes} [Sat May 14 20:50:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:42.687976 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bde6762-2c65-4edd-87a9-bdf538e60b06 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:42.733632 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b157db-9a38-4bcd-8f33-bb8bd3540f13 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:42.782434 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645c22fe-c925-4d28-a4b6-ef18d7e377f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:42.785676 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c22fe-c925-4d28-a4b6-ef18d7e377f3 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:42.785961 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c22fe-c925-4d28-a4b6-ef18d7e377f3 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:42.786237 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c22fe-c925-4d28-a4b6-ef18d7e377f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:42.839163 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bde6762-2c65-4edd-87a9-bdf538e60b06 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:42.882095 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0624b38-39cc-4e03-ad68-dd841aede0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:42.882831 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0624b38-39cc-4e03-ad68-dd841aede0f6 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:42.883243 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0624b38-39cc-4e03-ad68-dd841aede0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:42.883548 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0624b38-39cc-4e03-ad68-dd841aede0f6 None admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:42.890483 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0624b38-39cc-4e03-ad68-dd841aede0f6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:42.890807 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0624b38-39cc-4e03-ad68-dd841aede0f6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:42.892964 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0624b38-39cc-4e03-ad68-dd841aede0f6 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:42.921722 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 379/759] 10.222.0.52 () {56 vars in 1148 bytes} [Sat May 14 20:50:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:42.922965 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0624b38-39cc-4e03-ad68-dd841aede0f6 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:42.938794 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645c22fe-c925-4d28-a4b6-ef18d7e377f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:42.941053 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645c22fe-c925-4d28-a4b6-ef18d7e377f3 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:43.044566 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 381/760] 10.222.0.52 () {58 vars in 1282 bytes} [Sat May 14 20:50:42 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 14 20:50:43.046051 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54806b6-e5ae-4fbd-8428-9b2213cc44d1 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:43.046341 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54806b6-e5ae-4fbd-8428-9b2213cc44d1 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:43.046617 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54806b6-e5ae-4fbd-8428-9b2213cc44d1 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:43.048169 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 382/761] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:50:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:50:43.052373 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54806b6-e5ae-4fbd-8428-9b2213cc44d1 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:43.053283 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0624b38-39cc-4e03-ad68-dd841aede0f6 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:43.088595 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda41638-e7e7-4532-bb69-fd3bee2dd942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:43.089509 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda41638-e7e7-4532-bb69-fd3bee2dd942 None admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:43.089870 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda41638-e7e7-4532-bb69-fd3bee2dd942 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:43.090160 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda41638-e7e7-4532-bb69-fd3bee2dd942 None admin] PATH_INFO: `/v3/projects/0911a024287e430ea6ee015389f0c440/users/0f1b0e2b025d4eceaa90e1616d0a9db8/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:43.092208 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda41638-e7e7-4532-bb69-fd3bee2dd942 None admin] RBAC: Authorizing `identity:create_grant(project_id=0911a024287e430ea6ee015389f0c440, user_id=0f1b0e2b025d4eceaa90e1616d0a9db8, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:43.093698 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda41638-e7e7-4532-bb69-fd3bee2dd942 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:43.158472 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54806b6-e5ae-4fbd-8428-9b2213cc44d1 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:43.165783 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 380/762] 10.222.0.52 () {58 vars in 1439 bytes} [Sat May 14 20:50:42 2022] PUT /identity/v3/projects/0911a024287e430ea6ee015389f0c440/users/0f1b0e2b025d4eceaa90e1616d0a9db8/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 20:50:43.167082 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76553d-c614-43d3-8868-7ea6b198fd53 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:43.172083 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76553d-c614-43d3-8868-7ea6b198fd53 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:43.172488 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76553d-c614-43d3-8868-7ea6b198fd53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:43.196190 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549217ee-e5ea-4599-91f9-7a50aded57e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:43.196911 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549217ee-e5ea-4599-91f9-7a50aded57e0 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:43.197194 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549217ee-e5ea-4599-91f9-7a50aded57e0 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:43.197472 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549217ee-e5ea-4599-91f9-7a50aded57e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:43.209220 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549217ee-e5ea-4599-91f9-7a50aded57e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:43.209655 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-6a76553d-c614-43d3-8868-7ea6b198fd53 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:50:43.210967 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549217ee-e5ea-4599-91f9-7a50aded57e0 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:43.211134 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-6a76553d-c614-43d3-8868-7ea6b198fd53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:50:43.230677 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-549217ee-e5ea-4599-91f9-7a50aded57e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:43.230677 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:43.230677 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:43.230677 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:43.230677 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:43.230677 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:43.230677 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:43.230677 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:43.230677 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:43.230677 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:43.230677 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:43.230677 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:43.230677 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:50:43.230677 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:50:43.230677 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:50:43.231675 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:50:43.231675 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:43.231675 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:43.231675 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:43.231675 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:43.231675 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:43.231675 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:43.231675 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:43.231675 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:50:43.231675 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:43.231675 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:43.231675 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:43.231675 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:43.231675 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:43.231675 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:43.231675 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:43.231675 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:43.232576 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 20:50:43.232576 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:50:43.232576 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:43.232576 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:43.232576 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 383/763] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:50:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:43.239438 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549217ee-e5ea-4599-91f9-7a50aded57e0 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:43.363443 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549217ee-e5ea-4599-91f9-7a50aded57e0 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:43.410699 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf8b4e8-bfcb-4aa3-860c-1c372a843f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:43.411877 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8b4e8-bfcb-4aa3-860c-1c372a843f04 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:43.413278 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8b4e8-bfcb-4aa3-860c-1c372a843f04 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:43.413777 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8b4e8-bfcb-4aa3-860c-1c372a843f04 None admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:43.414988 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf8b4e8-bfcb-4aa3-860c-1c372a843f04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:43.416980 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf8b4e8-bfcb-4aa3-860c-1c372a843f04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:43.419211 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf8b4e8-bfcb-4aa3-860c-1c372a843f04 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:43.431242 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 381/764] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:50:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 20:50:43.441585 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 384/765] 10.222.0.52 () {56 vars in 1109 bytes} [Sat May 14 20:50:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:43.447234 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a76553d-c614-43d3-8868-7ea6b198fd53 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:43.468423 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf8b4e8-bfcb-4aa3-860c-1c372a843f04 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:43.562734 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a76553d-c614-43d3-8868-7ea6b198fd53 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:43.600654 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6967e4-f72f-4ab4-b4e8-154bcd9ab6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:43.602447 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6967e4-f72f-4ab4-b4e8-154bcd9ab6aa None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:43.603091 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6967e4-f72f-4ab4-b4e8-154bcd9ab6aa None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:43.604617 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6967e4-f72f-4ab4-b4e8-154bcd9ab6aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:43.616096 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6967e4-f72f-4ab4-b4e8-154bcd9ab6aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:43.618393 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf8b4e8-bfcb-4aa3-860c-1c372a843f04 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:43.621619 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6967e4-f72f-4ab4-b4e8-154bcd9ab6aa None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:43.640677 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-df6967e4-f72f-4ab4-b4e8-154bcd9ab6aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 14 20:50:43.640677 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:43.640677 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:43.640677 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:43.640677 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:43.640677 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:43.640677 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:43.640677 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:43.640677 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:43.640677 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:43.640677 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:43.640677 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:43.640677 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 14 20:50:43.640677 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_project(project_id) May 14 20:50:43.640677 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 14 20:50:43.641631 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 14 20:50:43.641631 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:43.641631 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:43.641631 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:43.641631 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:43.641631 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:43.641631 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:43.641631 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:43.641631 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:50:43.641631 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:43.641631 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:43.641631 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:43.641631 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:43.641631 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:43.641631 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:43.641631 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:43.641631 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:43.643068 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 14 20:50:43.643068 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 14 20:50:43.643068 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 20:50:43.643068 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 20:50:43.643068 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 20:50:43.643068 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 20:50:43.643068 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 14 20:50:43.643068 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:43.645538 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 382/766] 10.222.0.52 () {56 vars in 1111 bytes} [Sat May 14 20:50:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:43.652658 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6967e4-f72f-4ab4-b4e8-154bcd9ab6aa None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:43.675344 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74368201-5987-4005-83c4-c71de8f93b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:43.677745 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74368201-5987-4005-83c4-c71de8f93b88 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:43.678025 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74368201-5987-4005-83c4-c71de8f93b88 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:43.678349 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74368201-5987-4005-83c4-c71de8f93b88 None admin] PATH_INFO: `/v3/services/network` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:43.679011 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74368201-5987-4005-83c4-c71de8f93b88 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:43.681317 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74368201-5987-4005-83c4-c71de8f93b88 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:43.699098 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-74368201-5987-4005-83c4-c71de8f93b88 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 14 20:50:43.699098 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:43.699098 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 14 20:50:43.699098 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 14 20:50:43.699098 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 14 20:50:43.699098 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 14 20:50:43.699098 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 14 20:50:43.699098 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 20:50:43.699098 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 14 20:50:43.699098 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:43.699098 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 20:50:43.699098 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:43.699098 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:43.699098 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:43.699098 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:43.699098 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:43.699098 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:43.700133 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:43.700133 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:43.700133 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:43.700133 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:43.700133 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:43.700133 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:43.700133 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 14 20:50:43.700133 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_service(service_id) May 14 20:50:43.700133 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 14 20:50:43.700133 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 14 20:50:43.700133 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:43.700133 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:43.700133 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:43.700133 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:43.700133 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:43.700133 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:43.700988 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:43.700988 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:50:43.700988 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:43.700988 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:43.700988 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:43.700988 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:43.700988 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:43.700988 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:43.700988 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:43.700988 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:43.700988 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 14 20:50:43.700988 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 20:50:43.700988 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 14 20:50:43.700988 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:43.700988 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 385/767] 10.222.0.52 () {56 vars in 1111 bytes} [Sat May 14 20:50:43 2022] GET /identity/v3/services/network => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 20:50:43.709752 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74368201-5987-4005-83c4-c71de8f93b88 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:43.796486 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6967e4-f72f-4ab4-b4e8-154bcd9ab6aa None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:43.817040 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74368201-5987-4005-83c4-c71de8f93b88 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:43.841805 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78c2c9b-e493-4d3f-bf07-449ba75f366c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:43.842863 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c2c9b-e493-4d3f-bf07-449ba75f366c None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:43.843349 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c2c9b-e493-4d3f-bf07-449ba75f366c None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:43.843848 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c2c9b-e493-4d3f-bf07-449ba75f366c None admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:43.844849 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78c2c9b-e493-4d3f-bf07-449ba75f366c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:43.845944 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78c2c9b-e493-4d3f-bf07-449ba75f366c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:43.847843 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78c2c9b-e493-4d3f-bf07-449ba75f366c None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:43.854797 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b103bc0b-7f5f-47a7-bc16-29917933f7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:43.855295 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103bc0b-7f5f-47a7-bc16-29917933f7bc None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:43.855602 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103bc0b-7f5f-47a7-bc16-29917933f7bc None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:43.855882 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103bc0b-7f5f-47a7-bc16-29917933f7bc None admin] PATH_INFO: `/v3/services` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:43.856603 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b103bc0b-7f5f-47a7-bc16-29917933f7bc None admin] RBAC: Adding query filter params (name=network) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:43.856912 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b103bc0b-7f5f-47a7-bc16-29917933f7bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:43.858297 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b103bc0b-7f5f-47a7-bc16-29917933f7bc None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:43.868862 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 386/768] 10.222.0.52 () {56 vars in 1112 bytes} [Sat May 14 20:50:43 2022] GET /identity/v3/services?name=network => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:50:43.871509 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b103bc0b-7f5f-47a7-bc16-29917933f7bc None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:43.889804 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 383/769] 10.222.0.52 () {56 vars in 1148 bytes} [Sat May 14 20:50:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:50:43.895904 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78c2c9b-e493-4d3f-bf07-449ba75f366c None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:43.975762 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b103bc0b-7f5f-47a7-bc16-29917933f7bc None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:44.010740 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8215d08c-1e53-40a1-b123-e28585e90f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:44.011412 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215d08c-1e53-40a1-b123-e28585e90f56 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:44.011721 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215d08c-1e53-40a1-b123-e28585e90f56 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:44.012000 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215d08c-1e53-40a1-b123-e28585e90f56 None admin] PATH_INFO: `/v3/services` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:44.012706 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8215d08c-1e53-40a1-b123-e28585e90f56 None admin] RBAC: Adding query filter params (type=network) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:44.013010 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8215d08c-1e53-40a1-b123-e28585e90f56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:44.014381 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8215d08c-1e53-40a1-b123-e28585e90f56 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:44.023614 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 387/770] 10.222.0.52 () {56 vars in 1112 bytes} [Sat May 14 20:50:43 2022] GET /identity/v3/services?type=network => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:44.025632 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8215d08c-1e53-40a1-b123-e28585e90f56 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:44.109366 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78c2c9b-e493-4d3f-bf07-449ba75f366c None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:44.132788 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8215d08c-1e53-40a1-b123-e28585e90f56 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:44.149713 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24076dc-7066-4bc5-bf3a-3080df4257b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:44.150370 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24076dc-7066-4bc5-bf3a-3080df4257b1 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:44.150669 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24076dc-7066-4bc5-bf3a-3080df4257b1 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:44.150984 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24076dc-7066-4bc5-bf3a-3080df4257b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:44.152052 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24076dc-7066-4bc5-bf3a-3080df4257b1 None admin] RBAC: Adding query filter params (role.id=998d6a3451be42a89d4cff277851ad70, scope.project.id=0911a024287e430ea6ee015389f0c440, user.id=c31cffc526be4f8992c57ca5e4e2a0f9) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:44.152367 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24076dc-7066-4bc5-bf3a-3080df4257b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:44.153786 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24076dc-7066-4bc5-bf3a-3080df4257b1 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:44.159805 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 384/771] 10.222.0.52 () {56 vars in 1374 bytes} [Sat May 14 20:50:43 2022] GET /identity/v3/role_assignments?user.id=c31cffc526be4f8992c57ca5e4e2a0f9&scope.project.id=0911a024287e430ea6ee015389f0c440&role.id=998d6a3451be42a89d4cff277851ad70 => generated 259 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:50:44.161280 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e92aef-6075-4148-8abe-c700ec7c3a82 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:44.161573 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e92aef-6075-4148-8abe-c700ec7c3a82 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:44.162002 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e92aef-6075-4148-8abe-c700ec7c3a82 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:44.163700 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 385/772] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:50:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:50:44.169368 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635d671-c57e-4a0a-8b6e-15223d16f035 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:44.169993 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635d671-c57e-4a0a-8b6e-15223d16f035 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:44.169993 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635d671-c57e-4a0a-8b6e-15223d16f035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:44.178703 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f676eb1a-cf3f-4279-b7d8-8d0550c07ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:44.179512 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f676eb1a-cf3f-4279-b7d8-8d0550c07ac7 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:44.180816 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f676eb1a-cf3f-4279-b7d8-8d0550c07ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:44.181118 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f676eb1a-cf3f-4279-b7d8-8d0550c07ac7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:44.186849 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f676eb1a-cf3f-4279-b7d8-8d0550c07ac7 None admin] RBAC: Adding query filter params (interface=public, service_id=f3bd30ec15fc40aaa95c0c77c4bd660b, region_id=RegionOne) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:44.187207 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f676eb1a-cf3f-4279-b7d8-8d0550c07ac7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:44.191114 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f676eb1a-cf3f-4279-b7d8-8d0550c07ac7 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:44.198194 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-e635d671-c57e-4a0a-8b6e-15223d16f035 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:50:44.199411 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e635d671-c57e-4a0a-8b6e-15223d16f035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:50:44.201383 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 388/773] 10.222.0.52 () {56 vars in 1251 bytes} [Sat May 14 20:50:44 2022] GET /identity/v3/endpoints?service_id=f3bd30ec15fc40aaa95c0c77c4bd660b&interface=public®ion_id=RegionOne => generated 194 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:44.208537 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f676eb1a-cf3f-4279-b7d8-8d0550c07ac7 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:44.329028 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f676eb1a-cf3f-4279-b7d8-8d0550c07ac7 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:44.353227 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 386/774] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:50:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 20:50:44.367401 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6c19f9-820d-4b52-98a3-4cc88caea633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:44.368105 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c19f9-820d-4b52-98a3-4cc88caea633 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:44.368436 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c19f9-820d-4b52-98a3-4cc88caea633 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:44.368715 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c19f9-820d-4b52-98a3-4cc88caea633 None admin] PATH_INFO: `/v3/services` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:44.369417 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6c19f9-820d-4b52-98a3-4cc88caea633 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:44.370765 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6c19f9-820d-4b52-98a3-4cc88caea633 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:44.376893 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 389/775] 10.222.0.52 () {56 vars in 1087 bytes} [Sat May 14 20:50:44 2022] GET /identity/v3/services => generated 772 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:50:44.380768 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e635d671-c57e-4a0a-8b6e-15223d16f035 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:44.492388 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e635d671-c57e-4a0a-8b6e-15223d16f035 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:44.529102 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f5408e-a2be-40ac-a700-f5f9d2b0dbc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:44.529919 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5408e-a2be-40ac-a700-f5f9d2b0dbc6 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:44.530200 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5408e-a2be-40ac-a700-f5f9d2b0dbc6 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:44.530468 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5408e-a2be-40ac-a700-f5f9d2b0dbc6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:44.531127 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f5408e-a2be-40ac-a700-f5f9d2b0dbc6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:44.532629 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f5408e-a2be-40ac-a700-f5f9d2b0dbc6 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:44.545717 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-92f5408e-a2be-40ac-a700-f5f9d2b0dbc6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 14 20:50:44.545717 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:44.545717 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 14 20:50:44.545717 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 14 20:50:44.545717 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 14 20:50:44.545717 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 14 20:50:44.545717 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 14 20:50:44.545717 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 20:50:44.545717 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 14 20:50:44.545717 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:44.545717 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 20:50:44.545717 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:44.545717 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:44.545717 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:44.545717 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:44.545717 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:44.548015 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:44.548015 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:44.548015 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:44.548015 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:44.548015 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:44.548015 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:44.548015 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:44.548015 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 14 20:50:44.548015 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_service(service_id) May 14 20:50:44.548015 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 14 20:50:44.548015 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 14 20:50:44.548015 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:44.548015 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:44.548015 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:44.548015 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:44.548015 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:44.550573 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:44.550573 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:44.550573 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:50:44.550573 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:44.550573 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:44.550573 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:44.550573 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:44.550573 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:44.550573 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:44.550573 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:44.550573 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:44.550573 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 14 20:50:44.550573 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 20:50:44.550573 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 14 20:50:44.550573 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:44.550573 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 387/776] 10.222.0.52 () {56 vars in 1129 bytes} [Sat May 14 20:50:44 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 20:50:44.556566 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6c19f9-820d-4b52-98a3-4cc88caea633 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:44.701242 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6c19f9-820d-4b52-98a3-4cc88caea633 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:44.735198 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936c909b-eb17-4a5a-a678-a7dd582ccf0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:44.736014 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936c909b-eb17-4a5a-a678-a7dd582ccf0f None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:44.736294 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936c909b-eb17-4a5a-a678-a7dd582ccf0f None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:44.736656 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936c909b-eb17-4a5a-a678-a7dd582ccf0f None admin] PATH_INFO: `/v3/services` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:44.737359 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936c909b-eb17-4a5a-a678-a7dd582ccf0f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:44.737663 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936c909b-eb17-4a5a-a678-a7dd582ccf0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:44.739024 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936c909b-eb17-4a5a-a678-a7dd582ccf0f None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:44.743983 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 390/777] 10.222.0.52 () {56 vars in 1124 bytes} [Sat May 14 20:50:44 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:44.750664 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f5408e-a2be-40ac-a700-f5f9d2b0dbc6 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:44.856079 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f5408e-a2be-40ac-a700-f5f9d2b0dbc6 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:44.890697 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5098a895-0366-4cef-a069-7e06ac37fd7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:44.891272 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098a895-0366-4cef-a069-7e06ac37fd7e None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:44.891579 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098a895-0366-4cef-a069-7e06ac37fd7e None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:44.891860 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098a895-0366-4cef-a069-7e06ac37fd7e None admin] PATH_INFO: `/v3/services` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:44.892657 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5098a895-0366-4cef-a069-7e06ac37fd7e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:44.892957 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5098a895-0366-4cef-a069-7e06ac37fd7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:44.894314 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5098a895-0366-4cef-a069-7e06ac37fd7e None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:44.899502 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 388/778] 10.222.0.52 () {56 vars in 1124 bytes} [Sat May 14 20:50:44 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:44.909264 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936c909b-eb17-4a5a-a678-a7dd582ccf0f None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:45.063360 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936c909b-eb17-4a5a-a678-a7dd582ccf0f None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:45.108391 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a9347b-0e96-4165-af01-408d131978ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:45.109059 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9347b-0e96-4165-af01-408d131978ad None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:45.109341 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9347b-0e96-4165-af01-408d131978ad None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:45.109623 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9347b-0e96-4165-af01-408d131978ad None admin] PATH_INFO: `/v3/endpoints` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:45.110412 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a9347b-0e96-4165-af01-408d131978ad None admin] RBAC: Adding query filter params (interface=public, service_id=5dd47f81cef4469fac2855a2a9f14299, region_id=RegionOne) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:45.110749 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a9347b-0e96-4165-af01-408d131978ad None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:45.112153 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a9347b-0e96-4165-af01-408d131978ad None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:45.124202 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 391/779] 10.222.0.52 () {56 vars in 1251 bytes} [Sat May 14 20:50:44 2022] GET /identity/v3/endpoints?service_id=5dd47f81cef4469fac2855a2a9f14299&interface=public®ion_id=RegionOne => generated 194 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:45.129223 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5098a895-0366-4cef-a069-7e06ac37fd7e None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:45.147165 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d580d49d-7e66-423b-ab44-f5936b62194c None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:45.147470 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d580d49d-7e66-423b-ab44-f5936b62194c None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:45.147737 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d580d49d-7e66-423b-ab44-f5936b62194c None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:45.149377 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 392/780] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:50:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 14 20:50:45.154656 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde25c9-ac4a-4554-b831-538178462f35 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:45.154928 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde25c9-ac4a-4554-b831-538178462f35 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:45.155212 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde25c9-ac4a-4554-b831-538178462f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:45.180781 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-0fde25c9-ac4a-4554-b831-538178462f35 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:50:45.181975 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-0fde25c9-ac4a-4554-b831-538178462f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:50:45.239276 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5098a895-0366-4cef-a069-7e06ac37fd7e None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:45.285636 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913a5aee-2fee-47a9-ae9e-bca61bcef236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:45.286305 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913a5aee-2fee-47a9-ae9e-bca61bcef236 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:45.286655 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913a5aee-2fee-47a9-ae9e-bca61bcef236 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:45.286863 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913a5aee-2fee-47a9-ae9e-bca61bcef236 None admin] PATH_INFO: `/v3/services` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:45.287571 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913a5aee-2fee-47a9-ae9e-bca61bcef236 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:45.289023 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913a5aee-2fee-47a9-ae9e-bca61bcef236 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:45.299509 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 389/781] 10.222.0.52 () {56 vars in 1087 bytes} [Sat May 14 20:50:45 2022] GET /identity/v3/services => generated 772 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:45.302710 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 393/782] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:50:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 20:50:45.345498 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913a5aee-2fee-47a9-ae9e-bca61bcef236 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:45.468759 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913a5aee-2fee-47a9-ae9e-bca61bcef236 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:45.515093 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766b8017-69dc-4239-9fe6-1cc95ed59557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:45.515998 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b8017-69dc-4239-9fe6-1cc95ed59557 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:45.516284 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b8017-69dc-4239-9fe6-1cc95ed59557 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:45.516561 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b8017-69dc-4239-9fe6-1cc95ed59557 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:45.528583 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766b8017-69dc-4239-9fe6-1cc95ed59557 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:50:45.536536 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-766b8017-69dc-4239-9fe6-1cc95ed59557 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 14 20:50:45.536536 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:45.536536 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:45.536536 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:45.536536 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:45.536536 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:45.536536 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:45.536536 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:45.536536 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:45.536536 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:45.536536 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:45.536536 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:45.536536 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:50:45.536536 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:50:45.536536 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:50:45.536536 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:50:45.537520 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:50:45.537520 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:50:45.537520 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:50:45.537520 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:50:45.537520 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:45.537520 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:45.537520 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:45.537520 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:45.537520 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:45.537520 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:45.537520 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:45.537520 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:50:45.537520 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:45.537520 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:45.537520 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:45.537520 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:45.538395 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:45.538395 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:45.538395 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:45.538395 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:45.538395 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:50:45.538395 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:50:45.538395 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:50:45.538395 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:50:45.538395 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:50:45.538395 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:50:45.538395 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 14 20:50:45.538395 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:45.538395 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 390/783] 10.222.0.52 () {56 vars in 1096 bytes} [Sat May 14 20:50:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:45.545197 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde25c9-ac4a-4554-b831-538178462f35 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:45.654349 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde25c9-ac4a-4554-b831-538178462f35 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:45.694082 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866194b6-56e2-4eb6-b64d-80679e30dd84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:45.694756 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866194b6-56e2-4eb6-b64d-80679e30dd84 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:45.695037 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866194b6-56e2-4eb6-b64d-80679e30dd84 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:45.695325 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866194b6-56e2-4eb6-b64d-80679e30dd84 None admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:45.696097 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866194b6-56e2-4eb6-b64d-80679e30dd84 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:45.696404 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866194b6-56e2-4eb6-b64d-80679e30dd84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:45.697785 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866194b6-56e2-4eb6-b64d-80679e30dd84 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:45.707110 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 394/784] 10.222.0.52 () {56 vars in 1099 bytes} [Sat May 14 20:50:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:45.712693 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766b8017-69dc-4239-9fe6-1cc95ed59557 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:45.840802 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766b8017-69dc-4239-9fe6-1cc95ed59557 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:45.875414 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2da740-e530-4328-9974-657966b75e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:45.876224 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2da740-e530-4328-9974-657966b75e95 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:45.877179 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2da740-e530-4328-9974-657966b75e95 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:45.877436 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2da740-e530-4328-9974-657966b75e95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:45.888115 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2da740-e530-4328-9974-657966b75e95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:45.889557 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2da740-e530-4328-9974-657966b75e95 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:45.906682 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-6d2da740-e530-4328-9974-657966b75e95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:45.906682 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:45.906682 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:45.906682 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:45.906682 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:45.906682 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:45.906682 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:45.906682 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:45.906682 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:45.906682 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:45.906682 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:45.906682 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:45.906682 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:50:45.906682 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:50:45.906682 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:50:45.907674 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:50:45.907674 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:45.907674 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:45.907674 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:45.907674 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:45.907674 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:45.907674 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:45.907674 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:45.907674 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:50:45.907674 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:45.907674 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:45.907674 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:45.907674 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:45.907674 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:45.907674 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:45.907674 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:45.907674 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:45.908738 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 20:50:45.908738 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:50:45.908738 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:45.908738 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:45.908738 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 391/785] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:50:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:45.913772 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866194b6-56e2-4eb6-b64d-80679e30dd84 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:46.033331 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866194b6-56e2-4eb6-b64d-80679e30dd84 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:46.070727 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb875d0e-7798-4ebe-920b-05dfd14b64ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:46.071391 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb875d0e-7798-4ebe-920b-05dfd14b64ae None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:46.071705 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb875d0e-7798-4ebe-920b-05dfd14b64ae None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:46.071984 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb875d0e-7798-4ebe-920b-05dfd14b64ae None admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:46.072702 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb875d0e-7798-4ebe-920b-05dfd14b64ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:46.073010 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb875d0e-7798-4ebe-920b-05dfd14b64ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:46.074381 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb875d0e-7798-4ebe-920b-05dfd14b64ae None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:46.088708 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 395/786] 10.222.0.52 () {56 vars in 1109 bytes} [Sat May 14 20:50:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:46.096730 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2da740-e530-4328-9974-657966b75e95 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:46.227897 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2da740-e530-4328-9974-657966b75e95 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:46.269009 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e4922b-1973-4584-bbab-3fb66cd14ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:46.269807 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e4922b-1973-4584-bbab-3fb66cd14ef7 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:46.270092 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e4922b-1973-4584-bbab-3fb66cd14ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:46.270369 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e4922b-1973-4584-bbab-3fb66cd14ef7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:46.285214 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e4922b-1973-4584-bbab-3fb66cd14ef7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:46.286661 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e4922b-1973-4584-bbab-3fb66cd14ef7 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:46.303860 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-85e4922b-1973-4584-bbab-3fb66cd14ef7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 14 20:50:46.303860 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:46.303860 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:46.303860 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:46.303860 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:46.303860 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:46.303860 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:46.303860 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:46.303860 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:46.303860 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:46.303860 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:46.303860 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:46.303860 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 14 20:50:46.303860 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_user(user_id) May 14 20:50:46.303860 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 14 20:50:46.303860 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 14 20:50:46.304864 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:46.304864 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:46.304864 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 20:50:46.304864 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 20:50:46.304864 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 14 20:50:46.304864 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 20:50:46.304864 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:46.304864 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:46.304864 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:46.304864 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:46.304864 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:46.304864 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:50:46.304864 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:46.304864 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:46.304864 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:46.304864 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:46.304864 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:46.304864 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:46.305840 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:46.305840 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:46.305840 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 14 20:50:46.305840 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 14 20:50:46.305840 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 14 20:50:46.305840 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 14 20:50:46.305840 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 14 20:50:46.305840 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 14 20:50:46.305840 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 14 20:50:46.305840 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:46.306455 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ccd6a6-93db-477f-80e1-e2a0a62e1d1f None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:46.306455 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ccd6a6-93db-477f-80e1-e2a0a62e1d1f None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:46.306455 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ccd6a6-93db-477f-80e1-e2a0a62e1d1f None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:46.307687 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 396/788] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:50:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 14 20:50:46.307809 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 392/788] 10.222.0.52 () {56 vars in 1096 bytes} [Sat May 14 20:50:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:46.312609 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ccd6a6-93db-477f-80e1-e2a0a62e1d1f None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:46.317507 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d805c-9e60-4e2a-8fc1-cfa17d6eb0e8 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:46.318045 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d805c-9e60-4e2a-8fc1-cfa17d6eb0e8 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:46.318335 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d805c-9e60-4e2a-8fc1-cfa17d6eb0e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:46.335750 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-950d805c-9e60-4e2a-8fc1-cfa17d6eb0e8 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:50:46.336931 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-950d805c-9e60-4e2a-8fc1-cfa17d6eb0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:50:46.467938 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 393/789] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:50:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 14 20:50:46.492906 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ccd6a6-93db-477f-80e1-e2a0a62e1d1f None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:46.502466 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950d805c-9e60-4e2a-8fc1-cfa17d6eb0e8 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:46.564845 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbdf04c-cb37-4d3d-ada8-5e9cd95142a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:46.566255 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbdf04c-cb37-4d3d-ada8-5e9cd95142a9 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:46.566771 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbdf04c-cb37-4d3d-ada8-5e9cd95142a9 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:46.567255 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbdf04c-cb37-4d3d-ada8-5e9cd95142a9 None admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:46.568423 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbdf04c-cb37-4d3d-ada8-5e9cd95142a9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:46.568965 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbdf04c-cb37-4d3d-ada8-5e9cd95142a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:46.570609 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbdf04c-cb37-4d3d-ada8-5e9cd95142a9 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:46.609736 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950d805c-9e60-4e2a-8fc1-cfa17d6eb0e8 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:46.610321 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 397/790] 10.222.0.52 () {56 vars in 1135 bytes} [Sat May 14 20:50:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:46.615843 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbdf04c-cb37-4d3d-ada8-5e9cd95142a9 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:46.650876 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fae9aa8-1092-4d3e-95de-ecf858174eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:46.651687 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae9aa8-1092-4d3e-95de-ecf858174eb2 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:46.651965 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae9aa8-1092-4d3e-95de-ecf858174eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:46.652234 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae9aa8-1092-4d3e-95de-ecf858174eb2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:46.674741 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fae9aa8-1092-4d3e-95de-ecf858174eb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:50:46.693216 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-5fae9aa8-1092-4d3e-95de-ecf858174eb2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 14 20:50:46.693216 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:46.693216 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:46.693216 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:46.693216 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:46.693216 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:46.693216 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:46.693216 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:46.693216 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:46.693216 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:46.693216 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:46.693216 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:46.693216 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:50:46.693216 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:50:46.693216 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:50:46.693216 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:50:46.694224 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:50:46.694224 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:50:46.694224 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:50:46.694224 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:50:46.694224 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:46.694224 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:46.694224 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:46.694224 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:46.694224 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:46.694224 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:46.694224 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:46.694224 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:50:46.694224 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:46.694224 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:46.694224 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:46.694224 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:46.695095 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:46.695095 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:46.695095 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:46.695095 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:46.695095 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:50:46.695095 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:50:46.695095 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:50:46.695095 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:50:46.695095 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:50:46.695095 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:50:46.695095 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 14 20:50:46.695095 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:46.701290 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 394/791] 10.222.0.52 () {56 vars in 1096 bytes} [Sat May 14 20:50:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 20:50:46.716687 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fae9aa8-1092-4d3e-95de-ecf858174eb2 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:46.781837 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbdf04c-cb37-4d3d-ada8-5e9cd95142a9 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:46.822067 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f0e2c9-ef12-4fe2-9387-cb34b750d666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:46.822883 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0e2c9-ef12-4fe2-9387-cb34b750d666 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:46.823162 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0e2c9-ef12-4fe2-9387-cb34b750d666 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:46.823441 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0e2c9-ef12-4fe2-9387-cb34b750d666 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:46.836786 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f0e2c9-ef12-4fe2-9387-cb34b750d666 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:46.838273 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f0e2c9-ef12-4fe2-9387-cb34b750d666 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:46.859869 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-28f0e2c9-ef12-4fe2-9387-cb34b750d666 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:46.859869 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:46.859869 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:46.859869 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:46.859869 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:46.859869 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:46.859869 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:46.859869 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:46.859869 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:46.859869 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:46.859869 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:46.859869 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:46.859869 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:50:46.859869 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:50:46.859869 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:50:46.861886 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:50:46.861886 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:46.861886 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:46.861886 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:46.861886 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:46.861886 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:46.861886 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:46.861886 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:46.861886 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:50:46.861886 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:46.861886 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:46.861886 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:46.861886 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:46.861886 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:46.861886 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:46.861886 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:46.861886 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:46.863077 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 20:50:46.863077 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:50:46.863077 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:46.863077 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:46.863077 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 398/792] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:50:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 20:50:46.869368 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f0e2c9-ef12-4fe2-9387-cb34b750d666 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:46.935458 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fae9aa8-1092-4d3e-95de-ecf858174eb2 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:46.972683 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41bd2c3-7b3f-41cd-9c13-66099f3af6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:46.973653 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41bd2c3-7b3f-41cd-9c13-66099f3af6ce None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:46.974110 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41bd2c3-7b3f-41cd-9c13-66099f3af6ce None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:46.974536 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41bd2c3-7b3f-41cd-9c13-66099f3af6ce None admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:46.975430 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41bd2c3-7b3f-41cd-9c13-66099f3af6ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:46.975911 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41bd2c3-7b3f-41cd-9c13-66099f3af6ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:46.977493 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41bd2c3-7b3f-41cd-9c13-66099f3af6ce None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:46.986907 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 395/793] 10.222.0.52 () {56 vars in 1099 bytes} [Sat May 14 20:50:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:50:46.992103 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41bd2c3-7b3f-41cd-9c13-66099f3af6ce None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:47.085112 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f0e2c9-ef12-4fe2-9387-cb34b750d666 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:47.101786 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41bd2c3-7b3f-41cd-9c13-66099f3af6ce None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:47.130388 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e0dad-b8a9-40c2-9a8c-ca2a9a2f67b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:47.131380 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e0dad-b8a9-40c2-9a8c-ca2a9a2f67b4 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:47.131702 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e0dad-b8a9-40c2-9a8c-ca2a9a2f67b4 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:47.131986 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e0dad-b8a9-40c2-9a8c-ca2a9a2f67b4 None admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:47.132805 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57e0dad-b8a9-40c2-9a8c-ca2a9a2f67b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:47.133304 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57e0dad-b8a9-40c2-9a8c-ca2a9a2f67b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:47.135527 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57e0dad-b8a9-40c2-9a8c-ca2a9a2f67b4 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:47.139524 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadf7dfd-2574-43b0-a789-c715a9e21ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:47.140589 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf7dfd-2574-43b0-a789-c715a9e21ce9 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:47.141060 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf7dfd-2574-43b0-a789-c715a9e21ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:47.141518 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf7dfd-2574-43b0-a789-c715a9e21ce9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:47.153998 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 399/794] 10.222.0.52 () {56 vars in 1109 bytes} [Sat May 14 20:50:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:50:47.153998 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ff37b-18b3-4c8f-8808-811a164b51e3 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:47.153998 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ff37b-18b3-4c8f-8808-811a164b51e3 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:47.153998 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ff37b-18b3-4c8f-8808-811a164b51e3 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:47.154370 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 400/795] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:50:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:50:47.155597 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6ff37b-18b3-4c8f-8808-811a164b51e3 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:47.160157 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadf7dfd-2574-43b0-a789-c715a9e21ce9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:47.161980 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadf7dfd-2574-43b0-a789-c715a9e21ce9 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:47.181009 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-fadf7dfd-2574-43b0-a789-c715a9e21ce9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:47.181009 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:47.181009 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:47.181009 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:47.181009 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:47.181009 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:47.181009 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:47.181009 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:47.181009 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:47.181009 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:47.181009 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:47.181009 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:47.181009 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:50:47.181009 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:50:47.181009 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:50:47.182012 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:50:47.182012 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:47.182012 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:47.182012 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:47.182012 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:47.182012 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:47.182012 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:47.182012 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:47.182012 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:50:47.182012 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:47.182012 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:47.182012 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:47.182012 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:47.182012 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:47.182012 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:47.182012 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:47.182012 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:47.182901 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 20:50:47.182901 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:50:47.182901 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:47.182901 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:47.185171 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 396/796] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:50:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:47.186690 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e840d431-0712-402c-8718-2909da391264 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:47.187177 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e840d431-0712-402c-8718-2909da391264 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:47.187699 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e840d431-0712-402c-8718-2909da391264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:47.208706 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-e840d431-0712-402c-8718-2909da391264 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:50:47.210248 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e840d431-0712-402c-8718-2909da391264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:50:47.279144 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6ff37b-18b3-4c8f-8808-811a164b51e3 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:47.288531 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 397/797] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:50:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 20:50:47.289821 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e840d431-0712-402c-8718-2909da391264 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:47.316518 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95b8001-d630-4b9e-80d9-64330cf2625c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:47.317744 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b8001-d630-4b9e-80d9-64330cf2625c None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:47.318229 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b8001-d630-4b9e-80d9-64330cf2625c None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:47.319045 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b8001-d630-4b9e-80d9-64330cf2625c None admin] PATH_INFO: `/v3/projects/service` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:47.326508 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95b8001-d630-4b9e-80d9-64330cf2625c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:47.328292 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95b8001-d630-4b9e-80d9-64330cf2625c None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:47.344587 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-e95b8001-d630-4b9e-80d9-64330cf2625c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 14 20:50:47.344587 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:47.344587 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:47.344587 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:47.344587 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:47.344587 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:47.344587 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:47.344587 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:47.344587 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:47.344587 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:47.344587 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:47.344587 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:47.344587 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 14 20:50:47.344587 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_project(project_id) May 14 20:50:47.344587 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 14 20:50:47.345603 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 14 20:50:47.345603 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:47.345603 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:47.345603 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:47.345603 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:47.345603 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:47.345603 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:47.345603 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:47.345603 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:50:47.345603 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:47.345603 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:47.345603 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:47.345603 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:47.345603 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:47.345603 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:47.345603 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:47.345603 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:47.347358 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 14 20:50:47.347358 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 14 20:50:47.347358 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 20:50:47.347358 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 20:50:47.347358 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 20:50:47.347358 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 20:50:47.347358 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 14 20:50:47.347358 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:47.347358 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 401/798] 10.222.0.52 () {56 vars in 1111 bytes} [Sat May 14 20:50:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 20:50:47.347358 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95b8001-d630-4b9e-80d9-64330cf2625c None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:47.409268 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e840d431-0712-402c-8718-2909da391264 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:47.444069 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14efe111-fd76-4421-ba42-cbec6e88b7cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:47.444787 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14efe111-fd76-4421-ba42-cbec6e88b7cc None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:47.445057 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95b8001-d630-4b9e-80d9-64330cf2625c None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:47.445162 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14efe111-fd76-4421-ba42-cbec6e88b7cc None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:47.445342 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14efe111-fd76-4421-ba42-cbec6e88b7cc None admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:47.446058 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14efe111-fd76-4421-ba42-cbec6e88b7cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:47.446372 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14efe111-fd76-4421-ba42-cbec6e88b7cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:47.447773 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14efe111-fd76-4421-ba42-cbec6e88b7cc None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:47.459504 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 398/799] 10.222.0.52 () {56 vars in 1109 bytes} [Sat May 14 20:50:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:47.460876 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02bf913-16e2-4b05-a219-382c6ead9528 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:47.461240 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02bf913-16e2-4b05-a219-382c6ead9528 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:47.461527 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02bf913-16e2-4b05-a219-382c6ead9528 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:47.462884 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 399/800] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:50:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:50:47.467612 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02bf913-16e2-4b05-a219-382c6ead9528 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:47.485235 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0704704-9181-4756-97bd-b2b4f1b12d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:47.486102 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0704704-9181-4756-97bd-b2b4f1b12d0f None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:47.486549 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0704704-9181-4756-97bd-b2b4f1b12d0f None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:47.486807 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0704704-9181-4756-97bd-b2b4f1b12d0f None admin] PATH_INFO: `/v3/roles/service` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:47.497805 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0704704-9181-4756-97bd-b2b4f1b12d0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:50:47.505591 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-e0704704-9181-4756-97bd-b2b4f1b12d0f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 14 20:50:47.505591 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:47.505591 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:47.505591 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:47.505591 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:47.505591 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:47.505591 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:47.505591 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:47.505591 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:47.505591 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:47.505591 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:47.505591 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:47.505591 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:50:47.505591 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:50:47.505591 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:50:47.505591 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:50:47.506582 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:50:47.506582 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:50:47.506582 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:50:47.506582 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:50:47.506582 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:47.506582 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:47.506582 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:47.506582 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:47.506582 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:47.506582 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:47.506582 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:47.506582 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:50:47.506582 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:47.506582 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:47.506582 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:47.506582 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:47.507425 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:47.507425 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:47.507425 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:47.507425 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:47.507425 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:50:47.507425 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:50:47.507425 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:50:47.507425 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:50:47.507425 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:50:47.507425 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:50:47.507425 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 14 20:50:47.507425 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:47.507425 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 402/801] 10.222.0.52 () {56 vars in 1102 bytes} [Sat May 14 20:50:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:47.508625 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0704704-9181-4756-97bd-b2b4f1b12d0f None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:47.570324 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02bf913-16e2-4b05-a219-382c6ead9528 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:47.603803 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451097be-13af-4ecd-8f65-777edaafc8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:47.604378 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451097be-13af-4ecd-8f65-777edaafc8fc None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:47.604659 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451097be-13af-4ecd-8f65-777edaafc8fc None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:47.604931 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451097be-13af-4ecd-8f65-777edaafc8fc None admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:47.605703 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451097be-13af-4ecd-8f65-777edaafc8fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:47.606012 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451097be-13af-4ecd-8f65-777edaafc8fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:47.607419 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451097be-13af-4ecd-8f65-777edaafc8fc None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:47.612661 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0704704-9181-4756-97bd-b2b4f1b12d0f None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:47.619542 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 400/802] 10.222.0.52 () {56 vars in 1148 bytes} [Sat May 14 20:50:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:47.620569 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f2420-c823-4c3f-aa39-0228f17a9375 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:47.620854 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f2420-c823-4c3f-aa39-0228f17a9375 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:47.621379 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f2420-c823-4c3f-aa39-0228f17a9375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:47.637480 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-d47f2420-c823-4c3f-aa39-0228f17a9375 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:50:47.638634 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d47f2420-c823-4c3f-aa39-0228f17a9375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:50:47.651440 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7147cf78-d891-465d-af43-9287cbe197b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:47.652255 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7147cf78-d891-465d-af43-9287cbe197b4 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:47.652539 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7147cf78-d891-465d-af43-9287cbe197b4 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:47.652821 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7147cf78-d891-465d-af43-9287cbe197b4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:47.661211 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7147cf78-d891-465d-af43-9287cbe197b4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:47.662690 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7147cf78-d891-465d-af43-9287cbe197b4 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:47.676784 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-7147cf78-d891-465d-af43-9287cbe197b4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 14 20:50:47.676784 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:47.676784 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:47.676784 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:47.676784 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:47.676784 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:47.676784 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:47.676784 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:47.676784 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:47.676784 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:47.676784 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:47.676784 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:47.676784 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 14 20:50:47.676784 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_user(user_id) May 14 20:50:47.676784 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 14 20:50:47.676784 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 14 20:50:47.677784 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:47.677784 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:47.677784 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 20:50:47.677784 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 20:50:47.677784 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 14 20:50:47.677784 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 20:50:47.677784 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:47.677784 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:47.677784 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:47.677784 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:47.677784 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:47.677784 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:50:47.677784 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:47.677784 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:47.677784 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:47.677784 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:47.677784 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:47.677784 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:47.679338 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:47.679338 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:47.679338 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 14 20:50:47.679338 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 14 20:50:47.679338 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 14 20:50:47.679338 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 14 20:50:47.679338 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 14 20:50:47.679338 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 14 20:50:47.679338 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 14 20:50:47.679338 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:47.679338 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 403/803] 10.222.0.52 () {56 vars in 1093 bytes} [Sat May 14 20:50:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:47.679338 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7147cf78-d891-465d-af43-9287cbe197b4 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:47.718995 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 401/804] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:50:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 20:50:47.718995 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47f2420-c823-4c3f-aa39-0228f17a9375 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:47.797534 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7147cf78-d891-465d-af43-9287cbe197b4 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:47.831465 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47f2420-c823-4c3f-aa39-0228f17a9375 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:47.832011 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdbb123-ec19-4286-82df-ff34be6010ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:47.832686 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdbb123-ec19-4286-82df-ff34be6010ea None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:47.832972 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdbb123-ec19-4286-82df-ff34be6010ea None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:47.833252 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdbb123-ec19-4286-82df-ff34be6010ea None admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:47.834005 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdbb123-ec19-4286-82df-ff34be6010ea None admin] RBAC: Adding query filter params (name=service) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:47.834312 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdbb123-ec19-4286-82df-ff34be6010ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:47.835719 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdbb123-ec19-4286-82df-ff34be6010ea None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:47.848349 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 404/805] 10.222.0.52 () {56 vars in 1103 bytes} [Sat May 14 20:50:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:47.848349 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdbb123-ec19-4286-82df-ff34be6010ea None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:47.870187 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f76a926-2bb3-4875-87bc-7f58d55f35ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:47.871000 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76a926-2bb3-4875-87bc-7f58d55f35ff None admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:47.871573 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76a926-2bb3-4875-87bc-7f58d55f35ff None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:47.871855 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76a926-2bb3-4875-87bc-7f58d55f35ff None admin] PATH_INFO: `/v3/projects/0911a024287e430ea6ee015389f0c440/users/c781fe7f4a014f0d8b5e7385b20b348c/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:47.873849 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f76a926-2bb3-4875-87bc-7f58d55f35ff None admin] RBAC: Authorizing `identity:create_grant(project_id=0911a024287e430ea6ee015389f0c440, user_id=c781fe7f4a014f0d8b5e7385b20b348c, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:47.875265 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f76a926-2bb3-4875-87bc-7f58d55f35ff None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:47.943685 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 402/806] 10.222.0.52 () {58 vars in 1439 bytes} [Sat May 14 20:50:47 2022] PUT /identity/v3/projects/0911a024287e430ea6ee015389f0c440/users/c781fe7f4a014f0d8b5e7385b20b348c/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 20:50:47.944869 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f76a926-2bb3-4875-87bc-7f58d55f35ff None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:47.948432 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdbb123-ec19-4286-82df-ff34be6010ea None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:48.007967 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceefca0-f5ca-44e5-b52a-042bd9a346f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:48.009378 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceefca0-f5ca-44e5-b52a-042bd9a346f9 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:48.009846 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceefca0-f5ca-44e5-b52a-042bd9a346f9 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:48.010301 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceefca0-f5ca-44e5-b52a-042bd9a346f9 None admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:48.011369 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceefca0-f5ca-44e5-b52a-042bd9a346f9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:48.012476 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceefca0-f5ca-44e5-b52a-042bd9a346f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:48.014526 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceefca0-f5ca-44e5-b52a-042bd9a346f9 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:48.041623 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 405/807] 10.222.0.52 () {56 vars in 1133 bytes} [Sat May 14 20:50:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:48.042942 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceefca0-f5ca-44e5-b52a-042bd9a346f9 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:48.074411 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f76a926-2bb3-4875-87bc-7f58d55f35ff None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:48.133301 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f137d52-d4e7-4209-8c4b-3e964c44a8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:48.135098 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f137d52-d4e7-4209-8c4b-3e964c44a8cb None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:48.135779 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f137d52-d4e7-4209-8c4b-3e964c44a8cb None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:48.136271 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f137d52-d4e7-4209-8c4b-3e964c44a8cb None admin] PATH_INFO: `/v3/services/network` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:48.137186 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f137d52-d4e7-4209-8c4b-3e964c44a8cb None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:48.139681 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f137d52-d4e7-4209-8c4b-3e964c44a8cb None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:48.153115 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-3f137d52-d4e7-4209-8c4b-3e964c44a8cb None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 14 20:50:48.153115 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:48.153115 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 14 20:50:48.153115 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 14 20:50:48.153115 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 14 20:50:48.153115 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 14 20:50:48.153115 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 14 20:50:48.153115 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 20:50:48.153115 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 14 20:50:48.153115 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:48.153115 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 20:50:48.153115 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:48.153115 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:48.153115 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:48.153115 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:48.153115 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:48.153115 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:48.154185 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:48.154185 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:48.154185 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:48.154185 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:48.154185 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:48.154185 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:48.154185 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 14 20:50:48.154185 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_service(service_id) May 14 20:50:48.154185 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 14 20:50:48.154185 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 14 20:50:48.154185 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:48.154185 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:48.154185 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:48.154185 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:48.154185 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:48.154185 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:48.155023 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:48.155023 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:50:48.155023 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:48.155023 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:48.155023 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:48.155023 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:48.155023 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:48.155023 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:48.155023 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:48.155023 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:48.155023 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 14 20:50:48.155023 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 20:50:48.155023 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 14 20:50:48.155023 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:48.160632 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 403/808] 10.222.0.52 () {56 vars in 1111 bytes} [Sat May 14 20:50:47 2022] GET /identity/v3/services/network => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:48.161835 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f137d52-d4e7-4209-8c4b-3e964c44a8cb None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:48.186817 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceefca0-f5ca-44e5-b52a-042bd9a346f9 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:48.223176 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6028a7d6-6302-4b10-af0d-e8cbc4efbbf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:48.223843 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6028a7d6-6302-4b10-af0d-e8cbc4efbbf5 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:48.224132 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6028a7d6-6302-4b10-af0d-e8cbc4efbbf5 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:48.224413 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6028a7d6-6302-4b10-af0d-e8cbc4efbbf5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:48.235275 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6028a7d6-6302-4b10-af0d-e8cbc4efbbf5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:48.237461 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6028a7d6-6302-4b10-af0d-e8cbc4efbbf5 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:48.256446 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-6028a7d6-6302-4b10-af0d-e8cbc4efbbf5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:48.256446 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:48.256446 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:48.256446 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:48.256446 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:48.256446 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:48.256446 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:48.256446 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:48.256446 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:48.256446 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:48.256446 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:48.256446 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:48.256446 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:50:48.256446 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:50:48.256446 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:50:48.257583 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:50:48.257583 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:48.257583 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:48.257583 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:48.257583 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:48.257583 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:48.257583 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:48.257583 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:48.257583 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:50:48.257583 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:48.257583 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:48.257583 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:48.257583 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:48.257583 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:48.257583 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:48.257583 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:48.257583 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:48.258576 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 20:50:48.258576 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:50:48.258576 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:48.258576 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:48.264794 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 406/809] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:50:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:48.265861 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6028a7d6-6302-4b10-af0d-e8cbc4efbbf5 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:48.275834 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f137d52-d4e7-4209-8c4b-3e964c44a8cb None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:48.311279 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f308e5aa-02f4-4a2d-8413-720b70497764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:48.311971 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308e5aa-02f4-4a2d-8413-720b70497764 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:48.312231 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308e5aa-02f4-4a2d-8413-720b70497764 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:48.312503 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308e5aa-02f4-4a2d-8413-720b70497764 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:48.368486 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6028a7d6-6302-4b10-af0d-e8cbc4efbbf5 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:48.381212 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f308e5aa-02f4-4a2d-8413-720b70497764 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:48.382663 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f308e5aa-02f4-4a2d-8413-720b70497764 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:48.404066 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d0fe39-5594-4f4e-91dc-621ddc089f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:48.404706 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0fe39-5594-4f4e-91dc-621ddc089f48 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:48.404994 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0fe39-5594-4f4e-91dc-621ddc089f48 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:48.405446 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0fe39-5594-4f4e-91dc-621ddc089f48 None admin] PATH_INFO: `/v3/services` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:48.406454 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d0fe39-5594-4f4e-91dc-621ddc089f48 None admin] RBAC: Adding query filter params (name=network) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:48.406610 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d0fe39-5594-4f4e-91dc-621ddc089f48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:48.408697 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d0fe39-5594-4f4e-91dc-621ddc089f48 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:48.417899 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 407/810] 10.222.0.52 () {56 vars in 1112 bytes} [Sat May 14 20:50:48 2022] GET /identity/v3/services?name=network => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:48.417899 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d0fe39-5594-4f4e-91dc-621ddc089f48 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:48.487554 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 404/811] 10.222.0.52 () {58 vars in 1282 bytes} [Sat May 14 20:50:48 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 14 20:50:48.487554 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7678b4-f28e-4a28-8cda-f4b8c930aaee None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:48.487554 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7678b4-f28e-4a28-8cda-f4b8c930aaee None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:48.487554 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7678b4-f28e-4a28-8cda-f4b8c930aaee None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:48.487554 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 405/812] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:50:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:50:48.487554 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7678b4-f28e-4a28-8cda-f4b8c930aaee None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:48.516980 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d0fe39-5594-4f4e-91dc-621ddc089f48 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:48.551451 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5fd511-364b-48c8-b904-ab822314bbdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:48.552136 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5fd511-364b-48c8-b904-ab822314bbdb None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:48.552418 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5fd511-364b-48c8-b904-ab822314bbdb None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:48.552687 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5fd511-364b-48c8-b904-ab822314bbdb None admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:48.553403 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5fd511-364b-48c8-b904-ab822314bbdb None admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:48.553710 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5fd511-364b-48c8-b904-ab822314bbdb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:48.555069 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5fd511-364b-48c8-b904-ab822314bbdb None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:48.570951 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 408/813] 10.222.0.52 () {56 vars in 1109 bytes} [Sat May 14 20:50:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:48.570951 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5fd511-364b-48c8-b904-ab822314bbdb None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:48.593236 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7678b4-f28e-4a28-8cda-f4b8c930aaee None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:48.628374 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5d860e-fe40-41eb-951d-0b5deb67b553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:48.629031 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d860e-fe40-41eb-951d-0b5deb67b553 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:48.629365 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d860e-fe40-41eb-951d-0b5deb67b553 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:48.629644 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d860e-fe40-41eb-951d-0b5deb67b553 None admin] PATH_INFO: `/v3/services` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:48.630331 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5d860e-fe40-41eb-951d-0b5deb67b553 None admin] RBAC: Adding query filter params (type=network) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:48.630635 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5d860e-fe40-41eb-951d-0b5deb67b553 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:48.632018 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5d860e-fe40-41eb-951d-0b5deb67b553 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:48.637013 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 406/814] 10.222.0.52 () {56 vars in 1112 bytes} [Sat May 14 20:50:48 2022] GET /identity/v3/services?type=network => generated 350 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:48.638418 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861e9a5-ddfe-457d-936c-f1e944c69926 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:48.638880 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861e9a5-ddfe-457d-936c-f1e944c69926 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:48.639345 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861e9a5-ddfe-457d-936c-f1e944c69926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:48.655383 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-8861e9a5-ddfe-457d-936c-f1e944c69926 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:50:48.656776 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-8861e9a5-ddfe-457d-936c-f1e944c69926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:50:48.678013 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5fd511-364b-48c8-b904-ab822314bbdb None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:48.712996 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d318c2-439f-48dd-8c19-c5a63cd2305a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:48.713783 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d318c2-439f-48dd-8c19-c5a63cd2305a None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:48.714094 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d318c2-439f-48dd-8c19-c5a63cd2305a None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:48.714333 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d318c2-439f-48dd-8c19-c5a63cd2305a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:48.724632 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 407/815] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:50:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 20:50:48.725470 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8861e9a5-ddfe-457d-936c-f1e944c69926 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:48.738023 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d318c2-439f-48dd-8c19-c5a63cd2305a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:48.739821 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d318c2-439f-48dd-8c19-c5a63cd2305a None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:48.758534 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-c6d318c2-439f-48dd-8c19-c5a63cd2305a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:48.758534 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:48.758534 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:48.758534 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:48.758534 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:48.758534 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:48.758534 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:48.758534 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:48.758534 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:48.758534 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:48.758534 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:48.758534 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:48.758534 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:50:48.758534 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:50:48.758534 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:50:48.759490 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:50:48.759490 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:48.759490 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:48.759490 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:48.759490 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:48.759490 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:48.759490 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:48.759490 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:48.759490 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:50:48.759490 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:48.759490 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:48.759490 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:48.759490 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:48.759490 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:48.759490 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:48.759490 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:48.759490 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:48.760410 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 20:50:48.760410 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:50:48.760410 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:48.760410 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:48.766538 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 409/816] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:50:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:48.766538 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d318c2-439f-48dd-8c19-c5a63cd2305a None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:48.828937 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8861e9a5-ddfe-457d-936c-f1e944c69926 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:48.865669 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918e4dbe-64a8-43ed-8cff-54ef751295fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:48.866476 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e4dbe-64a8-43ed-8cff-54ef751295fe None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:48.866757 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e4dbe-64a8-43ed-8cff-54ef751295fe None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:48.867031 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e4dbe-64a8-43ed-8cff-54ef751295fe None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:48.874310 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918e4dbe-64a8-43ed-8cff-54ef751295fe None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:48.875771 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918e4dbe-64a8-43ed-8cff-54ef751295fe None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:48.887115 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d318c2-439f-48dd-8c19-c5a63cd2305a None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:48.891053 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-918e4dbe-64a8-43ed-8cff-54ef751295fe None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 14 20:50:48.891053 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:48.891053 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:48.891053 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:48.891053 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:48.891053 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:48.891053 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:48.891053 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:48.891053 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:48.891053 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:48.891053 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:48.891053 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:48.891053 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 14 20:50:48.891053 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_user(user_id) May 14 20:50:48.891053 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 14 20:50:48.891053 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 14 20:50:48.892189 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:48.892189 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:48.892189 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 20:50:48.892189 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 20:50:48.892189 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 14 20:50:48.892189 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 20:50:48.892189 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:48.892189 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:48.892189 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:48.892189 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:48.892189 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:48.892189 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:50:48.892189 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:48.892189 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:48.892189 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:48.892189 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:48.892189 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:48.892189 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:48.893176 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:48.893176 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:48.893176 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 14 20:50:48.893176 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 14 20:50:48.893176 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 14 20:50:48.893176 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 14 20:50:48.893176 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 14 20:50:48.893176 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 14 20:50:48.893176 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 14 20:50:48.893176 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:48.893176 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 408/817] 10.222.0.52 () {56 vars in 1117 bytes} [Sat May 14 20:50:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:48.893777 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918e4dbe-64a8-43ed-8cff-54ef751295fe None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:48.927971 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d021e62-f784-404e-a9bd-9774d562915c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:48.928730 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d021e62-f784-404e-a9bd-9774d562915c None admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:48.929086 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d021e62-f784-404e-a9bd-9774d562915c None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:48.929437 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d021e62-f784-404e-a9bd-9774d562915c None admin] PATH_INFO: `/v3/endpoints` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:48.930247 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d021e62-f784-404e-a9bd-9774d562915c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:48.931727 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d021e62-f784-404e-a9bd-9774d562915c None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:48.997003 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918e4dbe-64a8-43ed-8cff-54ef751295fe None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:49.030286 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c633c2a-0544-42db-80c9-538228b30709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:49.031179 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c633c2a-0544-42db-80c9-538228b30709 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:49.031456 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c633c2a-0544-42db-80c9-538228b30709 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:49.031756 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c633c2a-0544-42db-80c9-538228b30709 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:49.032443 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c633c2a-0544-42db-80c9-538228b30709 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:49.033863 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c633c2a-0544-42db-80c9-538228b30709 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:49.044508 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 410/818] 10.222.0.52 () {60 vars in 1144 bytes} [Sat May 14 20:50:48 2022] POST /identity/v3/endpoints => generated 327 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 20:50:49.045504 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d021e62-f784-404e-a9bd-9774d562915c None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:49.045791 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-9c633c2a-0544-42db-80c9-538228b30709 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 14 20:50:49.045791 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:49.045791 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 14 20:50:49.045791 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 14 20:50:49.045791 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 14 20:50:49.045791 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 14 20:50:49.045791 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 14 20:50:49.045791 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 20:50:49.045791 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 14 20:50:49.045791 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:49.045791 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 20:50:49.045791 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:49.045791 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:49.045791 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:49.045791 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:49.045791 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:49.046815 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:49.046815 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:49.046815 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:49.046815 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:49.046815 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:49.046815 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:49.046815 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:49.046815 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 14 20:50:49.046815 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_service(service_id) May 14 20:50:49.046815 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 14 20:50:49.046815 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 14 20:50:49.046815 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:49.046815 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:49.046815 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:49.046815 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:49.046815 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:49.047736 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:49.047736 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:49.047736 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:50:49.047736 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:49.047736 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:49.047736 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:49.047736 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:49.047736 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:49.047736 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:49.047736 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:49.047736 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:49.047736 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 14 20:50:49.047736 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 20:50:49.047736 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 14 20:50:49.047736 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:49.047736 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 409/819] 10.222.0.52 () {56 vars in 1129 bytes} [Sat May 14 20:50:48 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:49.049294 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c633c2a-0544-42db-80c9-538228b30709 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:49.196526 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d021e62-f784-404e-a9bd-9774d562915c None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:49.235406 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d56c06-7ad4-4003-9858-d0966ac1496c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:49.236660 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d56c06-7ad4-4003-9858-d0966ac1496c None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:49.236939 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d56c06-7ad4-4003-9858-d0966ac1496c None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:49.237205 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d56c06-7ad4-4003-9858-d0966ac1496c None admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:49.237932 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d56c06-7ad4-4003-9858-d0966ac1496c None admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:49.238234 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d56c06-7ad4-4003-9858-d0966ac1496c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:49.239679 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d56c06-7ad4-4003-9858-d0966ac1496c None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:49.253153 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 411/820] 10.222.0.52 () {56 vars in 1109 bytes} [Sat May 14 20:50:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:49.254030 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d56c06-7ad4-4003-9858-d0966ac1496c None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:49.338843 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c633c2a-0544-42db-80c9-538228b30709 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:49.367918 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d56c06-7ad4-4003-9858-d0966ac1496c None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:49.376280 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404a0ade-3fc5-44af-a05a-70c5f0ccb3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:49.377009 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a0ade-3fc5-44af-a05a-70c5f0ccb3d0 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:49.377296 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a0ade-3fc5-44af-a05a-70c5f0ccb3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:49.377574 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a0ade-3fc5-44af-a05a-70c5f0ccb3d0 None admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:49.378402 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404a0ade-3fc5-44af-a05a-70c5f0ccb3d0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:49.378710 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404a0ade-3fc5-44af-a05a-70c5f0ccb3d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:49.380169 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404a0ade-3fc5-44af-a05a-70c5f0ccb3d0 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:49.396954 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 410/821] 10.222.0.52 () {56 vars in 1149 bytes} [Sat May 14 20:50:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:49.397763 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404a0ade-3fc5-44af-a05a-70c5f0ccb3d0 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:49.403712 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8047b350-0021-4984-97d2-41ffa4242278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:49.404746 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8047b350-0021-4984-97d2-41ffa4242278 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:49.405232 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8047b350-0021-4984-97d2-41ffa4242278 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:49.405761 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8047b350-0021-4984-97d2-41ffa4242278 None admin] PATH_INFO: `/v3/services` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:49.406537 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8047b350-0021-4984-97d2-41ffa4242278 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:49.406910 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8047b350-0021-4984-97d2-41ffa4242278 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:49.408955 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8047b350-0021-4984-97d2-41ffa4242278 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:49.418107 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 412/822] 10.222.0.52 () {56 vars in 1124 bytes} [Sat May 14 20:50:49 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:49.418107 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8047b350-0021-4984-97d2-41ffa4242278 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:49.507900 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404a0ade-3fc5-44af-a05a-70c5f0ccb3d0 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:49.535663 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8047b350-0021-4984-97d2-41ffa4242278 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:49.548590 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d65dd4-982b-4c7b-a4c2-37a725aa7b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:49.549370 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d65dd4-982b-4c7b-a4c2-37a725aa7b8c None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:49.549649 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d65dd4-982b-4c7b-a4c2-37a725aa7b8c None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:49.549924 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d65dd4-982b-4c7b-a4c2-37a725aa7b8c None admin] PATH_INFO: `/v3/projects/service` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:49.557024 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d65dd4-982b-4c7b-a4c2-37a725aa7b8c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:49.558463 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d65dd4-982b-4c7b-a4c2-37a725aa7b8c None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:49.571226 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f16994-fda1-4087-a09f-f91a9a71c98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:49.572036 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f16994-fda1-4087-a09f-f91a9a71c98b None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:49.572313 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f16994-fda1-4087-a09f-f91a9a71c98b None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:49.572582 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f16994-fda1-4087-a09f-f91a9a71c98b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:49.573653 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-b5d65dd4-982b-4c7b-a4c2-37a725aa7b8c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 14 20:50:49.573653 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:49.573653 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:49.573653 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:49.573653 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:49.573653 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:49.573653 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:49.573653 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:49.573653 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:49.573653 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:49.573653 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:49.573653 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:49.573653 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 14 20:50:49.573653 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_project(project_id) May 14 20:50:49.573653 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 14 20:50:49.574531 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 14 20:50:49.574531 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:49.574531 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:49.574531 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:49.574531 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:49.574531 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:49.574531 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:49.574531 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:49.574531 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:50:49.574531 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:49.574531 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:49.574531 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:49.574531 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:49.574531 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:49.574531 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:49.574531 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:49.574531 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:49.575408 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 14 20:50:49.575408 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 14 20:50:49.575408 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 20:50:49.575408 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 20:50:49.575408 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 20:50:49.575408 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 20:50:49.575408 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 14 20:50:49.575408 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:49.579550 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 411/823] 10.222.0.52 () {56 vars in 1111 bytes} [Sat May 14 20:50:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:49.580486 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d65dd4-982b-4c7b-a4c2-37a725aa7b8c None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:49.583408 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f16994-fda1-4087-a09f-f91a9a71c98b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:49.584904 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f16994-fda1-4087-a09f-f91a9a71c98b None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:49.602007 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-67f16994-fda1-4087-a09f-f91a9a71c98b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:49.602007 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:49.602007 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:49.602007 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:49.602007 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:49.602007 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:49.602007 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:49.602007 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:49.602007 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:49.602007 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:49.602007 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:49.602007 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:49.602007 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:50:49.602007 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:50:49.602007 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:50:49.602898 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:50:49.602898 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:49.602898 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:49.602898 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:49.602898 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:49.602898 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:49.602898 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:49.602898 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:49.602898 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:50:49.602898 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:49.602898 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:49.602898 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:49.602898 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:49.602898 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:49.602898 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:49.602898 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:49.602898 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:49.604161 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 20:50:49.604161 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:50:49.604161 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:49.604161 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:49.607856 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 413/824] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:50:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:49.608681 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f16994-fda1-4087-a09f-f91a9a71c98b None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:49.676669 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d65dd4-982b-4c7b-a4c2-37a725aa7b8c None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:49.704801 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f16994-fda1-4087-a09f-f91a9a71c98b None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:49.709397 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c7105-6657-4077-857a-1199fe7ffe34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:49.710058 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c7105-6657-4077-857a-1199fe7ffe34 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:49.710343 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c7105-6657-4077-857a-1199fe7ffe34 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:49.710616 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c7105-6657-4077-857a-1199fe7ffe34 None admin] PATH_INFO: `/v3/services` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:49.711311 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37c7105-6657-4077-857a-1199fe7ffe34 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:49.711659 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37c7105-6657-4077-857a-1199fe7ffe34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:49.713020 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37c7105-6657-4077-857a-1199fe7ffe34 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:49.722121 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 412/825] 10.222.0.52 () {56 vars in 1124 bytes} [Sat May 14 20:50:49 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:49.722121 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c7105-6657-4077-857a-1199fe7ffe34 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:49.743881 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082c3a08-2c2e-4799-9deb-f926bf56fe24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:49.744543 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082c3a08-2c2e-4799-9deb-f926bf56fe24 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:49.744826 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082c3a08-2c2e-4799-9deb-f926bf56fe24 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:49.745099 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082c3a08-2c2e-4799-9deb-f926bf56fe24 None admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:49.745878 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082c3a08-2c2e-4799-9deb-f926bf56fe24 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:49.746437 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082c3a08-2c2e-4799-9deb-f926bf56fe24 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:49.747897 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082c3a08-2c2e-4799-9deb-f926bf56fe24 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:49.764563 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 414/826] 10.222.0.52 () {56 vars in 1148 bytes} [Sat May 14 20:50:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:49.764563 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082c3a08-2c2e-4799-9deb-f926bf56fe24 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:49.823157 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c7105-6657-4077-857a-1199fe7ffe34 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:49.856985 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2753489-cea9-4bbd-9e5f-9255fe13c500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:49.857643 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2753489-cea9-4bbd-9e5f-9255fe13c500 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:49.857926 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2753489-cea9-4bbd-9e5f-9255fe13c500 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:49.858201 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2753489-cea9-4bbd-9e5f-9255fe13c500 None admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:49.858913 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2753489-cea9-4bbd-9e5f-9255fe13c500 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:49.859229 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2753489-cea9-4bbd-9e5f-9255fe13c500 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:49.860747 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2753489-cea9-4bbd-9e5f-9255fe13c500 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:49.864252 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082c3a08-2c2e-4799-9deb-f926bf56fe24 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:49.872561 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 413/827] 10.222.0.52 () {56 vars in 1109 bytes} [Sat May 14 20:50:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:49.873375 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2753489-cea9-4bbd-9e5f-9255fe13c500 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:49.903073 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b08a50b-c07b-49c0-9116-26cd3051d4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:49.903754 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b08a50b-c07b-49c0-9116-26cd3051d4f4 None admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:49.904083 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b08a50b-c07b-49c0-9116-26cd3051d4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:49.904306 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b08a50b-c07b-49c0-9116-26cd3051d4f4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:49.905039 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b08a50b-c07b-49c0-9116-26cd3051d4f4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:49.906405 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b08a50b-c07b-49c0-9116-26cd3051d4f4 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:49.974433 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2753489-cea9-4bbd-9e5f-9255fe13c500 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:49.994073 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 415/828] 10.222.0.52 () {60 vars in 1144 bytes} [Sat May 14 20:50:49 2022] POST /identity/v3/endpoints => generated 346 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 20:50:49.995190 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b08a50b-c07b-49c0-9116-26cd3051d4f4 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:50.030372 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bace01-8266-46a3-b9fc-e68a5f032fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:50.031866 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bace01-8266-46a3-b9fc-e68a5f032fdb None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:50.032716 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bace01-8266-46a3-b9fc-e68a5f032fdb None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:50.033200 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bace01-8266-46a3-b9fc-e68a5f032fdb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:50.034231 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bace01-8266-46a3-b9fc-e68a5f032fdb None admin] RBAC: Adding query filter params (role.id=24c463e2b4d44dd28cd2723a69a8ed2e, scope.project.id=0911a024287e430ea6ee015389f0c440, user.id=0f1b0e2b025d4eceaa90e1616d0a9db8) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:50.034724 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bace01-8266-46a3-b9fc-e68a5f032fdb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:50.037647 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bace01-8266-46a3-b9fc-e68a5f032fdb None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:50.051506 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 414/829] 10.222.0.52 () {56 vars in 1374 bytes} [Sat May 14 20:50:49 2022] GET /identity/v3/role_assignments?user.id=0f1b0e2b025d4eceaa90e1616d0a9db8&scope.project.id=0911a024287e430ea6ee015389f0c440&role.id=24c463e2b4d44dd28cd2723a69a8ed2e => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:50.125377 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b08a50b-c07b-49c0-9116-26cd3051d4f4 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:50.169976 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd9a30c-f8dd-4615-8635-128c5a48ade5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:50.170806 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd9a30c-f8dd-4615-8635-128c5a48ade5 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:50.171084 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd9a30c-f8dd-4615-8635-128c5a48ade5 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:50.171355 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd9a30c-f8dd-4615-8635-128c5a48ade5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:50.184630 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd9a30c-f8dd-4615-8635-128c5a48ade5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:50.186489 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd9a30c-f8dd-4615-8635-128c5a48ade5 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:50.203898 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-bfd9a30c-f8dd-4615-8635-128c5a48ade5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 14 20:50:50.203898 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:50.203898 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:50.203898 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:50.203898 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:50.203898 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:50.203898 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:50.203898 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:50.203898 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:50.203898 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:50.203898 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:50.203898 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:50.203898 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 14 20:50:50.203898 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_project(project_id) May 14 20:50:50.203898 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 14 20:50:50.205719 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 14 20:50:50.205719 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:50.205719 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:50.205719 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:50.205719 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:50.205719 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:50.205719 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:50.205719 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:50.205719 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:50:50.205719 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:50.205719 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:50.205719 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:50.205719 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:50.205719 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:50.205719 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:50.205719 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:50.205719 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:50.206604 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 14 20:50:50.206604 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 14 20:50:50.206604 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 20:50:50.206604 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 20:50:50.206604 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 20:50:50.206604 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 20:50:50.206604 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 14 20:50:50.206604 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:50.208972 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 416/830] 10.222.0.52 () {56 vars in 1111 bytes} [Sat May 14 20:50:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:50.214738 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bace01-8266-46a3-b9fc-e68a5f032fdb None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:50.324132 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bace01-8266-46a3-b9fc-e68a5f032fdb None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:50.357728 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4afeb-2d22-4bbe-8372-6a38c91864d0 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:50.358252 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4afeb-2d22-4bbe-8372-6a38c91864d0 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:50.358528 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4afeb-2d22-4bbe-8372-6a38c91864d0 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:50.359056 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8ec3c3-c8eb-4e71-9c3e-5fe91d56b050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:50.359742 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ec3c3-c8eb-4e71-9c3e-5fe91d56b050 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:50.360117 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 417/831] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:50:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:50:50.360224 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ec3c3-c8eb-4e71-9c3e-5fe91d56b050 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:50.360301 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ec3c3-c8eb-4e71-9c3e-5fe91d56b050 None admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:50.361652 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8ec3c3-c8eb-4e71-9c3e-5fe91d56b050 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:50.362295 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8ec3c3-c8eb-4e71-9c3e-5fe91d56b050 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:50.363440 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8ec3c3-c8eb-4e71-9c3e-5fe91d56b050 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:50.366962 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc59873-756c-4959-981c-e44029c32f3d None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:50.367559 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc59873-756c-4959-981c-e44029c32f3d None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:50.368065 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc59873-756c-4959-981c-e44029c32f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:50.377829 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 415/832] 10.222.0.52 () {56 vars in 1148 bytes} [Sat May 14 20:50:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:50:50.383522 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8ec3c3-c8eb-4e71-9c3e-5fe91d56b050 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:50.386792 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-dbc59873-756c-4959-981c-e44029c32f3d None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:50:50.388235 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-dbc59873-756c-4959-981c-e44029c32f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:50:50.458653 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 418/833] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:50:50 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 14 20:50:50.483576 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc59873-756c-4959-981c-e44029c32f3d None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:50.485120 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8ec3c3-c8eb-4e71-9c3e-5fe91d56b050 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:50.523527 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e13e39-c5b1-4db2-bbf9-35e99b541cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:50.524513 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e13e39-c5b1-4db2-bbf9-35e99b541cd6 None admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:50.524799 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e13e39-c5b1-4db2-bbf9-35e99b541cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:50.525074 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e13e39-c5b1-4db2-bbf9-35e99b541cd6 None admin] PATH_INFO: `/v3/projects/0911a024287e430ea6ee015389f0c440/users/c31cffc526be4f8992c57ca5e4e2a0f9/roles/998d6a3451be42a89d4cff277851ad70` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:50.542038 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e13e39-c5b1-4db2-bbf9-35e99b541cd6 None admin] RBAC: Authorizing `identity:create_grant(project_id=0911a024287e430ea6ee015389f0c440, user_id=c31cffc526be4f8992c57ca5e4e2a0f9, role_id=998d6a3451be42a89d4cff277851ad70)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:50.543501 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e13e39-c5b1-4db2-bbf9-35e99b541cd6 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:50.593046 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc59873-756c-4959-981c-e44029c32f3d None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:50.618418 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 416/834] 10.222.0.52 () {58 vars in 1439 bytes} [Sat May 14 20:50:50 2022] PUT /identity/v3/projects/0911a024287e430ea6ee015389f0c440/users/c31cffc526be4f8992c57ca5e4e2a0f9/roles/998d6a3451be42a89d4cff277851ad70 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 20:50:50.646786 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa68b16-8ef4-4cb0-9653-af229fb19f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:50.647820 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa68b16-8ef4-4cb0-9653-af229fb19f0a None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:50.648326 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa68b16-8ef4-4cb0-9653-af229fb19f0a None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:50.648807 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa68b16-8ef4-4cb0-9653-af229fb19f0a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:50.662757 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa68b16-8ef4-4cb0-9653-af229fb19f0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:50:50.671343 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-9aa68b16-8ef4-4cb0-9653-af229fb19f0a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 14 20:50:50.671343 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:50.671343 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:50.671343 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:50.671343 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:50.671343 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:50.671343 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:50.671343 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:50.671343 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:50.671343 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:50.671343 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:50.671343 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:50.671343 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:50:50.671343 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:50:50.671343 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:50:50.671343 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:50:50.672370 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:50:50.672370 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:50:50.672370 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:50:50.672370 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:50:50.672370 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:50.672370 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:50.672370 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:50.672370 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:50.672370 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:50.672370 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:50.672370 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:50.672370 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:50:50.672370 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:50.672370 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:50.672370 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:50.672370 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:50.673692 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:50.673692 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:50.673692 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:50.673692 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:50.673692 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:50:50.673692 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:50:50.673692 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:50:50.673692 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:50:50.673692 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:50:50.673692 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:50:50.673692 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 14 20:50:50.673692 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:50.673692 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 419/835] 10.222.0.52 () {56 vars in 1096 bytes} [Sat May 14 20:50:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:50.678797 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e13e39-c5b1-4db2-bbf9-35e99b541cd6 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:50.805112 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e13e39-c5b1-4db2-bbf9-35e99b541cd6 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:50.840127 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cc8a08-54f2-4d82-8eb2-69cdbc366ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:50.840796 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc8a08-54f2-4d82-8eb2-69cdbc366ebd None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:50.841074 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc8a08-54f2-4d82-8eb2-69cdbc366ebd None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:50.841343 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc8a08-54f2-4d82-8eb2-69cdbc366ebd None admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:50.842077 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cc8a08-54f2-4d82-8eb2-69cdbc366ebd None admin] RBAC: Adding query filter params (name=admin) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:50.842376 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cc8a08-54f2-4d82-8eb2-69cdbc366ebd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:50.843834 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cc8a08-54f2-4d82-8eb2-69cdbc366ebd None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:50.853532 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 417/836] 10.222.0.52 () {56 vars in 1099 bytes} [Sat May 14 20:50:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:50:50.859122 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa68b16-8ef4-4cb0-9653-af229fb19f0a None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:50.968573 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa68b16-8ef4-4cb0-9653-af229fb19f0a None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:51.005367 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0295d2ed-f39f-4f18-83db-7b29336372d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:51.006222 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0295d2ed-f39f-4f18-83db-7b29336372d8 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:51.006515 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0295d2ed-f39f-4f18-83db-7b29336372d8 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:51.006796 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0295d2ed-f39f-4f18-83db-7b29336372d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:51.018399 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0295d2ed-f39f-4f18-83db-7b29336372d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:51.019889 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0295d2ed-f39f-4f18-83db-7b29336372d8 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:51.037956 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-0295d2ed-f39f-4f18-83db-7b29336372d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:51.037956 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:51.037956 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:51.037956 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:51.037956 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:51.037956 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:51.037956 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:51.037956 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:51.037956 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:51.037956 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:51.037956 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:51.037956 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:51.037956 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:50:51.037956 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:50:51.037956 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:50:51.038894 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:50:51.038894 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:51.038894 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:51.038894 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:51.038894 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:51.038894 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:51.038894 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:51.038894 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:51.038894 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:50:51.038894 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:51.038894 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:51.038894 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:51.038894 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:51.038894 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:51.038894 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:51.038894 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:51.038894 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:51.039862 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 20:50:51.039862 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:50:51.039862 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:51.039862 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:51.039862 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 420/837] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:50:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:51.045183 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cc8a08-54f2-4d82-8eb2-69cdbc366ebd None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:51.145930 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cc8a08-54f2-4d82-8eb2-69cdbc366ebd None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:51.179866 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c51cf8c-f75b-476c-8560-1e3c9466c73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:51.180568 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51cf8c-f75b-476c-8560-1e3c9466c73a None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:51.180857 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51cf8c-f75b-476c-8560-1e3c9466c73a None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:51.181248 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51cf8c-f75b-476c-8560-1e3c9466c73a None admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:51.181968 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c51cf8c-f75b-476c-8560-1e3c9466c73a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:51.182281 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c51cf8c-f75b-476c-8560-1e3c9466c73a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:51.183661 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c51cf8c-f75b-476c-8560-1e3c9466c73a None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:51.196354 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 418/838] 10.222.0.52 () {56 vars in 1109 bytes} [Sat May 14 20:50:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:51.202017 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0295d2ed-f39f-4f18-83db-7b29336372d8 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:51.307007 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0295d2ed-f39f-4f18-83db-7b29336372d8 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:51.342604 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9681ee-7044-4444-9ebf-94ac918a7297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:51.343425 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9681ee-7044-4444-9ebf-94ac918a7297 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:51.343739 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9681ee-7044-4444-9ebf-94ac918a7297 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:51.344021 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9681ee-7044-4444-9ebf-94ac918a7297 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:51.352939 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9681ee-7044-4444-9ebf-94ac918a7297 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:51.354399 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9681ee-7044-4444-9ebf-94ac918a7297 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:51.368598 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-3d9681ee-7044-4444-9ebf-94ac918a7297 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 14 20:50:51.368598 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:51.368598 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:51.368598 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:51.368598 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:51.368598 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:51.368598 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:51.368598 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:51.368598 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:51.368598 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:51.368598 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:51.368598 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:51.368598 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 14 20:50:51.368598 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_user(user_id) May 14 20:50:51.368598 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 14 20:50:51.368598 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 14 20:50:51.370768 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:51.370768 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:51.370768 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 20:50:51.370768 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 20:50:51.370768 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 14 20:50:51.370768 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 20:50:51.370768 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:51.370768 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:51.370768 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:51.370768 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:51.370768 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:51.370768 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:50:51.370768 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:51.370768 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:51.370768 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:51.370768 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:51.370768 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:51.370768 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:51.373414 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:51.373414 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:51.373414 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 14 20:50:51.373414 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 14 20:50:51.373414 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 14 20:50:51.373414 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 14 20:50:51.373414 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 14 20:50:51.373414 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 14 20:50:51.373414 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 14 20:50:51.373414 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:51.373414 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 421/839] 10.222.0.52 () {56 vars in 1096 bytes} [Sat May 14 20:50:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:51.379498 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c51cf8c-f75b-476c-8560-1e3c9466c73a None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:51.488775 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c51cf8c-f75b-476c-8560-1e3c9466c73a None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:51.523848 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282e556d-cbf2-4bc2-a24e-42f887314737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:51.524560 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282e556d-cbf2-4bc2-a24e-42f887314737 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:51.524848 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282e556d-cbf2-4bc2-a24e-42f887314737 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:51.525118 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282e556d-cbf2-4bc2-a24e-42f887314737 None admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:51.525932 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282e556d-cbf2-4bc2-a24e-42f887314737 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:51.526238 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282e556d-cbf2-4bc2-a24e-42f887314737 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:51.527666 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282e556d-cbf2-4bc2-a24e-42f887314737 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:51.548474 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 419/840] 10.222.0.52 () {56 vars in 1135 bytes} [Sat May 14 20:50:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:51.553908 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9681ee-7044-4444-9ebf-94ac918a7297 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:51.655125 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9681ee-7044-4444-9ebf-94ac918a7297 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:51.689870 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f42aa48-1e43-4f48-b67c-7cbf7ca6c573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:51.690517 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f42aa48-1e43-4f48-b67c-7cbf7ca6c573 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:51.690802 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f42aa48-1e43-4f48-b67c-7cbf7ca6c573 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:51.691081 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f42aa48-1e43-4f48-b67c-7cbf7ca6c573 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:51.768458 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f42aa48-1e43-4f48-b67c-7cbf7ca6c573 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:51.769884 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f42aa48-1e43-4f48-b67c-7cbf7ca6c573 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:51.877766 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 422/841] 10.222.0.52 () {58 vars in 1282 bytes} [Sat May 14 20:50:51 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 14 20:50:51.883463 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282e556d-cbf2-4bc2-a24e-42f887314737 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:51.997440 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282e556d-cbf2-4bc2-a24e-42f887314737 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:52.034064 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e74c3cd-b852-4957-b27b-2f03facf89d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:52.035194 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74c3cd-b852-4957-b27b-2f03facf89d1 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:52.035712 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74c3cd-b852-4957-b27b-2f03facf89d1 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:52.036193 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74c3cd-b852-4957-b27b-2f03facf89d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:52.046457 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e74c3cd-b852-4957-b27b-2f03facf89d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:52.049240 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e74c3cd-b852-4957-b27b-2f03facf89d1 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:52.067236 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-0e74c3cd-b852-4957-b27b-2f03facf89d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:52.067236 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:52.067236 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:52.067236 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:52.067236 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:52.067236 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:52.067236 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:52.067236 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:52.067236 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:52.067236 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:52.067236 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:52.067236 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:52.067236 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:50:52.067236 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:50:52.067236 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:50:52.068285 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:50:52.068285 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:52.068285 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:52.068285 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:52.068285 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:52.068285 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:52.068285 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:52.068285 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:52.068285 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:50:52.068285 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:52.068285 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:52.068285 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:52.068285 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:52.068285 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:52.068285 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:52.068285 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:52.068285 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:52.069263 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 20:50:52.069263 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:50:52.069263 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:52.069263 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:52.071509 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 420/842] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:50:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:52.083543 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f42aa48-1e43-4f48-b67c-7cbf7ca6c573 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:52.181809 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f42aa48-1e43-4f48-b67c-7cbf7ca6c573 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:52.224852 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096fcdb3-51c4-42f1-8e8d-920e7e29fa41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:52.225530 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096fcdb3-51c4-42f1-8e8d-920e7e29fa41 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:52.225817 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096fcdb3-51c4-42f1-8e8d-920e7e29fa41 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:52.226096 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096fcdb3-51c4-42f1-8e8d-920e7e29fa41 None admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:52.226815 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096fcdb3-51c4-42f1-8e8d-920e7e29fa41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:52.227124 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096fcdb3-51c4-42f1-8e8d-920e7e29fa41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:52.228520 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096fcdb3-51c4-42f1-8e8d-920e7e29fa41 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:52.240612 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 423/843] 10.222.0.52 () {56 vars in 1109 bytes} [Sat May 14 20:50:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:52.246755 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e74c3cd-b852-4957-b27b-2f03facf89d1 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:52.354212 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e74c3cd-b852-4957-b27b-2f03facf89d1 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:52.390878 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6d47ab-35a2-4127-9243-73623d0bc9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:52.392667 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d47ab-35a2-4127-9243-73623d0bc9df None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:52.393193 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d47ab-35a2-4127-9243-73623d0bc9df None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:52.393637 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d47ab-35a2-4127-9243-73623d0bc9df None admin] PATH_INFO: `/v3/projects/service` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:52.401884 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6d47ab-35a2-4127-9243-73623d0bc9df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:52.403708 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6d47ab-35a2-4127-9243-73623d0bc9df None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:52.419407 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-9b6d47ab-35a2-4127-9243-73623d0bc9df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 14 20:50:52.419407 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:52.419407 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:52.419407 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:52.419407 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:52.419407 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:52.419407 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:52.419407 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:52.419407 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:52.419407 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:52.419407 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:52.419407 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:52.419407 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 14 20:50:52.419407 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_project(project_id) May 14 20:50:52.419407 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 14 20:50:52.420452 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 14 20:50:52.420452 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:52.420452 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:52.420452 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:52.420452 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:52.420452 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:52.420452 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:52.420452 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:52.420452 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:50:52.420452 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:52.420452 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:52.420452 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:52.420452 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:52.420452 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:52.420452 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:52.420452 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:52.420452 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:52.421357 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 14 20:50:52.421357 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 14 20:50:52.421357 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 20:50:52.421357 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 20:50:52.421357 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 20:50:52.421357 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 20:50:52.421357 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 14 20:50:52.421357 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:52.423630 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 421/844] 10.222.0.52 () {56 vars in 1111 bytes} [Sat May 14 20:50:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:52.433518 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096fcdb3-51c4-42f1-8e8d-920e7e29fa41 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:52.469635 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f48d31-4e29-49d8-b3bb-c435a3658af3 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:52.470627 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f48d31-4e29-49d8-b3bb-c435a3658af3 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:52.470994 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f48d31-4e29-49d8-b3bb-c435a3658af3 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:52.472674 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 422/845] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:50:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:50:52.478228 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5cf053-6608-422c-bcd7-9b8ebb10686f None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:52.478518 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5cf053-6608-422c-bcd7-9b8ebb10686f None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:52.478802 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5cf053-6608-422c-bcd7-9b8ebb10686f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:52.497290 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-0f5cf053-6608-422c-bcd7-9b8ebb10686f None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:50:52.498474 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-0f5cf053-6608-422c-bcd7-9b8ebb10686f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:50:52.538961 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096fcdb3-51c4-42f1-8e8d-920e7e29fa41 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:52.574724 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcda38cf-23b3-45ff-bf89-543bb8a471eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:52.575499 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda38cf-23b3-45ff-bf89-543bb8a471eb None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:52.575827 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda38cf-23b3-45ff-bf89-543bb8a471eb None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:52.576093 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda38cf-23b3-45ff-bf89-543bb8a471eb None admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:52.576983 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcda38cf-23b3-45ff-bf89-543bb8a471eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:52.577301 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcda38cf-23b3-45ff-bf89-543bb8a471eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:52.578744 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcda38cf-23b3-45ff-bf89-543bb8a471eb None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:52.582722 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 423/846] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:50:52 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 20:50:52.591698 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2a623-0885-48ca-9982-11fb450b0f29 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:52.591990 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2a623-0885-48ca-9982-11fb450b0f29 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:52.592267 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2a623-0885-48ca-9982-11fb450b0f29 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:52.593557 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 424/847] 10.222.0.52 () {56 vars in 1148 bytes} [Sat May 14 20:50:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:52.593749 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 424/848] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:50:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 14 20:50:52.600984 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393ddc7-bb95-42a4-9d7b-e600b1722499 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:52.601278 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393ddc7-bb95-42a4-9d7b-e600b1722499 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:52.601562 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393ddc7-bb95-42a4-9d7b-e600b1722499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:52.602606 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcda38cf-23b3-45ff-bf89-543bb8a471eb None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:52.619241 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-4393ddc7-bb95-42a4-9d7b-e600b1722499 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:50:52.620370 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-4393ddc7-bb95-42a4-9d7b-e600b1722499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:50:52.692101 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 425/849] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:50:52 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 20:50:52.696382 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4393ddc7-bb95-42a4-9d7b-e600b1722499 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:52.711727 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcda38cf-23b3-45ff-bf89-543bb8a471eb None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:52.747069 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a815b6-006c-4c12-9b9c-3b80975e1d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:52.747756 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a815b6-006c-4c12-9b9c-3b80975e1d42 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:52.748042 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a815b6-006c-4c12-9b9c-3b80975e1d42 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:52.748320 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a815b6-006c-4c12-9b9c-3b80975e1d42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:52.749137 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a815b6-006c-4c12-9b9c-3b80975e1d42 None admin] RBAC: Adding query filter params (role.id=24c463e2b4d44dd28cd2723a69a8ed2e, scope.project.id=0911a024287e430ea6ee015389f0c440, user.id=c781fe7f4a014f0d8b5e7385b20b348c) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:52.749450 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a815b6-006c-4c12-9b9c-3b80975e1d42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:52.750873 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a815b6-006c-4c12-9b9c-3b80975e1d42 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:52.757793 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 425/850] 10.222.0.52 () {56 vars in 1374 bytes} [Sat May 14 20:50:52 2022] GET /identity/v3/role_assignments?user.id=c781fe7f4a014f0d8b5e7385b20b348c&scope.project.id=0911a024287e430ea6ee015389f0c440&role.id=24c463e2b4d44dd28cd2723a69a8ed2e => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:50:52.758594 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a815b6-006c-4c12-9b9c-3b80975e1d42 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:52.811186 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4393ddc7-bb95-42a4-9d7b-e600b1722499 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:52.848729 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0882ff-8a76-467f-9189-dc5d053ef0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:52.849573 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0882ff-8a76-467f-9189-dc5d053ef0bc None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:52.849853 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0882ff-8a76-467f-9189-dc5d053ef0bc None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:52.850122 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0882ff-8a76-467f-9189-dc5d053ef0bc None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:52.850804 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0882ff-8a76-467f-9189-dc5d053ef0bc None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:52.852256 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0882ff-8a76-467f-9189-dc5d053ef0bc None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:52.864654 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-be0882ff-8a76-467f-9189-dc5d053ef0bc None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 14 20:50:52.864654 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:52.864654 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 14 20:50:52.864654 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 14 20:50:52.864654 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 14 20:50:52.864654 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 14 20:50:52.864654 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 14 20:50:52.864654 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 20:50:52.864654 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 14 20:50:52.864654 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:52.864654 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 20:50:52.864654 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:52.864654 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:52.864654 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:52.864654 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:52.864654 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:52.864654 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:52.865774 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:52.865774 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:52.865774 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:52.865774 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:52.865774 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:52.865774 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:52.865774 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 14 20:50:52.865774 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_service(service_id) May 14 20:50:52.865774 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 14 20:50:52.865774 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 14 20:50:52.865774 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:52.865774 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:52.865774 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:52.865774 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:52.865774 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:52.865774 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:52.866663 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:52.866663 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:50:52.866663 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:52.866663 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:52.866663 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:52.866663 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:52.866663 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:52.866663 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:52.866663 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:52.866663 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:52.866663 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 14 20:50:52.866663 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 20:50:52.866663 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 14 20:50:52.866663 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:52.866663 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 426/851] 10.222.0.52 () {56 vars in 1114 bytes} [Sat May 14 20:50:52 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:52.873345 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0882ff-8a76-467f-9189-dc5d053ef0bc None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:52.907790 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a815b6-006c-4c12-9b9c-3b80975e1d42 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:52.957665 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc45cb67-401a-424a-8944-9e88bfbef882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:52.958783 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45cb67-401a-424a-8944-9e88bfbef882 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:52.959207 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45cb67-401a-424a-8944-9e88bfbef882 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:52.959655 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45cb67-401a-424a-8944-9e88bfbef882 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:52.960492 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc45cb67-401a-424a-8944-9e88bfbef882 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:52.962730 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc45cb67-401a-424a-8944-9e88bfbef882 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:52.977948 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-fc45cb67-401a-424a-8944-9e88bfbef882 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 14 20:50:52.977948 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:52.977948 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 14 20:50:52.977948 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 14 20:50:52.977948 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 14 20:50:52.977948 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 14 20:50:52.977948 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 14 20:50:52.977948 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 20:50:52.977948 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 14 20:50:52.977948 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:52.977948 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 20:50:52.977948 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:52.977948 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:52.977948 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:52.977948 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:52.977948 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:52.979140 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:52.979140 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:52.979140 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:52.979140 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:52.979140 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:52.979140 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:52.979140 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:52.979140 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 14 20:50:52.979140 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_service(service_id) May 14 20:50:52.979140 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 14 20:50:52.979140 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 14 20:50:52.979140 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:52.979140 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:52.979140 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:52.979140 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:52.979140 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:52.980015 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:52.980015 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:52.980015 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:50:52.980015 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:52.980015 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:52.980015 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:52.980015 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:52.980015 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:52.980015 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:52.980015 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:52.980015 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:52.980015 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 14 20:50:52.980015 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 20:50:52.980015 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 14 20:50:52.980015 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:52.982804 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 426/852] 10.222.0.52 () {56 vars in 1132 bytes} [Sat May 14 20:50:52 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:52.988822 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc45cb67-401a-424a-8944-9e88bfbef882 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:52.997842 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0882ff-8a76-467f-9189-dc5d053ef0bc None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:53.041443 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce96735-6cf3-4f99-a8f5-2ad5d0d38e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:53.042197 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce96735-6cf3-4f99-a8f5-2ad5d0d38e55 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:53.042571 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce96735-6cf3-4f99-a8f5-2ad5d0d38e55 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:53.042915 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce96735-6cf3-4f99-a8f5-2ad5d0d38e55 None admin] PATH_INFO: `/v3/services` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:53.043739 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce96735-6cf3-4f99-a8f5-2ad5d0d38e55 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:53.044189 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce96735-6cf3-4f99-a8f5-2ad5d0d38e55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:53.045631 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce96735-6cf3-4f99-a8f5-2ad5d0d38e55 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:53.050693 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 427/853] 10.222.0.52 () {56 vars in 1114 bytes} [Sat May 14 20:50:52 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:53.056787 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce96735-6cf3-4f99-a8f5-2ad5d0d38e55 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:53.105759 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc45cb67-401a-424a-8944-9e88bfbef882 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:53.142613 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac2549c-b500-47fa-b5ac-85eaad2ec51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:53.143181 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac2549c-b500-47fa-b5ac-85eaad2ec51e None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:53.143459 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac2549c-b500-47fa-b5ac-85eaad2ec51e None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:53.143761 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac2549c-b500-47fa-b5ac-85eaad2ec51e None admin] PATH_INFO: `/v3/services` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:53.144849 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac2549c-b500-47fa-b5ac-85eaad2ec51e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:53.144849 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac2549c-b500-47fa-b5ac-85eaad2ec51e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:53.146167 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac2549c-b500-47fa-b5ac-85eaad2ec51e None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:53.155086 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 427/854] 10.222.0.52 () {56 vars in 1126 bytes} [Sat May 14 20:50:52 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:53.155086 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef392c45-ead1-4788-80d4-68501e5f7caf None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:53.155086 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef392c45-ead1-4788-80d4-68501e5f7caf None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:53.155086 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef392c45-ead1-4788-80d4-68501e5f7caf None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:53.155086 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 428/855] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:50:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:50:53.158471 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef392c45-ead1-4788-80d4-68501e5f7caf None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:53.163215 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce96735-6cf3-4f99-a8f5-2ad5d0d38e55 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:53.199330 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd8d04c-3153-4608-80e4-8b2aa8403078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:53.200021 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd8d04c-3153-4608-80e4-8b2aa8403078 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:53.200305 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd8d04c-3153-4608-80e4-8b2aa8403078 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:53.200579 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd8d04c-3153-4608-80e4-8b2aa8403078 None admin] PATH_INFO: `/v3/services` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:53.201272 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd8d04c-3153-4608-80e4-8b2aa8403078 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:53.201577 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd8d04c-3153-4608-80e4-8b2aa8403078 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:53.202933 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd8d04c-3153-4608-80e4-8b2aa8403078 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:53.208245 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 428/856] 10.222.0.52 () {56 vars in 1114 bytes} [Sat May 14 20:50:53 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:50:53.209450 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eeb6a6-7b4c-4640-a915-6376dc8aef95 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:53.209740 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eeb6a6-7b4c-4640-a915-6376dc8aef95 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:53.210015 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eeb6a6-7b4c-4640-a915-6376dc8aef95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:53.234508 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-d6eeb6a6-7b4c-4640-a915-6376dc8aef95 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:50:53.236982 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d6eeb6a6-7b4c-4640-a915-6376dc8aef95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:50:53.274041 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef392c45-ead1-4788-80d4-68501e5f7caf None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:53.311757 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e10383-5990-4aa9-813e-e56f2d4d4c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:53.312440 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e10383-5990-4aa9-813e-e56f2d4d4c19 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:53.312800 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e10383-5990-4aa9-813e-e56f2d4d4c19 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:53.313249 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 429/857] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:50:53 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 20:50:53.315862 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e10383-5990-4aa9-813e-e56f2d4d4c19 None admin] PATH_INFO: `/v3/services` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:53.316855 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e10383-5990-4aa9-813e-e56f2d4d4c19 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:53.317574 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e10383-5990-4aa9-813e-e56f2d4d4c19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:53.319258 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e10383-5990-4aa9-813e-e56f2d4d4c19 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:53.325196 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 429/858] 10.222.0.52 () {56 vars in 1126 bytes} [Sat May 14 20:50:53 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:53.340052 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eeb6a6-7b4c-4640-a915-6376dc8aef95 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:53.456846 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eeb6a6-7b4c-4640-a915-6376dc8aef95 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:53.514799 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615be1b8-1dd2-4ffa-bef6-7fca9fa1e8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:53.514799 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615be1b8-1dd2-4ffa-bef6-7fca9fa1e8d8 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:53.514799 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615be1b8-1dd2-4ffa-bef6-7fca9fa1e8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:53.514799 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615be1b8-1dd2-4ffa-bef6-7fca9fa1e8d8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:53.529811 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615be1b8-1dd2-4ffa-bef6-7fca9fa1e8d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:50:53.538135 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-615be1b8-1dd2-4ffa-bef6-7fca9fa1e8d8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 14 20:50:53.538135 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:53.538135 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:53.538135 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:53.538135 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:53.538135 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:53.538135 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:53.538135 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:53.538135 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:53.538135 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:53.538135 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:53.538135 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:53.538135 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:50:53.538135 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:50:53.538135 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:50:53.538135 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:50:53.544439 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:50:53.544439 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:50:53.544439 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:50:53.544439 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:50:53.544439 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:53.544439 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:53.544439 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:53.544439 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:53.544439 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:53.544439 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:53.544439 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:53.544439 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:50:53.544439 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:53.544439 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:53.544439 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:53.544439 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:53.546139 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:53.546139 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:53.546139 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:53.546139 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:53.546139 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:50:53.546139 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:50:53.546139 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:50:53.546139 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:50:53.546139 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:50:53.546139 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:50:53.546139 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 14 20:50:53.546139 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:53.546139 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 430/859] 10.222.0.52 () {56 vars in 1102 bytes} [Sat May 14 20:50:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:53.548525 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e10383-5990-4aa9-813e-e56f2d4d4c19 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:53.662702 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e10383-5990-4aa9-813e-e56f2d4d4c19 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:53.702055 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f22cf8d-b7f1-4b88-bd07-835a2e9cc597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:53.703127 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22cf8d-b7f1-4b88-bd07-835a2e9cc597 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:53.703661 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22cf8d-b7f1-4b88-bd07-835a2e9cc597 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:53.704715 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22cf8d-b7f1-4b88-bd07-835a2e9cc597 None admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:53.706101 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f22cf8d-b7f1-4b88-bd07-835a2e9cc597 None admin] RBAC: Adding query filter params (name=service) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:53.706613 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f22cf8d-b7f1-4b88-bd07-835a2e9cc597 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:53.708279 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f22cf8d-b7f1-4b88-bd07-835a2e9cc597 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:53.723741 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 430/860] 10.222.0.52 () {56 vars in 1103 bytes} [Sat May 14 20:50:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:53.729575 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615be1b8-1dd2-4ffa-bef6-7fca9fa1e8d8 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:53.863732 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615be1b8-1dd2-4ffa-bef6-7fca9fa1e8d8 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:53.905594 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e7eb85-a71b-4e4e-bf0d-85551bfab374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:53.906967 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e7eb85-a71b-4e4e-bf0d-85551bfab374 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:53.907493 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e7eb85-a71b-4e4e-bf0d-85551bfab374 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:53.907881 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e7eb85-a71b-4e4e-bf0d-85551bfab374 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:53.919668 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e7eb85-a71b-4e4e-bf0d-85551bfab374 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:53.921192 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e7eb85-a71b-4e4e-bf0d-85551bfab374 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:53.948910 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-41e7eb85-a71b-4e4e-bf0d-85551bfab374 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:53.948910 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:53.948910 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:53.948910 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:53.948910 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:53.948910 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:53.948910 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:53.948910 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:53.948910 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:53.948910 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:53.948910 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:53.948910 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:53.948910 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:50:53.948910 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:50:53.948910 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:50:53.949969 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:50:53.949969 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:53.949969 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:53.949969 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:53.949969 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:53.949969 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:53.949969 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:53.949969 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:53.949969 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:50:53.949969 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:53.949969 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:53.949969 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:53.949969 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:53.949969 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:53.949969 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:53.949969 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:53.949969 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:53.950863 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 20:50:53.950863 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:50:53.950863 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:53.950863 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:53.950863 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 431/861] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:50:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:53.957590 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f22cf8d-b7f1-4b88-bd07-835a2e9cc597 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:54.073850 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f22cf8d-b7f1-4b88-bd07-835a2e9cc597 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:54.114624 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5633de37-6444-45a4-a165-5dbb89386c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:54.115288 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633de37-6444-45a4-a165-5dbb89386c0d None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:54.115606 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633de37-6444-45a4-a165-5dbb89386c0d None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:54.115885 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633de37-6444-45a4-a165-5dbb89386c0d None admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:54.116674 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5633de37-6444-45a4-a165-5dbb89386c0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:54.116988 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5633de37-6444-45a4-a165-5dbb89386c0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:54.118417 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5633de37-6444-45a4-a165-5dbb89386c0d None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:54.134361 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 431/862] 10.222.0.52 () {56 vars in 1109 bytes} [Sat May 14 20:50:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:54.139715 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e7eb85-a71b-4e4e-bf0d-85551bfab374 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:54.256155 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e7eb85-a71b-4e4e-bf0d-85551bfab374 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:54.296616 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343ecab3-d4a5-43f6-8ae8-d28af319f77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:54.297426 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ecab3-d4a5-43f6-8ae8-d28af319f77a None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:54.298254 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ecab3-d4a5-43f6-8ae8-d28af319f77a None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:54.298632 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ecab3-d4a5-43f6-8ae8-d28af319f77a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:54.309169 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343ecab3-d4a5-43f6-8ae8-d28af319f77a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:54.310631 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343ecab3-d4a5-43f6-8ae8-d28af319f77a None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:54.327444 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-343ecab3-d4a5-43f6-8ae8-d28af319f77a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 14 20:50:54.327444 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:54.327444 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:54.327444 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:54.327444 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:54.327444 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:54.327444 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:54.327444 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:54.327444 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:54.327444 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:54.327444 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:54.327444 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:54.327444 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 14 20:50:54.327444 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_user(user_id) May 14 20:50:54.327444 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 14 20:50:54.327444 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 14 20:50:54.328896 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:54.328896 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:54.328896 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 20:50:54.328896 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 20:50:54.328896 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 14 20:50:54.328896 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 20:50:54.328896 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:54.328896 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:54.328896 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:54.328896 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:54.328896 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:54.328896 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:50:54.328896 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:54.328896 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:54.328896 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:54.328896 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:54.328896 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:54.328896 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:54.330397 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:54.330397 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:54.330397 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 14 20:50:54.330397 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 14 20:50:54.330397 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 14 20:50:54.330397 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 14 20:50:54.330397 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 14 20:50:54.330397 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 14 20:50:54.330397 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 14 20:50:54.330397 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:54.330397 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 432/863] 10.222.0.52 () {56 vars in 1117 bytes} [Sat May 14 20:50:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:54.338494 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5633de37-6444-45a4-a165-5dbb89386c0d None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:54.459615 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5633de37-6444-45a4-a165-5dbb89386c0d None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:54.499967 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4a9703-3c84-4715-b4d8-ee4803c443a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:54.500759 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a9703-3c84-4715-b4d8-ee4803c443a4 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:54.501149 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a9703-3c84-4715-b4d8-ee4803c443a4 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:54.501439 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a9703-3c84-4715-b4d8-ee4803c443a4 None admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:54.502259 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4a9703-3c84-4715-b4d8-ee4803c443a4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:54.502573 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4a9703-3c84-4715-b4d8-ee4803c443a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:54.504058 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4a9703-3c84-4715-b4d8-ee4803c443a4 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:54.527821 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 432/864] 10.222.0.52 () {56 vars in 1149 bytes} [Sat May 14 20:50:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:54.534263 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343ecab3-d4a5-43f6-8ae8-d28af319f77a None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:54.661029 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343ecab3-d4a5-43f6-8ae8-d28af319f77a None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:54.696142 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9686ba2a-52f6-46c1-b873-bd53dbb71abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:54.696795 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686ba2a-52f6-46c1-b873-bd53dbb71abd None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:54.697074 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686ba2a-52f6-46c1-b873-bd53dbb71abd None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:54.697895 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686ba2a-52f6-46c1-b873-bd53dbb71abd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:54.769295 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9686ba2a-52f6-46c1-b873-bd53dbb71abd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:54.770747 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9686ba2a-52f6-46c1-b873-bd53dbb71abd None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:54.873101 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 433/865] 10.222.0.52 () {58 vars in 1282 bytes} [Sat May 14 20:50:54 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 14 20:50:54.878735 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4a9703-3c84-4715-b4d8-ee4803c443a4 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:54.988510 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4a9703-3c84-4715-b4d8-ee4803c443a4 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:55.025078 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cdcc0c-e1f6-49fe-9f23-3406dde9fa1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:55.025869 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cdcc0c-e1f6-49fe-9f23-3406dde9fa1f None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:55.026151 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cdcc0c-e1f6-49fe-9f23-3406dde9fa1f None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:55.026424 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cdcc0c-e1f6-49fe-9f23-3406dde9fa1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:55.037679 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cdcc0c-e1f6-49fe-9f23-3406dde9fa1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:55.039129 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cdcc0c-e1f6-49fe-9f23-3406dde9fa1f None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:55.056529 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-45cdcc0c-e1f6-49fe-9f23-3406dde9fa1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:55.056529 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:55.056529 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:55.056529 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:55.056529 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:55.056529 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:55.056529 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:55.056529 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:55.056529 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:55.056529 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:55.056529 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:55.056529 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:55.056529 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:50:55.056529 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:50:55.056529 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:50:55.057465 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:50:55.057465 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:55.057465 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:55.057465 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:55.057465 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:55.057465 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:55.057465 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:55.057465 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:55.057465 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:50:55.057465 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:55.057465 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:55.057465 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:55.057465 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:55.057465 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:55.057465 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:55.057465 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:55.057465 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:55.058623 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 20:50:55.058623 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:50:55.058623 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:55.058623 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:55.058623 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 433/866] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:50:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:55.064403 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9686ba2a-52f6-46c1-b873-bd53dbb71abd None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:55.165174 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9686ba2a-52f6-46c1-b873-bd53dbb71abd None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:55.203823 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2153ce-9ec1-4c25-86de-a9a24ee6d75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:55.204981 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2153ce-9ec1-4c25-86de-a9a24ee6d75f None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:55.205323 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2153ce-9ec1-4c25-86de-a9a24ee6d75f None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:55.205528 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2153ce-9ec1-4c25-86de-a9a24ee6d75f None admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:55.206251 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2153ce-9ec1-4c25-86de-a9a24ee6d75f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:55.206554 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2153ce-9ec1-4c25-86de-a9a24ee6d75f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:55.207966 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2153ce-9ec1-4c25-86de-a9a24ee6d75f None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:55.220587 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 434/867] 10.222.0.52 () {56 vars in 1109 bytes} [Sat May 14 20:50:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:55.225869 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cdcc0c-e1f6-49fe-9f23-3406dde9fa1f None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:55.327513 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cdcc0c-e1f6-49fe-9f23-3406dde9fa1f None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:55.362360 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892b7330-0bbb-4250-aec6-acfe9df7340b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:55.363160 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b7330-0bbb-4250-aec6-acfe9df7340b None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:55.363443 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b7330-0bbb-4250-aec6-acfe9df7340b None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:55.363753 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b7330-0bbb-4250-aec6-acfe9df7340b None admin] PATH_INFO: `/v3/projects/service` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:55.370887 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892b7330-0bbb-4250-aec6-acfe9df7340b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:55.372649 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892b7330-0bbb-4250-aec6-acfe9df7340b None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:55.387183 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-892b7330-0bbb-4250-aec6-acfe9df7340b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 14 20:50:55.387183 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:55.387183 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:55.387183 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:55.387183 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:55.387183 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:55.387183 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:55.387183 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:55.387183 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:55.387183 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:55.387183 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:55.387183 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:55.387183 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 14 20:50:55.387183 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_project(project_id) May 14 20:50:55.387183 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 14 20:50:55.388208 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 14 20:50:55.388208 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:55.388208 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:55.388208 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:55.388208 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:55.388208 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:55.388208 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:55.388208 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:55.388208 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:50:55.388208 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:55.388208 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:55.388208 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:55.388208 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:55.388208 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:55.388208 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:55.388208 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:55.388208 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:55.389126 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 14 20:50:55.389126 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 14 20:50:55.389126 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 20:50:55.389126 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 20:50:55.389126 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 20:50:55.389126 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 20:50:55.389126 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 14 20:50:55.389126 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:55.389126 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 434/868] 10.222.0.52 () {56 vars in 1111 bytes} [Sat May 14 20:50:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:55.396122 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2153ce-9ec1-4c25-86de-a9a24ee6d75f None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:55.408288 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b6dfef-09c0-420e-9d57-2947a5c8cfdf None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:55.408673 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b6dfef-09c0-420e-9d57-2947a5c8cfdf None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:55.408958 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b6dfef-09c0-420e-9d57-2947a5c8cfdf None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:55.410604 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 435/869] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:50:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 14 20:50:55.415662 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b871b55-a8f0-4490-a978-e74dc1e245cf None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:55.415953 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b871b55-a8f0-4490-a978-e74dc1e245cf None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:55.416240 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b871b55-a8f0-4490-a978-e74dc1e245cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:55.434027 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-4b871b55-a8f0-4490-a978-e74dc1e245cf None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:50:55.435554 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-4b871b55-a8f0-4490-a978-e74dc1e245cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:50:55.513079 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 436/870] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:50:55 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 14 20:50:55.527224 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2153ce-9ec1-4c25-86de-a9a24ee6d75f None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:55.537533 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b871b55-a8f0-4490-a978-e74dc1e245cf None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:55.579566 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddb8279-33d5-4e08-b17b-00508838aebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:55.581052 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddb8279-33d5-4e08-b17b-00508838aebc None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:55.581545 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddb8279-33d5-4e08-b17b-00508838aebc None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:55.582038 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddb8279-33d5-4e08-b17b-00508838aebc None admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:55.583040 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddb8279-33d5-4e08-b17b-00508838aebc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:55.583600 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddb8279-33d5-4e08-b17b-00508838aebc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:55.585382 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddb8279-33d5-4e08-b17b-00508838aebc None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:55.600136 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 435/871] 10.222.0.52 () {56 vars in 1148 bytes} [Sat May 14 20:50:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:55.606341 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddb8279-33d5-4e08-b17b-00508838aebc None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:55.650683 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b871b55-a8f0-4490-a978-e74dc1e245cf None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:55.689441 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc195897-f0cf-4af9-af31-4cc16c56ac7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:55.690268 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc195897-f0cf-4af9-af31-4cc16c56ac7c None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:55.690567 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc195897-f0cf-4af9-af31-4cc16c56ac7c None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:55.690842 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc195897-f0cf-4af9-af31-4cc16c56ac7c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:55.691511 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc195897-f0cf-4af9-af31-4cc16c56ac7c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:55.698642 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc195897-f0cf-4af9-af31-4cc16c56ac7c None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:55.705887 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-cc195897-f0cf-4af9-af31-4cc16c56ac7c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 14 20:50:55.705887 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:55.705887 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 14 20:50:55.705887 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 14 20:50:55.705887 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 14 20:50:55.705887 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 14 20:50:55.705887 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 14 20:50:55.705887 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 20:50:55.705887 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 14 20:50:55.705887 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:55.705887 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 20:50:55.705887 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:55.705887 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:55.705887 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:55.705887 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:55.705887 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:55.705887 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:55.706887 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:55.706887 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:55.706887 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:55.706887 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:55.706887 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:55.706887 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:55.706887 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 14 20:50:55.706887 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_service(service_id) May 14 20:50:55.706887 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 14 20:50:55.706887 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 14 20:50:55.706887 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:55.706887 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:55.706887 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:55.706887 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:55.706887 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:55.706887 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:55.708247 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:55.708247 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:50:55.708247 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:55.708247 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:55.708247 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:55.708247 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:55.708247 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:55.708247 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:55.708247 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:55.708247 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:55.708247 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 14 20:50:55.708247 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 20:50:55.708247 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 14 20:50:55.708247 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:55.712198 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 437/872] 10.222.0.52 () {56 vars in 1126 bytes} [Sat May 14 20:50:55 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 20:50:55.713479 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc195897-f0cf-4af9-af31-4cc16c56ac7c None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:55.720918 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddb8279-33d5-4e08-b17b-00508838aebc None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:55.756602 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15830bd-8c54-4de0-9644-bb1d578c4d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:55.757263 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15830bd-8c54-4de0-9644-bb1d578c4d5c None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:55.757553 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15830bd-8c54-4de0-9644-bb1d578c4d5c None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:55.757827 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15830bd-8c54-4de0-9644-bb1d578c4d5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:55.758649 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15830bd-8c54-4de0-9644-bb1d578c4d5c None admin] RBAC: Adding query filter params (role.id=998d6a3451be42a89d4cff277851ad70, scope.project.id=0911a024287e430ea6ee015389f0c440, user.id=c31cffc526be4f8992c57ca5e4e2a0f9) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:55.758961 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15830bd-8c54-4de0-9644-bb1d578c4d5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:55.760419 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15830bd-8c54-4de0-9644-bb1d578c4d5c None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:55.766236 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 436/873] 10.222.0.52 () {56 vars in 1374 bytes} [Sat May 14 20:50:55 2022] GET /identity/v3/role_assignments?user.id=c31cffc526be4f8992c57ca5e4e2a0f9&scope.project.id=0911a024287e430ea6ee015389f0c440&role.id=998d6a3451be42a89d4cff277851ad70 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:55.767977 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ece622-148e-4117-88d0-68a82d3f5a3f None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:55.768265 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ece622-148e-4117-88d0-68a82d3f5a3f None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:55.768543 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ece622-148e-4117-88d0-68a82d3f5a3f None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:55.769767 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 437/874] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:50:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:50:55.775276 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475cdeba-5d97-4321-9815-265f686b19d0 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:55.775601 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475cdeba-5d97-4321-9815-265f686b19d0 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:55.775883 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475cdeba-5d97-4321-9815-265f686b19d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:55.797931 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-475cdeba-5d97-4321-9815-265f686b19d0 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:50:55.800197 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-475cdeba-5d97-4321-9815-265f686b19d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:50:55.843383 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc195897-f0cf-4af9-af31-4cc16c56ac7c None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:55.885657 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a49b58-631e-438c-87b6-3634b0fdb5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:55.886344 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a49b58-631e-438c-87b6-3634b0fdb5c9 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:55.886631 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a49b58-631e-438c-87b6-3634b0fdb5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:55.886908 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a49b58-631e-438c-87b6-3634b0fdb5c9 None admin] PATH_INFO: `/v3/services` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:55.887666 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a49b58-631e-438c-87b6-3634b0fdb5c9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:55.887979 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a49b58-631e-438c-87b6-3634b0fdb5c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:55.889389 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a49b58-631e-438c-87b6-3634b0fdb5c9 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:55.890798 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 438/875] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:50:55 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 14 20:50:55.893007 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7194b57c-7dec-43f2-81a0-1c5ae294e481 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:55.893454 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7194b57c-7dec-43f2-81a0-1c5ae294e481 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:55.893893 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7194b57c-7dec-43f2-81a0-1c5ae294e481 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:55.895654 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 439/876] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:50:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:50:55.900980 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d47b5-a3db-4aa9-b215-8ed9a781a391 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:55.901268 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d47b5-a3db-4aa9-b215-8ed9a781a391 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:55.901547 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d47b5-a3db-4aa9-b215-8ed9a781a391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:55.906169 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 438/877] 10.222.0.52 () {56 vars in 1122 bytes} [Sat May 14 20:50:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:55.912578 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a49b58-631e-438c-87b6-3634b0fdb5c9 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:55.923753 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-501d47b5-a3db-4aa9-b215-8ed9a781a391 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:50:55.927106 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-501d47b5-a3db-4aa9-b215-8ed9a781a391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:50:56.000001 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 440/878] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:50:55 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 14 20:50:56.000862 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501d47b5-a3db-4aa9-b215-8ed9a781a391 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:56.033157 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a49b58-631e-438c-87b6-3634b0fdb5c9 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:56.071775 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88effe3-d9b8-4fd9-881d-6f1cb04e47d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:56.072610 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88effe3-d9b8-4fd9-881d-6f1cb04e47d4 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:56.072899 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88effe3-d9b8-4fd9-881d-6f1cb04e47d4 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:56.073177 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88effe3-d9b8-4fd9-881d-6f1cb04e47d4 None admin] PATH_INFO: `/v3/services` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:56.073877 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88effe3-d9b8-4fd9-881d-6f1cb04e47d4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:56.074286 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88effe3-d9b8-4fd9-881d-6f1cb04e47d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:56.075692 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88effe3-d9b8-4fd9-881d-6f1cb04e47d4 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:56.087596 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 439/879] 10.222.0.52 () {56 vars in 1122 bytes} [Sat May 14 20:50:55 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:56.087596 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88effe3-d9b8-4fd9-881d-6f1cb04e47d4 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:56.111870 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501d47b5-a3db-4aa9-b215-8ed9a781a391 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:56.161214 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928524c8-e4d4-4dbf-9994-71f2ab60c651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:56.162115 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928524c8-e4d4-4dbf-9994-71f2ab60c651 None admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:56.162525 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928524c8-e4d4-4dbf-9994-71f2ab60c651 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:56.162816 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928524c8-e4d4-4dbf-9994-71f2ab60c651 None admin] PATH_INFO: `/v3/services` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:56.163757 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928524c8-e4d4-4dbf-9994-71f2ab60c651 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:56.165877 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928524c8-e4d4-4dbf-9994-71f2ab60c651 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:56.215432 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88effe3-d9b8-4fd9-881d-6f1cb04e47d4 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:56.244033 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 441/880] 10.222.0.52 () {60 vars in 1141 bytes} [Sat May 14 20:50:56 2022] POST /identity/v3/services => generated 251 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 20:50:56.271030 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b055a0-9d59-4fe6-ba7a-24c70b257ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:56.272166 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b055a0-9d59-4fe6-ba7a-24c70b257ea8 None admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:56.276419 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b055a0-9d59-4fe6-ba7a-24c70b257ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:56.276419 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b055a0-9d59-4fe6-ba7a-24c70b257ea8 None admin] PATH_INFO: `/v3/services` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:56.276419 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b055a0-9d59-4fe6-ba7a-24c70b257ea8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:56.276419 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b055a0-9d59-4fe6-ba7a-24c70b257ea8 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:56.361217 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 440/881] 10.222.0.52 () {60 vars in 1141 bytes} [Sat May 14 20:50:56 2022] POST /identity/v3/services => generated 269 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 20:50:58.196854 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5babd848-9041-4ade-b385-8d72e79cf25c None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:58.197371 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5babd848-9041-4ade-b385-8d72e79cf25c None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:58.197371 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5babd848-9041-4ade-b385-8d72e79cf25c None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:58.198938 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 442/882] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:50:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:50:58.204644 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b7e383-f64e-4a9c-a0b9-5bbef51eed49 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:58.205137 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b7e383-f64e-4a9c-a0b9-5bbef51eed49 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:58.205406 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b7e383-f64e-4a9c-a0b9-5bbef51eed49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:58.223057 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-49b7e383-f64e-4a9c-a0b9-5bbef51eed49 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:50:58.224311 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-49b7e383-f64e-4a9c-a0b9-5bbef51eed49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:50:58.300822 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 441/883] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:50:58 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 20:50:58.326772 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5babd848-9041-4ade-b385-8d72e79cf25c None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:58.446675 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5babd848-9041-4ade-b385-8d72e79cf25c None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:58.485839 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eedc68-1e38-4392-afca-57ec89d82132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:58.486608 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eedc68-1e38-4392-afca-57ec89d82132 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:58.486886 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eedc68-1e38-4392-afca-57ec89d82132 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:58.487156 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eedc68-1e38-4392-afca-57ec89d82132 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:58.497655 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eedc68-1e38-4392-afca-57ec89d82132 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:50:58.506152 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-e9eedc68-1e38-4392-afca-57ec89d82132 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 14 20:50:58.506152 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:58.506152 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:58.506152 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:58.506152 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:58.506152 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:58.506152 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:58.506152 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:58.506152 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:58.506152 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:58.506152 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:58.506152 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:58.506152 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:50:58.506152 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:50:58.506152 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:50:58.506152 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:50:58.507088 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:50:58.507088 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:50:58.507088 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:50:58.507088 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:50:58.507088 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:58.507088 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:58.507088 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:58.507088 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:58.507088 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:58.507088 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:58.507088 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:58.507088 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:50:58.507088 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:58.507088 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:58.507088 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:58.507088 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:58.508997 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:58.508997 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:58.508997 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:58.508997 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:58.508997 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:50:58.508997 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:50:58.508997 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:50:58.508997 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:50:58.508997 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:50:58.508997 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:50:58.508997 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 14 20:50:58.508997 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:58.508997 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 443/884] 10.222.0.52 () {56 vars in 1120 bytes} [Sat May 14 20:50:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:58.513242 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b7e383-f64e-4a9c-a0b9-5bbef51eed49 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:58.585238 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18297db7-0bf1-41ac-9db7-54c6631eeb54 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:58.585550 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18297db7-0bf1-41ac-9db7-54c6631eeb54 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:58.585786 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18297db7-0bf1-41ac-9db7-54c6631eeb54 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:58.587384 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 444/885] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:50:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 14 20:50:58.590272 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5096f8d-3908-4e1d-82f6-6699db185019 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:58.590561 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5096f8d-3908-4e1d-82f6-6699db185019 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:58.590840 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5096f8d-3908-4e1d-82f6-6699db185019 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:58.592400 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 445/886] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:50:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:50:58.598579 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd27901-acb7-4cce-a147-0298fb7d1f6b None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:58.598872 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd27901-acb7-4cce-a147-0298fb7d1f6b None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:58.599154 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd27901-acb7-4cce-a147-0298fb7d1f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:58.615695 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-9cd27901-acb7-4cce-a147-0298fb7d1f6b None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:50:58.616893 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-9cd27901-acb7-4cce-a147-0298fb7d1f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:50:58.621872 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b7e383-f64e-4a9c-a0b9-5bbef51eed49 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:58.655100 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac09d15-493a-445a-ac56-17f590926ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:58.655805 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac09d15-493a-445a-ac56-17f590926ee4 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:58.656091 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac09d15-493a-445a-ac56-17f590926ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:58.656367 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac09d15-493a-445a-ac56-17f590926ee4 None admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:58.657722 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac09d15-493a-445a-ac56-17f590926ee4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:58.658068 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac09d15-493a-445a-ac56-17f590926ee4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:58.659450 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac09d15-493a-445a-ac56-17f590926ee4 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:58.667869 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 442/887] 10.222.0.52 () {56 vars in 1115 bytes} [Sat May 14 20:50:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:58.669321 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037554a3-0f58-484f-b1e9-22fefdbe6785 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:58.669608 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037554a3-0f58-484f-b1e9-22fefdbe6785 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:58.669881 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037554a3-0f58-484f-b1e9-22fefdbe6785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:58.685698 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-037554a3-0f58-484f-b1e9-22fefdbe6785 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:50:58.686855 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-037554a3-0f58-484f-b1e9-22fefdbe6785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:50:58.695497 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 446/888] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:50:58 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 20:50:58.695497 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd27901-acb7-4cce-a147-0298fb7d1f6b None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:58.761801 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 443/889] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:50:58 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 20:50:58.762671 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037554a3-0f58-484f-b1e9-22fefdbe6785 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:58.794624 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd27901-acb7-4cce-a147-0298fb7d1f6b None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:58.827993 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b73fcbc-8868-4f60-93e0-e00e24ea8cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:58.828772 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b73fcbc-8868-4f60-93e0-e00e24ea8cbd None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:58.829096 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b73fcbc-8868-4f60-93e0-e00e24ea8cbd None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:58.829373 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b73fcbc-8868-4f60-93e0-e00e24ea8cbd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:58.840013 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b73fcbc-8868-4f60-93e0-e00e24ea8cbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:58.841490 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b73fcbc-8868-4f60-93e0-e00e24ea8cbd None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:58.857531 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037554a3-0f58-484f-b1e9-22fefdbe6785 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:58.858650 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-0b73fcbc-8868-4f60-93e0-e00e24ea8cbd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:58.858650 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:58.858650 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:58.858650 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:58.858650 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:58.858650 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:58.858650 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:58.858650 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:58.858650 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:58.858650 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:58.858650 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:58.858650 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:58.858650 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:50:58.858650 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:50:58.858650 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:50:58.859570 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:50:58.859570 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:58.859570 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:58.859570 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:58.859570 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:58.859570 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:58.859570 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:58.859570 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:58.859570 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:50:58.859570 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:58.859570 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:58.859570 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:58.859570 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:58.859570 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:58.859570 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:58.859570 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:58.859570 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:58.860521 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 20:50:58.860521 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:50:58.860521 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:50:58.860521 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:58.860521 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 447/890] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:50:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:58.861436 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b1f653-4c0b-453a-b329-ff4f8bb46b8f None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:58.861717 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b1f653-4c0b-453a-b329-ff4f8bb46b8f None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:58.861988 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b1f653-4c0b-453a-b329-ff4f8bb46b8f None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:58.863224 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 448/891] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:50:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:50:58.863935 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b1f653-4c0b-453a-b329-ff4f8bb46b8f None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:58.896991 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c566725c-435d-4def-9248-0542160b09fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:58.897652 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566725c-435d-4def-9248-0542160b09fe None admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:58.897935 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566725c-435d-4def-9248-0542160b09fe None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:58.898214 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566725c-435d-4def-9248-0542160b09fe None admin] PATH_INFO: `/v3/services` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:58.898926 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c566725c-435d-4def-9248-0542160b09fe None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:58.900330 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c566725c-435d-4def-9248-0542160b09fe None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:58.967343 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b1f653-4c0b-453a-b329-ff4f8bb46b8f None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:58.971662 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 444/892] 10.222.0.52 () {60 vars in 1141 bytes} [Sat May 14 20:50:58 2022] POST /identity/v3/services => generated 241 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 20:50:58.972292 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c566725c-435d-4def-9248-0542160b09fe None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:59.014336 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787ac720-152d-453c-ad13-d74e95730f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:59.015064 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ac720-152d-453c-ad13-d74e95730f1b None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:59.015358 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ac720-152d-453c-ad13-d74e95730f1b None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:59.015665 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ac720-152d-453c-ad13-d74e95730f1b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:59.016392 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787ac720-152d-453c-ad13-d74e95730f1b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:59.018441 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787ac720-152d-453c-ad13-d74e95730f1b None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:59.030693 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-787ac720-152d-453c-ad13-d74e95730f1b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 14 20:50:59.030693 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:59.030693 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 14 20:50:59.030693 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 14 20:50:59.030693 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 14 20:50:59.030693 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 14 20:50:59.030693 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 14 20:50:59.030693 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 20:50:59.030693 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 14 20:50:59.030693 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:59.030693 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 20:50:59.030693 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:59.030693 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:59.030693 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:59.030693 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:59.030693 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:59.030693 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:59.031880 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:59.031880 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:59.031880 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:59.031880 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:59.031880 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:59.031880 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:59.031880 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 14 20:50:59.031880 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_service(service_id) May 14 20:50:59.031880 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 14 20:50:59.031880 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 14 20:50:59.031880 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:59.031880 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:59.031880 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:59.031880 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:59.031880 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:59.031880 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:59.033669 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:59.033669 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:50:59.033669 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:59.033669 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:59.033669 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:59.033669 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:59.033669 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:59.033669 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:59.033669 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:59.033669 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:59.033669 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 14 20:50:59.033669 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 20:50:59.033669 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 14 20:50:59.033669 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:59.033669 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 449/893] 10.222.0.52 () {56 vars in 1114 bytes} [Sat May 14 20:50:58 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:59.034687 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13a628e-1524-46ba-bdb7-8438205e7742 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:59.034687 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13a628e-1524-46ba-bdb7-8438205e7742 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:59.034687 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13a628e-1524-46ba-bdb7-8438205e7742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:59.051993 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-a13a628e-1524-46ba-bdb7-8438205e7742 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:50:59.053210 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-a13a628e-1524-46ba-bdb7-8438205e7742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:50:59.089985 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c566725c-435d-4def-9248-0542160b09fe None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:59.128842 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db39226b-0b17-4692-a455-c70573a275b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:59.129394 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db39226b-0b17-4692-a455-c70573a275b9 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:59.129730 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db39226b-0b17-4692-a455-c70573a275b9 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:59.130021 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db39226b-0b17-4692-a455-c70573a275b9 None admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:59.130814 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db39226b-0b17-4692-a455-c70573a275b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:59.131132 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db39226b-0b17-4692-a455-c70573a275b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:59.139768 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 450/894] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:50:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 20:50:59.139768 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13a628e-1524-46ba-bdb7-8438205e7742 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:59.140105 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db39226b-0b17-4692-a455-c70573a275b9 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:59.152655 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 445/895] 10.222.0.52 () {56 vars in 1109 bytes} [Sat May 14 20:50:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:59.153614 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db39226b-0b17-4692-a455-c70573a275b9 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:59.252639 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13a628e-1524-46ba-bdb7-8438205e7742 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:59.271121 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db39226b-0b17-4692-a455-c70573a275b9 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:59.286758 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723ad1bb-8713-4900-a4a9-4966db76fd56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:59.287414 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ad1bb-8713-4900-a4a9-4966db76fd56 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:59.287725 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ad1bb-8713-4900-a4a9-4966db76fd56 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:59.287999 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ad1bb-8713-4900-a4a9-4966db76fd56 None admin] PATH_INFO: `/v3/services` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:59.288694 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723ad1bb-8713-4900-a4a9-4966db76fd56 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:59.288997 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723ad1bb-8713-4900-a4a9-4966db76fd56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:59.290353 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723ad1bb-8713-4900-a4a9-4966db76fd56 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:59.294988 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 451/896] 10.222.0.52 () {56 vars in 1114 bytes} [Sat May 14 20:50:59 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:59.295792 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723ad1bb-8713-4900-a4a9-4966db76fd56 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:59.306910 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6a9292-812d-4934-838d-4566483356db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:59.308097 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a9292-812d-4934-838d-4566483356db None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:59.308097 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a9292-812d-4934-838d-4566483356db None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:59.308379 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a9292-812d-4934-838d-4566483356db None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:59.316234 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6a9292-812d-4934-838d-4566483356db None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:59.317668 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6a9292-812d-4934-838d-4566483356db None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:59.333487 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-db6a9292-812d-4934-838d-4566483356db None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 14 20:50:59.333487 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:59.333487 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:59.333487 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:59.333487 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:59.333487 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:59.333487 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:59.333487 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:59.333487 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:59.333487 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:59.333487 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:59.333487 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:59.333487 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 14 20:50:59.333487 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_user(user_id) May 14 20:50:59.333487 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 14 20:50:59.333487 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 14 20:50:59.334664 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:59.334664 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:59.334664 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 20:50:59.334664 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 20:50:59.334664 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 14 20:50:59.334664 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 20:50:59.334664 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:59.334664 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:59.334664 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:59.334664 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:59.334664 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:59.334664 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:50:59.334664 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:59.334664 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:59.334664 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:59.334664 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:59.334664 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:59.334664 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:59.335869 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:59.335869 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:59.335869 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 14 20:50:59.335869 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 14 20:50:59.335869 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 14 20:50:59.335869 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 14 20:50:59.335869 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 14 20:50:59.335869 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 14 20:50:59.335869 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 14 20:50:59.335869 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:50:59.339419 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 446/897] 10.222.0.52 () {56 vars in 1117 bytes} [Sat May 14 20:50:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:59.340312 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6a9292-812d-4934-838d-4566483356db None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:59.406788 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723ad1bb-8713-4900-a4a9-4966db76fd56 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:59.442916 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6a9292-812d-4934-838d-4566483356db None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:59.443123 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0954a4-bde3-4a70-a053-7cfd6160652f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:59.444027 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0954a4-bde3-4a70-a053-7cfd6160652f None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:59.444569 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0954a4-bde3-4a70-a053-7cfd6160652f None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:59.444946 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0954a4-bde3-4a70-a053-7cfd6160652f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:59.446500 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0954a4-bde3-4a70-a053-7cfd6160652f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:59.448001 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0954a4-bde3-4a70-a053-7cfd6160652f None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:59.463427 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-ad0954a4-bde3-4a70-a053-7cfd6160652f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 14 20:50:59.463427 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:59.463427 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 14 20:50:59.463427 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 14 20:50:59.463427 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 14 20:50:59.463427 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 14 20:50:59.463427 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 14 20:50:59.463427 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 20:50:59.463427 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 14 20:50:59.463427 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:59.463427 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 20:50:59.463427 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:59.463427 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:50:59.463427 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:50:59.463427 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:50:59.463427 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:50:59.464638 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:50:59.464638 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:50:59.464638 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:50:59.464638 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:50:59.464638 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:50:59.464638 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:50:59.464638 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:50:59.464638 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 14 20:50:59.464638 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_service(service_id) May 14 20:50:59.464638 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 14 20:50:59.464638 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 14 20:50:59.464638 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:50:59.464638 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:50:59.464638 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:50:59.464638 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:50:59.464638 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:50:59.465533 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:50:59.465533 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:50:59.465533 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:50:59.465533 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:50:59.465533 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:50:59.465533 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:50:59.465533 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:50:59.465533 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:50:59.465533 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:50:59.465533 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:50:59.465533 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:50:59.465533 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 14 20:50:59.465533 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 20:50:59.465533 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 14 20:50:59.465533 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:50:59.466943 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 452/898] 10.222.0.52 () {56 vars in 1132 bytes} [Sat May 14 20:50:59 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:50:59.468045 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0954a4-bde3-4a70-a053-7cfd6160652f None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:59.487607 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a26ff49-0b1f-4310-a6df-802530ca50e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:59.488284 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a26ff49-0b1f-4310-a6df-802530ca50e2 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:59.488567 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a26ff49-0b1f-4310-a6df-802530ca50e2 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:59.488844 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a26ff49-0b1f-4310-a6df-802530ca50e2 None admin] PATH_INFO: `/v3/services` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:59.489549 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a26ff49-0b1f-4310-a6df-802530ca50e2 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:59.489856 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a26ff49-0b1f-4310-a6df-802530ca50e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:59.491231 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a26ff49-0b1f-4310-a6df-802530ca50e2 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:59.496828 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 447/899] 10.222.0.52 () {56 vars in 1114 bytes} [Sat May 14 20:50:59 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:59.500933 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a26ff49-0b1f-4310-a6df-802530ca50e2 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:59.578210 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0954a4-bde3-4a70-a053-7cfd6160652f None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:59.600285 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a26ff49-0b1f-4310-a6df-802530ca50e2 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:59.619042 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f64489f-236b-491a-b655-f393629a4722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:59.619749 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f64489f-236b-491a-b655-f393629a4722 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:59.620033 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f64489f-236b-491a-b655-f393629a4722 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:59.620309 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f64489f-236b-491a-b655-f393629a4722 None admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:59.621137 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f64489f-236b-491a-b655-f393629a4722 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:59.621704 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f64489f-236b-491a-b655-f393629a4722 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:59.623122 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f64489f-236b-491a-b655-f393629a4722 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:59.634931 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed2982c-c19f-4375-b221-a4bd7110cce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:59.635620 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed2982c-c19f-4375-b221-a4bd7110cce6 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:59.635905 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed2982c-c19f-4375-b221-a4bd7110cce6 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:59.636178 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed2982c-c19f-4375-b221-a4bd7110cce6 None admin] PATH_INFO: `/v3/services` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:59.636880 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed2982c-c19f-4375-b221-a4bd7110cce6 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:59.637185 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed2982c-c19f-4375-b221-a4bd7110cce6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:59.638531 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed2982c-c19f-4375-b221-a4bd7110cce6 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:59.646242 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 453/900] 10.222.0.52 () {56 vars in 1149 bytes} [Sat May 14 20:50:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:59.646242 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f64489f-236b-491a-b655-f393629a4722 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:59.648618 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 448/901] 10.222.0.52 () {56 vars in 1126 bytes} [Sat May 14 20:50:59 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:59.649305 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed2982c-c19f-4375-b221-a4bd7110cce6 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:59.746591 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed2982c-c19f-4375-b221-a4bd7110cce6 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:59.752395 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f64489f-236b-491a-b655-f393629a4722 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:59.780197 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc6cfbe-0397-4c93-8744-e75bf709998d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:59.780852 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6cfbe-0397-4c93-8744-e75bf709998d None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:59.781131 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6cfbe-0397-4c93-8744-e75bf709998d None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:59.781405 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6cfbe-0397-4c93-8744-e75bf709998d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:59.789929 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c8d382-b3cc-4f1e-91c3-47904f5fb9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:59.791179 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c8d382-b3cc-4f1e-91c3-47904f5fb9cb None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:59.791640 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c8d382-b3cc-4f1e-91c3-47904f5fb9cb None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:59.792058 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c8d382-b3cc-4f1e-91c3-47904f5fb9cb None admin] PATH_INFO: `/v3/endpoints` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:59.792982 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c8d382-b3cc-4f1e-91c3-47904f5fb9cb None admin] RBAC: Adding query filter params (interface=public, service_id=60984fe2feaf40e0ae6119da06e63728, region_id=RegionOne) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:59.793456 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c8d382-b3cc-4f1e-91c3-47904f5fb9cb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:59.794952 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c8d382-b3cc-4f1e-91c3-47904f5fb9cb None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:59.802549 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 454/902] 10.222.0.52 () {56 vars in 1251 bytes} [Sat May 14 20:50:59 2022] GET /identity/v3/endpoints?service_id=60984fe2feaf40e0ae6119da06e63728&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:59.803639 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c8d382-b3cc-4f1e-91c3-47904f5fb9cb None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:59.855169 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc6cfbe-0397-4c93-8744-e75bf709998d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:59.856698 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc6cfbe-0397-4c93-8744-e75bf709998d None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:59.910231 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c8d382-b3cc-4f1e-91c3-47904f5fb9cb None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:50:59.947228 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be07cd-651b-4126-986d-0d79f24bdb03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:50:59.948014 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be07cd-651b-4126-986d-0d79f24bdb03 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:50:59.948444 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be07cd-651b-4126-986d-0d79f24bdb03 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:50:59.948791 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be07cd-651b-4126-986d-0d79f24bdb03 None admin] PATH_INFO: `/v3/services` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:50:59.949567 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4be07cd-651b-4126-986d-0d79f24bdb03 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:50:59.949931 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4be07cd-651b-4126-986d-0d79f24bdb03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:50:59.951350 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4be07cd-651b-4126-986d-0d79f24bdb03 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:50:59.957074 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 455/903] 10.222.0.52 () {56 vars in 1126 bytes} [Sat May 14 20:50:59 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:50:59.957711 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be07cd-651b-4126-986d-0d79f24bdb03 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:50:59.972296 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 449/904] 10.222.0.52 () {58 vars in 1282 bytes} [Sat May 14 20:50:59 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 14 20:50:59.972296 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc6cfbe-0397-4c93-8744-e75bf709998d None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:00.060909 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be07cd-651b-4126-986d-0d79f24bdb03 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:00.064687 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc6cfbe-0397-4c93-8744-e75bf709998d None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:00.094797 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dcba36-a09a-46de-a9a6-111dc201b24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:00.095618 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dcba36-a09a-46de-a9a6-111dc201b24a None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:00.095993 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dcba36-a09a-46de-a9a6-111dc201b24a None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:00.096364 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dcba36-a09a-46de-a9a6-111dc201b24a None admin] PATH_INFO: `/v3/services` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:00.097152 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dcba36-a09a-46de-a9a6-111dc201b24a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:00.098039 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b3677f-65a5-4039-8f25-ee288c7b7866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:00.098692 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3677f-65a5-4039-8f25-ee288c7b7866 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:00.098823 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dcba36-a09a-46de-a9a6-111dc201b24a None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:00.098979 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3677f-65a5-4039-8f25-ee288c7b7866 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:00.099258 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3677f-65a5-4039-8f25-ee288c7b7866 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:00.100074 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b3677f-65a5-4039-8f25-ee288c7b7866 None admin] RBAC: Adding query filter params (interface=public, service_id=729e41bb5ab342ef9bed9dfcf5b79653, region_id=RegionOne) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:51:00.100385 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b3677f-65a5-4039-8f25-ee288c7b7866 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:00.101745 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b3677f-65a5-4039-8f25-ee288c7b7866 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:00.105246 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 456/905] 10.222.0.52 () {56 vars in 1087 bytes} [Sat May 14 20:50:59 2022] GET /identity/v3/services => generated 1497 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 20:51:00.112208 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 450/906] 10.222.0.52 () {56 vars in 1251 bytes} [Sat May 14 20:50:59 2022] GET /identity/v3/endpoints?service_id=729e41bb5ab342ef9bed9dfcf5b79653&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:51:00.117156 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dcba36-a09a-46de-a9a6-111dc201b24a None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:00.117336 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b3677f-65a5-4039-8f25-ee288c7b7866 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:00.243712 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b3677f-65a5-4039-8f25-ee288c7b7866 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:00.247327 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dcba36-a09a-46de-a9a6-111dc201b24a None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:00.282537 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8458627-f073-4889-8641-634e4965020c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:00.284115 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8458627-f073-4889-8641-634e4965020c None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:00.284614 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8458627-f073-4889-8641-634e4965020c None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:00.285047 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82389461-ce32-4016-a558-1e4a6ee7a0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:00.285456 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8458627-f073-4889-8641-634e4965020c None admin] PATH_INFO: `/v3/services` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:00.285970 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82389461-ce32-4016-a558-1e4a6ee7a0ed None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:00.286324 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82389461-ce32-4016-a558-1e4a6ee7a0ed None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:00.286672 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82389461-ce32-4016-a558-1e4a6ee7a0ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:00.286864 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8458627-f073-4889-8641-634e4965020c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:00.288642 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8458627-f073-4889-8641-634e4965020c None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:00.296696 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 451/907] 10.222.0.52 () {56 vars in 1087 bytes} [Sat May 14 20:51:00 2022] GET /identity/v3/services => generated 1497 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 20:51:00.302801 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82389461-ce32-4016-a558-1e4a6ee7a0ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:00.302801 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82389461-ce32-4016-a558-1e4a6ee7a0ed None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:00.322737 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-82389461-ce32-4016-a558-1e4a6ee7a0ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:51:00.322737 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:51:00.322737 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:51:00.322737 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:51:00.322737 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:51:00.322737 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:51:00.322737 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:51:00.322737 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:51:00.322737 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:51:00.322737 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:51:00.322737 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:51:00.322737 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:51:00.322737 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:51:00.322737 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:51:00.322737 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:51:00.323906 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:51:00.323906 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:51:00.323906 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:51:00.323906 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:51:00.323906 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:51:00.323906 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:51:00.323906 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:51:00.323906 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:51:00.323906 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:51:00.323906 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:51:00.323906 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:51:00.323906 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:51:00.323906 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:51:00.323906 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:51:00.323906 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:51:00.323906 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:51:00.323906 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:51:00.325149 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 20:51:00.325149 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:51:00.325149 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:51:00.325149 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:51:00.325149 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 457/908] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:51:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:51:00.332182 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8458627-f073-4889-8641-634e4965020c None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:00.445513 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8458627-f073-4889-8641-634e4965020c None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:00.483732 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b912429-657d-4b8c-926b-2d896460bf0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:00.484458 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b912429-657d-4b8c-926b-2d896460bf0e None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:00.484748 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b912429-657d-4b8c-926b-2d896460bf0e None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:00.485608 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b912429-657d-4b8c-926b-2d896460bf0e None admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:00.486467 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b912429-657d-4b8c-926b-2d896460bf0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:51:00.486742 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b912429-657d-4b8c-926b-2d896460bf0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:00.488074 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b912429-657d-4b8c-926b-2d896460bf0e None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:00.500359 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 452/909] 10.222.0.52 () {56 vars in 1109 bytes} [Sat May 14 20:51:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:51:00.505520 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82389461-ce32-4016-a558-1e4a6ee7a0ed None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:00.617784 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82389461-ce32-4016-a558-1e4a6ee7a0ed None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:00.654492 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766197d5-b938-4ac5-b772-d56a732ff374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:00.655353 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766197d5-b938-4ac5-b772-d56a732ff374 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:00.655668 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766197d5-b938-4ac5-b772-d56a732ff374 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:00.655942 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766197d5-b938-4ac5-b772-d56a732ff374 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:00.664381 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766197d5-b938-4ac5-b772-d56a732ff374 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:00.665837 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766197d5-b938-4ac5-b772-d56a732ff374 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:00.680571 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-766197d5-b938-4ac5-b772-d56a732ff374 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 14 20:51:00.680571 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:51:00.680571 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:51:00.680571 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:51:00.680571 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:51:00.680571 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:51:00.680571 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:51:00.680571 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:51:00.680571 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:51:00.680571 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:51:00.680571 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:51:00.680571 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:51:00.680571 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 14 20:51:00.680571 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_project(project_id) May 14 20:51:00.680571 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 14 20:51:00.681474 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 14 20:51:00.681474 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:51:00.681474 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:51:00.681474 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:51:00.681474 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:51:00.681474 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:51:00.681474 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:51:00.681474 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:51:00.681474 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:51:00.681474 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:51:00.681474 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:51:00.681474 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:51:00.681474 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:51:00.681474 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:51:00.681474 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:51:00.681474 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:51:00.681474 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:51:00.682422 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 14 20:51:00.682422 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 14 20:51:00.682422 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 20:51:00.682422 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 20:51:00.682422 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 20:51:00.682422 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 20:51:00.682422 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 14 20:51:00.682422 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:51:00.682422 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 458/910] 10.222.0.52 () {56 vars in 1111 bytes} [Sat May 14 20:51:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 20:51:00.687586 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b912429-657d-4b8c-926b-2d896460bf0e None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:00.802975 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b912429-657d-4b8c-926b-2d896460bf0e None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:00.837971 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aba1eff-cee5-4c7f-9e6c-9a89108e90a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:00.839001 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba1eff-cee5-4c7f-9e6c-9a89108e90a5 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:00.839540 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba1eff-cee5-4c7f-9e6c-9a89108e90a5 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:00.840026 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba1eff-cee5-4c7f-9e6c-9a89108e90a5 None admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:00.841001 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aba1eff-cee5-4c7f-9e6c-9a89108e90a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:51:00.841506 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aba1eff-cee5-4c7f-9e6c-9a89108e90a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:00.843134 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aba1eff-cee5-4c7f-9e6c-9a89108e90a5 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:00.857273 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 453/911] 10.222.0.52 () {56 vars in 1148 bytes} [Sat May 14 20:51:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:51:00.863116 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766197d5-b938-4ac5-b772-d56a732ff374 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:00.979746 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766197d5-b938-4ac5-b772-d56a732ff374 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:01.015943 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d45035-2e86-411a-bb36-46bd05f43415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:01.017699 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d45035-2e86-411a-bb36-46bd05f43415 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:01.017984 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d45035-2e86-411a-bb36-46bd05f43415 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:01.018256 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d45035-2e86-411a-bb36-46bd05f43415 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:01.019077 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d45035-2e86-411a-bb36-46bd05f43415 None admin] RBAC: Adding query filter params (role.id=b842db64da3a4644945d0a941a9a9285, scope.project.id=0911a024287e430ea6ee015389f0c440, user.id=c31cffc526be4f8992c57ca5e4e2a0f9) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:51:01.019383 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d45035-2e86-411a-bb36-46bd05f43415 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:01.020829 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d45035-2e86-411a-bb36-46bd05f43415 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:01.026806 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 459/912] 10.222.0.52 () {56 vars in 1374 bytes} [Sat May 14 20:51:00 2022] GET /identity/v3/role_assignments?user.id=c31cffc526be4f8992c57ca5e4e2a0f9&scope.project.id=0911a024287e430ea6ee015389f0c440&role.id=b842db64da3a4644945d0a941a9a9285 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:51:01.355069 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add392d-5a7d-4888-bc69-fc969e1f7ec6 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:01.355608 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add392d-5a7d-4888-bc69-fc969e1f7ec6 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:01.355687 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add392d-5a7d-4888-bc69-fc969e1f7ec6 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:01.357244 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 454/913] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:51:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:51:01.362765 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc23a0-96dd-4e44-963c-86326ba34613 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:01.363170 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc23a0-96dd-4e44-963c-86326ba34613 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:01.363395 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc23a0-96dd-4e44-963c-86326ba34613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:01.381865 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-e2fc23a0-96dd-4e44-963c-86326ba34613 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:51:01.383064 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e2fc23a0-96dd-4e44-963c-86326ba34613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:51:01.455869 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 460/914] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:51:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 20:51:01.479915 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1add392d-5a7d-4888-bc69-fc969e1f7ec6 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:01.599512 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1add392d-5a7d-4888-bc69-fc969e1f7ec6 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:01.627635 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a429c3-8e5f-49ab-bd52-fe61cd8fbe75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:01.628369 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a429c3-8e5f-49ab-bd52-fe61cd8fbe75 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:01.628871 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a429c3-8e5f-49ab-bd52-fe61cd8fbe75 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:01.629365 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a429c3-8e5f-49ab-bd52-fe61cd8fbe75 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:01.630039 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a429c3-8e5f-49ab-bd52-fe61cd8fbe75 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:01.632030 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a429c3-8e5f-49ab-bd52-fe61cd8fbe75 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:01.645515 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-22a429c3-8e5f-49ab-bd52-fe61cd8fbe75 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 14 20:51:01.645515 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:51:01.645515 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 14 20:51:01.645515 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 14 20:51:01.645515 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 14 20:51:01.645515 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 14 20:51:01.645515 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 14 20:51:01.645515 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 20:51:01.645515 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 14 20:51:01.645515 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:51:01.645515 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 20:51:01.645515 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:51:01.645515 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:51:01.645515 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:51:01.645515 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:51:01.645515 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:51:01.645515 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:51:01.646538 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:51:01.646538 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:51:01.646538 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:51:01.646538 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:51:01.646538 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:51:01.646538 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:51:01.646538 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 14 20:51:01.646538 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_service(service_id) May 14 20:51:01.646538 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 14 20:51:01.646538 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 14 20:51:01.646538 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:51:01.646538 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:51:01.646538 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:51:01.646538 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:51:01.646538 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:51:01.646538 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:51:01.647399 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:51:01.647399 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:51:01.647399 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:51:01.647399 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:51:01.647399 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:51:01.647399 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:51:01.647399 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:51:01.647399 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:51:01.647399 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:51:01.647399 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:51:01.647399 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 14 20:51:01.647399 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 20:51:01.647399 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 14 20:51:01.647399 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:51:01.647399 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 455/915] 10.222.0.52 () {56 vars in 1126 bytes} [Sat May 14 20:51:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:51:01.653014 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc23a0-96dd-4e44-963c-86326ba34613 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:01.758582 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc23a0-96dd-4e44-963c-86326ba34613 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:01.793368 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe8692c-3901-4d46-9780-7561a4aaa45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:01.794043 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe8692c-3901-4d46-9780-7561a4aaa45c None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:01.794328 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe8692c-3901-4d46-9780-7561a4aaa45c None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:01.794608 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe8692c-3901-4d46-9780-7561a4aaa45c None admin] PATH_INFO: `/v3/services` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:01.795381 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe8692c-3901-4d46-9780-7561a4aaa45c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:51:01.795719 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe8692c-3901-4d46-9780-7561a4aaa45c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:01.797082 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe8692c-3901-4d46-9780-7561a4aaa45c None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:01.802711 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 461/916] 10.222.0.52 () {56 vars in 1122 bytes} [Sat May 14 20:51:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:51:01.808369 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a429c3-8e5f-49ab-bd52-fe61cd8fbe75 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:01.912901 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a429c3-8e5f-49ab-bd52-fe61cd8fbe75 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:01.948514 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3805dd5f-d2a3-459c-b7d1-5f2e56329909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:01.949192 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3805dd5f-d2a3-459c-b7d1-5f2e56329909 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:01.949477 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3805dd5f-d2a3-459c-b7d1-5f2e56329909 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:01.949754 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3805dd5f-d2a3-459c-b7d1-5f2e56329909 None admin] PATH_INFO: `/v3/services` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:01.950465 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3805dd5f-d2a3-459c-b7d1-5f2e56329909 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:51:01.950774 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3805dd5f-d2a3-459c-b7d1-5f2e56329909 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:01.952174 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3805dd5f-d2a3-459c-b7d1-5f2e56329909 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:01.958380 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 456/917] 10.222.0.52 () {56 vars in 1122 bytes} [Sat May 14 20:51:01 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:51:01.964214 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe8692c-3901-4d46-9780-7561a4aaa45c None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:02.069853 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe8692c-3901-4d46-9780-7561a4aaa45c None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:02.105530 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e6b54-9260-4e38-92a3-7128add88829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:02.106192 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e6b54-9260-4e38-92a3-7128add88829 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:02.106477 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e6b54-9260-4e38-92a3-7128add88829 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:02.106757 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e6b54-9260-4e38-92a3-7128add88829 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:02.107658 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2e6b54-9260-4e38-92a3-7128add88829 None admin] RBAC: Adding query filter params (interface=public, service_id=9e954f3af51a44068ea7d1a546c6453b, region_id=RegionOne) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:51:02.107976 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2e6b54-9260-4e38-92a3-7128add88829 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:02.109344 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2e6b54-9260-4e38-92a3-7128add88829 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:02.115381 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 462/918] 10.222.0.52 () {56 vars in 1251 bytes} [Sat May 14 20:51:01 2022] GET /identity/v3/endpoints?service_id=9e954f3af51a44068ea7d1a546c6453b&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:51:02.120896 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3805dd5f-d2a3-459c-b7d1-5f2e56329909 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:02.223926 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3805dd5f-d2a3-459c-b7d1-5f2e56329909 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:02.259034 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f590c35d-86f7-498a-8007-7aab0606a0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:02.259739 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f590c35d-86f7-498a-8007-7aab0606a0d3 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:02.264795 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f590c35d-86f7-498a-8007-7aab0606a0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:02.264795 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f590c35d-86f7-498a-8007-7aab0606a0d3 None admin] PATH_INFO: `/v3/services` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:02.264795 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f590c35d-86f7-498a-8007-7aab0606a0d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:02.264795 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f590c35d-86f7-498a-8007-7aab0606a0d3 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:02.269552 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 457/919] 10.222.0.52 () {56 vars in 1087 bytes} [Sat May 14 20:51:02 2022] GET /identity/v3/services => generated 1497 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 20:51:02.604027 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53042c8-c332-4e7e-a217-e4c8a36f0851 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:02.604516 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53042c8-c332-4e7e-a217-e4c8a36f0851 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:02.604516 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53042c8-c332-4e7e-a217-e4c8a36f0851 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:02.606098 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 463/920] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:51:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:51:02.611759 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f29f5-fc78-41c1-802c-650e32d34134 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:02.612197 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f29f5-fc78-41c1-802c-650e32d34134 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:02.612400 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f29f5-fc78-41c1-802c-650e32d34134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:02.629930 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-995f29f5-fc78-41c1-802c-650e32d34134 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:51:02.631127 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-995f29f5-fc78-41c1-802c-650e32d34134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:51:02.705247 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 458/921] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:51:02 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 14 20:51:02.728746 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53042c8-c332-4e7e-a217-e4c8a36f0851 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:02.833492 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53042c8-c332-4e7e-a217-e4c8a36f0851 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:02.850261 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74c1b0-6811-42c3-add4-fed09da590a2 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:02.850564 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74c1b0-6811-42c3-add4-fed09da590a2 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:02.850827 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74c1b0-6811-42c3-add4-fed09da590a2 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:02.853866 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 459/922] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:51:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 14 20:51:02.860996 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805d202-b0df-4ec0-abca-ce56cbc1ad68 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:02.861290 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805d202-b0df-4ec0-abca-ce56cbc1ad68 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:02.861643 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805d202-b0df-4ec0-abca-ce56cbc1ad68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:02.874458 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfc90aa-2358-4aa3-af1e-889d9ec3dfd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:02.876085 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc90aa-2358-4aa3-af1e-889d9ec3dfd0 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:02.876574 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc90aa-2358-4aa3-af1e-889d9ec3dfd0 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:02.877050 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc90aa-2358-4aa3-af1e-889d9ec3dfd0 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:02.877917 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfc90aa-2358-4aa3-af1e-889d9ec3dfd0 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:02.879465 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfc90aa-2358-4aa3-af1e-889d9ec3dfd0 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:02.883899 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-6805d202-b0df-4ec0-abca-ce56cbc1ad68 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:51:02.885509 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-6805d202-b0df-4ec0-abca-ce56cbc1ad68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:51:02.894164 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-3cfc90aa-2358-4aa3-af1e-889d9ec3dfd0 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 14 20:51:02.894164 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:51:02.894164 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 14 20:51:02.894164 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 14 20:51:02.894164 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 14 20:51:02.894164 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 14 20:51:02.894164 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 14 20:51:02.894164 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 20:51:02.894164 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 14 20:51:02.894164 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:51:02.894164 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 20:51:02.894164 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:51:02.894164 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:51:02.894164 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:51:02.894164 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:51:02.894164 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:51:02.894164 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:51:02.895314 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:51:02.895314 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:51:02.895314 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:51:02.895314 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:51:02.895314 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:51:02.895314 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:51:02.895314 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 14 20:51:02.895314 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_service(service_id) May 14 20:51:02.895314 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 14 20:51:02.895314 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 14 20:51:02.895314 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:51:02.895314 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:51:02.895314 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:51:02.895314 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:51:02.895314 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:51:02.895314 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:51:02.896354 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:51:02.896354 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:51:02.896354 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:51:02.896354 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:51:02.896354 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:51:02.896354 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:51:02.896354 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:51:02.896354 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:51:02.896354 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:51:02.896354 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:51:02.896354 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 14 20:51:02.896354 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 20:51:02.896354 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 14 20:51:02.896354 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:51:02.898770 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 464/923] 10.222.0.52 () {56 vars in 1114 bytes} [Sat May 14 20:51:02 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:51:02.904788 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfc90aa-2358-4aa3-af1e-889d9ec3dfd0 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:02.958682 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 460/924] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:51:02 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 20:51:02.982497 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6805d202-b0df-4ec0-abca-ce56cbc1ad68 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:03.025666 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfc90aa-2358-4aa3-af1e-889d9ec3dfd0 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:03.070192 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33613cd-6886-4719-a0e0-81ddcd438a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:03.071194 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33613cd-6886-4719-a0e0-81ddcd438a8c None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:03.071914 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33613cd-6886-4719-a0e0-81ddcd438a8c None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:03.072207 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33613cd-6886-4719-a0e0-81ddcd438a8c None admin] PATH_INFO: `/v3/services` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:03.072928 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33613cd-6886-4719-a0e0-81ddcd438a8c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:51:03.073244 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33613cd-6886-4719-a0e0-81ddcd438a8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:03.074619 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33613cd-6886-4719-a0e0-81ddcd438a8c None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:03.084245 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 465/925] 10.222.0.52 () {56 vars in 1114 bytes} [Sat May 14 20:51:02 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:51:03.085154 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33613cd-6886-4719-a0e0-81ddcd438a8c None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:03.091295 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6805d202-b0df-4ec0-abca-ce56cbc1ad68 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:03.137343 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1137bf7-395a-4aee-aee3-146be87e22c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:03.138546 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1137bf7-395a-4aee-aee3-146be87e22c6 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:03.139052 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1137bf7-395a-4aee-aee3-146be87e22c6 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:03.139890 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1137bf7-395a-4aee-aee3-146be87e22c6 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:03.141040 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1137bf7-395a-4aee-aee3-146be87e22c6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:03.143156 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1137bf7-395a-4aee-aee3-146be87e22c6 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:03.159910 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-f1137bf7-395a-4aee-aee3-146be87e22c6 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 14 20:51:03.159910 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:51:03.159910 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 14 20:51:03.159910 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 14 20:51:03.159910 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 14 20:51:03.159910 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 14 20:51:03.159910 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 14 20:51:03.159910 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 20:51:03.159910 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 14 20:51:03.159910 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:51:03.159910 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 20:51:03.159910 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:51:03.159910 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:51:03.159910 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:51:03.159910 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:51:03.159910 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:51:03.161036 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:51:03.161036 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:51:03.161036 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:51:03.161036 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:51:03.161036 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:51:03.161036 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:51:03.161036 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:51:03.161036 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 14 20:51:03.161036 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_service(service_id) May 14 20:51:03.161036 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 14 20:51:03.161036 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 14 20:51:03.161036 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:51:03.161036 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:51:03.161036 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:51:03.161036 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:51:03.161036 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:51:03.161893 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:51:03.161893 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:51:03.161893 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:51:03.161893 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:51:03.161893 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:51:03.161893 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:51:03.161893 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:51:03.161893 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:51:03.161893 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:51:03.161893 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:51:03.161893 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:51:03.161893 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 14 20:51:03.161893 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 20:51:03.161893 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 14 20:51:03.161893 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:51:03.165242 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 461/926] 10.222.0.52 () {56 vars in 1132 bytes} [Sat May 14 20:51:02 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 20:51:03.170684 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1137bf7-395a-4aee-aee3-146be87e22c6 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:03.200201 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33613cd-6886-4719-a0e0-81ddcd438a8c None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:03.245086 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd29620a-fe71-42f4-903c-3710a8f4ac21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:03.246061 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd29620a-fe71-42f4-903c-3710a8f4ac21 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:03.246779 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd29620a-fe71-42f4-903c-3710a8f4ac21 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:03.247258 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd29620a-fe71-42f4-903c-3710a8f4ac21 None admin] PATH_INFO: `/v3/services` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:03.248194 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd29620a-fe71-42f4-903c-3710a8f4ac21 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:51:03.248680 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd29620a-fe71-42f4-903c-3710a8f4ac21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:03.250713 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd29620a-fe71-42f4-903c-3710a8f4ac21 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:03.258142 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 466/927] 10.222.0.52 () {56 vars in 1114 bytes} [Sat May 14 20:51:03 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:51:03.263581 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd29620a-fe71-42f4-903c-3710a8f4ac21 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:03.281540 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1137bf7-395a-4aee-aee3-146be87e22c6 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:03.318786 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0d9aa4-acf2-45f5-a0ab-33c63cd10ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:03.319548 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d9aa4-acf2-45f5-a0ab-33c63cd10ca5 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:03.319838 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d9aa4-acf2-45f5-a0ab-33c63cd10ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:03.320120 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d9aa4-acf2-45f5-a0ab-33c63cd10ca5 None admin] PATH_INFO: `/v3/services` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:03.320873 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0d9aa4-acf2-45f5-a0ab-33c63cd10ca5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:51:03.321188 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0d9aa4-acf2-45f5-a0ab-33c63cd10ca5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:03.322564 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0d9aa4-acf2-45f5-a0ab-33c63cd10ca5 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:03.332686 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 462/928] 10.222.0.52 () {56 vars in 1126 bytes} [Sat May 14 20:51:03 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:51:03.333549 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0d9aa4-acf2-45f5-a0ab-33c63cd10ca5 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:03.393467 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd29620a-fe71-42f4-903c-3710a8f4ac21 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:03.441026 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d490d-88d4-4049-9bc7-8e85a0cd8751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:03.442836 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d490d-88d4-4049-9bc7-8e85a0cd8751 None admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:03.443122 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d490d-88d4-4049-9bc7-8e85a0cd8751 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:03.443402 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d490d-88d4-4049-9bc7-8e85a0cd8751 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:03.444181 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1d490d-88d4-4049-9bc7-8e85a0cd8751 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:03.445612 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1d490d-88d4-4049-9bc7-8e85a0cd8751 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:03.459635 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0d9aa4-acf2-45f5-a0ab-33c63cd10ca5 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:03.493221 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fad1726-30de-472f-9f55-b54261ef4855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:03.493912 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad1726-30de-472f-9f55-b54261ef4855 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:03.494196 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad1726-30de-472f-9f55-b54261ef4855 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:03.494469 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad1726-30de-472f-9f55-b54261ef4855 None admin] PATH_INFO: `/v3/services` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:03.495220 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fad1726-30de-472f-9f55-b54261ef4855 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:51:03.495557 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fad1726-30de-472f-9f55-b54261ef4855 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:03.497190 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fad1726-30de-472f-9f55-b54261ef4855 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:03.503330 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 463/929] 10.222.0.52 () {56 vars in 1126 bytes} [Sat May 14 20:51:03 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:51:03.508533 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fad1726-30de-472f-9f55-b54261ef4855 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:03.546475 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 467/930] 10.222.0.52 () {60 vars in 1144 bytes} [Sat May 14 20:51:03 2022] POST /identity/v3/endpoints => generated 346 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 20:51:03.604957 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae67ac9-ccfd-45a7-bf97-3ea2f21d924c None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:03.605616 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae67ac9-ccfd-45a7-bf97-3ea2f21d924c None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:03.605616 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae67ac9-ccfd-45a7-bf97-3ea2f21d924c None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:03.606878 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 468/931] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:51:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 14 20:51:03.612605 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b2012-f47e-4f9d-b6d1-8ffc13e87dfd None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:03.612905 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b2012-f47e-4f9d-b6d1-8ffc13e87dfd None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:03.613166 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b2012-f47e-4f9d-b6d1-8ffc13e87dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:03.631503 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-e73b2012-f47e-4f9d-b6d1-8ffc13e87dfd None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:51:03.632745 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e73b2012-f47e-4f9d-b6d1-8ffc13e87dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:51:03.633388 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fad1726-30de-472f-9f55-b54261ef4855 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:03.681973 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c13fbf-f442-4ed1-9be6-c021864eb14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:03.682649 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c13fbf-f442-4ed1-9be6-c021864eb14b None admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:03.682975 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c13fbf-f442-4ed1-9be6-c021864eb14b None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:03.683259 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c13fbf-f442-4ed1-9be6-c021864eb14b None admin] PATH_INFO: `/v3/endpoints` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:03.684071 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c13fbf-f442-4ed1-9be6-c021864eb14b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:03.685638 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c13fbf-f442-4ed1-9be6-c021864eb14b None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:03.715009 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 469/932] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:51:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 20:51:03.739769 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b2012-f47e-4f9d-b6d1-8ffc13e87dfd None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:03.768745 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 464/933] 10.222.0.52 () {60 vars in 1144 bytes} [Sat May 14 20:51:03 2022] POST /identity/v3/endpoints => generated 347 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 20:51:03.867690 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b2012-f47e-4f9d-b6d1-8ffc13e87dfd None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:03.913332 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788af8c1-106f-4af8-b761-a0594daec236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:03.920617 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788af8c1-106f-4af8-b761-a0594daec236 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:03.921235 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788af8c1-106f-4af8-b761-a0594daec236 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:03.921713 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788af8c1-106f-4af8-b761-a0594daec236 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:03.941877 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788af8c1-106f-4af8-b761-a0594daec236 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:51:03.951338 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-788af8c1-106f-4af8-b761-a0594daec236 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 14 20:51:03.951338 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:51:03.951338 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:51:03.951338 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:51:03.951338 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:51:03.951338 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:51:03.951338 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:51:03.951338 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:51:03.951338 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:51:03.951338 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:51:03.951338 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:51:03.951338 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:51:03.951338 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:51:03.951338 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:51:03.951338 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:51:03.951338 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:51:03.952295 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:51:03.952295 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:51:03.952295 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:51:03.952295 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:51:03.952295 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:51:03.952295 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:51:03.952295 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:51:03.952295 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:51:03.952295 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:51:03.952295 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:51:03.952295 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:51:03.952295 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:51:03.952295 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:51:03.952295 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:51:03.952295 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:51:03.952295 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:51:03.953159 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:51:03.953159 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:51:03.953159 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:51:03.953159 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:51:03.953159 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:51:03.953159 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:51:03.953159 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:51:03.953159 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:51:03.953159 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:51:03.953159 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:51:03.953159 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 14 20:51:03.953159 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:51:03.956235 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 470/934] 10.222.0.52 () {56 vars in 1120 bytes} [Sat May 14 20:51:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 20:51:03.962762 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c13fbf-f442-4ed1-9be6-c021864eb14b None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:04.068229 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c13fbf-f442-4ed1-9be6-c021864eb14b None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:04.110851 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f14b1e-80a6-4c9d-a85f-5129e9b40089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:04.111839 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f14b1e-80a6-4c9d-a85f-5129e9b40089 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:04.112135 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f14b1e-80a6-4c9d-a85f-5129e9b40089 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:04.112545 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f14b1e-80a6-4c9d-a85f-5129e9b40089 None admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:04.113165 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f14b1e-80a6-4c9d-a85f-5129e9b40089 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:51:04.113475 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f14b1e-80a6-4c9d-a85f-5129e9b40089 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:04.114872 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f14b1e-80a6-4c9d-a85f-5129e9b40089 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:04.124417 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 465/935] 10.222.0.52 () {56 vars in 1115 bytes} [Sat May 14 20:51:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:51:04.131927 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788af8c1-106f-4af8-b761-a0594daec236 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:04.242227 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788af8c1-106f-4af8-b761-a0594daec236 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:04.277553 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639b1a24-aec0-4fdb-848c-116bef3f6edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:04.278707 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b1a24-aec0-4fdb-848c-116bef3f6edb None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:04.279188 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b1a24-aec0-4fdb-848c-116bef3f6edb None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:04.279692 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b1a24-aec0-4fdb-848c-116bef3f6edb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:04.290675 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639b1a24-aec0-4fdb-848c-116bef3f6edb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:04.292460 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639b1a24-aec0-4fdb-848c-116bef3f6edb None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:04.309831 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-639b1a24-aec0-4fdb-848c-116bef3f6edb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:51:04.309831 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:51:04.309831 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:51:04.309831 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:51:04.309831 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:51:04.309831 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:51:04.309831 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:51:04.309831 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:51:04.309831 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:51:04.309831 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:51:04.309831 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:51:04.309831 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:51:04.309831 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:51:04.309831 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:51:04.309831 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:51:04.310750 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:51:04.310750 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:51:04.310750 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:51:04.310750 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:51:04.310750 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:51:04.310750 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:51:04.310750 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:51:04.310750 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:51:04.310750 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:51:04.310750 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:51:04.310750 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:51:04.310750 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:51:04.310750 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:51:04.310750 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:51:04.310750 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:51:04.310750 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:51:04.310750 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:51:04.311668 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 20:51:04.311668 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:51:04.311668 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:51:04.311668 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:51:04.314400 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 471/936] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:51:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 20:51:04.319767 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f14b1e-80a6-4c9d-a85f-5129e9b40089 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:04.424337 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f14b1e-80a6-4c9d-a85f-5129e9b40089 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:04.466380 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c923be93-6666-4c37-83ec-9c9d9a2927fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:04.467048 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923be93-6666-4c37-83ec-9c9d9a2927fc None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:04.467335 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923be93-6666-4c37-83ec-9c9d9a2927fc None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:04.467646 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923be93-6666-4c37-83ec-9c9d9a2927fc None admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:04.468369 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c923be93-6666-4c37-83ec-9c9d9a2927fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:51:04.468737 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c923be93-6666-4c37-83ec-9c9d9a2927fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:04.470870 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c923be93-6666-4c37-83ec-9c9d9a2927fc None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:04.483342 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 466/937] 10.222.0.52 () {56 vars in 1109 bytes} [Sat May 14 20:51:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:51:04.489939 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639b1a24-aec0-4fdb-848c-116bef3f6edb None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:04.603591 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639b1a24-aec0-4fdb-848c-116bef3f6edb None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:04.627616 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c399ddd-a2f8-427b-be21-3d37449820b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:04.629293 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c399ddd-a2f8-427b-be21-3d37449820b6 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:04.629803 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c399ddd-a2f8-427b-be21-3d37449820b6 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:04.630302 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c399ddd-a2f8-427b-be21-3d37449820b6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:04.639668 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c399ddd-a2f8-427b-be21-3d37449820b6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:04.642251 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c399ddd-a2f8-427b-be21-3d37449820b6 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:04.658674 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-9c399ddd-a2f8-427b-be21-3d37449820b6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 14 20:51:04.658674 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:51:04.658674 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:51:04.658674 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:51:04.658674 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:51:04.658674 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:51:04.658674 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:51:04.658674 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:51:04.658674 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:51:04.658674 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:51:04.658674 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:51:04.658674 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:51:04.658674 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 14 20:51:04.658674 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_user(user_id) May 14 20:51:04.658674 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 14 20:51:04.658674 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 14 20:51:04.659758 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:51:04.659758 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:51:04.659758 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 20:51:04.659758 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 20:51:04.659758 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 14 20:51:04.659758 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 20:51:04.659758 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:51:04.659758 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:51:04.659758 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:51:04.659758 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:51:04.659758 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:51:04.659758 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:51:04.659758 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:51:04.659758 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:51:04.659758 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:51:04.659758 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:51:04.659758 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:51:04.659758 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:51:04.660963 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:51:04.660963 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:51:04.660963 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 14 20:51:04.660963 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 14 20:51:04.660963 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 14 20:51:04.660963 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 14 20:51:04.660963 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 14 20:51:04.660963 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 14 20:51:04.660963 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 14 20:51:04.660963 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:51:04.663278 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 472/938] 10.222.0.52 () {56 vars in 1117 bytes} [Sat May 14 20:51:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:51:04.669692 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c923be93-6666-4c37-83ec-9c9d9a2927fc None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:04.789042 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c923be93-6666-4c37-83ec-9c9d9a2927fc None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:04.834299 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bef01e-2513-4157-a05e-48ed19f7c332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:04.834973 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bef01e-2513-4157-a05e-48ed19f7c332 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:04.835257 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bef01e-2513-4157-a05e-48ed19f7c332 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:04.835558 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bef01e-2513-4157-a05e-48ed19f7c332 None admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:04.836404 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bef01e-2513-4157-a05e-48ed19f7c332 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:51:04.836713 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bef01e-2513-4157-a05e-48ed19f7c332 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:04.838155 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bef01e-2513-4157-a05e-48ed19f7c332 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:04.842142 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b558ec-589e-4911-a5d5-35bbaf5002c7 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:04.842697 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b558ec-589e-4911-a5d5-35bbaf5002c7 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:04.843173 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b558ec-589e-4911-a5d5-35bbaf5002c7 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:04.845747 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 473/939] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:51:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 14 20:51:04.851220 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0690ab-aa13-4655-84b2-80b312b04b5a None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:04.851775 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0690ab-aa13-4655-84b2-80b312b04b5a None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:04.852272 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0690ab-aa13-4655-84b2-80b312b04b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:04.857615 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 467/940] 10.222.0.52 () {56 vars in 1149 bytes} [Sat May 14 20:51:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:51:04.863382 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bef01e-2513-4157-a05e-48ed19f7c332 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:04.870472 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-ab0690ab-aa13-4655-84b2-80b312b04b5a None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:51:04.872202 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ab0690ab-aa13-4655-84b2-80b312b04b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:51:04.959723 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 474/941] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:51:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 20:51:04.964380 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bef01e-2513-4157-a05e-48ed19f7c332 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:04.977226 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0690ab-aa13-4655-84b2-80b312b04b5a None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:04.999801 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caded0e-48f5-4f3b-a79d-616f9bb1d90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:05.001119 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caded0e-48f5-4f3b-a79d-616f9bb1d90c None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:05.001586 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caded0e-48f5-4f3b-a79d-616f9bb1d90c None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:05.001863 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caded0e-48f5-4f3b-a79d-616f9bb1d90c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:05.012121 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caded0e-48f5-4f3b-a79d-616f9bb1d90c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:05.014165 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caded0e-48f5-4f3b-a79d-616f9bb1d90c None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:05.032516 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-4caded0e-48f5-4f3b-a79d-616f9bb1d90c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:51:05.032516 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:51:05.032516 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:51:05.032516 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:51:05.032516 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:51:05.032516 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:51:05.032516 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:51:05.032516 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:51:05.032516 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:51:05.032516 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:51:05.032516 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:51:05.032516 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:51:05.032516 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:51:05.032516 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:51:05.032516 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:51:05.033654 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:51:05.033654 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:51:05.033654 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:51:05.033654 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:51:05.033654 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:51:05.033654 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:51:05.033654 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:51:05.033654 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:51:05.033654 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:51:05.033654 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:51:05.033654 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:51:05.033654 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:51:05.033654 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:51:05.033654 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:51:05.033654 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:51:05.033654 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:51:05.033654 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:51:05.034570 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 20:51:05.034570 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:51:05.034570 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:51:05.034570 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:51:05.034570 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 468/942] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:51:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 20:51:05.040956 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caded0e-48f5-4f3b-a79d-616f9bb1d90c None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:05.096004 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0690ab-aa13-4655-84b2-80b312b04b5a None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:05.137174 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9258880e-d4d4-4b55-90cd-6f5545ee218a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:05.137961 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9258880e-d4d4-4b55-90cd-6f5545ee218a None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:05.138246 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9258880e-d4d4-4b55-90cd-6f5545ee218a None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:05.138580 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9258880e-d4d4-4b55-90cd-6f5545ee218a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:05.139305 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9258880e-d4d4-4b55-90cd-6f5545ee218a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:05.141713 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9258880e-d4d4-4b55-90cd-6f5545ee218a None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:05.154303 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-9258880e-d4d4-4b55-90cd-6f5545ee218a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 14 20:51:05.154303 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:51:05.154303 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 14 20:51:05.154303 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 14 20:51:05.154303 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 14 20:51:05.154303 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 14 20:51:05.154303 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 14 20:51:05.154303 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 20:51:05.154303 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 14 20:51:05.154303 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:51:05.154303 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 20:51:05.154303 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:51:05.154303 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:51:05.154303 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:51:05.154303 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:51:05.154303 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:51:05.154303 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:51:05.155357 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:51:05.155357 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:51:05.155357 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:51:05.155357 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:51:05.155357 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:51:05.155357 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:51:05.155357 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 14 20:51:05.155357 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_service(service_id) May 14 20:51:05.155357 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 14 20:51:05.155357 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 14 20:51:05.155357 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:51:05.155357 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:51:05.155357 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:51:05.155357 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:51:05.155357 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:51:05.155357 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:51:05.156234 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:51:05.156234 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:51:05.156234 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:51:05.156234 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:51:05.156234 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:51:05.156234 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:51:05.156234 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:51:05.156234 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:51:05.156234 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:51:05.156234 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:51:05.156234 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 14 20:51:05.156234 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 20:51:05.156234 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 14 20:51:05.156234 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:51:05.161415 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 475/943] 10.222.0.52 () {56 vars in 1126 bytes} [Sat May 14 20:51:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 20:51:05.161913 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caded0e-48f5-4f3b-a79d-616f9bb1d90c None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:05.162293 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9258880e-d4d4-4b55-90cd-6f5545ee218a None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:05.196961 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88619faa-0caf-4525-bcac-af8c0478e0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:05.197960 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88619faa-0caf-4525-bcac-af8c0478e0aa None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:05.198418 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88619faa-0caf-4525-bcac-af8c0478e0aa None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:05.198877 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88619faa-0caf-4525-bcac-af8c0478e0aa None admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:05.199795 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88619faa-0caf-4525-bcac-af8c0478e0aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:51:05.200275 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88619faa-0caf-4525-bcac-af8c0478e0aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:05.201867 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88619faa-0caf-4525-bcac-af8c0478e0aa None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:05.214275 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 469/944] 10.222.0.52 () {56 vars in 1109 bytes} [Sat May 14 20:51:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:51:05.219808 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88619faa-0caf-4525-bcac-af8c0478e0aa None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:05.268240 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9258880e-d4d4-4b55-90cd-6f5545ee218a None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:05.307308 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a1e1f-030d-4971-8a92-5908eef8a235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:05.308475 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a1e1f-030d-4971-8a92-5908eef8a235 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:05.309273 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a1e1f-030d-4971-8a92-5908eef8a235 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:05.309991 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a1e1f-030d-4971-8a92-5908eef8a235 None admin] PATH_INFO: `/v3/services` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:05.310870 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94a1e1f-030d-4971-8a92-5908eef8a235 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:51:05.311501 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94a1e1f-030d-4971-8a92-5908eef8a235 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:05.314018 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94a1e1f-030d-4971-8a92-5908eef8a235 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:05.320958 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 476/945] 10.222.0.52 () {56 vars in 1122 bytes} [Sat May 14 20:51:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:51:05.326034 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a1e1f-030d-4971-8a92-5908eef8a235 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:05.332571 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88619faa-0caf-4525-bcac-af8c0478e0aa None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:05.372032 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84435a52-b361-46e9-bf49-ac478e166d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:05.372877 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84435a52-b361-46e9-bf49-ac478e166d11 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:05.373156 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84435a52-b361-46e9-bf49-ac478e166d11 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:05.373473 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84435a52-b361-46e9-bf49-ac478e166d11 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:05.384132 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84435a52-b361-46e9-bf49-ac478e166d11 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:05.385586 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84435a52-b361-46e9-bf49-ac478e166d11 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:05.401633 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-84435a52-b361-46e9-bf49-ac478e166d11 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 14 20:51:05.401633 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:51:05.401633 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:51:05.401633 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:51:05.401633 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:51:05.401633 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:51:05.401633 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:51:05.401633 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:51:05.401633 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:51:05.401633 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:51:05.401633 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:51:05.401633 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:51:05.401633 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 14 20:51:05.401633 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_project(project_id) May 14 20:51:05.401633 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 14 20:51:05.402552 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 14 20:51:05.402552 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:51:05.402552 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:51:05.402552 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:51:05.402552 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:51:05.402552 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:51:05.402552 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:51:05.402552 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:51:05.402552 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:51:05.402552 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:51:05.402552 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:51:05.402552 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:51:05.402552 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:51:05.402552 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:51:05.402552 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:51:05.402552 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:51:05.402552 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:51:05.403564 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 14 20:51:05.403564 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 14 20:51:05.403564 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 20:51:05.403564 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 20:51:05.403564 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 20:51:05.403564 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 20:51:05.403564 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 14 20:51:05.403564 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:51:05.407605 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 470/946] 10.222.0.52 () {56 vars in 1111 bytes} [Sat May 14 20:51:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 20:51:05.408457 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84435a52-b361-46e9-bf49-ac478e166d11 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:05.452200 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a1e1f-030d-4971-8a92-5908eef8a235 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:05.494959 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fdd2fd-572d-4eec-8ff5-d2a1c0b66862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:05.496533 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fdd2fd-572d-4eec-8ff5-d2a1c0b66862 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:05.497042 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fdd2fd-572d-4eec-8ff5-d2a1c0b66862 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:05.497639 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fdd2fd-572d-4eec-8ff5-d2a1c0b66862 None admin] PATH_INFO: `/v3/services` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:05.498844 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fdd2fd-572d-4eec-8ff5-d2a1c0b66862 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:51:05.499351 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fdd2fd-572d-4eec-8ff5-d2a1c0b66862 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:05.502044 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fdd2fd-572d-4eec-8ff5-d2a1c0b66862 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:05.509452 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 477/947] 10.222.0.52 () {56 vars in 1122 bytes} [Sat May 14 20:51:05 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:51:05.515229 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84435a52-b361-46e9-bf49-ac478e166d11 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:05.515355 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fdd2fd-572d-4eec-8ff5-d2a1c0b66862 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:05.558691 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad0b327-b388-452e-94a7-c6201775ca52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:05.560027 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad0b327-b388-452e-94a7-c6201775ca52 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:05.560555 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad0b327-b388-452e-94a7-c6201775ca52 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:05.561187 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad0b327-b388-452e-94a7-c6201775ca52 None admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:05.562570 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad0b327-b388-452e-94a7-c6201775ca52 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:51:05.563402 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad0b327-b388-452e-94a7-c6201775ca52 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:05.565579 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad0b327-b388-452e-94a7-c6201775ca52 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:05.583895 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 471/948] 10.222.0.52 () {56 vars in 1148 bytes} [Sat May 14 20:51:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:51:05.585998 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad0b327-b388-452e-94a7-c6201775ca52 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:05.629287 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fdd2fd-572d-4eec-8ff5-d2a1c0b66862 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:05.670773 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e85cb5-4f20-4f71-87e2-fb630a43c70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:05.671344 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e85cb5-4f20-4f71-87e2-fb630a43c70d None admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:05.671669 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e85cb5-4f20-4f71-87e2-fb630a43c70d None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:05.671950 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e85cb5-4f20-4f71-87e2-fb630a43c70d None admin] PATH_INFO: `/v3/endpoints` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:05.672824 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e85cb5-4f20-4f71-87e2-fb630a43c70d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:05.674294 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e85cb5-4f20-4f71-87e2-fb630a43c70d None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:05.702145 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad0b327-b388-452e-94a7-c6201775ca52 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:05.738050 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d533e56-8ba9-4a9a-ab2b-20426b2b5c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:05.738939 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d533e56-8ba9-4a9a-ab2b-20426b2b5c7a None admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:05.739217 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d533e56-8ba9-4a9a-ab2b-20426b2b5c7a None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:05.739511 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d533e56-8ba9-4a9a-ab2b-20426b2b5c7a None admin] PATH_INFO: `/v3/projects/0911a024287e430ea6ee015389f0c440/users/c31cffc526be4f8992c57ca5e4e2a0f9/roles/b842db64da3a4644945d0a941a9a9285` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:05.741715 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d533e56-8ba9-4a9a-ab2b-20426b2b5c7a None admin] RBAC: Authorizing `identity:create_grant(project_id=0911a024287e430ea6ee015389f0c440, user_id=c31cffc526be4f8992c57ca5e4e2a0f9, role_id=b842db64da3a4644945d0a941a9a9285)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:05.743173 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d533e56-8ba9-4a9a-ab2b-20426b2b5c7a None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:05.760098 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 478/949] 10.222.0.52 () {60 vars in 1144 bytes} [Sat May 14 20:51:05 2022] POST /identity/v3/endpoints => generated 349 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 20:51:05.822689 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 472/950] 10.222.0.52 () {58 vars in 1439 bytes} [Sat May 14 20:51:05 2022] PUT /identity/v3/projects/0911a024287e430ea6ee015389f0c440/users/c31cffc526be4f8992c57ca5e4e2a0f9/roles/b842db64da3a4644945d0a941a9a9285 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 20:51:06.014008 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4a68a-779a-4012-aecc-5e636169a1cf None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:06.014332 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4a68a-779a-4012-aecc-5e636169a1cf None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:06.014564 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4a68a-779a-4012-aecc-5e636169a1cf None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:06.016782 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 479/951] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:51:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:51:06.022275 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44316873-5bb6-4b07-8421-3648568ecee1 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:06.022839 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44316873-5bb6-4b07-8421-3648568ecee1 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:06.023355 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44316873-5bb6-4b07-8421-3648568ecee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:06.041458 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-44316873-5bb6-4b07-8421-3648568ecee1 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:51:06.042863 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-44316873-5bb6-4b07-8421-3648568ecee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:51:06.126339 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 473/952] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:51:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 20:51:06.151784 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d4a68a-779a-4012-aecc-5e636169a1cf None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:06.259299 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d4a68a-779a-4012-aecc-5e636169a1cf None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:06.293524 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3331d7-308a-4e33-a751-8371268647b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:06.294187 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3331d7-308a-4e33-a751-8371268647b2 None admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:06.294473 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3331d7-308a-4e33-a751-8371268647b2 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:06.294755 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3331d7-308a-4e33-a751-8371268647b2 None admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:06.295471 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3331d7-308a-4e33-a751-8371268647b2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:06.296924 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3331d7-308a-4e33-a751-8371268647b2 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:06.298832 ncdv-master-1 devstack@keystone.service[91106]: WARNING keystone.server.flask.common [None req-ef3331d7-308a-4e33-a751-8371268647b2 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 14 20:51:06.313299 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4f39f-c846-4e88-8883-b0731ab7dd45 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:06.313928 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4f39f-c846-4e88-8883-b0731ab7dd45 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:06.314565 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4f39f-c846-4e88-8883-b0731ab7dd45 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:06.316578 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 474/953] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:51:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 14 20:51:06.321826 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd9d72-ff22-44ba-b4e4-e89b92a13bd0 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:06.322356 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd9d72-ff22-44ba-b4e4-e89b92a13bd0 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:06.322835 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd9d72-ff22-44ba-b4e4-e89b92a13bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:06.340371 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-38dd9d72-ff22-44ba-b4e4-e89b92a13bd0 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:51:06.341794 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-38dd9d72-ff22-44ba-b4e4-e89b92a13bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:51:06.347595 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.sql.core [None req-ef3331d7-308a-4e33-a751-8371268647b2 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 14 20:51:06.347595 ncdv-master-1 devstack@keystone.service[91106]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 14 20:51:06.347595 ncdv-master-1 devstack@keystone.service[91106]: [parameters: {'id': '3dd4f1572ea443d6a66f46b8128cedc3', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 14 20:51:06.347595 ncdv-master-1 devstack@keystone.service[91106]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91106) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 14 20:51:06.364680 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-ef3331d7-308a-4e33-a751-8371268647b2 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3dd4f1572ea443d6a66f46b8128cedc3.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3dd4f1572ea443d6a66f46b8128cedc3. May 14 20:51:06.364680 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:51:06.364680 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 14 20:51:06.364680 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application self.dialect.do_execute( May 14 20:51:06.364680 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 14 20:51:06.364680 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 14 20:51:06.364680 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 14 20:51:06.364680 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application result = self._query(query) May 14 20:51:06.364680 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 14 20:51:06.364680 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application conn.query(q) May 14 20:51:06.364680 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 14 20:51:06.364680 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 14 20:51:06.364680 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 14 20:51:06.365583 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application result.read() May 14 20:51:06.365583 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 14 20:51:06.365583 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 14 20:51:06.365583 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 14 20:51:06.365583 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application packet.raise_for_error() May 14 20:51:06.365583 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 14 20:51:06.365583 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 14 20:51:06.365583 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 14 20:51:06.365583 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 14 20:51:06.365583 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 14 20:51:06.365583 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:51:06.365583 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 14 20:51:06.365583 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:51:06.365583 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:51:06.365583 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 14 20:51:06.365583 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 14 20:51:06.365583 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 14 20:51:06.365583 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return project_ref.to_dict() May 14 20:51:06.366567 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 14 20:51:06.366567 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application next(self.gen) May 14 20:51:06.366567 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 14 20:51:06.366567 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application yield resource May 14 20:51:06.366567 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 14 20:51:06.366567 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application next(self.gen) May 14 20:51:06.366567 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 14 20:51:06.366567 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application self.session.rollback() May 14 20:51:06.366567 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 14 20:51:06.366567 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application self.force_reraise() May 14 20:51:06.366567 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 14 20:51:06.366567 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise self.value May 14 20:51:06.366567 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 14 20:51:06.366567 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 14 20:51:06.366567 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 14 20:51:06.366567 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application session.commit() May 14 20:51:06.366567 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 14 20:51:06.372993 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 14 20:51:06.372993 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 14 20:51:06.372993 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application self._prepare_impl() May 14 20:51:06.372993 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 14 20:51:06.372993 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application self.session.flush() May 14 20:51:06.372993 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 14 20:51:06.372993 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application self._flush(objects) May 14 20:51:06.372993 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 14 20:51:06.372993 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 14 20:51:06.372993 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 14 20:51:06.372993 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application compat.raise_( May 14 20:51:06.372993 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 14 20:51:06.372993 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception May 14 20:51:06.372993 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 14 20:51:06.372993 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application flush_context.execute() May 14 20:51:06.372993 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 14 20:51:06.372993 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rec.execute(self) May 14 20:51:06.374590 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 14 20:51:06.374590 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 14 20:51:06.374590 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 14 20:51:06.374590 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application _emit_insert_statements( May 14 20:51:06.374590 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 14 20:51:06.374590 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application c = connection._execute_20( May 14 20:51:06.374590 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 14 20:51:06.374590 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 14 20:51:06.374590 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 14 20:51:06.374590 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 14 20:51:06.374590 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 14 20:51:06.374590 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ret = self._execute_context( May 14 20:51:06.374590 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 14 20:51:06.374590 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 14 20:51:06.374590 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 14 20:51:06.376537 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 14 20:51:06.376537 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 14 20:51:06.376537 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception May 14 20:51:06.376537 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 14 20:51:06.376537 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application self.dialect.do_execute( May 14 20:51:06.376537 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 14 20:51:06.376537 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 14 20:51:06.376537 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 14 20:51:06.376537 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application result = self._query(query) May 14 20:51:06.376537 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 14 20:51:06.376537 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application conn.query(q) May 14 20:51:06.376537 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 14 20:51:06.376537 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 14 20:51:06.376537 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 14 20:51:06.376537 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application result.read() May 14 20:51:06.376537 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 14 20:51:06.376537 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 14 20:51:06.377848 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 14 20:51:06.377848 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application packet.raise_for_error() May 14 20:51:06.377848 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 14 20:51:06.377848 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 14 20:51:06.377848 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 14 20:51:06.377848 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 14 20:51:06.377848 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 14 20:51:06.377848 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 14 20:51:06.377848 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [parameters: {'id': '3dd4f1572ea443d6a66f46b8128cedc3', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 14 20:51:06.377848 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 14 20:51:06.377848 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:51:06.377848 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 20:51:06.377848 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:51:06.377848 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:51:06.377848 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 14 20:51:06.382048 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 14 20:51:06.382048 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 14 20:51:06.382048 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 14 20:51:06.382048 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 14 20:51:06.382048 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:51:06.382048 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 20:51:06.382048 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:51:06.382048 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:51:06.382048 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:51:06.382048 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:51:06.382048 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:51:06.382048 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:51:06.382048 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:51:06.382048 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:51:06.382048 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:51:06.382048 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:51:06.382048 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:51:06.385176 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:51:06.385176 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 14 20:51:06.385176 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 14 20:51:06.385176 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:51:06.385176 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:51:06.385176 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 14 20:51:06.385176 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.Conflict( May 14 20:51:06.385176 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3dd4f1572ea443d6a66f46b8128cedc3. May 14 20:51:06.385176 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:51:06.385176 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 480/954] 10.222.0.52 () {60 vars in 1140 bytes} [Sat May 14 20:51:06 2022] POST /identity/v3/projects => generated 262 bytes in 215 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 14 20:51:06.385176 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3331d7-308a-4e33-a751-8371268647b2 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:06.435689 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 475/955] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:51:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 14 20:51:06.452891 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dd9d72-ff22-44ba-b4e4-e89b92a13bd0 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:06.516207 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3331d7-308a-4e33-a751-8371268647b2 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:06.557286 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c7ca1-813e-40de-a65f-b0847e8da6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:06.558038 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c7ca1-813e-40de-a65f-b0847e8da6a5 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:06.558321 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c7ca1-813e-40de-a65f-b0847e8da6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:06.558597 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c7ca1-813e-40de-a65f-b0847e8da6a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:06.566371 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1c7ca1-813e-40de-a65f-b0847e8da6a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:06.568062 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1c7ca1-813e-40de-a65f-b0847e8da6a5 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:06.570667 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dd9d72-ff22-44ba-b4e4-e89b92a13bd0 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:06.585719 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-ae1c7ca1-813e-40de-a65f-b0847e8da6a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 14 20:51:06.585719 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:51:06.585719 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:51:06.585719 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:51:06.585719 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:51:06.585719 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:51:06.585719 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:51:06.585719 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:51:06.585719 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:51:06.585719 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:51:06.585719 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:51:06.585719 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:51:06.585719 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 14 20:51:06.585719 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_project(project_id) May 14 20:51:06.585719 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 14 20:51:06.586677 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 14 20:51:06.586677 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:51:06.586677 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:51:06.586677 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:51:06.586677 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:51:06.586677 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:51:06.586677 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:51:06.586677 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:51:06.586677 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:51:06.586677 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:51:06.586677 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:51:06.586677 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:51:06.586677 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:51:06.586677 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:51:06.586677 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:51:06.586677 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:51:06.586677 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:51:06.588422 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 14 20:51:06.588422 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 14 20:51:06.588422 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 20:51:06.588422 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 20:51:06.588422 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 20:51:06.588422 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 20:51:06.588422 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 14 20:51:06.588422 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:51:06.588422 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 481/956] 10.222.0.52 () {56 vars in 1111 bytes} [Sat May 14 20:51:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 20:51:06.592893 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c7ca1-813e-40de-a65f-b0847e8da6a5 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:06.613110 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4515534c-16f8-4feb-9a3f-e4511e77a5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:06.613927 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515534c-16f8-4feb-9a3f-e4511e77a5dc None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:06.614410 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515534c-16f8-4feb-9a3f-e4511e77a5dc None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:06.614794 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515534c-16f8-4feb-9a3f-e4511e77a5dc None admin] PATH_INFO: `/v3/services/compute` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:06.615437 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4515534c-16f8-4feb-9a3f-e4511e77a5dc None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:06.616962 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4515534c-16f8-4feb-9a3f-e4511e77a5dc None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:06.629821 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-4515534c-16f8-4feb-9a3f-e4511e77a5dc None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 14 20:51:06.629821 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:51:06.629821 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 14 20:51:06.629821 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 14 20:51:06.629821 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 14 20:51:06.629821 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 14 20:51:06.629821 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 14 20:51:06.629821 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 20:51:06.629821 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 14 20:51:06.629821 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:51:06.629821 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 20:51:06.629821 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:51:06.629821 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:51:06.629821 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:51:06.629821 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:51:06.629821 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:51:06.629821 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:51:06.630873 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:51:06.630873 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:51:06.630873 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:51:06.630873 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:51:06.630873 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:51:06.630873 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:51:06.630873 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 14 20:51:06.630873 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_service(service_id) May 14 20:51:06.630873 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 14 20:51:06.630873 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 14 20:51:06.630873 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:51:06.630873 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:51:06.630873 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:51:06.630873 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:51:06.630873 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:51:06.630873 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:51:06.631760 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:51:06.631760 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:51:06.631760 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:51:06.631760 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:51:06.631760 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:51:06.631760 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:51:06.631760 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:51:06.631760 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:51:06.631760 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:51:06.631760 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:51:06.631760 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 14 20:51:06.631760 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 20:51:06.631760 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 14 20:51:06.631760 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:51:06.636064 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 476/957] 10.222.0.52 () {56 vars in 1111 bytes} [Sat May 14 20:51:06 2022] GET /identity/v3/services/compute => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:51:06.637425 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4515534c-16f8-4feb-9a3f-e4511e77a5dc None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:06.720338 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c7ca1-813e-40de-a65f-b0847e8da6a5 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:06.741961 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4515534c-16f8-4feb-9a3f-e4511e77a5dc None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:06.770995 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e25352-01f9-494a-af39-81bdeb94afc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:06.772539 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e25352-01f9-494a-af39-81bdeb94afc8 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:06.773007 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e25352-01f9-494a-af39-81bdeb94afc8 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:06.773479 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e25352-01f9-494a-af39-81bdeb94afc8 None admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:06.774830 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e25352-01f9-494a-af39-81bdeb94afc8 None admin] RBAC: Adding query filter params (name=service) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:51:06.775611 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e25352-01f9-494a-af39-81bdeb94afc8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:06.777221 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e25352-01f9-494a-af39-81bdeb94afc8 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:06.779374 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46661c39-b4dc-459c-b3ce-ad5c1c8370f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:06.780146 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46661c39-b4dc-459c-b3ce-ad5c1c8370f1 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:06.780505 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46661c39-b4dc-459c-b3ce-ad5c1c8370f1 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:06.780849 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46661c39-b4dc-459c-b3ce-ad5c1c8370f1 None admin] PATH_INFO: `/v3/services` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:06.781771 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46661c39-b4dc-459c-b3ce-ad5c1c8370f1 None admin] RBAC: Adding query filter params (name=compute) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:51:06.781771 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46661c39-b4dc-459c-b3ce-ad5c1c8370f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:06.784015 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46661c39-b4dc-459c-b3ce-ad5c1c8370f1 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:06.793523 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 477/958] 10.222.0.52 () {56 vars in 1112 bytes} [Sat May 14 20:51:06 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:51:06.794444 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46661c39-b4dc-459c-b3ce-ad5c1c8370f1 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:06.806039 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 482/959] 10.222.0.52 () {56 vars in 1112 bytes} [Sat May 14 20:51:06 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:51:06.916278 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46661c39-b4dc-459c-b3ce-ad5c1c8370f1 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:06.954833 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7bc93d-c498-4cd9-a41c-c9bbfb603bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:06.955598 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7bc93d-c498-4cd9-a41c-c9bbfb603bd0 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:06.955889 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7bc93d-c498-4cd9-a41c-c9bbfb603bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:06.956165 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7bc93d-c498-4cd9-a41c-c9bbfb603bd0 None admin] PATH_INFO: `/v3/services` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:06.956893 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7bc93d-c498-4cd9-a41c-c9bbfb603bd0 None admin] RBAC: Adding query filter params (type=compute) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:51:06.957201 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7bc93d-c498-4cd9-a41c-c9bbfb603bd0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:06.958595 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7bc93d-c498-4cd9-a41c-c9bbfb603bd0 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:06.964517 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 478/960] 10.222.0.52 () {56 vars in 1112 bytes} [Sat May 14 20:51:06 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:51:08.220836 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed3ebd-6dc8-4426-bc46-0dcc21ee9ccf None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:08.221339 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed3ebd-6dc8-4426-bc46-0dcc21ee9ccf None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:08.221339 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed3ebd-6dc8-4426-bc46-0dcc21ee9ccf None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:08.222905 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 483/961] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:51:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:51:08.228423 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6fe101-eb16-481a-83f0-339d0e2494cb None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:08.228836 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6fe101-eb16-481a-83f0-339d0e2494cb None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:08.229007 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6fe101-eb16-481a-83f0-339d0e2494cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:08.246752 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-0e6fe101-eb16-481a-83f0-339d0e2494cb None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:51:08.248293 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-0e6fe101-eb16-481a-83f0-339d0e2494cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:51:08.319964 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 479/962] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:51:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 20:51:08.321078 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306dd19b-0da1-4955-a43f-082b2880b329 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:08.321374 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306dd19b-0da1-4955-a43f-082b2880b329 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:08.321664 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306dd19b-0da1-4955-a43f-082b2880b329 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:08.323248 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 484/963] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:51:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 14 20:51:08.329194 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f2900-d395-47af-9807-a934eff767c0 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:08.329488 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f2900-d395-47af-9807-a934eff767c0 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:08.329772 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f2900-d395-47af-9807-a934eff767c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:08.345214 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306dd19b-0da1-4955-a43f-082b2880b329 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:08.347075 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-3d8f2900-d395-47af-9807-a934eff767c0 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:51:08.348289 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-3d8f2900-d395-47af-9807-a934eff767c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:51:08.417704 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 480/964] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:51:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 20:51:08.441706 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8f2900-d395-47af-9807-a934eff767c0 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:08.448729 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306dd19b-0da1-4955-a43f-082b2880b329 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:08.482666 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a317b3-6d34-4ff5-80d4-19af65bed68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:08.483097 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a317b3-6d34-4ff5-80d4-19af65bed68e None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:08.483373 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a317b3-6d34-4ff5-80d4-19af65bed68e None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:08.483684 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a317b3-6d34-4ff5-80d4-19af65bed68e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:08.496748 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a317b3-6d34-4ff5-80d4-19af65bed68e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:51:08.505329 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-94a317b3-6d34-4ff5-80d4-19af65bed68e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 14 20:51:08.505329 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:51:08.505329 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:51:08.505329 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:51:08.505329 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:51:08.505329 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:51:08.505329 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:51:08.505329 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:51:08.505329 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:51:08.505329 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:51:08.505329 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:51:08.505329 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:51:08.505329 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:51:08.505329 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:51:08.505329 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:51:08.505329 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:51:08.506261 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:51:08.506261 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:51:08.506261 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:51:08.506261 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:51:08.506261 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:51:08.506261 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:51:08.506261 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:51:08.506261 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:51:08.506261 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:51:08.506261 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:51:08.506261 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:51:08.506261 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:51:08.506261 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:51:08.506261 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:51:08.506261 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:51:08.506261 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:51:08.507156 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:51:08.507156 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:51:08.507156 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:51:08.507156 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:51:08.507156 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:51:08.507156 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:51:08.507156 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:51:08.507156 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:51:08.507156 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:51:08.507156 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:51:08.507156 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 14 20:51:08.507156 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:51:08.511447 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 485/965] 10.222.0.52 () {56 vars in 1120 bytes} [Sat May 14 20:51:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:51:08.512628 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a317b3-6d34-4ff5-80d4-19af65bed68e None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:08.570034 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8f2900-d395-47af-9807-a934eff767c0 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:08.612387 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a317b3-6d34-4ff5-80d4-19af65bed68e None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:08.614277 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1848f14e-ed9a-42e5-99bf-7b324189fb14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:08.616225 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1848f14e-ed9a-42e5-99bf-7b324189fb14 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:08.616717 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1848f14e-ed9a-42e5-99bf-7b324189fb14 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:08.617193 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1848f14e-ed9a-42e5-99bf-7b324189fb14 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:08.618061 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1848f14e-ed9a-42e5-99bf-7b324189fb14 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:08.620114 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1848f14e-ed9a-42e5-99bf-7b324189fb14 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:08.635455 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-1848f14e-ed9a-42e5-99bf-7b324189fb14 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 14 20:51:08.635455 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:51:08.635455 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 14 20:51:08.635455 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 14 20:51:08.635455 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 14 20:51:08.635455 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 14 20:51:08.635455 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 14 20:51:08.635455 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 20:51:08.635455 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 14 20:51:08.635455 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:51:08.635455 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 20:51:08.635455 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:51:08.635455 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:51:08.635455 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:51:08.635455 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:51:08.635455 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:51:08.635455 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:51:08.636533 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:51:08.636533 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:51:08.636533 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:51:08.636533 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:51:08.636533 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:51:08.636533 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:51:08.636533 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 14 20:51:08.636533 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_service(service_id) May 14 20:51:08.636533 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 14 20:51:08.636533 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 14 20:51:08.636533 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:51:08.636533 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:51:08.636533 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:51:08.636533 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:51:08.636533 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:51:08.636533 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:51:08.637366 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:51:08.637366 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:51:08.637366 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:51:08.637366 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:51:08.637366 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:51:08.637366 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:51:08.637366 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:51:08.637366 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:51:08.637366 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:51:08.637366 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:51:08.637366 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 14 20:51:08.637366 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 20:51:08.637366 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 14 20:51:08.637366 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:51:08.637366 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 481/966] 10.222.0.52 () {56 vars in 1126 bytes} [Sat May 14 20:51:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 20:51:08.642761 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1848f14e-ed9a-42e5-99bf-7b324189fb14 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:08.656474 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4f0823-3ba2-4580-887c-30e0ddff8f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:08.658011 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f0823-3ba2-4580-887c-30e0ddff8f35 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:08.658465 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f0823-3ba2-4580-887c-30e0ddff8f35 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:08.659068 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f0823-3ba2-4580-887c-30e0ddff8f35 None admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:08.660367 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4f0823-3ba2-4580-887c-30e0ddff8f35 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:51:08.660848 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4f0823-3ba2-4580-887c-30e0ddff8f35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:08.662766 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4f0823-3ba2-4580-887c-30e0ddff8f35 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:08.674463 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 486/967] 10.222.0.52 () {56 vars in 1115 bytes} [Sat May 14 20:51:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:51:08.682049 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4f0823-3ba2-4580-887c-30e0ddff8f35 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:08.751045 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1848f14e-ed9a-42e5-99bf-7b324189fb14 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:08.780845 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4f0823-3ba2-4580-887c-30e0ddff8f35 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:08.794266 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d38bb6-53d8-4aac-9472-3ac940b45cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:08.795025 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d38bb6-53d8-4aac-9472-3ac940b45cac None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:08.795405 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d38bb6-53d8-4aac-9472-3ac940b45cac None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:08.795789 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d38bb6-53d8-4aac-9472-3ac940b45cac None admin] PATH_INFO: `/v3/services` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:08.796575 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d38bb6-53d8-4aac-9472-3ac940b45cac None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:51:08.796988 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d38bb6-53d8-4aac-9472-3ac940b45cac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:08.798620 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d38bb6-53d8-4aac-9472-3ac940b45cac None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:08.808661 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 482/968] 10.222.0.52 () {56 vars in 1122 bytes} [Sat May 14 20:51:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:51:08.809704 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d38bb6-53d8-4aac-9472-3ac940b45cac None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:08.817256 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410fd657-2fb5-4c9e-bacc-7c6f7c9e9303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:08.818047 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410fd657-2fb5-4c9e-bacc-7c6f7c9e9303 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:08.818324 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410fd657-2fb5-4c9e-bacc-7c6f7c9e9303 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:08.818597 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410fd657-2fb5-4c9e-bacc-7c6f7c9e9303 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:08.829898 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410fd657-2fb5-4c9e-bacc-7c6f7c9e9303 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:08.831336 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410fd657-2fb5-4c9e-bacc-7c6f7c9e9303 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:08.849278 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-410fd657-2fb5-4c9e-bacc-7c6f7c9e9303 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:51:08.849278 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:51:08.849278 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:51:08.849278 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:51:08.849278 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:51:08.849278 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:51:08.849278 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:51:08.849278 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:51:08.849278 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:51:08.849278 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:51:08.849278 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:51:08.849278 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:51:08.849278 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:51:08.849278 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:51:08.849278 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:51:08.850222 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:51:08.850222 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:51:08.850222 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:51:08.850222 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:51:08.850222 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:51:08.850222 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:51:08.850222 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:51:08.850222 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:51:08.850222 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:51:08.850222 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:51:08.850222 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:51:08.850222 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:51:08.850222 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:51:08.850222 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:51:08.850222 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:51:08.850222 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:51:08.850222 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:51:08.851156 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 20:51:08.851156 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:51:08.851156 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:51:08.851156 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:51:08.855271 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 487/969] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:51:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 20:51:08.856423 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410fd657-2fb5-4c9e-bacc-7c6f7c9e9303 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:08.929543 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d38bb6-53d8-4aac-9472-3ac940b45cac None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:08.957831 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410fd657-2fb5-4c9e-bacc-7c6f7c9e9303 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:08.965488 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7955a69-4ac6-487e-a0d9-71080e6631b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:08.966350 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7955a69-4ac6-487e-a0d9-71080e6631b8 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:08.966786 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7955a69-4ac6-487e-a0d9-71080e6631b8 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:08.967240 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7955a69-4ac6-487e-a0d9-71080e6631b8 None admin] PATH_INFO: `/v3/services` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:08.968129 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7955a69-4ac6-487e-a0d9-71080e6631b8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:51:08.968587 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7955a69-4ac6-487e-a0d9-71080e6631b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:08.970655 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7955a69-4ac6-487e-a0d9-71080e6631b8 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:08.980748 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 483/970] 10.222.0.52 () {56 vars in 1122 bytes} [Sat May 14 20:51:08 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:51:08.982149 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7955a69-4ac6-487e-a0d9-71080e6631b8 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:08.993119 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea293656-0d77-4af1-b80f-1e69745b45f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:08.993785 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea293656-0d77-4af1-b80f-1e69745b45f2 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:08.994411 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea293656-0d77-4af1-b80f-1e69745b45f2 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:08.994411 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea293656-0d77-4af1-b80f-1e69745b45f2 None admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:08.995086 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea293656-0d77-4af1-b80f-1e69745b45f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:51:08.995440 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea293656-0d77-4af1-b80f-1e69745b45f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:08.997105 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea293656-0d77-4af1-b80f-1e69745b45f2 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:09.015287 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 488/971] 10.222.0.52 () {56 vars in 1109 bytes} [Sat May 14 20:51:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:51:09.017293 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea293656-0d77-4af1-b80f-1e69745b45f2 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:09.088670 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7955a69-4ac6-487e-a0d9-71080e6631b8 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:09.123826 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea293656-0d77-4af1-b80f-1e69745b45f2 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:09.136334 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a18634d-9ba1-4352-a8e8-1e3b8c1d4529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:09.137020 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18634d-9ba1-4352-a8e8-1e3b8c1d4529 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:09.137364 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18634d-9ba1-4352-a8e8-1e3b8c1d4529 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:09.138036 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18634d-9ba1-4352-a8e8-1e3b8c1d4529 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:09.139223 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a18634d-9ba1-4352-a8e8-1e3b8c1d4529 None admin] RBAC: Adding query filter params (interface=admin, service_id=9e954f3af51a44068ea7d1a546c6453b, region_id=RegionOne) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:51:09.139578 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a18634d-9ba1-4352-a8e8-1e3b8c1d4529 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:09.141185 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a18634d-9ba1-4352-a8e8-1e3b8c1d4529 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:09.148331 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 484/972] 10.222.0.52 () {56 vars in 1249 bytes} [Sat May 14 20:51:08 2022] GET /identity/v3/endpoints?service_id=9e954f3af51a44068ea7d1a546c6453b&interface=admin®ion_id=RegionOne => generated 193 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:51:09.157217 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a18634d-9ba1-4352-a8e8-1e3b8c1d4529 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:09.173021 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7692b9de-ac30-4708-9299-bfb5959b3332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:09.174634 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692b9de-ac30-4708-9299-bfb5959b3332 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:09.175125 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692b9de-ac30-4708-9299-bfb5959b3332 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:09.175877 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692b9de-ac30-4708-9299-bfb5959b3332 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:09.186157 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7692b9de-ac30-4708-9299-bfb5959b3332 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:09.189520 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7692b9de-ac30-4708-9299-bfb5959b3332 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:09.209849 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-7692b9de-ac30-4708-9299-bfb5959b3332 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 14 20:51:09.209849 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:51:09.209849 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:51:09.209849 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:51:09.209849 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:51:09.209849 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:51:09.209849 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:51:09.209849 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:51:09.209849 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:51:09.209849 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:51:09.209849 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:51:09.209849 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:51:09.209849 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 14 20:51:09.209849 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_user(user_id) May 14 20:51:09.209849 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 14 20:51:09.209849 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 14 20:51:09.211139 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:51:09.211139 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:51:09.211139 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 20:51:09.211139 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 20:51:09.211139 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 14 20:51:09.211139 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 20:51:09.211139 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:51:09.211139 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:51:09.211139 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:51:09.211139 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:51:09.211139 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:51:09.211139 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:51:09.211139 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:51:09.211139 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:51:09.211139 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:51:09.211139 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:51:09.211139 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:51:09.211139 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:51:09.212429 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:51:09.212429 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:51:09.212429 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 14 20:51:09.212429 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 14 20:51:09.212429 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 14 20:51:09.212429 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 14 20:51:09.212429 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 14 20:51:09.212429 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 14 20:51:09.212429 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 14 20:51:09.212429 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:51:09.215270 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 489/973] 10.222.0.52 () {56 vars in 1117 bytes} [Sat May 14 20:51:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 20:51:09.222390 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7692b9de-ac30-4708-9299-bfb5959b3332 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:09.280949 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a18634d-9ba1-4352-a8e8-1e3b8c1d4529 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:09.321490 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da436419-2833-4326-855d-65266eb037a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:09.322459 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da436419-2833-4326-855d-65266eb037a0 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:09.322735 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da436419-2833-4326-855d-65266eb037a0 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:09.323005 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da436419-2833-4326-855d-65266eb037a0 None admin] PATH_INFO: `/v3/services` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:09.323728 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da436419-2833-4326-855d-65266eb037a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:09.325087 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da436419-2833-4326-855d-65266eb037a0 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:09.331085 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 485/974] 10.222.0.52 () {56 vars in 1087 bytes} [Sat May 14 20:51:09 2022] GET /identity/v3/services => generated 1497 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 20:51:09.333511 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6fc0f1-297b-4a2f-bd70-c676dc01e578 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:09.333785 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6fc0f1-297b-4a2f-bd70-c676dc01e578 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:09.334068 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6fc0f1-297b-4a2f-bd70-c676dc01e578 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:09.335408 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 486/975] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:51:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:51:09.338947 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6defa741-d3b1-4193-8000-4a7dd2161fd2 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:09.338947 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6defa741-d3b1-4193-8000-4a7dd2161fd2 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:09.338947 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6defa741-d3b1-4193-8000-4a7dd2161fd2 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:09.338947 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 487/976] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:51:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:51:09.341493 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55369c-0cbd-451e-97c9-07f376b650d8 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:09.341770 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55369c-0cbd-451e-97c9-07f376b650d8 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:09.342048 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55369c-0cbd-451e-97c9-07f376b650d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:09.345695 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7692b9de-ac30-4708-9299-bfb5959b3332 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:09.361652 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-6b55369c-0cbd-451e-97c9-07f376b650d8 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:51:09.363025 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-6b55369c-0cbd-451e-97c9-07f376b650d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:51:09.386122 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26abf9-2698-4353-a647-c129da4d632d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:09.387335 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26abf9-2698-4353-a647-c129da4d632d None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:09.387679 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26abf9-2698-4353-a647-c129da4d632d None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:09.388215 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26abf9-2698-4353-a647-c129da4d632d None admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:09.389067 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c26abf9-2698-4353-a647-c129da4d632d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:51:09.389490 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c26abf9-2698-4353-a647-c129da4d632d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:09.391048 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c26abf9-2698-4353-a647-c129da4d632d None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:09.417742 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 490/977] 10.222.0.52 () {56 vars in 1149 bytes} [Sat May 14 20:51:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:51:09.417742 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c2521-b13f-47dc-bb37-bca791d61cdd None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:09.417742 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c2521-b13f-47dc-bb37-bca791d61cdd None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:09.417742 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c2521-b13f-47dc-bb37-bca791d61cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:09.433961 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-bb4c2521-b13f-47dc-bb37-bca791d61cdd None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:51:09.435602 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-bb4c2521-b13f-47dc-bb37-bca791d61cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:51:09.455519 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 488/978] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:51:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 14 20:51:09.455519 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b55369c-0cbd-451e-97c9-07f376b650d8 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:09.526599 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 491/979] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:51:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 20:51:09.527742 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4c2521-b13f-47dc-bb37-bca791d61cdd None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:09.567399 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b55369c-0cbd-451e-97c9-07f376b650d8 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:09.610025 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3caada-3feb-4159-bb4f-55ff3d823c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:09.611539 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3caada-3feb-4159-bb4f-55ff3d823c1e None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:09.611859 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3caada-3feb-4159-bb4f-55ff3d823c1e None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:09.612145 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3caada-3feb-4159-bb4f-55ff3d823c1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:09.634987 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4c2521-b13f-47dc-bb37-bca791d61cdd None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:09.669649 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84de3e5b-1a21-4317-b187-01f710b229a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:09.670310 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de3e5b-1a21-4317-b187-01f710b229a2 None admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:09.670591 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de3e5b-1a21-4317-b187-01f710b229a2 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:09.670864 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de3e5b-1a21-4317-b187-01f710b229a2 None admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:09.671577 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84de3e5b-1a21-4317-b187-01f710b229a2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:09.673651 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84de3e5b-1a21-4317-b187-01f710b229a2 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:09.679273 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3caada-3feb-4159-bb4f-55ff3d823c1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:09.680761 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3caada-3feb-4159-bb4f-55ff3d823c1e None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:09.724656 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.sql.core [None req-84de3e5b-1a21-4317-b187-01f710b229a2 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 14 20:51:09.724656 ncdv-master-1 devstack@keystone.service[91106]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 14 20:51:09.724656 ncdv-master-1 devstack@keystone.service[91106]: [parameters: {'user_id': '2b321801c63b4600824d5e6f6219da8f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 14 20:51:09.724656 ncdv-master-1 devstack@keystone.service[91106]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91106) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 14 20:51:09.732012 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-84de3e5b-1a21-4317-b187-01f710b229a2 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 14 20:51:09.732012 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:51:09.732012 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 14 20:51:09.732012 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application self.dialect.do_execute( May 14 20:51:09.732012 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 14 20:51:09.732012 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 14 20:51:09.732012 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 14 20:51:09.732012 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application result = self._query(query) May 14 20:51:09.732012 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 14 20:51:09.732012 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application conn.query(q) May 14 20:51:09.732012 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 14 20:51:09.732012 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 14 20:51:09.732012 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 14 20:51:09.732012 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application result.read() May 14 20:51:09.732012 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 14 20:51:09.732954 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 14 20:51:09.732954 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 14 20:51:09.732954 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application packet.raise_for_error() May 14 20:51:09.732954 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 14 20:51:09.732954 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 14 20:51:09.732954 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 14 20:51:09.732954 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 14 20:51:09.732954 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 14 20:51:09.732954 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:51:09.732954 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 14 20:51:09.732954 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:51:09.732954 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:51:09.732954 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 14 20:51:09.732954 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 14 20:51:09.732954 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 14 20:51:09.732954 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 14 20:51:09.732954 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 14 20:51:09.732954 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application next(self.gen) May 14 20:51:09.733949 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 14 20:51:09.733949 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application yield resource May 14 20:51:09.733949 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 14 20:51:09.733949 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application next(self.gen) May 14 20:51:09.733949 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 14 20:51:09.733949 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application self.session.rollback() May 14 20:51:09.733949 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 14 20:51:09.733949 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application self.force_reraise() May 14 20:51:09.733949 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 14 20:51:09.733949 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise self.value May 14 20:51:09.733949 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 14 20:51:09.733949 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 14 20:51:09.733949 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 14 20:51:09.733949 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application session.commit() May 14 20:51:09.733949 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 14 20:51:09.733949 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 14 20:51:09.733949 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 14 20:51:09.735424 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application self._prepare_impl() May 14 20:51:09.735424 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 14 20:51:09.735424 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application self.session.flush() May 14 20:51:09.735424 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 14 20:51:09.735424 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application self._flush(objects) May 14 20:51:09.735424 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 14 20:51:09.735424 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 14 20:51:09.735424 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 14 20:51:09.735424 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application compat.raise_( May 14 20:51:09.735424 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 14 20:51:09.735424 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception May 14 20:51:09.735424 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 14 20:51:09.735424 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application flush_context.execute() May 14 20:51:09.735424 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 14 20:51:09.735424 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rec.execute(self) May 14 20:51:09.735424 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 14 20:51:09.735424 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 14 20:51:09.736430 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 14 20:51:09.736430 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application _emit_insert_statements( May 14 20:51:09.736430 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 14 20:51:09.736430 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application result = connection._execute_20( May 14 20:51:09.736430 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 14 20:51:09.736430 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 14 20:51:09.736430 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 14 20:51:09.736430 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 14 20:51:09.736430 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 14 20:51:09.736430 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ret = self._execute_context( May 14 20:51:09.736430 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 14 20:51:09.736430 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 14 20:51:09.736430 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 14 20:51:09.736430 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 14 20:51:09.736430 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 14 20:51:09.736430 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception May 14 20:51:09.737298 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 14 20:51:09.737298 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application self.dialect.do_execute( May 14 20:51:09.737298 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 14 20:51:09.737298 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 14 20:51:09.737298 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 14 20:51:09.737298 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application result = self._query(query) May 14 20:51:09.737298 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 14 20:51:09.737298 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application conn.query(q) May 14 20:51:09.737298 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 14 20:51:09.737298 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 14 20:51:09.737298 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 14 20:51:09.737298 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application result.read() May 14 20:51:09.737298 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 14 20:51:09.737298 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 14 20:51:09.737298 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 14 20:51:09.737298 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application packet.raise_for_error() May 14 20:51:09.741004 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 14 20:51:09.741004 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 14 20:51:09.741004 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 14 20:51:09.741004 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 14 20:51:09.741004 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 14 20:51:09.741004 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 14 20:51:09.741004 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [parameters: {'user_id': '2b321801c63b4600824d5e6f6219da8f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 14 20:51:09.741004 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 14 20:51:09.741004 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:51:09.741004 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 20:51:09.741004 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:51:09.741004 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:51:09.741004 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:51:09.741004 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:51:09.741004 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:51:09.743570 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:51:09.743570 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:51:09.743570 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:51:09.743570 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:51:09.743570 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:51:09.743570 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:51:09.743570 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:51:09.743570 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 14 20:51:09.743570 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 14 20:51:09.743570 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:51:09.743570 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:51:09.743570 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 20:51:09.743570 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 20:51:09.743570 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 14 20:51:09.743570 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 20:51:09.743570 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 14 20:51:09.743570 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 14 20:51:09.747325 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 14 20:51:09.747325 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 14 20:51:09.747325 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 14 20:51:09.747325 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 14 20:51:09.747325 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 14 20:51:09.747325 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:51:09.747325 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 492/980] 10.222.0.52 () {60 vars in 1131 bytes} [Sat May 14 20:51:09 2022] POST /identity/v3/users => generated 160 bytes in 206 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 14 20:51:09.747325 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84de3e5b-1a21-4317-b187-01f710b229a2 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:09.790108 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 489/981] 10.222.0.52 () {58 vars in 1282 bytes} [Sat May 14 20:51:09 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 14 20:51:09.791195 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3caada-3feb-4159-bb4f-55ff3d823c1e None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:09.846442 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84de3e5b-1a21-4317-b187-01f710b229a2 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:09.881630 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2410c0-c1d0-4f6f-ac47-74203f26b3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:09.882292 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2410c0-c1d0-4f6f-ac47-74203f26b3d7 None admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:09.882576 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2410c0-c1d0-4f6f-ac47-74203f26b3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:09.882849 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2410c0-c1d0-4f6f-ac47-74203f26b3d7 None admin] PATH_INFO: `/v3/services` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:09.883589 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2410c0-c1d0-4f6f-ac47-74203f26b3d7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:09.885152 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2410c0-c1d0-4f6f-ac47-74203f26b3d7 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:09.894892 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3caada-3feb-4159-bb4f-55ff3d823c1e None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:09.928809 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8929cbcd-c72a-42cf-8974-ad6e5b4d51e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:09.929604 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929cbcd-c72a-42cf-8974-ad6e5b4d51e2 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:09.929884 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929cbcd-c72a-42cf-8974-ad6e5b4d51e2 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:09.930159 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929cbcd-c72a-42cf-8974-ad6e5b4d51e2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:09.937675 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8929cbcd-c72a-42cf-8974-ad6e5b4d51e2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:09.939978 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8929cbcd-c72a-42cf-8974-ad6e5b4d51e2 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:09.955808 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 493/982] 10.222.0.52 () {60 vars in 1141 bytes} [Sat May 14 20:51:09 2022] POST /identity/v3/services => generated 242 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 20:51:09.955808 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2410c0-c1d0-4f6f-ac47-74203f26b3d7 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:09.968054 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-8929cbcd-c72a-42cf-8974-ad6e5b4d51e2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 14 20:51:09.968054 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:51:09.968054 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:51:09.968054 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:51:09.968054 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:51:09.968054 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:51:09.968054 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:51:09.968054 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:51:09.968054 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:51:09.968054 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:51:09.968054 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:51:09.968054 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:51:09.968054 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 14 20:51:09.968054 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_user(user_id) May 14 20:51:09.968054 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 14 20:51:09.968054 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 14 20:51:09.969252 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:51:09.969252 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:51:09.969252 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 20:51:09.969252 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 20:51:09.969252 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 14 20:51:09.969252 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 20:51:09.969252 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:51:09.969252 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:51:09.969252 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:51:09.969252 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:51:09.969252 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:51:09.969252 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:51:09.969252 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:51:09.969252 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:51:09.969252 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:51:09.969252 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:51:09.969252 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:51:09.969252 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:51:09.970204 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:51:09.970204 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:51:09.970204 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 14 20:51:09.970204 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 14 20:51:09.970204 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 14 20:51:09.970204 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 14 20:51:09.970204 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 14 20:51:09.970204 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 14 20:51:09.970204 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 14 20:51:09.970204 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:51:09.971111 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 490/983] 10.222.0.52 () {56 vars in 1099 bytes} [Sat May 14 20:51:09 2022] GET /identity/v3/users/cinder => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:51:09.978304 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8929cbcd-c72a-42cf-8974-ad6e5b4d51e2 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:10.082655 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2410c0-c1d0-4f6f-ac47-74203f26b3d7 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:10.118931 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8929cbcd-c72a-42cf-8974-ad6e5b4d51e2 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:10.132059 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4561c9-43e2-440c-a536-07e332815382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:10.132872 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4561c9-43e2-440c-a536-07e332815382 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:10.133152 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4561c9-43e2-440c-a536-07e332815382 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:10.133425 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4561c9-43e2-440c-a536-07e332815382 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:10.145983 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4561c9-43e2-440c-a536-07e332815382 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:10.147448 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4561c9-43e2-440c-a536-07e332815382 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:10.161412 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70106654-e5ff-4aab-8d73-ab05b5bf825f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:10.162083 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70106654-e5ff-4aab-8d73-ab05b5bf825f None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:10.162363 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70106654-e5ff-4aab-8d73-ab05b5bf825f None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:10.162637 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70106654-e5ff-4aab-8d73-ab05b5bf825f None admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:10.163435 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70106654-e5ff-4aab-8d73-ab05b5bf825f None admin] RBAC: Adding query filter params (name=cinder) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:51:10.163772 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70106654-e5ff-4aab-8d73-ab05b5bf825f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:10.165200 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70106654-e5ff-4aab-8d73-ab05b5bf825f None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:10.165564 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-9f4561c9-43e2-440c-a536-07e332815382 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:51:10.165564 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:51:10.165564 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:51:10.165564 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:51:10.165564 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:51:10.165564 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:51:10.165564 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:51:10.165564 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:51:10.165564 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:51:10.165564 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:51:10.165564 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:51:10.165564 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:51:10.165564 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:51:10.165564 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:51:10.165564 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:51:10.168058 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:51:10.168058 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:51:10.168058 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:51:10.168058 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:51:10.168058 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:51:10.168058 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:51:10.168058 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:51:10.168058 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:51:10.168058 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:51:10.168058 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:51:10.168058 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:51:10.168058 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:51:10.168058 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:51:10.168058 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:51:10.168058 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:51:10.168058 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:51:10.168058 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:51:10.170229 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 20:51:10.170229 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:51:10.170229 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:51:10.170229 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:51:10.170229 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 494/984] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:51:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:51:10.173396 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4561c9-43e2-440c-a536-07e332815382 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:10.206675 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 491/985] 10.222.0.52 () {56 vars in 1101 bytes} [Sat May 14 20:51:09 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:51:10.284545 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4561c9-43e2-440c-a536-07e332815382 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:10.322359 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb16893-0cbb-4b2e-826e-72e633d618c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:10.323096 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb16893-0cbb-4b2e-826e-72e633d618c7 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:10.323379 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb16893-0cbb-4b2e-826e-72e633d618c7 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:10.323689 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb16893-0cbb-4b2e-826e-72e633d618c7 None admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:10.324423 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb16893-0cbb-4b2e-826e-72e633d618c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:51:10.324732 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb16893-0cbb-4b2e-826e-72e633d618c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:10.326117 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb16893-0cbb-4b2e-826e-72e633d618c7 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:10.340356 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 495/986] 10.222.0.52 () {56 vars in 1109 bytes} [Sat May 14 20:51:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:51:10.346176 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70106654-e5ff-4aab-8d73-ab05b5bf825f None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:10.454035 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70106654-e5ff-4aab-8d73-ab05b5bf825f None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:10.489961 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c00e6-132e-48c4-a876-a5c67435a49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:10.490756 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c00e6-132e-48c4-a876-a5c67435a49f None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:10.491036 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c00e6-132e-48c4-a876-a5c67435a49f None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:10.491304 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c00e6-132e-48c4-a876-a5c67435a49f None admin] PATH_INFO: `/v3/projects/service` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:10.499199 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835c00e6-132e-48c4-a876-a5c67435a49f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:10.502068 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835c00e6-132e-48c4-a876-a5c67435a49f None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:10.517835 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-835c00e6-132e-48c4-a876-a5c67435a49f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 14 20:51:10.517835 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:51:10.517835 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:51:10.517835 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:51:10.517835 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:51:10.517835 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:51:10.517835 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:51:10.517835 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:51:10.517835 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:51:10.517835 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:51:10.517835 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:51:10.517835 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:51:10.517835 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 14 20:51:10.517835 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_project(project_id) May 14 20:51:10.517835 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 14 20:51:10.518909 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 14 20:51:10.518909 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:51:10.518909 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:51:10.518909 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:51:10.518909 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:51:10.518909 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:51:10.518909 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:51:10.518909 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:51:10.518909 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:51:10.518909 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:51:10.518909 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:51:10.518909 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:51:10.518909 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:51:10.518909 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:51:10.518909 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:51:10.518909 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:51:10.518909 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:51:10.519852 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 14 20:51:10.519852 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 14 20:51:10.519852 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 20:51:10.519852 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 20:51:10.519852 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 20:51:10.519852 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 20:51:10.519852 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 14 20:51:10.519852 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:51:10.519852 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 492/987] 10.222.0.52 () {56 vars in 1111 bytes} [Sat May 14 20:51:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:51:10.526579 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb16893-0cbb-4b2e-826e-72e633d618c7 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:10.628910 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb16893-0cbb-4b2e-826e-72e633d618c7 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:10.663609 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6912ce8f-a5b8-44a3-b5d5-324d0c3ee9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:10.664267 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912ce8f-a5b8-44a3-b5d5-324d0c3ee9c8 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:10.664545 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912ce8f-a5b8-44a3-b5d5-324d0c3ee9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:10.664815 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912ce8f-a5b8-44a3-b5d5-324d0c3ee9c8 None admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:10.665582 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6912ce8f-a5b8-44a3-b5d5-324d0c3ee9c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:51:10.665886 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6912ce8f-a5b8-44a3-b5d5-324d0c3ee9c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:10.667294 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6912ce8f-a5b8-44a3-b5d5-324d0c3ee9c8 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:10.680210 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 496/988] 10.222.0.52 () {56 vars in 1148 bytes} [Sat May 14 20:51:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:51:10.686239 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c00e6-132e-48c4-a876-a5c67435a49f None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:10.788881 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c00e6-132e-48c4-a876-a5c67435a49f None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:10.820860 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad114d19-bbad-44ea-9e68-7f2a9d234d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:10.821507 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad114d19-bbad-44ea-9e68-7f2a9d234d96 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:10.821785 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad114d19-bbad-44ea-9e68-7f2a9d234d96 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:10.822058 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad114d19-bbad-44ea-9e68-7f2a9d234d96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:10.822924 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad114d19-bbad-44ea-9e68-7f2a9d234d96 None admin] RBAC: Adding query filter params (role.id=b842db64da3a4644945d0a941a9a9285, scope.project.id=0911a024287e430ea6ee015389f0c440, user.id=c31cffc526be4f8992c57ca5e4e2a0f9) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:51:10.823234 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad114d19-bbad-44ea-9e68-7f2a9d234d96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:10.824690 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad114d19-bbad-44ea-9e68-7f2a9d234d96 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:10.832256 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 493/989] 10.222.0.52 () {56 vars in 1374 bytes} [Sat May 14 20:51:10 2022] GET /identity/v3/role_assignments?user.id=c31cffc526be4f8992c57ca5e4e2a0f9&scope.project.id=0911a024287e430ea6ee015389f0c440&role.id=b842db64da3a4644945d0a941a9a9285 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:51:11.692363 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c4b1a-010b-48e2-b49f-65333549001c None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:11.692894 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c4b1a-010b-48e2-b49f-65333549001c None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:11.692894 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c4b1a-010b-48e2-b49f-65333549001c None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:11.694430 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 497/990] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:51:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:51:11.699602 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a9309-a6e5-4534-b483-af17379e650f None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:11.700002 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a9309-a6e5-4534-b483-af17379e650f None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:11.700165 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a9309-a6e5-4534-b483-af17379e650f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:11.717218 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-4a1a9309-a6e5-4534-b483-af17379e650f None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:51:11.718507 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-4a1a9309-a6e5-4534-b483-af17379e650f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:51:11.790212 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 494/991] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:51:11 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 20:51:11.814132 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c4b1a-010b-48e2-b49f-65333549001c None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:11.914171 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c4b1a-010b-48e2-b49f-65333549001c None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:11.953634 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fb4b50-ff42-49ba-ad6c-ab9362e327ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:11.954362 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb4b50-ff42-49ba-ad6c-ab9362e327ef None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:11.954651 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb4b50-ff42-49ba-ad6c-ab9362e327ef None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:11.954926 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb4b50-ff42-49ba-ad6c-ab9362e327ef None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:11.955604 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fb4b50-ff42-49ba-ad6c-ab9362e327ef None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:11.956974 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fb4b50-ff42-49ba-ad6c-ab9362e327ef None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:11.970362 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-e3fb4b50-ff42-49ba-ad6c-ab9362e327ef None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 14 20:51:11.970362 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:51:11.970362 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 14 20:51:11.970362 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 14 20:51:11.970362 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 14 20:51:11.970362 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 14 20:51:11.970362 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 14 20:51:11.970362 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 20:51:11.970362 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 14 20:51:11.970362 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:51:11.970362 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 20:51:11.970362 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:51:11.970362 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:51:11.970362 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:51:11.970362 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:51:11.970362 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:51:11.970362 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:51:11.976469 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:51:11.976469 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:51:11.976469 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:51:11.976469 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:51:11.976469 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:51:11.976469 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:51:11.976469 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 14 20:51:11.976469 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_service(service_id) May 14 20:51:11.976469 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 14 20:51:11.976469 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 14 20:51:11.976469 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:51:11.976469 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:51:11.976469 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:51:11.976469 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:51:11.976469 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:51:11.976469 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:51:11.977377 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:51:11.977377 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:51:11.977377 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:51:11.977377 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:51:11.977377 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:51:11.977377 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:51:11.977377 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:51:11.977377 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:51:11.977377 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:51:11.977377 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:51:11.977377 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 14 20:51:11.977377 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 20:51:11.977377 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 14 20:51:11.977377 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:51:11.977377 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 498/992] 10.222.0.52 () {56 vars in 1126 bytes} [Sat May 14 20:51:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:51:11.978179 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a9309-a6e5-4534-b483-af17379e650f None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:12.073703 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a9309-a6e5-4534-b483-af17379e650f None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:12.107625 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4952474f-551d-486c-8685-5ecf8a9bbd9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:12.108322 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4952474f-551d-486c-8685-5ecf8a9bbd9d None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:12.108602 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4952474f-551d-486c-8685-5ecf8a9bbd9d None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:12.108874 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4952474f-551d-486c-8685-5ecf8a9bbd9d None admin] PATH_INFO: `/v3/services` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:12.109634 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4952474f-551d-486c-8685-5ecf8a9bbd9d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:51:12.109943 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4952474f-551d-486c-8685-5ecf8a9bbd9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:12.111520 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4952474f-551d-486c-8685-5ecf8a9bbd9d None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:12.121937 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 495/993] 10.222.0.52 () {56 vars in 1122 bytes} [Sat May 14 20:51:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:51:12.123697 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fb4b50-ff42-49ba-ad6c-ab9362e327ef None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:12.226293 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fb4b50-ff42-49ba-ad6c-ab9362e327ef None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:12.259494 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c0c69c-2d10-4b6a-b8bf-839e93399d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:12.260174 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c0c69c-2d10-4b6a-b8bf-839e93399d7d None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:12.260456 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c0c69c-2d10-4b6a-b8bf-839e93399d7d None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:12.260761 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c0c69c-2d10-4b6a-b8bf-839e93399d7d None admin] PATH_INFO: `/v3/services` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:12.261457 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c0c69c-2d10-4b6a-b8bf-839e93399d7d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:51:12.261825 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c0c69c-2d10-4b6a-b8bf-839e93399d7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:12.263278 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c0c69c-2d10-4b6a-b8bf-839e93399d7d None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:12.273723 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 499/994] 10.222.0.52 () {56 vars in 1122 bytes} [Sat May 14 20:51:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:51:12.275215 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4952474f-551d-486c-8685-5ecf8a9bbd9d None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:12.310126 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f812b-36b1-477e-9198-ff904b081ce5 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:12.310419 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f812b-36b1-477e-9198-ff904b081ce5 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:12.310705 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f812b-36b1-477e-9198-ff904b081ce5 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:12.312269 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 500/995] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:51:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 14 20:51:12.317546 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118caffd-a6bf-4da4-8871-2739433ceb67 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:12.318089 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118caffd-a6bf-4da4-8871-2739433ceb67 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:12.318380 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118caffd-a6bf-4da4-8871-2739433ceb67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:12.335131 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-118caffd-a6bf-4da4-8871-2739433ceb67 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:51:12.336666 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-118caffd-a6bf-4da4-8871-2739433ceb67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:51:12.377480 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4952474f-551d-486c-8685-5ecf8a9bbd9d None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:12.412760 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 501/996] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:51:12 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 20:51:12.414264 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c202d8-4eae-4de9-89fc-301f2d4482f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:12.414987 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c202d8-4eae-4de9-89fc-301f2d4482f0 None admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:12.415340 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c202d8-4eae-4de9-89fc-301f2d4482f0 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:12.415713 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c202d8-4eae-4de9-89fc-301f2d4482f0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:12.416539 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c202d8-4eae-4de9-89fc-301f2d4482f0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:12.417992 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c202d8-4eae-4de9-89fc-301f2d4482f0 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:12.437080 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118caffd-a6bf-4da4-8871-2739433ceb67 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:12.507598 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 496/997] 10.222.0.52 () {60 vars in 1144 bytes} [Sat May 14 20:51:12 2022] POST /identity/v3/endpoints => generated 325 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 20:51:12.538855 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118caffd-a6bf-4da4-8871-2739433ceb67 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:12.583541 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b054dcb1-dab3-4a42-b5e4-45054c1b5b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:12.584379 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b054dcb1-dab3-4a42-b5e4-45054c1b5b94 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:12.584667 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b054dcb1-dab3-4a42-b5e4-45054c1b5b94 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:12.584946 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b054dcb1-dab3-4a42-b5e4-45054c1b5b94 None admin] PATH_INFO: `/v3/services/compute` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:12.585602 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b054dcb1-dab3-4a42-b5e4-45054c1b5b94 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:12.586999 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b054dcb1-dab3-4a42-b5e4-45054c1b5b94 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:12.600478 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-b054dcb1-dab3-4a42-b5e4-45054c1b5b94 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 14 20:51:12.600478 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:51:12.600478 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 14 20:51:12.600478 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 14 20:51:12.600478 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 14 20:51:12.600478 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 14 20:51:12.600478 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 14 20:51:12.600478 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 20:51:12.600478 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 14 20:51:12.600478 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:51:12.600478 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 20:51:12.600478 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:51:12.600478 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:51:12.600478 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:51:12.600478 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:51:12.600478 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:51:12.600478 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:51:12.601573 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:51:12.601573 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:51:12.601573 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:51:12.601573 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:51:12.601573 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:51:12.601573 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:51:12.601573 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 14 20:51:12.601573 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_service(service_id) May 14 20:51:12.601573 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 14 20:51:12.601573 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 14 20:51:12.601573 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:51:12.601573 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:51:12.601573 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:51:12.601573 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:51:12.601573 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:51:12.601573 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:51:12.607387 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:51:12.607387 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:51:12.607387 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:51:12.607387 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:51:12.607387 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:51:12.607387 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:51:12.607387 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:51:12.607387 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:51:12.607387 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:51:12.607387 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:51:12.607387 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 14 20:51:12.607387 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 20:51:12.607387 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 14 20:51:12.607387 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:51:12.607387 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 502/998] 10.222.0.52 () {56 vars in 1111 bytes} [Sat May 14 20:51:12 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 20:51:12.608673 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c202d8-4eae-4de9-89fc-301f2d4482f0 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:12.714730 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c202d8-4eae-4de9-89fc-301f2d4482f0 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:12.748002 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918bf99-dd12-4634-837b-a3a691d2f4c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:12.748663 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918bf99-dd12-4634-837b-a3a691d2f4c8 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:12.748940 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918bf99-dd12-4634-837b-a3a691d2f4c8 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:12.749210 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918bf99-dd12-4634-837b-a3a691d2f4c8 None admin] PATH_INFO: `/v3/services` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:12.749903 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c918bf99-dd12-4634-837b-a3a691d2f4c8 None admin] RBAC: Adding query filter params (name=compute) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:51:12.750815 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c918bf99-dd12-4634-837b-a3a691d2f4c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:12.752235 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c918bf99-dd12-4634-837b-a3a691d2f4c8 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:12.761645 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 497/999] 10.222.0.52 () {56 vars in 1112 bytes} [Sat May 14 20:51:12 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:51:12.763235 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b054dcb1-dab3-4a42-b5e4-45054c1b5b94 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:12.861736 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b054dcb1-dab3-4a42-b5e4-45054c1b5b94 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:12.895392 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357804c-9f11-4b83-8acb-1e5a574bacd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:12.896075 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357804c-9f11-4b83-8acb-1e5a574bacd4 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:12.896356 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357804c-9f11-4b83-8acb-1e5a574bacd4 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:12.896628 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357804c-9f11-4b83-8acb-1e5a574bacd4 None admin] PATH_INFO: `/v3/services` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:12.897319 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0357804c-9f11-4b83-8acb-1e5a574bacd4 None admin] RBAC: Adding query filter params (type=compute) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:51:12.897621 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0357804c-9f11-4b83-8acb-1e5a574bacd4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:12.898964 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0357804c-9f11-4b83-8acb-1e5a574bacd4 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:12.909235 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 503/1000] 10.222.0.52 () {56 vars in 1112 bytes} [Sat May 14 20:51:12 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:51:12.910862 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918bf99-dd12-4634-837b-a3a691d2f4c8 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:13.018344 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918bf99-dd12-4634-837b-a3a691d2f4c8 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:13.051625 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089d3857-9369-4e1d-afad-554cd0fdf847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:13.052275 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d3857-9369-4e1d-afad-554cd0fdf847 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:13.052556 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d3857-9369-4e1d-afad-554cd0fdf847 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:13.052828 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d3857-9369-4e1d-afad-554cd0fdf847 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:13.053628 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089d3857-9369-4e1d-afad-554cd0fdf847 None admin] RBAC: Adding query filter params (interface=public, service_id=c8bf0f98ec8e42c79750ebbb44324846, region_id=RegionOne) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:51:13.053937 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089d3857-9369-4e1d-afad-554cd0fdf847 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:13.055305 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089d3857-9369-4e1d-afad-554cd0fdf847 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:13.065126 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 498/1001] 10.222.0.52 () {56 vars in 1251 bytes} [Sat May 14 20:51:12 2022] GET /identity/v3/endpoints?service_id=c8bf0f98ec8e42c79750ebbb44324846&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:51:13.066710 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357804c-9f11-4b83-8acb-1e5a574bacd4 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:13.155120 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a12620-dca7-4780-8bc8-d75c70757699 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:13.155465 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a12620-dca7-4780-8bc8-d75c70757699 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:13.155713 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a12620-dca7-4780-8bc8-d75c70757699 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:13.157865 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 499/1002] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:51:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 14 20:51:13.162690 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad42d14c-b5d5-4102-85f4-f94e3af9e995 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:13.162978 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad42d14c-b5d5-4102-85f4-f94e3af9e995 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:13.163258 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad42d14c-b5d5-4102-85f4-f94e3af9e995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:13.166129 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357804c-9f11-4b83-8acb-1e5a574bacd4 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:13.179818 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-ad42d14c-b5d5-4102-85f4-f94e3af9e995 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:51:13.181276 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-ad42d14c-b5d5-4102-85f4-f94e3af9e995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:51:13.199220 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc38528-09b5-43cc-a766-66333ffc8cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:13.199903 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc38528-09b5-43cc-a766-66333ffc8cb7 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:13.200185 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc38528-09b5-43cc-a766-66333ffc8cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:13.200461 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc38528-09b5-43cc-a766-66333ffc8cb7 None admin] PATH_INFO: `/v3/services` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:13.201132 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc38528-09b5-43cc-a766-66333ffc8cb7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:13.202489 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc38528-09b5-43cc-a766-66333ffc8cb7 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:13.209632 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 504/1003] 10.222.0.52 () {56 vars in 1087 bytes} [Sat May 14 20:51:13 2022] GET /identity/v3/services => generated 1727 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 20:51:13.255522 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 500/1004] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:51:13 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 14 20:51:13.280581 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc38528-09b5-43cc-a766-66333ffc8cb7 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:13.386305 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc38528-09b5-43cc-a766-66333ffc8cb7 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:13.422889 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a21a49-37d5-4774-83c7-201e45971e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:13.423789 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a21a49-37d5-4774-83c7-201e45971e07 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:13.424074 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a21a49-37d5-4774-83c7-201e45971e07 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:13.424348 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a21a49-37d5-4774-83c7-201e45971e07 None admin] PATH_INFO: `/v3/services/image` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:13.425016 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a21a49-37d5-4774-83c7-201e45971e07 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:13.426366 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a21a49-37d5-4774-83c7-201e45971e07 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:13.438914 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-23a21a49-37d5-4774-83c7-201e45971e07 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 14 20:51:13.438914 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:51:13.438914 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 14 20:51:13.438914 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 14 20:51:13.438914 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 14 20:51:13.438914 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 14 20:51:13.438914 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 14 20:51:13.438914 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 20:51:13.438914 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 14 20:51:13.438914 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:51:13.438914 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 20:51:13.438914 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:51:13.438914 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:51:13.438914 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:51:13.438914 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:51:13.438914 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:51:13.438914 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:51:13.440255 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:51:13.440255 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:51:13.440255 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:51:13.440255 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:51:13.440255 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:51:13.440255 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:51:13.440255 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 14 20:51:13.440255 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_service(service_id) May 14 20:51:13.440255 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 14 20:51:13.440255 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 14 20:51:13.440255 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:51:13.440255 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:51:13.440255 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:51:13.440255 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:51:13.440255 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:51:13.440255 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:51:13.441118 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:51:13.441118 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:51:13.441118 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:51:13.441118 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:51:13.441118 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:51:13.441118 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:51:13.441118 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:51:13.441118 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:51:13.441118 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:51:13.441118 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:51:13.441118 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 14 20:51:13.441118 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 20:51:13.441118 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 14 20:51:13.441118 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:51:13.441118 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 505/1005] 10.222.0.52 () {56 vars in 1105 bytes} [Sat May 14 20:51:13 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:51:13.446014 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad42d14c-b5d5-4102-85f4-f94e3af9e995 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:13.557262 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad42d14c-b5d5-4102-85f4-f94e3af9e995 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:13.591127 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c04a1bf-3a74-451b-af95-f077a169986a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:13.591818 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c04a1bf-3a74-451b-af95-f077a169986a None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:13.592100 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c04a1bf-3a74-451b-af95-f077a169986a None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:13.592370 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c04a1bf-3a74-451b-af95-f077a169986a None admin] PATH_INFO: `/v3/services` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:13.593090 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c04a1bf-3a74-451b-af95-f077a169986a None admin] RBAC: Adding query filter params (name=image) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:51:13.593364 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c04a1bf-3a74-451b-af95-f077a169986a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:13.595428 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c04a1bf-3a74-451b-af95-f077a169986a None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:13.604618 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 501/1006] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:51:13 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:51:13.605863 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a21a49-37d5-4774-83c7-201e45971e07 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:13.708941 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a21a49-37d5-4774-83c7-201e45971e07 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:13.745367 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce32f060-1327-45cf-a040-18507ddf555b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:13.746040 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32f060-1327-45cf-a040-18507ddf555b None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:13.746582 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32f060-1327-45cf-a040-18507ddf555b None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:13.746852 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32f060-1327-45cf-a040-18507ddf555b None admin] PATH_INFO: `/v3/services` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:13.747587 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce32f060-1327-45cf-a040-18507ddf555b None admin] RBAC: Adding query filter params (type=image) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:51:13.747892 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce32f060-1327-45cf-a040-18507ddf555b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:13.749246 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce32f060-1327-45cf-a040-18507ddf555b None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:13.759897 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 506/1007] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:51:13 2022] GET /identity/v3/services?type=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:51:14.842101 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a3f82-2055-4f51-b182-40ea167024a4 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:14.842633 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a3f82-2055-4f51-b182-40ea167024a4 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:14.842633 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a3f82-2055-4f51-b182-40ea167024a4 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:14.844760 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 502/1008] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:51:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:51:14.850267 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa31a3f6-f882-406e-b25a-f3ccb87e1393 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:14.850778 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa31a3f6-f882-406e-b25a-f3ccb87e1393 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:14.850859 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa31a3f6-f882-406e-b25a-f3ccb87e1393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:14.869601 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-aa31a3f6-f882-406e-b25a-f3ccb87e1393 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:51:14.870782 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-aa31a3f6-f882-406e-b25a-f3ccb87e1393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:51:14.947505 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 507/1009] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:51:14 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 20:51:14.967963 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86a3f82-2055-4f51-b182-40ea167024a4 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:15.067735 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86a3f82-2055-4f51-b182-40ea167024a4 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:15.101618 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb23c5-bc0a-4c7b-af7a-bc7e039222d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:15.102329 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb23c5-bc0a-4c7b-af7a-bc7e039222d2 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:15.102611 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb23c5-bc0a-4c7b-af7a-bc7e039222d2 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:15.102886 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb23c5-bc0a-4c7b-af7a-bc7e039222d2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:15.104082 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cb23c5-bc0a-4c7b-af7a-bc7e039222d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:15.105510 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cb23c5-bc0a-4c7b-af7a-bc7e039222d2 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:15.111624 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 503/1010] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:51:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:51:15.113101 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa31a3f6-f882-406e-b25a-f3ccb87e1393 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:15.207888 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa31a3f6-f882-406e-b25a-f3ccb87e1393 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:15.240029 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ae4705-b59a-4382-88a0-ae93a6a45d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:15.240679 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae4705-b59a-4382-88a0-ae93a6a45d5c None admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:15.240959 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae4705-b59a-4382-88a0-ae93a6a45d5c None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:15.241230 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae4705-b59a-4382-88a0-ae93a6a45d5c None admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:15.241931 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ae4705-b59a-4382-88a0-ae93a6a45d5c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:15.243345 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ae4705-b59a-4382-88a0-ae93a6a45d5c None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:15.383204 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 508/1011] 10.222.0.52 () {60 vars in 1141 bytes} [Sat May 14 20:51:15 2022] POST /identity/v3/projects => generated 311 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 20:51:15.540531 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeeb132-9ab3-4376-8ee6-c2737af0b1cc None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:15.540947 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeeb132-9ab3-4376-8ee6-c2737af0b1cc None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:15.541131 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeeb132-9ab3-4376-8ee6-c2737af0b1cc None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:15.542627 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 504/1012] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:51:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:51:15.548546 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22befcf6-c126-481e-8c91-45e8ba6effb5 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:15.548836 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22befcf6-c126-481e-8c91-45e8ba6effb5 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:15.549123 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22befcf6-c126-481e-8c91-45e8ba6effb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:15.567064 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-22befcf6-c126-481e-8c91-45e8ba6effb5 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:51:15.568281 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-22befcf6-c126-481e-8c91-45e8ba6effb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:51:15.641321 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 509/1013] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:51:15 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 20:51:15.670401 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeeb132-9ab3-4376-8ee6-c2737af0b1cc None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:15.772361 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeeb132-9ab3-4376-8ee6-c2737af0b1cc None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:15.811913 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a401b73c-4c11-4157-a10b-3a57987155a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:15.813258 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401b73c-4c11-4157-a10b-3a57987155a0 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:15.813560 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401b73c-4c11-4157-a10b-3a57987155a0 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:15.813833 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401b73c-4c11-4157-a10b-3a57987155a0 None admin] PATH_INFO: `/v3/services/compute` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:15.814474 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a401b73c-4c11-4157-a10b-3a57987155a0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:15.815928 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a401b73c-4c11-4157-a10b-3a57987155a0 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:15.827568 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-a401b73c-4c11-4157-a10b-3a57987155a0 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 14 20:51:15.827568 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:51:15.827568 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 14 20:51:15.827568 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 14 20:51:15.827568 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 14 20:51:15.827568 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 14 20:51:15.827568 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 14 20:51:15.827568 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 20:51:15.827568 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 14 20:51:15.827568 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:51:15.827568 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 20:51:15.827568 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:51:15.827568 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:51:15.827568 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:51:15.827568 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:51:15.827568 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:51:15.827568 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:51:15.828926 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:51:15.828926 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:51:15.828926 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:51:15.828926 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:51:15.828926 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:51:15.828926 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:51:15.828926 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 14 20:51:15.828926 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_service(service_id) May 14 20:51:15.828926 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 14 20:51:15.828926 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 14 20:51:15.828926 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:51:15.828926 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:51:15.828926 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:51:15.828926 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:51:15.828926 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:51:15.828926 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:51:15.829804 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:51:15.829804 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:51:15.829804 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:51:15.829804 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:51:15.829804 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:51:15.829804 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:51:15.829804 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:51:15.829804 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:51:15.829804 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:51:15.829804 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:51:15.829804 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 14 20:51:15.829804 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 20:51:15.829804 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 14 20:51:15.829804 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:51:15.829804 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 505/1014] 10.222.0.52 () {56 vars in 1111 bytes} [Sat May 14 20:51:15 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:51:15.835155 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22befcf6-c126-481e-8c91-45e8ba6effb5 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:15.944260 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22befcf6-c126-481e-8c91-45e8ba6effb5 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:15.978441 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de99f41-5911-4092-8f79-b1279fa818c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:15.979107 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de99f41-5911-4092-8f79-b1279fa818c6 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:15.979389 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de99f41-5911-4092-8f79-b1279fa818c6 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:15.979689 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de99f41-5911-4092-8f79-b1279fa818c6 None admin] PATH_INFO: `/v3/services` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:15.980393 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de99f41-5911-4092-8f79-b1279fa818c6 None admin] RBAC: Adding query filter params (name=compute) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:51:15.980699 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de99f41-5911-4092-8f79-b1279fa818c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:15.982052 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de99f41-5911-4092-8f79-b1279fa818c6 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:15.991940 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 510/1015] 10.222.0.52 () {56 vars in 1112 bytes} [Sat May 14 20:51:15 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:51:15.993480 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a401b73c-4c11-4157-a10b-3a57987155a0 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:16.057568 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c114f3-8321-421c-9607-c283137031e1 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:16.057933 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c114f3-8321-421c-9607-c283137031e1 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:16.058118 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c114f3-8321-421c-9607-c283137031e1 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:16.063508 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 511/1016] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:51:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 14 20:51:16.065151 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ca5b1-c96e-44d3-8a95-63031ef7e8a5 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:16.065498 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ca5b1-c96e-44d3-8a95-63031ef7e8a5 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:16.065844 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ca5b1-c96e-44d3-8a95-63031ef7e8a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:16.086215 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-001ca5b1-c96e-44d3-8a95-63031ef7e8a5 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:51:16.089213 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-001ca5b1-c96e-44d3-8a95-63031ef7e8a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:51:16.095262 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a401b73c-4c11-4157-a10b-3a57987155a0 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:16.130662 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035af1a3-4e2a-47a5-a6ba-60cd532ffbc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:16.131332 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035af1a3-4e2a-47a5-a6ba-60cd532ffbc6 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:16.131645 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035af1a3-4e2a-47a5-a6ba-60cd532ffbc6 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:16.131918 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035af1a3-4e2a-47a5-a6ba-60cd532ffbc6 None admin] PATH_INFO: `/v3/services` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:16.132614 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035af1a3-4e2a-47a5-a6ba-60cd532ffbc6 None admin] RBAC: Adding query filter params (type=compute) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:51:16.132914 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035af1a3-4e2a-47a5-a6ba-60cd532ffbc6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:16.134294 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035af1a3-4e2a-47a5-a6ba-60cd532ffbc6 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:16.139782 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 506/1017] 10.222.0.52 () {56 vars in 1112 bytes} [Sat May 14 20:51:15 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:51:16.145313 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035af1a3-4e2a-47a5-a6ba-60cd532ffbc6 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:16.172562 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 512/1018] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:51:16 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 20:51:16.188982 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001ca5b1-c96e-44d3-8a95-63031ef7e8a5 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:16.247764 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035af1a3-4e2a-47a5-a6ba-60cd532ffbc6 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:16.281820 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483519f4-e346-48fd-86c1-417a51cff0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:16.282992 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483519f4-e346-48fd-86c1-417a51cff0a1 None admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:16.283518 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483519f4-e346-48fd-86c1-417a51cff0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:16.283994 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483519f4-e346-48fd-86c1-417a51cff0a1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:16.284945 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483519f4-e346-48fd-86c1-417a51cff0a1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:16.286461 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483519f4-e346-48fd-86c1-417a51cff0a1 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:16.287755 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001ca5b1-c96e-44d3-8a95-63031ef7e8a5 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:16.321092 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf0a86-faf2-4ea1-b39c-b413bfb17a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:16.321754 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf0a86-faf2-4ea1-b39c-b413bfb17a88 None admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:16.322038 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf0a86-faf2-4ea1-b39c-b413bfb17a88 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:16.322314 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf0a86-faf2-4ea1-b39c-b413bfb17a88 None admin] PATH_INFO: `/v3/services` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:16.323024 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebf0a86-faf2-4ea1-b39c-b413bfb17a88 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:16.324470 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebf0a86-faf2-4ea1-b39c-b413bfb17a88 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:16.371125 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 507/1019] 10.222.0.52 () {60 vars in 1144 bytes} [Sat May 14 20:51:16 2022] POST /identity/v3/endpoints => generated 334 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 20:51:16.400976 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 513/1020] 10.222.0.52 () {60 vars in 1141 bytes} [Sat May 14 20:51:16 2022] POST /identity/v3/services => generated 242 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 20:51:17.783988 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d55c2-ff9f-4820-a727-593a3d4f155f None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:17.784514 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d55c2-ff9f-4820-a727-593a3d4f155f None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:17.784514 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d55c2-ff9f-4820-a727-593a3d4f155f None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:17.785924 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 508/1021] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:51:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:51:17.791171 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f9037-14b2-4ec3-b8c3-3c1386168726 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:17.791630 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f9037-14b2-4ec3-b8c3-3c1386168726 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:17.791805 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f9037-14b2-4ec3-b8c3-3c1386168726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:17.808106 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-d73f9037-14b2-4ec3-b8c3-3c1386168726 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:51:17.809261 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d73f9037-14b2-4ec3-b8c3-3c1386168726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:51:17.880395 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 514/1022] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:51:17 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 14 20:51:17.904939 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0d55c2-ff9f-4820-a727-593a3d4f155f None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:18.005809 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0d55c2-ff9f-4820-a727-593a3d4f155f None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:18.038668 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37288891-493a-4b89-b82b-969ecdd50c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:18.039778 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37288891-493a-4b89-b82b-969ecdd50c91 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:18.040293 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37288891-493a-4b89-b82b-969ecdd50c91 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:18.040768 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37288891-493a-4b89-b82b-969ecdd50c91 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:18.042128 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37288891-493a-4b89-b82b-969ecdd50c91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:18.043863 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37288891-493a-4b89-b82b-969ecdd50c91 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:18.046029 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 509/1023] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:51:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:51:18.051233 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f9037-14b2-4ec3-b8c3-3c1386168726 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:18.149896 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f9037-14b2-4ec3-b8c3-3c1386168726 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:18.183830 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3979a5-f3da-451e-8f35-40e0a4cd0527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:18.184497 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3979a5-f3da-451e-8f35-40e0a4cd0527 None admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:18.184785 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3979a5-f3da-451e-8f35-40e0a4cd0527 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:18.185062 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3979a5-f3da-451e-8f35-40e0a4cd0527 None admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:18.185776 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3979a5-f3da-451e-8f35-40e0a4cd0527 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:18.187201 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3979a5-f3da-451e-8f35-40e0a4cd0527 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:18.307585 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 515/1024] 10.222.0.52 () {60 vars in 1132 bytes} [Sat May 14 20:51:18 2022] POST /identity/v3/users => generated 285 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 20:51:18.752747 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f65bc45-0e9b-4d68-a673-e50e7fc53a6d None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:18.753100 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f65bc45-0e9b-4d68-a673-e50e7fc53a6d None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:18.753315 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f65bc45-0e9b-4d68-a673-e50e7fc53a6d None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:18.754943 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 510/1025] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:51:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:51:18.760352 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec1ab3-9a5f-4817-8e87-833f64e0df6a None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:18.760647 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec1ab3-9a5f-4817-8e87-833f64e0df6a None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:18.760930 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec1ab3-9a5f-4817-8e87-833f64e0df6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:18.777951 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-fcec1ab3-9a5f-4817-8e87-833f64e0df6a None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:51:18.779143 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-fcec1ab3-9a5f-4817-8e87-833f64e0df6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:51:18.819218 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af069f53-b471-48d1-808a-1961a0a2caf5 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:18.819769 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af069f53-b471-48d1-808a-1961a0a2caf5 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:18.819874 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af069f53-b471-48d1-808a-1961a0a2caf5 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:18.821284 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 511/1026] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:51:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 14 20:51:18.826026 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054ee23-371f-49ac-bc5d-b5aa62ad298c None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:18.826304 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054ee23-371f-49ac-bc5d-b5aa62ad298c None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:18.826588 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054ee23-371f-49ac-bc5d-b5aa62ad298c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:18.843429 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-4054ee23-371f-49ac-bc5d-b5aa62ad298c None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:51:18.845375 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-4054ee23-371f-49ac-bc5d-b5aa62ad298c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:51:18.846618 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 516/1027] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:51:18 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 14 20:51:18.870515 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcec1ab3-9a5f-4817-8e87-833f64e0df6a None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:18.920307 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 512/1028] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:51:18 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 14 20:51:18.939365 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4054ee23-371f-49ac-bc5d-b5aa62ad298c None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:18.978359 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcec1ab3-9a5f-4817-8e87-833f64e0df6a None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:19.017205 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0458db-8639-4547-a505-ac347ff7b491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:19.017910 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0458db-8639-4547-a505-ac347ff7b491 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:19.018194 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0458db-8639-4547-a505-ac347ff7b491 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:19.018469 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0458db-8639-4547-a505-ac347ff7b491 None admin] PATH_INFO: `/v3/services/image` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:19.019119 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0458db-8639-4547-a505-ac347ff7b491 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:19.020528 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0458db-8639-4547-a505-ac347ff7b491 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:19.032445 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-dd0458db-8639-4547-a505-ac347ff7b491 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 14 20:51:19.032445 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:51:19.032445 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 14 20:51:19.032445 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 14 20:51:19.032445 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 14 20:51:19.032445 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 14 20:51:19.032445 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 14 20:51:19.032445 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 20:51:19.032445 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 14 20:51:19.032445 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:51:19.032445 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 20:51:19.032445 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:51:19.032445 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:51:19.032445 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:51:19.032445 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:51:19.032445 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:51:19.032445 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:51:19.038618 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:51:19.038618 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:51:19.038618 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:51:19.038618 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:51:19.038618 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:51:19.038618 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:51:19.038618 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 14 20:51:19.038618 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_service(service_id) May 14 20:51:19.038618 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 14 20:51:19.038618 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 14 20:51:19.038618 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:51:19.038618 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:51:19.038618 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:51:19.038618 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:51:19.038618 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:51:19.038618 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:51:19.039651 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:51:19.039651 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:51:19.039651 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:51:19.039651 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:51:19.039651 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:51:19.039651 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:51:19.039651 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:51:19.039651 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:51:19.039651 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:51:19.039651 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:51:19.039651 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 14 20:51:19.039651 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 20:51:19.039651 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 14 20:51:19.039651 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:51:19.039651 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 517/1029] 10.222.0.52 () {56 vars in 1105 bytes} [Sat May 14 20:51:18 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 20:51:19.042355 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0458db-8639-4547-a505-ac347ff7b491 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:19.043959 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4054ee23-371f-49ac-bc5d-b5aa62ad298c None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:19.078557 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd13c20-f776-4105-a2cb-9e900c24776b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:19.079364 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd13c20-f776-4105-a2cb-9e900c24776b None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:19.079680 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd13c20-f776-4105-a2cb-9e900c24776b None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:19.079954 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd13c20-f776-4105-a2cb-9e900c24776b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:19.090002 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd13c20-f776-4105-a2cb-9e900c24776b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:51:19.099063 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-4cd13c20-f776-4105-a2cb-9e900c24776b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 14 20:51:19.099063 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:51:19.099063 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:51:19.099063 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:51:19.099063 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:51:19.099063 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:51:19.099063 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:51:19.099063 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:51:19.099063 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:51:19.099063 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:51:19.099063 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:51:19.099063 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:51:19.099063 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:51:19.099063 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:51:19.099063 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:51:19.099063 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:51:19.100063 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:51:19.100063 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:51:19.100063 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:51:19.100063 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:51:19.100063 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:51:19.100063 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:51:19.100063 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:51:19.100063 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:51:19.100063 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:51:19.100063 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:51:19.100063 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:51:19.100063 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:51:19.100063 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:51:19.100063 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:51:19.100063 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:51:19.100063 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:51:19.106189 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:51:19.106189 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:51:19.106189 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:51:19.106189 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:51:19.106189 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:51:19.106189 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:51:19.106189 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:51:19.106189 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:51:19.106189 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:51:19.106189 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:51:19.106189 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 14 20:51:19.106189 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:51:19.106189 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 513/1030] 10.222.0.52 () {56 vars in 1120 bytes} [Sat May 14 20:51:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 20:51:19.106189 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd13c20-f776-4105-a2cb-9e900c24776b None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:19.144681 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0458db-8639-4547-a505-ac347ff7b491 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:19.179384 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa10378-e9da-4da8-81ba-efe609aa278e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:19.180089 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa10378-e9da-4da8-81ba-efe609aa278e None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:19.180359 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa10378-e9da-4da8-81ba-efe609aa278e None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:19.180630 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa10378-e9da-4da8-81ba-efe609aa278e None admin] PATH_INFO: `/v3/services` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:19.181327 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa10378-e9da-4da8-81ba-efe609aa278e None admin] RBAC: Adding query filter params (name=image) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:51:19.181631 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa10378-e9da-4da8-81ba-efe609aa278e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:19.182981 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa10378-e9da-4da8-81ba-efe609aa278e None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:19.189052 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 518/1031] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:51:19 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:51:19.193499 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa10378-e9da-4da8-81ba-efe609aa278e None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:19.208074 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd13c20-f776-4105-a2cb-9e900c24776b None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:19.242704 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d295dbf3-b8e1-4563-b871-4e045d5ca4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:19.243371 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295dbf3-b8e1-4563-b871-4e045d5ca4a4 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:19.243685 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295dbf3-b8e1-4563-b871-4e045d5ca4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:19.243961 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295dbf3-b8e1-4563-b871-4e045d5ca4a4 None admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:19.244833 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d295dbf3-b8e1-4563-b871-4e045d5ca4a4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:51:19.245027 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d295dbf3-b8e1-4563-b871-4e045d5ca4a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:19.246636 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d295dbf3-b8e1-4563-b871-4e045d5ca4a4 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:19.254635 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 514/1032] 10.222.0.52 () {56 vars in 1115 bytes} [Sat May 14 20:51:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:51:19.260107 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d295dbf3-b8e1-4563-b871-4e045d5ca4a4 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:19.294515 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa10378-e9da-4da8-81ba-efe609aa278e None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:19.329247 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cf968e-124c-4d3e-9dd9-992452428ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:19.333365 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf968e-124c-4d3e-9dd9-992452428ad4 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:19.333365 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf968e-124c-4d3e-9dd9-992452428ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:19.333365 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf968e-124c-4d3e-9dd9-992452428ad4 None admin] PATH_INFO: `/v3/services` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:19.335338 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cf968e-124c-4d3e-9dd9-992452428ad4 None admin] RBAC: Adding query filter params (type=image) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:51:19.335709 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cf968e-124c-4d3e-9dd9-992452428ad4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:19.337625 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cf968e-124c-4d3e-9dd9-992452428ad4 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:19.350192 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 519/1033] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:51:19 2022] GET /identity/v3/services?type=image => generated 350 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:51:19.352277 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cf968e-124c-4d3e-9dd9-992452428ad4 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:19.368169 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d295dbf3-b8e1-4563-b871-4e045d5ca4a4 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:19.405408 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd3fe80-5123-4e96-8ac1-b93e1c1543dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:19.406724 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd3fe80-5123-4e96-8ac1-b93e1c1543dc None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:19.407137 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd3fe80-5123-4e96-8ac1-b93e1c1543dc None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:19.407626 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd3fe80-5123-4e96-8ac1-b93e1c1543dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:19.417889 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd3fe80-5123-4e96-8ac1-b93e1c1543dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:19.419587 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd3fe80-5123-4e96-8ac1-b93e1c1543dc None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:19.436772 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-ccd3fe80-5123-4e96-8ac1-b93e1c1543dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:51:19.436772 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:51:19.436772 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:51:19.436772 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:51:19.436772 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:51:19.436772 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:51:19.436772 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:51:19.436772 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:51:19.436772 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:51:19.436772 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:51:19.436772 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:51:19.436772 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:51:19.436772 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:51:19.436772 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:51:19.436772 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:51:19.437905 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:51:19.437905 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:51:19.437905 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:51:19.437905 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:51:19.437905 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:51:19.437905 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:51:19.437905 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:51:19.437905 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:51:19.437905 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:51:19.437905 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:51:19.437905 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:51:19.437905 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:51:19.437905 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:51:19.437905 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:51:19.437905 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:51:19.437905 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:51:19.437905 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:51:19.449829 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 20:51:19.449829 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:51:19.449829 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:51:19.449829 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:51:19.449829 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 515/1034] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:51:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 20:51:19.449829 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd3fe80-5123-4e96-8ac1-b93e1c1543dc None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:19.454147 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cf968e-124c-4d3e-9dd9-992452428ad4 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:19.488398 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a52f9e-077b-4979-a5db-ded67a526ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:19.489049 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a52f9e-077b-4979-a5db-ded67a526ce0 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:19.489391 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a52f9e-077b-4979-a5db-ded67a526ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:19.489734 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a52f9e-077b-4979-a5db-ded67a526ce0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:19.490549 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a52f9e-077b-4979-a5db-ded67a526ce0 None admin] RBAC: Adding query filter params (interface=public, service_id=f6b73585c6874aaeafbce5438867d748, region_id=RegionOne) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:51:19.490872 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a52f9e-077b-4979-a5db-ded67a526ce0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:19.492281 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a52f9e-077b-4979-a5db-ded67a526ce0 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:19.497664 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 520/1035] 10.222.0.52 () {56 vars in 1251 bytes} [Sat May 14 20:51:19 2022] GET /identity/v3/endpoints?service_id=f6b73585c6874aaeafbce5438867d748&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:51:19.504208 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a52f9e-077b-4979-a5db-ded67a526ce0 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:19.556427 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd3fe80-5123-4e96-8ac1-b93e1c1543dc None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:19.592840 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd3dbd0-f9db-4deb-8aa8-c867aeb50ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:19.593511 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd3dbd0-f9db-4deb-8aa8-c867aeb50ee5 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:19.594749 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd3dbd0-f9db-4deb-8aa8-c867aeb50ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:19.595108 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd3dbd0-f9db-4deb-8aa8-c867aeb50ee5 None admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:19.595978 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd3dbd0-f9db-4deb-8aa8-c867aeb50ee5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:51:19.596556 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd3dbd0-f9db-4deb-8aa8-c867aeb50ee5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:19.597931 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd3dbd0-f9db-4deb-8aa8-c867aeb50ee5 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:19.607819 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a52f9e-077b-4979-a5db-ded67a526ce0 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:19.610607 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 516/1036] 10.222.0.52 () {56 vars in 1109 bytes} [Sat May 14 20:51:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:51:19.615792 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd3dbd0-f9db-4deb-8aa8-c867aeb50ee5 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:19.642280 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dffe00d-786c-4568-bb07-2f022e36e7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:19.642954 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dffe00d-786c-4568-bb07-2f022e36e7e8 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:19.643255 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dffe00d-786c-4568-bb07-2f022e36e7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:19.643521 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dffe00d-786c-4568-bb07-2f022e36e7e8 None admin] PATH_INFO: `/v3/services` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:19.644200 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dffe00d-786c-4568-bb07-2f022e36e7e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:19.645567 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dffe00d-786c-4568-bb07-2f022e36e7e8 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:19.652621 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 521/1037] 10.222.0.52 () {56 vars in 1087 bytes} [Sat May 14 20:51:19 2022] GET /identity/v3/services => generated 1957 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 20:51:19.736902 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd3dbd0-f9db-4deb-8aa8-c867aeb50ee5 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:19.773828 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe5315-97ba-42bf-afc5-f35efa6f8049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:19.774635 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe5315-97ba-42bf-afc5-f35efa6f8049 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:19.774918 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe5315-97ba-42bf-afc5-f35efa6f8049 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:19.775192 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe5315-97ba-42bf-afc5-f35efa6f8049 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:19.783263 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fe5315-97ba-42bf-afc5-f35efa6f8049 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:19.784793 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fe5315-97ba-42bf-afc5-f35efa6f8049 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:19.807027 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-b2fe5315-97ba-42bf-afc5-f35efa6f8049 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 14 20:51:19.807027 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:51:19.807027 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:51:19.807027 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:51:19.807027 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:51:19.807027 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:51:19.807027 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:51:19.807027 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:51:19.807027 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:51:19.807027 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:51:19.807027 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:51:19.807027 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:51:19.807027 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 14 20:51:19.807027 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_user(user_id) May 14 20:51:19.807027 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 14 20:51:19.807027 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 14 20:51:19.808110 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:51:19.808110 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:51:19.808110 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 20:51:19.808110 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 20:51:19.808110 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 14 20:51:19.808110 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 20:51:19.808110 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:51:19.808110 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:51:19.808110 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:51:19.808110 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:51:19.808110 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:51:19.808110 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:51:19.808110 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:51:19.808110 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:51:19.808110 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:51:19.808110 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:51:19.808110 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:51:19.808110 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:51:19.814846 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:51:19.814846 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:51:19.814846 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 14 20:51:19.814846 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 14 20:51:19.814846 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 14 20:51:19.814846 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 14 20:51:19.814846 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 14 20:51:19.814846 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 14 20:51:19.814846 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 14 20:51:19.814846 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:51:19.814846 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 517/1038] 10.222.0.52 () {56 vars in 1093 bytes} [Sat May 14 20:51:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 20:51:19.816594 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dffe00d-786c-4568-bb07-2f022e36e7e8 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:19.928881 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dffe00d-786c-4568-bb07-2f022e36e7e8 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:19.961700 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a37300-913f-454c-a225-a694ccba9a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:19.962457 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a37300-913f-454c-a225-a694ccba9a40 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:19.962738 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a37300-913f-454c-a225-a694ccba9a40 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:19.963009 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a37300-913f-454c-a225-a694ccba9a40 None admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:19.963853 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a37300-913f-454c-a225-a694ccba9a40 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:51:19.964156 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a37300-913f-454c-a225-a694ccba9a40 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:19.965562 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a37300-913f-454c-a225-a694ccba9a40 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:19.989191 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 522/1039] 10.222.0.52 () {56 vars in 1133 bytes} [Sat May 14 20:51:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:51:19.990942 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe5315-97ba-42bf-afc5-f35efa6f8049 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:20.095590 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe5315-97ba-42bf-afc5-f35efa6f8049 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:20.123757 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e765b037-49ed-4173-869d-deff2e71f2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:20.124406 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e765b037-49ed-4173-869d-deff2e71f2af None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:20.124685 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e765b037-49ed-4173-869d-deff2e71f2af None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:20.124984 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e765b037-49ed-4173-869d-deff2e71f2af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:20.193045 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e765b037-49ed-4173-869d-deff2e71f2af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:20.194496 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e765b037-49ed-4173-869d-deff2e71f2af None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:20.295606 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 518/1040] 10.222.0.52 () {58 vars in 1282 bytes} [Sat May 14 20:51:19 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 14 20:51:20.297956 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a37300-913f-454c-a225-a694ccba9a40 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:20.403820 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a37300-913f-454c-a225-a694ccba9a40 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:20.437165 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90fe2d3-417e-4093-ada0-e9d65d2c7d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:20.439130 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90fe2d3-417e-4093-ada0-e9d65d2c7d0e None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:20.439408 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90fe2d3-417e-4093-ada0-e9d65d2c7d0e None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:20.439713 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90fe2d3-417e-4093-ada0-e9d65d2c7d0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:20.449661 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90fe2d3-417e-4093-ada0-e9d65d2c7d0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:20.451088 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90fe2d3-417e-4093-ada0-e9d65d2c7d0e None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:20.468242 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-a90fe2d3-417e-4093-ada0-e9d65d2c7d0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:51:20.468242 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:51:20.468242 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:51:20.468242 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:51:20.468242 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:51:20.468242 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:51:20.468242 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:51:20.468242 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:51:20.468242 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:51:20.468242 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:51:20.468242 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:51:20.468242 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:51:20.468242 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:51:20.468242 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:51:20.468242 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:51:20.469191 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:51:20.469191 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:51:20.469191 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:51:20.469191 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:51:20.469191 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:51:20.469191 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:51:20.469191 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:51:20.469191 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:51:20.469191 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:51:20.469191 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:51:20.469191 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:51:20.469191 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:51:20.469191 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:51:20.469191 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:51:20.469191 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:51:20.469191 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:51:20.469191 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:51:20.470133 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 20:51:20.470133 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:51:20.470133 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:51:20.470133 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:51:20.471808 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 523/1041] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:51:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:51:20.475729 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e765b037-49ed-4173-869d-deff2e71f2af None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:20.581698 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e765b037-49ed-4173-869d-deff2e71f2af None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:20.616227 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292efb6b-3f9c-47c2-8b45-a1397be9a116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:20.616945 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292efb6b-3f9c-47c2-8b45-a1397be9a116 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:20.617232 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292efb6b-3f9c-47c2-8b45-a1397be9a116 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:20.617511 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292efb6b-3f9c-47c2-8b45-a1397be9a116 None admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:20.618275 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292efb6b-3f9c-47c2-8b45-a1397be9a116 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:51:20.618579 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292efb6b-3f9c-47c2-8b45-a1397be9a116 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:20.620096 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292efb6b-3f9c-47c2-8b45-a1397be9a116 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:20.649433 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 519/1042] 10.222.0.52 () {56 vars in 1109 bytes} [Sat May 14 20:51:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:51:20.651628 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90fe2d3-417e-4093-ada0-e9d65d2c7d0e None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:20.717939 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e92114-92f9-414c-b1a7-49ecc5180175 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:20.718560 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e92114-92f9-414c-b1a7-49ecc5180175 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:20.718849 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e92114-92f9-414c-b1a7-49ecc5180175 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:20.720802 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 520/1043] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:51:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 14 20:51:20.726003 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216e842-5489-43bf-9716-5f31dec8cfef None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:20.726293 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216e842-5489-43bf-9716-5f31dec8cfef None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:20.726571 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216e842-5489-43bf-9716-5f31dec8cfef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:20.743134 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-b216e842-5489-43bf-9716-5f31dec8cfef None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:51:20.744348 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b216e842-5489-43bf-9716-5f31dec8cfef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:51:20.759024 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90fe2d3-417e-4093-ada0-e9d65d2c7d0e None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:20.792665 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63440d0-17ac-496f-b627-d517ad3b75cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:20.793447 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63440d0-17ac-496f-b627-d517ad3b75cf None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:20.793725 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63440d0-17ac-496f-b627-d517ad3b75cf None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:20.793997 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63440d0-17ac-496f-b627-d517ad3b75cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:20.800906 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63440d0-17ac-496f-b627-d517ad3b75cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:20.802346 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63440d0-17ac-496f-b627-d517ad3b75cf None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:20.816659 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-a63440d0-17ac-496f-b627-d517ad3b75cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 14 20:51:20.816659 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:51:20.816659 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:51:20.816659 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:51:20.816659 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:51:20.816659 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:51:20.816659 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:51:20.816659 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:51:20.816659 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:51:20.816659 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:51:20.816659 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:51:20.816659 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:51:20.816659 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 14 20:51:20.816659 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_project(project_id) May 14 20:51:20.816659 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 14 20:51:20.817678 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 14 20:51:20.817678 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:51:20.817678 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:51:20.817678 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:51:20.817678 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:51:20.817678 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:51:20.817678 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:51:20.817678 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:51:20.817678 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:51:20.817678 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:51:20.817678 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:51:20.817678 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:51:20.817678 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:51:20.817678 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:51:20.817678 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:51:20.817678 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:51:20.817678 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:51:20.835885 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 14 20:51:20.835885 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 14 20:51:20.835885 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 20:51:20.835885 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 20:51:20.835885 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 20:51:20.835885 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 20:51:20.835885 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 14 20:51:20.835885 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:51:20.836340 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 521/1044] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:51:20 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 14 20:51:20.836415 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 524/1045] 10.222.0.52 () {56 vars in 1111 bytes} [Sat May 14 20:51:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:51:20.836492 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b216e842-5489-43bf-9716-5f31dec8cfef None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:20.843205 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63440d0-17ac-496f-b627-d517ad3b75cf None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:20.924105 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b216e842-5489-43bf-9716-5f31dec8cfef None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:20.954268 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63440d0-17ac-496f-b627-d517ad3b75cf None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:20.959389 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ba09d2-5608-49d9-baf1-e1292adb94d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:20.960083 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba09d2-5608-49d9-baf1-e1292adb94d5 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:20.960365 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba09d2-5608-49d9-baf1-e1292adb94d5 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:20.960639 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba09d2-5608-49d9-baf1-e1292adb94d5 None admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:20.961419 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ba09d2-5608-49d9-baf1-e1292adb94d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:51:20.961728 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ba09d2-5608-49d9-baf1-e1292adb94d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:20.963215 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ba09d2-5608-49d9-baf1-e1292adb94d5 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:20.976632 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 522/1046] 10.222.0.52 () {56 vars in 1148 bytes} [Sat May 14 20:51:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:51:20.981996 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ba09d2-5608-49d9-baf1-e1292adb94d5 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:20.994541 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cdd4fa-2830-4663-b77a-8dd959b3a024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:20.995698 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cdd4fa-2830-4663-b77a-8dd959b3a024 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:20.996191 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cdd4fa-2830-4663-b77a-8dd959b3a024 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:20.996943 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cdd4fa-2830-4663-b77a-8dd959b3a024 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:21.007625 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cdd4fa-2830-4663-b77a-8dd959b3a024 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:51:21.015191 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-f3cdd4fa-2830-4663-b77a-8dd959b3a024 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 14 20:51:21.015191 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:51:21.015191 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:51:21.015191 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:51:21.015191 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:51:21.015191 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:51:21.015191 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:51:21.015191 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:51:21.015191 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:51:21.015191 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:51:21.015191 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:51:21.015191 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:51:21.015191 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:51:21.015191 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:51:21.015191 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:51:21.015191 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:51:21.017017 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:51:21.017017 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:51:21.017017 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:51:21.017017 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:51:21.017017 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:51:21.017017 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:51:21.017017 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:51:21.017017 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:51:21.017017 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:51:21.017017 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:51:21.017017 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:51:21.017017 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:51:21.017017 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:51:21.017017 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:51:21.017017 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:51:21.017017 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:51:21.018018 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:51:21.018018 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:51:21.018018 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:51:21.018018 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:51:21.018018 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:51:21.018018 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:51:21.018018 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:51:21.018018 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:51:21.018018 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:51:21.018018 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:51:21.018018 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 14 20:51:21.018018 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:51:21.018018 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 525/1047] 10.222.0.52 () {56 vars in 1096 bytes} [Sat May 14 20:51:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 20:51:21.022938 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cdd4fa-2830-4663-b77a-8dd959b3a024 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:21.083912 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ba09d2-5608-49d9-baf1-e1292adb94d5 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:21.117529 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e822ce8-4435-4290-8589-70b8293b28a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:21.118161 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e822ce8-4435-4290-8589-70b8293b28a6 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:21.118445 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e822ce8-4435-4290-8589-70b8293b28a6 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:21.118721 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e822ce8-4435-4290-8589-70b8293b28a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:21.119327 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cdd4fa-2830-4663-b77a-8dd959b3a024 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:21.119570 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e822ce8-4435-4290-8589-70b8293b28a6 None admin] RBAC: Adding query filter params (role.id=b842db64da3a4644945d0a941a9a9285, scope.project.id=0911a024287e430ea6ee015389f0c440, user.id=0f1b0e2b025d4eceaa90e1616d0a9db8) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:51:21.119886 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e822ce8-4435-4290-8589-70b8293b28a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:21.121581 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e822ce8-4435-4290-8589-70b8293b28a6 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:21.131887 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 523/1048] 10.222.0.52 () {56 vars in 1374 bytes} [Sat May 14 20:51:20 2022] GET /identity/v3/role_assignments?user.id=0f1b0e2b025d4eceaa90e1616d0a9db8&scope.project.id=0911a024287e430ea6ee015389f0c440&role.id=b842db64da3a4644945d0a941a9a9285 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:51:21.154878 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d585984-b0e1-4c98-af6b-b0cb1319cd25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:21.155600 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d585984-b0e1-4c98-af6b-b0cb1319cd25 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:21.155884 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d585984-b0e1-4c98-af6b-b0cb1319cd25 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:21.156726 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d585984-b0e1-4c98-af6b-b0cb1319cd25 None admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:21.157555 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d585984-b0e1-4c98-af6b-b0cb1319cd25 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:51:21.157861 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d585984-b0e1-4c98-af6b-b0cb1319cd25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:21.159257 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d585984-b0e1-4c98-af6b-b0cb1319cd25 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:21.173525 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 526/1049] 10.222.0.52 () {56 vars in 1099 bytes} [Sat May 14 20:51:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:51:21.175421 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e822ce8-4435-4290-8589-70b8293b28a6 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:21.280787 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e822ce8-4435-4290-8589-70b8293b28a6 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:21.321997 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ebf3ca-f637-4fc4-9f50-d806c7886930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:21.322868 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ebf3ca-f637-4fc4-9f50-d806c7886930 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:21.323151 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ebf3ca-f637-4fc4-9f50-d806c7886930 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:21.323430 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ebf3ca-f637-4fc4-9f50-d806c7886930 None admin] PATH_INFO: `/v3/users/0559aaea2bd94110a055838f393c59ad` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:21.337647 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ebf3ca-f637-4fc4-9f50-d806c7886930 None admin] RBAC: Authorizing `identity:get_user(user_id=0559aaea2bd94110a055838f393c59ad)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:21.339107 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ebf3ca-f637-4fc4-9f50-d806c7886930 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:21.340960 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 524/1050] 10.222.0.52 () {56 vars in 1177 bytes} [Sat May 14 20:51:21 2022] GET /identity/v3/users/0559aaea2bd94110a055838f393c59ad => generated 285 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:51:21.357331 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d585984-b0e1-4c98-af6b-b0cb1319cd25 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:21.462673 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d585984-b0e1-4c98-af6b-b0cb1319cd25 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:21.495746 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd75999f-0c9d-497b-983e-f786dc3ed49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:21.496904 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd75999f-0c9d-497b-983e-f786dc3ed49b None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:21.497369 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd75999f-0c9d-497b-983e-f786dc3ed49b None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:21.497845 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd75999f-0c9d-497b-983e-f786dc3ed49b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:21.564603 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd75999f-0c9d-497b-983e-f786dc3ed49b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:21.566289 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd75999f-0c9d-497b-983e-f786dc3ed49b None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:21.662546 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 527/1051] 10.222.0.52 () {58 vars in 1282 bytes} [Sat May 14 20:51:21 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 14 20:51:21.668273 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ebf3ca-f637-4fc4-9f50-d806c7886930 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:21.771442 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ebf3ca-f637-4fc4-9f50-d806c7886930 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:21.811676 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a108fbb5-e4f0-45b6-bfa0-b023696c0017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:21.813190 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108fbb5-e4f0-45b6-bfa0-b023696c0017 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:21.813485 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108fbb5-e4f0-45b6-bfa0-b023696c0017 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:21.813764 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108fbb5-e4f0-45b6-bfa0-b023696c0017 None admin] PATH_INFO: `/v3/projects/8572729d346a40f880487d1543795db1` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:21.815307 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a108fbb5-e4f0-45b6-bfa0-b023696c0017 None admin] RBAC: Authorizing `identity:get_project(project_id=8572729d346a40f880487d1543795db1)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:21.816782 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a108fbb5-e4f0-45b6-bfa0-b023696c0017 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:21.818802 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 525/1052] 10.222.0.52 () {56 vars in 1186 bytes} [Sat May 14 20:51:21 2022] GET /identity/v3/projects/8572729d346a40f880487d1543795db1 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:51:21.825217 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd75999f-0c9d-497b-983e-f786dc3ed49b None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:21.929593 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd75999f-0c9d-497b-983e-f786dc3ed49b None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:21.964828 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350889cf-4d5a-407f-80d1-9db187a80d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:21.966268 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350889cf-4d5a-407f-80d1-9db187a80d52 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:21.966767 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350889cf-4d5a-407f-80d1-9db187a80d52 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:21.967287 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350889cf-4d5a-407f-80d1-9db187a80d52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:21.968355 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350889cf-4d5a-407f-80d1-9db187a80d52 None admin] RBAC: Adding query filter params (role.id=24c463e2b4d44dd28cd2723a69a8ed2e, scope.project.id=8572729d346a40f880487d1543795db1, user.id=0559aaea2bd94110a055838f393c59ad) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:51:21.969574 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350889cf-4d5a-407f-80d1-9db187a80d52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:21.971210 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350889cf-4d5a-407f-80d1-9db187a80d52 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:21.977140 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 528/1053] 10.222.0.52 () {56 vars in 1374 bytes} [Sat May 14 20:51:21 2022] GET /identity/v3/role_assignments?user.id=0559aaea2bd94110a055838f393c59ad&scope.project.id=8572729d346a40f880487d1543795db1&role.id=24c463e2b4d44dd28cd2723a69a8ed2e => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:51:22.011635 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97163a-365b-482e-ba2e-acf67d8f86a5 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:22.011998 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97163a-365b-482e-ba2e-acf67d8f86a5 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:22.012205 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97163a-365b-482e-ba2e-acf67d8f86a5 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:22.014013 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 526/1054] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:51:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:51:22.021321 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6d761-f715-4a9e-b700-640a7c409966 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:22.021790 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6d761-f715-4a9e-b700-640a7c409966 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:22.022231 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6d761-f715-4a9e-b700-640a7c409966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:22.044571 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-80e6d761-f715-4a9e-b700-640a7c409966 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:51:22.045819 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-80e6d761-f715-4a9e-b700-640a7c409966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:51:22.117253 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 529/1055] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:51:22 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 20:51:22.142665 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d97163a-365b-482e-ba2e-acf67d8f86a5 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:22.245167 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d97163a-365b-482e-ba2e-acf67d8f86a5 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:22.280974 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d27a79-4060-4ee9-8866-036a6e3439f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:22.281848 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d27a79-4060-4ee9-8866-036a6e3439f5 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:22.282134 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d27a79-4060-4ee9-8866-036a6e3439f5 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:22.282465 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d27a79-4060-4ee9-8866-036a6e3439f5 None admin] PATH_INFO: `/v3/services/image` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:22.283114 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d27a79-4060-4ee9-8866-036a6e3439f5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:22.284546 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d27a79-4060-4ee9-8866-036a6e3439f5 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:22.296019 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-a5d27a79-4060-4ee9-8866-036a6e3439f5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 14 20:51:22.296019 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:51:22.296019 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 14 20:51:22.296019 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 14 20:51:22.296019 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 14 20:51:22.296019 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 14 20:51:22.296019 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 14 20:51:22.296019 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 20:51:22.296019 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 14 20:51:22.296019 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:51:22.296019 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 20:51:22.296019 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:51:22.296019 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:51:22.296019 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:51:22.296019 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:51:22.296019 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:51:22.296019 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:51:22.303402 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:51:22.303402 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:51:22.303402 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:51:22.303402 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:51:22.303402 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:51:22.303402 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:51:22.303402 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 14 20:51:22.303402 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_service(service_id) May 14 20:51:22.303402 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 14 20:51:22.303402 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 14 20:51:22.303402 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:51:22.303402 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:51:22.303402 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:51:22.303402 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:51:22.303402 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:51:22.303402 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:51:22.304530 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:51:22.304530 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:51:22.304530 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:51:22.304530 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:51:22.304530 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:51:22.304530 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:51:22.304530 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:51:22.304530 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:51:22.304530 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:51:22.304530 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:51:22.304530 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 14 20:51:22.304530 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 20:51:22.304530 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 14 20:51:22.304530 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:51:22.304530 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 527/1056] 10.222.0.52 () {56 vars in 1105 bytes} [Sat May 14 20:51:22 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:51:22.305344 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e6d761-f715-4a9e-b700-640a7c409966 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:22.402971 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e6d761-f715-4a9e-b700-640a7c409966 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:22.441073 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec50879-a56f-4bc7-aea9-4d4fc482ab51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:22.441741 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec50879-a56f-4bc7-aea9-4d4fc482ab51 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:22.442045 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec50879-a56f-4bc7-aea9-4d4fc482ab51 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:22.442381 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec50879-a56f-4bc7-aea9-4d4fc482ab51 None admin] PATH_INFO: `/v3/services` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:22.443076 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec50879-a56f-4bc7-aea9-4d4fc482ab51 None admin] RBAC: Adding query filter params (name=image) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:51:22.443378 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec50879-a56f-4bc7-aea9-4d4fc482ab51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:22.445150 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec50879-a56f-4bc7-aea9-4d4fc482ab51 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:22.451069 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 530/1057] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:51:22 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:51:22.458300 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d27a79-4060-4ee9-8866-036a6e3439f5 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:22.561948 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d27a79-4060-4ee9-8866-036a6e3439f5 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:22.594652 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb933fb-ed52-455b-9ad2-255a184b4c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:22.595314 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb933fb-ed52-455b-9ad2-255a184b4c3a None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:22.595633 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb933fb-ed52-455b-9ad2-255a184b4c3a None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:22.595913 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb933fb-ed52-455b-9ad2-255a184b4c3a None admin] PATH_INFO: `/v3/services` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:22.596608 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb933fb-ed52-455b-9ad2-255a184b4c3a None admin] RBAC: Adding query filter params (type=image) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:51:22.596915 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb933fb-ed52-455b-9ad2-255a184b4c3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:22.598279 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb933fb-ed52-455b-9ad2-255a184b4c3a None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:22.603174 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 528/1058] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:51:22 2022] GET /identity/v3/services?type=image => generated 350 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:51:22.608593 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec50879-a56f-4bc7-aea9-4d4fc482ab51 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:22.705719 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec50879-a56f-4bc7-aea9-4d4fc482ab51 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:22.740305 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdab68fc-6ed1-4366-a0a6-7d1c704e3845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:22.740966 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab68fc-6ed1-4366-a0a6-7d1c704e3845 None admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:22.741249 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab68fc-6ed1-4366-a0a6-7d1c704e3845 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:22.741525 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab68fc-6ed1-4366-a0a6-7d1c704e3845 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:22.742270 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdab68fc-6ed1-4366-a0a6-7d1c704e3845 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:22.743664 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdab68fc-6ed1-4366-a0a6-7d1c704e3845 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:22.823506 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 531/1059] 10.222.0.52 () {60 vars in 1144 bytes} [Sat May 14 20:51:22 2022] POST /identity/v3/endpoints => generated 327 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 20:51:23.444235 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5630e0-5d49-41e7-8f62-5851a903b364 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:23.444784 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5630e0-5d49-41e7-8f62-5851a903b364 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:23.444784 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5630e0-5d49-41e7-8f62-5851a903b364 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:23.446355 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 529/1060] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:51:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:51:23.451291 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b3dd9c-bf54-4c65-a2c2-5a57d1930601 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:23.451864 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b3dd9c-bf54-4c65-a2c2-5a57d1930601 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:23.452033 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b3dd9c-bf54-4c65-a2c2-5a57d1930601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:23.469736 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-15b3dd9c-bf54-4c65-a2c2-5a57d1930601 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:51:23.470995 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-15b3dd9c-bf54-4c65-a2c2-5a57d1930601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:51:23.545291 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 532/1061] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:51:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 14 20:51:23.569106 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5630e0-5d49-41e7-8f62-5851a903b364 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:23.668257 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5630e0-5d49-41e7-8f62-5851a903b364 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:23.706092 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be565f1c-be8d-4095-a2e6-f0d5dfdca729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:23.706878 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be565f1c-be8d-4095-a2e6-f0d5dfdca729 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:23.707155 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be565f1c-be8d-4095-a2e6-f0d5dfdca729 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:23.707429 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be565f1c-be8d-4095-a2e6-f0d5dfdca729 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:23.718391 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be565f1c-be8d-4095-a2e6-f0d5dfdca729 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:51:23.726635 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-be565f1c-be8d-4095-a2e6-f0d5dfdca729 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 14 20:51:23.726635 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:51:23.726635 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:51:23.726635 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:51:23.726635 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:51:23.726635 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:51:23.726635 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:51:23.726635 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:51:23.726635 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:51:23.726635 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:51:23.726635 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:51:23.726635 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:51:23.726635 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:51:23.726635 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:51:23.726635 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:51:23.726635 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:51:23.727711 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:51:23.727711 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:51:23.727711 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:51:23.727711 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:51:23.727711 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:51:23.727711 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:51:23.727711 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:51:23.727711 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:51:23.727711 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:51:23.727711 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:51:23.727711 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:51:23.727711 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:51:23.727711 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:51:23.727711 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:51:23.727711 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:51:23.727711 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:51:23.728741 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:51:23.728741 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:51:23.728741 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:51:23.728741 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:51:23.728741 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:51:23.728741 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:51:23.728741 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:51:23.728741 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:51:23.728741 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:51:23.728741 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:51:23.728741 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 14 20:51:23.728741 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:51:23.731550 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 530/1062] 10.222.0.52 () {56 vars in 1120 bytes} [Sat May 14 20:51:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:51:23.734079 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b3dd9c-bf54-4c65-a2c2-5a57d1930601 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:23.834675 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b3dd9c-bf54-4c65-a2c2-5a57d1930601 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:23.866527 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a40982-b4a1-441b-93bc-9bba4b127c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:23.867187 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a40982-b4a1-441b-93bc-9bba4b127c5b None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:23.867466 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a40982-b4a1-441b-93bc-9bba4b127c5b None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:23.867763 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a40982-b4a1-441b-93bc-9bba4b127c5b None admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:23.868487 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a40982-b4a1-441b-93bc-9bba4b127c5b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:51:23.868788 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a40982-b4a1-441b-93bc-9bba4b127c5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:23.870138 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a40982-b4a1-441b-93bc-9bba4b127c5b None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:23.879013 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 533/1063] 10.222.0.52 () {56 vars in 1115 bytes} [Sat May 14 20:51:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:51:23.884655 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be565f1c-be8d-4095-a2e6-f0d5dfdca729 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:23.989799 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be565f1c-be8d-4095-a2e6-f0d5dfdca729 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:24.024468 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd04ae7f-3985-4ab6-90a3-441a16ec35dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:24.025248 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04ae7f-3985-4ab6-90a3-441a16ec35dd None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:24.025526 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04ae7f-3985-4ab6-90a3-441a16ec35dd None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:24.025795 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04ae7f-3985-4ab6-90a3-441a16ec35dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:24.035941 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd04ae7f-3985-4ab6-90a3-441a16ec35dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:24.037379 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd04ae7f-3985-4ab6-90a3-441a16ec35dd None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:24.055105 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-dd04ae7f-3985-4ab6-90a3-441a16ec35dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:51:24.055105 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:51:24.055105 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:51:24.055105 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:51:24.055105 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:51:24.055105 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:51:24.055105 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:51:24.055105 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:51:24.055105 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:51:24.055105 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:51:24.055105 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:51:24.055105 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:51:24.055105 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:51:24.055105 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:51:24.055105 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:51:24.056143 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:51:24.056143 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:51:24.056143 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:51:24.056143 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:51:24.056143 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:51:24.056143 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:51:24.056143 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:51:24.056143 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:51:24.056143 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:51:24.056143 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:51:24.056143 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:51:24.056143 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:51:24.056143 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:51:24.056143 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:51:24.056143 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:51:24.056143 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:51:24.056143 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:51:24.057078 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 20:51:24.057078 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:51:24.057078 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:51:24.057078 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:51:24.059555 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 531/1064] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:51:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:51:24.062066 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a40982-b4a1-441b-93bc-9bba4b127c5b None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:24.165614 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a40982-b4a1-441b-93bc-9bba4b127c5b None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:24.197598 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f4b34a-55fd-4dc7-a3ee-6d939b84ffa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:24.198037 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f4b34a-55fd-4dc7-a3ee-6d939b84ffa0 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:24.198317 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f4b34a-55fd-4dc7-a3ee-6d939b84ffa0 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:24.198590 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f4b34a-55fd-4dc7-a3ee-6d939b84ffa0 None admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:24.199297 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f4b34a-55fd-4dc7-a3ee-6d939b84ffa0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:51:24.199630 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f4b34a-55fd-4dc7-a3ee-6d939b84ffa0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:24.200980 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f4b34a-55fd-4dc7-a3ee-6d939b84ffa0 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:24.213410 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 534/1065] 10.222.0.52 () {56 vars in 1109 bytes} [Sat May 14 20:51:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:51:24.218859 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd04ae7f-3985-4ab6-90a3-441a16ec35dd None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:24.307784 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5491e2-6f53-4604-8331-dd8aa490be39 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:24.307972 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5491e2-6f53-4604-8331-dd8aa490be39 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:24.308253 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5491e2-6f53-4604-8331-dd8aa490be39 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:24.309934 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 535/1066] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:51:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 14 20:51:24.314729 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83764b86-0767-444d-9e89-b10643779ac2 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:24.315018 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83764b86-0767-444d-9e89-b10643779ac2 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:24.315299 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83764b86-0767-444d-9e89-b10643779ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:24.315546 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd04ae7f-3985-4ab6-90a3-441a16ec35dd None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:24.333103 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-83764b86-0767-444d-9e89-b10643779ac2 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:51:24.334284 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-83764b86-0767-444d-9e89-b10643779ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:51:24.350857 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439454c0-186b-405a-a6d4-6254af64a380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:24.351678 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439454c0-186b-405a-a6d4-6254af64a380 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:24.351959 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439454c0-186b-405a-a6d4-6254af64a380 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:24.352236 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439454c0-186b-405a-a6d4-6254af64a380 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:24.359307 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439454c0-186b-405a-a6d4-6254af64a380 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:24.360833 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439454c0-186b-405a-a6d4-6254af64a380 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:24.375400 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-439454c0-186b-405a-a6d4-6254af64a380 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 14 20:51:24.375400 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:51:24.375400 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:51:24.375400 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:51:24.375400 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:51:24.375400 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:51:24.375400 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:51:24.375400 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:51:24.375400 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:51:24.375400 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:51:24.375400 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:51:24.375400 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:51:24.375400 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 14 20:51:24.375400 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_user(user_id) May 14 20:51:24.375400 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 14 20:51:24.375400 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 14 20:51:24.376428 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:51:24.376428 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:51:24.376428 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 20:51:24.376428 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 20:51:24.376428 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 14 20:51:24.376428 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 20:51:24.376428 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:51:24.376428 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:51:24.376428 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:51:24.376428 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:51:24.376428 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:51:24.376428 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:51:24.376428 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:51:24.376428 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:51:24.376428 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:51:24.376428 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:51:24.376428 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:51:24.376428 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:51:24.377395 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:51:24.377395 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:51:24.377395 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 14 20:51:24.377395 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 14 20:51:24.377395 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 14 20:51:24.377395 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 14 20:51:24.377395 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 14 20:51:24.377395 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 14 20:51:24.377395 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 14 20:51:24.377395 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:51:24.377395 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 532/1067] 10.222.0.52 () {56 vars in 1093 bytes} [Sat May 14 20:51:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:51:24.382264 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439454c0-186b-405a-a6d4-6254af64a380 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:24.409230 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 536/1068] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:51:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 14 20:51:24.432873 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83764b86-0767-444d-9e89-b10643779ac2 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:24.479647 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439454c0-186b-405a-a6d4-6254af64a380 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:24.517119 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38a145a-1da2-47cc-87f1-4291bf470fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:24.518731 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a145a-1da2-47cc-87f1-4291bf470fac None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:24.518731 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a145a-1da2-47cc-87f1-4291bf470fac None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:24.518731 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a145a-1da2-47cc-87f1-4291bf470fac None admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:24.519161 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38a145a-1da2-47cc-87f1-4291bf470fac None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:51:24.519496 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38a145a-1da2-47cc-87f1-4291bf470fac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:24.520931 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38a145a-1da2-47cc-87f1-4291bf470fac None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:24.531671 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83764b86-0767-444d-9e89-b10643779ac2 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:24.538564 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 533/1069] 10.222.0.52 () {56 vars in 1133 bytes} [Sat May 14 20:51:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:51:24.544123 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38a145a-1da2-47cc-87f1-4291bf470fac None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:24.570283 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b590e6-63b0-4eb5-831d-a4f6573e2a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:24.570283 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b590e6-63b0-4eb5-831d-a4f6573e2a05 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:24.570283 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b590e6-63b0-4eb5-831d-a4f6573e2a05 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:24.570283 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b590e6-63b0-4eb5-831d-a4f6573e2a05 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:24.579861 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b590e6-63b0-4eb5-831d-a4f6573e2a05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:51:24.587578 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-63b590e6-63b0-4eb5-831d-a4f6573e2a05 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 14 20:51:24.587578 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:51:24.587578 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:51:24.587578 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:51:24.587578 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:51:24.587578 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:51:24.587578 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:51:24.587578 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:51:24.587578 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:51:24.587578 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:51:24.587578 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:51:24.587578 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:51:24.587578 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:51:24.587578 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:51:24.587578 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:51:24.587578 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:51:24.588538 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:51:24.588538 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:51:24.588538 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:51:24.588538 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:51:24.588538 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:51:24.588538 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:51:24.588538 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:51:24.588538 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:51:24.588538 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:51:24.588538 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:51:24.588538 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:51:24.588538 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:51:24.588538 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:51:24.588538 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:51:24.588538 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:51:24.588538 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:51:24.590041 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:51:24.590041 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:51:24.590041 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:51:24.590041 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:51:24.590041 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:51:24.590041 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:51:24.590041 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:51:24.590041 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:51:24.590041 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:51:24.590041 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:51:24.590041 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 14 20:51:24.590041 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:51:24.590041 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 537/1070] 10.222.0.52 () {56 vars in 1096 bytes} [Sat May 14 20:51:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 20:51:24.595314 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b590e6-63b0-4eb5-831d-a4f6573e2a05 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:24.651152 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38a145a-1da2-47cc-87f1-4291bf470fac None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:24.695364 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b786d-6816-4d83-b0c6-82ee3c2c3de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:24.696204 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b786d-6816-4d83-b0c6-82ee3c2c3de3 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:24.696485 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b786d-6816-4d83-b0c6-82ee3c2c3de3 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:24.696756 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b786d-6816-4d83-b0c6-82ee3c2c3de3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:24.707144 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2b786d-6816-4d83-b0c6-82ee3c2c3de3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:24.707310 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b590e6-63b0-4eb5-831d-a4f6573e2a05 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:24.708686 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2b786d-6816-4d83-b0c6-82ee3c2c3de3 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:24.726504 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-0a2b786d-6816-4d83-b0c6-82ee3c2c3de3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:51:24.726504 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:51:24.726504 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:51:24.726504 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:51:24.726504 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:51:24.726504 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:51:24.726504 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:51:24.726504 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:51:24.726504 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:51:24.726504 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:51:24.726504 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:51:24.726504 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:51:24.726504 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:51:24.726504 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:51:24.726504 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:51:24.732168 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:51:24.732168 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:51:24.732168 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:51:24.732168 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:51:24.732168 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:51:24.732168 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:51:24.732168 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:51:24.732168 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:51:24.732168 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:51:24.732168 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:51:24.732168 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:51:24.732168 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:51:24.732168 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:51:24.732168 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:51:24.732168 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:51:24.732168 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:51:24.732168 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:51:24.733343 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 20:51:24.733343 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:51:24.733343 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:51:24.733343 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:51:24.733343 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 534/1071] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:51:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:51:24.733343 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b786d-6816-4d83-b0c6-82ee3c2c3de3 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:24.748069 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc600f2-8201-4110-af7d-bb6a2f2634bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:24.749491 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc600f2-8201-4110-af7d-bb6a2f2634bb None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:24.750136 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc600f2-8201-4110-af7d-bb6a2f2634bb None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:24.750865 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc600f2-8201-4110-af7d-bb6a2f2634bb None admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:24.751640 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc600f2-8201-4110-af7d-bb6a2f2634bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:51:24.755927 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc600f2-8201-4110-af7d-bb6a2f2634bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:24.757331 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc600f2-8201-4110-af7d-bb6a2f2634bb None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:24.771080 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 538/1072] 10.222.0.52 () {56 vars in 1099 bytes} [Sat May 14 20:51:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:51:24.772212 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc600f2-8201-4110-af7d-bb6a2f2634bb None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:24.839875 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b786d-6816-4d83-b0c6-82ee3c2c3de3 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:24.869161 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc600f2-8201-4110-af7d-bb6a2f2634bb None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:24.877507 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c609049f-d01c-4fa2-939e-18e66f569cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:24.878168 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c609049f-d01c-4fa2-939e-18e66f569cd6 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:24.878452 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c609049f-d01c-4fa2-939e-18e66f569cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:24.878727 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c609049f-d01c-4fa2-939e-18e66f569cd6 None admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:24.879433 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c609049f-d01c-4fa2-939e-18e66f569cd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:51:24.879774 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c609049f-d01c-4fa2-939e-18e66f569cd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:24.881158 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c609049f-d01c-4fa2-939e-18e66f569cd6 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:24.897340 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 535/1073] 10.222.0.52 () {56 vars in 1109 bytes} [Sat May 14 20:51:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:51:24.898396 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c609049f-d01c-4fa2-939e-18e66f569cd6 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:24.903137 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea609b3-73ca-4ead-a337-0725a73bedd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:24.904033 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea609b3-73ca-4ead-a337-0725a73bedd7 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:24.904314 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea609b3-73ca-4ead-a337-0725a73bedd7 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:24.904588 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea609b3-73ca-4ead-a337-0725a73bedd7 None admin] PATH_INFO: `/v3/users/0559aaea2bd94110a055838f393c59ad` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:24.905772 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea609b3-73ca-4ead-a337-0725a73bedd7 None admin] RBAC: Authorizing `identity:get_user(user_id=0559aaea2bd94110a055838f393c59ad)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:24.907407 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea609b3-73ca-4ead-a337-0725a73bedd7 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:24.909405 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 539/1074] 10.222.0.52 () {56 vars in 1177 bytes} [Sat May 14 20:51:24 2022] GET /identity/v3/users/0559aaea2bd94110a055838f393c59ad => generated 285 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:51:24.915403 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea609b3-73ca-4ead-a337-0725a73bedd7 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:25.006865 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c609049f-d01c-4fa2-939e-18e66f569cd6 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:25.025617 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea609b3-73ca-4ead-a337-0725a73bedd7 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:25.041872 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2421cc42-dc06-42c1-9927-7206f2176ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:25.042663 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421cc42-dc06-42c1-9927-7206f2176ab2 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:25.042946 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421cc42-dc06-42c1-9927-7206f2176ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:25.043227 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421cc42-dc06-42c1-9927-7206f2176ab2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:25.050500 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2421cc42-dc06-42c1-9927-7206f2176ab2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:25.051992 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2421cc42-dc06-42c1-9927-7206f2176ab2 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:25.060143 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550c2360-837a-4496-8eec-53d2bbf90f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:25.060974 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c2360-837a-4496-8eec-53d2bbf90f49 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:25.061256 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c2360-837a-4496-8eec-53d2bbf90f49 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:25.061601 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c2360-837a-4496-8eec-53d2bbf90f49 None admin] PATH_INFO: `/v3/projects/8572729d346a40f880487d1543795db1` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:25.063493 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550c2360-837a-4496-8eec-53d2bbf90f49 None admin] RBAC: Authorizing `identity:get_project(project_id=8572729d346a40f880487d1543795db1)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:25.065028 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550c2360-837a-4496-8eec-53d2bbf90f49 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:25.066578 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-2421cc42-dc06-42c1-9927-7206f2176ab2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 14 20:51:25.066578 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:51:25.066578 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:51:25.066578 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:51:25.066578 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:51:25.066578 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:51:25.066578 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:51:25.066578 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:51:25.066578 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:51:25.066578 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:51:25.066578 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:51:25.066578 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:51:25.066578 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 14 20:51:25.066578 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_project(project_id) May 14 20:51:25.066578 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 14 20:51:25.067920 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 14 20:51:25.067920 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:51:25.067920 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:51:25.067920 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:51:25.067920 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:51:25.067920 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:51:25.067920 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:51:25.067920 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:51:25.067920 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:51:25.067920 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:51:25.067920 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:51:25.067920 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:51:25.067920 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:51:25.067920 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:51:25.067920 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:51:25.067920 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:51:25.067920 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:51:25.068857 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 14 20:51:25.068857 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 14 20:51:25.068857 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 20:51:25.068857 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 20:51:25.068857 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 20:51:25.068857 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 20:51:25.068857 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 14 20:51:25.068857 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:51:25.069308 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 540/1075] 10.222.0.52 () {56 vars in 1186 bytes} [Sat May 14 20:51:24 2022] GET /identity/v3/projects/8572729d346a40f880487d1543795db1 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:51:25.071354 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 536/1076] 10.222.0.52 () {56 vars in 1111 bytes} [Sat May 14 20:51:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 20:51:25.073847 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550c2360-837a-4496-8eec-53d2bbf90f49 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:25.073968 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2421cc42-dc06-42c1-9927-7206f2176ab2 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:25.210467 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2421cc42-dc06-42c1-9927-7206f2176ab2 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:25.211489 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550c2360-837a-4496-8eec-53d2bbf90f49 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:25.243426 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9e5fc7-3543-4715-94a2-551f5f8543e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:25.244105 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e5fc7-3543-4715-94a2-551f5f8543e0 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:25.244313 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d452abb-cbb1-4288-925f-dd5abc04a46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:25.244424 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e5fc7-3543-4715-94a2-551f5f8543e0 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:25.244645 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e5fc7-3543-4715-94a2-551f5f8543e0 None admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:25.245187 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d452abb-cbb1-4288-925f-dd5abc04a46a None admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:25.245440 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9e5fc7-3543-4715-94a2-551f5f8543e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:51:25.245575 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d452abb-cbb1-4288-925f-dd5abc04a46a None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:25.245728 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d452abb-cbb1-4288-925f-dd5abc04a46a None admin] PATH_INFO: `/v3/projects/8572729d346a40f880487d1543795db1/users/0559aaea2bd94110a055838f393c59ad/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:25.245842 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9e5fc7-3543-4715-94a2-551f5f8543e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:25.247402 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9e5fc7-3543-4715-94a2-551f5f8543e0 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:25.247924 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d452abb-cbb1-4288-925f-dd5abc04a46a None admin] RBAC: Authorizing `identity:create_grant(project_id=8572729d346a40f880487d1543795db1, user_id=0559aaea2bd94110a055838f393c59ad, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:25.249318 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d452abb-cbb1-4288-925f-dd5abc04a46a None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:25.258421 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 537/1077] 10.222.0.52 () {56 vars in 1148 bytes} [Sat May 14 20:51:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:51:25.259802 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89accc19-b305-4a97-a704-6239259fcb65 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:25.260085 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89accc19-b305-4a97-a704-6239259fcb65 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:25.260402 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89accc19-b305-4a97-a704-6239259fcb65 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:25.261554 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 538/1078] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:51:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:51:25.264255 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89accc19-b305-4a97-a704-6239259fcb65 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:25.324677 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 541/1079] 10.222.0.52 () {58 vars in 1439 bytes} [Sat May 14 20:51:25 2022] PUT /identity/v3/projects/8572729d346a40f880487d1543795db1/users/0559aaea2bd94110a055838f393c59ad/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 20:51:25.326058 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4be1b8-1d09-4811-b862-efe44d5b8fb1 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:25.326349 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4be1b8-1d09-4811-b862-efe44d5b8fb1 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:25.326622 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4be1b8-1d09-4811-b862-efe44d5b8fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:25.344903 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-3d4be1b8-1d09-4811-b862-efe44d5b8fb1 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:51:25.346142 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-3d4be1b8-1d09-4811-b862-efe44d5b8fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:51:25.367576 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89accc19-b305-4a97-a704-6239259fcb65 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:25.404034 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a757a11-9474-4a5c-ba97-4e8952a89c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:25.404936 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a757a11-9474-4a5c-ba97-4e8952a89c88 None admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:25.405214 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a757a11-9474-4a5c-ba97-4e8952a89c88 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:25.405543 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a757a11-9474-4a5c-ba97-4e8952a89c88 None admin] PATH_INFO: `/v3/projects/0911a024287e430ea6ee015389f0c440/users/0f1b0e2b025d4eceaa90e1616d0a9db8/roles/b842db64da3a4644945d0a941a9a9285` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:25.408497 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a757a11-9474-4a5c-ba97-4e8952a89c88 None admin] RBAC: Authorizing `identity:create_grant(project_id=0911a024287e430ea6ee015389f0c440, user_id=0f1b0e2b025d4eceaa90e1616d0a9db8, role_id=b842db64da3a4644945d0a941a9a9285)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:25.410023 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a757a11-9474-4a5c-ba97-4e8952a89c88 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:25.420623 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 542/1080] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:51:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 20:51:25.445032 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4be1b8-1d09-4811-b862-efe44d5b8fb1 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:25.480372 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 539/1081] 10.222.0.52 () {58 vars in 1439 bytes} [Sat May 14 20:51:25 2022] PUT /identity/v3/projects/0911a024287e430ea6ee015389f0c440/users/0f1b0e2b025d4eceaa90e1616d0a9db8/roles/b842db64da3a4644945d0a941a9a9285 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 20:51:25.556337 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4be1b8-1d09-4811-b862-efe44d5b8fb1 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:25.592583 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b02d80-87bb-4c85-9a2c-d0441825f632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:25.593377 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b02d80-87bb-4c85-9a2c-d0441825f632 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:25.593706 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b02d80-87bb-4c85-9a2c-d0441825f632 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:25.594053 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b02d80-87bb-4c85-9a2c-d0441825f632 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:25.664530 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b02d80-87bb-4c85-9a2c-d0441825f632 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:25.667680 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b02d80-87bb-4c85-9a2c-d0441825f632 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:25.767574 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 543/1082] 10.222.0.52 () {58 vars in 1282 bytes} [Sat May 14 20:51:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 14 20:51:25.773340 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a757a11-9474-4a5c-ba97-4e8952a89c88 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:25.875671 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a757a11-9474-4a5c-ba97-4e8952a89c88 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:25.909590 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c904c6-ffa7-4a79-aec0-f01dd9518139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:25.910381 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c904c6-ffa7-4a79-aec0-f01dd9518139 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:25.910660 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c904c6-ffa7-4a79-aec0-f01dd9518139 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:25.910930 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c904c6-ffa7-4a79-aec0-f01dd9518139 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:25.922831 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c904c6-ffa7-4a79-aec0-f01dd9518139 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:25.926776 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c904c6-ffa7-4a79-aec0-f01dd9518139 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:25.944514 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-51c904c6-ffa7-4a79-aec0-f01dd9518139 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:51:25.944514 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:51:25.944514 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:51:25.944514 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:51:25.944514 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:51:25.944514 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:51:25.944514 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:51:25.944514 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:51:25.944514 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:51:25.944514 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:51:25.944514 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:51:25.944514 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:51:25.944514 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:51:25.944514 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:51:25.944514 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:51:25.945460 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:51:25.945460 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:51:25.945460 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:51:25.945460 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:51:25.945460 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:51:25.945460 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:51:25.945460 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:51:25.945460 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:51:25.945460 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:51:25.945460 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:51:25.945460 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:51:25.945460 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:51:25.945460 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:51:25.945460 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:51:25.945460 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:51:25.945460 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:51:25.945460 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:51:25.946377 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 20:51:25.946377 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:51:25.946377 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:51:25.946377 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:51:25.950651 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 540/1083] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:51:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:51:25.952132 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b02d80-87bb-4c85-9a2c-d0441825f632 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:26.053615 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b02d80-87bb-4c85-9a2c-d0441825f632 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:26.089370 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25dde38-1bfb-48a5-92bd-ca9874e5b14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:26.090404 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25dde38-1bfb-48a5-92bd-ca9874e5b14d None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:26.090897 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25dde38-1bfb-48a5-92bd-ca9874e5b14d None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:26.091379 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25dde38-1bfb-48a5-92bd-ca9874e5b14d None admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:26.092349 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25dde38-1bfb-48a5-92bd-ca9874e5b14d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:51:26.092959 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25dde38-1bfb-48a5-92bd-ca9874e5b14d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:26.094562 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25dde38-1bfb-48a5-92bd-ca9874e5b14d None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:26.106887 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 544/1084] 10.222.0.52 () {56 vars in 1109 bytes} [Sat May 14 20:51:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:51:27.636586 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c7431-5614-479b-bb18-0481de13460c None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:27.637111 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c7431-5614-479b-bb18-0481de13460c None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:27.637111 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c7431-5614-479b-bb18-0481de13460c None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:27.638403 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 541/1085] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:51:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:51:27.643911 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a0a715-79d4-4c44-b02a-8bc79e7fc985 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:27.644355 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a0a715-79d4-4c44-b02a-8bc79e7fc985 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:27.644479 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a0a715-79d4-4c44-b02a-8bc79e7fc985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:27.661368 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-c0a0a715-79d4-4c44-b02a-8bc79e7fc985 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:51:27.662543 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c0a0a715-79d4-4c44-b02a-8bc79e7fc985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:51:27.730585 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 545/1086] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:51:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 20:51:27.755599 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5c7431-5614-479b-bb18-0481de13460c None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:27.795803 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db9696-8dcd-44e4-b9c4-186491c7077b None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:27.796098 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db9696-8dcd-44e4-b9c4-186491c7077b None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:27.796413 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db9696-8dcd-44e4-b9c4-186491c7077b None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:27.797780 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 546/1087] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:51:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 14 20:51:27.802625 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679111f0-fadd-4d3e-8051-1d2901421c9f None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:27.802916 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679111f0-fadd-4d3e-8051-1d2901421c9f None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:27.803198 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679111f0-fadd-4d3e-8051-1d2901421c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:27.819122 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-679111f0-fadd-4d3e-8051-1d2901421c9f None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:51:27.820321 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-679111f0-fadd-4d3e-8051-1d2901421c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:51:27.854201 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5c7431-5614-479b-bb18-0481de13460c None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:27.886203 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f5f3d2-a8c0-4998-8f5f-c18725c627cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:27.887035 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f5f3d2-a8c0-4998-8f5f-c18725c627cc None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:27.887263 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f5f3d2-a8c0-4998-8f5f-c18725c627cc None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:27.887360 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 547/1088] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:51:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 14 20:51:27.887628 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f5f3d2-a8c0-4998-8f5f-c18725c627cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:27.899061 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f5f3d2-a8c0-4998-8f5f-c18725c627cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:51:27.907050 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-25f5f3d2-a8c0-4998-8f5f-c18725c627cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 14 20:51:27.907050 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:51:27.907050 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:51:27.907050 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:51:27.907050 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:51:27.907050 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:51:27.907050 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:51:27.907050 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:51:27.907050 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:51:27.907050 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:51:27.907050 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:51:27.907050 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:51:27.907050 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:51:27.907050 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:51:27.907050 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:51:27.907050 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:51:27.908220 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:51:27.908220 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:51:27.908220 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:51:27.908220 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:51:27.908220 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:51:27.908220 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:51:27.908220 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:51:27.908220 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:51:27.908220 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:51:27.908220 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:51:27.908220 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:51:27.908220 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:51:27.908220 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:51:27.908220 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:51:27.908220 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:51:27.908220 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:51:27.909105 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:51:27.909105 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:51:27.909105 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:51:27.909105 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:51:27.909105 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:51:27.909105 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:51:27.909105 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:51:27.909105 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:51:27.909105 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:51:27.909105 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:51:27.909105 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 14 20:51:27.909105 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:51:27.909105 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 542/1089] 10.222.0.52 () {56 vars in 1096 bytes} [Sat May 14 20:51:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:51:27.913997 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679111f0-fadd-4d3e-8051-1d2901421c9f None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:27.915029 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f5f3d2-a8c0-4998-8f5f-c18725c627cc None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:28.008740 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679111f0-fadd-4d3e-8051-1d2901421c9f None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:28.009459 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f5f3d2-a8c0-4998-8f5f-c18725c627cc None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:28.041273 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c7be8a-e5b1-44a5-9e17-78d0b8aa8c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:28.041931 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c7be8a-e5b1-44a5-9e17-78d0b8aa8c7a None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:28.042116 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1862750f-950b-4b59-b784-76d7cec1a189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:28.042231 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c7be8a-e5b1-44a5-9e17-78d0b8aa8c7a None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:28.042469 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c7be8a-e5b1-44a5-9e17-78d0b8aa8c7a None admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:28.042913 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862750f-950b-4b59-b784-76d7cec1a189 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:28.043198 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c7be8a-e5b1-44a5-9e17-78d0b8aa8c7a None admin] RBAC: Adding query filter params (name=admin) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:51:28.043300 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862750f-950b-4b59-b784-76d7cec1a189 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:28.043503 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862750f-950b-4b59-b784-76d7cec1a189 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:28.043595 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c7be8a-e5b1-44a5-9e17-78d0b8aa8c7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:28.044875 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c7be8a-e5b1-44a5-9e17-78d0b8aa8c7a None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:28.053348 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 548/1090] 10.222.0.52 () {56 vars in 1099 bytes} [Sat May 14 20:51:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:51:28.055317 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1862750f-950b-4b59-b784-76d7cec1a189 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:51:28.059074 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c7be8a-e5b1-44a5-9e17-78d0b8aa8c7a None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:28.065983 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-1862750f-950b-4b59-b784-76d7cec1a189 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 14 20:51:28.065983 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:51:28.065983 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:51:28.065983 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:51:28.065983 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:51:28.065983 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:51:28.065983 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:51:28.065983 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:51:28.065983 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:51:28.065983 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:51:28.065983 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:51:28.065983 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:51:28.065983 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:51:28.065983 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:51:28.065983 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:51:28.065983 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:51:28.067172 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:51:28.067172 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:51:28.067172 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:51:28.067172 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:51:28.067172 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:51:28.067172 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:51:28.067172 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:51:28.067172 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:51:28.067172 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:51:28.067172 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:51:28.067172 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:51:28.067172 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:51:28.067172 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:51:28.067172 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:51:28.067172 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:51:28.067172 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:51:28.068278 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:51:28.068278 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:51:28.068278 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:51:28.068278 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:51:28.068278 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:51:28.068278 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:51:28.068278 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:51:28.068278 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:51:28.068278 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:51:28.068278 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:51:28.068278 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 14 20:51:28.068278 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:51:28.068278 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 543/1091] 10.222.0.52 () {56 vars in 1120 bytes} [Sat May 14 20:51:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:51:28.073078 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1862750f-950b-4b59-b784-76d7cec1a189 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:28.157309 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c7be8a-e5b1-44a5-9e17-78d0b8aa8c7a None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:28.170660 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1862750f-950b-4b59-b784-76d7cec1a189 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:28.189778 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a3c4fb-3e74-4625-b17b-fe712943bfa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:28.190637 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a3c4fb-3e74-4625-b17b-fe712943bfa8 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:28.190917 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a3c4fb-3e74-4625-b17b-fe712943bfa8 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:28.191193 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a3c4fb-3e74-4625-b17b-fe712943bfa8 None admin] PATH_INFO: `/v3/users/0559aaea2bd94110a055838f393c59ad` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:28.192413 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a3c4fb-3e74-4625-b17b-fe712943bfa8 None admin] RBAC: Authorizing `identity:get_user(user_id=0559aaea2bd94110a055838f393c59ad)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:28.193832 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a3c4fb-3e74-4625-b17b-fe712943bfa8 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:28.195448 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 549/1092] 10.222.0.52 () {56 vars in 1177 bytes} [Sat May 14 20:51:28 2022] GET /identity/v3/users/0559aaea2bd94110a055838f393c59ad => generated 285 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:51:28.201168 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a3c4fb-3e74-4625-b17b-fe712943bfa8 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:28.204293 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918bcf33-3215-4f05-9f65-97e6dd8e6d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:28.204966 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918bcf33-3215-4f05-9f65-97e6dd8e6d20 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:28.205253 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918bcf33-3215-4f05-9f65-97e6dd8e6d20 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:28.205532 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918bcf33-3215-4f05-9f65-97e6dd8e6d20 None admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:28.206274 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918bcf33-3215-4f05-9f65-97e6dd8e6d20 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:51:28.206581 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918bcf33-3215-4f05-9f65-97e6dd8e6d20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:28.208001 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918bcf33-3215-4f05-9f65-97e6dd8e6d20 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:28.216091 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 544/1093] 10.222.0.52 () {56 vars in 1115 bytes} [Sat May 14 20:51:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:51:28.221973 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918bcf33-3215-4f05-9f65-97e6dd8e6d20 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:28.299394 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a3c4fb-3e74-4625-b17b-fe712943bfa8 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:28.317764 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918bcf33-3215-4f05-9f65-97e6dd8e6d20 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:28.331731 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a2ac9a-2022-45ef-879f-94d467b62d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:28.332369 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a2ac9a-2022-45ef-879f-94d467b62d12 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:28.332659 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a2ac9a-2022-45ef-879f-94d467b62d12 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:28.333036 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a2ac9a-2022-45ef-879f-94d467b62d12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:28.350529 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa5891-94c1-4ae5-b630-9e37ff1fe5b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:28.351311 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa5891-94c1-4ae5-b630-9e37ff1fe5b6 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:28.351628 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa5891-94c1-4ae5-b630-9e37ff1fe5b6 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:28.351904 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa5891-94c1-4ae5-b630-9e37ff1fe5b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:28.362102 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfa5891-94c1-4ae5-b630-9e37ff1fe5b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:28.363573 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfa5891-94c1-4ae5-b630-9e37ff1fe5b6 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:28.380852 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-9bfa5891-94c1-4ae5-b630-9e37ff1fe5b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:51:28.380852 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:51:28.380852 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:51:28.380852 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:51:28.380852 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:51:28.380852 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:51:28.380852 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:51:28.380852 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:51:28.380852 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:51:28.380852 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:51:28.380852 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:51:28.380852 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:51:28.380852 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:51:28.380852 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:51:28.380852 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:51:28.381792 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:51:28.381792 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:51:28.381792 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:51:28.381792 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:51:28.381792 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:51:28.381792 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:51:28.381792 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:51:28.381792 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:51:28.381792 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:51:28.381792 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:51:28.381792 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:51:28.381792 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:51:28.381792 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:51:28.381792 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:51:28.381792 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:51:28.381792 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:51:28.381792 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:51:28.382697 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 20:51:28.382697 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:51:28.382697 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:51:28.382697 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:51:28.382697 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 545/1094] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:51:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 20:51:28.387603 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa5891-94c1-4ae5-b630-9e37ff1fe5b6 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:28.407539 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a2ac9a-2022-45ef-879f-94d467b62d12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:28.409890 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a2ac9a-2022-45ef-879f-94d467b62d12 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:28.482089 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa5891-94c1-4ae5-b630-9e37ff1fe5b6 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:28.506049 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 550/1095] 10.222.0.52 () {58 vars in 1282 bytes} [Sat May 14 20:51:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 14 20:51:28.511824 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a2ac9a-2022-45ef-879f-94d467b62d12 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:28.516509 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cfe578-4812-4a80-b222-0394993693ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:28.517161 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cfe578-4812-4a80-b222-0394993693ee None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:28.517443 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cfe578-4812-4a80-b222-0394993693ee None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:28.517710 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cfe578-4812-4a80-b222-0394993693ee None admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:28.518446 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cfe578-4812-4a80-b222-0394993693ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:51:28.518744 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cfe578-4812-4a80-b222-0394993693ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:28.520122 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cfe578-4812-4a80-b222-0394993693ee None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:28.531525 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 546/1096] 10.222.0.52 () {56 vars in 1109 bytes} [Sat May 14 20:51:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:51:28.537017 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cfe578-4812-4a80-b222-0394993693ee None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:28.607192 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a2ac9a-2022-45ef-879f-94d467b62d12 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:28.631901 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cfe578-4812-4a80-b222-0394993693ee None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:28.640801 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188c527b-4060-4369-948a-70f9989983ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:28.641642 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c527b-4060-4369-948a-70f9989983ad None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:28.641921 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c527b-4060-4369-948a-70f9989983ad None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:28.642193 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c527b-4060-4369-948a-70f9989983ad None admin] PATH_INFO: `/v3/projects/8572729d346a40f880487d1543795db1` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:28.643363 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188c527b-4060-4369-948a-70f9989983ad None admin] RBAC: Authorizing `identity:get_project(project_id=8572729d346a40f880487d1543795db1)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:28.644810 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188c527b-4060-4369-948a-70f9989983ad None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:28.646479 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 551/1097] 10.222.0.52 () {56 vars in 1186 bytes} [Sat May 14 20:51:28 2022] GET /identity/v3/projects/8572729d346a40f880487d1543795db1 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:51:28.652447 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188c527b-4060-4369-948a-70f9989983ad None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:28.666262 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eac482-0631-4ca8-b2d4-66ec8724cf3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:28.666977 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eac482-0631-4ca8-b2d4-66ec8724cf3d None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:28.667253 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eac482-0631-4ca8-b2d4-66ec8724cf3d None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:28.667604 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eac482-0631-4ca8-b2d4-66ec8724cf3d None admin] PATH_INFO: `/v3/users/nova` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:28.675295 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eac482-0631-4ca8-b2d4-66ec8724cf3d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:28.676753 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eac482-0631-4ca8-b2d4-66ec8724cf3d None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:28.691231 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-d9eac482-0631-4ca8-b2d4-66ec8724cf3d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 14 20:51:28.691231 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:51:28.691231 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:51:28.691231 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:51:28.691231 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:51:28.691231 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:51:28.691231 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:51:28.691231 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:51:28.691231 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:51:28.691231 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:51:28.691231 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:51:28.691231 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:51:28.691231 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 14 20:51:28.691231 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_user(user_id) May 14 20:51:28.691231 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 14 20:51:28.691231 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 14 20:51:28.697121 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:51:28.697121 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:51:28.697121 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 20:51:28.697121 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 20:51:28.697121 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 14 20:51:28.697121 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 20:51:28.697121 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:51:28.697121 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:51:28.697121 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:51:28.697121 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:51:28.697121 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:51:28.697121 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:51:28.697121 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:51:28.697121 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:51:28.697121 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:51:28.697121 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:51:28.697121 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:51:28.697121 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:51:28.698174 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:51:28.698174 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:51:28.698174 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 14 20:51:28.698174 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 14 20:51:28.698174 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 14 20:51:28.698174 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 14 20:51:28.698174 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 14 20:51:28.698174 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 14 20:51:28.698174 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 14 20:51:28.698174 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:51:28.698174 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 547/1098] 10.222.0.52 () {56 vars in 1093 bytes} [Sat May 14 20:51:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 20:51:28.698174 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eac482-0631-4ca8-b2d4-66ec8724cf3d None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:28.746919 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188c527b-4060-4369-948a-70f9989983ad None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:28.779169 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d7406c-a4dd-405d-9874-197e2a299d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:28.779841 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d7406c-a4dd-405d-9874-197e2a299d9b None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:28.780122 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d7406c-a4dd-405d-9874-197e2a299d9b None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:28.780395 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d7406c-a4dd-405d-9874-197e2a299d9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:28.781748 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d7406c-a4dd-405d-9874-197e2a299d9b None admin] RBAC: Adding query filter params (role.id=24c463e2b4d44dd28cd2723a69a8ed2e, scope.project.id=8572729d346a40f880487d1543795db1, user.id=0559aaea2bd94110a055838f393c59ad) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:51:28.782053 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d7406c-a4dd-405d-9874-197e2a299d9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:28.783452 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d7406c-a4dd-405d-9874-197e2a299d9b None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:28.789067 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 552/1099] 10.222.0.52 () {56 vars in 1374 bytes} [Sat May 14 20:51:28 2022] GET /identity/v3/role_assignments?user.id=0559aaea2bd94110a055838f393c59ad&scope.project.id=8572729d346a40f880487d1543795db1&role.id=24c463e2b4d44dd28cd2723a69a8ed2e => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:51:28.792200 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eac482-0631-4ca8-b2d4-66ec8724cf3d None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:28.829092 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9649b42-de63-4ce4-9ed1-261bd87e0498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:28.829785 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9649b42-de63-4ce4-9ed1-261bd87e0498 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:28.830064 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9649b42-de63-4ce4-9ed1-261bd87e0498 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:28.830334 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9649b42-de63-4ce4-9ed1-261bd87e0498 None admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:28.831176 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9649b42-de63-4ce4-9ed1-261bd87e0498 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:51:28.831511 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9649b42-de63-4ce4-9ed1-261bd87e0498 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:28.832957 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9649b42-de63-4ce4-9ed1-261bd87e0498 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:28.852856 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 548/1100] 10.222.0.52 () {56 vars in 1133 bytes} [Sat May 14 20:51:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:51:28.858937 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d7406c-a4dd-405d-9874-197e2a299d9b None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:28.966508 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d7406c-a4dd-405d-9874-197e2a299d9b None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:29.002938 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7fed3f-81f9-412b-a42e-28f1cf2c8c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:29.003662 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7fed3f-81f9-412b-a42e-28f1cf2c8c1c None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:29.003950 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7fed3f-81f9-412b-a42e-28f1cf2c8c1c None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:29.004237 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7fed3f-81f9-412b-a42e-28f1cf2c8c1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:29.070033 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7fed3f-81f9-412b-a42e-28f1cf2c8c1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:29.071508 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7fed3f-81f9-412b-a42e-28f1cf2c8c1c None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:29.164670 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 553/1101] 10.222.0.52 () {58 vars in 1282 bytes} [Sat May 14 20:51:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 14 20:51:29.170248 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9649b42-de63-4ce4-9ed1-261bd87e0498 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:29.266718 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9649b42-de63-4ce4-9ed1-261bd87e0498 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:29.298928 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf3db74-55e3-4325-8ba6-85604ea8c665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:29.299741 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf3db74-55e3-4325-8ba6-85604ea8c665 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:29.300024 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf3db74-55e3-4325-8ba6-85604ea8c665 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:29.300293 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf3db74-55e3-4325-8ba6-85604ea8c665 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:29.309935 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf3db74-55e3-4325-8ba6-85604ea8c665 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:29.311363 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf3db74-55e3-4325-8ba6-85604ea8c665 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:29.328965 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-7cf3db74-55e3-4325-8ba6-85604ea8c665 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:51:29.328965 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:51:29.328965 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:51:29.328965 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:51:29.328965 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:51:29.328965 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:51:29.328965 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:51:29.328965 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:51:29.328965 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:51:29.328965 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:51:29.328965 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:51:29.328965 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:51:29.328965 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:51:29.328965 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:51:29.328965 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:51:29.329918 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:51:29.329918 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:51:29.329918 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:51:29.329918 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:51:29.329918 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:51:29.329918 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:51:29.329918 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:51:29.329918 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:51:29.329918 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:51:29.329918 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:51:29.329918 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:51:29.329918 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:51:29.329918 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:51:29.329918 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:51:29.329918 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:51:29.329918 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:51:29.329918 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:51:29.330823 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 20:51:29.330823 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:51:29.330823 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:51:29.330823 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:51:29.330823 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 549/1102] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:51:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:51:29.335724 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7fed3f-81f9-412b-a42e-28f1cf2c8c1c None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:29.432184 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7fed3f-81f9-412b-a42e-28f1cf2c8c1c None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:29.466447 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d135776-a2c4-4441-af42-f465bac31e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:29.467107 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d135776-a2c4-4441-af42-f465bac31e50 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:29.467389 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d135776-a2c4-4441-af42-f465bac31e50 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:29.467695 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d135776-a2c4-4441-af42-f465bac31e50 None admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:29.468458 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d135776-a2c4-4441-af42-f465bac31e50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:51:29.468753 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d135776-a2c4-4441-af42-f465bac31e50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:29.470105 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d135776-a2c4-4441-af42-f465bac31e50 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:29.480988 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 554/1103] 10.222.0.52 () {56 vars in 1109 bytes} [Sat May 14 20:51:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:51:29.487240 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf3db74-55e3-4325-8ba6-85604ea8c665 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:29.583350 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf3db74-55e3-4325-8ba6-85604ea8c665 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:29.616670 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9d89a1-117a-4c4c-814c-db9506843c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:29.617453 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d89a1-117a-4c4c-814c-db9506843c01 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:29.617734 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d89a1-117a-4c4c-814c-db9506843c01 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:29.618005 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d89a1-117a-4c4c-814c-db9506843c01 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:29.624741 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9d89a1-117a-4c4c-814c-db9506843c01 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:29.626321 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9d89a1-117a-4c4c-814c-db9506843c01 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:29.639432 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-ca9d89a1-117a-4c4c-814c-db9506843c01 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 14 20:51:29.639432 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:51:29.639432 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:51:29.639432 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:51:29.639432 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:51:29.639432 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:51:29.639432 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:51:29.639432 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:51:29.639432 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:51:29.639432 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:51:29.639432 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:51:29.639432 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:51:29.639432 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 14 20:51:29.639432 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_project(project_id) May 14 20:51:29.639432 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 14 20:51:29.640487 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 14 20:51:29.640487 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:51:29.640487 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:51:29.640487 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:51:29.640487 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:51:29.640487 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:51:29.640487 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:51:29.640487 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:51:29.640487 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:51:29.640487 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:51:29.640487 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:51:29.640487 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:51:29.640487 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:51:29.640487 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:51:29.640487 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:51:29.640487 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:51:29.640487 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:51:29.641445 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 14 20:51:29.641445 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 14 20:51:29.641445 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 20:51:29.641445 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 20:51:29.641445 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 20:51:29.641445 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 20:51:29.641445 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 14 20:51:29.641445 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:51:29.641445 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 550/1104] 10.222.0.52 () {56 vars in 1111 bytes} [Sat May 14 20:51:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:51:29.646794 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d135776-a2c4-4441-af42-f465bac31e50 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:29.743754 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d135776-a2c4-4441-af42-f465bac31e50 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:29.782875 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487219fd-ccb5-463c-b7a7-d7ace848e0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:29.783546 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487219fd-ccb5-463c-b7a7-d7ace848e0ce None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:29.783829 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487219fd-ccb5-463c-b7a7-d7ace848e0ce None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:29.784103 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487219fd-ccb5-463c-b7a7-d7ace848e0ce None admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:29.784865 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487219fd-ccb5-463c-b7a7-d7ace848e0ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:51:29.785169 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487219fd-ccb5-463c-b7a7-d7ace848e0ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:29.786580 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487219fd-ccb5-463c-b7a7-d7ace848e0ce None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:29.798234 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 555/1105] 10.222.0.52 () {56 vars in 1148 bytes} [Sat May 14 20:51:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:51:29.804274 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9d89a1-117a-4c4c-814c-db9506843c01 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:29.906389 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9d89a1-117a-4c4c-814c-db9506843c01 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:29.942369 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d617c9-fb68-47d0-9fcd-2a904f15b733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:29.943038 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d617c9-fb68-47d0-9fcd-2a904f15b733 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:29.943324 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d617c9-fb68-47d0-9fcd-2a904f15b733 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:29.943637 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d617c9-fb68-47d0-9fcd-2a904f15b733 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:29.944483 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d617c9-fb68-47d0-9fcd-2a904f15b733 None admin] RBAC: Adding query filter params (role.id=b842db64da3a4644945d0a941a9a9285, scope.project.id=0911a024287e430ea6ee015389f0c440, user.id=0f1b0e2b025d4eceaa90e1616d0a9db8) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:51:29.944796 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d617c9-fb68-47d0-9fcd-2a904f15b733 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:29.946281 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d617c9-fb68-47d0-9fcd-2a904f15b733 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:29.962207 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 551/1106] 10.222.0.52 () {56 vars in 1374 bytes} [Sat May 14 20:51:29 2022] GET /identity/v3/role_assignments?user.id=0f1b0e2b025d4eceaa90e1616d0a9db8&scope.project.id=0911a024287e430ea6ee015389f0c440&role.id=b842db64da3a4644945d0a941a9a9285 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:51:31.139226 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e34c20-ce5c-47b6-8709-a65e6c574229 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:31.139808 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e34c20-ce5c-47b6-8709-a65e6c574229 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:31.139808 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e34c20-ce5c-47b6-8709-a65e6c574229 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:31.141745 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 556/1107] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:51:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:51:31.146871 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4666ff4-c484-47cd-a6a2-6eaf7023c07e None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:31.147282 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4666ff4-c484-47cd-a6a2-6eaf7023c07e None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:31.147425 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4666ff4-c484-47cd-a6a2-6eaf7023c07e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:31.164385 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-b4666ff4-c484-47cd-a6a2-6eaf7023c07e None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:51:31.165563 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b4666ff4-c484-47cd-a6a2-6eaf7023c07e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:51:31.228300 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 552/1108] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:51:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 20:51:31.254348 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e34c20-ce5c-47b6-8709-a65e6c574229 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:31.349567 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e34c20-ce5c-47b6-8709-a65e6c574229 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:31.381578 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a9cbc0-8c30-4ea7-b79c-feac29b5d692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:31.382338 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9cbc0-8c30-4ea7-b79c-feac29b5d692 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:31.382620 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9cbc0-8c30-4ea7-b79c-feac29b5d692 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:31.382897 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9cbc0-8c30-4ea7-b79c-feac29b5d692 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:31.384080 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a9cbc0-8c30-4ea7-b79c-feac29b5d692 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:31.385494 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a9cbc0-8c30-4ea7-b79c-feac29b5d692 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:31.387057 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 557/1109] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:51:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:51:31.393309 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4666ff4-c484-47cd-a6a2-6eaf7023c07e None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:31.486024 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4666ff4-c484-47cd-a6a2-6eaf7023c07e None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:31.517971 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c5621d-aa31-4a92-81e5-1950265bb808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:31.518624 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c5621d-aa31-4a92-81e5-1950265bb808 None admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:31.518932 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c5621d-aa31-4a92-81e5-1950265bb808 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:31.519228 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c5621d-aa31-4a92-81e5-1950265bb808 None admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:31.519952 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c5621d-aa31-4a92-81e5-1950265bb808 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:31.521373 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c5621d-aa31-4a92-81e5-1950265bb808 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:31.615997 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 553/1110] 10.222.0.52 () {60 vars in 1132 bytes} [Sat May 14 20:51:31 2022] POST /identity/v3/users => generated 286 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 20:51:33.933058 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14d62b-6f03-4a52-aa99-2336d0a06e7e None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:33.933522 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14d62b-6f03-4a52-aa99-2336d0a06e7e None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:33.933647 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14d62b-6f03-4a52-aa99-2336d0a06e7e None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:33.934967 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 558/1111] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:51:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:51:33.940261 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea283e-3eb4-4379-b8bf-3fc46d6ca78b None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:33.940676 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea283e-3eb4-4379-b8bf-3fc46d6ca78b None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:33.940818 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea283e-3eb4-4379-b8bf-3fc46d6ca78b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:33.958207 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-daea283e-3eb4-4379-b8bf-3fc46d6ca78b None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:51:33.959364 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-daea283e-3eb4-4379-b8bf-3fc46d6ca78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:51:34.023540 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 554/1112] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:51:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 20:51:34.048373 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e14d62b-6f03-4a52-aa99-2336d0a06e7e None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:34.145703 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e14d62b-6f03-4a52-aa99-2336d0a06e7e None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:34.176929 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a300c1f-5cdb-424b-9439-d744b1339ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:34.177756 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a300c1f-5cdb-424b-9439-d744b1339ff6 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:34.178031 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a300c1f-5cdb-424b-9439-d744b1339ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:34.178350 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a300c1f-5cdb-424b-9439-d744b1339ff6 None admin] PATH_INFO: `/v3/roles/274f900b5153444b84117bc9919443fc` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:34.179759 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a300c1f-5cdb-424b-9439-d744b1339ff6 None admin] RBAC: Authorizing `identity:get_role(role_id=274f900b5153444b84117bc9919443fc)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:34.181108 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a300c1f-5cdb-424b-9439-d744b1339ff6 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:34.182439 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 559/1113] 10.222.0.52 () {56 vars in 1177 bytes} [Sat May 14 20:51:34 2022] GET /identity/v3/roles/274f900b5153444b84117bc9919443fc => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:51:34.188568 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daea283e-3eb4-4379-b8bf-3fc46d6ca78b None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:34.281255 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daea283e-3eb4-4379-b8bf-3fc46d6ca78b None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:34.312679 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d9a6d-8142-4f98-bbe2-093210ba152f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:34.313519 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d9a6d-8142-4f98-bbe2-093210ba152f None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:34.313797 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d9a6d-8142-4f98-bbe2-093210ba152f None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:34.314066 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d9a6d-8142-4f98-bbe2-093210ba152f None admin] PATH_INFO: `/v3/users/9c86e94a3eb2495d9fbbd8f873b330ba` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:34.326297 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02d9a6d-8142-4f98-bbe2-093210ba152f None admin] RBAC: Authorizing `identity:get_user(user_id=9c86e94a3eb2495d9fbbd8f873b330ba)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:34.327929 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02d9a6d-8142-4f98-bbe2-093210ba152f None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:34.329529 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 555/1114] 10.222.0.52 () {56 vars in 1177 bytes} [Sat May 14 20:51:34 2022] GET /identity/v3/users/9c86e94a3eb2495d9fbbd8f873b330ba => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:51:34.335168 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a300c1f-5cdb-424b-9439-d744b1339ff6 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:34.430324 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a300c1f-5cdb-424b-9439-d744b1339ff6 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:34.463851 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8a32f1-8deb-4d52-b686-0244487aa8cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:34.464492 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a32f1-8deb-4d52-b686-0244487aa8cd None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:34.464776 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a32f1-8deb-4d52-b686-0244487aa8cd None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:34.465050 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a32f1-8deb-4d52-b686-0244487aa8cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:34.532919 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8a32f1-8deb-4d52-b686-0244487aa8cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:34.534363 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8a32f1-8deb-4d52-b686-0244487aa8cd None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:34.627940 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 560/1115] 10.222.0.52 () {58 vars in 1282 bytes} [Sat May 14 20:51:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 14 20:51:34.634060 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d9a6d-8142-4f98-bbe2-093210ba152f None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:34.729596 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d9a6d-8142-4f98-bbe2-093210ba152f None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:34.761477 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c529ca8-a063-42b4-97b9-ca6adf0ed063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:34.762318 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c529ca8-a063-42b4-97b9-ca6adf0ed063 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:34.762600 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c529ca8-a063-42b4-97b9-ca6adf0ed063 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:34.762875 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c529ca8-a063-42b4-97b9-ca6adf0ed063 None admin] PATH_INFO: `/v3/projects/8572729d346a40f880487d1543795db1` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:34.764067 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c529ca8-a063-42b4-97b9-ca6adf0ed063 None admin] RBAC: Authorizing `identity:get_project(project_id=8572729d346a40f880487d1543795db1)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:34.766043 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c529ca8-a063-42b4-97b9-ca6adf0ed063 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:34.767753 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 556/1116] 10.222.0.52 () {56 vars in 1186 bytes} [Sat May 14 20:51:34 2022] GET /identity/v3/projects/8572729d346a40f880487d1543795db1 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:51:34.774227 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8a32f1-8deb-4d52-b686-0244487aa8cd None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:34.877977 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8a32f1-8deb-4d52-b686-0244487aa8cd None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:34.911236 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f340c9a9-33ec-46a3-b234-9d4e7ad1690e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:34.911906 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f340c9a9-33ec-46a3-b234-9d4e7ad1690e None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:34.912190 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f340c9a9-33ec-46a3-b234-9d4e7ad1690e None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:34.912467 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f340c9a9-33ec-46a3-b234-9d4e7ad1690e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:34.913276 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f340c9a9-33ec-46a3-b234-9d4e7ad1690e None admin] RBAC: Adding query filter params (role.id=274f900b5153444b84117bc9919443fc, scope.project.id=8572729d346a40f880487d1543795db1, user.id=9c86e94a3eb2495d9fbbd8f873b330ba) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:51:34.913587 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f340c9a9-33ec-46a3-b234-9d4e7ad1690e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:34.915037 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f340c9a9-33ec-46a3-b234-9d4e7ad1690e None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:34.920384 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 561/1117] 10.222.0.52 () {56 vars in 1374 bytes} [Sat May 14 20:51:34 2022] GET /identity/v3/role_assignments?user.id=9c86e94a3eb2495d9fbbd8f873b330ba&scope.project.id=8572729d346a40f880487d1543795db1&role.id=274f900b5153444b84117bc9919443fc => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:51:37.197715 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0657d519-529b-4a18-947d-54d201dc577f None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:37.198226 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0657d519-529b-4a18-947d-54d201dc577f None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:37.198226 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0657d519-529b-4a18-947d-54d201dc577f None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:37.199558 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 557/1118] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:51:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:51:37.205528 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c022d64-9e21-4678-a7b8-b9675dfa8555 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:37.205932 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c022d64-9e21-4678-a7b8-b9675dfa8555 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:37.206079 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c022d64-9e21-4678-a7b8-b9675dfa8555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:37.222263 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-2c022d64-9e21-4678-a7b8-b9675dfa8555 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:51:37.223440 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-2c022d64-9e21-4678-a7b8-b9675dfa8555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:51:37.287586 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 562/1119] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:51:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 14 20:51:37.311311 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0657d519-529b-4a18-947d-54d201dc577f None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:37.410395 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0657d519-529b-4a18-947d-54d201dc577f None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:37.443941 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903ee533-cc0b-45af-826d-beeccf66502d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:37.444784 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ee533-cc0b-45af-826d-beeccf66502d None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:37.445064 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ee533-cc0b-45af-826d-beeccf66502d None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:37.445340 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ee533-cc0b-45af-826d-beeccf66502d None admin] PATH_INFO: `/v3/roles/274f900b5153444b84117bc9919443fc` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:37.446801 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903ee533-cc0b-45af-826d-beeccf66502d None admin] RBAC: Authorizing `identity:get_role(role_id=274f900b5153444b84117bc9919443fc)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:37.448254 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903ee533-cc0b-45af-826d-beeccf66502d None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:37.449549 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 558/1120] 10.222.0.52 () {56 vars in 1177 bytes} [Sat May 14 20:51:37 2022] GET /identity/v3/roles/274f900b5153444b84117bc9919443fc => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:51:37.456186 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c022d64-9e21-4678-a7b8-b9675dfa8555 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:37.550011 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c022d64-9e21-4678-a7b8-b9675dfa8555 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:37.581534 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca131868-414e-4457-8838-351f367e8f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:37.582374 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca131868-414e-4457-8838-351f367e8f63 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:37.582651 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca131868-414e-4457-8838-351f367e8f63 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:37.582921 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca131868-414e-4457-8838-351f367e8f63 None admin] PATH_INFO: `/v3/users/9c86e94a3eb2495d9fbbd8f873b330ba` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:37.584095 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca131868-414e-4457-8838-351f367e8f63 None admin] RBAC: Authorizing `identity:get_user(user_id=9c86e94a3eb2495d9fbbd8f873b330ba)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:37.585780 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca131868-414e-4457-8838-351f367e8f63 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:37.587358 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 563/1121] 10.222.0.52 () {56 vars in 1177 bytes} [Sat May 14 20:51:37 2022] GET /identity/v3/users/9c86e94a3eb2495d9fbbd8f873b330ba => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:51:37.593099 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903ee533-cc0b-45af-826d-beeccf66502d None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:37.686263 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903ee533-cc0b-45af-826d-beeccf66502d None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:37.718530 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1eed6d-ad11-4d24-bf67-d5b230ed8f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:37.719307 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1eed6d-ad11-4d24-bf67-d5b230ed8f7d None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:37.719622 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1eed6d-ad11-4d24-bf67-d5b230ed8f7d None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:37.719903 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1eed6d-ad11-4d24-bf67-d5b230ed8f7d None admin] PATH_INFO: `/v3/projects/8572729d346a40f880487d1543795db1` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:37.721068 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1eed6d-ad11-4d24-bf67-d5b230ed8f7d None admin] RBAC: Authorizing `identity:get_project(project_id=8572729d346a40f880487d1543795db1)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:37.722492 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1eed6d-ad11-4d24-bf67-d5b230ed8f7d None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:37.724174 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 559/1122] 10.222.0.52 () {56 vars in 1186 bytes} [Sat May 14 20:51:37 2022] GET /identity/v3/projects/8572729d346a40f880487d1543795db1 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:51:37.729987 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca131868-414e-4457-8838-351f367e8f63 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:37.832795 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca131868-414e-4457-8838-351f367e8f63 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:37.864908 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8edad1b-6458-41d9-8c08-921c88f4ac2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:37.865781 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8edad1b-6458-41d9-8c08-921c88f4ac2b None admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:37.866061 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8edad1b-6458-41d9-8c08-921c88f4ac2b None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:37.866331 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8edad1b-6458-41d9-8c08-921c88f4ac2b None admin] PATH_INFO: `/v3/projects/8572729d346a40f880487d1543795db1/users/9c86e94a3eb2495d9fbbd8f873b330ba/roles/274f900b5153444b84117bc9919443fc` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:37.868520 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8edad1b-6458-41d9-8c08-921c88f4ac2b None admin] RBAC: Authorizing `identity:create_grant(project_id=8572729d346a40f880487d1543795db1, user_id=9c86e94a3eb2495d9fbbd8f873b330ba, role_id=274f900b5153444b84117bc9919443fc)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:37.869940 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8edad1b-6458-41d9-8c08-921c88f4ac2b None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:37.942108 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 564/1123] 10.222.0.52 () {58 vars in 1439 bytes} [Sat May 14 20:51:37 2022] PUT /identity/v3/projects/8572729d346a40f880487d1543795db1/users/9c86e94a3eb2495d9fbbd8f873b330ba/roles/274f900b5153444b84117bc9919443fc => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 20:51:40.203716 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1316d3d4-8f33-4196-b889-fe97341d3c9e None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:40.204219 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1316d3d4-8f33-4196-b889-fe97341d3c9e None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:40.204219 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1316d3d4-8f33-4196-b889-fe97341d3c9e None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:40.205535 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 560/1124] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:51:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:51:40.210803 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df834c-8a50-41bf-9d2d-02fa0c983648 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:40.211230 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df834c-8a50-41bf-9d2d-02fa0c983648 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:40.211343 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df834c-8a50-41bf-9d2d-02fa0c983648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:40.227469 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-a4df834c-8a50-41bf-9d2d-02fa0c983648 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:51:40.228652 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-a4df834c-8a50-41bf-9d2d-02fa0c983648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:51:40.291269 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 565/1125] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:51:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 20:51:40.315764 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1316d3d4-8f33-4196-b889-fe97341d3c9e None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:40.412397 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1316d3d4-8f33-4196-b889-fe97341d3c9e None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:40.444630 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba891b-4c77-4d51-88ca-d29eda15fe80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:40.445456 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba891b-4c77-4d51-88ca-d29eda15fe80 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:40.445733 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba891b-4c77-4d51-88ca-d29eda15fe80 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:40.446002 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba891b-4c77-4d51-88ca-d29eda15fe80 None admin] PATH_INFO: `/v3/roles/274f900b5153444b84117bc9919443fc` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:40.447431 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffba891b-4c77-4d51-88ca-d29eda15fe80 None admin] RBAC: Authorizing `identity:get_role(role_id=274f900b5153444b84117bc9919443fc)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:40.448804 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffba891b-4c77-4d51-88ca-d29eda15fe80 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:40.450112 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 561/1126] 10.222.0.52 () {56 vars in 1177 bytes} [Sat May 14 20:51:40 2022] GET /identity/v3/roles/274f900b5153444b84117bc9919443fc => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:51:40.456559 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df834c-8a50-41bf-9d2d-02fa0c983648 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:40.550271 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df834c-8a50-41bf-9d2d-02fa0c983648 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:40.582114 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895cfe44-d7bf-4878-9ed7-d8731b4738b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:40.582956 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895cfe44-d7bf-4878-9ed7-d8731b4738b0 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:40.583234 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895cfe44-d7bf-4878-9ed7-d8731b4738b0 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:40.583531 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895cfe44-d7bf-4878-9ed7-d8731b4738b0 None admin] PATH_INFO: `/v3/users/9c86e94a3eb2495d9fbbd8f873b330ba` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:40.584683 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895cfe44-d7bf-4878-9ed7-d8731b4738b0 None admin] RBAC: Authorizing `identity:get_user(user_id=9c86e94a3eb2495d9fbbd8f873b330ba)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:40.586152 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895cfe44-d7bf-4878-9ed7-d8731b4738b0 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:40.587785 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 566/1127] 10.222.0.52 () {56 vars in 1177 bytes} [Sat May 14 20:51:40 2022] GET /identity/v3/users/9c86e94a3eb2495d9fbbd8f873b330ba => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:51:40.593696 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba891b-4c77-4d51-88ca-d29eda15fe80 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:40.689757 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba891b-4c77-4d51-88ca-d29eda15fe80 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:40.721570 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279879a-63d5-4c7e-bdd2-ce9340652fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:40.722143 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279879a-63d5-4c7e-bdd2-ce9340652fe1 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:40.722426 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279879a-63d5-4c7e-bdd2-ce9340652fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:40.722750 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279879a-63d5-4c7e-bdd2-ce9340652fe1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:40.787072 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e279879a-63d5-4c7e-bdd2-ce9340652fe1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:40.788543 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e279879a-63d5-4c7e-bdd2-ce9340652fe1 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:40.881484 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 562/1128] 10.222.0.52 () {58 vars in 1282 bytes} [Sat May 14 20:51:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 14 20:51:40.887302 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895cfe44-d7bf-4878-9ed7-d8731b4738b0 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:40.982411 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895cfe44-d7bf-4878-9ed7-d8731b4738b0 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:41.015880 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a1d3b3-b436-41fd-82ab-4a8b81848ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:41.016711 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a1d3b3-b436-41fd-82ab-4a8b81848ece None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:41.016994 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a1d3b3-b436-41fd-82ab-4a8b81848ece None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:41.017264 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a1d3b3-b436-41fd-82ab-4a8b81848ece None admin] PATH_INFO: `/v3/projects/8572729d346a40f880487d1543795db1` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:41.018438 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a1d3b3-b436-41fd-82ab-4a8b81848ece None admin] RBAC: Authorizing `identity:get_project(project_id=8572729d346a40f880487d1543795db1)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:41.019888 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a1d3b3-b436-41fd-82ab-4a8b81848ece None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:41.021584 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 567/1129] 10.222.0.52 () {56 vars in 1186 bytes} [Sat May 14 20:51:40 2022] GET /identity/v3/projects/8572729d346a40f880487d1543795db1 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:51:41.027842 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279879a-63d5-4c7e-bdd2-ce9340652fe1 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:41.122112 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279879a-63d5-4c7e-bdd2-ce9340652fe1 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:41.153836 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f9f4af-c276-4065-8e9b-95dd44be2506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:41.154477 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f9f4af-c276-4065-8e9b-95dd44be2506 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:41.154761 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f9f4af-c276-4065-8e9b-95dd44be2506 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:41.155038 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f9f4af-c276-4065-8e9b-95dd44be2506 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:41.156589 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f9f4af-c276-4065-8e9b-95dd44be2506 None admin] RBAC: Adding query filter params (role.id=274f900b5153444b84117bc9919443fc, scope.project.id=8572729d346a40f880487d1543795db1, user.id=9c86e94a3eb2495d9fbbd8f873b330ba) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:51:41.156899 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f9f4af-c276-4065-8e9b-95dd44be2506 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:41.158328 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f9f4af-c276-4065-8e9b-95dd44be2506 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:41.163982 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 563/1130] 10.222.0.52 () {56 vars in 1374 bytes} [Sat May 14 20:51:41 2022] GET /identity/v3/role_assignments?user.id=9c86e94a3eb2495d9fbbd8f873b330ba&scope.project.id=8572729d346a40f880487d1543795db1&role.id=274f900b5153444b84117bc9919443fc => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:51:43.452852 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd4d8f-68f1-4a9e-9cc1-3413f8daffe0 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:43.453386 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd4d8f-68f1-4a9e-9cc1-3413f8daffe0 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:43.453386 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd4d8f-68f1-4a9e-9cc1-3413f8daffe0 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:43.454750 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 568/1131] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:51:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:51:43.460025 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c987375-3622-4189-b8de-f1dfcfed1519 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:43.460414 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c987375-3622-4189-b8de-f1dfcfed1519 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:43.460580 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c987375-3622-4189-b8de-f1dfcfed1519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:43.478142 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-4c987375-3622-4189-b8de-f1dfcfed1519 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:51:43.479332 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-4c987375-3622-4189-b8de-f1dfcfed1519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:51:43.544220 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 564/1132] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:51:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 20:51:43.568040 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bd4d8f-68f1-4a9e-9cc1-3413f8daffe0 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:43.663484 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bd4d8f-68f1-4a9e-9cc1-3413f8daffe0 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:43.694469 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec859ee-70fc-463e-af98-29462d7e367d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:43.695228 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec859ee-70fc-463e-af98-29462d7e367d None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:43.695532 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec859ee-70fc-463e-af98-29462d7e367d None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:43.695807 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec859ee-70fc-463e-af98-29462d7e367d None admin] PATH_INFO: `/v3/domains/default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:43.696943 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec859ee-70fc-463e-af98-29462d7e367d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:43.698352 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec859ee-70fc-463e-af98-29462d7e367d None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:43.699978 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 569/1133] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:51:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:51:43.706325 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c987375-3622-4189-b8de-f1dfcfed1519 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:43.801636 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c987375-3622-4189-b8de-f1dfcfed1519 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:43.835168 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f00648b-a124-4ed0-9537-d2300c5e402b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:43.835867 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00648b-a124-4ed0-9537-d2300c5e402b None admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:43.836168 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00648b-a124-4ed0-9537-d2300c5e402b None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:43.836443 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00648b-a124-4ed0-9537-d2300c5e402b None admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:43.837180 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f00648b-a124-4ed0-9537-d2300c5e402b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:43.838617 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f00648b-a124-4ed0-9537-d2300c5e402b None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:43.954094 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 565/1134] 10.222.0.52 () {60 vars in 1141 bytes} [Sat May 14 20:51:43 2022] POST /identity/v3/projects => generated 311 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 20:51:46.269849 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f28ddbe-ec3a-4923-a075-49e3403d61f6 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:46.270359 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f28ddbe-ec3a-4923-a075-49e3403d61f6 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:46.270359 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f28ddbe-ec3a-4923-a075-49e3403d61f6 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:46.271814 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 570/1135] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:51:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:51:46.276947 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a179f2-659b-4747-a9c2-89aed825ab8e None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:46.277371 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a179f2-659b-4747-a9c2-89aed825ab8e None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:46.277511 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a179f2-659b-4747-a9c2-89aed825ab8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:46.293887 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-73a179f2-659b-4747-a9c2-89aed825ab8e None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:51:46.295072 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-73a179f2-659b-4747-a9c2-89aed825ab8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:51:46.358889 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 566/1136] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:51:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 20:51:46.385244 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f28ddbe-ec3a-4923-a075-49e3403d61f6 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:46.480718 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f28ddbe-ec3a-4923-a075-49e3403d61f6 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:46.513103 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c2e4ab-6a6a-4828-89e0-f4b86d528d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:46.513866 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c2e4ab-6a6a-4828-89e0-f4b86d528d75 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:46.514148 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c2e4ab-6a6a-4828-89e0-f4b86d528d75 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:46.514942 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c2e4ab-6a6a-4828-89e0-f4b86d528d75 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:46.516220 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c2e4ab-6a6a-4828-89e0-f4b86d528d75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:46.517638 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c2e4ab-6a6a-4828-89e0-f4b86d528d75 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:46.519213 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 571/1137] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:51:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:51:46.524948 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a179f2-659b-4747-a9c2-89aed825ab8e None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:46.619031 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a179f2-659b-4747-a9c2-89aed825ab8e None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:46.651126 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2287adcf-71a6-4cc6-9a01-cadae7ae9884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:46.651811 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2287adcf-71a6-4cc6-9a01-cadae7ae9884 None admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:46.652097 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2287adcf-71a6-4cc6-9a01-cadae7ae9884 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:46.652372 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2287adcf-71a6-4cc6-9a01-cadae7ae9884 None admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:46.653067 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2287adcf-71a6-4cc6-9a01-cadae7ae9884 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:46.654483 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2287adcf-71a6-4cc6-9a01-cadae7ae9884 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:46.757909 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 567/1138] 10.222.0.52 () {60 vars in 1132 bytes} [Sat May 14 20:51:46 2022] POST /identity/v3/users => generated 286 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 20:51:49.078276 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6268f1-ed6a-4d4d-b9e2-27b6201d6ead None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:49.078792 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6268f1-ed6a-4d4d-b9e2-27b6201d6ead None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:49.078881 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6268f1-ed6a-4d4d-b9e2-27b6201d6ead None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:49.080235 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 572/1139] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:51:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:51:49.085505 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ba207-8faf-4d85-8599-79dfb0d20152 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:49.085908 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ba207-8faf-4d85-8599-79dfb0d20152 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:49.086059 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ba207-8faf-4d85-8599-79dfb0d20152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:49.103184 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-7a8ba207-8faf-4d85-8599-79dfb0d20152 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:51:49.104384 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-7a8ba207-8faf-4d85-8599-79dfb0d20152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:51:49.168668 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 568/1140] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:51:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 20:51:49.194267 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6268f1-ed6a-4d4d-b9e2-27b6201d6ead None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:49.289738 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6268f1-ed6a-4d4d-b9e2-27b6201d6ead None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:49.321110 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce544928-1986-4992-a97c-450aeec1155f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:49.321874 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce544928-1986-4992-a97c-450aeec1155f None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:49.322159 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce544928-1986-4992-a97c-450aeec1155f None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:49.322427 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce544928-1986-4992-a97c-450aeec1155f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:49.332479 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce544928-1986-4992-a97c-450aeec1155f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:51:49.339914 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-ce544928-1986-4992-a97c-450aeec1155f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 14 20:51:49.339914 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:51:49.339914 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:51:49.339914 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:51:49.339914 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:51:49.339914 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:51:49.339914 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:51:49.339914 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:51:49.339914 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:51:49.339914 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:51:49.339914 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:51:49.339914 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:51:49.339914 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:51:49.339914 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:51:49.339914 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:51:49.339914 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:51:49.341043 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:51:49.341043 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:51:49.341043 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:51:49.341043 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:51:49.341043 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:51:49.341043 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:51:49.341043 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:51:49.341043 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:51:49.341043 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:51:49.341043 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:51:49.341043 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:51:49.341043 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:51:49.341043 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:51:49.341043 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:51:49.341043 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:51:49.341043 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:51:49.341911 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:51:49.341911 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:51:49.341911 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:51:49.341911 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:51:49.341911 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:51:49.341911 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:51:49.341911 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:51:49.341911 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:51:49.341911 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:51:49.341911 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:51:49.341911 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 14 20:51:49.341911 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:51:49.341911 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 573/1141] 10.222.0.52 () {56 vars in 1096 bytes} [Sat May 14 20:51:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 20:51:49.347199 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8ba207-8faf-4d85-8599-79dfb0d20152 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:49.440707 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8ba207-8faf-4d85-8599-79dfb0d20152 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:49.472775 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a63a2c-14c9-4572-8db3-3141d9c67ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:49.473365 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a63a2c-14c9-4572-8db3-3141d9c67ab6 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:49.473646 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a63a2c-14c9-4572-8db3-3141d9c67ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:49.473918 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a63a2c-14c9-4572-8db3-3141d9c67ab6 None admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:49.474647 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a63a2c-14c9-4572-8db3-3141d9c67ab6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:51:49.474950 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a63a2c-14c9-4572-8db3-3141d9c67ab6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:49.476349 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a63a2c-14c9-4572-8db3-3141d9c67ab6 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:49.484632 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 569/1142] 10.222.0.52 () {56 vars in 1099 bytes} [Sat May 14 20:51:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:51:49.490200 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce544928-1986-4992-a97c-450aeec1155f None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:49.584291 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce544928-1986-4992-a97c-450aeec1155f None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:49.615871 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f9cf09-2510-4148-b05f-7ecc9a03774e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:49.616713 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f9cf09-2510-4148-b05f-7ecc9a03774e None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:49.616989 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f9cf09-2510-4148-b05f-7ecc9a03774e None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:49.617259 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f9cf09-2510-4148-b05f-7ecc9a03774e None admin] PATH_INFO: `/v3/users/50c19f75bb114859ba813baf4515aa4d` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:49.630644 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f9cf09-2510-4148-b05f-7ecc9a03774e None admin] RBAC: Authorizing `identity:get_user(user_id=50c19f75bb114859ba813baf4515aa4d)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:49.632084 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f9cf09-2510-4148-b05f-7ecc9a03774e None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:49.633670 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 574/1143] 10.222.0.52 () {56 vars in 1177 bytes} [Sat May 14 20:51:49 2022] GET /identity/v3/users/50c19f75bb114859ba813baf4515aa4d => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:51:49.639342 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a63a2c-14c9-4572-8db3-3141d9c67ab6 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:49.734180 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a63a2c-14c9-4572-8db3-3141d9c67ab6 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:49.766095 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0874c0-cf72-429c-97d6-ed49c40e9e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:49.766753 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0874c0-cf72-429c-97d6-ed49c40e9e25 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:49.767038 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0874c0-cf72-429c-97d6-ed49c40e9e25 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:49.767308 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0874c0-cf72-429c-97d6-ed49c40e9e25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:49.831560 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0874c0-cf72-429c-97d6-ed49c40e9e25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:49.833012 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0874c0-cf72-429c-97d6-ed49c40e9e25 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:49.927204 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 570/1144] 10.222.0.52 () {58 vars in 1282 bytes} [Sat May 14 20:51:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 14 20:51:49.932950 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f9cf09-2510-4148-b05f-7ecc9a03774e None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:50.027940 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f9cf09-2510-4148-b05f-7ecc9a03774e None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:50.060769 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a009a7-d8aa-40ae-9c94-3b207f4d1245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:50.062043 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a009a7-d8aa-40ae-9c94-3b207f4d1245 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:50.062321 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a009a7-d8aa-40ae-9c94-3b207f4d1245 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:50.062594 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a009a7-d8aa-40ae-9c94-3b207f4d1245 None admin] PATH_INFO: `/v3/projects/271f2b6a94b4458c84d07a356546f596` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:50.063774 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a009a7-d8aa-40ae-9c94-3b207f4d1245 None admin] RBAC: Authorizing `identity:get_project(project_id=271f2b6a94b4458c84d07a356546f596)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:50.065189 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a009a7-d8aa-40ae-9c94-3b207f4d1245 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:50.066846 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 575/1145] 10.222.0.52 () {56 vars in 1186 bytes} [Sat May 14 20:51:49 2022] GET /identity/v3/projects/271f2b6a94b4458c84d07a356546f596 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:51:50.072868 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0874c0-cf72-429c-97d6-ed49c40e9e25 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:50.186986 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0874c0-cf72-429c-97d6-ed49c40e9e25 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:50.219380 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2796bfc2-3a3c-4474-9d4d-928c1d6d9984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:50.220045 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2796bfc2-3a3c-4474-9d4d-928c1d6d9984 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:50.220322 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2796bfc2-3a3c-4474-9d4d-928c1d6d9984 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:50.220591 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2796bfc2-3a3c-4474-9d4d-928c1d6d9984 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:50.221394 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2796bfc2-3a3c-4474-9d4d-928c1d6d9984 None admin] RBAC: Adding query filter params (role.id=24c463e2b4d44dd28cd2723a69a8ed2e, scope.project.id=271f2b6a94b4458c84d07a356546f596, user.id=50c19f75bb114859ba813baf4515aa4d) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:51:50.221697 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2796bfc2-3a3c-4474-9d4d-928c1d6d9984 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:50.223099 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2796bfc2-3a3c-4474-9d4d-928c1d6d9984 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:50.228424 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 571/1146] 10.222.0.52 () {56 vars in 1374 bytes} [Sat May 14 20:51:50 2022] GET /identity/v3/role_assignments?user.id=50c19f75bb114859ba813baf4515aa4d&scope.project.id=271f2b6a94b4458c84d07a356546f596&role.id=24c463e2b4d44dd28cd2723a69a8ed2e => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:51:52.517844 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87547c7-8fa9-41bf-a7bd-c1910012cd1b None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:52.518378 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87547c7-8fa9-41bf-a7bd-c1910012cd1b None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:52.518378 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87547c7-8fa9-41bf-a7bd-c1910012cd1b None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:52.519781 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 576/1147] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:51:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:51:52.525083 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7e700-9e6e-4f4a-8381-6e9192f0c922 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:52.525506 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7e700-9e6e-4f4a-8381-6e9192f0c922 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:52.525629 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7e700-9e6e-4f4a-8381-6e9192f0c922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:52.542618 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-f6f7e700-9e6e-4f4a-8381-6e9192f0c922 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:51:52.543840 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-f6f7e700-9e6e-4f4a-8381-6e9192f0c922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:51:52.607365 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 572/1148] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:51:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 20:51:52.631187 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87547c7-8fa9-41bf-a7bd-c1910012cd1b None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:52.729004 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87547c7-8fa9-41bf-a7bd-c1910012cd1b None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:52.763532 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ba84fa-0b8f-4527-a270-23e6ae80296f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:52.764909 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba84fa-0b8f-4527-a270-23e6ae80296f None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:52.765185 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba84fa-0b8f-4527-a270-23e6ae80296f None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:52.765541 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba84fa-0b8f-4527-a270-23e6ae80296f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:52.775536 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ba84fa-0b8f-4527-a270-23e6ae80296f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:51:52.783985 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-d1ba84fa-0b8f-4527-a270-23e6ae80296f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 14 20:51:52.783985 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:51:52.783985 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:51:52.783985 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:51:52.783985 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:51:52.783985 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:51:52.783985 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:51:52.783985 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:51:52.783985 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:51:52.783985 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:51:52.783985 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:51:52.783985 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:51:52.783985 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:51:52.783985 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:51:52.783985 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:51:52.783985 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:51:52.785427 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:51:52.785427 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:51:52.785427 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:51:52.785427 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:51:52.785427 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:51:52.785427 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:51:52.785427 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:51:52.785427 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:51:52.785427 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:51:52.785427 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:51:52.785427 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:51:52.785427 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:51:52.785427 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:51:52.785427 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:51:52.785427 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:51:52.785427 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:51:52.786670 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:51:52.786670 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:51:52.786670 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:51:52.786670 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:51:52.786670 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:51:52.786670 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:51:52.786670 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:51:52.786670 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:51:52.786670 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:51:52.786670 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:51:52.786670 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 14 20:51:52.786670 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:51:52.786670 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 577/1149] 10.222.0.52 () {56 vars in 1096 bytes} [Sat May 14 20:51:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:51:52.791365 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f7e700-9e6e-4f4a-8381-6e9192f0c922 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:52.885502 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f7e700-9e6e-4f4a-8381-6e9192f0c922 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:52.918362 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b938a6-21b4-42c6-93c4-01bc33fbfd48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:52.919038 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b938a6-21b4-42c6-93c4-01bc33fbfd48 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:52.919342 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b938a6-21b4-42c6-93c4-01bc33fbfd48 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:52.919653 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b938a6-21b4-42c6-93c4-01bc33fbfd48 None admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:52.920399 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b938a6-21b4-42c6-93c4-01bc33fbfd48 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:51:52.921008 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b938a6-21b4-42c6-93c4-01bc33fbfd48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:52.922230 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b938a6-21b4-42c6-93c4-01bc33fbfd48 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:52.930679 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 573/1150] 10.222.0.52 () {56 vars in 1099 bytes} [Sat May 14 20:51:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:51:52.937345 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ba84fa-0b8f-4527-a270-23e6ae80296f None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:53.035738 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ba84fa-0b8f-4527-a270-23e6ae80296f None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:53.071687 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852740f5-9eb5-4541-9e66-510eb883909b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:53.072543 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852740f5-9eb5-4541-9e66-510eb883909b None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:53.072849 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852740f5-9eb5-4541-9e66-510eb883909b None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:53.073227 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852740f5-9eb5-4541-9e66-510eb883909b None admin] PATH_INFO: `/v3/users/50c19f75bb114859ba813baf4515aa4d` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:53.074413 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852740f5-9eb5-4541-9e66-510eb883909b None admin] RBAC: Authorizing `identity:get_user(user_id=50c19f75bb114859ba813baf4515aa4d)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:53.075882 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852740f5-9eb5-4541-9e66-510eb883909b None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:53.078350 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 578/1151] 10.222.0.52 () {56 vars in 1177 bytes} [Sat May 14 20:51:52 2022] GET /identity/v3/users/50c19f75bb114859ba813baf4515aa4d => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:51:53.084257 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b938a6-21b4-42c6-93c4-01bc33fbfd48 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:53.192928 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b938a6-21b4-42c6-93c4-01bc33fbfd48 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:53.225289 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30875707-c917-4236-bfe2-ebe5e2fe0efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:53.226236 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30875707-c917-4236-bfe2-ebe5e2fe0efc None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:53.226513 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30875707-c917-4236-bfe2-ebe5e2fe0efc None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:53.226784 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30875707-c917-4236-bfe2-ebe5e2fe0efc None admin] PATH_INFO: `/v3/projects/271f2b6a94b4458c84d07a356546f596` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:53.227970 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30875707-c917-4236-bfe2-ebe5e2fe0efc None admin] RBAC: Authorizing `identity:get_project(project_id=271f2b6a94b4458c84d07a356546f596)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:53.229396 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30875707-c917-4236-bfe2-ebe5e2fe0efc None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:53.231041 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 574/1152] 10.222.0.52 () {56 vars in 1186 bytes} [Sat May 14 20:51:53 2022] GET /identity/v3/projects/271f2b6a94b4458c84d07a356546f596 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:51:53.237400 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852740f5-9eb5-4541-9e66-510eb883909b None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:53.331850 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852740f5-9eb5-4541-9e66-510eb883909b None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:53.363992 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a1131d-c278-4e85-8b7d-1afe8a568dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:53.364857 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1131d-c278-4e85-8b7d-1afe8a568dc9 None admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:53.365141 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1131d-c278-4e85-8b7d-1afe8a568dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:53.365416 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1131d-c278-4e85-8b7d-1afe8a568dc9 None admin] PATH_INFO: `/v3/projects/271f2b6a94b4458c84d07a356546f596/users/50c19f75bb114859ba813baf4515aa4d/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:53.367349 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a1131d-c278-4e85-8b7d-1afe8a568dc9 None admin] RBAC: Authorizing `identity:create_grant(project_id=271f2b6a94b4458c84d07a356546f596, user_id=50c19f75bb114859ba813baf4515aa4d, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:53.368801 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a1131d-c278-4e85-8b7d-1afe8a568dc9 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:53.443816 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 579/1153] 10.222.0.52 () {58 vars in 1439 bytes} [Sat May 14 20:51:53 2022] PUT /identity/v3/projects/271f2b6a94b4458c84d07a356546f596/users/50c19f75bb114859ba813baf4515aa4d/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 20:51:55.801473 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803e288-8e6b-46dd-a807-08788a3cfe46 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:55.802034 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803e288-8e6b-46dd-a807-08788a3cfe46 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:55.802034 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803e288-8e6b-46dd-a807-08788a3cfe46 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:55.803356 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 575/1154] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:51:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:51:55.808885 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb964b-fc41-4a4c-b1e2-7d0605c86a0e None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:55.809277 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb964b-fc41-4a4c-b1e2-7d0605c86a0e None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:55.809448 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb964b-fc41-4a4c-b1e2-7d0605c86a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:55.825835 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-4bfb964b-fc41-4a4c-b1e2-7d0605c86a0e None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:51:55.827544 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-4bfb964b-fc41-4a4c-b1e2-7d0605c86a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:51:55.892862 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 580/1155] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:51:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 20:51:55.919330 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e803e288-8e6b-46dd-a807-08788a3cfe46 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:56.017674 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e803e288-8e6b-46dd-a807-08788a3cfe46 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:56.048769 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33e3f00-588f-419a-8cd9-ac33e5c22618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:56.049547 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e3f00-588f-419a-8cd9-ac33e5c22618 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:56.049829 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e3f00-588f-419a-8cd9-ac33e5c22618 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:56.050103 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e3f00-588f-419a-8cd9-ac33e5c22618 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:56.060201 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33e3f00-588f-419a-8cd9-ac33e5c22618 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:51:56.068383 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-f33e3f00-588f-419a-8cd9-ac33e5c22618 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 14 20:51:56.068383 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:51:56.068383 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:51:56.068383 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:51:56.068383 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:51:56.068383 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:51:56.068383 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:51:56.068383 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:51:56.068383 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:51:56.068383 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:51:56.068383 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:51:56.068383 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:51:56.068383 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:51:56.068383 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:51:56.068383 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:51:56.068383 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:51:56.069605 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:51:56.069605 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:51:56.069605 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:51:56.069605 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:51:56.069605 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:51:56.069605 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:51:56.069605 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:51:56.069605 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:51:56.069605 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:51:56.069605 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:51:56.069605 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:51:56.069605 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:51:56.069605 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:51:56.069605 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:51:56.069605 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:51:56.069605 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:51:56.070731 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:51:56.070731 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:51:56.070731 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:51:56.070731 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:51:56.070731 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:51:56.070731 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:51:56.070731 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:51:56.070731 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:51:56.070731 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:51:56.070731 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:51:56.070731 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 14 20:51:56.070731 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:51:56.070731 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 576/1156] 10.222.0.52 () {56 vars in 1096 bytes} [Sat May 14 20:51:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:51:56.075549 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfb964b-fc41-4a4c-b1e2-7d0605c86a0e None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:56.171089 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfb964b-fc41-4a4c-b1e2-7d0605c86a0e None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:56.204047 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57fee0c-eeaa-4e51-b2da-50589ddc8272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:56.204707 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57fee0c-eeaa-4e51-b2da-50589ddc8272 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:56.204992 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57fee0c-eeaa-4e51-b2da-50589ddc8272 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:56.205269 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57fee0c-eeaa-4e51-b2da-50589ddc8272 None admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:56.206004 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57fee0c-eeaa-4e51-b2da-50589ddc8272 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:51:56.206311 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57fee0c-eeaa-4e51-b2da-50589ddc8272 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:56.207710 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57fee0c-eeaa-4e51-b2da-50589ddc8272 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:56.215439 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 581/1157] 10.222.0.52 () {56 vars in 1099 bytes} [Sat May 14 20:51:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:51:56.221221 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33e3f00-588f-419a-8cd9-ac33e5c22618 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:56.315220 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33e3f00-588f-419a-8cd9-ac33e5c22618 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:56.346517 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8140e3-5277-4450-860b-a86a9f49f3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:56.347363 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8140e3-5277-4450-860b-a86a9f49f3f4 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:56.347668 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8140e3-5277-4450-860b-a86a9f49f3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:56.347941 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8140e3-5277-4450-860b-a86a9f49f3f4 None admin] PATH_INFO: `/v3/users/50c19f75bb114859ba813baf4515aa4d` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:56.349098 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8140e3-5277-4450-860b-a86a9f49f3f4 None admin] RBAC: Authorizing `identity:get_user(user_id=50c19f75bb114859ba813baf4515aa4d)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:56.350505 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8140e3-5277-4450-860b-a86a9f49f3f4 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:56.352122 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 577/1158] 10.222.0.52 () {56 vars in 1177 bytes} [Sat May 14 20:51:56 2022] GET /identity/v3/users/50c19f75bb114859ba813baf4515aa4d => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:51:56.358287 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57fee0c-eeaa-4e51-b2da-50589ddc8272 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:56.454182 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57fee0c-eeaa-4e51-b2da-50589ddc8272 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:56.485729 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d25efc5-fb83-4190-97a1-95f39c7ab246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:56.486358 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d25efc5-fb83-4190-97a1-95f39c7ab246 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:56.486643 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d25efc5-fb83-4190-97a1-95f39c7ab246 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:56.486921 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d25efc5-fb83-4190-97a1-95f39c7ab246 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:56.551806 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d25efc5-fb83-4190-97a1-95f39c7ab246 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:56.553247 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d25efc5-fb83-4190-97a1-95f39c7ab246 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:56.646764 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 582/1159] 10.222.0.52 () {58 vars in 1282 bytes} [Sat May 14 20:51:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 14 20:51:56.652527 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8140e3-5277-4450-860b-a86a9f49f3f4 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:56.746958 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8140e3-5277-4450-860b-a86a9f49f3f4 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:56.778242 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c695d1-2503-4e85-849e-1a6cfe62cd59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:56.779070 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c695d1-2503-4e85-849e-1a6cfe62cd59 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:56.779350 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c695d1-2503-4e85-849e-1a6cfe62cd59 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:56.780162 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c695d1-2503-4e85-849e-1a6cfe62cd59 None admin] PATH_INFO: `/v3/projects/271f2b6a94b4458c84d07a356546f596` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:56.781333 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c695d1-2503-4e85-849e-1a6cfe62cd59 None admin] RBAC: Authorizing `identity:get_project(project_id=271f2b6a94b4458c84d07a356546f596)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:56.782753 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c695d1-2503-4e85-849e-1a6cfe62cd59 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:56.784433 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 578/1160] 10.222.0.52 () {56 vars in 1186 bytes} [Sat May 14 20:51:56 2022] GET /identity/v3/projects/271f2b6a94b4458c84d07a356546f596 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:51:56.790539 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d25efc5-fb83-4190-97a1-95f39c7ab246 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:56.885229 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d25efc5-fb83-4190-97a1-95f39c7ab246 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:56.918217 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da69ed3-2824-462d-9d72-0858a8652429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:56.918798 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da69ed3-2824-462d-9d72-0858a8652429 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:56.919077 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da69ed3-2824-462d-9d72-0858a8652429 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:56.919349 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da69ed3-2824-462d-9d72-0858a8652429 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:56.921231 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da69ed3-2824-462d-9d72-0858a8652429 None admin] RBAC: Adding query filter params (role.id=24c463e2b4d44dd28cd2723a69a8ed2e, scope.project.id=271f2b6a94b4458c84d07a356546f596, user.id=50c19f75bb114859ba813baf4515aa4d) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:51:56.921548 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da69ed3-2824-462d-9d72-0858a8652429 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:56.922957 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da69ed3-2824-462d-9d72-0858a8652429 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:56.928820 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 583/1161] 10.222.0.52 () {56 vars in 1374 bytes} [Sat May 14 20:51:56 2022] GET /identity/v3/role_assignments?user.id=50c19f75bb114859ba813baf4515aa4d&scope.project.id=271f2b6a94b4458c84d07a356546f596&role.id=24c463e2b4d44dd28cd2723a69a8ed2e => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:51:59.234769 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea16da20-7c45-450e-94a2-43bcf61ca9ba None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:59.235276 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea16da20-7c45-450e-94a2-43bcf61ca9ba None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:59.235276 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea16da20-7c45-450e-94a2-43bcf61ca9ba None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:59.236593 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 579/1162] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:51:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:51:59.241842 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b74e1-6a87-424d-9fbd-f44e7af2ff1e None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:59.242251 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b74e1-6a87-424d-9fbd-f44e7af2ff1e None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:59.242404 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b74e1-6a87-424d-9fbd-f44e7af2ff1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:59.259085 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-d20b74e1-6a87-424d-9fbd-f44e7af2ff1e None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:51:59.260315 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d20b74e1-6a87-424d-9fbd-f44e7af2ff1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:51:59.323917 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 584/1163] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:51:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 20:51:59.348650 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea16da20-7c45-450e-94a2-43bcf61ca9ba None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:59.444325 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea16da20-7c45-450e-94a2-43bcf61ca9ba None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:59.476669 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf45f6-52c2-4e37-bf2f-e3e11b7cbeba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:59.477295 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf45f6-52c2-4e37-bf2f-e3e11b7cbeba None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:59.477572 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf45f6-52c2-4e37-bf2f-e3e11b7cbeba None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:59.477841 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf45f6-52c2-4e37-bf2f-e3e11b7cbeba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:59.540397 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bf45f6-52c2-4e37-bf2f-e3e11b7cbeba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:59.541799 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bf45f6-52c2-4e37-bf2f-e3e11b7cbeba None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:59.633803 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 580/1164] 10.222.0.52 () {58 vars in 1282 bytes} [Sat May 14 20:51:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 14 20:51:59.640452 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20b74e1-6a87-424d-9fbd-f44e7af2ff1e None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:59.733214 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20b74e1-6a87-424d-9fbd-f44e7af2ff1e None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:59.765883 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d96a282-7d64-4648-b7c2-0120b2bb4532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:59.766658 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d96a282-7d64-4648-b7c2-0120b2bb4532 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:59.766940 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d96a282-7d64-4648-b7c2-0120b2bb4532 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:59.767215 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d96a282-7d64-4648-b7c2-0120b2bb4532 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:59.773623 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d96a282-7d64-4648-b7c2-0120b2bb4532 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:59.775043 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d96a282-7d64-4648-b7c2-0120b2bb4532 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:59.788693 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-6d96a282-7d64-4648-b7c2-0120b2bb4532 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 14 20:51:59.788693 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:51:59.788693 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 14 20:51:59.788693 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 14 20:51:59.788693 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 20:51:59.788693 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 20:51:59.788693 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 20:51:59.788693 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 20:51:59.788693 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 14 20:51:59.788693 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:51:59.788693 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 20:51:59.788693 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:51:59.788693 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:51:59.788693 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:51:59.788693 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:51:59.788693 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:51:59.788693 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:51:59.789882 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:51:59.789882 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:51:59.789882 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:51:59.789882 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:51:59.789882 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:51:59.789882 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:51:59.789882 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:51:59.789882 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:51:59.789882 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:51:59.789882 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:51:59.789882 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:51:59.789882 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:51:59.789882 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:51:59.789882 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:51:59.789882 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:51:59.789882 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:51:59.790809 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:51:59.790809 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:51:59.790809 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:51:59.790809 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:51:59.790809 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:51:59.790809 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:51:59.790809 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:51:59.790809 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:51:59.790809 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:51:59.790809 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:51:59.790809 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 14 20:51:59.790809 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:51:59.790809 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 14 20:51:59.790809 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:51:59.790809 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 585/1165] 10.222.0.52 () {56 vars in 1117 bytes} [Sat May 14 20:51:59 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 20:51:59.795918 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf45f6-52c2-4e37-bf2f-e3e11b7cbeba None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:51:59.888173 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf45f6-52c2-4e37-bf2f-e3e11b7cbeba None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:51:59.921037 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a396fceb-a2c0-4a4d-b613-c10dbbb483a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:51:59.921688 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a396fceb-a2c0-4a4d-b613-c10dbbb483a3 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:51:59.921967 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a396fceb-a2c0-4a4d-b613-c10dbbb483a3 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:51:59.922238 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a396fceb-a2c0-4a4d-b613-c10dbbb483a3 None admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:51:59.922942 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a396fceb-a2c0-4a4d-b613-c10dbbb483a3 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:51:59.923242 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a396fceb-a2c0-4a4d-b613-c10dbbb483a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:51:59.924636 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a396fceb-a2c0-4a4d-b613-c10dbbb483a3 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:51:59.932046 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 581/1166] 10.222.0.52 () {56 vars in 1115 bytes} [Sat May 14 20:51:59 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:52:02.185113 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc790e-4a5a-4435-afa5-741fc2619d8b None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:52:02.186154 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc790e-4a5a-4435-afa5-741fc2619d8b None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:52:02.186154 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc790e-4a5a-4435-afa5-741fc2619d8b None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:52:02.187466 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 586/1167] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:52:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:52:02.192682 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b4b54-4b4a-45bd-95d6-1338876d369e None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:52:02.193094 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b4b54-4b4a-45bd-95d6-1338876d369e None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:52:02.193240 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b4b54-4b4a-45bd-95d6-1338876d369e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:52:02.210255 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-703b4b54-4b4a-45bd-95d6-1338876d369e None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:52:02.211423 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-703b4b54-4b4a-45bd-95d6-1338876d369e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:52:02.274705 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 582/1168] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:52:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 20:52:02.298902 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fc790e-4a5a-4435-afa5-741fc2619d8b None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:52:02.396857 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fc790e-4a5a-4435-afa5-741fc2619d8b None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:52:02.428967 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce671b01-a0ef-457e-b559-6f2a7c185f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:52:02.429608 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce671b01-a0ef-457e-b559-6f2a7c185f9c None admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:52:02.429893 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce671b01-a0ef-457e-b559-6f2a7c185f9c None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:52:02.430167 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce671b01-a0ef-457e-b559-6f2a7c185f9c None admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:52:02.430899 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce671b01-a0ef-457e-b559-6f2a7c185f9c None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:52:02.432290 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce671b01-a0ef-457e-b559-6f2a7c185f9c None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:52:02.519143 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 587/1169] 10.222.0.52 () {60 vars in 1138 bytes} [Sat May 14 20:52:02 2022] POST /identity/v3/domains => generated 267 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 20:52:04.860527 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef45560-1cf2-4d57-ac5b-2e51c4259cdf None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:52:04.861067 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef45560-1cf2-4d57-ac5b-2e51c4259cdf None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:52:04.861067 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef45560-1cf2-4d57-ac5b-2e51c4259cdf None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:52:04.862408 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 583/1170] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:52:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:52:04.867677 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b87cb-7896-4ed2-a221-3f97307d7193 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:52:04.868115 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b87cb-7896-4ed2-a221-3f97307d7193 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:52:04.868234 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b87cb-7896-4ed2-a221-3f97307d7193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:52:04.885731 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-e95b87cb-7896-4ed2-a221-3f97307d7193 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:52:04.886888 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e95b87cb-7896-4ed2-a221-3f97307d7193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:52:04.950689 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 588/1171] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:52:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 20:52:04.975297 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef45560-1cf2-4d57-ac5b-2e51c4259cdf None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:52:05.071209 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef45560-1cf2-4d57-ac5b-2e51c4259cdf None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:52:05.102864 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b1c91a-dd60-4fa0-938e-082f8639ad1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:52:05.103729 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b1c91a-dd60-4fa0-938e-082f8639ad1e None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:52:05.104013 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b1c91a-dd60-4fa0-938e-082f8639ad1e None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:52:05.104287 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b1c91a-dd60-4fa0-938e-082f8639ad1e None admin] PATH_INFO: `/v3/domains/896ea41a170641b78a24e078892360b1` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:52:05.114163 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b1c91a-dd60-4fa0-938e-082f8639ad1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=896ea41a170641b78a24e078892360b1)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:52:05.115582 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b1c91a-dd60-4fa0-938e-082f8639ad1e None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:52:05.117207 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 584/1172] 10.222.0.52 () {56 vars in 1183 bytes} [Sat May 14 20:52:04 2022] GET /identity/v3/domains/896ea41a170641b78a24e078892360b1 => generated 267 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:52:05.123568 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95b87cb-7896-4ed2-a221-3f97307d7193 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:52:05.218565 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95b87cb-7896-4ed2-a221-3f97307d7193 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:52:05.251408 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca94f54f-2162-4d19-92ff-f27e97b56b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:52:05.252125 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca94f54f-2162-4d19-92ff-f27e97b56b3d None admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:52:05.252406 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca94f54f-2162-4d19-92ff-f27e97b56b3d None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:52:05.252681 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca94f54f-2162-4d19-92ff-f27e97b56b3d None admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:52:05.253388 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca94f54f-2162-4d19-92ff-f27e97b56b3d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:52:05.254803 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca94f54f-2162-4d19-92ff-f27e97b56b3d None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:52:05.380863 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 589/1173] 10.222.0.52 () {60 vars in 1141 bytes} [Sat May 14 20:52:05 2022] POST /identity/v3/projects => generated 361 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 20:52:07.713646 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32228370-0e1f-4b82-b63e-b68238308185 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:52:07.714209 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32228370-0e1f-4b82-b63e-b68238308185 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:52:07.714209 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32228370-0e1f-4b82-b63e-b68238308185 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:52:07.715548 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 585/1174] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:52:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:52:07.721032 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe3833-0d7c-4a26-a4d4-85446cd8c3ce None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:52:07.721478 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe3833-0d7c-4a26-a4d4-85446cd8c3ce None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:52:07.721603 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe3833-0d7c-4a26-a4d4-85446cd8c3ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:52:07.738352 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-5afe3833-0d7c-4a26-a4d4-85446cd8c3ce None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:52:07.739551 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-5afe3833-0d7c-4a26-a4d4-85446cd8c3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:52:07.803201 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 590/1175] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:52:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 20:52:07.828998 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32228370-0e1f-4b82-b63e-b68238308185 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:52:07.925625 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32228370-0e1f-4b82-b63e-b68238308185 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:52:07.964003 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b0436f-0575-476f-94b7-8b205d1b56b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:52:07.964850 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0436f-0575-476f-94b7-8b205d1b56b9 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:52:07.965134 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0436f-0575-476f-94b7-8b205d1b56b9 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:52:07.965406 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0436f-0575-476f-94b7-8b205d1b56b9 None admin] PATH_INFO: `/v3/domains/896ea41a170641b78a24e078892360b1` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:52:07.967122 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b0436f-0575-476f-94b7-8b205d1b56b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=896ea41a170641b78a24e078892360b1)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:52:07.968738 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b0436f-0575-476f-94b7-8b205d1b56b9 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:52:07.970334 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 586/1176] 10.222.0.52 () {56 vars in 1183 bytes} [Sat May 14 20:52:07 2022] GET /identity/v3/domains/896ea41a170641b78a24e078892360b1 => generated 267 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:52:07.976198 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe3833-0d7c-4a26-a4d4-85446cd8c3ce None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:52:08.072751 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe3833-0d7c-4a26-a4d4-85446cd8c3ce None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:52:08.106405 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd56bf-d193-48a1-997d-9c7c432edf19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:52:08.107063 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd56bf-d193-48a1-997d-9c7c432edf19 None admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:52:08.107568 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd56bf-d193-48a1-997d-9c7c432edf19 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:52:08.107862 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd56bf-d193-48a1-997d-9c7c432edf19 None admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:52:08.108563 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd56bf-d193-48a1-997d-9c7c432edf19 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:52:08.109991 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd56bf-d193-48a1-997d-9c7c432edf19 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:52:08.226669 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 591/1177] 10.222.0.52 () {60 vars in 1132 bytes} [Sat May 14 20:52:07 2022] POST /identity/v3/users => generated 311 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 20:52:10.554959 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7271bf-f5a7-451a-a001-b1acae863291 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:52:10.555525 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7271bf-f5a7-451a-a001-b1acae863291 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:52:10.555649 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7271bf-f5a7-451a-a001-b1acae863291 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:52:10.556899 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 587/1178] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:52:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:52:10.562027 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f10a674-675a-4daf-84c1-6c841b20ac26 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:52:10.562417 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f10a674-675a-4daf-84c1-6c841b20ac26 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:52:10.562605 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f10a674-675a-4daf-84c1-6c841b20ac26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:52:10.579273 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-8f10a674-675a-4daf-84c1-6c841b20ac26 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:52:10.580485 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-8f10a674-675a-4daf-84c1-6c841b20ac26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:52:10.643753 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 592/1179] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:52:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 20:52:10.668061 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7271bf-f5a7-451a-a001-b1acae863291 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:52:10.764749 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7271bf-f5a7-451a-a001-b1acae863291 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:52:10.796849 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11090bcf-d9bd-4613-8386-99a08f780db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:52:10.797628 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11090bcf-d9bd-4613-8386-99a08f780db2 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:52:10.797911 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11090bcf-d9bd-4613-8386-99a08f780db2 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:52:10.798188 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11090bcf-d9bd-4613-8386-99a08f780db2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:52:10.808341 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11090bcf-d9bd-4613-8386-99a08f780db2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:52:10.816522 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-11090bcf-d9bd-4613-8386-99a08f780db2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 14 20:52:10.816522 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:52:10.816522 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:52:10.816522 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:52:10.816522 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:52:10.816522 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:52:10.816522 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:52:10.816522 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:52:10.816522 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:52:10.816522 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:52:10.816522 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:52:10.816522 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:52:10.816522 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:52:10.816522 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:52:10.816522 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:52:10.816522 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:52:10.817610 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:52:10.817610 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:52:10.817610 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:52:10.817610 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:52:10.817610 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:52:10.817610 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:52:10.817610 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:52:10.817610 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:52:10.817610 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:52:10.817610 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:52:10.817610 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:52:10.817610 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:52:10.817610 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:52:10.817610 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:52:10.817610 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:52:10.817610 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:52:10.818658 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:52:10.818658 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:52:10.818658 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:52:10.818658 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:52:10.818658 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:52:10.818658 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:52:10.818658 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:52:10.818658 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:52:10.818658 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:52:10.818658 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:52:10.818658 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 14 20:52:10.818658 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:52:10.818658 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 588/1180] 10.222.0.52 () {56 vars in 1096 bytes} [Sat May 14 20:52:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:52:10.823643 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f10a674-675a-4daf-84c1-6c841b20ac26 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:52:10.916674 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f10a674-675a-4daf-84c1-6c841b20ac26 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:52:10.949278 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28ff71a-0814-4385-8a66-e46154bdf024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:52:10.949936 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ff71a-0814-4385-8a66-e46154bdf024 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:52:10.950219 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ff71a-0814-4385-8a66-e46154bdf024 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:52:10.950494 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ff71a-0814-4385-8a66-e46154bdf024 None admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:52:10.951231 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28ff71a-0814-4385-8a66-e46154bdf024 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:52:10.951558 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28ff71a-0814-4385-8a66-e46154bdf024 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:52:10.952914 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28ff71a-0814-4385-8a66-e46154bdf024 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:52:10.960600 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 593/1181] 10.222.0.52 () {56 vars in 1099 bytes} [Sat May 14 20:52:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:52:10.966928 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11090bcf-d9bd-4613-8386-99a08f780db2 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:52:11.060475 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11090bcf-d9bd-4613-8386-99a08f780db2 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:52:11.092302 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8616a56-00b5-4e63-a708-b9357e77cf6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:52:11.093498 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8616a56-00b5-4e63-a708-b9357e77cf6a None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:52:11.093498 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8616a56-00b5-4e63-a708-b9357e77cf6a None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:52:11.093741 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8616a56-00b5-4e63-a708-b9357e77cf6a None admin] PATH_INFO: `/v3/users/1f57529fb29945a781e6e1e6236fa1c6` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:52:11.105964 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8616a56-00b5-4e63-a708-b9357e77cf6a None admin] RBAC: Authorizing `identity:get_user(user_id=1f57529fb29945a781e6e1e6236fa1c6)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:52:11.107509 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8616a56-00b5-4e63-a708-b9357e77cf6a None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:52:11.109106 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 589/1182] 10.222.0.52 () {56 vars in 1177 bytes} [Sat May 14 20:52:10 2022] GET /identity/v3/users/1f57529fb29945a781e6e1e6236fa1c6 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:52:11.114721 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28ff71a-0814-4385-8a66-e46154bdf024 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:52:11.281045 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28ff71a-0814-4385-8a66-e46154bdf024 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:52:11.314862 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c019f4c4-f501-45e9-8ffd-5968563f1d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:52:11.315531 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019f4c4-f501-45e9-8ffd-5968563f1d91 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:52:11.315817 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019f4c4-f501-45e9-8ffd-5968563f1d91 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:52:11.316094 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019f4c4-f501-45e9-8ffd-5968563f1d91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:52:11.379874 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c019f4c4-f501-45e9-8ffd-5968563f1d91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:52:11.381301 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c019f4c4-f501-45e9-8ffd-5968563f1d91 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:52:11.472788 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 594/1183] 10.222.0.52 () {58 vars in 1282 bytes} [Sat May 14 20:52:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 14 20:52:11.478573 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8616a56-00b5-4e63-a708-b9357e77cf6a None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:52:11.574564 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8616a56-00b5-4e63-a708-b9357e77cf6a None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:52:11.607570 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56968539-6fc7-48a3-a612-dc989289a135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:52:11.608463 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56968539-6fc7-48a3-a612-dc989289a135 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:52:11.608750 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56968539-6fc7-48a3-a612-dc989289a135 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:52:11.609025 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56968539-6fc7-48a3-a612-dc989289a135 None admin] PATH_INFO: `/v3/projects/c6bd2675e80448cb9b171060bef9ccba` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:52:11.610227 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56968539-6fc7-48a3-a612-dc989289a135 None admin] RBAC: Authorizing `identity:get_project(project_id=c6bd2675e80448cb9b171060bef9ccba)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:52:11.611692 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56968539-6fc7-48a3-a612-dc989289a135 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:52:11.613375 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 590/1184] 10.222.0.52 () {56 vars in 1186 bytes} [Sat May 14 20:52:11 2022] GET /identity/v3/projects/c6bd2675e80448cb9b171060bef9ccba => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:52:11.619406 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c019f4c4-f501-45e9-8ffd-5968563f1d91 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:52:11.713295 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c019f4c4-f501-45e9-8ffd-5968563f1d91 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:52:11.746071 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce39f33-7c28-4a00-a68f-0f669a31306c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:52:11.746969 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce39f33-7c28-4a00-a68f-0f669a31306c None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:52:11.747254 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce39f33-7c28-4a00-a68f-0f669a31306c None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:52:11.747597 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce39f33-7c28-4a00-a68f-0f669a31306c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:52:11.748588 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce39f33-7c28-4a00-a68f-0f669a31306c None admin] RBAC: Adding query filter params (role.id=24c463e2b4d44dd28cd2723a69a8ed2e, scope.project.id=c6bd2675e80448cb9b171060bef9ccba, user.id=1f57529fb29945a781e6e1e6236fa1c6) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:52:11.748903 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce39f33-7c28-4a00-a68f-0f669a31306c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:52:11.750343 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce39f33-7c28-4a00-a68f-0f669a31306c None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:52:11.755631 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 595/1185] 10.222.0.52 () {56 vars in 1374 bytes} [Sat May 14 20:52:11 2022] GET /identity/v3/role_assignments?user.id=1f57529fb29945a781e6e1e6236fa1c6&scope.project.id=c6bd2675e80448cb9b171060bef9ccba&role.id=24c463e2b4d44dd28cd2723a69a8ed2e => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:52:14.011801 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b2e2f6-0e11-4474-ae97-5c3516061025 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:52:14.012351 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b2e2f6-0e11-4474-ae97-5c3516061025 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:52:14.012351 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b2e2f6-0e11-4474-ae97-5c3516061025 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:52:14.014331 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 591/1186] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:52:14 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:52:14.019654 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8290a219-fe28-4bc0-a53d-95daca942b04 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:52:14.020073 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8290a219-fe28-4bc0-a53d-95daca942b04 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:52:14.020213 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8290a219-fe28-4bc0-a53d-95daca942b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:52:14.036371 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-8290a219-fe28-4bc0-a53d-95daca942b04 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:52:14.037540 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-8290a219-fe28-4bc0-a53d-95daca942b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:52:14.106558 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 596/1187] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:52:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 20:52:14.135989 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b2e2f6-0e11-4474-ae97-5c3516061025 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:52:14.231611 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b2e2f6-0e11-4474-ae97-5c3516061025 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:52:14.264352 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6fceb6-ff3d-4d8d-9c55-7e772a4d4f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:52:14.265119 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6fceb6-ff3d-4d8d-9c55-7e772a4d4f6e None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:52:14.265397 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6fceb6-ff3d-4d8d-9c55-7e772a4d4f6e None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:52:14.272163 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6fceb6-ff3d-4d8d-9c55-7e772a4d4f6e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:52:14.275143 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6fceb6-ff3d-4d8d-9c55-7e772a4d4f6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:52:14.282888 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-5c6fceb6-ff3d-4d8d-9c55-7e772a4d4f6e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 14 20:52:14.282888 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:52:14.282888 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:52:14.282888 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:52:14.282888 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:52:14.282888 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:52:14.282888 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:52:14.282888 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:52:14.282888 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:52:14.282888 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:52:14.282888 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:52:14.282888 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:52:14.282888 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:52:14.282888 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:52:14.282888 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:52:14.282888 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:52:14.284110 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:52:14.284110 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:52:14.284110 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:52:14.284110 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:52:14.284110 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:52:14.284110 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:52:14.284110 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:52:14.284110 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:52:14.284110 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:52:14.284110 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:52:14.284110 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:52:14.284110 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:52:14.284110 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:52:14.284110 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:52:14.284110 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:52:14.284110 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:52:14.285154 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:52:14.285154 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:52:14.285154 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:52:14.285154 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:52:14.285154 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:52:14.285154 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:52:14.285154 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:52:14.285154 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:52:14.285154 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:52:14.285154 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:52:14.285154 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 14 20:52:14.285154 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:52:14.285154 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 592/1188] 10.222.0.52 () {56 vars in 1096 bytes} [Sat May 14 20:52:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 20:52:14.290019 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8290a219-fe28-4bc0-a53d-95daca942b04 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:52:14.385694 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8290a219-fe28-4bc0-a53d-95daca942b04 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:52:14.417548 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518c11c4-1872-4e12-86cf-749afb9b9e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:52:14.418209 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c11c4-1872-4e12-86cf-749afb9b9e39 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:52:14.418495 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c11c4-1872-4e12-86cf-749afb9b9e39 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:52:14.418775 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c11c4-1872-4e12-86cf-749afb9b9e39 None admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:52:14.420110 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518c11c4-1872-4e12-86cf-749afb9b9e39 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:52:14.420421 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518c11c4-1872-4e12-86cf-749afb9b9e39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:52:14.421791 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518c11c4-1872-4e12-86cf-749afb9b9e39 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:52:14.429768 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 597/1189] 10.222.0.52 () {56 vars in 1099 bytes} [Sat May 14 20:52:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:52:14.436663 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6fceb6-ff3d-4d8d-9c55-7e772a4d4f6e None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:52:14.532273 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6fceb6-ff3d-4d8d-9c55-7e772a4d4f6e None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:52:14.564033 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18672081-f985-40ba-ba8f-0e82ba82ed55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:52:14.564868 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18672081-f985-40ba-ba8f-0e82ba82ed55 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:52:14.565144 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18672081-f985-40ba-ba8f-0e82ba82ed55 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:52:14.565410 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18672081-f985-40ba-ba8f-0e82ba82ed55 None admin] PATH_INFO: `/v3/users/1f57529fb29945a781e6e1e6236fa1c6` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:52:14.566595 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18672081-f985-40ba-ba8f-0e82ba82ed55 None admin] RBAC: Authorizing `identity:get_user(user_id=1f57529fb29945a781e6e1e6236fa1c6)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:52:14.568048 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18672081-f985-40ba-ba8f-0e82ba82ed55 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:52:14.569624 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 593/1190] 10.222.0.52 () {56 vars in 1177 bytes} [Sat May 14 20:52:14 2022] GET /identity/v3/users/1f57529fb29945a781e6e1e6236fa1c6 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:52:14.575329 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518c11c4-1872-4e12-86cf-749afb9b9e39 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:52:14.671243 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518c11c4-1872-4e12-86cf-749afb9b9e39 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:52:14.702061 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d93e28-df70-436c-805d-a25491dd7922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:52:14.702884 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d93e28-df70-436c-805d-a25491dd7922 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:52:14.703158 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d93e28-df70-436c-805d-a25491dd7922 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:52:14.703425 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d93e28-df70-436c-805d-a25491dd7922 None admin] PATH_INFO: `/v3/projects/c6bd2675e80448cb9b171060bef9ccba` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:52:14.704601 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d93e28-df70-436c-805d-a25491dd7922 None admin] RBAC: Authorizing `identity:get_project(project_id=c6bd2675e80448cb9b171060bef9ccba)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:52:14.706010 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d93e28-df70-436c-805d-a25491dd7922 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:52:14.707683 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 598/1191] 10.222.0.52 () {56 vars in 1186 bytes} [Sat May 14 20:52:14 2022] GET /identity/v3/projects/c6bd2675e80448cb9b171060bef9ccba => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:52:14.713575 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18672081-f985-40ba-ba8f-0e82ba82ed55 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:52:14.808867 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18672081-f985-40ba-ba8f-0e82ba82ed55 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:52:14.839801 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2063cf25-9a8f-4e5d-99a7-a348d2a86f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:52:14.840659 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063cf25-9a8f-4e5d-99a7-a348d2a86f9f None admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:52:14.840941 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063cf25-9a8f-4e5d-99a7-a348d2a86f9f None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:52:14.841741 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063cf25-9a8f-4e5d-99a7-a348d2a86f9f None admin] PATH_INFO: `/v3/projects/c6bd2675e80448cb9b171060bef9ccba/users/1f57529fb29945a781e6e1e6236fa1c6/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:52:14.843712 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2063cf25-9a8f-4e5d-99a7-a348d2a86f9f None admin] RBAC: Authorizing `identity:create_grant(project_id=c6bd2675e80448cb9b171060bef9ccba, user_id=1f57529fb29945a781e6e1e6236fa1c6, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:52:14.845144 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2063cf25-9a8f-4e5d-99a7-a348d2a86f9f None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:52:14.924050 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 594/1192] 10.222.0.52 () {58 vars in 1439 bytes} [Sat May 14 20:52:14 2022] PUT /identity/v3/projects/c6bd2675e80448cb9b171060bef9ccba/users/1f57529fb29945a781e6e1e6236fa1c6/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 20:52:17.189710 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3453748-6521-43da-8558-7fea1fc9e5d6 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:52:17.190235 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3453748-6521-43da-8558-7fea1fc9e5d6 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:52:17.190235 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3453748-6521-43da-8558-7fea1fc9e5d6 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:52:17.191539 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 599/1193] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:52:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:52:17.196738 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79761691-99cd-46d6-8f08-b5c8227e3707 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:52:17.197160 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79761691-99cd-46d6-8f08-b5c8227e3707 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:52:17.197271 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79761691-99cd-46d6-8f08-b5c8227e3707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:52:17.213472 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-79761691-99cd-46d6-8f08-b5c8227e3707 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:52:17.214644 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-79761691-99cd-46d6-8f08-b5c8227e3707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:52:17.277937 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 595/1194] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:52:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 14 20:52:17.302104 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3453748-6521-43da-8558-7fea1fc9e5d6 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:52:17.399053 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3453748-6521-43da-8558-7fea1fc9e5d6 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:52:17.430941 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356d3e23-7e50-4c16-9e7a-31b7fd1cb3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:52:17.431733 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d3e23-7e50-4c16-9e7a-31b7fd1cb3e1 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:52:17.432015 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d3e23-7e50-4c16-9e7a-31b7fd1cb3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:52:17.432289 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d3e23-7e50-4c16-9e7a-31b7fd1cb3e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:52:17.441948 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356d3e23-7e50-4c16-9e7a-31b7fd1cb3e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:52:17.449357 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-356d3e23-7e50-4c16-9e7a-31b7fd1cb3e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 14 20:52:17.449357 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:52:17.449357 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:52:17.449357 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:52:17.449357 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:52:17.449357 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:52:17.449357 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:52:17.449357 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:52:17.449357 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:52:17.449357 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:52:17.449357 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:52:17.449357 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:52:17.449357 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:52:17.449357 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:52:17.449357 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:52:17.449357 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:52:17.450990 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:52:17.450990 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:52:17.450990 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:52:17.450990 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:52:17.450990 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:52:17.450990 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:52:17.450990 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:52:17.450990 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:52:17.450990 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:52:17.450990 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:52:17.450990 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:52:17.450990 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:52:17.450990 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:52:17.450990 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:52:17.450990 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:52:17.450990 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:52:17.452043 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:52:17.452043 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:52:17.452043 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:52:17.452043 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:52:17.452043 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:52:17.452043 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:52:17.452043 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:52:17.452043 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:52:17.452043 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:52:17.452043 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:52:17.452043 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 14 20:52:17.452043 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:52:17.452043 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 600/1195] 10.222.0.52 () {56 vars in 1096 bytes} [Sat May 14 20:52:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:52:17.457090 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79761691-99cd-46d6-8f08-b5c8227e3707 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:52:17.551005 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79761691-99cd-46d6-8f08-b5c8227e3707 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:52:17.582897 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee62071-b2f8-4b55-af7e-73359dfdc51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:52:17.583567 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee62071-b2f8-4b55-af7e-73359dfdc51b None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:52:17.583847 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee62071-b2f8-4b55-af7e-73359dfdc51b None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:52:17.584119 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee62071-b2f8-4b55-af7e-73359dfdc51b None admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:52:17.584840 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee62071-b2f8-4b55-af7e-73359dfdc51b None admin] RBAC: Adding query filter params (name=admin) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:52:17.585140 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee62071-b2f8-4b55-af7e-73359dfdc51b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:52:17.586490 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee62071-b2f8-4b55-af7e-73359dfdc51b None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:52:17.594330 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 596/1196] 10.222.0.52 () {56 vars in 1099 bytes} [Sat May 14 20:52:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:52:17.600078 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356d3e23-7e50-4c16-9e7a-31b7fd1cb3e1 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:52:17.694963 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356d3e23-7e50-4c16-9e7a-31b7fd1cb3e1 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:52:17.726676 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1079550b-07cd-40ef-b4f7-b98d45365bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:52:17.727622 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1079550b-07cd-40ef-b4f7-b98d45365bad None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:52:17.727817 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1079550b-07cd-40ef-b4f7-b98d45365bad None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:52:17.728089 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1079550b-07cd-40ef-b4f7-b98d45365bad None admin] PATH_INFO: `/v3/users/1f57529fb29945a781e6e1e6236fa1c6` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:52:17.729245 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1079550b-07cd-40ef-b4f7-b98d45365bad None admin] RBAC: Authorizing `identity:get_user(user_id=1f57529fb29945a781e6e1e6236fa1c6)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:52:17.730653 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1079550b-07cd-40ef-b4f7-b98d45365bad None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:52:17.732725 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 601/1197] 10.222.0.52 () {56 vars in 1177 bytes} [Sat May 14 20:52:17 2022] GET /identity/v3/users/1f57529fb29945a781e6e1e6236fa1c6 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:52:17.738253 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee62071-b2f8-4b55-af7e-73359dfdc51b None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:52:17.832973 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee62071-b2f8-4b55-af7e-73359dfdc51b None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:52:17.863503 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449a5897-3759-4ef2-9dd3-925b87e978f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:52:17.864125 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449a5897-3759-4ef2-9dd3-925b87e978f4 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:52:17.864406 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449a5897-3759-4ef2-9dd3-925b87e978f4 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:52:17.864676 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449a5897-3759-4ef2-9dd3-925b87e978f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:52:17.927491 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449a5897-3759-4ef2-9dd3-925b87e978f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:52:17.928937 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449a5897-3759-4ef2-9dd3-925b87e978f4 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:52:18.022098 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 597/1198] 10.222.0.52 () {58 vars in 1282 bytes} [Sat May 14 20:52:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 14 20:52:18.028244 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1079550b-07cd-40ef-b4f7-b98d45365bad None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:52:18.127238 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1079550b-07cd-40ef-b4f7-b98d45365bad None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:52:18.159727 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcac4cac-af47-41c9-acf6-dca88c5731c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:52:18.160561 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac4cac-af47-41c9-acf6-dca88c5731c2 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:52:18.160844 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac4cac-af47-41c9-acf6-dca88c5731c2 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:52:18.161119 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac4cac-af47-41c9-acf6-dca88c5731c2 None admin] PATH_INFO: `/v3/projects/c6bd2675e80448cb9b171060bef9ccba` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:52:18.162274 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcac4cac-af47-41c9-acf6-dca88c5731c2 None admin] RBAC: Authorizing `identity:get_project(project_id=c6bd2675e80448cb9b171060bef9ccba)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:52:18.163731 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcac4cac-af47-41c9-acf6-dca88c5731c2 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:52:18.165408 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 602/1199] 10.222.0.52 () {56 vars in 1186 bytes} [Sat May 14 20:52:18 2022] GET /identity/v3/projects/c6bd2675e80448cb9b171060bef9ccba => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:52:18.171705 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449a5897-3759-4ef2-9dd3-925b87e978f4 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:52:18.265925 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449a5897-3759-4ef2-9dd3-925b87e978f4 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:52:18.298837 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b217e92-28d1-4521-9bd8-75be36a2293f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:52:18.299422 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b217e92-28d1-4521-9bd8-75be36a2293f None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:52:18.299737 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b217e92-28d1-4521-9bd8-75be36a2293f None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:52:18.300014 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b217e92-28d1-4521-9bd8-75be36a2293f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:52:18.300829 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b217e92-28d1-4521-9bd8-75be36a2293f None admin] RBAC: Adding query filter params (role.id=24c463e2b4d44dd28cd2723a69a8ed2e, scope.project.id=c6bd2675e80448cb9b171060bef9ccba, user.id=1f57529fb29945a781e6e1e6236fa1c6) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:52:18.301139 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b217e92-28d1-4521-9bd8-75be36a2293f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:52:18.302566 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b217e92-28d1-4521-9bd8-75be36a2293f None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:52:18.308195 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 598/1200] 10.222.0.52 () {56 vars in 1374 bytes} [Sat May 14 20:52:18 2022] GET /identity/v3/role_assignments?user.id=1f57529fb29945a781e6e1e6236fa1c6&scope.project.id=c6bd2675e80448cb9b171060bef9ccba&role.id=24c463e2b4d44dd28cd2723a69a8ed2e => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:53:37.578630 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b6d58-b7dc-4e4f-a150-e3b65ff6a2b3 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:53:37.579224 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b6d58-b7dc-4e4f-a150-e3b65ff6a2b3 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:53:37.579224 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b6d58-b7dc-4e4f-a150-e3b65ff6a2b3 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:53:37.580587 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 603/1201] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:53:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 14 20:53:37.585805 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e756573-0aa2-4b87-a18f-bed60f8d14b2 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:53:37.586239 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e756573-0aa2-4b87-a18f-bed60f8d14b2 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:53:37.586341 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e756573-0aa2-4b87-a18f-bed60f8d14b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:53:37.603348 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-5e756573-0aa2-4b87-a18f-bed60f8d14b2 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:53:37.604607 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-5e756573-0aa2-4b87-a18f-bed60f8d14b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:53:37.668712 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 599/1202] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:53:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 14 20:53:37.695654 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b6d58-b7dc-4e4f-a150-e3b65ff6a2b3 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:53:37.795660 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b6d58-b7dc-4e4f-a150-e3b65ff6a2b3 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:53:37.829705 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd36d5ba-3c8d-4991-952d-9f2631ed6a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:53:37.830412 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd36d5ba-3c8d-4991-952d-9f2631ed6a73 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:53:37.830695 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd36d5ba-3c8d-4991-952d-9f2631ed6a73 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:53:37.830971 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd36d5ba-3c8d-4991-952d-9f2631ed6a73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:53:37.840633 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd36d5ba-3c8d-4991-952d-9f2631ed6a73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:53:37.842098 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd36d5ba-3c8d-4991-952d-9f2631ed6a73 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:53:37.860077 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-bd36d5ba-3c8d-4991-952d-9f2631ed6a73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:53:37.860077 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:53:37.860077 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:53:37.860077 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:53:37.860077 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:53:37.860077 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:53:37.860077 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:53:37.860077 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:53:37.860077 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:53:37.860077 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:53:37.860077 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:53:37.860077 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:53:37.860077 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:53:37.860077 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:53:37.860077 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:53:37.861240 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:53:37.861240 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:53:37.861240 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:53:37.861240 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:53:37.861240 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:53:37.861240 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:53:37.861240 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:53:37.861240 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:53:37.861240 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:53:37.861240 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:53:37.861240 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:53:37.861240 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:53:37.861240 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:53:37.861240 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:53:37.861240 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:53:37.861240 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:53:37.861240 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:53:37.862481 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 20:53:37.862481 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:53:37.862481 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:53:37.862481 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:53:37.862481 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 604/1203] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:53:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:53:37.869083 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e756573-0aa2-4b87-a18f-bed60f8d14b2 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:53:37.966735 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e756573-0aa2-4b87-a18f-bed60f8d14b2 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:53:38.001316 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08070420-a8c0-4358-b8d8-c32dc17b4697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:53:38.001972 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08070420-a8c0-4358-b8d8-c32dc17b4697 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:53:38.002253 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08070420-a8c0-4358-b8d8-c32dc17b4697 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:53:38.002530 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08070420-a8c0-4358-b8d8-c32dc17b4697 None admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:53:38.003235 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08070420-a8c0-4358-b8d8-c32dc17b4697 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:53:38.003573 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08070420-a8c0-4358-b8d8-c32dc17b4697 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:53:38.004960 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08070420-a8c0-4358-b8d8-c32dc17b4697 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:53:38.016778 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 600/1204] 10.222.0.52 () {56 vars in 1109 bytes} [Sat May 14 20:53:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:53:38.022573 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd36d5ba-3c8d-4991-952d-9f2631ed6a73 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:53:38.119039 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd36d5ba-3c8d-4991-952d-9f2631ed6a73 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:53:38.155138 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a85eb3-c0c2-4d5b-a623-c7c893792701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:53:38.155826 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a85eb3-c0c2-4d5b-a623-c7c893792701 None admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:53:38.156101 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a85eb3-c0c2-4d5b-a623-c7c893792701 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:53:38.156445 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a85eb3-c0c2-4d5b-a623-c7c893792701 None admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:53:38.157155 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a85eb3-c0c2-4d5b-a623-c7c893792701 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:53:38.158877 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a85eb3-c0c2-4d5b-a623-c7c893792701 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:53:38.299505 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 605/1205] 10.222.0.52 () {60 vars in 1132 bytes} [Sat May 14 20:53:38 2022] POST /identity/v3/users => generated 251 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 20:53:40.621870 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032e2c9-bad6-481d-bea2-850ef8cd23e2 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:53:40.622670 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032e2c9-bad6-481d-bea2-850ef8cd23e2 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:53:40.622670 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032e2c9-bad6-481d-bea2-850ef8cd23e2 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:53:40.624078 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 601/1206] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:53:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:53:40.629808 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475566ca-e3db-4155-899c-2e7acf1dfa47 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:53:40.630236 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475566ca-e3db-4155-899c-2e7acf1dfa47 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:53:40.630372 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475566ca-e3db-4155-899c-2e7acf1dfa47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:53:40.647023 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-475566ca-e3db-4155-899c-2e7acf1dfa47 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:53:40.648218 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-475566ca-e3db-4155-899c-2e7acf1dfa47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:53:40.714979 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 606/1207] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:53:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 20:53:40.739964 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8032e2c9-bad6-481d-bea2-850ef8cd23e2 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:53:40.841033 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8032e2c9-bad6-481d-bea2-850ef8cd23e2 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:53:40.872910 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c604ac4b-bf15-408f-bbb4-b159d0e40a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:53:40.873650 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c604ac4b-bf15-408f-bbb4-b159d0e40a40 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:53:40.873929 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c604ac4b-bf15-408f-bbb4-b159d0e40a40 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:53:40.874199 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c604ac4b-bf15-408f-bbb4-b159d0e40a40 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:53:40.885421 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c604ac4b-bf15-408f-bbb4-b159d0e40a40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:53:40.893847 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-c604ac4b-bf15-408f-bbb4-b159d0e40a40 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 14 20:53:40.893847 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:53:40.893847 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:53:40.893847 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:53:40.893847 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:53:40.893847 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:53:40.893847 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:53:40.893847 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:53:40.893847 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:53:40.893847 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:53:40.893847 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:53:40.893847 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:53:40.893847 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:53:40.893847 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:53:40.893847 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:53:40.893847 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:53:40.894840 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:53:40.894840 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:53:40.894840 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:53:40.894840 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:53:40.894840 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:53:40.894840 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:53:40.894840 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:53:40.894840 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:53:40.894840 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:53:40.894840 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:53:40.894840 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:53:40.894840 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:53:40.894840 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:53:40.894840 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:53:40.894840 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:53:40.894840 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:53:40.895723 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:53:40.895723 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:53:40.895723 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:53:40.895723 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:53:40.895723 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:53:40.895723 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:53:40.895723 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:53:40.895723 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:53:40.895723 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:53:40.895723 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:53:40.895723 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 14 20:53:40.895723 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:53:40.895723 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 602/1208] 10.222.0.52 () {56 vars in 1102 bytes} [Sat May 14 20:53:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:53:40.901239 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475566ca-e3db-4155-899c-2e7acf1dfa47 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:53:40.997578 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475566ca-e3db-4155-899c-2e7acf1dfa47 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:53:41.030246 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3cf70b-71ce-4ee1-8141-7021dd590826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:53:41.030907 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3cf70b-71ce-4ee1-8141-7021dd590826 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:53:41.031320 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3cf70b-71ce-4ee1-8141-7021dd590826 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:53:41.031649 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3cf70b-71ce-4ee1-8141-7021dd590826 None admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:53:41.032386 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3cf70b-71ce-4ee1-8141-7021dd590826 None admin] RBAC: Adding query filter params (name=service) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:53:41.032689 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3cf70b-71ce-4ee1-8141-7021dd590826 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:53:41.034146 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3cf70b-71ce-4ee1-8141-7021dd590826 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:53:41.041732 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 607/1209] 10.222.0.52 () {56 vars in 1103 bytes} [Sat May 14 20:53:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:53:41.048328 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c604ac4b-bf15-408f-bbb4-b159d0e40a40 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:53:41.146431 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c604ac4b-bf15-408f-bbb4-b159d0e40a40 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:53:41.179001 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f4816-7879-4a05-a1cd-cb4e880e1959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:53:41.179800 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f4816-7879-4a05-a1cd-cb4e880e1959 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:53:41.180076 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f4816-7879-4a05-a1cd-cb4e880e1959 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:53:41.180342 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f4816-7879-4a05-a1cd-cb4e880e1959 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:53:41.190703 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834f4816-7879-4a05-a1cd-cb4e880e1959 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:53:41.194485 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834f4816-7879-4a05-a1cd-cb4e880e1959 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:53:41.209740 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-834f4816-7879-4a05-a1cd-cb4e880e1959 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:53:41.209740 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:53:41.209740 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:53:41.209740 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:53:41.209740 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:53:41.209740 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:53:41.209740 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:53:41.209740 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:53:41.209740 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:53:41.209740 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:53:41.209740 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:53:41.209740 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:53:41.209740 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:53:41.209740 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:53:41.209740 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:53:41.210788 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:53:41.210788 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:53:41.210788 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:53:41.210788 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:53:41.210788 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:53:41.210788 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:53:41.210788 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:53:41.210788 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:53:41.210788 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:53:41.210788 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:53:41.210788 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:53:41.210788 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:53:41.210788 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:53:41.210788 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:53:41.210788 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:53:41.210788 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:53:41.210788 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:53:41.211791 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 20:53:41.211791 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:53:41.211791 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:53:41.211791 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:53:41.211791 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 603/1210] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:53:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:53:41.216748 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3cf70b-71ce-4ee1-8141-7021dd590826 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:53:41.315414 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3cf70b-71ce-4ee1-8141-7021dd590826 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:53:41.347958 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec31034-d6ac-4e14-916b-833991971b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:53:41.348612 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec31034-d6ac-4e14-916b-833991971b20 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:53:41.348893 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec31034-d6ac-4e14-916b-833991971b20 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:53:41.349167 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec31034-d6ac-4e14-916b-833991971b20 None admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:53:41.349936 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec31034-d6ac-4e14-916b-833991971b20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:53:41.350239 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec31034-d6ac-4e14-916b-833991971b20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:53:41.351628 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec31034-d6ac-4e14-916b-833991971b20 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:53:41.363158 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 608/1211] 10.222.0.52 () {56 vars in 1109 bytes} [Sat May 14 20:53:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:53:41.368789 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f4816-7879-4a05-a1cd-cb4e880e1959 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:53:41.466773 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f4816-7879-4a05-a1cd-cb4e880e1959 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:53:41.500379 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0de26-9b3b-4b3e-88a0-f24127c5effd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:53:41.501265 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0de26-9b3b-4b3e-88a0-f24127c5effd None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:53:41.501548 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0de26-9b3b-4b3e-88a0-f24127c5effd None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:53:41.501820 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0de26-9b3b-4b3e-88a0-f24127c5effd None admin] PATH_INFO: `/v3/users/placement` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:53:41.509037 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea0de26-9b3b-4b3e-88a0-f24127c5effd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:53:41.510470 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea0de26-9b3b-4b3e-88a0-f24127c5effd None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:53:41.524943 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-dea0de26-9b3b-4b3e-88a0-f24127c5effd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 14 20:53:41.524943 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:53:41.524943 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:53:41.524943 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:53:41.524943 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:53:41.524943 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:53:41.524943 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:53:41.524943 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:53:41.524943 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:53:41.524943 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:53:41.524943 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:53:41.524943 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:53:41.524943 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 14 20:53:41.524943 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_user(user_id) May 14 20:53:41.524943 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 14 20:53:41.524943 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 14 20:53:41.526113 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:53:41.526113 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:53:41.526113 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 20:53:41.526113 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 20:53:41.526113 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 14 20:53:41.526113 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 20:53:41.526113 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:53:41.526113 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:53:41.526113 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:53:41.526113 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:53:41.526113 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:53:41.526113 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:53:41.526113 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:53:41.526113 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:53:41.526113 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:53:41.526113 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:53:41.526113 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:53:41.526113 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:53:41.527271 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:53:41.527271 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:53:41.527271 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 14 20:53:41.527271 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 14 20:53:41.527271 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 14 20:53:41.527271 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 14 20:53:41.527271 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 14 20:53:41.527271 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 14 20:53:41.527271 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 14 20:53:41.527271 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:53:41.527271 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 604/1212] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:53:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:53:41.532180 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec31034-d6ac-4e14-916b-833991971b20 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:53:41.628903 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec31034-d6ac-4e14-916b-833991971b20 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:53:41.661300 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127f2946-4dfe-49c1-b2ee-680ab2bd5b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:53:41.661956 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f2946-4dfe-49c1-b2ee-680ab2bd5b67 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:53:41.662234 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f2946-4dfe-49c1-b2ee-680ab2bd5b67 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:53:41.662504 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f2946-4dfe-49c1-b2ee-680ab2bd5b67 None admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:53:41.663314 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127f2946-4dfe-49c1-b2ee-680ab2bd5b67 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:53:41.663648 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127f2946-4dfe-49c1-b2ee-680ab2bd5b67 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:53:41.665065 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127f2946-4dfe-49c1-b2ee-680ab2bd5b67 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:53:41.681910 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 609/1213] 10.222.0.52 () {56 vars in 1143 bytes} [Sat May 14 20:53:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:53:41.688261 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0de26-9b3b-4b3e-88a0-f24127c5effd None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:53:41.784651 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0de26-9b3b-4b3e-88a0-f24127c5effd None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:53:41.817380 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2737ab8-967e-4353-acdf-6e54fdb50b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:53:41.818181 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2737ab8-967e-4353-acdf-6e54fdb50b2a None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:53:41.818290 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2737ab8-967e-4353-acdf-6e54fdb50b2a None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:53:41.818549 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2737ab8-967e-4353-acdf-6e54fdb50b2a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:53:41.884723 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2737ab8-967e-4353-acdf-6e54fdb50b2a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:53:41.886190 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2737ab8-967e-4353-acdf-6e54fdb50b2a None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:53:41.980175 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 605/1214] 10.222.0.52 () {58 vars in 1282 bytes} [Sat May 14 20:53:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 14 20:53:41.986411 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127f2946-4dfe-49c1-b2ee-680ab2bd5b67 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:53:42.085456 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127f2946-4dfe-49c1-b2ee-680ab2bd5b67 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:53:42.122627 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0672dd-b9d8-48e4-863b-a0cf7c021c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:53:42.123414 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0672dd-b9d8-48e4-863b-a0cf7c021c35 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:53:42.123728 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0672dd-b9d8-48e4-863b-a0cf7c021c35 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:53:42.124000 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0672dd-b9d8-48e4-863b-a0cf7c021c35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:53:42.133978 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0672dd-b9d8-48e4-863b-a0cf7c021c35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:53:42.138151 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0672dd-b9d8-48e4-863b-a0cf7c021c35 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:53:42.152527 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-6a0672dd-b9d8-48e4-863b-a0cf7c021c35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:53:42.152527 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:53:42.152527 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:53:42.152527 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:53:42.152527 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:53:42.152527 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:53:42.152527 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:53:42.152527 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:53:42.152527 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:53:42.152527 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:53:42.152527 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:53:42.152527 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:53:42.152527 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:53:42.152527 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:53:42.152527 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:53:42.153599 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:53:42.153599 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:53:42.153599 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:53:42.153599 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:53:42.153599 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:53:42.153599 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:53:42.153599 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:53:42.153599 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:53:42.153599 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:53:42.153599 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:53:42.153599 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:53:42.153599 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:53:42.153599 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:53:42.153599 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:53:42.153599 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:53:42.153599 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:53:42.153599 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:53:42.154663 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 20:53:42.154663 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:53:42.154663 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:53:42.154663 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:53:42.154663 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 610/1215] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:53:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:53:42.160174 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2737ab8-967e-4353-acdf-6e54fdb50b2a None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:53:42.256679 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2737ab8-967e-4353-acdf-6e54fdb50b2a None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:53:42.289281 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a075a9fe-857e-4db5-afce-df0f8cd315bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:53:42.289968 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a075a9fe-857e-4db5-afce-df0f8cd315bb None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:53:42.290250 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a075a9fe-857e-4db5-afce-df0f8cd315bb None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:53:42.290524 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a075a9fe-857e-4db5-afce-df0f8cd315bb None admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:53:42.291232 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a075a9fe-857e-4db5-afce-df0f8cd315bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:53:42.291563 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a075a9fe-857e-4db5-afce-df0f8cd315bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:53:42.292925 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a075a9fe-857e-4db5-afce-df0f8cd315bb None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:53:42.304657 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 606/1216] 10.222.0.52 () {56 vars in 1109 bytes} [Sat May 14 20:53:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:53:42.310267 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0672dd-b9d8-48e4-863b-a0cf7c021c35 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:53:42.406841 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0672dd-b9d8-48e4-863b-a0cf7c021c35 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:53:42.440127 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eff665-48ad-407c-88b0-be259ca7292d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:53:42.440912 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eff665-48ad-407c-88b0-be259ca7292d None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:53:42.441199 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eff665-48ad-407c-88b0-be259ca7292d None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:53:42.441472 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eff665-48ad-407c-88b0-be259ca7292d None admin] PATH_INFO: `/v3/projects/service` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:53:42.447878 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eff665-48ad-407c-88b0-be259ca7292d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:53:42.449307 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eff665-48ad-407c-88b0-be259ca7292d None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:53:42.470479 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-32eff665-48ad-407c-88b0-be259ca7292d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 14 20:53:42.470479 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:53:42.470479 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:53:42.470479 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:53:42.470479 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:53:42.470479 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:53:42.470479 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:53:42.470479 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:53:42.470479 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:53:42.470479 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:53:42.470479 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:53:42.470479 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:53:42.470479 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 14 20:53:42.470479 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_project(project_id) May 14 20:53:42.470479 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 14 20:53:42.471619 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 14 20:53:42.471619 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:53:42.471619 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:53:42.471619 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:53:42.471619 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:53:42.471619 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:53:42.471619 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:53:42.471619 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:53:42.471619 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:53:42.471619 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:53:42.471619 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:53:42.471619 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:53:42.471619 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:53:42.471619 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:53:42.471619 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:53:42.471619 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:53:42.471619 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:53:42.472751 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 14 20:53:42.472751 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 14 20:53:42.472751 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 20:53:42.472751 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 20:53:42.472751 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 20:53:42.472751 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 20:53:42.472751 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 14 20:53:42.472751 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:53:42.472751 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 611/1217] 10.222.0.52 () {56 vars in 1111 bytes} [Sat May 14 20:53:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:53:42.477566 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a075a9fe-857e-4db5-afce-df0f8cd315bb None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:53:42.575812 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a075a9fe-857e-4db5-afce-df0f8cd315bb None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:53:42.608909 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6b2fac-d8c3-4448-acae-1cc85cbc9e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:53:42.609632 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b2fac-d8c3-4448-acae-1cc85cbc9e21 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:53:42.609863 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b2fac-d8c3-4448-acae-1cc85cbc9e21 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:53:42.610132 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b2fac-d8c3-4448-acae-1cc85cbc9e21 None admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:53:42.610896 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6b2fac-d8c3-4448-acae-1cc85cbc9e21 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:53:42.611197 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6b2fac-d8c3-4448-acae-1cc85cbc9e21 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:53:42.612655 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6b2fac-d8c3-4448-acae-1cc85cbc9e21 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:53:42.624772 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 607/1218] 10.222.0.52 () {56 vars in 1148 bytes} [Sat May 14 20:53:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:53:42.630672 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eff665-48ad-407c-88b0-be259ca7292d None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:53:42.729070 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eff665-48ad-407c-88b0-be259ca7292d None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:53:42.761420 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcc5068-3860-4d3a-8f48-9abad13fc03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:53:42.762516 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc5068-3860-4d3a-8f48-9abad13fc03c None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:53:42.762516 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc5068-3860-4d3a-8f48-9abad13fc03c None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:53:42.762717 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc5068-3860-4d3a-8f48-9abad13fc03c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:53:42.763379 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcc5068-3860-4d3a-8f48-9abad13fc03c None admin] RBAC: Adding query filter params (role.id=998d6a3451be42a89d4cff277851ad70, scope.project.id=0911a024287e430ea6ee015389f0c440, user.id=0812ae67e44d483baf2dbb1a5332a1d7) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:53:42.763716 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcc5068-3860-4d3a-8f48-9abad13fc03c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:53:42.765122 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcc5068-3860-4d3a-8f48-9abad13fc03c None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:53:42.771168 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 612/1219] 10.222.0.52 () {56 vars in 1374 bytes} [Sat May 14 20:53:42 2022] GET /identity/v3/role_assignments?user.id=0812ae67e44d483baf2dbb1a5332a1d7&scope.project.id=0911a024287e430ea6ee015389f0c440&role.id=998d6a3451be42a89d4cff277851ad70 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:53:45.010829 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d83e789-5870-46d4-8a46-f959b9101852 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:53:45.011383 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d83e789-5870-46d4-8a46-f959b9101852 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:53:45.011383 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d83e789-5870-46d4-8a46-f959b9101852 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:53:45.012748 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 608/1220] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:53:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:53:45.018830 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaad616-d1d0-4390-b8a2-6b85f5997238 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:53:45.019258 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaad616-d1d0-4390-b8a2-6b85f5997238 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:53:45.023086 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaad616-d1d0-4390-b8a2-6b85f5997238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:53:45.035880 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-cdaad616-d1d0-4390-b8a2-6b85f5997238 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:53:45.037054 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-cdaad616-d1d0-4390-b8a2-6b85f5997238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:53:45.101842 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 613/1221] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:53:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 20:53:45.126739 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d83e789-5870-46d4-8a46-f959b9101852 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:53:45.226206 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d83e789-5870-46d4-8a46-f959b9101852 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:53:45.259609 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bb8df4-36f6-429c-b665-cdbc3c2e4282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:53:45.260394 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb8df4-36f6-429c-b665-cdbc3c2e4282 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:53:45.260677 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb8df4-36f6-429c-b665-cdbc3c2e4282 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:53:45.260966 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb8df4-36f6-429c-b665-cdbc3c2e4282 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:53:45.271097 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bb8df4-36f6-429c-b665-cdbc3c2e4282 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:53:45.278735 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-52bb8df4-36f6-429c-b665-cdbc3c2e4282 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 14 20:53:45.278735 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:53:45.278735 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:53:45.278735 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:53:45.278735 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:53:45.278735 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:53:45.278735 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:53:45.278735 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:53:45.278735 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:53:45.278735 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:53:45.278735 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:53:45.278735 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:53:45.278735 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:53:45.278735 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:53:45.278735 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:53:45.278735 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:53:45.279894 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:53:45.279894 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:53:45.279894 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:53:45.279894 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:53:45.279894 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:53:45.279894 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:53:45.279894 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:53:45.279894 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:53:45.279894 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:53:45.279894 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:53:45.279894 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:53:45.279894 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:53:45.279894 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:53:45.279894 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:53:45.279894 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:53:45.279894 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:53:45.282004 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:53:45.282004 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:53:45.282004 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:53:45.282004 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:53:45.282004 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:53:45.282004 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:53:45.282004 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:53:45.282004 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:53:45.282004 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:53:45.282004 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:53:45.282004 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 14 20:53:45.282004 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:53:45.282004 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 609/1222] 10.222.0.52 () {56 vars in 1102 bytes} [Sat May 14 20:53:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:53:45.286535 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaad616-d1d0-4390-b8a2-6b85f5997238 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:53:45.383465 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaad616-d1d0-4390-b8a2-6b85f5997238 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:53:45.416778 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3560b7b-914a-4be9-97cd-c03b09db84e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:53:45.417476 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3560b7b-914a-4be9-97cd-c03b09db84e2 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:53:45.417798 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3560b7b-914a-4be9-97cd-c03b09db84e2 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:53:45.418071 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3560b7b-914a-4be9-97cd-c03b09db84e2 None admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:53:45.418796 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3560b7b-914a-4be9-97cd-c03b09db84e2 None admin] RBAC: Adding query filter params (name=service) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:53:45.419098 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3560b7b-914a-4be9-97cd-c03b09db84e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:53:45.420480 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3560b7b-914a-4be9-97cd-c03b09db84e2 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:53:45.428527 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 614/1223] 10.222.0.52 () {56 vars in 1103 bytes} [Sat May 14 20:53:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:53:45.434407 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bb8df4-36f6-429c-b665-cdbc3c2e4282 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:53:45.532899 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bb8df4-36f6-429c-b665-cdbc3c2e4282 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:53:45.565020 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458be8bb-de8b-440e-b172-816ff6f5a4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:53:45.565798 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458be8bb-de8b-440e-b172-816ff6f5a4d1 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:53:45.566084 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458be8bb-de8b-440e-b172-816ff6f5a4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:53:45.566356 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458be8bb-de8b-440e-b172-816ff6f5a4d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:53:45.576716 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458be8bb-de8b-440e-b172-816ff6f5a4d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:53:45.578743 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458be8bb-de8b-440e-b172-816ff6f5a4d1 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:53:45.596019 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-458be8bb-de8b-440e-b172-816ff6f5a4d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:53:45.596019 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:53:45.596019 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:53:45.596019 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:53:45.596019 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:53:45.596019 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:53:45.596019 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:53:45.596019 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:53:45.596019 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:53:45.596019 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:53:45.596019 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:53:45.596019 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:53:45.596019 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:53:45.596019 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:53:45.596019 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:53:45.597082 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:53:45.597082 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:53:45.597082 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:53:45.597082 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:53:45.597082 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:53:45.597082 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:53:45.597082 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:53:45.597082 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:53:45.597082 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:53:45.597082 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:53:45.597082 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:53:45.597082 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:53:45.597082 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:53:45.597082 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:53:45.597082 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:53:45.597082 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:53:45.597082 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:53:45.598047 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 20:53:45.598047 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:53:45.598047 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:53:45.598047 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:53:45.598047 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 610/1224] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:53:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:53:45.602909 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3560b7b-914a-4be9-97cd-c03b09db84e2 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:53:45.699948 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3560b7b-914a-4be9-97cd-c03b09db84e2 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:53:45.732832 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa07ed-74f5-40ee-b7ca-bbec407d21a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:53:45.733484 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa07ed-74f5-40ee-b7ca-bbec407d21a9 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:53:45.733767 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa07ed-74f5-40ee-b7ca-bbec407d21a9 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:53:45.734068 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa07ed-74f5-40ee-b7ca-bbec407d21a9 None admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:53:45.734946 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfa07ed-74f5-40ee-b7ca-bbec407d21a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:53:45.735252 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfa07ed-74f5-40ee-b7ca-bbec407d21a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:53:45.736648 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfa07ed-74f5-40ee-b7ca-bbec407d21a9 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:53:45.748393 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 615/1225] 10.222.0.52 () {56 vars in 1109 bytes} [Sat May 14 20:53:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:53:45.754525 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458be8bb-de8b-440e-b172-816ff6f5a4d1 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:53:45.851096 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458be8bb-de8b-440e-b172-816ff6f5a4d1 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:53:45.883752 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9e1172-dd0b-4463-87a0-b68bddcdfcf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:53:45.884592 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e1172-dd0b-4463-87a0-b68bddcdfcf1 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:53:45.884870 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e1172-dd0b-4463-87a0-b68bddcdfcf1 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:53:45.885143 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e1172-dd0b-4463-87a0-b68bddcdfcf1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:53:45.892479 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9e1172-dd0b-4463-87a0-b68bddcdfcf1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:53:45.893909 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9e1172-dd0b-4463-87a0-b68bddcdfcf1 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:53:45.908465 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-8c9e1172-dd0b-4463-87a0-b68bddcdfcf1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 14 20:53:45.908465 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:53:45.908465 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:53:45.908465 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:53:45.908465 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:53:45.908465 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:53:45.908465 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:53:45.908465 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:53:45.908465 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:53:45.908465 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:53:45.908465 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:53:45.908465 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:53:45.908465 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 14 20:53:45.908465 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_user(user_id) May 14 20:53:45.908465 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 14 20:53:45.908465 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 14 20:53:45.912820 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:53:45.912820 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:53:45.912820 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 20:53:45.912820 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 20:53:45.912820 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 14 20:53:45.912820 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 20:53:45.912820 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:53:45.912820 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:53:45.912820 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:53:45.912820 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:53:45.912820 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:53:45.912820 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:53:45.912820 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:53:45.912820 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:53:45.912820 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:53:45.912820 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:53:45.912820 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:53:45.912820 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:53:45.914187 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:53:45.914187 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:53:45.914187 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 14 20:53:45.914187 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 14 20:53:45.914187 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 14 20:53:45.914187 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 14 20:53:45.914187 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 14 20:53:45.914187 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 14 20:53:45.914187 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 14 20:53:45.914187 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:53:45.914187 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 611/1226] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:53:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:53:45.916245 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa07ed-74f5-40ee-b7ca-bbec407d21a9 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:53:46.014625 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa07ed-74f5-40ee-b7ca-bbec407d21a9 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:53:46.048255 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfc8ca3-d215-4fa4-af24-cffdb03494b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:53:46.048914 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc8ca3-d215-4fa4-af24-cffdb03494b0 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:53:46.049198 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc8ca3-d215-4fa4-af24-cffdb03494b0 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:53:46.049473 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc8ca3-d215-4fa4-af24-cffdb03494b0 None admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:53:46.050292 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfc8ca3-d215-4fa4-af24-cffdb03494b0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:53:46.050598 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfc8ca3-d215-4fa4-af24-cffdb03494b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:53:46.052163 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfc8ca3-d215-4fa4-af24-cffdb03494b0 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:53:46.070515 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 616/1227] 10.222.0.52 () {56 vars in 1143 bytes} [Sat May 14 20:53:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:53:46.076142 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9e1172-dd0b-4463-87a0-b68bddcdfcf1 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:53:46.175825 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9e1172-dd0b-4463-87a0-b68bddcdfcf1 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:53:46.208463 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257b2e8a-8746-44b3-87bc-2000a9809173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:53:46.209266 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b2e8a-8746-44b3-87bc-2000a9809173 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:53:46.209548 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b2e8a-8746-44b3-87bc-2000a9809173 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:53:46.209818 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b2e8a-8746-44b3-87bc-2000a9809173 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:53:46.220564 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257b2e8a-8746-44b3-87bc-2000a9809173 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:53:46.223936 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257b2e8a-8746-44b3-87bc-2000a9809173 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:53:46.239282 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-257b2e8a-8746-44b3-87bc-2000a9809173 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:53:46.239282 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:53:46.239282 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:53:46.239282 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:53:46.239282 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:53:46.239282 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:53:46.239282 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:53:46.239282 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:53:46.239282 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:53:46.239282 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:53:46.239282 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:53:46.239282 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:53:46.239282 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:53:46.239282 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:53:46.239282 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:53:46.242123 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:53:46.242123 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:53:46.242123 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:53:46.242123 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:53:46.242123 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:53:46.242123 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:53:46.242123 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:53:46.242123 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:53:46.242123 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:53:46.242123 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:53:46.242123 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:53:46.242123 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:53:46.242123 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:53:46.242123 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:53:46.242123 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:53:46.242123 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:53:46.242123 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:53:46.243232 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 20:53:46.243232 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:53:46.243232 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:53:46.243232 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:53:46.243232 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 612/1228] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:53:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:53:46.246190 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfc8ca3-d215-4fa4-af24-cffdb03494b0 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:53:46.344291 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfc8ca3-d215-4fa4-af24-cffdb03494b0 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:53:46.376554 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8995f11c-f945-4be2-8d71-1f62f3687b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:53:46.377203 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8995f11c-f945-4be2-8d71-1f62f3687b9e None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:53:46.377485 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8995f11c-f945-4be2-8d71-1f62f3687b9e None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:53:46.377772 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8995f11c-f945-4be2-8d71-1f62f3687b9e None admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:53:46.378525 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8995f11c-f945-4be2-8d71-1f62f3687b9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:53:46.378832 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8995f11c-f945-4be2-8d71-1f62f3687b9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:53:46.380211 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8995f11c-f945-4be2-8d71-1f62f3687b9e None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:53:46.391405 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 617/1229] 10.222.0.52 () {56 vars in 1109 bytes} [Sat May 14 20:53:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:53:46.397155 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257b2e8a-8746-44b3-87bc-2000a9809173 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:53:46.506116 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257b2e8a-8746-44b3-87bc-2000a9809173 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:53:46.549073 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c66fea-2fa9-4d1e-b643-5f249d9d655c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:53:46.549861 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c66fea-2fa9-4d1e-b643-5f249d9d655c None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:53:46.550143 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c66fea-2fa9-4d1e-b643-5f249d9d655c None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:53:46.550418 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c66fea-2fa9-4d1e-b643-5f249d9d655c None admin] PATH_INFO: `/v3/projects/service` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:53:46.556932 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c66fea-2fa9-4d1e-b643-5f249d9d655c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:53:46.558367 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c66fea-2fa9-4d1e-b643-5f249d9d655c None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:53:46.572687 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-61c66fea-2fa9-4d1e-b643-5f249d9d655c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 14 20:53:46.572687 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:53:46.572687 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:53:46.572687 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:53:46.572687 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:53:46.572687 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:53:46.572687 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:53:46.572687 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:53:46.572687 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:53:46.572687 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:53:46.572687 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:53:46.572687 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:53:46.572687 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 14 20:53:46.572687 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_project(project_id) May 14 20:53:46.572687 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 14 20:53:46.573762 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 14 20:53:46.573762 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:53:46.573762 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:53:46.573762 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:53:46.573762 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:53:46.573762 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:53:46.573762 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:53:46.573762 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:53:46.573762 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:53:46.573762 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:53:46.573762 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:53:46.573762 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:53:46.573762 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:53:46.573762 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:53:46.573762 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:53:46.573762 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:53:46.573762 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:53:46.574886 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 14 20:53:46.574886 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 14 20:53:46.574886 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 20:53:46.574886 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 20:53:46.574886 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 20:53:46.574886 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 20:53:46.574886 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 14 20:53:46.574886 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:53:46.574886 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 613/1230] 10.222.0.52 () {56 vars in 1111 bytes} [Sat May 14 20:53:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:53:46.584309 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8995f11c-f945-4be2-8d71-1f62f3687b9e None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:53:46.680761 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8995f11c-f945-4be2-8d71-1f62f3687b9e None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:53:46.713690 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4672de49-ea53-4e3c-839b-a590708fea40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:53:46.714344 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4672de49-ea53-4e3c-839b-a590708fea40 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:53:46.714624 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4672de49-ea53-4e3c-839b-a590708fea40 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:53:46.714897 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4672de49-ea53-4e3c-839b-a590708fea40 None admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:53:46.715700 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4672de49-ea53-4e3c-839b-a590708fea40 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:53:46.716009 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4672de49-ea53-4e3c-839b-a590708fea40 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:53:46.717428 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4672de49-ea53-4e3c-839b-a590708fea40 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:53:46.729747 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 618/1231] 10.222.0.52 () {56 vars in 1148 bytes} [Sat May 14 20:53:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:53:46.736850 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c66fea-2fa9-4d1e-b643-5f249d9d655c None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:53:46.834208 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c66fea-2fa9-4d1e-b643-5f249d9d655c None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:53:46.870210 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9bbad0-a48c-4054-b889-5b2f8aaedc26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:53:46.871134 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9bbad0-a48c-4054-b889-5b2f8aaedc26 None admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:53:46.871417 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9bbad0-a48c-4054-b889-5b2f8aaedc26 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:53:46.871724 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9bbad0-a48c-4054-b889-5b2f8aaedc26 None admin] PATH_INFO: `/v3/projects/0911a024287e430ea6ee015389f0c440/users/0812ae67e44d483baf2dbb1a5332a1d7/roles/998d6a3451be42a89d4cff277851ad70` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:53:46.885981 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9bbad0-a48c-4054-b889-5b2f8aaedc26 None admin] RBAC: Authorizing `identity:create_grant(project_id=0911a024287e430ea6ee015389f0c440, user_id=0812ae67e44d483baf2dbb1a5332a1d7, role_id=998d6a3451be42a89d4cff277851ad70)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:53:46.887411 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9bbad0-a48c-4054-b889-5b2f8aaedc26 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:53:47.003413 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 614/1232] 10.222.0.52 () {58 vars in 1439 bytes} [Sat May 14 20:53:46 2022] PUT /identity/v3/projects/0911a024287e430ea6ee015389f0c440/users/0812ae67e44d483baf2dbb1a5332a1d7/roles/998d6a3451be42a89d4cff277851ad70 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 20:53:49.269605 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2de29b-35a8-4c5b-aed3-0d68797d2a1e None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:53:49.270111 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2de29b-35a8-4c5b-aed3-0d68797d2a1e None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:53:49.270111 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2de29b-35a8-4c5b-aed3-0d68797d2a1e None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:53:49.271462 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 619/1233] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:53:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:53:49.276736 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0a109-2bd5-44f3-9cd0-2d8cce31ea3c None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:53:49.277160 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0a109-2bd5-44f3-9cd0-2d8cce31ea3c None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:53:49.280458 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0a109-2bd5-44f3-9cd0-2d8cce31ea3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:53:49.293614 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-c0b0a109-2bd5-44f3-9cd0-2d8cce31ea3c None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:53:49.294782 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c0b0a109-2bd5-44f3-9cd0-2d8cce31ea3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:53:49.360340 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 615/1234] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:53:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 14 20:53:49.385746 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2de29b-35a8-4c5b-aed3-0d68797d2a1e None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:53:49.484755 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2de29b-35a8-4c5b-aed3-0d68797d2a1e None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:53:49.517838 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564bdd2d-2add-4fd5-b237-583a464f8d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:53:49.518638 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564bdd2d-2add-4fd5-b237-583a464f8d52 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:53:49.518905 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564bdd2d-2add-4fd5-b237-583a464f8d52 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:53:49.519180 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564bdd2d-2add-4fd5-b237-583a464f8d52 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:53:49.529262 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564bdd2d-2add-4fd5-b237-583a464f8d52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:53:49.537429 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-564bdd2d-2add-4fd5-b237-583a464f8d52 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 14 20:53:49.537429 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:53:49.537429 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:53:49.537429 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:53:49.537429 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:53:49.537429 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:53:49.537429 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:53:49.537429 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:53:49.537429 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:53:49.537429 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:53:49.537429 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:53:49.537429 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:53:49.537429 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:53:49.537429 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:53:49.537429 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:53:49.537429 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:53:49.538547 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:53:49.538547 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:53:49.538547 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:53:49.538547 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:53:49.538547 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:53:49.538547 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:53:49.538547 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:53:49.538547 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:53:49.538547 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:53:49.538547 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:53:49.538547 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:53:49.538547 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:53:49.538547 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:53:49.538547 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:53:49.538547 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:53:49.538547 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:53:49.539401 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:53:49.539401 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:53:49.539401 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:53:49.539401 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:53:49.539401 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:53:49.539401 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:53:49.539401 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:53:49.539401 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:53:49.539401 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:53:49.539401 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:53:49.539401 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 14 20:53:49.539401 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:53:49.539401 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 620/1235] 10.222.0.52 () {56 vars in 1102 bytes} [Sat May 14 20:53:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:53:49.544593 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b0a109-2bd5-44f3-9cd0-2d8cce31ea3c None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:53:49.639833 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b0a109-2bd5-44f3-9cd0-2d8cce31ea3c None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:53:49.672548 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879c885c-af6d-40ab-8a13-46966f36f3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:53:49.673209 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c885c-af6d-40ab-8a13-46966f36f3d6 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:53:49.673496 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c885c-af6d-40ab-8a13-46966f36f3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:53:49.673776 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c885c-af6d-40ab-8a13-46966f36f3d6 None admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:53:49.674512 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879c885c-af6d-40ab-8a13-46966f36f3d6 None admin] RBAC: Adding query filter params (name=service) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:53:49.674875 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879c885c-af6d-40ab-8a13-46966f36f3d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:53:49.676276 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879c885c-af6d-40ab-8a13-46966f36f3d6 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:53:49.684455 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 616/1236] 10.222.0.52 () {56 vars in 1103 bytes} [Sat May 14 20:53:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:53:49.690487 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564bdd2d-2add-4fd5-b237-583a464f8d52 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:53:49.793762 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564bdd2d-2add-4fd5-b237-583a464f8d52 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:53:49.826095 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a82c13e-8300-4824-912b-add337d48003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:53:49.826903 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a82c13e-8300-4824-912b-add337d48003 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:53:49.827188 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a82c13e-8300-4824-912b-add337d48003 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:53:49.827468 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a82c13e-8300-4824-912b-add337d48003 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:53:49.837793 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a82c13e-8300-4824-912b-add337d48003 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:53:49.839249 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a82c13e-8300-4824-912b-add337d48003 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:53:49.856371 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-4a82c13e-8300-4824-912b-add337d48003 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:53:49.856371 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:53:49.856371 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:53:49.856371 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:53:49.856371 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:53:49.856371 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:53:49.856371 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:53:49.856371 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:53:49.856371 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:53:49.856371 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:53:49.856371 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:53:49.856371 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:53:49.856371 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:53:49.856371 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:53:49.856371 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:53:49.857440 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:53:49.857440 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:53:49.857440 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:53:49.857440 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:53:49.857440 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:53:49.857440 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:53:49.857440 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:53:49.857440 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:53:49.857440 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:53:49.857440 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:53:49.857440 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:53:49.857440 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:53:49.857440 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:53:49.857440 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:53:49.857440 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:53:49.857440 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:53:49.857440 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:53:49.858412 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 20:53:49.858412 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:53:49.858412 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:53:49.858412 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:53:49.858412 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 621/1237] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:53:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:53:49.864872 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879c885c-af6d-40ab-8a13-46966f36f3d6 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:53:49.965712 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879c885c-af6d-40ab-8a13-46966f36f3d6 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:53:49.999278 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f946fcd-b1c9-4d77-97b2-b5555d6c7a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:53:50.000227 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f946fcd-b1c9-4d77-97b2-b5555d6c7a43 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:53:50.000563 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f946fcd-b1c9-4d77-97b2-b5555d6c7a43 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:53:50.000961 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f946fcd-b1c9-4d77-97b2-b5555d6c7a43 None admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:53:50.001677 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f946fcd-b1c9-4d77-97b2-b5555d6c7a43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:53:50.001982 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f946fcd-b1c9-4d77-97b2-b5555d6c7a43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:53:50.003344 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f946fcd-b1c9-4d77-97b2-b5555d6c7a43 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:53:50.014253 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 617/1238] 10.222.0.52 () {56 vars in 1109 bytes} [Sat May 14 20:53:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 20:53:50.020841 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a82c13e-8300-4824-912b-add337d48003 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:53:50.116970 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a82c13e-8300-4824-912b-add337d48003 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:53:50.149224 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef14c2-3dc4-4324-8971-8b7b7fa65626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:53:50.150015 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef14c2-3dc4-4324-8971-8b7b7fa65626 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:53:50.150293 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef14c2-3dc4-4324-8971-8b7b7fa65626 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:53:50.150566 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef14c2-3dc4-4324-8971-8b7b7fa65626 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:53:50.158459 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aef14c2-3dc4-4324-8971-8b7b7fa65626 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:53:50.159906 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aef14c2-3dc4-4324-8971-8b7b7fa65626 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:53:50.173759 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-2aef14c2-3dc4-4324-8971-8b7b7fa65626 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 14 20:53:50.173759 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:53:50.173759 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:53:50.173759 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:53:50.173759 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:53:50.173759 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:53:50.173759 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:53:50.173759 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:53:50.173759 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:53:50.173759 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:53:50.173759 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:53:50.173759 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:53:50.173759 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 14 20:53:50.173759 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_user(user_id) May 14 20:53:50.173759 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 14 20:53:50.173759 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 14 20:53:50.174727 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:53:50.174727 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:53:50.174727 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 20:53:50.174727 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 20:53:50.174727 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 14 20:53:50.174727 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 20:53:50.174727 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:53:50.174727 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:53:50.174727 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:53:50.174727 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:53:50.174727 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:53:50.174727 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:53:50.174727 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:53:50.174727 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:53:50.174727 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:53:50.174727 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:53:50.174727 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:53:50.174727 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:53:50.175849 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:53:50.175849 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:53:50.175849 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 14 20:53:50.175849 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 14 20:53:50.175849 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 14 20:53:50.175849 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 14 20:53:50.175849 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 14 20:53:50.175849 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 14 20:53:50.175849 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 14 20:53:50.175849 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:53:50.175849 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 622/1239] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:53:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:53:50.181279 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f946fcd-b1c9-4d77-97b2-b5555d6c7a43 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:53:50.279714 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f946fcd-b1c9-4d77-97b2-b5555d6c7a43 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:53:50.311414 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8091585-bca0-4c5f-81a5-f2ac21831aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:53:50.312763 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8091585-bca0-4c5f-81a5-f2ac21831aae None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:53:50.313108 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8091585-bca0-4c5f-81a5-f2ac21831aae None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:53:50.313436 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8091585-bca0-4c5f-81a5-f2ac21831aae None admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:53:50.314257 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8091585-bca0-4c5f-81a5-f2ac21831aae None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:53:50.314563 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8091585-bca0-4c5f-81a5-f2ac21831aae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:53:50.316007 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8091585-bca0-4c5f-81a5-f2ac21831aae None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:53:50.333082 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 618/1240] 10.222.0.52 () {56 vars in 1143 bytes} [Sat May 14 20:53:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:53:50.338932 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef14c2-3dc4-4324-8971-8b7b7fa65626 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:53:50.434492 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef14c2-3dc4-4324-8971-8b7b7fa65626 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:53:50.467674 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f822378-c331-49d9-be59-9a896bf8bc55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:53:50.468452 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f822378-c331-49d9-be59-9a896bf8bc55 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:53:50.468731 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f822378-c331-49d9-be59-9a896bf8bc55 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:53:50.469172 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f822378-c331-49d9-be59-9a896bf8bc55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:53:50.535984 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f822378-c331-49d9-be59-9a896bf8bc55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:53:50.537510 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f822378-c331-49d9-be59-9a896bf8bc55 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:53:50.632976 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 623/1241] 10.222.0.52 () {58 vars in 1282 bytes} [Sat May 14 20:53:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 14 20:53:50.638882 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8091585-bca0-4c5f-81a5-f2ac21831aae None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:53:50.736915 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8091585-bca0-4c5f-81a5-f2ac21831aae None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:53:50.771206 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391f3949-a3c5-41b5-b166-715f72b651a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:53:50.772015 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f3949-a3c5-41b5-b166-715f72b651a8 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:53:50.772295 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f3949-a3c5-41b5-b166-715f72b651a8 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:53:50.772568 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f3949-a3c5-41b5-b166-715f72b651a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:53:50.783076 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391f3949-a3c5-41b5-b166-715f72b651a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:53:50.784538 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391f3949-a3c5-41b5-b166-715f72b651a8 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:53:50.801384 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-391f3949-a3c5-41b5-b166-715f72b651a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:53:50.801384 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:53:50.801384 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:53:50.801384 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:53:50.801384 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:53:50.801384 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:53:50.801384 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:53:50.801384 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:53:50.801384 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:53:50.801384 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:53:50.801384 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:53:50.801384 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:53:50.801384 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:53:50.801384 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:53:50.801384 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:53:50.802482 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:53:50.802482 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:53:50.802482 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:53:50.802482 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:53:50.802482 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:53:50.802482 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:53:50.802482 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:53:50.802482 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:53:50.802482 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:53:50.802482 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:53:50.802482 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:53:50.802482 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:53:50.802482 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:53:50.802482 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:53:50.802482 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:53:50.802482 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:53:50.802482 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:53:50.803639 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 20:53:50.803639 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:53:50.803639 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:53:50.803639 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:53:50.803639 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 619/1242] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:53:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:53:50.808271 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f822378-c331-49d9-be59-9a896bf8bc55 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:53:50.903610 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f822378-c331-49d9-be59-9a896bf8bc55 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:53:50.938049 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0163b0-19ee-4ddf-a284-2521dce68c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:53:50.938705 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0163b0-19ee-4ddf-a284-2521dce68c9a None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:53:50.938981 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0163b0-19ee-4ddf-a284-2521dce68c9a None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:53:50.939255 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0163b0-19ee-4ddf-a284-2521dce68c9a None admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:53:50.939999 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0163b0-19ee-4ddf-a284-2521dce68c9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:53:50.940299 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0163b0-19ee-4ddf-a284-2521dce68c9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:53:50.941645 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0163b0-19ee-4ddf-a284-2521dce68c9a None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:53:50.952348 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 624/1243] 10.222.0.52 () {56 vars in 1109 bytes} [Sat May 14 20:53:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:53:50.958696 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391f3949-a3c5-41b5-b166-715f72b651a8 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:53:51.057365 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391f3949-a3c5-41b5-b166-715f72b651a8 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:53:51.090939 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eb8fed-39df-4a61-afcf-3811e4f336ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:53:51.091827 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb8fed-39df-4a61-afcf-3811e4f336ab None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:53:51.092115 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb8fed-39df-4a61-afcf-3811e4f336ab None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:53:51.092393 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb8fed-39df-4a61-afcf-3811e4f336ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:53:51.099013 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eb8fed-39df-4a61-afcf-3811e4f336ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:53:51.103104 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eb8fed-39df-4a61-afcf-3811e4f336ab None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:53:51.113733 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-a0eb8fed-39df-4a61-afcf-3811e4f336ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 14 20:53:51.113733 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:53:51.113733 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:53:51.113733 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:53:51.113733 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:53:51.113733 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:53:51.113733 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:53:51.113733 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:53:51.113733 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:53:51.113733 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:53:51.113733 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:53:51.113733 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:53:51.113733 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 14 20:53:51.113733 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_project(project_id) May 14 20:53:51.113733 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 14 20:53:51.114857 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 14 20:53:51.114857 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:53:51.114857 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:53:51.114857 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:53:51.114857 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:53:51.114857 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:53:51.114857 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:53:51.114857 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:53:51.114857 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:53:51.114857 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:53:51.114857 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:53:51.114857 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:53:51.114857 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:53:51.114857 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:53:51.114857 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:53:51.114857 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:53:51.114857 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:53:51.116026 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 14 20:53:51.116026 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 14 20:53:51.116026 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 20:53:51.116026 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 20:53:51.116026 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 20:53:51.116026 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 20:53:51.116026 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 14 20:53:51.116026 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:53:51.116026 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 620/1244] 10.222.0.52 () {56 vars in 1111 bytes} [Sat May 14 20:53:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:53:51.120728 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0163b0-19ee-4ddf-a284-2521dce68c9a None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:53:51.219637 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0163b0-19ee-4ddf-a284-2521dce68c9a None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:53:51.252449 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70fd1b3-b79c-4a57-8754-0d0188067d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:53:51.253085 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70fd1b3-b79c-4a57-8754-0d0188067d81 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:53:51.253364 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70fd1b3-b79c-4a57-8754-0d0188067d81 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:53:51.253639 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70fd1b3-b79c-4a57-8754-0d0188067d81 None admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:53:51.254407 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70fd1b3-b79c-4a57-8754-0d0188067d81 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:53:51.254716 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70fd1b3-b79c-4a57-8754-0d0188067d81 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:53:51.256171 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70fd1b3-b79c-4a57-8754-0d0188067d81 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:53:51.268703 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 625/1245] 10.222.0.52 () {56 vars in 1148 bytes} [Sat May 14 20:53:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:53:51.274720 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eb8fed-39df-4a61-afcf-3811e4f336ab None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:53:51.370204 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eb8fed-39df-4a61-afcf-3811e4f336ab None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:53:51.403545 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f04f450-1285-461c-9aa7-13fade2f5d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:53:51.404187 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f04f450-1285-461c-9aa7-13fade2f5d79 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:53:51.404473 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f04f450-1285-461c-9aa7-13fade2f5d79 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:53:51.404772 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f04f450-1285-461c-9aa7-13fade2f5d79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:53:51.405592 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f04f450-1285-461c-9aa7-13fade2f5d79 None admin] RBAC: Adding query filter params (role.id=998d6a3451be42a89d4cff277851ad70, scope.project.id=0911a024287e430ea6ee015389f0c440, user.id=0812ae67e44d483baf2dbb1a5332a1d7) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:53:51.406119 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f04f450-1285-461c-9aa7-13fade2f5d79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:53:51.407578 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f04f450-1285-461c-9aa7-13fade2f5d79 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:53:51.413294 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 621/1246] 10.222.0.52 () {56 vars in 1374 bytes} [Sat May 14 20:53:51 2022] GET /identity/v3/role_assignments?user.id=0812ae67e44d483baf2dbb1a5332a1d7&scope.project.id=0911a024287e430ea6ee015389f0c440&role.id=998d6a3451be42a89d4cff277851ad70 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:53:53.772448 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ebba78-d836-4fe3-8bfd-363f8f2b6549 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:53:53.773000 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ebba78-d836-4fe3-8bfd-363f8f2b6549 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:53:53.773000 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ebba78-d836-4fe3-8bfd-363f8f2b6549 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:53:53.774338 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 626/1247] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:53:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:53:53.779645 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f68ca-fc4b-4f3d-b526-8fe2c5badc4c None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:53:53.780073 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f68ca-fc4b-4f3d-b526-8fe2c5badc4c None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:53:53.780186 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f68ca-fc4b-4f3d-b526-8fe2c5badc4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:53:53.797692 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-f95f68ca-fc4b-4f3d-b526-8fe2c5badc4c None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:53:53.798852 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-f95f68ca-fc4b-4f3d-b526-8fe2c5badc4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:53:53.868982 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 622/1248] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:53:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 20:53:53.893815 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ebba78-d836-4fe3-8bfd-363f8f2b6549 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:53:53.992675 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ebba78-d836-4fe3-8bfd-363f8f2b6549 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:53:54.029173 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c09b73-0f60-4671-80f1-3635931eb2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:53:54.029173 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c09b73-0f60-4671-80f1-3635931eb2fc None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:53:54.029173 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c09b73-0f60-4671-80f1-3635931eb2fc None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:53:54.029173 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c09b73-0f60-4671-80f1-3635931eb2fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:53:54.037433 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c09b73-0f60-4671-80f1-3635931eb2fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:53:54.045051 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-54c09b73-0f60-4671-80f1-3635931eb2fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 14 20:53:54.045051 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:53:54.045051 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:53:54.045051 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:53:54.045051 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:53:54.045051 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:53:54.045051 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:53:54.045051 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:53:54.045051 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:53:54.045051 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:53:54.045051 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:53:54.045051 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:53:54.045051 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:53:54.045051 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:53:54.045051 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:53:54.045051 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:53:54.046038 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:53:54.046038 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:53:54.046038 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:53:54.046038 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:53:54.046038 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:53:54.046038 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:53:54.046038 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:53:54.046038 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:53:54.046038 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:53:54.046038 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:53:54.046038 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:53:54.046038 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:53:54.046038 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:53:54.046038 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:53:54.046038 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:53:54.046038 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:53:54.047274 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:53:54.047274 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:53:54.047274 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:53:54.047274 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:53:54.047274 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:53:54.047274 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:53:54.047274 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:53:54.047274 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:53:54.047274 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:53:54.047274 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:53:54.047274 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 14 20:53:54.047274 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:53:54.047274 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 627/1249] 10.222.0.52 () {56 vars in 1096 bytes} [Sat May 14 20:53:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:53:54.052407 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95f68ca-fc4b-4f3d-b526-8fe2c5badc4c None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:53:54.151655 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95f68ca-fc4b-4f3d-b526-8fe2c5badc4c None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:53:54.187199 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab7c549-3270-4670-ba7b-b402928def4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:53:54.188271 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab7c549-3270-4670-ba7b-b402928def4b None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:53:54.188692 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab7c549-3270-4670-ba7b-b402928def4b None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:53:54.189132 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab7c549-3270-4670-ba7b-b402928def4b None admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:53:54.190281 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab7c549-3270-4670-ba7b-b402928def4b None admin] RBAC: Adding query filter params (name=admin) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:53:54.190736 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab7c549-3270-4670-ba7b-b402928def4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:53:54.192877 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab7c549-3270-4670-ba7b-b402928def4b None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:53:54.201922 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 623/1250] 10.222.0.52 () {56 vars in 1099 bytes} [Sat May 14 20:53:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:53:54.208187 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c09b73-0f60-4671-80f1-3635931eb2fc None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:53:54.306964 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c09b73-0f60-4671-80f1-3635931eb2fc None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:53:54.339246 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f33132-4d94-4d24-b50f-4e357008e51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:53:54.340051 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f33132-4d94-4d24-b50f-4e357008e51d None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:53:54.340334 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f33132-4d94-4d24-b50f-4e357008e51d None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:53:54.340603 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f33132-4d94-4d24-b50f-4e357008e51d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:53:54.351919 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f33132-4d94-4d24-b50f-4e357008e51d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:53:54.353345 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f33132-4d94-4d24-b50f-4e357008e51d None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:53:54.370194 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-66f33132-4d94-4d24-b50f-4e357008e51d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:53:54.370194 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:53:54.370194 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:53:54.370194 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:53:54.370194 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:53:54.370194 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:53:54.370194 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:53:54.370194 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:53:54.370194 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:53:54.370194 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:53:54.370194 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:53:54.370194 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:53:54.370194 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:53:54.370194 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:53:54.370194 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:53:54.371237 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:53:54.371237 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:53:54.371237 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:53:54.371237 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:53:54.371237 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:53:54.371237 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:53:54.371237 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:53:54.371237 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:53:54.371237 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:53:54.371237 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:53:54.371237 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:53:54.371237 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:53:54.371237 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:53:54.371237 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:53:54.371237 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:53:54.371237 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:53:54.371237 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:53:54.382413 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 20:53:54.382413 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:53:54.382413 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:53:54.382413 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:53:54.382413 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 628/1251] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:53:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:53:54.382780 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab7c549-3270-4670-ba7b-b402928def4b None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:53:54.478043 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab7c549-3270-4670-ba7b-b402928def4b None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:53:54.519866 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d2d92d-1ef6-458f-befc-06585f34ef1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:53:54.520534 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2d92d-1ef6-458f-befc-06585f34ef1a None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:53:54.520813 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2d92d-1ef6-458f-befc-06585f34ef1a None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:53:54.521083 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2d92d-1ef6-458f-befc-06585f34ef1a None admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:53:54.521796 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d2d92d-1ef6-458f-befc-06585f34ef1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:53:54.522097 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d2d92d-1ef6-458f-befc-06585f34ef1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:53:54.523513 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d2d92d-1ef6-458f-befc-06585f34ef1a None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:53:54.537395 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 624/1252] 10.222.0.52 () {56 vars in 1109 bytes} [Sat May 14 20:53:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:53:54.545470 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f33132-4d94-4d24-b50f-4e357008e51d None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:53:54.646142 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f33132-4d94-4d24-b50f-4e357008e51d None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:53:54.678018 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb150c88-cfc2-4794-8494-58520c6ed07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:53:54.678832 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb150c88-cfc2-4794-8494-58520c6ed07d None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:53:54.679122 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb150c88-cfc2-4794-8494-58520c6ed07d None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:53:54.679405 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb150c88-cfc2-4794-8494-58520c6ed07d None admin] PATH_INFO: `/v3/users/placement` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:53:54.688258 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb150c88-cfc2-4794-8494-58520c6ed07d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:53:54.689724 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb150c88-cfc2-4794-8494-58520c6ed07d None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:53:54.703754 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-eb150c88-cfc2-4794-8494-58520c6ed07d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 14 20:53:54.703754 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:53:54.703754 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:53:54.703754 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:53:54.703754 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:53:54.703754 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:53:54.703754 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:53:54.703754 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:53:54.703754 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:53:54.703754 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:53:54.703754 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:53:54.703754 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:53:54.703754 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 14 20:53:54.703754 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_user(user_id) May 14 20:53:54.703754 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 14 20:53:54.703754 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 14 20:53:54.704933 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:53:54.704933 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:53:54.704933 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 20:53:54.704933 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 20:53:54.704933 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 14 20:53:54.704933 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 20:53:54.704933 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:53:54.704933 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:53:54.704933 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:53:54.704933 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:53:54.704933 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:53:54.704933 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:53:54.704933 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:53:54.704933 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:53:54.704933 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:53:54.704933 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:53:54.704933 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:53:54.704933 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:53:54.706122 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:53:54.706122 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:53:54.706122 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 14 20:53:54.706122 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 14 20:53:54.706122 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 14 20:53:54.706122 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 14 20:53:54.706122 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 14 20:53:54.706122 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 14 20:53:54.706122 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 14 20:53:54.706122 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:53:54.706122 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 629/1253] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:53:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:53:54.710726 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d2d92d-1ef6-458f-befc-06585f34ef1a None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:53:54.809540 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d2d92d-1ef6-458f-befc-06585f34ef1a None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:53:54.848518 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa61c257-97da-4c2d-a459-42d009834f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:53:54.849195 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61c257-97da-4c2d-a459-42d009834f7a None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:53:54.849479 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61c257-97da-4c2d-a459-42d009834f7a None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:53:54.849753 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61c257-97da-4c2d-a459-42d009834f7a None admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:53:54.850588 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa61c257-97da-4c2d-a459-42d009834f7a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:53:54.850918 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa61c257-97da-4c2d-a459-42d009834f7a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:53:54.852467 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa61c257-97da-4c2d-a459-42d009834f7a None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:53:54.878433 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 625/1254] 10.222.0.52 () {56 vars in 1143 bytes} [Sat May 14 20:53:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:53:54.884314 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb150c88-cfc2-4794-8494-58520c6ed07d None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:53:54.987412 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb150c88-cfc2-4794-8494-58520c6ed07d None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:53:55.020173 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03de74-61c0-491d-bad1-cf46e06f5dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:53:55.020816 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03de74-61c0-491d-bad1-cf46e06f5dc2 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:53:55.021098 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03de74-61c0-491d-bad1-cf46e06f5dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:53:55.021372 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03de74-61c0-491d-bad1-cf46e06f5dc2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:53:55.086513 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a03de74-61c0-491d-bad1-cf46e06f5dc2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:53:55.088013 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a03de74-61c0-491d-bad1-cf46e06f5dc2 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:53:55.193640 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 630/1255] 10.222.0.52 () {58 vars in 1282 bytes} [Sat May 14 20:53:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 14 20:53:55.199309 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa61c257-97da-4c2d-a459-42d009834f7a None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:53:55.295514 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa61c257-97da-4c2d-a459-42d009834f7a None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:53:55.328985 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d5731e-7f79-429b-aa81-5e2a1b8dee35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:53:55.329771 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d5731e-7f79-429b-aa81-5e2a1b8dee35 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:53:55.330054 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d5731e-7f79-429b-aa81-5e2a1b8dee35 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:53:55.330333 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d5731e-7f79-429b-aa81-5e2a1b8dee35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:53:55.340057 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d5731e-7f79-429b-aa81-5e2a1b8dee35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:53:55.341553 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d5731e-7f79-429b-aa81-5e2a1b8dee35 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:53:55.359700 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-11d5731e-7f79-429b-aa81-5e2a1b8dee35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:53:55.359700 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:53:55.359700 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:53:55.359700 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:53:55.359700 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:53:55.359700 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:53:55.359700 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:53:55.359700 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:53:55.359700 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:53:55.359700 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:53:55.359700 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:53:55.359700 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:53:55.359700 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:53:55.359700 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:53:55.359700 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:53:55.360752 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:53:55.360752 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:53:55.360752 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:53:55.360752 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:53:55.360752 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:53:55.360752 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:53:55.360752 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:53:55.360752 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:53:55.360752 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:53:55.360752 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:53:55.360752 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:53:55.360752 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:53:55.360752 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:53:55.360752 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:53:55.360752 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:53:55.360752 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:53:55.360752 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:53:55.361866 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 20:53:55.361866 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:53:55.361866 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:53:55.361866 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:53:55.361866 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 626/1256] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:53:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:53:55.366727 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03de74-61c0-491d-bad1-cf46e06f5dc2 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:53:55.462808 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03de74-61c0-491d-bad1-cf46e06f5dc2 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:53:55.496730 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a44f55-ddb7-4297-9b89-49bbcb4e3da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:53:55.497646 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a44f55-ddb7-4297-9b89-49bbcb4e3da0 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:53:55.497972 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a44f55-ddb7-4297-9b89-49bbcb4e3da0 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:53:55.498266 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a44f55-ddb7-4297-9b89-49bbcb4e3da0 None admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:53:55.498977 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a44f55-ddb7-4297-9b89-49bbcb4e3da0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:53:55.499319 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a44f55-ddb7-4297-9b89-49bbcb4e3da0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:53:55.500713 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a44f55-ddb7-4297-9b89-49bbcb4e3da0 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:53:55.511621 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 631/1257] 10.222.0.52 () {56 vars in 1109 bytes} [Sat May 14 20:53:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:53:55.517772 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d5731e-7f79-429b-aa81-5e2a1b8dee35 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:53:55.615497 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d5731e-7f79-429b-aa81-5e2a1b8dee35 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:53:55.648492 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3293cd-2a82-4db1-a821-27ab66433158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:53:55.649277 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3293cd-2a82-4db1-a821-27ab66433158 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:53:55.649564 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3293cd-2a82-4db1-a821-27ab66433158 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:53:55.649843 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3293cd-2a82-4db1-a821-27ab66433158 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:53:55.656421 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3293cd-2a82-4db1-a821-27ab66433158 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:53:55.657899 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3293cd-2a82-4db1-a821-27ab66433158 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:53:55.671957 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-6e3293cd-2a82-4db1-a821-27ab66433158 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 14 20:53:55.671957 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:53:55.671957 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:53:55.671957 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:53:55.671957 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:53:55.671957 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:53:55.671957 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:53:55.671957 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:53:55.671957 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:53:55.671957 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:53:55.671957 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:53:55.671957 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:53:55.671957 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 14 20:53:55.671957 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_project(project_id) May 14 20:53:55.671957 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 14 20:53:55.673024 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 14 20:53:55.673024 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:53:55.673024 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:53:55.673024 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:53:55.673024 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:53:55.673024 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:53:55.673024 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:53:55.673024 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:53:55.673024 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:53:55.673024 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:53:55.673024 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:53:55.673024 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:53:55.673024 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:53:55.673024 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:53:55.673024 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:53:55.673024 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:53:55.673024 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:53:55.674168 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 14 20:53:55.674168 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 14 20:53:55.674168 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 20:53:55.674168 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 20:53:55.674168 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 20:53:55.674168 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 20:53:55.674168 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 14 20:53:55.674168 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:53:55.674168 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 627/1258] 10.222.0.52 () {56 vars in 1111 bytes} [Sat May 14 20:53:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:53:55.679178 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a44f55-ddb7-4297-9b89-49bbcb4e3da0 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:53:55.778016 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a44f55-ddb7-4297-9b89-49bbcb4e3da0 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:53:55.809933 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab18fcc1-bff6-4979-9a71-be8cb3975d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:53:55.810573 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab18fcc1-bff6-4979-9a71-be8cb3975d02 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:53:55.810850 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab18fcc1-bff6-4979-9a71-be8cb3975d02 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:53:55.811120 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab18fcc1-bff6-4979-9a71-be8cb3975d02 None admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:53:55.812137 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab18fcc1-bff6-4979-9a71-be8cb3975d02 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:53:55.812440 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab18fcc1-bff6-4979-9a71-be8cb3975d02 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:53:55.813849 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab18fcc1-bff6-4979-9a71-be8cb3975d02 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:53:55.825241 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 632/1259] 10.222.0.52 () {56 vars in 1148 bytes} [Sat May 14 20:53:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:53:55.832079 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3293cd-2a82-4db1-a821-27ab66433158 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:53:55.929250 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3293cd-2a82-4db1-a821-27ab66433158 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:53:55.962200 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d81493-d3fc-4a37-9dc1-89debd78a003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:53:55.962838 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d81493-d3fc-4a37-9dc1-89debd78a003 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:53:55.963118 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d81493-d3fc-4a37-9dc1-89debd78a003 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:53:55.963387 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d81493-d3fc-4a37-9dc1-89debd78a003 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:53:55.964273 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d81493-d3fc-4a37-9dc1-89debd78a003 None admin] RBAC: Adding query filter params (role.id=24c463e2b4d44dd28cd2723a69a8ed2e, scope.project.id=0911a024287e430ea6ee015389f0c440, user.id=0812ae67e44d483baf2dbb1a5332a1d7) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:53:55.964579 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d81493-d3fc-4a37-9dc1-89debd78a003 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:53:55.965989 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d81493-d3fc-4a37-9dc1-89debd78a003 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:53:55.971332 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 628/1260] 10.222.0.52 () {56 vars in 1374 bytes} [Sat May 14 20:53:55 2022] GET /identity/v3/role_assignments?user.id=0812ae67e44d483baf2dbb1a5332a1d7&scope.project.id=0911a024287e430ea6ee015389f0c440&role.id=24c463e2b4d44dd28cd2723a69a8ed2e => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:53:58.340743 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b707f-3c8a-4e30-b6e0-7829baa0083f None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:53:58.341313 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b707f-3c8a-4e30-b6e0-7829baa0083f None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:53:58.341313 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b707f-3c8a-4e30-b6e0-7829baa0083f None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:53:58.342552 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 633/1261] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:53:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:53:58.348406 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249fb8a9-6f8f-4b73-b143-0e3c5e2adbb0 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:53:58.348893 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249fb8a9-6f8f-4b73-b143-0e3c5e2adbb0 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:53:58.349085 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249fb8a9-6f8f-4b73-b143-0e3c5e2adbb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:53:58.366161 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-249fb8a9-6f8f-4b73-b143-0e3c5e2adbb0 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:53:58.367346 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-249fb8a9-6f8f-4b73-b143-0e3c5e2adbb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:53:58.431964 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 629/1262] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:53:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 20:53:58.455991 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36b707f-3c8a-4e30-b6e0-7829baa0083f None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:53:58.557148 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36b707f-3c8a-4e30-b6e0-7829baa0083f None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:53:58.592394 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804ba915-bf52-4527-9f93-1614dab26417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:53:58.593840 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ba915-bf52-4527-9f93-1614dab26417 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:53:58.594123 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ba915-bf52-4527-9f93-1614dab26417 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:53:58.594397 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ba915-bf52-4527-9f93-1614dab26417 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:53:58.604311 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804ba915-bf52-4527-9f93-1614dab26417 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:53:58.611973 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-804ba915-bf52-4527-9f93-1614dab26417 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 14 20:53:58.611973 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:53:58.611973 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:53:58.611973 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:53:58.611973 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:53:58.611973 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:53:58.611973 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:53:58.611973 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:53:58.611973 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:53:58.611973 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:53:58.611973 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:53:58.611973 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:53:58.611973 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:53:58.611973 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:53:58.611973 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:53:58.611973 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:53:58.613014 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:53:58.613014 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:53:58.613014 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:53:58.613014 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:53:58.613014 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:53:58.613014 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:53:58.613014 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:53:58.613014 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:53:58.613014 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:53:58.613014 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:53:58.613014 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:53:58.613014 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:53:58.613014 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:53:58.613014 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:53:58.613014 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:53:58.613014 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:53:58.613972 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:53:58.613972 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:53:58.613972 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:53:58.613972 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:53:58.613972 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:53:58.613972 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:53:58.613972 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:53:58.613972 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:53:58.613972 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:53:58.613972 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:53:58.613972 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 14 20:53:58.613972 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:53:58.613972 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 634/1263] 10.222.0.52 () {56 vars in 1096 bytes} [Sat May 14 20:53:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:53:58.619136 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249fb8a9-6f8f-4b73-b143-0e3c5e2adbb0 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:53:58.714874 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249fb8a9-6f8f-4b73-b143-0e3c5e2adbb0 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:53:58.748060 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d9043a-9caf-4492-bace-faa15547dcc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:53:58.751664 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d9043a-9caf-4492-bace-faa15547dcc1 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:53:58.751664 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d9043a-9caf-4492-bace-faa15547dcc1 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:53:58.751664 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d9043a-9caf-4492-bace-faa15547dcc1 None admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:53:58.751664 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d9043a-9caf-4492-bace-faa15547dcc1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:53:58.751664 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d9043a-9caf-4492-bace-faa15547dcc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:53:58.752109 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d9043a-9caf-4492-bace-faa15547dcc1 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:53:58.764610 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 630/1264] 10.222.0.52 () {56 vars in 1099 bytes} [Sat May 14 20:53:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:53:58.766229 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804ba915-bf52-4527-9f93-1614dab26417 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:53:58.863295 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804ba915-bf52-4527-9f93-1614dab26417 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:53:58.895598 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26567280-d5e9-4646-8f0b-7c65cf6bc428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:53:58.896390 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26567280-d5e9-4646-8f0b-7c65cf6bc428 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:53:58.896683 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26567280-d5e9-4646-8f0b-7c65cf6bc428 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:53:58.896962 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26567280-d5e9-4646-8f0b-7c65cf6bc428 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:53:58.907424 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26567280-d5e9-4646-8f0b-7c65cf6bc428 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:53:58.908922 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26567280-d5e9-4646-8f0b-7c65cf6bc428 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:53:58.925853 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-26567280-d5e9-4646-8f0b-7c65cf6bc428 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:53:58.925853 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:53:58.925853 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:53:58.925853 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:53:58.925853 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:53:58.925853 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:53:58.925853 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:53:58.925853 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:53:58.925853 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:53:58.925853 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:53:58.925853 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:53:58.925853 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:53:58.925853 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:53:58.925853 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:53:58.925853 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:53:58.926814 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:53:58.926814 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:53:58.926814 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:53:58.926814 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:53:58.926814 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:53:58.926814 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:53:58.926814 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:53:58.926814 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:53:58.926814 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:53:58.926814 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:53:58.926814 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:53:58.926814 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:53:58.926814 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:53:58.926814 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:53:58.926814 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:53:58.926814 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:53:58.926814 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:53:58.927856 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 20:53:58.927856 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:53:58.927856 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:53:58.927856 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:53:58.927856 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 635/1265] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:53:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 20:53:58.933035 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d9043a-9caf-4492-bace-faa15547dcc1 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:53:59.031870 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d9043a-9caf-4492-bace-faa15547dcc1 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:53:59.064036 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f950126-210f-420d-b347-72a03977fe69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:53:59.064689 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f950126-210f-420d-b347-72a03977fe69 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:53:59.064972 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f950126-210f-420d-b347-72a03977fe69 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:53:59.065249 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f950126-210f-420d-b347-72a03977fe69 None admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:53:59.065959 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f950126-210f-420d-b347-72a03977fe69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:53:59.066266 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f950126-210f-420d-b347-72a03977fe69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:53:59.067651 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f950126-210f-420d-b347-72a03977fe69 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:53:59.079469 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 631/1266] 10.222.0.52 () {56 vars in 1109 bytes} [Sat May 14 20:53:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:53:59.085313 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26567280-d5e9-4646-8f0b-7c65cf6bc428 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:53:59.183749 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26567280-d5e9-4646-8f0b-7c65cf6bc428 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:53:59.217034 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d075a-7752-4156-ac17-1d534f049300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:53:59.217905 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d075a-7752-4156-ac17-1d534f049300 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:53:59.218223 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d075a-7752-4156-ac17-1d534f049300 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:53:59.218498 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d075a-7752-4156-ac17-1d534f049300 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:53:59.225897 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5d075a-7752-4156-ac17-1d534f049300 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:53:59.227321 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5d075a-7752-4156-ac17-1d534f049300 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:53:59.241800 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-ed5d075a-7752-4156-ac17-1d534f049300 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 14 20:53:59.241800 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:53:59.241800 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:53:59.241800 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:53:59.241800 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:53:59.241800 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:53:59.241800 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:53:59.241800 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:53:59.241800 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:53:59.241800 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:53:59.241800 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:53:59.241800 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:53:59.241800 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 14 20:53:59.241800 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_user(user_id) May 14 20:53:59.241800 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 14 20:53:59.241800 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 14 20:53:59.245822 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:53:59.245822 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:53:59.245822 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 20:53:59.245822 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 20:53:59.245822 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 14 20:53:59.245822 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 20:53:59.245822 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:53:59.245822 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:53:59.245822 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:53:59.245822 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:53:59.245822 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:53:59.245822 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:53:59.245822 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:53:59.245822 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:53:59.245822 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:53:59.245822 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:53:59.245822 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:53:59.245822 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:53:59.246780 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:53:59.246780 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:53:59.246780 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 14 20:53:59.246780 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 14 20:53:59.246780 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 14 20:53:59.246780 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 14 20:53:59.246780 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 14 20:53:59.246780 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 14 20:53:59.246780 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 14 20:53:59.246780 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:53:59.246780 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 636/1267] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:53:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:53:59.249713 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f950126-210f-420d-b347-72a03977fe69 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:53:59.347361 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f950126-210f-420d-b347-72a03977fe69 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:53:59.380755 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98cbaa5-f9f3-4e6f-89c9-76877f81aa7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:53:59.381413 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98cbaa5-f9f3-4e6f-89c9-76877f81aa7e None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:53:59.381693 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98cbaa5-f9f3-4e6f-89c9-76877f81aa7e None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:53:59.381962 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98cbaa5-f9f3-4e6f-89c9-76877f81aa7e None admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:53:59.382779 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98cbaa5-f9f3-4e6f-89c9-76877f81aa7e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:53:59.383083 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98cbaa5-f9f3-4e6f-89c9-76877f81aa7e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:53:59.384527 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98cbaa5-f9f3-4e6f-89c9-76877f81aa7e None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:53:59.401058 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 632/1268] 10.222.0.52 () {56 vars in 1143 bytes} [Sat May 14 20:53:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:53:59.406816 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d075a-7752-4156-ac17-1d534f049300 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:53:59.505246 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d075a-7752-4156-ac17-1d534f049300 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:53:59.536327 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614b41c2-e911-47dd-87a9-16bb7341cbe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:53:59.537101 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b41c2-e911-47dd-87a9-16bb7341cbe6 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:53:59.537379 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b41c2-e911-47dd-87a9-16bb7341cbe6 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:53:59.537691 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b41c2-e911-47dd-87a9-16bb7341cbe6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:53:59.548345 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614b41c2-e911-47dd-87a9-16bb7341cbe6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:53:59.550122 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614b41c2-e911-47dd-87a9-16bb7341cbe6 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:53:59.567073 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-614b41c2-e911-47dd-87a9-16bb7341cbe6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:53:59.567073 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:53:59.567073 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:53:59.567073 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:53:59.567073 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:53:59.567073 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:53:59.567073 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:53:59.567073 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:53:59.567073 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:53:59.567073 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:53:59.567073 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:53:59.567073 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:53:59.567073 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:53:59.567073 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:53:59.567073 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:53:59.568195 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:53:59.568195 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:53:59.568195 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:53:59.568195 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:53:59.568195 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:53:59.568195 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:53:59.568195 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:53:59.568195 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:53:59.568195 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:53:59.568195 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:53:59.568195 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:53:59.568195 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:53:59.568195 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:53:59.568195 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:53:59.568195 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:53:59.568195 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:53:59.568195 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:53:59.573916 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 20:53:59.573916 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:53:59.573916 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:53:59.573916 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:53:59.573916 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 637/1269] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:53:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:53:59.574814 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98cbaa5-f9f3-4e6f-89c9-76877f81aa7e None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:53:59.672900 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98cbaa5-f9f3-4e6f-89c9-76877f81aa7e None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:53:59.704804 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4dbd98-03e6-49e0-879a-bfbd270b1196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:53:59.705453 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4dbd98-03e6-49e0-879a-bfbd270b1196 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:53:59.705738 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4dbd98-03e6-49e0-879a-bfbd270b1196 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:53:59.706049 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4dbd98-03e6-49e0-879a-bfbd270b1196 None admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:53:59.706720 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4dbd98-03e6-49e0-879a-bfbd270b1196 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:53:59.707024 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4dbd98-03e6-49e0-879a-bfbd270b1196 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:53:59.708412 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4dbd98-03e6-49e0-879a-bfbd270b1196 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:53:59.719802 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 633/1270] 10.222.0.52 () {56 vars in 1109 bytes} [Sat May 14 20:53:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:53:59.725470 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614b41c2-e911-47dd-87a9-16bb7341cbe6 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:53:59.826724 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614b41c2-e911-47dd-87a9-16bb7341cbe6 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:53:59.864910 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14655506-5acc-41b7-9ac9-4abc2c7dc66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:53:59.865696 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14655506-5acc-41b7-9ac9-4abc2c7dc66c None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:53:59.865978 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14655506-5acc-41b7-9ac9-4abc2c7dc66c None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:53:59.866254 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14655506-5acc-41b7-9ac9-4abc2c7dc66c None admin] PATH_INFO: `/v3/projects/service` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:53:59.873055 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14655506-5acc-41b7-9ac9-4abc2c7dc66c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:53:59.876979 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14655506-5acc-41b7-9ac9-4abc2c7dc66c None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:53:59.888469 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-14655506-5acc-41b7-9ac9-4abc2c7dc66c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 14 20:53:59.888469 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:53:59.888469 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:53:59.888469 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:53:59.888469 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:53:59.888469 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:53:59.888469 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:53:59.888469 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:53:59.888469 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:53:59.888469 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:53:59.888469 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:53:59.888469 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:53:59.888469 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 14 20:53:59.888469 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_project(project_id) May 14 20:53:59.888469 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 14 20:53:59.889533 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 14 20:53:59.889533 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:53:59.889533 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:53:59.889533 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:53:59.889533 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:53:59.889533 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:53:59.889533 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:53:59.889533 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:53:59.889533 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:53:59.889533 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:53:59.889533 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:53:59.889533 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:53:59.889533 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:53:59.889533 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:53:59.889533 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:53:59.889533 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:53:59.889533 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:53:59.890833 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 14 20:53:59.890833 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 14 20:53:59.890833 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 20:53:59.890833 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 20:53:59.890833 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 20:53:59.890833 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 20:53:59.890833 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 14 20:53:59.890833 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:53:59.890833 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 638/1271] 10.222.0.52 () {56 vars in 1111 bytes} [Sat May 14 20:53:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:53:59.895574 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4dbd98-03e6-49e0-879a-bfbd270b1196 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:53:59.995066 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4dbd98-03e6-49e0-879a-bfbd270b1196 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:54:00.027316 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1e4c24-a9c2-451c-a468-af30eddd2cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:54:00.028050 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e4c24-a9c2-451c-a468-af30eddd2cff None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:54:00.028336 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e4c24-a9c2-451c-a468-af30eddd2cff None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:54:00.028608 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e4c24-a9c2-451c-a468-af30eddd2cff None admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:54:00.029385 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1e4c24-a9c2-451c-a468-af30eddd2cff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:54:00.029692 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1e4c24-a9c2-451c-a468-af30eddd2cff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:54:00.031131 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1e4c24-a9c2-451c-a468-af30eddd2cff None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:54:00.043605 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 634/1272] 10.222.0.52 () {56 vars in 1148 bytes} [Sat May 14 20:53:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:54:00.049920 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14655506-5acc-41b7-9ac9-4abc2c7dc66c None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:54:00.148344 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14655506-5acc-41b7-9ac9-4abc2c7dc66c None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:54:00.182396 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28db37cd-f18d-4581-8b2a-44aced9ebaa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:54:00.183261 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db37cd-f18d-4581-8b2a-44aced9ebaa3 None admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:54:00.183566 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db37cd-f18d-4581-8b2a-44aced9ebaa3 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:54:00.183844 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db37cd-f18d-4581-8b2a-44aced9ebaa3 None admin] PATH_INFO: `/v3/projects/0911a024287e430ea6ee015389f0c440/users/0812ae67e44d483baf2dbb1a5332a1d7/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:54:00.185759 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28db37cd-f18d-4581-8b2a-44aced9ebaa3 None admin] RBAC: Authorizing `identity:create_grant(project_id=0911a024287e430ea6ee015389f0c440, user_id=0812ae67e44d483baf2dbb1a5332a1d7, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:54:00.187312 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28db37cd-f18d-4581-8b2a-44aced9ebaa3 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:54:00.259344 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 639/1273] 10.222.0.52 () {58 vars in 1439 bytes} [Sat May 14 20:54:00 2022] PUT /identity/v3/projects/0911a024287e430ea6ee015389f0c440/users/0812ae67e44d483baf2dbb1a5332a1d7/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 20:54:02.546173 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd9c333-f549-4452-a8fa-c8fcc0fee28a None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:54:02.547273 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd9c333-f549-4452-a8fa-c8fcc0fee28a None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:54:02.547273 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd9c333-f549-4452-a8fa-c8fcc0fee28a None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:54:02.548718 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 635/1274] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:54:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:54:02.553940 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aaf60e-59c4-4a03-bbdd-1f0d42748f8c None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:54:02.554340 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aaf60e-59c4-4a03-bbdd-1f0d42748f8c None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:54:02.554503 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aaf60e-59c4-4a03-bbdd-1f0d42748f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:54:02.571432 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-68aaf60e-59c4-4a03-bbdd-1f0d42748f8c None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:54:02.576391 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-68aaf60e-59c4-4a03-bbdd-1f0d42748f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:54:02.640327 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 640/1275] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:54:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 20:54:02.665629 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd9c333-f549-4452-a8fa-c8fcc0fee28a None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:54:02.765017 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd9c333-f549-4452-a8fa-c8fcc0fee28a None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:54:02.802419 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d318c4c-fb9a-40e9-9287-d9823f900a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:54:02.802419 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d318c4c-fb9a-40e9-9287-d9823f900a29 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:54:02.802419 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d318c4c-fb9a-40e9-9287-d9823f900a29 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:54:02.802419 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d318c4c-fb9a-40e9-9287-d9823f900a29 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:54:02.810172 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d318c4c-fb9a-40e9-9287-d9823f900a29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 20:54:02.818072 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-8d318c4c-fb9a-40e9-9287-d9823f900a29 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 14 20:54:02.818072 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:54:02.818072 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:54:02.818072 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:54:02.818072 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:54:02.818072 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:54:02.818072 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:54:02.818072 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:54:02.818072 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:54:02.818072 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:54:02.818072 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:54:02.818072 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:54:02.818072 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 20:54:02.818072 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 20:54:02.818072 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 20:54:02.818072 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 20:54:02.819214 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 20:54:02.819214 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 20:54:02.819214 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 20:54:02.819214 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 20:54:02.819214 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:54:02.819214 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:54:02.819214 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:54:02.819214 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:54:02.819214 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:54:02.819214 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:54:02.819214 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:54:02.819214 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:54:02.819214 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:54:02.819214 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:54:02.819214 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:54:02.819214 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:54:02.820295 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:54:02.820295 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:54:02.820295 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:54:02.820295 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:54:02.820295 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 20:54:02.820295 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 20:54:02.820295 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 20:54:02.820295 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 20:54:02.820295 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 20:54:02.820295 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 20:54:02.820295 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 14 20:54:02.820295 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:54:02.820295 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 636/1276] 10.222.0.52 () {56 vars in 1096 bytes} [Sat May 14 20:54:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:54:02.825559 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aaf60e-59c4-4a03-bbdd-1f0d42748f8c None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:54:02.922985 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aaf60e-59c4-4a03-bbdd-1f0d42748f8c None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:54:02.955181 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c7075f-480a-4302-a5e1-1116c3af6009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:54:02.955867 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7075f-480a-4302-a5e1-1116c3af6009 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:54:02.956150 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7075f-480a-4302-a5e1-1116c3af6009 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:54:02.956426 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7075f-480a-4302-a5e1-1116c3af6009 None admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:54:02.957156 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c7075f-480a-4302-a5e1-1116c3af6009 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:54:02.957460 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c7075f-480a-4302-a5e1-1116c3af6009 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:54:02.958813 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c7075f-480a-4302-a5e1-1116c3af6009 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:54:02.966535 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 641/1277] 10.222.0.52 () {56 vars in 1099 bytes} [Sat May 14 20:54:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:54:02.973237 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d318c4c-fb9a-40e9-9287-d9823f900a29 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:54:03.070499 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d318c4c-fb9a-40e9-9287-d9823f900a29 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:54:03.104970 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26763d82-4b08-4dfc-bbbe-6029eb38575c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:54:03.105776 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26763d82-4b08-4dfc-bbbe-6029eb38575c None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:54:03.106060 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26763d82-4b08-4dfc-bbbe-6029eb38575c None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:54:03.106339 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26763d82-4b08-4dfc-bbbe-6029eb38575c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:54:03.117029 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26763d82-4b08-4dfc-bbbe-6029eb38575c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:54:03.118480 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26763d82-4b08-4dfc-bbbe-6029eb38575c None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:54:03.135888 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-26763d82-4b08-4dfc-bbbe-6029eb38575c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:54:03.135888 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:54:03.135888 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:54:03.135888 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:54:03.135888 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:54:03.135888 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:54:03.135888 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:54:03.135888 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:54:03.135888 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:54:03.135888 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:54:03.135888 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:54:03.135888 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:54:03.135888 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:54:03.135888 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:54:03.135888 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:54:03.143668 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:54:03.143668 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:54:03.143668 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:54:03.143668 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:54:03.143668 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:54:03.143668 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:54:03.143668 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:54:03.143668 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:54:03.143668 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:54:03.143668 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:54:03.143668 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:54:03.143668 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:54:03.143668 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:54:03.143668 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:54:03.143668 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:54:03.143668 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:54:03.143668 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:54:03.144574 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 20:54:03.144574 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:54:03.144574 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:54:03.144574 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:54:03.144574 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 637/1278] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:54:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:54:03.144863 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c7075f-480a-4302-a5e1-1116c3af6009 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:54:03.248959 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c7075f-480a-4302-a5e1-1116c3af6009 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:54:03.283312 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d17ef-56a1-4898-a3ab-23bfaee9ddd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:54:03.284013 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d17ef-56a1-4898-a3ab-23bfaee9ddd4 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:54:03.284300 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d17ef-56a1-4898-a3ab-23bfaee9ddd4 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:54:03.284579 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d17ef-56a1-4898-a3ab-23bfaee9ddd4 None admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:54:03.285297 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6d17ef-56a1-4898-a3ab-23bfaee9ddd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:54:03.285660 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6d17ef-56a1-4898-a3ab-23bfaee9ddd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:54:03.287072 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6d17ef-56a1-4898-a3ab-23bfaee9ddd4 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:54:03.299777 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 642/1279] 10.222.0.52 () {56 vars in 1109 bytes} [Sat May 14 20:54:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:54:03.305493 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26763d82-4b08-4dfc-bbbe-6029eb38575c None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:54:03.403528 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26763d82-4b08-4dfc-bbbe-6029eb38575c None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:54:03.436450 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23d07cc-1db7-455e-ae3a-11fc532493b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:54:03.437243 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23d07cc-1db7-455e-ae3a-11fc532493b9 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:54:03.437567 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23d07cc-1db7-455e-ae3a-11fc532493b9 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:54:03.437846 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23d07cc-1db7-455e-ae3a-11fc532493b9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:54:03.445205 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23d07cc-1db7-455e-ae3a-11fc532493b9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:54:03.446645 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23d07cc-1db7-455e-ae3a-11fc532493b9 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:54:03.460492 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-e23d07cc-1db7-455e-ae3a-11fc532493b9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 14 20:54:03.460492 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:54:03.460492 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:54:03.460492 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:54:03.460492 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:54:03.460492 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:54:03.460492 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:54:03.460492 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:54:03.460492 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:54:03.460492 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:54:03.460492 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:54:03.460492 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:54:03.460492 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 14 20:54:03.460492 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_user(user_id) May 14 20:54:03.460492 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 14 20:54:03.460492 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 14 20:54:03.462428 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:54:03.462428 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:54:03.462428 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 20:54:03.462428 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 20:54:03.462428 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 14 20:54:03.462428 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 20:54:03.462428 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:54:03.462428 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:54:03.462428 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:54:03.462428 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:54:03.462428 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:54:03.462428 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:54:03.462428 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:54:03.462428 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:54:03.462428 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:54:03.462428 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:54:03.462428 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:54:03.462428 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:54:03.463660 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:54:03.463660 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:54:03.463660 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 14 20:54:03.463660 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 14 20:54:03.463660 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 14 20:54:03.463660 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 14 20:54:03.463660 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 14 20:54:03.463660 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 14 20:54:03.463660 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 14 20:54:03.463660 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:54:03.463660 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 638/1280] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:54:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:54:03.471111 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d17ef-56a1-4898-a3ab-23bfaee9ddd4 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:54:03.566476 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d17ef-56a1-4898-a3ab-23bfaee9ddd4 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:54:03.598953 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3969742-0c86-47ee-90a0-72ae63212b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:54:03.599638 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3969742-0c86-47ee-90a0-72ae63212b1f None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:54:03.599923 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3969742-0c86-47ee-90a0-72ae63212b1f None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:54:03.600198 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3969742-0c86-47ee-90a0-72ae63212b1f None admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:54:03.601013 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3969742-0c86-47ee-90a0-72ae63212b1f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:54:03.601320 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3969742-0c86-47ee-90a0-72ae63212b1f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:54:03.602729 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3969742-0c86-47ee-90a0-72ae63212b1f None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:54:03.619778 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 643/1281] 10.222.0.52 () {56 vars in 1143 bytes} [Sat May 14 20:54:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:54:03.625913 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23d07cc-1db7-455e-ae3a-11fc532493b9 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:54:03.721211 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23d07cc-1db7-455e-ae3a-11fc532493b9 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:54:03.753873 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f66bcf-65e5-4b3c-8098-7e547351fee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:54:03.754545 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f66bcf-65e5-4b3c-8098-7e547351fee9 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:54:03.754877 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f66bcf-65e5-4b3c-8098-7e547351fee9 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:54:03.755153 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f66bcf-65e5-4b3c-8098-7e547351fee9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:54:03.820541 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f66bcf-65e5-4b3c-8098-7e547351fee9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:54:03.821987 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f66bcf-65e5-4b3c-8098-7e547351fee9 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:54:03.916573 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 639/1282] 10.222.0.52 () {58 vars in 1282 bytes} [Sat May 14 20:54:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 14 20:54:03.922398 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3969742-0c86-47ee-90a0-72ae63212b1f None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:54:04.019575 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3969742-0c86-47ee-90a0-72ae63212b1f None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:54:04.052574 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d110d7f6-4a43-4ddd-ac15-f7913343c055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:54:04.053351 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110d7f6-4a43-4ddd-ac15-f7913343c055 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:54:04.053638 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110d7f6-4a43-4ddd-ac15-f7913343c055 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:54:04.053916 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110d7f6-4a43-4ddd-ac15-f7913343c055 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:54:04.063768 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d110d7f6-4a43-4ddd-ac15-f7913343c055 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:54:04.065837 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d110d7f6-4a43-4ddd-ac15-f7913343c055 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:54:04.082474 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-d110d7f6-4a43-4ddd-ac15-f7913343c055 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:54:04.082474 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:54:04.082474 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:54:04.082474 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:54:04.082474 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:54:04.082474 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:54:04.082474 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:54:04.082474 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:54:04.082474 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:54:04.082474 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:54:04.082474 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:54:04.082474 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:54:04.082474 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 20:54:04.082474 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 20:54:04.082474 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 20:54:04.083423 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 20:54:04.083423 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:54:04.083423 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:54:04.083423 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:54:04.083423 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:54:04.083423 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:54:04.083423 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:54:04.083423 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:54:04.083423 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:54:04.083423 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:54:04.083423 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:54:04.083423 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:54:04.083423 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:54:04.083423 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:54:04.083423 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:54:04.083423 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:54:04.083423 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:54:04.084431 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 20:54:04.084431 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 20:54:04.084431 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 20:54:04.084431 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:54:04.084431 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 644/1283] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 20:54:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:54:04.089590 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f66bcf-65e5-4b3c-8098-7e547351fee9 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:54:04.184799 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f66bcf-65e5-4b3c-8098-7e547351fee9 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:54:04.218757 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886758bb-c492-4566-8203-90fc1ad634ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:54:04.219400 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886758bb-c492-4566-8203-90fc1ad634ac None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:54:04.219711 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886758bb-c492-4566-8203-90fc1ad634ac None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:54:04.219990 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886758bb-c492-4566-8203-90fc1ad634ac None admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:54:04.220697 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886758bb-c492-4566-8203-90fc1ad634ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:54:04.221016 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886758bb-c492-4566-8203-90fc1ad634ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:54:04.222390 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886758bb-c492-4566-8203-90fc1ad634ac None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:54:04.233391 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 640/1284] 10.222.0.52 () {56 vars in 1109 bytes} [Sat May 14 20:54:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:54:04.238980 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d110d7f6-4a43-4ddd-ac15-f7913343c055 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:54:04.335754 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d110d7f6-4a43-4ddd-ac15-f7913343c055 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:54:04.367791 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbea7dde-33ac-4b29-bdc2-17821bbdc7e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:54:04.368573 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea7dde-33ac-4b29-bdc2-17821bbdc7e0 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:54:04.368858 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea7dde-33ac-4b29-bdc2-17821bbdc7e0 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:54:04.369135 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea7dde-33ac-4b29-bdc2-17821bbdc7e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:54:04.376468 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbea7dde-33ac-4b29-bdc2-17821bbdc7e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:54:04.377898 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbea7dde-33ac-4b29-bdc2-17821bbdc7e0 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:54:04.391955 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-cbea7dde-33ac-4b29-bdc2-17821bbdc7e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 14 20:54:04.391955 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:54:04.391955 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:54:04.391955 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:54:04.391955 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:54:04.391955 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:54:04.391955 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:54:04.391955 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:54:04.391955 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:54:04.391955 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:54:04.391955 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:54:04.391955 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:54:04.391955 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 14 20:54:04.391955 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_project(project_id) May 14 20:54:04.391955 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 14 20:54:04.393015 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 14 20:54:04.393015 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:54:04.393015 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:54:04.393015 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:54:04.393015 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:54:04.393015 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:54:04.393015 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:54:04.393015 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:54:04.393015 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 20:54:04.393015 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:54:04.393015 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 20:54:04.393015 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:54:04.393015 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:54:04.393015 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:54:04.393015 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 20:54:04.393015 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:54:04.393015 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 20:54:04.394373 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 14 20:54:04.394373 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 14 20:54:04.394373 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 20:54:04.394373 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 20:54:04.394373 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 20:54:04.394373 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 20:54:04.394373 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 14 20:54:04.394373 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 20:54:04.394373 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 645/1285] 10.222.0.52 () {56 vars in 1111 bytes} [Sat May 14 20:54:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:54:04.398907 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886758bb-c492-4566-8203-90fc1ad634ac None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:54:04.497613 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886758bb-c492-4566-8203-90fc1ad634ac None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:54:04.535932 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80044158-51ec-4eca-9b57-1b1a412a438e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:54:04.536588 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80044158-51ec-4eca-9b57-1b1a412a438e None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:54:04.536872 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80044158-51ec-4eca-9b57-1b1a412a438e None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:54:04.537144 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80044158-51ec-4eca-9b57-1b1a412a438e None admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:54:04.537919 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80044158-51ec-4eca-9b57-1b1a412a438e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:54:04.538224 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80044158-51ec-4eca-9b57-1b1a412a438e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:54:04.539689 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80044158-51ec-4eca-9b57-1b1a412a438e None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:54:04.552150 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 641/1286] 10.222.0.52 () {56 vars in 1148 bytes} [Sat May 14 20:54:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:54:04.558307 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbea7dde-33ac-4b29-bdc2-17821bbdc7e0 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:54:04.657323 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbea7dde-33ac-4b29-bdc2-17821bbdc7e0 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:54:04.690847 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9352e67-edc7-427f-a1d7-e69f64b7b27c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:54:04.691528 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9352e67-edc7-427f-a1d7-e69f64b7b27c None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:54:04.691818 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9352e67-edc7-427f-a1d7-e69f64b7b27c None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:54:04.692097 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9352e67-edc7-427f-a1d7-e69f64b7b27c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:54:04.692918 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9352e67-edc7-427f-a1d7-e69f64b7b27c None admin] RBAC: Adding query filter params (role.id=24c463e2b4d44dd28cd2723a69a8ed2e, scope.project.id=0911a024287e430ea6ee015389f0c440, user.id=0812ae67e44d483baf2dbb1a5332a1d7) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:54:04.693228 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9352e67-edc7-427f-a1d7-e69f64b7b27c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:54:04.694702 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9352e67-edc7-427f-a1d7-e69f64b7b27c None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:54:04.700535 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 646/1287] 10.222.0.52 () {56 vars in 1374 bytes} [Sat May 14 20:54:04 2022] GET /identity/v3/role_assignments?user.id=0812ae67e44d483baf2dbb1a5332a1d7&scope.project.id=0911a024287e430ea6ee015389f0c440&role.id=24c463e2b4d44dd28cd2723a69a8ed2e => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:54:07.034161 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc1724-f99f-45c2-86fd-856984f97d34 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:54:07.034719 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc1724-f99f-45c2-86fd-856984f97d34 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:54:07.034719 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc1724-f99f-45c2-86fd-856984f97d34 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:54:07.036112 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 642/1288] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:54:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:54:07.041583 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c15bfe-715f-465b-8169-2d7fb5eb95f9 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:54:07.041953 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c15bfe-715f-465b-8169-2d7fb5eb95f9 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:54:07.041953 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c15bfe-715f-465b-8169-2d7fb5eb95f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:54:07.058842 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-c3c15bfe-715f-465b-8169-2d7fb5eb95f9 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:54:07.060043 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c3c15bfe-715f-465b-8169-2d7fb5eb95f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:54:07.124294 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 647/1289] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:54:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 20:54:07.148725 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedc1724-f99f-45c2-86fd-856984f97d34 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:54:07.249238 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedc1724-f99f-45c2-86fd-856984f97d34 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:54:07.281853 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1220ec7a-239b-4aaf-b03c-35de7751a8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:54:07.282640 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220ec7a-239b-4aaf-b03c-35de7751a8c8 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:54:07.282923 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220ec7a-239b-4aaf-b03c-35de7751a8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:54:07.283199 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220ec7a-239b-4aaf-b03c-35de7751a8c8 None admin] PATH_INFO: `/v3/services/placement` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:54:07.283867 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1220ec7a-239b-4aaf-b03c-35de7751a8c8 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:54:07.285231 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1220ec7a-239b-4aaf-b03c-35de7751a8c8 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:54:07.296857 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-1220ec7a-239b-4aaf-b03c-35de7751a8c8 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 14 20:54:07.296857 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:54:07.296857 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 14 20:54:07.296857 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 14 20:54:07.296857 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 14 20:54:07.296857 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 14 20:54:07.296857 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 14 20:54:07.296857 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 20:54:07.296857 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 14 20:54:07.296857 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:54:07.296857 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 20:54:07.296857 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:54:07.296857 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:54:07.296857 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:54:07.296857 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:54:07.296857 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:54:07.296857 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:54:07.297957 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:54:07.297957 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:54:07.297957 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:54:07.297957 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:54:07.297957 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:54:07.297957 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:54:07.297957 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 14 20:54:07.297957 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_service(service_id) May 14 20:54:07.297957 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 14 20:54:07.297957 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 14 20:54:07.297957 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:54:07.297957 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:54:07.297957 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:54:07.297957 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:54:07.297957 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:54:07.297957 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:54:07.298898 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:54:07.298898 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:54:07.298898 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:54:07.298898 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:54:07.298898 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:54:07.298898 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:54:07.298898 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:54:07.298898 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:54:07.298898 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:54:07.298898 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:54:07.298898 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 14 20:54:07.298898 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 20:54:07.298898 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 14 20:54:07.298898 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:54:07.298898 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 643/1290] 10.222.0.52 () {56 vars in 1117 bytes} [Sat May 14 20:54:07 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:54:07.304301 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c15bfe-715f-465b-8169-2d7fb5eb95f9 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:54:07.401731 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c15bfe-715f-465b-8169-2d7fb5eb95f9 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:54:07.433776 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb556a5-88a2-4496-ba24-523239f6d2df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:54:07.434451 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb556a5-88a2-4496-ba24-523239f6d2df None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:54:07.434734 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb556a5-88a2-4496-ba24-523239f6d2df None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:54:07.435008 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb556a5-88a2-4496-ba24-523239f6d2df None admin] PATH_INFO: `/v3/services` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:54:07.435826 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb556a5-88a2-4496-ba24-523239f6d2df None admin] RBAC: Adding query filter params (name=placement) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:54:07.436127 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb556a5-88a2-4496-ba24-523239f6d2df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:54:07.440711 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb556a5-88a2-4496-ba24-523239f6d2df None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:54:07.442683 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 648/1291] 10.222.0.52 () {56 vars in 1116 bytes} [Sat May 14 20:54:07 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:54:07.448602 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1220ec7a-239b-4aaf-b03c-35de7751a8c8 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:54:07.543811 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1220ec7a-239b-4aaf-b03c-35de7751a8c8 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:54:07.576052 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08751f61-60de-41eb-8c39-17e0343af455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:54:07.576710 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08751f61-60de-41eb-8c39-17e0343af455 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:54:07.576994 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08751f61-60de-41eb-8c39-17e0343af455 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:54:07.577273 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08751f61-60de-41eb-8c39-17e0343af455 None admin] PATH_INFO: `/v3/services` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:54:07.578171 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08751f61-60de-41eb-8c39-17e0343af455 None admin] RBAC: Adding query filter params (type=placement) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:54:07.578505 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08751f61-60de-41eb-8c39-17e0343af455 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:54:07.579901 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08751f61-60de-41eb-8c39-17e0343af455 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:54:07.584240 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 644/1292] 10.222.0.52 () {56 vars in 1116 bytes} [Sat May 14 20:54:07 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:54:09.829546 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd2d95-210d-4f29-83ed-2971caf9cb34 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:54:09.830104 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd2d95-210d-4f29-83ed-2971caf9cb34 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:54:09.830104 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd2d95-210d-4f29-83ed-2971caf9cb34 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:54:09.831513 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 649/1293] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:54:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:54:09.836817 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2dbdc-7503-4227-8252-cbc13abb0964 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:54:09.837261 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2dbdc-7503-4227-8252-cbc13abb0964 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:54:09.837361 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2dbdc-7503-4227-8252-cbc13abb0964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:54:09.855259 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-dde2dbdc-7503-4227-8252-cbc13abb0964 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:54:09.856458 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-dde2dbdc-7503-4227-8252-cbc13abb0964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:54:09.929985 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 645/1294] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:54:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 20:54:09.954032 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bd2d95-210d-4f29-83ed-2971caf9cb34 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:54:10.053571 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bd2d95-210d-4f29-83ed-2971caf9cb34 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:54:10.087610 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f4e061-56af-4a28-a7be-4d0864c58693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:54:10.088191 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4e061-56af-4a28-a7be-4d0864c58693 None admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:54:10.088472 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4e061-56af-4a28-a7be-4d0864c58693 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:54:10.088745 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4e061-56af-4a28-a7be-4d0864c58693 None admin] PATH_INFO: `/v3/services` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:54:10.089464 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f4e061-56af-4a28-a7be-4d0864c58693 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:54:10.090918 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f4e061-56af-4a28-a7be-4d0864c58693 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:54:10.165401 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 650/1295] 10.222.0.52 () {60 vars in 1141 bytes} [Sat May 14 20:54:09 2022] POST /identity/v3/services => generated 246 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 20:54:12.454727 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2777975-5e87-4ce2-8edd-3aae28e1f645 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:54:12.455251 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2777975-5e87-4ce2-8edd-3aae28e1f645 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:54:12.455251 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2777975-5e87-4ce2-8edd-3aae28e1f645 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:54:12.456655 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 646/1296] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:54:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:54:12.462098 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade36f5-5739-4f96-8641-34e83d8ebc0e None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:54:12.462505 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade36f5-5739-4f96-8641-34e83d8ebc0e None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:54:12.462654 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade36f5-5739-4f96-8641-34e83d8ebc0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:54:12.479952 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-eade36f5-5739-4f96-8641-34e83d8ebc0e None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:54:12.481111 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-eade36f5-5739-4f96-8641-34e83d8ebc0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:54:12.551997 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 651/1297] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:54:12 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 14 20:54:12.583102 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2777975-5e87-4ce2-8edd-3aae28e1f645 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:54:12.682485 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2777975-5e87-4ce2-8edd-3aae28e1f645 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:54:12.715857 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73f3737-f057-4a3d-ab6b-ec4e50a14c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:54:12.716088 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f3737-f057-4a3d-ab6b-ec4e50a14c06 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:54:12.716354 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f3737-f057-4a3d-ab6b-ec4e50a14c06 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:54:12.716624 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f3737-f057-4a3d-ab6b-ec4e50a14c06 None admin] PATH_INFO: `/v3/services/placement` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:54:12.717269 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73f3737-f057-4a3d-ab6b-ec4e50a14c06 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:54:12.718792 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73f3737-f057-4a3d-ab6b-ec4e50a14c06 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:54:12.730440 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-c73f3737-f057-4a3d-ab6b-ec4e50a14c06 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 14 20:54:12.730440 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:54:12.730440 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 14 20:54:12.730440 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 14 20:54:12.730440 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 14 20:54:12.730440 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 14 20:54:12.730440 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 14 20:54:12.730440 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 20:54:12.730440 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 14 20:54:12.730440 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:54:12.730440 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 20:54:12.730440 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:54:12.730440 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:54:12.730440 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:54:12.730440 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:54:12.730440 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:54:12.730440 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:54:12.731781 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:54:12.731781 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:54:12.731781 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:54:12.731781 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:54:12.731781 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:54:12.731781 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:54:12.731781 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 14 20:54:12.731781 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_service(service_id) May 14 20:54:12.731781 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 14 20:54:12.731781 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 14 20:54:12.731781 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:54:12.731781 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:54:12.731781 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:54:12.731781 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:54:12.731781 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:54:12.731781 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:54:12.733003 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:54:12.733003 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:54:12.733003 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:54:12.733003 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:54:12.733003 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:54:12.733003 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:54:12.733003 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:54:12.733003 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:54:12.733003 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:54:12.733003 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:54:12.733003 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 14 20:54:12.733003 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 20:54:12.733003 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 14 20:54:12.733003 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:54:12.733003 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 647/1298] 10.222.0.52 () {56 vars in 1117 bytes} [Sat May 14 20:54:12 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 20:54:12.737762 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eade36f5-5739-4f96-8641-34e83d8ebc0e None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:54:12.835526 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eade36f5-5739-4f96-8641-34e83d8ebc0e None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:54:12.873934 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5969e4-92ed-4256-85fa-5edb50297ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:54:12.875662 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5969e4-92ed-4256-85fa-5edb50297ad2 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:54:12.876019 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5969e4-92ed-4256-85fa-5edb50297ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:54:12.876300 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5969e4-92ed-4256-85fa-5edb50297ad2 None admin] PATH_INFO: `/v3/services` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:54:12.877004 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5969e4-92ed-4256-85fa-5edb50297ad2 None admin] RBAC: Adding query filter params (name=placement) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:54:12.877556 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5969e4-92ed-4256-85fa-5edb50297ad2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:54:12.879766 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5969e4-92ed-4256-85fa-5edb50297ad2 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:54:12.885983 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 652/1299] 10.222.0.52 () {56 vars in 1116 bytes} [Sat May 14 20:54:12 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:54:12.892371 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73f3737-f057-4a3d-ab6b-ec4e50a14c06 None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:54:12.991463 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73f3737-f057-4a3d-ab6b-ec4e50a14c06 None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:54:13.023926 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d69e4d9-e8fc-4cc2-9bcc-1c75e95bd037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:54:13.024579 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69e4d9-e8fc-4cc2-9bcc-1c75e95bd037 None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:54:13.024863 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69e4d9-e8fc-4cc2-9bcc-1c75e95bd037 None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:54:13.025140 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69e4d9-e8fc-4cc2-9bcc-1c75e95bd037 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:54:13.025919 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d69e4d9-e8fc-4cc2-9bcc-1c75e95bd037 None admin] RBAC: Adding query filter params (interface=public, service_id=7888c9dd219b419fa6f4676a9e7e7ceb, region_id=RegionOne) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:54:13.026227 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d69e4d9-e8fc-4cc2-9bcc-1c75e95bd037 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:54:13.027614 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d69e4d9-e8fc-4cc2-9bcc-1c75e95bd037 None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:54:13.033204 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 648/1300] 10.222.0.52 () {56 vars in 1251 bytes} [Sat May 14 20:54:12 2022] GET /identity/v3/endpoints?service_id=7888c9dd219b419fa6f4676a9e7e7ceb&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:54:13.038818 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5969e4-92ed-4256-85fa-5edb50297ad2 None admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:54:13.134853 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5969e4-92ed-4256-85fa-5edb50297ad2 None admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:54:13.167252 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea15dc-fe2c-4224-ad92-ad6269197d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:54:13.167931 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea15dc-fe2c-4224-ad92-ad6269197d90 None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:54:13.168214 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea15dc-fe2c-4224-ad92-ad6269197d90 None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:54:13.168487 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea15dc-fe2c-4224-ad92-ad6269197d90 None admin] PATH_INFO: `/v3/services` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:54:13.169155 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ea15dc-fe2c-4224-ad92-ad6269197d90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:54:13.170513 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ea15dc-fe2c-4224-ad92-ad6269197d90 None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:54:13.177187 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 653/1301] 10.222.0.52 () {56 vars in 1087 bytes} [Sat May 14 20:54:13 2022] GET /identity/v3/services => generated 2191 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 20:54:15.429321 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec528a-f1e8-4844-8696-3c676a427f20 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:54:15.429834 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec528a-f1e8-4844-8696-3c676a427f20 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:54:15.429929 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec528a-f1e8-4844-8696-3c676a427f20 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:54:15.431264 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 649/1302] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 20:54:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 20:54:15.436367 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8590f70-ed63-4a19-86c2-0a4a5d1faf22 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:54:15.437538 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8590f70-ed63-4a19-86c2-0a4a5d1faf22 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:54:15.437538 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8590f70-ed63-4a19-86c2-0a4a5d1faf22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:54:15.454696 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-c8590f70-ed63-4a19-86c2-0a4a5d1faf22 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 20:54:15.455935 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c8590f70-ed63-4a19-86c2-0a4a5d1faf22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 20:54:15.520270 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 654/1303] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 20:54:15 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 20:54:15.544146 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec528a-f1e8-4844-8696-3c676a427f20 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:54:15.646108 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec528a-f1e8-4844-8696-3c676a427f20 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:54:15.678390 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6640e7dc-7e22-4ac4-8922-4ff46ccddd1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:54:15.679176 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6640e7dc-7e22-4ac4-8922-4ff46ccddd1c None admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:54:15.679546 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6640e7dc-7e22-4ac4-8922-4ff46ccddd1c None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:54:15.679765 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6640e7dc-7e22-4ac4-8922-4ff46ccddd1c None admin] PATH_INFO: `/v3/services/placement` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:54:15.680456 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6640e7dc-7e22-4ac4-8922-4ff46ccddd1c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:54:15.681856 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6640e7dc-7e22-4ac4-8922-4ff46ccddd1c None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:54:15.694563 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-6640e7dc-7e22-4ac4-8922-4ff46ccddd1c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 14 20:54:15.694563 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:54:15.694563 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 14 20:54:15.694563 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 14 20:54:15.694563 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 14 20:54:15.694563 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 14 20:54:15.694563 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 14 20:54:15.694563 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 20:54:15.694563 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 14 20:54:15.694563 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:54:15.694563 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 20:54:15.694563 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:54:15.694563 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 20:54:15.694563 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 20:54:15.694563 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 20:54:15.694563 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 20:54:15.694563 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 20:54:15.695847 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 20:54:15.695847 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 20:54:15.695847 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 20:54:15.695847 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 20:54:15.695847 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 20:54:15.695847 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 20:54:15.695847 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 14 20:54:15.695847 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_service(service_id) May 14 20:54:15.695847 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 14 20:54:15.695847 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 14 20:54:15.695847 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 20:54:15.695847 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 20:54:15.695847 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 20:54:15.695847 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 20:54:15.695847 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 20:54:15.695847 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 20:54:15.697152 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 20:54:15.697152 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 20:54:15.697152 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 20:54:15.697152 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 20:54:15.697152 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 20:54:15.697152 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 20:54:15.697152 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 20:54:15.697152 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 20:54:15.697152 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 20:54:15.697152 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 20:54:15.697152 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 14 20:54:15.697152 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 20:54:15.697152 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 14 20:54:15.697152 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 20:54:15.697152 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 650/1304] 10.222.0.52 () {56 vars in 1117 bytes} [Sat May 14 20:54:15 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 20:54:15.701870 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8590f70-ed63-4a19-86c2-0a4a5d1faf22 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:54:15.797855 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8590f70-ed63-4a19-86c2-0a4a5d1faf22 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:54:15.831076 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c210880f-605f-4445-ada5-ca8224bb3eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:54:15.831753 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c210880f-605f-4445-ada5-ca8224bb3eea None admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:54:15.832097 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c210880f-605f-4445-ada5-ca8224bb3eea None admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:54:15.832363 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c210880f-605f-4445-ada5-ca8224bb3eea None admin] PATH_INFO: `/v3/services` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:54:15.833047 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c210880f-605f-4445-ada5-ca8224bb3eea None admin] RBAC: Adding query filter params (name=placement) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 20:54:15.833350 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c210880f-605f-4445-ada5-ca8224bb3eea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:54:15.834692 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c210880f-605f-4445-ada5-ca8224bb3eea None admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:54:15.839594 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 655/1305] 10.222.0.52 () {56 vars in 1116 bytes} [Sat May 14 20:54:15 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 20:54:15.845555 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6640e7dc-7e22-4ac4-8922-4ff46ccddd1c None admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 20:54:15.942598 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6640e7dc-7e22-4ac4-8922-4ff46ccddd1c None admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 20:54:15.974718 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746c1bd9-6816-4e26-a330-2f751b480e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 20:54:15.975366 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c1bd9-6816-4e26-a330-2f751b480e1a None admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 20:54:15.975682 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c1bd9-6816-4e26-a330-2f751b480e1a None admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 20:54:15.975961 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c1bd9-6816-4e26-a330-2f751b480e1a None admin] PATH_INFO: `/v3/endpoints` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 20:54:15.976706 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746c1bd9-6816-4e26-a330-2f751b480e1a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 20:54:15.978129 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746c1bd9-6816-4e26-a330-2f751b480e1a None admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 20:54:16.074525 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 651/1306] 10.222.0.52 () {60 vars in 1144 bytes} [Sat May 14 20:54:15 2022] POST /identity/v3/endpoints => generated 331 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:00:43.353213 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c4ca21-9ce8-43e9-a03c-6a4679507557 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:00:43.353699 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c4ca21-9ce8-43e9-a03c-6a4679507557 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:00:43.353779 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c4ca21-9ce8-43e9-a03c-6a4679507557 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:00:43.360844 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392493b2-7bfe-46db-bb04-f0f1851cb40f None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:00:43.361557 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392493b2-7bfe-46db-bb04-f0f1851cb40f None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:00:43.361897 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392493b2-7bfe-46db-bb04-f0f1851cb40f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:00:43.363582 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 656/1307] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 21:00:43 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:00:43.446068 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-392493b2-7bfe-46db-bb04-f0f1851cb40f None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:00:43.447295 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-392493b2-7bfe-46db-bb04-f0f1851cb40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:00:43.555638 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 652/1308] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 21:00:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:00:43.604899 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c046dbd-14a4-4508-af56-d5f5f471d376 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:00:43.605392 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c046dbd-14a4-4508-af56-d5f5f471d376 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:00:43.605778 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c046dbd-14a4-4508-af56-d5f5f471d376 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:00:43.607228 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 657/1309] 10.222.0.52 () {54 vars in 964 bytes} [Sat May 14 21:00:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:00:43.614196 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ec959-a119-4bb6-a9a9-a3aefa807221 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:00:43.614491 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ec959-a119-4bb6-a9a9-a3aefa807221 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:00:43.614772 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ec959-a119-4bb6-a9a9-a3aefa807221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:00:43.693356 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-b35ec959-a119-4bb6-a9a9-a3aefa807221 None None] MFA Rules not processed for user `99ed32a6d699453bb7e088540e8fc980`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:00:43.694936 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b35ec959-a119-4bb6-a9a9-a3aefa807221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:00:43.785750 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 653/1310] 10.222.0.52 () {58 vars in 1061 bytes} [Sat May 14 21:00:43 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:00:43.795424 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c046dbd-14a4-4508-af56-d5f5f471d376 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:00:43.797261 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-2c046dbd-14a4-4508-af56-d5f5f471d376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:00:43.928870 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c046dbd-14a4-4508-af56-d5f5f471d376 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:00:44.006952 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33acfb-faec-467c-b6cc-2d31ce62860d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:00:44.007887 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33acfb-faec-467c-b6cc-2d31ce62860d service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:00:44.008352 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33acfb-faec-467c-b6cc-2d31ce62860d service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:00:44.008786 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33acfb-faec-467c-b6cc-2d31ce62860d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:00:44.010612 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-1f33acfb-faec-467c-b6cc-2d31ce62860d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:00:44.127339 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f33acfb-faec-467c-b6cc-2d31ce62860d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:00:44.129115 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f33acfb-faec-467c-b6cc-2d31ce62860d service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:00:44.149294 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 658/1311] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:00:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:00:46.827583 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b4b7c-7121-405b-9505-33713275ff1a None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:00:46.828183 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b4b7c-7121-405b-9505-33713275ff1a None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:00:46.828183 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b4b7c-7121-405b-9505-33713275ff1a None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:00:46.831612 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 654/1312] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 21:00:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:00:46.837145 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182464a6-80dd-470b-a8f2-dbb338a78446 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:00:46.837682 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182464a6-80dd-470b-a8f2-dbb338a78446 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:00:46.837812 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182464a6-80dd-470b-a8f2-dbb338a78446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:00:46.927339 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-182464a6-80dd-470b-a8f2-dbb338a78446 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:00:46.930808 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-182464a6-80dd-470b-a8f2-dbb338a78446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:00:47.030772 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 659/1313] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 21:00:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:00:47.071247 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8b4b7c-7121-405b-9505-33713275ff1a None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:00:47.072833 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-4a8b4b7c-7121-405b-9505-33713275ff1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:00:47.177173 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8b4b7c-7121-405b-9505-33713275ff1a None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:00:47.252065 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e1b89-5c66-483e-bc5d-8ad752a79dfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:00:47.252803 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e1b89-5c66-483e-bc5d-8ad752a79dfa service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:00:47.253107 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e1b89-5c66-483e-bc5d-8ad752a79dfa service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:00:47.253387 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e1b89-5c66-483e-bc5d-8ad752a79dfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:00:47.255010 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-700e1b89-5c66-483e-bc5d-8ad752a79dfa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:00:47.365944 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700e1b89-5c66-483e-bc5d-8ad752a79dfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:00:47.367398 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700e1b89-5c66-483e-bc5d-8ad752a79dfa service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:00:47.387395 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 655/1314] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:00:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:00:50.200251 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f421ab-a573-43e6-99bd-8f47668e6e38 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:00:50.200806 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f421ab-a573-43e6-99bd-8f47668e6e38 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:00:50.200806 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f421ab-a573-43e6-99bd-8f47668e6e38 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:00:50.202793 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 660/1315] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 21:00:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:00:50.209088 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7285d7e-42b2-4117-8600-5ac24b996974 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:00:50.209546 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7285d7e-42b2-4117-8600-5ac24b996974 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:00:50.209662 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7285d7e-42b2-4117-8600-5ac24b996974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:00:50.286848 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-c7285d7e-42b2-4117-8600-5ac24b996974 None None] MFA Rules not processed for user `1f1ad598c0eb49f9a6bda831fba1c4e6`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:00:50.288137 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c7285d7e-42b2-4117-8600-5ac24b996974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:00:50.380488 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 656/1316] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 21:00:50 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:00:50.420774 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f421ab-a573-43e6-99bd-8f47668e6e38 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:00:50.422307 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-15f421ab-a573-43e6-99bd-8f47668e6e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:00:50.527939 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f421ab-a573-43e6-99bd-8f47668e6e38 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:00:50.599685 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf41a73-8d4f-4230-9c9b-2d22e1a17120 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:00:50.600329 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf41a73-8d4f-4230-9c9b-2d22e1a17120 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:00:50.600610 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf41a73-8d4f-4230-9c9b-2d22e1a17120 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:00:50.600886 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf41a73-8d4f-4230-9c9b-2d22e1a17120 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:00:50.602557 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-acf41a73-8d4f-4230-9c9b-2d22e1a17120 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:00:50.706258 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf41a73-8d4f-4230-9c9b-2d22e1a17120 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:00:50.707747 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf41a73-8d4f-4230-9c9b-2d22e1a17120 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:00:50.725657 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 661/1317] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:00:50 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:00:53.807584 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55275646-22cf-420c-abff-74d33e7e7c15 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:00:53.808098 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55275646-22cf-420c-abff-74d33e7e7c15 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:00:53.808098 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55275646-22cf-420c-abff-74d33e7e7c15 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:00:53.809473 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 657/1318] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 21:00:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:00:53.815161 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa8e45-c8d0-4ea0-8005-826c8e81200d None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:00:53.815596 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa8e45-c8d0-4ea0-8005-826c8e81200d None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:00:53.815741 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa8e45-c8d0-4ea0-8005-826c8e81200d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:00:53.878355 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-cdfa8e45-c8d0-4ea0-8005-826c8e81200d None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:00:53.879588 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-cdfa8e45-c8d0-4ea0-8005-826c8e81200d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:00:53.971673 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 662/1319] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 21:00:53 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:00:54.027629 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15056d8d-e013-4812-b60b-2aa8309b2dbc None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:00:54.027915 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15056d8d-e013-4812-b60b-2aa8309b2dbc None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:00:54.028189 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15056d8d-e013-4812-b60b-2aa8309b2dbc None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:00:54.029577 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 658/1320] 10.222.0.52 () {54 vars in 964 bytes} [Sat May 14 21:00:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:00:54.035828 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb209a3-61c6-43ae-9f97-2a5bb2ef3e89 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:00:54.036099 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb209a3-61c6-43ae-9f97-2a5bb2ef3e89 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:00:54.036372 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb209a3-61c6-43ae-9f97-2a5bb2ef3e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:00:54.112627 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-afb209a3-61c6-43ae-9f97-2a5bb2ef3e89 None None] MFA Rules not processed for user `99ed32a6d699453bb7e088540e8fc980`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:00:54.113727 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-afb209a3-61c6-43ae-9f97-2a5bb2ef3e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:00:54.185631 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 663/1321] 10.222.0.52 () {58 vars in 1061 bytes} [Sat May 14 21:00:54 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:00:54.194779 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15056d8d-e013-4812-b60b-2aa8309b2dbc None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:00:54.196400 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-15056d8d-e013-4812-b60b-2aa8309b2dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:00:54.296286 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15056d8d-e013-4812-b60b-2aa8309b2dbc None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:00:54.366238 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811f5fb8-d438-4e46-99f7-f22e047bc52a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:00:54.366803 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f5fb8-d438-4e46-99f7-f22e047bc52a service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:00:54.367084 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f5fb8-d438-4e46-99f7-f22e047bc52a service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:00:54.367358 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f5fb8-d438-4e46-99f7-f22e047bc52a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:00:54.369019 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-811f5fb8-d438-4e46-99f7-f22e047bc52a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:00:54.474888 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811f5fb8-d438-4e46-99f7-f22e047bc52a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:00:54.476350 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811f5fb8-d438-4e46-99f7-f22e047bc52a service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:00:54.494032 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 659/1322] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:00:54 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:00:58.156008 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b148670-fd6b-4f02-9e36-e5589c0ef346 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:00:58.156569 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b148670-fd6b-4f02-9e36-e5589c0ef346 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:00:58.156569 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b148670-fd6b-4f02-9e36-e5589c0ef346 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:00:58.158161 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 664/1323] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 21:00:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:00:58.163469 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1678ca8b-713c-4cb5-a7df-70965932704d None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:00:58.163979 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1678ca8b-713c-4cb5-a7df-70965932704d None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:00:58.164089 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1678ca8b-713c-4cb5-a7df-70965932704d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:00:58.228808 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-1678ca8b-713c-4cb5-a7df-70965932704d None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:00:58.229938 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-1678ca8b-713c-4cb5-a7df-70965932704d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:00:58.323570 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 660/1324] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 21:00:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:00:58.360770 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b148670-fd6b-4f02-9e36-e5589c0ef346 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:00:58.362423 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-1b148670-fd6b-4f02-9e36-e5589c0ef346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:00:58.462267 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b148670-fd6b-4f02-9e36-e5589c0ef346 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:00:58.533706 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5048c968-00ae-40c7-b8b4-4ab4593768d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:00:58.534255 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5048c968-00ae-40c7-b8b4-4ab4593768d7 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:00:58.534530 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5048c968-00ae-40c7-b8b4-4ab4593768d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:00:58.534797 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5048c968-00ae-40c7-b8b4-4ab4593768d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:00:58.536442 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-5048c968-00ae-40c7-b8b4-4ab4593768d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:00:58.641884 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5048c968-00ae-40c7-b8b4-4ab4593768d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:00:58.643322 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5048c968-00ae-40c7-b8b4-4ab4593768d7 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:00:58.661128 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 665/1325] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:00:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:01:01.003290 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e093eb2-db2b-4988-94b0-eb3106caa7a4 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:01:01.003941 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e093eb2-db2b-4988-94b0-eb3106caa7a4 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:01:01.003941 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e093eb2-db2b-4988-94b0-eb3106caa7a4 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:01:01.005206 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 661/1326] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 21:01:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:01:01.010355 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bcc2c6-033e-410b-96cb-93dc8129bd67 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:01:01.010789 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bcc2c6-033e-410b-96cb-93dc8129bd67 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:01:01.010917 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bcc2c6-033e-410b-96cb-93dc8129bd67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:01:01.074757 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-c1bcc2c6-033e-410b-96cb-93dc8129bd67 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:01:01.076065 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c1bcc2c6-033e-410b-96cb-93dc8129bd67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:01:01.171388 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 666/1327] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 21:01:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:01:01.208671 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e093eb2-db2b-4988-94b0-eb3106caa7a4 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:01:01.210262 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-2e093eb2-db2b-4988-94b0-eb3106caa7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:01:01.325237 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e093eb2-db2b-4988-94b0-eb3106caa7a4 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:01:01.400131 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf6bfe9-e440-46d6-9719-c9d79895d61f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:01:01.400830 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6bfe9-e440-46d6-9719-c9d79895d61f service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:01:01.401112 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6bfe9-e440-46d6-9719-c9d79895d61f service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:01:01.401382 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6bfe9-e440-46d6-9719-c9d79895d61f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:01:01.403017 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-3cf6bfe9-e440-46d6-9719-c9d79895d61f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:01:01.511282 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf6bfe9-e440-46d6-9719-c9d79895d61f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:01:01.512686 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf6bfe9-e440-46d6-9719-c9d79895d61f service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:01:01.530208 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 662/1328] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:01:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:01:03.867882 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83781c1c-06af-4a89-837d-5e1830d1f2f3 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:01:03.868448 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83781c1c-06af-4a89-837d-5e1830d1f2f3 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:01:03.868448 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83781c1c-06af-4a89-837d-5e1830d1f2f3 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:01:03.869960 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 667/1329] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 21:01:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:01:03.875626 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d10353f-8a93-4c55-9974-2c4e44aed4b3 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:01:03.876710 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d10353f-8a93-4c55-9974-2c4e44aed4b3 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:01:03.876994 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d10353f-8a93-4c55-9974-2c4e44aed4b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:01:03.941606 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-0d10353f-8a93-4c55-9974-2c4e44aed4b3 None None] MFA Rules not processed for user `1f1ad598c0eb49f9a6bda831fba1c4e6`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:01:03.942898 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-0d10353f-8a93-4c55-9974-2c4e44aed4b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:01:04.038249 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 663/1330] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 21:01:03 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:01:04.076995 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83781c1c-06af-4a89-837d-5e1830d1f2f3 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:01:04.078538 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-83781c1c-06af-4a89-837d-5e1830d1f2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:01:04.180504 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83781c1c-06af-4a89-837d-5e1830d1f2f3 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:01:04.252923 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda377e2-6ae3-4965-b611-ee34f85e3fe6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:01:04.253577 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda377e2-6ae3-4965-b611-ee34f85e3fe6 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:01:04.253859 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda377e2-6ae3-4965-b611-ee34f85e3fe6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:01:04.254134 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda377e2-6ae3-4965-b611-ee34f85e3fe6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:01:04.255809 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-cda377e2-6ae3-4965-b611-ee34f85e3fe6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:01:04.363247 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda377e2-6ae3-4965-b611-ee34f85e3fe6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:01:04.364802 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda377e2-6ae3-4965-b611-ee34f85e3fe6 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:01:04.383359 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 668/1331] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:01:04 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:01:07.250293 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd7483-b2e9-4c15-8d7a-27a9ae33cb00 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:01:07.251826 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd7483-b2e9-4c15-8d7a-27a9ae33cb00 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:01:07.251987 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd7483-b2e9-4c15-8d7a-27a9ae33cb00 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:01:07.253240 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 664/1332] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 21:01:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:01:07.258538 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d924e-f3a7-4345-bb38-44db8f621aa1 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:01:07.260074 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d924e-f3a7-4345-bb38-44db8f621aa1 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:01:07.260074 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d924e-f3a7-4345-bb38-44db8f621aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:01:07.337545 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-353d924e-f3a7-4345-bb38-44db8f621aa1 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:01:07.338754 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-353d924e-f3a7-4345-bb38-44db8f621aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:01:07.436884 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 669/1333] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 21:01:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:01:07.477280 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fd7483-b2e9-4c15-8d7a-27a9ae33cb00 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:01:07.478810 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-64fd7483-b2e9-4c15-8d7a-27a9ae33cb00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:01:07.586159 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fd7483-b2e9-4c15-8d7a-27a9ae33cb00 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:01:07.664277 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cc326a-4ba1-4583-87fa-8e427392ca24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:01:07.665072 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc326a-4ba1-4583-87fa-8e427392ca24 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:01:07.665382 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc326a-4ba1-4583-87fa-8e427392ca24 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:01:07.665654 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc326a-4ba1-4583-87fa-8e427392ca24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:01:07.667297 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-95cc326a-4ba1-4583-87fa-8e427392ca24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:01:07.781198 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cc326a-4ba1-4583-87fa-8e427392ca24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:01:07.783434 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cc326a-4ba1-4583-87fa-8e427392ca24 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:01:07.800998 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 665/1334] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:01:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:01:10.164024 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e676e1a-1f85-4818-b93f-0671cd10c516 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:01:10.174288 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e676e1a-1f85-4818-b93f-0671cd10c516 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:01:10.174288 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e676e1a-1f85-4818-b93f-0671cd10c516 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:01:10.174288 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 670/1335] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 21:01:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:01:10.174589 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f5466-026f-45aa-b7d7-a797008bffb7 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:01:10.174589 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f5466-026f-45aa-b7d7-a797008bffb7 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:01:10.174589 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f5466-026f-45aa-b7d7-a797008bffb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:01:10.236853 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-098f5466-026f-45aa-b7d7-a797008bffb7 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:01:10.238007 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-098f5466-026f-45aa-b7d7-a797008bffb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:01:10.335301 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 666/1336] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 21:01:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:01:10.377137 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e676e1a-1f85-4818-b93f-0671cd10c516 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:01:10.378731 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-5e676e1a-1f85-4818-b93f-0671cd10c516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:01:10.478586 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e676e1a-1f85-4818-b93f-0671cd10c516 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:01:10.551285 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c59f469-d909-47c9-be90-8e72fdf89d23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:01:10.551869 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c59f469-d909-47c9-be90-8e72fdf89d23 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:01:10.552202 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c59f469-d909-47c9-be90-8e72fdf89d23 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:01:10.552481 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c59f469-d909-47c9-be90-8e72fdf89d23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:01:10.554108 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-1c59f469-d909-47c9-be90-8e72fdf89d23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:01:10.660021 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c59f469-d909-47c9-be90-8e72fdf89d23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:01:10.662194 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c59f469-d909-47c9-be90-8e72fdf89d23 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:01:10.680009 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 671/1337] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:01:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:01:13.494227 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0df242-9fce-4c7a-97a8-91e126f7ce82 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:01:13.494755 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0df242-9fce-4c7a-97a8-91e126f7ce82 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:01:13.494755 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0df242-9fce-4c7a-97a8-91e126f7ce82 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:01:13.496153 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 667/1338] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 21:01:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:01:13.502042 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe305679-ccc7-4660-8285-824ad154183d None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:01:13.502470 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe305679-ccc7-4660-8285-824ad154183d None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:01:13.502593 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe305679-ccc7-4660-8285-824ad154183d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:01:13.568896 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-fe305679-ccc7-4660-8285-824ad154183d None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:01:13.570135 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-fe305679-ccc7-4660-8285-824ad154183d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:01:13.663904 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 672/1339] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 21:01:13 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:01:13.700776 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0df242-9fce-4c7a-97a8-91e126f7ce82 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:01:13.704186 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-fb0df242-9fce-4c7a-97a8-91e126f7ce82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:01:13.812792 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0df242-9fce-4c7a-97a8-91e126f7ce82 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:01:13.817087 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b27b69d-e474-48aa-8eab-9fe4cf35b0b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:01:13.817733 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27b69d-e474-48aa-8eab-9fe4cf35b0b5 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:01:13.818020 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27b69d-e474-48aa-8eab-9fe4cf35b0b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:01:13.818298 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27b69d-e474-48aa-8eab-9fe4cf35b0b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:01:13.820095 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-5b27b69d-e474-48aa-8eab-9fe4cf35b0b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:01:13.919280 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b27b69d-e474-48aa-8eab-9fe4cf35b0b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:01:13.920752 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b27b69d-e474-48aa-8eab-9fe4cf35b0b5 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:01:13.941647 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 668/1340] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:01:13 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:01:18.587821 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b21208-6bad-430e-b2ca-f60b80c91a59 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:01:18.588334 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b21208-6bad-430e-b2ca-f60b80c91a59 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:01:18.588334 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b21208-6bad-430e-b2ca-f60b80c91a59 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:01:18.589673 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 673/1341] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 21:01:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:01:18.596171 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c8427-719b-46a3-a69f-3ca45fd10564 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:01:18.596610 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c8427-719b-46a3-a69f-3ca45fd10564 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:01:18.596714 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c8427-719b-46a3-a69f-3ca45fd10564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:01:18.642363 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-2e6c8427-719b-46a3-a69f-3ca45fd10564 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:01:18.643595 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-2e6c8427-719b-46a3-a69f-3ca45fd10564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:01:18.717918 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 669/1342] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 21:01:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:01:18.759128 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b21208-6bad-430e-b2ca-f60b80c91a59 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:01:18.771419 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b21208-6bad-430e-b2ca-f60b80c91a59 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:01:18.775002 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979963df-6493-45c7-9562-e56cd937d58b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:01:18.775736 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979963df-6493-45c7-9562-e56cd937d58b service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:01:18.776090 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979963df-6493-45c7-9562-e56cd937d58b service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:01:18.776454 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979963df-6493-45c7-9562-e56cd937d58b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:01:18.786068 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979963df-6493-45c7-9562-e56cd937d58b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:01:18.787609 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979963df-6493-45c7-9562-e56cd937d58b service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:01:18.796996 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 674/1343] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:01:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:01:22.117318 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cef562-f300-4bf0-85c1-b2d7532900e8 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:01:22.117832 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cef562-f300-4bf0-85c1-b2d7532900e8 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:01:22.117832 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cef562-f300-4bf0-85c1-b2d7532900e8 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:01:22.119149 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 670/1344] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 21:01:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:01:22.124467 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981daab6-8375-4448-b31a-3f27ea6d2cb0 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:01:22.124876 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981daab6-8375-4448-b31a-3f27ea6d2cb0 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:01:22.125134 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981daab6-8375-4448-b31a-3f27ea6d2cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:01:22.152607 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-981daab6-8375-4448-b31a-3f27ea6d2cb0 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:01:22.153799 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-981daab6-8375-4448-b31a-3f27ea6d2cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:01:22.161919 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 675/1345] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 21:01:22 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:01:22.200462 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cef562-f300-4bf0-85c1-b2d7532900e8 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:01:22.211898 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cef562-f300-4bf0-85c1-b2d7532900e8 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:01:22.215451 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94001f21-1fdf-460a-b616-0643998b1700 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:01:22.216119 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94001f21-1fdf-460a-b616-0643998b1700 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:01:22.216402 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94001f21-1fdf-460a-b616-0643998b1700 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:01:22.216675 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94001f21-1fdf-460a-b616-0643998b1700 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:01:22.226390 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94001f21-1fdf-460a-b616-0643998b1700 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:01:22.227969 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94001f21-1fdf-460a-b616-0643998b1700 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:01:22.238362 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 671/1346] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:01:22 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:01:26.705325 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087781de-45b6-4b0a-b487-97d9095e75d7 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:01:26.707358 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087781de-45b6-4b0a-b487-97d9095e75d7 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:01:26.707358 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087781de-45b6-4b0a-b487-97d9095e75d7 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:01:26.707358 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 676/1347] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 21:01:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:01:26.712461 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28583323-d826-4a32-981e-96a6d265f09c None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:01:26.712880 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28583323-d826-4a32-981e-96a6d265f09c None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:01:26.713177 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28583323-d826-4a32-981e-96a6d265f09c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:01:26.731953 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-28583323-d826-4a32-981e-96a6d265f09c None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:01:26.733151 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-28583323-d826-4a32-981e-96a6d265f09c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:01:26.742412 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 672/1348] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 21:01:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:01:26.780476 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087781de-45b6-4b0a-b487-97d9095e75d7 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:01:26.791699 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087781de-45b6-4b0a-b487-97d9095e75d7 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:01:26.795175 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7c4ede-e03f-4179-b65b-637a3a18ab7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:01:26.795840 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c4ede-e03f-4179-b65b-637a3a18ab7c service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:01:26.796121 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c4ede-e03f-4179-b65b-637a3a18ab7c service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:01:26.796395 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c4ede-e03f-4179-b65b-637a3a18ab7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:01:26.805954 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7c4ede-e03f-4179-b65b-637a3a18ab7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:01:26.807377 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7c4ede-e03f-4179-b65b-637a3a18ab7c service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:01:26.816961 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 677/1349] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:01:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:01:32.303751 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a6bbb-9fce-4a0f-85f6-fa5b9a628ee5 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:01:32.304303 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a6bbb-9fce-4a0f-85f6-fa5b9a628ee5 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:01:32.304303 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a6bbb-9fce-4a0f-85f6-fa5b9a628ee5 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:01:32.305933 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 673/1350] 10.222.0.52 () {54 vars in 921 bytes} [Sat May 14 21:01:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:01:32.311071 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6758b0f5-41ef-4f64-80a1-a4621f5c434d None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:01:32.311540 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6758b0f5-41ef-4f64-80a1-a4621f5c434d None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:01:32.311687 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6758b0f5-41ef-4f64-80a1-a4621f5c434d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:01:32.395307 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-6758b0f5-41ef-4f64-80a1-a4621f5c434d None None] MFA Rules not processed for user `0812ae67e44d483baf2dbb1a5332a1d7`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:01:32.396628 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-6758b0f5-41ef-4f64-80a1-a4621f5c434d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:01:32.485221 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 678/1351] 10.222.0.52 () {58 vars in 1018 bytes} [Sat May 14 21:01:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:01:36.974916 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c204388-1cc7-453f-968e-959856282167 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:01:36.975421 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c204388-1cc7-453f-968e-959856282167 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:01:36.975421 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c204388-1cc7-453f-968e-959856282167 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:01:36.976967 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 674/1352] 10.222.0.52 () {54 vars in 921 bytes} [Sat May 14 21:01:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:01:36.983800 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5545109f-efcb-4bd7-a836-170ae3a78fc6 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:01:36.984726 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5545109f-efcb-4bd7-a836-170ae3a78fc6 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:01:36.985167 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5545109f-efcb-4bd7-a836-170ae3a78fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:01:37.004952 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-5545109f-efcb-4bd7-a836-170ae3a78fc6 None None] MFA Rules not processed for user `0812ae67e44d483baf2dbb1a5332a1d7`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:01:37.006162 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-5545109f-efcb-4bd7-a836-170ae3a78fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:01:37.014958 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 679/1353] 10.222.0.52 () {58 vars in 1018 bytes} [Sat May 14 21:01:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:01:38.838279 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b98dc0-13d1-46ee-b13f-1fd68dd5a87d None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:01:38.838885 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b98dc0-13d1-46ee-b13f-1fd68dd5a87d None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:01:38.839055 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b98dc0-13d1-46ee-b13f-1fd68dd5a87d None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:01:38.841575 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 675/1354] 10.222.0.52 () {54 vars in 921 bytes} [Sat May 14 21:01:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:01:38.846286 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5f7e3-fa90-47ea-b075-c1607c42737d None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:01:38.846763 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5f7e3-fa90-47ea-b075-c1607c42737d None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:01:38.846973 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5f7e3-fa90-47ea-b075-c1607c42737d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:01:38.865790 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-63c5f7e3-fa90-47ea-b075-c1607c42737d None None] MFA Rules not processed for user `0812ae67e44d483baf2dbb1a5332a1d7`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:01:38.867011 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-63c5f7e3-fa90-47ea-b075-c1607c42737d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:01:38.875891 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 680/1355] 10.222.0.52 () {58 vars in 1018 bytes} [Sat May 14 21:01:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:01:42.765156 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89d4c7-e955-467c-a134-f0a589f4fd64 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:01:42.765705 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89d4c7-e955-467c-a134-f0a589f4fd64 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:01:42.766049 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89d4c7-e955-467c-a134-f0a589f4fd64 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:01:42.767577 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 676/1356] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 21:01:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:01:42.772609 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d14efe0-394a-4009-8dd3-aa6ab257757b None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:01:42.773073 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d14efe0-394a-4009-8dd3-aa6ab257757b None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:01:42.773185 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d14efe0-394a-4009-8dd3-aa6ab257757b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:01:42.791748 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-6d14efe0-394a-4009-8dd3-aa6ab257757b None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:01:42.792939 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-6d14efe0-394a-4009-8dd3-aa6ab257757b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:01:42.801907 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 681/1357] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 21:01:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:01:42.853173 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff9e4e-a62f-49a2-84cb-fb92defa2085 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:01:42.854335 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff9e4e-a62f-49a2-84cb-fb92defa2085 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:01:42.854625 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff9e4e-a62f-49a2-84cb-fb92defa2085 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:01:42.856497 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 677/1358] 10.222.0.52 () {54 vars in 961 bytes} [Sat May 14 21:01:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:01:42.863005 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a270d3a-91e0-45d6-aa57-ff621eb2b839 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:01:42.863440 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a270d3a-91e0-45d6-aa57-ff621eb2b839 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:01:42.863849 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a270d3a-91e0-45d6-aa57-ff621eb2b839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:01:42.930793 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-4a270d3a-91e0-45d6-aa57-ff621eb2b839 None None] MFA Rules not processed for user `0f1b0e2b025d4eceaa90e1616d0a9db8`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:01:42.932172 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-4a270d3a-91e0-45d6-aa57-ff621eb2b839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:01:43.016191 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 682/1359] 10.222.0.52 () {58 vars in 1058 bytes} [Sat May 14 21:01:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:01:43.024526 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aff9e4e-a62f-49a2-84cb-fb92defa2085 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:01:43.039330 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aff9e4e-a62f-49a2-84cb-fb92defa2085 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:01:43.044793 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac12ed56-6e2b-44c5-ae8e-730c33d20762 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:01:43.045428 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac12ed56-6e2b-44c5-ae8e-730c33d20762 service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:01:43.045713 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac12ed56-6e2b-44c5-ae8e-730c33d20762 service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:01:43.045992 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac12ed56-6e2b-44c5-ae8e-730c33d20762 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:01:43.054780 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac12ed56-6e2b-44c5-ae8e-730c33d20762 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:01:43.056443 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac12ed56-6e2b-44c5-ae8e-730c33d20762 service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:01:43.066586 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 678/1360] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:01:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:01:45.607382 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47281c28-bcc5-4956-9c95-a3223f4d2b7b None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:01:45.607951 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47281c28-bcc5-4956-9c95-a3223f4d2b7b None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:01:45.608096 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47281c28-bcc5-4956-9c95-a3223f4d2b7b None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:01:45.610461 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 683/1361] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 21:01:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:01:45.615931 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78eeb62-4fea-49a7-986f-2ead28e29df3 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:01:45.616360 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78eeb62-4fea-49a7-986f-2ead28e29df3 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:01:45.616536 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78eeb62-4fea-49a7-986f-2ead28e29df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:01:45.635191 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-d78eeb62-4fea-49a7-986f-2ead28e29df3 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:01:45.636412 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-d78eeb62-4fea-49a7-986f-2ead28e29df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:01:45.644712 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 679/1362] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 21:01:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:01:45.689626 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47281c28-bcc5-4956-9c95-a3223f4d2b7b None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:01:45.703792 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47281c28-bcc5-4956-9c95-a3223f4d2b7b None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:01:45.709158 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a0bbde-be2a-4711-a785-c31a1e1686e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:01:45.709777 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0bbde-be2a-4711-a785-c31a1e1686e7 service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:01:45.710055 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0bbde-be2a-4711-a785-c31a1e1686e7 service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:01:45.710329 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0bbde-be2a-4711-a785-c31a1e1686e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:01:45.720962 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a0bbde-be2a-4711-a785-c31a1e1686e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:01:45.722540 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a0bbde-be2a-4711-a785-c31a1e1686e7 service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:01:45.743860 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 684/1363] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:01:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:01:48.520115 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25091d9d-ac4b-4a9f-9c5c-8d5a8150b83d None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:01:48.520663 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25091d9d-ac4b-4a9f-9c5c-8d5a8150b83d None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:01:48.520663 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25091d9d-ac4b-4a9f-9c5c-8d5a8150b83d None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:01:48.522378 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 680/1364] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 21:01:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:01:48.528019 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f19785-93ed-4c47-99d7-7ebfb6d3fdde None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:01:48.528798 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f19785-93ed-4c47-99d7-7ebfb6d3fdde None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:01:48.529252 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f19785-93ed-4c47-99d7-7ebfb6d3fdde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:01:48.548520 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-f8f19785-93ed-4c47-99d7-7ebfb6d3fdde None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:01:48.549648 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-f8f19785-93ed-4c47-99d7-7ebfb6d3fdde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:01:48.557681 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 685/1365] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 21:01:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:01:48.604159 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b2da5-5316-47c5-a02a-960ef6371413 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:01:48.604445 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b2da5-5316-47c5-a02a-960ef6371413 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:01:48.604979 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b2da5-5316-47c5-a02a-960ef6371413 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:01:48.606410 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 681/1366] 10.222.0.52 () {54 vars in 961 bytes} [Sat May 14 21:01:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:01:48.612699 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c1fe1-2378-4301-b1d6-2dd78fb5a1e7 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:01:48.612991 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c1fe1-2378-4301-b1d6-2dd78fb5a1e7 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:01:48.613274 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c1fe1-2378-4301-b1d6-2dd78fb5a1e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:01:48.631523 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-ce6c1fe1-2378-4301-b1d6-2dd78fb5a1e7 None None] MFA Rules not processed for user `0f1b0e2b025d4eceaa90e1616d0a9db8`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:01:48.632707 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ce6c1fe1-2378-4301-b1d6-2dd78fb5a1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:01:48.641779 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 686/1367] 10.222.0.52 () {58 vars in 1058 bytes} [Sat May 14 21:01:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:01:48.649265 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b2da5-5316-47c5-a02a-960ef6371413 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:01:48.664182 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b2da5-5316-47c5-a02a-960ef6371413 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:01:48.669774 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c59b04-81b2-46fd-994e-855a33aad50c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:01:48.670408 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c59b04-81b2-46fd-994e-855a33aad50c service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:01:48.670690 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c59b04-81b2-46fd-994e-855a33aad50c service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:01:48.670970 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c59b04-81b2-46fd-994e-855a33aad50c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:01:48.679093 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c59b04-81b2-46fd-994e-855a33aad50c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:01:48.680715 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c59b04-81b2-46fd-994e-855a33aad50c service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:01:48.690714 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 682/1368] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:01:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:01:51.428326 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df42e2-8321-4095-babb-52c3f03ddf2c None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:01:51.428326 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df42e2-8321-4095-babb-52c3f03ddf2c None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:01:51.430090 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df42e2-8321-4095-babb-52c3f03ddf2c None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:01:51.430636 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 687/1369] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 21:01:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:01:51.444863 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab23dd1-18eb-43e7-a187-4171e96b79cb None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:01:51.445852 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab23dd1-18eb-43e7-a187-4171e96b79cb None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:01:51.446334 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab23dd1-18eb-43e7-a187-4171e96b79cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:01:51.495117 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-bab23dd1-18eb-43e7-a187-4171e96b79cb None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:01:51.496650 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-bab23dd1-18eb-43e7-a187-4171e96b79cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:01:51.506972 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 683/1370] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 21:01:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:01:51.555629 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df42e2-8321-4095-babb-52c3f03ddf2c None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:01:51.571464 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df42e2-8321-4095-babb-52c3f03ddf2c None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:01:51.577762 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2844e45-0b29-443d-85f2-223f4877150f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:01:51.578774 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2844e45-0b29-443d-85f2-223f4877150f service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:01:51.579270 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2844e45-0b29-443d-85f2-223f4877150f service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:01:51.579793 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2844e45-0b29-443d-85f2-223f4877150f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:01:51.589388 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2844e45-0b29-443d-85f2-223f4877150f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:01:51.591372 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2844e45-0b29-443d-85f2-223f4877150f service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:01:51.614794 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 688/1371] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:01:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:01:54.472258 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a47ef-06cb-4121-880c-7b8ae6f530f1 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:01:54.480135 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a47ef-06cb-4121-880c-7b8ae6f530f1 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:01:54.480135 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a47ef-06cb-4121-880c-7b8ae6f530f1 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:01:54.482003 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d553c1-4e1f-4ec0-8a71-3f6a973b12f4 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:01:54.486316 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d553c1-4e1f-4ec0-8a71-3f6a973b12f4 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:01:54.486316 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d553c1-4e1f-4ec0-8a71-3f6a973b12f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:01:54.486532 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 684/1372] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 21:01:54 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:01:54.510428 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-f6d553c1-4e1f-4ec0-8a71-3f6a973b12f4 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:01:54.512109 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-f6d553c1-4e1f-4ec0-8a71-3f6a973b12f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:01:54.520620 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 689/1373] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 21:01:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:01:54.567137 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75a47ef-06cb-4121-880c-7b8ae6f530f1 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:01:54.582225 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75a47ef-06cb-4121-880c-7b8ae6f530f1 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:01:54.587813 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001fd65c-25b7-4d19-8174-83fc6ef3ceff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:01:54.588475 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001fd65c-25b7-4d19-8174-83fc6ef3ceff service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:01:54.588760 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001fd65c-25b7-4d19-8174-83fc6ef3ceff service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:01:54.589074 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001fd65c-25b7-4d19-8174-83fc6ef3ceff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:01:54.600409 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001fd65c-25b7-4d19-8174-83fc6ef3ceff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:01:54.605204 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001fd65c-25b7-4d19-8174-83fc6ef3ceff service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:01:54.616194 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 685/1374] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:01:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:01:55.417393 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f7368-6fcc-41f8-8c6f-7ded258c96aa None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:01:55.434247 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f7368-6fcc-41f8-8c6f-7ded258c96aa None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:01:55.434247 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f7368-6fcc-41f8-8c6f-7ded258c96aa None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:01:55.434247 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 690/1375] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 21:01:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:01:55.434523 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d395b-10fc-405d-88f1-643bf7fbee9f None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:01:55.434523 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d395b-10fc-405d-88f1-643bf7fbee9f None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:01:55.434523 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d395b-10fc-405d-88f1-643bf7fbee9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:01:55.448275 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-174d395b-10fc-405d-88f1-643bf7fbee9f None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:01:55.449500 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-174d395b-10fc-405d-88f1-643bf7fbee9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:01:55.457789 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 686/1376] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 21:01:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:01:55.746474 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afdb52f-f733-4d0e-83bd-142a291d3822 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:01:55.746982 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afdb52f-f733-4d0e-83bd-142a291d3822 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:01:55.747095 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afdb52f-f733-4d0e-83bd-142a291d3822 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:01:55.748394 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 691/1377] 10.222.0.52 () {54 vars in 963 bytes} [Sat May 14 21:01:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:01:55.754485 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10dda02-8abd-4a5c-8087-bfdc934b23b1 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:01:55.755006 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10dda02-8abd-4a5c-8087-bfdc934b23b1 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:01:55.755006 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10dda02-8abd-4a5c-8087-bfdc934b23b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:01:55.809900 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-d10dda02-8abd-4a5c-8087-bfdc934b23b1 None None] MFA Rules not processed for user `198271d1c0d44cb58bace41a65f4b94c`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:01:55.811115 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-d10dda02-8abd-4a5c-8087-bfdc934b23b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:01:55.872937 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 687/1378] 10.222.0.52 () {58 vars in 1060 bytes} [Sat May 14 21:01:55 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:01:55.881027 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afdb52f-f733-4d0e-83bd-142a291d3822 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:01:55.893220 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afdb52f-f733-4d0e-83bd-142a291d3822 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:01:55.896994 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d5922-f507-4525-89eb-65c3ed22c8fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198271d1c0d44cb58bace41a65f4b94c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:01:55.897729 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d5922-f507-4525-89eb-65c3ed22c8fe service cinder] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:01:55.898109 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d5922-f507-4525-89eb-65c3ed22c8fe service cinder] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:01:55.898481 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d5922-f507-4525-89eb-65c3ed22c8fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:01:55.908092 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1d5922-f507-4525-89eb-65c3ed22c8fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:01:55.909615 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1d5922-f507-4525-89eb-65c3ed22c8fe service cinder] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:01:55.923185 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 692/1379] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:01:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:01:57.540703 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b384a2e0-2409-47a0-ad79-74fad7dfdf04 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:01:57.541319 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b384a2e0-2409-47a0-ad79-74fad7dfdf04 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:01:57.541319 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b384a2e0-2409-47a0-ad79-74fad7dfdf04 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:01:57.542712 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 688/1380] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 21:01:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:01:57.548380 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecbbc3e-5732-48f1-af4d-8beaf62a983f None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:01:57.548879 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecbbc3e-5732-48f1-af4d-8beaf62a983f None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:01:57.548983 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecbbc3e-5732-48f1-af4d-8beaf62a983f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:01:57.566715 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-8ecbbc3e-5732-48f1-af4d-8beaf62a983f None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:01:57.571171 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-8ecbbc3e-5732-48f1-af4d-8beaf62a983f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:01:57.579859 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 693/1381] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 21:01:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:01:57.625201 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b384a2e0-2409-47a0-ad79-74fad7dfdf04 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:01:57.640476 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b384a2e0-2409-47a0-ad79-74fad7dfdf04 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:01:57.646190 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845ad749-ef00-4dcb-beb4-86efc8213f1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:01:57.646912 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ad749-ef00-4dcb-beb4-86efc8213f1f service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:01:57.647164 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ad749-ef00-4dcb-beb4-86efc8213f1f service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:01:57.647421 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ad749-ef00-4dcb-beb4-86efc8213f1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:01:57.655937 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845ad749-ef00-4dcb-beb4-86efc8213f1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:01:57.657525 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845ad749-ef00-4dcb-beb4-86efc8213f1f service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:01:57.666904 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 689/1382] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:01:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:02:00.109035 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82260f91-6d88-4e06-bcbe-672582e399f8 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:02:00.109895 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82260f91-6d88-4e06-bcbe-672582e399f8 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:02:00.110338 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82260f91-6d88-4e06-bcbe-672582e399f8 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:02:00.115967 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 694/1383] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 21:02:00 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:02:00.117447 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec9451-3eff-4927-8251-f6f509f01155 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:02:00.118326 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec9451-3eff-4927-8251-f6f509f01155 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:02:00.118857 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec9451-3eff-4927-8251-f6f509f01155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:02:00.141782 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-1fec9451-3eff-4927-8251-f6f509f01155 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:02:00.144028 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-1fec9451-3eff-4927-8251-f6f509f01155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:02:00.152429 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 690/1384] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 21:02:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:02:00.198823 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82260f91-6d88-4e06-bcbe-672582e399f8 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:02:00.214975 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82260f91-6d88-4e06-bcbe-672582e399f8 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:02:00.219593 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d860964-5909-4e12-a048-13cf24d33c1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:02:00.220224 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d860964-5909-4e12-a048-13cf24d33c1a service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:02:00.220506 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d860964-5909-4e12-a048-13cf24d33c1a service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:02:00.220780 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d860964-5909-4e12-a048-13cf24d33c1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:02:00.229081 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d860964-5909-4e12-a048-13cf24d33c1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:02:00.230653 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d860964-5909-4e12-a048-13cf24d33c1a service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:02:00.241156 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 695/1385] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:02:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:02:02.613303 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ab066-d403-44b3-991e-4f7ee5ca13e6 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:02:02.617225 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ab066-d403-44b3-991e-4f7ee5ca13e6 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:02:02.617225 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ab066-d403-44b3-991e-4f7ee5ca13e6 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:02:02.617225 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 691/1386] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 21:02:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:02:02.620743 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be1c6a-f5df-4aab-aae9-df733ad588fa None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:02:02.621233 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be1c6a-f5df-4aab-aae9-df733ad588fa None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:02:02.621391 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be1c6a-f5df-4aab-aae9-df733ad588fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:02:02.641337 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-17be1c6a-f5df-4aab-aae9-df733ad588fa None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:02:02.644903 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-17be1c6a-f5df-4aab-aae9-df733ad588fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:02:02.651240 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 696/1387] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 21:02:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:02:02.697169 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2ab066-d403-44b3-991e-4f7ee5ca13e6 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:02:02.713481 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2ab066-d403-44b3-991e-4f7ee5ca13e6 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:02:02.720173 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa2ce6e-ed2b-47db-b26b-e918082f231c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:02:02.721049 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa2ce6e-ed2b-47db-b26b-e918082f231c service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:02:02.721397 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa2ce6e-ed2b-47db-b26b-e918082f231c service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:02:02.721748 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa2ce6e-ed2b-47db-b26b-e918082f231c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:02:02.730608 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa2ce6e-ed2b-47db-b26b-e918082f231c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:02:02.732542 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa2ce6e-ed2b-47db-b26b-e918082f231c service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:02:02.743960 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 692/1388] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:02:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:02:05.446237 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d64b871-11da-4e83-8dda-b15451fb1184 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:02:05.447090 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d64b871-11da-4e83-8dda-b15451fb1184 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:02:05.447090 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d64b871-11da-4e83-8dda-b15451fb1184 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:02:05.448495 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 697/1389] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 21:02:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:02:05.456096 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c0d61-4ec7-4538-bc34-170354d0ecdb None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:02:05.456757 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c0d61-4ec7-4538-bc34-170354d0ecdb None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:02:05.457317 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c0d61-4ec7-4538-bc34-170354d0ecdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:02:05.480310 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-b58c0d61-4ec7-4538-bc34-170354d0ecdb None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:02:05.481546 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b58c0d61-4ec7-4538-bc34-170354d0ecdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:02:05.492617 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 693/1390] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 21:02:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:02:05.542090 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d64b871-11da-4e83-8dda-b15451fb1184 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:02:05.559932 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d64b871-11da-4e83-8dda-b15451fb1184 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:02:05.565619 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea01c2-90b2-4ed0-b678-c79a62b051e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:02:05.566267 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea01c2-90b2-4ed0-b678-c79a62b051e3 service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:02:05.566544 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea01c2-90b2-4ed0-b678-c79a62b051e3 service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:02:05.566819 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea01c2-90b2-4ed0-b678-c79a62b051e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:02:05.575617 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea01c2-90b2-4ed0-b678-c79a62b051e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:02:05.577918 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea01c2-90b2-4ed0-b678-c79a62b051e3 service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:02:05.588169 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 698/1391] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:02:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:02:08.219660 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18bca4b-db35-4c36-911c-1792d60478b7 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:02:08.220301 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18bca4b-db35-4c36-911c-1792d60478b7 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:02:08.220301 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18bca4b-db35-4c36-911c-1792d60478b7 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:02:08.221590 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 694/1392] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 21:02:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:02:08.226836 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc73b85-d223-4a5f-8c67-6cef1eb10ef7 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:02:08.227316 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc73b85-d223-4a5f-8c67-6cef1eb10ef7 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:02:08.227430 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc73b85-d223-4a5f-8c67-6cef1eb10ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:02:08.246894 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-2dc73b85-d223-4a5f-8c67-6cef1eb10ef7 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:02:08.248138 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-2dc73b85-d223-4a5f-8c67-6cef1eb10ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:02:08.257164 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 699/1393] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 21:02:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:02:08.307300 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18bca4b-db35-4c36-911c-1792d60478b7 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:02:08.322286 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18bca4b-db35-4c36-911c-1792d60478b7 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:02:08.328661 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72476cd4-ba29-4034-bc4a-5094f1b8ff83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:02:08.329313 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72476cd4-ba29-4034-bc4a-5094f1b8ff83 service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:02:08.329617 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72476cd4-ba29-4034-bc4a-5094f1b8ff83 service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:02:08.329881 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72476cd4-ba29-4034-bc4a-5094f1b8ff83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:02:08.338662 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72476cd4-ba29-4034-bc4a-5094f1b8ff83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:02:08.341527 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72476cd4-ba29-4034-bc4a-5094f1b8ff83 service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:02:08.350401 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 695/1394] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:02:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:02:11.330049 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc1ecc-8057-446d-874e-b4defd86248d None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:02:11.330733 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc1ecc-8057-446d-874e-b4defd86248d None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:02:11.330733 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc1ecc-8057-446d-874e-b4defd86248d None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:02:11.332076 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 700/1395] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 21:02:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:02:11.337282 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46f268-fed9-48fa-ad9d-81ce1a811b37 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:02:11.337862 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46f268-fed9-48fa-ad9d-81ce1a811b37 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:02:11.337862 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46f268-fed9-48fa-ad9d-81ce1a811b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:02:11.356271 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-ff46f268-fed9-48fa-ad9d-81ce1a811b37 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:02:11.357910 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-ff46f268-fed9-48fa-ad9d-81ce1a811b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:02:11.365777 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 696/1396] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 21:02:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:02:11.413581 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfc1ecc-8057-446d-874e-b4defd86248d None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:02:11.428159 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfc1ecc-8057-446d-874e-b4defd86248d None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:02:11.433587 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882257c4-44a3-4dd0-92fe-4c7bf6640c59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:02:11.434188 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882257c4-44a3-4dd0-92fe-4c7bf6640c59 service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:02:11.434474 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882257c4-44a3-4dd0-92fe-4c7bf6640c59 service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:02:11.434753 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882257c4-44a3-4dd0-92fe-4c7bf6640c59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:02:11.443231 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882257c4-44a3-4dd0-92fe-4c7bf6640c59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:02:11.444868 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882257c4-44a3-4dd0-92fe-4c7bf6640c59 service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:02:11.455003 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 701/1397] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:02:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:02:12.823724 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61308298-2f67-49af-ad0b-13b7d1a7903b None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:02:12.824253 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61308298-2f67-49af-ad0b-13b7d1a7903b None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:02:12.824253 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61308298-2f67-49af-ad0b-13b7d1a7903b None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:02:12.825784 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 697/1398] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 21:02:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:02:12.831537 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017da1cb-7bb0-4e76-a208-90361217b6a3 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:02:12.831981 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017da1cb-7bb0-4e76-a208-90361217b6a3 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:02:12.832095 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017da1cb-7bb0-4e76-a208-90361217b6a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:02:12.850733 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-017da1cb-7bb0-4e76-a208-90361217b6a3 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:02:12.851991 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-017da1cb-7bb0-4e76-a208-90361217b6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:02:12.860616 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 702/1399] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 21:02:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:02:12.919995 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e32a1-b6db-4185-a6c3-0c50202b8e50 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:02:12.921038 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e32a1-b6db-4185-a6c3-0c50202b8e50 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:02:12.921513 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e32a1-b6db-4185-a6c3-0c50202b8e50 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:02:12.922878 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 698/1400] 10.222.0.52 () {54 vars in 962 bytes} [Sat May 14 21:02:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:02:12.928366 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c90639c-2a0c-4f06-94e8-0c4795259a46 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:02:12.928659 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c90639c-2a0c-4f06-94e8-0c4795259a46 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:02:12.928937 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c90639c-2a0c-4f06-94e8-0c4795259a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:02:12.975717 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-5c90639c-2a0c-4f06-94e8-0c4795259a46 None None] MFA Rules not processed for user `7b5cb86f190f4fcfb06d66cb8f14643f`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:02:12.976918 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-5c90639c-2a0c-4f06-94e8-0c4795259a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:02:13.035591 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 703/1401] 10.222.0.52 () {58 vars in 1059 bytes} [Sat May 14 21:02:12 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:02:13.042777 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8e32a1-b6db-4185-a6c3-0c50202b8e50 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:02:13.053762 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8e32a1-b6db-4185-a6c3-0c50202b8e50 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:02:13.057218 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f555874-3b5b-4608-8903-45e3516f6c7b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b5cb86f190f4fcfb06d66cb8f14643f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:02:13.057846 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f555874-3b5b-4608-8903-45e3516f6c7b service glance] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:02:13.058128 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f555874-3b5b-4608-8903-45e3516f6c7b service glance] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:02:13.058400 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f555874-3b5b-4608-8903-45e3516f6c7b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:02:13.067192 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f555874-3b5b-4608-8903-45e3516f6c7b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:02:13.068654 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f555874-3b5b-4608-8903-45e3516f6c7b service glance] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:02:13.078509 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 699/1402] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:02:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:02:13.618839 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5136359-5b63-4bc6-85a5-3955852b31d2 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:02:13.619130 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5136359-5b63-4bc6-85a5-3955852b31d2 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:02:13.619412 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5136359-5b63-4bc6-85a5-3955852b31d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:02:13.669564 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-b5136359-5b63-4bc6-85a5-3955852b31d2 None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:02:13.670858 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b5136359-5b63-4bc6-85a5-3955852b31d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:02:13.734286 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 704/1403] 10.222.0.52 () {58 vars in 1009 bytes} [Sat May 14 21:02:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:02:13.786524 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276658ad-cc94-4af2-8f03-8be7603903e8 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:02:13.786808 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276658ad-cc94-4af2-8f03-8be7603903e8 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:02:13.787086 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276658ad-cc94-4af2-8f03-8be7603903e8 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:02:13.788494 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 700/1404] 10.222.0.52 () {54 vars in 942 bytes} [Sat May 14 21:02:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:02:13.795238 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38f018-aeeb-4259-a4eb-50e7fb20abfa None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:02:13.795660 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38f018-aeeb-4259-a4eb-50e7fb20abfa None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:02:13.796049 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38f018-aeeb-4259-a4eb-50e7fb20abfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:02:13.843990 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-ca38f018-aeeb-4259-a4eb-50e7fb20abfa None None] MFA Rules not processed for user `c781fe7f4a014f0d8b5e7385b20b348c`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:02:13.845213 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ca38f018-aeeb-4259-a4eb-50e7fb20abfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:02:13.915698 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 705/1405] 10.222.0.52 () {58 vars in 1039 bytes} [Sat May 14 21:02:13 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:02:13.928338 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276658ad-cc94-4af2-8f03-8be7603903e8 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:02:13.942493 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276658ad-cc94-4af2-8f03-8be7603903e8 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:02:13.947415 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab84ad9-0c98-4837-b11b-8f320f0a093c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:02:13.948089 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab84ad9-0c98-4837-b11b-8f320f0a093c service swift] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:02:13.948370 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab84ad9-0c98-4837-b11b-8f320f0a093c service swift] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:02:13.948648 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab84ad9-0c98-4837-b11b-8f320f0a093c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:02:13.953001 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1d985-39d1-471b-9e3e-e0fd051cacf2 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:02:13.953294 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1d985-39d1-471b-9e3e-e0fd051cacf2 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:02:13.953572 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1d985-39d1-471b-9e3e-e0fd051cacf2 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:02:13.954953 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 706/1406] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 21:02:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 14 21:02:13.957224 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab84ad9-0c98-4837-b11b-8f320f0a093c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:02:13.958983 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab84ad9-0c98-4837-b11b-8f320f0a093c service swift] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:02:13.960044 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321be053-ea7a-4e9a-b485-056ee1cb1896 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:02:13.960311 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321be053-ea7a-4e9a-b485-056ee1cb1896 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:02:13.960586 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321be053-ea7a-4e9a-b485-056ee1cb1896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:02:13.967595 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 701/1407] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 21:02:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 21:02:13.979746 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-321be053-ea7a-4e9a-b485-056ee1cb1896 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:02:13.981038 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-321be053-ea7a-4e9a-b485-056ee1cb1896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:02:13.990165 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 707/1408] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 21:02:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:02:14.035416 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab84ad9-0c98-4837-b11b-8f320f0a093c service swift] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:02:14.047651 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab84ad9-0c98-4837-b11b-8f320f0a093c service swift] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:02:14.053684 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b84e0bf-237a-4454-80a4-126e83795f5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:02:14.054374 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b84e0bf-237a-4454-80a4-126e83795f5c service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:02:14.054655 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b84e0bf-237a-4454-80a4-126e83795f5c service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:02:14.054930 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b84e0bf-237a-4454-80a4-126e83795f5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:02:14.063860 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b84e0bf-237a-4454-80a4-126e83795f5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:02:14.065943 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b84e0bf-237a-4454-80a4-126e83795f5c service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:02:14.075408 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 702/1409] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:02:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:02:38.088611 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c2c93e-c46f-4f08-8154-4e30d8658686 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:02:38.089260 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c2c93e-c46f-4f08-8154-4e30d8658686 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:02:38.089260 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c2c93e-c46f-4f08-8154-4e30d8658686 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:02:38.090520 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 708/1410] 10.222.0.52 () {54 vars in 918 bytes} [Sat May 14 21:02:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:02:38.096290 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f3578-2735-4a2c-92e3-eacac10e5b8f None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:02:38.096762 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f3578-2735-4a2c-92e3-eacac10e5b8f None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:02:38.096861 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f3578-2735-4a2c-92e3-eacac10e5b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:02:38.114938 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-d39f3578-2735-4a2c-92e3-eacac10e5b8f None None] MFA Rules not processed for user `0812ae67e44d483baf2dbb1a5332a1d7`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:02:38.116171 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-d39f3578-2735-4a2c-92e3-eacac10e5b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:02:38.124801 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 703/1411] 10.222.0.52 () {58 vars in 1015 bytes} [Sat May 14 21:02:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:02:38.139089 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4858393-5c54-4c19-a24d-9c80a84bd44d None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:02:38.139369 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4858393-5c54-4c19-a24d-9c80a84bd44d None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:02:38.139694 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4858393-5c54-4c19-a24d-9c80a84bd44d None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:02:38.141043 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 709/1412] 10.222.0.52 () {54 vars in 918 bytes} [Sat May 14 21:02:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:02:38.145796 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a21f921-eb1a-4f1e-a74e-8a1ccc9b84bc None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:02:38.146089 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a21f921-eb1a-4f1e-a74e-8a1ccc9b84bc None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:02:38.146370 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a21f921-eb1a-4f1e-a74e-8a1ccc9b84bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:02:38.164727 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-4a21f921-eb1a-4f1e-a74e-8a1ccc9b84bc None None] MFA Rules not processed for user `0f1b0e2b025d4eceaa90e1616d0a9db8`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:02:38.165939 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-4a21f921-eb1a-4f1e-a74e-8a1ccc9b84bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:02:38.175985 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 704/1413] 10.222.0.52 () {58 vars in 1015 bytes} [Sat May 14 21:02:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:02:40.980119 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16696b9-97cf-4692-94bd-c619cc09c664 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:02:40.980658 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16696b9-97cf-4692-94bd-c619cc09c664 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:02:40.980658 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16696b9-97cf-4692-94bd-c619cc09c664 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:02:40.982766 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 710/1414] 127.0.0.1 () {54 vars in 916 bytes} [Sat May 14 21:02:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:02:40.988052 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1052e550-6503-405a-8a0f-df2003257d14 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:02:40.988498 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1052e550-6503-405a-8a0f-df2003257d14 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:02:40.988636 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1052e550-6503-405a-8a0f-df2003257d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:02:41.006726 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-1052e550-6503-405a-8a0f-df2003257d14 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:02:41.007973 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-1052e550-6503-405a-8a0f-df2003257d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:02:41.016013 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 705/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Sat May 14 21:02:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:02:41.059237 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16696b9-97cf-4692-94bd-c619cc09c664 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:02:41.073361 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16696b9-97cf-4692-94bd-c619cc09c664 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:02:41.078840 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1858aefa-5176-4b04-976d-03bb81499254 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:02:41.079464 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858aefa-5176-4b04-976d-03bb81499254 service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:02:41.079785 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858aefa-5176-4b04-976d-03bb81499254 service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:02:41.080062 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858aefa-5176-4b04-976d-03bb81499254 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:02:41.087990 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1858aefa-5176-4b04-976d-03bb81499254 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:02:41.089603 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1858aefa-5176-4b04-976d-03bb81499254 service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:02:41.099597 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 711/1416] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:02:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:02:42.122742 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20531c1-17b5-4cd0-9ac6-d41b8d3b01c6 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:02:42.123301 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20531c1-17b5-4cd0-9ac6-d41b8d3b01c6 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:02:42.123301 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20531c1-17b5-4cd0-9ac6-d41b8d3b01c6 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:02:42.124691 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 706/1417] 127.0.0.1 () {54 vars in 901 bytes} [Sat May 14 21:02:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:02:42.129691 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41040d-e0ea-4bb0-9d26-185428f76529 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:02:42.130096 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41040d-e0ea-4bb0-9d26-185428f76529 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:02:42.130231 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41040d-e0ea-4bb0-9d26-185428f76529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:02:42.148141 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-5b41040d-e0ea-4bb0-9d26-185428f76529 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:02:42.149314 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-5b41040d-e0ea-4bb0-9d26-185428f76529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:02:42.158227 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 712/1418] 127.0.0.1 () {58 vars in 998 bytes} [Sat May 14 21:02:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:02:42.370082 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20531c1-17b5-4cd0-9ac6-d41b8d3b01c6 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:02:42.384776 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20531c1-17b5-4cd0-9ac6-d41b8d3b01c6 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:02:42.390706 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2f2e55-ff89-47c3-904f-af3212e82bfd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:02:42.391338 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f2e55-ff89-47c3-904f-af3212e82bfd service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:02:42.391652 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f2e55-ff89-47c3-904f-af3212e82bfd service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:02:42.391924 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f2e55-ff89-47c3-904f-af3212e82bfd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:02:42.400104 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2f2e55-ff89-47c3-904f-af3212e82bfd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:02:42.401551 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2f2e55-ff89-47c3-904f-af3212e82bfd service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:02:42.411325 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 707/1419] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:02:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:02:43.365623 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcaeae9-3449-41b7-932f-00c88bcc5cad None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:02:43.366165 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcaeae9-3449-41b7-932f-00c88bcc5cad None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:02:43.366300 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcaeae9-3449-41b7-932f-00c88bcc5cad None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:02:43.367638 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 713/1420] 127.0.0.1 () {54 vars in 901 bytes} [Sat May 14 21:02:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:02:43.373028 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3e8a8-d837-4f1c-862f-1a7c993b3d30 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:02:43.373446 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3e8a8-d837-4f1c-862f-1a7c993b3d30 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:02:43.373557 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3e8a8-d837-4f1c-862f-1a7c993b3d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:02:43.391935 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-2fe3e8a8-d837-4f1c-862f-1a7c993b3d30 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:02:43.393123 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-2fe3e8a8-d837-4f1c-862f-1a7c993b3d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:02:43.400848 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 708/1421] 127.0.0.1 () {58 vars in 998 bytes} [Sat May 14 21:02:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:02:43.557687 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcaeae9-3449-41b7-932f-00c88bcc5cad None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:02:43.572662 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcaeae9-3449-41b7-932f-00c88bcc5cad None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:02:43.578791 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f962b1a-cfa3-4340-8ba6-16a5c4b26265 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:02:43.579552 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f962b1a-cfa3-4340-8ba6-16a5c4b26265 service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:02:43.579837 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f962b1a-cfa3-4340-8ba6-16a5c4b26265 service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:02:43.580150 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f962b1a-cfa3-4340-8ba6-16a5c4b26265 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:02:43.588355 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f962b1a-cfa3-4340-8ba6-16a5c4b26265 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:02:43.589929 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f962b1a-cfa3-4340-8ba6-16a5c4b26265 service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:02:43.599638 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 714/1422] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:02:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:02:44.543788 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870eb7e3-0493-4ee4-bbd7-25e8f5f00d3f None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:02:44.544879 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870eb7e3-0493-4ee4-bbd7-25e8f5f00d3f None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:02:44.545099 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870eb7e3-0493-4ee4-bbd7-25e8f5f00d3f None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:02:44.546488 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 709/1423] 127.0.0.1 () {54 vars in 901 bytes} [Sat May 14 21:02:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:02:44.551702 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9c3a3-14b8-4e8e-8360-9ae9cee029f2 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:02:44.552136 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9c3a3-14b8-4e8e-8360-9ae9cee029f2 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:02:44.552238 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9c3a3-14b8-4e8e-8360-9ae9cee029f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:02:44.571278 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-70a9c3a3-14b8-4e8e-8360-9ae9cee029f2 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:02:44.572510 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-70a9c3a3-14b8-4e8e-8360-9ae9cee029f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:02:44.580279 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 715/1424] 127.0.0.1 () {58 vars in 998 bytes} [Sat May 14 21:02:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:02:44.746890 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870eb7e3-0493-4ee4-bbd7-25e8f5f00d3f None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:02:44.761612 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870eb7e3-0493-4ee4-bbd7-25e8f5f00d3f None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:02:44.767127 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5250a547-4240-415a-a5f1-3b2184301ce8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:02:44.767799 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5250a547-4240-415a-a5f1-3b2184301ce8 service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:02:44.768082 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5250a547-4240-415a-a5f1-3b2184301ce8 service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:02:44.768355 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5250a547-4240-415a-a5f1-3b2184301ce8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:02:44.776388 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5250a547-4240-415a-a5f1-3b2184301ce8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:02:44.778023 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5250a547-4240-415a-a5f1-3b2184301ce8 service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:02:44.787831 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 710/1425] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:02:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:02:45.743782 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc645e-3a06-4174-9e07-300afff71a7c None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:02:45.744349 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc645e-3a06-4174-9e07-300afff71a7c None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:02:45.744349 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc645e-3a06-4174-9e07-300afff71a7c None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:02:45.745712 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 716/1426] 127.0.0.1 () {54 vars in 901 bytes} [Sat May 14 21:02:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 14 21:02:45.751789 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5238d02-a82f-489f-8948-6124dfeec24c None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:02:45.752244 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5238d02-a82f-489f-8948-6124dfeec24c None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:02:45.752345 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5238d02-a82f-489f-8948-6124dfeec24c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:02:45.770735 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-c5238d02-a82f-489f-8948-6124dfeec24c None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:02:45.771943 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c5238d02-a82f-489f-8948-6124dfeec24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:02:45.779704 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 711/1427] 127.0.0.1 () {58 vars in 998 bytes} [Sat May 14 21:02:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:02:45.939439 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fc645e-3a06-4174-9e07-300afff71a7c None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:02:45.953501 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fc645e-3a06-4174-9e07-300afff71a7c None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:02:45.959022 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b72d33-372d-4400-976d-3664d0b92ef3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:02:45.959676 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b72d33-372d-4400-976d-3664d0b92ef3 service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:02:45.959957 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b72d33-372d-4400-976d-3664d0b92ef3 service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:02:45.960229 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b72d33-372d-4400-976d-3664d0b92ef3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:02:45.968405 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b72d33-372d-4400-976d-3664d0b92ef3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:02:45.969975 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b72d33-372d-4400-976d-3664d0b92ef3 service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:02:45.978995 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 717/1428] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:02:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:02:46.956186 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feab725-0f81-4728-9790-921f002abdd4 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:02:46.956681 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feab725-0f81-4728-9790-921f002abdd4 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:02:46.956681 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feab725-0f81-4728-9790-921f002abdd4 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:02:46.958060 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 712/1429] 127.0.0.1 () {54 vars in 901 bytes} [Sat May 14 21:02:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:02:46.963010 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e85f172-d260-489d-bb6c-320827eca109 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:02:46.963452 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e85f172-d260-489d-bb6c-320827eca109 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:02:46.963592 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e85f172-d260-489d-bb6c-320827eca109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:02:46.981095 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-9e85f172-d260-489d-bb6c-320827eca109 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:02:46.982453 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-9e85f172-d260-489d-bb6c-320827eca109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:02:46.990331 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 718/1430] 127.0.0.1 () {58 vars in 998 bytes} [Sat May 14 21:02:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:02:47.145999 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feab725-0f81-4728-9790-921f002abdd4 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:02:47.160540 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feab725-0f81-4728-9790-921f002abdd4 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:02:47.166079 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5963383a-4d2c-45a7-b3e8-9334045add0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:02:47.166712 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963383a-4d2c-45a7-b3e8-9334045add0a service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:02:47.166999 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963383a-4d2c-45a7-b3e8-9334045add0a service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:02:47.167280 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963383a-4d2c-45a7-b3e8-9334045add0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:02:47.175611 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5963383a-4d2c-45a7-b3e8-9334045add0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:02:47.186143 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5963383a-4d2c-45a7-b3e8-9334045add0a service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:02:47.187175 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 713/1431] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:02:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:02:48.146264 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a686e4d-5b82-42a5-beea-7061ffc60fa6 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:02:48.146833 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a686e4d-5b82-42a5-beea-7061ffc60fa6 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:02:48.146833 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a686e4d-5b82-42a5-beea-7061ffc60fa6 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:02:48.148260 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 719/1432] 127.0.0.1 () {54 vars in 901 bytes} [Sat May 14 21:02:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:02:48.153252 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec919a26-e92c-4b4b-a089-10b9fca6521a None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:02:48.153660 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec919a26-e92c-4b4b-a089-10b9fca6521a None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:02:48.153834 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec919a26-e92c-4b4b-a089-10b9fca6521a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:02:48.173057 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-ec919a26-e92c-4b4b-a089-10b9fca6521a None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:02:48.174259 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-ec919a26-e92c-4b4b-a089-10b9fca6521a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:02:48.182140 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 714/1433] 127.0.0.1 () {58 vars in 998 bytes} [Sat May 14 21:02:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:02:48.341663 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a686e4d-5b82-42a5-beea-7061ffc60fa6 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:02:48.356495 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a686e4d-5b82-42a5-beea-7061ffc60fa6 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:02:48.361917 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd473db-9e63-46f5-9655-c2236fe886dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:02:48.362542 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd473db-9e63-46f5-9655-c2236fe886dd service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:02:48.362823 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd473db-9e63-46f5-9655-c2236fe886dd service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:02:48.363098 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd473db-9e63-46f5-9655-c2236fe886dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:02:48.371046 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd473db-9e63-46f5-9655-c2236fe886dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:02:48.372646 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd473db-9e63-46f5-9655-c2236fe886dd service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:02:48.382178 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 720/1434] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:02:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:02:49.346321 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8829e513-60f0-43f3-9de6-674292f7df21 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:02:49.346869 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8829e513-60f0-43f3-9de6-674292f7df21 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:02:49.346869 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8829e513-60f0-43f3-9de6-674292f7df21 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:02:49.348276 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 715/1435] 127.0.0.1 () {54 vars in 901 bytes} [Sat May 14 21:02:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:02:49.353544 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6335df-0077-4bec-8142-8a16f9cca11a None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:02:49.353995 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6335df-0077-4bec-8142-8a16f9cca11a None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:02:49.354097 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6335df-0077-4bec-8142-8a16f9cca11a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:02:49.371551 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-4d6335df-0077-4bec-8142-8a16f9cca11a None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:02:49.373274 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-4d6335df-0077-4bec-8142-8a16f9cca11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:02:49.381216 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 721/1436] 127.0.0.1 () {58 vars in 998 bytes} [Sat May 14 21:02:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:02:49.539327 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8829e513-60f0-43f3-9de6-674292f7df21 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:02:49.554114 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8829e513-60f0-43f3-9de6-674292f7df21 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:02:49.559263 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04e3cd7-1dba-4de2-8948-38fa4f24401f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:02:49.559922 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04e3cd7-1dba-4de2-8948-38fa4f24401f service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:02:49.560257 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04e3cd7-1dba-4de2-8948-38fa4f24401f service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:02:49.560589 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04e3cd7-1dba-4de2-8948-38fa4f24401f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:02:49.568581 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04e3cd7-1dba-4de2-8948-38fa4f24401f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:02:49.570158 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04e3cd7-1dba-4de2-8948-38fa4f24401f service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:02:49.580439 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 716/1437] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:02:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:02:50.568491 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57b4cd-0470-46a2-8508-68bbfe3f59f2 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:02:50.569068 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57b4cd-0470-46a2-8508-68bbfe3f59f2 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:02:50.569068 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57b4cd-0470-46a2-8508-68bbfe3f59f2 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:02:50.570440 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 722/1438] 127.0.0.1 () {54 vars in 901 bytes} [Sat May 14 21:02:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:02:50.575234 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf748a16-bd42-4d63-b04a-5db689b10ac5 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:02:50.576206 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf748a16-bd42-4d63-b04a-5db689b10ac5 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:02:50.576322 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf748a16-bd42-4d63-b04a-5db689b10ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:02:50.594481 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-bf748a16-bd42-4d63-b04a-5db689b10ac5 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:02:50.595693 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-bf748a16-bd42-4d63-b04a-5db689b10ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:02:50.603220 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 717/1439] 127.0.0.1 () {58 vars in 998 bytes} [Sat May 14 21:02:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:02:50.765208 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e57b4cd-0470-46a2-8508-68bbfe3f59f2 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:02:50.779773 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e57b4cd-0470-46a2-8508-68bbfe3f59f2 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:02:50.785090 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7e350f-3a20-4b27-803e-2a91b53ebdd1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:02:50.785718 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e350f-3a20-4b27-803e-2a91b53ebdd1 service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:02:50.785999 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e350f-3a20-4b27-803e-2a91b53ebdd1 service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:02:50.786269 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e350f-3a20-4b27-803e-2a91b53ebdd1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:02:50.794318 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7e350f-3a20-4b27-803e-2a91b53ebdd1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:02:50.796205 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7e350f-3a20-4b27-803e-2a91b53ebdd1 service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:02:50.805453 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 723/1440] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:02:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:02:53.017443 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f002a-d6c9-4d2a-91ef-20033d4435b7 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:02:53.017994 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f002a-d6c9-4d2a-91ef-20033d4435b7 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:02:53.017994 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f002a-d6c9-4d2a-91ef-20033d4435b7 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:02:53.019375 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 718/1441] 127.0.0.1 () {54 vars in 916 bytes} [Sat May 14 21:02:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:02:53.024715 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e46be28-af65-42a4-ad94-6f86d301af98 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:02:53.025130 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e46be28-af65-42a4-ad94-6f86d301af98 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:02:53.025273 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e46be28-af65-42a4-ad94-6f86d301af98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:02:53.043002 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-0e46be28-af65-42a4-ad94-6f86d301af98 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:02:53.044229 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-0e46be28-af65-42a4-ad94-6f86d301af98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:02:53.052613 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 724/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Sat May 14 21:02:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:02:53.092599 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f002a-d6c9-4d2a-91ef-20033d4435b7 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:02:53.103104 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f002a-d6c9-4d2a-91ef-20033d4435b7 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:02:53.106564 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd885984-7dc9-44be-bc56-2f5ac808f34f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:02:53.107791 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd885984-7dc9-44be-bc56-2f5ac808f34f service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:02:53.108074 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd885984-7dc9-44be-bc56-2f5ac808f34f service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:02:53.108349 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd885984-7dc9-44be-bc56-2f5ac808f34f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:02:53.117061 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd885984-7dc9-44be-bc56-2f5ac808f34f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:02:53.118520 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd885984-7dc9-44be-bc56-2f5ac808f34f service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:02:53.128001 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 719/1443] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:02:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:02:55.614234 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a4c2d-9758-4627-ad2e-f6e1676f7687 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:02:55.614760 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a4c2d-9758-4627-ad2e-f6e1676f7687 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:02:55.614888 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a4c2d-9758-4627-ad2e-f6e1676f7687 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:02:55.616197 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 725/1444] 127.0.0.1 () {54 vars in 916 bytes} [Sat May 14 21:02:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:02:55.621635 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d0cf90-196c-436f-9fc2-5c9249a34897 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:02:55.622037 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d0cf90-196c-436f-9fc2-5c9249a34897 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:02:55.622188 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d0cf90-196c-436f-9fc2-5c9249a34897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:02:55.640679 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-66d0cf90-196c-436f-9fc2-5c9249a34897 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:02:55.641874 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-66d0cf90-196c-436f-9fc2-5c9249a34897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:02:55.649668 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 720/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Sat May 14 21:02:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:02:55.688379 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99a4c2d-9758-4627-ad2e-f6e1676f7687 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:02:55.698940 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99a4c2d-9758-4627-ad2e-f6e1676f7687 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:02:55.703288 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8fb5fb-1e53-4fac-b2a8-532452571390 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:02:55.703953 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8fb5fb-1e53-4fac-b2a8-532452571390 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:02:55.704227 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8fb5fb-1e53-4fac-b2a8-532452571390 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:02:55.704494 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8fb5fb-1e53-4fac-b2a8-532452571390 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:02:55.713151 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8fb5fb-1e53-4fac-b2a8-532452571390 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:02:55.714566 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8fb5fb-1e53-4fac-b2a8-532452571390 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:02:55.724638 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 726/1446] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:02:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:02:58.384706 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264afb9-5dbd-42b6-adde-8155d02bd5ce None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:02:58.385268 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264afb9-5dbd-42b6-adde-8155d02bd5ce None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:02:58.385268 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264afb9-5dbd-42b6-adde-8155d02bd5ce None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:02:58.386577 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 721/1447] 127.0.0.1 () {54 vars in 916 bytes} [Sat May 14 21:02:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:02:58.392612 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5cfb05-faa0-4c93-aebc-16ea18377f4c None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:02:58.393067 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5cfb05-faa0-4c93-aebc-16ea18377f4c None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:02:58.393204 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5cfb05-faa0-4c93-aebc-16ea18377f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:02:58.410686 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-8e5cfb05-faa0-4c93-aebc-16ea18377f4c None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:02:58.411902 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-8e5cfb05-faa0-4c93-aebc-16ea18377f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:02:58.419542 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 727/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Sat May 14 21:02:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:02:58.460025 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e264afb9-5dbd-42b6-adde-8155d02bd5ce None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:02:58.470829 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e264afb9-5dbd-42b6-adde-8155d02bd5ce None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:02:58.474379 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4980b9f9-d0f0-4ad8-81ba-126eaa2b8897 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:02:58.475003 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980b9f9-d0f0-4ad8-81ba-126eaa2b8897 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:02:58.475282 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980b9f9-d0f0-4ad8-81ba-126eaa2b8897 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:02:58.475590 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980b9f9-d0f0-4ad8-81ba-126eaa2b8897 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:02:58.485227 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4980b9f9-d0f0-4ad8-81ba-126eaa2b8897 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:02:58.486654 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4980b9f9-d0f0-4ad8-81ba-126eaa2b8897 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:02:58.495820 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 722/1449] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:02:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:03:00.896197 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e499c804-0631-4ab1-a037-e0f843728d50 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:03:00.896775 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e499c804-0631-4ab1-a037-e0f843728d50 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:03:00.896775 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e499c804-0631-4ab1-a037-e0f843728d50 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:03:00.898130 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 728/1450] 127.0.0.1 () {54 vars in 916 bytes} [Sat May 14 21:03:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:03:00.903301 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a150e92-2115-4e2f-9b0e-a14a5e93214c None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:03:00.903897 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a150e92-2115-4e2f-9b0e-a14a5e93214c None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:03:00.904141 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a150e92-2115-4e2f-9b0e-a14a5e93214c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:03:00.922213 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-0a150e92-2115-4e2f-9b0e-a14a5e93214c None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:03:00.923394 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-0a150e92-2115-4e2f-9b0e-a14a5e93214c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:03:00.931132 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 723/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Sat May 14 21:03:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:03:00.970654 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e499c804-0631-4ab1-a037-e0f843728d50 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:03:00.982222 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e499c804-0631-4ab1-a037-e0f843728d50 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:03:00.985447 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59396da9-82c8-47f4-947b-6cdd154cb194 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:03:00.986088 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59396da9-82c8-47f4-947b-6cdd154cb194 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:03:00.986376 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59396da9-82c8-47f4-947b-6cdd154cb194 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:03:00.986657 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59396da9-82c8-47f4-947b-6cdd154cb194 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:03:00.995593 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59396da9-82c8-47f4-947b-6cdd154cb194 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:03:00.997059 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59396da9-82c8-47f4-947b-6cdd154cb194 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:03:01.007538 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 729/1452] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:03:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:03:03.374999 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa81188-d579-4ec3-978f-f8be5747fef1 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:03:03.375565 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa81188-d579-4ec3-978f-f8be5747fef1 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:03:03.375565 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa81188-d579-4ec3-978f-f8be5747fef1 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:03:03.377162 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 724/1453] 127.0.0.1 () {54 vars in 916 bytes} [Sat May 14 21:03:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:03:03.382440 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe157ff-72e9-48c8-a4fd-9ab0f9b3cbea None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:03:03.382864 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe157ff-72e9-48c8-a4fd-9ab0f9b3cbea None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:03:03.382998 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe157ff-72e9-48c8-a4fd-9ab0f9b3cbea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:03:03.400662 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-3fe157ff-72e9-48c8-a4fd-9ab0f9b3cbea None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:03:03.401849 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-3fe157ff-72e9-48c8-a4fd-9ab0f9b3cbea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:03:03.410194 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 730/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Sat May 14 21:03:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:03:03.448894 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa81188-d579-4ec3-978f-f8be5747fef1 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:03:03.460325 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa81188-d579-4ec3-978f-f8be5747fef1 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:03:03.463814 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee2112a-2e99-410f-a6ce-d6e297d69476 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:03:03.464446 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2112a-2e99-410f-a6ce-d6e297d69476 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:03:03.464731 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2112a-2e99-410f-a6ce-d6e297d69476 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:03:03.465008 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2112a-2e99-410f-a6ce-d6e297d69476 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:03:03.474035 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee2112a-2e99-410f-a6ce-d6e297d69476 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:03:03.475490 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee2112a-2e99-410f-a6ce-d6e297d69476 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:03:03.484798 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 725/1455] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:03:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:03:05.828829 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf3735-8aff-4b26-b63b-c0fba78e289f None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:03:05.829359 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf3735-8aff-4b26-b63b-c0fba78e289f None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:03:05.829359 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf3735-8aff-4b26-b63b-c0fba78e289f None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:03:05.830735 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 731/1456] 127.0.0.1 () {54 vars in 916 bytes} [Sat May 14 21:03:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:03:05.836125 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc264f6-66bc-4ceb-9544-5249a48e3b22 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:03:05.836527 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc264f6-66bc-4ceb-9544-5249a48e3b22 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:03:05.836667 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc264f6-66bc-4ceb-9544-5249a48e3b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:03:05.853690 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-1bc264f6-66bc-4ceb-9544-5249a48e3b22 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:03:05.854862 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-1bc264f6-66bc-4ceb-9544-5249a48e3b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:03:05.862657 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 726/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Sat May 14 21:03:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:03:05.902281 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbf3735-8aff-4b26-b63b-c0fba78e289f None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:03:05.913047 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbf3735-8aff-4b26-b63b-c0fba78e289f None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:03:05.916646 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9d4a53-ba80-4a53-b199-6e83a327dc07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:03:05.917279 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d4a53-ba80-4a53-b199-6e83a327dc07 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:03:05.917563 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d4a53-ba80-4a53-b199-6e83a327dc07 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:03:05.917861 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d4a53-ba80-4a53-b199-6e83a327dc07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:03:05.927348 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9d4a53-ba80-4a53-b199-6e83a327dc07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:03:05.928850 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9d4a53-ba80-4a53-b199-6e83a327dc07 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:03:05.938787 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 732/1458] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:03:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:03:08.517526 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23654fef-557c-4a30-8f00-668b7dd1c6a8 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:03:08.518103 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23654fef-557c-4a30-8f00-668b7dd1c6a8 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:03:08.518103 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23654fef-557c-4a30-8f00-668b7dd1c6a8 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:03:08.519430 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 727/1459] 127.0.0.1 () {54 vars in 916 bytes} [Sat May 14 21:03:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:03:08.524597 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56ce544-d6fe-4ebb-8ff4-4655f5236692 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:03:08.525002 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56ce544-d6fe-4ebb-8ff4-4655f5236692 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:03:08.525147 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56ce544-d6fe-4ebb-8ff4-4655f5236692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:03:08.542461 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-c56ce544-d6fe-4ebb-8ff4-4655f5236692 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:03:08.543679 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c56ce544-d6fe-4ebb-8ff4-4655f5236692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:03:08.551793 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 733/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Sat May 14 21:03:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:03:08.589614 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23654fef-557c-4a30-8f00-668b7dd1c6a8 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:03:08.600354 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23654fef-557c-4a30-8f00-668b7dd1c6a8 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:03:08.603869 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69288509-b3b6-46fa-b0ca-3d3203a9b53e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:03:08.604499 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69288509-b3b6-46fa-b0ca-3d3203a9b53e service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:03:08.604782 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69288509-b3b6-46fa-b0ca-3d3203a9b53e service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:03:08.605058 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69288509-b3b6-46fa-b0ca-3d3203a9b53e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:03:08.614570 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69288509-b3b6-46fa-b0ca-3d3203a9b53e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:03:08.616038 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69288509-b3b6-46fa-b0ca-3d3203a9b53e service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:03:08.625825 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 728/1461] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:03:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:03:10.968878 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc136f3b-a834-4d46-9b5f-564162499409 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:03:10.969402 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc136f3b-a834-4d46-9b5f-564162499409 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:03:10.969402 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc136f3b-a834-4d46-9b5f-564162499409 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:03:10.970786 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 734/1462] 127.0.0.1 () {54 vars in 916 bytes} [Sat May 14 21:03:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:03:10.976016 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c9331-e3b4-4a5e-8187-71a0827b34a4 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:03:10.976465 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c9331-e3b4-4a5e-8187-71a0827b34a4 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:03:10.976600 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c9331-e3b4-4a5e-8187-71a0827b34a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:03:10.993878 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-270c9331-e3b4-4a5e-8187-71a0827b34a4 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:03:10.995063 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-270c9331-e3b4-4a5e-8187-71a0827b34a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:03:11.003551 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 729/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Sat May 14 21:03:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:03:11.041381 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc136f3b-a834-4d46-9b5f-564162499409 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:03:11.051758 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc136f3b-a834-4d46-9b5f-564162499409 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:03:11.055152 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78555e03-58e9-44ad-a5ed-81cad7787c4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:03:11.055815 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78555e03-58e9-44ad-a5ed-81cad7787c4f service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:03:11.056094 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78555e03-58e9-44ad-a5ed-81cad7787c4f service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:03:11.056365 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78555e03-58e9-44ad-a5ed-81cad7787c4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:03:11.065437 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78555e03-58e9-44ad-a5ed-81cad7787c4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:03:11.066858 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78555e03-58e9-44ad-a5ed-81cad7787c4f service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:03:11.076461 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 735/1464] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:03:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:03:13.373966 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e4230-3df0-491c-9213-a17632e77af7 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:03:13.374533 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e4230-3df0-491c-9213-a17632e77af7 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:03:13.374533 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e4230-3df0-491c-9213-a17632e77af7 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:03:13.375973 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 730/1465] 127.0.0.1 () {54 vars in 916 bytes} [Sat May 14 21:03:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:03:13.381663 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238075d2-9915-4821-bd20-83bf90546bec None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:03:13.382093 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238075d2-9915-4821-bd20-83bf90546bec None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:03:13.382209 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238075d2-9915-4821-bd20-83bf90546bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:03:13.400051 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-238075d2-9915-4821-bd20-83bf90546bec None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:03:13.401250 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-238075d2-9915-4821-bd20-83bf90546bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:03:13.409029 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 736/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Sat May 14 21:03:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:03:13.446285 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8e4230-3df0-491c-9213-a17632e77af7 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:03:13.457590 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8e4230-3df0-491c-9213-a17632e77af7 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:03:13.461058 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d624d076-f4bc-4c2f-ab2e-99523446e4bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:03:13.461685 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d624d076-f4bc-4c2f-ab2e-99523446e4bf service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:03:13.461967 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d624d076-f4bc-4c2f-ab2e-99523446e4bf service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:03:13.462247 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d624d076-f4bc-4c2f-ab2e-99523446e4bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:03:13.470991 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d624d076-f4bc-4c2f-ab2e-99523446e4bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:03:13.472448 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d624d076-f4bc-4c2f-ab2e-99523446e4bf service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:03:13.481713 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 731/1467] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:03:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:03:15.768276 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e4f20-f035-4257-acc6-bec4269409db None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:03:15.768862 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e4f20-f035-4257-acc6-bec4269409db None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:03:15.768862 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e4f20-f035-4257-acc6-bec4269409db None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:03:15.770165 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 737/1468] 127.0.0.1 () {54 vars in 916 bytes} [Sat May 14 21:03:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:03:15.775585 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97112649-b36e-48c3-9a6c-02c39c761619 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:03:15.775993 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97112649-b36e-48c3-9a6c-02c39c761619 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:03:15.776150 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97112649-b36e-48c3-9a6c-02c39c761619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:03:15.794235 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-97112649-b36e-48c3-9a6c-02c39c761619 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:03:15.795418 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-97112649-b36e-48c3-9a6c-02c39c761619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:03:15.803194 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 732/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Sat May 14 21:03:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:03:15.840379 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e4f20-f035-4257-acc6-bec4269409db None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:03:15.850870 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e4f20-f035-4257-acc6-bec4269409db None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:03:15.854491 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e38d1-913c-45b8-9765-e6e8f91b83fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:03:15.855105 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e38d1-913c-45b8-9765-e6e8f91b83fe service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:03:15.855383 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e38d1-913c-45b8-9765-e6e8f91b83fe service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:03:15.855757 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e38d1-913c-45b8-9765-e6e8f91b83fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:03:15.864952 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7e38d1-913c-45b8-9765-e6e8f91b83fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:03:15.866373 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7e38d1-913c-45b8-9765-e6e8f91b83fe service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:03:15.876162 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 738/1470] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:03:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:03:50.705990 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00a7d1-859b-47e2-8a35-bf6bbae7af66 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:03:50.706600 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00a7d1-859b-47e2-8a35-bf6bbae7af66 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:03:50.706600 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00a7d1-859b-47e2-8a35-bf6bbae7af66 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:03:50.707916 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 733/1471] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 21:03:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:03:50.713336 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a7593-2866-4903-844d-f30800baadc2 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:03:50.713822 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a7593-2866-4903-844d-f30800baadc2 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:03:50.713947 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a7593-2866-4903-844d-f30800baadc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:03:50.732742 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-9a0a7593-2866-4903-844d-f30800baadc2 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:03:50.733935 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-9a0a7593-2866-4903-844d-f30800baadc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:03:50.741649 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 739/1472] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 21:03:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:03:50.788807 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a8bc2-b058-4a47-978a-96a27c06486a None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:03:50.789100 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a8bc2-b058-4a47-978a-96a27c06486a None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:03:50.789380 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a8bc2-b058-4a47-978a-96a27c06486a None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:03:50.790777 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 734/1473] 10.222.0.52 () {54 vars in 962 bytes} [Sat May 14 21:03:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:03:50.796474 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14cd1a-30d8-4b2d-a11b-165d0b16a347 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:03:50.796769 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14cd1a-30d8-4b2d-a11b-165d0b16a347 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:03:50.797050 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14cd1a-30d8-4b2d-a11b-165d0b16a347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:03:50.814974 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-3e14cd1a-30d8-4b2d-a11b-165d0b16a347 None None] MFA Rules not processed for user `7b5cb86f190f4fcfb06d66cb8f14643f`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:03:50.822026 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-3e14cd1a-30d8-4b2d-a11b-165d0b16a347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:03:50.828649 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 740/1474] 10.222.0.52 () {58 vars in 1059 bytes} [Sat May 14 21:03:50 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:03:50.836003 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848a8bc2-b058-4a47-978a-96a27c06486a None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:03:50.846992 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848a8bc2-b058-4a47-978a-96a27c06486a None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:03:50.850497 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1495206-5f61-42d4-b047-c25ad38d9e39 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b5cb86f190f4fcfb06d66cb8f14643f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:03:50.851121 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1495206-5f61-42d4-b047-c25ad38d9e39 service glance] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:03:50.851402 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1495206-5f61-42d4-b047-c25ad38d9e39 service glance] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:03:50.851705 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1495206-5f61-42d4-b047-c25ad38d9e39 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:03:50.861168 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1495206-5f61-42d4-b047-c25ad38d9e39 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:03:50.862593 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1495206-5f61-42d4-b047-c25ad38d9e39 service glance] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:03:50.872556 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 735/1475] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:03:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:03:53.294875 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374f916-90e7-40ea-85dd-d546d04cc0b8 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:03:53.295439 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374f916-90e7-40ea-85dd-d546d04cc0b8 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:03:53.295439 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374f916-90e7-40ea-85dd-d546d04cc0b8 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:03:53.296736 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 741/1476] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 21:03:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:03:53.302075 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269ac40-4224-4a7c-98b4-0b341392cb4e None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:03:53.302507 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269ac40-4224-4a7c-98b4-0b341392cb4e None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:03:53.302626 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269ac40-4224-4a7c-98b4-0b341392cb4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:03:53.320919 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-1269ac40-4224-4a7c-98b4-0b341392cb4e None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:03:53.322117 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-1269ac40-4224-4a7c-98b4-0b341392cb4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:03:53.330207 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 736/1477] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 21:03:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:03:53.357148 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8374f916-90e7-40ea-85dd-d546d04cc0b8 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:03:53.369829 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8374f916-90e7-40ea-85dd-d546d04cc0b8 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:03:53.374959 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ed1af-8c92-4aeb-8522-6429d826d458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:03:53.375652 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ed1af-8c92-4aeb-8522-6429d826d458 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:03:53.375939 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ed1af-8c92-4aeb-8522-6429d826d458 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:03:53.376218 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ed1af-8c92-4aeb-8522-6429d826d458 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:03:53.377195 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7ed1af-8c92-4aeb-8522-6429d826d458 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:03:53.378960 ncdv-master-1 devstack@keystone.service[91106]: WARNING py.warnings [None req-cc7ed1af-8c92-4aeb-8522-6429d826d458 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 14 21:03:53.378960 ncdv-master-1 devstack@keystone.service[91106]: warnings.warn(msg) May 14 21:03:53.378960 ncdv-master-1 devstack@keystone.service[91106]: May 14 21:03:53.380142 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7ed1af-8c92-4aeb-8522-6429d826d458 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:03:53.399024 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 742/1478] 10.222.0.52 () {56 vars in 1108 bytes} [Sat May 14 21:03:53 2022] GET /identity/v3/projects => generated 2553 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:03:55.711347 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bd45c-7244-4355-ab0d-b333efa298c5 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:03:55.712026 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bd45c-7244-4355-ab0d-b333efa298c5 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:03:55.712026 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bd45c-7244-4355-ab0d-b333efa298c5 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:03:55.713286 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 737/1479] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 21:03:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:03:55.719432 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c2516-4d4d-4b79-82da-9ce7c1cdf26b None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:03:55.719921 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c2516-4d4d-4b79-82da-9ce7c1cdf26b None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:03:55.720029 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c2516-4d4d-4b79-82da-9ce7c1cdf26b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:03:55.737444 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-399c2516-4d4d-4b79-82da-9ce7c1cdf26b None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:03:55.738632 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-399c2516-4d4d-4b79-82da-9ce7c1cdf26b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:03:55.746383 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 743/1480] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 21:03:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:03:55.790730 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667bd45c-7244-4355-ab0d-b333efa298c5 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:03:55.804892 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667bd45c-7244-4355-ab0d-b333efa298c5 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:03:55.810280 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1c2daa-5849-479c-8053-a0a410992428 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:03:55.810913 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c2daa-5849-479c-8053-a0a410992428 service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:03:55.811195 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c2daa-5849-479c-8053-a0a410992428 service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:03:55.811469 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c2daa-5849-479c-8053-a0a410992428 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:03:55.819523 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1c2daa-5849-479c-8053-a0a410992428 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:03:55.821060 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1c2daa-5849-479c-8053-a0a410992428 service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:03:55.830763 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 738/1481] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:03:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:03:58.332911 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b225501-25c2-4306-b6ce-f2224db5c3ba None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:03:58.333446 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b225501-25c2-4306-b6ce-f2224db5c3ba None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:03:58.333446 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b225501-25c2-4306-b6ce-f2224db5c3ba None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:03:58.334729 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 744/1482] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 21:03:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:03:58.339916 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e92664-8077-4fcd-80e4-6d36cdf5395e None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:03:58.340703 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e92664-8077-4fcd-80e4-6d36cdf5395e None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:03:58.340985 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e92664-8077-4fcd-80e4-6d36cdf5395e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:03:58.358619 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-40e92664-8077-4fcd-80e4-6d36cdf5395e None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:03:58.359839 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-40e92664-8077-4fcd-80e4-6d36cdf5395e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:03:58.367630 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 739/1483] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 21:03:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:03:58.404945 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b225501-25c2-4306-b6ce-f2224db5c3ba None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:03:58.415747 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b225501-25c2-4306-b6ce-f2224db5c3ba None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:03:58.419360 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6beb5fe-e52a-4bf2-a609-e2dda0aef907 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:03:58.420021 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6beb5fe-e52a-4bf2-a609-e2dda0aef907 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:03:58.420297 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6beb5fe-e52a-4bf2-a609-e2dda0aef907 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:03:58.420567 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6beb5fe-e52a-4bf2-a609-e2dda0aef907 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:03:58.430430 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6beb5fe-e52a-4bf2-a609-e2dda0aef907 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:03:58.431887 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6beb5fe-e52a-4bf2-a609-e2dda0aef907 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:03:58.441856 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 745/1484] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:03:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:04:00.794053 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf690234-c087-4722-9bf6-72a6fd7a54fe None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:04:00.794690 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf690234-c087-4722-9bf6-72a6fd7a54fe None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:04:00.794690 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf690234-c087-4722-9bf6-72a6fd7a54fe None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:04:00.795978 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 740/1485] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 21:04:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:04:00.801333 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49626cc-e136-4cf6-bd91-cd3728e5ae3d None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:04:00.801795 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49626cc-e136-4cf6-bd91-cd3728e5ae3d None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:04:00.801926 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49626cc-e136-4cf6-bd91-cd3728e5ae3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:04:00.820688 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-d49626cc-e136-4cf6-bd91-cd3728e5ae3d None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:04:00.821887 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d49626cc-e136-4cf6-bd91-cd3728e5ae3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:04:00.830511 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 746/1486] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 21:04:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:04:00.870188 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf690234-c087-4722-9bf6-72a6fd7a54fe None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:04:00.872177 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-cf690234-c087-4722-9bf6-72a6fd7a54fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:04:00.885815 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf690234-c087-4722-9bf6-72a6fd7a54fe None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:04:00.890242 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed02511a-b58c-42cf-b54a-4082da8b8077 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:04:00.890881 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02511a-b58c-42cf-b54a-4082da8b8077 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:04:00.891168 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02511a-b58c-42cf-b54a-4082da8b8077 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:04:00.891462 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02511a-b58c-42cf-b54a-4082da8b8077 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:04:00.900575 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed02511a-b58c-42cf-b54a-4082da8b8077 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:04:00.901996 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed02511a-b58c-42cf-b54a-4082da8b8077 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:04:00.912230 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 741/1487] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:04:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:04:03.352261 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad08a80-6952-41c9-bc13-e585dc42a77a None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:04:03.352804 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad08a80-6952-41c9-bc13-e585dc42a77a None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:04:03.352804 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad08a80-6952-41c9-bc13-e585dc42a77a None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:04:03.354204 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 747/1488] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 21:04:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:04:03.359969 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47439602-ad5f-47ee-9fb9-dfa43e18f440 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:04:03.360382 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47439602-ad5f-47ee-9fb9-dfa43e18f440 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:04:03.360507 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47439602-ad5f-47ee-9fb9-dfa43e18f440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:04:03.378758 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-47439602-ad5f-47ee-9fb9-dfa43e18f440 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:04:03.379982 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-47439602-ad5f-47ee-9fb9-dfa43e18f440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:04:03.387861 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 742/1489] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 21:04:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:04:03.429151 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad08a80-6952-41c9-bc13-e585dc42a77a None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:04:03.439823 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad08a80-6952-41c9-bc13-e585dc42a77a None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:04:03.443344 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9f5dd6-2293-458f-ac76-e97500d8aa6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:04:03.443997 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f5dd6-2293-458f-ac76-e97500d8aa6c service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:04:03.444272 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f5dd6-2293-458f-ac76-e97500d8aa6c service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:04:03.444541 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f5dd6-2293-458f-ac76-e97500d8aa6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:04:03.453109 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9f5dd6-2293-458f-ac76-e97500d8aa6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:04:03.454523 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9f5dd6-2293-458f-ac76-e97500d8aa6c service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:04:03.463647 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 748/1490] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:04:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:04:06.239155 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe9ff0b-15df-4568-bac4-e9ba1de1377b None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:04:06.239722 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe9ff0b-15df-4568-bac4-e9ba1de1377b None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:04:06.239722 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe9ff0b-15df-4568-bac4-e9ba1de1377b None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:04:06.241041 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 743/1491] 10.222.0.52 () {54 vars in 926 bytes} [Sat May 14 21:04:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:04:06.246876 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e0f9c0-9408-4864-bce9-195f147a17a9 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:04:06.247329 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e0f9c0-9408-4864-bce9-195f147a17a9 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:04:06.247443 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e0f9c0-9408-4864-bce9-195f147a17a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:04:06.264893 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-c3e0f9c0-9408-4864-bce9-195f147a17a9 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:04:06.266091 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c3e0f9c0-9408-4864-bce9-195f147a17a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:04:06.273898 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 749/1492] 10.222.0.52 () {58 vars in 1023 bytes} [Sat May 14 21:04:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:04:06.313946 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe9ff0b-15df-4568-bac4-e9ba1de1377b None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:04:06.324456 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe9ff0b-15df-4568-bac4-e9ba1de1377b None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:04:06.327970 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44023c25-fd8b-450a-98ef-07c079a80259 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:04:06.328600 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44023c25-fd8b-450a-98ef-07c079a80259 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:04:06.328881 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44023c25-fd8b-450a-98ef-07c079a80259 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:04:06.329155 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44023c25-fd8b-450a-98ef-07c079a80259 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:04:06.337743 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44023c25-fd8b-450a-98ef-07c079a80259 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:04:06.339174 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44023c25-fd8b-450a-98ef-07c079a80259 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:04:06.348593 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 744/1493] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:04:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:06:12.493338 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf00bbc-14ee-4f52-80d5-3e8c9bd41449 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:06:12.494200 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf00bbc-14ee-4f52-80d5-3e8c9bd41449 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:06:12.494479 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf00bbc-14ee-4f52-80d5-3e8c9bd41449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:06:12.512396 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-bdf00bbc-14ee-4f52-80d5-3e8c9bd41449 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:06:12.513563 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-bdf00bbc-14ee-4f52-80d5-3e8c9bd41449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:06:12.521767 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 750/1494] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:06:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:06:12.531605 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8912ad89-6d3c-4198-9346-f361501b45dc None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:06:12.532126 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8912ad89-6d3c-4198-9346-f361501b45dc None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:06:12.532245 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8912ad89-6d3c-4198-9346-f361501b45dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:06:12.550358 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-8912ad89-6d3c-4198-9346-f361501b45dc None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:06:12.551567 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8912ad89-6d3c-4198-9346-f361501b45dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:06:12.559402 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 745/1495] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:06:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:06:12.563859 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf00bbc-14ee-4f52-80d5-3e8c9bd41449 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:06:12.573359 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf00bbc-14ee-4f52-80d5-3e8c9bd41449 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:06:12.577770 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a96be-dbcf-4441-aeb9-810b1a5fe96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:06:12.578407 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a96be-dbcf-4441-aeb9-810b1a5fe96f admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:06:12.578687 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a96be-dbcf-4441-aeb9-810b1a5fe96f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:06:12.578959 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a96be-dbcf-4441-aeb9-810b1a5fe96f admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:06:12.579691 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4a96be-dbcf-4441-aeb9-810b1a5fe96f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:06:12.579996 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4a96be-dbcf-4441-aeb9-810b1a5fe96f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:06:12.580990 ncdv-master-1 devstack@keystone.service[91106]: WARNING py.warnings [None req-cc4a96be-dbcf-4441-aeb9-810b1a5fe96f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:06:12.580990 ncdv-master-1 devstack@keystone.service[91106]: warnings.warn(msg) May 14 21:06:12.580990 ncdv-master-1 devstack@keystone.service[91106]: May 14 21:06:12.581878 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4a96be-dbcf-4441-aeb9-810b1a5fe96f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:06:12.593438 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 751/1496] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:06:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:06:12.601757 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8912ad89-6d3c-4198-9346-f361501b45dc None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:06:12.611759 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8912ad89-6d3c-4198-9346-f361501b45dc None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:06:12.616282 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb98d29c-4ac2-40df-8dc6-e9f129cf1ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:06:12.616928 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb98d29c-4ac2-40df-8dc6-e9f129cf1ea8 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:06:12.617215 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb98d29c-4ac2-40df-8dc6-e9f129cf1ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:06:12.617496 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb98d29c-4ac2-40df-8dc6-e9f129cf1ea8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:06:12.618209 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb98d29c-4ac2-40df-8dc6-e9f129cf1ea8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:06:12.620160 ncdv-master-1 devstack@keystone.service[91107]: WARNING py.warnings [None req-fb98d29c-4ac2-40df-8dc6-e9f129cf1ea8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 14 21:06:12.620160 ncdv-master-1 devstack@keystone.service[91107]: warnings.warn(msg) May 14 21:06:12.620160 ncdv-master-1 devstack@keystone.service[91107]: May 14 21:06:12.621535 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb98d29c-4ac2-40df-8dc6-e9f129cf1ea8 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:06:12.700224 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 746/1497] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:06:12 2022] POST /identity/v3/projects => generated 377 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:06:12.701348 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a96be-dbcf-4441-aeb9-810b1a5fe96f admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:06:12.711550 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a96be-dbcf-4441-aeb9-810b1a5fe96f admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:06:12.768744 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca5ca5a-1e70-4ea1-ad03-5b0c7a2aeb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:06:12.769406 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca5ca5a-1e70-4ea1-ad03-5b0c7a2aeb37 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:06:12.769685 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca5ca5a-1e70-4ea1-ad03-5b0c7a2aeb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:06:12.769954 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca5ca5a-1e70-4ea1-ad03-5b0c7a2aeb37 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:06:12.770645 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca5ca5a-1e70-4ea1-ad03-5b0c7a2aeb37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:06:12.771667 ncdv-master-1 devstack@keystone.service[91106]: WARNING py.warnings [None req-2ca5ca5a-1e70-4ea1-ad03-5b0c7a2aeb37 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 14 21:06:12.771667 ncdv-master-1 devstack@keystone.service[91106]: warnings.warn(msg) May 14 21:06:12.771667 ncdv-master-1 devstack@keystone.service[91106]: May 14 21:06:12.772884 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca5ca5a-1e70-4ea1-ad03-5b0c7a2aeb37 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:06:12.866104 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 752/1498] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:06:12 2022] POST /identity/v3/users => generated 289 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:06:12.870207 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb98d29c-4ac2-40df-8dc6-e9f129cf1ea8 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:06:12.880934 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb98d29c-4ac2-40df-8dc6-e9f129cf1ea8 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:06:12.886444 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ba2e0e-6eab-4a91-998c-b08f82df3bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:06:12.886814 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba2e0e-6eab-4a91-998c-b08f82df3bbf admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:06:12.887102 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba2e0e-6eab-4a91-998c-b08f82df3bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:06:12.887380 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba2e0e-6eab-4a91-998c-b08f82df3bbf admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:06:12.888130 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ba2e0e-6eab-4a91-998c-b08f82df3bbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:06:12.889139 ncdv-master-1 devstack@keystone.service[91107]: WARNING py.warnings [None req-d9ba2e0e-6eab-4a91-998c-b08f82df3bbf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:06:12.889139 ncdv-master-1 devstack@keystone.service[91107]: warnings.warn(msg) May 14 21:06:12.889139 ncdv-master-1 devstack@keystone.service[91107]: May 14 21:06:12.890040 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ba2e0e-6eab-4a91-998c-b08f82df3bbf admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:06:12.904687 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 747/1499] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:06:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:06:12.908762 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca5ca5a-1e70-4ea1-ad03-5b0c7a2aeb37 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:06:12.919150 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca5ca5a-1e70-4ea1-ad03-5b0c7a2aeb37 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:06:12.923733 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c986754-c8cd-4e78-84bb-073889e9c4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:06:12.924406 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c986754-c8cd-4e78-84bb-073889e9c4b8 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:06:12.924691 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c986754-c8cd-4e78-84bb-073889e9c4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:06:12.924969 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c986754-c8cd-4e78-84bb-073889e9c4b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:06:12.925684 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c986754-c8cd-4e78-84bb-073889e9c4b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:06:12.926689 ncdv-master-1 devstack@keystone.service[91106]: WARNING py.warnings [None req-5c986754-c8cd-4e78-84bb-073889e9c4b8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:06:12.926689 ncdv-master-1 devstack@keystone.service[91106]: warnings.warn(msg) May 14 21:06:12.926689 ncdv-master-1 devstack@keystone.service[91106]: May 14 21:06:12.927651 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c986754-c8cd-4e78-84bb-073889e9c4b8 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:06:12.941745 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 753/1500] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:06:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:06:12.946001 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ba2e0e-6eab-4a91-998c-b08f82df3bbf admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:06:12.956513 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ba2e0e-6eab-4a91-998c-b08f82df3bbf admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:06:12.960988 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e47632-8ef8-46e8-a399-e23b1d589e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:06:12.961859 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e47632-8ef8-46e8-a399-e23b1d589e25 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:06:12.962142 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e47632-8ef8-46e8-a399-e23b1d589e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:06:12.962417 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e47632-8ef8-46e8-a399-e23b1d589e25 admin admin] PATH_INFO: `/v3/projects/f4474b3517394bc0a943dfb1f668ca2f/users/298dcf47c7fc443a8781364dcb074d4a/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:06:12.977215 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e47632-8ef8-46e8-a399-e23b1d589e25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4474b3517394bc0a943dfb1f668ca2f, user_id=298dcf47c7fc443a8781364dcb074d4a, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:06:12.978244 ncdv-master-1 devstack@keystone.service[91107]: WARNING py.warnings [None req-b9e47632-8ef8-46e8-a399-e23b1d589e25 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 14 21:06:12.978244 ncdv-master-1 devstack@keystone.service[91107]: warnings.warn(msg) May 14 21:06:12.978244 ncdv-master-1 devstack@keystone.service[91107]: May 14 21:06:12.980401 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e47632-8ef8-46e8-a399-e23b1d589e25 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:06:13.094614 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 748/1501] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:06:12 2022] PUT /identity/v3/projects/f4474b3517394bc0a943dfb1f668ca2f/users/298dcf47c7fc443a8781364dcb074d4a/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:06:13.105794 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae10da95-38b1-474a-9e0d-4924ae2d09c0 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:06:13.106088 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae10da95-38b1-474a-9e0d-4924ae2d09c0 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:06:13.106369 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae10da95-38b1-474a-9e0d-4924ae2d09c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:06:13.132855 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-ae10da95-38b1-474a-9e0d-4924ae2d09c0 None None] MFA Rules not processed for user `298dcf47c7fc443a8781364dcb074d4a`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:06:13.134073 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ae10da95-38b1-474a-9e0d-4924ae2d09c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:06:13.200170 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 754/1502] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:06:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:06:13.213335 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a4dda-6f91-44c1-8533-735aa64c0851 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:06:13.213622 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a4dda-6f91-44c1-8533-735aa64c0851 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:06:13.213923 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a4dda-6f91-44c1-8533-735aa64c0851 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:06:13.215280 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 749/1503] 10.222.0.52 () {54 vars in 963 bytes} [Sat May 14 21:06:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:06:13.219993 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5274de6-04e8-4fdc-a437-72f91b647d59 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:06:13.220290 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5274de6-04e8-4fdc-a437-72f91b647d59 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:06:13.220566 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5274de6-04e8-4fdc-a437-72f91b647d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:06:13.237766 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-d5274de6-04e8-4fdc-a437-72f91b647d59 None None] MFA Rules not processed for user `198271d1c0d44cb58bace41a65f4b94c`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:06:13.238942 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d5274de6-04e8-4fdc-a437-72f91b647d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:06:13.287179 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 755/1504] 10.222.0.52 () {58 vars in 1060 bytes} [Sat May 14 21:06:13 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:06:13.294935 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a4dda-6f91-44c1-8533-735aa64c0851 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:06:13.305627 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a4dda-6f91-44c1-8533-735aa64c0851 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:06:13.309770 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f34d4-9d8f-420a-99aa-0f8ea6855e20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198271d1c0d44cb58bace41a65f4b94c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:06:13.310397 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f34d4-9d8f-420a-99aa-0f8ea6855e20 service cinder] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:06:13.310678 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f34d4-9d8f-420a-99aa-0f8ea6855e20 service cinder] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:06:13.310957 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f34d4-9d8f-420a-99aa-0f8ea6855e20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:06:13.319218 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7f34d4-9d8f-420a-99aa-0f8ea6855e20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:06:13.320658 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7f34d4-9d8f-420a-99aa-0f8ea6855e20 service cinder] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:06:13.329486 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 750/1505] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:06:13 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:06:13.372274 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43beeaee-0e4f-4187-9635-9b7c1ff04ddc None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:06:13.372562 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43beeaee-0e4f-4187-9635-9b7c1ff04ddc None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:06:13.372837 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43beeaee-0e4f-4187-9635-9b7c1ff04ddc None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:06:13.374164 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 756/1506] 10.222.0.52 () {52 vars in 829 bytes} [Sat May 14 21:06:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:06:13.377807 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f34d4-9d8f-420a-99aa-0f8ea6855e20 service cinder] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:06:13.443965 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f34d4-9d8f-420a-99aa-0f8ea6855e20 service cinder] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:06:13.451272 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c72d499-d2db-4008-8cad-0160c43fa6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:06:13.452165 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72d499-d2db-4008-8cad-0160c43fa6bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:06:13.452445 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72d499-d2db-4008-8cad-0160c43fa6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:06:13.452716 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72d499-d2db-4008-8cad-0160c43fa6bc admin admin] PATH_INFO: `/v3/users/298dcf47c7fc443a8781364dcb074d4a` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:06:13.453892 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c72d499-d2db-4008-8cad-0160c43fa6bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=298dcf47c7fc443a8781364dcb074d4a)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:06:13.454903 ncdv-master-1 devstack@keystone.service[91107]: WARNING py.warnings [None req-0c72d499-d2db-4008-8cad-0160c43fa6bc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 14 21:06:13.454903 ncdv-master-1 devstack@keystone.service[91107]: warnings.warn(msg) May 14 21:06:13.454903 ncdv-master-1 devstack@keystone.service[91107]: May 14 21:06:13.456141 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c72d499-d2db-4008-8cad-0160c43fa6bc admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:06:13.684697 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0c72d499-d2db-4008-8cad-0160c43fa6bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '298dcf47c7fc443a8781364dcb074d4a'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:06:13.696751 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0c72d499-d2db-4008-8cad-0160c43fa6bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '298dcf47c7fc443a8781364dcb074d4a'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:06:13.697503 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0c72d499-d2db-4008-8cad-0160c43fa6bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '298dcf47c7fc443a8781364dcb074d4a'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:06:13.763039 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0c72d499-d2db-4008-8cad-0160c43fa6bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '298dcf47c7fc443a8781364dcb074d4a'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:06:13.781387 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0c72d499-d2db-4008-8cad-0160c43fa6bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '298dcf47c7fc443a8781364dcb074d4a'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:06:13.787642 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 751/1507] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:06:13 2022] DELETE /identity/v3/users/298dcf47c7fc443a8781364dcb074d4a => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:06:13.792224 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ef0f1-1b2d-4471-9c97-346a45cccf9a None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:06:13.792759 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ef0f1-1b2d-4471-9c97-346a45cccf9a None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:06:13.792759 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ef0f1-1b2d-4471-9c97-346a45cccf9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:06:13.816294 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-800ef0f1-1b2d-4471-9c97-346a45cccf9a None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:06:13.817526 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-800ef0f1-1b2d-4471-9c97-346a45cccf9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:06:13.880346 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 757/1508] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:06:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:06:13.904450 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c72d499-d2db-4008-8cad-0160c43fa6bc admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:06:13.904450 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-0c72d499-d2db-4008-8cad-0160c43fa6bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:06:13.949612 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c72d499-d2db-4008-8cad-0160c43fa6bc admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:06:13.953230 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d19c9c-c60e-41c2-ad15-e21fa6ccc476 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:06:13.953877 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d19c9c-c60e-41c2-ad15-e21fa6ccc476 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:06:13.954157 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d19c9c-c60e-41c2-ad15-e21fa6ccc476 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:06:13.954432 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d19c9c-c60e-41c2-ad15-e21fa6ccc476 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:06:13.963164 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d19c9c-c60e-41c2-ad15-e21fa6ccc476 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:06:13.965230 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d19c9c-c60e-41c2-ad15-e21fa6ccc476 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:06:13.974387 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 752/1509] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:06:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:06:14.422501 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800ef0f1-1b2d-4471-9c97-346a45cccf9a None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:06:14.423958 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-800ef0f1-1b2d-4471-9c97-346a45cccf9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:06:14.437398 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800ef0f1-1b2d-4471-9c97-346a45cccf9a None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:06:14.444243 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab56500-ef7f-4751-b5da-f40a5a024278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:06:14.445177 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab56500-ef7f-4751-b5da-f40a5a024278 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:06:14.445422 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab56500-ef7f-4751-b5da-f40a5a024278 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:06:14.448733 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab56500-ef7f-4751-b5da-f40a5a024278 admin admin] PATH_INFO: `/v3/projects/f4474b3517394bc0a943dfb1f668ca2f` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:06:14.448733 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab56500-ef7f-4751-b5da-f40a5a024278 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4474b3517394bc0a943dfb1f668ca2f)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:06:14.448733 ncdv-master-1 devstack@keystone.service[91106]: WARNING py.warnings [None req-eab56500-ef7f-4751-b5da-f40a5a024278 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 14 21:06:14.448733 ncdv-master-1 devstack@keystone.service[91106]: warnings.warn(msg) May 14 21:06:14.448733 ncdv-master-1 devstack@keystone.service[91106]: May 14 21:06:14.450657 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab56500-ef7f-4751-b5da-f40a5a024278 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:06:14.632648 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-eab56500-ef7f-4751-b5da-f40a5a024278 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4474b3517394bc0a943dfb1f668ca2f', 'request_id': 'req-eab56500-ef7f-4751-b5da-f40a5a024278'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:06:14.639368 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-eab56500-ef7f-4751-b5da-f40a5a024278 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4474b3517394bc0a943dfb1f668ca2f', 'request_id': 'req-eab56500-ef7f-4751-b5da-f40a5a024278'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:06:14.694821 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-eab56500-ef7f-4751-b5da-f40a5a024278 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4474b3517394bc0a943dfb1f668ca2f', 'request_id': 'req-eab56500-ef7f-4751-b5da-f40a5a024278'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:06:14.714860 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-eab56500-ef7f-4751-b5da-f40a5a024278 admin admin] The token cache is being invalidate because project f4474b3517394bc0a943dfb1f668ca2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:06:14.715147 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-eab56500-ef7f-4751-b5da-f40a5a024278 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:06:14.715783 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-eab56500-ef7f-4751-b5da-f40a5a024278 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:06:14.717424 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 758/1510] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:06:14 2022] DELETE /identity/v3/projects/f4474b3517394bc0a943dfb1f668ca2f => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:09:13.321330 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe4c0a-04ac-459f-b1c5-f4fc816306f4 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:09:13.321931 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe4c0a-04ac-459f-b1c5-f4fc816306f4 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:09:13.321931 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe4c0a-04ac-459f-b1c5-f4fc816306f4 None None] PATH_INFO: `/v3` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:09:13.323530 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 753/1511] 10.222.0.48 () {54 vars in 925 bytes} [Sat May 14 21:09:13 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:09:13.329749 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd3be9-c3a3-4a62-9c2b-a5abe9546094 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:09:13.330166 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd3be9-c3a3-4a62-9c2b-a5abe9546094 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:09:13.330317 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd3be9-c3a3-4a62-9c2b-a5abe9546094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:09:13.348093 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-fcfd3be9-c3a3-4a62-9c2b-a5abe9546094 None None] MFA Rules not processed for user `0812ae67e44d483baf2dbb1a5332a1d7`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:09:13.349286 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-fcfd3be9-c3a3-4a62-9c2b-a5abe9546094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:09:13.410877 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 759/1512] 10.222.0.48 () {58 vars in 1015 bytes} [Sat May 14 21:09:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:09:13.653164 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab7a130-283e-4ed1-9514-7d7b86fb6dd4 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:09:13.653390 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab7a130-283e-4ed1-9514-7d7b86fb6dd4 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:09:13.653652 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab7a130-283e-4ed1-9514-7d7b86fb6dd4 None None] PATH_INFO: `/v3` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:09:13.654946 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 754/1513] 10.222.0.36 () {54 vars in 925 bytes} [Sat May 14 21:09:13 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:09:13.661076 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0306283-00fe-4580-bedf-0148238a3f11 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:09:13.661390 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0306283-00fe-4580-bedf-0148238a3f11 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:09:13.661668 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0306283-00fe-4580-bedf-0148238a3f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:09:13.680120 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-a0306283-00fe-4580-bedf-0148238a3f11 None None] MFA Rules not processed for user `0812ae67e44d483baf2dbb1a5332a1d7`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:09:13.681404 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-a0306283-00fe-4580-bedf-0148238a3f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:09:13.691197 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 760/1514] 10.222.0.36 () {58 vars in 1015 bytes} [Sat May 14 21:09:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:09:17.502841 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88483dfe-bb89-4b7e-a5cb-6bf88870ad26 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:09:17.503402 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88483dfe-bb89-4b7e-a5cb-6bf88870ad26 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:09:17.503402 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88483dfe-bb89-4b7e-a5cb-6bf88870ad26 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:09:17.505082 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 755/1515] 10.222.0.52 () {54 vars in 960 bytes} [Sat May 14 21:09:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:09:17.510412 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d60fd-9a4d-4a9e-a70a-46f007121b04 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:09:17.513461 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d60fd-9a4d-4a9e-a70a-46f007121b04 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:09:17.513461 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d60fd-9a4d-4a9e-a70a-46f007121b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:09:17.530102 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-dd2d60fd-9a4d-4a9e-a70a-46f007121b04 None None] MFA Rules not processed for user `0812ae67e44d483baf2dbb1a5332a1d7`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:09:17.531357 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-dd2d60fd-9a4d-4a9e-a70a-46f007121b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:09:17.540156 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 761/1516] 10.222.0.52 () {58 vars in 1057 bytes} [Sat May 14 21:09:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:09:17.547708 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88483dfe-bb89-4b7e-a5cb-6bf88870ad26 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:09:17.561603 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88483dfe-bb89-4b7e-a5cb-6bf88870ad26 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:09:17.566600 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd21739-d1fb-4e87-ad9a-353daabcc150 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:09:17.570872 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd21739-d1fb-4e87-ad9a-353daabcc150 service placement] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:09:17.570872 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd21739-d1fb-4e87-ad9a-353daabcc150 service placement] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:09:17.570872 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd21739-d1fb-4e87-ad9a-353daabcc150 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:09:17.576966 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd21739-d1fb-4e87-ad9a-353daabcc150 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:09:17.578561 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd21739-d1fb-4e87-ad9a-353daabcc150 service placement] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:09:17.588293 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 756/1517] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:09:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:09:17.651717 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc801c2-3010-476c-bcd5-d94ca3fe5302 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:09:17.652020 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc801c2-3010-476c-bcd5-d94ca3fe5302 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:09:17.652330 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc801c2-3010-476c-bcd5-d94ca3fe5302 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:09:17.653883 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 762/1518] 10.222.0.52 () {54 vars in 960 bytes} [Sat May 14 21:09:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:09:17.659161 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd9149-5710-46be-956c-e8725b82c11d None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:09:17.659498 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd9149-5710-46be-956c-e8725b82c11d None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:09:17.659802 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd9149-5710-46be-956c-e8725b82c11d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:09:17.682732 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-d7fd9149-5710-46be-956c-e8725b82c11d None None] MFA Rules not processed for user `0812ae67e44d483baf2dbb1a5332a1d7`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:09:17.684633 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-d7fd9149-5710-46be-956c-e8725b82c11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:09:17.693693 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 757/1519] 10.222.0.52 () {58 vars in 1057 bytes} [Sat May 14 21:09:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:09:17.701618 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc801c2-3010-476c-bcd5-d94ca3fe5302 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:09:17.715925 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc801c2-3010-476c-bcd5-d94ca3fe5302 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:09:17.721146 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c285ebda-11a6-4e54-b7b0-cf009e19e2d5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:09:17.721784 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285ebda-11a6-4e54-b7b0-cf009e19e2d5 service placement] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:09:17.722067 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285ebda-11a6-4e54-b7b0-cf009e19e2d5 service placement] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:09:17.722342 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285ebda-11a6-4e54-b7b0-cf009e19e2d5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:09:17.731683 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c285ebda-11a6-4e54-b7b0-cf009e19e2d5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:09:17.733279 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c285ebda-11a6-4e54-b7b0-cf009e19e2d5 service placement] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:09:17.742973 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 763/1520] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:09:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:09:55.001601 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b6e35e-bc0f-4f32-a5a1-098ab75dcb8a None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:09:55.002197 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b6e35e-bc0f-4f32-a5a1-098ab75dcb8a None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:09:55.002197 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b6e35e-bc0f-4f32-a5a1-098ab75dcb8a None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:09:55.003516 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 758/1521] 127.0.0.1 () {54 vars in 901 bytes} [Sat May 14 21:09:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:09:55.008593 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b5100-96f1-46d6-a789-10bfc34a425a None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:09:55.009069 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b5100-96f1-46d6-a789-10bfc34a425a None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:09:55.009188 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b5100-96f1-46d6-a789-10bfc34a425a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:09:55.027087 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-e49b5100-96f1-46d6-a789-10bfc34a425a None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:09:55.028322 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e49b5100-96f1-46d6-a789-10bfc34a425a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:09:55.086124 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 764/1522] 127.0.0.1 () {58 vars in 998 bytes} [Sat May 14 21:09:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:09:55.260885 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b6e35e-bc0f-4f32-a5a1-098ab75dcb8a None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:09:55.262475 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b0b6e35e-bc0f-4f32-a5a1-098ab75dcb8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:09:55.335210 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b6e35e-bc0f-4f32-a5a1-098ab75dcb8a None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:09:55.340619 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eb6d03-b92d-442f-8ed1-1384e1a501ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:09:55.341256 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb6d03-b92d-442f-8ed1-1384e1a501ca service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:09:55.341541 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb6d03-b92d-442f-8ed1-1384e1a501ca service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:09:55.341817 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb6d03-b92d-442f-8ed1-1384e1a501ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:09:55.349924 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eb6d03-b92d-442f-8ed1-1384e1a501ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:09:55.351536 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eb6d03-b92d-442f-8ed1-1384e1a501ca service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:09:55.360775 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 759/1523] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:09:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:09:56.269211 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f316a31a-d464-4ad2-a066-49f7cc084498 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:09:56.269790 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f316a31a-d464-4ad2-a066-49f7cc084498 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:09:56.269790 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f316a31a-d464-4ad2-a066-49f7cc084498 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:09:56.271134 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 765/1524] 127.0.0.1 () {54 vars in 901 bytes} [Sat May 14 21:09:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:09:56.275887 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30662419-fb45-4d59-a89f-19ba686ad73a None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:09:56.276291 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30662419-fb45-4d59-a89f-19ba686ad73a None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:09:56.276452 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30662419-fb45-4d59-a89f-19ba686ad73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:09:56.294002 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-30662419-fb45-4d59-a89f-19ba686ad73a None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:09:56.295224 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-30662419-fb45-4d59-a89f-19ba686ad73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:09:56.302997 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 760/1525] 127.0.0.1 () {58 vars in 998 bytes} [Sat May 14 21:09:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:09:56.458872 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f316a31a-d464-4ad2-a066-49f7cc084498 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:09:56.473401 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f316a31a-d464-4ad2-a066-49f7cc084498 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:09:56.478765 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb69574c-e8c7-4db1-bd95-e5738d17b479 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:09:56.479394 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69574c-e8c7-4db1-bd95-e5738d17b479 service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:09:56.479708 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69574c-e8c7-4db1-bd95-e5738d17b479 service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:09:56.479988 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69574c-e8c7-4db1-bd95-e5738d17b479 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:09:56.488079 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb69574c-e8c7-4db1-bd95-e5738d17b479 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:09:56.489661 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb69574c-e8c7-4db1-bd95-e5738d17b479 service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:09:56.498907 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 766/1526] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:09:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:10:00.478116 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5ba2f-c9b1-4ca8-9cb0-7d90bbee7fc9 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:10:00.478670 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5ba2f-c9b1-4ca8-9cb0-7d90bbee7fc9 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:10:00.478794 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5ba2f-c9b1-4ca8-9cb0-7d90bbee7fc9 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:10:00.480090 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 761/1527] 127.0.0.1 () {54 vars in 916 bytes} [Sat May 14 21:10:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:10:00.485304 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb3d60-687a-45db-8651-396010ba9cb5 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:10:00.485749 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb3d60-687a-45db-8651-396010ba9cb5 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:10:00.485864 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb3d60-687a-45db-8651-396010ba9cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:10:00.504634 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-42fb3d60-687a-45db-8651-396010ba9cb5 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:10:00.506078 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-42fb3d60-687a-45db-8651-396010ba9cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:10:00.513899 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 767/1528] 127.0.0.1 () {58 vars in 1013 bytes} [Sat May 14 21:10:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:10:00.551068 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d5ba2f-c9b1-4ca8-9cb0-7d90bbee7fc9 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:10:00.552836 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-03d5ba2f-c9b1-4ca8-9cb0-7d90bbee7fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:10:00.610177 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d5ba2f-c9b1-4ca8-9cb0-7d90bbee7fc9 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:10:00.614279 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07af2e07-5682-470f-b74b-7b0f12698dc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:10:00.614924 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af2e07-5682-470f-b74b-7b0f12698dc0 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:10:00.615205 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af2e07-5682-470f-b74b-7b0f12698dc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:10:00.615500 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af2e07-5682-470f-b74b-7b0f12698dc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:10:00.624259 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07af2e07-5682-470f-b74b-7b0f12698dc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:10:00.625689 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07af2e07-5682-470f-b74b-7b0f12698dc0 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:10:00.635823 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 762/1529] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:10:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:10:02.917113 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c6ba2-98fb-4be7-b370-0694d48d361a None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:10:02.917642 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c6ba2-98fb-4be7-b370-0694d48d361a None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:10:02.917642 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c6ba2-98fb-4be7-b370-0694d48d361a None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:10:02.919060 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 768/1530] 127.0.0.1 () {54 vars in 916 bytes} [Sat May 14 21:10:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:10:02.925040 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab1d20b-cafe-466e-b599-8535119403c4 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:10:02.925591 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab1d20b-cafe-466e-b599-8535119403c4 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:10:02.925591 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab1d20b-cafe-466e-b599-8535119403c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:10:02.948012 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-fab1d20b-cafe-466e-b599-8535119403c4 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:10:02.949221 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-fab1d20b-cafe-466e-b599-8535119403c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:10:02.957187 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 763/1531] 127.0.0.1 () {58 vars in 1013 bytes} [Sat May 14 21:10:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:10:02.995234 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16c6ba2-98fb-4be7-b370-0694d48d361a None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:10:03.006474 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16c6ba2-98fb-4be7-b370-0694d48d361a None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:10:03.009901 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8fc92c-530d-4eb7-90d9-7f9dcd3230f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:10:03.010522 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8fc92c-530d-4eb7-90d9-7f9dcd3230f6 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:10:03.010801 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8fc92c-530d-4eb7-90d9-7f9dcd3230f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:10:03.011071 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8fc92c-530d-4eb7-90d9-7f9dcd3230f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:10:03.020110 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8fc92c-530d-4eb7-90d9-7f9dcd3230f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:10:03.021566 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8fc92c-530d-4eb7-90d9-7f9dcd3230f6 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:10:03.030685 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 769/1532] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:10:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:10:51.768134 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844a88b-570b-49b7-bc8f-4513a89197cc None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:10:51.768767 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844a88b-570b-49b7-bc8f-4513a89197cc None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:10:51.768767 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844a88b-570b-49b7-bc8f-4513a89197cc None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:10:51.770069 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 764/1533] 10.222.0.52 () {54 vars in 921 bytes} [Sat May 14 21:10:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:10:51.775203 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbfe686-835c-4058-ac81-7c7d0098912f None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:10:51.775734 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbfe686-835c-4058-ac81-7c7d0098912f None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:10:51.775843 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbfe686-835c-4058-ac81-7c7d0098912f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:10:51.794183 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-4dbfe686-835c-4058-ac81-7c7d0098912f None None] MFA Rules not processed for user `0812ae67e44d483baf2dbb1a5332a1d7`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:10:51.795383 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-4dbfe686-835c-4058-ac81-7c7d0098912f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:10:51.804488 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 770/1534] 10.222.0.52 () {58 vars in 1018 bytes} [Sat May 14 21:10:51 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:11:30.856089 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed31dd-2f27-4153-afe8-f590c8d86629 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:30.856656 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed31dd-2f27-4153-afe8-f590c8d86629 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:30.856656 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed31dd-2f27-4153-afe8-f590c8d86629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:30.962403 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-82ed31dd-2f27-4153-afe8-f590c8d86629 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:11:30.963699 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-82ed31dd-2f27-4153-afe8-f590c8d86629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:31.038449 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 765/1535] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:11:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:11:31.040100 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88510a-25d1-4f4f-9a4e-359fc4ea0214 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:31.040983 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88510a-25d1-4f4f-9a4e-359fc4ea0214 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:31.041465 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88510a-25d1-4f4f-9a4e-359fc4ea0214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:31.068261 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d3ea9a-2558-4a3c-a877-b50763787727 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:31.068550 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d3ea9a-2558-4a3c-a877-b50763787727 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:31.068998 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d3ea9a-2558-4a3c-a877-b50763787727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:31.073195 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-fe88510a-25d1-4f4f-9a4e-359fc4ea0214 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:11:31.074859 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-fe88510a-25d1-4f4f-9a4e-359fc4ea0214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:31.090354 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 771/1536] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:11:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:11:31.098765 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-e4d3ea9a-2558-4a3c-a877-b50763787727 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:11:31.100056 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e4d3ea9a-2558-4a3c-a877-b50763787727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:31.102761 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c9f17-1d9b-49c9-af33-5a55c4012d42 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:31.103294 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c9f17-1d9b-49c9-af33-5a55c4012d42 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:31.103797 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c9f17-1d9b-49c9-af33-5a55c4012d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:31.114604 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 766/1537] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:11:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:11:31.119361 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f040e629-c485-470a-b788-46bd5cc07d87 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:31.124542 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f040e629-c485-470a-b788-46bd5cc07d87 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:31.124542 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f040e629-c485-470a-b788-46bd5cc07d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:31.135125 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-773c9f17-1d9b-49c9-af33-5a55c4012d42 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:11:31.136574 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-773c9f17-1d9b-49c9-af33-5a55c4012d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:31.153284 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-f040e629-c485-470a-b788-46bd5cc07d87 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:11:31.154895 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-f040e629-c485-470a-b788-46bd5cc07d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:31.156238 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 772/1538] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:11:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:11:31.160192 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773c9f17-1d9b-49c9-af33-5a55c4012d42 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:31.174769 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773c9f17-1d9b-49c9-af33-5a55c4012d42 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:31.190203 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 767/1539] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:11:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:11:31.191073 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9250f559-4162-4721-bdb9-4eced6cfd1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:31.191202 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f040e629-c485-470a-b788-46bd5cc07d87 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:31.192347 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9250f559-4162-4721-bdb9-4eced6cfd1c5 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:31.192855 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9250f559-4162-4721-bdb9-4eced6cfd1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:31.193337 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9250f559-4162-4721-bdb9-4eced6cfd1c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:31.194310 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9250f559-4162-4721-bdb9-4eced6cfd1c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:11:31.198454 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9250f559-4162-4721-bdb9-4eced6cfd1c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:31.200573 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9250f559-4162-4721-bdb9-4eced6cfd1c5 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:31.215083 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f040e629-c485-470a-b788-46bd5cc07d87 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:31.223102 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 773/1540] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:11:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:11:31.224585 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef20bf7e-ea21-40c9-ad07-0d47b3e7af41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:31.225019 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e0fac-3bd7-4210-8712-e9312c6781b2 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:31.225266 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20bf7e-ea21-40c9-ad07-0d47b3e7af41 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:31.225555 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20bf7e-ea21-40c9-ad07-0d47b3e7af41 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:31.225832 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20bf7e-ea21-40c9-ad07-0d47b3e7af41 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:31.226134 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e0fac-3bd7-4210-8712-e9312c6781b2 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:31.226558 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef20bf7e-ea21-40c9-ad07-0d47b3e7af41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:11:31.226743 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e0fac-3bd7-4210-8712-e9312c6781b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:31.226847 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef20bf7e-ea21-40c9-ad07-0d47b3e7af41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:31.227995 ncdv-master-1 devstack@keystone.service[91107]: WARNING py.warnings [None req-ef20bf7e-ea21-40c9-ad07-0d47b3e7af41 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:11:31.227995 ncdv-master-1 devstack@keystone.service[91107]: warnings.warn(msg) May 14 21:11:31.227995 ncdv-master-1 devstack@keystone.service[91107]: May 14 21:11:31.229226 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef20bf7e-ea21-40c9-ad07-0d47b3e7af41 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:31.242855 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 768/1541] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:11:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:11:31.244456 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5414ea2-8bf9-4572-a428-20752e7071e6 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:31.244752 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5414ea2-8bf9-4572-a428-20752e7071e6 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:31.245035 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5414ea2-8bf9-4572-a428-20752e7071e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:31.260611 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-cb7e0fac-3bd7-4210-8712-e9312c6781b2 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:11:31.261860 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-cb7e0fac-3bd7-4210-8712-e9312c6781b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:31.263697 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-f5414ea2-8bf9-4572-a428-20752e7071e6 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:11:31.269186 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-f5414ea2-8bf9-4572-a428-20752e7071e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:31.271667 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 774/1542] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:11:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:11:31.273020 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd8c6f6-aa88-4eee-900e-c15550685f3d None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:31.273318 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd8c6f6-aa88-4eee-900e-c15550685f3d None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:31.273599 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd8c6f6-aa88-4eee-900e-c15550685f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:31.277234 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 769/1543] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:11:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:11:31.278051 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5414ea2-8bf9-4572-a428-20752e7071e6 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:31.289169 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5414ea2-8bf9-4572-a428-20752e7071e6 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:31.300718 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-bdd8c6f6-aa88-4eee-900e-c15550685f3d None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:11:31.301912 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-bdd8c6f6-aa88-4eee-900e-c15550685f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:31.304000 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d7829f-cfba-469a-a76d-f032452b24a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:31.304671 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7829f-cfba-469a-a76d-f032452b24a6 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:31.304954 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7829f-cfba-469a-a76d-f032452b24a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:31.305227 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7829f-cfba-469a-a76d-f032452b24a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:31.305916 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d7829f-cfba-469a-a76d-f032452b24a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:31.307891 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d7829f-cfba-469a-a76d-f032452b24a6 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:31.315656 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 775/1544] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:11:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:11:31.317547 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f52cc3-6471-4ae9-8ce8-b8c8e5b50c77 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:31.317834 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f52cc3-6471-4ae9-8ce8-b8c8e5b50c77 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:31.318115 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f52cc3-6471-4ae9-8ce8-b8c8e5b50c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:31.343072 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-b8f52cc3-6471-4ae9-8ce8-b8c8e5b50c77 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:11:31.344489 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b8f52cc3-6471-4ae9-8ce8-b8c8e5b50c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:31.354457 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 776/1545] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:11:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:11:31.355646 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f52cc3-6471-4ae9-8ce8-b8c8e5b50c77 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:31.366483 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f52cc3-6471-4ae9-8ce8-b8c8e5b50c77 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:31.373288 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41c61a4-b80c-4deb-a060-d02ad04082c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:31.373957 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c61a4-b80c-4deb-a060-d02ad04082c8 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:31.374273 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c61a4-b80c-4deb-a060-d02ad04082c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:31.374550 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c61a4-b80c-4deb-a060-d02ad04082c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:31.375238 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41c61a4-b80c-4deb-a060-d02ad04082c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:31.377010 ncdv-master-1 devstack@keystone.service[91106]: WARNING py.warnings [None req-d41c61a4-b80c-4deb-a060-d02ad04082c8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 14 21:11:31.377010 ncdv-master-1 devstack@keystone.service[91106]: warnings.warn(msg) May 14 21:11:31.377010 ncdv-master-1 devstack@keystone.service[91106]: May 14 21:11:31.378216 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41c61a4-b80c-4deb-a060-d02ad04082c8 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:31.416167 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 770/1546] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:11:31 2022] POST /identity/v3/projects => generated 383 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:11:31.417236 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d7829f-cfba-469a-a76d-f032452b24a6 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:31.466958 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 777/1547] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:11:31 2022] POST /identity/v3/projects => generated 387 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:11:31.468358 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afb55ac-7a12-473c-997a-41ce030decc8 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:31.468649 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afb55ac-7a12-473c-997a-41ce030decc8 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:31.469176 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afb55ac-7a12-473c-997a-41ce030decc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:31.477155 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d7829f-cfba-469a-a76d-f032452b24a6 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:31.487928 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-0afb55ac-7a12-473c-997a-41ce030decc8 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:11:31.489315 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-0afb55ac-7a12-473c-997a-41ce030decc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:31.530719 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1c39e8-1547-493c-a11d-9e984843e1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:31.531377 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c39e8-1547-493c-a11d-9e984843e1a7 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:31.531689 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c39e8-1547-493c-a11d-9e984843e1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:31.531965 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c39e8-1547-493c-a11d-9e984843e1a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:31.533733 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1c39e8-1547-493c-a11d-9e984843e1a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:11:31.534038 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1c39e8-1547-493c-a11d-9e984843e1a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:31.535668 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1c39e8-1547-493c-a11d-9e984843e1a7 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:31.546721 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 771/1548] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:11:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:11:31.547065 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 778/1549] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:11:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:11:31.548508 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e02753-1f37-4fb1-8a1b-27e8f8249ac7 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:31.548718 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e02753-1f37-4fb1-8a1b-27e8f8249ac7 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:31.548995 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e02753-1f37-4fb1-8a1b-27e8f8249ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:31.549083 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a035ed6-c16b-4e3d-afe1-fc0d76aeff24 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:31.549279 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a035ed6-c16b-4e3d-afe1-fc0d76aeff24 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:31.549553 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a035ed6-c16b-4e3d-afe1-fc0d76aeff24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:31.567910 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-67e02753-1f37-4fb1-8a1b-27e8f8249ac7 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:11:31.569247 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-67e02753-1f37-4fb1-8a1b-27e8f8249ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:31.569412 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-6a035ed6-c16b-4e3d-afe1-fc0d76aeff24 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:11:31.570556 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-6a035ed6-c16b-4e3d-afe1-fc0d76aeff24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:31.577168 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 772/1550] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:11:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:11:31.582431 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 779/1551] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:11:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:11:31.582569 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84daf978-8452-4c25-9ee1-d6043a192eb9 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:31.582569 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84daf978-8452-4c25-9ee1-d6043a192eb9 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:31.582569 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84daf978-8452-4c25-9ee1-d6043a192eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:31.582888 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6306e8c-04aa-414b-8023-dd938e59996b None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:31.582888 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6306e8c-04aa-414b-8023-dd938e59996b None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:31.582888 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6306e8c-04aa-414b-8023-dd938e59996b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:31.599400 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-e6306e8c-04aa-414b-8023-dd938e59996b None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:11:31.599897 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-84daf978-8452-4c25-9ee1-d6043a192eb9 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:11:31.600649 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e6306e8c-04aa-414b-8023-dd938e59996b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:31.601062 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-84daf978-8452-4c25-9ee1-d6043a192eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:31.608528 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 780/1552] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:11:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:11:31.609303 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6306e8c-04aa-414b-8023-dd938e59996b None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:31.612442 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 773/1553] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:11:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:11:31.613464 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84daf978-8452-4c25-9ee1-d6043a192eb9 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:31.621868 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6306e8c-04aa-414b-8023-dd938e59996b None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:31.623586 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84daf978-8452-4c25-9ee1-d6043a192eb9 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:31.627550 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5dc7cc-c97b-4dc1-9407-014112b1f537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:31.628231 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5dc7cc-c97b-4dc1-9407-014112b1f537 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:31.628504 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5dc7cc-c97b-4dc1-9407-014112b1f537 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:31.629388 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb252c-a014-42f0-b1ec-0aa9ac04b19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:31.630063 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb252c-a014-42f0-b1ec-0aa9ac04b19c admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:31.630339 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb252c-a014-42f0-b1ec-0aa9ac04b19c admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:31.630871 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb252c-a014-42f0-b1ec-0aa9ac04b19c admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:31.631719 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cb252c-a014-42f0-b1ec-0aa9ac04b19c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:31.632759 ncdv-master-1 devstack@keystone.service[91107]: WARNING py.warnings [None req-62cb252c-a014-42f0-b1ec-0aa9ac04b19c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 14 21:11:31.632759 ncdv-master-1 devstack@keystone.service[91107]: warnings.warn(msg) May 14 21:11:31.632759 ncdv-master-1 devstack@keystone.service[91107]: May 14 21:11:31.633962 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cb252c-a014-42f0-b1ec-0aa9ac04b19c admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:31.634914 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5dc7cc-c97b-4dc1-9407-014112b1f537 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:31.635647 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5dc7cc-c97b-4dc1-9407-014112b1f537 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:31.637558 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5dc7cc-c97b-4dc1-9407-014112b1f537 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:31.724119 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 774/1554] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:11:31 2022] POST /identity/v3/users => generated 294 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:11:31.724956 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb252c-a014-42f0-b1ec-0aa9ac04b19c admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:31.734673 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb252c-a014-42f0-b1ec-0aa9ac04b19c admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:31.735814 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 781/1555] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:11:31 2022] POST /identity/v3/users => generated 292 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:11:31.736782 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5dc7cc-c97b-4dc1-9407-014112b1f537 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:31.742606 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfb02df-5ed4-4a68-81a5-1bac94398f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:31.743265 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfb02df-5ed4-4a68-81a5-1bac94398f34 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:31.743586 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfb02df-5ed4-4a68-81a5-1bac94398f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:31.743859 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfb02df-5ed4-4a68-81a5-1bac94398f34 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:31.744550 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfb02df-5ed4-4a68-81a5-1bac94398f34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:31.746183 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5dc7cc-c97b-4dc1-9407-014112b1f537 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:31.746483 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfb02df-5ed4-4a68-81a5-1bac94398f34 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:31.751433 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5be65f8-0d32-4f0c-88c9-ef77646a032c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:31.755031 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be65f8-0d32-4f0c-88c9-ef77646a032c admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:31.755031 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be65f8-0d32-4f0c-88c9-ef77646a032c admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:31.755031 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be65f8-0d32-4f0c-88c9-ef77646a032c admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:31.755031 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5be65f8-0d32-4f0c-88c9-ef77646a032c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:11:31.755031 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5be65f8-0d32-4f0c-88c9-ef77646a032c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:31.755697 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5be65f8-0d32-4f0c-88c9-ef77646a032c admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:31.768308 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 782/1556] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:11:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:11:31.769545 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75cb761-c4a6-40b2-9cb9-fbb0623abbdb None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:31.769835 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75cb761-c4a6-40b2-9cb9-fbb0623abbdb None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:31.770115 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75cb761-c4a6-40b2-9cb9-fbb0623abbdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:31.787756 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-f75cb761-c4a6-40b2-9cb9-fbb0623abbdb None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:11:31.789278 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-f75cb761-c4a6-40b2-9cb9-fbb0623abbdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:31.797259 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 783/1557] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:11:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:11:31.798699 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75cb761-c4a6-40b2-9cb9-fbb0623abbdb None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:31.808016 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75cb761-c4a6-40b2-9cb9-fbb0623abbdb None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:31.812827 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d877910-b93d-4453-b8f9-513035c99fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:31.813514 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d877910-b93d-4453-b8f9-513035c99fc1 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:31.813801 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d877910-b93d-4453-b8f9-513035c99fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:31.814250 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d877910-b93d-4453-b8f9-513035c99fc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:31.814973 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d877910-b93d-4453-b8f9-513035c99fc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:11:31.815278 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d877910-b93d-4453-b8f9-513035c99fc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:31.816985 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d877910-b93d-4453-b8f9-513035c99fc1 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:31.828560 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 784/1558] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:11:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:11:31.830219 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d877910-b93d-4453-b8f9-513035c99fc1 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:31.839573 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d877910-b93d-4453-b8f9-513035c99fc1 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:31.844355 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f192d05-ec46-4f39-9f70-e7edf5693779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:31.844488 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 775/1559] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:11:31 2022] POST /identity/v3/projects => generated 383 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:11:31.845236 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f192d05-ec46-4f39-9f70-e7edf5693779 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:31.845591 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f192d05-ec46-4f39-9f70-e7edf5693779 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:31.845876 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f192d05-ec46-4f39-9f70-e7edf5693779 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:31.846143 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0229ce27-6522-4bfb-a554-70598bf753f2 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:31.846432 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0229ce27-6522-4bfb-a554-70598bf753f2 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:31.846604 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f192d05-ec46-4f39-9f70-e7edf5693779 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:11:31.846706 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0229ce27-6522-4bfb-a554-70598bf753f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:31.846946 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f192d05-ec46-4f39-9f70-e7edf5693779 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:31.848611 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f192d05-ec46-4f39-9f70-e7edf5693779 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:31.860723 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 785/1560] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:11:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:11:31.861769 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f192d05-ec46-4f39-9f70-e7edf5693779 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:31.866194 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-0229ce27-6522-4bfb-a554-70598bf753f2 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:11:31.867375 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-0229ce27-6522-4bfb-a554-70598bf753f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:31.874464 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f192d05-ec46-4f39-9f70-e7edf5693779 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:31.967038 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aa0e14-c419-42ca-baa9-cc872e429f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:31.967750 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa0e14-c419-42ca-baa9-cc872e429f33 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:31.968032 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa0e14-c419-42ca-baa9-cc872e429f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:31.968307 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa0e14-c419-42ca-baa9-cc872e429f33 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:31.969037 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aa0e14-c419-42ca-baa9-cc872e429f33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:31.969688 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 776/1561] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:11:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:11:31.971063 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aa0e14-c419-42ca-baa9-cc872e429f33 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:31.971236 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0229ce27-6522-4bfb-a554-70598bf753f2 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:31.986672 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 786/1562] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:11:31 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:11:31.986672 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aa0e14-c419-42ca-baa9-cc872e429f33 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:31.986968 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0229ce27-6522-4bfb-a554-70598bf753f2 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:31.991934 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173ed593-ff6a-4492-b90d-bd551a2903dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:31.992788 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ed593-ff6a-4492-b90d-bd551a2903dd admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:31.993170 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ed593-ff6a-4492-b90d-bd551a2903dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:31.993502 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ed593-ff6a-4492-b90d-bd551a2903dd admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:31.993594 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aa0e14-c419-42ca-baa9-cc872e429f33 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:31.994410 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173ed593-ff6a-4492-b90d-bd551a2903dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:31.996871 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173ed593-ff6a-4492-b90d-bd551a2903dd admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:31.999628 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c54454a-5504-474c-9422-586fedb1023a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:32.000275 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54454a-5504-474c-9422-586fedb1023a admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:32.000557 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54454a-5504-474c-9422-586fedb1023a admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:32.001536 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54454a-5504-474c-9422-586fedb1023a admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:32.002515 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c54454a-5504-474c-9422-586fedb1023a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:32.004475 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c54454a-5504-474c-9422-586fedb1023a admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:32.009152 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 777/1563] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:11:31 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:11:32.010023 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173ed593-ff6a-4492-b90d-bd551a2903dd admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:32.020039 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173ed593-ff6a-4492-b90d-bd551a2903dd admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:32.024665 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a637ab5-73b5-4010-b039-46c881c74eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:32.025302 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a637ab5-73b5-4010-b039-46c881c74eb4 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:32.025583 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a637ab5-73b5-4010-b039-46c881c74eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:32.025857 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a637ab5-73b5-4010-b039-46c881c74eb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:32.026571 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a637ab5-73b5-4010-b039-46c881c74eb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:11:32.026861 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a637ab5-73b5-4010-b039-46c881c74eb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:32.028464 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a637ab5-73b5-4010-b039-46c881c74eb4 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:32.040657 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 778/1564] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:11:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:11:32.041544 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a637ab5-73b5-4010-b039-46c881c74eb4 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:32.051203 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a637ab5-73b5-4010-b039-46c881c74eb4 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:32.055769 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676ceea6-887a-4b57-b798-f41928e3d47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:32.056430 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676ceea6-887a-4b57-b798-f41928e3d47a admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:32.056712 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676ceea6-887a-4b57-b798-f41928e3d47a admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:32.056985 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676ceea6-887a-4b57-b798-f41928e3d47a admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:32.057715 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676ceea6-887a-4b57-b798-f41928e3d47a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:32.059618 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676ceea6-887a-4b57-b798-f41928e3d47a admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:32.122494 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 787/1565] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:11:31 2022] POST /identity/v3/projects => generated 369 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:11:32.122494 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c54454a-5504-474c-9422-586fedb1023a admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:32.158939 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 779/1566] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:11:32 2022] POST /identity/v3/projects => generated 383 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:11:32.158939 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676ceea6-887a-4b57-b798-f41928e3d47a admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:32.180528 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c54454a-5504-474c-9422-586fedb1023a admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:32.217106 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676ceea6-887a-4b57-b798-f41928e3d47a admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:32.221932 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5593767-e373-4c67-a7f3-db460d725fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:32.222594 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5593767-e373-4c67-a7f3-db460d725fb7 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:32.222911 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5593767-e373-4c67-a7f3-db460d725fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:32.223189 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5593767-e373-4c67-a7f3-db460d725fb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:32.223967 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5593767-e373-4c67-a7f3-db460d725fb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:32.225886 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5593767-e373-4c67-a7f3-db460d725fb7 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:32.237089 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa224719-802e-4aab-9325-00a32bd1927b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:32.237758 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa224719-802e-4aab-9325-00a32bd1927b admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:32.238048 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa224719-802e-4aab-9325-00a32bd1927b admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:32.238322 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa224719-802e-4aab-9325-00a32bd1927b admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:32.239000 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa224719-802e-4aab-9325-00a32bd1927b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:32.240972 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa224719-802e-4aab-9325-00a32bd1927b admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:32.342825 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 780/1567] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:11:32 2022] POST /identity/v3/projects => generated 401 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:11:32.343679 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5593767-e373-4c67-a7f3-db460d725fb7 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:32.353297 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 788/1568] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:11:32 2022] POST /identity/v3/users => generated 292 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:11:32.355616 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa224719-802e-4aab-9325-00a32bd1927b admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:32.364149 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa224719-802e-4aab-9325-00a32bd1927b admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:32.405261 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5593767-e373-4c67-a7f3-db460d725fb7 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:32.409997 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e38069-ee55-4206-b0bb-34bd003d8434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:32.410590 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e38069-ee55-4206-b0bb-34bd003d8434 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:32.410876 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e38069-ee55-4206-b0bb-34bd003d8434 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:32.411156 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e38069-ee55-4206-b0bb-34bd003d8434 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:32.411913 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e38069-ee55-4206-b0bb-34bd003d8434 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:11:32.412227 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e38069-ee55-4206-b0bb-34bd003d8434 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:32.413836 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e38069-ee55-4206-b0bb-34bd003d8434 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:32.418385 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b393109-847b-47f0-8d94-6f53247341c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:32.419047 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b393109-847b-47f0-8d94-6f53247341c5 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:32.419329 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b393109-847b-47f0-8d94-6f53247341c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:32.419637 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b393109-847b-47f0-8d94-6f53247341c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:32.420366 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b393109-847b-47f0-8d94-6f53247341c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:32.421940 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b393109-847b-47f0-8d94-6f53247341c5 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:32.425188 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 781/1569] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:11:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:11:32.425992 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e38069-ee55-4206-b0bb-34bd003d8434 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:32.434610 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 789/1570] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:11:32 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:11:32.434610 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b393109-847b-47f0-8d94-6f53247341c5 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:32.442496 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b393109-847b-47f0-8d94-6f53247341c5 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:32.442652 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e38069-ee55-4206-b0bb-34bd003d8434 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:32.446997 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15263bac-3cef-478d-9604-a797aafce4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:32.447134 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144b0004-2a11-4fed-8e63-019913ac6e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:32.447667 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15263bac-3cef-478d-9604-a797aafce4d1 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:32.447780 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b0004-2a11-4fed-8e63-019913ac6e1d admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:32.447949 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15263bac-3cef-478d-9604-a797aafce4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:32.448052 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b0004-2a11-4fed-8e63-019913ac6e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:32.448229 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15263bac-3cef-478d-9604-a797aafce4d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:32.448354 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b0004-2a11-4fed-8e63-019913ac6e1d admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:32.448904 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15263bac-3cef-478d-9604-a797aafce4d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:32.449002 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144b0004-2a11-4fed-8e63-019913ac6e1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:32.450588 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144b0004-2a11-4fed-8e63-019913ac6e1d admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:32.450830 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15263bac-3cef-478d-9604-a797aafce4d1 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:32.461651 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 782/1571] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:11:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:11:32.462439 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144b0004-2a11-4fed-8e63-019913ac6e1d admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:32.473858 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144b0004-2a11-4fed-8e63-019913ac6e1d admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:32.478555 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b961cb5a-52e4-4c8a-ab87-750c657e5402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:32.479217 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b961cb5a-52e4-4c8a-ab87-750c657e5402 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:32.479564 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b961cb5a-52e4-4c8a-ab87-750c657e5402 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:32.479845 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b961cb5a-52e4-4c8a-ab87-750c657e5402 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:32.480558 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b961cb5a-52e4-4c8a-ab87-750c657e5402 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:32.482572 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b961cb5a-52e4-4c8a-ab87-750c657e5402 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:32.546792 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 790/1572] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:11:32 2022] POST /identity/v3/projects => generated 383 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:11:32.548215 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15263bac-3cef-478d-9604-a797aafce4d1 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:32.607530 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15263bac-3cef-478d-9604-a797aafce4d1 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:32.612913 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 783/1573] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:11:32 2022] POST /identity/v3/users => generated 285 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:11:32.612913 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b961cb5a-52e4-4c8a-ab87-750c657e5402 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:32.613117 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dda8e2c-7663-4019-8ed4-9414e7036753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:32.613117 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda8e2c-7663-4019-8ed4-9414e7036753 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:32.613360 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda8e2c-7663-4019-8ed4-9414e7036753 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:32.613618 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda8e2c-7663-4019-8ed4-9414e7036753 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:32.614334 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dda8e2c-7663-4019-8ed4-9414e7036753 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:32.616312 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dda8e2c-7663-4019-8ed4-9414e7036753 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:32.620760 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b961cb5a-52e4-4c8a-ab87-750c657e5402 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:32.625439 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4c516d-5441-49ba-9a7c-0a698e10c287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:32.628740 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c516d-5441-49ba-9a7c-0a698e10c287 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:32.628740 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c516d-5441-49ba-9a7c-0a698e10c287 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:32.628740 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c516d-5441-49ba-9a7c-0a698e10c287 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:32.628740 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4c516d-5441-49ba-9a7c-0a698e10c287 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:32.629420 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4c516d-5441-49ba-9a7c-0a698e10c287 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:32.694368 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 791/1574] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:11:32 2022] POST /identity/v3/users => generated 292 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:11:32.695217 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dda8e2c-7663-4019-8ed4-9414e7036753 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:32.705123 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dda8e2c-7663-4019-8ed4-9414e7036753 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:32.709699 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f867d4-6235-4e8a-a5a0-f235456ecdb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:32.710328 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f867d4-6235-4e8a-a5a0-f235456ecdb8 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:32.710613 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f867d4-6235-4e8a-a5a0-f235456ecdb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:32.710893 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f867d4-6235-4e8a-a5a0-f235456ecdb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:32.711630 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f867d4-6235-4e8a-a5a0-f235456ecdb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:32.713214 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f867d4-6235-4e8a-a5a0-f235456ecdb8 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:32.723538 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 784/1575] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:11:32 2022] POST /identity/v3/users => generated 301 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:11:32.728063 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 792/1576] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:11:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:11:32.728173 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4c516d-5441-49ba-9a7c-0a698e10c287 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:32.728251 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f867d4-6235-4e8a-a5a0-f235456ecdb8 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:32.734557 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f867d4-6235-4e8a-a5a0-f235456ecdb8 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:32.735591 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4c516d-5441-49ba-9a7c-0a698e10c287 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:32.739921 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6842fa12-1cd4-47c1-9459-ea498cbdda16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:32.740229 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff72729e-ea9b-44db-b251-86e6efafe536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:32.740791 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842fa12-1cd4-47c1-9459-ea498cbdda16 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:32.740904 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff72729e-ea9b-44db-b251-86e6efafe536 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:32.741073 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842fa12-1cd4-47c1-9459-ea498cbdda16 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:32.741170 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff72729e-ea9b-44db-b251-86e6efafe536 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:32.741348 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842fa12-1cd4-47c1-9459-ea498cbdda16 admin admin] PATH_INFO: `/v3/projects/313d5b39fe10417993b28718eb6e6f7a/users/7d7d10a70c364505af3b2b8294238615/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:32.741435 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff72729e-ea9b-44db-b251-86e6efafe536 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:32.742055 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff72729e-ea9b-44db-b251-86e6efafe536 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:32.744044 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff72729e-ea9b-44db-b251-86e6efafe536 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:32.762041 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6842fa12-1cd4-47c1-9459-ea498cbdda16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=313d5b39fe10417993b28718eb6e6f7a, user_id=7d7d10a70c364505af3b2b8294238615, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:32.763190 ncdv-master-1 devstack@keystone.service[91106]: WARNING py.warnings [None req-6842fa12-1cd4-47c1-9459-ea498cbdda16 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 14 21:11:32.763190 ncdv-master-1 devstack@keystone.service[91106]: warnings.warn(msg) May 14 21:11:32.763190 ncdv-master-1 devstack@keystone.service[91106]: May 14 21:11:32.765174 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6842fa12-1cd4-47c1-9459-ea498cbdda16 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:32.817275 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 785/1577] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:11:32 2022] POST /identity/v3/projects => generated 377 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:11:32.818241 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff72729e-ea9b-44db-b251-86e6efafe536 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:32.827369 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 793/1578] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:11:32 2022] PUT /identity/v3/projects/313d5b39fe10417993b28718eb6e6f7a/users/7d7d10a70c364505af3b2b8294238615/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:11:32.828399 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6842fa12-1cd4-47c1-9459-ea498cbdda16 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:32.881564 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff72729e-ea9b-44db-b251-86e6efafe536 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:32.886190 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0120e22e-dc5c-4cb0-ba41-3e6c351eb94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:32.887107 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120e22e-dc5c-4cb0-ba41-3e6c351eb94b admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:32.887415 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120e22e-dc5c-4cb0-ba41-3e6c351eb94b admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:32.887720 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120e22e-dc5c-4cb0-ba41-3e6c351eb94b admin admin] PATH_INFO: `/v3/projects/74b77f0e49394b5c9310e60089449508/users/9c00dfe7fbe34ec5aacccdcf52f68cf9/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:32.888943 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6842fa12-1cd4-47c1-9459-ea498cbdda16 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:32.895050 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcfcfcb-14f4-4435-a757-bd81c79ca234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:32.895738 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcfcfcb-14f4-4435-a757-bd81c79ca234 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:32.896027 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcfcfcb-14f4-4435-a757-bd81c79ca234 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:32.896300 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcfcfcb-14f4-4435-a757-bd81c79ca234 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:32.896973 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcfcfcb-14f4-4435-a757-bd81c79ca234 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:32.898887 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcfcfcb-14f4-4435-a757-bd81c79ca234 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:32.902706 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0120e22e-dc5c-4cb0-ba41-3e6c351eb94b admin admin] RBAC: Authorizing `identity:create_grant(project_id=74b77f0e49394b5c9310e60089449508, user_id=9c00dfe7fbe34ec5aacccdcf52f68cf9, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:32.905400 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0120e22e-dc5c-4cb0-ba41-3e6c351eb94b admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:32.968286 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 786/1579] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:11:32 2022] PUT /identity/v3/projects/74b77f0e49394b5c9310e60089449508/users/9c00dfe7fbe34ec5aacccdcf52f68cf9/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:11:32.968615 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 794/1580] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:11:32 2022] POST /identity/v3/users => generated 292 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:11:32.969309 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0120e22e-dc5c-4cb0-ba41-3e6c351eb94b admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:32.969532 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcfcfcb-14f4-4435-a757-bd81c79ca234 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:32.979053 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcfcfcb-14f4-4435-a757-bd81c79ca234 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:33.036416 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0120e22e-dc5c-4cb0-ba41-3e6c351eb94b admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:33.037328 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57000d7d-1d29-4edc-9866-816a5c622ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:33.038002 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57000d7d-1d29-4edc-9866-816a5c622ce7 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:33.038366 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57000d7d-1d29-4edc-9866-816a5c622ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:33.038625 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57000d7d-1d29-4edc-9866-816a5c622ce7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:33.039343 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57000d7d-1d29-4edc-9866-816a5c622ce7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:33.041033 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57000d7d-1d29-4edc-9866-816a5c622ce7 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:33.041147 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aba89e-f134-47dd-b2e3-54a7d5c2c9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:33.041813 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aba89e-f134-47dd-b2e3-54a7d5c2c9a6 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:33.042098 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aba89e-f134-47dd-b2e3-54a7d5c2c9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:33.042373 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aba89e-f134-47dd-b2e3-54a7d5c2c9a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:33.043121 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aba89e-f134-47dd-b2e3-54a7d5c2c9a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:33.044742 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aba89e-f134-47dd-b2e3-54a7d5c2c9a6 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:33.050743 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 795/1581] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:11:32 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:11:33.051568 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57000d7d-1d29-4edc-9866-816a5c622ce7 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:33.055593 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 787/1582] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:11:32 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:11:33.056467 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aba89e-f134-47dd-b2e3-54a7d5c2c9a6 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:33.060928 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57000d7d-1d29-4edc-9866-816a5c622ce7 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:33.066165 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3f80f6-f461-4c8d-a646-2c4a326a1ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:33.066814 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f80f6-f461-4c8d-a646-2c4a326a1ae9 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:33.066917 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aba89e-f134-47dd-b2e3-54a7d5c2c9a6 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:33.067099 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f80f6-f461-4c8d-a646-2c4a326a1ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:33.067375 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f80f6-f461-4c8d-a646-2c4a326a1ae9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:33.068119 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3f80f6-f461-4c8d-a646-2c4a326a1ae9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:33.069702 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3f80f6-f461-4c8d-a646-2c4a326a1ae9 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:33.071692 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cea1ddc-0ad1-4e74-b946-ecfdb1aed5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:33.072401 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea1ddc-0ad1-4e74-b946-ecfdb1aed5a0 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:33.072680 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea1ddc-0ad1-4e74-b946-ecfdb1aed5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:33.072952 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea1ddc-0ad1-4e74-b946-ecfdb1aed5a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:33.073652 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cea1ddc-0ad1-4e74-b946-ecfdb1aed5a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:33.075241 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cea1ddc-0ad1-4e74-b946-ecfdb1aed5a0 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:33.080245 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 796/1583] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:11:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:11:33.081096 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3f80f6-f461-4c8d-a646-2c4a326a1ae9 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:33.088526 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 788/1584] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:11:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:11:33.089636 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e0aa9b-b5d4-4662-8cc9-619370b6ed16 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:33.090004 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e0aa9b-b5d4-4662-8cc9-619370b6ed16 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:33.090291 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e0aa9b-b5d4-4662-8cc9-619370b6ed16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:33.093624 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3f80f6-f461-4c8d-a646-2c4a326a1ae9 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:33.098733 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb21908e-a1e8-4e78-a462-8af7b2067035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:33.099379 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb21908e-a1e8-4e78-a462-8af7b2067035 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:33.099699 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb21908e-a1e8-4e78-a462-8af7b2067035 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:33.099976 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb21908e-a1e8-4e78-a462-8af7b2067035 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:33.100651 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb21908e-a1e8-4e78-a462-8af7b2067035 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:33.102555 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb21908e-a1e8-4e78-a462-8af7b2067035 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:33.115725 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-e8e0aa9b-b5d4-4662-8cc9-619370b6ed16 None None] MFA Rules not processed for user `7d7d10a70c364505af3b2b8294238615`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:11:33.116912 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e8e0aa9b-b5d4-4662-8cc9-619370b6ed16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:33.169013 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 797/1585] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:11:33 2022] POST /identity/v3/users => generated 289 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:11:33.170281 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb8c4e-8066-4282-ab96-f0fc024c7e57 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:33.170567 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb8c4e-8066-4282-ab96-f0fc024c7e57 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:33.170839 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb8c4e-8066-4282-ab96-f0fc024c7e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:33.186272 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 789/1586] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:11:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:11:33.186272 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e0aa9b-b5d4-4662-8cc9-619370b6ed16 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:33.194615 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e0aa9b-b5d4-4662-8cc9-619370b6ed16 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:33.200814 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b90828-e08c-4fba-be6a-47e05bd7d6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:33.201147 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b90828-e08c-4fba-be6a-47e05bd7d6f5 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:33.201428 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b90828-e08c-4fba-be6a-47e05bd7d6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:33.201701 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b90828-e08c-4fba-be6a-47e05bd7d6f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:33.202437 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b90828-e08c-4fba-be6a-47e05bd7d6f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:33.203602 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-64eb8c4e-8066-4282-ab96-f0fc024c7e57 None None] MFA Rules not processed for user `9c00dfe7fbe34ec5aacccdcf52f68cf9`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:11:33.205223 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b90828-e08c-4fba-be6a-47e05bd7d6f5 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:33.205792 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-64eb8c4e-8066-4282-ab96-f0fc024c7e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:33.214844 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 790/1587] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:11:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:11:33.215683 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b90828-e08c-4fba-be6a-47e05bd7d6f5 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:33.225330 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b90828-e08c-4fba-be6a-47e05bd7d6f5 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:33.229777 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45b23df-7c60-417d-911b-47127de42fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:33.230398 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b23df-7c60-417d-911b-47127de42fa5 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:33.230678 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b23df-7c60-417d-911b-47127de42fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:33.230953 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b23df-7c60-417d-911b-47127de42fa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:33.231674 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45b23df-7c60-417d-911b-47127de42fa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:33.233219 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45b23df-7c60-417d-911b-47127de42fa5 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:33.243107 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 791/1588] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:11:33 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:11:33.243905 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45b23df-7c60-417d-911b-47127de42fa5 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:33.256019 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45b23df-7c60-417d-911b-47127de42fa5 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:33.260474 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e700fdad-7266-44f4-8abd-aa6192bbaa6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:33.261128 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e700fdad-7266-44f4-8abd-aa6192bbaa6a admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:33.261410 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e700fdad-7266-44f4-8abd-aa6192bbaa6a admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:33.261683 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e700fdad-7266-44f4-8abd-aa6192bbaa6a admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:33.262383 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e700fdad-7266-44f4-8abd-aa6192bbaa6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:33.263981 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e700fdad-7266-44f4-8abd-aa6192bbaa6a admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:33.269484 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 798/1589] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:11:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:11:33.270146 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eb8c4e-8066-4282-ab96-f0fc024c7e57 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:33.279677 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 792/1590] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:11:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:11:33.279677 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e700fdad-7266-44f4-8abd-aa6192bbaa6a admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:33.280043 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eb8c4e-8066-4282-ab96-f0fc024c7e57 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:33.284772 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b241348-bd34-4231-a5e4-13d3ade29edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:33.285641 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b241348-bd34-4231-a5e4-13d3ade29edc admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:33.285923 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b241348-bd34-4231-a5e4-13d3ade29edc admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:33.286198 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b241348-bd34-4231-a5e4-13d3ade29edc admin admin] PATH_INFO: `/v3/projects/6ef6150a042b4fb0be291048656e5e9c/users/187b7fcb1e2a40ebaa484ad813116e67/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:33.287596 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e700fdad-7266-44f4-8abd-aa6192bbaa6a admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:33.292153 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4951a0f3-7e4f-406f-978f-51237fd3eefa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:33.292790 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4951a0f3-7e4f-406f-978f-51237fd3eefa admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:33.293103 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4951a0f3-7e4f-406f-978f-51237fd3eefa admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:33.293375 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4951a0f3-7e4f-406f-978f-51237fd3eefa admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:33.294132 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4951a0f3-7e4f-406f-978f-51237fd3eefa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:33.295738 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4951a0f3-7e4f-406f-978f-51237fd3eefa admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:33.301568 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b241348-bd34-4231-a5e4-13d3ade29edc admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ef6150a042b4fb0be291048656e5e9c, user_id=187b7fcb1e2a40ebaa484ad813116e67, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:33.304332 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b241348-bd34-4231-a5e4-13d3ade29edc admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:33.309389 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 793/1591] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:11:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:11:33.309389 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4951a0f3-7e4f-406f-978f-51237fd3eefa admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:33.320555 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4951a0f3-7e4f-406f-978f-51237fd3eefa admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:33.325311 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca4e64b-6b64-4314-9754-b5a3ba73fbd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:33.325969 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca4e64b-6b64-4314-9754-b5a3ba73fbd3 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:33.326257 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca4e64b-6b64-4314-9754-b5a3ba73fbd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:33.326531 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca4e64b-6b64-4314-9754-b5a3ba73fbd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:33.327277 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca4e64b-6b64-4314-9754-b5a3ba73fbd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:33.329050 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca4e64b-6b64-4314-9754-b5a3ba73fbd3 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:33.338767 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 794/1592] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:11:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:11:33.339583 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca4e64b-6b64-4314-9754-b5a3ba73fbd3 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:33.348706 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca4e64b-6b64-4314-9754-b5a3ba73fbd3 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:33.353273 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b56b0-4b33-49c3-9bcb-1de1ae50bfc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:33.353884 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b56b0-4b33-49c3-9bcb-1de1ae50bfc3 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:33.354166 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b56b0-4b33-49c3-9bcb-1de1ae50bfc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:33.354444 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b56b0-4b33-49c3-9bcb-1de1ae50bfc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:33.355108 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3b56b0-4b33-49c3-9bcb-1de1ae50bfc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:33.357053 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3b56b0-4b33-49c3-9bcb-1de1ae50bfc3 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:33.404243 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 799/1593] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:11:33 2022] PUT /identity/v3/projects/6ef6150a042b4fb0be291048656e5e9c/users/187b7fcb1e2a40ebaa484ad813116e67/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:11:33.405223 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b241348-bd34-4231-a5e4-13d3ade29edc admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:33.449342 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 795/1594] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:11:33 2022] POST /identity/v3/projects => generated 389 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:11:33.449342 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b56b0-4b33-49c3-9bcb-1de1ae50bfc3 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:33.467252 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b241348-bd34-4231-a5e4-13d3ade29edc admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:33.509353 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b56b0-4b33-49c3-9bcb-1de1ae50bfc3 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:33.513962 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf2f783-53c0-471c-92fa-3411c0eca98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:33.514848 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2f783-53c0-471c-92fa-3411c0eca98b admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:33.515138 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2f783-53c0-471c-92fa-3411c0eca98b admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:33.515418 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2f783-53c0-471c-92fa-3411c0eca98b admin admin] PATH_INFO: `/v3/projects/fe8189ae2a22445d9be93e4be1495fce/users/94cb6331b06048e491f46346898dd347/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:33.524532 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128ba1bf-ce1c-4815-a1aa-83f6dc5bd6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:33.525200 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ba1bf-ce1c-4815-a1aa-83f6dc5bd6f5 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:33.525483 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ba1bf-ce1c-4815-a1aa-83f6dc5bd6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:33.525760 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ba1bf-ce1c-4815-a1aa-83f6dc5bd6f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:33.526479 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128ba1bf-ce1c-4815-a1aa-83f6dc5bd6f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:33.528130 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128ba1bf-ce1c-4815-a1aa-83f6dc5bd6f5 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:33.529539 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf2f783-53c0-471c-92fa-3411c0eca98b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe8189ae2a22445d9be93e4be1495fce, user_id=94cb6331b06048e491f46346898dd347, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:33.533740 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf2f783-53c0-471c-92fa-3411c0eca98b admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:33.537792 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 800/1595] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:11:33 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:11:33.538725 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128ba1bf-ce1c-4815-a1aa-83f6dc5bd6f5 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:33.548847 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128ba1bf-ce1c-4815-a1aa-83f6dc5bd6f5 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:33.554566 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293f97f3-f75f-4deb-b89f-6ba9e48cdd68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:33.555316 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f97f3-f75f-4deb-b89f-6ba9e48cdd68 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:33.556042 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f97f3-f75f-4deb-b89f-6ba9e48cdd68 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:33.556726 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f97f3-f75f-4deb-b89f-6ba9e48cdd68 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:33.557045 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293f97f3-f75f-4deb-b89f-6ba9e48cdd68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:33.558960 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293f97f3-f75f-4deb-b89f-6ba9e48cdd68 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:33.621179 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 796/1596] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:11:33 2022] PUT /identity/v3/projects/fe8189ae2a22445d9be93e4be1495fce/users/94cb6331b06048e491f46346898dd347/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:11:33.622101 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf2f783-53c0-471c-92fa-3411c0eca98b admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:33.639955 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 801/1597] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:11:33 2022] POST /identity/v3/projects => generated 383 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:11:33.640650 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293f97f3-f75f-4deb-b89f-6ba9e48cdd68 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:33.692396 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf2f783-53c0-471c-92fa-3411c0eca98b admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:33.701970 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293f97f3-f75f-4deb-b89f-6ba9e48cdd68 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:33.707665 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2396cd-200c-4fcc-8dc9-4a0fe07134ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:33.708545 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2396cd-200c-4fcc-8dc9-4a0fe07134ea admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:33.708823 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2396cd-200c-4fcc-8dc9-4a0fe07134ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:33.709094 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2396cd-200c-4fcc-8dc9-4a0fe07134ea admin admin] PATH_INFO: `/v3/projects/97eb48c86b4d49f1b11b2b6380020f4b/users/36c32d3de24045bdbfce30559ea022e7/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:33.723265 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2396cd-200c-4fcc-8dc9-4a0fe07134ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=97eb48c86b4d49f1b11b2b6380020f4b, user_id=36c32d3de24045bdbfce30559ea022e7, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:33.725962 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2396cd-200c-4fcc-8dc9-4a0fe07134ea admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:33.748271 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee03283-fd6e-4845-b573-14a0f297c066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:33.749169 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee03283-fd6e-4845-b573-14a0f297c066 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:33.749451 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee03283-fd6e-4845-b573-14a0f297c066 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:33.749720 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee03283-fd6e-4845-b573-14a0f297c066 admin admin] PATH_INFO: `/v3/projects/98338f941db74e73803bef199f8b90a4/users/78a55f9dde1b4e769c8d91837f03c166/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:33.764710 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee03283-fd6e-4845-b573-14a0f297c066 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98338f941db74e73803bef199f8b90a4, user_id=78a55f9dde1b4e769c8d91837f03c166, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:33.767723 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee03283-fd6e-4845-b573-14a0f297c066 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:33.770782 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 802/1598] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:11:33 2022] PUT /identity/v3/projects/97eb48c86b4d49f1b11b2b6380020f4b/users/36c32d3de24045bdbfce30559ea022e7/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:11:33.771780 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2396cd-200c-4fcc-8dc9-4a0fe07134ea admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:33.831415 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2396cd-200c-4fcc-8dc9-4a0fe07134ea admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:33.836060 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcc9227-f7bf-40d8-83ae-ac8978b88f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:33.836723 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcc9227-f7bf-40d8-83ae-ac8978b88f98 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:33.837006 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcc9227-f7bf-40d8-83ae-ac8978b88f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:33.837284 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcc9227-f7bf-40d8-83ae-ac8978b88f98 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:33.837995 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcc9227-f7bf-40d8-83ae-ac8978b88f98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:33.838835 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 797/1599] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:11:33 2022] PUT /identity/v3/projects/98338f941db74e73803bef199f8b90a4/users/78a55f9dde1b4e769c8d91837f03c166/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:11:33.839742 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcc9227-f7bf-40d8-83ae-ac8978b88f98 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:33.840158 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe732eb-f5d0-4a1f-8af0-e866f3c59d74 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:33.840448 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe732eb-f5d0-4a1f-8af0-e866f3c59d74 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:33.840724 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe732eb-f5d0-4a1f-8af0-e866f3c59d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:33.853268 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 803/1600] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:11:33 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:11:33.853268 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcc9227-f7bf-40d8-83ae-ac8978b88f98 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:33.860862 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcc9227-f7bf-40d8-83ae-ac8978b88f98 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:33.869798 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-cfe732eb-f5d0-4a1f-8af0-e866f3c59d74 None None] MFA Rules not processed for user `187b7fcb1e2a40ebaa484ad813116e67`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:11:33.870645 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-cfe732eb-f5d0-4a1f-8af0-e866f3c59d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:33.917192 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99401393-c0f7-4083-851f-43aaee6c7e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:33.917865 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99401393-c0f7-4083-851f-43aaee6c7e47 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:33.918154 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99401393-c0f7-4083-851f-43aaee6c7e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:33.918435 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99401393-c0f7-4083-851f-43aaee6c7e47 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:33.919129 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99401393-c0f7-4083-851f-43aaee6c7e47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:33.921096 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99401393-c0f7-4083-851f-43aaee6c7e47 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:33.935113 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 798/1601] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:11:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:11:33.936128 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe732eb-f5d0-4a1f-8af0-e866f3c59d74 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:33.947409 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe732eb-f5d0-4a1f-8af0-e866f3c59d74 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:33.952000 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9609d98-1f60-49ea-a7bd-1a35c1820686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:33.952861 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9609d98-1f60-49ea-a7bd-1a35c1820686 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:33.953143 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9609d98-1f60-49ea-a7bd-1a35c1820686 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:33.953416 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9609d98-1f60-49ea-a7bd-1a35c1820686 admin admin] PATH_INFO: `/v3/projects/7284e17654bc4a62a6d92db0f9fe2b5e/users/bbd1715608f64bcfbff6bf07039389c9/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:33.967760 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9609d98-1f60-49ea-a7bd-1a35c1820686 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7284e17654bc4a62a6d92db0f9fe2b5e, user_id=bbd1715608f64bcfbff6bf07039389c9, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:33.970525 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9609d98-1f60-49ea-a7bd-1a35c1820686 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:33.976197 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 804/1602] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:11:33 2022] POST /identity/v3/users => generated 301 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:11:33.977483 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823a7d2-47b0-4f64-8a4c-ed663458572e None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:33.977764 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823a7d2-47b0-4f64-8a4c-ed663458572e None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:33.978040 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823a7d2-47b0-4f64-8a4c-ed663458572e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:34.003613 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-d823a7d2-47b0-4f64-8a4c-ed663458572e None None] MFA Rules not processed for user `94cb6331b06048e491f46346898dd347`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:11:34.004795 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d823a7d2-47b0-4f64-8a4c-ed663458572e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:34.027118 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 799/1603] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:11:33 2022] PUT /identity/v3/projects/7284e17654bc4a62a6d92db0f9fe2b5e/users/bbd1715608f64bcfbff6bf07039389c9/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:11:34.027890 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9609d98-1f60-49ea-a7bd-1a35c1820686 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:34.067786 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 805/1604] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:11:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:11:34.069073 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9766e-8c2e-4ece-b6da-f370f7b70882 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:34.069365 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9766e-8c2e-4ece-b6da-f370f7b70882 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:34.069643 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9766e-8c2e-4ece-b6da-f370f7b70882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:34.086678 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-4dd9766e-8c2e-4ece-b6da-f370f7b70882 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:11:34.087908 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-4dd9766e-8c2e-4ece-b6da-f370f7b70882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:34.088609 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9609d98-1f60-49ea-a7bd-1a35c1820686 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:34.093381 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bf78ff-6be1-499a-a10d-e9a0950dbee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:34.094045 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf78ff-6be1-499a-a10d-e9a0950dbee5 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:34.094334 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf78ff-6be1-499a-a10d-e9a0950dbee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:34.094624 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf78ff-6be1-499a-a10d-e9a0950dbee5 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:34.095306 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bf78ff-6be1-499a-a10d-e9a0950dbee5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:34.099535 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 806/1605] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:11:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:11:34.099535 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a42779-7b86-45f1-b7ca-95eec7a3cad6 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:34.099535 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a42779-7b86-45f1-b7ca-95eec7a3cad6 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:34.099535 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a42779-7b86-45f1-b7ca-95eec7a3cad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:34.099882 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bf78ff-6be1-499a-a10d-e9a0950dbee5 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:34.123572 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-e2a42779-7b86-45f1-b7ca-95eec7a3cad6 None None] MFA Rules not processed for user `78a55f9dde1b4e769c8d91837f03c166`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:11:34.124758 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e2a42779-7b86-45f1-b7ca-95eec7a3cad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:34.185620 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 807/1606] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:11:34 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:11:34.186424 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a42779-7b86-45f1-b7ca-95eec7a3cad6 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:34.186961 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 800/1607] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:11:34 2022] POST /identity/v3/users => generated 298 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:11:34.187706 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bf78ff-6be1-499a-a10d-e9a0950dbee5 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:34.197893 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bf78ff-6be1-499a-a10d-e9a0950dbee5 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:34.198996 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a42779-7b86-45f1-b7ca-95eec7a3cad6 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:34.202531 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847e3dea-7f5e-4046-8118-03dcc5508b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:34.203186 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e3dea-7f5e-4046-8118-03dcc5508b5f admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:34.203468 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e3dea-7f5e-4046-8118-03dcc5508b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:34.203799 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e3dea-7f5e-4046-8118-03dcc5508b5f admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:34.203996 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e607ccf-dfce-4194-9719-8cfca3501024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:34.204482 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847e3dea-7f5e-4046-8118-03dcc5508b5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:34.204924 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e607ccf-dfce-4194-9719-8cfca3501024 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:34.205742 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e607ccf-dfce-4194-9719-8cfca3501024 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:34.206182 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e607ccf-dfce-4194-9719-8cfca3501024 admin admin] PATH_INFO: `/v3/projects/8bf7d2dbcd5748dd97172b86455bdbca/users/c0af14c87b2c4487ba2535a95d5cdf51/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:34.207137 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847e3dea-7f5e-4046-8118-03dcc5508b5f admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:34.221758 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e607ccf-dfce-4194-9719-8cfca3501024 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bf7d2dbcd5748dd97172b86455bdbca, user_id=c0af14c87b2c4487ba2535a95d5cdf51, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:34.224516 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e607ccf-dfce-4194-9719-8cfca3501024 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:34.318882 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 801/1608] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:11:34 2022] POST /identity/v3/projects => generated 383 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:11:34.319674 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847e3dea-7f5e-4046-8118-03dcc5508b5f admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:34.348266 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 808/1609] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:11:34 2022] PUT /identity/v3/projects/8bf7d2dbcd5748dd97172b86455bdbca/users/c0af14c87b2c4487ba2535a95d5cdf51/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:11:34.350302 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4afe14-d687-4f6b-b1ab-95ecfae84b3e None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:34.350302 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4afe14-d687-4f6b-b1ab-95ecfae84b3e None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:34.350740 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4afe14-d687-4f6b-b1ab-95ecfae84b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:34.379240 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-ae4afe14-d687-4f6b-b1ab-95ecfae84b3e None None] MFA Rules not processed for user `bbd1715608f64bcfbff6bf07039389c9`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:11:34.380850 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ae4afe14-d687-4f6b-b1ab-95ecfae84b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:34.381643 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847e3dea-7f5e-4046-8118-03dcc5508b5f admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:34.434415 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e15704e-1167-447c-9c98-0883c7c23b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:34.435082 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e15704e-1167-447c-9c98-0883c7c23b23 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:34.435366 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e15704e-1167-447c-9c98-0883c7c23b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:34.435678 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e15704e-1167-447c-9c98-0883c7c23b23 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:34.436395 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e15704e-1167-447c-9c98-0883c7c23b23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:34.438002 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e15704e-1167-447c-9c98-0883c7c23b23 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:34.442239 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 809/1610] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:11:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:11:34.443051 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4afe14-d687-4f6b-b1ab-95ecfae84b3e None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:34.448452 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 802/1611] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:11:34 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:11:34.449387 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e15704e-1167-447c-9c98-0883c7c23b23 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:34.455140 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4afe14-d687-4f6b-b1ab-95ecfae84b3e None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:34.459911 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67c517e-c6f1-404c-ac04-441653df77bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:34.460624 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c517e-c6f1-404c-ac04-441653df77bc admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:34.460909 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c517e-c6f1-404c-ac04-441653df77bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:34.461186 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c517e-c6f1-404c-ac04-441653df77bc admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:34.461895 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67c517e-c6f1-404c-ac04-441653df77bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:34.463829 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67c517e-c6f1-404c-ac04-441653df77bc admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:34.526613 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e15704e-1167-447c-9c98-0883c7c23b23 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:34.530224 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aac1ed-4aa0-4149-8552-532e55151b88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:34.530866 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aac1ed-4aa0-4149-8552-532e55151b88 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:34.531147 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aac1ed-4aa0-4149-8552-532e55151b88 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:34.531423 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aac1ed-4aa0-4149-8552-532e55151b88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:34.540872 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aac1ed-4aa0-4149-8552-532e55151b88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:34.544765 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aac1ed-4aa0-4149-8552-532e55151b88 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:34.552397 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 803/1612] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:11:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:11:34.553256 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aac1ed-4aa0-4149-8552-532e55151b88 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:34.562053 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aac1ed-4aa0-4149-8552-532e55151b88 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:34.567409 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3784c520-ccd6-4236-8c1b-79383894bd18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:34.568166 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3784c520-ccd6-4236-8c1b-79383894bd18 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:34.568452 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3784c520-ccd6-4236-8c1b-79383894bd18 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:34.568730 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3784c520-ccd6-4236-8c1b-79383894bd18 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:34.569501 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3784c520-ccd6-4236-8c1b-79383894bd18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:34.571044 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3784c520-ccd6-4236-8c1b-79383894bd18 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:34.575550 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 810/1613] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:11:34 2022] POST /identity/v3/projects => generated 385 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:11:34.575550 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67c517e-c6f1-404c-ac04-441653df77bc admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:34.584933 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 804/1614] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:11:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:11:34.584933 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3784c520-ccd6-4236-8c1b-79383894bd18 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:34.592140 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3784c520-ccd6-4236-8c1b-79383894bd18 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:34.637123 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67c517e-c6f1-404c-ac04-441653df77bc admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:34.641888 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953effb3-b8e3-4920-9f19-590d70bb4a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:34.642610 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953effb3-b8e3-4920-9f19-590d70bb4a3a admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:34.642954 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953effb3-b8e3-4920-9f19-590d70bb4a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:34.643363 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953effb3-b8e3-4920-9f19-590d70bb4a3a admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:34.644133 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953effb3-b8e3-4920-9f19-590d70bb4a3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:34.646126 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953effb3-b8e3-4920-9f19-590d70bb4a3a admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:34.647756 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa2477a-12c8-4bc3-b32d-cc2a350e4878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:34.648429 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa2477a-12c8-4bc3-b32d-cc2a350e4878 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:34.648713 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa2477a-12c8-4bc3-b32d-cc2a350e4878 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:34.648994 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa2477a-12c8-4bc3-b32d-cc2a350e4878 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:34.649676 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa2477a-12c8-4bc3-b32d-cc2a350e4878 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:34.651617 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa2477a-12c8-4bc3-b32d-cc2a350e4878 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:34.743330 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 811/1615] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:11:34 2022] POST /identity/v3/projects => generated 371 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:11:34.744709 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf8c10-510c-46e1-80a6-38b13f918162 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:34.745843 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf8c10-510c-46e1-80a6-38b13f918162 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:34.745843 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf8c10-510c-46e1-80a6-38b13f918162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:34.772079 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-2fdf8c10-510c-46e1-80a6-38b13f918162 None None] MFA Rules not processed for user `c0af14c87b2c4487ba2535a95d5cdf51`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:11:34.773335 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-2fdf8c10-510c-46e1-80a6-38b13f918162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:34.774676 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 805/1616] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:11:34 2022] POST /identity/v3/users => generated 298 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:11:34.775439 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa2477a-12c8-4bc3-b32d-cc2a350e4878 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:34.785319 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa2477a-12c8-4bc3-b32d-cc2a350e4878 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:34.837658 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 812/1617] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:11:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:11:34.838455 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdf8c10-510c-46e1-80a6-38b13f918162 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:34.845141 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595de237-e290-4212-b6e0-346eb8f6f8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:34.852773 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595de237-e290-4212-b6e0-346eb8f6f8cd admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:34.852773 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595de237-e290-4212-b6e0-346eb8f6f8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:34.852773 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595de237-e290-4212-b6e0-346eb8f6f8cd admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:34.852773 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595de237-e290-4212-b6e0-346eb8f6f8cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:34.852773 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595de237-e290-4212-b6e0-346eb8f6f8cd admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:34.853151 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdf8c10-510c-46e1-80a6-38b13f918162 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:34.856449 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cb1d64-fc7f-4fe9-ab4a-da2f09d2d54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:34.857321 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cb1d64-fc7f-4fe9-ab4a-da2f09d2d54a admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:34.857597 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cb1d64-fc7f-4fe9-ab4a-da2f09d2d54a admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:34.857870 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cb1d64-fc7f-4fe9-ab4a-da2f09d2d54a admin admin] PATH_INFO: `/v3/projects/a501722ff503426bbca34fbbcc48cac5/users/a02e6c5c0e894928b389b6e0136be249/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:34.876011 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cb1d64-fc7f-4fe9-ab4a-da2f09d2d54a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a501722ff503426bbca34fbbcc48cac5, user_id=a02e6c5c0e894928b389b6e0136be249, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:34.876011 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cb1d64-fc7f-4fe9-ab4a-da2f09d2d54a admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:34.960809 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 806/1618] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:11:34 2022] POST /identity/v3/projects => generated 383 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:11:34.962158 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595de237-e290-4212-b6e0-346eb8f6f8cd admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:34.987770 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 813/1619] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:11:34 2022] PUT /identity/v3/projects/a501722ff503426bbca34fbbcc48cac5/users/a02e6c5c0e894928b389b6e0136be249/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:11:34.990733 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cb1d64-fc7f-4fe9-ab4a-da2f09d2d54a admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:35.026329 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595de237-e290-4212-b6e0-346eb8f6f8cd admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:35.052803 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cb1d64-fc7f-4fe9-ab4a-da2f09d2d54a admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:35.057511 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5979479-1ffd-406e-9771-dd9317825c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:35.058394 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5979479-1ffd-406e-9771-dd9317825c69 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:35.058673 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5979479-1ffd-406e-9771-dd9317825c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:35.058945 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5979479-1ffd-406e-9771-dd9317825c69 admin admin] PATH_INFO: `/v3/projects/196e3f40a70f4ef9b59562eea143da02/users/f5a4e940701d4101b0ff6aa4590fd89c/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:35.074076 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5979479-1ffd-406e-9771-dd9317825c69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=196e3f40a70f4ef9b59562eea143da02, user_id=f5a4e940701d4101b0ff6aa4590fd89c, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:35.077181 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5979479-1ffd-406e-9771-dd9317825c69 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:35.085773 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f570af51-2d10-438b-b741-f89fa7a3a619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:35.086534 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570af51-2d10-438b-b741-f89fa7a3a619 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:35.086918 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570af51-2d10-438b-b741-f89fa7a3a619 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:35.087286 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570af51-2d10-438b-b741-f89fa7a3a619 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:35.088135 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f570af51-2d10-438b-b741-f89fa7a3a619 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:35.090124 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f570af51-2d10-438b-b741-f89fa7a3a619 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:35.158747 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 814/1620] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:11:34 2022] PUT /identity/v3/projects/196e3f40a70f4ef9b59562eea143da02/users/f5a4e940701d4101b0ff6aa4590fd89c/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:11:35.159832 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5979479-1ffd-406e-9771-dd9317825c69 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:35.221861 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 807/1621] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:11:34 2022] POST /identity/v3/users => generated 299 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:11:35.221861 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f570af51-2d10-438b-b741-f89fa7a3a619 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:35.226401 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5979479-1ffd-406e-9771-dd9317825c69 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:35.230236 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f570af51-2d10-438b-b741-f89fa7a3a619 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:35.232249 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c3ccb1-cafe-4cc9-b62f-88c76aa4f8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:35.233278 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c3ccb1-cafe-4cc9-b62f-88c76aa4f8de admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:35.233783 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c3ccb1-cafe-4cc9-b62f-88c76aa4f8de admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:35.234162 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c3ccb1-cafe-4cc9-b62f-88c76aa4f8de admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:35.234950 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c3ccb1-cafe-4cc9-b62f-88c76aa4f8de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:35.235331 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff8bf4d-9f6e-463b-8fe3-91f0c07faa1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:35.236027 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff8bf4d-9f6e-463b-8fe3-91f0c07faa1f admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:35.236370 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff8bf4d-9f6e-463b-8fe3-91f0c07faa1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:35.237868 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c3ccb1-cafe-4cc9-b62f-88c76aa4f8de admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:35.239935 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff8bf4d-9f6e-463b-8fe3-91f0c07faa1f admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:35.240374 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff8bf4d-9f6e-463b-8fe3-91f0c07faa1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:35.241979 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff8bf4d-9f6e-463b-8fe3-91f0c07faa1f admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:35.252640 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 808/1622] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:11:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:11:35.253966 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff8bf4d-9f6e-463b-8fe3-91f0c07faa1f admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:35.263818 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff8bf4d-9f6e-463b-8fe3-91f0c07faa1f admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:35.269574 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfe8f5a-16dd-46c9-a5a7-73f6b0d14841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:35.270191 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe8f5a-16dd-46c9-a5a7-73f6b0d14841 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:35.270471 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe8f5a-16dd-46c9-a5a7-73f6b0d14841 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:35.270746 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe8f5a-16dd-46c9-a5a7-73f6b0d14841 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:35.271446 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfe8f5a-16dd-46c9-a5a7-73f6b0d14841 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:35.273331 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfe8f5a-16dd-46c9-a5a7-73f6b0d14841 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:35.318242 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 815/1623] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:11:35 2022] POST /identity/v3/users => generated 292 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:11:35.319341 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c3ccb1-cafe-4cc9-b62f-88c76aa4f8de admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:35.329401 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c3ccb1-cafe-4cc9-b62f-88c76aa4f8de admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:35.335668 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f03797-944c-4393-b3d9-db8d2016a3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:35.336331 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f03797-944c-4393-b3d9-db8d2016a3d8 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:35.336881 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f03797-944c-4393-b3d9-db8d2016a3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:35.336881 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f03797-944c-4393-b3d9-db8d2016a3d8 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:35.337568 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f03797-944c-4393-b3d9-db8d2016a3d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:35.339582 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f03797-944c-4393-b3d9-db8d2016a3d8 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:35.344824 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 809/1624] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:11:35 2022] POST /identity/v3/projects => generated 377 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:11:35.344824 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfe8f5a-16dd-46c9-a5a7-73f6b0d14841 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:35.406561 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfe8f5a-16dd-46c9-a5a7-73f6b0d14841 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:35.411600 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1252ca90-f044-4a03-a0cb-3bbb67bc5499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:35.412270 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1252ca90-f044-4a03-a0cb-3bbb67bc5499 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:35.412553 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1252ca90-f044-4a03-a0cb-3bbb67bc5499 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:35.412827 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1252ca90-f044-4a03-a0cb-3bbb67bc5499 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:35.413545 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1252ca90-f044-4a03-a0cb-3bbb67bc5499 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:35.415267 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1252ca90-f044-4a03-a0cb-3bbb67bc5499 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:35.425535 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 810/1625] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:11:35 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:11:35.426375 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1252ca90-f044-4a03-a0cb-3bbb67bc5499 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:35.428030 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 816/1626] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:11:35 2022] POST /identity/v3/users => generated 298 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:11:35.429379 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f03797-944c-4393-b3d9-db8d2016a3d8 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:35.437317 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1252ca90-f044-4a03-a0cb-3bbb67bc5499 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:35.438866 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f03797-944c-4393-b3d9-db8d2016a3d8 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:35.442717 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cc13d0-745d-40a2-9c74-54548acaba96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:35.443405 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc13d0-745d-40a2-9c74-54548acaba96 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:35.443722 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc13d0-745d-40a2-9c74-54548acaba96 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:35.444001 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc13d0-745d-40a2-9c74-54548acaba96 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:35.444210 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570141b7-82c0-40fd-9b4a-1a21f1cf3ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:35.444723 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cc13d0-745d-40a2-9c74-54548acaba96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:35.444841 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570141b7-82c0-40fd-9b4a-1a21f1cf3ce2 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:35.445111 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570141b7-82c0-40fd-9b4a-1a21f1cf3ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:35.445381 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570141b7-82c0-40fd-9b4a-1a21f1cf3ce2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:35.446094 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570141b7-82c0-40fd-9b4a-1a21f1cf3ce2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:35.446400 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cc13d0-745d-40a2-9c74-54548acaba96 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:35.447701 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570141b7-82c0-40fd-9b4a-1a21f1cf3ce2 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:35.457641 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 811/1627] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:11:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:11:35.458375 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cc13d0-745d-40a2-9c74-54548acaba96 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:35.462082 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 817/1628] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:11:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:11:35.463017 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570141b7-82c0-40fd-9b4a-1a21f1cf3ce2 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:35.469262 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cc13d0-745d-40a2-9c74-54548acaba96 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:35.473085 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570141b7-82c0-40fd-9b4a-1a21f1cf3ce2 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:35.474115 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e3b955-0baa-4ebf-bb27-f34f5c1f3615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:35.475024 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3b955-0baa-4ebf-bb27-f34f5c1f3615 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:35.475307 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3b955-0baa-4ebf-bb27-f34f5c1f3615 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:35.475619 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3b955-0baa-4ebf-bb27-f34f5c1f3615 admin admin] PATH_INFO: `/v3/projects/eedb58eea0c34c29bb548e35ee09b65c/users/09277a59876047498af154f78f46bd5a/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:35.477733 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca13e2-a6e3-451a-b91b-e11df5f50fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:35.478382 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca13e2-a6e3-451a-b91b-e11df5f50fbb admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:35.478662 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca13e2-a6e3-451a-b91b-e11df5f50fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:35.478938 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca13e2-a6e3-451a-b91b-e11df5f50fbb admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:35.479688 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ca13e2-a6e3-451a-b91b-e11df5f50fbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:35.481392 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ca13e2-a6e3-451a-b91b-e11df5f50fbb admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:35.490952 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e3b955-0baa-4ebf-bb27-f34f5c1f3615 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eedb58eea0c34c29bb548e35ee09b65c, user_id=09277a59876047498af154f78f46bd5a, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:35.492085 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 818/1629] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:11:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:11:35.492941 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca13e2-a6e3-451a-b91b-e11df5f50fbb admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:35.493656 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e3b955-0baa-4ebf-bb27-f34f5c1f3615 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:35.504501 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca13e2-a6e3-451a-b91b-e11df5f50fbb admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:35.509543 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebfa4af-802c-4129-a2d3-c1fb5632bdd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:35.510187 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebfa4af-802c-4129-a2d3-c1fb5632bdd2 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:35.510470 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebfa4af-802c-4129-a2d3-c1fb5632bdd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:35.510747 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebfa4af-802c-4129-a2d3-c1fb5632bdd2 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:35.511471 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebfa4af-802c-4129-a2d3-c1fb5632bdd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:35.513401 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebfa4af-802c-4129-a2d3-c1fb5632bdd2 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:35.559252 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 812/1630] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:11:35 2022] PUT /identity/v3/projects/eedb58eea0c34c29bb548e35ee09b65c/users/09277a59876047498af154f78f46bd5a/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:11:35.559882 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e3b955-0baa-4ebf-bb27-f34f5c1f3615 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:35.609324 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 819/1631] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:11:35 2022] POST /identity/v3/users => generated 295 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:11:35.609324 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebfa4af-802c-4129-a2d3-c1fb5632bdd2 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:35.620708 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebfa4af-802c-4129-a2d3-c1fb5632bdd2 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:35.625968 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2dd567-48af-484d-bcd9-0f02864d5e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:35.626844 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2dd567-48af-484d-bcd9-0f02864d5e9c admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:35.627286 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2dd567-48af-484d-bcd9-0f02864d5e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:35.627700 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2dd567-48af-484d-bcd9-0f02864d5e9c admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:35.628539 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2dd567-48af-484d-bcd9-0f02864d5e9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:35.630766 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2dd567-48af-484d-bcd9-0f02864d5e9c admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:35.631160 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e3b955-0baa-4ebf-bb27-f34f5c1f3615 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:35.636278 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1959912f-07d6-478f-852b-3f18cd9453ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:35.637372 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959912f-07d6-478f-852b-3f18cd9453ee admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:35.637678 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959912f-07d6-478f-852b-3f18cd9453ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:35.637979 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959912f-07d6-478f-852b-3f18cd9453ee admin admin] PATH_INFO: `/v3/projects/a501722ff503426bbca34fbbcc48cac5/users/a02e6c5c0e894928b389b6e0136be249/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:35.640094 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1959912f-07d6-478f-852b-3f18cd9453ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=a501722ff503426bbca34fbbcc48cac5, user_id=a02e6c5c0e894928b389b6e0136be249, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:35.642382 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 820/1632] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:11:35 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:11:35.643426 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1959912f-07d6-478f-852b-3f18cd9453ee admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:35.643989 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2dd567-48af-484d-bcd9-0f02864d5e9c admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:35.654226 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 813/1633] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:11:35 2022] PUT /identity/v3/projects/a501722ff503426bbca34fbbcc48cac5/users/a02e6c5c0e894928b389b6e0136be249/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:11:35.665470 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2dd567-48af-484d-bcd9-0f02864d5e9c admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:35.665693 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1959912f-07d6-478f-852b-3f18cd9453ee admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:35.719443 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e19ca6-262b-47cd-b6de-754d8376ba80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:35.720471 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e19ca6-262b-47cd-b6de-754d8376ba80 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:35.721501 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e19ca6-262b-47cd-b6de-754d8376ba80 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:35.721740 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e19ca6-262b-47cd-b6de-754d8376ba80 admin admin] PATH_INFO: `/v3/projects/196e3f40a70f4ef9b59562eea143da02/users/f5a4e940701d4101b0ff6aa4590fd89c/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:35.723995 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e19ca6-262b-47cd-b6de-754d8376ba80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=196e3f40a70f4ef9b59562eea143da02, user_id=f5a4e940701d4101b0ff6aa4590fd89c, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:35.724954 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1959912f-07d6-478f-852b-3f18cd9453ee admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:35.726691 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e19ca6-262b-47cd-b6de-754d8376ba80 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:35.729734 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e30a5-7e62-446e-8b5b-5ffd7f51e40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:35.730612 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e30a5-7e62-446e-8b5b-5ffd7f51e40d admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:35.730894 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e30a5-7e62-446e-8b5b-5ffd7f51e40d admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:35.731159 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e30a5-7e62-446e-8b5b-5ffd7f51e40d admin admin] PATH_INFO: `/v3/projects/8182d39b3eb24680b87fe7e32da0b52b/users/83e779486ff4486ba63c5780a485b090/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:35.737275 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 821/1634] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:11:35 2022] PUT /identity/v3/projects/196e3f40a70f4ef9b59562eea143da02/users/f5a4e940701d4101b0ff6aa4590fd89c/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:11:35.738161 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e19ca6-262b-47cd-b6de-754d8376ba80 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:35.746434 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32e30a5-7e62-446e-8b5b-5ffd7f51e40d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8182d39b3eb24680b87fe7e32da0b52b, user_id=83e779486ff4486ba63c5780a485b090, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:35.749375 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32e30a5-7e62-446e-8b5b-5ffd7f51e40d admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:35.798357 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e19ca6-262b-47cd-b6de-754d8376ba80 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:35.803319 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a7f0fe-b017-4e4c-9712-ba32e86c6c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:35.804236 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7f0fe-b017-4e4c-9712-ba32e86c6c7f admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:35.804520 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7f0fe-b017-4e4c-9712-ba32e86c6c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:35.804801 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7f0fe-b017-4e4c-9712-ba32e86c6c7f admin admin] PATH_INFO: `/v3/projects/bfbedfbe06254e398d6c51e9c7bd3d88/users/a631ff777ed2405e8168ee6684f800e6/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:35.821149 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a7f0fe-b017-4e4c-9712-ba32e86c6c7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfbedfbe06254e398d6c51e9c7bd3d88, user_id=a631ff777ed2405e8168ee6684f800e6, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:35.823896 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a7f0fe-b017-4e4c-9712-ba32e86c6c7f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:35.834283 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 814/1635] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:11:35 2022] PUT /identity/v3/projects/8182d39b3eb24680b87fe7e32da0b52b/users/83e779486ff4486ba63c5780a485b090/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:11:35.835214 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e30a5-7e62-446e-8b5b-5ffd7f51e40d admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:35.897141 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e30a5-7e62-446e-8b5b-5ffd7f51e40d admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:35.901907 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eea553-fd40-4775-b1f1-79c40a49b63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:35.902571 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eea553-fd40-4775-b1f1-79c40a49b63c admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:35.902856 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eea553-fd40-4775-b1f1-79c40a49b63c admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:35.903133 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eea553-fd40-4775-b1f1-79c40a49b63c admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:35.903904 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eea553-fd40-4775-b1f1-79c40a49b63c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:35.905518 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eea553-fd40-4775-b1f1-79c40a49b63c admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:35.918240 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 815/1636] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:11:35 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:11:35.918240 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eea553-fd40-4775-b1f1-79c40a49b63c admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:35.928414 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eea553-fd40-4775-b1f1-79c40a49b63c admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:35.934204 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823af372-7e3c-4c17-bb50-e95d938ada25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:35.934894 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823af372-7e3c-4c17-bb50-e95d938ada25 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:35.940133 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823af372-7e3c-4c17-bb50-e95d938ada25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:35.940133 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823af372-7e3c-4c17-bb50-e95d938ada25 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:35.940133 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823af372-7e3c-4c17-bb50-e95d938ada25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:35.940133 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823af372-7e3c-4c17-bb50-e95d938ada25 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:35.946389 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 822/1637] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:11:35 2022] PUT /identity/v3/projects/bfbedfbe06254e398d6c51e9c7bd3d88/users/a631ff777ed2405e8168ee6684f800e6/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:11:35.947353 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a7f0fe-b017-4e4c-9712-ba32e86c6c7f admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:35.952759 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 816/1638] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:11:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:11:35.952759 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd4ef5-1d8e-4609-b53d-79c88801465d None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:35.952759 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd4ef5-1d8e-4609-b53d-79c88801465d None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:35.952759 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd4ef5-1d8e-4609-b53d-79c88801465d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:35.981720 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-4dfd4ef5-1d8e-4609-b53d-79c88801465d None None] MFA Rules not processed for user `a02e6c5c0e894928b389b6e0136be249`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:11:35.982994 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-4dfd4ef5-1d8e-4609-b53d-79c88801465d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:36.019834 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a7f0fe-b017-4e4c-9712-ba32e86c6c7f admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:36.025380 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3e3aec-f87e-41b9-b077-3103c57becf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:36.026322 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e3aec-f87e-41b9-b077-3103c57becf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:36.026774 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e3aec-f87e-41b9-b077-3103c57becf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:36.027021 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e3aec-f87e-41b9-b077-3103c57becf4 admin admin] PATH_INFO: `/v3/projects/0486a488dff8466eab866f24429eab4e/users/63d4ee28ddbc4d5885f048e4cbefc85d/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:36.044011 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3e3aec-f87e-41b9-b077-3103c57becf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0486a488dff8466eab866f24429eab4e, user_id=63d4ee28ddbc4d5885f048e4cbefc85d, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:36.046915 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3e3aec-f87e-41b9-b077-3103c57becf4 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:36.066007 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 817/1639] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:11:35 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:11:36.075568 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d49562-95f9-4503-b9e6-9f988d35431a None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:36.075568 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d49562-95f9-4503-b9e6-9f988d35431a None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:36.075568 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d49562-95f9-4503-b9e6-9f988d35431a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:36.096952 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-c7d49562-95f9-4503-b9e6-9f988d35431a None None] MFA Rules not processed for user `f5a4e940701d4101b0ff6aa4590fd89c`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:11:36.098244 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c7d49562-95f9-4503-b9e6-9f988d35431a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:36.121550 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 823/1640] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:11:35 2022] PUT /identity/v3/projects/0486a488dff8466eab866f24429eab4e/users/63d4ee28ddbc4d5885f048e4cbefc85d/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:11:36.121550 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3e3aec-f87e-41b9-b077-3103c57becf4 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:36.181689 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 818/1641] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:11:36 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:11:36.182825 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d49562-95f9-4503-b9e6-9f988d35431a None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:36.189086 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3e3aec-f87e-41b9-b077-3103c57becf4 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:36.195929 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d49562-95f9-4503-b9e6-9f988d35431a None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:36.196584 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b35887a-18e6-41de-88b3-f5eaffe3debe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:36.197414 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35887a-18e6-41de-88b3-f5eaffe3debe admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:36.197721 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35887a-18e6-41de-88b3-f5eaffe3debe admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:36.197997 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35887a-18e6-41de-88b3-f5eaffe3debe admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:36.198727 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b35887a-18e6-41de-88b3-f5eaffe3debe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:36.200439 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b35887a-18e6-41de-88b3-f5eaffe3debe admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:36.201557 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ea589-84f5-459f-ba9a-e8d3fc7b93b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:36.202635 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ea589-84f5-459f-ba9a-e8d3fc7b93b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:36.203014 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ea589-84f5-459f-ba9a-e8d3fc7b93b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:36.203370 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ea589-84f5-459f-ba9a-e8d3fc7b93b4 admin admin] PATH_INFO: `/v3/projects/eedb58eea0c34c29bb548e35ee09b65c/users/09277a59876047498af154f78f46bd5a/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:36.206118 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06ea589-84f5-459f-ba9a-e8d3fc7b93b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eedb58eea0c34c29bb548e35ee09b65c, user_id=09277a59876047498af154f78f46bd5a, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:36.208979 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06ea589-84f5-459f-ba9a-e8d3fc7b93b4 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:36.215653 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 824/1642] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:11:36.217095 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b35887a-18e6-41de-88b3-f5eaffe3debe admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:36.225500 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 819/1643] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:11:36 2022] PUT /identity/v3/projects/eedb58eea0c34c29bb548e35ee09b65c/users/09277a59876047498af154f78f46bd5a/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:11:36.226514 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ea589-84f5-459f-ba9a-e8d3fc7b93b4 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:36.229525 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b35887a-18e6-41de-88b3-f5eaffe3debe admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:36.306322 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1775ef54-a14a-4f68-8c71-8b0f82050d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:36.319184 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775ef54-a14a-4f68-8c71-8b0f82050d5a admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:36.319322 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ea589-84f5-459f-ba9a-e8d3fc7b93b4 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:36.319411 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775ef54-a14a-4f68-8c71-8b0f82050d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:36.319411 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775ef54-a14a-4f68-8c71-8b0f82050d5a admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:36.319411 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1775ef54-a14a-4f68-8c71-8b0f82050d5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:36.319411 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1775ef54-a14a-4f68-8c71-8b0f82050d5a admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:36.319757 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df59c967-b7d0-4e09-aa0e-39c7a7643fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:36.319757 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df59c967-b7d0-4e09-aa0e-39c7a7643fff admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:36.319757 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df59c967-b7d0-4e09-aa0e-39c7a7643fff admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:36.319757 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df59c967-b7d0-4e09-aa0e-39c7a7643fff admin admin] PATH_INFO: `/v3/projects/4e4e50b1efc04956979213869dec7aa1/users/a91775de59f043e1bf5e8a28472583ae/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:36.323927 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 825/1644] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:11:36.326137 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa1a25-5ad5-4d4d-ad4a-a177f28d8b42 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:36.326794 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa1a25-5ad5-4d4d-ad4a-a177f28d8b42 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:36.327289 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa1a25-5ad5-4d4d-ad4a-a177f28d8b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:36.332369 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df59c967-b7d0-4e09-aa0e-39c7a7643fff admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e4e50b1efc04956979213869dec7aa1, user_id=a91775de59f043e1bf5e8a28472583ae, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:36.335634 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df59c967-b7d0-4e09-aa0e-39c7a7643fff admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:36.354401 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-e4aa1a25-5ad5-4d4d-ad4a-a177f28d8b42 None None] MFA Rules not processed for user `7d7d10a70c364505af3b2b8294238615`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:11:36.355785 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e4aa1a25-5ad5-4d4d-ad4a-a177f28d8b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:36.405171 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 820/1645] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:11:36 2022] PUT /identity/v3/projects/4e4e50b1efc04956979213869dec7aa1/users/a91775de59f043e1bf5e8a28472583ae/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:11:36.406476 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df59c967-b7d0-4e09-aa0e-39c7a7643fff admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:36.424845 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 826/1646] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:11:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:11:36.426588 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4900d1-cef7-444c-b268-1161a0f6a6a5 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:36.427023 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4900d1-cef7-444c-b268-1161a0f6a6a5 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:36.427442 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4900d1-cef7-444c-b268-1161a0f6a6a5 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:36.441149 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 827/1647] 10.222.0.52 () {54 vars in 961 bytes} [Sat May 14 21:11:36 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:11:36.442266 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4900d1-cef7-444c-b268-1161a0f6a6a5 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:36.497383 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df59c967-b7d0-4e09-aa0e-39c7a7643fff admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:36.509925 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7f7e9b-c912-4df4-92c4-996483de7adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:36.510722 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f7e9b-c912-4df4-92c4-996483de7adf admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:36.511301 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f7e9b-c912-4df4-92c4-996483de7adf admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:36.511783 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f7e9b-c912-4df4-92c4-996483de7adf admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:36.512601 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7f7e9b-c912-4df4-92c4-996483de7adf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:36.514074 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4900d1-cef7-444c-b268-1161a0f6a6a5 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:36.515825 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7f7e9b-c912-4df4-92c4-996483de7adf admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:36.520309 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28fd8f7-7ed4-40a7-a881-f03cb5a9793e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:36.521285 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28fd8f7-7ed4-40a7-a881-f03cb5a9793e admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:36.521663 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28fd8f7-7ed4-40a7-a881-f03cb5a9793e admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:36.522011 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28fd8f7-7ed4-40a7-a881-f03cb5a9793e admin admin] PATH_INFO: `/v3/projects/8182d39b3eb24680b87fe7e32da0b52b/users/83e779486ff4486ba63c5780a485b090/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:36.524165 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28fd8f7-7ed4-40a7-a881-f03cb5a9793e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8182d39b3eb24680b87fe7e32da0b52b, user_id=83e779486ff4486ba63c5780a485b090, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:36.527144 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28fd8f7-7ed4-40a7-a881-f03cb5a9793e admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:36.531000 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 821/1648] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:11:36.533610 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b6c96b-ed9f-46ab-8bf6-94eaf93840b6 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:36.533956 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b6c96b-ed9f-46ab-8bf6-94eaf93840b6 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:36.534561 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b6c96b-ed9f-46ab-8bf6-94eaf93840b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:36.540049 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 828/1649] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:11:36 2022] PUT /identity/v3/projects/8182d39b3eb24680b87fe7e32da0b52b/users/83e779486ff4486ba63c5780a485b090/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:11:36.540849 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28fd8f7-7ed4-40a7-a881-f03cb5a9793e admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:36.569064 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-32b6c96b-ed9f-46ab-8bf6-94eaf93840b6 None None] MFA Rules not processed for user `09277a59876047498af154f78f46bd5a`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:11:36.570337 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-32b6c96b-ed9f-46ab-8bf6-94eaf93840b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:36.607641 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28fd8f7-7ed4-40a7-a881-f03cb5a9793e admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:36.613124 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b6a5a-00f9-4327-a11d-6183f545a73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:36.613822 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b6a5a-00f9-4327-a11d-6183f545a73b admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:36.614114 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b6a5a-00f9-4327-a11d-6183f545a73b admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:36.614394 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b6a5a-00f9-4327-a11d-6183f545a73b admin admin] PATH_INFO: `/v3/projects/bfbedfbe06254e398d6c51e9c7bd3d88/users/a631ff777ed2405e8168ee6684f800e6/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:36.616664 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7b6a5a-00f9-4327-a11d-6183f545a73b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfbedfbe06254e398d6c51e9c7bd3d88, user_id=a631ff777ed2405e8168ee6684f800e6, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:36.619328 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7b6a5a-00f9-4327-a11d-6183f545a73b admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:36.631832 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 829/1650] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:11:36 2022] PUT /identity/v3/projects/bfbedfbe06254e398d6c51e9c7bd3d88/users/a631ff777ed2405e8168ee6684f800e6/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:11:36.633602 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b6a5a-00f9-4327-a11d-6183f545a73b admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:36.666976 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 822/1651] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:11:36 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:11:36.668368 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32cdb8-957b-4b08-8384-98d8ef5b5937 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:36.668667 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32cdb8-957b-4b08-8384-98d8ef5b5937 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:36.668952 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32cdb8-957b-4b08-8384-98d8ef5b5937 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:36.670677 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 823/1652] 10.222.0.52 () {54 vars in 961 bytes} [Sat May 14 21:11:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:11:36.672694 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f3f41-1378-44f8-8ee7-fd6981617788 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:36.672694 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f3f41-1378-44f8-8ee7-fd6981617788 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:36.672922 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f3f41-1378-44f8-8ee7-fd6981617788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:36.732626 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b6a5a-00f9-4327-a11d-6183f545a73b admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:36.740544 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25108c59-b47c-4c67-a6f7-a8adc2ed4c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:36.742859 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25108c59-b47c-4c67-a6f7-a8adc2ed4c78 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:36.742859 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25108c59-b47c-4c67-a6f7-a8adc2ed4c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:36.742859 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25108c59-b47c-4c67-a6f7-a8adc2ed4c78 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:36.743516 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25108c59-b47c-4c67-a6f7-a8adc2ed4c78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:36.745400 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25108c59-b47c-4c67-a6f7-a8adc2ed4c78 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:36.775871 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 830/1653] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:11:36.777180 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25108c59-b47c-4c67-a6f7-a8adc2ed4c78 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:36.796193 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25108c59-b47c-4c67-a6f7-a8adc2ed4c78 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:36.802127 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32682312-d99d-4957-ab5d-dbaaf53e7e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:36.803202 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32682312-d99d-4957-ab5d-dbaaf53e7e38 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:36.803590 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32682312-d99d-4957-ab5d-dbaaf53e7e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:36.803941 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32682312-d99d-4957-ab5d-dbaaf53e7e38 admin admin] PATH_INFO: `/v3/projects/0486a488dff8466eab866f24429eab4e/users/63d4ee28ddbc4d5885f048e4cbefc85d/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:36.806167 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32682312-d99d-4957-ab5d-dbaaf53e7e38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0486a488dff8466eab866f24429eab4e, user_id=63d4ee28ddbc4d5885f048e4cbefc85d, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:36.809360 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32682312-d99d-4957-ab5d-dbaaf53e7e38 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:36.835536 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 831/1654] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:11:36 2022] PUT /identity/v3/projects/0486a488dff8466eab866f24429eab4e/users/63d4ee28ddbc4d5885f048e4cbefc85d/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:11:36.835536 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003f388-4994-4c47-9ca5-52c7c5aef1bd None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:36.835536 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003f388-4994-4c47-9ca5-52c7c5aef1bd None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:36.835536 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003f388-4994-4c47-9ca5-52c7c5aef1bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:36.856493 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-e77f3f41-1378-44f8-8ee7-fd6981617788 None None] MFA Rules not processed for user `0f1b0e2b025d4eceaa90e1616d0a9db8`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:11:36.858077 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e77f3f41-1378-44f8-8ee7-fd6981617788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:36.865914 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-2003f388-4994-4c47-9ca5-52c7c5aef1bd None None] MFA Rules not processed for user `83e779486ff4486ba63c5780a485b090`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:11:36.870591 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-2003f388-4994-4c47-9ca5-52c7c5aef1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:37.001187 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 824/1655] 10.222.0.52 () {58 vars in 1058 bytes} [Sat May 14 21:11:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:11:37.007532 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 832/1656] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:11:36 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:11:37.009351 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04462cdf-9d4f-4a5f-b010-52840b9fa7e4 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:37.009652 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04462cdf-9d4f-4a5f-b010-52840b9fa7e4 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:37.010087 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04462cdf-9d4f-4a5f-b010-52840b9fa7e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:37.012614 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a604a21-7e12-40d4-a65f-81875c702642 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:37.012614 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a604a21-7e12-40d4-a65f-81875c702642 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:37.012844 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a604a21-7e12-40d4-a65f-81875c702642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:37.042321 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-04462cdf-9d4f-4a5f-b010-52840b9fa7e4 None None] MFA Rules not processed for user `0f1b0e2b025d4eceaa90e1616d0a9db8`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:11:37.043646 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-04462cdf-9d4f-4a5f-b010-52840b9fa7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:37.050896 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-5a604a21-7e12-40d4-a65f-81875c702642 None None] MFA Rules not processed for user `a631ff777ed2405e8168ee6684f800e6`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:11:37.052287 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-5a604a21-7e12-40d4-a65f-81875c702642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:37.058082 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 833/1657] 10.222.0.52 () {58 vars in 1058 bytes} [Sat May 14 21:11:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:11:37.058749 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04462cdf-9d4f-4a5f-b010-52840b9fa7e4 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:37.144956 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 825/1658] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:11:37 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:11:37.144956 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc2cb04-acda-4493-8654-c5028583a982 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:37.144956 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc2cb04-acda-4493-8654-c5028583a982 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:37.144956 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc2cb04-acda-4493-8654-c5028583a982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:37.145302 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04462cdf-9d4f-4a5f-b010-52840b9fa7e4 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:37.150204 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f043fc34-8255-498c-b958-625a63f108e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:37.150638 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043fc34-8255-498c-b958-625a63f108e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:37.150923 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043fc34-8255-498c-b958-625a63f108e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:37.153578 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043fc34-8255-498c-b958-625a63f108e3 admin admin] PATH_INFO: `/v3/projects/4e4e50b1efc04956979213869dec7aa1/users/a91775de59f043e1bf5e8a28472583ae/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:37.153578 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f043fc34-8255-498c-b958-625a63f108e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e4e50b1efc04956979213869dec7aa1, user_id=a91775de59f043e1bf5e8a28472583ae, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:37.156339 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f043fc34-8255-498c-b958-625a63f108e3 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:37.169988 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 834/1659] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:11:37 2022] PUT /identity/v3/projects/4e4e50b1efc04956979213869dec7aa1/users/a91775de59f043e1bf5e8a28472583ae/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:11:37.170632 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f043fc34-8255-498c-b958-625a63f108e3 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:37.170780 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-6cc2cb04-acda-4493-8654-c5028583a982 None None] MFA Rules not processed for user `63d4ee28ddbc4d5885f048e4cbefc85d`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:11:37.172166 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-6cc2cb04-acda-4493-8654-c5028583a982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:37.257812 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f043fc34-8255-498c-b958-625a63f108e3 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:37.268429 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 826/1660] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:11:37 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:11:37.268429 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc2cb04-acda-4493-8654-c5028583a982 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:37.268710 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e8717-a655-4cb1-b8c9-1b5465a9d617 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:37.269204 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e8717-a655-4cb1-b8c9-1b5465a9d617 service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:37.269490 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e8717-a655-4cb1-b8c9-1b5465a9d617 service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:37.269771 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e8717-a655-4cb1-b8c9-1b5465a9d617 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:37.287344 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc2cb04-acda-4493-8654-c5028583a982 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:37.297065 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84496bf2-a117-41b7-977c-54cbe61c53a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:37.297857 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84496bf2-a117-41b7-977c-54cbe61c53a3 service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:37.299463 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84496bf2-a117-41b7-977c-54cbe61c53a3 service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:37.300244 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84496bf2-a117-41b7-977c-54cbe61c53a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:37.344356 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842e8717-a655-4cb1-b8c9-1b5465a9d617 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:37.346629 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842e8717-a655-4cb1-b8c9-1b5465a9d617 service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:37.357263 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 835/1661] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:11:37 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:11:37.358597 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796488cf-f855-435b-a1b3-d6e9eb073a76 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:37.358891 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796488cf-f855-435b-a1b3-d6e9eb073a76 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:37.359172 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796488cf-f855-435b-a1b3-d6e9eb073a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:37.372084 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84496bf2-a117-41b7-977c-54cbe61c53a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:37.373775 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84496bf2-a117-41b7-977c-54cbe61c53a3 service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:37.384751 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 827/1662] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:11:37 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:11:37.394766 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-796488cf-f855-435b-a1b3-d6e9eb073a76 None None] MFA Rules not processed for user `a91775de59f043e1bf5e8a28472583ae`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:11:37.400294 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-796488cf-f855-435b-a1b3-d6e9eb073a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:37.497409 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 836/1663] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:11:37 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:11:37.698315 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012c45e-97aa-4351-9100-8c6cfb1325e5 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:37.698637 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012c45e-97aa-4351-9100-8c6cfb1325e5 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:37.698913 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012c45e-97aa-4351-9100-8c6cfb1325e5 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:37.704767 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 828/1664] 10.222.0.52 () {54 vars in 912 bytes} [Sat May 14 21:11:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:11:37.709067 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796488cf-f855-435b-a1b3-d6e9eb073a76 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:37.714352 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b976ee6-f405-475e-a5d3-82d2ff43ce92 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:37.714667 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b976ee6-f405-475e-a5d3-82d2ff43ce92 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:37.714946 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b976ee6-f405-475e-a5d3-82d2ff43ce92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:37.727941 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796488cf-f855-435b-a1b3-d6e9eb073a76 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:37.737167 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce796aa-48a8-41ad-a927-f1d80bac8603 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:37.737674 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-1b976ee6-f405-475e-a5d3-82d2ff43ce92 None None] MFA Rules not processed for user `0f1b0e2b025d4eceaa90e1616d0a9db8`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:11:37.738694 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce796aa-48a8-41ad-a927-f1d80bac8603 service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:37.738993 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce796aa-48a8-41ad-a927-f1d80bac8603 service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:37.739125 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-1b976ee6-f405-475e-a5d3-82d2ff43ce92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:37.739274 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce796aa-48a8-41ad-a927-f1d80bac8603 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:37.749090 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 829/1665] 10.222.0.52 () {58 vars in 1009 bytes} [Sat May 14 21:11:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:11:37.766549 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b976ee6-f405-475e-a5d3-82d2ff43ce92 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:37.769051 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-1b976ee6-f405-475e-a5d3-82d2ff43ce92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:37.816208 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce796aa-48a8-41ad-a927-f1d80bac8603 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:37.818046 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce796aa-48a8-41ad-a927-f1d80bac8603 service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:37.828005 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 837/1666] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:11:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:11:37.840165 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b976ee6-f405-475e-a5d3-82d2ff43ce92 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:37.848144 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce29f08-cfc3-450d-9322-45b23088cd91 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b5cb86f190f4fcfb06d66cb8f14643f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:37.848875 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce29f08-cfc3-450d-9322-45b23088cd91 service glance] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:37.849225 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce29f08-cfc3-450d-9322-45b23088cd91 service glance] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:37.849567 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce29f08-cfc3-450d-9322-45b23088cd91 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:37.852500 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce796aa-48a8-41ad-a927-f1d80bac8603 service nova] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:37.866395 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce29f08-cfc3-450d-9322-45b23088cd91 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:37.867897 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce29f08-cfc3-450d-9322-45b23088cd91 service glance] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:37.903521 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 830/1667] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:11:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:11:37.904871 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce29f08-cfc3-450d-9322-45b23088cd91 service glance] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:37.931157 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce29f08-cfc3-450d-9322-45b23088cd91 service glance] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:37.940008 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f71fe3a-24e7-4a50-9374-375cd176c7a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:37.947500 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f71fe3a-24e7-4a50-9374-375cd176c7a8 service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:37.947500 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f71fe3a-24e7-4a50-9374-375cd176c7a8 service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:37.947500 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f71fe3a-24e7-4a50-9374-375cd176c7a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:37.965975 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce796aa-48a8-41ad-a927-f1d80bac8603 service nova] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:37.976839 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28867bb0-0556-4fb0-962f-e6f547657abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:37.977805 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28867bb0-0556-4fb0-962f-e6f547657abc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:37.978098 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28867bb0-0556-4fb0-962f-e6f547657abc admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:37.978429 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28867bb0-0556-4fb0-962f-e6f547657abc admin admin] PATH_INFO: `/v3/users/187b7fcb1e2a40ebaa484ad813116e67` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:37.981002 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28867bb0-0556-4fb0-962f-e6f547657abc admin admin] RBAC: Authorizing `identity:delete_user(user_id=187b7fcb1e2a40ebaa484ad813116e67)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:37.982182 ncdv-master-1 devstack@keystone.service[91106]: WARNING py.warnings [None req-28867bb0-0556-4fb0-962f-e6f547657abc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 14 21:11:37.982182 ncdv-master-1 devstack@keystone.service[91106]: warnings.warn(msg) May 14 21:11:37.982182 ncdv-master-1 devstack@keystone.service[91106]: May 14 21:11:37.986917 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28867bb0-0556-4fb0-962f-e6f547657abc admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:38.047822 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f71fe3a-24e7-4a50-9374-375cd176c7a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:38.049778 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f71fe3a-24e7-4a50-9374-375cd176c7a8 service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:38.062216 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 831/1668] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:11:37 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:11:38.173078 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f71fe3a-24e7-4a50-9374-375cd176c7a8 service nova] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:38.187547 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f71fe3a-24e7-4a50-9374-375cd176c7a8 service nova] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:38.194312 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24791035-425e-45f9-a3a7-747c0a6aec6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:38.195037 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24791035-425e-45f9-a3a7-747c0a6aec6a service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:38.195320 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24791035-425e-45f9-a3a7-747c0a6aec6a service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:38.198374 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24791035-425e-45f9-a3a7-747c0a6aec6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:38.226025 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-28867bb0-0556-4fb0-962f-e6f547657abc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '187b7fcb1e2a40ebaa484ad813116e67'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:38.258313 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-28867bb0-0556-4fb0-962f-e6f547657abc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '187b7fcb1e2a40ebaa484ad813116e67'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:38.275742 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-28867bb0-0556-4fb0-962f-e6f547657abc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '187b7fcb1e2a40ebaa484ad813116e67'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:38.341630 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24791035-425e-45f9-a3a7-747c0a6aec6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:38.343264 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24791035-425e-45f9-a3a7-747c0a6aec6a service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:38.348234 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-28867bb0-0556-4fb0-962f-e6f547657abc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '187b7fcb1e2a40ebaa484ad813116e67'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:38.349796 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-28867bb0-0556-4fb0-962f-e6f547657abc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '187b7fcb1e2a40ebaa484ad813116e67'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:38.356631 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 832/1669] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:11:38 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:11:38.359615 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 838/1670] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:11:37 2022] DELETE /identity/v3/users/187b7fcb1e2a40ebaa484ad813116e67 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:11:38.368436 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e54d5-2186-4161-b11e-b1a191cc20db None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:38.370746 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e54d5-2186-4161-b11e-b1a191cc20db None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:38.375010 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e54d5-2186-4161-b11e-b1a191cc20db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:38.394017 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-946e54d5-2186-4161-b11e-b1a191cc20db None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:11:38.395408 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-946e54d5-2186-4161-b11e-b1a191cc20db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:38.474635 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28867bb0-0556-4fb0-962f-e6f547657abc admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:38.476186 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-28867bb0-0556-4fb0-962f-e6f547657abc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:38.507224 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 833/1671] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:11:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:11:38.523293 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946e54d5-2186-4161-b11e-b1a191cc20db None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:38.525411 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-946e54d5-2186-4161-b11e-b1a191cc20db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:38.654614 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28867bb0-0556-4fb0-962f-e6f547657abc admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:38.666599 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caa6d4f-9334-4030-b79b-8c63cae0d77a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:38.668938 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caa6d4f-9334-4030-b79b-8c63cae0d77a service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:38.669399 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caa6d4f-9334-4030-b79b-8c63cae0d77a service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:38.669830 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caa6d4f-9334-4030-b79b-8c63cae0d77a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:38.672421 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-3caa6d4f-9334-4030-b79b-8c63cae0d77a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:38.693845 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946e54d5-2186-4161-b11e-b1a191cc20db None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:38.706312 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71bbc05-74c1-47a2-8c80-af4deb703993 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:38.707750 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71bbc05-74c1-47a2-8c80-af4deb703993 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:38.709235 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71bbc05-74c1-47a2-8c80-af4deb703993 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:38.710419 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71bbc05-74c1-47a2-8c80-af4deb703993 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:38.751207 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71bbc05-74c1-47a2-8c80-af4deb703993 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:38.753109 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71bbc05-74c1-47a2-8c80-af4deb703993 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:38.778249 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 834/1672] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:11:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:11:38.805415 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caa6d4f-9334-4030-b79b-8c63cae0d77a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:38.807563 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caa6d4f-9334-4030-b79b-8c63cae0d77a service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:38.831963 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71bbc05-74c1-47a2-8c80-af4deb703993 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:38.833724 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-f71bbc05-74c1-47a2-8c80-af4deb703993 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:38.839235 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 839/1673] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:11:38 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:11:38.861021 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71bbc05-74c1-47a2-8c80-af4deb703993 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:38.867730 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7672971c-fdf9-40f3-a1d0-73110c4848a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:38.868303 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672971c-fdf9-40f3-a1d0-73110c4848a7 service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:38.868633 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672971c-fdf9-40f3-a1d0-73110c4848a7 service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:38.868920 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672971c-fdf9-40f3-a1d0-73110c4848a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:38.876811 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-7672971c-fdf9-40f3-a1d0-73110c4848a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:38.961402 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caa6d4f-9334-4030-b79b-8c63cae0d77a service nova] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:38.962850 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-3caa6d4f-9334-4030-b79b-8c63cae0d77a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:38.969158 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7672971c-fdf9-40f3-a1d0-73110c4848a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:38.972456 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7672971c-fdf9-40f3-a1d0-73110c4848a7 service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:38.990569 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 835/1674] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:11:38 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:11:39.099772 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caa6d4f-9334-4030-b79b-8c63cae0d77a service nova] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:39.105580 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4414916f-d334-4ffa-b6b6-a5453764851b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:39.106317 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4414916f-d334-4ffa-b6b6-a5453764851b service placement] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:39.106609 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4414916f-d334-4ffa-b6b6-a5453764851b service placement] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:39.106954 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4414916f-d334-4ffa-b6b6-a5453764851b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:39.117217 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-4414916f-d334-4ffa-b6b6-a5453764851b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:39.133745 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4414916f-d334-4ffa-b6b6-a5453764851b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:39.135380 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4414916f-d334-4ffa-b6b6-a5453764851b service placement] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:39.169990 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 840/1675] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:11:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:11:39.201423 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7672971c-fdf9-40f3-a1d0-73110c4848a7 service nova] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:39.203000 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-7672971c-fdf9-40f3-a1d0-73110c4848a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:39.230374 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7672971c-fdf9-40f3-a1d0-73110c4848a7 service nova] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:39.253503 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4707cb52-54d9-468c-afd2-f7af8ffd200e None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:39.254061 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4707cb52-54d9-468c-afd2-f7af8ffd200e None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:39.254487 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4707cb52-54d9-468c-afd2-f7af8ffd200e None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:39.255211 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406fe747-306d-42d8-b328-3aab4e90799e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:39.256681 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406fe747-306d-42d8-b328-3aab4e90799e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:39.257057 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 841/1676] 10.222.0.52 () {54 vars in 912 bytes} [Sat May 14 21:11:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 14 21:11:39.262424 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406fe747-306d-42d8-b328-3aab4e90799e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:39.262846 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406fe747-306d-42d8-b328-3aab4e90799e admin admin] PATH_INFO: `/v3/users/78a55f9dde1b4e769c8d91837f03c166` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:39.263984 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0fc70-c1b4-4a4c-8d99-aac8c243358d None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:39.264865 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0fc70-c1b4-4a4c-8d99-aac8c243358d None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:39.265273 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0fc70-c1b4-4a4c-8d99-aac8c243358d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:39.265938 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406fe747-306d-42d8-b328-3aab4e90799e admin admin] RBAC: Authorizing `identity:delete_user(user_id=78a55f9dde1b4e769c8d91837f03c166)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:39.268852 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406fe747-306d-42d8-b328-3aab4e90799e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:39.304884 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-e8a0fc70-c1b4-4a4c-8d99-aac8c243358d None None] MFA Rules not processed for user `0f1b0e2b025d4eceaa90e1616d0a9db8`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:11:39.308534 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e8a0fc70-c1b4-4a4c-8d99-aac8c243358d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:39.376266 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 842/1677] 10.222.0.52 () {58 vars in 1009 bytes} [Sat May 14 21:11:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:11:39.396103 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a0fc70-c1b4-4a4c-8d99-aac8c243358d None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:39.410075 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a0fc70-c1b4-4a4c-8d99-aac8c243358d None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:39.419674 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea5217d-a708-42ce-b0d6-d857377bb2f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:39.420792 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5217d-a708-42ce-b0d6-d857377bb2f6 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:39.421808 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5217d-a708-42ce-b0d6-d857377bb2f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:39.421808 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5217d-a708-42ce-b0d6-d857377bb2f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:39.450074 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea5217d-a708-42ce-b0d6-d857377bb2f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:39.451772 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea5217d-a708-42ce-b0d6-d857377bb2f6 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:39.480312 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 843/1678] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:11:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:11:39.480591 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-406fe747-306d-42d8-b328-3aab4e90799e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78a55f9dde1b4e769c8d91837f03c166'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:39.495818 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-406fe747-306d-42d8-b328-3aab4e90799e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78a55f9dde1b4e769c8d91837f03c166'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:39.497608 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-406fe747-306d-42d8-b328-3aab4e90799e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78a55f9dde1b4e769c8d91837f03c166'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:39.565044 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-406fe747-306d-42d8-b328-3aab4e90799e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78a55f9dde1b4e769c8d91837f03c166'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:39.598269 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-406fe747-306d-42d8-b328-3aab4e90799e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78a55f9dde1b4e769c8d91837f03c166'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:39.606459 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 836/1679] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:11:39 2022] DELETE /identity/v3/users/78a55f9dde1b4e769c8d91837f03c166 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:11:39.612063 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0128fd4-26e2-4bb8-a867-386aaebbfb6c None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:39.612768 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0128fd4-26e2-4bb8-a867-386aaebbfb6c None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:39.613119 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0128fd4-26e2-4bb8-a867-386aaebbfb6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:39.636625 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-a0128fd4-26e2-4bb8-a867-386aaebbfb6c None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:11:39.637818 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-a0128fd4-26e2-4bb8-a867-386aaebbfb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:39.667847 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406fe747-306d-42d8-b328-3aab4e90799e admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:39.669317 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-406fe747-306d-42d8-b328-3aab4e90799e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:39.793594 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 844/1680] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:11:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:11:39.804000 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0128fd4-26e2-4bb8-a867-386aaebbfb6c None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:39.805463 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-a0128fd4-26e2-4bb8-a867-386aaebbfb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:39.813640 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406fe747-306d-42d8-b328-3aab4e90799e admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:39.828995 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ed479-59e5-4d44-8dc8-26b7e241bb06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:39.828995 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ed479-59e5-4d44-8dc8-26b7e241bb06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:39.828995 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ed479-59e5-4d44-8dc8-26b7e241bb06 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:39.828995 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ed479-59e5-4d44-8dc8-26b7e241bb06 admin admin] PATH_INFO: `/v3/projects/6ef6150a042b4fb0be291048656e5e9c` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:39.829288 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279ed479-59e5-4d44-8dc8-26b7e241bb06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ef6150a042b4fb0be291048656e5e9c)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:39.829288 ncdv-master-1 devstack@keystone.service[91107]: WARNING py.warnings [None req-279ed479-59e5-4d44-8dc8-26b7e241bb06 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 14 21:11:39.829288 ncdv-master-1 devstack@keystone.service[91107]: warnings.warn(msg) May 14 21:11:39.829288 ncdv-master-1 devstack@keystone.service[91107]: May 14 21:11:39.830050 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279ed479-59e5-4d44-8dc8-26b7e241bb06 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:39.914028 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0128fd4-26e2-4bb8-a867-386aaebbfb6c None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:39.920969 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea3dffc-1653-4bf5-bd7d-dc834d2e9555 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:39.921658 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea3dffc-1653-4bf5-bd7d-dc834d2e9555 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:39.921940 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea3dffc-1653-4bf5-bd7d-dc834d2e9555 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:39.922366 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea3dffc-1653-4bf5-bd7d-dc834d2e9555 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:39.952636 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea3dffc-1653-4bf5-bd7d-dc834d2e9555 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:39.954416 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea3dffc-1653-4bf5-bd7d-dc834d2e9555 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:39.974950 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 845/1681] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:11:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:11:39.988579 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-279ed479-59e5-4d44-8dc8-26b7e241bb06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ef6150a042b4fb0be291048656e5e9c', 'request_id': 'req-279ed479-59e5-4d44-8dc8-26b7e241bb06'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:39.996447 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-279ed479-59e5-4d44-8dc8-26b7e241bb06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ef6150a042b4fb0be291048656e5e9c', 'request_id': 'req-279ed479-59e5-4d44-8dc8-26b7e241bb06'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:40.021554 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea3dffc-1653-4bf5-bd7d-dc834d2e9555 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:40.023019 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-1ea3dffc-1653-4bf5-bd7d-dc834d2e9555 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:40.030509 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-279ed479-59e5-4d44-8dc8-26b7e241bb06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ef6150a042b4fb0be291048656e5e9c', 'request_id': 'req-279ed479-59e5-4d44-8dc8-26b7e241bb06'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:40.038375 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea3dffc-1653-4bf5-bd7d-dc834d2e9555 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:40.118188 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-279ed479-59e5-4d44-8dc8-26b7e241bb06 admin admin] The token cache is being invalidate because project 6ef6150a042b4fb0be291048656e5e9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:11:40.118471 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-279ed479-59e5-4d44-8dc8-26b7e241bb06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:40.119467 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-279ed479-59e5-4d44-8dc8-26b7e241bb06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:40.122272 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 837/1682] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:11:39 2022] DELETE /identity/v3/projects/6ef6150a042b4fb0be291048656e5e9c => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:11:40.128015 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ed479-59e5-4d44-8dc8-26b7e241bb06 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:40.131870 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-279ed479-59e5-4d44-8dc8-26b7e241bb06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:40.208100 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c09593-ee3d-428c-8a4f-f956ace6226f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:40.209002 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c09593-ee3d-428c-8a4f-f956ace6226f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:40.209288 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c09593-ee3d-428c-8a4f-f956ace6226f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:40.209577 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c09593-ee3d-428c-8a4f-f956ace6226f admin admin] PATH_INFO: `/v3/users/94cb6331b06048e491f46346898dd347` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:40.210803 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c09593-ee3d-428c-8a4f-f956ace6226f admin admin] RBAC: Authorizing `identity:delete_user(user_id=94cb6331b06048e491f46346898dd347)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:40.212820 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c09593-ee3d-428c-8a4f-f956ace6226f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:40.289451 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ed479-59e5-4d44-8dc8-26b7e241bb06 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:40.297131 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6a180f-dab9-4912-9c8c-729630e6cacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:40.298058 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a180f-dab9-4912-9c8c-729630e6cacd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:40.298345 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a180f-dab9-4912-9c8c-729630e6cacd admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:40.299151 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a180f-dab9-4912-9c8c-729630e6cacd admin admin] PATH_INFO: `/v3/users/09277a59876047498af154f78f46bd5a` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:40.300562 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6a180f-dab9-4912-9c8c-729630e6cacd admin admin] RBAC: Authorizing `identity:delete_user(user_id=09277a59876047498af154f78f46bd5a)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:40.303088 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6a180f-dab9-4912-9c8c-729630e6cacd admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:40.479155 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-70c09593-ee3d-428c-8a4f-f956ace6226f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94cb6331b06048e491f46346898dd347'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:40.504098 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-70c09593-ee3d-428c-8a4f-f956ace6226f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94cb6331b06048e491f46346898dd347'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:40.512548 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-70c09593-ee3d-428c-8a4f-f956ace6226f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94cb6331b06048e491f46346898dd347'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:40.580169 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dc6a180f-dab9-4912-9c8c-729630e6cacd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09277a59876047498af154f78f46bd5a'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:40.601975 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dc6a180f-dab9-4912-9c8c-729630e6cacd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09277a59876047498af154f78f46bd5a'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:40.604961 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-70c09593-ee3d-428c-8a4f-f956ace6226f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94cb6331b06048e491f46346898dd347'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:40.605950 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-70c09593-ee3d-428c-8a4f-f956ace6226f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94cb6331b06048e491f46346898dd347'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:40.615116 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dc6a180f-dab9-4912-9c8c-729630e6cacd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09277a59876047498af154f78f46bd5a'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:40.615332 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 846/1683] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:11:40 2022] DELETE /identity/v3/users/94cb6331b06048e491f46346898dd347 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:11:40.616853 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86465b-bf03-4918-9684-60cc15a92295 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:40.617139 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86465b-bf03-4918-9684-60cc15a92295 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:40.619010 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86465b-bf03-4918-9684-60cc15a92295 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:40.619913 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 847/1684] 10.222.0.52 () {54 vars in 912 bytes} [Sat May 14 21:11:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:11:40.621551 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3680adf-7132-4f2d-84d4-432857632841 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:40.621842 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3680adf-7132-4f2d-84d4-432857632841 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:40.623666 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3680adf-7132-4f2d-84d4-432857632841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:40.646800 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-a3680adf-7132-4f2d-84d4-432857632841 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:11:40.648056 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-a3680adf-7132-4f2d-84d4-432857632841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:40.707943 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dc6a180f-dab9-4912-9c8c-729630e6cacd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09277a59876047498af154f78f46bd5a'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:40.725609 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dc6a180f-dab9-4912-9c8c-729630e6cacd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09277a59876047498af154f78f46bd5a'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:40.734696 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 838/1685] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:11:40 2022] DELETE /identity/v3/users/09277a59876047498af154f78f46bd5a => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:11:40.735900 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862bc462-c5a7-4980-b5ff-7f86d1f97fde None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:40.736503 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862bc462-c5a7-4980-b5ff-7f86d1f97fde None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:40.736841 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862bc462-c5a7-4980-b5ff-7f86d1f97fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:40.740263 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 848/1686] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:11:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:11:40.805470 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-862bc462-c5a7-4980-b5ff-7f86d1f97fde None None] MFA Rules not processed for user `0812ae67e44d483baf2dbb1a5332a1d7`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:11:40.807219 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-862bc462-c5a7-4980-b5ff-7f86d1f97fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:40.898215 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3680adf-7132-4f2d-84d4-432857632841 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:40.899735 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-a3680adf-7132-4f2d-84d4-432857632841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:40.899939 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 839/1687] 10.222.0.52 () {58 vars in 1009 bytes} [Sat May 14 21:11:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:11:40.953541 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862bc462-c5a7-4980-b5ff-7f86d1f97fde None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:40.961589 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-862bc462-c5a7-4980-b5ff-7f86d1f97fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:41.004023 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862bc462-c5a7-4980-b5ff-7f86d1f97fde None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:41.022544 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cf0bdd-7f76-4e54-9123-0e4ae595b84a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:41.024047 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf0bdd-7f76-4e54-9123-0e4ae595b84a service placement] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:41.025562 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf0bdd-7f76-4e54-9123-0e4ae595b84a service placement] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:41.026105 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf0bdd-7f76-4e54-9123-0e4ae595b84a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:41.042270 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cf0bdd-7f76-4e54-9123-0e4ae595b84a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:41.044075 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cf0bdd-7f76-4e54-9123-0e4ae595b84a service placement] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:41.049255 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3680adf-7132-4f2d-84d4-432857632841 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:41.093600 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 840/1688] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:11:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:11:41.094843 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cf0bdd-7f76-4e54-9123-0e4ae595b84a service placement] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:41.099462 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c4cf0bdd-7f76-4e54-9123-0e4ae595b84a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:41.130941 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfe6b3e-08cd-4f49-9c9b-7b2eb62e404b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:41.131704 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe6b3e-08cd-4f49-9c9b-7b2eb62e404b service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:41.131994 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe6b3e-08cd-4f49-9c9b-7b2eb62e404b service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:41.132275 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe6b3e-08cd-4f49-9c9b-7b2eb62e404b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:41.233481 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cf0bdd-7f76-4e54-9123-0e4ae595b84a service placement] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:41.235325 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfe6b3e-08cd-4f49-9c9b-7b2eb62e404b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:41.236836 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfe6b3e-08cd-4f49-9c9b-7b2eb62e404b service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:41.249342 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9040ddb2-f006-494c-9938-8999918f1491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:41.250214 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040ddb2-f006-494c-9938-8999918f1491 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:41.250500 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040ddb2-f006-494c-9938-8999918f1491 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:41.250780 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040ddb2-f006-494c-9938-8999918f1491 admin admin] PATH_INFO: `/v3/projects/98338f941db74e73803bef199f8b90a4` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:41.253564 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9040ddb2-f006-494c-9938-8999918f1491 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98338f941db74e73803bef199f8b90a4)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:41.256255 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9040ddb2-f006-494c-9938-8999918f1491 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:41.266527 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 849/1689] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:11:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:11:41.489951 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9040ddb2-f006-494c-9938-8999918f1491 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98338f941db74e73803bef199f8b90a4', 'request_id': 'req-9040ddb2-f006-494c-9938-8999918f1491'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:41.497641 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9040ddb2-f006-494c-9938-8999918f1491 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98338f941db74e73803bef199f8b90a4', 'request_id': 'req-9040ddb2-f006-494c-9938-8999918f1491'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:41.506360 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9040ddb2-f006-494c-9938-8999918f1491 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98338f941db74e73803bef199f8b90a4', 'request_id': 'req-9040ddb2-f006-494c-9938-8999918f1491'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:41.596054 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfe6b3e-08cd-4f49-9c9b-7b2eb62e404b service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:41.597825 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-fbfe6b3e-08cd-4f49-9c9b-7b2eb62e404b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:41.628438 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9040ddb2-f006-494c-9938-8999918f1491 admin admin] The token cache is being invalidate because project 98338f941db74e73803bef199f8b90a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:11:41.628438 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9040ddb2-f006-494c-9938-8999918f1491 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:41.628631 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9040ddb2-f006-494c-9938-8999918f1491 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:41.631134 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 841/1690] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:11:41 2022] DELETE /identity/v3/projects/98338f941db74e73803bef199f8b90a4 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:11:41.634720 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9040ddb2-f006-494c-9938-8999918f1491 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:41.635379 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfe6b3e-08cd-4f49-9c9b-7b2eb62e404b service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:41.637329 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-9040ddb2-f006-494c-9938-8999918f1491 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:41.787246 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9040ddb2-f006-494c-9938-8999918f1491 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:41.788224 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7531182a-9b20-4171-af87-b3afa26c7a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:41.792533 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7531182a-9b20-4171-af87-b3afa26c7a57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:41.792714 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7531182a-9b20-4171-af87-b3afa26c7a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:41.793010 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7531182a-9b20-4171-af87-b3afa26c7a57 admin admin] PATH_INFO: `/v3/projects/eedb58eea0c34c29bb548e35ee09b65c` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:41.794907 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7531182a-9b20-4171-af87-b3afa26c7a57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eedb58eea0c34c29bb548e35ee09b65c)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:41.797486 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7531182a-9b20-4171-af87-b3afa26c7a57 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:41.813020 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ffde6d-b067-43e8-b7b2-37679d2ad5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:41.813020 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ffde6d-b067-43e8-b7b2-37679d2ad5f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:41.813020 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ffde6d-b067-43e8-b7b2-37679d2ad5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:41.813020 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ffde6d-b067-43e8-b7b2-37679d2ad5f6 admin admin] PATH_INFO: `/v3/users/a631ff777ed2405e8168ee6684f800e6` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:41.813371 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ffde6d-b067-43e8-b7b2-37679d2ad5f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a631ff777ed2405e8168ee6684f800e6)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:41.815837 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ffde6d-b067-43e8-b7b2-37679d2ad5f6 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:42.022069 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-7531182a-9b20-4171-af87-b3afa26c7a57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eedb58eea0c34c29bb548e35ee09b65c', 'request_id': 'req-7531182a-9b20-4171-af87-b3afa26c7a57'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:42.037326 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-30ffde6d-b067-43e8-b7b2-37679d2ad5f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a631ff777ed2405e8168ee6684f800e6'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:42.045949 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-7531182a-9b20-4171-af87-b3afa26c7a57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eedb58eea0c34c29bb548e35ee09b65c', 'request_id': 'req-7531182a-9b20-4171-af87-b3afa26c7a57'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:42.067105 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-30ffde6d-b067-43e8-b7b2-37679d2ad5f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a631ff777ed2405e8168ee6684f800e6'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:42.081609 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-30ffde6d-b067-43e8-b7b2-37679d2ad5f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a631ff777ed2405e8168ee6684f800e6'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:42.147242 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-7531182a-9b20-4171-af87-b3afa26c7a57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eedb58eea0c34c29bb548e35ee09b65c', 'request_id': 'req-7531182a-9b20-4171-af87-b3afa26c7a57'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:42.161749 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-7531182a-9b20-4171-af87-b3afa26c7a57 admin admin] The token cache is being invalidate because project eedb58eea0c34c29bb548e35ee09b65c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:11:42.162044 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-7531182a-9b20-4171-af87-b3afa26c7a57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:42.162784 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-7531182a-9b20-4171-af87-b3afa26c7a57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:42.167646 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 850/1691] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:11:41 2022] DELETE /identity/v3/projects/eedb58eea0c34c29bb548e35ee09b65c => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:11:42.167646 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7531182a-9b20-4171-af87-b3afa26c7a57 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:42.169614 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-7531182a-9b20-4171-af87-b3afa26c7a57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:42.196886 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-30ffde6d-b067-43e8-b7b2-37679d2ad5f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a631ff777ed2405e8168ee6684f800e6'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:42.217456 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-30ffde6d-b067-43e8-b7b2-37679d2ad5f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a631ff777ed2405e8168ee6684f800e6'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:42.241018 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 842/1692] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:11:41 2022] DELETE /identity/v3/users/a631ff777ed2405e8168ee6684f800e6 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:11:42.243006 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ffde6d-b067-43e8-b7b2-37679d2ad5f6 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:42.245098 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7531182a-9b20-4171-af87-b3afa26c7a57 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:42.246185 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-30ffde6d-b067-43e8-b7b2-37679d2ad5f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:42.346349 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265e1082-d3db-4ddc-8182-5c0c1eb7e6c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:42.347297 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e1082-d3db-4ddc-8182-5c0c1eb7e6c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:42.347853 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e1082-d3db-4ddc-8182-5c0c1eb7e6c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:42.348140 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e1082-d3db-4ddc-8182-5c0c1eb7e6c7 admin admin] PATH_INFO: `/v3/users/9c00dfe7fbe34ec5aacccdcf52f68cf9` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:42.349612 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265e1082-d3db-4ddc-8182-5c0c1eb7e6c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c00dfe7fbe34ec5aacccdcf52f68cf9)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:42.351659 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265e1082-d3db-4ddc-8182-5c0c1eb7e6c7 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:42.413217 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ffde6d-b067-43e8-b7b2-37679d2ad5f6 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:42.441238 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7266253a-2590-4f86-b825-ae6809047cbc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:42.442969 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266253a-2590-4f86-b825-ae6809047cbc service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:42.443374 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266253a-2590-4f86-b825-ae6809047cbc service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:42.443773 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266253a-2590-4f86-b825-ae6809047cbc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:42.446587 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-7266253a-2590-4f86-b825-ae6809047cbc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:42.517838 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7266253a-2590-4f86-b825-ae6809047cbc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:42.519431 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7266253a-2590-4f86-b825-ae6809047cbc service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:42.528812 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 843/1693] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:11:42 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:11:42.529990 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2234db-dc2a-4f66-b7fc-76ab683be5e9 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:42.530278 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2234db-dc2a-4f66-b7fc-76ab683be5e9 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:42.530550 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2234db-dc2a-4f66-b7fc-76ab683be5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:42.560625 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-8f2234db-dc2a-4f66-b7fc-76ab683be5e9 None None] MFA Rules not processed for user `36c32d3de24045bdbfce30559ea022e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:11:42.561854 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8f2234db-dc2a-4f66-b7fc-76ab683be5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:42.653171 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-265e1082-d3db-4ddc-8182-5c0c1eb7e6c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c00dfe7fbe34ec5aacccdcf52f68cf9'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:42.668425 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 844/1694] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:11:42 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:11:42.668425 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30580f05-3dd5-421d-bed5-da2a76daa198 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:42.668425 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30580f05-3dd5-421d-bed5-da2a76daa198 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:42.668425 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30580f05-3dd5-421d-bed5-da2a76daa198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:42.668701 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-265e1082-d3db-4ddc-8182-5c0c1eb7e6c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c00dfe7fbe34ec5aacccdcf52f68cf9'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:42.696447 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-30580f05-3dd5-421d-bed5-da2a76daa198 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:11:42.697220 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-30580f05-3dd5-421d-bed5-da2a76daa198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:42.698572 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-265e1082-d3db-4ddc-8182-5c0c1eb7e6c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c00dfe7fbe34ec5aacccdcf52f68cf9'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:42.713356 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 845/1695] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:11:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:11:42.718888 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30580f05-3dd5-421d-bed5-da2a76daa198 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:42.722196 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-30580f05-3dd5-421d-bed5-da2a76daa198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:42.741481 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30580f05-3dd5-421d-bed5-da2a76daa198 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:42.747578 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea08b33b-d3f4-49e1-9e2a-5c0fc56fc011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:42.748459 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea08b33b-d3f4-49e1-9e2a-5c0fc56fc011 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:42.748753 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea08b33b-d3f4-49e1-9e2a-5c0fc56fc011 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:42.749462 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea08b33b-d3f4-49e1-9e2a-5c0fc56fc011 admin admin] PATH_INFO: `/v3/projects/fe8189ae2a22445d9be93e4be1495fce` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:42.751309 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea08b33b-d3f4-49e1-9e2a-5c0fc56fc011 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe8189ae2a22445d9be93e4be1495fce)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:42.754053 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea08b33b-d3f4-49e1-9e2a-5c0fc56fc011 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:42.786143 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-265e1082-d3db-4ddc-8182-5c0c1eb7e6c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c00dfe7fbe34ec5aacccdcf52f68cf9'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:42.786776 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-265e1082-d3db-4ddc-8182-5c0c1eb7e6c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c00dfe7fbe34ec5aacccdcf52f68cf9'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:42.794575 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 851/1696] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:11:42 2022] DELETE /identity/v3/users/9c00dfe7fbe34ec5aacccdcf52f68cf9 => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:11:42.795974 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265e1082-d3db-4ddc-8182-5c0c1eb7e6c7 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:42.797026 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-265e1082-d3db-4ddc-8182-5c0c1eb7e6c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:42.873651 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265e1082-d3db-4ddc-8182-5c0c1eb7e6c7 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:42.880048 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783137b6-e462-46c8-810d-55427b6c4997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:42.880991 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783137b6-e462-46c8-810d-55427b6c4997 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:42.881287 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783137b6-e462-46c8-810d-55427b6c4997 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:42.881570 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783137b6-e462-46c8-810d-55427b6c4997 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:42.882858 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783137b6-e462-46c8-810d-55427b6c4997 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:42.893535 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783137b6-e462-46c8-810d-55427b6c4997 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:42.918491 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ea08b33b-d3f4-49e1-9e2a-5c0fc56fc011 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe8189ae2a22445d9be93e4be1495fce', 'request_id': 'req-ea08b33b-d3f4-49e1-9e2a-5c0fc56fc011'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:42.931867 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ea08b33b-d3f4-49e1-9e2a-5c0fc56fc011 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe8189ae2a22445d9be93e4be1495fce', 'request_id': 'req-ea08b33b-d3f4-49e1-9e2a-5c0fc56fc011'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:42.942252 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ea08b33b-d3f4-49e1-9e2a-5c0fc56fc011 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe8189ae2a22445d9be93e4be1495fce', 'request_id': 'req-ea08b33b-d3f4-49e1-9e2a-5c0fc56fc011'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:42.982942 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 852/1697] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:11:42 2022] POST /identity/v3/projects => generated 399 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:11:42.982942 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a2855c-c38a-4b2c-879a-b39bbfeee024 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:42.982942 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a2855c-c38a-4b2c-879a-b39bbfeee024 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:42.982942 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a2855c-c38a-4b2c-879a-b39bbfeee024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:43.001590 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-68a2855c-c38a-4b2c-879a-b39bbfeee024 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:11:43.002925 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-68a2855c-c38a-4b2c-879a-b39bbfeee024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:43.039198 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ea08b33b-d3f4-49e1-9e2a-5c0fc56fc011 admin admin] The token cache is being invalidate because project fe8189ae2a22445d9be93e4be1495fce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:11:43.039423 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ea08b33b-d3f4-49e1-9e2a-5c0fc56fc011 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:43.040107 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ea08b33b-d3f4-49e1-9e2a-5c0fc56fc011 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:43.041683 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 846/1698] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:11:42 2022] DELETE /identity/v3/projects/fe8189ae2a22445d9be93e4be1495fce => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:11:43.042926 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f9b64-62c7-44c8-a350-d404e2a28edc None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:43.043215 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f9b64-62c7-44c8-a350-d404e2a28edc None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:43.043560 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f9b64-62c7-44c8-a350-d404e2a28edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:43.066301 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-3e1f9b64-62c7-44c8-a350-d404e2a28edc None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:11:43.066301 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-3e1f9b64-62c7-44c8-a350-d404e2a28edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:43.070049 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 853/1699] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:11:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:11:43.082777 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 847/1700] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:11:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:11:43.082777 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1f9b64-62c7-44c8-a350-d404e2a28edc None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:43.083468 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a2855c-c38a-4b2c-879a-b39bbfeee024 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:43.085553 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-68a2855c-c38a-4b2c-879a-b39bbfeee024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:43.094646 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-3e1f9b64-62c7-44c8-a350-d404e2a28edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:43.119776 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1f9b64-62c7-44c8-a350-d404e2a28edc None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:43.123811 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a2855c-c38a-4b2c-879a-b39bbfeee024 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:43.126973 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d361f8-87d9-4731-b216-89d90aa795f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:43.128521 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d361f8-87d9-4731-b216-89d90aa795f3 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:43.132285 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d361f8-87d9-4731-b216-89d90aa795f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:43.132384 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a384b40-c625-4977-91ab-3df9fe1d1a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:43.132478 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d361f8-87d9-4731-b216-89d90aa795f3 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:43.132478 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d361f8-87d9-4731-b216-89d90aa795f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:43.132600 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a384b40-c625-4977-91ab-3df9fe1d1a77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:43.132600 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a384b40-c625-4977-91ab-3df9fe1d1a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:43.132600 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a384b40-c625-4977-91ab-3df9fe1d1a77 admin admin] PATH_INFO: `/v3/projects/bfbedfbe06254e398d6c51e9c7bd3d88` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:43.133363 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d361f8-87d9-4731-b216-89d90aa795f3 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:43.133829 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a384b40-c625-4977-91ab-3df9fe1d1a77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfbedfbe06254e398d6c51e9c7bd3d88)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:43.135957 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a384b40-c625-4977-91ab-3df9fe1d1a77 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:43.219533 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 848/1701] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:11:43 2022] POST /identity/v3/users => generated 306 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:11:43.219533 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d361f8-87d9-4731-b216-89d90aa795f3 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:43.224318 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e3d361f8-87d9-4731-b216-89d90aa795f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:43.251068 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d361f8-87d9-4731-b216-89d90aa795f3 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:43.257805 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c31b3a7-3aa8-486f-b942-cb6b48debcd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:43.258735 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c31b3a7-3aa8-486f-b942-cb6b48debcd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:43.259166 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c31b3a7-3aa8-486f-b942-cb6b48debcd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:43.259446 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c31b3a7-3aa8-486f-b942-cb6b48debcd8 admin admin] PATH_INFO: `/v3/users/83e779486ff4486ba63c5780a485b090` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:43.260732 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c31b3a7-3aa8-486f-b942-cb6b48debcd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83e779486ff4486ba63c5780a485b090)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:43.262667 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c31b3a7-3aa8-486f-b942-cb6b48debcd8 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:43.294982 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6a384b40-c625-4977-91ab-3df9fe1d1a77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfbedfbe06254e398d6c51e9c7bd3d88', 'request_id': 'req-6a384b40-c625-4977-91ab-3df9fe1d1a77'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:43.301163 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6a384b40-c625-4977-91ab-3df9fe1d1a77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfbedfbe06254e398d6c51e9c7bd3d88', 'request_id': 'req-6a384b40-c625-4977-91ab-3df9fe1d1a77'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:43.410702 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6a384b40-c625-4977-91ab-3df9fe1d1a77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfbedfbe06254e398d6c51e9c7bd3d88', 'request_id': 'req-6a384b40-c625-4977-91ab-3df9fe1d1a77'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:43.424143 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6a384b40-c625-4977-91ab-3df9fe1d1a77 admin admin] The token cache is being invalidate because project bfbedfbe06254e398d6c51e9c7bd3d88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:11:43.424889 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6a384b40-c625-4977-91ab-3df9fe1d1a77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:43.425780 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6a384b40-c625-4977-91ab-3df9fe1d1a77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:43.430721 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 854/1702] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:11:43 2022] DELETE /identity/v3/projects/bfbedfbe06254e398d6c51e9c7bd3d88 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:11:43.430721 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a384b40-c625-4977-91ab-3df9fe1d1a77 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:43.430721 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-6a384b40-c625-4977-91ab-3df9fe1d1a77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:43.529304 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0c31b3a7-3aa8-486f-b942-cb6b48debcd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83e779486ff4486ba63c5780a485b090'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:43.560468 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0c31b3a7-3aa8-486f-b942-cb6b48debcd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83e779486ff4486ba63c5780a485b090'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:43.561150 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0c31b3a7-3aa8-486f-b942-cb6b48debcd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83e779486ff4486ba63c5780a485b090'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:43.594812 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a384b40-c625-4977-91ab-3df9fe1d1a77 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:43.600491 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288f267b-b120-495c-acbf-f636582df183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:43.601165 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f267b-b120-495c-acbf-f636582df183 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:43.601451 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f267b-b120-495c-acbf-f636582df183 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:43.601728 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f267b-b120-495c-acbf-f636582df183 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:43.602461 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288f267b-b120-495c-acbf-f636582df183 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:11:43.602830 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288f267b-b120-495c-acbf-f636582df183 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:43.614785 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288f267b-b120-495c-acbf-f636582df183 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:43.615443 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0c31b3a7-3aa8-486f-b942-cb6b48debcd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83e779486ff4486ba63c5780a485b090'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:43.630866 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 855/1703] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:11:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:11:43.634534 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288f267b-b120-495c-acbf-f636582df183 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:43.642268 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0c31b3a7-3aa8-486f-b942-cb6b48debcd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83e779486ff4486ba63c5780a485b090'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:43.643337 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-288f267b-b120-495c-acbf-f636582df183 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:43.649382 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 849/1704] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:11:43 2022] DELETE /identity/v3/users/83e779486ff4486ba63c5780a485b090 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:11:43.650766 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c84966-0eb0-4699-adbb-d524f74ec261 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:43.651143 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c84966-0eb0-4699-adbb-d524f74ec261 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:43.651341 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c84966-0eb0-4699-adbb-d524f74ec261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:43.687579 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-64c84966-0eb0-4699-adbb-d524f74ec261 None None] MFA Rules not processed for user `bbd1715608f64bcfbff6bf07039389c9`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:11:43.688809 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-64c84966-0eb0-4699-adbb-d524f74ec261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:43.728444 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288f267b-b120-495c-acbf-f636582df183 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:43.807454 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f33f3-3f63-4616-b476-37488831b38e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:43.810959 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f33f3-3f63-4616-b476-37488831b38e service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:43.811192 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f33f3-3f63-4616-b476-37488831b38e service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:43.811510 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f33f3-3f63-4616-b476-37488831b38e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:43.815270 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-345f33f3-3f63-4616-b476-37488831b38e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:43.839192 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 850/1705] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:11:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:11:43.840417 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c84966-0eb0-4699-adbb-d524f74ec261 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:43.841917 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-64c84966-0eb0-4699-adbb-d524f74ec261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:43.906812 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345f33f3-3f63-4616-b476-37488831b38e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:43.908362 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345f33f3-3f63-4616-b476-37488831b38e service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:43.931276 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 856/1706] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:11:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:11:43.932669 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48323483-d75a-4f74-b84e-856da0b4c174 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:43.933123 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48323483-d75a-4f74-b84e-856da0b4c174 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:43.933579 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48323483-d75a-4f74-b84e-856da0b4c174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:43.952477 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-48323483-d75a-4f74-b84e-856da0b4c174 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:11:43.953927 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-48323483-d75a-4f74-b84e-856da0b4c174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:43.966513 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 857/1707] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:11:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:11:43.968016 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48323483-d75a-4f74-b84e-856da0b4c174 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:43.969426 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-48323483-d75a-4f74-b84e-856da0b4c174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:43.986913 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48323483-d75a-4f74-b84e-856da0b4c174 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:43.988110 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c84966-0eb0-4699-adbb-d524f74ec261 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:43.993296 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b17ea43-4b02-49fa-933e-ff150fbc724c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:43.994109 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17ea43-4b02-49fa-933e-ff150fbc724c admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:43.994494 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17ea43-4b02-49fa-933e-ff150fbc724c admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:43.994834 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b14e55-d691-458b-91b1-6ea08c1d9369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:43.994975 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17ea43-4b02-49fa-933e-ff150fbc724c admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:43.995776 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b17ea43-4b02-49fa-933e-ff150fbc724c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:43.996141 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b14e55-d691-458b-91b1-6ea08c1d9369 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:43.996574 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b14e55-d691-458b-91b1-6ea08c1d9369 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:43.997265 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b14e55-d691-458b-91b1-6ea08c1d9369 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:43.998293 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b17ea43-4b02-49fa-933e-ff150fbc724c admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:43.998535 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b14e55-d691-458b-91b1-6ea08c1d9369 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:44.000574 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b14e55-d691-458b-91b1-6ea08c1d9369 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:44.021144 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 851/1708] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:11:44.022507 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1708ba97-b689-4f05-b2e1-3285fd7cebf8 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:44.023222 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1708ba97-b689-4f05-b2e1-3285fd7cebf8 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:44.023222 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1708ba97-b689-4f05-b2e1-3285fd7cebf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:44.069610 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-1708ba97-b689-4f05-b2e1-3285fd7cebf8 None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:11:44.070855 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-1708ba97-b689-4f05-b2e1-3285fd7cebf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:44.121326 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 858/1709] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:11:43 2022] POST /identity/v3/projects => generated 379 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:11:44.122536 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b17ea43-4b02-49fa-933e-ff150fbc724c admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:44.129328 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-9b17ea43-4b02-49fa-933e-ff150fbc724c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:44.179532 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 852/1710] 10.222.0.52 () {58 vars in 1009 bytes} [Sat May 14 21:11:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:11:44.181188 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf85302-f3fb-4e20-a165-6c87f86e5840 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:44.181188 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf85302-f3fb-4e20-a165-6c87f86e5840 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:44.181354 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf85302-f3fb-4e20-a165-6c87f86e5840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:44.203140 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-4cf85302-f3fb-4e20-a165-6c87f86e5840 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:11:44.204960 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-4cf85302-f3fb-4e20-a165-6c87f86e5840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:44.335689 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b17ea43-4b02-49fa-933e-ff150fbc724c admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:44.348810 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac6653f-f0bc-4d7a-a97c-1f80de09533a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:44.349729 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac6653f-f0bc-4d7a-a97c-1f80de09533a service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:44.350012 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac6653f-f0bc-4d7a-a97c-1f80de09533a service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:44.350305 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac6653f-f0bc-4d7a-a97c-1f80de09533a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:44.352955 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-eac6653f-f0bc-4d7a-a97c-1f80de09533a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:44.364549 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 853/1711] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:11:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:11:44.365680 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf85302-f3fb-4e20-a165-6c87f86e5840 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:44.378541 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf85302-f3fb-4e20-a165-6c87f86e5840 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:44.385017 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf2d1c-7d76-49ee-81fa-bae890064d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:44.386245 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf2d1c-7d76-49ee-81fa-bae890064d44 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:44.386736 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf2d1c-7d76-49ee-81fa-bae890064d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:44.387219 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf2d1c-7d76-49ee-81fa-bae890064d44 admin admin] PATH_INFO: `/v3/projects/899b3d5b2ffd4706b856c765063b8536/users/3e7721c1487c423bbdba825f336234bb/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:44.440947 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cf2d1c-7d76-49ee-81fa-bae890064d44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=899b3d5b2ffd4706b856c765063b8536, user_id=3e7721c1487c423bbdba825f336234bb, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:44.450449 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cf2d1c-7d76-49ee-81fa-bae890064d44 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:44.491287 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac6653f-f0bc-4d7a-a97c-1f80de09533a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:44.496401 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac6653f-f0bc-4d7a-a97c-1f80de09533a service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:44.514362 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 859/1712] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:11:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:11:44.515286 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac6653f-f0bc-4d7a-a97c-1f80de09533a service nova] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:44.532412 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 854/1713] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:11:44 2022] PUT /identity/v3/projects/899b3d5b2ffd4706b856c765063b8536/users/3e7721c1487c423bbdba825f336234bb/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:11:44.536685 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf2d1c-7d76-49ee-81fa-bae890064d44 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:44.545714 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac6653f-f0bc-4d7a-a97c-1f80de09533a service nova] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:44.683235 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7755bdbe-1c48-4c8d-b2e5-fefc33733468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:44.683977 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7755bdbe-1c48-4c8d-b2e5-fefc33733468 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:44.684714 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7755bdbe-1c48-4c8d-b2e5-fefc33733468 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:44.686476 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7755bdbe-1c48-4c8d-b2e5-fefc33733468 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:44.686476 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7755bdbe-1c48-4c8d-b2e5-fefc33733468 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:44.688148 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7755bdbe-1c48-4c8d-b2e5-fefc33733468 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:44.701322 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf2d1c-7d76-49ee-81fa-bae890064d44 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:44.715788 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba89b9c-d439-4862-9a47-3ea10cfd3c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:44.715788 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba89b9c-d439-4862-9a47-3ea10cfd3c1f admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:44.715788 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba89b9c-d439-4862-9a47-3ea10cfd3c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:44.715788 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba89b9c-d439-4862-9a47-3ea10cfd3c1f admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:44.716457 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba89b9c-d439-4862-9a47-3ea10cfd3c1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:11:44.716845 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba89b9c-d439-4862-9a47-3ea10cfd3c1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:44.720191 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba89b9c-d439-4862-9a47-3ea10cfd3c1f admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:44.741620 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 855/1714] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:11:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:11:44.747688 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba89b9c-d439-4862-9a47-3ea10cfd3c1f admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:44.771139 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 860/1715] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:11:44 2022] POST /identity/v3/users => generated 290 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:11:44.771943 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7755bdbe-1c48-4c8d-b2e5-fefc33733468 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:44.775599 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba89b9c-d439-4862-9a47-3ea10cfd3c1f admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:44.777687 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-7755bdbe-1c48-4c8d-b2e5-fefc33733468 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:44.797517 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b75515-5333-411a-8f65-9a18cdf297dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:44.798223 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b75515-5333-411a-8f65-9a18cdf297dd admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:44.799052 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b75515-5333-411a-8f65-9a18cdf297dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:44.799426 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b75515-5333-411a-8f65-9a18cdf297dd admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:44.802635 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b75515-5333-411a-8f65-9a18cdf297dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:44.807139 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b75515-5333-411a-8f65-9a18cdf297dd admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:44.828465 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 856/1716] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:11:44 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:11:44.829303 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b75515-5333-411a-8f65-9a18cdf297dd admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:44.838881 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-14b75515-5333-411a-8f65-9a18cdf297dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:44.877304 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b75515-5333-411a-8f65-9a18cdf297dd admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:44.883158 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d18acab-d5af-4995-8331-6e48a566927b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:44.884273 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18acab-d5af-4995-8331-6e48a566927b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:44.884403 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18acab-d5af-4995-8331-6e48a566927b admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:44.884682 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18acab-d5af-4995-8331-6e48a566927b admin admin] PATH_INFO: `/v3/projects/8182d39b3eb24680b87fe7e32da0b52b` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:44.886584 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d18acab-d5af-4995-8331-6e48a566927b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8182d39b3eb24680b87fe7e32da0b52b)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:44.888615 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7755bdbe-1c48-4c8d-b2e5-fefc33733468 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:44.888773 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d18acab-d5af-4995-8331-6e48a566927b admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:44.903144 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72021fb2-84f6-42a0-ae77-afffcd26263a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:44.903940 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72021fb2-84f6-42a0-ae77-afffcd26263a service swift] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:44.904307 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72021fb2-84f6-42a0-ae77-afffcd26263a service swift] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:44.904658 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72021fb2-84f6-42a0-ae77-afffcd26263a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:45.029722 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-6d18acab-d5af-4995-8331-6e48a566927b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8182d39b3eb24680b87fe7e32da0b52b', 'request_id': 'req-6d18acab-d5af-4995-8331-6e48a566927b'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:45.037885 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-6d18acab-d5af-4995-8331-6e48a566927b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8182d39b3eb24680b87fe7e32da0b52b', 'request_id': 'req-6d18acab-d5af-4995-8331-6e48a566927b'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:45.044330 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72021fb2-84f6-42a0-ae77-afffcd26263a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:45.046034 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72021fb2-84f6-42a0-ae77-afffcd26263a service swift] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:45.047903 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-6d18acab-d5af-4995-8331-6e48a566927b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8182d39b3eb24680b87fe7e32da0b52b', 'request_id': 'req-6d18acab-d5af-4995-8331-6e48a566927b'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:45.069172 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 861/1717] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 21:11:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 21:11:45.070104 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72021fb2-84f6-42a0-ae77-afffcd26263a service swift] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:45.088603 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72021fb2-84f6-42a0-ae77-afffcd26263a service swift] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:45.171443 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-6d18acab-d5af-4995-8331-6e48a566927b admin admin] The token cache is being invalidate because project 8182d39b3eb24680b87fe7e32da0b52b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:11:45.172037 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-6d18acab-d5af-4995-8331-6e48a566927b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:45.172879 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-6d18acab-d5af-4995-8331-6e48a566927b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:45.179821 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 857/1718] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:11:44 2022] DELETE /identity/v3/projects/8182d39b3eb24680b87fe7e32da0b52b => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:11:45.181065 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d18acab-d5af-4995-8331-6e48a566927b admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:45.184202 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-6d18acab-d5af-4995-8331-6e48a566927b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:45.205689 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b6a104-a19d-4fdf-b63c-82410ebe9b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:45.213581 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b6a104-a19d-4fdf-b63c-82410ebe9b64 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:45.217644 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b6a104-a19d-4fdf-b63c-82410ebe9b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:45.218812 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b6a104-a19d-4fdf-b63c-82410ebe9b64 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:45.221527 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b6a104-a19d-4fdf-b63c-82410ebe9b64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:45.222654 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d18acab-d5af-4995-8331-6e48a566927b admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:45.228736 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b6a104-a19d-4fdf-b63c-82410ebe9b64 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:45.230113 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07019df-ba7d-4a43-964f-9b22187aadfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:45.232584 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07019df-ba7d-4a43-964f-9b22187aadfe admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:45.232967 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07019df-ba7d-4a43-964f-9b22187aadfe admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:45.233395 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07019df-ba7d-4a43-964f-9b22187aadfe admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:45.234234 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07019df-ba7d-4a43-964f-9b22187aadfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:45.242139 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07019df-ba7d-4a43-964f-9b22187aadfe admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:45.275215 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 858/1719] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:11:45 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:11:45.275215 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07019df-ba7d-4a43-964f-9b22187aadfe admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:45.285106 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e07019df-ba7d-4a43-964f-9b22187aadfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:45.331832 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07019df-ba7d-4a43-964f-9b22187aadfe admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:45.351594 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38435592-f03d-42dd-8e97-8174938e4ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:45.352555 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38435592-f03d-42dd-8e97-8174938e4ee2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:45.354442 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38435592-f03d-42dd-8e97-8174938e4ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:45.354832 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38435592-f03d-42dd-8e97-8174938e4ee2 admin admin] PATH_INFO: `/v3/projects/899b3d5b2ffd4706b856c765063b8536/users/3e7721c1487c423bbdba825f336234bb/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:45.360595 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38435592-f03d-42dd-8e97-8174938e4ee2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=899b3d5b2ffd4706b856c765063b8536, user_id=3e7721c1487c423bbdba825f336234bb, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:45.364263 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38435592-f03d-42dd-8e97-8174938e4ee2 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:45.403101 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 859/1720] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:11:45 2022] PUT /identity/v3/projects/899b3d5b2ffd4706b856c765063b8536/users/3e7721c1487c423bbdba825f336234bb/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:11:45.407312 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 862/1721] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:11:45 2022] POST /identity/v3/projects => generated 375 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:11:45.407506 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38435592-f03d-42dd-8e97-8174938e4ee2 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:45.409574 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b6a104-a19d-4fdf-b63c-82410ebe9b64 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:45.413231 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-38435592-f03d-42dd-8e97-8174938e4ee2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:45.420880 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e2b6a104-a19d-4fdf-b63c-82410ebe9b64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:45.600571 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b6a104-a19d-4fdf-b63c-82410ebe9b64 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:45.609192 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78a5686-626f-4570-83e0-ebf04e68ffbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:45.612234 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a5686-626f-4570-83e0-ebf04e68ffbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:45.612234 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a5686-626f-4570-83e0-ebf04e68ffbc admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:45.612234 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a5686-626f-4570-83e0-ebf04e68ffbc admin admin] PATH_INFO: `/v3/users/c0af14c87b2c4487ba2535a95d5cdf51` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:45.616063 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38435592-f03d-42dd-8e97-8174938e4ee2 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:45.617261 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78a5686-626f-4570-83e0-ebf04e68ffbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0af14c87b2c4487ba2535a95d5cdf51)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:45.623755 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78a5686-626f-4570-83e0-ebf04e68ffbc admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:45.631302 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d739f023-a1dd-4039-ac06-04ed032e55d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:45.632726 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d739f023-a1dd-4039-ac06-04ed032e55d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:45.633058 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d739f023-a1dd-4039-ac06-04ed032e55d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:45.633381 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d739f023-a1dd-4039-ac06-04ed032e55d6 admin admin] PATH_INFO: `/v3/projects/74b77f0e49394b5c9310e60089449508` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:45.634782 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d739f023-a1dd-4039-ac06-04ed032e55d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74b77f0e49394b5c9310e60089449508)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:45.646443 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d739f023-a1dd-4039-ac06-04ed032e55d6 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:45.893185 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d739f023-a1dd-4039-ac06-04ed032e55d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74b77f0e49394b5c9310e60089449508', 'request_id': 'req-d739f023-a1dd-4039-ac06-04ed032e55d6'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:45.895018 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b78a5686-626f-4570-83e0-ebf04e68ffbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0af14c87b2c4487ba2535a95d5cdf51'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:46.026957 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d739f023-a1dd-4039-ac06-04ed032e55d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74b77f0e49394b5c9310e60089449508', 'request_id': 'req-d739f023-a1dd-4039-ac06-04ed032e55d6'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:46.029551 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b78a5686-626f-4570-83e0-ebf04e68ffbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0af14c87b2c4487ba2535a95d5cdf51'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:46.029823 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d739f023-a1dd-4039-ac06-04ed032e55d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74b77f0e49394b5c9310e60089449508', 'request_id': 'req-d739f023-a1dd-4039-ac06-04ed032e55d6'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:46.029920 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b78a5686-626f-4570-83e0-ebf04e68ffbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0af14c87b2c4487ba2535a95d5cdf51'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:46.723094 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d739f023-a1dd-4039-ac06-04ed032e55d6 admin admin] The token cache is being invalidate because project 74b77f0e49394b5c9310e60089449508 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:11:46.723600 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d739f023-a1dd-4039-ac06-04ed032e55d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:46.724542 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d739f023-a1dd-4039-ac06-04ed032e55d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:46.726168 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 860/1722] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:11:45 2022] DELETE /identity/v3/projects/74b77f0e49394b5c9310e60089449508 => generated 0 bytes in 1323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:11:46.727570 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd916735-c63d-4bb4-acab-9fdd22f5d8d3 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:46.727861 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd916735-c63d-4bb4-acab-9fdd22f5d8d3 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:46.728136 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd916735-c63d-4bb4-acab-9fdd22f5d8d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:46.773067 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-cd916735-c63d-4bb4-acab-9fdd22f5d8d3 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:11:46.779371 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-cd916735-c63d-4bb4-acab-9fdd22f5d8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:46.865491 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b78a5686-626f-4570-83e0-ebf04e68ffbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0af14c87b2c4487ba2535a95d5cdf51'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:46.866135 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b78a5686-626f-4570-83e0-ebf04e68ffbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0af14c87b2c4487ba2535a95d5cdf51'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:46.877232 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 863/1723] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:11:45 2022] DELETE /identity/v3/users/c0af14c87b2c4487ba2535a95d5cdf51 => generated 0 bytes in 1469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:11:46.887403 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78a5686-626f-4570-83e0-ebf04e68ffbc admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:46.890525 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b78a5686-626f-4570-83e0-ebf04e68ffbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:46.954335 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 861/1724] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:11:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:11:46.956217 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd916735-c63d-4bb4-acab-9fdd22f5d8d3 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:46.967592 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-cd916735-c63d-4bb4-acab-9fdd22f5d8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:47.013798 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd916735-c63d-4bb4-acab-9fdd22f5d8d3 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:47.151939 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cac8f6-bf0e-47ea-9339-4ca755ab9e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:47.153147 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cac8f6-bf0e-47ea-9339-4ca755ab9e75 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:47.153872 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cac8f6-bf0e-47ea-9339-4ca755ab9e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:47.154253 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cac8f6-bf0e-47ea-9339-4ca755ab9e75 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:47.155062 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cac8f6-bf0e-47ea-9339-4ca755ab9e75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:47.159987 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cac8f6-bf0e-47ea-9339-4ca755ab9e75 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:47.167895 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78a5686-626f-4570-83e0-ebf04e68ffbc admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:47.179078 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943251e4-687d-4adb-9f3d-0714d0fd77a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:47.179969 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943251e4-687d-4adb-9f3d-0714d0fd77a7 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:47.180410 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943251e4-687d-4adb-9f3d-0714d0fd77a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:47.180700 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943251e4-687d-4adb-9f3d-0714d0fd77a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:47.181679 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943251e4-687d-4adb-9f3d-0714d0fd77a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:47.183206 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943251e4-687d-4adb-9f3d-0714d0fd77a7 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:47.200198 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 864/1725] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:11:46 2022] GET /identity/v3/roles => generated 1420 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:11:47.201299 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943251e4-687d-4adb-9f3d-0714d0fd77a7 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:47.204524 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-943251e4-687d-4adb-9f3d-0714d0fd77a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:47.222647 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943251e4-687d-4adb-9f3d-0714d0fd77a7 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:47.229483 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c051bc4-47c9-46a0-a7de-cf27decad257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:47.230640 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c051bc4-47c9-46a0-a7de-cf27decad257 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:47.231318 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c051bc4-47c9-46a0-a7de-cf27decad257 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:47.231774 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c051bc4-47c9-46a0-a7de-cf27decad257 admin admin] PATH_INFO: `/v3/users/f5a4e940701d4101b0ff6aa4590fd89c` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:47.233338 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c051bc4-47c9-46a0-a7de-cf27decad257 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5a4e940701d4101b0ff6aa4590fd89c)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:47.236712 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c051bc4-47c9-46a0-a7de-cf27decad257 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:47.275366 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 862/1726] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:11:46 2022] POST /identity/v3/users => generated 288 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:11:47.276840 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719cb2d4-b690-48c6-a39b-f6beef374a64 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:47.277268 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719cb2d4-b690-48c6-a39b-f6beef374a64 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:47.277765 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719cb2d4-b690-48c6-a39b-f6beef374a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:47.325429 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-719cb2d4-b690-48c6-a39b-f6beef374a64 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:11:47.326689 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-719cb2d4-b690-48c6-a39b-f6beef374a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:47.366958 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 863/1727] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:11:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:11:47.378088 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eaf1c7-78be-4392-a7e0-4b81441fa791 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:47.378568 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eaf1c7-78be-4392-a7e0-4b81441fa791 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:47.378739 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eaf1c7-78be-4392-a7e0-4b81441fa791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:47.424556 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-f6eaf1c7-78be-4392-a7e0-4b81441fa791 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:11:47.425807 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-f6eaf1c7-78be-4392-a7e0-4b81441fa791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:47.466775 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 864/1728] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:11:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:11:47.467746 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eaf1c7-78be-4392-a7e0-4b81441fa791 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:47.495631 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eaf1c7-78be-4392-a7e0-4b81441fa791 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:47.509192 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2c051bc4-47c9-46a0-a7de-cf27decad257 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5a4e940701d4101b0ff6aa4590fd89c'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:47.513357 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149bb640-e9e2-45b0-a267-54544a85a72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:47.514323 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149bb640-e9e2-45b0-a267-54544a85a72d admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:47.514597 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149bb640-e9e2-45b0-a267-54544a85a72d admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:47.514936 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149bb640-e9e2-45b0-a267-54544a85a72d admin admin] PATH_INFO: `/v3/projects/1ecabb816bab433d81c64af18cfdb59e/users/7b9339334e3942c083c0736f16fc0411/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:47.548637 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2c051bc4-47c9-46a0-a7de-cf27decad257 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5a4e940701d4101b0ff6aa4590fd89c'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:47.570160 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2c051bc4-47c9-46a0-a7de-cf27decad257 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5a4e940701d4101b0ff6aa4590fd89c'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:47.610482 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149bb640-e9e2-45b0-a267-54544a85a72d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ecabb816bab433d81c64af18cfdb59e, user_id=7b9339334e3942c083c0736f16fc0411, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:47.634713 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149bb640-e9e2-45b0-a267-54544a85a72d admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:47.684231 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2c051bc4-47c9-46a0-a7de-cf27decad257 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5a4e940701d4101b0ff6aa4590fd89c'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:47.684988 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2c051bc4-47c9-46a0-a7de-cf27decad257 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5a4e940701d4101b0ff6aa4590fd89c'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:47.697097 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 865/1729] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:11:47 2022] DELETE /identity/v3/users/f5a4e940701d4101b0ff6aa4590fd89c => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:11:47.698316 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c051bc4-47c9-46a0-a7de-cf27decad257 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:47.700035 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-2c051bc4-47c9-46a0-a7de-cf27decad257 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:47.743067 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 865/1730] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:11:47 2022] PUT /identity/v3/projects/1ecabb816bab433d81c64af18cfdb59e/users/7b9339334e3942c083c0736f16fc0411/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:11:47.745228 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf601e31-2b5f-473e-af74-aeed8bd9d8fb None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:47.745767 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf601e31-2b5f-473e-af74-aeed8bd9d8fb None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:47.746269 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf601e31-2b5f-473e-af74-aeed8bd9d8fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:47.884545 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-cf601e31-2b5f-473e-af74-aeed8bd9d8fb None None] MFA Rules not processed for user `99ed32a6d699453bb7e088540e8fc980`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:11:47.885997 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-cf601e31-2b5f-473e-af74-aeed8bd9d8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:47.928145 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c051bc4-47c9-46a0-a7de-cf27decad257 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:48.027362 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 866/1731] 10.222.0.48 () {58 vars in 1015 bytes} [Sat May 14 21:11:47 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:11:48.028327 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf601e31-2b5f-473e-af74-aeed8bd9d8fb None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:48.032620 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-cf601e31-2b5f-473e-af74-aeed8bd9d8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:48.086170 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf601e31-2b5f-473e-af74-aeed8bd9d8fb None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:48.103958 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d0c6e0-ca78-4c79-97d0-b14161d775d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:48.105790 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d0c6e0-ca78-4c79-97d0-b14161d775d1 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:48.106259 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d0c6e0-ca78-4c79-97d0-b14161d775d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:48.106804 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d0c6e0-ca78-4c79-97d0-b14161d775d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:48.118878 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-01d0c6e0-ca78-4c79-97d0-b14161d775d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:48.130772 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de98b0-bd15-4cf4-b482-ef709d11faa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:48.132452 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de98b0-bd15-4cf4-b482-ef709d11faa7 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:48.132906 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de98b0-bd15-4cf4-b482-ef709d11faa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:48.133969 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de98b0-bd15-4cf4-b482-ef709d11faa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:48.136209 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3de98b0-bd15-4cf4-b482-ef709d11faa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:48.140609 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3de98b0-bd15-4cf4-b482-ef709d11faa7 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:48.160722 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 866/1732] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:11:47 2022] GET /identity/v3/roles => generated 1420 bytes in 463 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:11:48.162197 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de98b0-bd15-4cf4-b482-ef709d11faa7 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:48.167805 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-f3de98b0-bd15-4cf4-b482-ef709d11faa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:48.185359 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de98b0-bd15-4cf4-b482-ef709d11faa7 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:48.193941 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d0c6e0-ca78-4c79-97d0-b14161d775d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:48.195429 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d0c6e0-ca78-4c79-97d0-b14161d775d1 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:48.196277 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fc7497-ac4a-4194-acc1-ab3a1a85a900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:48.197433 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc7497-ac4a-4194-acc1-ab3a1a85a900 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:48.198161 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc7497-ac4a-4194-acc1-ab3a1a85a900 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:48.198667 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc7497-ac4a-4194-acc1-ab3a1a85a900 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:48.199701 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fc7497-ac4a-4194-acc1-ab3a1a85a900 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:11:48.200282 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fc7497-ac4a-4194-acc1-ab3a1a85a900 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:48.202152 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fc7497-ac4a-4194-acc1-ab3a1a85a900 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:48.219983 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 867/1733] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:11:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:11:48.229515 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df4b5d8-65ae-4b81-9db5-e42f07a25ab8 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:48.229847 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df4b5d8-65ae-4b81-9db5-e42f07a25ab8 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:48.230204 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df4b5d8-65ae-4b81-9db5-e42f07a25ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:48.238999 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 867/1734] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:11:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:11:48.240768 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fc7497-ac4a-4194-acc1-ab3a1a85a900 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:48.254184 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fc7497-ac4a-4194-acc1-ab3a1a85a900 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:48.262094 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd28d6-92ce-42e8-8e71-4911db0bc8f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:48.263212 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd28d6-92ce-42e8-8e71-4911db0bc8f5 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:48.263900 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd28d6-92ce-42e8-8e71-4911db0bc8f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:48.264396 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd28d6-92ce-42e8-8e71-4911db0bc8f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:48.274637 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-2df4b5d8-65ae-4b81-9db5-e42f07a25ab8 None None] MFA Rules not processed for user `7b9339334e3942c083c0736f16fc0411`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:11:48.276868 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babd28d6-92ce-42e8-8e71-4911db0bc8f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:48.276977 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-2df4b5d8-65ae-4b81-9db5-e42f07a25ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:48.277687 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babd28d6-92ce-42e8-8e71-4911db0bc8f5 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:48.291565 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 868/1735] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:11:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:11:48.292785 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd28d6-92ce-42e8-8e71-4911db0bc8f5 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:48.314258 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd28d6-92ce-42e8-8e71-4911db0bc8f5 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:48.324140 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9929c3b-d2c0-4bb4-a022-5c197a9871e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:48.325268 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9929c3b-d2c0-4bb4-a022-5c197a9871e5 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:48.325720 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9929c3b-d2c0-4bb4-a022-5c197a9871e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:48.326529 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9929c3b-d2c0-4bb4-a022-5c197a9871e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:48.327513 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9929c3b-d2c0-4bb4-a022-5c197a9871e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:48.330429 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9929c3b-d2c0-4bb4-a022-5c197a9871e5 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:48.386331 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 869/1736] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:11:48 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:11:48.387933 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9929c3b-d2c0-4bb4-a022-5c197a9871e5 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:48.409596 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9929c3b-d2c0-4bb4-a022-5c197a9871e5 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:48.411313 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 868/1737] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:11:48 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:11:48.412365 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df4b5d8-65ae-4b81-9db5-e42f07a25ab8 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:48.438487 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8f04f0-4f64-45df-a396-3957146c0efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:48.439902 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f04f0-4f64-45df-a396-3957146c0efc admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:48.440412 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f04f0-4f64-45df-a396-3957146c0efc admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:48.440516 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f04f0-4f64-45df-a396-3957146c0efc admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:48.448678 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8f04f0-4f64-45df-a396-3957146c0efc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:48.451081 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8f04f0-4f64-45df-a396-3957146c0efc admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:48.453357 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df4b5d8-65ae-4b81-9db5-e42f07a25ab8 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:48.467515 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b39519b-bf70-44c8-a025-504bea6ca477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:48.471760 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b39519b-bf70-44c8-a025-504bea6ca477 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:48.472096 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b39519b-bf70-44c8-a025-504bea6ca477 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:48.480950 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b39519b-bf70-44c8-a025-504bea6ca477 admin admin] PATH_INFO: `/v3/projects/3650527b8cd44dc782856a3cc8233d04/users/db3459023d74437a99e1efc32ab8f7dc/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:48.543545 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b39519b-bf70-44c8-a025-504bea6ca477 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3650527b8cd44dc782856a3cc8233d04, user_id=db3459023d74437a99e1efc32ab8f7dc, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:48.550985 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b39519b-bf70-44c8-a025-504bea6ca477 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:48.664063 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 870/1738] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:11:48 2022] POST /identity/v3/projects => generated 391 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:11:48.668119 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8f04f0-4f64-45df-a396-3957146c0efc admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:48.674581 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-6a8f04f0-4f64-45df-a396-3957146c0efc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:48.698872 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 869/1739] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:11:48 2022] PUT /identity/v3/projects/3650527b8cd44dc782856a3cc8233d04/users/db3459023d74437a99e1efc32ab8f7dc/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:11:48.700081 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b39519b-bf70-44c8-a025-504bea6ca477 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:48.704068 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8b39519b-bf70-44c8-a025-504bea6ca477 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:48.838621 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8f04f0-4f64-45df-a396-3957146c0efc admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:48.890645 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b39519b-bf70-44c8-a025-504bea6ca477 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:48.897780 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a92307-f92b-4572-a93f-9574e7471f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:48.898869 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a92307-f92b-4572-a93f-9574e7471f1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:48.899298 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a92307-f92b-4572-a93f-9574e7471f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:48.899735 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a92307-f92b-4572-a93f-9574e7471f1c admin admin] PATH_INFO: `/v3/projects/196e3f40a70f4ef9b59562eea143da02` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:48.901274 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a92307-f92b-4572-a93f-9574e7471f1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=196e3f40a70f4ef9b59562eea143da02)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:48.915120 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a92307-f92b-4572-a93f-9574e7471f1c admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:48.971621 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a858ff-0aa2-4bfe-87b0-de4bbc011280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:48.972302 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a858ff-0aa2-4bfe-87b0-de4bbc011280 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:48.972590 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a858ff-0aa2-4bfe-87b0-de4bbc011280 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:48.972869 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a858ff-0aa2-4bfe-87b0-de4bbc011280 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:48.973735 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a858ff-0aa2-4bfe-87b0-de4bbc011280 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:48.976239 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a858ff-0aa2-4bfe-87b0-de4bbc011280 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:49.150667 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 871/1740] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:11:48 2022] POST /identity/v3/projects => generated 379 bytes in 486 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:11:49.151987 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a858ff-0aa2-4bfe-87b0-de4bbc011280 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:49.198426 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-83a92307-f92b-4572-a93f-9574e7471f1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '196e3f40a70f4ef9b59562eea143da02', 'request_id': 'req-83a92307-f92b-4572-a93f-9574e7471f1c'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:49.218950 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-83a92307-f92b-4572-a93f-9574e7471f1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '196e3f40a70f4ef9b59562eea143da02', 'request_id': 'req-83a92307-f92b-4572-a93f-9574e7471f1c'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:49.237831 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-83a92307-f92b-4572-a93f-9574e7471f1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '196e3f40a70f4ef9b59562eea143da02', 'request_id': 'req-83a92307-f92b-4572-a93f-9574e7471f1c'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:49.339495 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a858ff-0aa2-4bfe-87b0-de4bbc011280 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:49.362949 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-83a92307-f92b-4572-a93f-9574e7471f1c admin admin] The token cache is being invalidate because project 196e3f40a70f4ef9b59562eea143da02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:11:49.370842 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-83a92307-f92b-4572-a93f-9574e7471f1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:49.370842 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-83a92307-f92b-4572-a93f-9574e7471f1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:49.371036 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a302e606-0dc4-4e24-9239-5b61e7f14c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:49.371036 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a302e606-0dc4-4e24-9239-5b61e7f14c23 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:49.371231 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 870/1741] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:11:48 2022] DELETE /identity/v3/projects/196e3f40a70f4ef9b59562eea143da02 => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:11:49.371311 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a302e606-0dc4-4e24-9239-5b61e7f14c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:49.371311 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a302e606-0dc4-4e24-9239-5b61e7f14c23 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:49.371311 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a302e606-0dc4-4e24-9239-5b61e7f14c23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:49.372176 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a302e606-0dc4-4e24-9239-5b61e7f14c23 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:49.372781 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f4c04-a4b7-4e34-aebc-c385068867f7 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:49.373080 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f4c04-a4b7-4e34-aebc-c385068867f7 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:49.376511 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f4c04-a4b7-4e34-aebc-c385068867f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:49.460931 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-b58f4c04-a4b7-4e34-aebc-c385068867f7 None None] MFA Rules not processed for user `db3459023d74437a99e1efc32ab8f7dc`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:11:49.469211 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b58f4c04-a4b7-4e34-aebc-c385068867f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:49.667441 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 871/1742] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:11:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:11:49.668531 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58f4c04-a4b7-4e34-aebc-c385068867f7 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:49.669879 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b58f4c04-a4b7-4e34-aebc-c385068867f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:49.712410 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58f4c04-a4b7-4e34-aebc-c385068867f7 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:49.728217 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6053aadd-4e0d-40b3-a038-94f7c29fef59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:49.735556 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6053aadd-4e0d-40b3-a038-94f7c29fef59 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:49.735556 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6053aadd-4e0d-40b3-a038-94f7c29fef59 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:49.735556 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6053aadd-4e0d-40b3-a038-94f7c29fef59 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:49.735556 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6053aadd-4e0d-40b3-a038-94f7c29fef59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:49.735556 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6053aadd-4e0d-40b3-a038-94f7c29fef59 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:49.981118 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 872/1743] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:11:49 2022] POST /identity/v3/users => generated 296 bytes in 827 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:11:49.981118 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181e576-37ff-4028-8faa-a89953911e90 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:49.981118 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181e576-37ff-4028-8faa-a89953911e90 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:49.981118 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181e576-37ff-4028-8faa-a89953911e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:50.014081 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-3181e576-37ff-4028-8faa-a89953911e90 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:11:50.016046 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-3181e576-37ff-4028-8faa-a89953911e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:50.044911 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 873/1744] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:11:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:11:50.052663 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3181e576-37ff-4028-8faa-a89953911e90 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:50.070270 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-3181e576-37ff-4028-8faa-a89953911e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:50.086099 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 872/1745] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:11:49 2022] POST /identity/v3/users => generated 296 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:11:50.090206 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6053aadd-4e0d-40b3-a038-94f7c29fef59 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:50.099578 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-6053aadd-4e0d-40b3-a038-94f7c29fef59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:50.100335 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3181e576-37ff-4028-8faa-a89953911e90 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:50.109700 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cddb54-7de7-4df5-87b6-62e88b375b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:50.110397 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cddb54-7de7-4df5-87b6-62e88b375b97 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:50.111440 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cddb54-7de7-4df5-87b6-62e88b375b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:50.112872 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cddb54-7de7-4df5-87b6-62e88b375b97 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:50.114300 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cddb54-7de7-4df5-87b6-62e88b375b97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:50.121898 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cddb54-7de7-4df5-87b6-62e88b375b97 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:50.137891 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6053aadd-4e0d-40b3-a038-94f7c29fef59 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:50.168489 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf85e84-34a0-4364-8bdc-356296dea1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:50.168489 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf85e84-34a0-4364-8bdc-356296dea1be admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:50.168489 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf85e84-34a0-4364-8bdc-356296dea1be admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:50.168489 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf85e84-34a0-4364-8bdc-356296dea1be admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:50.168826 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf85e84-34a0-4364-8bdc-356296dea1be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:50.168826 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf85e84-34a0-4364-8bdc-356296dea1be admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:50.195188 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 873/1746] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:11:50.195188 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3577182-b798-4d8a-bd68-ca231e6389c3 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:50.195188 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3577182-b798-4d8a-bd68-ca231e6389c3 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:50.195188 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3577182-b798-4d8a-bd68-ca231e6389c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:50.238275 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 874/1747] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:11:50 2022] POST /identity/v3/projects => generated 373 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:11:50.239880 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cddb54-7de7-4df5-87b6-62e88b375b97 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:50.264450 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-b3577182-b798-4d8a-bd68-ca231e6389c3 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:11:50.265918 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b3577182-b798-4d8a-bd68-ca231e6389c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:50.383786 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cddb54-7de7-4df5-87b6-62e88b375b97 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:50.392776 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1da90d-9d9f-4cd9-9189-a3643af302ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:50.394056 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1da90d-9d9f-4cd9-9189-a3643af302ba admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:50.394453 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1da90d-9d9f-4cd9-9189-a3643af302ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:50.394869 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1da90d-9d9f-4cd9-9189-a3643af302ba admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:50.403346 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1da90d-9d9f-4cd9-9189-a3643af302ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:50.405770 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1da90d-9d9f-4cd9-9189-a3643af302ba admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:50.440326 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 875/1748] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:11:50.446643 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1da90d-9d9f-4cd9-9189-a3643af302ba admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:50.461208 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1da90d-9d9f-4cd9-9189-a3643af302ba admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:50.467544 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 874/1749] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:11:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:11:50.467544 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3577182-b798-4d8a-bd68-ca231e6389c3 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:50.473500 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b3577182-b798-4d8a-bd68-ca231e6389c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:50.477365 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fb171b-4a1e-40e7-bd37-e1b78b8905e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:50.496047 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb171b-4a1e-40e7-bd37-e1b78b8905e6 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:50.496047 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb171b-4a1e-40e7-bd37-e1b78b8905e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:50.497922 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb171b-4a1e-40e7-bd37-e1b78b8905e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:50.499293 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fb171b-4a1e-40e7-bd37-e1b78b8905e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:50.502600 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fb171b-4a1e-40e7-bd37-e1b78b8905e6 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:50.530254 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3577182-b798-4d8a-bd68-ca231e6389c3 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:50.548175 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 876/1750] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:11:50.549363 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fb171b-4a1e-40e7-bd37-e1b78b8905e6 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:50.555823 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d0ee7b-6568-42ce-8518-e9ea657d4712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:50.556801 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0ee7b-6568-42ce-8518-e9ea657d4712 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:50.557310 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0ee7b-6568-42ce-8518-e9ea657d4712 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:50.557597 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0ee7b-6568-42ce-8518-e9ea657d4712 admin admin] PATH_INFO: `/v3/projects/8bf7d2dbcd5748dd97172b86455bdbca` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:50.559820 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d0ee7b-6568-42ce-8518-e9ea657d4712 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bf7d2dbcd5748dd97172b86455bdbca)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:50.566288 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d0ee7b-6568-42ce-8518-e9ea657d4712 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:50.568037 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fb171b-4a1e-40e7-bd37-e1b78b8905e6 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:50.577058 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c86b4a2-4258-4d3b-9fa8-e75ac6ae4b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:50.577928 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c86b4a2-4258-4d3b-9fa8-e75ac6ae4b39 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:50.578406 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c86b4a2-4258-4d3b-9fa8-e75ac6ae4b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:50.578841 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c86b4a2-4258-4d3b-9fa8-e75ac6ae4b39 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:50.580621 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c86b4a2-4258-4d3b-9fa8-e75ac6ae4b39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:50.584815 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c86b4a2-4258-4d3b-9fa8-e75ac6ae4b39 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:50.707335 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 877/1751] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:11:50 2022] POST /identity/v3/users => generated 293 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:11:50.709593 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c86b4a2-4258-4d3b-9fa8-e75ac6ae4b39 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:50.752504 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c86b4a2-4258-4d3b-9fa8-e75ac6ae4b39 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:50.769203 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb5068-1cba-4914-95c1-94e1463bd64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:50.771819 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb5068-1cba-4914-95c1-94e1463bd64a admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:50.778925 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb5068-1cba-4914-95c1-94e1463bd64a admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:50.780282 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb5068-1cba-4914-95c1-94e1463bd64a admin admin] PATH_INFO: `/v3/projects/bb73614e1df94f129ac6079eb165eac3/users/9dd4cced9bb340c2acbc954fab90fb70/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:50.815818 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-05d0ee7b-6568-42ce-8518-e9ea657d4712 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bf7d2dbcd5748dd97172b86455bdbca', 'request_id': 'req-05d0ee7b-6568-42ce-8518-e9ea657d4712'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:50.831838 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-05d0ee7b-6568-42ce-8518-e9ea657d4712 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bf7d2dbcd5748dd97172b86455bdbca', 'request_id': 'req-05d0ee7b-6568-42ce-8518-e9ea657d4712'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:50.839871 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bb5068-1cba-4914-95c1-94e1463bd64a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb73614e1df94f129ac6079eb165eac3, user_id=9dd4cced9bb340c2acbc954fab90fb70, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:50.847003 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-05d0ee7b-6568-42ce-8518-e9ea657d4712 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bf7d2dbcd5748dd97172b86455bdbca', 'request_id': 'req-05d0ee7b-6568-42ce-8518-e9ea657d4712'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:50.849247 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bb5068-1cba-4914-95c1-94e1463bd64a admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:50.969416 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-05d0ee7b-6568-42ce-8518-e9ea657d4712 admin admin] The token cache is being invalidate because project 8bf7d2dbcd5748dd97172b86455bdbca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:11:50.969919 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-05d0ee7b-6568-42ce-8518-e9ea657d4712 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:50.971812 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-05d0ee7b-6568-42ce-8518-e9ea657d4712 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:50.980514 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 875/1752] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:11:50 2022] DELETE /identity/v3/projects/8bf7d2dbcd5748dd97172b86455bdbca => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:11:50.983640 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d0ee7b-6568-42ce-8518-e9ea657d4712 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:50.998876 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 878/1753] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:11:50 2022] PUT /identity/v3/projects/bb73614e1df94f129ac6079eb165eac3/users/9dd4cced9bb340c2acbc954fab90fb70/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:11:51.001317 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb5068-1cba-4914-95c1-94e1463bd64a admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:51.003855 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-05d0ee7b-6568-42ce-8518-e9ea657d4712 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:51.005313 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-88bb5068-1cba-4914-95c1-94e1463bd64a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:51.222127 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d0ee7b-6568-42ce-8518-e9ea657d4712 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:51.232150 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8726360c-69a4-4f6a-894b-227291695eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:51.233257 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726360c-69a4-4f6a-894b-227291695eac admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:51.233839 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726360c-69a4-4f6a-894b-227291695eac admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:51.234632 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726360c-69a4-4f6a-894b-227291695eac admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:51.242610 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8726360c-69a4-4f6a-894b-227291695eac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:11:51.243197 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8726360c-69a4-4f6a-894b-227291695eac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:51.248438 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8726360c-69a4-4f6a-894b-227291695eac admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:51.253102 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb5068-1cba-4914-95c1-94e1463bd64a admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:51.273106 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c754cfa-0265-484e-81ff-4d550ce0160b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:51.275178 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c754cfa-0265-484e-81ff-4d550ce0160b admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:51.275414 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c754cfa-0265-484e-81ff-4d550ce0160b admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:51.275745 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c754cfa-0265-484e-81ff-4d550ce0160b admin admin] PATH_INFO: `/v3/projects/f12a80cd32a94245b549bdae3cf5d1f4/users/b9757cdac15c41d1b703b363683fb6f2/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:51.301908 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 876/1754] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:11:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:11:51.302792 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8726360c-69a4-4f6a-894b-227291695eac admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:51.306697 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8726360c-69a4-4f6a-894b-227291695eac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:51.332575 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c754cfa-0265-484e-81ff-4d550ce0160b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f12a80cd32a94245b549bdae3cf5d1f4, user_id=b9757cdac15c41d1b703b363683fb6f2, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:51.335307 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c754cfa-0265-484e-81ff-4d550ce0160b admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:51.358652 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8726360c-69a4-4f6a-894b-227291695eac admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:51.365348 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c39fe0-2a99-4049-bdb8-dab8d62a118d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:51.366338 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c39fe0-2a99-4049-bdb8-dab8d62a118d admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:51.366782 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c39fe0-2a99-4049-bdb8-dab8d62a118d admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:51.367410 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c39fe0-2a99-4049-bdb8-dab8d62a118d admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:51.368442 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c39fe0-2a99-4049-bdb8-dab8d62a118d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:51.370690 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c39fe0-2a99-4049-bdb8-dab8d62a118d admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:51.395004 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 877/1755] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:11:51 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:11:51.397643 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c39fe0-2a99-4049-bdb8-dab8d62a118d admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:51.408513 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-85c39fe0-2a99-4049-bdb8-dab8d62a118d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:51.436949 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 879/1756] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:11:50 2022] PUT /identity/v3/projects/f12a80cd32a94245b549bdae3cf5d1f4/users/b9757cdac15c41d1b703b363683fb6f2/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:11:51.437929 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c754cfa-0265-484e-81ff-4d550ce0160b admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:51.442779 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c39fe0-2a99-4049-bdb8-dab8d62a118d admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:51.443279 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-0c754cfa-0265-484e-81ff-4d550ce0160b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:51.627449 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c754cfa-0265-484e-81ff-4d550ce0160b admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:51.650405 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d663b115-b1dc-4bf6-8506-544b7625b423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:51.651091 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d663b115-b1dc-4bf6-8506-544b7625b423 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:51.651371 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d663b115-b1dc-4bf6-8506-544b7625b423 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:51.651717 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d663b115-b1dc-4bf6-8506-544b7625b423 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:51.652462 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d663b115-b1dc-4bf6-8506-544b7625b423 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:51.665696 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9de41ba-c7c6-4929-af2c-a532d32b7a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:51.667794 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de41ba-c7c6-4929-af2c-a532d32b7a70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:51.668090 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de41ba-c7c6-4929-af2c-a532d32b7a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:51.668880 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d663b115-b1dc-4bf6-8506-544b7625b423 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:51.670822 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de41ba-c7c6-4929-af2c-a532d32b7a70 admin admin] PATH_INFO: `/v3/users/a91775de59f043e1bf5e8a28472583ae` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:51.673869 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9de41ba-c7c6-4929-af2c-a532d32b7a70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a91775de59f043e1bf5e8a28472583ae)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:51.678467 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9de41ba-c7c6-4929-af2c-a532d32b7a70 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:51.704930 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 880/1757] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:11:51 2022] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:11:51.715247 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da08ea-43b4-4fdf-babc-be6470356a67 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:51.715558 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da08ea-43b4-4fdf-babc-be6470356a67 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:51.716460 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da08ea-43b4-4fdf-babc-be6470356a67 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:51.718551 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 881/1758] 10.222.0.52 () {54 vars in 921 bytes} [Sat May 14 21:11:51 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:11:51.733744 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7da08ea-43b4-4fdf-babc-be6470356a67 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:51.768419 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7da08ea-43b4-4fdf-babc-be6470356a67 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:51.775344 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6053c9b1-50c5-4694-b273-875eac51c656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:51.785970 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6053c9b1-50c5-4694-b273-875eac51c656 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:51.785970 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6053c9b1-50c5-4694-b273-875eac51c656 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:51.785970 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6053c9b1-50c5-4694-b273-875eac51c656 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:51.785970 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6053c9b1-50c5-4694-b273-875eac51c656 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:51.785970 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6053c9b1-50c5-4694-b273-875eac51c656 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:51.937599 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 882/1759] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:11:51 2022] POST /identity/v3/projects => generated 399 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:11:51.937599 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6053c9b1-50c5-4694-b273-875eac51c656 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:51.979851 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e9de41ba-c7c6-4929-af2c-a532d32b7a70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a91775de59f043e1bf5e8a28472583ae'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:52.000510 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e9de41ba-c7c6-4929-af2c-a532d32b7a70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a91775de59f043e1bf5e8a28472583ae'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:52.006330 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e9de41ba-c7c6-4929-af2c-a532d32b7a70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a91775de59f043e1bf5e8a28472583ae'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:52.084148 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e9de41ba-c7c6-4929-af2c-a532d32b7a70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a91775de59f043e1bf5e8a28472583ae'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:52.108661 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e9de41ba-c7c6-4929-af2c-a532d32b7a70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a91775de59f043e1bf5e8a28472583ae'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:52.135255 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 878/1760] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:11:51 2022] DELETE /identity/v3/users/a91775de59f043e1bf5e8a28472583ae => generated 0 bytes in 740 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:11:52.136982 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b179f-d341-4ecd-a763-6c4eb655e2d4 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:52.139962 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b179f-d341-4ecd-a763-6c4eb655e2d4 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:52.140588 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b179f-d341-4ecd-a763-6c4eb655e2d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:52.155649 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6053c9b1-50c5-4694-b273-875eac51c656 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:52.199789 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-023b179f-d341-4ecd-a763-6c4eb655e2d4 None None] MFA Rules not processed for user `b9757cdac15c41d1b703b363683fb6f2`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:11:52.201019 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-023b179f-d341-4ecd-a763-6c4eb655e2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:52.312164 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe0fc5-4a38-4ee6-9aab-e290989c39e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:52.313327 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe0fc5-4a38-4ee6-9aab-e290989c39e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:52.313680 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe0fc5-4a38-4ee6-9aab-e290989c39e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:52.315649 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe0fc5-4a38-4ee6-9aab-e290989c39e6 admin admin] PATH_INFO: `/v3/projects/65ae5f6e23724538a104b1c21557fe35/users/a995f01d2d1f420499eb36485617cc76/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:52.332401 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 879/1761] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:11:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:11:52.332973 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023b179f-d341-4ecd-a763-6c4eb655e2d4 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:52.337659 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-023b179f-d341-4ecd-a763-6c4eb655e2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:52.362033 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbe0fc5-4a38-4ee6-9aab-e290989c39e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65ae5f6e23724538a104b1c21557fe35, user_id=a995f01d2d1f420499eb36485617cc76, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:52.362381 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023b179f-d341-4ecd-a763-6c4eb655e2d4 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:52.365676 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbe0fc5-4a38-4ee6-9aab-e290989c39e6 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:52.370767 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c125d155-2395-4d3a-90bf-41b11e23844a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:52.371731 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125d155-2395-4d3a-90bf-41b11e23844a admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:52.372010 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125d155-2395-4d3a-90bf-41b11e23844a admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:52.372282 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125d155-2395-4d3a-90bf-41b11e23844a admin admin] PATH_INFO: `/v3/projects/bb73614e1df94f129ac6079eb165eac3/users/9dd4cced9bb340c2acbc954fab90fb70/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:52.374939 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c125d155-2395-4d3a-90bf-41b11e23844a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb73614e1df94f129ac6079eb165eac3, user_id=9dd4cced9bb340c2acbc954fab90fb70, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:52.390192 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c125d155-2395-4d3a-90bf-41b11e23844a admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:52.418514 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 880/1762] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:11:52 2022] PUT /identity/v3/projects/bb73614e1df94f129ac6079eb165eac3/users/9dd4cced9bb340c2acbc954fab90fb70/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:11:52.419986 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498cd2fc-b32e-4094-90dd-ce9d09dbe822 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:52.420270 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498cd2fc-b32e-4094-90dd-ce9d09dbe822 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:52.420543 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498cd2fc-b32e-4094-90dd-ce9d09dbe822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:52.485782 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 883/1763] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:11:51 2022] PUT /identity/v3/projects/65ae5f6e23724538a104b1c21557fe35/users/a995f01d2d1f420499eb36485617cc76/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:11:52.488244 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe0fc5-4a38-4ee6-9aab-e290989c39e6 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:52.498983 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-5fbe0fc5-4a38-4ee6-9aab-e290989c39e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:52.513239 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-498cd2fc-b32e-4094-90dd-ce9d09dbe822 None None] MFA Rules not processed for user `0f1b0e2b025d4eceaa90e1616d0a9db8`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:11:52.514551 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-498cd2fc-b32e-4094-90dd-ce9d09dbe822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:52.848957 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe0fc5-4a38-4ee6-9aab-e290989c39e6 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:52.874641 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7097ac-05d6-41ed-b279-4a8f88fd7ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:52.874641 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7097ac-05d6-41ed-b279-4a8f88fd7ec8 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:52.874641 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7097ac-05d6-41ed-b279-4a8f88fd7ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:52.874641 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7097ac-05d6-41ed-b279-4a8f88fd7ec8 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:52.878023 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 881/1764] 10.222.0.52 () {58 vars in 1018 bytes} [Sat May 14 21:11:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 458 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:11:52.879510 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498cd2fc-b32e-4094-90dd-ce9d09dbe822 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:52.880391 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7097ac-05d6-41ed-b279-4a8f88fd7ec8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:52.882866 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-498cd2fc-b32e-4094-90dd-ce9d09dbe822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:52.885295 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7097ac-05d6-41ed-b279-4a8f88fd7ec8 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:52.932633 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498cd2fc-b32e-4094-90dd-ce9d09dbe822 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:52.941192 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b60702d-e3eb-40a7-996d-770dba8e9773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:52.942245 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60702d-e3eb-40a7-996d-770dba8e9773 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:52.942544 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60702d-e3eb-40a7-996d-770dba8e9773 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:52.942871 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60702d-e3eb-40a7-996d-770dba8e9773 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:52.943660 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b60702d-e3eb-40a7-996d-770dba8e9773 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:52.945805 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b60702d-e3eb-40a7-996d-770dba8e9773 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:53.016792 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 884/1765] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:11:52 2022] POST /identity/v3/users => generated 300 bytes in 530 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:11:53.020061 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9a22e-c698-437d-b0e3-3f8f9437764d None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:53.020061 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9a22e-c698-437d-b0e3-3f8f9437764d None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:53.020061 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9a22e-c698-437d-b0e3-3f8f9437764d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:53.075335 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-c5c9a22e-c698-437d-b0e3-3f8f9437764d None None] MFA Rules not processed for user `9dd4cced9bb340c2acbc954fab90fb70`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:11:53.076815 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c5c9a22e-c698-437d-b0e3-3f8f9437764d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:53.112182 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 882/1766] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:11:52 2022] POST /identity/v3/projects => generated 391 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:11:53.115390 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b60702d-e3eb-40a7-996d-770dba8e9773 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:53.134177 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-0b60702d-e3eb-40a7-996d-770dba8e9773 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:53.239417 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 885/1767] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:11:53 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:11:53.240396 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c9a22e-c698-437d-b0e3-3f8f9437764d None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:53.242004 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c5c9a22e-c698-437d-b0e3-3f8f9437764d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:53.276468 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c9a22e-c698-437d-b0e3-3f8f9437764d None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:53.327190 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b60702d-e3eb-40a7-996d-770dba8e9773 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:53.366246 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f3f84-d0d2-4a7f-b21a-ef5adbad1d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:53.366246 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f3f84-d0d2-4a7f-b21a-ef5adbad1d95 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:53.366246 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f3f84-d0d2-4a7f-b21a-ef5adbad1d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:53.366246 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f3f84-d0d2-4a7f-b21a-ef5adbad1d95 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:53.375793 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462f3f84-d0d2-4a7f-b21a-ef5adbad1d95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:53.379103 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462f3f84-d0d2-4a7f-b21a-ef5adbad1d95 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:53.412441 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 883/1768] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:11:53.414229 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f3f84-d0d2-4a7f-b21a-ef5adbad1d95 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:53.440036 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f3f84-d0d2-4a7f-b21a-ef5adbad1d95 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:53.445318 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d19dc1-7abe-4a04-a780-7eccdb23c757 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:53.445996 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d19dc1-7abe-4a04-a780-7eccdb23c757 service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:53.446393 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d19dc1-7abe-4a04-a780-7eccdb23c757 service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:53.446683 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d19dc1-7abe-4a04-a780-7eccdb23c757 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:53.459067 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eba9d6b-adab-4a95-9337-33ba262378c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:53.461782 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eba9d6b-adab-4a95-9337-33ba262378c3 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:53.462124 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eba9d6b-adab-4a95-9337-33ba262378c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:53.462343 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eba9d6b-adab-4a95-9337-33ba262378c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:53.463871 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eba9d6b-adab-4a95-9337-33ba262378c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:53.464783 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eba9d6b-adab-4a95-9337-33ba262378c3 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:53.468814 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d19dc1-7abe-4a04-a780-7eccdb23c757 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:53.470672 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d19dc1-7abe-4a04-a780-7eccdb23c757 service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:53.498100 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 886/1769] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:11:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:11:53.499041 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d19dc1-7abe-4a04-a780-7eccdb23c757 service nova] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:53.512344 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 884/1770] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:11:53.515696 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eba9d6b-adab-4a95-9337-33ba262378c3 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:53.520507 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d19dc1-7abe-4a04-a780-7eccdb23c757 service nova] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:53.526945 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-6eba9d6b-adab-4a95-9337-33ba262378c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:53.529953 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ed409e-29f7-4470-b1e5-de5f8c203065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:53.530654 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed409e-29f7-4470-b1e5-de5f8c203065 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:53.530940 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed409e-29f7-4470-b1e5-de5f8c203065 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:53.531220 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed409e-29f7-4470-b1e5-de5f8c203065 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:53.538855 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ed409e-29f7-4470-b1e5-de5f8c203065 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:53.541218 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ed409e-29f7-4470-b1e5-de5f8c203065 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:53.600404 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eba9d6b-adab-4a95-9337-33ba262378c3 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:53.619632 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba2f039-5f52-4f9d-9288-956dbf82af0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:53.620657 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba2f039-5f52-4f9d-9288-956dbf82af0b service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:53.622384 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba2f039-5f52-4f9d-9288-956dbf82af0b service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:53.623708 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba2f039-5f52-4f9d-9288-956dbf82af0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:53.677590 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 887/1771] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:11:53 2022] POST /identity/v3/users => generated 302 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:11:53.677590 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ed409e-29f7-4470-b1e5-de5f8c203065 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:53.698300 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ed409e-29f7-4470-b1e5-de5f8c203065 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:53.709980 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d5c8b2-f67c-4bca-b79b-d1e7b0a0fa01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:53.710902 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5c8b2-f67c-4bca-b79b-d1e7b0a0fa01 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:53.711217 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5c8b2-f67c-4bca-b79b-d1e7b0a0fa01 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:53.711934 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5c8b2-f67c-4bca-b79b-d1e7b0a0fa01 admin admin] PATH_INFO: `/v3/projects/65ae5f6e23724538a104b1c21557fe35/users/a995f01d2d1f420499eb36485617cc76/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:53.718256 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d5c8b2-f67c-4bca-b79b-d1e7b0a0fa01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65ae5f6e23724538a104b1c21557fe35, user_id=a995f01d2d1f420499eb36485617cc76, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:53.721845 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d5c8b2-f67c-4bca-b79b-d1e7b0a0fa01 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:53.747270 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 888/1772] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:11:53 2022] PUT /identity/v3/projects/65ae5f6e23724538a104b1c21557fe35/users/a995f01d2d1f420499eb36485617cc76/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:11:53.748570 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d5c8b2-f67c-4bca-b79b-d1e7b0a0fa01 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:53.889539 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba2f039-5f52-4f9d-9288-956dbf82af0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:53.901389 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba2f039-5f52-4f9d-9288-956dbf82af0b service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:53.901472 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d5c8b2-f67c-4bca-b79b-d1e7b0a0fa01 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:53.920325 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a6f0d-c0ee-4deb-949e-84e53d3a528a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:53.921038 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a6f0d-c0ee-4deb-949e-84e53d3a528a admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:53.921302 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a6f0d-c0ee-4deb-949e-84e53d3a528a admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:53.921637 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a6f0d-c0ee-4deb-949e-84e53d3a528a admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:53.922359 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18a6f0d-c0ee-4deb-949e-84e53d3a528a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:53.924278 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18a6f0d-c0ee-4deb-949e-84e53d3a528a admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:53.946793 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 885/1773] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:11:53 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:11:53.948509 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba2f039-5f52-4f9d-9288-956dbf82af0b service nova] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:53.952857 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 889/1774] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:11:53.954374 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64079bec-f4cd-411e-8548-ee93554e7c7d None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:53.955234 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64079bec-f4cd-411e-8548-ee93554e7c7d None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:53.955536 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64079bec-f4cd-411e-8548-ee93554e7c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:53.990647 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba2f039-5f52-4f9d-9288-956dbf82af0b service nova] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:54.004491 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f44754-9668-468a-a97f-e6cbe51c5e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:54.007160 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f44754-9668-468a-a97f-e6cbe51c5e97 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:54.007160 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f44754-9668-468a-a97f-e6cbe51c5e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:54.023088 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f44754-9668-468a-a97f-e6cbe51c5e97 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:54.024320 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f44754-9668-468a-a97f-e6cbe51c5e97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:54.032076 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f44754-9668-468a-a97f-e6cbe51c5e97 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:54.065551 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 886/1775] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:11:54.074317 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-64079bec-f4cd-411e-8548-ee93554e7c7d None None] MFA Rules not processed for user `a995f01d2d1f420499eb36485617cc76`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:11:54.075595 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-64079bec-f4cd-411e-8548-ee93554e7c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:54.083195 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f44754-9668-468a-a97f-e6cbe51c5e97 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:54.119618 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f44754-9668-468a-a97f-e6cbe51c5e97 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:54.155998 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef0b50-520c-47f1-9ea6-7b7e9824d109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:54.159240 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef0b50-520c-47f1-9ea6-7b7e9824d109 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:54.159240 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef0b50-520c-47f1-9ea6-7b7e9824d109 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:54.159240 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef0b50-520c-47f1-9ea6-7b7e9824d109 admin admin] PATH_INFO: `/v3/projects/6c736aeec5a841eeabb4213d8e0e1a80/users/9c6eeaaeaddc449294b0231b93d9218b/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:54.230065 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfef0b50-520c-47f1-9ea6-7b7e9824d109 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c736aeec5a841eeabb4213d8e0e1a80, user_id=9c6eeaaeaddc449294b0231b93d9218b, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:54.232885 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfef0b50-520c-47f1-9ea6-7b7e9824d109 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:54.334297 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 887/1776] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:11:54 2022] PUT /identity/v3/projects/6c736aeec5a841eeabb4213d8e0e1a80/users/9c6eeaaeaddc449294b0231b93d9218b/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:11:54.342983 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef0b50-520c-47f1-9ea6-7b7e9824d109 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:54.342983 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-dfef0b50-520c-47f1-9ea6-7b7e9824d109 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:54.360228 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 890/1777] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:11:53 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 407 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:11:54.364478 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64079bec-f4cd-411e-8548-ee93554e7c7d None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:54.407216 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64079bec-f4cd-411e-8548-ee93554e7c7d None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:54.548760 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef0b50-520c-47f1-9ea6-7b7e9824d109 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:54.548760 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfdfa79-3314-400f-b58c-13fc60e34270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:54.548760 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfdfa79-3314-400f-b58c-13fc60e34270 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:54.548760 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfdfa79-3314-400f-b58c-13fc60e34270 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:54.549980 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfdfa79-3314-400f-b58c-13fc60e34270 admin admin] PATH_INFO: `/v3/projects/4e4e50b1efc04956979213869dec7aa1` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:54.549980 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfdfa79-3314-400f-b58c-13fc60e34270 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e4e50b1efc04956979213869dec7aa1)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:54.549980 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfdfa79-3314-400f-b58c-13fc60e34270 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:54.645540 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b32d771-561a-4f59-b1cc-513abaefe5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:54.648385 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b32d771-561a-4f59-b1cc-513abaefe5f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:54.648385 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b32d771-561a-4f59-b1cc-513abaefe5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:54.648385 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b32d771-561a-4f59-b1cc-513abaefe5f5 admin admin] PATH_INFO: `/v3/projects/04bdefd9ae534ef98ba0ee5d2adbe13e/users/bb8fa625718447cc8c72dc0ea4692e9b/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:54.704152 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b32d771-561a-4f59-b1cc-513abaefe5f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04bdefd9ae534ef98ba0ee5d2adbe13e, user_id=bb8fa625718447cc8c72dc0ea4692e9b, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:54.728630 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b32d771-561a-4f59-b1cc-513abaefe5f5 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:54.975565 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 891/1778] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:11:54 2022] PUT /identity/v3/projects/04bdefd9ae534ef98ba0ee5d2adbe13e/users/bb8fa625718447cc8c72dc0ea4692e9b/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:11:54.975565 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4992f9-698d-4b60-927d-085a4bddd5fc None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:54.975565 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4992f9-698d-4b60-927d-085a4bddd5fc None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:54.975565 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4992f9-698d-4b60-927d-085a4bddd5fc None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:54.976712 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 892/1779] 10.222.0.52 () {54 vars in 912 bytes} [Sat May 14 21:11:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:11:54.977777 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d683d-42ce-4a3b-857e-acb494c3e2a0 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:54.978102 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d683d-42ce-4a3b-857e-acb494c3e2a0 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:54.988236 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d683d-42ce-4a3b-857e-acb494c3e2a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:55.012902 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-5cfdfa79-3314-400f-b58c-13fc60e34270 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e4e50b1efc04956979213869dec7aa1', 'request_id': 'req-5cfdfa79-3314-400f-b58c-13fc60e34270'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:55.026891 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-381d683d-42ce-4a3b-857e-acb494c3e2a0 None None] MFA Rules not processed for user `9c6eeaaeaddc449294b0231b93d9218b`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:11:55.029452 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-5cfdfa79-3314-400f-b58c-13fc60e34270 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e4e50b1efc04956979213869dec7aa1', 'request_id': 'req-5cfdfa79-3314-400f-b58c-13fc60e34270'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:55.029570 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-381d683d-42ce-4a3b-857e-acb494c3e2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:55.037979 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-5cfdfa79-3314-400f-b58c-13fc60e34270 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e4e50b1efc04956979213869dec7aa1', 'request_id': 'req-5cfdfa79-3314-400f-b58c-13fc60e34270'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:55.120976 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-5cfdfa79-3314-400f-b58c-13fc60e34270 admin admin] The token cache is being invalidate because project 4e4e50b1efc04956979213869dec7aa1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:11:55.121232 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-5cfdfa79-3314-400f-b58c-13fc60e34270 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:55.123261 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 893/1780] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:11:54 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:11:55.123876 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-5cfdfa79-3314-400f-b58c-13fc60e34270 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:55.124405 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381d683d-42ce-4a3b-857e-acb494c3e2a0 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:55.153306 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 888/1781] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:11:54 2022] DELETE /identity/v3/projects/4e4e50b1efc04956979213869dec7aa1 => generated 0 bytes in 817 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:11:55.153306 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfdfa79-3314-400f-b58c-13fc60e34270 admin admin] Authenticating service token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 14 21:11:55.164024 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-5cfdfa79-3314-400f-b58c-13fc60e34270 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:55.219360 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381d683d-42ce-4a3b-857e-acb494c3e2a0 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:55.225838 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd5bc9b-4511-41d6-94c1-906f9ed4e09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:55.226917 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd5bc9b-4511-41d6-94c1-906f9ed4e09a admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:55.227652 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd5bc9b-4511-41d6-94c1-906f9ed4e09a admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:55.228141 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd5bc9b-4511-41d6-94c1-906f9ed4e09a admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:55.229230 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd5bc9b-4511-41d6-94c1-906f9ed4e09a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:55.232132 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd5bc9b-4511-41d6-94c1-906f9ed4e09a admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:55.250400 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 894/1782] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:11:55.254924 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd5bc9b-4511-41d6-94c1-906f9ed4e09a admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:55.257437 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-dcd5bc9b-4511-41d6-94c1-906f9ed4e09a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:55.291876 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd5bc9b-4511-41d6-94c1-906f9ed4e09a admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:55.305746 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3370be3b-3e56-482a-9c1e-59073ded2f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:55.307939 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3370be3b-3e56-482a-9c1e-59073ded2f3a admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:55.309075 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3370be3b-3e56-482a-9c1e-59073ded2f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:55.309606 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3370be3b-3e56-482a-9c1e-59073ded2f3a admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:55.311600 ncdv-master-1 devstack@keystone.service[91107]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-5cfdfa79-3314-400f-b58c-13fc60e34270 admin admin] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. May 14 21:11:55.311924 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfdfa79-3314-400f-b58c-13fc60e34270 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:55.313458 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-5cfdfa79-3314-400f-b58c-13fc60e34270 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:55.314270 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3370be3b-3e56-482a-9c1e-59073ded2f3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:55.320316 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3370be3b-3e56-482a-9c1e-59073ded2f3a admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:55.457093 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 895/1783] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:11:55 2022] POST /identity/v3/projects => generated 397 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:11:55.473533 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1665711-9a31-4355-8787-c6d4ae928818 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:55.473533 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1665711-9a31-4355-8787-c6d4ae928818 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:55.473533 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1665711-9a31-4355-8787-c6d4ae928818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:55.473884 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfdfa79-3314-400f-b58c-13fc60e34270 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:55.518812 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-f1665711-9a31-4355-8787-c6d4ae928818 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:11:55.518812 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-f1665711-9a31-4355-8787-c6d4ae928818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:55.593829 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17400cd-da61-43d9-84c3-ba880ac90e23 tempest-FlavorsAccessTestJSON-1189733697 tempest-FlavorsAccessTestJSON-1189733697-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dd4cced9bb340c2acbc954fab90fb70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb73614e1df94f129ac6079eb165eac3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:55.599786 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17400cd-da61-43d9-84c3-ba880ac90e23 tempest-FlavorsAccessTestJSON-1189733697 tempest-FlavorsAccessTestJSON-1189733697-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:55.599786 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17400cd-da61-43d9-84c3-ba880ac90e23 tempest-FlavorsAccessTestJSON-1189733697 tempest-FlavorsAccessTestJSON-1189733697-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:55.599786 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17400cd-da61-43d9-84c3-ba880ac90e23 tempest-FlavorsAccessTestJSON-1189733697 tempest-FlavorsAccessTestJSON-1189733697-project-admin] PATH_INFO: `/v3/projects/1ecabb816bab433d81c64af18cfdb59e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:55.600467 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17400cd-da61-43d9-84c3-ba880ac90e23 tempest-FlavorsAccessTestJSON-1189733697 tempest-FlavorsAccessTestJSON-1189733697-project-admin] RBAC: Authorizing `identity:get_project(project_id=1ecabb816bab433d81c64af18cfdb59e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:55.603643 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17400cd-da61-43d9-84c3-ba880ac90e23 tempest-FlavorsAccessTestJSON-1189733697 tempest-FlavorsAccessTestJSON-1189733697-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:55.606488 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 889/1784] 10.222.0.52 () {58 vars in 1443 bytes} [Sat May 14 21:11:55 2022] GET /identity/v3/projects/1ecabb816bab433d81c64af18cfdb59e => generated 379 bytes in 454 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:11:55.617277 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17400cd-da61-43d9-84c3-ba880ac90e23 tempest-FlavorsAccessTestJSON-1189733697 tempest-FlavorsAccessTestJSON-1189733697-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:55.621281 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-a17400cd-da61-43d9-84c3-ba880ac90e23 tempest-FlavorsAccessTestJSON-1189733697 tempest-FlavorsAccessTestJSON-1189733697-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:55.652651 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 896/1785] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:11:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:11:55.653735 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1665711-9a31-4355-8787-c6d4ae928818 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:55.664719 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-f1665711-9a31-4355-8787-c6d4ae928818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:55.691302 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1665711-9a31-4355-8787-c6d4ae928818 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:55.701995 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62211d44-0f5f-41e5-9086-9e19d6cd71ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:55.703142 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62211d44-0f5f-41e5-9086-9e19d6cd71ab admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:55.703245 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62211d44-0f5f-41e5-9086-9e19d6cd71ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:55.703449 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62211d44-0f5f-41e5-9086-9e19d6cd71ab admin admin] PATH_INFO: `/v3/projects/04bdefd9ae534ef98ba0ee5d2adbe13e/users/bb8fa625718447cc8c72dc0ea4692e9b/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:55.710809 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62211d44-0f5f-41e5-9086-9e19d6cd71ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=04bdefd9ae534ef98ba0ee5d2adbe13e, user_id=bb8fa625718447cc8c72dc0ea4692e9b, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:55.717209 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62211d44-0f5f-41e5-9086-9e19d6cd71ab admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:55.743162 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 897/1786] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:11:55 2022] PUT /identity/v3/projects/04bdefd9ae534ef98ba0ee5d2adbe13e/users/bb8fa625718447cc8c72dc0ea4692e9b/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:11:55.744833 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62211d44-0f5f-41e5-9086-9e19d6cd71ab admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:55.884691 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17400cd-da61-43d9-84c3-ba880ac90e23 tempest-FlavorsAccessTestJSON-1189733697 tempest-FlavorsAccessTestJSON-1189733697-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:55.903352 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62211d44-0f5f-41e5-9086-9e19d6cd71ab admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:55.920123 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1191b4-193f-4512-9bfb-b46921736af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:55.920752 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1191b4-193f-4512-9bfb-b46921736af8 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:55.921042 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1191b4-193f-4512-9bfb-b46921736af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:55.921322 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1191b4-193f-4512-9bfb-b46921736af8 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:55.922035 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1191b4-193f-4512-9bfb-b46921736af8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:55.924255 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1191b4-193f-4512-9bfb-b46921736af8 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:56.038397 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 898/1787] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:11:55 2022] POST /identity/v3/users => generated 305 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:11:56.038397 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b1b22-01c6-4de8-85c0-81803b962f28 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:56.038397 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b1b22-01c6-4de8-85c0-81803b962f28 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:56.038397 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b1b22-01c6-4de8-85c0-81803b962f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:56.072077 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874dce65-c7ce-4eea-8029-aab47388d034 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:56.072908 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874dce65-c7ce-4eea-8029-aab47388d034 service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:56.073286 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874dce65-c7ce-4eea-8029-aab47388d034 service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:56.073680 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874dce65-c7ce-4eea-8029-aab47388d034 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:56.086266 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-874dce65-c7ce-4eea-8029-aab47388d034 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:56.092608 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-244b1b22-01c6-4de8-85c0-81803b962f28 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:11:56.094010 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-244b1b22-01c6-4de8-85c0-81803b962f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:56.130426 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 899/1788] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:11:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:11:56.132319 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eaa0a6-9670-42e0-b06f-c33248b7886c None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:56.132610 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eaa0a6-9670-42e0-b06f-c33248b7886c None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:56.132923 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eaa0a6-9670-42e0-b06f-c33248b7886c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:56.214461 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-d6eaa0a6-9670-42e0-b06f-c33248b7886c None None] MFA Rules not processed for user `bb8fa625718447cc8c72dc0ea4692e9b`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:11:56.231743 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d6eaa0a6-9670-42e0-b06f-c33248b7886c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:56.266785 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874dce65-c7ce-4eea-8029-aab47388d034 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:56.273583 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874dce65-c7ce-4eea-8029-aab47388d034 service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:56.326743 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 890/1789] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:11:55 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 710 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:11:56.328666 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874dce65-c7ce-4eea-8029-aab47388d034 service nova] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:56.353187 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874dce65-c7ce-4eea-8029-aab47388d034 service nova] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:56.359152 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfad6a1-a263-4a21-878c-4fd34334e139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:56.359871 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfad6a1-a263-4a21-878c-4fd34334e139 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:56.360156 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfad6a1-a263-4a21-878c-4fd34334e139 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:56.360434 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfad6a1-a263-4a21-878c-4fd34334e139 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:56.361872 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfad6a1-a263-4a21-878c-4fd34334e139 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:56.384137 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 900/1790] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:11:56 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:11:56.385496 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eaa0a6-9670-42e0-b06f-c33248b7886c None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:56.388038 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfad6a1-a263-4a21-878c-4fd34334e139 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:56.413360 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 891/1791] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:11:56 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:11:56.417774 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfad6a1-a263-4a21-878c-4fd34334e139 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:56.419048 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eaa0a6-9670-42e0-b06f-c33248b7886c None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:56.432582 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfad6a1-a263-4a21-878c-4fd34334e139 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:56.435276 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c42539-8e8e-42f5-81d0-ae829fe9dd49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:56.435276 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c42539-8e8e-42f5-81d0-ae829fe9dd49 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:56.435276 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c42539-8e8e-42f5-81d0-ae829fe9dd49 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:56.435276 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c42539-8e8e-42f5-81d0-ae829fe9dd49 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:56.436129 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c42539-8e8e-42f5-81d0-ae829fe9dd49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:11:56.436591 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c42539-8e8e-42f5-81d0-ae829fe9dd49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:56.438411 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c42539-8e8e-42f5-81d0-ae829fe9dd49 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:56.446500 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863952ec-bec1-461b-8c83-71d9f5d09397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:56.447695 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863952ec-bec1-461b-8c83-71d9f5d09397 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:56.448060 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863952ec-bec1-461b-8c83-71d9f5d09397 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:56.448404 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863952ec-bec1-461b-8c83-71d9f5d09397 admin admin] PATH_INFO: `/v3/projects/c64daeb40257492c80bc37c6323473f8/users/486797a29695490b931e7e7549d659f8/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:56.476325 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863952ec-bec1-461b-8c83-71d9f5d09397 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c64daeb40257492c80bc37c6323473f8, user_id=486797a29695490b931e7e7549d659f8, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:56.482311 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863952ec-bec1-461b-8c83-71d9f5d09397 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:56.503665 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 901/1792] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:11:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:11:56.507892 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c42539-8e8e-42f5-81d0-ae829fe9dd49 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:56.543502 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c42539-8e8e-42f5-81d0-ae829fe9dd49 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:56.567851 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c9253-1b51-4f15-bcb0-097521f4f00e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:56.567851 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c9253-1b51-4f15-bcb0-097521f4f00e service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:56.567851 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c9253-1b51-4f15-bcb0-097521f4f00e service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:56.567851 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c9253-1b51-4f15-bcb0-097521f4f00e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:56.576011 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-a95c9253-1b51-4f15-bcb0-097521f4f00e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:56.663708 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 892/1793] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:11:56 2022] PUT /identity/v3/projects/c64daeb40257492c80bc37c6323473f8/users/486797a29695490b931e7e7549d659f8/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:11:56.664888 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863952ec-bec1-461b-8c83-71d9f5d09397 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:56.746821 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95c9253-1b51-4f15-bcb0-097521f4f00e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:56.749378 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95c9253-1b51-4f15-bcb0-097521f4f00e service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:56.774482 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 902/1794] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:11:56 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:11:56.775207 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c9253-1b51-4f15-bcb0-097521f4f00e service nova] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:56.801418 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c9253-1b51-4f15-bcb0-097521f4f00e service nova] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:56.910635 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863952ec-bec1-461b-8c83-71d9f5d09397 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:56.924131 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66568470-311e-41d2-b16e-90d783e8c7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:56.926569 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66568470-311e-41d2-b16e-90d783e8c7ca admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:56.926974 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66568470-311e-41d2-b16e-90d783e8c7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:56.927535 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66568470-311e-41d2-b16e-90d783e8c7ca admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:56.928668 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66568470-311e-41d2-b16e-90d783e8c7ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:56.930812 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66568470-311e-41d2-b16e-90d783e8c7ca admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:56.944115 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b35fb-f4cc-4f6c-ab0b-c41376a99ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:56.944825 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b35fb-f4cc-4f6c-ab0b-c41376a99ad0 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:56.945180 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b35fb-f4cc-4f6c-ab0b-c41376a99ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:56.945847 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b35fb-f4cc-4f6c-ab0b-c41376a99ad0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:56.946168 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996b35fb-f4cc-4f6c-ab0b-c41376a99ad0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:56.948257 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996b35fb-f4cc-4f6c-ab0b-c41376a99ad0 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:56.960215 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 903/1795] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:11:56 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:11:56.961633 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66568470-311e-41d2-b16e-90d783e8c7ca admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:56.978207 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66568470-311e-41d2-b16e-90d783e8c7ca admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:56.990619 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad58acf3-5904-46bb-9a69-6f99cacb17a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:56.991787 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58acf3-5904-46bb-9a69-6f99cacb17a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:56.992217 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58acf3-5904-46bb-9a69-6f99cacb17a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:56.992672 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58acf3-5904-46bb-9a69-6f99cacb17a7 admin admin] PATH_INFO: `/v3/users/b9757cdac15c41d1b703b363683fb6f2` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:56.994351 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad58acf3-5904-46bb-9a69-6f99cacb17a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9757cdac15c41d1b703b363683fb6f2)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:56.996758 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad58acf3-5904-46bb-9a69-6f99cacb17a7 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:57.106721 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 893/1796] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:11:56 2022] POST /identity/v3/projects => generated 381 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:11:57.106721 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b35fb-f4cc-4f6c-ab0b-c41376a99ad0 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:57.211186 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ad58acf3-5904-46bb-9a69-6f99cacb17a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9757cdac15c41d1b703b363683fb6f2'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:57.231056 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ad58acf3-5904-46bb-9a69-6f99cacb17a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9757cdac15c41d1b703b363683fb6f2'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:57.246184 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ad58acf3-5904-46bb-9a69-6f99cacb17a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9757cdac15c41d1b703b363683fb6f2'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:57.295932 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b35fb-f4cc-4f6c-ab0b-c41376a99ad0 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:57.303564 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47ba362-46b3-4b38-b637-c19e5895897e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:57.304666 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ba362-46b3-4b38-b637-c19e5895897e service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:57.305116 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ba362-46b3-4b38-b637-c19e5895897e service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:57.305541 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ba362-46b3-4b38-b637-c19e5895897e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:57.307671 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b47ba362-46b3-4b38-b637-c19e5895897e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:57.320322 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ad58acf3-5904-46bb-9a69-6f99cacb17a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9757cdac15c41d1b703b363683fb6f2'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:57.321120 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ad58acf3-5904-46bb-9a69-6f99cacb17a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9757cdac15c41d1b703b363683fb6f2'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:57.335394 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 904/1797] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:11:56 2022] DELETE /identity/v3/users/b9757cdac15c41d1b703b363683fb6f2 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:11:57.335394 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad58acf3-5904-46bb-9a69-6f99cacb17a7 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:57.339660 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ad58acf3-5904-46bb-9a69-6f99cacb17a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:57.488340 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47ba362-46b3-4b38-b637-c19e5895897e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:57.490015 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47ba362-46b3-4b38-b637-c19e5895897e service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:57.523284 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 894/1798] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:11:57 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:11:57.523284 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47ba362-46b3-4b38-b637-c19e5895897e service nova] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:57.531499 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad58acf3-5904-46bb-9a69-6f99cacb17a7 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:57.536080 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0ded7b-1217-4b9c-bf72-fc3cd229e293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:57.537153 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ded7b-1217-4b9c-bf72-fc3cd229e293 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:57.537540 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ded7b-1217-4b9c-bf72-fc3cd229e293 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:57.537917 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ded7b-1217-4b9c-bf72-fc3cd229e293 admin admin] PATH_INFO: `/v3/projects/c64daeb40257492c80bc37c6323473f8/users/486797a29695490b931e7e7549d659f8/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:57.568781 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0ded7b-1217-4b9c-bf72-fc3cd229e293 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c64daeb40257492c80bc37c6323473f8, user_id=486797a29695490b931e7e7549d659f8, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:57.571755 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0ded7b-1217-4b9c-bf72-fc3cd229e293 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:57.599536 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 905/1799] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:11:57 2022] PUT /identity/v3/projects/c64daeb40257492c80bc37c6323473f8/users/486797a29695490b931e7e7549d659f8/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:11:57.601079 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe3d891-6a73-42a3-88f0-aaec0349b751 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:57.603216 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe3d891-6a73-42a3-88f0-aaec0349b751 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:57.604678 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe3d891-6a73-42a3-88f0-aaec0349b751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:57.743424 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47ba362-46b3-4b38-b637-c19e5895897e service nova] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:57.860822 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a57a545-b02f-4ba0-b5f3-3844f0b90129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:57.862484 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a57a545-b02f-4ba0-b5f3-3844f0b90129 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:57.862780 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a57a545-b02f-4ba0-b5f3-3844f0b90129 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:57.863064 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a57a545-b02f-4ba0-b5f3-3844f0b90129 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:57.863816 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a57a545-b02f-4ba0-b5f3-3844f0b90129 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:57.871883 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a57a545-b02f-4ba0-b5f3-3844f0b90129 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:57.946290 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-cbe3d891-6a73-42a3-88f0-aaec0349b751 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:11:57.953524 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-cbe3d891-6a73-42a3-88f0-aaec0349b751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:57.975673 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 906/1800] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:11:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:11:57.982808 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722b37e-68cf-4515-89e6-ba43811205fd None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:57.982808 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722b37e-68cf-4515-89e6-ba43811205fd None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:57.982808 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722b37e-68cf-4515-89e6-ba43811205fd None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:57.989753 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 907/1801] 10.222.0.52 () {54 vars in 912 bytes} [Sat May 14 21:11:57 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:11:57.991297 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c04f04-d3d6-4ad4-b39f-581c022c081c None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:57.991669 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c04f04-d3d6-4ad4-b39f-581c022c081c None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:57.992552 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c04f04-d3d6-4ad4-b39f-581c022c081c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:58.061288 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-32c04f04-d3d6-4ad4-b39f-581c022c081c None None] MFA Rules not processed for user `486797a29695490b931e7e7549d659f8`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:11:58.062225 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 895/1802] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:11:57 2022] POST /identity/v3/users => generated 291 bytes in 542 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:11:58.063446 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a57a545-b02f-4ba0-b5f3-3844f0b90129 admin admin] Authenticating service token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 14 21:11:58.073094 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8a57a545-b02f-4ba0-b5f3-3844f0b90129 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:58.087021 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-32c04f04-d3d6-4ad4-b39f-581c022c081c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:58.284627 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a57a545-b02f-4ba0-b5f3-3844f0b90129 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:58.289705 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8a57a545-b02f-4ba0-b5f3-3844f0b90129 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:58.349297 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 908/1803] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:11:57 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:11:58.350050 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c04f04-d3d6-4ad4-b39f-581c022c081c None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:58.368369 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-32c04f04-d3d6-4ad4-b39f-581c022c081c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:58.491135 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a57a545-b02f-4ba0-b5f3-3844f0b90129 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:58.512335 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71bfd30-6c71-488c-895f-66997b5e357f tempest-FlavorsAccessTestJSON-1189733697 tempest-FlavorsAccessTestJSON-1189733697-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dd4cced9bb340c2acbc954fab90fb70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb73614e1df94f129ac6079eb165eac3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:58.513203 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71bfd30-6c71-488c-895f-66997b5e357f tempest-FlavorsAccessTestJSON-1189733697 tempest-FlavorsAccessTestJSON-1189733697-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:58.513515 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71bfd30-6c71-488c-895f-66997b5e357f tempest-FlavorsAccessTestJSON-1189733697 tempest-FlavorsAccessTestJSON-1189733697-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:58.513818 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71bfd30-6c71-488c-895f-66997b5e357f tempest-FlavorsAccessTestJSON-1189733697 tempest-FlavorsAccessTestJSON-1189733697-project-admin] PATH_INFO: `/v3/projects/1ecabb816bab433d81c64af18cfdb59e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:58.520324 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c04f04-d3d6-4ad4-b39f-581c022c081c None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:58.520936 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71bfd30-6c71-488c-895f-66997b5e357f tempest-FlavorsAccessTestJSON-1189733697 tempest-FlavorsAccessTestJSON-1189733697-project-admin] RBAC: Authorizing `identity:get_project(project_id=1ecabb816bab433d81c64af18cfdb59e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:58.527739 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71bfd30-6c71-488c-895f-66997b5e357f tempest-FlavorsAccessTestJSON-1189733697 tempest-FlavorsAccessTestJSON-1189733697-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:58.527859 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b9b082-30af-4150-8cc1-d6d6cd1ee9aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:58.527859 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b9b082-30af-4150-8cc1-d6d6cd1ee9aa service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:58.527859 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b9b082-30af-4150-8cc1-d6d6cd1ee9aa service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:58.528111 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 896/1804] 10.222.0.52 () {58 vars in 1443 bytes} [Sat May 14 21:11:58 2022] GET /identity/v3/projects/1ecabb816bab433d81c64af18cfdb59e => generated 379 bytes in 463 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:11:58.528195 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b9b082-30af-4150-8cc1-d6d6cd1ee9aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:58.528273 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71bfd30-6c71-488c-895f-66997b5e357f tempest-FlavorsAccessTestJSON-1189733697 tempest-FlavorsAccessTestJSON-1189733697-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:58.538671 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-d71bfd30-6c71-488c-895f-66997b5e357f tempest-FlavorsAccessTestJSON-1189733697 tempest-FlavorsAccessTestJSON-1189733697-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:58.544023 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b9b082-30af-4150-8cc1-d6d6cd1ee9aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:58.545727 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b9b082-30af-4150-8cc1-d6d6cd1ee9aa service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:58.559971 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 909/1805] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:11:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:11:58.571420 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71bfd30-6c71-488c-895f-66997b5e357f tempest-FlavorsAccessTestJSON-1189733697 tempest-FlavorsAccessTestJSON-1189733697-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:58.586392 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60906f78-6f5d-4372-bf40-966ff9a71ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:58.587165 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60906f78-6f5d-4372-bf40-966ff9a71ce2 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:58.587378 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60906f78-6f5d-4372-bf40-966ff9a71ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:58.587699 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60906f78-6f5d-4372-bf40-966ff9a71ce2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:58.588521 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60906f78-6f5d-4372-bf40-966ff9a71ce2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:58.595265 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60906f78-6f5d-4372-bf40-966ff9a71ce2 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:58.635594 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b9b082-30af-4150-8cc1-d6d6cd1ee9aa service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:58.635835 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 897/1806] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:11:58 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:11:58.652029 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b9b082-30af-4150-8cc1-d6d6cd1ee9aa service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:58.658735 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60906f78-6f5d-4372-bf40-966ff9a71ce2 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:58.670589 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b5b9dd-3ce1-4428-81ae-768eaac7db74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:58.671281 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b5b9dd-3ce1-4428-81ae-768eaac7db74 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:58.671749 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b5b9dd-3ce1-4428-81ae-768eaac7db74 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:58.671876 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b5b9dd-3ce1-4428-81ae-768eaac7db74 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:58.672596 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b5b9dd-3ce1-4428-81ae-768eaac7db74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:58.674497 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b5b9dd-3ce1-4428-81ae-768eaac7db74 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:58.694711 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60906f78-6f5d-4372-bf40-966ff9a71ce2 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:58.708339 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 910/1807] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:11:58 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:11:58.713207 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b5b9dd-3ce1-4428-81ae-768eaac7db74 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:58.714076 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2846aea-b9b6-4d8c-aa2f-7eea5022a795 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:58.715810 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2846aea-b9b6-4d8c-aa2f-7eea5022a795 service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:58.716185 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2846aea-b9b6-4d8c-aa2f-7eea5022a795 service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:58.719310 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2846aea-b9b6-4d8c-aa2f-7eea5022a795 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:58.729275 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b5b9dd-3ce1-4428-81ae-768eaac7db74 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:58.735284 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2846aea-b9b6-4d8c-aa2f-7eea5022a795 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:58.738084 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2846aea-b9b6-4d8c-aa2f-7eea5022a795 service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:58.738776 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14df02c0-d75f-4f98-b577-0a131bb3249c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:58.739881 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df02c0-d75f-4f98-b577-0a131bb3249c admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:58.740993 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df02c0-d75f-4f98-b577-0a131bb3249c admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:58.741438 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df02c0-d75f-4f98-b577-0a131bb3249c admin admin] PATH_INFO: `/v3/projects/3e3f93a484a94d7cb554fb46301fdf31/users/e27742d098d44abd96ec0d362ef8ddb7/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:58.759911 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 898/1808] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:11:58 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:11:58.765054 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14df02c0-d75f-4f98-b577-0a131bb3249c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e3f93a484a94d7cb554fb46301fdf31, user_id=e27742d098d44abd96ec0d362ef8ddb7, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:58.769168 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14df02c0-d75f-4f98-b577-0a131bb3249c admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:58.870829 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 911/1809] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:11:58 2022] PUT /identity/v3/projects/3e3f93a484a94d7cb554fb46301fdf31/users/e27742d098d44abd96ec0d362ef8ddb7/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:11:58.881717 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225206c2-7063-4761-9441-fd4fbdac1a59 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:58.882489 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225206c2-7063-4761-9441-fd4fbdac1a59 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:58.882779 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225206c2-7063-4761-9441-fd4fbdac1a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:58.932948 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-225206c2-7063-4761-9441-fd4fbdac1a59 None None] MFA Rules not processed for user `e27742d098d44abd96ec0d362ef8ddb7`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:11:58.935107 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-225206c2-7063-4761-9441-fd4fbdac1a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:58.965600 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14df02c0-d75f-4f98-b577-0a131bb3249c admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:58.967721 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-14df02c0-d75f-4f98-b577-0a131bb3249c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:59.071702 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 899/1810] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:11:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:11:59.076094 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225206c2-7063-4761-9441-fd4fbdac1a59 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:59.117874 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14df02c0-d75f-4f98-b577-0a131bb3249c admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:59.137876 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e32ae1-1506-4f10-85b0-73224251ab0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:59.138790 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e32ae1-1506-4f10-85b0-73224251ab0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:59.139077 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e32ae1-1506-4f10-85b0-73224251ab0b admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:59.139354 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e32ae1-1506-4f10-85b0-73224251ab0b admin admin] PATH_INFO: `/v3/users/db3459023d74437a99e1efc32ab8f7dc` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:59.147287 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e32ae1-1506-4f10-85b0-73224251ab0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=db3459023d74437a99e1efc32ab8f7dc)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:59.147287 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e32ae1-1506-4f10-85b0-73224251ab0b admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:59.161925 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225206c2-7063-4761-9441-fd4fbdac1a59 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:59.169804 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c005c8d-1708-4e8b-a9f3-b74ac01a7cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:59.171356 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c005c8d-1708-4e8b-a9f3-b74ac01a7cea admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:59.171817 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c005c8d-1708-4e8b-a9f3-b74ac01a7cea admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:59.172201 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c005c8d-1708-4e8b-a9f3-b74ac01a7cea admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:59.174085 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c005c8d-1708-4e8b-a9f3-b74ac01a7cea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:59.176535 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c005c8d-1708-4e8b-a9f3-b74ac01a7cea admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:59.311837 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 900/1811] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:11:59 2022] POST /identity/v3/projects => generated 381 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:11:59.313329 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c005c8d-1708-4e8b-a9f3-b74ac01a7cea admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:59.420084 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-26e32ae1-1506-4f10-85b0-73224251ab0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db3459023d74437a99e1efc32ab8f7dc'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:59.433386 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c005c8d-1708-4e8b-a9f3-b74ac01a7cea admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:59.436013 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-26e32ae1-1506-4f10-85b0-73224251ab0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db3459023d74437a99e1efc32ab8f7dc'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:59.444434 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babfd8c1-6de1-4627-8a1f-3036a54e74a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:59.445135 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babfd8c1-6de1-4627-8a1f-3036a54e74a3 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:59.445554 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babfd8c1-6de1-4627-8a1f-3036a54e74a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:59.445845 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babfd8c1-6de1-4627-8a1f-3036a54e74a3 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:59.446248 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-26e32ae1-1506-4f10-85b0-73224251ab0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db3459023d74437a99e1efc32ab8f7dc'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:59.446610 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babfd8c1-6de1-4627-8a1f-3036a54e74a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:59.448598 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babfd8c1-6de1-4627-8a1f-3036a54e74a3 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:59.536453 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 901/1812] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:11:59 2022] POST /identity/v3/users => generated 297 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:11:59.537611 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-26e32ae1-1506-4f10-85b0-73224251ab0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db3459023d74437a99e1efc32ab8f7dc'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:59.537712 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babfd8c1-6de1-4627-8a1f-3036a54e74a3 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:59.538167 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-26e32ae1-1506-4f10-85b0-73224251ab0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db3459023d74437a99e1efc32ab8f7dc'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:59.547174 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-babfd8c1-6de1-4627-8a1f-3036a54e74a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:59.551566 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 912/1813] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:11:58 2022] DELETE /identity/v3/users/db3459023d74437a99e1efc32ab8f7dc => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:11:59.552571 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e32ae1-1506-4f10-85b0-73224251ab0b admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:59.556223 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-26e32ae1-1506-4f10-85b0-73224251ab0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:59.564744 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babfd8c1-6de1-4627-8a1f-3036a54e74a3 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:59.642410 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d93d3-88aa-4ea2-8eab-d1394d859756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:59.643663 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d93d3-88aa-4ea2-8eab-d1394d859756 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:59.643663 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d93d3-88aa-4ea2-8eab-d1394d859756 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:59.643881 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d93d3-88aa-4ea2-8eab-d1394d859756 admin admin] PATH_INFO: `/v3/users/7b9339334e3942c083c0736f16fc0411` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:59.645437 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40d93d3-88aa-4ea2-8eab-d1394d859756 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b9339334e3942c083c0736f16fc0411)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:59.646713 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e32ae1-1506-4f10-85b0-73224251ab0b admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:11:59.647401 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40d93d3-88aa-4ea2-8eab-d1394d859756 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:59.659736 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc62b8b4-aee5-4165-b3c0-9c8b75682590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:11:59.660732 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc62b8b4-aee5-4165-b3c0-9c8b75682590 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:11:59.661090 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc62b8b4-aee5-4165-b3c0-9c8b75682590 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:11:59.661439 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc62b8b4-aee5-4165-b3c0-9c8b75682590 admin admin] PATH_INFO: `/v3/projects/f12a80cd32a94245b549bdae3cf5d1f4` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:11:59.665790 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc62b8b4-aee5-4165-b3c0-9c8b75682590 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f12a80cd32a94245b549bdae3cf5d1f4)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:11:59.669235 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc62b8b4-aee5-4165-b3c0-9c8b75682590 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:11:59.801174 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a40d93d3-88aa-4ea2-8eab-d1394d859756 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b9339334e3942c083c0736f16fc0411'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:59.806491 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-dc62b8b4-aee5-4165-b3c0-9c8b75682590 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f12a80cd32a94245b549bdae3cf5d1f4', 'request_id': 'req-dc62b8b4-aee5-4165-b3c0-9c8b75682590'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:59.813063 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a40d93d3-88aa-4ea2-8eab-d1394d859756 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b9339334e3942c083c0736f16fc0411'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:59.813983 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-dc62b8b4-aee5-4165-b3c0-9c8b75682590 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f12a80cd32a94245b549bdae3cf5d1f4', 'request_id': 'req-dc62b8b4-aee5-4165-b3c0-9c8b75682590'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:59.817066 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a40d93d3-88aa-4ea2-8eab-d1394d859756 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b9339334e3942c083c0736f16fc0411'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:59.897572 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-dc62b8b4-aee5-4165-b3c0-9c8b75682590 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f12a80cd32a94245b549bdae3cf5d1f4', 'request_id': 'req-dc62b8b4-aee5-4165-b3c0-9c8b75682590'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:59.912058 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-dc62b8b4-aee5-4165-b3c0-9c8b75682590 admin admin] The token cache is being invalidate because project f12a80cd32a94245b549bdae3cf5d1f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:11:59.912353 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-dc62b8b4-aee5-4165-b3c0-9c8b75682590 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:59.914293 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-dc62b8b4-aee5-4165-b3c0-9c8b75682590 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:11:59.929339 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 913/1814] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:11:59 2022] DELETE /identity/v3/projects/f12a80cd32a94245b549bdae3cf5d1f4 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:11:59.930292 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc62b8b4-aee5-4165-b3c0-9c8b75682590 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:11:59.932782 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-dc62b8b4-aee5-4165-b3c0-9c8b75682590 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:11:59.973136 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a40d93d3-88aa-4ea2-8eab-d1394d859756 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b9339334e3942c083c0736f16fc0411'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:00.016545 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a40d93d3-88aa-4ea2-8eab-d1394d859756 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b9339334e3942c083c0736f16fc0411'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:00.025886 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 902/1815] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:11:59 2022] DELETE /identity/v3/users/7b9339334e3942c083c0736f16fc0411 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:00.027457 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190dfc97-10f1-472b-9f9e-4790c314b253 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:00.028115 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc62b8b4-aee5-4165-b3c0-9c8b75682590 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:00.029173 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190dfc97-10f1-472b-9f9e-4790c314b253 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:00.029630 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190dfc97-10f1-472b-9f9e-4790c314b253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:00.047153 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-190dfc97-10f1-472b-9f9e-4790c314b253 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:00.048506 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-190dfc97-10f1-472b-9f9e-4790c314b253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:00.101347 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e4a86-be83-42b6-b9f2-fa7b91039dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:00.102321 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e4a86-be83-42b6-b9f2-fa7b91039dba admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:00.102616 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e4a86-be83-42b6-b9f2-fa7b91039dba admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:00.103056 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e4a86-be83-42b6-b9f2-fa7b91039dba admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:00.104153 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781e4a86-be83-42b6-b9f2-fa7b91039dba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:00.106230 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781e4a86-be83-42b6-b9f2-fa7b91039dba admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:00.116820 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 903/1816] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:00.118136 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8bdd52-d080-4e3c-8417-b443622b0f8d None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:00.118430 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8bdd52-d080-4e3c-8417-b443622b0f8d None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:00.118712 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8bdd52-d080-4e3c-8417-b443622b0f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:00.121866 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 914/1817] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:11:59 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:12:00.121866 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e4a86-be83-42b6-b9f2-fa7b91039dba admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:00.122376 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-781e4a86-be83-42b6-b9f2-fa7b91039dba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:00.139124 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e4a86-be83-42b6-b9f2-fa7b91039dba admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:00.145450 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a7a654-845a-44e7-982c-3c5f1d074303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:00.146331 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a7a654-845a-44e7-982c-3c5f1d074303 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:00.146614 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a7a654-845a-44e7-982c-3c5f1d074303 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:00.146886 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a7a654-845a-44e7-982c-3c5f1d074303 admin admin] PATH_INFO: `/v3/users/bb8fa625718447cc8c72dc0ea4692e9b` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:00.148389 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a7a654-845a-44e7-982c-3c5f1d074303 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb8fa625718447cc8c72dc0ea4692e9b)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:00.150298 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a7a654-845a-44e7-982c-3c5f1d074303 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:00.159980 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-da8bdd52-d080-4e3c-8417-b443622b0f8d None None] MFA Rules not processed for user `3e7721c1487c423bbdba825f336234bb`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:00.161338 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-da8bdd52-d080-4e3c-8417-b443622b0f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:00.230253 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 904/1818] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:00 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:00.231402 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f13962c-3262-4057-96ec-c87b1d7b5e1a None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:00.231727 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f13962c-3262-4057-96ec-c87b1d7b5e1a None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:00.232029 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f13962c-3262-4057-96ec-c87b1d7b5e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:00.254614 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-0f13962c-3262-4057-96ec-c87b1d7b5e1a None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:00.256243 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-0f13962c-3262-4057-96ec-c87b1d7b5e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:00.265545 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 905/1819] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:00.266189 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f13962c-3262-4057-96ec-c87b1d7b5e1a None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:00.268214 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-0f13962c-3262-4057-96ec-c87b1d7b5e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:00.287315 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f13962c-3262-4057-96ec-c87b1d7b5e1a None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:00.292541 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cc4422-63c7-4c16-87d2-22e4de3c2dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:00.293608 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc4422-63c7-4c16-87d2-22e4de3c2dba admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:00.293739 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc4422-63c7-4c16-87d2-22e4de3c2dba admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:00.294003 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc4422-63c7-4c16-87d2-22e4de3c2dba admin admin] PATH_INFO: `/v3/projects/953fd8d466f64b23a52126135ab7e21b/users/d8319fc06ca9473783a3e2cb6ec94872/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:00.311796 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cc4422-63c7-4c16-87d2-22e4de3c2dba admin admin] RBAC: Authorizing `identity:create_grant(project_id=953fd8d466f64b23a52126135ab7e21b, user_id=d8319fc06ca9473783a3e2cb6ec94872, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:00.316211 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cc4422-63c7-4c16-87d2-22e4de3c2dba admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:00.349662 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-84a7a654-845a-44e7-982c-3c5f1d074303 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb8fa625718447cc8c72dc0ea4692e9b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:00.362852 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-84a7a654-845a-44e7-982c-3c5f1d074303 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb8fa625718447cc8c72dc0ea4692e9b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:00.370487 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-84a7a654-845a-44e7-982c-3c5f1d074303 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb8fa625718447cc8c72dc0ea4692e9b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:00.395432 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 906/1820] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:12:00 2022] PUT /identity/v3/projects/953fd8d466f64b23a52126135ab7e21b/users/d8319fc06ca9473783a3e2cb6ec94872/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:00.397334 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cc4422-63c7-4c16-87d2-22e4de3c2dba admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:00.401086 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-62cc4422-63c7-4c16-87d2-22e4de3c2dba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:00.438163 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-84a7a654-845a-44e7-982c-3c5f1d074303 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb8fa625718447cc8c72dc0ea4692e9b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:00.438916 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-84a7a654-845a-44e7-982c-3c5f1d074303 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb8fa625718447cc8c72dc0ea4692e9b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:00.445738 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 915/1821] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:12:00 2022] DELETE /identity/v3/users/bb8fa625718447cc8c72dc0ea4692e9b => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:00.446825 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a7a654-845a-44e7-982c-3c5f1d074303 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:00.449275 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-84a7a654-845a-44e7-982c-3c5f1d074303 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:00.481597 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cc4422-63c7-4c16-87d2-22e4de3c2dba admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:00.550434 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faed645-4fad-4530-af55-671bd5834432 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:00.551250 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faed645-4fad-4530-af55-671bd5834432 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:00.551683 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faed645-4fad-4530-af55-671bd5834432 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:00.552233 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faed645-4fad-4530-af55-671bd5834432 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:00.556094 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8faed645-4fad-4530-af55-671bd5834432 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:00.558425 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a7a654-845a-44e7-982c-3c5f1d074303 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:00.570154 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a3dd25-20ac-4de3-8bfb-e61f8dd6caae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:00.571314 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3dd25-20ac-4de3-8bfb-e61f8dd6caae service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:00.571444 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3dd25-20ac-4de3-8bfb-e61f8dd6caae service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:00.571753 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3dd25-20ac-4de3-8bfb-e61f8dd6caae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:00.574259 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-29a3dd25-20ac-4de3-8bfb-e61f8dd6caae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:00.634681 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faed645-4fad-4530-af55-671bd5834432 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:00.636181 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faed645-4fad-4530-af55-671bd5834432 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:00.649590 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a3dd25-20ac-4de3-8bfb-e61f8dd6caae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:00.651696 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a3dd25-20ac-4de3-8bfb-e61f8dd6caae service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:00.663958 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 907/1822] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:12:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:12:00.665177 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 916/1823] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:12:00 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:12:00.666183 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a3dd25-20ac-4de3-8bfb-e61f8dd6caae service nova] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:00.667718 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-29a3dd25-20ac-4de3-8bfb-e61f8dd6caae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:00.673416 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faed645-4fad-4530-af55-671bd5834432 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:00.675359 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8faed645-4fad-4530-af55-671bd5834432 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:00.685015 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a3dd25-20ac-4de3-8bfb-e61f8dd6caae service nova] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:00.687095 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faed645-4fad-4530-af55-671bd5834432 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:00.691815 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b143d1e4-ba39-45e6-b336-f23a52afec86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:00.692093 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf97876-c901-48d9-bac0-172c6778eac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:00.692905 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b143d1e4-ba39-45e6-b336-f23a52afec86 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:00.693022 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b143d1e4-ba39-45e6-b336-f23a52afec86 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:00.693465 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b143d1e4-ba39-45e6-b336-f23a52afec86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:00.694547 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf97876-c901-48d9-bac0-172c6778eac2 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:00.694980 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf97876-c901-48d9-bac0-172c6778eac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:00.695412 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf97876-c901-48d9-bac0-172c6778eac2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:00.695991 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b143d1e4-ba39-45e6-b336-f23a52afec86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:00.696559 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf97876-c901-48d9-bac0-172c6778eac2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:00.700241 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf97876-c901-48d9-bac0-172c6778eac2 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:00.718203 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 917/1824] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:12:00 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:12:00.720330 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf97876-c901-48d9-bac0-172c6778eac2 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:00.724165 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-2bf97876-c901-48d9-bac0-172c6778eac2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:00.724484 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b143d1e4-ba39-45e6-b336-f23a52afec86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:00.726123 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b143d1e4-ba39-45e6-b336-f23a52afec86 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:00.738947 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 908/1825] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:12:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:12:00.740559 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b143d1e4-ba39-45e6-b336-f23a52afec86 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:00.747201 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf97876-c901-48d9-bac0-172c6778eac2 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:00.751734 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b143d1e4-ba39-45e6-b336-f23a52afec86 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:00.755072 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed2f48a-4958-4db1-9ad5-60d6ef877797 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:00.756744 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2f48a-4958-4db1-9ad5-60d6ef877797 service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:00.757307 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2f48a-4958-4db1-9ad5-60d6ef877797 service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:00.757731 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2f48a-4958-4db1-9ad5-60d6ef877797 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:00.758380 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bfa26d-af6e-4bd3-879f-db6c3abc3309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:00.759378 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bfa26d-af6e-4bd3-879f-db6c3abc3309 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:00.759804 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bfa26d-af6e-4bd3-879f-db6c3abc3309 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:00.760201 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bfa26d-af6e-4bd3-879f-db6c3abc3309 admin admin] PATH_INFO: `/v3/projects/953fd8d466f64b23a52126135ab7e21b/users/d8319fc06ca9473783a3e2cb6ec94872/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:00.760588 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-4ed2f48a-4958-4db1-9ad5-60d6ef877797 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:00.762598 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bfa26d-af6e-4bd3-879f-db6c3abc3309 admin admin] RBAC: Authorizing `identity:create_grant(project_id=953fd8d466f64b23a52126135ab7e21b, user_id=d8319fc06ca9473783a3e2cb6ec94872, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:00.765402 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bfa26d-af6e-4bd3-879f-db6c3abc3309 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:00.779734 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 909/1826] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:12:00 2022] PUT /identity/v3/projects/953fd8d466f64b23a52126135ab7e21b/users/d8319fc06ca9473783a3e2cb6ec94872/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:00.791681 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1a4976-e5e6-46fb-be9b-ab959adb58b7 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:00.792718 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1a4976-e5e6-46fb-be9b-ab959adb58b7 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:00.793314 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1a4976-e5e6-46fb-be9b-ab959adb58b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:00.830912 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-ac1a4976-e5e6-46fb-be9b-ab959adb58b7 None None] MFA Rules not processed for user `d8319fc06ca9473783a3e2cb6ec94872`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:00.832991 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-ac1a4976-e5e6-46fb-be9b-ab959adb58b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:00.894353 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed2f48a-4958-4db1-9ad5-60d6ef877797 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:00.898846 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed2f48a-4958-4db1-9ad5-60d6ef877797 service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:00.930242 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 918/1827] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:12:00 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:12:00.955377 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 910/1828] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:00 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:00.970653 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed2f48a-4958-4db1-9ad5-60d6ef877797 service nova] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:00.984795 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed2f48a-4958-4db1-9ad5-60d6ef877797 service nova] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:01.027905 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1a4976-e5e6-46fb-be9b-ab959adb58b7 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:01.027905 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-ac1a4976-e5e6-46fb-be9b-ab959adb58b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:01.118288 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d4a88-7198-4158-b668-5b0b1c913d39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:01.118955 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d4a88-7198-4158-b668-5b0b1c913d39 service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:01.119394 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d4a88-7198-4158-b668-5b0b1c913d39 service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:01.119832 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d4a88-7198-4158-b668-5b0b1c913d39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:01.137818 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149d4a88-7198-4158-b668-5b0b1c913d39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:01.141393 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149d4a88-7198-4158-b668-5b0b1c913d39 service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:01.165478 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 919/1829] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:12:00 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:12:01.168719 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1a4976-e5e6-46fb-be9b-ab959adb58b7 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:01.186139 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ae9680-2c7d-489c-99f3-2dbd37d838c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:01.187024 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae9680-2c7d-489c-99f3-2dbd37d838c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:01.187308 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae9680-2c7d-489c-99f3-2dbd37d838c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:01.187788 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae9680-2c7d-489c-99f3-2dbd37d838c3 admin admin] PATH_INFO: `/v3/projects/04bdefd9ae534ef98ba0ee5d2adbe13e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:01.190579 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ae9680-2c7d-489c-99f3-2dbd37d838c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04bdefd9ae534ef98ba0ee5d2adbe13e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:01.192554 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ae9680-2c7d-489c-99f3-2dbd37d838c3 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:01.317561 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d4a88-7198-4158-b668-5b0b1c913d39 service nova] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:01.323253 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d4a88-7198-4158-b668-5b0b1c913d39 service nova] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:01.329311 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7668fd-f77f-4175-bdc2-edc085acce75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:01.330518 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7668fd-f77f-4175-bdc2-edc085acce75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:01.331121 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7668fd-f77f-4175-bdc2-edc085acce75 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:01.331577 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7668fd-f77f-4175-bdc2-edc085acce75 admin admin] PATH_INFO: `/v3/users/e27742d098d44abd96ec0d362ef8ddb7` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:01.333379 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7668fd-f77f-4175-bdc2-edc085acce75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e27742d098d44abd96ec0d362ef8ddb7)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:01.340505 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7668fd-f77f-4175-bdc2-edc085acce75 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:01.355438 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-56ae9680-2c7d-489c-99f3-2dbd37d838c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04bdefd9ae534ef98ba0ee5d2adbe13e', 'request_id': 'req-56ae9680-2c7d-489c-99f3-2dbd37d838c3'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:01.362518 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-56ae9680-2c7d-489c-99f3-2dbd37d838c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04bdefd9ae534ef98ba0ee5d2adbe13e', 'request_id': 'req-56ae9680-2c7d-489c-99f3-2dbd37d838c3'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:01.372826 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-56ae9680-2c7d-489c-99f3-2dbd37d838c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04bdefd9ae534ef98ba0ee5d2adbe13e', 'request_id': 'req-56ae9680-2c7d-489c-99f3-2dbd37d838c3'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:01.454864 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-56ae9680-2c7d-489c-99f3-2dbd37d838c3 admin admin] The token cache is being invalidate because project 04bdefd9ae534ef98ba0ee5d2adbe13e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:12:01.455226 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-56ae9680-2c7d-489c-99f3-2dbd37d838c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:01.455999 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-56ae9680-2c7d-489c-99f3-2dbd37d838c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:01.458130 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 911/1830] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:12:01 2022] DELETE /identity/v3/projects/04bdefd9ae534ef98ba0ee5d2adbe13e => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:12:01.462780 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ae9680-2c7d-489c-99f3-2dbd37d838c3 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:01.467200 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-56ae9680-2c7d-489c-99f3-2dbd37d838c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:01.528426 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2d7668fd-f77f-4175-bdc2-edc085acce75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e27742d098d44abd96ec0d362ef8ddb7'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:01.558513 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2d7668fd-f77f-4175-bdc2-edc085acce75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e27742d098d44abd96ec0d362ef8ddb7'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:01.574737 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2d7668fd-f77f-4175-bdc2-edc085acce75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e27742d098d44abd96ec0d362ef8ddb7'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:01.623418 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ae9680-2c7d-489c-99f3-2dbd37d838c3 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:01.632283 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d5db82-6bff-410b-911d-879caabc14c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:01.633419 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d5db82-6bff-410b-911d-879caabc14c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:01.633708 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d5db82-6bff-410b-911d-879caabc14c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:01.633998 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d5db82-6bff-410b-911d-879caabc14c4 admin admin] PATH_INFO: `/v3/projects/3650527b8cd44dc782856a3cc8233d04` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:01.635529 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d5db82-6bff-410b-911d-879caabc14c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3650527b8cd44dc782856a3cc8233d04)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:01.638207 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d5db82-6bff-410b-911d-879caabc14c4 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:01.673491 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2d7668fd-f77f-4175-bdc2-edc085acce75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e27742d098d44abd96ec0d362ef8ddb7'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:01.674186 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2d7668fd-f77f-4175-bdc2-edc085acce75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e27742d098d44abd96ec0d362ef8ddb7'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:01.684446 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 920/1831] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:12:01 2022] DELETE /identity/v3/users/e27742d098d44abd96ec0d362ef8ddb7 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:01.685373 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7668fd-f77f-4175-bdc2-edc085acce75 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:01.686841 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-2d7668fd-f77f-4175-bdc2-edc085acce75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:01.767348 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7668fd-f77f-4175-bdc2-edc085acce75 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:01.780892 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d3d5db82-6bff-410b-911d-879caabc14c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3650527b8cd44dc782856a3cc8233d04', 'request_id': 'req-d3d5db82-6bff-410b-911d-879caabc14c4'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:01.787493 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d3d5db82-6bff-410b-911d-879caabc14c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3650527b8cd44dc782856a3cc8233d04', 'request_id': 'req-d3d5db82-6bff-410b-911d-879caabc14c4'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:01.794207 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d3d5db82-6bff-410b-911d-879caabc14c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3650527b8cd44dc782856a3cc8233d04', 'request_id': 'req-d3d5db82-6bff-410b-911d-879caabc14c4'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:01.876426 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2267ed-c0f6-447c-b3ec-9671131fb1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:01.877417 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2267ed-c0f6-447c-b3ec-9671131fb1e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:01.877707 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2267ed-c0f6-447c-b3ec-9671131fb1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:01.878131 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2267ed-c0f6-447c-b3ec-9671131fb1e5 admin admin] PATH_INFO: `/v3/projects/1ecabb816bab433d81c64af18cfdb59e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:01.879469 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2267ed-c0f6-447c-b3ec-9671131fb1e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ecabb816bab433d81c64af18cfdb59e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:01.882130 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2267ed-c0f6-447c-b3ec-9671131fb1e5 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:01.952313 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d3d5db82-6bff-410b-911d-879caabc14c4 admin admin] The token cache is being invalidate because project 3650527b8cd44dc782856a3cc8233d04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:12:01.953232 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d3d5db82-6bff-410b-911d-879caabc14c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:01.955407 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d3d5db82-6bff-410b-911d-879caabc14c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:01.960938 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 912/1832] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:12:01 2022] DELETE /identity/v3/projects/3650527b8cd44dc782856a3cc8233d04 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:01.962693 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f744b2-180c-42ca-bfc7-d93304122c24 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:01.963176 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f744b2-180c-42ca-bfc7-d93304122c24 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:01.963665 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f744b2-180c-42ca-bfc7-d93304122c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:01.995616 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-65f744b2-180c-42ca-bfc7-d93304122c24 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:01.997213 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-65f744b2-180c-42ca-bfc7-d93304122c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:02.009868 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 913/1833] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:02.011815 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d55a426-4a44-4032-bacb-d9431dd5a8a4 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:02.012217 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d55a426-4a44-4032-bacb-d9431dd5a8a4 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:02.012632 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d55a426-4a44-4032-bacb-d9431dd5a8a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:02.034814 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-9d55a426-4a44-4032-bacb-d9431dd5a8a4 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:02.036480 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-9d55a426-4a44-4032-bacb-d9431dd5a8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:02.046015 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 914/1834] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:02.047296 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d55a426-4a44-4032-bacb-d9431dd5a8a4 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:02.052525 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-9d55a426-4a44-4032-bacb-d9431dd5a8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:02.067557 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d55a426-4a44-4032-bacb-d9431dd5a8a4 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:02.072478 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de408a4-69f8-4506-9ade-c8ccc3c427a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:02.073356 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de408a4-69f8-4506-9ade-c8ccc3c427a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:02.073640 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de408a4-69f8-4506-9ade-c8ccc3c427a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:02.073912 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de408a4-69f8-4506-9ade-c8ccc3c427a9 admin admin] PATH_INFO: `/v3/users/a995f01d2d1f420499eb36485617cc76` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:02.075161 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de408a4-69f8-4506-9ade-c8ccc3c427a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a995f01d2d1f420499eb36485617cc76)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:02.080610 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de408a4-69f8-4506-9ade-c8ccc3c427a9 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:02.109905 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8b2267ed-c0f6-447c-b3ec-9671131fb1e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ecabb816bab433d81c64af18cfdb59e', 'request_id': 'req-8b2267ed-c0f6-447c-b3ec-9671131fb1e5'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:02.118498 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8b2267ed-c0f6-447c-b3ec-9671131fb1e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ecabb816bab433d81c64af18cfdb59e', 'request_id': 'req-8b2267ed-c0f6-447c-b3ec-9671131fb1e5'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:02.219720 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8b2267ed-c0f6-447c-b3ec-9671131fb1e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ecabb816bab433d81c64af18cfdb59e', 'request_id': 'req-8b2267ed-c0f6-447c-b3ec-9671131fb1e5'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:02.234135 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8b2267ed-c0f6-447c-b3ec-9671131fb1e5 admin admin] The token cache is being invalidate because project 1ecabb816bab433d81c64af18cfdb59e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:12:02.234684 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8b2267ed-c0f6-447c-b3ec-9671131fb1e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:02.235514 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8b2267ed-c0f6-447c-b3ec-9671131fb1e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:02.240193 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 921/1835] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:12:01 2022] DELETE /identity/v3/projects/1ecabb816bab433d81c64af18cfdb59e => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:02.240193 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb2d39-0e72-46c4-ade8-5d421b080542 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:02.240193 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb2d39-0e72-46c4-ade8-5d421b080542 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:02.240193 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb2d39-0e72-46c4-ade8-5d421b080542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:02.260610 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-eacb2d39-0e72-46c4-ade8-5d421b080542 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:02.262394 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-eacb2d39-0e72-46c4-ade8-5d421b080542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:02.300862 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-6de408a4-69f8-4506-9ade-c8ccc3c427a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a995f01d2d1f420499eb36485617cc76'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:02.310812 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-6de408a4-69f8-4506-9ade-c8ccc3c427a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a995f01d2d1f420499eb36485617cc76'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:02.311865 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-6de408a4-69f8-4506-9ade-c8ccc3c427a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a995f01d2d1f420499eb36485617cc76'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:02.337035 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 922/1836] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:02.340798 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacb2d39-0e72-46c4-ade8-5d421b080542 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:02.342647 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-eacb2d39-0e72-46c4-ade8-5d421b080542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:02.398672 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-6de408a4-69f8-4506-9ade-c8ccc3c427a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a995f01d2d1f420499eb36485617cc76'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:02.435689 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacb2d39-0e72-46c4-ade8-5d421b080542 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:02.441109 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-6de408a4-69f8-4506-9ade-c8ccc3c427a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a995f01d2d1f420499eb36485617cc76'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:02.441690 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb232ed2-0ca2-41e0-a921-9462a3e3d052 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:02.442607 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb232ed2-0ca2-41e0-a921-9462a3e3d052 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:02.442992 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb232ed2-0ca2-41e0-a921-9462a3e3d052 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:02.443568 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb232ed2-0ca2-41e0-a921-9462a3e3d052 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:02.446551 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-cb232ed2-0ca2-41e0-a921-9462a3e3d052 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:02.453345 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 915/1837] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:12:02 2022] DELETE /identity/v3/users/a995f01d2d1f420499eb36485617cc76 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:02.456098 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de408a4-69f8-4506-9ade-c8ccc3c427a9 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:02.459069 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-6de408a4-69f8-4506-9ade-c8ccc3c427a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:02.480450 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb232ed2-0ca2-41e0-a921-9462a3e3d052 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:02.483095 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb232ed2-0ca2-41e0-a921-9462a3e3d052 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:02.499062 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 923/1838] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:12:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:12:02.500723 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb232ed2-0ca2-41e0-a921-9462a3e3d052 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:02.502463 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-cb232ed2-0ca2-41e0-a921-9462a3e3d052 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:02.519866 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb232ed2-0ca2-41e0-a921-9462a3e3d052 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:02.623277 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de408a4-69f8-4506-9ade-c8ccc3c427a9 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:02.629924 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8544a43-c1c6-45d9-a5a2-b37b066b711e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:02.630547 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8544a43-c1c6-45d9-a5a2-b37b066b711e admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:02.631190 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8544a43-c1c6-45d9-a5a2-b37b066b711e admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:02.631347 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8544a43-c1c6-45d9-a5a2-b37b066b711e admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:02.632098 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8544a43-c1c6-45d9-a5a2-b37b066b711e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:12:02.632380 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8544a43-c1c6-45d9-a5a2-b37b066b711e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:02.633966 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8544a43-c1c6-45d9-a5a2-b37b066b711e admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:02.637696 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a82cf5a-9fe0-4655-97d6-b65570232e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:02.639204 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a82cf5a-9fe0-4655-97d6-b65570232e51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:02.639448 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a82cf5a-9fe0-4655-97d6-b65570232e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:02.639749 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a82cf5a-9fe0-4655-97d6-b65570232e51 admin admin] PATH_INFO: `/v3/users/9dd4cced9bb340c2acbc954fab90fb70` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:02.643898 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a82cf5a-9fe0-4655-97d6-b65570232e51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dd4cced9bb340c2acbc954fab90fb70)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:02.644308 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a82cf5a-9fe0-4655-97d6-b65570232e51 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:02.687523 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 924/1839] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:12:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:12:02.692151 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8544a43-c1c6-45d9-a5a2-b37b066b711e admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:02.713504 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8544a43-c1c6-45d9-a5a2-b37b066b711e admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:02.737242 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74528674-78de-4ed3-a6cf-61072a02f98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:02.737242 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74528674-78de-4ed3-a6cf-61072a02f98f admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:02.737514 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74528674-78de-4ed3-a6cf-61072a02f98f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:02.737605 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74528674-78de-4ed3-a6cf-61072a02f98f admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:02.738254 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74528674-78de-4ed3-a6cf-61072a02f98f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:02.741401 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74528674-78de-4ed3-a6cf-61072a02f98f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:02.883159 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 925/1840] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:12:02 2022] POST /identity/v3/projects => generated 377 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:12:02.889256 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74528674-78de-4ed3-a6cf-61072a02f98f admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:02.956621 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3a82cf5a-9fe0-4655-97d6-b65570232e51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dd4cced9bb340c2acbc954fab90fb70'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:02.969224 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3a82cf5a-9fe0-4655-97d6-b65570232e51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dd4cced9bb340c2acbc954fab90fb70'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:02.970805 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3a82cf5a-9fe0-4655-97d6-b65570232e51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dd4cced9bb340c2acbc954fab90fb70'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:02.998868 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74528674-78de-4ed3-a6cf-61072a02f98f admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:03.007628 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb16f441-5477-4746-8abc-a5a16e2f4557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:03.011628 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16f441-5477-4746-8abc-a5a16e2f4557 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:03.011628 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16f441-5477-4746-8abc-a5a16e2f4557 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:03.011628 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16f441-5477-4746-8abc-a5a16e2f4557 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:03.011628 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb16f441-5477-4746-8abc-a5a16e2f4557 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:03.017495 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb16f441-5477-4746-8abc-a5a16e2f4557 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:03.130475 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3a82cf5a-9fe0-4655-97d6-b65570232e51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dd4cced9bb340c2acbc954fab90fb70'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:03.143663 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 926/1841] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:12:02 2022] POST /identity/v3/users => generated 289 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:12:03.147554 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb16f441-5477-4746-8abc-a5a16e2f4557 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:03.160154 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3a82cf5a-9fe0-4655-97d6-b65570232e51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dd4cced9bb340c2acbc954fab90fb70'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:03.160807 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb16f441-5477-4746-8abc-a5a16e2f4557 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:03.167226 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 916/1842] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:12:02 2022] DELETE /identity/v3/users/9dd4cced9bb340c2acbc954fab90fb70 => generated 0 bytes in 713 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:03.168113 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a82cf5a-9fe0-4655-97d6-b65570232e51 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:03.169725 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-3a82cf5a-9fe0-4655-97d6-b65570232e51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:03.187814 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbf80dd-e3d9-4fef-ae90-bec51dae7f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:03.188939 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf80dd-e3d9-4fef-ae90-bec51dae7f7a admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:03.189409 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf80dd-e3d9-4fef-ae90-bec51dae7f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:03.189866 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf80dd-e3d9-4fef-ae90-bec51dae7f7a admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:03.190886 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbf80dd-e3d9-4fef-ae90-bec51dae7f7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:03.192728 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbf80dd-e3d9-4fef-ae90-bec51dae7f7a admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:03.218228 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 927/1843] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:12:03 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:12:03.219235 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbf80dd-e3d9-4fef-ae90-bec51dae7f7a admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:03.228433 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-3bbf80dd-e3d9-4fef-ae90-bec51dae7f7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:03.257128 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbf80dd-e3d9-4fef-ae90-bec51dae7f7a admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:03.309998 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a82cf5a-9fe0-4655-97d6-b65570232e51 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:03.317897 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c42fcb-331b-46cf-8417-a923d07627d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:03.319332 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c42fcb-331b-46cf-8417-a923d07627d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:03.319658 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c42fcb-331b-46cf-8417-a923d07627d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:03.320096 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c42fcb-331b-46cf-8417-a923d07627d9 admin admin] PATH_INFO: `/v3/projects/65ae5f6e23724538a104b1c21557fe35` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:03.322159 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c42fcb-331b-46cf-8417-a923d07627d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65ae5f6e23724538a104b1c21557fe35)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:03.325465 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c42fcb-331b-46cf-8417-a923d07627d9 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:03.349735 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5479d47-c567-49b4-974c-6b257a4412bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:03.350472 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5479d47-c567-49b4-974c-6b257a4412bb admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:03.350761 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5479d47-c567-49b4-974c-6b257a4412bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:03.351039 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5479d47-c567-49b4-974c-6b257a4412bb admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:03.351861 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5479d47-c567-49b4-974c-6b257a4412bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:03.353808 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5479d47-c567-49b4-974c-6b257a4412bb admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:03.374432 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 928/1844] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:12:03 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:12:03.379443 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5479d47-c567-49b4-974c-6b257a4412bb admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:03.391345 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5479d47-c567-49b4-974c-6b257a4412bb admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:03.397884 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17d6291-a490-4064-9c36-8d9d2032b27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:03.398806 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d6291-a490-4064-9c36-8d9d2032b27c admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:03.399085 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d6291-a490-4064-9c36-8d9d2032b27c admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:03.399443 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d6291-a490-4064-9c36-8d9d2032b27c admin admin] PATH_INFO: `/v3/projects/b51bea6b4a6f4aefb2dc04177e103f22/users/72b3ed0768f3432eb4ee966a72f28615/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:03.422339 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17d6291-a490-4064-9c36-8d9d2032b27c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b51bea6b4a6f4aefb2dc04177e103f22, user_id=72b3ed0768f3432eb4ee966a72f28615, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:03.425922 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17d6291-a490-4064-9c36-8d9d2032b27c admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:03.507571 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 929/1845] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:12:03 2022] PUT /identity/v3/projects/b51bea6b4a6f4aefb2dc04177e103f22/users/72b3ed0768f3432eb4ee966a72f28615/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:03.514703 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b6527-3b83-4046-bdf0-3437eea982d6 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:03.514890 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b6527-3b83-4046-bdf0-3437eea982d6 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:03.515172 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b6527-3b83-4046-bdf0-3437eea982d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:03.532645 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-64c42fcb-331b-46cf-8417-a923d07627d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65ae5f6e23724538a104b1c21557fe35', 'request_id': 'req-64c42fcb-331b-46cf-8417-a923d07627d9'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:03.543571 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-64c42fcb-331b-46cf-8417-a923d07627d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65ae5f6e23724538a104b1c21557fe35', 'request_id': 'req-64c42fcb-331b-46cf-8417-a923d07627d9'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:03.552461 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-64c42fcb-331b-46cf-8417-a923d07627d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65ae5f6e23724538a104b1c21557fe35', 'request_id': 'req-64c42fcb-331b-46cf-8417-a923d07627d9'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:03.566841 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-d63b6527-3b83-4046-bdf0-3437eea982d6 None None] MFA Rules not processed for user `72b3ed0768f3432eb4ee966a72f28615`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:03.568655 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d63b6527-3b83-4046-bdf0-3437eea982d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:03.623504 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-64c42fcb-331b-46cf-8417-a923d07627d9 admin admin] The token cache is being invalidate because project 65ae5f6e23724538a104b1c21557fe35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:12:03.624583 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-64c42fcb-331b-46cf-8417-a923d07627d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:03.625803 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-64c42fcb-331b-46cf-8417-a923d07627d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:03.627865 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 917/1846] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:12:03 2022] DELETE /identity/v3/projects/65ae5f6e23724538a104b1c21557fe35 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:03.633154 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c03699-533d-4328-9a0d-3896bdd2fd0d None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:03.633875 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c03699-533d-4328-9a0d-3896bdd2fd0d None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:03.634311 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c03699-533d-4328-9a0d-3896bdd2fd0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:03.667412 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-d8c03699-533d-4328-9a0d-3896bdd2fd0d None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:03.669101 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-d8c03699-533d-4328-9a0d-3896bdd2fd0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:03.702845 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 930/1847] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:03.707869 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63b6527-3b83-4046-bdf0-3437eea982d6 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:03.710333 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d63b6527-3b83-4046-bdf0-3437eea982d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:03.796096 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 918/1848] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:12:03.797421 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c03699-533d-4328-9a0d-3896bdd2fd0d None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:03.799155 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-d8c03699-533d-4328-9a0d-3896bdd2fd0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:03.811767 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c03699-533d-4328-9a0d-3896bdd2fd0d None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:03.818279 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580d6faa-9545-4b80-b4dd-5a4fe450867f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:03.819318 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d6faa-9545-4b80-b4dd-5a4fe450867f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:03.819740 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d6faa-9545-4b80-b4dd-5a4fe450867f admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:03.820117 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d6faa-9545-4b80-b4dd-5a4fe450867f admin admin] PATH_INFO: `/v3/projects/3e3f93a484a94d7cb554fb46301fdf31` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:03.822031 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580d6faa-9545-4b80-b4dd-5a4fe450867f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e3f93a484a94d7cb554fb46301fdf31)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:03.824183 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580d6faa-9545-4b80-b4dd-5a4fe450867f admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:03.896164 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63b6527-3b83-4046-bdf0-3437eea982d6 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:03.901296 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03842fca-7cbe-414c-8a3a-5928aa42df13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:03.902077 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03842fca-7cbe-414c-8a3a-5928aa42df13 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:03.906439 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03842fca-7cbe-414c-8a3a-5928aa42df13 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:03.906439 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03842fca-7cbe-414c-8a3a-5928aa42df13 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:03.906439 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03842fca-7cbe-414c-8a3a-5928aa42df13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:03.906439 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03842fca-7cbe-414c-8a3a-5928aa42df13 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:03.993073 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-580d6faa-9545-4b80-b4dd-5a4fe450867f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e3f93a484a94d7cb554fb46301fdf31', 'request_id': 'req-580d6faa-9545-4b80-b4dd-5a4fe450867f'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:04.002939 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-580d6faa-9545-4b80-b4dd-5a4fe450867f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e3f93a484a94d7cb554fb46301fdf31', 'request_id': 'req-580d6faa-9545-4b80-b4dd-5a4fe450867f'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:04.024398 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-580d6faa-9545-4b80-b4dd-5a4fe450867f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e3f93a484a94d7cb554fb46301fdf31', 'request_id': 'req-580d6faa-9545-4b80-b4dd-5a4fe450867f'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:04.070474 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 931/1849] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:12:03 2022] POST /identity/v3/projects => generated 377 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:12:04.072237 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03842fca-7cbe-414c-8a3a-5928aa42df13 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:04.074356 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-03842fca-7cbe-414c-8a3a-5928aa42df13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:04.130622 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-580d6faa-9545-4b80-b4dd-5a4fe450867f admin admin] The token cache is being invalidate because project 3e3f93a484a94d7cb554fb46301fdf31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:12:04.131449 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-580d6faa-9545-4b80-b4dd-5a4fe450867f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:04.132452 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-580d6faa-9545-4b80-b4dd-5a4fe450867f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:04.134543 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 919/1850] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:12:03 2022] DELETE /identity/v3/projects/3e3f93a484a94d7cb554fb46301fdf31 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:04.140355 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80472fbc-2497-4256-a739-3c2b962fe977 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:04.145408 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80472fbc-2497-4256-a739-3c2b962fe977 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:04.145408 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80472fbc-2497-4256-a739-3c2b962fe977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:04.164888 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03842fca-7cbe-414c-8a3a-5928aa42df13 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:04.170964 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005ad805-6fd5-4d4b-82d6-d8b8cf1e55e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:04.171779 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-80472fbc-2497-4256-a739-3c2b962fe977 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:04.173565 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ad805-6fd5-4d4b-82d6-d8b8cf1e55e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:04.173984 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-80472fbc-2497-4256-a739-3c2b962fe977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:04.174280 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ad805-6fd5-4d4b-82d6-d8b8cf1e55e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:04.174885 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ad805-6fd5-4d4b-82d6-d8b8cf1e55e0 admin admin] PATH_INFO: `/v3/projects/bb73614e1df94f129ac6079eb165eac3` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:04.176892 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005ad805-6fd5-4d4b-82d6-d8b8cf1e55e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb73614e1df94f129ac6079eb165eac3)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:04.179334 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005ad805-6fd5-4d4b-82d6-d8b8cf1e55e0 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:04.192852 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 920/1851] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:04.193975 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80472fbc-2497-4256-a739-3c2b962fe977 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:04.195661 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-80472fbc-2497-4256-a739-3c2b962fe977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:04.209250 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80472fbc-2497-4256-a739-3c2b962fe977 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:04.222722 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a8f1d-4ccd-41ad-a72e-2186743ded00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:04.223618 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a8f1d-4ccd-41ad-a72e-2186743ded00 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:04.223908 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a8f1d-4ccd-41ad-a72e-2186743ded00 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:04.224239 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a8f1d-4ccd-41ad-a72e-2186743ded00 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:04.227043 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29a8f1d-4ccd-41ad-a72e-2186743ded00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:04.227534 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29a8f1d-4ccd-41ad-a72e-2186743ded00 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:04.300686 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 921/1852] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:12:04 2022] POST /identity/v3/users => generated 295 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:12:04.301719 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a8f1d-4ccd-41ad-a72e-2186743ded00 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:04.304246 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e29a8f1d-4ccd-41ad-a72e-2186743ded00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:04.316369 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-005ad805-6fd5-4d4b-82d6-d8b8cf1e55e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb73614e1df94f129ac6079eb165eac3', 'request_id': 'req-005ad805-6fd5-4d4b-82d6-d8b8cf1e55e0'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:04.317823 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a8f1d-4ccd-41ad-a72e-2186743ded00 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:04.324946 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-005ad805-6fd5-4d4b-82d6-d8b8cf1e55e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb73614e1df94f129ac6079eb165eac3', 'request_id': 'req-005ad805-6fd5-4d4b-82d6-d8b8cf1e55e0'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:04.383074 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d1103f-f544-4887-bdda-939c3d308e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:04.384143 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d1103f-f544-4887-bdda-939c3d308e40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:04.384524 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d1103f-f544-4887-bdda-939c3d308e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:04.384924 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d1103f-f544-4887-bdda-939c3d308e40 admin admin] PATH_INFO: `/v3/users/d8319fc06ca9473783a3e2cb6ec94872` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:04.386349 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d1103f-f544-4887-bdda-939c3d308e40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8319fc06ca9473783a3e2cb6ec94872)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:04.387160 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-005ad805-6fd5-4d4b-82d6-d8b8cf1e55e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb73614e1df94f129ac6079eb165eac3', 'request_id': 'req-005ad805-6fd5-4d4b-82d6-d8b8cf1e55e0'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:04.388494 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d1103f-f544-4887-bdda-939c3d308e40 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:04.415541 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-005ad805-6fd5-4d4b-82d6-d8b8cf1e55e0 admin admin] The token cache is being invalidate because project bb73614e1df94f129ac6079eb165eac3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:12:04.415541 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-005ad805-6fd5-4d4b-82d6-d8b8cf1e55e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:04.416196 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-005ad805-6fd5-4d4b-82d6-d8b8cf1e55e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:04.417818 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 932/1853] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:12:04 2022] DELETE /identity/v3/projects/bb73614e1df94f129ac6079eb165eac3 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:04.418588 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005ad805-6fd5-4d4b-82d6-d8b8cf1e55e0 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:04.424759 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-005ad805-6fd5-4d4b-82d6-d8b8cf1e55e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:04.438104 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005ad805-6fd5-4d4b-82d6-d8b8cf1e55e0 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:04.443303 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58249ca2-0625-4461-9fd5-215974b2bba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:04.444309 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58249ca2-0625-4461-9fd5-215974b2bba4 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:04.444577 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58249ca2-0625-4461-9fd5-215974b2bba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:04.444864 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58249ca2-0625-4461-9fd5-215974b2bba4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:04.445596 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58249ca2-0625-4461-9fd5-215974b2bba4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:12:04.445960 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58249ca2-0625-4461-9fd5-215974b2bba4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:04.447608 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58249ca2-0625-4461-9fd5-215974b2bba4 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:04.460279 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 933/1854] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:12:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:12:04.461104 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58249ca2-0625-4461-9fd5-215974b2bba4 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:04.462883 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-58249ca2-0625-4461-9fd5-215974b2bba4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:04.476320 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58249ca2-0625-4461-9fd5-215974b2bba4 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:04.481588 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d046a-8b3b-4fe7-a3ea-7b24fcfcb846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:04.482768 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d046a-8b3b-4fe7-a3ea-7b24fcfcb846 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:04.482768 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d046a-8b3b-4fe7-a3ea-7b24fcfcb846 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:04.482945 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d046a-8b3b-4fe7-a3ea-7b24fcfcb846 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:04.483858 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460d046a-8b3b-4fe7-a3ea-7b24fcfcb846 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:04.486340 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460d046a-8b3b-4fe7-a3ea-7b24fcfcb846 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:04.499266 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 934/1855] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:12:04 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:12:04.501074 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e0c3a7-18f2-4ab6-a2f1-b33b6ec2c3a9 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:04.501370 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e0c3a7-18f2-4ab6-a2f1-b33b6ec2c3a9 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:04.501653 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e0c3a7-18f2-4ab6-a2f1-b33b6ec2c3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:04.520099 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-86e0c3a7-18f2-4ab6-a2f1-b33b6ec2c3a9 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:04.521303 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-86e0c3a7-18f2-4ab6-a2f1-b33b6ec2c3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:04.530859 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 935/1856] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:04.530859 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e0c3a7-18f2-4ab6-a2f1-b33b6ec2c3a9 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:04.541338 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e0c3a7-18f2-4ab6-a2f1-b33b6ec2c3a9 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:04.547365 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ad2a82-8348-40b6-a53d-c50b4f3372b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:04.547365 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad2a82-8348-40b6-a53d-c50b4f3372b1 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:04.547365 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad2a82-8348-40b6-a53d-c50b4f3372b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:04.547800 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad2a82-8348-40b6-a53d-c50b4f3372b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:04.548339 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ad2a82-8348-40b6-a53d-c50b4f3372b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:04.550270 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ad2a82-8348-40b6-a53d-c50b4f3372b1 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:04.593002 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f1d1103f-f544-4887-bdda-939c3d308e40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8319fc06ca9473783a3e2cb6ec94872'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:04.601488 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f1d1103f-f544-4887-bdda-939c3d308e40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8319fc06ca9473783a3e2cb6ec94872'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:04.602196 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f1d1103f-f544-4887-bdda-939c3d308e40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8319fc06ca9473783a3e2cb6ec94872'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:04.651683 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 936/1857] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:12:04 2022] POST /identity/v3/projects => generated 387 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:12:04.652320 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ad2a82-8348-40b6-a53d-c50b4f3372b1 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:04.666378 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f1d1103f-f544-4887-bdda-939c3d308e40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8319fc06ca9473783a3e2cb6ec94872'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:04.680351 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f1d1103f-f544-4887-bdda-939c3d308e40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8319fc06ca9473783a3e2cb6ec94872'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:04.687328 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 922/1858] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:12:04 2022] DELETE /identity/v3/users/d8319fc06ca9473783a3e2cb6ec94872 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:04.689847 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a302a7f1-038e-4927-ba89-6521928616ba None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:04.690138 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a302a7f1-038e-4927-ba89-6521928616ba None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:04.690520 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a302a7f1-038e-4927-ba89-6521928616ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:04.710239 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-a302a7f1-038e-4927-ba89-6521928616ba None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:04.711423 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-a302a7f1-038e-4927-ba89-6521928616ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:04.762024 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ad2a82-8348-40b6-a53d-c50b4f3372b1 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:04.795026 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 923/1859] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:04.796684 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a302a7f1-038e-4927-ba89-6521928616ba None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:04.799748 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-a302a7f1-038e-4927-ba89-6521928616ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:04.817121 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a302a7f1-038e-4927-ba89-6521928616ba None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:04.823689 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68325fc-c923-4936-b29e-77323655f94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:04.824712 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68325fc-c923-4936-b29e-77323655f94a admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:04.825003 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68325fc-c923-4936-b29e-77323655f94a admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:04.825319 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68325fc-c923-4936-b29e-77323655f94a admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:04.827546 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68325fc-c923-4936-b29e-77323655f94a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:04.828348 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68325fc-c923-4936-b29e-77323655f94a admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:04.874351 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638852a8-1530-4878-9d26-e2ca67aac878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:04.875235 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638852a8-1530-4878-9d26-e2ca67aac878 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:04.875541 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638852a8-1530-4878-9d26-e2ca67aac878 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:04.876430 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638852a8-1530-4878-9d26-e2ca67aac878 admin admin] PATH_INFO: `/v3/projects/1809ec840ff040de8bc3163c7e723838/users/68b64be896a9403888c05a33dfea02b9/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:04.890908 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638852a8-1530-4878-9d26-e2ca67aac878 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1809ec840ff040de8bc3163c7e723838, user_id=68b64be896a9403888c05a33dfea02b9, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:04.894207 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638852a8-1530-4878-9d26-e2ca67aac878 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:04.932697 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 924/1860] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:12:04 2022] POST /identity/v3/users => generated 294 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:12:04.935047 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68325fc-c923-4936-b29e-77323655f94a admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:04.947119 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68325fc-c923-4936-b29e-77323655f94a admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:04.952048 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268cddef-9b89-4f33-a9d3-4bf7dd12ce67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:04.952725 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268cddef-9b89-4f33-a9d3-4bf7dd12ce67 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:04.953011 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268cddef-9b89-4f33-a9d3-4bf7dd12ce67 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:04.953290 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268cddef-9b89-4f33-a9d3-4bf7dd12ce67 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:04.954014 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268cddef-9b89-4f33-a9d3-4bf7dd12ce67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:12:04.954325 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268cddef-9b89-4f33-a9d3-4bf7dd12ce67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:04.955987 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268cddef-9b89-4f33-a9d3-4bf7dd12ce67 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:04.972059 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 925/1861] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:12:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:12:04.972059 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a64e4fa-aa8f-4ecf-9394-997ba22c7d50 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:04.972059 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a64e4fa-aa8f-4ecf-9394-997ba22c7d50 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:04.972059 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a64e4fa-aa8f-4ecf-9394-997ba22c7d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:05.002730 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-3a64e4fa-aa8f-4ecf-9394-997ba22c7d50 None None] MFA Rules not processed for user `36c32d3de24045bdbfce30559ea022e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:05.002730 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-3a64e4fa-aa8f-4ecf-9394-997ba22c7d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:05.003341 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 937/1862] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:12:04 2022] PUT /identity/v3/projects/1809ec840ff040de8bc3163c7e723838/users/68b64be896a9403888c05a33dfea02b9/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:05.003341 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638852a8-1530-4878-9d26-e2ca67aac878 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:05.082811 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 926/1863] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:04 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:05.082811 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a64e4fa-aa8f-4ecf-9394-997ba22c7d50 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:05.091322 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638852a8-1530-4878-9d26-e2ca67aac878 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:05.107328 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728d507f-e901-4ecb-a311-e7be864070ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:05.109096 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d507f-e901-4ecb-a311-e7be864070ab admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:05.112367 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d507f-e901-4ecb-a311-e7be864070ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:05.112367 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d507f-e901-4ecb-a311-e7be864070ab admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:05.112367 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728d507f-e901-4ecb-a311-e7be864070ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:05.115935 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728d507f-e901-4ecb-a311-e7be864070ab admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:05.125644 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a64e4fa-aa8f-4ecf-9394-997ba22c7d50 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:05.134806 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 938/1864] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:12:04 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:12:05.134806 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728d507f-e901-4ecb-a311-e7be864070ab admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:05.140572 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-728d507f-e901-4ecb-a311-e7be864070ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:05.147183 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c9172-19f0-4089-b5b9-78b4a4c20de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:05.148122 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c9172-19f0-4089-b5b9-78b4a4c20de5 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:05.148650 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c9172-19f0-4089-b5b9-78b4a4c20de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:05.149216 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c9172-19f0-4089-b5b9-78b4a4c20de5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:05.149820 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565c9172-19f0-4089-b5b9-78b4a4c20de5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:05.152965 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565c9172-19f0-4089-b5b9-78b4a4c20de5 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:05.156299 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728d507f-e901-4ecb-a311-e7be864070ab admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:05.162758 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361697d6-89d5-45a0-baab-0d4f84df0a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:05.163580 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361697d6-89d5-45a0-baab-0d4f84df0a9f admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:05.163957 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361697d6-89d5-45a0-baab-0d4f84df0a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:05.164354 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361697d6-89d5-45a0-baab-0d4f84df0a9f admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:05.165354 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361697d6-89d5-45a0-baab-0d4f84df0a9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:05.167089 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361697d6-89d5-45a0-baab-0d4f84df0a9f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:05.183246 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 939/1865] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:12:05 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:12:05.183680 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361697d6-89d5-45a0-baab-0d4f84df0a9f admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:05.201830 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361697d6-89d5-45a0-baab-0d4f84df0a9f admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:05.207462 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25bedfb-34a4-4f56-8ff2-da73f8a09462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:05.208168 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25bedfb-34a4-4f56-8ff2-da73f8a09462 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:05.216981 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25bedfb-34a4-4f56-8ff2-da73f8a09462 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:05.216981 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25bedfb-34a4-4f56-8ff2-da73f8a09462 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:05.216981 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25bedfb-34a4-4f56-8ff2-da73f8a09462 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:05.216981 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25bedfb-34a4-4f56-8ff2-da73f8a09462 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:05.228330 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 940/1866] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:12:05 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:12:05.228330 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25bedfb-34a4-4f56-8ff2-da73f8a09462 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:05.245043 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25bedfb-34a4-4f56-8ff2-da73f8a09462 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:05.252258 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e124f8-9b05-4501-ace6-3baf812bae85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:05.253518 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e124f8-9b05-4501-ace6-3baf812bae85 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:05.256077 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e124f8-9b05-4501-ace6-3baf812bae85 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:05.256077 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e124f8-9b05-4501-ace6-3baf812bae85 admin admin] PATH_INFO: `/v3/projects/1809ec840ff040de8bc3163c7e723838/users/68b64be896a9403888c05a33dfea02b9/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:05.257542 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e124f8-9b05-4501-ace6-3baf812bae85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1809ec840ff040de8bc3163c7e723838, user_id=68b64be896a9403888c05a33dfea02b9, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:05.260814 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e124f8-9b05-4501-ace6-3baf812bae85 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:05.274023 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 941/1867] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:12:05 2022] PUT /identity/v3/projects/1809ec840ff040de8bc3163c7e723838/users/68b64be896a9403888c05a33dfea02b9/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:05.276553 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e124f8-9b05-4501-ace6-3baf812bae85 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:05.287323 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 927/1868] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:12:05 2022] POST /identity/v3/projects => generated 373 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:12:05.295167 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c9172-19f0-4089-b5b9-78b4a4c20de5 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:05.390975 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e124f8-9b05-4501-ace6-3baf812bae85 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:05.430157 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c9172-19f0-4089-b5b9-78b4a4c20de5 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:05.441047 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d4be90-c3dc-4cfd-9ee8-447bdb4651bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:05.441917 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4be90-c3dc-4cfd-9ee8-447bdb4651bd admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:05.442298 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4be90-c3dc-4cfd-9ee8-447bdb4651bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:05.442675 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4be90-c3dc-4cfd-9ee8-447bdb4651bd admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:05.443605 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d4be90-c3dc-4cfd-9ee8-447bdb4651bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:05.446038 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d4be90-c3dc-4cfd-9ee8-447bdb4651bd admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:05.451296 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac51614-9e16-4947-b71f-122d2c01685f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:05.452667 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac51614-9e16-4947-b71f-122d2c01685f admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:05.453054 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac51614-9e16-4947-b71f-122d2c01685f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:05.453331 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac51614-9e16-4947-b71f-122d2c01685f admin admin] PATH_INFO: `/v3/projects/9ffe47c465e1480d91f689bed8e9ed94/users/6ca2cafc3b794c88b48510b5d466b580/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:05.470498 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac51614-9e16-4947-b71f-122d2c01685f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ffe47c465e1480d91f689bed8e9ed94, user_id=6ca2cafc3b794c88b48510b5d466b580, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:05.475625 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac51614-9e16-4947-b71f-122d2c01685f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:05.556431 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 928/1869] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:12:05 2022] POST /identity/v3/users => generated 287 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:12:05.556431 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d276fef-9efb-44d9-807a-d71d0a07d67b None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:05.556431 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d276fef-9efb-44d9-807a-d71d0a07d67b None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:05.556431 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d276fef-9efb-44d9-807a-d71d0a07d67b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:05.565800 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 942/1870] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:12:05 2022] PUT /identity/v3/projects/9ffe47c465e1480d91f689bed8e9ed94/users/6ca2cafc3b794c88b48510b5d466b580/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:05.566684 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac51614-9e16-4947-b71f-122d2c01685f admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:05.568546 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-bac51614-9e16-4947-b71f-122d2c01685f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:05.596484 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-9d276fef-9efb-44d9-807a-d71d0a07d67b None None] MFA Rules not processed for user `68b64be896a9403888c05a33dfea02b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:05.597768 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-9d276fef-9efb-44d9-807a-d71d0a07d67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:05.641217 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac51614-9e16-4947-b71f-122d2c01685f admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:05.646515 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6b0aa5-ddb7-461b-ab5a-243be5cac5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:05.647379 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b0aa5-ddb7-461b-ab5a-243be5cac5b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:05.647694 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b0aa5-ddb7-461b-ab5a-243be5cac5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:05.647983 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b0aa5-ddb7-461b-ab5a-243be5cac5b7 admin admin] PATH_INFO: `/v3/projects/953fd8d466f64b23a52126135ab7e21b` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:05.649169 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6b0aa5-ddb7-461b-ab5a-243be5cac5b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=953fd8d466f64b23a52126135ab7e21b)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:05.651097 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6b0aa5-ddb7-461b-ab5a-243be5cac5b7 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:05.669557 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 929/1871] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:05 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:05.672181 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d276fef-9efb-44d9-807a-d71d0a07d67b None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:05.685845 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d276fef-9efb-44d9-807a-d71d0a07d67b None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:05.691202 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5072657-750a-4cf5-abfe-3aeb4d078e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:05.691897 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5072657-750a-4cf5-abfe-3aeb4d078e1d admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:05.692184 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5072657-750a-4cf5-abfe-3aeb4d078e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:05.692463 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5072657-750a-4cf5-abfe-3aeb4d078e1d admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:05.693186 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5072657-750a-4cf5-abfe-3aeb4d078e1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:05.694829 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5072657-750a-4cf5-abfe-3aeb4d078e1d admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:05.705180 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 930/1872] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:12:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:12:05.706369 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d4603b-be6c-44b5-a4d8-b8bc92bdfe29 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:05.706658 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d4603b-be6c-44b5-a4d8-b8bc92bdfe29 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:05.706936 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d4603b-be6c-44b5-a4d8-b8bc92bdfe29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:05.732636 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-c3d4603b-be6c-44b5-a4d8-b8bc92bdfe29 None None] MFA Rules not processed for user `6ca2cafc3b794c88b48510b5d466b580`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:05.733888 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c3d4603b-be6c-44b5-a4d8-b8bc92bdfe29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:05.781191 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-bc6b0aa5-ddb7-461b-ab5a-243be5cac5b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '953fd8d466f64b23a52126135ab7e21b', 'request_id': 'req-bc6b0aa5-ddb7-461b-ab5a-243be5cac5b7'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:05.787337 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-bc6b0aa5-ddb7-461b-ab5a-243be5cac5b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '953fd8d466f64b23a52126135ab7e21b', 'request_id': 'req-bc6b0aa5-ddb7-461b-ab5a-243be5cac5b7'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:05.797408 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 931/1873] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:05.798939 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e07c9-3ab5-4b3e-aadd-6dbf8dcfc21e None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:05.799223 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e07c9-3ab5-4b3e-aadd-6dbf8dcfc21e None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:05.799516 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e07c9-3ab5-4b3e-aadd-6dbf8dcfc21e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:05.817457 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-e71e07c9-3ab5-4b3e-aadd-6dbf8dcfc21e None None] MFA Rules not processed for user `99ed32a6d699453bb7e088540e8fc980`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:05.818689 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e71e07c9-3ab5-4b3e-aadd-6dbf8dcfc21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:05.868876 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 932/1874] 10.222.0.52 () {58 vars in 1009 bytes} [Sat May 14 21:12:05 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:05.869703 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e07c9-3ab5-4b3e-aadd-6dbf8dcfc21e None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:05.871309 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e71e07c9-3ab5-4b3e-aadd-6dbf8dcfc21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:05.872460 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-bc6b0aa5-ddb7-461b-ab5a-243be5cac5b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '953fd8d466f64b23a52126135ab7e21b', 'request_id': 'req-bc6b0aa5-ddb7-461b-ab5a-243be5cac5b7'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:05.889999 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-bc6b0aa5-ddb7-461b-ab5a-243be5cac5b7 admin admin] The token cache is being invalidate because project 953fd8d466f64b23a52126135ab7e21b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:12:05.890294 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-bc6b0aa5-ddb7-461b-ab5a-243be5cac5b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:05.891009 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-bc6b0aa5-ddb7-461b-ab5a-243be5cac5b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:05.892928 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 943/1875] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:12:05 2022] DELETE /identity/v3/projects/953fd8d466f64b23a52126135ab7e21b => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:05.893608 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6b0aa5-ddb7-461b-ab5a-243be5cac5b7 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:05.895471 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-bc6b0aa5-ddb7-461b-ab5a-243be5cac5b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:05.950179 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e07c9-3ab5-4b3e-aadd-6dbf8dcfc21e None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:05.956137 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1701f829-16fd-4600-a586-ced15195c873 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:05.957426 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701f829-16fd-4600-a586-ced15195c873 service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:05.957717 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701f829-16fd-4600-a586-ced15195c873 service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:05.957989 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701f829-16fd-4600-a586-ced15195c873 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:05.959882 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-1701f829-16fd-4600-a586-ced15195c873 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:05.964581 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6b0aa5-ddb7-461b-ab5a-243be5cac5b7 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:05.970381 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f34db7-8d46-4c3a-9218-79da3a41866a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:05.971048 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f34db7-8d46-4c3a-9218-79da3a41866a admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:05.971334 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f34db7-8d46-4c3a-9218-79da3a41866a admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:05.971633 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f34db7-8d46-4c3a-9218-79da3a41866a admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:05.972355 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f34db7-8d46-4c3a-9218-79da3a41866a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:05.973962 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f34db7-8d46-4c3a-9218-79da3a41866a admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:05.983871 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 944/1876] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:12:05 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:12:05.984661 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f34db7-8d46-4c3a-9218-79da3a41866a admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:05.987319 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b0f34db7-8d46-4c3a-9218-79da3a41866a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:05.999667 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f34db7-8d46-4c3a-9218-79da3a41866a admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:06.004826 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4359276b-f767-4d2e-bba3-4005106782a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:06.005521 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4359276b-f767-4d2e-bba3-4005106782a3 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:06.006077 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4359276b-f767-4d2e-bba3-4005106782a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:06.006353 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4359276b-f767-4d2e-bba3-4005106782a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:06.007173 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4359276b-f767-4d2e-bba3-4005106782a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:06.009117 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4359276b-f767-4d2e-bba3-4005106782a3 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:06.022846 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1701f829-16fd-4600-a586-ced15195c873 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:06.024502 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1701f829-16fd-4600-a586-ced15195c873 service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:06.034731 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 933/1877] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:12:05 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:12:06.035555 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1701f829-16fd-4600-a586-ced15195c873 service nova] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:06.036847 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-1701f829-16fd-4600-a586-ced15195c873 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:06.048734 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1701f829-16fd-4600-a586-ced15195c873 service nova] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:06.052432 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df21a3b4-8757-4d00-a01a-5de25ee547a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:06.053071 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df21a3b4-8757-4d00-a01a-5de25ee547a9 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:06.053353 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df21a3b4-8757-4d00-a01a-5de25ee547a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:06.053630 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df21a3b4-8757-4d00-a01a-5de25ee547a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:06.055407 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-df21a3b4-8757-4d00-a01a-5de25ee547a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:06.064894 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df21a3b4-8757-4d00-a01a-5de25ee547a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:06.066348 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df21a3b4-8757-4d00-a01a-5de25ee547a9 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:06.074406 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 934/1878] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:12:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:12:06.075602 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b1421-ea10-4be8-a113-6a05d20d9be7 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:06.075893 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b1421-ea10-4be8-a113-6a05d20d9be7 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:06.076239 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b1421-ea10-4be8-a113-6a05d20d9be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:06.094096 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-510b1421-ea10-4be8-a113-6a05d20d9be7 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:06.096269 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-510b1421-ea10-4be8-a113-6a05d20d9be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:06.103938 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 945/1879] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:12:05 2022] POST /identity/v3/projects => generated 387 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:12:06.104909 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4359276b-f767-4d2e-bba3-4005106782a3 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:06.106294 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 935/1880] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:06.107660 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b1421-ea10-4be8-a113-6a05d20d9be7 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:06.119705 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b1421-ea10-4be8-a113-6a05d20d9be7 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:06.181728 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0866a0-9257-49eb-8fc3-ed9585c4f66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:06.182486 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0866a0-9257-49eb-8fc3-ed9585c4f66e admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:06.182771 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0866a0-9257-49eb-8fc3-ed9585c4f66e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:06.183137 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0866a0-9257-49eb-8fc3-ed9585c4f66e admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:06.183954 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0866a0-9257-49eb-8fc3-ed9585c4f66e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:06.186222 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0866a0-9257-49eb-8fc3-ed9585c4f66e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:06.194623 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4359276b-f767-4d2e-bba3-4005106782a3 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:06.202200 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a660ee4b-581d-459b-b290-8928d2365f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:06.202200 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660ee4b-581d-459b-b290-8928d2365f17 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:06.202200 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660ee4b-581d-459b-b290-8928d2365f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:06.202200 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660ee4b-581d-459b-b290-8928d2365f17 admin admin] PATH_INFO: `/v3/projects/e2063e335c404cfeb061528dd896468f/users/c2d20a8e46724e249f90bd697e8f1783/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:06.219220 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a660ee4b-581d-459b-b290-8928d2365f17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2063e335c404cfeb061528dd896468f, user_id=c2d20a8e46724e249f90bd697e8f1783, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:06.223320 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a660ee4b-581d-459b-b290-8928d2365f17 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:06.330016 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 936/1881] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:12:06 2022] POST /identity/v3/users => generated 300 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:12:06.331618 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1bb54-30c0-48bd-aa41-45169495ecd4 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:06.333934 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1bb54-30c0-48bd-aa41-45169495ecd4 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:06.333934 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1bb54-30c0-48bd-aa41-45169495ecd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:06.351741 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-e9a1bb54-30c0-48bd-aa41-45169495ecd4 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:06.352949 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e9a1bb54-30c0-48bd-aa41-45169495ecd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:06.374821 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 937/1883] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:06.376494 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a1bb54-30c0-48bd-aa41-45169495ecd4 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:06.378702 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 946/1883] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:12:06 2022] PUT /identity/v3/projects/e2063e335c404cfeb061528dd896468f/users/c2d20a8e46724e249f90bd697e8f1783/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:06.380381 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c1964a-f42b-4729-bafc-0f05b1e46843 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:06.380995 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c1964a-f42b-4729-bafc-0f05b1e46843 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:06.381229 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c1964a-f42b-4729-bafc-0f05b1e46843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:06.390258 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a1bb54-30c0-48bd-aa41-45169495ecd4 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:06.419955 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-b5c1964a-f42b-4729-bafc-0f05b1e46843 None None] MFA Rules not processed for user `c2d20a8e46724e249f90bd697e8f1783`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:06.421198 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b5c1964a-f42b-4729-bafc-0f05b1e46843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:06.460226 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b18853-56dd-4655-ae36-584809079724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:06.461193 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b18853-56dd-4655-ae36-584809079724 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:06.461620 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b18853-56dd-4655-ae36-584809079724 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:06.461909 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b18853-56dd-4655-ae36-584809079724 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:06.463042 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b18853-56dd-4655-ae36-584809079724 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:06.464531 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b18853-56dd-4655-ae36-584809079724 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:06.482625 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 938/1884] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:12:06 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:12:06.482625 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b18853-56dd-4655-ae36-584809079724 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:06.492796 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b18853-56dd-4655-ae36-584809079724 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:06.497812 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50f9463-9151-4d54-a531-788438a8f5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:06.498536 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f9463-9151-4d54-a531-788438a8f5c7 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:06.498824 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f9463-9151-4d54-a531-788438a8f5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:06.499105 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f9463-9151-4d54-a531-788438a8f5c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:06.499915 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50f9463-9151-4d54-a531-788438a8f5c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:12:06.500273 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50f9463-9151-4d54-a531-788438a8f5c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:06.503107 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50f9463-9151-4d54-a531-788438a8f5c7 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:06.504075 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 947/1885] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:06.505254 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c1964a-f42b-4729-bafc-0f05b1e46843 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:06.517676 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c1964a-f42b-4729-bafc-0f05b1e46843 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:06.525707 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 939/1886] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:12:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:12:06.526628 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50f9463-9151-4d54-a531-788438a8f5c7 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:06.527447 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5e55cc-e2d4-4a59-96cb-ef9a913dae3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:06.529999 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e55cc-e2d4-4a59-96cb-ef9a913dae3a admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:06.531852 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e55cc-e2d4-4a59-96cb-ef9a913dae3a admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:06.532177 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e55cc-e2d4-4a59-96cb-ef9a913dae3a admin admin] PATH_INFO: `/v3/projects/b66b447c40c04f70b7375b342f88bec8/users/94856972be884cd7a06b4673411ffea8/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:06.541802 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50f9463-9151-4d54-a531-788438a8f5c7 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:06.549200 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eef2c29-341d-4847-849c-d98185baa733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:06.550125 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef2c29-341d-4847-849c-d98185baa733 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:06.550559 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef2c29-341d-4847-849c-d98185baa733 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:06.551461 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef2c29-341d-4847-849c-d98185baa733 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:06.552589 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eef2c29-341d-4847-849c-d98185baa733 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:06.555222 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eef2c29-341d-4847-849c-d98185baa733 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:06.584098 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5e55cc-e2d4-4a59-96cb-ef9a913dae3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b66b447c40c04f70b7375b342f88bec8, user_id=94856972be884cd7a06b4673411ffea8, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:06.587305 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5e55cc-e2d4-4a59-96cb-ef9a913dae3a admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:06.665969 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 940/1887] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:12:06 2022] POST /identity/v3/projects => generated 373 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:12:06.666790 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eef2c29-341d-4847-849c-d98185baa733 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:06.690900 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 948/1888] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:12:06 2022] PUT /identity/v3/projects/b66b447c40c04f70b7375b342f88bec8/users/94856972be884cd7a06b4673411ffea8/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:06.692393 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c972c-c7a4-4cf0-9e81-606553873768 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:06.692687 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c972c-c7a4-4cf0-9e81-606553873768 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:06.693190 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c972c-c7a4-4cf0-9e81-606553873768 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:06.696478 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 949/1889] 10.222.0.52 () {54 vars in 921 bytes} [Sat May 14 21:12:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:12:06.697253 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c972c-c7a4-4cf0-9e81-606553873768 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:06.793024 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eef2c29-341d-4847-849c-d98185baa733 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:06.793293 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c972c-c7a4-4cf0-9e81-606553873768 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:06.798873 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12b458f-6020-45d5-afe7-b8e4c756850a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:06.803234 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b458f-6020-45d5-afe7-b8e4c756850a admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:06.803637 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab86ba-4428-4c28-9f51-722ca8e8fff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:06.803758 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b458f-6020-45d5-afe7-b8e4c756850a admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:06.803758 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b458f-6020-45d5-afe7-b8e4c756850a admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:06.803920 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab86ba-4428-4c28-9f51-722ca8e8fff0 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:06.803920 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab86ba-4428-4c28-9f51-722ca8e8fff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:06.804066 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12b458f-6020-45d5-afe7-b8e4c756850a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:06.804156 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab86ba-4428-4c28-9f51-722ca8e8fff0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:06.804156 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbab86ba-4428-4c28-9f51-722ca8e8fff0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:06.804993 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbab86ba-4428-4c28-9f51-722ca8e8fff0 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:06.809435 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12b458f-6020-45d5-afe7-b8e4c756850a admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:06.928851 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 950/1890] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:12:06 2022] POST /identity/v3/users => generated 293 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:12:06.928851 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12b458f-6020-45d5-afe7-b8e4c756850a admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:06.939203 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12b458f-6020-45d5-afe7-b8e4c756850a admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:06.944532 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0247339-1b84-4721-a490-cda14c984c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:06.945385 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0247339-1b84-4721-a490-cda14c984c52 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:06.945855 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0247339-1b84-4721-a490-cda14c984c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:06.946134 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0247339-1b84-4721-a490-cda14c984c52 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:06.946863 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0247339-1b84-4721-a490-cda14c984c52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:06.948552 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0247339-1b84-4721-a490-cda14c984c52 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:06.962853 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 951/1891] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:12:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:12:06.962853 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5fd67-b04f-486c-acb6-45991dfb1317 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:06.962853 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5fd67-b04f-486c-acb6-45991dfb1317 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:06.962853 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5fd67-b04f-486c-acb6-45991dfb1317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:06.975821 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 941/1892] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:12:06 2022] POST /identity/v3/projects => generated 389 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:12:06.976879 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab86ba-4428-4c28-9f51-722ca8e8fff0 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:06.988637 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-1df5fd67-b04f-486c-acb6-45991dfb1317 None None] MFA Rules not processed for user `0f1b0e2b025d4eceaa90e1616d0a9db8`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:06.993216 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-1df5fd67-b04f-486c-acb6-45991dfb1317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:07.041178 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab86ba-4428-4c28-9f51-722ca8e8fff0 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:07.046453 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615da6ae-3a36-4b2e-be25-d6a83a4de46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:07.047209 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615da6ae-3a36-4b2e-be25-d6a83a4de46c admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:07.047647 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615da6ae-3a36-4b2e-be25-d6a83a4de46c admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:07.048000 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615da6ae-3a36-4b2e-be25-d6a83a4de46c admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:07.049400 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615da6ae-3a36-4b2e-be25-d6a83a4de46c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:07.051363 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615da6ae-3a36-4b2e-be25-d6a83a4de46c admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:07.066335 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 942/1893] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:12:06 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:12:07.067608 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615da6ae-3a36-4b2e-be25-d6a83a4de46c admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:07.073610 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 952/1894] 10.222.0.52 () {58 vars in 1018 bytes} [Sat May 14 21:12:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:07.074436 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df5fd67-b04f-486c-acb6-45991dfb1317 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:07.078189 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615da6ae-3a36-4b2e-be25-d6a83a4de46c admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:07.092423 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df5fd67-b04f-486c-acb6-45991dfb1317 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:07.093346 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b3a89-c4a2-4862-9069-6b633cd006ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:07.094253 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b3a89-c4a2-4862-9069-6b633cd006ef admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:07.094592 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b3a89-c4a2-4862-9069-6b633cd006ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:07.094876 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b3a89-c4a2-4862-9069-6b633cd006ef admin admin] PATH_INFO: `/v3/projects/b66b447c40c04f70b7375b342f88bec8/users/94856972be884cd7a06b4673411ffea8/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:07.097365 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65b3a89-c4a2-4862-9069-6b633cd006ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=b66b447c40c04f70b7375b342f88bec8, user_id=94856972be884cd7a06b4673411ffea8, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:07.101022 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0255a2-0234-48d9-bdf5-2df58bd0821b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:07.101893 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0255a2-0234-48d9-bdf5-2df58bd0821b admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:07.102558 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0255a2-0234-48d9-bdf5-2df58bd0821b admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:07.102853 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0255a2-0234-48d9-bdf5-2df58bd0821b admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:07.103645 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0255a2-0234-48d9-bdf5-2df58bd0821b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:07.106247 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0255a2-0234-48d9-bdf5-2df58bd0821b admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:07.106522 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65b3a89-c4a2-4862-9069-6b633cd006ef admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:07.131585 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 943/1895] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:12:07 2022] PUT /identity/v3/projects/b66b447c40c04f70b7375b342f88bec8/users/94856972be884cd7a06b4673411ffea8/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:07.136514 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b3a89-c4a2-4862-9069-6b633cd006ef admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:07.204172 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b3a89-c4a2-4862-9069-6b633cd006ef admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:07.212993 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20ce824-3ef7-45bd-8e22-30900392de5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:07.214368 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ce824-3ef7-45bd-8e22-30900392de5d admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:07.214657 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ce824-3ef7-45bd-8e22-30900392de5d admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:07.214938 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ce824-3ef7-45bd-8e22-30900392de5d admin admin] PATH_INFO: `/v3/projects/2310519e16b34f3b8ebdde01188d78f6/users/1ee1da20d78d4f57a4ffb48b317dc0ab/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:07.229835 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20ce824-3ef7-45bd-8e22-30900392de5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2310519e16b34f3b8ebdde01188d78f6, user_id=1ee1da20d78d4f57a4ffb48b317dc0ab, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:07.232626 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20ce824-3ef7-45bd-8e22-30900392de5d admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:07.256254 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 953/1896] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:12:07 2022] POST /identity/v3/users => generated 295 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:12:07.257098 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0255a2-0234-48d9-bdf5-2df58bd0821b admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:07.261993 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-df0255a2-0234-48d9-bdf5-2df58bd0821b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:07.273932 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0255a2-0234-48d9-bdf5-2df58bd0821b admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:07.335776 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 944/1897] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:12:07 2022] PUT /identity/v3/projects/2310519e16b34f3b8ebdde01188d78f6/users/1ee1da20d78d4f57a4ffb48b317dc0ab/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:07.340171 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3093330-4af3-4ef4-9ae6-9c0132e947e9 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:07.340463 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3093330-4af3-4ef4-9ae6-9c0132e947e9 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:07.340747 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3093330-4af3-4ef4-9ae6-9c0132e947e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:07.355798 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca42c388-3bd3-4d1e-88ed-4aae33d10bf1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:07.356497 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca42c388-3bd3-4d1e-88ed-4aae33d10bf1 service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:07.356778 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca42c388-3bd3-4d1e-88ed-4aae33d10bf1 service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:07.357057 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca42c388-3bd3-4d1e-88ed-4aae33d10bf1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:07.366788 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca42c388-3bd3-4d1e-88ed-4aae33d10bf1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:07.367996 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-b3093330-4af3-4ef4-9ae6-9c0132e947e9 None None] MFA Rules not processed for user `94856972be884cd7a06b4673411ffea8`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:07.368415 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca42c388-3bd3-4d1e-88ed-4aae33d10bf1 service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:07.369221 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b3093330-4af3-4ef4-9ae6-9c0132e947e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:07.380125 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 954/1898] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:12:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:12:07.381100 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca42c388-3bd3-4d1e-88ed-4aae33d10bf1 service nova] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:07.394550 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca42c388-3bd3-4d1e-88ed-4aae33d10bf1 service nova] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:07.454807 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 945/1899] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:07 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:07.455950 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3093330-4af3-4ef4-9ae6-9c0132e947e9 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:07.464862 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b3093330-4af3-4ef4-9ae6-9c0132e947e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:07.465705 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41787b1-1623-43bd-9d45-88601994fee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:07.466397 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41787b1-1623-43bd-9d45-88601994fee7 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:07.466680 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41787b1-1623-43bd-9d45-88601994fee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:07.466954 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41787b1-1623-43bd-9d45-88601994fee7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:07.468501 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41787b1-1623-43bd-9d45-88601994fee7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:07.469364 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41787b1-1623-43bd-9d45-88601994fee7 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:07.480750 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3093330-4af3-4ef4-9ae6-9c0132e947e9 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:07.487713 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d496857-0445-426c-b335-3679d867391f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:07.488709 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d496857-0445-426c-b335-3679d867391f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:07.488991 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d496857-0445-426c-b335-3679d867391f admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:07.489269 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d496857-0445-426c-b335-3679d867391f admin admin] PATH_INFO: `/v3/users/72b3ed0768f3432eb4ee966a72f28615` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:07.490517 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d496857-0445-426c-b335-3679d867391f admin admin] RBAC: Authorizing `identity:delete_user(user_id=72b3ed0768f3432eb4ee966a72f28615)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:07.492511 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 955/1900] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:12:07 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:12:07.492834 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d496857-0445-426c-b335-3679d867391f admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:07.493329 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41787b1-1623-43bd-9d45-88601994fee7 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:07.511375 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41787b1-1623-43bd-9d45-88601994fee7 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:07.518662 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316ef2ec-a77f-44ee-b70f-5af539a1f3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:07.519290 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ef2ec-a77f-44ee-b70f-5af539a1f3f4 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:07.519661 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ef2ec-a77f-44ee-b70f-5af539a1f3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:07.519941 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ef2ec-a77f-44ee-b70f-5af539a1f3f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:07.521408 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316ef2ec-a77f-44ee-b70f-5af539a1f3f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:07.522398 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316ef2ec-a77f-44ee-b70f-5af539a1f3f4 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:07.533205 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 956/1901] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:12:07 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:12:07.534509 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e926835-bf58-4362-b78b-68c1f855ac6e None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:07.534802 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e926835-bf58-4362-b78b-68c1f855ac6e None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:07.535090 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e926835-bf58-4362-b78b-68c1f855ac6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:07.554742 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-3e926835-bf58-4362-b78b-68c1f855ac6e None None] MFA Rules not processed for user `6ca2cafc3b794c88b48510b5d466b580`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:07.556795 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-3e926835-bf58-4362-b78b-68c1f855ac6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:07.624857 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 957/1902] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:07.626229 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e926835-bf58-4362-b78b-68c1f855ac6e None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:07.640400 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e926835-bf58-4362-b78b-68c1f855ac6e None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:07.645783 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a971e8d2-10b1-4ba2-8549-aeda126d582c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:07.646444 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971e8d2-10b1-4ba2-8549-aeda126d582c admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:07.646730 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971e8d2-10b1-4ba2-8549-aeda126d582c admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:07.647010 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971e8d2-10b1-4ba2-8549-aeda126d582c admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:07.647770 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a971e8d2-10b1-4ba2-8549-aeda126d582c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:07.649378 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a971e8d2-10b1-4ba2-8549-aeda126d582c admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:07.660334 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 958/1903] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:12:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:12:07.661257 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a971e8d2-10b1-4ba2-8549-aeda126d582c admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:07.681459 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7d496857-0445-426c-b335-3679d867391f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72b3ed0768f3432eb4ee966a72f28615'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:07.682935 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a971e8d2-10b1-4ba2-8549-aeda126d582c admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:07.689625 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7d496857-0445-426c-b335-3679d867391f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72b3ed0768f3432eb4ee966a72f28615'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:07.690409 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7d496857-0445-426c-b335-3679d867391f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72b3ed0768f3432eb4ee966a72f28615'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:07.700109 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a4a09d-484c-495e-b2a8-683eb39a31cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:07.701055 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a4a09d-484c-495e-b2a8-683eb39a31cb admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:07.701673 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a4a09d-484c-495e-b2a8-683eb39a31cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:07.702004 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a4a09d-484c-495e-b2a8-683eb39a31cb admin admin] PATH_INFO: `/v3/projects/2310519e16b34f3b8ebdde01188d78f6/users/1ee1da20d78d4f57a4ffb48b317dc0ab/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:07.705689 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a4a09d-484c-495e-b2a8-683eb39a31cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2310519e16b34f3b8ebdde01188d78f6, user_id=1ee1da20d78d4f57a4ffb48b317dc0ab, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:07.708385 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a4a09d-484c-495e-b2a8-683eb39a31cb admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:07.730170 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 959/1904] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:12:07 2022] PUT /identity/v3/projects/2310519e16b34f3b8ebdde01188d78f6/users/1ee1da20d78d4f57a4ffb48b317dc0ab/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:07.731693 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a4a09d-484c-495e-b2a8-683eb39a31cb admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:07.733660 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-96a4a09d-484c-495e-b2a8-683eb39a31cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:07.795950 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7d496857-0445-426c-b335-3679d867391f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72b3ed0768f3432eb4ee966a72f28615'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:07.811980 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7d496857-0445-426c-b335-3679d867391f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72b3ed0768f3432eb4ee966a72f28615'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:07.821233 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 946/1905] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:12:07 2022] DELETE /identity/v3/users/72b3ed0768f3432eb4ee966a72f28615 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:07.822198 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d496857-0445-426c-b335-3679d867391f admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:07.824217 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-7d496857-0445-426c-b335-3679d867391f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:07.863403 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a4a09d-484c-495e-b2a8-683eb39a31cb admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:07.925948 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d496857-0445-426c-b335-3679d867391f admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:07.932020 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b61809e-c19d-4417-8d32-6bc920e33461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:07.933170 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b61809e-c19d-4417-8d32-6bc920e33461 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:07.933743 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b61809e-c19d-4417-8d32-6bc920e33461 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:07.934571 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b61809e-c19d-4417-8d32-6bc920e33461 admin admin] PATH_INFO: `/v3/projects/07900cd943f749eda09005c560c237ac/users/5d238bf2bbec461083e6aad68486534b/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:07.966253 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b61809e-c19d-4417-8d32-6bc920e33461 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07900cd943f749eda09005c560c237ac, user_id=5d238bf2bbec461083e6aad68486534b, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:07.979548 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b61809e-c19d-4417-8d32-6bc920e33461 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:07.994002 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60951d5e-3e3d-4389-9ade-c9e32c4786e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:07.994716 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60951d5e-3e3d-4389-9ade-c9e32c4786e1 service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:07.995009 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60951d5e-3e3d-4389-9ade-c9e32c4786e1 service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:07.995292 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60951d5e-3e3d-4389-9ade-c9e32c4786e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:07.998488 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-60951d5e-3e3d-4389-9ade-c9e32c4786e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:08.064959 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60951d5e-3e3d-4389-9ade-c9e32c4786e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:08.066604 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60951d5e-3e3d-4389-9ade-c9e32c4786e1 service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:08.076833 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 960/1906] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:12:07 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:12:08.079404 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf1dcd5-acd4-481f-bb33-c10359eabc44 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:08.079734 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf1dcd5-acd4-481f-bb33-c10359eabc44 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:08.080014 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf1dcd5-acd4-481f-bb33-c10359eabc44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:08.113100 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 947/1907] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:12:07 2022] PUT /identity/v3/projects/07900cd943f749eda09005c560c237ac/users/5d238bf2bbec461083e6aad68486534b/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:08.113100 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c2e59a-e8d6-4bb0-8b6b-b4926da1d259 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:08.113100 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c2e59a-e8d6-4bb0-8b6b-b4926da1d259 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:08.113100 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c2e59a-e8d6-4bb0-8b6b-b4926da1d259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:08.119082 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-8cf1dcd5-acd4-481f-bb33-c10359eabc44 None None] MFA Rules not processed for user `1ee1da20d78d4f57a4ffb48b317dc0ab`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:08.119436 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-8cf1dcd5-acd4-481f-bb33-c10359eabc44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:08.152711 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-96c2e59a-e8d6-4bb0-8b6b-b4926da1d259 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:08.154332 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-96c2e59a-e8d6-4bb0-8b6b-b4926da1d259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:08.252601 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 961/1908] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:08 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:08.254208 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f83d80-2c94-4cbc-9e5f-1e26413e2203 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:08.254504 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f83d80-2c94-4cbc-9e5f-1e26413e2203 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:08.254786 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f83d80-2c94-4cbc-9e5f-1e26413e2203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:08.285669 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-45f83d80-2c94-4cbc-9e5f-1e26413e2203 None None] MFA Rules not processed for user `5d238bf2bbec461083e6aad68486534b`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:08.286998 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-45f83d80-2c94-4cbc-9e5f-1e26413e2203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:08.297323 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 948/1909] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:08.298212 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c2e59a-e8d6-4bb0-8b6b-b4926da1d259 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:08.301796 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-96c2e59a-e8d6-4bb0-8b6b-b4926da1d259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:08.378645 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 962/1910] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:08.378645 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f83d80-2c94-4cbc-9e5f-1e26413e2203 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:08.379313 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-45f83d80-2c94-4cbc-9e5f-1e26413e2203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:08.400252 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c2e59a-e8d6-4bb0-8b6b-b4926da1d259 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:08.403788 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeea5195-5a44-4036-a789-b233db845987 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:08.404450 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea5195-5a44-4036-a789-b233db845987 service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:08.404731 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea5195-5a44-4036-a789-b233db845987 service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:08.405008 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea5195-5a44-4036-a789-b233db845987 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:08.416411 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeea5195-5a44-4036-a789-b233db845987 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:08.418030 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeea5195-5a44-4036-a789-b233db845987 service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:08.429816 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 949/1911] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:12:08 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:12:08.430649 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeea5195-5a44-4036-a789-b233db845987 service nova] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:08.442030 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeea5195-5a44-4036-a789-b233db845987 service nova] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:08.447336 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f83d80-2c94-4cbc-9e5f-1e26413e2203 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:08.447645 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e92960-889f-4d86-b21e-9bcca4b5dd32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:08.448418 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e92960-889f-4d86-b21e-9bcca4b5dd32 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:08.448807 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e92960-889f-4d86-b21e-9bcca4b5dd32 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:08.449440 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e92960-889f-4d86-b21e-9bcca4b5dd32 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:08.450430 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e92960-889f-4d86-b21e-9bcca4b5dd32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:08.451911 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3396cef1-0a78-431b-99b3-6c56dd337c83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:08.452568 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3396cef1-0a78-431b-99b3-6c56dd337c83 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:08.452938 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3396cef1-0a78-431b-99b3-6c56dd337c83 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:08.453168 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e92960-889f-4d86-b21e-9bcca4b5dd32 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:08.453278 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3396cef1-0a78-431b-99b3-6c56dd337c83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:08.463998 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3396cef1-0a78-431b-99b3-6c56dd337c83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:08.465607 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3396cef1-0a78-431b-99b3-6c56dd337c83 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:08.479646 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 963/1912] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:12:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:12:08.552510 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 950/1913] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:12:08 2022] POST /identity/v3/projects => generated 387 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:12:08.556613 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3396cef1-0a78-431b-99b3-6c56dd337c83 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:08.569368 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3396cef1-0a78-431b-99b3-6c56dd337c83 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:08.640572 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a68e177-f3f0-4ddd-8648-d0d0cec3d723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:08.641784 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a68e177-f3f0-4ddd-8648-d0d0cec3d723 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:08.642065 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a68e177-f3f0-4ddd-8648-d0d0cec3d723 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:08.642339 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a68e177-f3f0-4ddd-8648-d0d0cec3d723 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:08.644345 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a68e177-f3f0-4ddd-8648-d0d0cec3d723 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:08.645234 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a68e177-f3f0-4ddd-8648-d0d0cec3d723 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:08.713429 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 964/1914] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:12:08 2022] POST /identity/v3/users => generated 300 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:12:08.717500 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e92960-889f-4d86-b21e-9bcca4b5dd32 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:08.730016 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e92960-889f-4d86-b21e-9bcca4b5dd32 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:08.735837 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19264f9-d747-4afb-8051-8540a26df953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:08.737073 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19264f9-d747-4afb-8051-8540a26df953 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:08.737485 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19264f9-d747-4afb-8051-8540a26df953 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:08.737972 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19264f9-d747-4afb-8051-8540a26df953 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:08.738812 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19264f9-d747-4afb-8051-8540a26df953 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:08.741711 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19264f9-d747-4afb-8051-8540a26df953 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:08.754460 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 951/1915] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:12:08.759273 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a68e177-f3f0-4ddd-8648-d0d0cec3d723 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:08.774849 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a68e177-f3f0-4ddd-8648-d0d0cec3d723 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:08.783729 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e9e2a4-bdcf-4226-a9de-ff59420c0cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:08.784756 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9e2a4-bdcf-4226-a9de-ff59420c0cd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:08.785145 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9e2a4-bdcf-4226-a9de-ff59420c0cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:08.785525 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9e2a4-bdcf-4226-a9de-ff59420c0cd0 admin admin] PATH_INFO: `/v3/projects/0a18ba6671854269bfe9ebfb710e9a8c/users/481d1d923d5a4debb2e6b439c64ab3b9/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:08.804648 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e9e2a4-bdcf-4226-a9de-ff59420c0cd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a18ba6671854269bfe9ebfb710e9a8c, user_id=481d1d923d5a4debb2e6b439c64ab3b9, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:08.807758 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e9e2a4-bdcf-4226-a9de-ff59420c0cd0 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:08.873235 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 965/1916] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:12:08 2022] PUT /identity/v3/projects/0a18ba6671854269bfe9ebfb710e9a8c/users/481d1d923d5a4debb2e6b439c64ab3b9/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:08.877782 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19264f9-d747-4afb-8051-8540a26df953 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:08.891708 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19264f9-d747-4afb-8051-8540a26df953 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:08.951404 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a6128-65e2-4661-a0ee-50dfbb54b8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:08.952140 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a6128-65e2-4661-a0ee-50dfbb54b8a1 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:08.952421 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a6128-65e2-4661-a0ee-50dfbb54b8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:08.952837 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a6128-65e2-4661-a0ee-50dfbb54b8a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:08.953588 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42a6128-65e2-4661-a0ee-50dfbb54b8a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:08.955467 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42a6128-65e2-4661-a0ee-50dfbb54b8a1 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:08.965530 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 952/1917] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:12:08.970471 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e9e2a4-bdcf-4226-a9de-ff59420c0cd0 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:08.980824 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e9e2a4-bdcf-4226-a9de-ff59420c0cd0 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:08.986188 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f21869-7cb7-4d1d-a533-cfd7a1e1d2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:08.987079 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f21869-7cb7-4d1d-a533-cfd7a1e1d2c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:08.987355 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f21869-7cb7-4d1d-a533-cfd7a1e1d2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:08.987663 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f21869-7cb7-4d1d-a533-cfd7a1e1d2c2 admin admin] PATH_INFO: `/v3/projects/0a18ba6671854269bfe9ebfb710e9a8c/users/481d1d923d5a4debb2e6b439c64ab3b9/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:08.989641 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f21869-7cb7-4d1d-a533-cfd7a1e1d2c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a18ba6671854269bfe9ebfb710e9a8c, user_id=481d1d923d5a4debb2e6b439c64ab3b9, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:08.992420 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f21869-7cb7-4d1d-a533-cfd7a1e1d2c2 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:09.006531 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a6128-65e2-4661-a0ee-50dfbb54b8a1 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:09.008370 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e42a6128-65e2-4661-a0ee-50dfbb54b8a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:09.023949 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a6128-65e2-4661-a0ee-50dfbb54b8a1 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:09.025187 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 966/1918] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:12:08 2022] PUT /identity/v3/projects/0a18ba6671854269bfe9ebfb710e9a8c/users/481d1d923d5a4debb2e6b439c64ab3b9/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:09.041632 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe5530-c03b-452e-9ff3-8083087ce12f None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:09.041632 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe5530-c03b-452e-9ff3-8083087ce12f None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:09.041632 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe5530-c03b-452e-9ff3-8083087ce12f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:09.091821 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-7ffe5530-c03b-452e-9ff3-8083087ce12f None None] MFA Rules not processed for user `481d1d923d5a4debb2e6b439c64ab3b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:09.093367 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-7ffe5530-c03b-452e-9ff3-8083087ce12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:09.115220 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a8038-40c3-45cc-b1dc-c423cbd443fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:09.116351 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a8038-40c3-45cc-b1dc-c423cbd443fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:09.116712 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a8038-40c3-45cc-b1dc-c423cbd443fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:09.117061 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a8038-40c3-45cc-b1dc-c423cbd443fa admin admin] PATH_INFO: `/v3/projects/b51bea6b4a6f4aefb2dc04177e103f22` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:09.119136 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440a8038-40c3-45cc-b1dc-c423cbd443fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=b51bea6b4a6f4aefb2dc04177e103f22)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:09.122618 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440a8038-40c3-45cc-b1dc-c423cbd443fa admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:09.209798 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 967/1919] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:09 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:12:09.226470 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffe5530-c03b-452e-9ff3-8083087ce12f None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:09.227848 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-7ffe5530-c03b-452e-9ff3-8083087ce12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:09.285059 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-440a8038-40c3-45cc-b1dc-c423cbd443fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b51bea6b4a6f4aefb2dc04177e103f22', 'request_id': 'req-440a8038-40c3-45cc-b1dc-c423cbd443fa'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:09.292587 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-440a8038-40c3-45cc-b1dc-c423cbd443fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b51bea6b4a6f4aefb2dc04177e103f22', 'request_id': 'req-440a8038-40c3-45cc-b1dc-c423cbd443fa'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:09.304013 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-440a8038-40c3-45cc-b1dc-c423cbd443fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b51bea6b4a6f4aefb2dc04177e103f22', 'request_id': 'req-440a8038-40c3-45cc-b1dc-c423cbd443fa'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:09.340718 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffe5530-c03b-452e-9ff3-8083087ce12f None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:09.396582 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-440a8038-40c3-45cc-b1dc-c423cbd443fa admin admin] The token cache is being invalidate because project b51bea6b4a6f4aefb2dc04177e103f22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:12:09.397000 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-440a8038-40c3-45cc-b1dc-c423cbd443fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:09.397951 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-440a8038-40c3-45cc-b1dc-c423cbd443fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:09.402380 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 953/1920] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:12:09 2022] DELETE /identity/v3/projects/b51bea6b4a6f4aefb2dc04177e103f22 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:12:09.405905 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a8038-40c3-45cc-b1dc-c423cbd443fa admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:09.407906 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-440a8038-40c3-45cc-b1dc-c423cbd443fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:09.444946 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18094117-e59d-49a7-9382-ce6f6cf642cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:09.445937 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18094117-e59d-49a7-9382-ce6f6cf642cd service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:09.446750 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18094117-e59d-49a7-9382-ce6f6cf642cd service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:09.446750 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18094117-e59d-49a7-9382-ce6f6cf642cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:09.449013 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-18094117-e59d-49a7-9382-ce6f6cf642cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:09.514307 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a8038-40c3-45cc-b1dc-c423cbd443fa admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:09.520561 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd06f2a-72bf-44fe-8c6a-a7c917d3366a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:09.521325 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd06f2a-72bf-44fe-8c6a-a7c917d3366a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:09.521673 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd06f2a-72bf-44fe-8c6a-a7c917d3366a admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:09.522220 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd06f2a-72bf-44fe-8c6a-a7c917d3366a admin admin] PATH_INFO: `/v3/users/68b64be896a9403888c05a33dfea02b9` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:09.523879 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd06f2a-72bf-44fe-8c6a-a7c917d3366a admin admin] RBAC: Authorizing `identity:delete_user(user_id=68b64be896a9403888c05a33dfea02b9)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:09.525854 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd06f2a-72bf-44fe-8c6a-a7c917d3366a admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:09.542927 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18094117-e59d-49a7-9382-ce6f6cf642cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:09.554876 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18094117-e59d-49a7-9382-ce6f6cf642cd service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:09.572851 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 968/1921] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:12:09 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:12:09.745606 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dbd06f2a-72bf-44fe-8c6a-a7c917d3366a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68b64be896a9403888c05a33dfea02b9'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:09.756336 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dbd06f2a-72bf-44fe-8c6a-a7c917d3366a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68b64be896a9403888c05a33dfea02b9'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:09.757410 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dbd06f2a-72bf-44fe-8c6a-a7c917d3366a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68b64be896a9403888c05a33dfea02b9'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:09.861634 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dbd06f2a-72bf-44fe-8c6a-a7c917d3366a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68b64be896a9403888c05a33dfea02b9'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:09.899200 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dbd06f2a-72bf-44fe-8c6a-a7c917d3366a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68b64be896a9403888c05a33dfea02b9'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:09.914648 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 954/1922] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:12:09 2022] DELETE /identity/v3/users/68b64be896a9403888c05a33dfea02b9 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:12:09.916474 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18094117-e59d-49a7-9382-ce6f6cf642cd service nova] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:09.919047 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-18094117-e59d-49a7-9382-ce6f6cf642cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:09.940581 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18094117-e59d-49a7-9382-ce6f6cf642cd service nova] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:10.022383 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56921e2d-42b4-4e74-9542-ce1fbf29442f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:10.023790 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56921e2d-42b4-4e74-9542-ce1fbf29442f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:10.024328 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56921e2d-42b4-4e74-9542-ce1fbf29442f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:10.024987 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56921e2d-42b4-4e74-9542-ce1fbf29442f admin admin] PATH_INFO: `/v3/users/5d238bf2bbec461083e6aad68486534b` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:10.026632 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56921e2d-42b4-4e74-9542-ce1fbf29442f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d238bf2bbec461083e6aad68486534b)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:10.029408 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56921e2d-42b4-4e74-9542-ce1fbf29442f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:10.289025 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-56921e2d-42b4-4e74-9542-ce1fbf29442f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d238bf2bbec461083e6aad68486534b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:10.333145 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-56921e2d-42b4-4e74-9542-ce1fbf29442f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d238bf2bbec461083e6aad68486534b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:10.348617 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-56921e2d-42b4-4e74-9542-ce1fbf29442f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d238bf2bbec461083e6aad68486534b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:10.417414 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-56921e2d-42b4-4e74-9542-ce1fbf29442f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d238bf2bbec461083e6aad68486534b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:10.419334 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-56921e2d-42b4-4e74-9542-ce1fbf29442f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d238bf2bbec461083e6aad68486534b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:10.430909 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 969/1923] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:12:09 2022] DELETE /identity/v3/users/5d238bf2bbec461083e6aad68486534b => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:10.435077 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24056899-aa31-45d9-8ec1-6820fad465ac None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:10.435686 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24056899-aa31-45d9-8ec1-6820fad465ac None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:10.435767 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24056899-aa31-45d9-8ec1-6820fad465ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:10.507613 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-24056899-aa31-45d9-8ec1-6820fad465ac None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:10.510148 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-24056899-aa31-45d9-8ec1-6820fad465ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:10.646171 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 955/1924] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:10.699204 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56921e2d-42b4-4e74-9542-ce1fbf29442f admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:10.701092 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-56921e2d-42b4-4e74-9542-ce1fbf29442f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:10.711774 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24056899-aa31-45d9-8ec1-6820fad465ac None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:10.713336 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-24056899-aa31-45d9-8ec1-6820fad465ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:10.820440 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56921e2d-42b4-4e74-9542-ce1fbf29442f admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:10.828034 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac19c8da-e669-4b73-9e63-433e0b4e5152 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:10.828858 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac19c8da-e669-4b73-9e63-433e0b4e5152 service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:10.829148 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac19c8da-e669-4b73-9e63-433e0b4e5152 service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:10.829429 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac19c8da-e669-4b73-9e63-433e0b4e5152 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:10.831338 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ac19c8da-e669-4b73-9e63-433e0b4e5152 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:10.833778 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24056899-aa31-45d9-8ec1-6820fad465ac None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:10.838485 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143576f8-3599-4841-b4c2-ccb66aa11817 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:10.839706 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143576f8-3599-4841-b4c2-ccb66aa11817 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:10.840170 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143576f8-3599-4841-b4c2-ccb66aa11817 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:10.840518 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143576f8-3599-4841-b4c2-ccb66aa11817 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:10.870587 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143576f8-3599-4841-b4c2-ccb66aa11817 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:10.877473 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143576f8-3599-4841-b4c2-ccb66aa11817 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:10.899243 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 956/1925] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:12:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:12:10.904883 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143576f8-3599-4841-b4c2-ccb66aa11817 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:10.907675 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-143576f8-3599-4841-b4c2-ccb66aa11817 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:10.962551 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143576f8-3599-4841-b4c2-ccb66aa11817 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:10.965008 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac19c8da-e669-4b73-9e63-433e0b4e5152 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:10.967445 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac19c8da-e669-4b73-9e63-433e0b4e5152 service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:10.969239 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639fdb05-4499-449f-be78-e0f03f35d736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:10.971875 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639fdb05-4499-449f-be78-e0f03f35d736 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:10.972496 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639fdb05-4499-449f-be78-e0f03f35d736 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:10.973108 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639fdb05-4499-449f-be78-e0f03f35d736 admin admin] PATH_INFO: `/v3/projects/1809ec840ff040de8bc3163c7e723838` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:10.980579 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639fdb05-4499-449f-be78-e0f03f35d736 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1809ec840ff040de8bc3163c7e723838)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:10.982983 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 970/1926] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:12:10 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:12:10.984272 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639fdb05-4499-449f-be78-e0f03f35d736 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:11.161349 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-639fdb05-4499-449f-be78-e0f03f35d736 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1809ec840ff040de8bc3163c7e723838', 'request_id': 'req-639fdb05-4499-449f-be78-e0f03f35d736'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:11.176032 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-639fdb05-4499-449f-be78-e0f03f35d736 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1809ec840ff040de8bc3163c7e723838', 'request_id': 'req-639fdb05-4499-449f-be78-e0f03f35d736'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:11.187380 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-639fdb05-4499-449f-be78-e0f03f35d736 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1809ec840ff040de8bc3163c7e723838', 'request_id': 'req-639fdb05-4499-449f-be78-e0f03f35d736'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:11.268593 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-639fdb05-4499-449f-be78-e0f03f35d736 admin admin] The token cache is being invalidate because project 1809ec840ff040de8bc3163c7e723838 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:12:11.269007 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-639fdb05-4499-449f-be78-e0f03f35d736 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:11.269868 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-639fdb05-4499-449f-be78-e0f03f35d736 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:11.272083 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 957/1927] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:12:10 2022] DELETE /identity/v3/projects/1809ec840ff040de8bc3163c7e723838 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:11.276967 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c52b79-43b9-436c-9964-718e8083c7dd None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:11.277692 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c52b79-43b9-436c-9964-718e8083c7dd None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:11.278136 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c52b79-43b9-436c-9964-718e8083c7dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:11.301746 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-12c52b79-43b9-436c-9964-718e8083c7dd None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:11.303667 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-12c52b79-43b9-436c-9964-718e8083c7dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:11.401114 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 971/1928] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:11.407548 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14519090-a926-4b23-a323-5cde6f28ca3f None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:11.407548 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14519090-a926-4b23-a323-5cde6f28ca3f None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:11.407548 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14519090-a926-4b23-a323-5cde6f28ca3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:11.433894 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-14519090-a926-4b23-a323-5cde6f28ca3f None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:11.436677 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-14519090-a926-4b23-a323-5cde6f28ca3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:11.452883 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 958/1929] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:12:11.455035 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c52b79-43b9-436c-9964-718e8083c7dd None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:11.466991 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c52b79-43b9-436c-9964-718e8083c7dd None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:11.475867 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89458772-dc54-4c9d-b9a0-c28f4fbc64d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:11.482137 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89458772-dc54-4c9d-b9a0-c28f4fbc64d6 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:11.482137 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89458772-dc54-4c9d-b9a0-c28f4fbc64d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:11.482137 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89458772-dc54-4c9d-b9a0-c28f4fbc64d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:11.482137 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89458772-dc54-4c9d-b9a0-c28f4fbc64d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:12:11.482137 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89458772-dc54-4c9d-b9a0-c28f4fbc64d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:11.482137 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89458772-dc54-4c9d-b9a0-c28f4fbc64d6 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:11.499589 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 972/1930] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:12:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:12:11.500809 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14519090-a926-4b23-a323-5cde6f28ca3f None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:11.520631 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89458772-dc54-4c9d-b9a0-c28f4fbc64d6 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:11.521322 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14519090-a926-4b23-a323-5cde6f28ca3f None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:11.523042 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-89458772-dc54-4c9d-b9a0-c28f4fbc64d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:11.533712 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce657a40-2a12-40d8-8df7-d182a1065d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:11.534716 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce657a40-2a12-40d8-8df7-d182a1065d1b admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:11.535209 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce657a40-2a12-40d8-8df7-d182a1065d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:11.535792 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce657a40-2a12-40d8-8df7-d182a1065d1b admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:11.537066 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce657a40-2a12-40d8-8df7-d182a1065d1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:11.540909 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce657a40-2a12-40d8-8df7-d182a1065d1b admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:11.570993 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89458772-dc54-4c9d-b9a0-c28f4fbc64d6 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:11.586148 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b3e30a-1d6d-46bb-aa01-0d3f74d10dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:11.587061 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3e30a-1d6d-46bb-aa01-0d3f74d10dba admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:11.587356 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3e30a-1d6d-46bb-aa01-0d3f74d10dba admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:11.587659 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3e30a-1d6d-46bb-aa01-0d3f74d10dba admin admin] PATH_INFO: `/v3/projects/07900cd943f749eda09005c560c237ac` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:11.589352 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b3e30a-1d6d-46bb-aa01-0d3f74d10dba admin admin] RBAC: Authorizing `identity:delete_project(project_id=07900cd943f749eda09005c560c237ac)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:11.593078 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b3e30a-1d6d-46bb-aa01-0d3f74d10dba admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:11.658813 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 959/1931] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:12:11 2022] POST /identity/v3/projects => generated 375 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:12:11.663269 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce657a40-2a12-40d8-8df7-d182a1065d1b admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:11.727952 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-50b3e30a-1d6d-46bb-aa01-0d3f74d10dba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07900cd943f749eda09005c560c237ac', 'request_id': 'req-50b3e30a-1d6d-46bb-aa01-0d3f74d10dba'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:11.733816 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-50b3e30a-1d6d-46bb-aa01-0d3f74d10dba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07900cd943f749eda09005c560c237ac', 'request_id': 'req-50b3e30a-1d6d-46bb-aa01-0d3f74d10dba'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:11.741326 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce657a40-2a12-40d8-8df7-d182a1065d1b admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:11.808817 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b328c061-3837-44d3-99b5-a88a8ce069ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:11.809614 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328c061-3837-44d3-99b5-a88a8ce069ec admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:11.809907 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328c061-3837-44d3-99b5-a88a8ce069ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:11.810187 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328c061-3837-44d3-99b5-a88a8ce069ec admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:11.810928 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b328c061-3837-44d3-99b5-a88a8ce069ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:11.812905 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b328c061-3837-44d3-99b5-a88a8ce069ec admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:11.815614 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-50b3e30a-1d6d-46bb-aa01-0d3f74d10dba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07900cd943f749eda09005c560c237ac', 'request_id': 'req-50b3e30a-1d6d-46bb-aa01-0d3f74d10dba'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:11.839169 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-50b3e30a-1d6d-46bb-aa01-0d3f74d10dba admin admin] The token cache is being invalidate because project 07900cd943f749eda09005c560c237ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:12:11.839617 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-50b3e30a-1d6d-46bb-aa01-0d3f74d10dba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:11.842133 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-50b3e30a-1d6d-46bb-aa01-0d3f74d10dba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:11.844371 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 973/1932] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:12:11 2022] DELETE /identity/v3/projects/07900cd943f749eda09005c560c237ac => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:11.848901 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b3e30a-1d6d-46bb-aa01-0d3f74d10dba admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:11.850607 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-50b3e30a-1d6d-46bb-aa01-0d3f74d10dba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:11.873591 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b3e30a-1d6d-46bb-aa01-0d3f74d10dba admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:11.879613 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0324747f-9ca2-4c22-acf7-33457ae87640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:11.880501 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0324747f-9ca2-4c22-acf7-33457ae87640 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:11.881158 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0324747f-9ca2-4c22-acf7-33457ae87640 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:11.881412 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0324747f-9ca2-4c22-acf7-33457ae87640 admin admin] PATH_INFO: `/v3/users/481d1d923d5a4debb2e6b439c64ab3b9` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:11.885219 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0324747f-9ca2-4c22-acf7-33457ae87640 admin admin] RBAC: Authorizing `identity:delete_user(user_id=481d1d923d5a4debb2e6b439c64ab3b9)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:11.887339 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0324747f-9ca2-4c22-acf7-33457ae87640 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:11.904418 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 960/1933] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:12:11 2022] POST /identity/v3/users => generated 288 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:12:11.906666 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b328c061-3837-44d3-99b5-a88a8ce069ec admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:11.908529 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b328c061-3837-44d3-99b5-a88a8ce069ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:11.922430 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b328c061-3837-44d3-99b5-a88a8ce069ec admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:11.933216 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d2a140-82cf-4deb-af4d-94a7287f8805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:11.934009 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2a140-82cf-4deb-af4d-94a7287f8805 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:11.934387 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2a140-82cf-4deb-af4d-94a7287f8805 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:11.934661 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2a140-82cf-4deb-af4d-94a7287f8805 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:11.935405 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d2a140-82cf-4deb-af4d-94a7287f8805 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:11.937102 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d2a140-82cf-4deb-af4d-94a7287f8805 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:11.954993 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 961/1934] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:12:11 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:12:11.956158 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d2a140-82cf-4deb-af4d-94a7287f8805 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:11.966823 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d2a140-82cf-4deb-af4d-94a7287f8805 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:11.972469 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc08b8f6-decd-4da3-bce3-6a45e7e9495a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:11.973425 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08b8f6-decd-4da3-bce3-6a45e7e9495a admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:11.973713 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08b8f6-decd-4da3-bce3-6a45e7e9495a admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:11.978386 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08b8f6-decd-4da3-bce3-6a45e7e9495a admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:11.978386 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc08b8f6-decd-4da3-bce3-6a45e7e9495a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:11.978386 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc08b8f6-decd-4da3-bce3-6a45e7e9495a admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:11.991813 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 962/1935] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:12:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:12:11.997525 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc08b8f6-decd-4da3-bce3-6a45e7e9495a admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:12.008544 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc08b8f6-decd-4da3-bce3-6a45e7e9495a admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:12.013187 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b421d6b-43d4-416f-8490-0aaed88d929f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:12.014070 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b421d6b-43d4-416f-8490-0aaed88d929f admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:12.014355 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b421d6b-43d4-416f-8490-0aaed88d929f admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:12.014629 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b421d6b-43d4-416f-8490-0aaed88d929f admin admin] PATH_INFO: `/v3/projects/35a0e2c4a9054b4b962b9bc72c64517c/users/5b93d6c3d03d407f8be4aa38e2fbb154/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:12.031247 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b421d6b-43d4-416f-8490-0aaed88d929f admin admin] RBAC: Authorizing `identity:create_grant(project_id=35a0e2c4a9054b4b962b9bc72c64517c, user_id=5b93d6c3d03d407f8be4aa38e2fbb154, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:12.034901 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b421d6b-43d4-416f-8490-0aaed88d929f admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:12.128906 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0324747f-9ca2-4c22-acf7-33457ae87640 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '481d1d923d5a4debb2e6b439c64ab3b9'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:12.140449 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 963/1936] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:12:11 2022] PUT /identity/v3/projects/35a0e2c4a9054b4b962b9bc72c64517c/users/5b93d6c3d03d407f8be4aa38e2fbb154/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:12.141431 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d74f6-d219-4ee8-8268-e0900d4372a5 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:12.141781 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d74f6-d219-4ee8-8268-e0900d4372a5 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:12.142058 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d74f6-d219-4ee8-8268-e0900d4372a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:12.160925 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0324747f-9ca2-4c22-acf7-33457ae87640 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '481d1d923d5a4debb2e6b439c64ab3b9'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:12.173120 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-fe7d74f6-d219-4ee8-8268-e0900d4372a5 None None] MFA Rules not processed for user `5b93d6c3d03d407f8be4aa38e2fbb154`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:12.174452 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-fe7d74f6-d219-4ee8-8268-e0900d4372a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:12.174835 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0324747f-9ca2-4c22-acf7-33457ae87640 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '481d1d923d5a4debb2e6b439c64ab3b9'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:12.245564 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 964/1937] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:12.251130 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7d74f6-d219-4ee8-8268-e0900d4372a5 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:12.255106 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0324747f-9ca2-4c22-acf7-33457ae87640 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '481d1d923d5a4debb2e6b439c64ab3b9'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:12.256082 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0324747f-9ca2-4c22-acf7-33457ae87640 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '481d1d923d5a4debb2e6b439c64ab3b9'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:12.262862 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 974/1938] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:12:11 2022] DELETE /identity/v3/users/481d1d923d5a4debb2e6b439c64ab3b9 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:12.341980 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7d74f6-d219-4ee8-8268-e0900d4372a5 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:12.409605 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5526476f-a58f-43ee-b923-83e23ecb340c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:12.410288 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526476f-a58f-43ee-b923-83e23ecb340c admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:12.410577 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526476f-a58f-43ee-b923-83e23ecb340c admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:12.410857 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526476f-a58f-43ee-b923-83e23ecb340c admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:12.411593 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5526476f-a58f-43ee-b923-83e23ecb340c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:12.415286 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5526476f-a58f-43ee-b923-83e23ecb340c admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:12.531670 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 965/1939] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:12:12 2022] POST /identity/v3/projects => generated 373 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:12:12.536379 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0324747f-9ca2-4c22-acf7-33457ae87640 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:12.537979 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-0324747f-9ca2-4c22-acf7-33457ae87640 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:12.552480 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0324747f-9ca2-4c22-acf7-33457ae87640 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:12.614992 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9017ddbf-90ab-42ab-b8b6-d29dc0a015e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:12.615652 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017ddbf-90ab-42ab-b8b6-d29dc0a015e6 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:12.615946 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017ddbf-90ab-42ab-b8b6-d29dc0a015e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:12.616222 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017ddbf-90ab-42ab-b8b6-d29dc0a015e6 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:12.616916 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9017ddbf-90ab-42ab-b8b6-d29dc0a015e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:12.618844 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9017ddbf-90ab-42ab-b8b6-d29dc0a015e6 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:12.740028 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 975/1940] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:12:12 2022] POST /identity/v3/users => generated 293 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:12:12.740920 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5526476f-a58f-43ee-b923-83e23ecb340c admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:12.753977 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5526476f-a58f-43ee-b923-83e23ecb340c admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:12.764016 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9404414e-0a0a-4e01-9045-889a2590cb31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:12.764641 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9404414e-0a0a-4e01-9045-889a2590cb31 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:12.764930 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9404414e-0a0a-4e01-9045-889a2590cb31 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:12.765209 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9404414e-0a0a-4e01-9045-889a2590cb31 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:12.766004 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9404414e-0a0a-4e01-9045-889a2590cb31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:12.768480 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9404414e-0a0a-4e01-9045-889a2590cb31 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:12.784862 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 966/1941] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:12:12 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:12:12.786213 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9017ddbf-90ab-42ab-b8b6-d29dc0a015e6 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:12.796570 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9017ddbf-90ab-42ab-b8b6-d29dc0a015e6 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:12.802306 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8538553c-2d95-40ae-90b8-ff20ba51fe9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:12.804434 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538553c-2d95-40ae-90b8-ff20ba51fe9b admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:12.804736 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538553c-2d95-40ae-90b8-ff20ba51fe9b admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:12.805007 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538553c-2d95-40ae-90b8-ff20ba51fe9b admin admin] PATH_INFO: `/v3/projects/8a4ed51cf6684302bed4497b2547ef09/users/9847c635058343c096bb44d95e70bc82/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:12.819673 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9404414e-0a0a-4e01-9045-889a2590cb31 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:12.821414 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-9404414e-0a0a-4e01-9045-889a2590cb31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:12.833235 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8538553c-2d95-40ae-90b8-ff20ba51fe9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a4ed51cf6684302bed4497b2547ef09, user_id=9847c635058343c096bb44d95e70bc82, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:12.840938 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8538553c-2d95-40ae-90b8-ff20ba51fe9b admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:12.848887 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9404414e-0a0a-4e01-9045-889a2590cb31 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:12.854481 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55285b7-7b17-4ae3-a2e2-928b33d91740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:12.855437 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55285b7-7b17-4ae3-a2e2-928b33d91740 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:12.855760 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55285b7-7b17-4ae3-a2e2-928b33d91740 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:12.856041 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55285b7-7b17-4ae3-a2e2-928b33d91740 admin admin] PATH_INFO: `/v3/projects/0a18ba6671854269bfe9ebfb710e9a8c` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:12.861993 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55285b7-7b17-4ae3-a2e2-928b33d91740 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a18ba6671854269bfe9ebfb710e9a8c)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:12.865471 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55285b7-7b17-4ae3-a2e2-928b33d91740 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:12.923557 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 976/1942] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:12:12 2022] PUT /identity/v3/projects/8a4ed51cf6684302bed4497b2547ef09/users/9847c635058343c096bb44d95e70bc82/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:12.930327 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8538553c-2d95-40ae-90b8-ff20ba51fe9b admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:13.012984 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8538553c-2d95-40ae-90b8-ff20ba51fe9b admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:13.022512 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e6fb36-d14b-48fa-81d1-a3fe2e8a2e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:13.023198 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e6fb36-d14b-48fa-81d1-a3fe2e8a2e51 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:13.023595 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e6fb36-d14b-48fa-81d1-a3fe2e8a2e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:13.023877 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e6fb36-d14b-48fa-81d1-a3fe2e8a2e51 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:13.024830 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e6fb36-d14b-48fa-81d1-a3fe2e8a2e51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:13.026533 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e6fb36-d14b-48fa-81d1-a3fe2e8a2e51 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:13.039544 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 977/1943] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:12:12 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:12:13.043016 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e6fb36-d14b-48fa-81d1-a3fe2e8a2e51 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:13.058882 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e6fb36-d14b-48fa-81d1-a3fe2e8a2e51 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:13.059647 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b55285b7-7b17-4ae3-a2e2-928b33d91740 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a18ba6671854269bfe9ebfb710e9a8c', 'request_id': 'req-b55285b7-7b17-4ae3-a2e2-928b33d91740'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:13.070957 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b55285b7-7b17-4ae3-a2e2-928b33d91740 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a18ba6671854269bfe9ebfb710e9a8c', 'request_id': 'req-b55285b7-7b17-4ae3-a2e2-928b33d91740'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:13.082335 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b55285b7-7b17-4ae3-a2e2-928b33d91740 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a18ba6671854269bfe9ebfb710e9a8c', 'request_id': 'req-b55285b7-7b17-4ae3-a2e2-928b33d91740'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:13.126131 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a7c9d7-56b5-4c10-9e7b-6b26c3774870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:13.126998 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a7c9d7-56b5-4c10-9e7b-6b26c3774870 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:13.127496 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a7c9d7-56b5-4c10-9e7b-6b26c3774870 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:13.127855 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a7c9d7-56b5-4c10-9e7b-6b26c3774870 admin admin] PATH_INFO: `/v3/projects/8a4ed51cf6684302bed4497b2547ef09/users/9847c635058343c096bb44d95e70bc82/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:13.129975 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a7c9d7-56b5-4c10-9e7b-6b26c3774870 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a4ed51cf6684302bed4497b2547ef09, user_id=9847c635058343c096bb44d95e70bc82, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:13.133083 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a7c9d7-56b5-4c10-9e7b-6b26c3774870 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:13.144223 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 978/1944] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:12:13 2022] PUT /identity/v3/projects/8a4ed51cf6684302bed4497b2547ef09/users/9847c635058343c096bb44d95e70bc82/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:13.155924 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c66f9-58dd-4c6b-b1d6-aa64919703da None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:13.156215 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c66f9-58dd-4c6b-b1d6-aa64919703da None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:13.156575 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c66f9-58dd-4c6b-b1d6-aa64919703da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:13.180676 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b55285b7-7b17-4ae3-a2e2-928b33d91740 admin admin] The token cache is being invalidate because project 0a18ba6671854269bfe9ebfb710e9a8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:12:13.181077 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b55285b7-7b17-4ae3-a2e2-928b33d91740 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:13.181722 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b55285b7-7b17-4ae3-a2e2-928b33d91740 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:13.183450 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 967/1945] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:12:12 2022] DELETE /identity/v3/projects/0a18ba6671854269bfe9ebfb710e9a8c => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:13.187418 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-897c66f9-58dd-4c6b-b1d6-aa64919703da None None] MFA Rules not processed for user `9847c635058343c096bb44d95e70bc82`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:13.189611 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-897c66f9-58dd-4c6b-b1d6-aa64919703da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:13.192287 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4aacb-d377-4eb6-aa60-a97948a0164e None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:13.192576 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4aacb-d377-4eb6-aa60-a97948a0164e None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:13.192851 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4aacb-d377-4eb6-aa60-a97948a0164e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:13.212566 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-9ca4aacb-d377-4eb6-aa60-a97948a0164e None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:13.213838 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-9ca4aacb-d377-4eb6-aa60-a97948a0164e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:13.272970 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 979/1946] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:13 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:12:13.280009 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 968/1947] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:13.284001 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba011d1-aaf4-40af-b990-36cdb87bfd90 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:13.284353 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba011d1-aaf4-40af-b990-36cdb87bfd90 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:13.284911 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba011d1-aaf4-40af-b990-36cdb87bfd90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:13.287948 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea89fb74-6b9f-47d4-98df-864ce690adb6 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:13.288246 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea89fb74-6b9f-47d4-98df-864ce690adb6 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:13.288528 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea89fb74-6b9f-47d4-98df-864ce690adb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:13.306184 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-5ba011d1-aaf4-40af-b990-36cdb87bfd90 None None] MFA Rules not processed for user `5b93d6c3d03d407f8be4aa38e2fbb154`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:13.307392 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-5ba011d1-aaf4-40af-b990-36cdb87bfd90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:13.311362 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-ea89fb74-6b9f-47d4-98df-864ce690adb6 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:13.311362 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-ea89fb74-6b9f-47d4-98df-864ce690adb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:13.321622 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 969/1948] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:12:13.325690 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea89fb74-6b9f-47d4-98df-864ce690adb6 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:13.335596 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea89fb74-6b9f-47d4-98df-864ce690adb6 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:13.340804 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f4ac07-03f9-481d-975e-293d765a626e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:13.341073 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4ac07-03f9-481d-975e-293d765a626e admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:13.341353 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4ac07-03f9-481d-975e-293d765a626e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:13.341637 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4ac07-03f9-481d-975e-293d765a626e admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:13.342364 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f4ac07-03f9-481d-975e-293d765a626e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:12:13.342671 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f4ac07-03f9-481d-975e-293d765a626e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:13.345011 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f4ac07-03f9-481d-975e-293d765a626e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:13.357849 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 970/1949] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:12:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:12:13.362905 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f4ac07-03f9-481d-975e-293d765a626e admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:13.374090 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 980/1950] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:13.380502 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f4ac07-03f9-481d-975e-293d765a626e admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:13.386219 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba011d1-aaf4-40af-b990-36cdb87bfd90 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:13.387996 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93644e02-ec93-4592-922d-4589779a96df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:13.388411 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-5ba011d1-aaf4-40af-b990-36cdb87bfd90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:13.388902 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93644e02-ec93-4592-922d-4589779a96df admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:13.389292 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93644e02-ec93-4592-922d-4589779a96df admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:13.389721 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93644e02-ec93-4592-922d-4589779a96df admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:13.390556 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93644e02-ec93-4592-922d-4589779a96df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:13.393605 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93644e02-ec93-4592-922d-4589779a96df admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:13.473192 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba011d1-aaf4-40af-b990-36cdb87bfd90 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:13.478912 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a422067-c5ee-4331-8350-b52a88b74188 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:13.479601 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a422067-c5ee-4331-8350-b52a88b74188 service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:13.479892 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a422067-c5ee-4331-8350-b52a88b74188 service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:13.480173 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a422067-c5ee-4331-8350-b52a88b74188 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:13.486797 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-5a422067-c5ee-4331-8350-b52a88b74188 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:13.493434 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 971/1951] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:12:13 2022] POST /identity/v3/projects => generated 409 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:12:13.494623 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93644e02-ec93-4592-922d-4589779a96df admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:13.498325 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a422067-c5ee-4331-8350-b52a88b74188 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:13.500318 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a422067-c5ee-4331-8350-b52a88b74188 service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:13.510853 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 981/1952] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:12:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:12:13.567552 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93644e02-ec93-4592-922d-4589779a96df admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:13.579584 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8441e9d7-daeb-4760-aad1-aaa73011d949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:13.580285 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441e9d7-daeb-4760-aad1-aaa73011d949 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:13.580555 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441e9d7-daeb-4760-aad1-aaa73011d949 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:13.580829 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441e9d7-daeb-4760-aad1-aaa73011d949 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:13.581550 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8441e9d7-daeb-4760-aad1-aaa73011d949 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:13.583459 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8441e9d7-daeb-4760-aad1-aaa73011d949 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:13.695015 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 972/1953] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:12:13 2022] POST /identity/v3/users => generated 305 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:12:13.699199 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a422067-c5ee-4331-8350-b52a88b74188 service nova] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:13.710574 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a422067-c5ee-4331-8350-b52a88b74188 service nova] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:13.715863 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2d76dc-b332-4327-9dcc-3a422badda2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:13.716549 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d76dc-b332-4327-9dcc-3a422badda2e admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:13.716836 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d76dc-b332-4327-9dcc-3a422badda2e admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:13.717114 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d76dc-b332-4327-9dcc-3a422badda2e admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:13.717859 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2d76dc-b332-4327-9dcc-3a422badda2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:13.719521 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2d76dc-b332-4327-9dcc-3a422badda2e admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:13.731817 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 982/1954] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:12:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:12:13.734403 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8441e9d7-daeb-4760-aad1-aaa73011d949 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:13.745993 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8441e9d7-daeb-4760-aad1-aaa73011d949 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:13.756757 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d42e9f3-9c11-4dc3-958c-2bee09b92970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:13.757450 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42e9f3-9c11-4dc3-958c-2bee09b92970 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:13.757736 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42e9f3-9c11-4dc3-958c-2bee09b92970 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:13.758014 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42e9f3-9c11-4dc3-958c-2bee09b92970 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:13.760768 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d42e9f3-9c11-4dc3-958c-2bee09b92970 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:13.760768 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d42e9f3-9c11-4dc3-958c-2bee09b92970 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:13.774687 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 973/1955] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:12:13 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:12:13.775780 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2d76dc-b332-4327-9dcc-3a422badda2e admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:13.786139 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2d76dc-b332-4327-9dcc-3a422badda2e admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:13.791507 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2f5f1b-3003-45f7-986e-387fe1e56fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:13.792417 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2f5f1b-3003-45f7-986e-387fe1e56fde admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:13.792758 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2f5f1b-3003-45f7-986e-387fe1e56fde admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:13.793068 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2f5f1b-3003-45f7-986e-387fe1e56fde admin admin] PATH_INFO: `/v3/projects/b95b9f9f7fbd4c0583841a5fcac655bf/users/0fda09f388884efaa038bd40c6d8c418/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:13.809515 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2f5f1b-3003-45f7-986e-387fe1e56fde admin admin] RBAC: Authorizing `identity:create_grant(project_id=b95b9f9f7fbd4c0583841a5fcac655bf, user_id=0fda09f388884efaa038bd40c6d8c418, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:13.815148 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2f5f1b-3003-45f7-986e-387fe1e56fde admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:13.937862 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 983/1956] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:12:13 2022] PUT /identity/v3/projects/b95b9f9f7fbd4c0583841a5fcac655bf/users/0fda09f388884efaa038bd40c6d8c418/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:12:13.950030 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2539646b-6074-4d91-b6f3-2a92e39d15b9 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:13.950318 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2539646b-6074-4d91-b6f3-2a92e39d15b9 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:13.950656 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2539646b-6074-4d91-b6f3-2a92e39d15b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:13.979512 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-2539646b-6074-4d91-b6f3-2a92e39d15b9 None None] MFA Rules not processed for user `0fda09f388884efaa038bd40c6d8c418`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:13.980724 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-2539646b-6074-4d91-b6f3-2a92e39d15b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:14.080261 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 974/1957] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:13 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:14.084716 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2f5f1b-3003-45f7-986e-387fe1e56fde admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:14.179747 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2f5f1b-3003-45f7-986e-387fe1e56fde admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:14.193579 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb29815-01a7-49d3-9935-00a7ce9d0eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:14.194270 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb29815-01a7-49d3-9935-00a7ce9d0eb7 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:14.194555 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb29815-01a7-49d3-9935-00a7ce9d0eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:14.194835 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb29815-01a7-49d3-9935-00a7ce9d0eb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:14.195557 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb29815-01a7-49d3-9935-00a7ce9d0eb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:14.197489 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb29815-01a7-49d3-9935-00a7ce9d0eb7 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:14.293022 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 984/1958] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:12:14 2022] POST /identity/v3/projects => generated 409 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:12:14.299954 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2539646b-6074-4d91-b6f3-2a92e39d15b9 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:14.319223 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2539646b-6074-4d91-b6f3-2a92e39d15b9 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:14.408719 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3c79eb-33ce-4823-a418-5010a95d0439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:14.409504 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c79eb-33ce-4823-a418-5010a95d0439 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:14.409855 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c79eb-33ce-4823-a418-5010a95d0439 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:14.410204 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c79eb-33ce-4823-a418-5010a95d0439 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:14.411122 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3c79eb-33ce-4823-a418-5010a95d0439 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:14.414362 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3c79eb-33ce-4823-a418-5010a95d0439 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:14.567131 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 975/1959] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:12:14 2022] POST /identity/v3/users => generated 311 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:12:14.568209 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb29815-01a7-49d3-9935-00a7ce9d0eb7 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:14.581304 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb29815-01a7-49d3-9935-00a7ce9d0eb7 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:14.586364 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcee6ebb-b694-48a3-8b58-ca74bb93e7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:14.587038 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee6ebb-b694-48a3-8b58-ca74bb93e7f8 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:14.587316 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee6ebb-b694-48a3-8b58-ca74bb93e7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:14.587642 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee6ebb-b694-48a3-8b58-ca74bb93e7f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:14.588370 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcee6ebb-b694-48a3-8b58-ca74bb93e7f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:14.590196 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcee6ebb-b694-48a3-8b58-ca74bb93e7f8 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:14.605149 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 985/1960] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:12:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:12:14.606345 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3c79eb-33ce-4823-a418-5010a95d0439 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:14.618702 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3c79eb-33ce-4823-a418-5010a95d0439 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:14.624782 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de1f4c-a95e-4841-accc-cabaa740fe3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:14.626138 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de1f4c-a95e-4841-accc-cabaa740fe3d admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:14.626736 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de1f4c-a95e-4841-accc-cabaa740fe3d admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:14.627062 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de1f4c-a95e-4841-accc-cabaa740fe3d admin admin] PATH_INFO: `/v3/projects/7e6b293613e54e6e81db74bb1880d696/users/84299f967d3444bea04c395235740a94/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:14.645536 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66de1f4c-a95e-4841-accc-cabaa740fe3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e6b293613e54e6e81db74bb1880d696, user_id=84299f967d3444bea04c395235740a94, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:14.648351 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66de1f4c-a95e-4841-accc-cabaa740fe3d admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:14.753268 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 976/1961] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:12:14 2022] PUT /identity/v3/projects/7e6b293613e54e6e81db74bb1880d696/users/84299f967d3444bea04c395235740a94/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:12:14.757540 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcee6ebb-b694-48a3-8b58-ca74bb93e7f8 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:14.768969 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcee6ebb-b694-48a3-8b58-ca74bb93e7f8 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:14.829112 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211c1b49-e23f-4b7a-8a7c-9ca13dab5b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:14.829681 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c1b49-e23f-4b7a-8a7c-9ca13dab5b3f admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:14.829964 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c1b49-e23f-4b7a-8a7c-9ca13dab5b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:14.830245 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c1b49-e23f-4b7a-8a7c-9ca13dab5b3f admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:14.830964 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211c1b49-e23f-4b7a-8a7c-9ca13dab5b3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:14.832620 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211c1b49-e23f-4b7a-8a7c-9ca13dab5b3f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:14.842900 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 986/1962] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:12:14 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:12:14.848112 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de1f4c-a95e-4841-accc-cabaa740fe3d admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:14.858457 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de1f4c-a95e-4841-accc-cabaa740fe3d admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:14.864319 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9d32a0-77df-4ed3-9e55-5910c0a6585b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:14.865279 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d32a0-77df-4ed3-9e55-5910c0a6585b admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:14.865546 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d32a0-77df-4ed3-9e55-5910c0a6585b admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:14.865822 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d32a0-77df-4ed3-9e55-5910c0a6585b admin admin] PATH_INFO: `/v3/projects/7e6b293613e54e6e81db74bb1880d696/users/84299f967d3444bea04c395235740a94/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:14.867896 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9d32a0-77df-4ed3-9e55-5910c0a6585b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e6b293613e54e6e81db74bb1880d696, user_id=84299f967d3444bea04c395235740a94, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:14.870572 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9d32a0-77df-4ed3-9e55-5910c0a6585b admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:14.890955 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 977/1963] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:12:14 2022] PUT /identity/v3/projects/7e6b293613e54e6e81db74bb1880d696/users/84299f967d3444bea04c395235740a94/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:14.894821 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1745f0b-3b7c-4dae-ab13-d03bbbf70128 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:14.895120 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1745f0b-3b7c-4dae-ab13-d03bbbf70128 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:14.895398 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1745f0b-3b7c-4dae-ab13-d03bbbf70128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:14.927541 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-c1745f0b-3b7c-4dae-ab13-d03bbbf70128 None None] MFA Rules not processed for user `84299f967d3444bea04c395235740a94`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:14.927541 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c1745f0b-3b7c-4dae-ab13-d03bbbf70128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:15.003387 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 987/1964] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:14 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:15.014760 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9d32a0-77df-4ed3-9e55-5910c0a6585b admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:15.073045 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e0ed8-8a1a-41f9-bb6e-f8601ddba6a7 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:15.073045 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e0ed8-8a1a-41f9-bb6e-f8601ddba6a7 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:15.075919 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e0ed8-8a1a-41f9-bb6e-f8601ddba6a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:15.107403 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-bf6e0ed8-8a1a-41f9-bb6e-f8601ddba6a7 None None] MFA Rules not processed for user `99ed32a6d699453bb7e088540e8fc980`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:15.109121 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-bf6e0ed8-8a1a-41f9-bb6e-f8601ddba6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:15.171028 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9d32a0-77df-4ed3-9e55-5910c0a6585b admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:15.203516 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eb5826-f7e8-4907-b607-11ca85d71a6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:15.205213 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb5826-f7e8-4907-b607-11ca85d71a6c service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:15.205499 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb5826-f7e8-4907-b607-11ca85d71a6c service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:15.205777 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb5826-f7e8-4907-b607-11ca85d71a6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:15.225145 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 988/1965] 10.222.0.36 () {58 vars in 1015 bytes} [Sat May 14 21:12:15 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:15.233103 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eb5826-f7e8-4907-b607-11ca85d71a6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:15.236508 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eb5826-f7e8-4907-b607-11ca85d71a6c service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:15.252030 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 978/1966] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:12:15 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:12:15.362439 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6e0ed8-8a1a-41f9-bb6e-f8601ddba6a7 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:15.363989 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-bf6e0ed8-8a1a-41f9-bb6e-f8601ddba6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:15.379746 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eb5826-f7e8-4907-b607-11ca85d71a6c service nova] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:15.380713 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6e0ed8-8a1a-41f9-bb6e-f8601ddba6a7 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:15.385583 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c112ce-d008-4280-b11f-66abb71e98e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:15.386795 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c112ce-d008-4280-b11f-66abb71e98e8 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:15.387170 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c112ce-d008-4280-b11f-66abb71e98e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:15.387581 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c112ce-d008-4280-b11f-66abb71e98e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:15.397728 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eb5826-f7e8-4907-b607-11ca85d71a6c service nova] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:15.411766 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c112ce-d008-4280-b11f-66abb71e98e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:15.411766 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c112ce-d008-4280-b11f-66abb71e98e8 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:15.414463 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf25f359-788c-474a-ae5e-2513667b9509 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:15.416485 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf25f359-788c-474a-ae5e-2513667b9509 service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:15.416485 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf25f359-788c-474a-ae5e-2513667b9509 service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:15.416485 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf25f359-788c-474a-ae5e-2513667b9509 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:15.419366 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 989/1967] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:12:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:12:15.512035 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf25f359-788c-474a-ae5e-2513667b9509 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:15.513724 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf25f359-788c-474a-ae5e-2513667b9509 service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:15.525523 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 979/1968] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:12:15 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:12:15.877960 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c112ce-d008-4280-b11f-66abb71e98e8 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:15.943826 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c112ce-d008-4280-b11f-66abb71e98e8 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:15.948513 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca18b58-1609-4ca4-b3f1-4ce41e398822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:15.949362 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca18b58-1609-4ca4-b3f1-4ce41e398822 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:15.949642 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca18b58-1609-4ca4-b3f1-4ce41e398822 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:15.949912 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca18b58-1609-4ca4-b3f1-4ce41e398822 admin admin] PATH_INFO: `/v3/users/0fda09f388884efaa038bd40c6d8c418` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:15.951086 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca18b58-1609-4ca4-b3f1-4ce41e398822 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fda09f388884efaa038bd40c6d8c418)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:15.953090 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca18b58-1609-4ca4-b3f1-4ce41e398822 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:16.181388 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-fca18b58-1609-4ca4-b3f1-4ce41e398822 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fda09f388884efaa038bd40c6d8c418'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:16.201922 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-fca18b58-1609-4ca4-b3f1-4ce41e398822 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fda09f388884efaa038bd40c6d8c418'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:16.209674 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-fca18b58-1609-4ca4-b3f1-4ce41e398822 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fda09f388884efaa038bd40c6d8c418'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:16.295099 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-fca18b58-1609-4ca4-b3f1-4ce41e398822 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fda09f388884efaa038bd40c6d8c418'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:16.295787 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-fca18b58-1609-4ca4-b3f1-4ce41e398822 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fda09f388884efaa038bd40c6d8c418'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:16.308517 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 990/1969] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:12:15 2022] DELETE /identity/v3/users/0fda09f388884efaa038bd40c6d8c418 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:16.312845 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355677c-43dc-4e6e-84eb-af90750430c9 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:16.313381 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355677c-43dc-4e6e-84eb-af90750430c9 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:16.313381 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355677c-43dc-4e6e-84eb-af90750430c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:16.340454 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-e355677c-43dc-4e6e-84eb-af90750430c9 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:16.343933 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e355677c-43dc-4e6e-84eb-af90750430c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:16.460131 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 980/1970] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:16.471086 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca18b58-1609-4ca4-b3f1-4ce41e398822 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:16.473171 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-fca18b58-1609-4ca4-b3f1-4ce41e398822 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:16.546672 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca18b58-1609-4ca4-b3f1-4ce41e398822 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:16.549221 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5189d2-f557-4d30-b986-199dfe4e7492 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:16.549880 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5189d2-f557-4d30-b986-199dfe4e7492 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:16.550161 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5189d2-f557-4d30-b986-199dfe4e7492 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:16.550426 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5189d2-f557-4d30-b986-199dfe4e7492 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:16.560031 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5189d2-f557-4d30-b986-199dfe4e7492 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:16.561473 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5189d2-f557-4d30-b986-199dfe4e7492 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:16.573256 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 991/1971] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:12:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:12:16.740329 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3749ee6a-708b-4663-a359-14bb10a9e137 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:16.740668 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3749ee6a-708b-4663-a359-14bb10a9e137 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:16.745873 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3749ee6a-708b-4663-a359-14bb10a9e137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:16.767580 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-3749ee6a-708b-4663-a359-14bb10a9e137 None None] MFA Rules not processed for user `7d7d10a70c364505af3b2b8294238615`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:16.769307 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-3749ee6a-708b-4663-a359-14bb10a9e137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:16.833676 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 981/1972] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:17.322116 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5189d2-f557-4d30-b986-199dfe4e7492 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:17.323143 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-eb5189d2-f557-4d30-b986-199dfe4e7492 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:17.340959 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5189d2-f557-4d30-b986-199dfe4e7492 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:17.348152 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a595cfef-cf28-4aed-88a4-707b5471a8f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:17.349531 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a595cfef-cf28-4aed-88a4-707b5471a8f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:17.355037 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a595cfef-cf28-4aed-88a4-707b5471a8f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:17.355037 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a595cfef-cf28-4aed-88a4-707b5471a8f3 admin admin] PATH_INFO: `/v3/projects/b95b9f9f7fbd4c0583841a5fcac655bf` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:17.355037 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a595cfef-cf28-4aed-88a4-707b5471a8f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b95b9f9f7fbd4c0583841a5fcac655bf)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:17.355037 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a595cfef-cf28-4aed-88a4-707b5471a8f3 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:17.589602 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a595cfef-cf28-4aed-88a4-707b5471a8f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b95b9f9f7fbd4c0583841a5fcac655bf', 'request_id': 'req-a595cfef-cf28-4aed-88a4-707b5471a8f3'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:17.614618 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a595cfef-cf28-4aed-88a4-707b5471a8f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b95b9f9f7fbd4c0583841a5fcac655bf', 'request_id': 'req-a595cfef-cf28-4aed-88a4-707b5471a8f3'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:17.678712 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a595cfef-cf28-4aed-88a4-707b5471a8f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b95b9f9f7fbd4c0583841a5fcac655bf', 'request_id': 'req-a595cfef-cf28-4aed-88a4-707b5471a8f3'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:17.692986 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a595cfef-cf28-4aed-88a4-707b5471a8f3 admin admin] The token cache is being invalidate because project b95b9f9f7fbd4c0583841a5fcac655bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:12:17.693276 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a595cfef-cf28-4aed-88a4-707b5471a8f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:17.694075 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a595cfef-cf28-4aed-88a4-707b5471a8f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:17.696999 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 992/1973] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:12:17 2022] DELETE /identity/v3/projects/b95b9f9f7fbd4c0583841a5fcac655bf => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:17.700907 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3749ee6a-708b-4663-a359-14bb10a9e137 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:17.712677 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3749ee6a-708b-4663-a359-14bb10a9e137 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:17.795803 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a67004-00d7-40a7-8ae0-c8b32242ce2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:17.797980 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a67004-00d7-40a7-8ae0-c8b32242ce2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:17.798747 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a67004-00d7-40a7-8ae0-c8b32242ce2d admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:17.799228 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a67004-00d7-40a7-8ae0-c8b32242ce2d admin admin] PATH_INFO: `/v3/users/84299f967d3444bea04c395235740a94` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:17.800878 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a67004-00d7-40a7-8ae0-c8b32242ce2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=84299f967d3444bea04c395235740a94)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:17.803201 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a67004-00d7-40a7-8ae0-c8b32242ce2d admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:18.006344 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d2a67004-00d7-40a7-8ae0-c8b32242ce2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84299f967d3444bea04c395235740a94'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:18.015503 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d2a67004-00d7-40a7-8ae0-c8b32242ce2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84299f967d3444bea04c395235740a94'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:18.016296 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d2a67004-00d7-40a7-8ae0-c8b32242ce2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84299f967d3444bea04c395235740a94'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:18.106285 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d2a67004-00d7-40a7-8ae0-c8b32242ce2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84299f967d3444bea04c395235740a94'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:18.120606 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d2a67004-00d7-40a7-8ae0-c8b32242ce2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84299f967d3444bea04c395235740a94'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:18.128365 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 982/1974] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:12:17 2022] DELETE /identity/v3/users/84299f967d3444bea04c395235740a94 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:18.622867 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a595cfef-cf28-4aed-88a4-707b5471a8f3 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:18.624041 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-a595cfef-cf28-4aed-88a4-707b5471a8f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:18.640449 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a595cfef-cf28-4aed-88a4-707b5471a8f3 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:18.727597 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e80771-a199-4056-9ba2-502a7a47660d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:18.728468 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e80771-a199-4056-9ba2-502a7a47660d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:18.728761 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e80771-a199-4056-9ba2-502a7a47660d admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:18.728895 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b346d6a0-1b2b-43f0-a800-b14b5437c2a5 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:18.729343 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b346d6a0-1b2b-43f0-a800-b14b5437c2a5 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:18.729432 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e80771-a199-4056-9ba2-502a7a47660d admin admin] PATH_INFO: `/v3/projects/7e6b293613e54e6e81db74bb1880d696` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:18.729531 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b346d6a0-1b2b-43f0-a800-b14b5437c2a5 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:18.730555 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e80771-a199-4056-9ba2-502a7a47660d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e6b293613e54e6e81db74bb1880d696)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:18.730792 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 983/1975] 10.222.0.52 () {54 vars in 912 bytes} [Sat May 14 21:12:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:12:18.733198 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e80771-a199-4056-9ba2-502a7a47660d admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:18.737642 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193deaf7-307a-4e6e-a1da-45500e0c4cdd None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:18.738140 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193deaf7-307a-4e6e-a1da-45500e0c4cdd None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:18.738560 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193deaf7-307a-4e6e-a1da-45500e0c4cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:18.789262 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-193deaf7-307a-4e6e-a1da-45500e0c4cdd None None] MFA Rules not processed for user `0812ae67e44d483baf2dbb1a5332a1d7`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:18.790724 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-193deaf7-307a-4e6e-a1da-45500e0c4cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:18.872712 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-01e80771-a199-4056-9ba2-502a7a47660d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e6b293613e54e6e81db74bb1880d696', 'request_id': 'req-01e80771-a199-4056-9ba2-502a7a47660d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:18.879742 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 984/1976] 10.222.0.52 () {58 vars in 1009 bytes} [Sat May 14 21:12:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:12:18.881361 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-01e80771-a199-4056-9ba2-502a7a47660d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e6b293613e54e6e81db74bb1880d696', 'request_id': 'req-01e80771-a199-4056-9ba2-502a7a47660d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:18.913724 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193deaf7-307a-4e6e-a1da-45500e0c4cdd None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:18.919739 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-193deaf7-307a-4e6e-a1da-45500e0c4cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:18.943943 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193deaf7-307a-4e6e-a1da-45500e0c4cdd None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:18.975630 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-01e80771-a199-4056-9ba2-502a7a47660d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e6b293613e54e6e81db74bb1880d696', 'request_id': 'req-01e80771-a199-4056-9ba2-502a7a47660d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:18.998198 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-01e80771-a199-4056-9ba2-502a7a47660d admin admin] The token cache is being invalidate because project 7e6b293613e54e6e81db74bb1880d696 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:12:18.998553 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-01e80771-a199-4056-9ba2-502a7a47660d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:18.999265 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-01e80771-a199-4056-9ba2-502a7a47660d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:19.003936 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 993/1977] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:12:18 2022] DELETE /identity/v3/projects/7e6b293613e54e6e81db74bb1880d696 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:19.009097 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c3dd5-4ffe-4634-bca5-f7d947ebe836 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:19.009606 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c3dd5-4ffe-4634-bca5-f7d947ebe836 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:19.010043 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c3dd5-4ffe-4634-bca5-f7d947ebe836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:19.049932 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-c38c3dd5-4ffe-4634-bca5-f7d947ebe836 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:19.052187 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c38c3dd5-4ffe-4634-bca5-f7d947ebe836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:19.081606 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380c1a70-2051-4683-99ef-faa3e6f5b464 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:19.082276 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c1a70-2051-4683-99ef-faa3e6f5b464 service placement] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:19.082557 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c1a70-2051-4683-99ef-faa3e6f5b464 service placement] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:19.082829 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c1a70-2051-4683-99ef-faa3e6f5b464 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:19.090068 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-380c1a70-2051-4683-99ef-faa3e6f5b464 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:19.110098 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380c1a70-2051-4683-99ef-faa3e6f5b464 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:19.112640 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380c1a70-2051-4683-99ef-faa3e6f5b464 service placement] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:19.136853 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 985/1978] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:12:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:12:19.202662 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 994/1979] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:12:19.211303 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cdcb80-ced7-43fe-8754-ec8a98859363 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:19.211912 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cdcb80-ced7-43fe-8754-ec8a98859363 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:19.212237 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cdcb80-ced7-43fe-8754-ec8a98859363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:19.234559 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-38cdcb80-ced7-43fe-8754-ec8a98859363 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:19.235938 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-38cdcb80-ced7-43fe-8754-ec8a98859363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:19.244618 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 986/1980] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:12:19.250798 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38c3dd5-4ffe-4634-bca5-f7d947ebe836 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:19.263532 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38c3dd5-4ffe-4634-bca5-f7d947ebe836 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:19.271285 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bfe5ec-c1c7-4968-9718-44632cc114a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:19.272328 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bfe5ec-c1c7-4968-9718-44632cc114a5 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:19.272972 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bfe5ec-c1c7-4968-9718-44632cc114a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:19.273402 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bfe5ec-c1c7-4968-9718-44632cc114a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:19.275217 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bfe5ec-c1c7-4968-9718-44632cc114a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:12:19.275721 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bfe5ec-c1c7-4968-9718-44632cc114a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:19.277932 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bfe5ec-c1c7-4968-9718-44632cc114a5 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:19.293763 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 995/1981] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:12:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:12:19.298001 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cdcb80-ced7-43fe-8754-ec8a98859363 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:19.309296 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cdcb80-ced7-43fe-8754-ec8a98859363 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:19.315418 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb23244f-7913-4be6-8c92-539ff86e693b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:19.317466 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb23244f-7913-4be6-8c92-539ff86e693b admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:19.317824 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb23244f-7913-4be6-8c92-539ff86e693b admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:19.318439 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb23244f-7913-4be6-8c92-539ff86e693b admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:19.319347 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb23244f-7913-4be6-8c92-539ff86e693b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:19.321420 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb23244f-7913-4be6-8c92-539ff86e693b admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:19.460429 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 987/1982] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:12:19 2022] POST /identity/v3/projects => generated 411 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:12:19.464304 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bfe5ec-c1c7-4968-9718-44632cc114a5 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:19.476419 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bfe5ec-c1c7-4968-9718-44632cc114a5 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:19.546680 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff69d8-3181-435e-bb00-5474401a6ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:19.551768 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff69d8-3181-435e-bb00-5474401a6ffc admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:19.551768 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff69d8-3181-435e-bb00-5474401a6ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:19.551768 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff69d8-3181-435e-bb00-5474401a6ffc admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:19.551768 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dff69d8-3181-435e-bb00-5474401a6ffc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:19.551768 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dff69d8-3181-435e-bb00-5474401a6ffc admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:19.661438 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 996/1983] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:12:19 2022] POST /identity/v3/users => generated 306 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:12:19.666406 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb23244f-7913-4be6-8c92-539ff86e693b admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:19.693025 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb23244f-7913-4be6-8c92-539ff86e693b admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:19.715044 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca9a4fc-6f92-4436-bafa-b0b3a8beff02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:19.720371 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca9a4fc-6f92-4436-bafa-b0b3a8beff02 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:19.720751 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca9a4fc-6f92-4436-bafa-b0b3a8beff02 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:19.720959 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca9a4fc-6f92-4436-bafa-b0b3a8beff02 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:19.721721 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca9a4fc-6f92-4436-bafa-b0b3a8beff02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:19.723369 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca9a4fc-6f92-4436-bafa-b0b3a8beff02 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:19.737867 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 988/1984] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:12:19 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:12:19.741393 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff69d8-3181-435e-bb00-5474401a6ffc admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:19.752619 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff69d8-3181-435e-bb00-5474401a6ffc admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:19.758107 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd7c40a-61c7-4ffa-a61c-6f0e2dc60ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:19.758779 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7c40a-61c7-4ffa-a61c-6f0e2dc60ce9 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:19.759062 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7c40a-61c7-4ffa-a61c-6f0e2dc60ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:19.759343 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7c40a-61c7-4ffa-a61c-6f0e2dc60ce9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:19.760103 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd7c40a-61c7-4ffa-a61c-6f0e2dc60ce9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:19.761742 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd7c40a-61c7-4ffa-a61c-6f0e2dc60ce9 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:19.778619 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 997/1985] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:12:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:12:19.779772 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca9a4fc-6f92-4436-bafa-b0b3a8beff02 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:19.790310 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca9a4fc-6f92-4436-bafa-b0b3a8beff02 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:19.795367 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94978be-032f-493d-b26c-1459ab57c463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:19.796310 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94978be-032f-493d-b26c-1459ab57c463 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:19.796749 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94978be-032f-493d-b26c-1459ab57c463 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:19.797546 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94978be-032f-493d-b26c-1459ab57c463 admin admin] PATH_INFO: `/v3/projects/09d100b7d10340adafb28f400696917d/users/ffab27037bd74cb780bb175db35b341c/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:19.813680 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94978be-032f-493d-b26c-1459ab57c463 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09d100b7d10340adafb28f400696917d, user_id=ffab27037bd74cb780bb175db35b341c, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:19.816400 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94978be-032f-493d-b26c-1459ab57c463 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:19.895826 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 989/1986] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:12:19 2022] PUT /identity/v3/projects/09d100b7d10340adafb28f400696917d/users/ffab27037bd74cb780bb175db35b341c/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:12:19.908287 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c868eb1e-e2ef-4ff0-94b2-510cf709d1be None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:19.908708 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c868eb1e-e2ef-4ff0-94b2-510cf709d1be None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:19.909454 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c868eb1e-e2ef-4ff0-94b2-510cf709d1be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:19.945104 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-c868eb1e-e2ef-4ff0-94b2-510cf709d1be None None] MFA Rules not processed for user `ffab27037bd74cb780bb175db35b341c`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:19.946652 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c868eb1e-e2ef-4ff0-94b2-510cf709d1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:20.032072 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 998/1987] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:19 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:20.036782 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94978be-032f-493d-b26c-1459ab57c463 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:20.143319 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94978be-032f-493d-b26c-1459ab57c463 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:20.148628 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7529ae85-7d20-43c2-8da8-13bc96f8ccec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:20.149667 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7529ae85-7d20-43c2-8da8-13bc96f8ccec admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:20.150026 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7529ae85-7d20-43c2-8da8-13bc96f8ccec admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:20.150402 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7529ae85-7d20-43c2-8da8-13bc96f8ccec admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:20.151903 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7529ae85-7d20-43c2-8da8-13bc96f8ccec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:20.154542 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7529ae85-7d20-43c2-8da8-13bc96f8ccec admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:20.299026 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 990/1988] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:12:20 2022] POST /identity/v3/projects => generated 411 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:12:20.302943 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c868eb1e-e2ef-4ff0-94b2-510cf709d1be None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:20.315399 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c868eb1e-e2ef-4ff0-94b2-510cf709d1be None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:20.388287 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae30977f-3dab-4848-9c77-f07a02ba4c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:20.388825 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae30977f-3dab-4848-9c77-f07a02ba4c4b admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:20.389182 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae30977f-3dab-4848-9c77-f07a02ba4c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:20.389526 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae30977f-3dab-4848-9c77-f07a02ba4c4b admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:20.390529 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae30977f-3dab-4848-9c77-f07a02ba4c4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:20.393176 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae30977f-3dab-4848-9c77-f07a02ba4c4b admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:20.482964 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 999/1989] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:12:20 2022] POST /identity/v3/users => generated 312 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:12:20.488302 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7529ae85-7d20-43c2-8da8-13bc96f8ccec admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:20.505219 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7529ae85-7d20-43c2-8da8-13bc96f8ccec admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:20.510226 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63701f3c-58d8-4859-9ebb-b8e6419302ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:20.510965 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63701f3c-58d8-4859-9ebb-b8e6419302ab admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:20.511441 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63701f3c-58d8-4859-9ebb-b8e6419302ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:20.511947 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63701f3c-58d8-4859-9ebb-b8e6419302ab admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:20.512843 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63701f3c-58d8-4859-9ebb-b8e6419302ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:20.514633 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63701f3c-58d8-4859-9ebb-b8e6419302ab admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:20.527146 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 991/1990] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:12:20 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:12:20.533245 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae30977f-3dab-4848-9c77-f07a02ba4c4b admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:20.544720 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae30977f-3dab-4848-9c77-f07a02ba4c4b admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:20.549915 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4389f4-4b7e-4697-9fc2-5ba5b82b62f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:20.551516 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4389f4-4b7e-4697-9fc2-5ba5b82b62f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:20.551818 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4389f4-4b7e-4697-9fc2-5ba5b82b62f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:20.552108 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4389f4-4b7e-4697-9fc2-5ba5b82b62f7 admin admin] PATH_INFO: `/v3/projects/3dafa8dbd6e64b59b2c0c5f7f36f915d/users/5190e584da704393b66c824b8bb73cd1/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:20.571609 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4389f4-4b7e-4697-9fc2-5ba5b82b62f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dafa8dbd6e64b59b2c0c5f7f36f915d, user_id=5190e584da704393b66c824b8bb73cd1, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:20.574409 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4389f4-4b7e-4697-9fc2-5ba5b82b62f7 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:20.642812 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1000/1991] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:12:20 2022] PUT /identity/v3/projects/3dafa8dbd6e64b59b2c0c5f7f36f915d/users/5190e584da704393b66c824b8bb73cd1/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:20.646703 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63701f3c-58d8-4859-9ebb-b8e6419302ab admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:20.667360 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63701f3c-58d8-4859-9ebb-b8e6419302ab admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:20.732484 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5220e4-d1f0-4f72-a92a-02fa44c1eba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:20.733222 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5220e4-d1f0-4f72-a92a-02fa44c1eba8 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:20.733572 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5220e4-d1f0-4f72-a92a-02fa44c1eba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:20.733938 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5220e4-d1f0-4f72-a92a-02fa44c1eba8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:20.734862 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5220e4-d1f0-4f72-a92a-02fa44c1eba8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:20.736992 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5220e4-d1f0-4f72-a92a-02fa44c1eba8 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:20.750430 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 992/1992] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:12:20 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:12:20.751942 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4389f4-4b7e-4697-9fc2-5ba5b82b62f7 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:20.764420 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4389f4-4b7e-4697-9fc2-5ba5b82b62f7 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:20.770332 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe46ee6-15f1-4bb8-8458-083965fc31c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:20.771295 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe46ee6-15f1-4bb8-8458-083965fc31c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:20.771644 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe46ee6-15f1-4bb8-8458-083965fc31c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:20.771964 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe46ee6-15f1-4bb8-8458-083965fc31c7 admin admin] PATH_INFO: `/v3/projects/3dafa8dbd6e64b59b2c0c5f7f36f915d/users/5190e584da704393b66c824b8bb73cd1/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:20.773898 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe46ee6-15f1-4bb8-8458-083965fc31c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dafa8dbd6e64b59b2c0c5f7f36f915d, user_id=5190e584da704393b66c824b8bb73cd1, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:20.776601 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe46ee6-15f1-4bb8-8458-083965fc31c7 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:20.788012 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1001/1993] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:12:20 2022] PUT /identity/v3/projects/3dafa8dbd6e64b59b2c0c5f7f36f915d/users/5190e584da704393b66c824b8bb73cd1/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:20.799137 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e0258a-e15b-4702-b6d7-7ea83cbd2c3d None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:20.799702 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e0258a-e15b-4702-b6d7-7ea83cbd2c3d None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:20.800141 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e0258a-e15b-4702-b6d7-7ea83cbd2c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:20.829416 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-a5e0258a-e15b-4702-b6d7-7ea83cbd2c3d None None] MFA Rules not processed for user `5190e584da704393b66c824b8bb73cd1`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:20.830939 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-a5e0258a-e15b-4702-b6d7-7ea83cbd2c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:20.915378 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 993/1994] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:20 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:20.928058 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe46ee6-15f1-4bb8-8458-083965fc31c7 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:20.930256 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-cbe46ee6-15f1-4bb8-8458-083965fc31c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:21.015513 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe46ee6-15f1-4bb8-8458-083965fc31c7 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:21.026429 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba8cb6d-e3ae-41bd-9f93-af7c7bb3bcdc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:21.027214 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8cb6d-e3ae-41bd-9f93-af7c7bb3bcdc service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:21.027605 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8cb6d-e3ae-41bd-9f93-af7c7bb3bcdc service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:21.027951 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8cb6d-e3ae-41bd-9f93-af7c7bb3bcdc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:21.039146 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba8cb6d-e3ae-41bd-9f93-af7c7bb3bcdc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:21.041017 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba8cb6d-e3ae-41bd-9f93-af7c7bb3bcdc service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:21.054151 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1002/1995] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:12:20 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:12:21.157464 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e0258a-e15b-4702-b6d7-7ea83cbd2c3d None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:21.161837 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-a5e0258a-e15b-4702-b6d7-7ea83cbd2c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:21.186746 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e0258a-e15b-4702-b6d7-7ea83cbd2c3d None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:21.193985 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ae5eb-dd0f-400a-8645-96e69f31b636 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:21.195455 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ae5eb-dd0f-400a-8645-96e69f31b636 service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:21.195832 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ae5eb-dd0f-400a-8645-96e69f31b636 service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:21.196327 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ae5eb-dd0f-400a-8645-96e69f31b636 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:21.282038 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321ae5eb-dd0f-400a-8645-96e69f31b636 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:21.284066 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321ae5eb-dd0f-400a-8645-96e69f31b636 service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:21.298474 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 994/1996] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:12:21 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:12:21.336005 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba8cb6d-e3ae-41bd-9f93-af7c7bb3bcdc service nova] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:21.422971 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba8cb6d-e3ae-41bd-9f93-af7c7bb3bcdc service nova] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:21.427468 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31627e30-afc2-4d9b-ade9-f619cd374cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:21.428358 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31627e30-afc2-4d9b-ade9-f619cd374cb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:21.428654 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31627e30-afc2-4d9b-ade9-f619cd374cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:21.428920 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31627e30-afc2-4d9b-ade9-f619cd374cb8 admin admin] PATH_INFO: `/v3/users/ffab27037bd74cb780bb175db35b341c` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:21.430095 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31627e30-afc2-4d9b-ade9-f619cd374cb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffab27037bd74cb780bb175db35b341c)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:21.432090 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31627e30-afc2-4d9b-ade9-f619cd374cb8 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:21.605978 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-31627e30-afc2-4d9b-ade9-f619cd374cb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffab27037bd74cb780bb175db35b341c'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:21.624622 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-31627e30-afc2-4d9b-ade9-f619cd374cb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffab27037bd74cb780bb175db35b341c'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:21.635737 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-31627e30-afc2-4d9b-ade9-f619cd374cb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffab27037bd74cb780bb175db35b341c'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:21.752316 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-31627e30-afc2-4d9b-ade9-f619cd374cb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffab27037bd74cb780bb175db35b341c'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:21.753063 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-31627e30-afc2-4d9b-ade9-f619cd374cb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffab27037bd74cb780bb175db35b341c'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:21.770240 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1003/1997] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:12:21 2022] DELETE /identity/v3/users/ffab27037bd74cb780bb175db35b341c => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:12:21.774877 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98405ea7-b940-4263-9f65-fbd5d0b0ab0e None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:21.775360 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98405ea7-b940-4263-9f65-fbd5d0b0ab0e None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:21.775454 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98405ea7-b940-4263-9f65-fbd5d0b0ab0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:21.808366 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-98405ea7-b940-4263-9f65-fbd5d0b0ab0e None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:21.815207 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-98405ea7-b940-4263-9f65-fbd5d0b0ab0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:21.916856 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 995/1998] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:12:21.940310 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31627e30-afc2-4d9b-ade9-f619cd374cb8 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:21.941908 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-31627e30-afc2-4d9b-ade9-f619cd374cb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:22.024151 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31627e30-afc2-4d9b-ade9-f619cd374cb8 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:22.029875 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571160e2-807b-46a5-b70c-bbfb82d642bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:22.037851 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571160e2-807b-46a5-b70c-bbfb82d642bb service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:22.037851 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571160e2-807b-46a5-b70c-bbfb82d642bb service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:22.037851 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571160e2-807b-46a5-b70c-bbfb82d642bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:22.054225 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571160e2-807b-46a5-b70c-bbfb82d642bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:22.056422 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571160e2-807b-46a5-b70c-bbfb82d642bb service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:22.069101 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1004/1999] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:12:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:12:22.867524 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98405ea7-b940-4263-9f65-fbd5d0b0ab0e None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:22.868990 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-98405ea7-b940-4263-9f65-fbd5d0b0ab0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:22.884322 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98405ea7-b940-4263-9f65-fbd5d0b0ab0e None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:22.891991 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f3eedf-0dc6-475c-9dda-8647c9c5dda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:22.893031 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f3eedf-0dc6-475c-9dda-8647c9c5dda2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:22.893423 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f3eedf-0dc6-475c-9dda-8647c9c5dda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:22.893767 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f3eedf-0dc6-475c-9dda-8647c9c5dda2 admin admin] PATH_INFO: `/v3/projects/09d100b7d10340adafb28f400696917d` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:22.895076 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f3eedf-0dc6-475c-9dda-8647c9c5dda2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09d100b7d10340adafb28f400696917d)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:22.897284 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f3eedf-0dc6-475c-9dda-8647c9c5dda2 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:23.070434 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-37f3eedf-0dc6-475c-9dda-8647c9c5dda2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09d100b7d10340adafb28f400696917d', 'request_id': 'req-37f3eedf-0dc6-475c-9dda-8647c9c5dda2'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:23.079819 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-37f3eedf-0dc6-475c-9dda-8647c9c5dda2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09d100b7d10340adafb28f400696917d', 'request_id': 'req-37f3eedf-0dc6-475c-9dda-8647c9c5dda2'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:23.087950 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-37f3eedf-0dc6-475c-9dda-8647c9c5dda2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09d100b7d10340adafb28f400696917d', 'request_id': 'req-37f3eedf-0dc6-475c-9dda-8647c9c5dda2'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:23.090147 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571160e2-807b-46a5-b70c-bbfb82d642bb service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:23.092459 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-571160e2-807b-46a5-b70c-bbfb82d642bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:23.111334 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571160e2-807b-46a5-b70c-bbfb82d642bb service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:23.181905 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd785253-5860-4c05-b943-3e6ece51ce36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:23.182811 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd785253-5860-4c05-b943-3e6ece51ce36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:23.183273 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd785253-5860-4c05-b943-3e6ece51ce36 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:23.183580 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd785253-5860-4c05-b943-3e6ece51ce36 admin admin] PATH_INFO: `/v3/users/c2d20a8e46724e249f90bd697e8f1783` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:23.184911 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd785253-5860-4c05-b943-3e6ece51ce36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2d20a8e46724e249f90bd697e8f1783)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:23.186850 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd785253-5860-4c05-b943-3e6ece51ce36 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:23.202109 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-37f3eedf-0dc6-475c-9dda-8647c9c5dda2 admin admin] The token cache is being invalidate because project 09d100b7d10340adafb28f400696917d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:12:23.202468 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-37f3eedf-0dc6-475c-9dda-8647c9c5dda2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:23.206248 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-37f3eedf-0dc6-475c-9dda-8647c9c5dda2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:23.206248 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 996/2000] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:12:22 2022] DELETE /identity/v3/projects/09d100b7d10340adafb28f400696917d => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:23.209590 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f3eedf-0dc6-475c-9dda-8647c9c5dda2 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:23.213320 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-37f3eedf-0dc6-475c-9dda-8647c9c5dda2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:23.238166 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f3eedf-0dc6-475c-9dda-8647c9c5dda2 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:23.243768 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d1961-bcb7-49be-b6a5-9791459249aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:23.244670 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d1961-bcb7-49be-b6a5-9791459249aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:23.244959 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d1961-bcb7-49be-b6a5-9791459249aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:23.246268 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d1961-bcb7-49be-b6a5-9791459249aa admin admin] PATH_INFO: `/v3/users/5190e584da704393b66c824b8bb73cd1` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:23.246494 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018d1961-bcb7-49be-b6a5-9791459249aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=5190e584da704393b66c824b8bb73cd1)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:23.248494 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018d1961-bcb7-49be-b6a5-9791459249aa admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:23.418275 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-dd785253-5860-4c05-b943-3e6ece51ce36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2d20a8e46724e249f90bd697e8f1783'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:23.434661 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-dd785253-5860-4c05-b943-3e6ece51ce36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2d20a8e46724e249f90bd697e8f1783'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:23.438882 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-dd785253-5860-4c05-b943-3e6ece51ce36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2d20a8e46724e249f90bd697e8f1783'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:23.477755 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-018d1961-bcb7-49be-b6a5-9791459249aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5190e584da704393b66c824b8bb73cd1'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:23.488589 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-018d1961-bcb7-49be-b6a5-9791459249aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5190e584da704393b66c824b8bb73cd1'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:23.489390 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-018d1961-bcb7-49be-b6a5-9791459249aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5190e584da704393b66c824b8bb73cd1'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:23.512520 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-dd785253-5860-4c05-b943-3e6ece51ce36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2d20a8e46724e249f90bd697e8f1783'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:23.513533 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-dd785253-5860-4c05-b943-3e6ece51ce36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2d20a8e46724e249f90bd697e8f1783'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:23.521433 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1005/2001] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:12:23 2022] DELETE /identity/v3/users/c2d20a8e46724e249f90bd697e8f1783 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:12:23.527714 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96efd37d-16c6-45f1-91a4-95bd039c9f44 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:23.528007 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96efd37d-16c6-45f1-91a4-95bd039c9f44 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:23.528287 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96efd37d-16c6-45f1-91a4-95bd039c9f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:23.568915 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-96efd37d-16c6-45f1-91a4-95bd039c9f44 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:23.570123 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-96efd37d-16c6-45f1-91a4-95bd039c9f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:23.620734 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-018d1961-bcb7-49be-b6a5-9791459249aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5190e584da704393b66c824b8bb73cd1'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:23.637490 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1006/2002] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:23.637737 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-018d1961-bcb7-49be-b6a5-9791459249aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5190e584da704393b66c824b8bb73cd1'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:23.644739 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96efd37d-16c6-45f1-91a4-95bd039c9f44 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:23.647144 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-96efd37d-16c6-45f1-91a4-95bd039c9f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:23.661875 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 997/2003] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:12:23 2022] DELETE /identity/v3/users/5190e584da704393b66c824b8bb73cd1 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:12:23.744202 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96efd37d-16c6-45f1-91a4-95bd039c9f44 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:23.842350 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca1dd3-a2e9-4fed-bb12-c315cbb48dde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:23.843147 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca1dd3-a2e9-4fed-bb12-c315cbb48dde service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:23.843590 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca1dd3-a2e9-4fed-bb12-c315cbb48dde service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:23.847130 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca1dd3-a2e9-4fed-bb12-c315cbb48dde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:23.854366 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e8ca1dd3-a2e9-4fed-bb12-c315cbb48dde service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:23.967452 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ca1dd3-a2e9-4fed-bb12-c315cbb48dde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:23.970184 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ca1dd3-a2e9-4fed-bb12-c315cbb48dde service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:23.980986 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1007/2004] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:12:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:12:24.296039 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d1961-bcb7-49be-b6a5-9791459249aa admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:24.297787 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-018d1961-bcb7-49be-b6a5-9791459249aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:24.360986 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca1dd3-a2e9-4fed-bb12-c315cbb48dde service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:24.363253 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e8ca1dd3-a2e9-4fed-bb12-c315cbb48dde service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:24.389621 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca1dd3-a2e9-4fed-bb12-c315cbb48dde service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:24.399635 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b855ce9-3631-4e45-90af-469fbf43fa5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:24.400846 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b855ce9-3631-4e45-90af-469fbf43fa5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:24.401318 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b855ce9-3631-4e45-90af-469fbf43fa5e admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:24.401745 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b855ce9-3631-4e45-90af-469fbf43fa5e admin admin] PATH_INFO: `/v3/projects/3dafa8dbd6e64b59b2c0c5f7f36f915d` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:24.403309 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b855ce9-3631-4e45-90af-469fbf43fa5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dafa8dbd6e64b59b2c0c5f7f36f915d)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:24.405752 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b855ce9-3631-4e45-90af-469fbf43fa5e admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:24.428891 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d1961-bcb7-49be-b6a5-9791459249aa admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:24.447800 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f02d11c-77f7-47ae-b072-1e366228f1b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:24.448617 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02d11c-77f7-47ae-b072-1e366228f1b5 service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:24.448930 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02d11c-77f7-47ae-b072-1e366228f1b5 service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:24.449179 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02d11c-77f7-47ae-b072-1e366228f1b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:24.452468 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-5f02d11c-77f7-47ae-b072-1e366228f1b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:24.539137 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f02d11c-77f7-47ae-b072-1e366228f1b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:24.541255 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f02d11c-77f7-47ae-b072-1e366228f1b5 service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:24.553752 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 998/2005] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:12:24 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:12:24.561035 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0b855ce9-3631-4e45-90af-469fbf43fa5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dafa8dbd6e64b59b2c0c5f7f36f915d', 'request_id': 'req-0b855ce9-3631-4e45-90af-469fbf43fa5e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:24.581904 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0b855ce9-3631-4e45-90af-469fbf43fa5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dafa8dbd6e64b59b2c0c5f7f36f915d', 'request_id': 'req-0b855ce9-3631-4e45-90af-469fbf43fa5e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:24.622796 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f02d11c-77f7-47ae-b072-1e366228f1b5 service nova] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:24.625014 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-5f02d11c-77f7-47ae-b072-1e366228f1b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:24.644627 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f02d11c-77f7-47ae-b072-1e366228f1b5 service nova] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:24.684395 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0b855ce9-3631-4e45-90af-469fbf43fa5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dafa8dbd6e64b59b2c0c5f7f36f915d', 'request_id': 'req-0b855ce9-3631-4e45-90af-469fbf43fa5e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:24.700316 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0b855ce9-3631-4e45-90af-469fbf43fa5e admin admin] The token cache is being invalidate because project 3dafa8dbd6e64b59b2c0c5f7f36f915d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:12:24.700724 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0b855ce9-3631-4e45-90af-469fbf43fa5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:24.701651 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0b855ce9-3631-4e45-90af-469fbf43fa5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:24.704968 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1008/2006] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:12:24 2022] DELETE /identity/v3/projects/3dafa8dbd6e64b59b2c0c5f7f36f915d => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:24.710211 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5309701-846b-47cf-a712-cf86ffc6722c None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:24.710211 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5309701-846b-47cf-a712-cf86ffc6722c None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:24.710489 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5309701-846b-47cf-a712-cf86ffc6722c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:24.744214 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-f5309701-846b-47cf-a712-cf86ffc6722c None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:24.744381 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d10a1c-3dee-44e7-ac37-93900bd86539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:24.745560 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-f5309701-846b-47cf-a712-cf86ffc6722c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:24.745754 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d10a1c-3dee-44e7-ac37-93900bd86539 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:24.746105 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d10a1c-3dee-44e7-ac37-93900bd86539 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:24.746447 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d10a1c-3dee-44e7-ac37-93900bd86539 admin admin] PATH_INFO: `/v3/projects/e2063e335c404cfeb061528dd896468f` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:24.748153 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d10a1c-3dee-44e7-ac37-93900bd86539 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2063e335c404cfeb061528dd896468f)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:24.751334 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d10a1c-3dee-44e7-ac37-93900bd86539 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:24.773231 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1009/2007] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:12:24.798311 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22509f4-5602-4ba0-8093-90ba6d30310d None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:24.798584 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22509f4-5602-4ba0-8093-90ba6d30310d None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:24.798894 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22509f4-5602-4ba0-8093-90ba6d30310d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:24.854712 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-c22509f4-5602-4ba0-8093-90ba6d30310d None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:24.855644 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c22509f4-5602-4ba0-8093-90ba6d30310d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:24.877980 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1010/2008] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:24.882453 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22509f4-5602-4ba0-8093-90ba6d30310d None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:24.896398 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22509f4-5602-4ba0-8093-90ba6d30310d None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:24.911407 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea58e90-5a6f-4baf-ad7f-5eb59a8ddd7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:24.912206 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea58e90-5a6f-4baf-ad7f-5eb59a8ddd7c admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:24.912480 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea58e90-5a6f-4baf-ad7f-5eb59a8ddd7c admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:24.912761 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea58e90-5a6f-4baf-ad7f-5eb59a8ddd7c admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:24.913563 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea58e90-5a6f-4baf-ad7f-5eb59a8ddd7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:12:24.914076 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea58e90-5a6f-4baf-ad7f-5eb59a8ddd7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:24.916296 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea58e90-5a6f-4baf-ad7f-5eb59a8ddd7c admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:24.937430 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1011/2009] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:12:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:12:24.942617 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d1d10a1c-3dee-44e7-ac37-93900bd86539 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2063e335c404cfeb061528dd896468f', 'request_id': 'req-d1d10a1c-3dee-44e7-ac37-93900bd86539'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:24.942787 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea58e90-5a6f-4baf-ad7f-5eb59a8ddd7c admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:24.949211 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d1d10a1c-3dee-44e7-ac37-93900bd86539 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2063e335c404cfeb061528dd896468f', 'request_id': 'req-d1d10a1c-3dee-44e7-ac37-93900bd86539'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:24.958984 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea58e90-5a6f-4baf-ad7f-5eb59a8ddd7c admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:24.970878 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d1d10a1c-3dee-44e7-ac37-93900bd86539 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2063e335c404cfeb061528dd896468f', 'request_id': 'req-d1d10a1c-3dee-44e7-ac37-93900bd86539'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:25.056492 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbceda25-ddae-4b75-8153-faa3b4da9454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:25.057223 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbceda25-ddae-4b75-8153-faa3b4da9454 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:25.057506 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbceda25-ddae-4b75-8153-faa3b4da9454 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:25.057864 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbceda25-ddae-4b75-8153-faa3b4da9454 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:25.058557 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbceda25-ddae-4b75-8153-faa3b4da9454 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:25.060494 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbceda25-ddae-4b75-8153-faa3b4da9454 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:25.073289 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d1d10a1c-3dee-44e7-ac37-93900bd86539 admin admin] The token cache is being invalidate because project e2063e335c404cfeb061528dd896468f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:12:25.073670 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d1d10a1c-3dee-44e7-ac37-93900bd86539 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:25.074707 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d1d10a1c-3dee-44e7-ac37-93900bd86539 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:25.076815 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 999/2010] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:12:24 2022] DELETE /identity/v3/projects/e2063e335c404cfeb061528dd896468f => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:25.082834 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d10a1c-3dee-44e7-ac37-93900bd86539 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:25.086360 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-d1d10a1c-3dee-44e7-ac37-93900bd86539 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:25.103818 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d10a1c-3dee-44e7-ac37-93900bd86539 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:25.108568 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8827d681-9573-46e7-82ad-eac9827af6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:25.110021 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8827d681-9573-46e7-82ad-eac9827af6f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:25.110305 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8827d681-9573-46e7-82ad-eac9827af6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:25.110582 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8827d681-9573-46e7-82ad-eac9827af6f4 admin admin] PATH_INFO: `/v3/users/1ee1da20d78d4f57a4ffb48b317dc0ab` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:25.111843 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8827d681-9573-46e7-82ad-eac9827af6f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ee1da20d78d4f57a4ffb48b317dc0ab)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:25.113837 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8827d681-9573-46e7-82ad-eac9827af6f4 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:25.223333 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1012/2011] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:12:24 2022] POST /identity/v3/projects => generated 375 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:12:25.225135 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbceda25-ddae-4b75-8153-faa3b4da9454 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:25.227140 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-cbceda25-ddae-4b75-8153-faa3b4da9454 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:25.319868 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbceda25-ddae-4b75-8153-faa3b4da9454 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:25.341097 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33735b69-0bcc-4b68-b2f8-c13a71352a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:25.341815 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33735b69-0bcc-4b68-b2f8-c13a71352a96 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:25.342160 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33735b69-0bcc-4b68-b2f8-c13a71352a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:25.342446 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33735b69-0bcc-4b68-b2f8-c13a71352a96 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:25.343528 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33735b69-0bcc-4b68-b2f8-c13a71352a96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:25.345226 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33735b69-0bcc-4b68-b2f8-c13a71352a96 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:25.350095 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-8827d681-9573-46e7-82ad-eac9827af6f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ee1da20d78d4f57a4ffb48b317dc0ab'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:25.357904 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-8827d681-9573-46e7-82ad-eac9827af6f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ee1da20d78d4f57a4ffb48b317dc0ab'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:25.358638 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-8827d681-9573-46e7-82ad-eac9827af6f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ee1da20d78d4f57a4ffb48b317dc0ab'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:25.405469 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1013/2012] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:12:25 2022] POST /identity/v3/users => generated 288 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:12:25.409968 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33735b69-0bcc-4b68-b2f8-c13a71352a96 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:25.421924 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33735b69-0bcc-4b68-b2f8-c13a71352a96 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:25.428378 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad33b77-9e03-4a38-89bf-532c0af04e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:25.429215 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad33b77-9e03-4a38-89bf-532c0af04e70 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:25.429770 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad33b77-9e03-4a38-89bf-532c0af04e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:25.430191 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad33b77-9e03-4a38-89bf-532c0af04e70 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:25.431174 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad33b77-9e03-4a38-89bf-532c0af04e70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:25.433206 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad33b77-9e03-4a38-89bf-532c0af04e70 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:25.442376 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-8827d681-9573-46e7-82ad-eac9827af6f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ee1da20d78d4f57a4ffb48b317dc0ab'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:25.449581 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1014/2013] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:12:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:12:25.450644 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad33b77-9e03-4a38-89bf-532c0af04e70 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:25.463511 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-8827d681-9573-46e7-82ad-eac9827af6f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ee1da20d78d4f57a4ffb48b317dc0ab'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:25.463845 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad33b77-9e03-4a38-89bf-532c0af04e70 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:25.469536 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd363f26-d50d-4ff9-a645-240dcf4ea7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:25.470806 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd363f26-d50d-4ff9-a645-240dcf4ea7e7 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:25.471258 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd363f26-d50d-4ff9-a645-240dcf4ea7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:25.471804 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd363f26-d50d-4ff9-a645-240dcf4ea7e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:25.473449 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1000/2014] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:12:25 2022] DELETE /identity/v3/users/1ee1da20d78d4f57a4ffb48b317dc0ab => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:25.473550 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd363f26-d50d-4ff9-a645-240dcf4ea7e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:25.475110 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd363f26-d50d-4ff9-a645-240dcf4ea7e7 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:25.492006 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1015/2015] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:12:25 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:12:25.493324 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8827d681-9573-46e7-82ad-eac9827af6f4 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:25.495208 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8827d681-9573-46e7-82ad-eac9827af6f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:25.893162 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8827d681-9573-46e7-82ad-eac9827af6f4 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:25.893162 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149ff2e-0a6c-4fc2-bcf1-dc4c21d52f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:25.893162 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149ff2e-0a6c-4fc2-bcf1-dc4c21d52f5e admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:25.893162 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149ff2e-0a6c-4fc2-bcf1-dc4c21d52f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:25.894113 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149ff2e-0a6c-4fc2-bcf1-dc4c21d52f5e admin admin] PATH_INFO: `/v3/projects/48bf82bdace04c2f93e8c18a0e12626b/users/94def4aa29674cca9e86691c84e5bff8/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:25.894113 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4149ff2e-0a6c-4fc2-bcf1-dc4c21d52f5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=48bf82bdace04c2f93e8c18a0e12626b, user_id=94def4aa29674cca9e86691c84e5bff8, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:25.894113 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4149ff2e-0a6c-4fc2-bcf1-dc4c21d52f5e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:26.317347 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1001/2016] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:12:25 2022] PUT /identity/v3/projects/48bf82bdace04c2f93e8c18a0e12626b/users/94def4aa29674cca9e86691c84e5bff8/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 805 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:12:26.322681 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b5cf06-4931-477d-b674-f329fc441ae8 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:26.322972 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b5cf06-4931-477d-b674-f329fc441ae8 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:26.323283 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b5cf06-4931-477d-b674-f329fc441ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:26.363705 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-a6b5cf06-4931-477d-b674-f329fc441ae8 None None] MFA Rules not processed for user `94def4aa29674cca9e86691c84e5bff8`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:26.365126 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-a6b5cf06-4931-477d-b674-f329fc441ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:26.480198 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1016/2017] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:26.485438 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149ff2e-0a6c-4fc2-bcf1-dc4c21d52f5e admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:26.565397 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149ff2e-0a6c-4fc2-bcf1-dc4c21d52f5e admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:26.570445 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51f2d22-1f10-4dda-a0f2-d4fd01034e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:26.571120 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f2d22-1f10-4dda-a0f2-d4fd01034e8a admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:26.571403 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f2d22-1f10-4dda-a0f2-d4fd01034e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:26.571707 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f2d22-1f10-4dda-a0f2-d4fd01034e8a admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:26.572412 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51f2d22-1f10-4dda-a0f2-d4fd01034e8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:26.574392 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51f2d22-1f10-4dda-a0f2-d4fd01034e8a admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:26.888009 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1002/2018] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:12:26 2022] POST /identity/v3/projects => generated 375 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:12:26.892843 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51f2d22-1f10-4dda-a0f2-d4fd01034e8a admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:26.893351 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b5cf06-4931-477d-b674-f329fc441ae8 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:26.894613 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-f51f2d22-1f10-4dda-a0f2-d4fd01034e8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:26.914499 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b5cf06-4931-477d-b674-f329fc441ae8 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:27.003343 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51f2d22-1f10-4dda-a0f2-d4fd01034e8a admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:27.006891 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eb30a7-1cd5-44d0-9167-98e3bfe8e9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:27.007854 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb30a7-1cd5-44d0-9167-98e3bfe8e9eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:27.008223 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb30a7-1cd5-44d0-9167-98e3bfe8e9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:27.008570 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb30a7-1cd5-44d0-9167-98e3bfe8e9eb admin admin] PATH_INFO: `/v3/projects/2310519e16b34f3b8ebdde01188d78f6` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:27.010315 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eb30a7-1cd5-44d0-9167-98e3bfe8e9eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=2310519e16b34f3b8ebdde01188d78f6)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:27.012008 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eb30a7-1cd5-44d0-9167-98e3bfe8e9eb admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:27.042592 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ecd66d-5ce6-42ed-b8d2-aa89897c2200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:27.043201 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ecd66d-5ce6-42ed-b8d2-aa89897c2200 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:27.043509 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ecd66d-5ce6-42ed-b8d2-aa89897c2200 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:27.043800 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ecd66d-5ce6-42ed-b8d2-aa89897c2200 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:27.044492 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ecd66d-5ce6-42ed-b8d2-aa89897c2200 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:27.046579 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ecd66d-5ce6-42ed-b8d2-aa89897c2200 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:27.230564 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1017/2019] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:12:26 2022] POST /identity/v3/users => generated 294 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:12:27.232731 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ecd66d-5ce6-42ed-b8d2-aa89897c2200 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:27.246329 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ecd66d-5ce6-42ed-b8d2-aa89897c2200 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:27.248117 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-63eb30a7-1cd5-44d0-9167-98e3bfe8e9eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2310519e16b34f3b8ebdde01188d78f6', 'request_id': 'req-63eb30a7-1cd5-44d0-9167-98e3bfe8e9eb'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:27.255293 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-63eb30a7-1cd5-44d0-9167-98e3bfe8e9eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2310519e16b34f3b8ebdde01188d78f6', 'request_id': 'req-63eb30a7-1cd5-44d0-9167-98e3bfe8e9eb'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:27.262779 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-63eb30a7-1cd5-44d0-9167-98e3bfe8e9eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2310519e16b34f3b8ebdde01188d78f6', 'request_id': 'req-63eb30a7-1cd5-44d0-9167-98e3bfe8e9eb'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:27.338792 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffe5804-d062-47f0-917c-2bc8954adc37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:27.339799 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe5804-d062-47f0-917c-2bc8954adc37 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:27.340317 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe5804-d062-47f0-917c-2bc8954adc37 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:27.340621 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe5804-d062-47f0-917c-2bc8954adc37 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:27.341459 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffe5804-d062-47f0-917c-2bc8954adc37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:27.343065 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffe5804-d062-47f0-917c-2bc8954adc37 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:27.356007 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1018/2020] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:12:27.360946 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffe5804-d062-47f0-917c-2bc8954adc37 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:27.364733 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-63eb30a7-1cd5-44d0-9167-98e3bfe8e9eb admin admin] The token cache is being invalidate because project 2310519e16b34f3b8ebdde01188d78f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:12:27.365180 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-63eb30a7-1cd5-44d0-9167-98e3bfe8e9eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:27.371140 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-63eb30a7-1cd5-44d0-9167-98e3bfe8e9eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:27.371140 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1003/2021] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:12:26 2022] DELETE /identity/v3/projects/2310519e16b34f3b8ebdde01188d78f6 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:27.373765 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffe5804-d062-47f0-917c-2bc8954adc37 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:27.376357 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88dade-5bb4-4fd1-9de7-95622a82df32 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:27.376564 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88dade-5bb4-4fd1-9de7-95622a82df32 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:27.376889 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88dade-5bb4-4fd1-9de7-95622a82df32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:27.381701 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f7761f-1023-4461-a3aa-f6f814397ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:27.382813 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7761f-1023-4461-a3aa-f6f814397ac9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:27.383891 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7761f-1023-4461-a3aa-f6f814397ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:27.384326 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7761f-1023-4461-a3aa-f6f814397ac9 admin admin] PATH_INFO: `/v3/projects/a3ef417f52a54c0eaabb9b87ae84b8ac/users/d4227805684e44988f9ebbe14e529a53/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:27.396393 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-6e88dade-5bb4-4fd1-9de7-95622a82df32 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:27.397702 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-6e88dade-5bb4-4fd1-9de7-95622a82df32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:27.401348 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f7761f-1023-4461-a3aa-f6f814397ac9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3ef417f52a54c0eaabb9b87ae84b8ac, user_id=d4227805684e44988f9ebbe14e529a53, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:27.404651 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f7761f-1023-4461-a3aa-f6f814397ac9 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:27.406330 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1004/2022] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:27.414127 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6837959c-05b3-4e6a-b90b-7f7279f13b0f None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:27.414422 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6837959c-05b3-4e6a-b90b-7f7279f13b0f None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:27.414728 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6837959c-05b3-4e6a-b90b-7f7279f13b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:27.433268 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-6837959c-05b3-4e6a-b90b-7f7279f13b0f None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:27.434467 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-6837959c-05b3-4e6a-b90b-7f7279f13b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:27.445995 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1005/2023] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:12:27.449872 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6837959c-05b3-4e6a-b90b-7f7279f13b0f None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:27.461069 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6837959c-05b3-4e6a-b90b-7f7279f13b0f None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:27.479965 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657f8546-8336-4ab2-bdfd-e5019c5ff03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:27.479965 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f8546-8336-4ab2-bdfd-e5019c5ff03e admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:27.479965 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f8546-8336-4ab2-bdfd-e5019c5ff03e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:27.479965 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f8546-8336-4ab2-bdfd-e5019c5ff03e admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:27.480262 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657f8546-8336-4ab2-bdfd-e5019c5ff03e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:12:27.480262 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657f8546-8336-4ab2-bdfd-e5019c5ff03e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:27.483399 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1019/2024] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:12:27 2022] PUT /identity/v3/projects/a3ef417f52a54c0eaabb9b87ae84b8ac/users/d4227805684e44988f9ebbe14e529a53/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:27.488146 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f7761f-1023-4461-a3aa-f6f814397ac9 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:27.490916 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-32f7761f-1023-4461-a3aa-f6f814397ac9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:27.493077 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657f8546-8336-4ab2-bdfd-e5019c5ff03e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:27.507857 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1006/2025] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:12:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:12:27.511790 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657f8546-8336-4ab2-bdfd-e5019c5ff03e admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:27.522527 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657f8546-8336-4ab2-bdfd-e5019c5ff03e admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:27.591525 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f7761f-1023-4461-a3aa-f6f814397ac9 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:27.608229 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f06912-5c68-40e1-b48a-ede2729c4a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:27.608771 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f06912-5c68-40e1-b48a-ede2729c4a65 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:27.609061 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f06912-5c68-40e1-b48a-ede2729c4a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:27.609419 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f06912-5c68-40e1-b48a-ede2729c4a65 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:27.612880 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f06912-5c68-40e1-b48a-ede2729c4a65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:27.619994 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f06912-5c68-40e1-b48a-ede2729c4a65 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:27.636069 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1020/2026] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:12:27.637102 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f06912-5c68-40e1-b48a-ede2729c4a65 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:27.638779 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-22f06912-5c68-40e1-b48a-ede2729c4a65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:27.653013 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f06912-5c68-40e1-b48a-ede2729c4a65 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:27.655986 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933f3f8d-060d-4436-ba46-fb72d43bf34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:27.656706 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f3f8d-060d-4436-ba46-fb72d43bf34e admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:27.656987 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f3f8d-060d-4436-ba46-fb72d43bf34e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:27.657351 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f3f8d-060d-4436-ba46-fb72d43bf34e admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:27.658038 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933f3f8d-060d-4436-ba46-fb72d43bf34e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:27.658844 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130cc707-d5e2-4919-9db4-bceedca1917c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:27.659879 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130cc707-d5e2-4919-9db4-bceedca1917c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:27.665285 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933f3f8d-060d-4436-ba46-fb72d43bf34e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:27.665426 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130cc707-d5e2-4919-9db4-bceedca1917c admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:27.665426 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130cc707-d5e2-4919-9db4-bceedca1917c admin admin] PATH_INFO: `/v3/users/bbd1715608f64bcfbff6bf07039389c9` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:27.665426 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130cc707-d5e2-4919-9db4-bceedca1917c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbd1715608f64bcfbff6bf07039389c9)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:27.665426 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130cc707-d5e2-4919-9db4-bceedca1917c admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:27.776676 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1007/2027] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:12:27 2022] POST /identity/v3/projects => generated 395 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:12:27.777958 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933f3f8d-060d-4436-ba46-fb72d43bf34e admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:27.853839 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933f3f8d-060d-4436-ba46-fb72d43bf34e admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:27.859190 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a69228-17cb-4485-b96e-4f254f009363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:27.861074 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a69228-17cb-4485-b96e-4f254f009363 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:27.861286 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a69228-17cb-4485-b96e-4f254f009363 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:27.861577 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a69228-17cb-4485-b96e-4f254f009363 admin admin] PATH_INFO: `/v3/projects/a3ef417f52a54c0eaabb9b87ae84b8ac/users/d4227805684e44988f9ebbe14e529a53/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:27.869977 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a69228-17cb-4485-b96e-4f254f009363 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3ef417f52a54c0eaabb9b87ae84b8ac, user_id=d4227805684e44988f9ebbe14e529a53, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:27.873145 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a69228-17cb-4485-b96e-4f254f009363 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:27.894610 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1008/2028] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:12:27 2022] PUT /identity/v3/projects/a3ef417f52a54c0eaabb9b87ae84b8ac/users/d4227805684e44988f9ebbe14e529a53/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:27.908585 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a69228-17cb-4485-b96e-4f254f009363 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:27.921364 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-130cc707-d5e2-4919-9db4-bceedca1917c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbd1715608f64bcfbff6bf07039389c9'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:27.938932 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-130cc707-d5e2-4919-9db4-bceedca1917c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbd1715608f64bcfbff6bf07039389c9'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:27.952267 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-130cc707-d5e2-4919-9db4-bceedca1917c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbd1715608f64bcfbff6bf07039389c9'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:28.009851 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a69228-17cb-4485-b96e-4f254f009363 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:28.015358 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd28a559-2e36-440c-8741-11b52cecab17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:28.016703 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd28a559-2e36-440c-8741-11b52cecab17 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:28.016986 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd28a559-2e36-440c-8741-11b52cecab17 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:28.017273 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd28a559-2e36-440c-8741-11b52cecab17 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:28.017958 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd28a559-2e36-440c-8741-11b52cecab17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:28.020029 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd28a559-2e36-440c-8741-11b52cecab17 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:28.074837 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-130cc707-d5e2-4919-9db4-bceedca1917c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbd1715608f64bcfbff6bf07039389c9'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:28.075880 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-130cc707-d5e2-4919-9db4-bceedca1917c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbd1715608f64bcfbff6bf07039389c9'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:28.086055 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1021/2029] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:12:27 2022] DELETE /identity/v3/users/bbd1715608f64bcfbff6bf07039389c9 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:28.086055 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4785f-c133-4e25-8c8b-1080743523a1 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:28.086055 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4785f-c133-4e25-8c8b-1080743523a1 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:28.090921 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4785f-c133-4e25-8c8b-1080743523a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:28.122900 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-96c4785f-c133-4e25-8c8b-1080743523a1 None None] MFA Rules not processed for user `d4227805684e44988f9ebbe14e529a53`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:28.127229 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1009/2030] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:12:27 2022] POST /identity/v3/users => generated 298 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:12:28.127229 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9ab07-71ea-4856-ac5a-f40cf12db321 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:28.127229 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9ab07-71ea-4856-ac5a-f40cf12db321 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:28.127229 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9ab07-71ea-4856-ac5a-f40cf12db321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:28.129081 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-96c4785f-c133-4e25-8c8b-1080743523a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:28.145907 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-1fc9ab07-71ea-4856-ac5a-f40cf12db321 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:28.147175 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-1fc9ab07-71ea-4856-ac5a-f40cf12db321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:28.210534 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1022/2031] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:28 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:28.212010 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c4785f-c133-4e25-8c8b-1080743523a1 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:28.214209 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-96c4785f-c133-4e25-8c8b-1080743523a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:28.226181 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1010/2032] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:28.227686 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc9ab07-71ea-4856-ac5a-f40cf12db321 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:28.232834 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c4785f-c133-4e25-8c8b-1080743523a1 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:28.240113 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f5873-c889-430a-8b1e-127a88928b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:28.244276 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f5873-c889-430a-8b1e-127a88928b30 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:28.244276 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f5873-c889-430a-8b1e-127a88928b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:28.244463 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc9ab07-71ea-4856-ac5a-f40cf12db321 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:28.247089 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6089ab-6b2e-4b4b-a4ac-515567c700d6 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4227805684e44988f9ebbe14e529a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3ef417f52a54c0eaabb9b87ae84b8ac', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:28.247655 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f5873-c889-430a-8b1e-127a88928b30 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:28.247856 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6089ab-6b2e-4b4b-a4ac-515567c700d6 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:28.248098 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6089ab-6b2e-4b4b-a4ac-515567c700d6 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:28.248554 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6089ab-6b2e-4b4b-a4ac-515567c700d6 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:28.249146 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6089ab-6b2e-4b4b-a4ac-515567c700d6 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:12:28.249549 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6089ab-6b2e-4b4b-a4ac-515567c700d6 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:28.251117 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375f5873-c889-430a-8b1e-127a88928b30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:28.251210 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6089ab-6b2e-4b4b-a4ac-515567c700d6 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:28.253055 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375f5873-c889-430a-8b1e-127a88928b30 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:28.270796 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1011/2033] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:12:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:12:28.271794 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6089ab-6b2e-4b4b-a4ac-515567c700d6 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:28.273869 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-4f6089ab-6b2e-4b4b-a4ac-515567c700d6 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:28.281955 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1023/2034] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:12:28 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:12:28.290745 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f5873-c889-430a-8b1e-127a88928b30 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:28.320428 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f5873-c889-430a-8b1e-127a88928b30 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:28.332792 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d0a9c-9735-4208-99b0-aa35700a3682 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4227805684e44988f9ebbe14e529a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3ef417f52a54c0eaabb9b87ae84b8ac', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:28.333489 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d0a9c-9735-4208-99b0-aa35700a3682 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:28.333773 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d0a9c-9735-4208-99b0-aa35700a3682 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:28.334051 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d0a9c-9735-4208-99b0-aa35700a3682 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:28.336075 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18d0a9c-9735-4208-99b0-aa35700a3682 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:28.340491 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18d0a9c-9735-4208-99b0-aa35700a3682 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:28.376597 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6089ab-6b2e-4b4b-a4ac-515567c700d6 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:28.380787 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814b4b4b-38bc-42e1-bc23-074a7f9a1922 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:28.381948 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b4b4b-38bc-42e1-bc23-074a7f9a1922 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:28.382239 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b4b4b-38bc-42e1-bc23-074a7f9a1922 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:28.383070 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b4b4b-38bc-42e1-bc23-074a7f9a1922 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:28.394872 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814b4b4b-38bc-42e1-bc23-074a7f9a1922 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:28.399443 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814b4b4b-38bc-42e1-bc23-074a7f9a1922 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:28.406567 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1012/2035] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:12:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:12:28.407494 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814b4b4b-38bc-42e1-bc23-074a7f9a1922 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:28.416957 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814b4b4b-38bc-42e1-bc23-074a7f9a1922 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:28.422468 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89594ea-f05d-4a38-9f95-36af0483e641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:28.422757 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89594ea-f05d-4a38-9f95-36af0483e641 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:28.423039 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89594ea-f05d-4a38-9f95-36af0483e641 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:28.423322 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89594ea-f05d-4a38-9f95-36af0483e641 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:28.424086 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89594ea-f05d-4a38-9f95-36af0483e641 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:28.425717 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89594ea-f05d-4a38-9f95-36af0483e641 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:28.437864 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1013/2036] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:12:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:12:28.444501 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89594ea-f05d-4a38-9f95-36af0483e641 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:28.457585 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89594ea-f05d-4a38-9f95-36af0483e641 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:28.462757 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5835f4-4505-472f-ad88-8e18edac98b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:28.463521 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5835f4-4505-472f-ad88-8e18edac98b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:28.463815 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5835f4-4505-472f-ad88-8e18edac98b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:28.467747 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5835f4-4505-472f-ad88-8e18edac98b9 admin admin] PATH_INFO: `/v3/projects/e705836efd0a45fbb5bedb2fc26ca87b/users/6b3d0249b7a0487cb139849e22b84ca5/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:28.489658 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5835f4-4505-472f-ad88-8e18edac98b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e705836efd0a45fbb5bedb2fc26ca87b, user_id=6b3d0249b7a0487cb139849e22b84ca5, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:28.493910 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5835f4-4505-472f-ad88-8e18edac98b9 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:28.510912 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1024/2037] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:12:28 2022] POST /identity/v3/projects => generated 371 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:12:28.523109 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d0a9c-9735-4208-99b0-aa35700a3682 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:28.582544 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1014/2038] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:12:28 2022] PUT /identity/v3/projects/e705836efd0a45fbb5bedb2fc26ca87b/users/6b3d0249b7a0487cb139849e22b84ca5/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:28.593018 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041a6dd-517f-4843-bf9b-6edbd0e22592 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:28.594484 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041a6dd-517f-4843-bf9b-6edbd0e22592 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:28.595286 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041a6dd-517f-4843-bf9b-6edbd0e22592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:28.608509 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d0a9c-9735-4208-99b0-aa35700a3682 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:28.637396 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-6041a6dd-517f-4843-bf9b-6edbd0e22592 None None] MFA Rules not processed for user `6b3d0249b7a0487cb139849e22b84ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:28.639137 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-6041a6dd-517f-4843-bf9b-6edbd0e22592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:28.744791 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc9ed24-bceb-4aba-95f7-fa3aa27d9703 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4227805684e44988f9ebbe14e529a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3ef417f52a54c0eaabb9b87ae84b8ac', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:28.748675 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9ed24-bceb-4aba-95f7-fa3aa27d9703 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:28.749282 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9ed24-bceb-4aba-95f7-fa3aa27d9703 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:28.750586 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9ed24-bceb-4aba-95f7-fa3aa27d9703 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:28.751820 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc9ed24-bceb-4aba-95f7-fa3aa27d9703 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:12:28.752108 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc9ed24-bceb-4aba-95f7-fa3aa27d9703 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:28.754164 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc9ed24-bceb-4aba-95f7-fa3aa27d9703 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:28.768550 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1015/2039] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:12:28.769542 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6041a6dd-517f-4843-bf9b-6edbd0e22592 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:28.771584 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-6041a6dd-517f-4843-bf9b-6edbd0e22592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:28.773799 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1025/2040] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:12:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:12:28.774976 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc9ed24-bceb-4aba-95f7-fa3aa27d9703 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:28.862343 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc9ed24-bceb-4aba-95f7-fa3aa27d9703 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:28.870636 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c08f0c-1cd8-4674-8564-bab7ba4887d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:28.872281 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c08f0c-1cd8-4674-8564-bab7ba4887d1 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:28.872576 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c08f0c-1cd8-4674-8564-bab7ba4887d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:28.872862 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c08f0c-1cd8-4674-8564-bab7ba4887d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:28.873550 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c08f0c-1cd8-4674-8564-bab7ba4887d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:28.876040 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6041a6dd-517f-4843-bf9b-6edbd0e22592 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:28.876360 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c08f0c-1cd8-4674-8564-bab7ba4887d1 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:28.882514 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8724041b-85e0-486b-9dad-1d675deeb614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:28.883899 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724041b-85e0-486b-9dad-1d675deeb614 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:28.884398 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724041b-85e0-486b-9dad-1d675deeb614 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:28.884873 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724041b-85e0-486b-9dad-1d675deeb614 admin admin] PATH_INFO: `/v3/projects/7284e17654bc4a62a6d92db0f9fe2b5e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:28.886779 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8724041b-85e0-486b-9dad-1d675deeb614 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7284e17654bc4a62a6d92db0f9fe2b5e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:28.890286 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8724041b-85e0-486b-9dad-1d675deeb614 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:29.025728 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1026/2041] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:12:28 2022] POST /identity/v3/projects => generated 393 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:12:29.025728 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c08f0c-1cd8-4674-8564-bab7ba4887d1 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:29.025728 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-13c08f0c-1cd8-4674-8564-bab7ba4887d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:29.078454 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-8724041b-85e0-486b-9dad-1d675deeb614 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7284e17654bc4a62a6d92db0f9fe2b5e', 'request_id': 'req-8724041b-85e0-486b-9dad-1d675deeb614'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:29.086711 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-8724041b-85e0-486b-9dad-1d675deeb614 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7284e17654bc4a62a6d92db0f9fe2b5e', 'request_id': 'req-8724041b-85e0-486b-9dad-1d675deeb614'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:29.096410 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-8724041b-85e0-486b-9dad-1d675deeb614 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7284e17654bc4a62a6d92db0f9fe2b5e', 'request_id': 'req-8724041b-85e0-486b-9dad-1d675deeb614'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:29.128007 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c08f0c-1cd8-4674-8564-bab7ba4887d1 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:29.180672 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-8724041b-85e0-486b-9dad-1d675deeb614 admin admin] The token cache is being invalidate because project 7284e17654bc4a62a6d92db0f9fe2b5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:12:29.181000 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-8724041b-85e0-486b-9dad-1d675deeb614 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:29.182034 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-8724041b-85e0-486b-9dad-1d675deeb614 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:29.187144 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1016/2042] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:12:28 2022] DELETE /identity/v3/projects/7284e17654bc4a62a6d92db0f9fe2b5e => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:29.187144 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8724041b-85e0-486b-9dad-1d675deeb614 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:29.190759 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8724041b-85e0-486b-9dad-1d675deeb614 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:29.211559 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bac7081-bf48-4297-b832-2d746412331d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:29.212497 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac7081-bf48-4297-b832-2d746412331d service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:29.213369 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac7081-bf48-4297-b832-2d746412331d service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:29.213657 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac7081-bf48-4297-b832-2d746412331d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:29.215587 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-9bac7081-bf48-4297-b832-2d746412331d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:29.269878 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8724041b-85e0-486b-9dad-1d675deeb614 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:29.275540 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb915bf-52c4-4d54-8076-afdd033faa83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:29.276428 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb915bf-52c4-4d54-8076-afdd033faa83 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:29.276740 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb915bf-52c4-4d54-8076-afdd033faa83 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:29.277014 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb915bf-52c4-4d54-8076-afdd033faa83 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:29.277750 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb915bf-52c4-4d54-8076-afdd033faa83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:29.279879 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb915bf-52c4-4d54-8076-afdd033faa83 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:29.285756 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bac7081-bf48-4297-b832-2d746412331d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:29.287404 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bac7081-bf48-4297-b832-2d746412331d service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:29.297672 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1027/2043] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:12:29 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:12:29.300344 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bac7081-bf48-4297-b832-2d746412331d service nova] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:29.300344 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-9bac7081-bf48-4297-b832-2d746412331d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:29.320272 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bac7081-bf48-4297-b832-2d746412331d service nova] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:29.331776 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed52a1c0-1544-4176-b96f-469b903b62d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:29.334282 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed52a1c0-1544-4176-b96f-469b903b62d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:29.334282 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed52a1c0-1544-4176-b96f-469b903b62d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:29.334282 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed52a1c0-1544-4176-b96f-469b903b62d1 admin admin] PATH_INFO: `/v3/users/63d4ee28ddbc4d5885f048e4cbefc85d` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:29.334590 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed52a1c0-1544-4176-b96f-469b903b62d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63d4ee28ddbc4d5885f048e4cbefc85d)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:29.336640 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed52a1c0-1544-4176-b96f-469b903b62d1 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:29.358776 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1017/2044] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:12:29 2022] POST /identity/v3/users => generated 303 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:12:29.360851 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d456a3-eb12-4781-aeb7-a569688a1b09 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:29.361207 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d456a3-eb12-4781-aeb7-a569688a1b09 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:29.361578 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d456a3-eb12-4781-aeb7-a569688a1b09 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:29.362978 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1018/2045] 10.222.0.52 () {54 vars in 912 bytes} [Sat May 14 21:12:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:12:29.363726 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d456a3-eb12-4781-aeb7-a569688a1b09 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:29.376480 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d456a3-eb12-4781-aeb7-a569688a1b09 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:29.381303 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d33ccb-5be3-4e4d-a628-ba5bec410492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:29.381961 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d33ccb-5be3-4e4d-a628-ba5bec410492 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:29.382243 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d33ccb-5be3-4e4d-a628-ba5bec410492 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:29.382520 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d33ccb-5be3-4e4d-a628-ba5bec410492 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:29.383234 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d33ccb-5be3-4e4d-a628-ba5bec410492 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:29.384902 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d33ccb-5be3-4e4d-a628-ba5bec410492 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:29.395581 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1019/2046] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:12:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:12:29.396437 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d33ccb-5be3-4e4d-a628-ba5bec410492 admin admin] Authenticating service token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 14 21:12:29.398061 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-31d33ccb-5be3-4e4d-a628-ba5bec410492 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:29.414864 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d33ccb-5be3-4e4d-a628-ba5bec410492 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:29.425219 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d33ccb-5be3-4e4d-a628-ba5bec410492 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:29.429875 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac529a-ac53-43e3-8906-23b2bb4ca343 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4227805684e44988f9ebbe14e529a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3ef417f52a54c0eaabb9b87ae84b8ac', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:29.431135 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac529a-ac53-43e3-8906-23b2bb4ca343 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:29.431412 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac529a-ac53-43e3-8906-23b2bb4ca343 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:29.431721 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac529a-ac53-43e3-8906-23b2bb4ca343 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] PATH_INFO: `/v3/projects/ee19ac3a5cf4496fb0909a5418060b37` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:29.432915 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cac529a-ac53-43e3-8906-23b2bb4ca343 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] RBAC: Authorizing `identity:get_project(project_id=ee19ac3a5cf4496fb0909a5418060b37)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:29.434991 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cac529a-ac53-43e3-8906-23b2bb4ca343 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:29.436979 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1020/2047] 10.222.0.52 () {58 vars in 1443 bytes} [Sat May 14 21:12:29 2022] GET /identity/v3/projects/ee19ac3a5cf4496fb0909a5418060b37 => generated 371 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:12:29.437686 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac529a-ac53-43e3-8906-23b2bb4ca343 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:29.448308 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac529a-ac53-43e3-8906-23b2bb4ca343 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:29.453481 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2665b3-c0f6-496f-a877-6fee89b886b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:29.454575 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2665b3-c0f6-496f-a877-6fee89b886b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:29.454867 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2665b3-c0f6-496f-a877-6fee89b886b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:29.455471 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2665b3-c0f6-496f-a877-6fee89b886b8 admin admin] PATH_INFO: `/v3/projects/76448e8c96cb4a719665c2ef24c71797/users/7aa08ba30f0b4a00a388ca9b81ad26d2/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:29.478810 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2665b3-c0f6-496f-a877-6fee89b886b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76448e8c96cb4a719665c2ef24c71797, user_id=7aa08ba30f0b4a00a388ca9b81ad26d2, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:29.481932 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2665b3-c0f6-496f-a877-6fee89b886b8 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:29.549126 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ed52a1c0-1544-4176-b96f-469b903b62d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63d4ee28ddbc4d5885f048e4cbefc85d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:29.566770 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ed52a1c0-1544-4176-b96f-469b903b62d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63d4ee28ddbc4d5885f048e4cbefc85d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:29.574171 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1021/2048] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:12:29 2022] PUT /identity/v3/projects/76448e8c96cb4a719665c2ef24c71797/users/7aa08ba30f0b4a00a388ca9b81ad26d2/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:29.576553 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ed52a1c0-1544-4176-b96f-469b903b62d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63d4ee28ddbc4d5885f048e4cbefc85d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:29.578960 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2665b3-c0f6-496f-a877-6fee89b886b8 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:29.649215 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2665b3-c0f6-496f-a877-6fee89b886b8 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:29.655653 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74b61db-0470-44fb-9273-8039521ebef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:29.655653 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b61db-0470-44fb-9273-8039521ebef6 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:29.655828 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ed52a1c0-1544-4176-b96f-469b903b62d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63d4ee28ddbc4d5885f048e4cbefc85d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:29.656014 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b61db-0470-44fb-9273-8039521ebef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:29.656014 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b61db-0470-44fb-9273-8039521ebef6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:29.656548 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74b61db-0470-44fb-9273-8039521ebef6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:29.657368 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ed52a1c0-1544-4176-b96f-469b903b62d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63d4ee28ddbc4d5885f048e4cbefc85d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:29.657869 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74b61db-0470-44fb-9273-8039521ebef6 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:29.665932 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1028/2049] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:12:29 2022] DELETE /identity/v3/users/63d4ee28ddbc4d5885f048e4cbefc85d => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:29.682463 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1022/2050] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:12:29 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:12:29.687207 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed52a1c0-1544-4176-b96f-469b903b62d1 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:29.689214 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ed52a1c0-1544-4176-b96f-469b903b62d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:29.760411 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d81f4-d2df-44ee-8ace-46ce88785a42 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:29.760736 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d81f4-d2df-44ee-8ace-46ce88785a42 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:29.761023 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d81f4-d2df-44ee-8ace-46ce88785a42 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:29.763126 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1023/2051] 10.222.0.52 () {54 vars in 912 bytes} [Sat May 14 21:12:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:12:29.769986 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517d81f4-d2df-44ee-8ace-46ce88785a42 None None] Authenticating service token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 14 21:12:29.771999 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-517d81f4-d2df-44ee-8ace-46ce88785a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:29.777772 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed52a1c0-1544-4176-b96f-469b903b62d1 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:29.784139 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d0be54-9d94-4412-ba34-7fda7c3c7bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:29.785051 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d0be54-9d94-4412-ba34-7fda7c3c7bea admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:29.785326 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d0be54-9d94-4412-ba34-7fda7c3c7bea admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:29.785606 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d0be54-9d94-4412-ba34-7fda7c3c7bea admin admin] PATH_INFO: `/v3/projects/76448e8c96cb4a719665c2ef24c71797/users/7aa08ba30f0b4a00a388ca9b81ad26d2/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:29.788017 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d0be54-9d94-4412-ba34-7fda7c3c7bea admin admin] RBAC: Authorizing `identity:create_grant(project_id=76448e8c96cb4a719665c2ef24c71797, user_id=7aa08ba30f0b4a00a388ca9b81ad26d2, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:29.790967 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d0be54-9d94-4412-ba34-7fda7c3c7bea admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:29.804885 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1029/2052] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:12:29 2022] PUT /identity/v3/projects/76448e8c96cb4a719665c2ef24c71797/users/7aa08ba30f0b4a00a388ca9b81ad26d2/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:12:29.816677 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b64772-cfd7-4063-9966-8be876a63f15 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:29.817109 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b64772-cfd7-4063-9966-8be876a63f15 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:29.817495 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b64772-cfd7-4063-9966-8be876a63f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:29.849334 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-b8b64772-cfd7-4063-9966-8be876a63f15 None None] MFA Rules not processed for user `7aa08ba30f0b4a00a388ca9b81ad26d2`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:29.850718 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b8b64772-cfd7-4063-9966-8be876a63f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:29.888429 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517d81f4-d2df-44ee-8ace-46ce88785a42 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:29.891075 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-517d81f4-d2df-44ee-8ace-46ce88785a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:29.962743 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1030/2053] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:29 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:12:30.015019 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b64772-cfd7-4063-9966-8be876a63f15 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:30.016546 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b8b64772-cfd7-4063-9966-8be876a63f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:30.063129 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517d81f4-d2df-44ee-8ace-46ce88785a42 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:30.145534 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b64772-cfd7-4063-9966-8be876a63f15 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:30.160405 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21046f7a-cafb-4f79-9375-b55c6bc984b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:30.161417 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21046f7a-cafb-4f79-9375-b55c6bc984b2 service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:30.161955 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21046f7a-cafb-4f79-9375-b55c6bc984b2 service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:30.163381 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21046f7a-cafb-4f79-9375-b55c6bc984b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:30.171138 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72bc16c-84fa-4dfd-a30d-b58cd05c0a3f tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4227805684e44988f9ebbe14e529a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3ef417f52a54c0eaabb9b87ae84b8ac', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:30.173033 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72bc16c-84fa-4dfd-a30d-b58cd05c0a3f tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:30.173419 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21046f7a-cafb-4f79-9375-b55c6bc984b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:30.173835 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72bc16c-84fa-4dfd-a30d-b58cd05c0a3f tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:30.174323 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72bc16c-84fa-4dfd-a30d-b58cd05c0a3f tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] PATH_INFO: `/v3/projects/ee19ac3a5cf4496fb0909a5418060b37` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:30.175076 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21046f7a-cafb-4f79-9375-b55c6bc984b2 service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:30.176336 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72bc16c-84fa-4dfd-a30d-b58cd05c0a3f tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] RBAC: Authorizing `identity:get_project(project_id=ee19ac3a5cf4496fb0909a5418060b37)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:30.178805 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72bc16c-84fa-4dfd-a30d-b58cd05c0a3f tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:30.181246 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1024/2054] 10.222.0.52 () {58 vars in 1443 bytes} [Sat May 14 21:12:29 2022] GET /identity/v3/projects/ee19ac3a5cf4496fb0909a5418060b37 => generated 371 bytes in 412 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:12:30.188001 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72bc16c-84fa-4dfd-a30d-b58cd05c0a3f tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:30.188001 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-a72bc16c-84fa-4dfd-a30d-b58cd05c0a3f tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:30.198729 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1031/2055] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:12:30 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:12:30.312243 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72bc16c-84fa-4dfd-a30d-b58cd05c0a3f tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:30.319109 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef8e5cc-f740-458b-a83c-416fc79e91f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:30.319984 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef8e5cc-f740-458b-a83c-416fc79e91f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:30.320271 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef8e5cc-f740-458b-a83c-416fc79e91f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:30.320693 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef8e5cc-f740-458b-a83c-416fc79e91f3 admin admin] PATH_INFO: `/v3/projects/0486a488dff8466eab866f24429eab4e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:30.322060 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef8e5cc-f740-458b-a83c-416fc79e91f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0486a488dff8466eab866f24429eab4e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:30.324161 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef8e5cc-f740-458b-a83c-416fc79e91f3 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:30.378293 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21046f7a-cafb-4f79-9375-b55c6bc984b2 service nova] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:30.379799 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-21046f7a-cafb-4f79-9375-b55c6bc984b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:30.404851 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21046f7a-cafb-4f79-9375-b55c6bc984b2 service nova] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:30.413379 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee9c548-84d0-45ae-a6d0-3ec7c5678c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:30.414068 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9c548-84d0-45ae-a6d0-3ec7c5678c42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:30.414349 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9c548-84d0-45ae-a6d0-3ec7c5678c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:30.414621 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9c548-84d0-45ae-a6d0-3ec7c5678c42 admin admin] PATH_INFO: `/v3/users/9c6eeaaeaddc449294b0231b93d9218b` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:30.416019 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee9c548-84d0-45ae-a6d0-3ec7c5678c42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c6eeaaeaddc449294b0231b93d9218b)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:30.417960 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee9c548-84d0-45ae-a6d0-3ec7c5678c42 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:30.475717 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-eef8e5cc-f740-458b-a83c-416fc79e91f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0486a488dff8466eab866f24429eab4e', 'request_id': 'req-eef8e5cc-f740-458b-a83c-416fc79e91f3'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:30.486403 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-eef8e5cc-f740-458b-a83c-416fc79e91f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0486a488dff8466eab866f24429eab4e', 'request_id': 'req-eef8e5cc-f740-458b-a83c-416fc79e91f3'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:30.500289 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-eef8e5cc-f740-458b-a83c-416fc79e91f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0486a488dff8466eab866f24429eab4e', 'request_id': 'req-eef8e5cc-f740-458b-a83c-416fc79e91f3'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:30.581623 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-eef8e5cc-f740-458b-a83c-416fc79e91f3 admin admin] The token cache is being invalidate because project 0486a488dff8466eab866f24429eab4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:12:30.582258 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-eef8e5cc-f740-458b-a83c-416fc79e91f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:30.583293 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-eef8e5cc-f740-458b-a83c-416fc79e91f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:30.584958 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1025/2056] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:12:30 2022] DELETE /identity/v3/projects/0486a488dff8466eab866f24429eab4e => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:30.585721 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef8e5cc-f740-458b-a83c-416fc79e91f3 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:30.587154 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-eef8e5cc-f740-458b-a83c-416fc79e91f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:30.652029 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0ee9c548-84d0-45ae-a6d0-3ec7c5678c42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c6eeaaeaddc449294b0231b93d9218b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:30.677412 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0ee9c548-84d0-45ae-a6d0-3ec7c5678c42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c6eeaaeaddc449294b0231b93d9218b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:30.686720 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef8e5cc-f740-458b-a83c-416fc79e91f3 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:30.688489 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0ee9c548-84d0-45ae-a6d0-3ec7c5678c42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c6eeaaeaddc449294b0231b93d9218b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:30.695305 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1a55b4-84b4-4a33-a555-ed606056de3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:30.696264 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1a55b4-84b4-4a33-a555-ed606056de3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:30.696683 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1a55b4-84b4-4a33-a555-ed606056de3e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:30.696959 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1a55b4-84b4-4a33-a555-ed606056de3e admin admin] PATH_INFO: `/v3/users/6b3d0249b7a0487cb139849e22b84ca5` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:30.698255 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1a55b4-84b4-4a33-a555-ed606056de3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b3d0249b7a0487cb139849e22b84ca5)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:30.700847 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1a55b4-84b4-4a33-a555-ed606056de3e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:30.757362 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0ee9c548-84d0-45ae-a6d0-3ec7c5678c42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c6eeaaeaddc449294b0231b93d9218b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:30.758144 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0ee9c548-84d0-45ae-a6d0-3ec7c5678c42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c6eeaaeaddc449294b0231b93d9218b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:30.770806 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1032/2057] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:12:30 2022] DELETE /identity/v3/users/9c6eeaaeaddc449294b0231b93d9218b => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:30.772601 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051faea-2255-43f9-a3e0-4214aeb2af5f None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:30.773121 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051faea-2255-43f9-a3e0-4214aeb2af5f None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:30.773690 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051faea-2255-43f9-a3e0-4214aeb2af5f None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:30.775694 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1033/2058] 10.222.0.52 () {54 vars in 912 bytes} [Sat May 14 21:12:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:12:30.777236 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71174729-9e47-4dcb-aec5-52632f52355e None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:30.777584 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71174729-9e47-4dcb-aec5-52632f52355e None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:30.777957 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71174729-9e47-4dcb-aec5-52632f52355e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:30.797719 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-71174729-9e47-4dcb-aec5-52632f52355e None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:30.798951 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-71174729-9e47-4dcb-aec5-52632f52355e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:30.862906 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1034/2059] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:30.864448 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada183b-795a-41bc-920c-03edddbe2bdb None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:30.877804 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada183b-795a-41bc-920c-03edddbe2bdb None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:30.877804 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada183b-795a-41bc-920c-03edddbe2bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:30.884529 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-3ada183b-795a-41bc-920c-03edddbe2bdb None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:30.885734 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-3ada183b-795a-41bc-920c-03edddbe2bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:30.895319 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1035/2060] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:30.898551 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ada183b-795a-41bc-920c-03edddbe2bdb None None] Authenticating service token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 14 21:12:30.900584 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-3ada183b-795a-41bc-920c-03edddbe2bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:30.950240 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-1b1a55b4-84b4-4a33-a555-ed606056de3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b3d0249b7a0487cb139849e22b84ca5'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:30.959420 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-1b1a55b4-84b4-4a33-a555-ed606056de3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b3d0249b7a0487cb139849e22b84ca5'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:30.960515 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-1b1a55b4-84b4-4a33-a555-ed606056de3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b3d0249b7a0487cb139849e22b84ca5'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:30.978477 ncdv-master-1 devstack@keystone.service[91106]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-3ada183b-795a-41bc-920c-03edddbe2bdb None None] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. May 14 21:12:30.978477 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ada183b-795a-41bc-920c-03edddbe2bdb None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:30.979778 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-3ada183b-795a-41bc-920c-03edddbe2bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:31.011013 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-1b1a55b4-84b4-4a33-a555-ed606056de3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b3d0249b7a0487cb139849e22b84ca5'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:31.025759 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-1b1a55b4-84b4-4a33-a555-ed606056de3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b3d0249b7a0487cb139849e22b84ca5'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:31.032732 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1026/2061] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:12:30 2022] DELETE /identity/v3/users/6b3d0249b7a0487cb139849e22b84ca5 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:31.034032 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd488f3-c773-468c-b3ee-08e1022aa028 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:31.034385 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd488f3-c773-468c-b3ee-08e1022aa028 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:31.034719 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd488f3-c773-468c-b3ee-08e1022aa028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:31.045892 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ada183b-795a-41bc-920c-03edddbe2bdb None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:31.053794 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-dbd488f3-c773-468c-b3ee-08e1022aa028 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:31.055106 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-dbd488f3-c773-468c-b3ee-08e1022aa028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:31.109009 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b4a371-1e64-4efe-b661-6575ff685793 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4227805684e44988f9ebbe14e529a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3ef417f52a54c0eaabb9b87ae84b8ac', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:31.110162 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4a371-1e64-4efe-b661-6575ff685793 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:31.110628 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4a371-1e64-4efe-b661-6575ff685793 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:31.110913 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4a371-1e64-4efe-b661-6575ff685793 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] PATH_INFO: `/v3/projects/ee19ac3a5cf4496fb0909a5418060b37` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:31.112187 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b4a371-1e64-4efe-b661-6575ff685793 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] RBAC: Authorizing `identity:get_project(project_id=ee19ac3a5cf4496fb0909a5418060b37)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:31.114355 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b4a371-1e64-4efe-b661-6575ff685793 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:31.116361 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1036/2062] 10.222.0.52 () {58 vars in 1443 bytes} [Sat May 14 21:12:30 2022] GET /identity/v3/projects/ee19ac3a5cf4496fb0909a5418060b37 => generated 371 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:12:31.116976 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b4a371-1e64-4efe-b661-6575ff685793 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:31.118612 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b0b4a371-1e64-4efe-b661-6575ff685793 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:31.172350 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1027/2063] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:31.172350 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3873bf6-2685-4189-aba2-82a52d578d6a None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:31.172350 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3873bf6-2685-4189-aba2-82a52d578d6a None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:31.172350 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3873bf6-2685-4189-aba2-82a52d578d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:31.185209 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b4a371-1e64-4efe-b661-6575ff685793 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:31.193686 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1963e3-8f5e-46b2-934e-f3d4220ad349 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:31.195199 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1963e3-8f5e-46b2-934e-f3d4220ad349 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:31.200102 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-f3873bf6-2685-4189-aba2-82a52d578d6a None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:31.201318 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-f3873bf6-2685-4189-aba2-82a52d578d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:31.208480 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1963e3-8f5e-46b2-934e-f3d4220ad349 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:31.208804 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1963e3-8f5e-46b2-934e-f3d4220ad349 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:31.212675 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-3d1963e3-8f5e-46b2-934e-f3d4220ad349 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:31.214040 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1028/2064] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:31.215000 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3873bf6-2685-4189-aba2-82a52d578d6a None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:31.216478 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-f3873bf6-2685-4189-aba2-82a52d578d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:31.225864 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1963e3-8f5e-46b2-934e-f3d4220ad349 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:31.227410 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1963e3-8f5e-46b2-934e-f3d4220ad349 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:31.231114 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3873bf6-2685-4189-aba2-82a52d578d6a None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:31.237329 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce028d2-0f20-4ad4-a03d-18c1aa7af084 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4227805684e44988f9ebbe14e529a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3ef417f52a54c0eaabb9b87ae84b8ac', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:31.238208 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce028d2-0f20-4ad4-a03d-18c1aa7af084 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:31.238495 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce028d2-0f20-4ad4-a03d-18c1aa7af084 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:31.238771 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce028d2-0f20-4ad4-a03d-18c1aa7af084 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] PATH_INFO: `/v3/projects/ee19ac3a5cf4496fb0909a5418060b37` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:31.239048 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1037/2065] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:12:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:12:31.239994 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1963e3-8f5e-46b2-934e-f3d4220ad349 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:31.240376 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce028d2-0f20-4ad4-a03d-18c1aa7af084 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ee19ac3a5cf4496fb0909a5418060b37)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:31.241348 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-3d1963e3-8f5e-46b2-934e-f3d4220ad349 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:31.242413 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce028d2-0f20-4ad4-a03d-18c1aa7af084 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:31.325726 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1963e3-8f5e-46b2-934e-f3d4220ad349 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:31.333925 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef092ead-db96-4186-9300-c8c7465701e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:31.334994 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef092ead-db96-4186-9300-c8c7465701e5 service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:31.335279 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef092ead-db96-4186-9300-c8c7465701e5 service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:31.335592 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef092ead-db96-4186-9300-c8c7465701e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:31.337844 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ef092ead-db96-4186-9300-c8c7465701e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:31.366783 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3ce028d2-0f20-4ad4-a03d-18c1aa7af084 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee19ac3a5cf4496fb0909a5418060b37', 'request_id': 'req-3ce028d2-0f20-4ad4-a03d-18c1aa7af084'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:31.373952 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3ce028d2-0f20-4ad4-a03d-18c1aa7af084 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee19ac3a5cf4496fb0909a5418060b37', 'request_id': 'req-3ce028d2-0f20-4ad4-a03d-18c1aa7af084'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:31.382594 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3ce028d2-0f20-4ad4-a03d-18c1aa7af084 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee19ac3a5cf4496fb0909a5418060b37', 'request_id': 'req-3ce028d2-0f20-4ad4-a03d-18c1aa7af084'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:31.433274 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef092ead-db96-4186-9300-c8c7465701e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:31.434909 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef092ead-db96-4186-9300-c8c7465701e5 service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:31.446376 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1038/2066] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:12:31 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:12:31.447261 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef092ead-db96-4186-9300-c8c7465701e5 service nova] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:31.458572 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef092ead-db96-4186-9300-c8c7465701e5 service nova] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:31.472061 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3ce028d2-0f20-4ad4-a03d-18c1aa7af084 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] The token cache is being invalidate because project ee19ac3a5cf4496fb0909a5418060b37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:12:31.472432 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3ce028d2-0f20-4ad4-a03d-18c1aa7af084 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:31.473161 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3ce028d2-0f20-4ad4-a03d-18c1aa7af084 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:31.479814 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1029/2067] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:12:31 2022] DELETE /identity/v3/projects/ee19ac3a5cf4496fb0909a5418060b37 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:31.483273 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce028d2-0f20-4ad4-a03d-18c1aa7af084 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:31.484824 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-3ce028d2-0f20-4ad4-a03d-18c1aa7af084 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:31.567912 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2df05-60c9-4f34-a227-dfb3ab6c2cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:31.570210 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce028d2-0f20-4ad4-a03d-18c1aa7af084 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:31.571043 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2df05-60c9-4f34-a227-dfb3ab6c2cca admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:31.571327 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2df05-60c9-4f34-a227-dfb3ab6c2cca admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:31.571625 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2df05-60c9-4f34-a227-dfb3ab6c2cca admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:31.572354 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad2df05-60c9-4f34-a227-dfb3ab6c2cca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:12:31.572655 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad2df05-60c9-4f34-a227-dfb3ab6c2cca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:31.575453 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad2df05-60c9-4f34-a227-dfb3ab6c2cca admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:31.581777 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207b411f-9aeb-4a75-b540-91abbe8410b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:31.582497 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b411f-9aeb-4a75-b540-91abbe8410b0 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:31.582781 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b411f-9aeb-4a75-b540-91abbe8410b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:31.583052 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b411f-9aeb-4a75-b540-91abbe8410b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:31.585866 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-207b411f-9aeb-4a75-b540-91abbe8410b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:31.607520 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207b411f-9aeb-4a75-b540-91abbe8410b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:31.609389 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1039/2068] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:12:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:12:31.609846 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207b411f-9aeb-4a75-b540-91abbe8410b0 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:31.612010 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f13f3-1ff9-46ef-8d08-984a5b55215a None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:31.612511 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f13f3-1ff9-46ef-8d08-984a5b55215a None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:31.613062 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f13f3-1ff9-46ef-8d08-984a5b55215a None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:31.615146 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1040/2069] 10.222.0.52 () {54 vars in 912 bytes} [Sat May 14 21:12:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:12:31.616192 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64f13f3-1ff9-46ef-8d08-984a5b55215a None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:31.620733 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e64f13f3-1ff9-46ef-8d08-984a5b55215a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:31.632604 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1030/2070] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:12:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:12:31.633900 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207b411f-9aeb-4a75-b540-91abbe8410b0 service neutron] Authenticating service token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 14 21:12:31.635437 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-207b411f-9aeb-4a75-b540-91abbe8410b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:31.643325 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64f13f3-1ff9-46ef-8d08-984a5b55215a None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:31.649144 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b127b4-375d-42cc-a7fc-db1cd7a61db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:31.649690 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b127b4-375d-42cc-a7fc-db1cd7a61db4 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:31.649971 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b127b4-375d-42cc-a7fc-db1cd7a61db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:31.650414 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b127b4-375d-42cc-a7fc-db1cd7a61db4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:31.651642 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b127b4-375d-42cc-a7fc-db1cd7a61db4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:31.653748 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b127b4-375d-42cc-a7fc-db1cd7a61db4 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:31.726307 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207b411f-9aeb-4a75-b540-91abbe8410b0 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:31.728267 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-207b411f-9aeb-4a75-b540-91abbe8410b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:31.822032 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1041/2071] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:12:31 2022] POST /identity/v3/projects => generated 383 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:12:31.822983 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b127b4-375d-42cc-a7fc-db1cd7a61db4 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:31.840453 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207b411f-9aeb-4a75-b540-91abbe8410b0 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:31.904812 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b127b4-375d-42cc-a7fc-db1cd7a61db4 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:31.910872 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f694bb-c7e1-4e34-ba26-61b5873cfaca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:31.911672 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f694bb-c7e1-4e34-ba26-61b5873cfaca admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:31.917186 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f694bb-c7e1-4e34-ba26-61b5873cfaca admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:31.917186 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f694bb-c7e1-4e34-ba26-61b5873cfaca admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:31.917186 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f694bb-c7e1-4e34-ba26-61b5873cfaca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:31.917186 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f694bb-c7e1-4e34-ba26-61b5873cfaca admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:31.930885 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6723954-98b5-43dd-90eb-67731714d248 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4227805684e44988f9ebbe14e529a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3ef417f52a54c0eaabb9b87ae84b8ac', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:31.931958 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6723954-98b5-43dd-90eb-67731714d248 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:31.932246 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6723954-98b5-43dd-90eb-67731714d248 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:31.932680 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6723954-98b5-43dd-90eb-67731714d248 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] PATH_INFO: `/v3/projects/48bf82bdace04c2f93e8c18a0e12626b` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:31.934128 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6723954-98b5-43dd-90eb-67731714d248 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] RBAC: Authorizing `identity:get_project(project_id=48bf82bdace04c2f93e8c18a0e12626b)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:31.936566 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6723954-98b5-43dd-90eb-67731714d248 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:31.940715 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1031/2072] 10.222.0.52 () {58 vars in 1443 bytes} [Sat May 14 21:12:31 2022] GET /identity/v3/projects/48bf82bdace04c2f93e8c18a0e12626b => generated 375 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:12:31.942459 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41890f2-72e2-4cac-abc9-82415390da51 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:31.943367 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41890f2-72e2-4cac-abc9-82415390da51 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:31.945255 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41890f2-72e2-4cac-abc9-82415390da51 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:31.946136 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1032/2073] 10.222.0.52 () {54 vars in 921 bytes} [Sat May 14 21:12:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:12:31.951735 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cabf6d-e28b-4a69-a922-b3b4146c0893 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:31.952435 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cabf6d-e28b-4a69-a922-b3b4146c0893 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:31.956687 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cabf6d-e28b-4a69-a922-b3b4146c0893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:32.003205 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-82cabf6d-e28b-4a69-a922-b3b4146c0893 None None] MFA Rules not processed for user `0f1b0e2b025d4eceaa90e1616d0a9db8`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:32.006550 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-82cabf6d-e28b-4a69-a922-b3b4146c0893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:32.059214 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1042/2074] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:12:31 2022] POST /identity/v3/users => generated 292 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:12:32.059214 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f694bb-c7e1-4e34-ba26-61b5873cfaca admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:32.076431 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-66f694bb-c7e1-4e34-ba26-61b5873cfaca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:32.092957 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f694bb-c7e1-4e34-ba26-61b5873cfaca admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:32.106890 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62c47b2-ee68-4eab-8ce7-99ee33a7a104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:32.108047 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62c47b2-ee68-4eab-8ce7-99ee33a7a104 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:32.108748 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62c47b2-ee68-4eab-8ce7-99ee33a7a104 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:32.108748 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62c47b2-ee68-4eab-8ce7-99ee33a7a104 admin admin] PATH_INFO: `/v3/projects/6c736aeec5a841eeabb4213d8e0e1a80` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:32.111531 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62c47b2-ee68-4eab-8ce7-99ee33a7a104 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c736aeec5a841eeabb4213d8e0e1a80)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:32.115805 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62c47b2-ee68-4eab-8ce7-99ee33a7a104 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:32.152130 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1033/2075] 10.222.0.52 () {58 vars in 1018 bytes} [Sat May 14 21:12:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:32.152848 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cabf6d-e28b-4a69-a922-b3b4146c0893 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:32.178427 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cabf6d-e28b-4a69-a922-b3b4146c0893 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:32.186782 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51395865-0369-4172-9e7e-ba67f340f904 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4227805684e44988f9ebbe14e529a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3ef417f52a54c0eaabb9b87ae84b8ac', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:32.188035 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51395865-0369-4172-9e7e-ba67f340f904 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:32.188322 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51395865-0369-4172-9e7e-ba67f340f904 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:32.188604 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51395865-0369-4172-9e7e-ba67f340f904 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:32.189910 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51395865-0369-4172-9e7e-ba67f340f904 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:12:32.190288 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51395865-0369-4172-9e7e-ba67f340f904 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:32.197131 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51395865-0369-4172-9e7e-ba67f340f904 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:32.211513 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1034/2076] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:12:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:12:32.211513 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51395865-0369-4172-9e7e-ba67f340f904 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:32.245549 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51395865-0369-4172-9e7e-ba67f340f904 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:32.262917 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059b82ad-8edb-4156-bb47-6d4a1df13503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:32.263845 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b82ad-8edb-4156-bb47-6d4a1df13503 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:32.264285 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b82ad-8edb-4156-bb47-6d4a1df13503 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:32.264574 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b82ad-8edb-4156-bb47-6d4a1df13503 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:32.270537 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059b82ad-8edb-4156-bb47-6d4a1df13503 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:32.275187 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059b82ad-8edb-4156-bb47-6d4a1df13503 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:32.297938 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1035/2077] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:12:32 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:12:32.302585 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059b82ad-8edb-4156-bb47-6d4a1df13503 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:32.303905 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b62c47b2-ee68-4eab-8ce7-99ee33a7a104 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c736aeec5a841eeabb4213d8e0e1a80', 'request_id': 'req-b62c47b2-ee68-4eab-8ce7-99ee33a7a104'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:32.320789 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b62c47b2-ee68-4eab-8ce7-99ee33a7a104 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c736aeec5a841eeabb4213d8e0e1a80', 'request_id': 'req-b62c47b2-ee68-4eab-8ce7-99ee33a7a104'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:32.330024 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059b82ad-8edb-4156-bb47-6d4a1df13503 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:32.416471 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b62c47b2-ee68-4eab-8ce7-99ee33a7a104 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c736aeec5a841eeabb4213d8e0e1a80', 'request_id': 'req-b62c47b2-ee68-4eab-8ce7-99ee33a7a104'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:32.438129 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b62c47b2-ee68-4eab-8ce7-99ee33a7a104 admin admin] The token cache is being invalidate because project 6c736aeec5a841eeabb4213d8e0e1a80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:12:32.438129 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b62c47b2-ee68-4eab-8ce7-99ee33a7a104 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:32.438129 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b62c47b2-ee68-4eab-8ce7-99ee33a7a104 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:32.442106 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1043/2078] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:12:32 2022] DELETE /identity/v3/projects/6c736aeec5a841eeabb4213d8e0e1a80 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:32.443815 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62c47b2-ee68-4eab-8ce7-99ee33a7a104 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:32.445813 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b62c47b2-ee68-4eab-8ce7-99ee33a7a104 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:32.492134 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d6d65-c274-48f9-b349-c9551303a9ad tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4227805684e44988f9ebbe14e529a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3ef417f52a54c0eaabb9b87ae84b8ac', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:32.492852 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d6d65-c274-48f9-b349-c9551303a9ad tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:32.493138 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d6d65-c274-48f9-b349-c9551303a9ad tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:32.493552 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d6d65-c274-48f9-b349-c9551303a9ad tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:32.494408 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912d6d65-c274-48f9-b349-c9551303a9ad tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:32.497009 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912d6d65-c274-48f9-b349-c9551303a9ad tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:32.573681 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62c47b2-ee68-4eab-8ce7-99ee33a7a104 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:32.581467 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fbf6fa-16d4-4f32-99cb-24b9fd079f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:32.582381 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fbf6fa-16d4-4f32-99cb-24b9fd079f9c admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:32.582830 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fbf6fa-16d4-4f32-99cb-24b9fd079f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:32.583255 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fbf6fa-16d4-4f32-99cb-24b9fd079f9c admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:32.584187 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fbf6fa-16d4-4f32-99cb-24b9fd079f9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:32.586000 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fbf6fa-16d4-4f32-99cb-24b9fd079f9c admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:32.604112 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1044/2079] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:12:32 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:12:32.605396 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fbf6fa-16d4-4f32-99cb-24b9fd079f9c admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:32.608307 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-f8fbf6fa-16d4-4f32-99cb-24b9fd079f9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:32.635522 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1036/2080] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:12:32 2022] POST /identity/v3/projects => generated 371 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:12:32.636525 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d6d65-c274-48f9-b349-c9551303a9ad tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:32.640274 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-912d6d65-c274-48f9-b349-c9551303a9ad tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:32.725048 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fbf6fa-16d4-4f32-99cb-24b9fd079f9c admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:32.733125 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d6d65-c274-48f9-b349-c9551303a9ad tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:32.738677 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34563971-4bd7-45a8-a478-32f7b4f100b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:32.740326 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34563971-4bd7-45a8-a478-32f7b4f100b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:32.740616 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34563971-4bd7-45a8-a478-32f7b4f100b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:32.740890 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34563971-4bd7-45a8-a478-32f7b4f100b3 admin admin] PATH_INFO: `/v3/users/486797a29695490b931e7e7549d659f8` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:32.742225 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34563971-4bd7-45a8-a478-32f7b4f100b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=486797a29695490b931e7e7549d659f8)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:32.744190 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34563971-4bd7-45a8-a478-32f7b4f100b3 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:32.801935 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7fde2c-459f-41da-a51b-698602c0b980 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:32.802655 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7fde2c-459f-41da-a51b-698602c0b980 service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:32.802940 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7fde2c-459f-41da-a51b-698602c0b980 service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:32.803217 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7fde2c-459f-41da-a51b-698602c0b980 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:32.805058 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-8e7fde2c-459f-41da-a51b-698602c0b980 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:32.817204 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7fde2c-459f-41da-a51b-698602c0b980 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:32.818796 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7fde2c-459f-41da-a51b-698602c0b980 service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:32.830088 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1045/2081] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:12:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:12:32.830902 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7fde2c-459f-41da-a51b-698602c0b980 service nova] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:32.832319 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-8e7fde2c-459f-41da-a51b-698602c0b980 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:32.847661 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7fde2c-459f-41da-a51b-698602c0b980 service nova] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:32.853638 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc6d29a-5d90-4a15-82c9-10c5e0b1f564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:32.854504 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6d29a-5d90-4a15-82c9-10c5e0b1f564 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:32.854786 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6d29a-5d90-4a15-82c9-10c5e0b1f564 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:32.855057 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6d29a-5d90-4a15-82c9-10c5e0b1f564 admin admin] PATH_INFO: `/v3/projects/e705836efd0a45fbb5bedb2fc26ca87b` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:32.856294 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc6d29a-5d90-4a15-82c9-10c5e0b1f564 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e705836efd0a45fbb5bedb2fc26ca87b)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:32.858289 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc6d29a-5d90-4a15-82c9-10c5e0b1f564 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:32.958107 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-34563971-4bd7-45a8-a478-32f7b4f100b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '486797a29695490b931e7e7549d659f8'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:32.965454 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-34563971-4bd7-45a8-a478-32f7b4f100b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '486797a29695490b931e7e7549d659f8'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:32.966234 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-34563971-4bd7-45a8-a478-32f7b4f100b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '486797a29695490b931e7e7549d659f8'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:32.992014 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8bc6d29a-5d90-4a15-82c9-10c5e0b1f564 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e705836efd0a45fbb5bedb2fc26ca87b', 'request_id': 'req-8bc6d29a-5d90-4a15-82c9-10c5e0b1f564'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:32.997290 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8bc6d29a-5d90-4a15-82c9-10c5e0b1f564 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e705836efd0a45fbb5bedb2fc26ca87b', 'request_id': 'req-8bc6d29a-5d90-4a15-82c9-10c5e0b1f564'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:33.084098 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-34563971-4bd7-45a8-a478-32f7b4f100b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '486797a29695490b931e7e7549d659f8'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:33.097974 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-34563971-4bd7-45a8-a478-32f7b4f100b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '486797a29695490b931e7e7549d659f8'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:33.108092 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1037/2082] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:12:32 2022] DELETE /identity/v3/users/486797a29695490b931e7e7549d659f8 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:33.110680 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34563971-4bd7-45a8-a478-32f7b4f100b3 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:33.110680 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-34563971-4bd7-45a8-a478-32f7b4f100b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:33.187930 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8bc6d29a-5d90-4a15-82c9-10c5e0b1f564 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e705836efd0a45fbb5bedb2fc26ca87b', 'request_id': 'req-8bc6d29a-5d90-4a15-82c9-10c5e0b1f564'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:33.197917 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34563971-4bd7-45a8-a478-32f7b4f100b3 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:33.203893 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a32e3ec-f7f9-4933-b43d-ee4d57aec0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:33.204793 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32e3ec-f7f9-4933-b43d-ee4d57aec0f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:33.205073 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32e3ec-f7f9-4933-b43d-ee4d57aec0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:33.205344 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32e3ec-f7f9-4933-b43d-ee4d57aec0f7 admin admin] PATH_INFO: `/v3/projects/6cd030f4bd8b407d9a6a1b96d6b81af1/users/f78c6cdf05e640da998a464deb55ad9b/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:33.206718 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8bc6d29a-5d90-4a15-82c9-10c5e0b1f564 admin admin] The token cache is being invalidate because project e705836efd0a45fbb5bedb2fc26ca87b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:12:33.208556 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8bc6d29a-5d90-4a15-82c9-10c5e0b1f564 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:33.210453 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8bc6d29a-5d90-4a15-82c9-10c5e0b1f564 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:33.219212 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1046/2083] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:12:32 2022] DELETE /identity/v3/projects/e705836efd0a45fbb5bedb2fc26ca87b => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:33.219212 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc6d29a-5d90-4a15-82c9-10c5e0b1f564 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:33.232770 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-8bc6d29a-5d90-4a15-82c9-10c5e0b1f564 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:33.235393 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a32e3ec-f7f9-4933-b43d-ee4d57aec0f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cd030f4bd8b407d9a6a1b96d6b81af1, user_id=f78c6cdf05e640da998a464deb55ad9b, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:33.239158 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a32e3ec-f7f9-4933-b43d-ee4d57aec0f7 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:33.329998 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc6d29a-5d90-4a15-82c9-10c5e0b1f564 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:33.346714 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1038/2084] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:12:33 2022] PUT /identity/v3/projects/6cd030f4bd8b407d9a6a1b96d6b81af1/users/f78c6cdf05e640da998a464deb55ad9b/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:33.348899 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de23c657-af93-462a-ab79-51f8b1f3f43a None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:33.349321 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de23c657-af93-462a-ab79-51f8b1f3f43a None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:33.351010 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de23c657-af93-462a-ab79-51f8b1f3f43a None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:33.355182 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1039/2085] 10.222.0.52 () {54 vars in 912 bytes} [Sat May 14 21:12:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:12:33.356689 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de23c657-af93-462a-ab79-51f8b1f3f43a None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:33.360352 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-de23c657-af93-462a-ab79-51f8b1f3f43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:33.418768 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e2229b-c5ee-4edd-aa87-3b0a308390c0 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4227805684e44988f9ebbe14e529a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3ef417f52a54c0eaabb9b87ae84b8ac', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:33.419519 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e2229b-c5ee-4edd-aa87-3b0a308390c0 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:33.419905 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e2229b-c5ee-4edd-aa87-3b0a308390c0 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:33.420186 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e2229b-c5ee-4edd-aa87-3b0a308390c0 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:33.420918 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e2229b-c5ee-4edd-aa87-3b0a308390c0 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:12:33.422580 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e2229b-c5ee-4edd-aa87-3b0a308390c0 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:33.424906 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e2229b-c5ee-4edd-aa87-3b0a308390c0 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:33.441801 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1047/2086] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:12:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:12:33.443337 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9500fc57-0f7b-4817-bd48-a50cd57f1b06 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:33.443654 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9500fc57-0f7b-4817-bd48-a50cd57f1b06 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:33.443922 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9500fc57-0f7b-4817-bd48-a50cd57f1b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:33.462132 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de23c657-af93-462a-ab79-51f8b1f3f43a None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:33.469799 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ac7d1-909f-4553-980f-71f12f18e383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:33.471852 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ac7d1-909f-4553-980f-71f12f18e383 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:33.472555 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ac7d1-909f-4553-980f-71f12f18e383 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:33.473016 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ac7d1-909f-4553-980f-71f12f18e383 admin admin] PATH_INFO: `/v3/users/7aa08ba30f0b4a00a388ca9b81ad26d2` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:33.475377 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9ac7d1-909f-4553-980f-71f12f18e383 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7aa08ba30f0b4a00a388ca9b81ad26d2)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:33.478471 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9ac7d1-909f-4553-980f-71f12f18e383 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:33.499073 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-9500fc57-0f7b-4817-bd48-a50cd57f1b06 None None] MFA Rules not processed for user `f78c6cdf05e640da998a464deb55ad9b`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:33.501561 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-9500fc57-0f7b-4817-bd48-a50cd57f1b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:33.572070 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1048/2087] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:33.573191 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc749bda-100d-4d11-acab-36e973a479a9 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:33.573492 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc749bda-100d-4d11-acab-36e973a479a9 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:33.573754 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc749bda-100d-4d11-acab-36e973a479a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:33.597594 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-fc749bda-100d-4d11-acab-36e973a479a9 None None] MFA Rules not processed for user `99ed32a6d699453bb7e088540e8fc980`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:33.598873 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-fc749bda-100d-4d11-acab-36e973a479a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:33.652818 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1049/2088] 10.222.0.52 () {58 vars in 1009 bytes} [Sat May 14 21:12:33 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:33.654168 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106f67e-c59b-4fba-9f9f-05cb338c07c8 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:33.654459 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106f67e-c59b-4fba-9f9f-05cb338c07c8 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:33.654736 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106f67e-c59b-4fba-9f9f-05cb338c07c8 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:33.656686 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1050/2089] 10.222.0.52 () {54 vars in 912 bytes} [Sat May 14 21:12:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:12:33.657509 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3106f67e-c59b-4fba-9f9f-05cb338c07c8 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:33.659226 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-3106f67e-c59b-4fba-9f9f-05cb338c07c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:33.674592 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3106f67e-c59b-4fba-9f9f-05cb338c07c8 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:33.678969 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9866daf-ab60-471c-9acc-c521cca03322 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:33.679864 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9866daf-ab60-471c-9acc-c521cca03322 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:33.680319 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9866daf-ab60-471c-9acc-c521cca03322 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:33.680594 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9866daf-ab60-471c-9acc-c521cca03322 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:33.689801 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9866daf-ab60-471c-9acc-c521cca03322 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:33.691284 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9866daf-ab60-471c-9acc-c521cca03322 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:33.701245 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1051/2090] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:12:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:12:33.702072 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9866daf-ab60-471c-9acc-c521cca03322 service neutron] Authenticating service token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 14 21:12:33.703538 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b9866daf-ab60-471c-9acc-c521cca03322 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:33.709716 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-da9ac7d1-909f-4553-980f-71f12f18e383 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7aa08ba30f0b4a00a388ca9b81ad26d2'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:33.717334 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-da9ac7d1-909f-4553-980f-71f12f18e383 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7aa08ba30f0b4a00a388ca9b81ad26d2'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:33.718150 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-da9ac7d1-909f-4553-980f-71f12f18e383 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7aa08ba30f0b4a00a388ca9b81ad26d2'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:33.787587 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9866daf-ab60-471c-9acc-c521cca03322 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:33.820778 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-da9ac7d1-909f-4553-980f-71f12f18e383 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7aa08ba30f0b4a00a388ca9b81ad26d2'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:33.834792 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-da9ac7d1-909f-4553-980f-71f12f18e383 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7aa08ba30f0b4a00a388ca9b81ad26d2'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:33.844194 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1040/2091] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:12:33 2022] DELETE /identity/v3/users/7aa08ba30f0b4a00a388ca9b81ad26d2 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:33.845080 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ac7d1-909f-4553-980f-71f12f18e383 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:33.846568 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-da9ac7d1-909f-4553-980f-71f12f18e383 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:33.859184 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9866daf-ab60-471c-9acc-c521cca03322 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:33.932504 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ac7d1-909f-4553-980f-71f12f18e383 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:33.934430 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bdc24e-5f8a-4bb2-abc0-cae2f368552a tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4227805684e44988f9ebbe14e529a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3ef417f52a54c0eaabb9b87ae84b8ac', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:33.935374 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bdc24e-5f8a-4bb2-abc0-cae2f368552a tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:33.935759 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bdc24e-5f8a-4bb2-abc0-cae2f368552a tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:33.936038 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bdc24e-5f8a-4bb2-abc0-cae2f368552a tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] PATH_INFO: `/v3/projects/902774b3ff584577a522cb8a7dbf1fb4` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:33.937772 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bdc24e-5f8a-4bb2-abc0-cae2f368552a tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] RBAC: Authorizing `identity:get_project(project_id=902774b3ff584577a522cb8a7dbf1fb4)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:33.939374 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b037462b-6741-4cd6-8040-13dae80dc17b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:33.939888 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bdc24e-5f8a-4bb2-abc0-cae2f368552a tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:33.940064 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b037462b-6741-4cd6-8040-13dae80dc17b service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:33.940344 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b037462b-6741-4cd6-8040-13dae80dc17b service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:33.940625 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b037462b-6741-4cd6-8040-13dae80dc17b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:33.943094 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b037462b-6741-4cd6-8040-13dae80dc17b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:33.950395 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1052/2092] 10.222.0.52 () {58 vars in 1443 bytes} [Sat May 14 21:12:33 2022] GET /identity/v3/projects/902774b3ff584577a522cb8a7dbf1fb4 => generated 371 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:12:33.954722 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bdc24e-5f8a-4bb2-abc0-cae2f368552a tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:33.957675 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b037462b-6741-4cd6-8040-13dae80dc17b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:33.959187 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b037462b-6741-4cd6-8040-13dae80dc17b service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:33.960213 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-18bdc24e-5f8a-4bb2-abc0-cae2f368552a tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:33.969045 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1041/2093] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:12:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:12:33.984638 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b037462b-6741-4cd6-8040-13dae80dc17b service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:33.989061 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b037462b-6741-4cd6-8040-13dae80dc17b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:34.060668 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bdc24e-5f8a-4bb2-abc0-cae2f368552a tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:34.066190 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078ee39f-8abf-40fb-a228-b52ead86e7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:34.067221 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ee39f-8abf-40fb-a228-b52ead86e7f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:34.067531 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ee39f-8abf-40fb-a228-b52ead86e7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:34.067815 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ee39f-8abf-40fb-a228-b52ead86e7f8 admin admin] PATH_INFO: `/v3/projects/c64daeb40257492c80bc37c6323473f8` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:34.069040 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078ee39f-8abf-40fb-a228-b52ead86e7f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c64daeb40257492c80bc37c6323473f8)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:34.075854 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078ee39f-8abf-40fb-a228-b52ead86e7f8 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:34.075996 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b037462b-6741-4cd6-8040-13dae80dc17b service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:34.077200 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf1e140-eeef-4597-906a-93d69c6e8184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:34.078910 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf1e140-eeef-4597-906a-93d69c6e8184 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:34.079171 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf1e140-eeef-4597-906a-93d69c6e8184 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:34.079450 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf1e140-eeef-4597-906a-93d69c6e8184 admin admin] PATH_INFO: `/v3/users/f78c6cdf05e640da998a464deb55ad9b` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:34.080722 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf1e140-eeef-4597-906a-93d69c6e8184 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f78c6cdf05e640da998a464deb55ad9b)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:34.082665 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf1e140-eeef-4597-906a-93d69c6e8184 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:34.263433 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-078ee39f-8abf-40fb-a228-b52ead86e7f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c64daeb40257492c80bc37c6323473f8', 'request_id': 'req-078ee39f-8abf-40fb-a228-b52ead86e7f8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:34.270110 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-078ee39f-8abf-40fb-a228-b52ead86e7f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c64daeb40257492c80bc37c6323473f8', 'request_id': 'req-078ee39f-8abf-40fb-a228-b52ead86e7f8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:34.334506 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-078ee39f-8abf-40fb-a228-b52ead86e7f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c64daeb40257492c80bc37c6323473f8', 'request_id': 'req-078ee39f-8abf-40fb-a228-b52ead86e7f8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:34.346206 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-078ee39f-8abf-40fb-a228-b52ead86e7f8 admin admin] The token cache is being invalidate because project c64daeb40257492c80bc37c6323473f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:12:34.346490 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-078ee39f-8abf-40fb-a228-b52ead86e7f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:34.347157 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-078ee39f-8abf-40fb-a228-b52ead86e7f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:34.349043 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1053/2094] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:12:33 2022] DELETE /identity/v3/projects/c64daeb40257492c80bc37c6323473f8 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:34.350269 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b544419-5b3f-40b9-a91b-5e620ff00704 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:34.350553 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b544419-5b3f-40b9-a91b-5e620ff00704 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:34.350828 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b544419-5b3f-40b9-a91b-5e620ff00704 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:34.352340 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1054/2095] 10.222.0.52 () {54 vars in 912 bytes} [Sat May 14 21:12:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:12:34.353337 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53858b6-9981-41c2-8f4e-249e3ca97fae None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:34.353704 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53858b6-9981-41c2-8f4e-249e3ca97fae None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:34.353982 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53858b6-9981-41c2-8f4e-249e3ca97fae None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:34.355189 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1055/2096] 10.222.0.52 () {54 vars in 912 bytes} [Sat May 14 21:12:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:12:34.361799 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0dd17-c0be-4547-a885-7c77a08961e2 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:34.362130 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0dd17-c0be-4547-a885-7c77a08961e2 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:34.371304 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0dd17-c0be-4547-a885-7c77a08961e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:34.371934 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-5cf1e140-eeef-4597-906a-93d69c6e8184 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f78c6cdf05e640da998a464deb55ad9b'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:34.379435 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-5cf1e140-eeef-4597-906a-93d69c6e8184 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f78c6cdf05e640da998a464deb55ad9b'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:34.380235 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-5cf1e140-eeef-4597-906a-93d69c6e8184 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f78c6cdf05e640da998a464deb55ad9b'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:34.380772 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-18c0dd17-c0be-4547-a885-7c77a08961e2 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:34.382224 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-18c0dd17-c0be-4547-a885-7c77a08961e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:34.443397 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-5cf1e140-eeef-4597-906a-93d69c6e8184 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f78c6cdf05e640da998a464deb55ad9b'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:34.451902 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1056/2097] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:34.451902 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd7fea8-9a16-42c8-bf76-68e62ecda080 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:34.451902 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd7fea8-9a16-42c8-bf76-68e62ecda080 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:34.451902 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd7fea8-9a16-42c8-bf76-68e62ecda080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:34.459599 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-5cf1e140-eeef-4597-906a-93d69c6e8184 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f78c6cdf05e640da998a464deb55ad9b'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:34.465697 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1042/2098] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:12:33 2022] DELETE /identity/v3/users/f78c6cdf05e640da998a464deb55ad9b => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:12:34.470192 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf1e140-eeef-4597-906a-93d69c6e8184 admin admin] Authenticating service token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 14 21:12:34.471585 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-5cf1e140-eeef-4597-906a-93d69c6e8184 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:34.473394 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-2dd7fea8-9a16-42c8-bf76-68e62ecda080 None None] MFA Rules not processed for user `0812ae67e44d483baf2dbb1a5332a1d7`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:34.474569 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-2dd7fea8-9a16-42c8-bf76-68e62ecda080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:34.540442 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1057/2099] 10.222.0.52 () {58 vars in 1009 bytes} [Sat May 14 21:12:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:34.541585 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd7fea8-9a16-42c8-bf76-68e62ecda080 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:34.543128 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-2dd7fea8-9a16-42c8-bf76-68e62ecda080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:34.551357 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf1e140-eeef-4597-906a-93d69c6e8184 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:34.553128 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-5cf1e140-eeef-4597-906a-93d69c6e8184 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:34.615295 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd7fea8-9a16-42c8-bf76-68e62ecda080 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:34.619857 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6326ba-092e-4006-8542-e9ae1db9a04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:34.620702 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6326ba-092e-4006-8542-e9ae1db9a04b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:34.620982 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6326ba-092e-4006-8542-e9ae1db9a04b admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:34.621100 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf1e140-eeef-4597-906a-93d69c6e8184 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:34.621257 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6326ba-092e-4006-8542-e9ae1db9a04b admin admin] PATH_INFO: `/v3/projects/76448e8c96cb4a719665c2ef24c71797` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:34.622408 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6326ba-092e-4006-8542-e9ae1db9a04b admin admin] RBAC: Authorizing `identity:delete_project(project_id=76448e8c96cb4a719665c2ef24c71797)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:34.624341 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6326ba-092e-4006-8542-e9ae1db9a04b admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:34.626137 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd45217d-9bc0-43c9-b38a-4b761637a57f tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4227805684e44988f9ebbe14e529a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3ef417f52a54c0eaabb9b87ae84b8ac', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:34.627000 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd45217d-9bc0-43c9-b38a-4b761637a57f tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:34.627283 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd45217d-9bc0-43c9-b38a-4b761637a57f tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:34.627593 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd45217d-9bc0-43c9-b38a-4b761637a57f tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] PATH_INFO: `/v3/projects/902774b3ff584577a522cb8a7dbf1fb4` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:34.628865 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd45217d-9bc0-43c9-b38a-4b761637a57f tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] RBAC: Authorizing `identity:get_project(project_id=902774b3ff584577a522cb8a7dbf1fb4)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:34.631224 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd45217d-9bc0-43c9-b38a-4b761637a57f tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:34.632987 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1043/2100] 10.222.0.52 () {58 vars in 1443 bytes} [Sat May 14 21:12:34 2022] GET /identity/v3/projects/902774b3ff584577a522cb8a7dbf1fb4 => generated 371 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:12:34.634160 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d524648-1481-4e1f-96bb-528901a0acc0 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:34.634509 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d524648-1481-4e1f-96bb-528901a0acc0 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:34.634923 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d524648-1481-4e1f-96bb-528901a0acc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:34.654201 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-9d524648-1481-4e1f-96bb-528901a0acc0 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:34.655392 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-9d524648-1481-4e1f-96bb-528901a0acc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:34.677195 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1044/2101] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:34.678645 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e03fe-8e97-4599-a18b-91ec1e5ae2f7 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:34.679080 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e03fe-8e97-4599-a18b-91ec1e5ae2f7 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:34.679360 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e03fe-8e97-4599-a18b-91ec1e5ae2f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:34.699459 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-871e03fe-8e97-4599-a18b-91ec1e5ae2f7 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:34.700773 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-871e03fe-8e97-4599-a18b-91ec1e5ae2f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:34.709499 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1045/2102] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:34.710100 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871e03fe-8e97-4599-a18b-91ec1e5ae2f7 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:34.711381 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-871e03fe-8e97-4599-a18b-91ec1e5ae2f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:34.726436 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871e03fe-8e97-4599-a18b-91ec1e5ae2f7 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:34.731396 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb1a1b4-448c-4d02-8dc7-0972ba5c0615 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:34.732078 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1a1b4-448c-4d02-8dc7-0972ba5c0615 service placement] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:34.732358 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1a1b4-448c-4d02-8dc7-0972ba5c0615 service placement] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:34.732653 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1a1b4-448c-4d02-8dc7-0972ba5c0615 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:34.742461 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb1a1b4-448c-4d02-8dc7-0972ba5c0615 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:34.744103 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb1a1b4-448c-4d02-8dc7-0972ba5c0615 service placement] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:34.754873 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1046/2103] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:12:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:12:34.756456 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb1a1b4-448c-4d02-8dc7-0972ba5c0615 service placement] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:34.765033 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ce6326ba-092e-4006-8542-e9ae1db9a04b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76448e8c96cb4a719665c2ef24c71797', 'request_id': 'req-ce6326ba-092e-4006-8542-e9ae1db9a04b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:34.768259 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb1a1b4-448c-4d02-8dc7-0972ba5c0615 service placement] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:34.772026 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ce6326ba-092e-4006-8542-e9ae1db9a04b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76448e8c96cb4a719665c2ef24c71797', 'request_id': 'req-ce6326ba-092e-4006-8542-e9ae1db9a04b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:34.828840 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e9b8c1-0c72-4fea-98e1-c5be13395437 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4227805684e44988f9ebbe14e529a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3ef417f52a54c0eaabb9b87ae84b8ac', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:34.829876 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e9b8c1-0c72-4fea-98e1-c5be13395437 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:34.830159 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e9b8c1-0c72-4fea-98e1-c5be13395437 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:34.830436 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e9b8c1-0c72-4fea-98e1-c5be13395437 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:34.831163 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e9b8c1-0c72-4fea-98e1-c5be13395437 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:12:34.831471 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e9b8c1-0c72-4fea-98e1-c5be13395437 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:34.833113 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e9b8c1-0c72-4fea-98e1-c5be13395437 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:34.837820 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ce6326ba-092e-4006-8542-e9ae1db9a04b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76448e8c96cb4a719665c2ef24c71797', 'request_id': 'req-ce6326ba-092e-4006-8542-e9ae1db9a04b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:34.848453 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1047/2104] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:12:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:12:34.848453 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e9b8c1-0c72-4fea-98e1-c5be13395437 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:34.872858 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ce6326ba-092e-4006-8542-e9ae1db9a04b admin admin] The token cache is being invalidate because project 76448e8c96cb4a719665c2ef24c71797 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:12:34.873256 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ce6326ba-092e-4006-8542-e9ae1db9a04b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:34.874081 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ce6326ba-092e-4006-8542-e9ae1db9a04b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:34.876170 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1058/2105] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:12:34 2022] DELETE /identity/v3/projects/76448e8c96cb4a719665c2ef24c71797 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:34.877075 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6326ba-092e-4006-8542-e9ae1db9a04b admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:34.880789 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ce6326ba-092e-4006-8542-e9ae1db9a04b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:34.918908 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e9b8c1-0c72-4fea-98e1-c5be13395437 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:34.926776 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80157558-dc87-4c0a-8456-17d49b44f489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:34.927615 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80157558-dc87-4c0a-8456-17d49b44f489 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:34.927994 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80157558-dc87-4c0a-8456-17d49b44f489 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:34.928366 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80157558-dc87-4c0a-8456-17d49b44f489 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:34.929296 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80157558-dc87-4c0a-8456-17d49b44f489 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:12:34.929719 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80157558-dc87-4c0a-8456-17d49b44f489 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:34.931890 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80157558-dc87-4c0a-8456-17d49b44f489 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:34.944557 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6326ba-092e-4006-8542-e9ae1db9a04b admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:34.946638 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1048/2106] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:12:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:12:34.948394 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80157558-dc87-4c0a-8456-17d49b44f489 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:34.948918 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdfd452-6faf-47fc-8423-c93b803409a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:34.949591 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdfd452-6faf-47fc-8423-c93b803409a6 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:34.949878 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdfd452-6faf-47fc-8423-c93b803409a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:34.950125 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-80157558-dc87-4c0a-8456-17d49b44f489 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:34.950295 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdfd452-6faf-47fc-8423-c93b803409a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:34.951993 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-6fdfd452-6faf-47fc-8423-c93b803409a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:34.964007 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80157558-dc87-4c0a-8456-17d49b44f489 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:34.964209 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdfd452-6faf-47fc-8423-c93b803409a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:34.965649 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdfd452-6faf-47fc-8423-c93b803409a6 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:34.969345 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a3a80-5b1f-4c5d-ad42-3e306d1deac6 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4227805684e44988f9ebbe14e529a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3ef417f52a54c0eaabb9b87ae84b8ac', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:34.970010 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a3a80-5b1f-4c5d-ad42-3e306d1deac6 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:34.970290 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a3a80-5b1f-4c5d-ad42-3e306d1deac6 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:34.979464 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a3a80-5b1f-4c5d-ad42-3e306d1deac6 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:34.979464 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6a3a80-5b1f-4c5d-ad42-3e306d1deac6 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:34.979464 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6a3a80-5b1f-4c5d-ad42-3e306d1deac6 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:34.979759 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1059/2107] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:12:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:12:34.979759 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdfd452-6faf-47fc-8423-c93b803409a6 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:34.980562 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-6fdfd452-6faf-47fc-8423-c93b803409a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:35.057344 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdfd452-6faf-47fc-8423-c93b803409a6 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:35.063533 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f43a6fe-8a55-4c33-8278-1a9ca10a0568 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:35.064194 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43a6fe-8a55-4c33-8278-1a9ca10a0568 service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:35.065253 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43a6fe-8a55-4c33-8278-1a9ca10a0568 service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:35.065253 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43a6fe-8a55-4c33-8278-1a9ca10a0568 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:35.066863 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-5f43a6fe-8a55-4c33-8278-1a9ca10a0568 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:35.109603 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1049/2108] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:12:34 2022] POST /identity/v3/users => generated 381 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:12:35.115268 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed1cd4-5271-4e1b-97bc-029e041a5ee6 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:35.115268 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed1cd4-5271-4e1b-97bc-029e041a5ee6 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:35.115268 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed1cd4-5271-4e1b-97bc-029e041a5ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:35.132750 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-eaed1cd4-5271-4e1b-97bc-029e041a5ee6 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:35.133894 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-eaed1cd4-5271-4e1b-97bc-029e041a5ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:35.141459 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f43a6fe-8a55-4c33-8278-1a9ca10a0568 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:35.143070 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f43a6fe-8a55-4c33-8278-1a9ca10a0568 service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:35.147650 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1050/2109] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:35.147650 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed1cd4-5271-4e1b-97bc-029e041a5ee6 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:35.148645 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-eaed1cd4-5271-4e1b-97bc-029e041a5ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:35.159909 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1060/2110] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:12:34 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:12:35.161065 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f43a6fe-8a55-4c33-8278-1a9ca10a0568 service nova] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:35.162134 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed1cd4-5271-4e1b-97bc-029e041a5ee6 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:35.166965 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9c069d-83cf-418e-9846-9cb91680a014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:35.168046 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9c069d-83cf-418e-9846-9cb91680a014 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:35.168416 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9c069d-83cf-418e-9846-9cb91680a014 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:35.168740 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9c069d-83cf-418e-9846-9cb91680a014 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:35.169607 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9c069d-83cf-418e-9846-9cb91680a014 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:35.171821 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9c069d-83cf-418e-9846-9cb91680a014 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:35.175579 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f43a6fe-8a55-4c33-8278-1a9ca10a0568 service nova] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:35.181476 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb02502-eb35-4909-a8cc-68d80dc79aa4 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4227805684e44988f9ebbe14e529a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3ef417f52a54c0eaabb9b87ae84b8ac', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:35.182680 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb02502-eb35-4909-a8cc-68d80dc79aa4 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:35.186245 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb02502-eb35-4909-a8cc-68d80dc79aa4 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:35.186245 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb02502-eb35-4909-a8cc-68d80dc79aa4 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:35.186245 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb02502-eb35-4909-a8cc-68d80dc79aa4 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:12:35.186245 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb02502-eb35-4909-a8cc-68d80dc79aa4 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:35.187691 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb02502-eb35-4909-a8cc-68d80dc79aa4 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:35.203960 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1061/2111] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:12:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:12:35.205495 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd29f43a-da93-4acc-a229-f748773cedbb None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:35.205907 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd29f43a-da93-4acc-a229-f748773cedbb None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:35.206509 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd29f43a-da93-4acc-a229-f748773cedbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:35.232706 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-dd29f43a-da93-4acc-a229-f748773cedbb None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:35.234175 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-dd29f43a-da93-4acc-a229-f748773cedbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:35.245182 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1062/2112] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:35.250288 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd29f43a-da93-4acc-a229-f748773cedbb None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:35.259984 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd29f43a-da93-4acc-a229-f748773cedbb None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:35.264804 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02c1063-1e30-4c38-8a86-4ec98a029933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:35.265655 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c1063-1e30-4c38-8a86-4ec98a029933 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:35.266054 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c1063-1e30-4c38-8a86-4ec98a029933 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:35.266479 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c1063-1e30-4c38-8a86-4ec98a029933 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:35.267309 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02c1063-1e30-4c38-8a86-4ec98a029933 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:12:35.267850 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02c1063-1e30-4c38-8a86-4ec98a029933 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:35.269463 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02c1063-1e30-4c38-8a86-4ec98a029933 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:35.274524 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1051/2113] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:12:35 2022] POST /identity/v3/projects => generated 395 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:12:35.283230 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9c069d-83cf-418e-9846-9cb91680a014 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:35.287738 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1063/2114] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:12:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:12:35.288735 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02c1063-1e30-4c38-8a86-4ec98a029933 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:35.306435 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02c1063-1e30-4c38-8a86-4ec98a029933 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:35.373776 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9c069d-83cf-418e-9846-9cb91680a014 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:35.379308 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ef14a-f5cc-45a9-9313-ec339736e75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:35.380016 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ef14a-f5cc-45a9-9313-ec339736e75a admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:35.380304 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ef14a-f5cc-45a9-9313-ec339736e75a admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:35.380585 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ef14a-f5cc-45a9-9313-ec339736e75a admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:35.381552 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57ef14a-f5cc-45a9-9313-ec339736e75a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:35.385407 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57ef14a-f5cc-45a9-9313-ec339736e75a admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:35.394644 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2089c8d3-8cfb-431c-b751-69f97ec21b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:35.395348 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2089c8d3-8cfb-431c-b751-69f97ec21b71 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:35.395665 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2089c8d3-8cfb-431c-b751-69f97ec21b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:35.395938 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2089c8d3-8cfb-431c-b751-69f97ec21b71 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:35.396815 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2089c8d3-8cfb-431c-b751-69f97ec21b71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:35.399022 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2089c8d3-8cfb-431c-b751-69f97ec21b71 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:35.504702 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1052/2115] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:12:35 2022] POST /identity/v3/users => generated 298 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:12:35.504702 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b8d3b-becf-4494-9a93-ab87060fcefc None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:35.504702 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b8d3b-becf-4494-9a93-ab87060fcefc None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:35.504702 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b8d3b-becf-4494-9a93-ab87060fcefc None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:35.504702 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1053/2116] 10.222.0.52 () {54 vars in 921 bytes} [Sat May 14 21:12:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:12:35.507051 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400b8d3b-becf-4494-9a93-ab87060fcefc None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:35.512296 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-400b8d3b-becf-4494-9a93-ab87060fcefc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:35.529178 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400b8d3b-becf-4494-9a93-ab87060fcefc None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:35.532454 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1064/2117] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:12:35 2022] POST /identity/v3/projects => generated 375 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:12:35.536951 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d71d5-932c-459e-b5db-31511af1a675 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:35.537321 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d71d5-932c-459e-b5db-31511af1a675 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:35.537608 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d71d5-932c-459e-b5db-31511af1a675 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:35.538934 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1065/2118] 10.222.0.52 () {54 vars in 912 bytes} [Sat May 14 21:12:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:12:35.539735 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42d71d5-932c-459e-b5db-31511af1a675 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:35.607955 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b909677b-f6eb-4c38-a214-59aef6975874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:35.608826 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b909677b-f6eb-4c38-a214-59aef6975874 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:35.609166 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b909677b-f6eb-4c38-a214-59aef6975874 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:35.609438 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b909677b-f6eb-4c38-a214-59aef6975874 admin admin] PATH_INFO: `/v3/projects/6cd030f4bd8b407d9a6a1b96d6b81af1` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:35.610851 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b909677b-f6eb-4c38-a214-59aef6975874 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cd030f4bd8b407d9a6a1b96d6b81af1)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:35.614202 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42d71d5-932c-459e-b5db-31511af1a675 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:35.617258 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b909677b-f6eb-4c38-a214-59aef6975874 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:35.619015 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3608198e-09b7-492b-b7a8-e7213308ccd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:35.619817 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3608198e-09b7-492b-b7a8-e7213308ccd2 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:35.620101 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3608198e-09b7-492b-b7a8-e7213308ccd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:35.620386 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3608198e-09b7-492b-b7a8-e7213308ccd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:35.621198 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3608198e-09b7-492b-b7a8-e7213308ccd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:35.622762 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3608198e-09b7-492b-b7a8-e7213308ccd2 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:35.633853 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1066/2119] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:12:35 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:12:35.635228 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df165fde-006c-4a1c-9a02-c695ec3daba1 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:35.635459 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df165fde-006c-4a1c-9a02-c695ec3daba1 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:35.635764 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df165fde-006c-4a1c-9a02-c695ec3daba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:35.655595 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-df165fde-006c-4a1c-9a02-c695ec3daba1 None None] MFA Rules not processed for user `99ed32a6d699453bb7e088540e8fc980`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:35.658778 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-df165fde-006c-4a1c-9a02-c695ec3daba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:35.707996 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1067/2120] 10.222.0.52 () {58 vars in 1018 bytes} [Sat May 14 21:12:35 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:35.708861 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df165fde-006c-4a1c-9a02-c695ec3daba1 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:35.723345 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df165fde-006c-4a1c-9a02-c695ec3daba1 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:35.733475 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ae000-5b63-41a6-8c12-b3d98e50171e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:35.734110 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ae000-5b63-41a6-8c12-b3d98e50171e admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:35.739186 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ae000-5b63-41a6-8c12-b3d98e50171e admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:35.739186 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ae000-5b63-41a6-8c12-b3d98e50171e admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:35.739186 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75ae000-5b63-41a6-8c12-b3d98e50171e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:35.739186 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75ae000-5b63-41a6-8c12-b3d98e50171e admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:35.764748 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b909677b-f6eb-4c38-a214-59aef6975874 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cd030f4bd8b407d9a6a1b96d6b81af1', 'request_id': 'req-b909677b-f6eb-4c38-a214-59aef6975874'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:35.770922 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b909677b-f6eb-4c38-a214-59aef6975874 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cd030f4bd8b407d9a6a1b96d6b81af1', 'request_id': 'req-b909677b-f6eb-4c38-a214-59aef6975874'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:35.777526 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b909677b-f6eb-4c38-a214-59aef6975874 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cd030f4bd8b407d9a6a1b96d6b81af1', 'request_id': 'req-b909677b-f6eb-4c38-a214-59aef6975874'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:35.851288 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1068/2121] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:12:35 2022] POST /identity/v3/users => generated 288 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:12:35.852193 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ae000-5b63-41a6-8c12-b3d98e50171e admin admin] Authenticating service token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 14 21:12:35.853820 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d75ae000-5b63-41a6-8c12-b3d98e50171e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:35.895188 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b909677b-f6eb-4c38-a214-59aef6975874 admin admin] The token cache is being invalidate because project 6cd030f4bd8b407d9a6a1b96d6b81af1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:12:35.895420 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b909677b-f6eb-4c38-a214-59aef6975874 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:35.896218 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b909677b-f6eb-4c38-a214-59aef6975874 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:35.897803 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1054/2122] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:12:35 2022] DELETE /identity/v3/projects/6cd030f4bd8b407d9a6a1b96d6b81af1 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:35.898597 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b909677b-f6eb-4c38-a214-59aef6975874 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:35.900286 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b909677b-f6eb-4c38-a214-59aef6975874 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:35.957661 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ae000-5b63-41a6-8c12-b3d98e50171e admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:35.973386 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b909677b-f6eb-4c38-a214-59aef6975874 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:35.978542 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5ddc1c-b356-4547-b564-f43058c71f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:35.979325 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ddc1c-b356-4547-b564-f43058c71f17 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:35.979707 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ddc1c-b356-4547-b564-f43058c71f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:35.979922 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ddc1c-b356-4547-b564-f43058c71f17 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:35.980633 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5ddc1c-b356-4547-b564-f43058c71f17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:35.982246 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5ddc1c-b356-4547-b564-f43058c71f17 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:35.992622 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1055/2123] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:12:35 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:12:35.993448 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5ddc1c-b356-4547-b564-f43058c71f17 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:35.997174 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-6e5ddc1c-b356-4547-b564-f43058c71f17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:36.022928 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ae000-5b63-41a6-8c12-b3d98e50171e admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:36.057632 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5ddc1c-b356-4547-b564-f43058c71f17 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:36.061590 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f712d9-dfbf-425e-bbec-2eb15cc2a496 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:36.062740 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f712d9-dfbf-425e-bbec-2eb15cc2a496 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:36.063125 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f712d9-dfbf-425e-bbec-2eb15cc2a496 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:36.063402 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f712d9-dfbf-425e-bbec-2eb15cc2a496 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:36.065221 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-22f712d9-dfbf-425e-bbec-2eb15cc2a496 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:36.074739 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f712d9-dfbf-425e-bbec-2eb15cc2a496 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:36.076361 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f712d9-dfbf-425e-bbec-2eb15cc2a496 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:36.079235 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f2a7dd-de05-4d2d-851c-66ffbb4275b5 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4227805684e44988f9ebbe14e529a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3ef417f52a54c0eaabb9b87ae84b8ac', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:36.080131 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2a7dd-de05-4d2d-851c-66ffbb4275b5 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:36.080418 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2a7dd-de05-4d2d-851c-66ffbb4275b5 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:36.080695 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2a7dd-de05-4d2d-851c-66ffbb4275b5 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] PATH_INFO: `/v3/projects/902774b3ff584577a522cb8a7dbf1fb4` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:36.082016 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f2a7dd-de05-4d2d-851c-66ffbb4275b5 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] RBAC: Authorizing `identity:get_project(project_id=902774b3ff584577a522cb8a7dbf1fb4)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:36.084019 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f2a7dd-de05-4d2d-851c-66ffbb4275b5 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:36.084945 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1056/2124] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:12:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:12:36.085758 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1069/2125] 10.222.0.52 () {58 vars in 1443 bytes} [Sat May 14 21:12:35 2022] GET /identity/v3/projects/902774b3ff584577a522cb8a7dbf1fb4 => generated 371 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:12:36.086234 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec7e63-aeeb-4288-9c84-8fe56e3b23e7 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:36.086517 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec7e63-aeeb-4288-9c84-8fe56e3b23e7 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:36.086627 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f2a7dd-de05-4d2d-851c-66ffbb4275b5 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:36.086863 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec7e63-aeeb-4288-9c84-8fe56e3b23e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:36.088252 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b8f2a7dd-de05-4d2d-851c-66ffbb4275b5 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:36.102378 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f2a7dd-de05-4d2d-851c-66ffbb4275b5 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:36.106681 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-f9ec7e63-aeeb-4288-9c84-8fe56e3b23e7 None None] MFA Rules not processed for user `6ca2cafc3b794c88b48510b5d466b580`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:36.107442 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caa1c5a-0346-466e-aede-a730b0976d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:36.108272 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa1c5a-0346-466e-aede-a730b0976d7d admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:36.108616 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-f9ec7e63-aeeb-4288-9c84-8fe56e3b23e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:36.108749 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa1c5a-0346-466e-aede-a730b0976d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:36.109615 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa1c5a-0346-466e-aede-a730b0976d7d admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:36.110443 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caa1c5a-0346-466e-aede-a730b0976d7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:36.112156 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caa1c5a-0346-466e-aede-a730b0976d7d admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:36.127653 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1070/2126] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:12:36 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:12:36.132575 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721158a5-da0b-4aae-bdca-c6072d9956c9 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:36.132575 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721158a5-da0b-4aae-bdca-c6072d9956c9 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:36.132842 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721158a5-da0b-4aae-bdca-c6072d9956c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:36.153456 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-721158a5-da0b-4aae-bdca-c6072d9956c9 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:36.154653 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-721158a5-da0b-4aae-bdca-c6072d9956c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:36.164175 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1071/2127] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:36.171540 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721158a5-da0b-4aae-bdca-c6072d9956c9 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:36.175471 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721158a5-da0b-4aae-bdca-c6072d9956c9 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:36.180601 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad8ca6-ac88-4444-9a49-06616798099a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:36.181708 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad8ca6-ac88-4444-9a49-06616798099a admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:36.181917 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad8ca6-ac88-4444-9a49-06616798099a admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:36.182438 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad8ca6-ac88-4444-9a49-06616798099a admin admin] PATH_INFO: `/v3/projects/bc82fc4cb79444acbdf29af78e302e6a/users/9539e4b48a0d49959780fae9a39cbce7/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:36.182545 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1057/2128] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:36.183280 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec7e63-aeeb-4288-9c84-8fe56e3b23e7 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:36.196304 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec7e63-aeeb-4288-9c84-8fe56e3b23e7 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:36.200432 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fad8ca6-ac88-4444-9a49-06616798099a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc82fc4cb79444acbdf29af78e302e6a, user_id=9539e4b48a0d49959780fae9a39cbce7, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:36.202939 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a80b1be-3148-4422-9db1-774a9ffcd6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:36.203588 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a80b1be-3148-4422-9db1-774a9ffcd6d9 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:36.203985 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a80b1be-3148-4422-9db1-774a9ffcd6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:36.204102 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fad8ca6-ac88-4444-9a49-06616798099a admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:36.204263 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a80b1be-3148-4422-9db1-774a9ffcd6d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:36.204994 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a80b1be-3148-4422-9db1-774a9ffcd6d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:36.207118 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a80b1be-3148-4422-9db1-774a9ffcd6d9 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:36.223304 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1058/2129] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:12:36 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:12:36.223304 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e750d55-5591-4860-a4ec-cca60adbb713 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:36.223304 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e750d55-5591-4860-a4ec-cca60adbb713 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:36.223304 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e750d55-5591-4860-a4ec-cca60adbb713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:36.249214 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-5e750d55-5591-4860-a4ec-cca60adbb713 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:36.251052 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-5e750d55-5591-4860-a4ec-cca60adbb713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:36.259547 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1059/2130] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:36.260295 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e750d55-5591-4860-a4ec-cca60adbb713 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:36.270482 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e750d55-5591-4860-a4ec-cca60adbb713 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:36.275154 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcca7929-4c1f-4ec2-8b44-ca3bd87273bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:36.276035 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca7929-4c1f-4ec2-8b44-ca3bd87273bf admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:36.276315 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca7929-4c1f-4ec2-8b44-ca3bd87273bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:36.276587 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca7929-4c1f-4ec2-8b44-ca3bd87273bf admin admin] PATH_INFO: `/v3/projects/f6c833726abf47f49b561df1966764d5/users/3bff40a84e6f4a82b0c9fb0b155684c4/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:36.291827 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcca7929-4c1f-4ec2-8b44-ca3bd87273bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6c833726abf47f49b561df1966764d5, user_id=3bff40a84e6f4a82b0c9fb0b155684c4, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:36.300888 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1072/2131] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:12:36 2022] PUT /identity/v3/projects/bc82fc4cb79444acbdf29af78e302e6a/users/9539e4b48a0d49959780fae9a39cbce7/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:36.301027 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcca7929-4c1f-4ec2-8b44-ca3bd87273bf admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:36.301118 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad8ca6-ac88-4444-9a49-06616798099a admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:36.365029 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad8ca6-ac88-4444-9a49-06616798099a admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:36.370171 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b7bbf5-666a-490b-8c8f-66a32ec3dfbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:36.370844 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b7bbf5-666a-490b-8c8f-66a32ec3dfbf admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:36.371551 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b7bbf5-666a-490b-8c8f-66a32ec3dfbf admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:36.371551 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b7bbf5-666a-490b-8c8f-66a32ec3dfbf admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:36.372184 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b7bbf5-666a-490b-8c8f-66a32ec3dfbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:12:36.372492 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b7bbf5-666a-490b-8c8f-66a32ec3dfbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:36.374114 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b7bbf5-666a-490b-8c8f-66a32ec3dfbf admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:36.391104 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1073/2132] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:12:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:12:36.392578 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46549b0d-f18d-4257-a41d-baf64bb1ddce None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:36.392855 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46549b0d-f18d-4257-a41d-baf64bb1ddce None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:36.393135 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46549b0d-f18d-4257-a41d-baf64bb1ddce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:36.399037 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1060/2133] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:12:36 2022] PUT /identity/v3/projects/f6c833726abf47f49b561df1966764d5/users/3bff40a84e6f4a82b0c9fb0b155684c4/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:36.410258 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ba5d5-c40b-4dc6-9f27-038a91e55f41 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:36.410541 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ba5d5-c40b-4dc6-9f27-038a91e55f41 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:36.410815 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ba5d5-c40b-4dc6-9f27-038a91e55f41 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:36.412225 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1061/2134] 10.222.0.52 () {54 vars in 921 bytes} [Sat May 14 21:12:36 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:12:36.417081 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580ba5d5-c40b-4dc6-9f27-038a91e55f41 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:36.439834 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-46549b0d-f18d-4257-a41d-baf64bb1ddce None None] MFA Rules not processed for user `9539e4b48a0d49959780fae9a39cbce7`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:36.441215 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-46549b0d-f18d-4257-a41d-baf64bb1ddce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:36.499933 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580ba5d5-c40b-4dc6-9f27-038a91e55f41 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:36.505441 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb139877-0913-4687-9264-17fb7527e18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:36.505852 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb139877-0913-4687-9264-17fb7527e18b admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:36.506423 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb139877-0913-4687-9264-17fb7527e18b admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:36.506710 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb139877-0913-4687-9264-17fb7527e18b admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:36.507354 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb139877-0913-4687-9264-17fb7527e18b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:36.509996 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb139877-0913-4687-9264-17fb7527e18b admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:36.527641 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1074/2135] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:36.529866 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d33317-cb6f-4a17-8053-7dcec92b2bf9 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:36.530154 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d33317-cb6f-4a17-8053-7dcec92b2bf9 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:36.530434 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d33317-cb6f-4a17-8053-7dcec92b2bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:36.560650 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-b3d33317-cb6f-4a17-8053-7dcec92b2bf9 None None] MFA Rules not processed for user `3bff40a84e6f4a82b0c9fb0b155684c4`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:36.561868 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b3d33317-cb6f-4a17-8053-7dcec92b2bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:36.630218 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1062/2136] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:12:36 2022] POST /identity/v3/projects => generated 389 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:12:36.634888 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049f89a-15d5-43e1-af5e-38ed1e70a0f4 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:36.635963 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049f89a-15d5-43e1-af5e-38ed1e70a0f4 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:36.635963 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049f89a-15d5-43e1-af5e-38ed1e70a0f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:36.639648 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1075/2137] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:36.639648 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d33317-cb6f-4a17-8053-7dcec92b2bf9 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:36.652633 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d33317-cb6f-4a17-8053-7dcec92b2bf9 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:36.658486 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-f049f89a-15d5-43e1-af5e-38ed1e70a0f4 None None] MFA Rules not processed for user `0812ae67e44d483baf2dbb1a5332a1d7`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:36.659966 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-f049f89a-15d5-43e1-af5e-38ed1e70a0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:36.714609 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149c6afb-56f3-46b2-b092-86b3bccc46a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:36.715269 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c6afb-56f3-46b2-b092-86b3bccc46a3 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:36.715587 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c6afb-56f3-46b2-b092-86b3bccc46a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:36.715868 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c6afb-56f3-46b2-b092-86b3bccc46a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:36.716617 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149c6afb-56f3-46b2-b092-86b3bccc46a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:36.718605 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149c6afb-56f3-46b2-b092-86b3bccc46a3 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:36.726872 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1063/2138] 10.222.0.52 () {58 vars in 1018 bytes} [Sat May 14 21:12:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:36.728302 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01e6fb-7560-4001-8975-321690af1876 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:36.728593 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01e6fb-7560-4001-8975-321690af1876 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:36.728892 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01e6fb-7560-4001-8975-321690af1876 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:36.730294 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1064/2139] 10.222.0.52 () {54 vars in 912 bytes} [Sat May 14 21:12:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:12:36.730840 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc01e6fb-7560-4001-8975-321690af1876 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:36.745149 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc01e6fb-7560-4001-8975-321690af1876 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:36.750641 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a161ee2d-ebfc-4bff-909d-1f89c6b249b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:36.751491 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161ee2d-ebfc-4bff-909d-1f89c6b249b6 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:36.751853 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161ee2d-ebfc-4bff-909d-1f89c6b249b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:36.752138 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161ee2d-ebfc-4bff-909d-1f89c6b249b6 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:36.752833 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a161ee2d-ebfc-4bff-909d-1f89c6b249b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:36.754793 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a161ee2d-ebfc-4bff-909d-1f89c6b249b6 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:36.816786 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1076/2140] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:12:36 2022] POST /identity/v3/projects => generated 395 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:12:36.817665 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149c6afb-56f3-46b2-b092-86b3bccc46a3 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:36.843895 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1065/2141] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:12:36 2022] POST /identity/v3/users => generated 295 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:12:36.846224 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a161ee2d-ebfc-4bff-909d-1f89c6b249b6 admin admin] Authenticating service token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 14 21:12:36.848469 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-a161ee2d-ebfc-4bff-909d-1f89c6b249b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:36.901700 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149c6afb-56f3-46b2-b092-86b3bccc46a3 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:36.906900 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac10bd-6862-40ed-90f6-33de19243719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:36.907644 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac10bd-6862-40ed-90f6-33de19243719 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:36.907932 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac10bd-6862-40ed-90f6-33de19243719 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:36.908209 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac10bd-6862-40ed-90f6-33de19243719 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:36.909055 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eac10bd-6862-40ed-90f6-33de19243719 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:36.911171 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eac10bd-6862-40ed-90f6-33de19243719 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:36.955266 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a161ee2d-ebfc-4bff-909d-1f89c6b249b6 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:36.956582 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-a161ee2d-ebfc-4bff-909d-1f89c6b249b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:37.030724 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1077/2142] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:12:36 2022] POST /identity/v3/projects => generated 375 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:12:37.031577 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a161ee2d-ebfc-4bff-909d-1f89c6b249b6 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:37.032315 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac10bd-6862-40ed-90f6-33de19243719 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:37.034688 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-7eac10bd-6862-40ed-90f6-33de19243719 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:37.118352 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decd80f9-531f-47e9-8fa5-fa5c76b370b3 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4227805684e44988f9ebbe14e529a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3ef417f52a54c0eaabb9b87ae84b8ac', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:37.119212 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd80f9-531f-47e9-8fa5-fa5c76b370b3 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:37.119560 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd80f9-531f-47e9-8fa5-fa5c76b370b3 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:37.119980 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd80f9-531f-47e9-8fa5-fa5c76b370b3 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] PATH_INFO: `/v3/projects/902774b3ff584577a522cb8a7dbf1fb4` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:37.121127 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decd80f9-531f-47e9-8fa5-fa5c76b370b3 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] RBAC: Authorizing `identity:get_project(project_id=902774b3ff584577a522cb8a7dbf1fb4)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:37.123391 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decd80f9-531f-47e9-8fa5-fa5c76b370b3 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:37.125388 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1066/2143] 10.222.0.52 () {58 vars in 1443 bytes} [Sat May 14 21:12:36 2022] GET /identity/v3/projects/902774b3ff584577a522cb8a7dbf1fb4 => generated 371 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:12:37.126725 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decd80f9-531f-47e9-8fa5-fa5c76b370b3 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:37.134547 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac10bd-6862-40ed-90f6-33de19243719 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:37.139630 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7093972e-f886-4975-b7c2-773eaf1d2884 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:37.141019 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093972e-f886-4975-b7c2-773eaf1d2884 service placement] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:37.141350 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093972e-f886-4975-b7c2-773eaf1d2884 service placement] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:37.141631 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093972e-f886-4975-b7c2-773eaf1d2884 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:37.153636 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7093972e-f886-4975-b7c2-773eaf1d2884 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:37.155352 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7093972e-f886-4975-b7c2-773eaf1d2884 service placement] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:37.170019 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1078/2144] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:12:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:12:37.170895 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7093972e-f886-4975-b7c2-773eaf1d2884 service placement] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:37.201718 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decd80f9-531f-47e9-8fa5-fa5c76b370b3 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:37.207801 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a51a15-6eda-4b52-b2d0-a6d761e8ee9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:37.208468 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a51a15-6eda-4b52-b2d0-a6d761e8ee9a admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:37.213132 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a51a15-6eda-4b52-b2d0-a6d761e8ee9a admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:37.213132 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a51a15-6eda-4b52-b2d0-a6d761e8ee9a admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:37.213132 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a51a15-6eda-4b52-b2d0-a6d761e8ee9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:37.213132 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a51a15-6eda-4b52-b2d0-a6d761e8ee9a admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:37.249921 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7093972e-f886-4975-b7c2-773eaf1d2884 service placement] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:37.254914 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3252c6b-5d69-4257-88ab-96fd66c74663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:37.255551 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3252c6b-5d69-4257-88ab-96fd66c74663 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:37.255841 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3252c6b-5d69-4257-88ab-96fd66c74663 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:37.256377 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3252c6b-5d69-4257-88ab-96fd66c74663 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:37.257097 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3252c6b-5d69-4257-88ab-96fd66c74663 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:37.258819 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3252c6b-5d69-4257-88ab-96fd66c74663 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:37.270101 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1079/2145] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:12:37.271185 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3252c6b-5d69-4257-88ab-96fd66c74663 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:37.281871 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3252c6b-5d69-4257-88ab-96fd66c74663 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:37.286563 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6491082c-2774-4c0a-bff8-a910a1903842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:37.287257 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6491082c-2774-4c0a-bff8-a910a1903842 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:37.287631 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6491082c-2774-4c0a-bff8-a910a1903842 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:37.287974 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6491082c-2774-4c0a-bff8-a910a1903842 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:37.288691 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6491082c-2774-4c0a-bff8-a910a1903842 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:37.290823 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6491082c-2774-4c0a-bff8-a910a1903842 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:37.324170 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1067/2146] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:12:37 2022] POST /identity/v3/users => generated 304 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:12:37.326244 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a51a15-6eda-4b52-b2d0-a6d761e8ee9a admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:37.336343 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a51a15-6eda-4b52-b2d0-a6d761e8ee9a admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:37.341138 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873d55ac-1412-477f-a4f1-1c6c1e368b75 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4227805684e44988f9ebbe14e529a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3ef417f52a54c0eaabb9b87ae84b8ac', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:37.341992 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d55ac-1412-477f-a4f1-1c6c1e368b75 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:37.342278 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d55ac-1412-477f-a4f1-1c6c1e368b75 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:37.342556 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d55ac-1412-477f-a4f1-1c6c1e368b75 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] PATH_INFO: `/v3/users/86b7079d5fdd4f719796d771f4211f39` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:37.357647 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873d55ac-1412-477f-a4f1-1c6c1e368b75 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] RBAC: Authorizing `identity:delete_user(user_id=86b7079d5fdd4f719796d771f4211f39)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:37.359857 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873d55ac-1412-477f-a4f1-1c6c1e368b75 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:37.441357 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1080/2147] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:12:37 2022] POST /identity/v3/users => generated 294 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:12:37.442751 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6491082c-2774-4c0a-bff8-a910a1903842 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:37.456287 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6491082c-2774-4c0a-bff8-a910a1903842 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:37.462851 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ed8c8-81c2-45d1-9bff-7a4e5c0fb764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:37.463771 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ed8c8-81c2-45d1-9bff-7a4e5c0fb764 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:37.464303 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ed8c8-81c2-45d1-9bff-7a4e5c0fb764 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:37.464716 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ed8c8-81c2-45d1-9bff-7a4e5c0fb764 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:37.465602 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16ed8c8-81c2-45d1-9bff-7a4e5c0fb764 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:37.467505 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16ed8c8-81c2-45d1-9bff-7a4e5c0fb764 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:37.486429 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1081/2148] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:12:37.486429 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ed8c8-81c2-45d1-9bff-7a4e5c0fb764 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:37.492841 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-873d55ac-1412-477f-a4f1-1c6c1e368b75 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86b7079d5fdd4f719796d771f4211f39'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:37.499800 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-873d55ac-1412-477f-a4f1-1c6c1e368b75 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86b7079d5fdd4f719796d771f4211f39'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:37.501374 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ed8c8-81c2-45d1-9bff-7a4e5c0fb764 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:37.504156 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-873d55ac-1412-477f-a4f1-1c6c1e368b75 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86b7079d5fdd4f719796d771f4211f39'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:37.509783 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e6e8ce-5270-4893-b061-bc6edc6d9570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:37.510506 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6e8ce-5270-4893-b061-bc6edc6d9570 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:37.510793 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6e8ce-5270-4893-b061-bc6edc6d9570 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:37.511070 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6e8ce-5270-4893-b061-bc6edc6d9570 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:37.511835 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e6e8ce-5270-4893-b061-bc6edc6d9570 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:37.513464 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e6e8ce-5270-4893-b061-bc6edc6d9570 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:37.525278 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1082/2149] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:12:37.526126 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e6e8ce-5270-4893-b061-bc6edc6d9570 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:37.538178 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e6e8ce-5270-4893-b061-bc6edc6d9570 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:37.543550 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef56ef26-55f5-484e-acac-4f00ffebf628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:37.544393 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef56ef26-55f5-484e-acac-4f00ffebf628 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:37.544872 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef56ef26-55f5-484e-acac-4f00ffebf628 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:37.545314 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef56ef26-55f5-484e-acac-4f00ffebf628 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:37.546061 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef56ef26-55f5-484e-acac-4f00ffebf628 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:37.548551 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef56ef26-55f5-484e-acac-4f00ffebf628 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:37.558402 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1083/2150] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:12:37.559093 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef56ef26-55f5-484e-acac-4f00ffebf628 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:37.568837 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef56ef26-55f5-484e-acac-4f00ffebf628 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:37.573355 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca79ab8b-3f72-4e81-9483-3139b5c739aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:37.574171 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca79ab8b-3f72-4e81-9483-3139b5c739aa admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:37.574450 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca79ab8b-3f72-4e81-9483-3139b5c739aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:37.574720 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca79ab8b-3f72-4e81-9483-3139b5c739aa admin admin] PATH_INFO: `/v3/projects/fe60a3885a2b45bcbc8a219998420fa4/users/d1bee64d3b304c53bf6a9e8fdcfbad56/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:37.598695 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca79ab8b-3f72-4e81-9483-3139b5c739aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe60a3885a2b45bcbc8a219998420fa4, user_id=d1bee64d3b304c53bf6a9e8fdcfbad56, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:37.601913 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca79ab8b-3f72-4e81-9483-3139b5c739aa admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:37.603400 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-873d55ac-1412-477f-a4f1-1c6c1e368b75 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86b7079d5fdd4f719796d771f4211f39'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:37.617773 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-873d55ac-1412-477f-a4f1-1c6c1e368b75 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86b7079d5fdd4f719796d771f4211f39'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:37.623946 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1068/2151] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:12:37 2022] DELETE /identity/v3/users/86b7079d5fdd4f719796d771f4211f39 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:37.625356 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873d55ac-1412-477f-a4f1-1c6c1e368b75 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:37.626342 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-873d55ac-1412-477f-a4f1-1c6c1e368b75 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:37.693993 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873d55ac-1412-477f-a4f1-1c6c1e368b75 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:37.696311 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1084/2152] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:12:37 2022] PUT /identity/v3/projects/fe60a3885a2b45bcbc8a219998420fa4/users/d1bee64d3b304c53bf6a9e8fdcfbad56/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:37.698751 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca79ab8b-3f72-4e81-9483-3139b5c739aa admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:37.700614 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ca79ab8b-3f72-4e81-9483-3139b5c739aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:37.755789 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef0a2f0-83cc-4970-96bf-1a031c293f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:37.757202 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0a2f0-83cc-4970-96bf-1a031c293f3b admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:37.757486 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0a2f0-83cc-4970-96bf-1a031c293f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:37.757755 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0a2f0-83cc-4970-96bf-1a031c293f3b admin admin] PATH_INFO: `/v3/projects/782f075c7cc0430f85d614dc49b230c6/users/09800a8572864b748da9fc581ea97e44/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:37.781770 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef0a2f0-83cc-4970-96bf-1a031c293f3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=782f075c7cc0430f85d614dc49b230c6, user_id=09800a8572864b748da9fc581ea97e44, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:37.782926 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca79ab8b-3f72-4e81-9483-3139b5c739aa admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:37.788489 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23628557-ce23-4618-8656-1b211ed7dc54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:37.789562 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23628557-ce23-4618-8656-1b211ed7dc54 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:37.789910 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23628557-ce23-4618-8656-1b211ed7dc54 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:37.790258 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23628557-ce23-4618-8656-1b211ed7dc54 admin admin] PATH_INFO: `/v3/projects/0582724f730b425cbe166533699aa291/users/24a03e5587064a5284568ac644aaa419/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:37.791959 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef0a2f0-83cc-4970-96bf-1a031c293f3b admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:37.805971 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23628557-ce23-4618-8656-1b211ed7dc54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0582724f730b425cbe166533699aa291, user_id=24a03e5587064a5284568ac644aaa419, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:37.808772 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23628557-ce23-4618-8656-1b211ed7dc54 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:37.950012 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1085/2153] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:12:37 2022] PUT /identity/v3/projects/0582724f730b425cbe166533699aa291/users/24a03e5587064a5284568ac644aaa419/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:37.950012 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb829b0-dc35-4078-b765-5fa05e5c90fc None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:37.950012 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb829b0-dc35-4078-b765-5fa05e5c90fc None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:37.950012 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb829b0-dc35-4078-b765-5fa05e5c90fc None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:37.954035 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1069/2154] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:12:37 2022] PUT /identity/v3/projects/782f075c7cc0430f85d614dc49b230c6/users/09800a8572864b748da9fc581ea97e44/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:37.954999 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef0a2f0-83cc-4970-96bf-1a031c293f3b admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:37.956089 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1086/2155] 10.222.0.52 () {54 vars in 921 bytes} [Sat May 14 21:12:37 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:12:37.957301 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-4ef0a2f0-83cc-4970-96bf-1a031c293f3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:37.957597 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94034aba-6ba9-4379-874b-2ab899092bd6 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:37.957958 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94034aba-6ba9-4379-874b-2ab899092bd6 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:37.958307 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94034aba-6ba9-4379-874b-2ab899092bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:37.988690 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-94034aba-6ba9-4379-874b-2ab899092bd6 None None] MFA Rules not processed for user `d1bee64d3b304c53bf6a9e8fdcfbad56`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:37.990013 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-94034aba-6ba9-4379-874b-2ab899092bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:38.034979 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef0a2f0-83cc-4970-96bf-1a031c293f3b admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:38.064357 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1087/2156] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:37 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:38.065212 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94034aba-6ba9-4379-874b-2ab899092bd6 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:38.112385 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915c1937-9bed-4791-b44e-0c4b04f454f4 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4227805684e44988f9ebbe14e529a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3ef417f52a54c0eaabb9b87ae84b8ac', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:38.113250 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c1937-9bed-4791-b44e-0c4b04f454f4 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:38.113678 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c1937-9bed-4791-b44e-0c4b04f454f4 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:38.113851 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c1937-9bed-4791-b44e-0c4b04f454f4 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] PATH_INFO: `/v3/projects/902774b3ff584577a522cb8a7dbf1fb4` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:38.116360 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915c1937-9bed-4791-b44e-0c4b04f454f4 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] RBAC: Authorizing `identity:delete_project(project_id=902774b3ff584577a522cb8a7dbf1fb4)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:38.118857 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915c1937-9bed-4791-b44e-0c4b04f454f4 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:38.145803 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94034aba-6ba9-4379-874b-2ab899092bd6 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:38.151395 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc3f04c-0db6-40b2-ad6a-39e6d5736c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:38.156416 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc3f04c-0db6-40b2-ad6a-39e6d5736c99 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:38.156416 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc3f04c-0db6-40b2-ad6a-39e6d5736c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:38.156416 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc3f04c-0db6-40b2-ad6a-39e6d5736c99 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:38.156416 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc3f04c-0db6-40b2-ad6a-39e6d5736c99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:38.156416 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc3f04c-0db6-40b2-ad6a-39e6d5736c99 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:38.174940 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1088/2157] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:12:38.174940 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc3f04c-0db6-40b2-ad6a-39e6d5736c99 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:38.190872 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc3f04c-0db6-40b2-ad6a-39e6d5736c99 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:38.197545 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690db914-14c3-44e5-88fc-489f6ee6da6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:38.198327 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690db914-14c3-44e5-88fc-489f6ee6da6f admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:38.198617 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690db914-14c3-44e5-88fc-489f6ee6da6f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:38.198895 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690db914-14c3-44e5-88fc-489f6ee6da6f admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:38.199685 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690db914-14c3-44e5-88fc-489f6ee6da6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:38.204177 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690db914-14c3-44e5-88fc-489f6ee6da6f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:38.219931 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1089/2158] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:12:38.221412 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb366f-2d7c-4e32-bedd-f53c14a03142 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:38.221709 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb366f-2d7c-4e32-bedd-f53c14a03142 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:38.221990 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb366f-2d7c-4e32-bedd-f53c14a03142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:38.247189 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-aafb366f-2d7c-4e32-bedd-f53c14a03142 None None] MFA Rules not processed for user `0f1b0e2b025d4eceaa90e1616d0a9db8`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:38.249032 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-aafb366f-2d7c-4e32-bedd-f53c14a03142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:38.309593 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-915c1937-9bed-4791-b44e-0c4b04f454f4 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '902774b3ff584577a522cb8a7dbf1fb4', 'request_id': 'req-915c1937-9bed-4791-b44e-0c4b04f454f4'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:38.317941 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-915c1937-9bed-4791-b44e-0c4b04f454f4 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '902774b3ff584577a522cb8a7dbf1fb4', 'request_id': 'req-915c1937-9bed-4791-b44e-0c4b04f454f4'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:38.329823 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-915c1937-9bed-4791-b44e-0c4b04f454f4 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '902774b3ff584577a522cb8a7dbf1fb4', 'request_id': 'req-915c1937-9bed-4791-b44e-0c4b04f454f4'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:38.361227 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1090/2159] 10.222.0.52 () {58 vars in 1018 bytes} [Sat May 14 21:12:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:38.362091 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafb366f-2d7c-4e32-bedd-f53c14a03142 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:38.363372 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-aafb366f-2d7c-4e32-bedd-f53c14a03142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:38.380658 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafb366f-2d7c-4e32-bedd-f53c14a03142 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:38.446959 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-915c1937-9bed-4791-b44e-0c4b04f454f4 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] The token cache is being invalidate because project 902774b3ff584577a522cb8a7dbf1fb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:12:38.447373 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-915c1937-9bed-4791-b44e-0c4b04f454f4 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:38.449399 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-915c1937-9bed-4791-b44e-0c4b04f454f4 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:38.451163 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1070/2160] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:12:37 2022] DELETE /identity/v3/projects/902774b3ff584577a522cb8a7dbf1fb4 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:38.457739 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915c1937-9bed-4791-b44e-0c4b04f454f4 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:38.459586 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-915c1937-9bed-4791-b44e-0c4b04f454f4 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:38.465657 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e36558-0786-4076-9c88-efbee636998d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:38.466409 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e36558-0786-4076-9c88-efbee636998d admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:38.466765 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e36558-0786-4076-9c88-efbee636998d admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:38.467106 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e36558-0786-4076-9c88-efbee636998d admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:38.467936 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e36558-0786-4076-9c88-efbee636998d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:38.470721 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e36558-0786-4076-9c88-efbee636998d admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:38.479208 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915c1937-9bed-4791-b44e-0c4b04f454f4 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:38.504243 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a690f4-0afa-4672-b835-da4044e5cca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:38.505262 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a690f4-0afa-4672-b835-da4044e5cca1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:38.505616 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a690f4-0afa-4672-b835-da4044e5cca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:38.506211 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a690f4-0afa-4672-b835-da4044e5cca1 admin admin] PATH_INFO: `/v3/projects/0582724f730b425cbe166533699aa291/users/24a03e5587064a5284568ac644aaa419/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:38.508884 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a690f4-0afa-4672-b835-da4044e5cca1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0582724f730b425cbe166533699aa291, user_id=24a03e5587064a5284568ac644aaa419, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:38.518758 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a690f4-0afa-4672-b835-da4044e5cca1 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:38.543801 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1071/2161] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:12:38 2022] PUT /identity/v3/projects/0582724f730b425cbe166533699aa291/users/24a03e5587064a5284568ac644aaa419/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:38.545267 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a690f4-0afa-4672-b835-da4044e5cca1 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:38.547321 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e1a690f4-0afa-4672-b835-da4044e5cca1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:38.569494 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1091/2162] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:12:38 2022] POST /identity/v3/projects => generated 389 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:12:38.570521 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e36558-0786-4076-9c88-efbee636998d admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:38.572564 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-a8e36558-0786-4076-9c88-efbee636998d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:38.613038 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a690f4-0afa-4672-b835-da4044e5cca1 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:38.631586 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e36558-0786-4076-9c88-efbee636998d admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:38.635300 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023666aa-dab1-490b-b8fe-42663cac73b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:38.636207 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023666aa-dab1-490b-b8fe-42663cac73b5 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:38.636528 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023666aa-dab1-490b-b8fe-42663cac73b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:38.636800 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023666aa-dab1-490b-b8fe-42663cac73b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:38.638680 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-023666aa-dab1-490b-b8fe-42663cac73b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:38.675376 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc6abc-fdcc-4c0b-b4bf-9c155c651497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:38.676505 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc6abc-fdcc-4c0b-b4bf-9c155c651497 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:38.676726 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc6abc-fdcc-4c0b-b4bf-9c155c651497 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:38.677012 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc6abc-fdcc-4c0b-b4bf-9c155c651497 admin admin] PATH_INFO: `/v3/projects/782f075c7cc0430f85d614dc49b230c6/users/09800a8572864b748da9fc581ea97e44/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:38.679061 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cc6abc-fdcc-4c0b-b4bf-9c155c651497 admin admin] RBAC: Authorizing `identity:create_grant(project_id=782f075c7cc0430f85d614dc49b230c6, user_id=09800a8572864b748da9fc581ea97e44, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:38.681837 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cc6abc-fdcc-4c0b-b4bf-9c155c651497 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:38.696245 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1072/2163] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:12:38 2022] PUT /identity/v3/projects/782f075c7cc0430f85d614dc49b230c6/users/09800a8572864b748da9fc581ea97e44/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:38.697678 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ab437-04e7-4886-b0e4-9b67f0f59115 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:38.698130 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ab437-04e7-4886-b0e4-9b67f0f59115 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:38.698420 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ab437-04e7-4886-b0e4-9b67f0f59115 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:38.699869 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1073/2164] 10.222.0.52 () {54 vars in 912 bytes} [Sat May 14 21:12:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:12:38.701117 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ed583-2e14-4211-9761-e0819b5e9028 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:38.701229 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ed583-2e14-4211-9761-e0819b5e9028 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:38.701421 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ed583-2e14-4211-9761-e0819b5e9028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:38.721980 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023666aa-dab1-490b-b8fe-42663cac73b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:38.722625 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023666aa-dab1-490b-b8fe-42663cac73b5 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:38.729815 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-269ed583-2e14-4211-9761-e0819b5e9028 None None] MFA Rules not processed for user `24a03e5587064a5284568ac644aaa419`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:38.731150 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-269ed583-2e14-4211-9761-e0819b5e9028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:38.734526 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1092/2165] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:12:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:12:38.735439 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023666aa-dab1-490b-b8fe-42663cac73b5 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:38.736908 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-023666aa-dab1-490b-b8fe-42663cac73b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:38.752471 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023666aa-dab1-490b-b8fe-42663cac73b5 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:38.813687 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc87258e-059c-440d-8ca1-413136d996c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:38.814482 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc87258e-059c-440d-8ca1-413136d996c8 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:38.814844 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc87258e-059c-440d-8ca1-413136d996c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:38.815197 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc87258e-059c-440d-8ca1-413136d996c8 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:38.817372 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc87258e-059c-440d-8ca1-413136d996c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:38.820229 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc87258e-059c-440d-8ca1-413136d996c8 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:38.820652 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1074/2166] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:38 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:38.821840 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25292c4e-0de8-4238-8d5c-8f9c130a50b0 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:38.822128 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25292c4e-0de8-4238-8d5c-8f9c130a50b0 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:38.822404 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25292c4e-0de8-4238-8d5c-8f9c130a50b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:38.854579 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-25292c4e-0de8-4238-8d5c-8f9c130a50b0 None None] MFA Rules not processed for user `09800a8572864b748da9fc581ea97e44`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:38.855840 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-25292c4e-0de8-4238-8d5c-8f9c130a50b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:38.909081 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1093/2167] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:12:38 2022] POST /identity/v3/users => generated 301 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:12:38.910135 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc87258e-059c-440d-8ca1-413136d996c8 admin admin] Authenticating service token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 14 21:12:38.912335 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-dc87258e-059c-440d-8ca1-413136d996c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:38.947786 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1075/2168] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:38 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:38.950678 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f1385b-3bd4-4e27-b393-0c10e69e7711 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:38.951071 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f1385b-3bd4-4e27-b393-0c10e69e7711 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:38.951355 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f1385b-3bd4-4e27-b393-0c10e69e7711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:38.978198 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-70f1385b-3bd4-4e27-b393-0c10e69e7711 None None] MFA Rules not processed for user `3bff40a84e6f4a82b0c9fb0b155684c4`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:38.979970 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-70f1385b-3bd4-4e27-b393-0c10e69e7711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:39.014676 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc87258e-059c-440d-8ca1-413136d996c8 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:39.016587 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-dc87258e-059c-440d-8ca1-413136d996c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:39.036753 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1076/2169] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:39.037421 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f1385b-3bd4-4e27-b393-0c10e69e7711 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:39.048189 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f1385b-3bd4-4e27-b393-0c10e69e7711 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:39.053058 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc9aa2-2c9f-4e5b-9392-6a440cc1ef30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:39.053735 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc9aa2-2c9f-4e5b-9392-6a440cc1ef30 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:39.054009 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc9aa2-2c9f-4e5b-9392-6a440cc1ef30 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:39.054284 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc9aa2-2c9f-4e5b-9392-6a440cc1ef30 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:39.055003 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebc9aa2-2c9f-4e5b-9392-6a440cc1ef30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:39.056653 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebc9aa2-2c9f-4e5b-9392-6a440cc1ef30 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:39.067144 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1077/2170] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:12:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:12:39.071030 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc9aa2-2c9f-4e5b-9392-6a440cc1ef30 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:39.081328 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc9aa2-2c9f-4e5b-9392-6a440cc1ef30 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:39.083301 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc87258e-059c-440d-8ca1-413136d996c8 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:39.085964 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db7e64c-ad05-4564-9182-cc9bedd71d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:39.086630 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db7e64c-ad05-4564-9182-cc9bedd71d4e admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:39.086914 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db7e64c-ad05-4564-9182-cc9bedd71d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:39.087216 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db7e64c-ad05-4564-9182-cc9bedd71d4e admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:39.087926 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db7e64c-ad05-4564-9182-cc9bedd71d4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:39.088045 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e573764-cc88-43bd-9e4e-93b875858de5 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4227805684e44988f9ebbe14e529a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3ef417f52a54c0eaabb9b87ae84b8ac', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:39.088863 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e573764-cc88-43bd-9e4e-93b875858de5 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:39.089147 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e573764-cc88-43bd-9e4e-93b875858de5 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:39.089425 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e573764-cc88-43bd-9e4e-93b875858de5 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] PATH_INFO: `/v3/projects/48bf82bdace04c2f93e8c18a0e12626b` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:39.089834 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db7e64c-ad05-4564-9182-cc9bedd71d4e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:39.090608 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e573764-cc88-43bd-9e4e-93b875858de5 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] RBAC: Authorizing `identity:get_project(project_id=48bf82bdace04c2f93e8c18a0e12626b)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:39.093037 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e573764-cc88-43bd-9e4e-93b875858de5 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:39.094795 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1094/2171] 10.222.0.52 () {58 vars in 1443 bytes} [Sat May 14 21:12:38 2022] GET /identity/v3/projects/48bf82bdace04c2f93e8c18a0e12626b => generated 375 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:12:39.095576 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e573764-cc88-43bd-9e4e-93b875858de5 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:39.097260 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-0e573764-cc88-43bd-9e4e-93b875858de5 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:39.116889 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e573764-cc88-43bd-9e4e-93b875858de5 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:39.129222 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2186123-9dd8-4f22-8aa7-4ec4e0e97a0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:39.129879 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2186123-9dd8-4f22-8aa7-4ec4e0e97a0b service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:39.130161 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2186123-9dd8-4f22-8aa7-4ec4e0e97a0b service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:39.131384 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2186123-9dd8-4f22-8aa7-4ec4e0e97a0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:39.132773 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-a2186123-9dd8-4f22-8aa7-4ec4e0e97a0b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:39.147691 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2186123-9dd8-4f22-8aa7-4ec4e0e97a0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:39.150518 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2186123-9dd8-4f22-8aa7-4ec4e0e97a0b service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:39.166323 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1095/2172] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:12:39 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:12:39.167602 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2186123-9dd8-4f22-8aa7-4ec4e0e97a0b service nova] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:39.181210 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2186123-9dd8-4f22-8aa7-4ec4e0e97a0b service nova] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:39.186162 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287cd3d2-317d-4333-a24f-c7dce1d3bdf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:39.187202 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287cd3d2-317d-4333-a24f-c7dce1d3bdf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:39.187504 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287cd3d2-317d-4333-a24f-c7dce1d3bdf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:39.187841 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287cd3d2-317d-4333-a24f-c7dce1d3bdf2 admin admin] PATH_INFO: `/v3/projects/89ae353dbfc44d8ea8ac03775f0722ac/users/bb563e92d4814f55bef0f9030ac72398/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:39.202658 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287cd3d2-317d-4333-a24f-c7dce1d3bdf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89ae353dbfc44d8ea8ac03775f0722ac, user_id=bb563e92d4814f55bef0f9030ac72398, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:39.207463 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287cd3d2-317d-4333-a24f-c7dce1d3bdf2 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:39.237804 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1078/2173] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:12:39 2022] POST /identity/v3/projects => generated 395 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:12:39.237804 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca03eb-f739-486e-ae6c-e970c980e918 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:39.237804 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca03eb-f739-486e-ae6c-e970c980e918 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:39.237804 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca03eb-f739-486e-ae6c-e970c980e918 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:39.240741 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1079/2174] 10.222.0.52 () {54 vars in 912 bytes} [Sat May 14 21:12:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:12:39.241572 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ca03eb-f739-486e-ae6c-e970c980e918 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:39.315181 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ca03eb-f739-486e-ae6c-e970c980e918 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:39.331113 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1096/2175] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:12:39 2022] PUT /identity/v3/projects/89ae353dbfc44d8ea8ac03775f0722ac/users/bb563e92d4814f55bef0f9030ac72398/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:39.332242 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287cd3d2-317d-4333-a24f-c7dce1d3bdf2 admin admin] Authenticating service token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 14 21:12:39.393812 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed8949e-a995-4e0a-9d5c-50d9e9e7d7c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:39.394516 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8949e-a995-4e0a-9d5c-50d9e9e7d7c2 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:39.394899 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8949e-a995-4e0a-9d5c-50d9e9e7d7c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:39.395092 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8949e-a995-4e0a-9d5c-50d9e9e7d7c2 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:39.395821 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed8949e-a995-4e0a-9d5c-50d9e9e7d7c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:39.397753 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed8949e-a995-4e0a-9d5c-50d9e9e7d7c2 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:39.418922 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287cd3d2-317d-4333-a24f-c7dce1d3bdf2 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:39.470869 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1080/2176] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:12:39 2022] POST /identity/v3/users => generated 298 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:12:39.472107 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed8949e-a995-4e0a-9d5c-50d9e9e7d7c2 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:39.517468 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed8949e-a995-4e0a-9d5c-50d9e9e7d7c2 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:39.539949 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9124fd34-5dea-40b5-9a0d-d79e846f7537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:39.541130 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9124fd34-5dea-40b5-9a0d-d79e846f7537 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:39.542284 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9124fd34-5dea-40b5-9a0d-d79e846f7537 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:39.542561 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9124fd34-5dea-40b5-9a0d-d79e846f7537 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:39.543302 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9124fd34-5dea-40b5-9a0d-d79e846f7537 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:39.549703 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9124fd34-5dea-40b5-9a0d-d79e846f7537 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:39.562285 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287cd3d2-317d-4333-a24f-c7dce1d3bdf2 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:39.567640 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25fdc12-fe98-418e-8110-23689e9901b1 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4227805684e44988f9ebbe14e529a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3ef417f52a54c0eaabb9b87ae84b8ac', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:39.568680 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25fdc12-fe98-418e-8110-23689e9901b1 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:39.569017 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25fdc12-fe98-418e-8110-23689e9901b1 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:39.569455 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25fdc12-fe98-418e-8110-23689e9901b1 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] PATH_INFO: `/v3/projects/48bf82bdace04c2f93e8c18a0e12626b` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:39.570669 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25fdc12-fe98-418e-8110-23689e9901b1 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] RBAC: Authorizing `identity:get_project(project_id=48bf82bdace04c2f93e8c18a0e12626b)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:39.572362 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1081/2177] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:12:39 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:12:39.573550 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9124fd34-5dea-40b5-9a0d-d79e846f7537 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:39.576374 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25fdc12-fe98-418e-8110-23689e9901b1 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:39.582053 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1097/2178] 10.222.0.52 () {58 vars in 1443 bytes} [Sat May 14 21:12:39 2022] GET /identity/v3/projects/48bf82bdace04c2f93e8c18a0e12626b => generated 375 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:12:39.582053 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25fdc12-fe98-418e-8110-23689e9901b1 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:39.586442 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9124fd34-5dea-40b5-9a0d-d79e846f7537 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:39.591355 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8c9ea5-7ce6-4b6d-b228-ebb216561a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:39.592407 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c9ea5-7ce6-4b6d-b228-ebb216561a14 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:39.592719 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c9ea5-7ce6-4b6d-b228-ebb216561a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:39.592957 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25fdc12-fe98-418e-8110-23689e9901b1 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:39.594242 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c9ea5-7ce6-4b6d-b228-ebb216561a14 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:39.594657 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8c9ea5-7ce6-4b6d-b228-ebb216561a14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:39.596749 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8c9ea5-7ce6-4b6d-b228-ebb216561a14 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:39.599627 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e40a06-0227-4cc3-aebd-9a536e432ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:39.601687 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e40a06-0227-4cc3-aebd-9a536e432ac1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:39.602100 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e40a06-0227-4cc3-aebd-9a536e432ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:39.602481 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e40a06-0227-4cc3-aebd-9a536e432ac1 admin admin] PATH_INFO: `/v3/projects/89ae353dbfc44d8ea8ac03775f0722ac/users/bb563e92d4814f55bef0f9030ac72398/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:39.605401 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e40a06-0227-4cc3-aebd-9a536e432ac1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89ae353dbfc44d8ea8ac03775f0722ac, user_id=bb563e92d4814f55bef0f9030ac72398, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:39.609029 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e40a06-0227-4cc3-aebd-9a536e432ac1 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:39.610267 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1082/2179] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:12:39 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:12:39.614673 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8c9ea5-7ce6-4b6d-b228-ebb216561a14 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:39.626702 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8c9ea5-7ce6-4b6d-b228-ebb216561a14 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:39.643403 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1098/2180] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:12:39 2022] PUT /identity/v3/projects/89ae353dbfc44d8ea8ac03775f0722ac/users/bb563e92d4814f55bef0f9030ac72398/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:39.646240 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c68e80-effd-4801-9fdf-89bb3a859b66 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:39.646547 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c68e80-effd-4801-9fdf-89bb3a859b66 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:39.647024 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c68e80-effd-4801-9fdf-89bb3a859b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:39.699457 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24827342-708b-4882-8e07-1502a1d51eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:39.705678 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24827342-708b-4882-8e07-1502a1d51eef admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:39.705678 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24827342-708b-4882-8e07-1502a1d51eef admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:39.705678 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24827342-708b-4882-8e07-1502a1d51eef admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:39.705678 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24827342-708b-4882-8e07-1502a1d51eef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:39.705678 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24827342-708b-4882-8e07-1502a1d51eef admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:39.719122 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1083/2181] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:12:39 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:12:39.723510 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24827342-708b-4882-8e07-1502a1d51eef admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:39.740937 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-01c68e80-effd-4801-9fdf-89bb3a859b66 None None] MFA Rules not processed for user `bb563e92d4814f55bef0f9030ac72398`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:39.742421 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-01c68e80-effd-4801-9fdf-89bb3a859b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:39.758512 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24827342-708b-4882-8e07-1502a1d51eef admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:39.766806 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a17ea05-0d5c-4f19-a0b5-12902791f850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:39.773309 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a17ea05-0d5c-4f19-a0b5-12902791f850 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:39.781479 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a17ea05-0d5c-4f19-a0b5-12902791f850 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:39.783036 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a17ea05-0d5c-4f19-a0b5-12902791f850 admin admin] PATH_INFO: `/v3/projects/40acab3854134d1e85effc683181971e/users/9a8d130d6d54435d93b7326734f0d47d/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:39.806757 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a17ea05-0d5c-4f19-a0b5-12902791f850 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40acab3854134d1e85effc683181971e, user_id=9a8d130d6d54435d93b7326734f0d47d, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:39.810312 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a17ea05-0d5c-4f19-a0b5-12902791f850 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:39.852312 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1099/2182] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:39 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:39.929765 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1084/2183] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:12:39 2022] PUT /identity/v3/projects/40acab3854134d1e85effc683181971e/users/9a8d130d6d54435d93b7326734f0d47d/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:39.929864 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb39ad8-296f-4acc-bb77-8017712ae211 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:39.929864 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb39ad8-296f-4acc-bb77-8017712ae211 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:39.929864 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb39ad8-296f-4acc-bb77-8017712ae211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:39.960072 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-8fb39ad8-296f-4acc-bb77-8017712ae211 None None] MFA Rules not processed for user `9a8d130d6d54435d93b7326734f0d47d`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:39.961907 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-8fb39ad8-296f-4acc-bb77-8017712ae211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:40.040809 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1100/2184] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:12:40.083813 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a17ea05-0d5c-4f19-a0b5-12902791f850 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:40.168134 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a17ea05-0d5c-4f19-a0b5-12902791f850 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:40.174072 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaed4be-9a7e-4395-b40c-dcf7aa191dbc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:40.174724 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaed4be-9a7e-4395-b40c-dcf7aa191dbc service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:40.175031 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaed4be-9a7e-4395-b40c-dcf7aa191dbc service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:40.175269 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaed4be-9a7e-4395-b40c-dcf7aa191dbc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:40.177354 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-efaed4be-9a7e-4395-b40c-dcf7aa191dbc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:40.241144 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaed4be-9a7e-4395-b40c-dcf7aa191dbc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:40.244814 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaed4be-9a7e-4395-b40c-dcf7aa191dbc service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:40.254706 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1085/2185] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:12:40 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:12:41.033711 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb39ad8-296f-4acc-bb77-8017712ae211 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:41.047154 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb39ad8-296f-4acc-bb77-8017712ae211 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:41.052813 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f7da41-b9cb-4764-8aef-6a6fc6322558 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:41.053542 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7da41-b9cb-4764-8aef-6a6fc6322558 service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:41.053896 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7da41-b9cb-4764-8aef-6a6fc6322558 service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:41.054223 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7da41-b9cb-4764-8aef-6a6fc6322558 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:41.116680 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f7da41-b9cb-4764-8aef-6a6fc6322558 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:41.118203 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f7da41-b9cb-4764-8aef-6a6fc6322558 service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:41.128979 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1101/2186] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:12:41 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:12:41.905903 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6015aae-70e0-4aff-a6a8-badb83dfea6b None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:41.910563 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6015aae-70e0-4aff-a6a8-badb83dfea6b None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:41.912760 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6015aae-70e0-4aff-a6a8-badb83dfea6b None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:41.913494 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f886fa15-9226-42cf-9c58-f2b79cc90f3a None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:41.915852 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1086/2187] 10.222.0.52 () {54 vars in 912 bytes} [Sat May 14 21:12:41 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:12:41.916684 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f886fa15-9226-42cf-9c58-f2b79cc90f3a None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:41.918860 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f886fa15-9226-42cf-9c58-f2b79cc90f3a None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:41.922630 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6015aae-70e0-4aff-a6a8-badb83dfea6b None None] Authenticating service token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 14 21:12:41.924135 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1102/2188] 10.222.0.52 () {54 vars in 912 bytes} [Sat May 14 21:12:41 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:12:41.936719 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f886fa15-9226-42cf-9c58-f2b79cc90f3a None None] Authenticating service token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 14 21:12:41.941827 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6015aae-70e0-4aff-a6a8-badb83dfea6b None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:41.956131 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6015aae-70e0-4aff-a6a8-badb83dfea6b None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:41.967172 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f886fa15-9226-42cf-9c58-f2b79cc90f3a None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:41.979129 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9cfba0-8293-4d87-8e70-369c565a7213 tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09800a8572864b748da9fc581ea97e44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782f075c7cc0430f85d614dc49b230c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:41.982600 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9cfba0-8293-4d87-8e70-369c565a7213 tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:41.984406 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9cfba0-8293-4d87-8e70-369c565a7213 tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:41.984406 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9cfba0-8293-4d87-8e70-369c565a7213 tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] PATH_INFO: `/v3/projects/bc82fc4cb79444acbdf29af78e302e6a` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:41.989901 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9cfba0-8293-4d87-8e70-369c565a7213 tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] RBAC: Authorizing `identity:get_project(project_id=bc82fc4cb79444acbdf29af78e302e6a)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:41.994756 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9cfba0-8293-4d87-8e70-369c565a7213 tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:41.997245 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1087/2189] 10.222.0.52 () {58 vars in 1443 bytes} [Sat May 14 21:12:41 2022] GET /identity/v3/projects/bc82fc4cb79444acbdf29af78e302e6a => generated 395 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:12:42.081196 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f886fa15-9226-42cf-9c58-f2b79cc90f3a None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:42.086839 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf4548a-a2eb-4732-b240-946791e02bda tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4227805684e44988f9ebbe14e529a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3ef417f52a54c0eaabb9b87ae84b8ac', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:42.087943 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf4548a-a2eb-4732-b240-946791e02bda tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:42.088382 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf4548a-a2eb-4732-b240-946791e02bda tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:42.088818 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf4548a-a2eb-4732-b240-946791e02bda tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] PATH_INFO: `/v3/projects/48bf82bdace04c2f93e8c18a0e12626b` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:42.090086 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf4548a-a2eb-4732-b240-946791e02bda tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] RBAC: Authorizing `identity:get_project(project_id=48bf82bdace04c2f93e8c18a0e12626b)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:42.092246 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf4548a-a2eb-4732-b240-946791e02bda tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:42.094678 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1103/2190] 10.222.0.52 () {58 vars in 1443 bytes} [Sat May 14 21:12:41 2022] GET /identity/v3/projects/48bf82bdace04c2f93e8c18a0e12626b => generated 375 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:12:42.145007 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9cfba0-8293-4d87-8e70-369c565a7213 tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:42.158778 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9cfba0-8293-4d87-8e70-369c565a7213 tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:42.164301 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec8fc4b-8374-4c4c-ae68-8036c849ba9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:42.164937 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec8fc4b-8374-4c4c-ae68-8036c849ba9e service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:42.165221 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec8fc4b-8374-4c4c-ae68-8036c849ba9e service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:42.165504 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec8fc4b-8374-4c4c-ae68-8036c849ba9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:42.229052 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec8fc4b-8374-4c4c-ae68-8036c849ba9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:42.230769 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec8fc4b-8374-4c4c-ae68-8036c849ba9e service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:42.241420 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1088/2191] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:12:42 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:12:42.822209 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbbb3cf-46d5-4147-990e-292f426d4696 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:42.822490 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbbb3cf-46d5-4147-990e-292f426d4696 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:42.822790 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbbb3cf-46d5-4147-990e-292f426d4696 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:42.824271 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1104/2192] 10.222.0.52 () {54 vars in 912 bytes} [Sat May 14 21:12:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:12:42.829630 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec8fc4b-8374-4c4c-ae68-8036c849ba9e service nova] Authenticating service token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 14 21:12:42.840735 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec8fc4b-8374-4c4c-ae68-8036c849ba9e service nova] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:42.851104 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec8fc4b-8374-4c4c-ae68-8036c849ba9e service nova] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:42.856344 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9331a601-9f84-4747-97a4-606b2dd8b379 tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09800a8572864b748da9fc581ea97e44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782f075c7cc0430f85d614dc49b230c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:42.856687 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331a601-9f84-4747-97a4-606b2dd8b379 tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:42.856969 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331a601-9f84-4747-97a4-606b2dd8b379 tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:42.857242 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331a601-9f84-4747-97a4-606b2dd8b379 tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] PATH_INFO: `/v3/projects/bc82fc4cb79444acbdf29af78e302e6a` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:42.858411 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9331a601-9f84-4747-97a4-606b2dd8b379 tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] RBAC: Authorizing `identity:get_project(project_id=bc82fc4cb79444acbdf29af78e302e6a)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:42.861613 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9331a601-9f84-4747-97a4-606b2dd8b379 tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:42.863295 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1089/2193] 10.222.0.52 () {58 vars in 1443 bytes} [Sat May 14 21:12:42 2022] GET /identity/v3/projects/bc82fc4cb79444acbdf29af78e302e6a => generated 395 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:12:43.895882 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0f1ab-1131-4f12-b979-430a4250771f None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:43.896356 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0f1ab-1131-4f12-b979-430a4250771f None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:43.896624 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0f1ab-1131-4f12-b979-430a4250771f None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:43.898008 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1105/2194] 10.222.0.52 () {54 vars in 912 bytes} [Sat May 14 21:12:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:12:43.902896 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9331a601-9f84-4747-97a4-606b2dd8b379 tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] Authenticating service token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 14 21:12:43.920470 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9331a601-9f84-4747-97a4-606b2dd8b379 tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:43.928804 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9331a601-9f84-4747-97a4-606b2dd8b379 tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:43.933429 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d0783-e858-4eb1-93ea-a3d17fb37c14 tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09800a8572864b748da9fc581ea97e44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782f075c7cc0430f85d614dc49b230c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:43.934515 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d0783-e858-4eb1-93ea-a3d17fb37c14 tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:43.934826 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d0783-e858-4eb1-93ea-a3d17fb37c14 tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:43.935103 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d0783-e858-4eb1-93ea-a3d17fb37c14 tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] PATH_INFO: `/v3/projects/bc82fc4cb79444acbdf29af78e302e6a` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:43.936292 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1d0783-e858-4eb1-93ea-a3d17fb37c14 tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] RBAC: Authorizing `identity:get_project(project_id=bc82fc4cb79444acbdf29af78e302e6a)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:43.939354 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1d0783-e858-4eb1-93ea-a3d17fb37c14 tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:43.941060 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1090/2195] 10.222.0.52 () {58 vars in 1443 bytes} [Sat May 14 21:12:43 2022] GET /identity/v3/projects/bc82fc4cb79444acbdf29af78e302e6a => generated 395 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:12:44.144265 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c0f1ab-1131-4f12-b979-430a4250771f None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:44.146279 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-58c0f1ab-1131-4f12-b979-430a4250771f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:44.179141 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d0783-e858-4eb1-93ea-a3d17fb37c14 tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:44.181089 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-4a1d0783-e858-4eb1-93ea-a3d17fb37c14 tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:44.223536 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c0f1ab-1131-4f12-b979-430a4250771f None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:44.229157 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb0bdbf-de19-42b7-bd8c-5590514c4313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:44.230141 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb0bdbf-de19-42b7-bd8c-5590514c4313 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:44.230488 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb0bdbf-de19-42b7-bd8c-5590514c4313 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:44.230857 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb0bdbf-de19-42b7-bd8c-5590514c4313 admin admin] PATH_INFO: `/v3/users/94def4aa29674cca9e86691c84e5bff8` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:44.232144 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb0bdbf-de19-42b7-bd8c-5590514c4313 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94def4aa29674cca9e86691c84e5bff8)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:44.234775 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb0bdbf-de19-42b7-bd8c-5590514c4313 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:44.256545 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d0783-e858-4eb1-93ea-a3d17fb37c14 tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:44.267113 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7327e79-e8c0-4b7e-a378-fd847e93d532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:44.268475 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7327e79-e8c0-4b7e-a378-fd847e93d532 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:44.268760 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7327e79-e8c0-4b7e-a378-fd847e93d532 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:44.269065 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7327e79-e8c0-4b7e-a378-fd847e93d532 admin admin] PATH_INFO: `/v3/users/7d7d10a70c364505af3b2b8294238615` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:44.270324 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7327e79-e8c0-4b7e-a378-fd847e93d532 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d7d10a70c364505af3b2b8294238615)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:44.272366 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7327e79-e8c0-4b7e-a378-fd847e93d532 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:44.440863 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-cfb0bdbf-de19-42b7-bd8c-5590514c4313 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94def4aa29674cca9e86691c84e5bff8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:44.457608 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-cfb0bdbf-de19-42b7-bd8c-5590514c4313 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94def4aa29674cca9e86691c84e5bff8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:44.464372 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d7327e79-e8c0-4b7e-a378-fd847e93d532 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d7d10a70c364505af3b2b8294238615'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:44.470420 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-cfb0bdbf-de19-42b7-bd8c-5590514c4313 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94def4aa29674cca9e86691c84e5bff8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:44.473332 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d7327e79-e8c0-4b7e-a378-fd847e93d532 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d7d10a70c364505af3b2b8294238615'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:44.474634 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d7327e79-e8c0-4b7e-a378-fd847e93d532 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d7d10a70c364505af3b2b8294238615'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:44.546518 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-cfb0bdbf-de19-42b7-bd8c-5590514c4313 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94def4aa29674cca9e86691c84e5bff8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:44.547151 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-cfb0bdbf-de19-42b7-bd8c-5590514c4313 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94def4aa29674cca9e86691c84e5bff8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:44.554634 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1106/2196] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:12:44 2022] DELETE /identity/v3/users/94def4aa29674cca9e86691c84e5bff8 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:44.559354 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7640935-1658-4de3-8a67-90c280d55986 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:44.559927 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7640935-1658-4de3-8a67-90c280d55986 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:44.560323 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7640935-1658-4de3-8a67-90c280d55986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:44.581483 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-d7640935-1658-4de3-8a67-90c280d55986 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:44.582807 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d7640935-1658-4de3-8a67-90c280d55986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:44.607522 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d7327e79-e8c0-4b7e-a378-fd847e93d532 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d7d10a70c364505af3b2b8294238615'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:44.621486 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d7327e79-e8c0-4b7e-a378-fd847e93d532 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d7d10a70c364505af3b2b8294238615'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:44.628478 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1091/2197] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:12:44 2022] DELETE /identity/v3/users/7d7d10a70c364505af3b2b8294238615 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:44.632699 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e963970-e722-4d93-8f69-680d2cfffc1e None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:44.633060 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e963970-e722-4d93-8f69-680d2cfffc1e None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:44.633351 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e963970-e722-4d93-8f69-680d2cfffc1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:44.648606 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1107/2198] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:44.651640 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-9e963970-e722-4d93-8f69-680d2cfffc1e None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:44.655538 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-9e963970-e722-4d93-8f69-680d2cfffc1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:44.665380 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7640935-1658-4de3-8a67-90c280d55986 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:44.666853 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d7640935-1658-4de3-8a67-90c280d55986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:44.725684 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1092/2199] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:44.740243 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e963970-e722-4d93-8f69-680d2cfffc1e None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:44.741941 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-9e963970-e722-4d93-8f69-680d2cfffc1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:44.752735 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7640935-1658-4de3-8a67-90c280d55986 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:44.804769 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e963970-e722-4d93-8f69-680d2cfffc1e None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:44.808658 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d036023-52b8-40ed-8f0d-f22183997c28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:44.809326 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d036023-52b8-40ed-8f0d-f22183997c28 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:44.809605 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d036023-52b8-40ed-8f0d-f22183997c28 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:44.809880 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d036023-52b8-40ed-8f0d-f22183997c28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:44.817702 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa22cf9-8e4e-459f-8318-3da7fb988b85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:44.818363 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa22cf9-8e4e-459f-8318-3da7fb988b85 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:44.818742 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa22cf9-8e4e-459f-8318-3da7fb988b85 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:44.818913 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa22cf9-8e4e-459f-8318-3da7fb988b85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:44.824608 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d036023-52b8-40ed-8f0d-f22183997c28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:44.828730 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d036023-52b8-40ed-8f0d-f22183997c28 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:44.832364 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa22cf9-8e4e-459f-8318-3da7fb988b85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:44.834409 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa22cf9-8e4e-459f-8318-3da7fb988b85 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:44.846834 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1108/2200] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:12:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:12:44.854239 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1093/2201] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:12:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:12:45.364266 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa22cf9-8e4e-459f-8318-3da7fb988b85 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:45.366716 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-5aa22cf9-8e4e-459f-8318-3da7fb988b85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:45.425580 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d036023-52b8-40ed-8f0d-f22183997c28 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:45.427584 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-5d036023-52b8-40ed-8f0d-f22183997c28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:45.476048 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d036023-52b8-40ed-8f0d-f22183997c28 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:45.480154 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5df3220-39b4-463e-b7dc-42cdb82c6888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:45.481195 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df3220-39b4-463e-b7dc-42cdb82c6888 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:45.481635 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df3220-39b4-463e-b7dc-42cdb82c6888 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:45.482050 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df3220-39b4-463e-b7dc-42cdb82c6888 admin admin] PATH_INFO: `/v3/projects/313d5b39fe10417993b28718eb6e6f7a` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:45.482846 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa22cf9-8e4e-459f-8318-3da7fb988b85 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:45.484264 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5df3220-39b4-463e-b7dc-42cdb82c6888 admin admin] RBAC: Authorizing `identity:delete_project(project_id=313d5b39fe10417993b28718eb6e6f7a)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:45.486710 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5df3220-39b4-463e-b7dc-42cdb82c6888 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:45.489438 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af16d34-e305-403f-8f00-4840f9e1ba70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:45.490117 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af16d34-e305-403f-8f00-4840f9e1ba70 service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:45.490404 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af16d34-e305-403f-8f00-4840f9e1ba70 service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:45.490690 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af16d34-e305-403f-8f00-4840f9e1ba70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:45.492547 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-4af16d34-e305-403f-8f00-4840f9e1ba70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:45.554878 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af16d34-e305-403f-8f00-4840f9e1ba70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:45.556662 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af16d34-e305-403f-8f00-4840f9e1ba70 service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:45.567154 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1109/2202] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:12:45 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:12:45.596590 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af16d34-e305-403f-8f00-4840f9e1ba70 service nova] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:45.602209 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-4af16d34-e305-403f-8f00-4840f9e1ba70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:45.639208 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af16d34-e305-403f-8f00-4840f9e1ba70 service nova] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:45.650168 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b5df3220-39b4-463e-b7dc-42cdb82c6888 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '313d5b39fe10417993b28718eb6e6f7a', 'request_id': 'req-b5df3220-39b4-463e-b7dc-42cdb82c6888'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:45.657468 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b5df3220-39b4-463e-b7dc-42cdb82c6888 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '313d5b39fe10417993b28718eb6e6f7a', 'request_id': 'req-b5df3220-39b4-463e-b7dc-42cdb82c6888'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:45.665508 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b5df3220-39b4-463e-b7dc-42cdb82c6888 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '313d5b39fe10417993b28718eb6e6f7a', 'request_id': 'req-b5df3220-39b4-463e-b7dc-42cdb82c6888'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:45.729038 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d23924-ffe6-4621-968d-43114627794b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:45.730115 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d23924-ffe6-4621-968d-43114627794b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:45.730552 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d23924-ffe6-4621-968d-43114627794b admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:45.731084 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d23924-ffe6-4621-968d-43114627794b admin admin] PATH_INFO: `/v3/projects/48bf82bdace04c2f93e8c18a0e12626b` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:45.732480 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d23924-ffe6-4621-968d-43114627794b admin admin] RBAC: Authorizing `identity:delete_project(project_id=48bf82bdace04c2f93e8c18a0e12626b)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:45.734972 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d23924-ffe6-4621-968d-43114627794b admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:45.744909 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b5df3220-39b4-463e-b7dc-42cdb82c6888 admin admin] The token cache is being invalidate because project 313d5b39fe10417993b28718eb6e6f7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:12:45.747922 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b5df3220-39b4-463e-b7dc-42cdb82c6888 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:45.749126 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b5df3220-39b4-463e-b7dc-42cdb82c6888 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:45.753064 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1094/2203] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:12:45 2022] DELETE /identity/v3/projects/313d5b39fe10417993b28718eb6e6f7a => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:45.757687 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5df3220-39b4-463e-b7dc-42cdb82c6888 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:45.759376 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b5df3220-39b4-463e-b7dc-42cdb82c6888 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:45.789204 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5df3220-39b4-463e-b7dc-42cdb82c6888 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:45.793682 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844a6907-6d19-4d20-9e25-69229296bb8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:45.794614 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a6907-6d19-4d20-9e25-69229296bb8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:45.794845 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a6907-6d19-4d20-9e25-69229296bb8a admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:45.795287 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a6907-6d19-4d20-9e25-69229296bb8a admin admin] PATH_INFO: `/v3/users/a02e6c5c0e894928b389b6e0136be249` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:45.796768 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844a6907-6d19-4d20-9e25-69229296bb8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a02e6c5c0e894928b389b6e0136be249)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:45.798852 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844a6907-6d19-4d20-9e25-69229296bb8a admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:45.899336 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-13d23924-ffe6-4621-968d-43114627794b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48bf82bdace04c2f93e8c18a0e12626b', 'request_id': 'req-13d23924-ffe6-4621-968d-43114627794b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:45.906612 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-13d23924-ffe6-4621-968d-43114627794b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48bf82bdace04c2f93e8c18a0e12626b', 'request_id': 'req-13d23924-ffe6-4621-968d-43114627794b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:46.006757 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-844a6907-6d19-4d20-9e25-69229296bb8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a02e6c5c0e894928b389b6e0136be249'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:46.014078 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-844a6907-6d19-4d20-9e25-69229296bb8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a02e6c5c0e894928b389b6e0136be249'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:46.014751 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-844a6907-6d19-4d20-9e25-69229296bb8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a02e6c5c0e894928b389b6e0136be249'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:46.018098 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-13d23924-ffe6-4621-968d-43114627794b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48bf82bdace04c2f93e8c18a0e12626b', 'request_id': 'req-13d23924-ffe6-4621-968d-43114627794b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:46.029838 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-13d23924-ffe6-4621-968d-43114627794b admin admin] The token cache is being invalidate because project 48bf82bdace04c2f93e8c18a0e12626b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:12:46.030134 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-13d23924-ffe6-4621-968d-43114627794b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:46.031558 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-13d23924-ffe6-4621-968d-43114627794b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:46.033500 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1110/2204] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:12:45 2022] DELETE /identity/v3/projects/48bf82bdace04c2f93e8c18a0e12626b => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:12:46.038495 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d23924-ffe6-4621-968d-43114627794b admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:46.039923 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-13d23924-ffe6-4621-968d-43114627794b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:46.095418 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-844a6907-6d19-4d20-9e25-69229296bb8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a02e6c5c0e894928b389b6e0136be249'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:46.106593 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d23924-ffe6-4621-968d-43114627794b admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:46.108144 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-844a6907-6d19-4d20-9e25-69229296bb8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a02e6c5c0e894928b389b6e0136be249'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:46.112489 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545a38c6-88d7-47fe-8f49-9b3aa0dd9623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:46.113350 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a38c6-88d7-47fe-8f49-9b3aa0dd9623 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:46.113610 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a38c6-88d7-47fe-8f49-9b3aa0dd9623 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:46.113890 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a38c6-88d7-47fe-8f49-9b3aa0dd9623 admin admin] PATH_INFO: `/v3/users/d4227805684e44988f9ebbe14e529a53` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:46.115145 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545a38c6-88d7-47fe-8f49-9b3aa0dd9623 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4227805684e44988f9ebbe14e529a53)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:46.116160 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1095/2205] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:12:45 2022] DELETE /identity/v3/users/a02e6c5c0e894928b389b6e0136be249 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:46.117222 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545a38c6-88d7-47fe-8f49-9b3aa0dd9623 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:46.338381 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-545a38c6-88d7-47fe-8f49-9b3aa0dd9623 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4227805684e44988f9ebbe14e529a53'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:46.352168 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-545a38c6-88d7-47fe-8f49-9b3aa0dd9623 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4227805684e44988f9ebbe14e529a53'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:46.360021 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-545a38c6-88d7-47fe-8f49-9b3aa0dd9623 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4227805684e44988f9ebbe14e529a53'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:46.476630 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-545a38c6-88d7-47fe-8f49-9b3aa0dd9623 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4227805684e44988f9ebbe14e529a53'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:46.477708 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-545a38c6-88d7-47fe-8f49-9b3aa0dd9623 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4227805684e44988f9ebbe14e529a53'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:46.489773 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1111/2206] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:12:46 2022] DELETE /identity/v3/users/d4227805684e44988f9ebbe14e529a53 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:12:46.577161 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2788478-b7ed-4113-a561-b91bacc489b2 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:46.577776 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2788478-b7ed-4113-a561-b91bacc489b2 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:46.578352 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2788478-b7ed-4113-a561-b91bacc489b2 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:46.579883 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1096/2207] 10.222.0.52 () {54 vars in 912 bytes} [Sat May 14 21:12:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:12:46.586029 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545a38c6-88d7-47fe-8f49-9b3aa0dd9623 admin admin] Authenticating service token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 14 21:12:46.587579 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-545a38c6-88d7-47fe-8f49-9b3aa0dd9623 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:46.683417 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545a38c6-88d7-47fe-8f49-9b3aa0dd9623 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:46.685102 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-545a38c6-88d7-47fe-8f49-9b3aa0dd9623 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:46.721805 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2788478-b7ed-4113-a561-b91bacc489b2 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:46.724888 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e2788478-b7ed-4113-a561-b91bacc489b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:46.785187 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545a38c6-88d7-47fe-8f49-9b3aa0dd9623 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:46.790954 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b556f96-67c0-4933-90d1-967c8dfb472f tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09800a8572864b748da9fc581ea97e44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782f075c7cc0430f85d614dc49b230c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:46.792015 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b556f96-67c0-4933-90d1-967c8dfb472f tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:46.792303 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b556f96-67c0-4933-90d1-967c8dfb472f tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:46.792825 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b556f96-67c0-4933-90d1-967c8dfb472f tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] PATH_INFO: `/v3/projects/bc82fc4cb79444acbdf29af78e302e6a` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:46.793800 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b556f96-67c0-4933-90d1-967c8dfb472f tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] RBAC: Authorizing `identity:get_project(project_id=bc82fc4cb79444acbdf29af78e302e6a)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:46.796271 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b556f96-67c0-4933-90d1-967c8dfb472f tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:46.802875 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1112/2208] 10.222.0.52 () {58 vars in 1443 bytes} [Sat May 14 21:12:46 2022] GET /identity/v3/projects/bc82fc4cb79444acbdf29af78e302e6a => generated 395 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:12:46.818224 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2788478-b7ed-4113-a561-b91bacc489b2 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:46.822638 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056390b6-40e3-49cc-ae5f-61804727dc88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:46.823553 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056390b6-40e3-49cc-ae5f-61804727dc88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:46.823835 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056390b6-40e3-49cc-ae5f-61804727dc88 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:46.824103 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056390b6-40e3-49cc-ae5f-61804727dc88 admin admin] PATH_INFO: `/v3/projects/a501722ff503426bbca34fbbcc48cac5` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:46.825494 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056390b6-40e3-49cc-ae5f-61804727dc88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a501722ff503426bbca34fbbcc48cac5)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:46.828725 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056390b6-40e3-49cc-ae5f-61804727dc88 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:47.007179 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-056390b6-40e3-49cc-ae5f-61804727dc88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a501722ff503426bbca34fbbcc48cac5', 'request_id': 'req-056390b6-40e3-49cc-ae5f-61804727dc88'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:47.013009 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-056390b6-40e3-49cc-ae5f-61804727dc88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a501722ff503426bbca34fbbcc48cac5', 'request_id': 'req-056390b6-40e3-49cc-ae5f-61804727dc88'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:47.020479 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-056390b6-40e3-49cc-ae5f-61804727dc88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a501722ff503426bbca34fbbcc48cac5', 'request_id': 'req-056390b6-40e3-49cc-ae5f-61804727dc88'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:47.122001 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b556f96-67c0-4933-90d1-967c8dfb472f tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:47.122001 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-9b556f96-67c0-4933-90d1-967c8dfb472f tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:47.147177 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b556f96-67c0-4933-90d1-967c8dfb472f tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:47.152213 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-056390b6-40e3-49cc-ae5f-61804727dc88 admin admin] The token cache is being invalidate because project a501722ff503426bbca34fbbcc48cac5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:12:47.152726 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-056390b6-40e3-49cc-ae5f-61804727dc88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:47.153606 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-056390b6-40e3-49cc-ae5f-61804727dc88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:47.166873 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1097/2209] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:12:46 2022] DELETE /identity/v3/projects/a501722ff503426bbca34fbbcc48cac5 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:47.166873 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e948c-9977-4e72-8fab-fada8024d6a0 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:47.166873 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e948c-9977-4e72-8fab-fada8024d6a0 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:47.166873 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e948c-9977-4e72-8fab-fada8024d6a0 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:47.166873 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1098/2210] 10.222.0.52 () {54 vars in 912 bytes} [Sat May 14 21:12:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:12:47.174057 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4531f-b38c-4e66-9bce-6cb6e9e70e41 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:47.174415 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4531f-b38c-4e66-9bce-6cb6e9e70e41 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:47.174779 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4531f-b38c-4e66-9bce-6cb6e9e70e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:47.196780 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-45d4531f-b38c-4e66-9bce-6cb6e9e70e41 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:47.198461 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-45d4531f-b38c-4e66-9bce-6cb6e9e70e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:47.221468 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f34666-47a5-48e6-bf0a-b652746d6494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:47.222350 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f34666-47a5-48e6-bf0a-b652746d6494 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:47.222638 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f34666-47a5-48e6-bf0a-b652746d6494 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:47.222914 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f34666-47a5-48e6-bf0a-b652746d6494 admin admin] PATH_INFO: `/v3/projects/a3ef417f52a54c0eaabb9b87ae84b8ac` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:47.224327 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f34666-47a5-48e6-bf0a-b652746d6494 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3ef417f52a54c0eaabb9b87ae84b8ac)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:47.226264 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f34666-47a5-48e6-bf0a-b652746d6494 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:47.261889 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1099/2211] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:47.264531 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d4531f-b38c-4e66-9bce-6cb6e9e70e41 None None] Authenticating service token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 14 21:12:47.266268 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-45d4531f-b38c-4e66-9bce-6cb6e9e70e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:47.339747 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d4531f-b38c-4e66-9bce-6cb6e9e70e41 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:47.340982 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-45d4531f-b38c-4e66-9bce-6cb6e9e70e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:47.361589 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f9f34666-47a5-48e6-bf0a-b652746d6494 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3ef417f52a54c0eaabb9b87ae84b8ac', 'request_id': 'req-f9f34666-47a5-48e6-bf0a-b652746d6494'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:47.368408 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f9f34666-47a5-48e6-bf0a-b652746d6494 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3ef417f52a54c0eaabb9b87ae84b8ac', 'request_id': 'req-f9f34666-47a5-48e6-bf0a-b652746d6494'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:47.413249 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d4531f-b38c-4e66-9bce-6cb6e9e70e41 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:47.443116 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f9f34666-47a5-48e6-bf0a-b652746d6494 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3ef417f52a54c0eaabb9b87ae84b8ac', 'request_id': 'req-f9f34666-47a5-48e6-bf0a-b652746d6494'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:47.455672 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f9f34666-47a5-48e6-bf0a-b652746d6494 admin admin] The token cache is being invalidate because project a3ef417f52a54c0eaabb9b87ae84b8ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:12:47.455889 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f9f34666-47a5-48e6-bf0a-b652746d6494 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:47.456541 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f9f34666-47a5-48e6-bf0a-b652746d6494 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:47.458315 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1113/2212] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:12:47 2022] DELETE /identity/v3/projects/a3ef417f52a54c0eaabb9b87ae84b8ac => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:47.459576 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd44e6d-4b0f-43dd-9861-5ddad3808fa4 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:47.459872 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd44e6d-4b0f-43dd-9861-5ddad3808fa4 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:47.460142 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd44e6d-4b0f-43dd-9861-5ddad3808fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:47.469484 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7659e9-fa39-4465-bfc0-f862152a0c41 tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09800a8572864b748da9fc581ea97e44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782f075c7cc0430f85d614dc49b230c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:47.470399 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7659e9-fa39-4465-bfc0-f862152a0c41 tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:47.470631 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7659e9-fa39-4465-bfc0-f862152a0c41 tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:47.470912 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7659e9-fa39-4465-bfc0-f862152a0c41 tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] PATH_INFO: `/v3/projects/bc82fc4cb79444acbdf29af78e302e6a` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:47.472132 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7659e9-fa39-4465-bfc0-f862152a0c41 tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] RBAC: Authorizing `identity:get_project(project_id=bc82fc4cb79444acbdf29af78e302e6a)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:47.474218 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7659e9-fa39-4465-bfc0-f862152a0c41 tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:47.476019 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1100/2213] 10.222.0.52 () {58 vars in 1443 bytes} [Sat May 14 21:12:47 2022] GET /identity/v3/projects/bc82fc4cb79444acbdf29af78e302e6a => generated 395 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:12:47.476729 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7659e9-fa39-4465-bfc0-f862152a0c41 tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:47.479004 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-ef7659e9-fa39-4465-bfc0-f862152a0c41 tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:47.479111 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-afd44e6d-4b0f-43dd-9861-5ddad3808fa4 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:47.480181 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-afd44e6d-4b0f-43dd-9861-5ddad3808fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:47.544492 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1114/2214] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:47.545913 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1fb08a-5ac5-4be7-90d7-62586e6dea45 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:47.547423 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1fb08a-5ac5-4be7-90d7-62586e6dea45 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:47.547800 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1fb08a-5ac5-4be7-90d7-62586e6dea45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:47.553462 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7659e9-fa39-4465-bfc0-f862152a0c41 tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:47.559162 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e85f59-40a8-4225-a7cc-102744678c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:47.560444 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e85f59-40a8-4225-a7cc-102744678c7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:47.560731 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e85f59-40a8-4225-a7cc-102744678c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:47.561006 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e85f59-40a8-4225-a7cc-102744678c7a admin admin] PATH_INFO: `/v3/users/d1bee64d3b304c53bf6a9e8fdcfbad56` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:47.562799 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e85f59-40a8-4225-a7cc-102744678c7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1bee64d3b304c53bf6a9e8fdcfbad56)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:47.564958 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e85f59-40a8-4225-a7cc-102744678c7a admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:47.566959 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-5f1fb08a-5ac5-4be7-90d7-62586e6dea45 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:47.568215 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-5f1fb08a-5ac5-4be7-90d7-62586e6dea45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:47.576530 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1115/2215] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:47.578161 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1fb08a-5ac5-4be7-90d7-62586e6dea45 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:47.587873 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1fb08a-5ac5-4be7-90d7-62586e6dea45 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:47.594022 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9816a9-02c3-4ad6-a03d-79ef36383873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:47.594746 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9816a9-02c3-4ad6-a03d-79ef36383873 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:47.595034 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9816a9-02c3-4ad6-a03d-79ef36383873 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:47.595320 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9816a9-02c3-4ad6-a03d-79ef36383873 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:47.596096 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9816a9-02c3-4ad6-a03d-79ef36383873 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:12:47.596439 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9816a9-02c3-4ad6-a03d-79ef36383873 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:47.598083 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9816a9-02c3-4ad6-a03d-79ef36383873 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:47.611441 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1116/2216] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:12:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:12:47.612867 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c23a86-fa21-43c9-bbac-bedf18f79b68 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:47.613254 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c23a86-fa21-43c9-bbac-bedf18f79b68 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:47.613617 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c23a86-fa21-43c9-bbac-bedf18f79b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:47.632426 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-87c23a86-fa21-43c9-bbac-bedf18f79b68 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:47.633627 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-87c23a86-fa21-43c9-bbac-bedf18f79b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:47.641870 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1117/2217] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:47.642711 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c23a86-fa21-43c9-bbac-bedf18f79b68 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:47.654318 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c23a86-fa21-43c9-bbac-bedf18f79b68 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:47.659048 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aea8a7-87ee-4cd7-a069-4f78f8dfb0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:47.659739 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aea8a7-87ee-4cd7-a069-4f78f8dfb0db admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:47.660059 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aea8a7-87ee-4cd7-a069-4f78f8dfb0db admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:47.660518 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aea8a7-87ee-4cd7-a069-4f78f8dfb0db admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:47.661236 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aea8a7-87ee-4cd7-a069-4f78f8dfb0db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:47.663300 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aea8a7-87ee-4cd7-a069-4f78f8dfb0db admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:47.821418 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-80e85f59-40a8-4225-a7cc-102744678c7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1bee64d3b304c53bf6a9e8fdcfbad56'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:47.828928 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-80e85f59-40a8-4225-a7cc-102744678c7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1bee64d3b304c53bf6a9e8fdcfbad56'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:47.829650 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-80e85f59-40a8-4225-a7cc-102744678c7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1bee64d3b304c53bf6a9e8fdcfbad56'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:47.877954 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1118/2218] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:12:47 2022] POST /identity/v3/projects => generated 381 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:12:47.877954 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aea8a7-87ee-4cd7-a069-4f78f8dfb0db admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:47.925128 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-80e85f59-40a8-4225-a7cc-102744678c7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1bee64d3b304c53bf6a9e8fdcfbad56'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:47.941214 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-80e85f59-40a8-4225-a7cc-102744678c7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1bee64d3b304c53bf6a9e8fdcfbad56'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:47.948152 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1101/2219] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:12:47 2022] DELETE /identity/v3/users/d1bee64d3b304c53bf6a9e8fdcfbad56 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:47.948998 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e85f59-40a8-4225-a7cc-102744678c7a admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:47.950422 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-80e85f59-40a8-4225-a7cc-102744678c7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:47.966165 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aea8a7-87ee-4cd7-a069-4f78f8dfb0db admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:48.016508 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e85f59-40a8-4225-a7cc-102744678c7a admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:48.021444 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be98380-b737-4fb0-b5e6-b97012278d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:48.022121 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be98380-b737-4fb0-b5e6-b97012278d03 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:48.022406 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be98380-b737-4fb0-b5e6-b97012278d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:48.022706 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be98380-b737-4fb0-b5e6-b97012278d03 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:48.023390 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be98380-b737-4fb0-b5e6-b97012278d03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:48.024981 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926acb67-4f79-40e2-8fb5-e1f2fd3cf1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:48.025350 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be98380-b737-4fb0-b5e6-b97012278d03 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:48.025638 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926acb67-4f79-40e2-8fb5-e1f2fd3cf1bf admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:48.025927 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926acb67-4f79-40e2-8fb5-e1f2fd3cf1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:48.026204 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926acb67-4f79-40e2-8fb5-e1f2fd3cf1bf admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:48.026922 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926acb67-4f79-40e2-8fb5-e1f2fd3cf1bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:12:48.027259 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926acb67-4f79-40e2-8fb5-e1f2fd3cf1bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:48.028952 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926acb67-4f79-40e2-8fb5-e1f2fd3cf1bf admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:48.040997 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1119/2220] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:12:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:12:48.042424 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96198f-b8f8-420f-9673-e0a34cbd6912 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:48.042714 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96198f-b8f8-420f-9673-e0a34cbd6912 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:48.049137 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96198f-b8f8-420f-9673-e0a34cbd6912 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:48.049137 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1120/2221] 10.222.0.52 () {54 vars in 912 bytes} [Sat May 14 21:12:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:12:48.049874 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5998da10-3f06-40ba-a701-f42973e2c2a3 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:48.050167 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5998da10-3f06-40ba-a701-f42973e2c2a3 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:48.050449 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5998da10-3f06-40ba-a701-f42973e2c2a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:48.067980 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-5998da10-3f06-40ba-a701-f42973e2c2a3 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:48.069187 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-5998da10-3f06-40ba-a701-f42973e2c2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:48.076841 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1121/2222] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:48.080125 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5998da10-3f06-40ba-a701-f42973e2c2a3 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:48.080125 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-5998da10-3f06-40ba-a701-f42973e2c2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:48.090334 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5998da10-3f06-40ba-a701-f42973e2c2a3 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:48.095701 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eb875e-a8d7-4a30-87be-1f11da4e5792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:48.096326 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb875e-a8d7-4a30-87be-1f11da4e5792 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:48.096602 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb875e-a8d7-4a30-87be-1f11da4e5792 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:48.096873 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb875e-a8d7-4a30-87be-1f11da4e5792 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:48.097553 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eb875e-a8d7-4a30-87be-1f11da4e5792 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:48.099457 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eb875e-a8d7-4a30-87be-1f11da4e5792 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:48.114316 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1102/2223] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:12:47 2022] POST /identity/v3/users => generated 291 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:12:48.117945 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be98380-b737-4fb0-b5e6-b97012278d03 admin admin] Authenticating service token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 14 21:12:48.117945 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-9be98380-b737-4fb0-b5e6-b97012278d03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:48.199798 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be98380-b737-4fb0-b5e6-b97012278d03 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:48.203652 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1122/2224] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:12:48 2022] POST /identity/v3/projects => generated 401 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:12:48.203841 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-9be98380-b737-4fb0-b5e6-b97012278d03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:48.203926 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eb875e-a8d7-4a30-87be-1f11da4e5792 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:48.207052 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-09eb875e-a8d7-4a30-87be-1f11da4e5792 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:48.275224 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eb875e-a8d7-4a30-87be-1f11da4e5792 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:48.279006 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede532ff-3b33-46f7-846a-dda3cb923b1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:48.279332 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be98380-b737-4fb0-b5e6-b97012278d03 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:48.279690 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede532ff-3b33-46f7-846a-dda3cb923b1e service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:48.280018 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede532ff-3b33-46f7-846a-dda3cb923b1e service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:48.280245 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede532ff-3b33-46f7-846a-dda3cb923b1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:48.345016 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede532ff-3b33-46f7-846a-dda3cb923b1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:48.346357 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d31ae8-c53e-4f08-95ee-463a45710a18 tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09800a8572864b748da9fc581ea97e44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782f075c7cc0430f85d614dc49b230c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:48.346524 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede532ff-3b33-46f7-846a-dda3cb923b1e service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:48.347237 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d31ae8-c53e-4f08-95ee-463a45710a18 tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:48.347553 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d31ae8-c53e-4f08-95ee-463a45710a18 tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:48.347840 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d31ae8-c53e-4f08-95ee-463a45710a18 tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] PATH_INFO: `/v3/projects/40acab3854134d1e85effc683181971e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:48.349370 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d31ae8-c53e-4f08-95ee-463a45710a18 tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] RBAC: Authorizing `identity:get_project(project_id=40acab3854134d1e85effc683181971e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:48.351458 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d31ae8-c53e-4f08-95ee-463a45710a18 tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:48.353229 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1103/2225] 10.222.0.52 () {58 vars in 1443 bytes} [Sat May 14 21:12:48 2022] GET /identity/v3/projects/40acab3854134d1e85effc683181971e => generated 395 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:12:48.354006 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d31ae8-c53e-4f08-95ee-463a45710a18 tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:48.356652 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1123/2226] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:12:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:12:48.357361 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede532ff-3b33-46f7-846a-dda3cb923b1e service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:48.365902 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d31ae8-c53e-4f08-95ee-463a45710a18 tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:48.368407 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede532ff-3b33-46f7-846a-dda3cb923b1e service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:48.371232 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e66d370-e445-4392-bda4-5de97f797ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:48.371971 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e66d370-e445-4392-bda4-5de97f797ba0 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:48.372257 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e66d370-e445-4392-bda4-5de97f797ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:48.372540 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e66d370-e445-4392-bda4-5de97f797ba0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:48.373268 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e66d370-e445-4392-bda4-5de97f797ba0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:48.374935 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e66d370-e445-4392-bda4-5de97f797ba0 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:48.381507 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c40349-eac4-45d7-b655-7d4d0a3f953e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:48.381507 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c40349-eac4-45d7-b655-7d4d0a3f953e admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:48.381507 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c40349-eac4-45d7-b655-7d4d0a3f953e admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:48.386575 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c40349-eac4-45d7-b655-7d4d0a3f953e admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:48.386575 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c40349-eac4-45d7-b655-7d4d0a3f953e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:48.386575 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c40349-eac4-45d7-b655-7d4d0a3f953e admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:48.394087 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1104/2227] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:12:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:12:48.397003 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e66d370-e445-4392-bda4-5de97f797ba0 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:48.409082 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e66d370-e445-4392-bda4-5de97f797ba0 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:48.415100 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac43ccf0-fa51-47ae-bacc-90ac7fde4669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:48.415886 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43ccf0-fa51-47ae-bacc-90ac7fde4669 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:48.417107 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43ccf0-fa51-47ae-bacc-90ac7fde4669 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:48.417473 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43ccf0-fa51-47ae-bacc-90ac7fde4669 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:48.418687 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac43ccf0-fa51-47ae-bacc-90ac7fde4669 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:48.422354 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac43ccf0-fa51-47ae-bacc-90ac7fde4669 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:48.433574 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1105/2228] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:12:48 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:12:48.438141 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac43ccf0-fa51-47ae-bacc-90ac7fde4669 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:48.448181 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac43ccf0-fa51-47ae-bacc-90ac7fde4669 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:48.454228 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870e7c0e-8879-48a8-9abd-16e8f811f5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:48.455111 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870e7c0e-8879-48a8-9abd-16e8f811f5e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:48.455391 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870e7c0e-8879-48a8-9abd-16e8f811f5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:48.455698 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870e7c0e-8879-48a8-9abd-16e8f811f5e9 admin admin] PATH_INFO: `/v3/projects/73a07b9f377c406280d6c74b0a28cc37/users/b1d2115001714999aee0bf3cae5b8d04/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:48.471356 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870e7c0e-8879-48a8-9abd-16e8f811f5e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73a07b9f377c406280d6c74b0a28cc37, user_id=b1d2115001714999aee0bf3cae5b8d04, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:48.474181 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870e7c0e-8879-48a8-9abd-16e8f811f5e9 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:48.491056 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1124/2229] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:12:48 2022] POST /identity/v3/users => generated 301 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:12:48.492247 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c40349-eac4-45d7-b655-7d4d0a3f953e admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:48.503655 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c40349-eac4-45d7-b655-7d4d0a3f953e admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:48.511151 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ce45b2-7c57-4e24-8879-945f8272742e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:48.512153 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce45b2-7c57-4e24-8879-945f8272742e admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:48.515364 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce45b2-7c57-4e24-8879-945f8272742e admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:48.515364 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce45b2-7c57-4e24-8879-945f8272742e admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:48.515364 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ce45b2-7c57-4e24-8879-945f8272742e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:48.516818 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ce45b2-7c57-4e24-8879-945f8272742e admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:48.533813 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1125/2230] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:12:48 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:12:48.534838 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ce45b2-7c57-4e24-8879-945f8272742e admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:48.550605 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ce45b2-7c57-4e24-8879-945f8272742e admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:48.559351 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bbe555-b94d-4bf4-a33a-e00f7c21a7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:48.560242 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bbe555-b94d-4bf4-a33a-e00f7c21a7eb admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:48.560582 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bbe555-b94d-4bf4-a33a-e00f7c21a7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:48.560865 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bbe555-b94d-4bf4-a33a-e00f7c21a7eb admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:48.561699 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bbe555-b94d-4bf4-a33a-e00f7c21a7eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:48.563655 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bbe555-b94d-4bf4-a33a-e00f7c21a7eb admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:48.569502 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1106/2231] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:12:48 2022] PUT /identity/v3/projects/73a07b9f377c406280d6c74b0a28cc37/users/b1d2115001714999aee0bf3cae5b8d04/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:12:48.570355 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870e7c0e-8879-48a8-9abd-16e8f811f5e9 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:48.576388 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1126/2232] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:12:48 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:12:48.580767 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-870e7c0e-8879-48a8-9abd-16e8f811f5e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:48.583075 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e5d618-5c0a-4607-bfc0-284f668ee47c None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:48.583075 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e5d618-5c0a-4607-bfc0-284f668ee47c None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:48.583075 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e5d618-5c0a-4607-bfc0-284f668ee47c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:48.613093 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-b5e5d618-5c0a-4607-bfc0-284f668ee47c None None] MFA Rules not processed for user `b1d2115001714999aee0bf3cae5b8d04`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:48.614375 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b5e5d618-5c0a-4607-bfc0-284f668ee47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:48.650308 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870e7c0e-8879-48a8-9abd-16e8f811f5e9 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:48.656061 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9002a7d3-164e-4ec1-a0f7-1c0fe762c640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:48.657170 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002a7d3-164e-4ec1-a0f7-1c0fe762c640 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:48.657516 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002a7d3-164e-4ec1-a0f7-1c0fe762c640 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:48.657858 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002a7d3-164e-4ec1-a0f7-1c0fe762c640 admin admin] PATH_INFO: `/v3/users/9539e4b48a0d49959780fae9a39cbce7` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:48.659099 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9002a7d3-164e-4ec1-a0f7-1c0fe762c640 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9539e4b48a0d49959780fae9a39cbce7)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:48.661075 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9002a7d3-164e-4ec1-a0f7-1c0fe762c640 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:48.690113 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1127/2233] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:12:48.691089 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e5d618-5c0a-4607-bfc0-284f668ee47c None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:48.703396 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e5d618-5c0a-4607-bfc0-284f668ee47c None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:48.708429 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808d6ac9-e78f-40f7-bfea-39e600fa7c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:48.709252 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808d6ac9-e78f-40f7-bfea-39e600fa7c5a admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:48.709612 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808d6ac9-e78f-40f7-bfea-39e600fa7c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:48.709923 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808d6ac9-e78f-40f7-bfea-39e600fa7c5a admin admin] PATH_INFO: `/v3/projects/4164536b7ed841c2b88d28b51543a9a2/users/c1bc27ae236b45ba959680d396ce104d/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:48.726052 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808d6ac9-e78f-40f7-bfea-39e600fa7c5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4164536b7ed841c2b88d28b51543a9a2, user_id=c1bc27ae236b45ba959680d396ce104d, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:48.728902 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808d6ac9-e78f-40f7-bfea-39e600fa7c5a admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:48.837405 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1128/2234] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:12:48 2022] PUT /identity/v3/projects/4164536b7ed841c2b88d28b51543a9a2/users/c1bc27ae236b45ba959680d396ce104d/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:48.838234 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808d6ac9-e78f-40f7-bfea-39e600fa7c5a admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:48.839831 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-808d6ac9-e78f-40f7-bfea-39e600fa7c5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:48.857362 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9002a7d3-164e-4ec1-a0f7-1c0fe762c640 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9539e4b48a0d49959780fae9a39cbce7'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:48.864399 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9002a7d3-164e-4ec1-a0f7-1c0fe762c640 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9539e4b48a0d49959780fae9a39cbce7'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:48.865125 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9002a7d3-164e-4ec1-a0f7-1c0fe762c640 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9539e4b48a0d49959780fae9a39cbce7'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:48.903656 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808d6ac9-e78f-40f7-bfea-39e600fa7c5a admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:48.908456 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4254560-bb47-47d0-8972-2323462fd30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:48.909306 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4254560-bb47-47d0-8972-2323462fd30d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:48.909594 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4254560-bb47-47d0-8972-2323462fd30d admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:48.909870 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4254560-bb47-47d0-8972-2323462fd30d admin admin] PATH_INFO: `/v3/projects/fe60a3885a2b45bcbc8a219998420fa4` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:48.911109 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4254560-bb47-47d0-8972-2323462fd30d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe60a3885a2b45bcbc8a219998420fa4)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:48.913067 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4254560-bb47-47d0-8972-2323462fd30d admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:48.940752 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9002a7d3-164e-4ec1-a0f7-1c0fe762c640 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9539e4b48a0d49959780fae9a39cbce7'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:48.954226 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9002a7d3-164e-4ec1-a0f7-1c0fe762c640 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9539e4b48a0d49959780fae9a39cbce7'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:48.960564 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1107/2235] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:12:48 2022] DELETE /identity/v3/users/9539e4b48a0d49959780fae9a39cbce7 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:48.961501 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9002a7d3-164e-4ec1-a0f7-1c0fe762c640 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:48.962876 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-9002a7d3-164e-4ec1-a0f7-1c0fe762c640 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:49.017142 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a4254560-bb47-47d0-8972-2323462fd30d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe60a3885a2b45bcbc8a219998420fa4', 'request_id': 'req-a4254560-bb47-47d0-8972-2323462fd30d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:49.022840 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a4254560-bb47-47d0-8972-2323462fd30d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe60a3885a2b45bcbc8a219998420fa4', 'request_id': 'req-a4254560-bb47-47d0-8972-2323462fd30d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:49.032167 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9002a7d3-164e-4ec1-a0f7-1c0fe762c640 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:49.089397 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3661c45-2a6b-4673-b5be-e48e4399153c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:49.090064 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3661c45-2a6b-4673-b5be-e48e4399153c admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:49.090353 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3661c45-2a6b-4673-b5be-e48e4399153c admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:49.090630 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3661c45-2a6b-4673-b5be-e48e4399153c admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:49.091320 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3661c45-2a6b-4673-b5be-e48e4399153c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:49.093466 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3661c45-2a6b-4673-b5be-e48e4399153c admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:49.140458 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a4254560-bb47-47d0-8972-2323462fd30d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe60a3885a2b45bcbc8a219998420fa4', 'request_id': 'req-a4254560-bb47-47d0-8972-2323462fd30d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:49.151910 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a4254560-bb47-47d0-8972-2323462fd30d admin admin] The token cache is being invalidate because project fe60a3885a2b45bcbc8a219998420fa4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:12:49.152199 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a4254560-bb47-47d0-8972-2323462fd30d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:49.152873 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a4254560-bb47-47d0-8972-2323462fd30d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:49.154442 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1129/2236] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:12:48 2022] DELETE /identity/v3/projects/fe60a3885a2b45bcbc8a219998420fa4 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:49.155782 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd7aa7-10ec-4f00-bcf7-2b5665475227 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:49.156082 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd7aa7-10ec-4f00-bcf7-2b5665475227 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:49.156358 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd7aa7-10ec-4f00-bcf7-2b5665475227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:49.181824 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-97cd7aa7-10ec-4f00-bcf7-2b5665475227 None None] MFA Rules not processed for user `c1bc27ae236b45ba959680d396ce104d`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:49.183189 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-97cd7aa7-10ec-4f00-bcf7-2b5665475227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:49.189433 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1108/2237] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:12:48 2022] POST /identity/v3/projects => generated 381 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:12:49.191384 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3d87b-90cc-4be0-87f1-b994b9b10ba1 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:49.191384 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3d87b-90cc-4be0-87f1-b994b9b10ba1 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:49.191384 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3d87b-90cc-4be0-87f1-b994b9b10ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:49.207860 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-77c3d87b-90cc-4be0-87f1-b994b9b10ba1 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:49.209064 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-77c3d87b-90cc-4be0-87f1-b994b9b10ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:49.248109 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1130/2238] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:49 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:49.248784 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cd7aa7-10ec-4f00-bcf7-2b5665475227 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:49.250691 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-97cd7aa7-10ec-4f00-bcf7-2b5665475227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:49.263978 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cd7aa7-10ec-4f00-bcf7-2b5665475227 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:49.268576 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78731ab1-94fd-4b0f-84e9-f1dd37118d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:49.269324 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1109/2239] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:49.269446 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78731ab1-94fd-4b0f-84e9-f1dd37118d75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:49.269703 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78731ab1-94fd-4b0f-84e9-f1dd37118d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:49.269991 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78731ab1-94fd-4b0f-84e9-f1dd37118d75 admin admin] PATH_INFO: `/v3/users/bb563e92d4814f55bef0f9030ac72398` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:49.270332 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c3d87b-90cc-4be0-87f1-b994b9b10ba1 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:49.271199 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78731ab1-94fd-4b0f-84e9-f1dd37118d75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb563e92d4814f55bef0f9030ac72398)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:49.271726 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-77c3d87b-90cc-4be0-87f1-b994b9b10ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:49.273172 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78731ab1-94fd-4b0f-84e9-f1dd37118d75 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:49.283340 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c3d87b-90cc-4be0-87f1-b994b9b10ba1 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:49.288271 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ff53b2-e5a1-4cd3-98da-3dff812c96bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:49.288944 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff53b2-e5a1-4cd3-98da-3dff812c96bc admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:49.289225 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff53b2-e5a1-4cd3-98da-3dff812c96bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:49.289501 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff53b2-e5a1-4cd3-98da-3dff812c96bc admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:49.290217 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ff53b2-e5a1-4cd3-98da-3dff812c96bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:49.292254 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ff53b2-e5a1-4cd3-98da-3dff812c96bc admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:49.432545 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1110/2240] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:12:49 2022] POST /identity/v3/users => generated 297 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:12:49.435089 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ff53b2-e5a1-4cd3-98da-3dff812c96bc admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:49.435089 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-a4ff53b2-e5a1-4cd3-98da-3dff812c96bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:49.447317 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ff53b2-e5a1-4cd3-98da-3dff812c96bc admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:49.452297 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af055752-3040-40dd-b2a8-3bdecd5fb3d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:49.453178 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af055752-3040-40dd-b2a8-3bdecd5fb3d9 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:49.453647 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af055752-3040-40dd-b2a8-3bdecd5fb3d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:49.453765 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af055752-3040-40dd-b2a8-3bdecd5fb3d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:49.454416 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af055752-3040-40dd-b2a8-3bdecd5fb3d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:49.456377 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af055752-3040-40dd-b2a8-3bdecd5fb3d9 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:49.503808 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-78731ab1-94fd-4b0f-84e9-f1dd37118d75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb563e92d4814f55bef0f9030ac72398'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:49.522423 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-78731ab1-94fd-4b0f-84e9-f1dd37118d75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb563e92d4814f55bef0f9030ac72398'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:49.529207 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-78731ab1-94fd-4b0f-84e9-f1dd37118d75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb563e92d4814f55bef0f9030ac72398'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:49.570739 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1111/2241] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:12:49 2022] POST /identity/v3/projects => generated 403 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:12:49.571609 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af055752-3040-40dd-b2a8-3bdecd5fb3d9 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:49.573275 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-af055752-3040-40dd-b2a8-3bdecd5fb3d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:49.596040 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-78731ab1-94fd-4b0f-84e9-f1dd37118d75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb563e92d4814f55bef0f9030ac72398'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:49.596040 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-78731ab1-94fd-4b0f-84e9-f1dd37118d75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb563e92d4814f55bef0f9030ac72398'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:49.599112 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1131/2242] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:12:49 2022] DELETE /identity/v3/users/bb563e92d4814f55bef0f9030ac72398 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:49.599916 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78731ab1-94fd-4b0f-84e9-f1dd37118d75 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:49.601343 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-78731ab1-94fd-4b0f-84e9-f1dd37118d75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:49.631690 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af055752-3040-40dd-b2a8-3bdecd5fb3d9 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:49.668829 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78731ab1-94fd-4b0f-84e9-f1dd37118d75 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:49.674015 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd395ca-a7fc-4d20-960e-99062175c5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:49.674810 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd395ca-a7fc-4d20-960e-99062175c5cf admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:49.675198 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd395ca-a7fc-4d20-960e-99062175c5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:49.675678 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd395ca-a7fc-4d20-960e-99062175c5cf admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:49.676514 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd395ca-a7fc-4d20-960e-99062175c5cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:49.678375 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd395ca-a7fc-4d20-960e-99062175c5cf admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:49.681255 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7342b25-1e5b-4833-a7b5-751216acfd31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:49.681907 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7342b25-1e5b-4833-a7b5-751216acfd31 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:49.682189 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7342b25-1e5b-4833-a7b5-751216acfd31 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:49.682461 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7342b25-1e5b-4833-a7b5-751216acfd31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:49.684558 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-d7342b25-1e5b-4833-a7b5-751216acfd31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:49.690311 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1132/2243] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:12:49 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:12:49.691428 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd395ca-a7fc-4d20-960e-99062175c5cf admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:49.694671 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-2fd395ca-a7fc-4d20-960e-99062175c5cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:49.701923 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7342b25-1e5b-4833-a7b5-751216acfd31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:49.704616 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7342b25-1e5b-4833-a7b5-751216acfd31 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:49.708855 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd395ca-a7fc-4d20-960e-99062175c5cf admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:49.714275 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9620c1-c15e-4663-bffc-7e42d296ad7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:49.714975 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9620c1-c15e-4663-bffc-7e42d296ad7a admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:49.715253 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9620c1-c15e-4663-bffc-7e42d296ad7a admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:49.715559 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9620c1-c15e-4663-bffc-7e42d296ad7a admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:49.716386 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1112/2244] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:12:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:12:49.716521 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9620c1-c15e-4663-bffc-7e42d296ad7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:49.716964 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7342b25-1e5b-4833-a7b5-751216acfd31 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:49.718268 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9620c1-c15e-4663-bffc-7e42d296ad7a admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:49.728068 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7342b25-1e5b-4833-a7b5-751216acfd31 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:49.733539 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f767f8-99c2-4e93-bb1d-3805a0007a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:49.735164 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f767f8-99c2-4e93-bb1d-3805a0007a65 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:49.735456 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f767f8-99c2-4e93-bb1d-3805a0007a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:49.735767 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f767f8-99c2-4e93-bb1d-3805a0007a65 admin admin] PATH_INFO: `/v3/projects/53ac55b684e64cc8af2b544a99b01fe6/users/aff1fb0bcf7649d59db88d4c3f4d8ac2/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:49.751819 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f767f8-99c2-4e93-bb1d-3805a0007a65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53ac55b684e64cc8af2b544a99b01fe6, user_id=aff1fb0bcf7649d59db88d4c3f4d8ac2, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:49.754512 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f767f8-99c2-4e93-bb1d-3805a0007a65 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:49.850360 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1133/2245] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:12:49 2022] POST /identity/v3/users => generated 308 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:12:49.860041 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9620c1-c15e-4663-bffc-7e42d296ad7a admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:49.870465 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9620c1-c15e-4663-bffc-7e42d296ad7a admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:49.872624 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1113/2246] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:12:49 2022] PUT /identity/v3/projects/53ac55b684e64cc8af2b544a99b01fe6/users/aff1fb0bcf7649d59db88d4c3f4d8ac2/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:49.877136 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f767f8-99c2-4e93-bb1d-3805a0007a65 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:49.968240 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be691918-4359-412a-b4c1-6b3b4e75ee66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:49.969600 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be691918-4359-412a-b4c1-6b3b4e75ee66 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:49.969894 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be691918-4359-412a-b4c1-6b3b4e75ee66 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:49.970184 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be691918-4359-412a-b4c1-6b3b4e75ee66 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:49.970976 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be691918-4359-412a-b4c1-6b3b4e75ee66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:49.971214 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f767f8-99c2-4e93-bb1d-3805a0007a65 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:49.972754 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be691918-4359-412a-b4c1-6b3b4e75ee66 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:49.976509 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a6d9b0-9499-452a-bbd9-7d61c86b14b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:49.977258 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a6d9b0-9499-452a-bbd9-7d61c86b14b4 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:49.977779 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a6d9b0-9499-452a-bbd9-7d61c86b14b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:49.978160 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a6d9b0-9499-452a-bbd9-7d61c86b14b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:49.979155 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a6d9b0-9499-452a-bbd9-7d61c86b14b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:49.981126 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a6d9b0-9499-452a-bbd9-7d61c86b14b4 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:49.988083 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1134/2247] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:12:49 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:12:49.988975 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be691918-4359-412a-b4c1-6b3b4e75ee66 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:49.991932 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-be691918-4359-412a-b4c1-6b3b4e75ee66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:49.999187 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1114/2248] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:12:49 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:12:50.000302 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a6d9b0-9499-452a-bbd9-7d61c86b14b4 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:50.008822 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be691918-4359-412a-b4c1-6b3b4e75ee66 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:50.011340 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a6d9b0-9499-452a-bbd9-7d61c86b14b4 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:50.014669 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0305b782-3568-4e3f-b1e6-7375749eeda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:50.016944 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0305b782-3568-4e3f-b1e6-7375749eeda1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:50.017224 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0305b782-3568-4e3f-b1e6-7375749eeda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:50.017406 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4f0834-e46f-4da9-ae51-e98b48e45e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:50.017518 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0305b782-3568-4e3f-b1e6-7375749eeda1 admin admin] PATH_INFO: `/v3/projects/89ae353dbfc44d8ea8ac03775f0722ac` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:50.018470 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f0834-e46f-4da9-ae51-e98b48e45e3c admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:50.018952 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f0834-e46f-4da9-ae51-e98b48e45e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:50.019079 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0305b782-3568-4e3f-b1e6-7375749eeda1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89ae353dbfc44d8ea8ac03775f0722ac)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:50.019534 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f0834-e46f-4da9-ae51-e98b48e45e3c admin admin] PATH_INFO: `/v3/projects/7dbaf999504b4a958cd359678792edee/users/7a109d9e95f74e48bc49e6ec51dfd754/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:50.021187 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0305b782-3568-4e3f-b1e6-7375749eeda1 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:50.036818 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4f0834-e46f-4da9-ae51-e98b48e45e3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dbaf999504b4a958cd359678792edee, user_id=7a109d9e95f74e48bc49e6ec51dfd754, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:50.039790 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4f0834-e46f-4da9-ae51-e98b48e45e3c admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:50.140850 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1115/2249] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:12:49 2022] PUT /identity/v3/projects/7dbaf999504b4a958cd359678792edee/users/7a109d9e95f74e48bc49e6ec51dfd754/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:50.141745 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4f0834-e46f-4da9-ae51-e98b48e45e3c admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:50.183532 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0305b782-3568-4e3f-b1e6-7375749eeda1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89ae353dbfc44d8ea8ac03775f0722ac', 'request_id': 'req-0305b782-3568-4e3f-b1e6-7375749eeda1'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:50.191105 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0305b782-3568-4e3f-b1e6-7375749eeda1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89ae353dbfc44d8ea8ac03775f0722ac', 'request_id': 'req-0305b782-3568-4e3f-b1e6-7375749eeda1'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:50.223110 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4f0834-e46f-4da9-ae51-e98b48e45e3c admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:50.249050 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0305b782-3568-4e3f-b1e6-7375749eeda1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89ae353dbfc44d8ea8ac03775f0722ac', 'request_id': 'req-0305b782-3568-4e3f-b1e6-7375749eeda1'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:50.262562 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0305b782-3568-4e3f-b1e6-7375749eeda1 admin admin] The token cache is being invalidate because project 89ae353dbfc44d8ea8ac03775f0722ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:12:50.262859 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0305b782-3568-4e3f-b1e6-7375749eeda1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:50.263899 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0305b782-3568-4e3f-b1e6-7375749eeda1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:50.267077 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1135/2250] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:12:49 2022] DELETE /identity/v3/projects/89ae353dbfc44d8ea8ac03775f0722ac => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:50.267822 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0305b782-3568-4e3f-b1e6-7375749eeda1 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:50.269155 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-0305b782-3568-4e3f-b1e6-7375749eeda1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:50.306303 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c795d55e-93e1-4f44-86f7-bfc522398873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:50.307285 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795d55e-93e1-4f44-86f7-bfc522398873 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:50.307673 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795d55e-93e1-4f44-86f7-bfc522398873 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:50.308017 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795d55e-93e1-4f44-86f7-bfc522398873 admin admin] PATH_INFO: `/v3/projects/53ac55b684e64cc8af2b544a99b01fe6/users/aff1fb0bcf7649d59db88d4c3f4d8ac2/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:50.310066 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c795d55e-93e1-4f44-86f7-bfc522398873 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53ac55b684e64cc8af2b544a99b01fe6, user_id=aff1fb0bcf7649d59db88d4c3f4d8ac2, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:50.313461 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c795d55e-93e1-4f44-86f7-bfc522398873 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:50.332887 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1116/2251] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:12:50 2022] PUT /identity/v3/projects/53ac55b684e64cc8af2b544a99b01fe6/users/aff1fb0bcf7649d59db88d4c3f4d8ac2/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:50.332887 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c795d55e-93e1-4f44-86f7-bfc522398873 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:50.334722 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c795d55e-93e1-4f44-86f7-bfc522398873 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:50.352226 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0305b782-3568-4e3f-b1e6-7375749eeda1 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:50.411602 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c795d55e-93e1-4f44-86f7-bfc522398873 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:50.413555 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f4057-1aa0-4d0c-8a3e-bf1b8038e4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:50.414336 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f4057-1aa0-4d0c-8a3e-bf1b8038e4ad admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:50.414628 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f4057-1aa0-4d0c-8a3e-bf1b8038e4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:50.414911 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f4057-1aa0-4d0c-8a3e-bf1b8038e4ad admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:50.415727 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117f4057-1aa0-4d0c-8a3e-bf1b8038e4ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:50.417352 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117f4057-1aa0-4d0c-8a3e-bf1b8038e4ad admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:50.418565 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a3fa3-46f2-4762-b703-5cbff01481e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:50.419509 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a3fa3-46f2-4762-b703-5cbff01481e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:50.419797 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a3fa3-46f2-4762-b703-5cbff01481e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:50.420076 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a3fa3-46f2-4762-b703-5cbff01481e4 admin admin] PATH_INFO: `/v3/projects/bc82fc4cb79444acbdf29af78e302e6a` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:50.421610 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8a3fa3-46f2-4762-b703-5cbff01481e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc82fc4cb79444acbdf29af78e302e6a)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:50.424024 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8a3fa3-46f2-4762-b703-5cbff01481e4 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:50.432039 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1136/2252] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:12:50 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:12:50.432039 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79212add-d06c-4d30-8d80-67f82f62b50b None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:50.432039 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79212add-d06c-4d30-8d80-67f82f62b50b None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:50.432338 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79212add-d06c-4d30-8d80-67f82f62b50b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:50.451655 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-79212add-d06c-4d30-8d80-67f82f62b50b None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:50.453925 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-79212add-d06c-4d30-8d80-67f82f62b50b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:50.462751 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1137/2253] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:50.464039 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fdfa86-ab44-4f38-a907-ba617ba9323c None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:50.464448 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fdfa86-ab44-4f38-a907-ba617ba9323c None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:50.464824 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fdfa86-ab44-4f38-a907-ba617ba9323c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:50.495258 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-b0fdfa86-ab44-4f38-a907-ba617ba9323c None None] MFA Rules not processed for user `aff1fb0bcf7649d59db88d4c3f4d8ac2`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:50.497417 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b0fdfa86-ab44-4f38-a907-ba617ba9323c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:50.547812 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-8c8a3fa3-46f2-4762-b703-5cbff01481e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc82fc4cb79444acbdf29af78e302e6a', 'request_id': 'req-8c8a3fa3-46f2-4762-b703-5cbff01481e4'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:50.553717 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-8c8a3fa3-46f2-4762-b703-5cbff01481e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc82fc4cb79444acbdf29af78e302e6a', 'request_id': 'req-8c8a3fa3-46f2-4762-b703-5cbff01481e4'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:50.563179 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-8c8a3fa3-46f2-4762-b703-5cbff01481e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc82fc4cb79444acbdf29af78e302e6a', 'request_id': 'req-8c8a3fa3-46f2-4762-b703-5cbff01481e4'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:50.590823 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1138/2254] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:50 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:50.591687 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fdfa86-ab44-4f38-a907-ba617ba9323c None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:50.602957 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fdfa86-ab44-4f38-a907-ba617ba9323c None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:50.661085 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7470a9-2e67-4c96-86b6-e5772f3a2de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:50.662033 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7470a9-2e67-4c96-86b6-e5772f3a2de6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:50.662326 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7470a9-2e67-4c96-86b6-e5772f3a2de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:50.662606 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7470a9-2e67-4c96-86b6-e5772f3a2de6 admin admin] PATH_INFO: `/v3/projects/7dbaf999504b4a958cd359678792edee/users/7a109d9e95f74e48bc49e6ec51dfd754/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:50.664992 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7470a9-2e67-4c96-86b6-e5772f3a2de6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dbaf999504b4a958cd359678792edee, user_id=7a109d9e95f74e48bc49e6ec51dfd754, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:50.667718 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7470a9-2e67-4c96-86b6-e5772f3a2de6 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:50.678385 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1139/2255] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:12:50 2022] PUT /identity/v3/projects/7dbaf999504b4a958cd359678792edee/users/7a109d9e95f74e48bc49e6ec51dfd754/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:50.679710 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7455d5-55bf-41f0-a3e7-f14ebbf1f5d2 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:50.679993 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7455d5-55bf-41f0-a3e7-f14ebbf1f5d2 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:50.680266 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7455d5-55bf-41f0-a3e7-f14ebbf1f5d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:50.699109 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-cd7455d5-55bf-41f0-a3e7-f14ebbf1f5d2 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:50.700351 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-cd7455d5-55bf-41f0-a3e7-f14ebbf1f5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:50.711606 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-8c8a3fa3-46f2-4762-b703-5cbff01481e4 admin admin] The token cache is being invalidate because project bc82fc4cb79444acbdf29af78e302e6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:12:50.711905 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-8c8a3fa3-46f2-4762-b703-5cbff01481e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:50.712559 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-8c8a3fa3-46f2-4762-b703-5cbff01481e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:50.714177 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1117/2256] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:12:50 2022] DELETE /identity/v3/projects/bc82fc4cb79444acbdf29af78e302e6a => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:50.714994 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a3fa3-46f2-4762-b703-5cbff01481e4 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:50.716367 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8c8a3fa3-46f2-4762-b703-5cbff01481e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:50.760329 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1140/2257] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:50.761620 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def4c8a-4d5d-416b-a093-b7848f75dfdb None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:50.761903 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def4c8a-4d5d-416b-a093-b7848f75dfdb None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:50.762178 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def4c8a-4d5d-416b-a093-b7848f75dfdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:50.788333 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-0def4c8a-4d5d-416b-a093-b7848f75dfdb None None] MFA Rules not processed for user `7a109d9e95f74e48bc49e6ec51dfd754`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:50.789513 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-0def4c8a-4d5d-416b-a093-b7848f75dfdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:50.793951 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a3fa3-46f2-4762-b703-5cbff01481e4 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:50.855152 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1141/2258] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:50 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:50.860606 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0def4c8a-4d5d-416b-a093-b7848f75dfdb None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:50.860745 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b214bb-ed5a-41fa-bc04-9d9261f68a83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:50.860849 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-0def4c8a-4d5d-416b-a093-b7848f75dfdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:50.860925 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b214bb-ed5a-41fa-bc04-9d9261f68a83 service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:50.860925 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b214bb-ed5a-41fa-bc04-9d9261f68a83 service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:50.860925 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b214bb-ed5a-41fa-bc04-9d9261f68a83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:50.860925 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-06b214bb-ed5a-41fa-bc04-9d9261f68a83 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:50.871667 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0def4c8a-4d5d-416b-a093-b7848f75dfdb None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:50.877063 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2cacde-0487-4143-a181-49c603b3a935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:50.877921 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2cacde-0487-4143-a181-49c603b3a935 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:50.878206 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2cacde-0487-4143-a181-49c603b3a935 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:50.878481 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2cacde-0487-4143-a181-49c603b3a935 admin admin] PATH_INFO: `/v3/users/09800a8572864b748da9fc581ea97e44` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:50.879703 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2cacde-0487-4143-a181-49c603b3a935 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09800a8572864b748da9fc581ea97e44)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:50.881896 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2cacde-0487-4143-a181-49c603b3a935 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:50.923468 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b214bb-ed5a-41fa-bc04-9d9261f68a83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:50.925025 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b214bb-ed5a-41fa-bc04-9d9261f68a83 service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:50.934852 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1118/2259] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:12:50 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:12:50.935798 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b214bb-ed5a-41fa-bc04-9d9261f68a83 service nova] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:50.946306 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b214bb-ed5a-41fa-bc04-9d9261f68a83 service nova] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:50.951927 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cd6307-ca1d-40a0-aa60-d6b59ce9ac03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:50.953149 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd6307-ca1d-40a0-aa60-d6b59ce9ac03 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:50.953467 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd6307-ca1d-40a0-aa60-d6b59ce9ac03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:50.953734 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd6307-ca1d-40a0-aa60-d6b59ce9ac03 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:50.954407 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cd6307-ca1d-40a0-aa60-d6b59ce9ac03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:12:50.954716 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cd6307-ca1d-40a0-aa60-d6b59ce9ac03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:50.956345 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cd6307-ca1d-40a0-aa60-d6b59ce9ac03 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:50.967910 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1119/2260] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:12:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:12:50.968868 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cd6307-ca1d-40a0-aa60-d6b59ce9ac03 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:50.970519 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c2cd6307-ca1d-40a0-aa60-d6b59ce9ac03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:50.986700 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cd6307-ca1d-40a0-aa60-d6b59ce9ac03 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:50.993226 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64eab9e-c213-4424-8a2c-5acec6ceb28e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:50.993845 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64eab9e-c213-4424-8a2c-5acec6ceb28e service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:50.994202 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64eab9e-c213-4424-8a2c-5acec6ceb28e service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:50.994399 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64eab9e-c213-4424-8a2c-5acec6ceb28e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:51.003702 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64eab9e-c213-4424-8a2c-5acec6ceb28e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:51.005364 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64eab9e-c213-4424-8a2c-5acec6ceb28e service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:51.015834 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1120/2261] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:12:50 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:12:51.016602 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64eab9e-c213-4424-8a2c-5acec6ceb28e service nova] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:51.026580 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64eab9e-c213-4424-8a2c-5acec6ceb28e service nova] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:51.032218 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c367d696-b5a9-4e90-beb4-ba9bdb5124e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:51.032873 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c367d696-b5a9-4e90-beb4-ba9bdb5124e0 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:51.033268 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c367d696-b5a9-4e90-beb4-ba9bdb5124e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:51.033534 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c367d696-b5a9-4e90-beb4-ba9bdb5124e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:51.034212 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c367d696-b5a9-4e90-beb4-ba9bdb5124e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:51.036226 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c367d696-b5a9-4e90-beb4-ba9bdb5124e0 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:51.069364 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6c2cacde-0487-4143-a181-49c603b3a935 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09800a8572864b748da9fc581ea97e44'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:51.082064 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6c2cacde-0487-4143-a181-49c603b3a935 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09800a8572864b748da9fc581ea97e44'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:51.089638 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6c2cacde-0487-4143-a181-49c603b3a935 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09800a8572864b748da9fc581ea97e44'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:51.112582 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1121/2262] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:12:51 2022] POST /identity/v3/projects => generated 411 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:12:51.112582 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c367d696-b5a9-4e90-beb4-ba9bdb5124e0 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:51.180487 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6c2cacde-0487-4143-a181-49c603b3a935 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09800a8572864b748da9fc581ea97e44'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:51.188465 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6c2cacde-0487-4143-a181-49c603b3a935 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09800a8572864b748da9fc581ea97e44'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:51.191212 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1142/2263] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:12:50 2022] DELETE /identity/v3/users/09800a8572864b748da9fc581ea97e44 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:51.231402 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c367d696-b5a9-4e90-beb4-ba9bdb5124e0 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:51.339278 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a785b85e-1bb2-4135-b1dc-b60bef125abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:51.340563 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a785b85e-1bb2-4135-b1dc-b60bef125abe admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:51.341078 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a785b85e-1bb2-4135-b1dc-b60bef125abe admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:51.342183 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a785b85e-1bb2-4135-b1dc-b60bef125abe admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:51.345111 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a785b85e-1bb2-4135-b1dc-b60bef125abe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:51.347982 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a785b85e-1bb2-4135-b1dc-b60bef125abe admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:51.472035 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1122/2264] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:12:51 2022] POST /identity/v3/users => generated 306 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:12:51.478616 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2cacde-0487-4143-a181-49c603b3a935 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:51.479717 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-6c2cacde-0487-4143-a181-49c603b3a935 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:51.503144 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2cacde-0487-4143-a181-49c603b3a935 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:51.508842 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b544e34a-8059-4cd0-a761-8d551aa6107f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:51.509673 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b544e34a-8059-4cd0-a761-8d551aa6107f admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:51.509957 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b544e34a-8059-4cd0-a761-8d551aa6107f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:51.510376 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b544e34a-8059-4cd0-a761-8d551aa6107f admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:51.511267 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b544e34a-8059-4cd0-a761-8d551aa6107f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:51.513867 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b544e34a-8059-4cd0-a761-8d551aa6107f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:51.529853 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a785b85e-1bb2-4135-b1dc-b60bef125abe admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:51.533972 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-a785b85e-1bb2-4135-b1dc-b60bef125abe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:51.547904 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1143/2265] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:12:51 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:12:51.552049 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a785b85e-1bb2-4135-b1dc-b60bef125abe admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:51.553596 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b544e34a-8059-4cd0-a761-8d551aa6107f admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:51.556708 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b544e34a-8059-4cd0-a761-8d551aa6107f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:51.557566 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb1eb7b-7a67-4b02-bf72-5a651cd8bd44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:51.558714 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb1eb7b-7a67-4b02-bf72-5a651cd8bd44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:51.559004 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb1eb7b-7a67-4b02-bf72-5a651cd8bd44 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:51.559329 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb1eb7b-7a67-4b02-bf72-5a651cd8bd44 admin admin] PATH_INFO: `/v3/users/b1d2115001714999aee0bf3cae5b8d04` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:51.560643 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb1eb7b-7a67-4b02-bf72-5a651cd8bd44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1d2115001714999aee0bf3cae5b8d04)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:51.562793 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb1eb7b-7a67-4b02-bf72-5a651cd8bd44 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:51.649304 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b544e34a-8059-4cd0-a761-8d551aa6107f admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:51.654801 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e4b649-b4d7-4e93-ac25-5d33574da2da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:51.655553 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e4b649-b4d7-4e93-ac25-5d33574da2da service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:51.655959 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e4b649-b4d7-4e93-ac25-5d33574da2da service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:51.656396 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e4b649-b4d7-4e93-ac25-5d33574da2da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:51.658165 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-37e4b649-b4d7-4e93-ac25-5d33574da2da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:51.730487 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e4b649-b4d7-4e93-ac25-5d33574da2da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:51.742306 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e4b649-b4d7-4e93-ac25-5d33574da2da service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:51.753199 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1144/2266] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:12:51 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:12:51.755620 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e4b649-b4d7-4e93-ac25-5d33574da2da service nova] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:51.778702 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e4b649-b4d7-4e93-ac25-5d33574da2da service nova] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:51.779009 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-6fb1eb7b-7a67-4b02-bf72-5a651cd8bd44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1d2115001714999aee0bf3cae5b8d04'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:51.786525 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78f5e02-c7ae-4054-9eda-53f069666510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:51.787800 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f5e02-c7ae-4054-9eda-53f069666510 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:51.787800 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f5e02-c7ae-4054-9eda-53f069666510 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:51.787962 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-6fb1eb7b-7a67-4b02-bf72-5a651cd8bd44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1d2115001714999aee0bf3cae5b8d04'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:51.788038 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f5e02-c7ae-4054-9eda-53f069666510 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:51.788629 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-6fb1eb7b-7a67-4b02-bf72-5a651cd8bd44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1d2115001714999aee0bf3cae5b8d04'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:51.788749 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78f5e02-c7ae-4054-9eda-53f069666510 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:51.790364 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78f5e02-c7ae-4054-9eda-53f069666510 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:51.802014 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1145/2267] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:12:51 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:12:51.802847 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78f5e02-c7ae-4054-9eda-53f069666510 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:51.804539 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-f78f5e02-c7ae-4054-9eda-53f069666510 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:51.819688 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78f5e02-c7ae-4054-9eda-53f069666510 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:51.825139 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9c3905-05a9-429a-8dad-86f61abe52df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:51.825995 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c3905-05a9-429a-8dad-86f61abe52df admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:51.827915 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c3905-05a9-429a-8dad-86f61abe52df admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:51.827915 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c3905-05a9-429a-8dad-86f61abe52df admin admin] PATH_INFO: `/v3/projects/782f075c7cc0430f85d614dc49b230c6` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:51.827915 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9c3905-05a9-429a-8dad-86f61abe52df admin admin] RBAC: Authorizing `identity:delete_project(project_id=782f075c7cc0430f85d614dc49b230c6)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:51.829644 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9c3905-05a9-429a-8dad-86f61abe52df admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:51.883037 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-6fb1eb7b-7a67-4b02-bf72-5a651cd8bd44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1d2115001714999aee0bf3cae5b8d04'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:51.895162 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-6fb1eb7b-7a67-4b02-bf72-5a651cd8bd44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1d2115001714999aee0bf3cae5b8d04'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:51.901008 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1123/2268] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:12:51 2022] DELETE /identity/v3/users/b1d2115001714999aee0bf3cae5b8d04 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:12:51.901845 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb1eb7b-7a67-4b02-bf72-5a651cd8bd44 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:51.903153 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-6fb1eb7b-7a67-4b02-bf72-5a651cd8bd44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:51.956683 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0a9c3905-05a9-429a-8dad-86f61abe52df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '782f075c7cc0430f85d614dc49b230c6', 'request_id': 'req-0a9c3905-05a9-429a-8dad-86f61abe52df'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:51.962027 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0a9c3905-05a9-429a-8dad-86f61abe52df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '782f075c7cc0430f85d614dc49b230c6', 'request_id': 'req-0a9c3905-05a9-429a-8dad-86f61abe52df'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:51.966545 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb1eb7b-7a67-4b02-bf72-5a651cd8bd44 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:52.022680 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581725b4-e491-4dad-982e-059b867f773f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:52.023514 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581725b4-e491-4dad-982e-059b867f773f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:52.023811 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581725b4-e491-4dad-982e-059b867f773f admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:52.024090 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581725b4-e491-4dad-982e-059b867f773f admin admin] PATH_INFO: `/v3/users/c1bc27ae236b45ba959680d396ce104d` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:52.025284 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581725b4-e491-4dad-982e-059b867f773f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1bc27ae236b45ba959680d396ce104d)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:52.027212 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581725b4-e491-4dad-982e-059b867f773f admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:52.048664 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0a9c3905-05a9-429a-8dad-86f61abe52df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '782f075c7cc0430f85d614dc49b230c6', 'request_id': 'req-0a9c3905-05a9-429a-8dad-86f61abe52df'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:52.060407 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0a9c3905-05a9-429a-8dad-86f61abe52df admin admin] The token cache is being invalidate because project 782f075c7cc0430f85d614dc49b230c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:12:52.060686 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0a9c3905-05a9-429a-8dad-86f61abe52df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:52.068682 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0a9c3905-05a9-429a-8dad-86f61abe52df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:52.068682 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1146/2269] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:12:51 2022] DELETE /identity/v3/projects/782f075c7cc0430f85d614dc49b230c6 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:52.068682 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9c3905-05a9-429a-8dad-86f61abe52df admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:52.068682 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-0a9c3905-05a9-429a-8dad-86f61abe52df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:52.077014 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9c3905-05a9-429a-8dad-86f61abe52df admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:52.082565 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97088db-8ae8-463f-9885-dfe6caa0779f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:52.083424 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97088db-8ae8-463f-9885-dfe6caa0779f admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:52.083740 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97088db-8ae8-463f-9885-dfe6caa0779f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:52.084013 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97088db-8ae8-463f-9885-dfe6caa0779f admin admin] PATH_INFO: `/v3/projects/f9d24089740246829e483d7d6177125c/users/34cd5580db494d05a9ea9cb37f714d27/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:52.098961 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97088db-8ae8-463f-9885-dfe6caa0779f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9d24089740246829e483d7d6177125c, user_id=34cd5580db494d05a9ea9cb37f714d27, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:52.101813 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97088db-8ae8-463f-9885-dfe6caa0779f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:52.175693 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1147/2270] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:12:52 2022] PUT /identity/v3/projects/f9d24089740246829e483d7d6177125c/users/34cd5580db494d05a9ea9cb37f714d27/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:52.176977 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d86e3d3-6010-4ae0-b6ba-b5fb75f82a20 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:52.177265 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d86e3d3-6010-4ae0-b6ba-b5fb75f82a20 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:52.177539 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d86e3d3-6010-4ae0-b6ba-b5fb75f82a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:52.195499 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-6d86e3d3-6010-4ae0-b6ba-b5fb75f82a20 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:52.196643 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-6d86e3d3-6010-4ae0-b6ba-b5fb75f82a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:52.256887 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1148/2271] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:52.257724 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d86e3d3-6010-4ae0-b6ba-b5fb75f82a20 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:52.258970 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-6d86e3d3-6010-4ae0-b6ba-b5fb75f82a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:52.271097 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d86e3d3-6010-4ae0-b6ba-b5fb75f82a20 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:52.275576 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-581725b4-e491-4dad-982e-059b867f773f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1bc27ae236b45ba959680d396ce104d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:52.275833 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641db0f8-8fe6-4017-b317-3e5cabb84718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:52.277474 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641db0f8-8fe6-4017-b317-3e5cabb84718 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:52.277474 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641db0f8-8fe6-4017-b317-3e5cabb84718 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:52.277474 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641db0f8-8fe6-4017-b317-3e5cabb84718 admin admin] PATH_INFO: `/v3/users/9a8d130d6d54435d93b7326734f0d47d` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:52.278600 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641db0f8-8fe6-4017-b317-3e5cabb84718 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a8d130d6d54435d93b7326734f0d47d)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:52.280741 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641db0f8-8fe6-4017-b317-3e5cabb84718 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:52.282590 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-581725b4-e491-4dad-982e-059b867f773f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1bc27ae236b45ba959680d396ce104d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:52.283331 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-581725b4-e491-4dad-982e-059b867f773f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1bc27ae236b45ba959680d396ce104d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:52.402940 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-581725b4-e491-4dad-982e-059b867f773f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1bc27ae236b45ba959680d396ce104d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:52.416335 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-581725b4-e491-4dad-982e-059b867f773f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1bc27ae236b45ba959680d396ce104d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:52.422904 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1124/2272] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:12:51 2022] DELETE /identity/v3/users/c1bc27ae236b45ba959680d396ce104d => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:52.424170 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc0c25-ddc9-455a-bbd9-b7f7d894c71a None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:52.424457 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc0c25-ddc9-455a-bbd9-b7f7d894c71a None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:52.424737 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc0c25-ddc9-455a-bbd9-b7f7d894c71a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:52.441009 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-c3cc0c25-ddc9-455a-bbd9-b7f7d894c71a None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:52.442277 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c3cc0c25-ddc9-455a-bbd9-b7f7d894c71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:52.512765 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1125/2273] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:52.516961 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc0c25-ddc9-455a-bbd9-b7f7d894c71a None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:52.518353 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c3cc0c25-ddc9-455a-bbd9-b7f7d894c71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:52.569921 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-641db0f8-8fe6-4017-b317-3e5cabb84718 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a8d130d6d54435d93b7326734f0d47d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:52.576673 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc0c25-ddc9-455a-bbd9-b7f7d894c71a None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:52.580508 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764a09b7-610a-439f-9954-085f6bffbbec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:52.581165 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a09b7-610a-439f-9954-085f6bffbbec service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:52.581449 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a09b7-610a-439f-9954-085f6bffbbec service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:52.581726 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a09b7-610a-439f-9954-085f6bffbbec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:52.583883 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-764a09b7-610a-439f-9954-085f6bffbbec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:52.584991 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-641db0f8-8fe6-4017-b317-3e5cabb84718 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a8d130d6d54435d93b7326734f0d47d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:52.592366 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-641db0f8-8fe6-4017-b317-3e5cabb84718 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a8d130d6d54435d93b7326734f0d47d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:52.598131 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764a09b7-610a-439f-9954-085f6bffbbec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:52.599757 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764a09b7-610a-439f-9954-085f6bffbbec service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:52.610600 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1126/2274] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:12:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:12:52.612016 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca2c728-bcd7-40bf-83ac-3768b57e47df None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:52.612302 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca2c728-bcd7-40bf-83ac-3768b57e47df None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:52.612586 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca2c728-bcd7-40bf-83ac-3768b57e47df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:52.632580 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-8ca2c728-bcd7-40bf-83ac-3768b57e47df None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:52.633928 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8ca2c728-bcd7-40bf-83ac-3768b57e47df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:52.642310 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1127/2275] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:52.643348 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca2c728-bcd7-40bf-83ac-3768b57e47df None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:52.653106 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-641db0f8-8fe6-4017-b317-3e5cabb84718 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a8d130d6d54435d93b7326734f0d47d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:52.654522 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-641db0f8-8fe6-4017-b317-3e5cabb84718 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a8d130d6d54435d93b7326734f0d47d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:52.654912 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca2c728-bcd7-40bf-83ac-3768b57e47df None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:52.659992 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d26b9-f8ec-4198-b3de-6772a117a9cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:52.660852 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d26b9-f8ec-4198-b3de-6772a117a9cd service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:52.661285 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d26b9-f8ec-4198-b3de-6772a117a9cd service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:52.661566 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d26b9-f8ec-4198-b3de-6772a117a9cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:52.662570 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1149/2276] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:12:52 2022] DELETE /identity/v3/users/9a8d130d6d54435d93b7326734f0d47d => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:52.664144 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-315d26b9-f8ec-4198-b3de-6772a117a9cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:52.667013 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641db0f8-8fe6-4017-b317-3e5cabb84718 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:52.668530 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-641db0f8-8fe6-4017-b317-3e5cabb84718 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:52.685645 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315d26b9-f8ec-4198-b3de-6772a117a9cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:52.687402 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315d26b9-f8ec-4198-b3de-6772a117a9cd service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:52.701497 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1128/2277] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:12:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:12:52.751653 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641db0f8-8fe6-4017-b317-3e5cabb84718 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:52.755749 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b059c849-47c2-46ee-8186-c5d3ec83921d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:52.756686 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059c849-47c2-46ee-8186-c5d3ec83921d service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:52.756974 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059c849-47c2-46ee-8186-c5d3ec83921d service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:52.757367 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059c849-47c2-46ee-8186-c5d3ec83921d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:52.759118 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b059c849-47c2-46ee-8186-c5d3ec83921d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:52.825260 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b059c849-47c2-46ee-8186-c5d3ec83921d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:52.826814 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b059c849-47c2-46ee-8186-c5d3ec83921d service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:52.837198 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1150/2278] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:12:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:12:53.229255 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d26b9-f8ec-4198-b3de-6772a117a9cd service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:53.230738 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-315d26b9-f8ec-4198-b3de-6772a117a9cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:53.243077 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d26b9-f8ec-4198-b3de-6772a117a9cd service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:53.248027 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d623f-caa6-4914-84d1-e8eecf35127f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:53.248916 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d623f-caa6-4914-84d1-e8eecf35127f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:53.249714 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d623f-caa6-4914-84d1-e8eecf35127f admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:53.249994 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d623f-caa6-4914-84d1-e8eecf35127f admin admin] PATH_INFO: `/v3/projects/73a07b9f377c406280d6c74b0a28cc37` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:53.251707 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5d623f-caa6-4914-84d1-e8eecf35127f admin admin] RBAC: Authorizing `identity:delete_project(project_id=73a07b9f377c406280d6c74b0a28cc37)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:53.253762 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5d623f-caa6-4914-84d1-e8eecf35127f admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:53.327698 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b059c849-47c2-46ee-8186-c5d3ec83921d service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:53.329273 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b059c849-47c2-46ee-8186-c5d3ec83921d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:53.343934 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b059c849-47c2-46ee-8186-c5d3ec83921d service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:53.348745 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e05606b-3109-44ec-884e-6dae1e77a8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:53.349680 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05606b-3109-44ec-884e-6dae1e77a8e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:53.349936 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05606b-3109-44ec-884e-6dae1e77a8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:53.351090 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05606b-3109-44ec-884e-6dae1e77a8e8 admin admin] PATH_INFO: `/v3/projects/40acab3854134d1e85effc683181971e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:53.352352 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e05606b-3109-44ec-884e-6dae1e77a8e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40acab3854134d1e85effc683181971e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:53.354314 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e05606b-3109-44ec-884e-6dae1e77a8e8 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:53.390135 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-1a5d623f-caa6-4914-84d1-e8eecf35127f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73a07b9f377c406280d6c74b0a28cc37', 'request_id': 'req-1a5d623f-caa6-4914-84d1-e8eecf35127f'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:53.397388 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-1a5d623f-caa6-4914-84d1-e8eecf35127f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73a07b9f377c406280d6c74b0a28cc37', 'request_id': 'req-1a5d623f-caa6-4914-84d1-e8eecf35127f'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:53.406917 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-1a5d623f-caa6-4914-84d1-e8eecf35127f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73a07b9f377c406280d6c74b0a28cc37', 'request_id': 'req-1a5d623f-caa6-4914-84d1-e8eecf35127f'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:53.455001 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6e05606b-3109-44ec-884e-6dae1e77a8e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40acab3854134d1e85effc683181971e', 'request_id': 'req-6e05606b-3109-44ec-884e-6dae1e77a8e8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:53.460254 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6e05606b-3109-44ec-884e-6dae1e77a8e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40acab3854134d1e85effc683181971e', 'request_id': 'req-6e05606b-3109-44ec-884e-6dae1e77a8e8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:53.523421 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-1a5d623f-caa6-4914-84d1-e8eecf35127f admin admin] The token cache is being invalidate because project 73a07b9f377c406280d6c74b0a28cc37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:12:53.523840 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-1a5d623f-caa6-4914-84d1-e8eecf35127f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:53.524481 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-1a5d623f-caa6-4914-84d1-e8eecf35127f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:53.526033 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1129/2279] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:12:53 2022] DELETE /identity/v3/projects/73a07b9f377c406280d6c74b0a28cc37 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:53.532168 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d623f-caa6-4914-84d1-e8eecf35127f admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:53.533864 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-1a5d623f-caa6-4914-84d1-e8eecf35127f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:53.627997 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d623f-caa6-4914-84d1-e8eecf35127f admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:53.657078 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6e05606b-3109-44ec-884e-6dae1e77a8e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40acab3854134d1e85effc683181971e', 'request_id': 'req-6e05606b-3109-44ec-884e-6dae1e77a8e8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:53.670094 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6e05606b-3109-44ec-884e-6dae1e77a8e8 admin admin] The token cache is being invalidate because project 40acab3854134d1e85effc683181971e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:12:53.670613 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6e05606b-3109-44ec-884e-6dae1e77a8e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:53.672088 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6e05606b-3109-44ec-884e-6dae1e77a8e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:53.674335 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1151/2280] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:12:53 2022] DELETE /identity/v3/projects/40acab3854134d1e85effc683181971e => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:12:53.675372 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e05606b-3109-44ec-884e-6dae1e77a8e8 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:53.677224 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-6e05606b-3109-44ec-884e-6dae1e77a8e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:53.720246 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbd34ce-1dda-4fc3-8268-4a60df893ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:53.720246 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd34ce-1dda-4fc3-8268-4a60df893ac1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:53.720246 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd34ce-1dda-4fc3-8268-4a60df893ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:53.720246 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd34ce-1dda-4fc3-8268-4a60df893ac1 admin admin] PATH_INFO: `/v3/users/aff1fb0bcf7649d59db88d4c3f4d8ac2` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:53.723559 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbd34ce-1dda-4fc3-8268-4a60df893ac1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aff1fb0bcf7649d59db88d4c3f4d8ac2)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:53.725886 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbd34ce-1dda-4fc3-8268-4a60df893ac1 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:53.776787 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e05606b-3109-44ec-884e-6dae1e77a8e8 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:53.782731 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d5739-d70a-4580-9636-986cd9674839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:53.784026 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d5739-d70a-4580-9636-986cd9674839 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:53.784300 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d5739-d70a-4580-9636-986cd9674839 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:53.784573 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d5739-d70a-4580-9636-986cd9674839 admin admin] PATH_INFO: `/v3/projects/4164536b7ed841c2b88d28b51543a9a2` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:53.785805 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753d5739-d70a-4580-9636-986cd9674839 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4164536b7ed841c2b88d28b51543a9a2)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:53.787785 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753d5739-d70a-4580-9636-986cd9674839 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:53.949497 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-753d5739-d70a-4580-9636-986cd9674839 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4164536b7ed841c2b88d28b51543a9a2', 'request_id': 'req-753d5739-d70a-4580-9636-986cd9674839'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:53.951199 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-2cbd34ce-1dda-4fc3-8268-4a60df893ac1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aff1fb0bcf7649d59db88d4c3f4d8ac2'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:53.959931 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-753d5739-d70a-4580-9636-986cd9674839 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4164536b7ed841c2b88d28b51543a9a2', 'request_id': 'req-753d5739-d70a-4580-9636-986cd9674839'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:53.963590 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-2cbd34ce-1dda-4fc3-8268-4a60df893ac1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aff1fb0bcf7649d59db88d4c3f4d8ac2'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:53.964859 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-2cbd34ce-1dda-4fc3-8268-4a60df893ac1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aff1fb0bcf7649d59db88d4c3f4d8ac2'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:54.048874 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-753d5739-d70a-4580-9636-986cd9674839 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4164536b7ed841c2b88d28b51543a9a2', 'request_id': 'req-753d5739-d70a-4580-9636-986cd9674839'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:54.060718 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-753d5739-d70a-4580-9636-986cd9674839 admin admin] The token cache is being invalidate because project 4164536b7ed841c2b88d28b51543a9a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:12:54.061009 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-753d5739-d70a-4580-9636-986cd9674839 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:54.061695 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-753d5739-d70a-4580-9636-986cd9674839 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:54.063279 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1152/2281] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:12:53 2022] DELETE /identity/v3/projects/4164536b7ed841c2b88d28b51543a9a2 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:54.064654 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a375a-2005-4cfd-8dc8-dc509f3433e2 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:54.064938 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a375a-2005-4cfd-8dc8-dc509f3433e2 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:54.065213 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a375a-2005-4cfd-8dc8-dc509f3433e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:54.083501 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-0f5a375a-2005-4cfd-8dc8-dc509f3433e2 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:54.084736 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-0f5a375a-2005-4cfd-8dc8-dc509f3433e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:54.144932 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1153/2282] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:54.146007 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5a375a-2005-4cfd-8dc8-dc509f3433e2 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:54.147605 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-0f5a375a-2005-4cfd-8dc8-dc509f3433e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:54.160510 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5a375a-2005-4cfd-8dc8-dc509f3433e2 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:54.165243 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab2168e-c20b-4444-b78b-5c7ad9c12f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:54.166112 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2168e-c20b-4444-b78b-5c7ad9c12f4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:54.166394 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2168e-c20b-4444-b78b-5c7ad9c12f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:54.166668 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2168e-c20b-4444-b78b-5c7ad9c12f4b admin admin] PATH_INFO: `/v3/users/7a109d9e95f74e48bc49e6ec51dfd754` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:54.167873 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab2168e-c20b-4444-b78b-5c7ad9c12f4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a109d9e95f74e48bc49e6ec51dfd754)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:54.169803 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab2168e-c20b-4444-b78b-5c7ad9c12f4b admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:54.197403 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-2cbd34ce-1dda-4fc3-8268-4a60df893ac1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aff1fb0bcf7649d59db88d4c3f4d8ac2'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:54.213112 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-2cbd34ce-1dda-4fc3-8268-4a60df893ac1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aff1fb0bcf7649d59db88d4c3f4d8ac2'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:54.220141 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1130/2283] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:12:53 2022] DELETE /identity/v3/users/aff1fb0bcf7649d59db88d4c3f4d8ac2 => generated 0 bytes in 689 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:54.224815 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a8f58-3e8a-458a-8ec0-45b457fac7b8 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:54.225126 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a8f58-3e8a-458a-8ec0-45b457fac7b8 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:54.226333 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a8f58-3e8a-458a-8ec0-45b457fac7b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:54.247510 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-fa7a8f58-3e8a-458a-8ec0-45b457fac7b8 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:54.248718 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-fa7a8f58-3e8a-458a-8ec0-45b457fac7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:54.320727 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1131/2284] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:54.326814 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7a8f58-3e8a-458a-8ec0-45b457fac7b8 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:54.336848 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7a8f58-3e8a-458a-8ec0-45b457fac7b8 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:54.341639 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cf6b74-7f4b-4127-ac82-1ee953f38693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:54.342289 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf6b74-7f4b-4127-ac82-1ee953f38693 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:54.342569 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf6b74-7f4b-4127-ac82-1ee953f38693 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:54.342940 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf6b74-7f4b-4127-ac82-1ee953f38693 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:54.344331 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cf6b74-7f4b-4127-ac82-1ee953f38693 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:12:54.344758 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cf6b74-7f4b-4127-ac82-1ee953f38693 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:54.346365 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cf6b74-7f4b-4127-ac82-1ee953f38693 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:54.355013 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5ab2168e-c20b-4444-b78b-5c7ad9c12f4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a109d9e95f74e48bc49e6ec51dfd754'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:54.357760 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1132/2285] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:12:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:12:54.362939 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cf6b74-7f4b-4127-ac82-1ee953f38693 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:54.367839 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5ab2168e-c20b-4444-b78b-5c7ad9c12f4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a109d9e95f74e48bc49e6ec51dfd754'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:54.374020 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cf6b74-7f4b-4127-ac82-1ee953f38693 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:54.380408 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a396f0c-2610-4e70-b49d-ab5a0326e7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:54.381971 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a396f0c-2610-4e70-b49d-ab5a0326e7c8 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:54.381971 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a396f0c-2610-4e70-b49d-ab5a0326e7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:54.382201 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a396f0c-2610-4e70-b49d-ab5a0326e7c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:54.382911 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a396f0c-2610-4e70-b49d-ab5a0326e7c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:54.384726 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a396f0c-2610-4e70-b49d-ab5a0326e7c8 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:54.400455 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5ab2168e-c20b-4444-b78b-5c7ad9c12f4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a109d9e95f74e48bc49e6ec51dfd754'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:54.512566 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5ab2168e-c20b-4444-b78b-5c7ad9c12f4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a109d9e95f74e48bc49e6ec51dfd754'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:54.513921 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5ab2168e-c20b-4444-b78b-5c7ad9c12f4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a109d9e95f74e48bc49e6ec51dfd754'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:54.523970 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1154/2286] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:12:54 2022] DELETE /identity/v3/users/7a109d9e95f74e48bc49e6ec51dfd754 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:54.531690 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1133/2287] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:12:54 2022] POST /identity/v3/projects => generated 387 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:12:54.538142 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab2168e-c20b-4444-b78b-5c7ad9c12f4b admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:54.539911 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-5ab2168e-c20b-4444-b78b-5c7ad9c12f4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:54.632430 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab2168e-c20b-4444-b78b-5c7ad9c12f4b admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:54.694094 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc12242-b514-432a-b773-351164be544b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:54.694795 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc12242-b514-432a-b773-351164be544b admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:54.695036 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc12242-b514-432a-b773-351164be544b admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:54.695310 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc12242-b514-432a-b773-351164be544b admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:54.696043 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc12242-b514-432a-b773-351164be544b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:54.697957 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc12242-b514-432a-b773-351164be544b admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:54.736960 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a396f0c-2610-4e70-b49d-ab5a0326e7c8 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:54.740245 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-1a396f0c-2610-4e70-b49d-ab5a0326e7c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:54.775910 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a396f0c-2610-4e70-b49d-ab5a0326e7c8 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:54.781649 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26548d6c-56d5-4e75-b297-762dcf2825de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:54.781858 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26548d6c-56d5-4e75-b297-762dcf2825de admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:54.787327 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26548d6c-56d5-4e75-b297-762dcf2825de admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:54.787327 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26548d6c-56d5-4e75-b297-762dcf2825de admin admin] PATH_INFO: `/v3/projects/53ac55b684e64cc8af2b544a99b01fe6` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:54.787327 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26548d6c-56d5-4e75-b297-762dcf2825de admin admin] RBAC: Authorizing `identity:delete_project(project_id=53ac55b684e64cc8af2b544a99b01fe6)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:54.787327 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26548d6c-56d5-4e75-b297-762dcf2825de admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:54.817960 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1155/2288] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:12:54 2022] POST /identity/v3/users => generated 294 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:12:54.822178 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc12242-b514-432a-b773-351164be544b admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:54.836962 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc12242-b514-432a-b773-351164be544b admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:54.850090 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013cfe98-1ce8-4464-a70e-5725106820c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:54.850809 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013cfe98-1ce8-4464-a70e-5725106820c0 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:54.853410 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013cfe98-1ce8-4464-a70e-5725106820c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:54.853912 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013cfe98-1ce8-4464-a70e-5725106820c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:54.857038 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013cfe98-1ce8-4464-a70e-5725106820c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:54.867995 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013cfe98-1ce8-4464-a70e-5725106820c0 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:54.883040 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1156/2289] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:12:54 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:12:54.887169 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013cfe98-1ce8-4464-a70e-5725106820c0 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:54.901013 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013cfe98-1ce8-4464-a70e-5725106820c0 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:54.907260 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eebd69-022f-4886-8ab9-4e7d01cab1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:54.909423 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eebd69-022f-4886-8ab9-4e7d01cab1bc admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:54.909423 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eebd69-022f-4886-8ab9-4e7d01cab1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:54.909423 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eebd69-022f-4886-8ab9-4e7d01cab1bc admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:54.910016 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eebd69-022f-4886-8ab9-4e7d01cab1bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:54.911978 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eebd69-022f-4886-8ab9-4e7d01cab1bc admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:54.932557 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1157/2290] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:12:54 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:12:54.933560 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eebd69-022f-4886-8ab9-4e7d01cab1bc admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:54.943516 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-26548d6c-56d5-4e75-b297-762dcf2825de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53ac55b684e64cc8af2b544a99b01fe6', 'request_id': 'req-26548d6c-56d5-4e75-b297-762dcf2825de'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:54.954150 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eebd69-022f-4886-8ab9-4e7d01cab1bc admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:54.954426 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-26548d6c-56d5-4e75-b297-762dcf2825de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53ac55b684e64cc8af2b544a99b01fe6', 'request_id': 'req-26548d6c-56d5-4e75-b297-762dcf2825de'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:54.969181 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-26548d6c-56d5-4e75-b297-762dcf2825de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53ac55b684e64cc8af2b544a99b01fe6', 'request_id': 'req-26548d6c-56d5-4e75-b297-762dcf2825de'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:55.053116 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8316b5-6f5f-4bbf-b426-9547df90c73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:55.054225 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8316b5-6f5f-4bbf-b426-9547df90c73d admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:55.054509 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8316b5-6f5f-4bbf-b426-9547df90c73d admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:55.054786 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8316b5-6f5f-4bbf-b426-9547df90c73d admin admin] PATH_INFO: `/v3/projects/59e14ad4fbf64ebc874c48163b3a11db/users/c9848ac7271142b88f6b0277eb6bb6d5/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:55.087049 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8316b5-6f5f-4bbf-b426-9547df90c73d admin admin] RBAC: Authorizing `identity:create_grant(project_id=59e14ad4fbf64ebc874c48163b3a11db, user_id=c9848ac7271142b88f6b0277eb6bb6d5, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:55.090559 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8316b5-6f5f-4bbf-b426-9547df90c73d admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:55.112678 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-26548d6c-56d5-4e75-b297-762dcf2825de admin admin] The token cache is being invalidate because project 53ac55b684e64cc8af2b544a99b01fe6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:12:55.113381 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-26548d6c-56d5-4e75-b297-762dcf2825de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:55.114261 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-26548d6c-56d5-4e75-b297-762dcf2825de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:55.117042 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1134/2291] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:12:54 2022] DELETE /identity/v3/projects/53ac55b684e64cc8af2b544a99b01fe6 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:55.121943 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e451cb66-eac6-4917-b7fd-89971a649b8c None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:55.122315 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e451cb66-eac6-4917-b7fd-89971a649b8c None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:55.122660 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e451cb66-eac6-4917-b7fd-89971a649b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:55.144370 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-e451cb66-eac6-4917-b7fd-89971a649b8c None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:55.145672 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e451cb66-eac6-4917-b7fd-89971a649b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:55.158513 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1135/2292] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:55.166227 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42168bbd-4b70-418b-a428-02c88d63c0c1 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:55.166455 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42168bbd-4b70-418b-a428-02c88d63c0c1 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:55.166731 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42168bbd-4b70-418b-a428-02c88d63c0c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:55.188548 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-42168bbd-4b70-418b-a428-02c88d63c0c1 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:55.189856 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-42168bbd-4b70-418b-a428-02c88d63c0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:55.198346 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1136/2293] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:12:55.203259 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42168bbd-4b70-418b-a428-02c88d63c0c1 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:55.213091 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42168bbd-4b70-418b-a428-02c88d63c0c1 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:55.218830 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128f4a18-20d0-44e0-b2b8-bff9d4ea2419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:55.219673 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f4a18-20d0-44e0-b2b8-bff9d4ea2419 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:55.220010 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f4a18-20d0-44e0-b2b8-bff9d4ea2419 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:55.220296 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f4a18-20d0-44e0-b2b8-bff9d4ea2419 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:55.221024 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128f4a18-20d0-44e0-b2b8-bff9d4ea2419 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:12:55.221359 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128f4a18-20d0-44e0-b2b8-bff9d4ea2419 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:55.222998 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128f4a18-20d0-44e0-b2b8-bff9d4ea2419 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:55.235410 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1158/2294] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:12:54 2022] PUT /identity/v3/projects/59e14ad4fbf64ebc874c48163b3a11db/users/c9848ac7271142b88f6b0277eb6bb6d5/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:55.252660 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ec299-a6ae-4955-ad24-624efc300ccb None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:55.253056 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ec299-a6ae-4955-ad24-624efc300ccb None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:55.253231 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ec299-a6ae-4955-ad24-624efc300ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:55.275668 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1137/2295] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:12:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:12:55.281167 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128f4a18-20d0-44e0-b2b8-bff9d4ea2419 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:55.288198 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-ce8ec299-a6ae-4955-ad24-624efc300ccb None None] MFA Rules not processed for user `c9848ac7271142b88f6b0277eb6bb6d5`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:55.289808 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ce8ec299-a6ae-4955-ad24-624efc300ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:55.310294 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128f4a18-20d0-44e0-b2b8-bff9d4ea2419 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:55.392997 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1159/2296] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:55.394965 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8ec299-a6ae-4955-ad24-624efc300ccb None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:55.397885 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ce8ec299-a6ae-4955-ad24-624efc300ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:55.432095 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b768305-cbd0-49c2-91b6-06f3b2f5c109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:55.432775 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b768305-cbd0-49c2-91b6-06f3b2f5c109 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:55.433060 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b768305-cbd0-49c2-91b6-06f3b2f5c109 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:55.433768 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b768305-cbd0-49c2-91b6-06f3b2f5c109 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:55.434025 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b768305-cbd0-49c2-91b6-06f3b2f5c109 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:55.438679 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b768305-cbd0-49c2-91b6-06f3b2f5c109 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:55.501642 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8ec299-a6ae-4955-ad24-624efc300ccb None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:55.510001 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be815b7b-4720-49d4-bb94-3b295b138299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:55.511533 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be815b7b-4720-49d4-bb94-3b295b138299 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:55.512161 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be815b7b-4720-49d4-bb94-3b295b138299 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:55.512684 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be815b7b-4720-49d4-bb94-3b295b138299 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:55.513777 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be815b7b-4720-49d4-bb94-3b295b138299 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:55.520213 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be815b7b-4720-49d4-bb94-3b295b138299 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:55.595907 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1138/2297] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:12:55 2022] POST /identity/v3/projects => generated 391 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:12:55.600750 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b768305-cbd0-49c2-91b6-06f3b2f5c109 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:55.679552 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b768305-cbd0-49c2-91b6-06f3b2f5c109 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:55.693962 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1160/2298] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:12:55 2022] POST /identity/v3/projects => generated 385 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:12:55.695520 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9702df15-d2bb-49ec-9ed1-11bb32c4b38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:55.696762 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9702df15-d2bb-49ec-9ed1-11bb32c4b38a admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:55.697937 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be815b7b-4720-49d4-bb94-3b295b138299 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:55.698424 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9702df15-d2bb-49ec-9ed1-11bb32c4b38a admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:55.698424 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9702df15-d2bb-49ec-9ed1-11bb32c4b38a admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:55.699823 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9702df15-d2bb-49ec-9ed1-11bb32c4b38a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:55.702988 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-be815b7b-4720-49d4-bb94-3b295b138299 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:55.704756 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9702df15-d2bb-49ec-9ed1-11bb32c4b38a admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:55.788156 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be815b7b-4720-49d4-bb94-3b295b138299 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:55.795821 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45b0993-83cc-4aeb-afde-49e15afe1c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:55.797407 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b0993-83cc-4aeb-afde-49e15afe1c83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:55.797740 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b0993-83cc-4aeb-afde-49e15afe1c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:55.798022 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b0993-83cc-4aeb-afde-49e15afe1c83 admin admin] PATH_INFO: `/v3/projects/7dbaf999504b4a958cd359678792edee` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:55.802843 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45b0993-83cc-4aeb-afde-49e15afe1c83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dbaf999504b4a958cd359678792edee)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:55.802843 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45b0993-83cc-4aeb-afde-49e15afe1c83 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:55.803371 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1139/2299] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:12:55 2022] POST /identity/v3/users => generated 296 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:12:55.804347 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9702df15-d2bb-49ec-9ed1-11bb32c4b38a admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:55.820094 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9702df15-d2bb-49ec-9ed1-11bb32c4b38a admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:55.826917 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b79d611-d0e9-4546-a01b-5b6e0fc848b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:55.828262 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b79d611-d0e9-4546-a01b-5b6e0fc848b6 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:55.828735 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b79d611-d0e9-4546-a01b-5b6e0fc848b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:55.829119 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b79d611-d0e9-4546-a01b-5b6e0fc848b6 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:55.830386 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b79d611-d0e9-4546-a01b-5b6e0fc848b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:55.833255 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b79d611-d0e9-4546-a01b-5b6e0fc848b6 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:55.935676 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1140/2300] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:12:55 2022] POST /identity/v3/users => generated 299 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:12:55.936482 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b79d611-d0e9-4546-a01b-5b6e0fc848b6 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:55.954005 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b79d611-d0e9-4546-a01b-5b6e0fc848b6 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:55.960184 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81fb90-7f79-4b53-9473-8e3169af9374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:55.961580 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81fb90-7f79-4b53-9473-8e3169af9374 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:55.962256 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81fb90-7f79-4b53-9473-8e3169af9374 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:55.963192 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81fb90-7f79-4b53-9473-8e3169af9374 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:55.964249 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f81fb90-7f79-4b53-9473-8e3169af9374 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:55.969614 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f81fb90-7f79-4b53-9473-8e3169af9374 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:56.016126 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1141/2301] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:12:55 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:12:56.020569 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81fb90-7f79-4b53-9473-8e3169af9374 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:56.036466 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81fb90-7f79-4b53-9473-8e3169af9374 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:56.065152 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b45b0993-83cc-4aeb-afde-49e15afe1c83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dbaf999504b4a958cd359678792edee', 'request_id': 'req-b45b0993-83cc-4aeb-afde-49e15afe1c83'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:56.081524 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b45b0993-83cc-4aeb-afde-49e15afe1c83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dbaf999504b4a958cd359678792edee', 'request_id': 'req-b45b0993-83cc-4aeb-afde-49e15afe1c83'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:56.120799 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c922310-cfe7-4078-a36c-7a66a04273e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:56.121745 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c922310-cfe7-4078-a36c-7a66a04273e2 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:56.122031 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c922310-cfe7-4078-a36c-7a66a04273e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:56.127740 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c922310-cfe7-4078-a36c-7a66a04273e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:56.127740 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c922310-cfe7-4078-a36c-7a66a04273e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:56.127740 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c922310-cfe7-4078-a36c-7a66a04273e2 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:56.136928 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1142/2302] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:12:56 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:12:56.137871 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c922310-cfe7-4078-a36c-7a66a04273e2 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:56.149455 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c922310-cfe7-4078-a36c-7a66a04273e2 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:56.154588 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bcfb6d-e292-4888-9b1b-11e8156595e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:56.155277 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bcfb6d-e292-4888-9b1b-11e8156595e8 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:56.156187 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bcfb6d-e292-4888-9b1b-11e8156595e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:56.156464 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bcfb6d-e292-4888-9b1b-11e8156595e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:56.157367 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bcfb6d-e292-4888-9b1b-11e8156595e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:56.159025 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bcfb6d-e292-4888-9b1b-11e8156595e8 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:56.173345 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1143/2303] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:12:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:12:56.174254 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bcfb6d-e292-4888-9b1b-11e8156595e8 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:56.184648 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bcfb6d-e292-4888-9b1b-11e8156595e8 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:56.190348 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a72375-47a5-4313-a8d7-99b2b705cd46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:56.191292 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a72375-47a5-4313-a8d7-99b2b705cd46 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:56.191629 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a72375-47a5-4313-a8d7-99b2b705cd46 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:56.191907 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a72375-47a5-4313-a8d7-99b2b705cd46 admin admin] PATH_INFO: `/v3/projects/78ff7c8c227d4782963792034d7cd5ab/users/65a652def16e4c658e0b67291ca60a34/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:56.207960 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a72375-47a5-4313-a8d7-99b2b705cd46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78ff7c8c227d4782963792034d7cd5ab, user_id=65a652def16e4c658e0b67291ca60a34, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:56.210720 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a72375-47a5-4313-a8d7-99b2b705cd46 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:56.224128 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b45b0993-83cc-4aeb-afde-49e15afe1c83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dbaf999504b4a958cd359678792edee', 'request_id': 'req-b45b0993-83cc-4aeb-afde-49e15afe1c83'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:56.235717 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b45b0993-83cc-4aeb-afde-49e15afe1c83 admin admin] The token cache is being invalidate because project 7dbaf999504b4a958cd359678792edee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:12:56.236010 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b45b0993-83cc-4aeb-afde-49e15afe1c83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:56.236662 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b45b0993-83cc-4aeb-afde-49e15afe1c83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:56.238210 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1161/2304] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:12:55 2022] DELETE /identity/v3/projects/7dbaf999504b4a958cd359678792edee => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:56.238953 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45b0993-83cc-4aeb-afde-49e15afe1c83 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:56.240262 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b45b0993-83cc-4aeb-afde-49e15afe1c83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:56.253583 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45b0993-83cc-4aeb-afde-49e15afe1c83 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:56.258462 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e313b6-a053-4da6-9329-f6d57526143c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:56.259321 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e313b6-a053-4da6-9329-f6d57526143c admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:56.259651 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e313b6-a053-4da6-9329-f6d57526143c admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:56.259935 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e313b6-a053-4da6-9329-f6d57526143c admin admin] PATH_INFO: `/v3/projects/ad90995c0ee2499284a5692a37c473fd/users/1869d7d837a84cb183861be8c558a4ad/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:56.277658 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e313b6-a053-4da6-9329-f6d57526143c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad90995c0ee2499284a5692a37c473fd, user_id=1869d7d837a84cb183861be8c558a4ad, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:56.280691 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e313b6-a053-4da6-9329-f6d57526143c admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:56.355989 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1144/2305] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:12:56 2022] PUT /identity/v3/projects/78ff7c8c227d4782963792034d7cd5ab/users/65a652def16e4c658e0b67291ca60a34/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:56.355989 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed889970-3a55-4dbe-be8a-b843385c5e3f None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:56.355989 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed889970-3a55-4dbe-be8a-b843385c5e3f None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:56.355989 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed889970-3a55-4dbe-be8a-b843385c5e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:56.380418 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1162/2306] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:12:56 2022] PUT /identity/v3/projects/ad90995c0ee2499284a5692a37c473fd/users/1869d7d837a84cb183861be8c558a4ad/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:56.381897 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e313b6-a053-4da6-9329-f6d57526143c admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:56.383774 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d7e313b6-a053-4da6-9329-f6d57526143c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:56.398478 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-ed889970-3a55-4dbe-be8a-b843385c5e3f None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:56.402147 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-ed889970-3a55-4dbe-be8a-b843385c5e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:56.475554 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e313b6-a053-4da6-9329-f6d57526143c admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:56.482465 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4468d839-b268-4f92-b2a9-8a58c7f1ab43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:56.485136 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4468d839-b268-4f92-b2a9-8a58c7f1ab43 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:56.485765 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4468d839-b268-4f92-b2a9-8a58c7f1ab43 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:56.486797 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4468d839-b268-4f92-b2a9-8a58c7f1ab43 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:56.487993 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4468d839-b268-4f92-b2a9-8a58c7f1ab43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:56.490036 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4468d839-b268-4f92-b2a9-8a58c7f1ab43 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:56.507065 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1145/2307] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:56.507065 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d0545-2cf6-4e5a-b289-78816257ad68 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:56.507065 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d0545-2cf6-4e5a-b289-78816257ad68 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:56.507065 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d0545-2cf6-4e5a-b289-78816257ad68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:56.510819 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1163/2308] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:12:56 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:12:56.512708 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac119d-5e85-4375-9e56-0eb2fef3a857 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:56.515458 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac119d-5e85-4375-9e56-0eb2fef3a857 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:56.516252 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac119d-5e85-4375-9e56-0eb2fef3a857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:56.542002 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-0aac119d-5e85-4375-9e56-0eb2fef3a857 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:56.543308 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-0aac119d-5e85-4375-9e56-0eb2fef3a857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:56.557703 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1164/2309] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:56.558581 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aac119d-5e85-4375-9e56-0eb2fef3a857 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:56.573811 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aac119d-5e85-4375-9e56-0eb2fef3a857 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:56.577232 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-536d0545-2cf6-4e5a-b289-78816257ad68 None None] MFA Rules not processed for user `1869d7d837a84cb183861be8c558a4ad`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:56.578532 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-536d0545-2cf6-4e5a-b289-78816257ad68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:56.581346 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208d89aa-81a7-43b5-9765-bb44c954b4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:56.582674 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d89aa-81a7-43b5-9765-bb44c954b4aa admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:56.583136 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d89aa-81a7-43b5-9765-bb44c954b4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:56.583647 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d89aa-81a7-43b5-9765-bb44c954b4aa admin admin] PATH_INFO: `/v3/projects/78ff7c8c227d4782963792034d7cd5ab/users/65a652def16e4c658e0b67291ca60a34/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:56.586128 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208d89aa-81a7-43b5-9765-bb44c954b4aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=78ff7c8c227d4782963792034d7cd5ab, user_id=65a652def16e4c658e0b67291ca60a34, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:56.589362 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208d89aa-81a7-43b5-9765-bb44c954b4aa admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:56.602464 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1165/2310] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:12:56 2022] PUT /identity/v3/projects/78ff7c8c227d4782963792034d7cd5ab/users/65a652def16e4c658e0b67291ca60a34/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:56.603399 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208d89aa-81a7-43b5-9765-bb44c954b4aa admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:56.665227 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1146/2311] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:56 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:56.667588 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ce798-c199-4f6f-b1be-05eae2de62ed None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:56.667884 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ce798-c199-4f6f-b1be-05eae2de62ed None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:56.668457 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ce798-c199-4f6f-b1be-05eae2de62ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:56.708114 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-ef2ce798-c199-4f6f-b1be-05eae2de62ed None None] MFA Rules not processed for user `65a652def16e4c658e0b67291ca60a34`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:56.709338 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-ef2ce798-c199-4f6f-b1be-05eae2de62ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:56.772997 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208d89aa-81a7-43b5-9765-bb44c954b4aa admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:56.780242 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c218b4-93c1-4bce-bf5f-642e2ae2cba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:56.780987 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c218b4-93c1-4bce-bf5f-642e2ae2cba6 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:56.781381 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c218b4-93c1-4bce-bf5f-642e2ae2cba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:56.781674 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c218b4-93c1-4bce-bf5f-642e2ae2cba6 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:56.782417 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c218b4-93c1-4bce-bf5f-642e2ae2cba6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:12:56.782732 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c218b4-93c1-4bce-bf5f-642e2ae2cba6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:56.784368 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c218b4-93c1-4bce-bf5f-642e2ae2cba6 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:56.811207 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1166/2312] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:12:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:12:56.812849 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c218b4-93c1-4bce-bf5f-642e2ae2cba6 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:56.825124 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c218b4-93c1-4bce-bf5f-642e2ae2cba6 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:56.829116 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1147/2313] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:56 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:56.830025 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2ce798-c199-4f6f-b1be-05eae2de62ed None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:56.844053 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3e5743-8196-4321-a358-3eeaf12e18f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:56.844959 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e5743-8196-4321-a358-3eeaf12e18f0 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:56.845334 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e5743-8196-4321-a358-3eeaf12e18f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:56.849158 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e5743-8196-4321-a358-3eeaf12e18f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:56.849964 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3e5743-8196-4321-a358-3eeaf12e18f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:56.850772 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2ce798-c199-4f6f-b1be-05eae2de62ed None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:56.852348 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3e5743-8196-4321-a358-3eeaf12e18f0 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:56.856282 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa7ee12-a91a-4f33-98c8-44b7909744be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:56.856969 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa7ee12-a91a-4f33-98c8-44b7909744be admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:56.857258 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa7ee12-a91a-4f33-98c8-44b7909744be admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:56.857541 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa7ee12-a91a-4f33-98c8-44b7909744be admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:56.858916 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa7ee12-a91a-4f33-98c8-44b7909744be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:56.860902 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa7ee12-a91a-4f33-98c8-44b7909744be admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:56.971285 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1167/2314] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:12:56 2022] POST /identity/v3/projects => generated 393 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:12:56.975335 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3e5743-8196-4321-a358-3eeaf12e18f0 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:56.977891 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-1c3e5743-8196-4321-a358-3eeaf12e18f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:56.998541 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1148/2315] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:12:56 2022] POST /identity/v3/projects => generated 391 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:12:57.000573 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa7ee12-a91a-4f33-98c8-44b7909744be admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:57.094571 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa7ee12-a91a-4f33-98c8-44b7909744be admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:57.103622 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21881f83-9f30-49a9-b5dd-4b281574599e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:57.104385 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21881f83-9f30-49a9-b5dd-4b281574599e admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:57.104860 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21881f83-9f30-49a9-b5dd-4b281574599e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:57.105287 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21881f83-9f30-49a9-b5dd-4b281574599e admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:57.106200 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21881f83-9f30-49a9-b5dd-4b281574599e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:57.108376 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21881f83-9f30-49a9-b5dd-4b281574599e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:57.118684 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3e5743-8196-4321-a358-3eeaf12e18f0 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:57.214079 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ad1147-6b97-4fd7-b6aa-d6983da3c772 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:57.214751 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad1147-6b97-4fd7-b6aa-d6983da3c772 service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:57.215036 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad1147-6b97-4fd7-b6aa-d6983da3c772 service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:57.215276 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad1147-6b97-4fd7-b6aa-d6983da3c772 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:57.225569 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1149/2316] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:12:56 2022] POST /identity/v3/users => generated 303 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:12:57.225569 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21881f83-9f30-49a9-b5dd-4b281574599e admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:57.235635 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21881f83-9f30-49a9-b5dd-4b281574599e admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:57.240800 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b0d78-52bc-45e3-87d2-ac995bbbd8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:57.241635 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b0d78-52bc-45e3-87d2-ac995bbbd8d2 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:57.242022 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b0d78-52bc-45e3-87d2-ac995bbbd8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:57.242404 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b0d78-52bc-45e3-87d2-ac995bbbd8d2 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:57.243193 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386b0d78-52bc-45e3-87d2-ac995bbbd8d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:57.245298 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386b0d78-52bc-45e3-87d2-ac995bbbd8d2 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:57.305222 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ad1147-6b97-4fd7-b6aa-d6983da3c772 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:57.306826 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ad1147-6b97-4fd7-b6aa-d6983da3c772 service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:57.319180 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1168/2317] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:12:56 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:12:57.320127 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ad1147-6b97-4fd7-b6aa-d6983da3c772 service nova] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:57.331406 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ad1147-6b97-4fd7-b6aa-d6983da3c772 service nova] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:57.349134 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd96f456-f9e1-4059-9247-9a0937c4b5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:57.349134 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd96f456-f9e1-4059-9247-9a0937c4b5ce admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:57.349134 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd96f456-f9e1-4059-9247-9a0937c4b5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:57.349134 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd96f456-f9e1-4059-9247-9a0937c4b5ce admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:57.349661 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd96f456-f9e1-4059-9247-9a0937c4b5ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:57.349661 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd96f456-f9e1-4059-9247-9a0937c4b5ce admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:57.351103 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1169/2318] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:12:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:12:57.355301 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd96f456-f9e1-4059-9247-9a0937c4b5ce admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:57.365491 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd96f456-f9e1-4059-9247-9a0937c4b5ce admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:57.370681 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02df2db4-b0be-4152-86c0-eb9ac3aee96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:57.371590 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df2db4-b0be-4152-86c0-eb9ac3aee96b admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:57.371901 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df2db4-b0be-4152-86c0-eb9ac3aee96b admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:57.372180 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df2db4-b0be-4152-86c0-eb9ac3aee96b admin admin] PATH_INFO: `/v3/projects/e3c4034dc5694a6083ecfb051be2958c/users/c87f6fd6a0424535875225bdb66392fb/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:57.388255 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02df2db4-b0be-4152-86c0-eb9ac3aee96b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3c4034dc5694a6083ecfb051be2958c, user_id=c87f6fd6a0424535875225bdb66392fb, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:57.391521 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02df2db4-b0be-4152-86c0-eb9ac3aee96b admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:57.639781 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1150/2319] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:12:57 2022] POST /identity/v3/users => generated 296 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:12:57.641712 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b0d78-52bc-45e3-87d2-ac995bbbd8d2 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:57.652470 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b0d78-52bc-45e3-87d2-ac995bbbd8d2 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:57.658170 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bedaf6d-ec6f-4713-b360-b03b99557336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:57.659272 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bedaf6d-ec6f-4713-b360-b03b99557336 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:57.659625 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bedaf6d-ec6f-4713-b360-b03b99557336 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:57.659935 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bedaf6d-ec6f-4713-b360-b03b99557336 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:57.660660 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bedaf6d-ec6f-4713-b360-b03b99557336 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:57.662410 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bedaf6d-ec6f-4713-b360-b03b99557336 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:57.676096 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1170/2320] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:12:57 2022] PUT /identity/v3/projects/e3c4034dc5694a6083ecfb051be2958c/users/c87f6fd6a0424535875225bdb66392fb/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:57.684884 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02df2db4-b0be-4152-86c0-eb9ac3aee96b admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:57.692386 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1151/2321] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:12:57 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:12:57.700668 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bedaf6d-ec6f-4713-b360-b03b99557336 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:57.733038 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bedaf6d-ec6f-4713-b360-b03b99557336 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:57.810174 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02df2db4-b0be-4152-86c0-eb9ac3aee96b admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:57.818755 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71f8577-d18b-4cd8-9cb3-0e4885227201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:57.826941 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71f8577-d18b-4cd8-9cb3-0e4885227201 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:57.826941 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71f8577-d18b-4cd8-9cb3-0e4885227201 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:57.826941 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71f8577-d18b-4cd8-9cb3-0e4885227201 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:57.826941 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71f8577-d18b-4cd8-9cb3-0e4885227201 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:57.826941 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71f8577-d18b-4cd8-9cb3-0e4885227201 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:57.832733 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7468722e-176a-4cdf-aaf3-2612742ede20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:57.833422 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468722e-176a-4cdf-aaf3-2612742ede20 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:57.834343 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468722e-176a-4cdf-aaf3-2612742ede20 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:57.834623 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468722e-176a-4cdf-aaf3-2612742ede20 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:57.835504 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7468722e-176a-4cdf-aaf3-2612742ede20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:57.837771 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7468722e-176a-4cdf-aaf3-2612742ede20 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:57.841454 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1171/2322] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:12:57 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:12:57.846310 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71f8577-d18b-4cd8-9cb3-0e4885227201 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:57.865717 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1152/2323] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:12:57 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:12:57.866716 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7468722e-176a-4cdf-aaf3-2612742ede20 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:57.869721 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71f8577-d18b-4cd8-9cb3-0e4885227201 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:57.886494 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9166d5d1-81fd-4d4e-a1f8-c55250871392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:57.888232 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166d5d1-81fd-4d4e-a1f8-c55250871392 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:57.888364 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166d5d1-81fd-4d4e-a1f8-c55250871392 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:57.888574 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166d5d1-81fd-4d4e-a1f8-c55250871392 admin admin] PATH_INFO: `/v3/projects/e3c4034dc5694a6083ecfb051be2958c/users/c87f6fd6a0424535875225bdb66392fb/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:57.890956 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9166d5d1-81fd-4d4e-a1f8-c55250871392 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3c4034dc5694a6083ecfb051be2958c, user_id=c87f6fd6a0424535875225bdb66392fb, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:57.894478 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9166d5d1-81fd-4d4e-a1f8-c55250871392 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:57.897315 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7468722e-176a-4cdf-aaf3-2612742ede20 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:57.910096 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1172/2324] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:12:57 2022] PUT /identity/v3/projects/e3c4034dc5694a6083ecfb051be2958c/users/c87f6fd6a0424535875225bdb66392fb/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:12:57.911064 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4039cc-5a71-4a5a-995e-aa2d4f322f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:57.912047 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4039cc-5a71-4a5a-995e-aa2d4f322f7d admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:57.912320 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4039cc-5a71-4a5a-995e-aa2d4f322f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:57.912736 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4039cc-5a71-4a5a-995e-aa2d4f322f7d admin admin] PATH_INFO: `/v3/projects/c774ae2a876247f6bff20542ac5e9f14/users/47f7cec16cf44072b39fab108c531783/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:57.927281 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be085dca-5daa-4885-91fa-ce7a29f9571a None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:57.927624 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be085dca-5daa-4885-91fa-ce7a29f9571a None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:57.927899 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be085dca-5daa-4885-91fa-ce7a29f9571a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:57.959131 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-be085dca-5daa-4885-91fa-ce7a29f9571a None None] MFA Rules not processed for user `c87f6fd6a0424535875225bdb66392fb`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:57.960278 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4039cc-5a71-4a5a-995e-aa2d4f322f7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c774ae2a876247f6bff20542ac5e9f14, user_id=47f7cec16cf44072b39fab108c531783, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:57.964568 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-be085dca-5daa-4885-91fa-ce7a29f9571a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:57.967114 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4039cc-5a71-4a5a-995e-aa2d4f322f7d admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:58.071995 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1153/2325] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:12:57 2022] PUT /identity/v3/projects/c774ae2a876247f6bff20542ac5e9f14/users/47f7cec16cf44072b39fab108c531783/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:58.083041 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c367362-1b22-42a2-a009-12978798a4a2 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:58.083327 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c367362-1b22-42a2-a009-12978798a4a2 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:58.083633 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c367362-1b22-42a2-a009-12978798a4a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:58.086985 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1173/2326] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:57 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:58.124197 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-9c367362-1b22-42a2-a009-12978798a4a2 None None] MFA Rules not processed for user `47f7cec16cf44072b39fab108c531783`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:58.125608 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-9c367362-1b22-42a2-a009-12978798a4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:58.202724 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be085dca-5daa-4885-91fa-ce7a29f9571a None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:58.274554 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1154/2327] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:58 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:58.277214 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c367362-1b22-42a2-a009-12978798a4a2 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:58.350917 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be085dca-5daa-4885-91fa-ce7a29f9571a None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:58.372080 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c367362-1b22-42a2-a009-12978798a4a2 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:58.379431 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63162d11-f73a-48da-bd82-78c5a4aaaf56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:58.380172 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63162d11-f73a-48da-bd82-78c5a4aaaf56 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:58.380461 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63162d11-f73a-48da-bd82-78c5a4aaaf56 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:58.380738 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63162d11-f73a-48da-bd82-78c5a4aaaf56 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:58.381813 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63162d11-f73a-48da-bd82-78c5a4aaaf56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:58.384117 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63162d11-f73a-48da-bd82-78c5a4aaaf56 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:58.472059 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d7b607-aa91-4ebd-b0a1-5d9c48b1feb1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:58.472059 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d7b607-aa91-4ebd-b0a1-5d9c48b1feb1 service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:58.472059 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d7b607-aa91-4ebd-b0a1-5d9c48b1feb1 service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:58.472059 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d7b607-aa91-4ebd-b0a1-5d9c48b1feb1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:58.474515 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-39d7b607-aa91-4ebd-b0a1-5d9c48b1feb1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:58.504951 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1155/2328] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:12:58 2022] POST /identity/v3/projects => generated 393 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:12:58.505903 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63162d11-f73a-48da-bd82-78c5a4aaaf56 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:58.513994 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-63162d11-f73a-48da-bd82-78c5a4aaaf56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:58.542267 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d7b607-aa91-4ebd-b0a1-5d9c48b1feb1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:58.544317 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d7b607-aa91-4ebd-b0a1-5d9c48b1feb1 service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:58.557523 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1174/2329] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:12:58 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:12:58.557523 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d7b607-aa91-4ebd-b0a1-5d9c48b1feb1 service nova] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:58.569632 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d7b607-aa91-4ebd-b0a1-5d9c48b1feb1 service nova] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:58.638405 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40edab43-c612-4161-92ce-1de69b1cca0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:58.639532 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40edab43-c612-4161-92ce-1de69b1cca0e admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:58.640155 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40edab43-c612-4161-92ce-1de69b1cca0e admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:58.640594 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40edab43-c612-4161-92ce-1de69b1cca0e admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:58.641446 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40edab43-c612-4161-92ce-1de69b1cca0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:58.643595 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40edab43-c612-4161-92ce-1de69b1cca0e admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:58.677106 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63162d11-f73a-48da-bd82-78c5a4aaaf56 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:58.690863 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eed7cff-d270-4bec-a09a-b5046ea60781 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:58.692322 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed7cff-d270-4bec-a09a-b5046ea60781 service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:58.692612 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed7cff-d270-4bec-a09a-b5046ea60781 service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:58.692889 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed7cff-d270-4bec-a09a-b5046ea60781 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:58.736286 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1175/2330] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:12:58 2022] POST /identity/v3/users => generated 303 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:12:58.747218 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40edab43-c612-4161-92ce-1de69b1cca0e admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:58.762165 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40edab43-c612-4161-92ce-1de69b1cca0e admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:58.770177 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb8e2c9-8476-402c-b283-d642858c4001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:58.774709 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb8e2c9-8476-402c-b283-d642858c4001 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:58.774709 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb8e2c9-8476-402c-b283-d642858c4001 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:58.774709 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb8e2c9-8476-402c-b283-d642858c4001 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:58.774709 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb8e2c9-8476-402c-b283-d642858c4001 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:58.776227 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb8e2c9-8476-402c-b283-d642858c4001 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:58.796820 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1176/2331] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:12:58 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:12:58.807739 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb8e2c9-8476-402c-b283-d642858c4001 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:58.816705 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eed7cff-d270-4bec-a09a-b5046ea60781 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:58.819471 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eed7cff-d270-4bec-a09a-b5046ea60781 service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:58.823707 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb8e2c9-8476-402c-b283-d642858c4001 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:58.837305 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc3105-e015-4634-ac81-2ca748b77fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:58.838223 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc3105-e015-4634-ac81-2ca748b77fef admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:58.838511 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc3105-e015-4634-ac81-2ca748b77fef admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:58.838789 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc3105-e015-4634-ac81-2ca748b77fef admin admin] PATH_INFO: `/v3/projects/52748c4cf00740c880b3cdcd92f5b90e/users/72b8294dba324f4f92d6317496cece1f/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:58.843607 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1156/2332] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:12:58 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:12:58.932101 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dc3105-e015-4634-ac81-2ca748b77fef admin admin] RBAC: Authorizing `identity:create_grant(project_id=52748c4cf00740c880b3cdcd92f5b90e, user_id=72b8294dba324f4f92d6317496cece1f, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:58.939040 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dc3105-e015-4634-ac81-2ca748b77fef admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:59.048673 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1177/2333] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:12:58 2022] PUT /identity/v3/projects/52748c4cf00740c880b3cdcd92f5b90e/users/72b8294dba324f4f92d6317496cece1f/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:59.049461 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eed7cff-d270-4bec-a09a-b5046ea60781 service nova] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:59.063265 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eed7cff-d270-4bec-a09a-b5046ea60781 service nova] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:59.201605 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7411cb-aa2b-4dae-9849-23c15af3b37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:59.202316 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7411cb-aa2b-4dae-9849-23c15af3b37f admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:59.202677 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7411cb-aa2b-4dae-9849-23c15af3b37f admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:59.202944 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7411cb-aa2b-4dae-9849-23c15af3b37f admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:59.203715 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7411cb-aa2b-4dae-9849-23c15af3b37f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:59.205491 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7411cb-aa2b-4dae-9849-23c15af3b37f admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:59.230875 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1157/2334] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:12:59 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:12:59.231071 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc3105-e015-4634-ac81-2ca748b77fef admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:59.246870 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc3105-e015-4634-ac81-2ca748b77fef admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:59.260870 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7c29ad-e6c0-49fc-aa6c-2dd81e299d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:59.261797 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c29ad-e6c0-49fc-aa6c-2dd81e299d44 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:59.262586 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c29ad-e6c0-49fc-aa6c-2dd81e299d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:59.262586 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c29ad-e6c0-49fc-aa6c-2dd81e299d44 admin admin] PATH_INFO: `/v3/projects/52748c4cf00740c880b3cdcd92f5b90e/users/72b8294dba324f4f92d6317496cece1f/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:59.265999 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7c29ad-e6c0-49fc-aa6c-2dd81e299d44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52748c4cf00740c880b3cdcd92f5b90e, user_id=72b8294dba324f4f92d6317496cece1f, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:59.268846 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7c29ad-e6c0-49fc-aa6c-2dd81e299d44 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:59.296449 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1178/2335] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:12:59 2022] PUT /identity/v3/projects/52748c4cf00740c880b3cdcd92f5b90e/users/72b8294dba324f4f92d6317496cece1f/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:12:59.297578 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950a649-fc59-46f1-a21c-b6eec62a37e8 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:59.298802 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950a649-fc59-46f1-a21c-b6eec62a37e8 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:59.299785 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950a649-fc59-46f1-a21c-b6eec62a37e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:59.350424 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-b950a649-fc59-46f1-a21c-b6eec62a37e8 None None] MFA Rules not processed for user `72b8294dba324f4f92d6317496cece1f`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:12:59.352081 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b950a649-fc59-46f1-a21c-b6eec62a37e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:12:59.473621 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1158/2336] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:12:59 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:12:59.620051 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7c29ad-e6c0-49fc-aa6c-2dd81e299d44 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:59.630066 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b950a649-fc59-46f1-a21c-b6eec62a37e8 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:59.755265 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7c29ad-e6c0-49fc-aa6c-2dd81e299d44 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:59.760889 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f3158a-efb4-4bc0-b061-6caf1aaced69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:59.761785 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f3158a-efb4-4bc0-b061-6caf1aaced69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:59.762071 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f3158a-efb4-4bc0-b061-6caf1aaced69 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:59.762348 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f3158a-efb4-4bc0-b061-6caf1aaced69 admin admin] PATH_INFO: `/v3/users/1869d7d837a84cb183861be8c558a4ad` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:59.763611 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f3158a-efb4-4bc0-b061-6caf1aaced69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1869d7d837a84cb183861be8c558a4ad)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:59.766214 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f3158a-efb4-4bc0-b061-6caf1aaced69 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:59.770220 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b950a649-fc59-46f1-a21c-b6eec62a37e8 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:59.789718 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52a4fbd-1cd8-4e55-a5e9-816e13f25bb9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:59.791589 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a4fbd-1cd8-4e55-a5e9-816e13f25bb9 service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:59.791743 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a4fbd-1cd8-4e55-a5e9-816e13f25bb9 service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:59.792443 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a4fbd-1cd8-4e55-a5e9-816e13f25bb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:59.801989 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52a4fbd-1cd8-4e55-a5e9-816e13f25bb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:59.803687 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52a4fbd-1cd8-4e55-a5e9-816e13f25bb9 service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:59.815071 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1159/2337] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:12:59 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:12:59.851747 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52a4fbd-1cd8-4e55-a5e9-816e13f25bb9 service nova] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:59.871440 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52a4fbd-1cd8-4e55-a5e9-816e13f25bb9 service nova] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:12:59.881626 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e340e491-85cc-4ebe-b5de-7e5888607a3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:12:59.889082 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340e491-85cc-4ebe-b5de-7e5888607a3c service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:12:59.889082 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340e491-85cc-4ebe-b5de-7e5888607a3c service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:12:59.889082 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340e491-85cc-4ebe-b5de-7e5888607a3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:12:59.961136 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e340e491-85cc-4ebe-b5de-7e5888607a3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:12:59.962769 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e340e491-85cc-4ebe-b5de-7e5888607a3c service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:12:59.973116 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1160/2338] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:12:59 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:12:59.973951 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e340e491-85cc-4ebe-b5de-7e5888607a3c service nova] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:12:59.998988 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a5f3158a-efb4-4bc0-b061-6caf1aaced69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1869d7d837a84cb183861be8c558a4ad'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:12:59.999563 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e340e491-85cc-4ebe-b5de-7e5888607a3c service nova] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:00.007028 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c90ee0-b506-4e3b-86f3-dc2719f9c86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:00.008619 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c90ee0-b506-4e3b-86f3-dc2719f9c86a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:00.008619 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c90ee0-b506-4e3b-86f3-dc2719f9c86a admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:00.008815 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c90ee0-b506-4e3b-86f3-dc2719f9c86a admin admin] PATH_INFO: `/v3/users/c9848ac7271142b88f6b0277eb6bb6d5` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:00.013970 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c90ee0-b506-4e3b-86f3-dc2719f9c86a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9848ac7271142b88f6b0277eb6bb6d5)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:00.015719 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a5f3158a-efb4-4bc0-b061-6caf1aaced69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1869d7d837a84cb183861be8c558a4ad'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:00.016973 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c90ee0-b506-4e3b-86f3-dc2719f9c86a admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:00.024688 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a5f3158a-efb4-4bc0-b061-6caf1aaced69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1869d7d837a84cb183861be8c558a4ad'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:00.230198 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a5f3158a-efb4-4bc0-b061-6caf1aaced69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1869d7d837a84cb183861be8c558a4ad'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:00.230198 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a5f3158a-efb4-4bc0-b061-6caf1aaced69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1869d7d837a84cb183861be8c558a4ad'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:00.237598 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1179/2339] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:12:59 2022] DELETE /identity/v3/users/1869d7d837a84cb183861be8c558a4ad => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:13:00.238596 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f3158a-efb4-4bc0-b061-6caf1aaced69 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:00.240316 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-a5f3158a-efb4-4bc0-b061-6caf1aaced69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:00.293887 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-04c90ee0-b506-4e3b-86f3-dc2719f9c86a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9848ac7271142b88f6b0277eb6bb6d5'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:00.306250 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-04c90ee0-b506-4e3b-86f3-dc2719f9c86a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9848ac7271142b88f6b0277eb6bb6d5'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:00.308053 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-04c90ee0-b506-4e3b-86f3-dc2719f9c86a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9848ac7271142b88f6b0277eb6bb6d5'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:00.322040 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f3158a-efb4-4bc0-b061-6caf1aaced69 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:00.332786 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33625ae5-b2df-402e-b643-7dfff1e5a08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:00.333801 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33625ae5-b2df-402e-b643-7dfff1e5a08a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:00.334087 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33625ae5-b2df-402e-b643-7dfff1e5a08a admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:00.334363 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33625ae5-b2df-402e-b643-7dfff1e5a08a admin admin] PATH_INFO: `/v3/users/47f7cec16cf44072b39fab108c531783` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:00.336104 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33625ae5-b2df-402e-b643-7dfff1e5a08a admin admin] RBAC: Authorizing `identity:delete_user(user_id=47f7cec16cf44072b39fab108c531783)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:00.338044 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33625ae5-b2df-402e-b643-7dfff1e5a08a admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:00.424391 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-04c90ee0-b506-4e3b-86f3-dc2719f9c86a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9848ac7271142b88f6b0277eb6bb6d5'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:00.439375 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-04c90ee0-b506-4e3b-86f3-dc2719f9c86a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9848ac7271142b88f6b0277eb6bb6d5'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:00.446179 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1161/2340] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:12:59 2022] DELETE /identity/v3/users/c9848ac7271142b88f6b0277eb6bb6d5 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:13:00.447553 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec818a-8513-4030-911d-010f380d6124 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:00.447809 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec818a-8513-4030-911d-010f380d6124 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:00.448090 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec818a-8513-4030-911d-010f380d6124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:00.472496 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-8aec818a-8513-4030-911d-010f380d6124 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:00.473785 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8aec818a-8513-4030-911d-010f380d6124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:00.551009 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1162/2341] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:13:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:13:00.552232 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2d1bd2-4ab8-42b7-bef0-cf41482651c2 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:00.552765 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2d1bd2-4ab8-42b7-bef0-cf41482651c2 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:00.552765 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2d1bd2-4ab8-42b7-bef0-cf41482651c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:00.589785 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-1a2d1bd2-4ab8-42b7-bef0-cf41482651c2 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:00.593803 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-1a2d1bd2-4ab8-42b7-bef0-cf41482651c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:00.598595 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-33625ae5-b2df-402e-b643-7dfff1e5a08a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47f7cec16cf44072b39fab108c531783'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:00.618702 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1163/2342] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:13:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:13:00.618702 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2d1bd2-4ab8-42b7-bef0-cf41482651c2 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:00.621262 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-1a2d1bd2-4ab8-42b7-bef0-cf41482651c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:00.625179 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-33625ae5-b2df-402e-b643-7dfff1e5a08a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47f7cec16cf44072b39fab108c531783'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:00.640491 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-33625ae5-b2df-402e-b643-7dfff1e5a08a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47f7cec16cf44072b39fab108c531783'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:00.712562 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2d1bd2-4ab8-42b7-bef0-cf41482651c2 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:00.724849 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db86525-e450-40ce-98bb-7fa4b63168ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:00.725551 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db86525-e450-40ce-98bb-7fa4b63168ec service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:00.725987 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db86525-e450-40ce-98bb-7fa4b63168ec service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:00.726119 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db86525-e450-40ce-98bb-7fa4b63168ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:00.740279 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-33625ae5-b2df-402e-b643-7dfff1e5a08a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47f7cec16cf44072b39fab108c531783'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:00.741689 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-33625ae5-b2df-402e-b643-7dfff1e5a08a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47f7cec16cf44072b39fab108c531783'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:00.742905 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db86525-e450-40ce-98bb-7fa4b63168ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:00.744521 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db86525-e450-40ce-98bb-7fa4b63168ec service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:00.755087 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1180/2343] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:13:00 2022] DELETE /identity/v3/users/47f7cec16cf44072b39fab108c531783 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:13:00.759247 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1164/2344] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:13:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:13:00.759247 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2741635-fe10-418a-8739-9c6b969e3d19 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:00.759247 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2741635-fe10-418a-8739-9c6b969e3d19 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:00.759247 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2741635-fe10-418a-8739-9c6b969e3d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:00.772574 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33625ae5-b2df-402e-b643-7dfff1e5a08a admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:00.776740 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-33625ae5-b2df-402e-b643-7dfff1e5a08a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:00.801053 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-d2741635-fe10-418a-8739-9c6b969e3d19 None None] MFA Rules not processed for user `34cd5580db494d05a9ea9cb37f714d27`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:00.805310 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-d2741635-fe10-418a-8739-9c6b969e3d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:00.918699 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33625ae5-b2df-402e-b643-7dfff1e5a08a admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:00.920914 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1165/2345] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:13:00 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:13:00.929947 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac61b7c7-68f7-42d1-9f06-d1105522153e None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:00.930570 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac61b7c7-68f7-42d1-9f06-d1105522153e None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:00.931458 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac61b7c7-68f7-42d1-9f06-d1105522153e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:00.933014 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e9cd19-21c4-45d4-bf80-832127e24ace service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:00.933677 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e9cd19-21c4-45d4-bf80-832127e24ace service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:00.934400 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e9cd19-21c4-45d4-bf80-832127e24ace service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:00.934400 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e9cd19-21c4-45d4-bf80-832127e24ace service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:00.936230 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-48e9cd19-21c4-45d4-bf80-832127e24ace service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:00.953352 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-ac61b7c7-68f7-42d1-9f06-d1105522153e None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:00.954900 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-ac61b7c7-68f7-42d1-9f06-d1105522153e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:01.009050 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e9cd19-21c4-45d4-bf80-832127e24ace service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:01.011084 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e9cd19-21c4-45d4-bf80-832127e24ace service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:01.022856 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1181/2346] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:13:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:13:01.024426 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eecc56-2dfe-44c2-89d8-dc04564e1957 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:01.024903 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eecc56-2dfe-44c2-89d8-dc04564e1957 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:01.025343 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eecc56-2dfe-44c2-89d8-dc04564e1957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:01.031681 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1166/2347] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:13:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:13:01.034406 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac61b7c7-68f7-42d1-9f06-d1105522153e None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:01.036027 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-ac61b7c7-68f7-42d1-9f06-d1105522153e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:01.047236 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-a7eecc56-2dfe-44c2-89d8-dc04564e1957 None None] MFA Rules not processed for user `34cd5580db494d05a9ea9cb37f714d27`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:01.048506 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-a7eecc56-2dfe-44c2-89d8-dc04564e1957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:01.051309 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac61b7c7-68f7-42d1-9f06-d1105522153e None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:01.055243 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a0d36a-4bcc-40cc-8397-041d4ed6548f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:01.056244 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a0d36a-4bcc-40cc-8397-041d4ed6548f service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:01.056601 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a0d36a-4bcc-40cc-8397-041d4ed6548f service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:01.056989 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a0d36a-4bcc-40cc-8397-041d4ed6548f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:01.061369 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1182/2348] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:13:01 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:13:01.069518 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a0d36a-4bcc-40cc-8397-041d4ed6548f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:01.077937 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a0d36a-4bcc-40cc-8397-041d4ed6548f service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:01.078042 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eecc56-2dfe-44c2-89d8-dc04564e1957 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:01.080088 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-a7eecc56-2dfe-44c2-89d8-dc04564e1957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:01.098240 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1167/2349] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:13:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:13:01.174699 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eecc56-2dfe-44c2-89d8-dc04564e1957 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:01.181511 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c10659e-cb76-4ab5-ab4a-d12899ab10d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:01.182231 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c10659e-cb76-4ab5-ab4a-d12899ab10d2 service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:01.182664 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c10659e-cb76-4ab5-ab4a-d12899ab10d2 service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:01.182949 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c10659e-cb76-4ab5-ab4a-d12899ab10d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:01.191937 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c10659e-cb76-4ab5-ab4a-d12899ab10d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:01.193669 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c10659e-cb76-4ab5-ab4a-d12899ab10d2 service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:01.205368 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1183/2350] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:13:01 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:13:01.505021 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a0d36a-4bcc-40cc-8397-041d4ed6548f service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:01.506720 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-82a0d36a-4bcc-40cc-8397-041d4ed6548f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:01.528363 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a0d36a-4bcc-40cc-8397-041d4ed6548f service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:01.542506 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f73ce5-0330-4c98-bc34-457ab341ffdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:01.543087 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f73ce5-0330-4c98-bc34-457ab341ffdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:01.543316 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f73ce5-0330-4c98-bc34-457ab341ffdb admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:01.543637 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f73ce5-0330-4c98-bc34-457ab341ffdb admin admin] PATH_INFO: `/v3/projects/ad90995c0ee2499284a5692a37c473fd` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:01.548313 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f73ce5-0330-4c98-bc34-457ab341ffdb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad90995c0ee2499284a5692a37c473fd)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:01.550447 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f73ce5-0330-4c98-bc34-457ab341ffdb admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:01.716757 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-79f73ce5-0330-4c98-bc34-457ab341ffdb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad90995c0ee2499284a5692a37c473fd', 'request_id': 'req-79f73ce5-0330-4c98-bc34-457ab341ffdb'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:01.722859 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-79f73ce5-0330-4c98-bc34-457ab341ffdb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad90995c0ee2499284a5692a37c473fd', 'request_id': 'req-79f73ce5-0330-4c98-bc34-457ab341ffdb'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:01.730115 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-79f73ce5-0330-4c98-bc34-457ab341ffdb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad90995c0ee2499284a5692a37c473fd', 'request_id': 'req-79f73ce5-0330-4c98-bc34-457ab341ffdb'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:01.737151 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c10659e-cb76-4ab5-ab4a-d12899ab10d2 service nova] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:01.738542 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-8c10659e-cb76-4ab5-ab4a-d12899ab10d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:01.760841 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c10659e-cb76-4ab5-ab4a-d12899ab10d2 service nova] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:01.840819 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-79f73ce5-0330-4c98-bc34-457ab341ffdb admin admin] The token cache is being invalidate because project ad90995c0ee2499284a5692a37c473fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:13:01.841272 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-79f73ce5-0330-4c98-bc34-457ab341ffdb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:01.842278 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-79f73ce5-0330-4c98-bc34-457ab341ffdb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:01.846240 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1168/2351] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:13:01 2022] DELETE /identity/v3/projects/ad90995c0ee2499284a5692a37c473fd => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:13:01.847521 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f73ce5-0330-4c98-bc34-457ab341ffdb admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:01.847920 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a5020-b444-481b-93b7-790565130c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:01.849717 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-79f73ce5-0330-4c98-bc34-457ab341ffdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:01.850153 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a5020-b444-481b-93b7-790565130c96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:01.850691 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a5020-b444-481b-93b7-790565130c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:01.851119 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a5020-b444-481b-93b7-790565130c96 admin admin] PATH_INFO: `/v3/projects/c774ae2a876247f6bff20542ac5e9f14` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:01.852692 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97a5020-b444-481b-93b7-790565130c96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c774ae2a876247f6bff20542ac5e9f14)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:01.855129 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97a5020-b444-481b-93b7-790565130c96 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:01.867955 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f73ce5-0330-4c98-bc34-457ab341ffdb admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:01.875146 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165fae42-4337-48d8-a678-7f8b1584e9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:01.876278 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165fae42-4337-48d8-a678-7f8b1584e9ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:01.877746 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165fae42-4337-48d8-a678-7f8b1584e9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:01.879770 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165fae42-4337-48d8-a678-7f8b1584e9ad admin admin] PATH_INFO: `/v3/projects/59e14ad4fbf64ebc874c48163b3a11db` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:01.881712 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165fae42-4337-48d8-a678-7f8b1584e9ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=59e14ad4fbf64ebc874c48163b3a11db)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:01.885537 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165fae42-4337-48d8-a678-7f8b1584e9ad admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:02.014395 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c97a5020-b444-481b-93b7-790565130c96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c774ae2a876247f6bff20542ac5e9f14', 'request_id': 'req-c97a5020-b444-481b-93b7-790565130c96'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:02.065099 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c97a5020-b444-481b-93b7-790565130c96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c774ae2a876247f6bff20542ac5e9f14', 'request_id': 'req-c97a5020-b444-481b-93b7-790565130c96'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:02.079945 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-165fae42-4337-48d8-a678-7f8b1584e9ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59e14ad4fbf64ebc874c48163b3a11db', 'request_id': 'req-165fae42-4337-48d8-a678-7f8b1584e9ad'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:02.094166 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-165fae42-4337-48d8-a678-7f8b1584e9ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59e14ad4fbf64ebc874c48163b3a11db', 'request_id': 'req-165fae42-4337-48d8-a678-7f8b1584e9ad'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:02.103539 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-165fae42-4337-48d8-a678-7f8b1584e9ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59e14ad4fbf64ebc874c48163b3a11db', 'request_id': 'req-165fae42-4337-48d8-a678-7f8b1584e9ad'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:02.140986 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c97a5020-b444-481b-93b7-790565130c96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c774ae2a876247f6bff20542ac5e9f14', 'request_id': 'req-c97a5020-b444-481b-93b7-790565130c96'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:02.166722 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c97a5020-b444-481b-93b7-790565130c96 admin admin] The token cache is being invalidate because project c774ae2a876247f6bff20542ac5e9f14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:13:02.167013 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c97a5020-b444-481b-93b7-790565130c96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:02.169085 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c97a5020-b444-481b-93b7-790565130c96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:02.173430 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1184/2352] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:13:01 2022] DELETE /identity/v3/projects/c774ae2a876247f6bff20542ac5e9f14 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:13:02.175496 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a5020-b444-481b-93b7-790565130c96 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:02.181127 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c97a5020-b444-481b-93b7-790565130c96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:02.223985 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-165fae42-4337-48d8-a678-7f8b1584e9ad admin admin] The token cache is being invalidate because project 59e14ad4fbf64ebc874c48163b3a11db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:13:02.231699 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-165fae42-4337-48d8-a678-7f8b1584e9ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:02.231699 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-165fae42-4337-48d8-a678-7f8b1584e9ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:02.231699 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1169/2353] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:13:01 2022] DELETE /identity/v3/projects/59e14ad4fbf64ebc874c48163b3a11db => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:13:02.231699 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165fae42-4337-48d8-a678-7f8b1584e9ad admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:02.231699 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-165fae42-4337-48d8-a678-7f8b1584e9ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:02.332469 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a5020-b444-481b-93b7-790565130c96 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:02.366253 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165fae42-4337-48d8-a678-7f8b1584e9ad admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:02.371146 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8645b35-7f67-4b18-a78c-51ece7eb9a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:02.372132 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8645b35-7f67-4b18-a78c-51ece7eb9a8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:02.372483 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8645b35-7f67-4b18-a78c-51ece7eb9a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:02.372843 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8645b35-7f67-4b18-a78c-51ece7eb9a8f admin admin] PATH_INFO: `/v3/users/72b8294dba324f4f92d6317496cece1f` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:02.374871 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8645b35-7f67-4b18-a78c-51ece7eb9a8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=72b8294dba324f4f92d6317496cece1f)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:02.377055 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8645b35-7f67-4b18-a78c-51ece7eb9a8f admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:02.403188 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8711db22-5dfd-479a-8162-368a0a1f47d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:02.404141 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711db22-5dfd-479a-8162-368a0a1f47d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:02.404432 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711db22-5dfd-479a-8162-368a0a1f47d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:02.404709 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711db22-5dfd-479a-8162-368a0a1f47d5 admin admin] PATH_INFO: `/v3/users/c87f6fd6a0424535875225bdb66392fb` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:02.406927 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8711db22-5dfd-479a-8162-368a0a1f47d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c87f6fd6a0424535875225bdb66392fb)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:02.408905 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8711db22-5dfd-479a-8162-368a0a1f47d5 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:02.612204 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b8645b35-7f67-4b18-a78c-51ece7eb9a8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72b8294dba324f4f92d6317496cece1f'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:02.620110 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b8645b35-7f67-4b18-a78c-51ece7eb9a8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72b8294dba324f4f92d6317496cece1f'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:02.620815 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b8645b35-7f67-4b18-a78c-51ece7eb9a8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72b8294dba324f4f92d6317496cece1f'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:02.644219 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8711db22-5dfd-479a-8162-368a0a1f47d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c87f6fd6a0424535875225bdb66392fb'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:02.659998 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8711db22-5dfd-479a-8162-368a0a1f47d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c87f6fd6a0424535875225bdb66392fb'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:02.667706 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8711db22-5dfd-479a-8162-368a0a1f47d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c87f6fd6a0424535875225bdb66392fb'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:02.753653 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b8645b35-7f67-4b18-a78c-51ece7eb9a8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72b8294dba324f4f92d6317496cece1f'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:02.772130 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b8645b35-7f67-4b18-a78c-51ece7eb9a8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72b8294dba324f4f92d6317496cece1f'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:02.784721 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1170/2354] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:13:02 2022] DELETE /identity/v3/users/72b8294dba324f4f92d6317496cece1f => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:13:02.785754 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8645b35-7f67-4b18-a78c-51ece7eb9a8f admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:02.787289 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b8645b35-7f67-4b18-a78c-51ece7eb9a8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:02.849208 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8711db22-5dfd-479a-8162-368a0a1f47d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c87f6fd6a0424535875225bdb66392fb'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:02.849798 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8711db22-5dfd-479a-8162-368a0a1f47d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c87f6fd6a0424535875225bdb66392fb'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:02.857792 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1185/2355] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:13:02 2022] DELETE /identity/v3/users/c87f6fd6a0424535875225bdb66392fb => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:13:02.883974 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8645b35-7f67-4b18-a78c-51ece7eb9a8f admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:03.012885 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28922f3d-0132-413b-87e0-1bb5840195e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:03.014607 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28922f3d-0132-413b-87e0-1bb5840195e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:03.015409 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28922f3d-0132-413b-87e0-1bb5840195e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:03.015828 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28922f3d-0132-413b-87e0-1bb5840195e9 admin admin] PATH_INFO: `/v3/users/65a652def16e4c658e0b67291ca60a34` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:03.017995 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28922f3d-0132-413b-87e0-1bb5840195e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65a652def16e4c658e0b67291ca60a34)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:03.021955 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28922f3d-0132-413b-87e0-1bb5840195e9 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:03.330090 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-28922f3d-0132-413b-87e0-1bb5840195e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65a652def16e4c658e0b67291ca60a34'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:03.339725 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-28922f3d-0132-413b-87e0-1bb5840195e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65a652def16e4c658e0b67291ca60a34'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:03.340705 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-28922f3d-0132-413b-87e0-1bb5840195e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65a652def16e4c658e0b67291ca60a34'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:03.432464 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-28922f3d-0132-413b-87e0-1bb5840195e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65a652def16e4c658e0b67291ca60a34'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:03.461635 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-28922f3d-0132-413b-87e0-1bb5840195e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65a652def16e4c658e0b67291ca60a34'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:03.477381 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1171/2356] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:13:02 2022] DELETE /identity/v3/users/65a652def16e4c658e0b67291ca60a34 => generated 0 bytes in 692 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:13:03.481905 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8711db22-5dfd-479a-8162-368a0a1f47d5 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:03.483927 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-8711db22-5dfd-479a-8162-368a0a1f47d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:03.510556 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8711db22-5dfd-479a-8162-368a0a1f47d5 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:03.635383 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28922f3d-0132-413b-87e0-1bb5840195e9 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:03.638044 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-28922f3d-0132-413b-87e0-1bb5840195e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:03.665900 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1719d1-635f-4227-997e-21a6138232d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:03.670700 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1719d1-635f-4227-997e-21a6138232d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:03.670700 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1719d1-635f-4227-997e-21a6138232d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:03.670700 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1719d1-635f-4227-997e-21a6138232d3 admin admin] PATH_INFO: `/v3/projects/e3c4034dc5694a6083ecfb051be2958c` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:03.693461 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1719d1-635f-4227-997e-21a6138232d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3c4034dc5694a6083ecfb051be2958c)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:03.699390 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1719d1-635f-4227-997e-21a6138232d3 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:03.775824 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28922f3d-0132-413b-87e0-1bb5840195e9 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:03.786676 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac849d5-8a47-4624-b367-ec01597ea98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:03.787595 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac849d5-8a47-4624-b367-ec01597ea98d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:03.787879 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac849d5-8a47-4624-b367-ec01597ea98d admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:03.788148 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac849d5-8a47-4624-b367-ec01597ea98d admin admin] PATH_INFO: `/v3/projects/52748c4cf00740c880b3cdcd92f5b90e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:03.790063 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac849d5-8a47-4624-b367-ec01597ea98d admin admin] RBAC: Authorizing `identity:delete_project(project_id=52748c4cf00740c880b3cdcd92f5b90e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:03.792070 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac849d5-8a47-4624-b367-ec01597ea98d admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:03.902442 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5d1719d1-635f-4227-997e-21a6138232d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3c4034dc5694a6083ecfb051be2958c', 'request_id': 'req-5d1719d1-635f-4227-997e-21a6138232d3'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:03.907780 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5d1719d1-635f-4227-997e-21a6138232d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3c4034dc5694a6083ecfb051be2958c', 'request_id': 'req-5d1719d1-635f-4227-997e-21a6138232d3'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:04.012223 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-6ac849d5-8a47-4624-b367-ec01597ea98d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52748c4cf00740c880b3cdcd92f5b90e', 'request_id': 'req-6ac849d5-8a47-4624-b367-ec01597ea98d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:04.019419 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5d1719d1-635f-4227-997e-21a6138232d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3c4034dc5694a6083ecfb051be2958c', 'request_id': 'req-5d1719d1-635f-4227-997e-21a6138232d3'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:04.036807 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-6ac849d5-8a47-4624-b367-ec01597ea98d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52748c4cf00740c880b3cdcd92f5b90e', 'request_id': 'req-6ac849d5-8a47-4624-b367-ec01597ea98d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:04.053434 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5d1719d1-635f-4227-997e-21a6138232d3 admin admin] The token cache is being invalidate because project e3c4034dc5694a6083ecfb051be2958c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:13:04.053791 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5d1719d1-635f-4227-997e-21a6138232d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:04.054980 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5d1719d1-635f-4227-997e-21a6138232d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:04.060182 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-6ac849d5-8a47-4624-b367-ec01597ea98d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52748c4cf00740c880b3cdcd92f5b90e', 'request_id': 'req-6ac849d5-8a47-4624-b367-ec01597ea98d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:04.061451 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1186/2357] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:13:03 2022] DELETE /identity/v3/projects/e3c4034dc5694a6083ecfb051be2958c => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:13:04.066741 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b1ee0-d103-484f-9e91-bcd9b7f15944 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:04.067037 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b1ee0-d103-484f-9e91-bcd9b7f15944 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:04.069519 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b1ee0-d103-484f-9e91-bcd9b7f15944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:04.128918 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-b93b1ee0-d103-484f-9e91-bcd9b7f15944 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:04.130278 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b93b1ee0-d103-484f-9e91-bcd9b7f15944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:04.174656 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-6ac849d5-8a47-4624-b367-ec01597ea98d admin admin] The token cache is being invalidate because project 52748c4cf00740c880b3cdcd92f5b90e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:13:04.175029 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-6ac849d5-8a47-4624-b367-ec01597ea98d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:04.181095 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-6ac849d5-8a47-4624-b367-ec01597ea98d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:04.187646 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1172/2358] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:13:03 2022] DELETE /identity/v3/projects/52748c4cf00740c880b3cdcd92f5b90e => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:13:04.189412 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4457c-28d8-4094-8879-d29979f8b364 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:04.189945 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4457c-28d8-4094-8879-d29979f8b364 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:04.190040 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4457c-28d8-4094-8879-d29979f8b364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:04.209780 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-b7e4457c-28d8-4094-8879-d29979f8b364 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:04.211109 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b7e4457c-28d8-4094-8879-d29979f8b364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:04.241869 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1187/2359] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:13:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:13:04.252596 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed13e04-10da-4c03-b0b8-3536f834491d None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:04.253018 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed13e04-10da-4c03-b0b8-3536f834491d None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:04.253530 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed13e04-10da-4c03-b0b8-3536f834491d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:04.300057 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1173/2360] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:13:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:13:04.300996 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e4457c-28d8-4094-8879-d29979f8b364 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:04.302492 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b7e4457c-28d8-4094-8879-d29979f8b364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:04.316187 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e4457c-28d8-4094-8879-d29979f8b364 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:04.321556 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051dd2b7-ad15-4097-b610-60c868671108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:04.328000 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-3ed13e04-10da-4c03-b0b8-3536f834491d None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:04.329225 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-3ed13e04-10da-4c03-b0b8-3536f834491d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:04.330944 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051dd2b7-ad15-4097-b610-60c868671108 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:04.331241 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051dd2b7-ad15-4097-b610-60c868671108 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:04.331584 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051dd2b7-ad15-4097-b610-60c868671108 admin admin] PATH_INFO: `/v3/projects/78ff7c8c227d4782963792034d7cd5ab` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:04.333492 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051dd2b7-ad15-4097-b610-60c868671108 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78ff7c8c227d4782963792034d7cd5ab)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:04.335455 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051dd2b7-ad15-4097-b610-60c868671108 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:04.351745 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1188/2361] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:13:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:13:04.353448 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6345290-ace3-493d-a59d-7153c8f7cb01 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:04.353879 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6345290-ace3-493d-a59d-7153c8f7cb01 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:04.354228 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6345290-ace3-493d-a59d-7153c8f7cb01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:04.399577 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-d6345290-ace3-493d-a59d-7153c8f7cb01 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:04.403094 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d6345290-ace3-493d-a59d-7153c8f7cb01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:04.418749 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1189/2362] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:13:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:13:04.420006 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6345290-ace3-493d-a59d-7153c8f7cb01 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:04.435002 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6345290-ace3-493d-a59d-7153c8f7cb01 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:04.442093 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e71f70-14c2-4d16-896d-8a877cfb10d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:04.443113 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e71f70-14c2-4d16-896d-8a877cfb10d2 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:04.443660 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e71f70-14c2-4d16-896d-8a877cfb10d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:04.444519 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e71f70-14c2-4d16-896d-8a877cfb10d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:04.445931 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e71f70-14c2-4d16-896d-8a877cfb10d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:13:04.446511 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e71f70-14c2-4d16-896d-8a877cfb10d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:04.448994 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e71f70-14c2-4d16-896d-8a877cfb10d2 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:04.473142 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1190/2363] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:13:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:13:04.475455 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e71f70-14c2-4d16-896d-8a877cfb10d2 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:04.487947 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e71f70-14c2-4d16-896d-8a877cfb10d2 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:04.500624 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ff7c2-5fce-40cc-b05a-6b05ff20bfb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:04.501640 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ff7c2-5fce-40cc-b05a-6b05ff20bfb5 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:04.502155 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ff7c2-5fce-40cc-b05a-6b05ff20bfb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:04.502604 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ff7c2-5fce-40cc-b05a-6b05ff20bfb5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:04.505012 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8ff7c2-5fce-40cc-b05a-6b05ff20bfb5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:13:04.505012 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8ff7c2-5fce-40cc-b05a-6b05ff20bfb5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:04.505991 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8ff7c2-5fce-40cc-b05a-6b05ff20bfb5 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:04.521057 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1191/2364] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:13:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:13:04.522238 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ff7c2-5fce-40cc-b05a-6b05ff20bfb5 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:04.536029 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-051dd2b7-ad15-4097-b610-60c868671108 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78ff7c8c227d4782963792034d7cd5ab', 'request_id': 'req-051dd2b7-ad15-4097-b610-60c868671108'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:04.585219 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-051dd2b7-ad15-4097-b610-60c868671108 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78ff7c8c227d4782963792034d7cd5ab', 'request_id': 'req-051dd2b7-ad15-4097-b610-60c868671108'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:04.587659 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ff7c2-5fce-40cc-b05a-6b05ff20bfb5 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:04.612917 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-051dd2b7-ad15-4097-b610-60c868671108 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78ff7c8c227d4782963792034d7cd5ab', 'request_id': 'req-051dd2b7-ad15-4097-b610-60c868671108'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:04.769099 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c0961e-1990-4406-81dd-277b8a7a6a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:04.774557 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c0961e-1990-4406-81dd-277b8a7a6a53 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:04.774557 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c0961e-1990-4406-81dd-277b8a7a6a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:04.774557 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c0961e-1990-4406-81dd-277b8a7a6a53 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:04.774557 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c0961e-1990-4406-81dd-277b8a7a6a53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:04.774557 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c0961e-1990-4406-81dd-277b8a7a6a53 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:04.790132 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-051dd2b7-ad15-4097-b610-60c868671108 admin admin] The token cache is being invalidate because project 78ff7c8c227d4782963792034d7cd5ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:13:04.790443 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-051dd2b7-ad15-4097-b610-60c868671108 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:04.792671 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-051dd2b7-ad15-4097-b610-60c868671108 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:04.797787 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1174/2365] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:13:04 2022] DELETE /identity/v3/projects/78ff7c8c227d4782963792034d7cd5ab => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:13:04.803528 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051dd2b7-ad15-4097-b610-60c868671108 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:04.808458 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-051dd2b7-ad15-4097-b610-60c868671108 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:04.846123 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051dd2b7-ad15-4097-b610-60c868671108 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:04.862978 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ec375-cc39-4972-b26d-90bbba5db7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:04.870254 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ec375-cc39-4972-b26d-90bbba5db7f9 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:04.870254 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ec375-cc39-4972-b26d-90bbba5db7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:04.870254 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ec375-cc39-4972-b26d-90bbba5db7f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:04.870254 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1ec375-cc39-4972-b26d-90bbba5db7f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:04.870254 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1ec375-cc39-4972-b26d-90bbba5db7f9 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:04.881585 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1192/2366] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:13:04 2022] POST /identity/v3/projects => generated 383 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:13:04.882521 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386e7f0-8dd6-468b-a44d-47afd79738b5 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:04.883690 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386e7f0-8dd6-468b-a44d-47afd79738b5 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:04.884309 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386e7f0-8dd6-468b-a44d-47afd79738b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:04.973734 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-c386e7f0-8dd6-468b-a44d-47afd79738b5 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:04.976290 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c386e7f0-8dd6-468b-a44d-47afd79738b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:05.044372 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1175/2367] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:13:04 2022] POST /identity/v3/projects => generated 385 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:13:05.045440 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ec375-cc39-4972-b26d-90bbba5db7f9 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:05.051587 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-2d1ec375-cc39-4972-b26d-90bbba5db7f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:05.161524 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ec375-cc39-4972-b26d-90bbba5db7f9 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:05.182690 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45910fbe-dbe9-4829-9ccc-4e3c4632b9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:05.183953 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45910fbe-dbe9-4829-9ccc-4e3c4632b9eb admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:05.184359 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45910fbe-dbe9-4829-9ccc-4e3c4632b9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:05.184707 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45910fbe-dbe9-4829-9ccc-4e3c4632b9eb admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:05.185611 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45910fbe-dbe9-4829-9ccc-4e3c4632b9eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:05.192157 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45910fbe-dbe9-4829-9ccc-4e3c4632b9eb admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:05.220455 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1193/2368] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:13:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:13:05.220455 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c386e7f0-8dd6-468b-a44d-47afd79738b5 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:05.225214 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c386e7f0-8dd6-468b-a44d-47afd79738b5 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:05.231318 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bf8a26-029b-4159-aa4b-3a56c7da9ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:05.232260 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf8a26-029b-4159-aa4b-3a56c7da9ba2 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:05.232545 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf8a26-029b-4159-aa4b-3a56c7da9ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:05.232823 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf8a26-029b-4159-aa4b-3a56c7da9ba2 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:05.234269 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bf8a26-029b-4159-aa4b-3a56c7da9ba2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:05.236374 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bf8a26-029b-4159-aa4b-3a56c7da9ba2 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:05.339806 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1194/2369] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:13:05 2022] POST /identity/v3/users => generated 293 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:13:05.340012 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1176/2370] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:13:05 2022] POST /identity/v3/users => generated 292 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:13:05.341418 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45910fbe-dbe9-4829-9ccc-4e3c4632b9eb admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:05.343599 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a34b2dd-b36c-465d-b635-a7bf44093617 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:05.344324 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a34b2dd-b36c-465d-b635-a7bf44093617 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:05.344616 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a34b2dd-b36c-465d-b635-a7bf44093617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:05.368352 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45910fbe-dbe9-4829-9ccc-4e3c4632b9eb admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:05.375228 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-0a34b2dd-b36c-465d-b635-a7bf44093617 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:05.377644 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-0a34b2dd-b36c-465d-b635-a7bf44093617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:05.385154 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc3a240-c879-480d-a447-b6b2f5383fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:05.392636 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc3a240-c879-480d-a447-b6b2f5383fb5 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:05.392636 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc3a240-c879-480d-a447-b6b2f5383fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:05.392636 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc3a240-c879-480d-a447-b6b2f5383fb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:05.392636 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc3a240-c879-480d-a447-b6b2f5383fb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:05.392636 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc3a240-c879-480d-a447-b6b2f5383fb5 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:05.396506 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1195/2371] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:13:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:13:05.396506 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a34b2dd-b36c-465d-b635-a7bf44093617 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:05.413780 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a34b2dd-b36c-465d-b635-a7bf44093617 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:05.420347 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1177/2372] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:13:05 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:13:05.421921 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc3a240-c879-480d-a447-b6b2f5383fb5 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:05.437422 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bd223e-cb42-4b55-b1c5-0175cd09697e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:05.438250 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd223e-cb42-4b55-b1c5-0175cd09697e admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:05.438547 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd223e-cb42-4b55-b1c5-0175cd09697e admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:05.442504 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc3a240-c879-480d-a447-b6b2f5383fb5 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:05.451199 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd223e-cb42-4b55-b1c5-0175cd09697e admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:05.452158 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bd223e-cb42-4b55-b1c5-0175cd09697e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:05.453356 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348bf554-0c13-426f-a441-ca3cc3ea69a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:05.455205 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348bf554-0c13-426f-a441-ca3cc3ea69a3 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:05.455514 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348bf554-0c13-426f-a441-ca3cc3ea69a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:05.456152 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bd223e-cb42-4b55-b1c5-0175cd09697e admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:05.457050 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348bf554-0c13-426f-a441-ca3cc3ea69a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:05.457811 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348bf554-0c13-426f-a441-ca3cc3ea69a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:13:05.459267 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348bf554-0c13-426f-a441-ca3cc3ea69a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:05.464001 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348bf554-0c13-426f-a441-ca3cc3ea69a3 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:05.487872 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1196/2373] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:13:05 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:13:05.487872 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bd223e-cb42-4b55-b1c5-0175cd09697e admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:05.488608 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1178/2374] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:13:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:13:05.488608 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348bf554-0c13-426f-a441-ca3cc3ea69a3 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:05.504298 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bd223e-cb42-4b55-b1c5-0175cd09697e admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:05.511021 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348bf554-0c13-426f-a441-ca3cc3ea69a3 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:05.516586 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8334e5b5-eed9-403f-bfeb-cdc04d1d1b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:05.517015 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8334e5b5-eed9-403f-bfeb-cdc04d1d1b33 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:05.517267 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e33ac9-1cf0-4833-9051-62b5fa26eb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:05.517417 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8334e5b5-eed9-403f-bfeb-cdc04d1d1b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:05.517633 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8334e5b5-eed9-403f-bfeb-cdc04d1d1b33 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:05.518091 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e33ac9-1cf0-4833-9051-62b5fa26eb08 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:05.518490 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e33ac9-1cf0-4833-9051-62b5fa26eb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:05.518606 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8334e5b5-eed9-403f-bfeb-cdc04d1d1b33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:05.518853 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e33ac9-1cf0-4833-9051-62b5fa26eb08 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:05.519902 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e33ac9-1cf0-4833-9051-62b5fa26eb08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:05.520531 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8334e5b5-eed9-403f-bfeb-cdc04d1d1b33 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:05.521952 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e33ac9-1cf0-4833-9051-62b5fa26eb08 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:05.557255 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1197/2375] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:13:05 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:13:05.558280 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8334e5b5-eed9-403f-bfeb-cdc04d1d1b33 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:05.571169 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8334e5b5-eed9-403f-bfeb-cdc04d1d1b33 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:05.578028 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba2b7c9-bba0-49d2-980c-a83804ca0e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:05.578846 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2b7c9-bba0-49d2-980c-a83804ca0e60 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:05.579175 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2b7c9-bba0-49d2-980c-a83804ca0e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:05.579459 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2b7c9-bba0-49d2-980c-a83804ca0e60 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:05.580214 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba2b7c9-bba0-49d2-980c-a83804ca0e60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:05.582135 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba2b7c9-bba0-49d2-980c-a83804ca0e60 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:05.595670 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1198/2376] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:13:05 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:13:05.597151 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba2b7c9-bba0-49d2-980c-a83804ca0e60 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:05.615244 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba2b7c9-bba0-49d2-980c-a83804ca0e60 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:05.619867 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbea190-7e74-48f5-9936-e3e6fbca4cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:05.623239 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbea190-7e74-48f5-9936-e3e6fbca4cc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:05.623239 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbea190-7e74-48f5-9936-e3e6fbca4cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:05.623239 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbea190-7e74-48f5-9936-e3e6fbca4cc0 admin admin] PATH_INFO: `/v3/projects/e4af8109ce4a4e98a2e7104125651db0/users/911b9cf4e9bc424bba387e2ff966cb46/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:05.651770 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1179/2377] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:13:05 2022] POST /identity/v3/projects => generated 403 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:13:05.652788 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e33ac9-1cf0-4833-9051-62b5fa26eb08 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:05.667281 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbea190-7e74-48f5-9936-e3e6fbca4cc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4af8109ce4a4e98a2e7104125651db0, user_id=911b9cf4e9bc424bba387e2ff966cb46, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:05.672437 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbea190-7e74-48f5-9936-e3e6fbca4cc0 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:05.801048 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1199/2378] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:13:05 2022] PUT /identity/v3/projects/e4af8109ce4a4e98a2e7104125651db0/users/911b9cf4e9bc424bba387e2ff966cb46/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:13:05.802792 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbea190-7e74-48f5-9936-e3e6fbca4cc0 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:05.832244 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e33ac9-1cf0-4833-9051-62b5fa26eb08 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:05.934505 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbea190-7e74-48f5-9936-e3e6fbca4cc0 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:05.941300 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54bb23d-28ec-406e-9dc9-24a7bb3ad2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:05.944309 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54bb23d-28ec-406e-9dc9-24a7bb3ad2d7 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:05.944743 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54bb23d-28ec-406e-9dc9-24a7bb3ad2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:05.955155 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54bb23d-28ec-406e-9dc9-24a7bb3ad2d7 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:05.955155 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54bb23d-28ec-406e-9dc9-24a7bb3ad2d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:05.955155 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54bb23d-28ec-406e-9dc9-24a7bb3ad2d7 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:05.961736 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85963dd2-a6f3-4c84-afb1-4e6af6efaaee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:05.966988 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85963dd2-a6f3-4c84-afb1-4e6af6efaaee admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:05.968779 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85963dd2-a6f3-4c84-afb1-4e6af6efaaee admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:05.969246 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85963dd2-a6f3-4c84-afb1-4e6af6efaaee admin admin] PATH_INFO: `/v3/projects/e3b587b3031449a3a23187f2df762615/users/849f6a4bcb77491bba6647995546bb7a/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:05.995649 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85963dd2-a6f3-4c84-afb1-4e6af6efaaee admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3b587b3031449a3a23187f2df762615, user_id=849f6a4bcb77491bba6647995546bb7a, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:05.998532 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85963dd2-a6f3-4c84-afb1-4e6af6efaaee admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:06.060644 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1200/2379] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:13:05 2022] POST /identity/v3/users => generated 302 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:13:06.064339 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58fcc8f-8c13-48f5-8147-a341a4d27caa None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:06.066971 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58fcc8f-8c13-48f5-8147-a341a4d27caa None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:06.068097 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58fcc8f-8c13-48f5-8147-a341a4d27caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:06.113397 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1180/2380] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:13:05 2022] PUT /identity/v3/projects/e3b587b3031449a3a23187f2df762615/users/849f6a4bcb77491bba6647995546bb7a/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:13:06.114231 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85963dd2-a6f3-4c84-afb1-4e6af6efaaee admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:06.136984 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-f58fcc8f-8c13-48f5-8147-a341a4d27caa None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:06.139224 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-f58fcc8f-8c13-48f5-8147-a341a4d27caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:06.285268 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1201/2381] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:13:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:13:06.287615 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca895665-854c-4ccb-a227-0d1e388f2098 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:06.288145 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca895665-854c-4ccb-a227-0d1e388f2098 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:06.291180 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca895665-854c-4ccb-a227-0d1e388f2098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:06.340673 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85963dd2-a6f3-4c84-afb1-4e6af6efaaee admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:06.365100 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5e7786-41f0-4f96-9bd5-4b96d946dbe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:06.366247 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e7786-41f0-4f96-9bd5-4b96d946dbe7 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:06.366765 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e7786-41f0-4f96-9bd5-4b96d946dbe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:06.367267 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e7786-41f0-4f96-9bd5-4b96d946dbe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:06.368710 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5e7786-41f0-4f96-9bd5-4b96d946dbe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:06.385485 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5e7786-41f0-4f96-9bd5-4b96d946dbe7 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:06.417943 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-ca895665-854c-4ccb-a227-0d1e388f2098 None None] MFA Rules not processed for user `849f6a4bcb77491bba6647995546bb7a`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:06.420368 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ca895665-854c-4ccb-a227-0d1e388f2098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:06.431424 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1181/2382] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:13:06 2022] GET /identity/v3/roles => generated 1420 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:13:06.433868 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5e7786-41f0-4f96-9bd5-4b96d946dbe7 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:06.440719 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-2e5e7786-41f0-4f96-9bd5-4b96d946dbe7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:06.634116 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5e7786-41f0-4f96-9bd5-4b96d946dbe7 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:06.645116 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1202/2383] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:13:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:13:06.651978 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896e3b0e-eec7-4cb0-b9f6-12d4a0bfd6ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:06.656707 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e3b0e-eec7-4cb0-b9f6-12d4a0bfd6ba service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:06.658144 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e3b0e-eec7-4cb0-b9f6-12d4a0bfd6ba service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:06.665340 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e3b0e-eec7-4cb0-b9f6-12d4a0bfd6ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:06.665487 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca895665-854c-4ccb-a227-0d1e388f2098 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:06.665487 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ca895665-854c-4ccb-a227-0d1e388f2098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:06.689107 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896e3b0e-eec7-4cb0-b9f6-12d4a0bfd6ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:06.692286 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896e3b0e-eec7-4cb0-b9f6-12d4a0bfd6ba service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:06.708126 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1182/2384] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:13:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:13:06.709225 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896e3b0e-eec7-4cb0-b9f6-12d4a0bfd6ba service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:06.724145 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca895665-854c-4ccb-a227-0d1e388f2098 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:06.745718 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ce1ff-f51f-43c8-8c0f-f2d67e8c6a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:06.745888 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896e3b0e-eec7-4cb0-b9f6-12d4a0bfd6ba service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:06.746000 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ce1ff-f51f-43c8-8c0f-f2d67e8c6a79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:06.746000 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ce1ff-f51f-43c8-8c0f-f2d67e8c6a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:06.746000 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ce1ff-f51f-43c8-8c0f-f2d67e8c6a79 admin admin] PATH_INFO: `/v3/users/6ca2cafc3b794c88b48510b5d466b580` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:06.746000 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07ce1ff-f51f-43c8-8c0f-f2d67e8c6a79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ca2cafc3b794c88b48510b5d466b580)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:06.749719 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07ce1ff-f51f-43c8-8c0f-f2d67e8c6a79 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:06.755236 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4291e364-2887-44d5-9f6a-1d0475500e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:06.756123 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4291e364-2887-44d5-9f6a-1d0475500e9f admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:06.756821 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4291e364-2887-44d5-9f6a-1d0475500e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:06.757204 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4291e364-2887-44d5-9f6a-1d0475500e9f admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:06.758772 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4291e364-2887-44d5-9f6a-1d0475500e9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:06.764730 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4291e364-2887-44d5-9f6a-1d0475500e9f admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:06.793464 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1183/2385] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:13:06 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:13:06.794625 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4291e364-2887-44d5-9f6a-1d0475500e9f admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:06.806617 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4291e364-2887-44d5-9f6a-1d0475500e9f admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:06.814736 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c98c708-94f5-40ea-aed0-02d77f2e4737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:06.815630 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98c708-94f5-40ea-aed0-02d77f2e4737 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:06.816010 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98c708-94f5-40ea-aed0-02d77f2e4737 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:06.816388 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98c708-94f5-40ea-aed0-02d77f2e4737 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:06.817195 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c98c708-94f5-40ea-aed0-02d77f2e4737 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:06.819788 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c98c708-94f5-40ea-aed0-02d77f2e4737 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:06.959562 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1184/2386] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:13:06 2022] POST /identity/v3/projects => generated 381 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:13:06.960402 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c98c708-94f5-40ea-aed0-02d77f2e4737 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:07.037027 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b07ce1ff-f51f-43c8-8c0f-f2d67e8c6a79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ca2cafc3b794c88b48510b5d466b580'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:07.075241 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b07ce1ff-f51f-43c8-8c0f-f2d67e8c6a79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ca2cafc3b794c88b48510b5d466b580'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:07.091760 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b07ce1ff-f51f-43c8-8c0f-f2d67e8c6a79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ca2cafc3b794c88b48510b5d466b580'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:07.115458 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c98c708-94f5-40ea-aed0-02d77f2e4737 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:07.129835 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c092f7bf-5405-4fa5-8e5b-e5d0c82dd8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:07.130755 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c092f7bf-5405-4fa5-8e5b-e5d0c82dd8a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:07.131038 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c092f7bf-5405-4fa5-8e5b-e5d0c82dd8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:07.131768 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c092f7bf-5405-4fa5-8e5b-e5d0c82dd8a1 admin admin] PATH_INFO: `/v3/projects/d2bea4301559473ea442e85b66e225b3/users/6840e733cb0f49eb9492da7e4c042b58/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:07.164992 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c092f7bf-5405-4fa5-8e5b-e5d0c82dd8a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2bea4301559473ea442e85b66e225b3, user_id=6840e733cb0f49eb9492da7e4c042b58, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:07.168040 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c092f7bf-5405-4fa5-8e5b-e5d0c82dd8a1 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:07.230057 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b07ce1ff-f51f-43c8-8c0f-f2d67e8c6a79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ca2cafc3b794c88b48510b5d466b580'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:07.230806 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b07ce1ff-f51f-43c8-8c0f-f2d67e8c6a79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ca2cafc3b794c88b48510b5d466b580'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:07.242175 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1203/2387] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:13:06 2022] DELETE /identity/v3/users/6ca2cafc3b794c88b48510b5d466b580 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:13:07.243382 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ce1ff-f51f-43c8-8c0f-f2d67e8c6a79 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:07.252151 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b07ce1ff-f51f-43c8-8c0f-f2d67e8c6a79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:07.300552 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1185/2388] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:13:06 2022] PUT /identity/v3/projects/d2bea4301559473ea442e85b66e225b3/users/6840e733cb0f49eb9492da7e4c042b58/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:13:07.302217 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a37fd5-e096-4b63-baec-75e6f87b82a8 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:07.308653 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a37fd5-e096-4b63-baec-75e6f87b82a8 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:07.311032 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a37fd5-e096-4b63-baec-75e6f87b82a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:07.340241 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-46a37fd5-e096-4b63-baec-75e6f87b82a8 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:07.343568 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-46a37fd5-e096-4b63-baec-75e6f87b82a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:07.388694 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ce1ff-f51f-43c8-8c0f-f2d67e8c6a79 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:07.495884 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1186/2389] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:13:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:13:07.497691 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d70639d-058e-40a1-8aea-ac87a1f339fa None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:07.498121 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d70639d-058e-40a1-8aea-ac87a1f339fa None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:07.499420 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d70639d-058e-40a1-8aea-ac87a1f339fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:07.532052 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9732b2-a2aa-42d7-8c76-300cc0756308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:07.532756 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9732b2-a2aa-42d7-8c76-300cc0756308 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:07.533072 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9732b2-a2aa-42d7-8c76-300cc0756308 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:07.533368 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9732b2-a2aa-42d7-8c76-300cc0756308 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:07.534151 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9732b2-a2aa-42d7-8c76-300cc0756308 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:07.535114 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-1d70639d-058e-40a1-8aea-ac87a1f339fa None None] MFA Rules not processed for user `36c32d3de24045bdbfce30559ea022e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:07.536160 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9732b2-a2aa-42d7-8c76-300cc0756308 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:07.538656 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-1d70639d-058e-40a1-8aea-ac87a1f339fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:07.643994 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1187/2390] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:13:07 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:13:07.650905 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981fdc0-6a59-4669-926e-7ae617f4cac0 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:07.651239 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981fdc0-6a59-4669-926e-7ae617f4cac0 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:07.651552 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981fdc0-6a59-4669-926e-7ae617f4cac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:07.672768 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1204/2391] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:13:07 2022] POST /identity/v3/users => generated 297 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:13:07.676395 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9732b2-a2aa-42d7-8c76-300cc0756308 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:07.681588 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-8c9732b2-a2aa-42d7-8c76-300cc0756308 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:07.703440 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-e981fdc0-6a59-4669-926e-7ae617f4cac0 None None] MFA Rules not processed for user `6840e733cb0f49eb9492da7e4c042b58`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:07.704877 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e981fdc0-6a59-4669-926e-7ae617f4cac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:07.834578 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1188/2392] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:13:07 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:13:07.836812 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e981fdc0-6a59-4669-926e-7ae617f4cac0 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:07.840538 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9732b2-a2aa-42d7-8c76-300cc0756308 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:07.864300 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f096177-4fe7-49bb-ac8d-f394e8cfc926 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:07.866363 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f096177-4fe7-49bb-ac8d-f394e8cfc926 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:07.866659 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f096177-4fe7-49bb-ac8d-f394e8cfc926 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:07.871178 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f096177-4fe7-49bb-ac8d-f394e8cfc926 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:07.884465 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e981fdc0-6a59-4669-926e-7ae617f4cac0 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:07.901619 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6732bec2-5fa9-4caa-ab4b-13bd0c1f9b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:07.902636 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6732bec2-5fa9-4caa-ab4b-13bd0c1f9b1c admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:07.902636 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6732bec2-5fa9-4caa-ab4b-13bd0c1f9b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:07.902940 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6732bec2-5fa9-4caa-ab4b-13bd0c1f9b1c admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:07.903619 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6732bec2-5fa9-4caa-ab4b-13bd0c1f9b1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:07.905916 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f096177-4fe7-49bb-ac8d-f394e8cfc926 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:07.906066 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6732bec2-5fa9-4caa-ab4b-13bd0c1f9b1c admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:07.908343 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f096177-4fe7-49bb-ac8d-f394e8cfc926 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:07.936090 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1189/2394] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:13:07 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:13:07.937649 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6732bec2-5fa9-4caa-ab4b-13bd0c1f9b1c admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:07.939570 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-6732bec2-5fa9-4caa-ab4b-13bd0c1f9b1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:07.947088 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1205/2394] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:13:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:13:07.955450 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f096177-4fe7-49bb-ac8d-f394e8cfc926 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:07.957285 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6732bec2-5fa9-4caa-ab4b-13bd0c1f9b1c admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:07.962128 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8210f6a-7611-4d6c-b73d-d46a0e4d1826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:07.963052 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8210f6a-7611-4d6c-b73d-d46a0e4d1826 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:07.964165 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8210f6a-7611-4d6c-b73d-d46a0e4d1826 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:07.964472 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8210f6a-7611-4d6c-b73d-d46a0e4d1826 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:07.965178 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8210f6a-7611-4d6c-b73d-d46a0e4d1826 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:07.967960 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8210f6a-7611-4d6c-b73d-d46a0e4d1826 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:07.977971 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f096177-4fe7-49bb-ac8d-f394e8cfc926 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:07.997527 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde00d38-ce98-49e9-81b2-4fd08947f2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:07.999815 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde00d38-ce98-49e9-81b2-4fd08947f2ea admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:08.000282 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde00d38-ce98-49e9-81b2-4fd08947f2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:08.000710 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde00d38-ce98-49e9-81b2-4fd08947f2ea admin admin] PATH_INFO: `/v3/projects/0a9e752fe7b147709743258855e42c78/users/4a62a8b9576a4cf08ee1ba5b8d500b6f/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:08.018519 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde00d38-ce98-49e9-81b2-4fd08947f2ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a9e752fe7b147709743258855e42c78, user_id=4a62a8b9576a4cf08ee1ba5b8d500b6f, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:08.021696 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde00d38-ce98-49e9-81b2-4fd08947f2ea admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:08.090790 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1190/2395] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:13:07 2022] POST /identity/v3/projects => generated 401 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:13:08.098968 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8210f6a-7611-4d6c-b73d-d46a0e4d1826 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:08.224733 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8210f6a-7611-4d6c-b73d-d46a0e4d1826 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:08.230355 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b440fa-b106-44eb-b049-4cd778ed1513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:08.243291 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b440fa-b106-44eb-b049-4cd778ed1513 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:08.243783 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b440fa-b106-44eb-b049-4cd778ed1513 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:08.244236 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b440fa-b106-44eb-b049-4cd778ed1513 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:08.245603 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b440fa-b106-44eb-b049-4cd778ed1513 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:08.249243 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b440fa-b106-44eb-b049-4cd778ed1513 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:08.322626 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1206/2396] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:13:07 2022] PUT /identity/v3/projects/0a9e752fe7b147709743258855e42c78/users/4a62a8b9576a4cf08ee1ba5b8d500b6f/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:13:08.343756 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde00d38-ce98-49e9-81b2-4fd08947f2ea admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:08.395417 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1191/2397] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:13:08 2022] POST /identity/v3/users => generated 307 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:13:08.399411 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b440fa-b106-44eb-b049-4cd778ed1513 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:08.422263 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b440fa-b106-44eb-b049-4cd778ed1513 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:08.494597 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde00d38-ce98-49e9-81b2-4fd08947f2ea admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:08.507809 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1923a0d0-78d2-4508-811b-8f777266f88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:08.508503 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1923a0d0-78d2-4508-811b-8f777266f88d admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:08.508788 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1923a0d0-78d2-4508-811b-8f777266f88d admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:08.509070 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1923a0d0-78d2-4508-811b-8f777266f88d admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:08.509864 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1923a0d0-78d2-4508-811b-8f777266f88d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:08.514898 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1923a0d0-78d2-4508-811b-8f777266f88d admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:08.532362 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9892ae-2616-461a-827f-5a25b832a94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:08.532362 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9892ae-2616-461a-827f-5a25b832a94c admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:08.532362 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9892ae-2616-461a-827f-5a25b832a94c admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:08.532362 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9892ae-2616-461a-827f-5a25b832a94c admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:08.532688 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9892ae-2616-461a-827f-5a25b832a94c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:08.532688 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9892ae-2616-461a-827f-5a25b832a94c admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:08.543019 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1207/2398] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:13:08 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:13:08.544251 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1923a0d0-78d2-4508-811b-8f777266f88d admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:08.572362 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1923a0d0-78d2-4508-811b-8f777266f88d admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:08.587343 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7e6174-2729-42fe-9121-7d2dc003e250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:08.588284 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e6174-2729-42fe-9121-7d2dc003e250 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:08.588567 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e6174-2729-42fe-9121-7d2dc003e250 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:08.588845 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e6174-2729-42fe-9121-7d2dc003e250 admin admin] PATH_INFO: `/v3/projects/0a9e752fe7b147709743258855e42c78/users/4a62a8b9576a4cf08ee1ba5b8d500b6f/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:08.593165 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7e6174-2729-42fe-9121-7d2dc003e250 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a9e752fe7b147709743258855e42c78, user_id=4a62a8b9576a4cf08ee1ba5b8d500b6f, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:08.594326 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1192/2399] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:13:08 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:13:08.595300 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9892ae-2616-461a-827f-5a25b832a94c admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:08.600590 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7e6174-2729-42fe-9121-7d2dc003e250 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:08.608364 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-7b9892ae-2616-461a-827f-5a25b832a94c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:08.623919 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9892ae-2616-461a-827f-5a25b832a94c admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:08.627845 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1208/2400] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:13:08 2022] PUT /identity/v3/projects/0a9e752fe7b147709743258855e42c78/users/4a62a8b9576a4cf08ee1ba5b8d500b6f/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:13:08.641114 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7e6174-2729-42fe-9121-7d2dc003e250 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:08.707227 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eb696a-892c-41e5-8b76-bf0b453a9fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:08.708410 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb696a-892c-41e5-8b76-bf0b453a9fab admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:08.708909 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb696a-892c-41e5-8b76-bf0b453a9fab admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:08.709442 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb696a-892c-41e5-8b76-bf0b453a9fab admin admin] PATH_INFO: `/v3/projects/9ffe47c465e1480d91f689bed8e9ed94` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:08.710899 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eb696a-892c-41e5-8b76-bf0b453a9fab admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ffe47c465e1480d91f689bed8e9ed94)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:08.714844 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eb696a-892c-41e5-8b76-bf0b453a9fab admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:08.811415 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7e6174-2729-42fe-9121-7d2dc003e250 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:08.819407 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3b0716-77ea-4476-b817-b442439df82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:08.821449 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b0716-77ea-4476-b817-b442439df82b admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:08.822312 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b0716-77ea-4476-b817-b442439df82b admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:08.823142 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b0716-77ea-4476-b817-b442439df82b admin admin] PATH_INFO: `/v3/projects/0d7b6619a39d40d1b81148b9761ae960/users/4e82245353e64a87967e346fedddf267/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:08.845311 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3b0716-77ea-4476-b817-b442439df82b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d7b6619a39d40d1b81148b9761ae960, user_id=4e82245353e64a87967e346fedddf267, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:08.856890 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3b0716-77ea-4476-b817-b442439df82b admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:08.986423 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1209/2401] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:13:08 2022] PUT /identity/v3/projects/0d7b6619a39d40d1b81148b9761ae960/users/4e82245353e64a87967e346fedddf267/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:13:08.988333 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2afc95-a598-4cdc-8415-eda1655a934b None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:08.989045 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2afc95-a598-4cdc-8415-eda1655a934b None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:08.989653 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2afc95-a598-4cdc-8415-eda1655a934b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:08.991052 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-83eb696a-892c-41e5-8b76-bf0b453a9fab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ffe47c465e1480d91f689bed8e9ed94', 'request_id': 'req-83eb696a-892c-41e5-8b76-bf0b453a9fab'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:09.002446 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-83eb696a-892c-41e5-8b76-bf0b453a9fab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ffe47c465e1480d91f689bed8e9ed94', 'request_id': 'req-83eb696a-892c-41e5-8b76-bf0b453a9fab'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:09.011318 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-83eb696a-892c-41e5-8b76-bf0b453a9fab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ffe47c465e1480d91f689bed8e9ed94', 'request_id': 'req-83eb696a-892c-41e5-8b76-bf0b453a9fab'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:09.044736 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-0b2afc95-a598-4cdc-8415-eda1655a934b None None] MFA Rules not processed for user `4a62a8b9576a4cf08ee1ba5b8d500b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:09.047164 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-0b2afc95-a598-4cdc-8415-eda1655a934b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:09.101544 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-83eb696a-892c-41e5-8b76-bf0b453a9fab admin admin] The token cache is being invalidate because project 9ffe47c465e1480d91f689bed8e9ed94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:13:09.102127 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-83eb696a-892c-41e5-8b76-bf0b453a9fab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:09.103034 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-83eb696a-892c-41e5-8b76-bf0b453a9fab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:09.105208 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1193/2402] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:13:08 2022] DELETE /identity/v3/projects/9ffe47c465e1480d91f689bed8e9ed94 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:13:09.106488 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eb696a-892c-41e5-8b76-bf0b453a9fab admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:09.110375 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-83eb696a-892c-41e5-8b76-bf0b453a9fab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:09.208375 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1210/2403] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:13:08 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:13:09.208518 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2afc95-a598-4cdc-8415-eda1655a934b None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:09.212375 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-0b2afc95-a598-4cdc-8415-eda1655a934b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:09.245641 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eb696a-892c-41e5-8b76-bf0b453a9fab admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:09.251219 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e843b2ed-a3e0-4033-92e0-c5e2495586d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:09.252282 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e843b2ed-a3e0-4033-92e0-c5e2495586d9 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:09.252580 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e843b2ed-a3e0-4033-92e0-c5e2495586d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:09.252859 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e843b2ed-a3e0-4033-92e0-c5e2495586d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:09.254038 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e843b2ed-a3e0-4033-92e0-c5e2495586d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:09.256696 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e843b2ed-a3e0-4033-92e0-c5e2495586d9 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:09.283216 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1194/2404] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:13:09 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:13:09.290023 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e843b2ed-a3e0-4033-92e0-c5e2495586d9 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:09.290023 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e843b2ed-a3e0-4033-92e0-c5e2495586d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:09.362634 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2afc95-a598-4cdc-8415-eda1655a934b None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:09.371642 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e6708d-91ea-40ac-b89d-cff15eb36de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:09.372929 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6708d-91ea-40ac-b89d-cff15eb36de0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:09.373356 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6708d-91ea-40ac-b89d-cff15eb36de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:09.374637 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6708d-91ea-40ac-b89d-cff15eb36de0 admin admin] PATH_INFO: `/v3/users/94856972be884cd7a06b4673411ffea8` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:09.377040 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e6708d-91ea-40ac-b89d-cff15eb36de0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94856972be884cd7a06b4673411ffea8)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:09.382875 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e6708d-91ea-40ac-b89d-cff15eb36de0 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:09.407335 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e843b2ed-a3e0-4033-92e0-c5e2495586d9 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:09.419396 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52154c4d-0156-422e-a2ce-6ca597cb1fe6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:09.420108 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52154c4d-0156-422e-a2ce-6ca597cb1fe6 service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:09.420913 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52154c4d-0156-422e-a2ce-6ca597cb1fe6 service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:09.421641 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52154c4d-0156-422e-a2ce-6ca597cb1fe6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:09.441496 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52154c4d-0156-422e-a2ce-6ca597cb1fe6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:09.443497 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52154c4d-0156-422e-a2ce-6ca597cb1fe6 service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:09.460375 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1195/2405] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:13:09 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:13:09.462157 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ab3c06-0486-4e2b-9968-679f455e86e4 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:09.467973 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ab3c06-0486-4e2b-9968-679f455e86e4 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:09.467973 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ab3c06-0486-4e2b-9968-679f455e86e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:09.499532 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-d7ab3c06-0486-4e2b-9968-679f455e86e4 None None] MFA Rules not processed for user `911b9cf4e9bc424bba387e2ff966cb46`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:09.507674 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-d7ab3c06-0486-4e2b-9968-679f455e86e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:09.577337 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-27e6708d-91ea-40ac-b89d-cff15eb36de0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94856972be884cd7a06b4673411ffea8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:09.603510 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1196/2406] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:13:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:13:09.603510 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ab3c06-0486-4e2b-9968-679f455e86e4 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:09.626043 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ab3c06-0486-4e2b-9968-679f455e86e4 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:09.637582 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e7da90-aca4-47c0-b45c-294ce5305af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:09.637582 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7da90-aca4-47c0-b45c-294ce5305af3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:09.637582 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7da90-aca4-47c0-b45c-294ce5305af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:09.637582 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7da90-aca4-47c0-b45c-294ce5305af3 admin admin] PATH_INFO: `/v3/projects/0d7b6619a39d40d1b81148b9761ae960/users/4e82245353e64a87967e346fedddf267/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:09.637984 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e7da90-aca4-47c0-b45c-294ce5305af3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d7b6619a39d40d1b81148b9761ae960, user_id=4e82245353e64a87967e346fedddf267, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:09.642109 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e7da90-aca4-47c0-b45c-294ce5305af3 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:09.643190 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-27e6708d-91ea-40ac-b89d-cff15eb36de0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94856972be884cd7a06b4673411ffea8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:09.664802 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1197/2407] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:13:09 2022] PUT /identity/v3/projects/0d7b6619a39d40d1b81148b9761ae960/users/4e82245353e64a87967e346fedddf267/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:13:09.668918 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60675ff2-27c6-4151-bcc9-58f0a1dff1de None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:09.669201 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60675ff2-27c6-4151-bcc9-58f0a1dff1de None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:09.669481 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60675ff2-27c6-4151-bcc9-58f0a1dff1de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:09.676377 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-27e6708d-91ea-40ac-b89d-cff15eb36de0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94856972be884cd7a06b4673411ffea8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:09.701711 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-60675ff2-27c6-4151-bcc9-58f0a1dff1de None None] MFA Rules not processed for user `4e82245353e64a87967e346fedddf267`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:09.704310 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-60675ff2-27c6-4151-bcc9-58f0a1dff1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:09.749987 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-27e6708d-91ea-40ac-b89d-cff15eb36de0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94856972be884cd7a06b4673411ffea8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:09.750777 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-27e6708d-91ea-40ac-b89d-cff15eb36de0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94856972be884cd7a06b4673411ffea8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:09.757937 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1211/2408] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:13:09 2022] DELETE /identity/v3/users/94856972be884cd7a06b4673411ffea8 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:13:09.759232 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768188b-3f80-4faa-a23b-ba0db6bec2e3 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:09.759565 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768188b-3f80-4faa-a23b-ba0db6bec2e3 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:09.759923 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768188b-3f80-4faa-a23b-ba0db6bec2e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:09.789528 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-4768188b-3f80-4faa-a23b-ba0db6bec2e3 None None] MFA Rules not processed for user `911b9cf4e9bc424bba387e2ff966cb46`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:09.790864 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-4768188b-3f80-4faa-a23b-ba0db6bec2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:09.796845 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1198/2409] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:13:09 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:13:09.885027 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1212/2410] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:13:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:13:10.031781 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60675ff2-27c6-4151-bcc9-58f0a1dff1de None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:10.033639 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-60675ff2-27c6-4151-bcc9-58f0a1dff1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:10.150033 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60675ff2-27c6-4151-bcc9-58f0a1dff1de None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:10.247049 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b422392-e6b3-4727-8312-0741c39d91fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:10.248057 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b422392-e6b3-4727-8312-0741c39d91fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:10.248351 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b422392-e6b3-4727-8312-0741c39d91fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:10.248719 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b422392-e6b3-4727-8312-0741c39d91fd admin admin] PATH_INFO: `/v3/projects/b66b447c40c04f70b7375b342f88bec8` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:10.250225 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b422392-e6b3-4727-8312-0741c39d91fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=b66b447c40c04f70b7375b342f88bec8)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:10.252448 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b422392-e6b3-4727-8312-0741c39d91fd admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:10.315529 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4768188b-3f80-4faa-a23b-ba0db6bec2e3 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:10.323693 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-4768188b-3f80-4faa-a23b-ba0db6bec2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:10.389874 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4b422392-e6b3-4727-8312-0741c39d91fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b66b447c40c04f70b7375b342f88bec8', 'request_id': 'req-4b422392-e6b3-4727-8312-0741c39d91fd'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:10.401174 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4b422392-e6b3-4727-8312-0741c39d91fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b66b447c40c04f70b7375b342f88bec8', 'request_id': 'req-4b422392-e6b3-4727-8312-0741c39d91fd'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:10.408635 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4b422392-e6b3-4727-8312-0741c39d91fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b66b447c40c04f70b7375b342f88bec8', 'request_id': 'req-4b422392-e6b3-4727-8312-0741c39d91fd'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:10.462587 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4768188b-3f80-4faa-a23b-ba0db6bec2e3 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:10.496508 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4b422392-e6b3-4727-8312-0741c39d91fd admin admin] The token cache is being invalidate because project b66b447c40c04f70b7375b342f88bec8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:13:10.497457 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4b422392-e6b3-4727-8312-0741c39d91fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:10.499992 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4b422392-e6b3-4727-8312-0741c39d91fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:10.513841 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1199/2411] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:13:10 2022] DELETE /identity/v3/projects/b66b447c40c04f70b7375b342f88bec8 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:13:10.513841 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b422392-e6b3-4727-8312-0741c39d91fd admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:10.513841 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-4b422392-e6b3-4727-8312-0741c39d91fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:10.566714 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272dcce6-b2a4-4312-bec9-37bebc980184 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:10.566714 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272dcce6-b2a4-4312-bec9-37bebc980184 service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:10.566714 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272dcce6-b2a4-4312-bec9-37bebc980184 service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:10.566714 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272dcce6-b2a4-4312-bec9-37bebc980184 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:10.570016 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-272dcce6-b2a4-4312-bec9-37bebc980184 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:10.603573 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b422392-e6b3-4727-8312-0741c39d91fd admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:10.610786 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef07154-89a4-4542-8cbc-9e8e9c1067da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:10.611449 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef07154-89a4-4542-8cbc-9e8e9c1067da service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:10.611778 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef07154-89a4-4542-8cbc-9e8e9c1067da service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:10.612055 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef07154-89a4-4542-8cbc-9e8e9c1067da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:10.614828 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-bef07154-89a4-4542-8cbc-9e8e9c1067da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:10.644113 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272dcce6-b2a4-4312-bec9-37bebc980184 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:10.646387 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272dcce6-b2a4-4312-bec9-37bebc980184 service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:10.676499 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1213/2412] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:13:10 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:13:10.678014 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a462a211-9377-44da-868f-5a7fb208dcfd None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:10.681025 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a462a211-9377-44da-868f-5a7fb208dcfd None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:10.684608 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a462a211-9377-44da-868f-5a7fb208dcfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:10.688505 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef07154-89a4-4542-8cbc-9e8e9c1067da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:10.690221 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef07154-89a4-4542-8cbc-9e8e9c1067da service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:10.712133 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-a462a211-9377-44da-868f-5a7fb208dcfd None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:10.713492 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-a462a211-9377-44da-868f-5a7fb208dcfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:10.713875 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1200/2413] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:13:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:13:10.797555 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1214/2414] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:13:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:13:10.807296 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88116424-c470-456e-814e-a097b726a583 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:10.807932 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88116424-c470-456e-814e-a097b726a583 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:10.808645 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88116424-c470-456e-814e-a097b726a583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:10.849834 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-88116424-c470-456e-814e-a097b726a583 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:10.851530 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-88116424-c470-456e-814e-a097b726a583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:10.863460 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1201/2415] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:13:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:13:10.867544 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a462a211-9377-44da-868f-5a7fb208dcfd None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:10.881152 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a462a211-9377-44da-868f-5a7fb208dcfd None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:10.886828 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d0c2f3-7a00-49ca-8de6-b816587e18a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:10.888546 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d0c2f3-7a00-49ca-8de6-b816587e18a5 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:10.889137 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d0c2f3-7a00-49ca-8de6-b816587e18a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:10.889603 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d0c2f3-7a00-49ca-8de6-b816587e18a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:10.890741 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d0c2f3-7a00-49ca-8de6-b816587e18a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:13:10.891235 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d0c2f3-7a00-49ca-8de6-b816587e18a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:10.893894 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d0c2f3-7a00-49ca-8de6-b816587e18a5 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:10.912435 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1215/2416] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:13:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:13:10.922187 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88116424-c470-456e-814e-a097b726a583 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:10.933917 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88116424-c470-456e-814e-a097b726a583 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:10.940869 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec9a29-5fc1-4011-97f2-0766cc42fc97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:10.941615 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec9a29-5fc1-4011-97f2-0766cc42fc97 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:10.941902 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec9a29-5fc1-4011-97f2-0766cc42fc97 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:10.942182 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec9a29-5fc1-4011-97f2-0766cc42fc97 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:10.942972 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ec9a29-5fc1-4011-97f2-0766cc42fc97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:10.945313 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ec9a29-5fc1-4011-97f2-0766cc42fc97 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:11.046737 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1202/2417] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:13:10 2022] POST /identity/v3/projects => generated 385 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:13:11.051003 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d0c2f3-7a00-49ca-8de6-b816587e18a5 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:11.063166 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d0c2f3-7a00-49ca-8de6-b816587e18a5 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:11.139258 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e32e8c-3999-4930-8648-6756844397cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:11.139979 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e32e8c-3999-4930-8648-6756844397cf admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:11.140417 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e32e8c-3999-4930-8648-6756844397cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:11.140925 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e32e8c-3999-4930-8648-6756844397cf admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:11.144347 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e32e8c-3999-4930-8648-6756844397cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:11.146993 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e32e8c-3999-4930-8648-6756844397cf admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:11.240542 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1216/2418] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:13:11 2022] POST /identity/v3/users => generated 293 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:13:11.242019 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec9a29-5fc1-4011-97f2-0766cc42fc97 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:11.254441 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec9a29-5fc1-4011-97f2-0766cc42fc97 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:11.261004 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7512ca1d-c1de-4cf5-9d4a-5b934d20e5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:11.261944 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7512ca1d-c1de-4cf5-9d4a-5b934d20e5a9 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:11.262304 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7512ca1d-c1de-4cf5-9d4a-5b934d20e5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:11.262640 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7512ca1d-c1de-4cf5-9d4a-5b934d20e5a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:11.263519 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7512ca1d-c1de-4cf5-9d4a-5b934d20e5a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:11.266145 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7512ca1d-c1de-4cf5-9d4a-5b934d20e5a9 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:11.277220 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1203/2419] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:13:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:13:11.281881 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e32e8c-3999-4930-8648-6756844397cf admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:11.292447 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e32e8c-3999-4930-8648-6756844397cf admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:11.298754 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28312c9-d942-465b-814a-9b95ca9bd306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:11.299431 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28312c9-d942-465b-814a-9b95ca9bd306 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:11.299752 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28312c9-d942-465b-814a-9b95ca9bd306 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:11.300170 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28312c9-d942-465b-814a-9b95ca9bd306 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:11.301046 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28312c9-d942-465b-814a-9b95ca9bd306 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:11.302670 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28312c9-d942-465b-814a-9b95ca9bd306 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:11.313609 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1217/2420] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:13:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:13:11.317551 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7512ca1d-c1de-4cf5-9d4a-5b934d20e5a9 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:11.328162 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7512ca1d-c1de-4cf5-9d4a-5b934d20e5a9 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:11.333246 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b975ba-0f07-4318-9bc1-8ba0ea5bc32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:11.334142 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b975ba-0f07-4318-9bc1-8ba0ea5bc32c admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:11.334448 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b975ba-0f07-4318-9bc1-8ba0ea5bc32c admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:11.334777 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b975ba-0f07-4318-9bc1-8ba0ea5bc32c admin admin] PATH_INFO: `/v3/projects/7fd11fc790a24c9c9b3b9b028257aad1/users/f0dc7195a3f84ec7958fb613cc7728be/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:11.353651 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b975ba-0f07-4318-9bc1-8ba0ea5bc32c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fd11fc790a24c9c9b3b9b028257aad1, user_id=f0dc7195a3f84ec7958fb613cc7728be, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:11.356463 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b975ba-0f07-4318-9bc1-8ba0ea5bc32c admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:11.459802 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1204/2421] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:13:11 2022] PUT /identity/v3/projects/7fd11fc790a24c9c9b3b9b028257aad1/users/f0dc7195a3f84ec7958fb613cc7728be/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:13:11.471902 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ffc648-086e-4834-b1d2-afce6e7c523a None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:11.471902 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ffc648-086e-4834-b1d2-afce6e7c523a None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:11.471902 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ffc648-086e-4834-b1d2-afce6e7c523a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:11.525340 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-46ffc648-086e-4834-b1d2-afce6e7c523a None None] MFA Rules not processed for user `f0dc7195a3f84ec7958fb613cc7728be`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:11.527451 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-46ffc648-086e-4834-b1d2-afce6e7c523a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:11.663709 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1218/2422] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:13:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:13:11.669319 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b975ba-0f07-4318-9bc1-8ba0ea5bc32c admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:11.690132 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ffc648-086e-4834-b1d2-afce6e7c523a None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:11.692118 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-46ffc648-086e-4834-b1d2-afce6e7c523a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:11.793777 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b975ba-0f07-4318-9bc1-8ba0ea5bc32c admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:11.803676 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb2365-68f4-4853-8b01-e568a727a125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:11.804355 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb2365-68f4-4853-8b01-e568a727a125 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:11.804641 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb2365-68f4-4853-8b01-e568a727a125 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:11.804919 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb2365-68f4-4853-8b01-e568a727a125 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:11.805618 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfb2365-68f4-4853-8b01-e568a727a125 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:11.810324 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfb2365-68f4-4853-8b01-e568a727a125 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:11.855909 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ffc648-086e-4834-b1d2-afce6e7c523a None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:11.857724 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659179fe-4c89-49ba-b6b6-171759a5b566 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:11.858701 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659179fe-4c89-49ba-b6b6-171759a5b566 service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:11.859092 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659179fe-4c89-49ba-b6b6-171759a5b566 service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:11.860006 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659179fe-4c89-49ba-b6b6-171759a5b566 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:11.862053 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-659179fe-4c89-49ba-b6b6-171759a5b566 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:11.930939 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659179fe-4c89-49ba-b6b6-171759a5b566 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:11.932619 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659179fe-4c89-49ba-b6b6-171759a5b566 service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:11.944325 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1219/2423] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:13:11 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:13:11.953979 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1205/2424] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:13:11 2022] POST /identity/v3/projects => generated 383 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:13:11.958071 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659179fe-4c89-49ba-b6b6-171759a5b566 service nova] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:11.975828 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659179fe-4c89-49ba-b6b6-171759a5b566 service nova] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:12.059423 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f058157-925d-43e6-acce-865a697aa4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:12.060245 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f058157-925d-43e6-acce-865a697aa4cc admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:12.060580 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f058157-925d-43e6-acce-865a697aa4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:12.060866 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f058157-925d-43e6-acce-865a697aa4cc admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:12.066256 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f058157-925d-43e6-acce-865a697aa4cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:12.069405 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f058157-925d-43e6-acce-865a697aa4cc admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:12.243325 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1220/2425] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:13:11 2022] POST /identity/v3/users => generated 298 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:13:12.247340 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb2365-68f4-4853-8b01-e568a727a125 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:12.265592 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb2365-68f4-4853-8b01-e568a727a125 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:12.269709 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3845ea5-1842-48f0-9fd7-d071a7b734f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:12.271382 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3845ea5-1842-48f0-9fd7-d071a7b734f4 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:12.272109 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3845ea5-1842-48f0-9fd7-d071a7b734f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:12.272749 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3845ea5-1842-48f0-9fd7-d071a7b734f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:12.273711 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3845ea5-1842-48f0-9fd7-d071a7b734f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:12.276107 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3845ea5-1842-48f0-9fd7-d071a7b734f4 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:12.299611 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1206/2426] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:13:12 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:13:12.300333 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f058157-925d-43e6-acce-865a697aa4cc admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:12.311826 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f058157-925d-43e6-acce-865a697aa4cc admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:12.317673 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107e210-9790-448c-ae34-b0dabd0336b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:12.318683 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107e210-9790-448c-ae34-b0dabd0336b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:12.320127 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107e210-9790-448c-ae34-b0dabd0336b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:12.327863 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107e210-9790-448c-ae34-b0dabd0336b4 admin admin] PATH_INFO: `/v3/projects/a6b6a6807b234ddc8ef2f51c6571db35/users/79e9b749860a443c802fc25dd3c6ec5a/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:12.354884 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d107e210-9790-448c-ae34-b0dabd0336b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6b6a6807b234ddc8ef2f51c6571db35, user_id=79e9b749860a443c802fc25dd3c6ec5a, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:12.359436 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d107e210-9790-448c-ae34-b0dabd0336b4 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:12.451341 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1221/2427] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:13:12 2022] PUT /identity/v3/projects/a6b6a6807b234ddc8ef2f51c6571db35/users/79e9b749860a443c802fc25dd3c6ec5a/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:13:12.453490 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3845ea5-1842-48f0-9fd7-d071a7b734f4 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:12.469020 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3845ea5-1842-48f0-9fd7-d071a7b734f4 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:12.549375 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe971f0-a459-4d9c-a581-408ad946b881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:12.550625 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe971f0-a459-4d9c-a581-408ad946b881 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:12.550923 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe971f0-a459-4d9c-a581-408ad946b881 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:12.551276 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe971f0-a459-4d9c-a581-408ad946b881 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:12.552321 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe971f0-a459-4d9c-a581-408ad946b881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:12.554109 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe971f0-a459-4d9c-a581-408ad946b881 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:12.571890 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107e210-9790-448c-ae34-b0dabd0336b4 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:12.579528 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1207/2428] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:13:12 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:13:12.586873 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe971f0-a459-4d9c-a581-408ad946b881 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:12.598414 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-dfe971f0-a459-4d9c-a581-408ad946b881 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:12.600464 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107e210-9790-448c-ae34-b0dabd0336b4 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:12.627507 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c829279-50ea-4e49-893d-bd18086b597e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:12.633713 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c829279-50ea-4e49-893d-bd18086b597e admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:12.654665 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c829279-50ea-4e49-893d-bd18086b597e admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:12.655095 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c829279-50ea-4e49-893d-bd18086b597e admin admin] PATH_INFO: `/v3/projects/a6b6a6807b234ddc8ef2f51c6571db35/users/79e9b749860a443c802fc25dd3c6ec5a/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:12.660663 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c829279-50ea-4e49-893d-bd18086b597e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6b6a6807b234ddc8ef2f51c6571db35, user_id=79e9b749860a443c802fc25dd3c6ec5a, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:12.663618 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c829279-50ea-4e49-893d-bd18086b597e admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:12.688441 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe971f0-a459-4d9c-a581-408ad946b881 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:12.708700 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1222/2429] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:13:12 2022] PUT /identity/v3/projects/a6b6a6807b234ddc8ef2f51c6571db35/users/79e9b749860a443c802fc25dd3c6ec5a/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:13:12.709964 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c829279-50ea-4e49-893d-bd18086b597e admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:12.716710 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-0c829279-50ea-4e49-893d-bd18086b597e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:12.898669 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c829279-50ea-4e49-893d-bd18086b597e admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:12.903257 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0916b2e3-6280-41b3-94fc-45bbdb36bf48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:12.904184 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916b2e3-6280-41b3-94fc-45bbdb36bf48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:12.904837 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916b2e3-6280-41b3-94fc-45bbdb36bf48 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:12.905133 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916b2e3-6280-41b3-94fc-45bbdb36bf48 admin admin] PATH_INFO: `/v3/users/849f6a4bcb77491bba6647995546bb7a` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:12.908034 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0916b2e3-6280-41b3-94fc-45bbdb36bf48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=849f6a4bcb77491bba6647995546bb7a)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:12.910029 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0916b2e3-6280-41b3-94fc-45bbdb36bf48 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:12.914474 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feca3cf-717a-4135-91c5-f277b8b2aafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:12.919259 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feca3cf-717a-4135-91c5-f277b8b2aafb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:12.919259 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feca3cf-717a-4135-91c5-f277b8b2aafb admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:12.919259 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feca3cf-717a-4135-91c5-f277b8b2aafb admin admin] PATH_INFO: `/v3/users/6840e733cb0f49eb9492da7e4c042b58` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:12.919259 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feca3cf-717a-4135-91c5-f277b8b2aafb admin admin] RBAC: Authorizing `identity:delete_user(user_id=6840e733cb0f49eb9492da7e4c042b58)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:12.921504 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feca3cf-717a-4135-91c5-f277b8b2aafb admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:13.344312 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2feca3cf-717a-4135-91c5-f277b8b2aafb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6840e733cb0f49eb9492da7e4c042b58'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:13.370119 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0916b2e3-6280-41b3-94fc-45bbdb36bf48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '849f6a4bcb77491bba6647995546bb7a'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:13.397463 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2feca3cf-717a-4135-91c5-f277b8b2aafb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6840e733cb0f49eb9492da7e4c042b58'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:13.405604 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0916b2e3-6280-41b3-94fc-45bbdb36bf48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '849f6a4bcb77491bba6647995546bb7a'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:13.406866 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0916b2e3-6280-41b3-94fc-45bbdb36bf48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '849f6a4bcb77491bba6647995546bb7a'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:13.414066 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2feca3cf-717a-4135-91c5-f277b8b2aafb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6840e733cb0f49eb9492da7e4c042b58'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:13.487408 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0916b2e3-6280-41b3-94fc-45bbdb36bf48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '849f6a4bcb77491bba6647995546bb7a'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:13.512177 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0916b2e3-6280-41b3-94fc-45bbdb36bf48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '849f6a4bcb77491bba6647995546bb7a'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:13.524924 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1208/2430] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:13:12 2022] DELETE /identity/v3/users/849f6a4bcb77491bba6647995546bb7a => generated 0 bytes in 945 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:13:13.526543 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb758dc-8819-4455-96cc-a21d7b01225a None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:13.526838 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb758dc-8819-4455-96cc-a21d7b01225a None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:13.527273 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb758dc-8819-4455-96cc-a21d7b01225a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:13.564226 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-0eb758dc-8819-4455-96cc-a21d7b01225a None None] MFA Rules not processed for user `79e9b749860a443c802fc25dd3c6ec5a`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:13.565575 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-0eb758dc-8819-4455-96cc-a21d7b01225a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:13.580476 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2feca3cf-717a-4135-91c5-f277b8b2aafb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6840e733cb0f49eb9492da7e4c042b58'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:13.580476 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2feca3cf-717a-4135-91c5-f277b8b2aafb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6840e733cb0f49eb9492da7e4c042b58'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:13.600482 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1223/2431] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:13:12 2022] DELETE /identity/v3/users/6840e733cb0f49eb9492da7e4c042b58 => generated 0 bytes in 882 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:13:13.609142 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0995bda-8275-472d-af0a-105da8f3e381 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:13.609427 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0995bda-8275-472d-af0a-105da8f3e381 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:13.609711 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0995bda-8275-472d-af0a-105da8f3e381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:13.648950 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-c0995bda-8275-472d-af0a-105da8f3e381 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:13.651287 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c0995bda-8275-472d-af0a-105da8f3e381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:13.682341 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1209/2432] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:13:13 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:13:13.684033 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20236f31-3e60-4e1f-9e6e-ab05856a01c5 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:13.684701 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20236f31-3e60-4e1f-9e6e-ab05856a01c5 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:13.685111 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20236f31-3e60-4e1f-9e6e-ab05856a01c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:13.706657 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-20236f31-3e60-4e1f-9e6e-ab05856a01c5 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:13.708199 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-20236f31-3e60-4e1f-9e6e-ab05856a01c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:13.792599 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1224/2433] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:13:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:13:13.793604 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0995bda-8275-472d-af0a-105da8f3e381 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:13.796297 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c0995bda-8275-472d-af0a-105da8f3e381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:13.800774 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1210/2434] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:13:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:13:13.804175 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20236f31-3e60-4e1f-9e6e-ab05856a01c5 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:13.805757 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-20236f31-3e60-4e1f-9e6e-ab05856a01c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:13.918311 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20236f31-3e60-4e1f-9e6e-ab05856a01c5 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:13.922402 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e95c8f5-8bd9-4602-b2c4-c87f73f42960 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:13.923065 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e95c8f5-8bd9-4602-b2c4-c87f73f42960 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:13.928422 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e95c8f5-8bd9-4602-b2c4-c87f73f42960 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:13.928422 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e95c8f5-8bd9-4602-b2c4-c87f73f42960 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:13.940361 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e95c8f5-8bd9-4602-b2c4-c87f73f42960 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:13.942963 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e95c8f5-8bd9-4602-b2c4-c87f73f42960 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:13.945680 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0995bda-8275-472d-af0a-105da8f3e381 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:13.954317 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adebffec-1d69-4550-a506-9d1b1a928ad2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:13.955709 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adebffec-1d69-4550-a506-9d1b1a928ad2 service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:13.956615 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adebffec-1d69-4550-a506-9d1b1a928ad2 service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:13.957001 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adebffec-1d69-4550-a506-9d1b1a928ad2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:13.957509 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1211/2435] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:13:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:13:13.958494 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e95c8f5-8bd9-4602-b2c4-c87f73f42960 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:13.971557 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e95c8f5-8bd9-4602-b2c4-c87f73f42960 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:13.979750 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c51243-afdb-4e5e-a4f7-fd1658230e66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:13.980423 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c51243-afdb-4e5e-a4f7-fd1658230e66 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:13.981208 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c51243-afdb-4e5e-a4f7-fd1658230e66 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:13.981208 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c51243-afdb-4e5e-a4f7-fd1658230e66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:13.994111 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c51243-afdb-4e5e-a4f7-fd1658230e66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:13.996692 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c51243-afdb-4e5e-a4f7-fd1658230e66 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:14.015774 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1212/2436] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:13:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:13:14.084769 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adebffec-1d69-4550-a506-9d1b1a928ad2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:14.086787 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adebffec-1d69-4550-a506-9d1b1a928ad2 service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:14.111429 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1225/2437] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:13:13 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:13:14.733208 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c51243-afdb-4e5e-a4f7-fd1658230e66 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:14.735792 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-f5c51243-afdb-4e5e-a4f7-fd1658230e66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:14.761482 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c51243-afdb-4e5e-a4f7-fd1658230e66 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:14.771605 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adebffec-1d69-4550-a506-9d1b1a928ad2 service nova] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:14.773704 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-adebffec-1d69-4550-a506-9d1b1a928ad2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:14.778996 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a3b927-5f0b-48ce-9888-32b90b7c56e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:14.781067 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a3b927-5f0b-48ce-9888-32b90b7c56e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:14.785595 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a3b927-5f0b-48ce-9888-32b90b7c56e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:14.787921 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a3b927-5f0b-48ce-9888-32b90b7c56e1 admin admin] PATH_INFO: `/v3/projects/e3b587b3031449a3a23187f2df762615` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:14.790037 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a3b927-5f0b-48ce-9888-32b90b7c56e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3b587b3031449a3a23187f2df762615)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:14.793315 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a3b927-5f0b-48ce-9888-32b90b7c56e1 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:14.812819 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adebffec-1d69-4550-a506-9d1b1a928ad2 service nova] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:14.829246 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329035d8-49db-4a8c-897d-b783209b7dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:14.831382 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329035d8-49db-4a8c-897d-b783209b7dc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:14.832157 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329035d8-49db-4a8c-897d-b783209b7dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:14.833767 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329035d8-49db-4a8c-897d-b783209b7dc8 admin admin] PATH_INFO: `/v3/projects/d2bea4301559473ea442e85b66e225b3` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:14.838373 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329035d8-49db-4a8c-897d-b783209b7dc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2bea4301559473ea442e85b66e225b3)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:14.846136 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329035d8-49db-4a8c-897d-b783209b7dc8 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:14.968628 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-91a3b927-5f0b-48ce-9888-32b90b7c56e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3b587b3031449a3a23187f2df762615', 'request_id': 'req-91a3b927-5f0b-48ce-9888-32b90b7c56e1'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:14.974138 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-91a3b927-5f0b-48ce-9888-32b90b7c56e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3b587b3031449a3a23187f2df762615', 'request_id': 'req-91a3b927-5f0b-48ce-9888-32b90b7c56e1'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:14.981622 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-91a3b927-5f0b-48ce-9888-32b90b7c56e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3b587b3031449a3a23187f2df762615', 'request_id': 'req-91a3b927-5f0b-48ce-9888-32b90b7c56e1'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:15.009557 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-329035d8-49db-4a8c-897d-b783209b7dc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2bea4301559473ea442e85b66e225b3', 'request_id': 'req-329035d8-49db-4a8c-897d-b783209b7dc8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:15.015578 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-329035d8-49db-4a8c-897d-b783209b7dc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2bea4301559473ea442e85b66e225b3', 'request_id': 'req-329035d8-49db-4a8c-897d-b783209b7dc8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:15.094489 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-91a3b927-5f0b-48ce-9888-32b90b7c56e1 admin admin] The token cache is being invalidate because project e3b587b3031449a3a23187f2df762615 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:13:15.094988 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-91a3b927-5f0b-48ce-9888-32b90b7c56e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:15.095612 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-91a3b927-5f0b-48ce-9888-32b90b7c56e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:15.097288 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1213/2438] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:13:14 2022] DELETE /identity/v3/projects/e3b587b3031449a3a23187f2df762615 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:13:15.101699 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a3b927-5f0b-48ce-9888-32b90b7c56e1 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:15.103254 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-91a3b927-5f0b-48ce-9888-32b90b7c56e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:15.176507 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a3b927-5f0b-48ce-9888-32b90b7c56e1 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:15.197326 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-329035d8-49db-4a8c-897d-b783209b7dc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2bea4301559473ea442e85b66e225b3', 'request_id': 'req-329035d8-49db-4a8c-897d-b783209b7dc8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:15.215472 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-329035d8-49db-4a8c-897d-b783209b7dc8 admin admin] The token cache is being invalidate because project d2bea4301559473ea442e85b66e225b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:13:15.215859 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-329035d8-49db-4a8c-897d-b783209b7dc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:15.222125 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-329035d8-49db-4a8c-897d-b783209b7dc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:15.223548 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1226/2439] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:13:14 2022] DELETE /identity/v3/projects/d2bea4301559473ea442e85b66e225b3 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:13:15.225331 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329035d8-49db-4a8c-897d-b783209b7dc8 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:15.226904 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-329035d8-49db-4a8c-897d-b783209b7dc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:15.265961 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fa8615-8975-4db9-9039-2c9cba97fab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:15.267004 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa8615-8975-4db9-9039-2c9cba97fab9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:15.267413 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa8615-8975-4db9-9039-2c9cba97fab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:15.267890 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa8615-8975-4db9-9039-2c9cba97fab9 admin admin] PATH_INFO: `/v3/users/4a62a8b9576a4cf08ee1ba5b8d500b6f` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:15.269290 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fa8615-8975-4db9-9039-2c9cba97fab9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a62a8b9576a4cf08ee1ba5b8d500b6f)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:15.271345 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fa8615-8975-4db9-9039-2c9cba97fab9 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:15.333671 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329035d8-49db-4a8c-897d-b783209b7dc8 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:15.339684 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d150a-5a62-4423-9ac7-3b2d1eb2d8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:15.340809 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d150a-5a62-4423-9ac7-3b2d1eb2d8c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:15.341555 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d150a-5a62-4423-9ac7-3b2d1eb2d8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:15.341933 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d150a-5a62-4423-9ac7-3b2d1eb2d8c4 admin admin] PATH_INFO: `/v3/users/4e82245353e64a87967e346fedddf267` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:15.343502 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48d150a-5a62-4423-9ac7-3b2d1eb2d8c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e82245353e64a87967e346fedddf267)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:15.346352 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48d150a-5a62-4423-9ac7-3b2d1eb2d8c4 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:15.548644 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-54fa8615-8975-4db9-9039-2c9cba97fab9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a62a8b9576a4cf08ee1ba5b8d500b6f'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:15.561355 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-54fa8615-8975-4db9-9039-2c9cba97fab9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a62a8b9576a4cf08ee1ba5b8d500b6f'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:15.562417 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-54fa8615-8975-4db9-9039-2c9cba97fab9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a62a8b9576a4cf08ee1ba5b8d500b6f'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:15.617046 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e48d150a-5a62-4423-9ac7-3b2d1eb2d8c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e82245353e64a87967e346fedddf267'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:15.629521 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e48d150a-5a62-4423-9ac7-3b2d1eb2d8c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e82245353e64a87967e346fedddf267'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:15.642019 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e48d150a-5a62-4423-9ac7-3b2d1eb2d8c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e82245353e64a87967e346fedddf267'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:15.661353 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-54fa8615-8975-4db9-9039-2c9cba97fab9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a62a8b9576a4cf08ee1ba5b8d500b6f'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:15.674997 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-54fa8615-8975-4db9-9039-2c9cba97fab9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a62a8b9576a4cf08ee1ba5b8d500b6f'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:15.687242 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1214/2440] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:13:15 2022] DELETE /identity/v3/users/4a62a8b9576a4cf08ee1ba5b8d500b6f => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:13:15.735428 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e48d150a-5a62-4423-9ac7-3b2d1eb2d8c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e82245353e64a87967e346fedddf267'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:15.736346 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e48d150a-5a62-4423-9ac7-3b2d1eb2d8c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e82245353e64a87967e346fedddf267'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:15.743833 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1227/2441] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:13:15 2022] DELETE /identity/v3/users/4e82245353e64a87967e346fedddf267 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:13:16.519993 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fa8615-8975-4db9-9039-2c9cba97fab9 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:16.521317 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-54fa8615-8975-4db9-9039-2c9cba97fab9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:16.526358 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d150a-5a62-4423-9ac7-3b2d1eb2d8c4 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:16.528384 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e48d150a-5a62-4423-9ac7-3b2d1eb2d8c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:16.603615 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fa8615-8975-4db9-9039-2c9cba97fab9 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:16.667683 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d150a-5a62-4423-9ac7-3b2d1eb2d8c4 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:16.675186 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7d0b4a-64ed-4fe0-9883-04d136310077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:16.676096 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d0b4a-64ed-4fe0-9883-04d136310077 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:16.676388 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d0b4a-64ed-4fe0-9883-04d136310077 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:16.676676 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d0b4a-64ed-4fe0-9883-04d136310077 admin admin] PATH_INFO: `/v3/projects/0a9e752fe7b147709743258855e42c78` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:16.677899 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7d0b4a-64ed-4fe0-9883-04d136310077 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a9e752fe7b147709743258855e42c78)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:16.679914 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7d0b4a-64ed-4fe0-9883-04d136310077 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:16.696517 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36812945-0604-4fe1-8fa8-3f28f00f649e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:16.698112 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36812945-0604-4fe1-8fa8-3f28f00f649e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:16.698821 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36812945-0604-4fe1-8fa8-3f28f00f649e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:16.699246 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36812945-0604-4fe1-8fa8-3f28f00f649e admin admin] PATH_INFO: `/v3/projects/0d7b6619a39d40d1b81148b9761ae960` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:16.701161 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36812945-0604-4fe1-8fa8-3f28f00f649e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d7b6619a39d40d1b81148b9761ae960)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:16.703587 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36812945-0604-4fe1-8fa8-3f28f00f649e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:16.809163 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8a7d0b4a-64ed-4fe0-9883-04d136310077 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a9e752fe7b147709743258855e42c78', 'request_id': 'req-8a7d0b4a-64ed-4fe0-9883-04d136310077'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:16.815013 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8a7d0b4a-64ed-4fe0-9883-04d136310077 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a9e752fe7b147709743258855e42c78', 'request_id': 'req-8a7d0b4a-64ed-4fe0-9883-04d136310077'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:16.884244 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-36812945-0604-4fe1-8fa8-3f28f00f649e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d7b6619a39d40d1b81148b9761ae960', 'request_id': 'req-36812945-0604-4fe1-8fa8-3f28f00f649e'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:16.894294 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-36812945-0604-4fe1-8fa8-3f28f00f649e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d7b6619a39d40d1b81148b9761ae960', 'request_id': 'req-36812945-0604-4fe1-8fa8-3f28f00f649e'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:16.901225 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-36812945-0604-4fe1-8fa8-3f28f00f649e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d7b6619a39d40d1b81148b9761ae960', 'request_id': 'req-36812945-0604-4fe1-8fa8-3f28f00f649e'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:16.955639 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8a7d0b4a-64ed-4fe0-9883-04d136310077 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a9e752fe7b147709743258855e42c78', 'request_id': 'req-8a7d0b4a-64ed-4fe0-9883-04d136310077'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:16.973868 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8a7d0b4a-64ed-4fe0-9883-04d136310077 admin admin] The token cache is being invalidate because project 0a9e752fe7b147709743258855e42c78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:13:16.974344 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8a7d0b4a-64ed-4fe0-9883-04d136310077 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:16.979334 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8a7d0b4a-64ed-4fe0-9883-04d136310077 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:16.982042 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1228/2442] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:13:16 2022] DELETE /identity/v3/projects/0a9e752fe7b147709743258855e42c78 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:13:16.994232 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c6728a-ce7a-4760-a934-f12d94bb830c None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:16.994818 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c6728a-ce7a-4760-a934-f12d94bb830c None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:16.995339 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c6728a-ce7a-4760-a934-f12d94bb830c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:17.026758 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-b2c6728a-ce7a-4760-a934-f12d94bb830c None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:17.026758 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b2c6728a-ce7a-4760-a934-f12d94bb830c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:17.053890 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-36812945-0604-4fe1-8fa8-3f28f00f649e admin admin] The token cache is being invalidate because project 0d7b6619a39d40d1b81148b9761ae960 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:13:17.054188 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-36812945-0604-4fe1-8fa8-3f28f00f649e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:17.055908 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-36812945-0604-4fe1-8fa8-3f28f00f649e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:17.058204 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1215/2443] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:13:16 2022] DELETE /identity/v3/projects/0d7b6619a39d40d1b81148b9761ae960 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:13:17.072576 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5feca35-4220-4df0-81b7-8d2a01690189 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:17.072576 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5feca35-4220-4df0-81b7-8d2a01690189 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:17.072576 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5feca35-4220-4df0-81b7-8d2a01690189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:17.091526 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-f5feca35-4220-4df0-81b7-8d2a01690189 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:17.095607 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-f5feca35-4220-4df0-81b7-8d2a01690189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:17.120928 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1229/2444] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:13:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:13:17.130114 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e558ae2-9947-4754-9432-585af88a7ae9 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:17.130503 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e558ae2-9947-4754-9432-585af88a7ae9 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:17.130860 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e558ae2-9947-4754-9432-585af88a7ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:17.150761 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-4e558ae2-9947-4754-9432-585af88a7ae9 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:17.152130 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-4e558ae2-9947-4754-9432-585af88a7ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:17.167612 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1230/2445] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:13:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:13:17.172802 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e558ae2-9947-4754-9432-585af88a7ae9 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:17.185163 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e558ae2-9947-4754-9432-585af88a7ae9 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:17.189288 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1216/2446] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:13:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:13:17.194889 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e4058a-a820-4b8f-80c7-d86b0aa10849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:17.195688 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e4058a-a820-4b8f-80c7-d86b0aa10849 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:17.195973 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e4058a-a820-4b8f-80c7-d86b0aa10849 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:17.196254 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e4058a-a820-4b8f-80c7-d86b0aa10849 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:17.197046 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e4058a-a820-4b8f-80c7-d86b0aa10849 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:13:17.197357 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e4058a-a820-4b8f-80c7-d86b0aa10849 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:17.199044 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e4058a-a820-4b8f-80c7-d86b0aa10849 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:17.211842 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1231/2447] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:13:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:13:17.237103 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5feca35-4220-4df0-81b7-8d2a01690189 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:17.240667 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c4c50-2aa7-4102-b87f-bb9421e125a7 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:17.241145 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c4c50-2aa7-4102-b87f-bb9421e125a7 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:17.241430 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c4c50-2aa7-4102-b87f-bb9421e125a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:17.247530 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5feca35-4220-4df0-81b7-8d2a01690189 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:17.252602 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3164d5d0-cebd-42b8-9799-fba34586fe93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:17.253461 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3164d5d0-cebd-42b8-9799-fba34586fe93 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:17.253759 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3164d5d0-cebd-42b8-9799-fba34586fe93 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:17.254042 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3164d5d0-cebd-42b8-9799-fba34586fe93 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:17.254760 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3164d5d0-cebd-42b8-9799-fba34586fe93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:17.257028 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3164d5d0-cebd-42b8-9799-fba34586fe93 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:17.261546 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-9d1c4c50-2aa7-4102-b87f-bb9421e125a7 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:17.263987 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-9d1c4c50-2aa7-4102-b87f-bb9421e125a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:17.272317 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1232/2448] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:13:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:13:17.276357 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1c4c50-2aa7-4102-b87f-bb9421e125a7 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:17.290294 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1c4c50-2aa7-4102-b87f-bb9421e125a7 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:17.296180 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76210c63-eecf-4f2b-a4a8-43a6f77f03be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:17.296998 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76210c63-eecf-4f2b-a4a8-43a6f77f03be admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:17.297278 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76210c63-eecf-4f2b-a4a8-43a6f77f03be admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:17.298102 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76210c63-eecf-4f2b-a4a8-43a6f77f03be admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:17.298276 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76210c63-eecf-4f2b-a4a8-43a6f77f03be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:13:17.298544 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76210c63-eecf-4f2b-a4a8-43a6f77f03be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:17.300244 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76210c63-eecf-4f2b-a4a8-43a6f77f03be admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:17.312854 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1233/2449] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:13:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:13:17.317460 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76210c63-eecf-4f2b-a4a8-43a6f77f03be admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:17.328634 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76210c63-eecf-4f2b-a4a8-43a6f77f03be admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:17.335004 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a819e3-5af3-4545-bc0d-4019627625c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:17.336373 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a819e3-5af3-4545-bc0d-4019627625c4 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:17.336373 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a819e3-5af3-4545-bc0d-4019627625c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:17.336373 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a819e3-5af3-4545-bc0d-4019627625c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:17.336927 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a819e3-5af3-4545-bc0d-4019627625c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:17.338827 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a819e3-5af3-4545-bc0d-4019627625c4 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:17.359378 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1217/2450] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:13:17 2022] POST /identity/v3/projects => generated 373 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:13:17.363433 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3164d5d0-cebd-42b8-9799-fba34586fe93 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:17.444733 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3164d5d0-cebd-42b8-9799-fba34586fe93 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:17.453247 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1234/2451] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:13:17 2022] POST /identity/v3/projects => generated 375 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:13:17.457264 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a819e3-5af3-4545-bc0d-4019627625c4 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:17.461176 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f2ee4-63af-4111-8d5e-8ebbb1b00a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:17.462316 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f2ee4-63af-4111-8d5e-8ebbb1b00a50 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:17.464204 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f2ee4-63af-4111-8d5e-8ebbb1b00a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:17.465041 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f2ee4-63af-4111-8d5e-8ebbb1b00a50 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:17.466726 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f2ee4-63af-4111-8d5e-8ebbb1b00a50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:17.470971 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f2ee4-63af-4111-8d5e-8ebbb1b00a50 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:17.548162 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a819e3-5af3-4545-bc0d-4019627625c4 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:17.553550 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb5d4c3-8756-4efc-8ad6-d9c7343c50be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:17.554329 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb5d4c3-8756-4efc-8ad6-d9c7343c50be admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:17.554687 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb5d4c3-8756-4efc-8ad6-d9c7343c50be admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:17.555041 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb5d4c3-8756-4efc-8ad6-d9c7343c50be admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:17.558476 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb5d4c3-8756-4efc-8ad6-d9c7343c50be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:17.563019 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb5d4c3-8756-4efc-8ad6-d9c7343c50be admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:17.564508 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1218/2452] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:13:17 2022] POST /identity/v3/users => generated 287 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:13:17.568362 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f2ee4-63af-4111-8d5e-8ebbb1b00a50 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:17.570234 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-169f2ee4-63af-4111-8d5e-8ebbb1b00a50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:17.589114 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f2ee4-63af-4111-8d5e-8ebbb1b00a50 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:17.594931 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0750b9c-f621-42a0-b93e-21cb3c1e45e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:17.595999 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0750b9c-f621-42a0-b93e-21cb3c1e45e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:17.596389 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0750b9c-f621-42a0-b93e-21cb3c1e45e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:17.596822 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0750b9c-f621-42a0-b93e-21cb3c1e45e8 admin admin] PATH_INFO: `/v3/users/f0dc7195a3f84ec7958fb613cc7728be` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:17.598197 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0750b9c-f621-42a0-b93e-21cb3c1e45e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0dc7195a3f84ec7958fb613cc7728be)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:17.600574 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0750b9c-f621-42a0-b93e-21cb3c1e45e8 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:17.679067 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1235/2453] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:13:17 2022] POST /identity/v3/users => generated 288 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:13:17.683213 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb5d4c3-8756-4efc-8ad6-d9c7343c50be admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:17.695450 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb5d4c3-8756-4efc-8ad6-d9c7343c50be admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:17.703721 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc5912-1305-470c-b1f4-e3bbc529c63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:17.704402 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc5912-1305-470c-b1f4-e3bbc529c63f admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:17.704682 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc5912-1305-470c-b1f4-e3bbc529c63f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:17.705011 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc5912-1305-470c-b1f4-e3bbc529c63f admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:17.705763 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dc5912-1305-470c-b1f4-e3bbc529c63f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:17.715590 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dc5912-1305-470c-b1f4-e3bbc529c63f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:17.728901 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1236/2454] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:13:17 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:13:17.729594 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc5912-1305-470c-b1f4-e3bbc529c63f admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:17.740611 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc5912-1305-470c-b1f4-e3bbc529c63f admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:17.746157 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99399dd2-e1a2-47d3-b226-27869d19c9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:17.746946 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99399dd2-e1a2-47d3-b226-27869d19c9b7 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:17.747325 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99399dd2-e1a2-47d3-b226-27869d19c9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:17.747732 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99399dd2-e1a2-47d3-b226-27869d19c9b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:17.748659 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99399dd2-e1a2-47d3-b226-27869d19c9b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:17.751549 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99399dd2-e1a2-47d3-b226-27869d19c9b7 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:17.767648 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1237/2455] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:13:17 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:13:17.767648 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99399dd2-e1a2-47d3-b226-27869d19c9b7 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:17.780964 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99399dd2-e1a2-47d3-b226-27869d19c9b7 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:17.786392 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b15d9d-9918-4588-99a1-85607f806581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:17.787161 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b15d9d-9918-4588-99a1-85607f806581 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:17.787740 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b15d9d-9918-4588-99a1-85607f806581 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:17.787942 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b15d9d-9918-4588-99a1-85607f806581 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:17.789284 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b15d9d-9918-4588-99a1-85607f806581 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:17.790459 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b15d9d-9918-4588-99a1-85607f806581 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:17.805744 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1238/2456] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:13:17 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:13:17.805744 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b15d9d-9918-4588-99a1-85607f806581 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:17.815768 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b15d9d-9918-4588-99a1-85607f806581 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:17.821477 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d10d97-3d27-45ad-b3df-704cb150a8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:17.822163 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d10d97-3d27-45ad-b3df-704cb150a8d3 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:17.822450 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d10d97-3d27-45ad-b3df-704cb150a8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:17.824550 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d10d97-3d27-45ad-b3df-704cb150a8d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:17.824550 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d10d97-3d27-45ad-b3df-704cb150a8d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:17.825249 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d10d97-3d27-45ad-b3df-704cb150a8d3 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:17.836397 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1239/2457] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:13:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:13:17.837920 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d10d97-3d27-45ad-b3df-704cb150a8d3 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:17.863072 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d10d97-3d27-45ad-b3df-704cb150a8d3 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:17.866930 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d0750b9c-f621-42a0-b93e-21cb3c1e45e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0dc7195a3f84ec7958fb613cc7728be'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:17.870186 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d9657c-f434-4dd3-9672-70205dbecab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:17.871182 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9657c-f434-4dd3-9672-70205dbecab0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:17.871614 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9657c-f434-4dd3-9672-70205dbecab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:17.871969 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9657c-f434-4dd3-9672-70205dbecab0 admin admin] PATH_INFO: `/v3/projects/6050ab531fd2485d89bda80c4608ae95/users/b8df5657863d48799cc2c21ff9242d3f/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:17.877785 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d0750b9c-f621-42a0-b93e-21cb3c1e45e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0dc7195a3f84ec7958fb613cc7728be'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:17.878516 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d0750b9c-f621-42a0-b93e-21cb3c1e45e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0dc7195a3f84ec7958fb613cc7728be'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:17.894777 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d9657c-f434-4dd3-9672-70205dbecab0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6050ab531fd2485d89bda80c4608ae95, user_id=b8df5657863d48799cc2c21ff9242d3f, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:17.898989 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d9657c-f434-4dd3-9672-70205dbecab0 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:18.003036 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d0750b9c-f621-42a0-b93e-21cb3c1e45e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0dc7195a3f84ec7958fb613cc7728be'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:18.010348 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1240/2458] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:13:17 2022] PUT /identity/v3/projects/6050ab531fd2485d89bda80c4608ae95/users/b8df5657863d48799cc2c21ff9242d3f/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:13:18.011319 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d9657c-f434-4dd3-9672-70205dbecab0 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:18.033239 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d0750b9c-f621-42a0-b93e-21cb3c1e45e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0dc7195a3f84ec7958fb613cc7728be'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:18.050533 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1219/2459] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:13:17 2022] DELETE /identity/v3/users/f0dc7195a3f84ec7958fb613cc7728be => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:13:18.052576 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a75825-5519-471d-af14-8621b5869082 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:18.053702 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a75825-5519-471d-af14-8621b5869082 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:18.053996 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a75825-5519-471d-af14-8621b5869082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:18.106419 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-44a75825-5519-471d-af14-8621b5869082 None None] MFA Rules not processed for user `b8df5657863d48799cc2c21ff9242d3f`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:18.109372 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-44a75825-5519-471d-af14-8621b5869082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:18.178284 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d9657c-f434-4dd3-9672-70205dbecab0 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:18.213950 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1220/2460] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:13:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:13:18.219841 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17123240-8192-4faf-a93a-538bfd7abcfd None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:18.220128 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17123240-8192-4faf-a93a-538bfd7abcfd None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:18.220407 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17123240-8192-4faf-a93a-538bfd7abcfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:18.244029 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-17123240-8192-4faf-a93a-538bfd7abcfd None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:18.245325 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-17123240-8192-4faf-a93a-538bfd7abcfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:18.319901 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88436bfa-acd4-4333-8e3a-0044bb4d0946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:18.327070 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88436bfa-acd4-4333-8e3a-0044bb4d0946 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:18.327070 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88436bfa-acd4-4333-8e3a-0044bb4d0946 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:18.327070 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88436bfa-acd4-4333-8e3a-0044bb4d0946 admin admin] PATH_INFO: `/v3/projects/8564671b8f374904898ab16b46f85158/users/2d08617d1f684b37a2f4a983cacbfaa6/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:18.339250 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88436bfa-acd4-4333-8e3a-0044bb4d0946 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8564671b8f374904898ab16b46f85158, user_id=2d08617d1f684b37a2f4a983cacbfaa6, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:18.343215 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88436bfa-acd4-4333-8e3a-0044bb4d0946 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:18.367977 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1221/2461] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:13:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:13:18.369047 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17123240-8192-4faf-a93a-538bfd7abcfd None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:18.370534 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-17123240-8192-4faf-a93a-538bfd7abcfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:18.398315 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17123240-8192-4faf-a93a-538bfd7abcfd None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:18.404830 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da0155-d314-4b57-bddb-4077a96ebdc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:18.405749 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da0155-d314-4b57-bddb-4077a96ebdc9 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:18.406036 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da0155-d314-4b57-bddb-4077a96ebdc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:18.406310 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da0155-d314-4b57-bddb-4077a96ebdc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:18.407243 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8da0155-d314-4b57-bddb-4077a96ebdc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:18.409546 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8da0155-d314-4b57-bddb-4077a96ebdc9 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:18.428576 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1241/2462] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:13:18 2022] PUT /identity/v3/projects/8564671b8f374904898ab16b46f85158/users/2d08617d1f684b37a2f4a983cacbfaa6/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:13:18.429905 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88436bfa-acd4-4333-8e3a-0044bb4d0946 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:18.436824 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-88436bfa-acd4-4333-8e3a-0044bb4d0946 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:18.527593 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1222/2463] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:13:18 2022] POST /identity/v3/projects => generated 375 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:13:18.527593 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da0155-d314-4b57-bddb-4077a96ebdc9 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:18.530082 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b8da0155-d314-4b57-bddb-4077a96ebdc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:18.532382 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88436bfa-acd4-4333-8e3a-0044bb4d0946 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:18.609303 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da0155-d314-4b57-bddb-4077a96ebdc9 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:18.614403 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c5d9b3-fa57-4ef0-a856-5cda7021ecf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:18.615328 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c5d9b3-fa57-4ef0-a856-5cda7021ecf6 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:18.619249 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c5d9b3-fa57-4ef0-a856-5cda7021ecf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:18.619249 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c5d9b3-fa57-4ef0-a856-5cda7021ecf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:18.644602 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d64ea6b-08cf-4a8e-9e4a-3357bdceec57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:18.657451 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64ea6b-08cf-4a8e-9e4a-3357bdceec57 service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:18.657451 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64ea6b-08cf-4a8e-9e4a-3357bdceec57 service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:18.657451 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64ea6b-08cf-4a8e-9e4a-3357bdceec57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:18.657451 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-3d64ea6b-08cf-4a8e-9e4a-3357bdceec57 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:18.704694 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c5d9b3-fa57-4ef0-a856-5cda7021ecf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:18.714463 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c5d9b3-fa57-4ef0-a856-5cda7021ecf6 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:18.736693 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1223/2464] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:13:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:13:18.738528 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8058663-9805-45ec-a07d-4261ffbb6153 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:18.738970 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8058663-9805-45ec-a07d-4261ffbb6153 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:18.740226 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8058663-9805-45ec-a07d-4261ffbb6153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:18.775372 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d64ea6b-08cf-4a8e-9e4a-3357bdceec57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:18.777032 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d64ea6b-08cf-4a8e-9e4a-3357bdceec57 service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:18.793279 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-f8058663-9805-45ec-a07d-4261ffbb6153 None None] MFA Rules not processed for user `2d08617d1f684b37a2f4a983cacbfaa6`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:18.795055 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-f8058663-9805-45ec-a07d-4261ffbb6153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:18.795298 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1242/2465] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:13:18 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:13:18.796424 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d64ea6b-08cf-4a8e-9e4a-3357bdceec57 service nova] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:18.828031 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d64ea6b-08cf-4a8e-9e4a-3357bdceec57 service nova] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:18.851122 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f10d371-7327-498b-8efb-ce7f5b7c179c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:18.851761 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f10d371-7327-498b-8efb-ce7f5b7c179c admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:18.858224 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f10d371-7327-498b-8efb-ce7f5b7c179c admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:18.858938 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f10d371-7327-498b-8efb-ce7f5b7c179c admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:18.862652 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f10d371-7327-498b-8efb-ce7f5b7c179c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:18.871521 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f10d371-7327-498b-8efb-ce7f5b7c179c admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:18.966356 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1224/2466] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:13:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:13:18.973637 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8058663-9805-45ec-a07d-4261ffbb6153 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:18.981688 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-f8058663-9805-45ec-a07d-4261ffbb6153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:19.018000 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8058663-9805-45ec-a07d-4261ffbb6153 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:19.037721 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7028fb1-e145-48ce-99b3-11e2c06f893e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:19.047435 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7028fb1-e145-48ce-99b3-11e2c06f893e admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:19.047435 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7028fb1-e145-48ce-99b3-11e2c06f893e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:19.047435 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7028fb1-e145-48ce-99b3-11e2c06f893e admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:19.049484 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7028fb1-e145-48ce-99b3-11e2c06f893e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:19.055514 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7028fb1-e145-48ce-99b3-11e2c06f893e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:19.068752 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1243/2467] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:13:18 2022] POST /identity/v3/users => generated 294 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:13:19.074784 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f10d371-7327-498b-8efb-ce7f5b7c179c admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:19.092565 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f10d371-7327-498b-8efb-ce7f5b7c179c admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:19.102269 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b8205-7c84-4303-bd84-e131cf632759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:19.102269 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b8205-7c84-4303-bd84-e131cf632759 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:19.102816 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b8205-7c84-4303-bd84-e131cf632759 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:19.103100 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b8205-7c84-4303-bd84-e131cf632759 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:19.104342 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723b8205-7c84-4303-bd84-e131cf632759 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:19.106015 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723b8205-7c84-4303-bd84-e131cf632759 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:19.124893 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1244/2468] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:13:19 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:13:19.124893 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b8205-7c84-4303-bd84-e131cf632759 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:19.135865 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b8205-7c84-4303-bd84-e131cf632759 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:19.147321 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3350091-d035-4fa7-bc34-10762adfb23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:19.148391 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3350091-d035-4fa7-bc34-10762adfb23f admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:19.148682 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3350091-d035-4fa7-bc34-10762adfb23f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:19.149157 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3350091-d035-4fa7-bc34-10762adfb23f admin admin] PATH_INFO: `/v3/projects/1ffb39ca25b845f8bad2446128f0afb2/users/6813cd145529475ba658be23403e599f/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:19.174808 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3350091-d035-4fa7-bc34-10762adfb23f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ffb39ca25b845f8bad2446128f0afb2, user_id=6813cd145529475ba658be23403e599f, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:19.180749 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3350091-d035-4fa7-bc34-10762adfb23f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:19.235871 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1225/2469] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:13:18 2022] POST /identity/v3/projects => generated 375 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:13:19.240001 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7028fb1-e145-48ce-99b3-11e2c06f893e admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:19.285492 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1245/2470] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:13:19 2022] PUT /identity/v3/projects/1ffb39ca25b845f8bad2446128f0afb2/users/6813cd145529475ba658be23403e599f/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:13:19.286533 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3350091-d035-4fa7-bc34-10762adfb23f admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:19.384016 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7028fb1-e145-48ce-99b3-11e2c06f893e admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:19.421839 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3350091-d035-4fa7-bc34-10762adfb23f admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:19.438207 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7160fe0b-2bbc-4828-b888-81eb1a9b60b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:19.438973 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160fe0b-2bbc-4828-b888-81eb1a9b60b4 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:19.439267 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160fe0b-2bbc-4828-b888-81eb1a9b60b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:19.439569 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160fe0b-2bbc-4828-b888-81eb1a9b60b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:19.440687 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7160fe0b-2bbc-4828-b888-81eb1a9b60b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:19.442261 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7160fe0b-2bbc-4828-b888-81eb1a9b60b4 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:19.458534 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1246/2471] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:13:19 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:13:19.462701 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7160fe0b-2bbc-4828-b888-81eb1a9b60b4 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:19.499120 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7160fe0b-2bbc-4828-b888-81eb1a9b60b4 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:19.500821 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ea532-e27e-471c-95f4-99ec77d99ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:19.501630 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ea532-e27e-471c-95f4-99ec77d99ad8 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:19.502913 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ea532-e27e-471c-95f4-99ec77d99ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:19.503443 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ea532-e27e-471c-95f4-99ec77d99ad8 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:19.505251 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4ea532-e27e-471c-95f4-99ec77d99ad8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:19.506088 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c04568-d77b-4ee2-a20d-ea315dbf5308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:19.508127 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c04568-d77b-4ee2-a20d-ea315dbf5308 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:19.508423 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c04568-d77b-4ee2-a20d-ea315dbf5308 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:19.508715 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c04568-d77b-4ee2-a20d-ea315dbf5308 admin admin] PATH_INFO: `/v3/projects/1ffb39ca25b845f8bad2446128f0afb2/users/6813cd145529475ba658be23403e599f/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:19.510909 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4ea532-e27e-471c-95f4-99ec77d99ad8 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:19.516766 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c04568-d77b-4ee2-a20d-ea315dbf5308 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ffb39ca25b845f8bad2446128f0afb2, user_id=6813cd145529475ba658be23403e599f, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:19.528788 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c04568-d77b-4ee2-a20d-ea315dbf5308 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:19.548667 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1247/2472] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:13:19 2022] PUT /identity/v3/projects/1ffb39ca25b845f8bad2446128f0afb2/users/6813cd145529475ba658be23403e599f/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:13:19.561415 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b679f5fb-a9e2-4bd4-96bc-c9443b7842cf None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:19.563275 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b679f5fb-a9e2-4bd4-96bc-c9443b7842cf None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:19.564076 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b679f5fb-a9e2-4bd4-96bc-c9443b7842cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:19.618539 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-b679f5fb-a9e2-4bd4-96bc-c9443b7842cf None None] MFA Rules not processed for user `6813cd145529475ba658be23403e599f`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:19.620260 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b679f5fb-a9e2-4bd4-96bc-c9443b7842cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:19.620902 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1226/2473] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:13:19 2022] POST /identity/v3/users => generated 294 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:13:19.622130 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ea532-e27e-471c-95f4-99ec77d99ad8 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:19.634117 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ea532-e27e-471c-95f4-99ec77d99ad8 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:19.722054 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599b5521-6f9b-4ee4-a53b-c1177832e776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:19.723450 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b5521-6f9b-4ee4-a53b-c1177832e776 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:19.723936 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b5521-6f9b-4ee4-a53b-c1177832e776 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:19.724225 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b5521-6f9b-4ee4-a53b-c1177832e776 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:19.724971 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599b5521-6f9b-4ee4-a53b-c1177832e776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:19.726853 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599b5521-6f9b-4ee4-a53b-c1177832e776 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:19.743183 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1227/2474] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:13:19 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:13:19.743183 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599b5521-6f9b-4ee4-a53b-c1177832e776 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:19.745502 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-599b5521-6f9b-4ee4-a53b-c1177832e776 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:19.792144 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599b5521-6f9b-4ee4-a53b-c1177832e776 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:19.797948 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1248/2475] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:13:19 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:13:19.799435 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b679f5fb-a9e2-4bd4-96bc-c9443b7842cf None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:19.800166 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b482c868-a855-4b13-9930-0b14098c2e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:19.802084 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482c868-a855-4b13-9930-0b14098c2e03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:19.802373 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482c868-a855-4b13-9930-0b14098c2e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:19.803943 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482c868-a855-4b13-9930-0b14098c2e03 admin admin] PATH_INFO: `/v3/projects/7fd11fc790a24c9c9b3b9b028257aad1` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:19.806408 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b482c868-a855-4b13-9930-0b14098c2e03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fd11fc790a24c9c9b3b9b028257aad1)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:19.821700 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b482c868-a855-4b13-9930-0b14098c2e03 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:19.833638 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b679f5fb-a9e2-4bd4-96bc-c9443b7842cf None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:19.844672 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084b76fe-e1eb-49ff-ad16-682cba417891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:19.845640 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b76fe-e1eb-49ff-ad16-682cba417891 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:19.846891 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b76fe-e1eb-49ff-ad16-682cba417891 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:19.847189 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b76fe-e1eb-49ff-ad16-682cba417891 admin admin] PATH_INFO: `/v3/projects/4c764d3d509c465491983c31928f42af/users/890a2dd5d1444932af9257261d849888/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:19.896807 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084b76fe-e1eb-49ff-ad16-682cba417891 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c764d3d509c465491983c31928f42af, user_id=890a2dd5d1444932af9257261d849888, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:19.900167 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084b76fe-e1eb-49ff-ad16-682cba417891 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:20.054794 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1249/2476] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:13:19 2022] PUT /identity/v3/projects/4c764d3d509c465491983c31928f42af/users/890a2dd5d1444932af9257261d849888/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:13:20.054794 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084b76fe-e1eb-49ff-ad16-682cba417891 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:20.074110 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b482c868-a855-4b13-9930-0b14098c2e03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fd11fc790a24c9c9b3b9b028257aad1', 'request_id': 'req-b482c868-a855-4b13-9930-0b14098c2e03'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:20.092766 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b482c868-a855-4b13-9930-0b14098c2e03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fd11fc790a24c9c9b3b9b028257aad1', 'request_id': 'req-b482c868-a855-4b13-9930-0b14098c2e03'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:20.109138 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b482c868-a855-4b13-9930-0b14098c2e03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fd11fc790a24c9c9b3b9b028257aad1', 'request_id': 'req-b482c868-a855-4b13-9930-0b14098c2e03'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:20.153042 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084b76fe-e1eb-49ff-ad16-682cba417891 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:20.245548 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b482c868-a855-4b13-9930-0b14098c2e03 admin admin] The token cache is being invalidate because project 7fd11fc790a24c9c9b3b9b028257aad1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:13:20.246136 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b482c868-a855-4b13-9930-0b14098c2e03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:20.249421 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b482c868-a855-4b13-9930-0b14098c2e03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:20.250751 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1228/2477] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:13:19 2022] DELETE /identity/v3/projects/7fd11fc790a24c9c9b3b9b028257aad1 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:13:20.255858 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b482c868-a855-4b13-9930-0b14098c2e03 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:20.262338 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f2049f-6a46-411f-a8e2-a91a19119c32 tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6813cd145529475ba658be23403e599f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ffb39ca25b845f8bad2446128f0afb2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:20.262910 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b482c868-a855-4b13-9930-0b14098c2e03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:20.264878 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f2049f-6a46-411f-a8e2-a91a19119c32 tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:20.265177 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f2049f-6a46-411f-a8e2-a91a19119c32 tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:20.265692 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f2049f-6a46-411f-a8e2-a91a19119c32 tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:20.267426 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f2049f-6a46-411f-a8e2-a91a19119c32 tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:13:20.268888 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f2049f-6a46-411f-a8e2-a91a19119c32 tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:20.270848 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f2049f-6a46-411f-a8e2-a91a19119c32 tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:20.297033 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1250/2478] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:13:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:13:20.297033 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f2049f-6a46-411f-a8e2-a91a19119c32 tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:20.298819 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-64f2049f-6a46-411f-a8e2-a91a19119c32 tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:20.347378 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b482c868-a855-4b13-9930-0b14098c2e03 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:20.356623 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c1d52f-b710-441b-9d79-9da8069b6588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:20.357348 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c1d52f-b710-441b-9d79-9da8069b6588 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:20.358307 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c1d52f-b710-441b-9d79-9da8069b6588 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:20.358686 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c1d52f-b710-441b-9d79-9da8069b6588 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:20.359584 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c1d52f-b710-441b-9d79-9da8069b6588 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:20.368201 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c1d52f-b710-441b-9d79-9da8069b6588 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:20.387735 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1229/2479] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:13:20.387735 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c1d52f-b710-441b-9d79-9da8069b6588 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:20.390643 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b5c1d52f-b710-441b-9d79-9da8069b6588 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:20.413713 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c1d52f-b710-441b-9d79-9da8069b6588 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:20.420604 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffc348a-0029-440f-baf5-a16614fed970 tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6813cd145529475ba658be23403e599f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ffb39ca25b845f8bad2446128f0afb2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:20.421616 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffc348a-0029-440f-baf5-a16614fed970 tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:20.422006 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffc348a-0029-440f-baf5-a16614fed970 tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:20.422386 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffc348a-0029-440f-baf5-a16614fed970 tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:20.423325 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffc348a-0029-440f-baf5-a16614fed970 tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:20.425668 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffc348a-0029-440f-baf5-a16614fed970 tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:20.457488 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f2049f-6a46-411f-a8e2-a91a19119c32 tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:20.471950 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87763469-d710-4237-8d28-fc7d8f15a822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:20.473212 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87763469-d710-4237-8d28-fc7d8f15a822 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:20.473644 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87763469-d710-4237-8d28-fc7d8f15a822 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:20.474066 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87763469-d710-4237-8d28-fc7d8f15a822 admin admin] PATH_INFO: `/v3/users/79e9b749860a443c802fc25dd3c6ec5a` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:20.475770 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87763469-d710-4237-8d28-fc7d8f15a822 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79e9b749860a443c802fc25dd3c6ec5a)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:20.477980 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87763469-d710-4237-8d28-fc7d8f15a822 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:20.533803 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1230/2480] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:13:20 2022] POST /identity/v3/projects => generated 369 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:13:20.540204 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffc348a-0029-440f-baf5-a16614fed970 tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:20.624845 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffc348a-0029-440f-baf5-a16614fed970 tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:20.636006 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c2c8e-af16-414f-9a0d-cb426ecf0fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:20.636006 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c2c8e-af16-414f-9a0d-cb426ecf0fc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:20.636006 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c2c8e-af16-414f-9a0d-cb426ecf0fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:20.636006 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c2c8e-af16-414f-9a0d-cb426ecf0fc9 admin admin] PATH_INFO: `/v3/projects/4c764d3d509c465491983c31928f42af/users/890a2dd5d1444932af9257261d849888/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:20.636364 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8c2c8e-af16-414f-9a0d-cb426ecf0fc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c764d3d509c465491983c31928f42af, user_id=890a2dd5d1444932af9257261d849888, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:20.636913 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8c2c8e-af16-414f-9a0d-cb426ecf0fc9 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:20.651186 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1231/2481] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:13:20 2022] PUT /identity/v3/projects/4c764d3d509c465491983c31928f42af/users/890a2dd5d1444932af9257261d849888/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:13:20.656435 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c2c8e-af16-414f-9a0d-cb426ecf0fc9 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:20.739860 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-87763469-d710-4237-8d28-fc7d8f15a822 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79e9b749860a443c802fc25dd3c6ec5a'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:20.762682 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-87763469-d710-4237-8d28-fc7d8f15a822 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79e9b749860a443c802fc25dd3c6ec5a'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:20.777370 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-87763469-d710-4237-8d28-fc7d8f15a822 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79e9b749860a443c802fc25dd3c6ec5a'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:20.782421 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c2c8e-af16-414f-9a0d-cb426ecf0fc9 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:20.790272 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1b141b-af35-48f3-92d8-e5aaf2e85160 tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6813cd145529475ba658be23403e599f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ffb39ca25b845f8bad2446128f0afb2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:20.790578 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b141b-af35-48f3-92d8-e5aaf2e85160 tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:20.790866 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b141b-af35-48f3-92d8-e5aaf2e85160 tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:20.791210 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b141b-af35-48f3-92d8-e5aaf2e85160 tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:20.792268 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1b141b-af35-48f3-92d8-e5aaf2e85160 tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:13:20.792642 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1b141b-af35-48f3-92d8-e5aaf2e85160 tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:20.797244 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1b141b-af35-48f3-92d8-e5aaf2e85160 tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:20.813532 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1232/2482] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:13:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:13:20.818544 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18bf923-b1bf-4735-843d-5945503c0298 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:20.818833 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18bf923-b1bf-4735-843d-5945503c0298 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:20.819113 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18bf923-b1bf-4735-843d-5945503c0298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:20.843284 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-87763469-d710-4237-8d28-fc7d8f15a822 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79e9b749860a443c802fc25dd3c6ec5a'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:20.844377 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-87763469-d710-4237-8d28-fc7d8f15a822 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79e9b749860a443c802fc25dd3c6ec5a'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:20.854109 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1251/2483] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:13:20 2022] DELETE /identity/v3/users/79e9b749860a443c802fc25dd3c6ec5a => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:13:20.860036 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-b18bf923-b1bf-4735-843d-5945503c0298 None None] MFA Rules not processed for user `890a2dd5d1444932af9257261d849888`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:20.862088 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b18bf923-b1bf-4735-843d-5945503c0298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:20.956081 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1233/2484] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:13:20 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:13:20.988996 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87763469-d710-4237-8d28-fc7d8f15a822 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:20.990546 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-87763469-d710-4237-8d28-fc7d8f15a822 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:21.010585 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18bf923-b1bf-4735-843d-5945503c0298 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:21.012145 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b18bf923-b1bf-4735-843d-5945503c0298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:21.074944 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87763469-d710-4237-8d28-fc7d8f15a822 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:21.080734 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ab22e-34e9-40fe-b7ef-f770bb9ffc00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:21.081382 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ab22e-34e9-40fe-b7ef-f770bb9ffc00 service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:21.081764 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ab22e-34e9-40fe-b7ef-f770bb9ffc00 service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:21.081938 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ab22e-34e9-40fe-b7ef-f770bb9ffc00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:21.083851 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-321ab22e-34e9-40fe-b7ef-f770bb9ffc00 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:21.093363 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18bf923-b1bf-4735-843d-5945503c0298 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:21.100446 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbd6ba7-333c-4cd4-b7a1-1b568358e1f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:21.101100 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd6ba7-333c-4cd4-b7a1-1b568358e1f5 service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:21.101378 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd6ba7-333c-4cd4-b7a1-1b568358e1f5 service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:21.101649 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd6ba7-333c-4cd4-b7a1-1b568358e1f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:21.112761 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbd6ba7-333c-4cd4-b7a1-1b568358e1f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:21.114465 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbd6ba7-333c-4cd4-b7a1-1b568358e1f5 service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:21.128720 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1234/2485] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:13:21 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:13:21.164042 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321ab22e-34e9-40fe-b7ef-f770bb9ffc00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:21.165724 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321ab22e-34e9-40fe-b7ef-f770bb9ffc00 service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:21.176601 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1252/2486] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:13:20 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:13:21.190694 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e1faf-f055-4cd0-a3de-53acf5ec821d None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:21.190982 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e1faf-f055-4cd0-a3de-53acf5ec821d None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:21.191259 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e1faf-f055-4cd0-a3de-53acf5ec821d None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:21.192643 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1235/2487] 10.222.0.52 () {54 vars in 912 bytes} [Sat May 14 21:13:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:13:21.197259 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ab22e-34e9-40fe-b7ef-f770bb9ffc00 service nova] Authenticating service token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 14 21:13:21.208427 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ab22e-34e9-40fe-b7ef-f770bb9ffc00 service nova] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:21.217330 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ab22e-34e9-40fe-b7ef-f770bb9ffc00 service nova] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:21.222094 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98377e6-e760-4f33-bdff-41943e591ab9 tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6813cd145529475ba658be23403e599f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ffb39ca25b845f8bad2446128f0afb2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:21.222958 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98377e6-e760-4f33-bdff-41943e591ab9 tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:21.223241 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98377e6-e760-4f33-bdff-41943e591ab9 tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:21.223559 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98377e6-e760-4f33-bdff-41943e591ab9 tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] PATH_INFO: `/v3/projects/a2e000a0124a45deb23d3a76ad36dc8f` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:21.224754 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98377e6-e760-4f33-bdff-41943e591ab9 tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] RBAC: Authorizing `identity:get_project(project_id=a2e000a0124a45deb23d3a76ad36dc8f)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:21.226807 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98377e6-e760-4f33-bdff-41943e591ab9 tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:21.228562 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1253/2488] 10.222.0.52 () {58 vars in 1443 bytes} [Sat May 14 21:13:21 2022] GET /identity/v3/projects/a2e000a0124a45deb23d3a76ad36dc8f => generated 369 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:13:21.272212 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39105b64-6184-4bdd-9a31-508141716714 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:21.272212 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39105b64-6184-4bdd-9a31-508141716714 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:21.272212 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39105b64-6184-4bdd-9a31-508141716714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:21.289862 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-39105b64-6184-4bdd-9a31-508141716714 None None] MFA Rules not processed for user `5b93d6c3d03d407f8be4aa38e2fbb154`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:21.291070 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-39105b64-6184-4bdd-9a31-508141716714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:21.319042 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98377e6-e760-4f33-bdff-41943e591ab9 tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:21.321089 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d98377e6-e760-4f33-bdff-41943e591ab9 tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:21.384013 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1236/2489] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:13:21 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:13:21.411140 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98377e6-e760-4f33-bdff-41943e591ab9 tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:21.415917 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae2a7e7-0da6-407a-81c6-246e12730227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:21.416791 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2a7e7-0da6-407a-81c6-246e12730227 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:21.417072 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2a7e7-0da6-407a-81c6-246e12730227 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:21.417346 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2a7e7-0da6-407a-81c6-246e12730227 admin admin] PATH_INFO: `/v3/projects/a6b6a6807b234ddc8ef2f51c6571db35` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:21.418540 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae2a7e7-0da6-407a-81c6-246e12730227 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6b6a6807b234ddc8ef2f51c6571db35)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:21.421269 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae2a7e7-0da6-407a-81c6-246e12730227 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:21.450663 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39105b64-6184-4bdd-9a31-508141716714 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:21.464129 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39105b64-6184-4bdd-9a31-508141716714 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:21.470211 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56a8431-8f63-495c-83b2-64ba3f482b66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:21.470867 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56a8431-8f63-495c-83b2-64ba3f482b66 service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:21.471145 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56a8431-8f63-495c-83b2-64ba3f482b66 service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:21.472096 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56a8431-8f63-495c-83b2-64ba3f482b66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:21.474010 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-a56a8431-8f63-495c-83b2-64ba3f482b66 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:21.537326 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56a8431-8f63-495c-83b2-64ba3f482b66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:21.539308 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56a8431-8f63-495c-83b2-64ba3f482b66 service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:21.544453 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6ae2a7e7-0da6-407a-81c6-246e12730227 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6b6a6807b234ddc8ef2f51c6571db35', 'request_id': 'req-6ae2a7e7-0da6-407a-81c6-246e12730227'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:21.549588 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1237/2490] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:13:21 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:13:21.550593 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6ae2a7e7-0da6-407a-81c6-246e12730227 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6b6a6807b234ddc8ef2f51c6571db35', 'request_id': 'req-6ae2a7e7-0da6-407a-81c6-246e12730227'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:21.551183 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3889820-a46a-4af7-a956-27ebe964d567 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:21.551641 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3889820-a46a-4af7-a956-27ebe964d567 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:21.551926 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3889820-a46a-4af7-a956-27ebe964d567 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:21.553547 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1238/2491] 10.222.0.52 () {54 vars in 912 bytes} [Sat May 14 21:13:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:13:21.558165 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3889820-a46a-4af7-a956-27ebe964d567 None None] Authenticating service token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 14 21:13:21.634129 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3889820-a46a-4af7-a956-27ebe964d567 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:21.637278 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6ae2a7e7-0da6-407a-81c6-246e12730227 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6b6a6807b234ddc8ef2f51c6571db35', 'request_id': 'req-6ae2a7e7-0da6-407a-81c6-246e12730227'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:21.649312 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6ae2a7e7-0da6-407a-81c6-246e12730227 admin admin] The token cache is being invalidate because project a6b6a6807b234ddc8ef2f51c6571db35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:13:21.649606 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6ae2a7e7-0da6-407a-81c6-246e12730227 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:21.650301 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6ae2a7e7-0da6-407a-81c6-246e12730227 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:21.652146 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1254/2492] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:13:21 2022] DELETE /identity/v3/projects/a6b6a6807b234ddc8ef2f51c6571db35 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:13:21.657531 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f1a68-24cf-4e0b-8d4c-a2211101e689 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:21.657822 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f1a68-24cf-4e0b-8d4c-a2211101e689 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:21.658101 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f1a68-24cf-4e0b-8d4c-a2211101e689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:21.676382 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-c71f1a68-24cf-4e0b-8d4c-a2211101e689 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:21.677717 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c71f1a68-24cf-4e0b-8d4c-a2211101e689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:21.698492 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3889820-a46a-4af7-a956-27ebe964d567 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:21.704711 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9584c2-52ba-4b32-963f-5a8719bab38d tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6813cd145529475ba658be23403e599f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ffb39ca25b845f8bad2446128f0afb2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:21.705575 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9584c2-52ba-4b32-963f-5a8719bab38d tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:21.705864 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9584c2-52ba-4b32-963f-5a8719bab38d tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:21.706146 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9584c2-52ba-4b32-963f-5a8719bab38d tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] PATH_INFO: `/v3/projects/a2e000a0124a45deb23d3a76ad36dc8f` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:21.707350 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9584c2-52ba-4b32-963f-5a8719bab38d tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] RBAC: Authorizing `identity:get_project(project_id=a2e000a0124a45deb23d3a76ad36dc8f)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:21.709464 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9584c2-52ba-4b32-963f-5a8719bab38d tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:21.711494 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1239/2493] 10.222.0.52 () {58 vars in 1443 bytes} [Sat May 14 21:13:21 2022] GET /identity/v3/projects/a2e000a0124a45deb23d3a76ad36dc8f => generated 369 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:13:21.755128 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9584c2-52ba-4b32-963f-5a8719bab38d tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:21.761350 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1255/2494] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:13:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:13:21.761545 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-9c9584c2-52ba-4b32-963f-5a8719bab38d tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:21.765454 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52bc91-0db8-4435-a84e-1866407519a9 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:21.765940 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52bc91-0db8-4435-a84e-1866407519a9 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:21.766323 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52bc91-0db8-4435-a84e-1866407519a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:21.773514 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9584c2-52ba-4b32-963f-5a8719bab38d tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:21.778461 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb25b9-97ea-42f4-868c-3bf20b08c2de tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6813cd145529475ba658be23403e599f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ffb39ca25b845f8bad2446128f0afb2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:21.779131 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb25b9-97ea-42f4-868c-3bf20b08c2de tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:21.780274 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb25b9-97ea-42f4-868c-3bf20b08c2de tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:21.780564 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb25b9-97ea-42f4-868c-3bf20b08c2de tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:21.781445 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecb25b9-97ea-42f4-868c-3bf20b08c2de tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:13:21.781766 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecb25b9-97ea-42f4-868c-3bf20b08c2de tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:21.783547 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecb25b9-97ea-42f4-868c-3bf20b08c2de tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:21.791436 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-7e52bc91-0db8-4435-a84e-1866407519a9 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:21.793681 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-7e52bc91-0db8-4435-a84e-1866407519a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:21.798095 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1240/2495] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:13:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:13:21.801852 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb25b9-97ea-42f4-868c-3bf20b08c2de tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:21.802840 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1256/2496] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:13:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:13:21.806407 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e52bc91-0db8-4435-a84e-1866407519a9 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:21.817425 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb25b9-97ea-42f4-868c-3bf20b08c2de tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:21.820219 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e52bc91-0db8-4435-a84e-1866407519a9 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:21.825138 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b1904-90d6-431e-9a84-f591db94e8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:21.825806 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b1904-90d6-431e-9a84-f591db94e8c8 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:21.826094 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b1904-90d6-431e-9a84-f591db94e8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:21.826430 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b1904-90d6-431e-9a84-f591db94e8c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:21.827169 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56b1904-90d6-431e-9a84-f591db94e8c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:13:21.827500 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56b1904-90d6-431e-9a84-f591db94e8c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:21.827798 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af99dcd-d906-4480-b6ac-6bceb96d818d tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6813cd145529475ba658be23403e599f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ffb39ca25b845f8bad2446128f0afb2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:21.828642 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af99dcd-d906-4480-b6ac-6bceb96d818d tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:21.829126 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56b1904-90d6-431e-9a84-f591db94e8c8 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:21.829426 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af99dcd-d906-4480-b6ac-6bceb96d818d tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:21.829864 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af99dcd-d906-4480-b6ac-6bceb96d818d tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:21.830734 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af99dcd-d906-4480-b6ac-6bceb96d818d tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:21.832713 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af99dcd-d906-4480-b6ac-6bceb96d818d tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:21.845412 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1257/2497] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:13:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:13:21.847203 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b1904-90d6-431e-9a84-f591db94e8c8 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:21.858815 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b1904-90d6-431e-9a84-f591db94e8c8 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:21.863703 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52040e11-2cd3-4510-a929-c9c8ce1baf85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:21.864363 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52040e11-2cd3-4510-a929-c9c8ce1baf85 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:21.864656 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52040e11-2cd3-4510-a929-c9c8ce1baf85 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:21.864955 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52040e11-2cd3-4510-a929-c9c8ce1baf85 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:21.865652 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52040e11-2cd3-4510-a929-c9c8ce1baf85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:21.867590 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52040e11-2cd3-4510-a929-c9c8ce1baf85 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:21.950969 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1241/2498] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:13:21 2022] POST /identity/v3/users => generated 383 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:13:21.952369 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af99dcd-d906-4480-b6ac-6bceb96d818d tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:21.963176 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af99dcd-d906-4480-b6ac-6bceb96d818d tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:21.971607 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1258/2499] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:13:21 2022] POST /identity/v3/projects => generated 377 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:13:21.971837 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf0c5b-fb23-44e2-89ea-abc0a63922e4 tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6813cd145529475ba658be23403e599f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ffb39ca25b845f8bad2446128f0afb2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:21.972571 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf0c5b-fb23-44e2-89ea-abc0a63922e4 tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:21.972864 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf0c5b-fb23-44e2-89ea-abc0a63922e4 tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:21.973244 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf0c5b-fb23-44e2-89ea-abc0a63922e4 tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:21.974019 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edf0c5b-fb23-44e2-89ea-abc0a63922e4 tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:13:21.974306 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52040e11-2cd3-4510-a929-c9c8ce1baf85 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:21.974431 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edf0c5b-fb23-44e2-89ea-abc0a63922e4 tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:21.976236 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edf0c5b-fb23-44e2-89ea-abc0a63922e4 tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:21.992702 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1242/2500] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:13:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:13:22.043120 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52040e11-2cd3-4510-a929-c9c8ce1baf85 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:22.048594 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467e265e-cbfc-4457-aede-2c52dd86ed1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:22.049265 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467e265e-cbfc-4457-aede-2c52dd86ed1a admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:22.049549 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467e265e-cbfc-4457-aede-2c52dd86ed1a admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:22.049977 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467e265e-cbfc-4457-aede-2c52dd86ed1a admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:22.050668 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467e265e-cbfc-4457-aede-2c52dd86ed1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:22.052699 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467e265e-cbfc-4457-aede-2c52dd86ed1a admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:22.082524 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee949ff-84af-41cd-889f-090b38269355 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:22.088181 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee949ff-84af-41cd-889f-090b38269355 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:22.088181 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee949ff-84af-41cd-889f-090b38269355 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:22.088181 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1243/2501] 10.222.0.52 () {54 vars in 912 bytes} [Sat May 14 21:13:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 14 21:13:22.089176 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee949ff-84af-41cd-889f-090b38269355 None None] Authenticating service token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 14 21:13:22.090938 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8ee949ff-84af-41cd-889f-090b38269355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:22.157595 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1259/2502] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:13:21 2022] POST /identity/v3/users => generated 289 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:13:22.159452 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467e265e-cbfc-4457-aede-2c52dd86ed1a admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:22.185618 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467e265e-cbfc-4457-aede-2c52dd86ed1a admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:22.192358 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26242b03-e590-4dde-a6e2-747912525e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:22.193116 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26242b03-e590-4dde-a6e2-747912525e36 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:22.193473 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26242b03-e590-4dde-a6e2-747912525e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:22.193823 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26242b03-e590-4dde-a6e2-747912525e36 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:22.194835 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26242b03-e590-4dde-a6e2-747912525e36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:22.197143 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26242b03-e590-4dde-a6e2-747912525e36 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:22.214348 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1260/2503] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:13:22.214552 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26242b03-e590-4dde-a6e2-747912525e36 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:22.219632 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee949ff-84af-41cd-889f-090b38269355 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:22.226301 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26242b03-e590-4dde-a6e2-747912525e36 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:22.240116 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a63309-5efe-4dc1-a5d6-aad9f5ff099c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:22.241559 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a63309-5efe-4dc1-a5d6-aad9f5ff099c admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:22.241960 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a63309-5efe-4dc1-a5d6-aad9f5ff099c admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:22.242246 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a63309-5efe-4dc1-a5d6-aad9f5ff099c admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:22.244117 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a63309-5efe-4dc1-a5d6-aad9f5ff099c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:22.246570 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a63309-5efe-4dc1-a5d6-aad9f5ff099c admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:22.281278 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1261/2504] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:13:22.282658 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a63309-5efe-4dc1-a5d6-aad9f5ff099c admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:22.296546 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a63309-5efe-4dc1-a5d6-aad9f5ff099c admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:22.301303 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2dbaa5-b9fc-47af-b24c-b89f3d747f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:22.302341 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2dbaa5-b9fc-47af-b24c-b89f3d747f97 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:22.302874 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2dbaa5-b9fc-47af-b24c-b89f3d747f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:22.303376 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2dbaa5-b9fc-47af-b24c-b89f3d747f97 admin admin] PATH_INFO: `/v3/projects/e22dc54ae5e448b1ab5ebec0483c5dff/users/d70bd5f4870740d8950b6033bdf74277/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:22.322790 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2dbaa5-b9fc-47af-b24c-b89f3d747f97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e22dc54ae5e448b1ab5ebec0483c5dff, user_id=d70bd5f4870740d8950b6033bdf74277, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:22.327192 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2dbaa5-b9fc-47af-b24c-b89f3d747f97 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:22.333255 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee949ff-84af-41cd-889f-090b38269355 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:22.345353 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7378a207-6677-49b0-8940-3a7f3e2bb063 tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6813cd145529475ba658be23403e599f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ffb39ca25b845f8bad2446128f0afb2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:22.346147 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7378a207-6677-49b0-8940-3a7f3e2bb063 tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:22.346510 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7378a207-6677-49b0-8940-3a7f3e2bb063 tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:22.346677 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7378a207-6677-49b0-8940-3a7f3e2bb063 tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] PATH_INFO: `/v3/projects/a2e000a0124a45deb23d3a76ad36dc8f` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:22.348124 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7378a207-6677-49b0-8940-3a7f3e2bb063 tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] RBAC: Authorizing `identity:get_project(project_id=a2e000a0124a45deb23d3a76ad36dc8f)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:22.350134 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7378a207-6677-49b0-8940-3a7f3e2bb063 tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:22.355940 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1244/2505] 10.222.0.52 () {58 vars in 1443 bytes} [Sat May 14 21:13:22 2022] GET /identity/v3/projects/a2e000a0124a45deb23d3a76ad36dc8f => generated 369 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:13:22.437989 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1262/2506] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:13:22 2022] PUT /identity/v3/projects/e22dc54ae5e448b1ab5ebec0483c5dff/users/d70bd5f4870740d8950b6033bdf74277/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:13:22.448863 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fdcbf1-77c4-4228-9f9d-6d0c989496dc None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:22.449233 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fdcbf1-77c4-4228-9f9d-6d0c989496dc None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:22.449649 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fdcbf1-77c4-4228-9f9d-6d0c989496dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:22.479203 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-49fdcbf1-77c4-4228-9f9d-6d0c989496dc None None] MFA Rules not processed for user `d70bd5f4870740d8950b6033bdf74277`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:22.488158 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-49fdcbf1-77c4-4228-9f9d-6d0c989496dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:22.566586 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1245/2507] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:13:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:13:22.571055 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2dbaa5-b9fc-47af-b24c-b89f3d747f97 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:22.651056 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2dbaa5-b9fc-47af-b24c-b89f3d747f97 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:22.656431 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7441aaaa-1943-4e7e-9b30-eb180ad7b233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:22.657113 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441aaaa-1943-4e7e-9b30-eb180ad7b233 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:22.657450 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441aaaa-1943-4e7e-9b30-eb180ad7b233 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:22.657887 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441aaaa-1943-4e7e-9b30-eb180ad7b233 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:22.658631 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7441aaaa-1943-4e7e-9b30-eb180ad7b233 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:22.660575 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7441aaaa-1943-4e7e-9b30-eb180ad7b233 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:22.720050 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a841f67f-1451-4b8e-9550-8d64879640fe None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:22.720580 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a841f67f-1451-4b8e-9550-8d64879640fe None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:22.720850 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a841f67f-1451-4b8e-9550-8d64879640fe None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:22.722395 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1246/2508] 10.222.0.52 () {54 vars in 912 bytes} [Sat May 14 21:13:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 14 21:13:22.727220 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a841f67f-1451-4b8e-9550-8d64879640fe None None] Authenticating service token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 14 21:13:22.728966 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-a841f67f-1451-4b8e-9550-8d64879640fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:22.789003 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1263/2509] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:13:22 2022] POST /identity/v3/projects => generated 375 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:13:22.793036 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7441aaaa-1943-4e7e-9b30-eb180ad7b233 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:22.810076 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a841f67f-1451-4b8e-9550-8d64879640fe None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:22.866283 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7441aaaa-1943-4e7e-9b30-eb180ad7b233 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:22.873943 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a0754e-f5b8-4d92-b04a-6604e0622523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:22.874745 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0754e-f5b8-4d92-b04a-6604e0622523 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:22.875100 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0754e-f5b8-4d92-b04a-6604e0622523 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:22.876082 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0754e-f5b8-4d92-b04a-6604e0622523 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:22.876430 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a0754e-f5b8-4d92-b04a-6604e0622523 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:22.878831 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a0754e-f5b8-4d92-b04a-6604e0622523 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:22.897491 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a841f67f-1451-4b8e-9550-8d64879640fe None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:22.962473 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f71f9ae-22e6-4c66-9430-8808967ebdcb tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6813cd145529475ba658be23403e599f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ffb39ca25b845f8bad2446128f0afb2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:22.963357 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71f9ae-22e6-4c66-9430-8808967ebdcb tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:22.963995 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71f9ae-22e6-4c66-9430-8808967ebdcb tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:22.963995 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71f9ae-22e6-4c66-9430-8808967ebdcb tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] PATH_INFO: `/v3/projects/a2e000a0124a45deb23d3a76ad36dc8f` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:22.965135 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f71f9ae-22e6-4c66-9430-8808967ebdcb tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] RBAC: Authorizing `identity:get_project(project_id=a2e000a0124a45deb23d3a76ad36dc8f)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:22.967332 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f71f9ae-22e6-4c66-9430-8808967ebdcb tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:22.969137 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1247/2510] 10.222.0.52 () {58 vars in 1443 bytes} [Sat May 14 21:13:22 2022] GET /identity/v3/projects/a2e000a0124a45deb23d3a76ad36dc8f => generated 369 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:13:22.969920 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f71f9ae-22e6-4c66-9430-8808967ebdcb tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:22.971604 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-0f71f9ae-22e6-4c66-9430-8808967ebdcb tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:22.978361 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1264/2511] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:13:22 2022] POST /identity/v3/users => generated 294 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:13:22.982335 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a0754e-f5b8-4d92-b04a-6604e0622523 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:22.999349 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f71f9ae-22e6-4c66-9430-8808967ebdcb tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:23.002989 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a0754e-f5b8-4d92-b04a-6604e0622523 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:23.004997 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0dadba-c65e-4cd0-bffe-311c33a3726e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:23.005902 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0dadba-c65e-4cd0-bffe-311c33a3726e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:23.006194 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0dadba-c65e-4cd0-bffe-311c33a3726e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:23.006978 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0dadba-c65e-4cd0-bffe-311c33a3726e admin admin] PATH_INFO: `/v3/users/2d08617d1f684b37a2f4a983cacbfaa6` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:23.008292 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0dadba-c65e-4cd0-bffe-311c33a3726e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d08617d1f684b37a2f4a983cacbfaa6)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:23.009535 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1581bf-d4f1-48cb-b571-c325f271bdfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:23.010306 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1581bf-d4f1-48cb-b571-c325f271bdfc admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:23.010549 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0dadba-c65e-4cd0-bffe-311c33a3726e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:23.010864 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1581bf-d4f1-48cb-b571-c325f271bdfc admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:23.011529 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1581bf-d4f1-48cb-b571-c325f271bdfc admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:23.012867 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1581bf-d4f1-48cb-b571-c325f271bdfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:23.018121 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1581bf-d4f1-48cb-b571-c325f271bdfc admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:23.034385 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1265/2512] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:13:23.039292 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1581bf-d4f1-48cb-b571-c325f271bdfc admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:23.056413 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1581bf-d4f1-48cb-b571-c325f271bdfc admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:23.061736 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c903e8d8-8b82-4dc5-b983-e124ba23abaf tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6813cd145529475ba658be23403e599f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ffb39ca25b845f8bad2446128f0afb2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:23.062694 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903e8d8-8b82-4dc5-b983-e124ba23abaf tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:23.062980 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903e8d8-8b82-4dc5-b983-e124ba23abaf tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:23.063284 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903e8d8-8b82-4dc5-b983-e124ba23abaf tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] PATH_INFO: `/v3/users/7f2e9af7c053469683f22d2a47ee2fdd` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:23.079063 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c903e8d8-8b82-4dc5-b983-e124ba23abaf tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] RBAC: Authorizing `identity:delete_user(user_id=7f2e9af7c053469683f22d2a47ee2fdd)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:23.081224 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c903e8d8-8b82-4dc5-b983-e124ba23abaf tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:23.172063 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c903e8d8-8b82-4dc5-b983-e124ba23abaf tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f2e9af7c053469683f22d2a47ee2fdd'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:23.183280 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c903e8d8-8b82-4dc5-b983-e124ba23abaf tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f2e9af7c053469683f22d2a47ee2fdd'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:23.189890 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c903e8d8-8b82-4dc5-b983-e124ba23abaf tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f2e9af7c053469683f22d2a47ee2fdd'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:23.215971 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-bd0dadba-c65e-4cd0-bffe-311c33a3726e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d08617d1f684b37a2f4a983cacbfaa6'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:23.223284 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-bd0dadba-c65e-4cd0-bffe-311c33a3726e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d08617d1f684b37a2f4a983cacbfaa6'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:23.223989 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-bd0dadba-c65e-4cd0-bffe-311c33a3726e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d08617d1f684b37a2f4a983cacbfaa6'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:23.305359 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c903e8d8-8b82-4dc5-b983-e124ba23abaf tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f2e9af7c053469683f22d2a47ee2fdd'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:23.306178 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c903e8d8-8b82-4dc5-b983-e124ba23abaf tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f2e9af7c053469683f22d2a47ee2fdd'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:23.312765 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1266/2513] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:13:23 2022] DELETE /identity/v3/users/7f2e9af7c053469683f22d2a47ee2fdd => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:13:23.313713 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c903e8d8-8b82-4dc5-b983-e124ba23abaf tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:23.315398 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c903e8d8-8b82-4dc5-b983-e124ba23abaf tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:23.379957 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-bd0dadba-c65e-4cd0-bffe-311c33a3726e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d08617d1f684b37a2f4a983cacbfaa6'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:23.384518 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c903e8d8-8b82-4dc5-b983-e124ba23abaf tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:23.389822 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9046d4b4-adbd-474f-b9ae-d18f0917fd74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:23.396342 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046d4b4-adbd-474f-b9ae-d18f0917fd74 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:23.396876 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046d4b4-adbd-474f-b9ae-d18f0917fd74 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:23.397118 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046d4b4-adbd-474f-b9ae-d18f0917fd74 admin admin] PATH_INFO: `/v3/projects/3cc006710530414f8627a37ddbffa73d/users/63fef14c06914a028f3de794dfc56d75/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:23.397672 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-bd0dadba-c65e-4cd0-bffe-311c33a3726e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d08617d1f684b37a2f4a983cacbfaa6'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:23.408025 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1248/2514] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:13:22 2022] DELETE /identity/v3/users/2d08617d1f684b37a2f4a983cacbfaa6 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:13:23.408974 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0dadba-c65e-4cd0-bffe-311c33a3726e admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:23.410818 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-bd0dadba-c65e-4cd0-bffe-311c33a3726e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:23.421063 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9046d4b4-adbd-474f-b9ae-d18f0917fd74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cc006710530414f8627a37ddbffa73d, user_id=63fef14c06914a028f3de794dfc56d75, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:23.423982 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9046d4b4-adbd-474f-b9ae-d18f0917fd74 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:23.488154 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0dadba-c65e-4cd0-bffe-311c33a3726e admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:23.492465 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1267/2515] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:13:23 2022] PUT /identity/v3/projects/3cc006710530414f8627a37ddbffa73d/users/63fef14c06914a028f3de794dfc56d75/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:13:23.492465 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c27592f-4d83-42cd-a619-4fbdd726e333 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:23.492465 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c27592f-4d83-42cd-a619-4fbdd726e333 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:23.492465 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c27592f-4d83-42cd-a619-4fbdd726e333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:23.522670 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-3c27592f-4d83-42cd-a619-4fbdd726e333 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:23.525792 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-3c27592f-4d83-42cd-a619-4fbdd726e333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:23.622072 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33c556f-bd64-4563-9f4a-4ac702f3ea34 tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6813cd145529475ba658be23403e599f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ffb39ca25b845f8bad2446128f0afb2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:23.624012 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c556f-bd64-4563-9f4a-4ac702f3ea34 tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:23.624569 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c556f-bd64-4563-9f4a-4ac702f3ea34 tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:23.624926 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c556f-bd64-4563-9f4a-4ac702f3ea34 tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] PATH_INFO: `/v3/projects/a2e000a0124a45deb23d3a76ad36dc8f` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:23.626566 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33c556f-bd64-4563-9f4a-4ac702f3ea34 tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a2e000a0124a45deb23d3a76ad36dc8f)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:23.629553 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33c556f-bd64-4563-9f4a-4ac702f3ea34 tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:23.631274 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1268/2516] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:13:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:13:23.632636 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c27592f-4d83-42cd-a619-4fbdd726e333 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:23.634108 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-3c27592f-4d83-42cd-a619-4fbdd726e333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:23.648206 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c27592f-4d83-42cd-a619-4fbdd726e333 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:23.653862 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda6f4e4-eac8-4842-a9c6-74c67cb150e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:23.654986 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6f4e4-eac8-4842-a9c6-74c67cb150e0 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:23.655431 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6f4e4-eac8-4842-a9c6-74c67cb150e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:23.655885 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6f4e4-eac8-4842-a9c6-74c67cb150e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:23.656763 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda6f4e4-eac8-4842-a9c6-74c67cb150e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:23.658920 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda6f4e4-eac8-4842-a9c6-74c67cb150e0 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:23.671271 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1269/2517] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:13:23 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:13:23.672555 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda6f4e4-eac8-4842-a9c6-74c67cb150e0 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:23.674679 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-eda6f4e4-eac8-4842-a9c6-74c67cb150e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:23.756265 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda6f4e4-eac8-4842-a9c6-74c67cb150e0 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:23.774524 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c72d69b-e154-48f7-8d76-e6bd5e08b6ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:23.775784 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c72d69b-e154-48f7-8d76-e6bd5e08b6ce service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:23.776251 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c72d69b-e154-48f7-8d76-e6bd5e08b6ce service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:23.776530 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c72d69b-e154-48f7-8d76-e6bd5e08b6ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:23.789254 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c72d69b-e154-48f7-8d76-e6bd5e08b6ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:23.796919 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c72d69b-e154-48f7-8d76-e6bd5e08b6ce service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:23.804264 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1270/2518] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:13:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:13:23.805125 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c72d69b-e154-48f7-8d76-e6bd5e08b6ce service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:23.810845 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d33c556f-bd64-4563-9f4a-4ac702f3ea34 tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2e000a0124a45deb23d3a76ad36dc8f', 'request_id': 'req-d33c556f-bd64-4563-9f4a-4ac702f3ea34'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:23.817258 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c72d69b-e154-48f7-8d76-e6bd5e08b6ce service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:23.818049 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d33c556f-bd64-4563-9f4a-4ac702f3ea34 tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2e000a0124a45deb23d3a76ad36dc8f', 'request_id': 'req-d33c556f-bd64-4563-9f4a-4ac702f3ea34'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:23.824780 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d33c556f-bd64-4563-9f4a-4ac702f3ea34 tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2e000a0124a45deb23d3a76ad36dc8f', 'request_id': 'req-d33c556f-bd64-4563-9f4a-4ac702f3ea34'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:23.899702 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64907bf7-7c6b-419e-8e61-251530d26ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:23.900815 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64907bf7-7c6b-419e-8e61-251530d26ae5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:23.908844 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d33c556f-bd64-4563-9f4a-4ac702f3ea34 tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] The token cache is being invalidate because project a2e000a0124a45deb23d3a76ad36dc8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:13:23.909705 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d33c556f-bd64-4563-9f4a-4ac702f3ea34 tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:23.910646 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d33c556f-bd64-4563-9f4a-4ac702f3ea34 tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:23.911178 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64907bf7-7c6b-419e-8e61-251530d26ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:23.911594 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64907bf7-7c6b-419e-8e61-251530d26ae5 admin admin] PATH_INFO: `/v3/projects/3cc006710530414f8627a37ddbffa73d/users/63fef14c06914a028f3de794dfc56d75/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:23.919436 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1249/2519] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:13:23 2022] DELETE /identity/v3/projects/a2e000a0124a45deb23d3a76ad36dc8f => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:13:23.919839 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64907bf7-7c6b-419e-8e61-251530d26ae5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cc006710530414f8627a37ddbffa73d, user_id=63fef14c06914a028f3de794dfc56d75, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:23.920069 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64907bf7-7c6b-419e-8e61-251530d26ae5 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:23.920954 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33c556f-bd64-4563-9f4a-4ac702f3ea34 tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:23.923354 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-d33c556f-bd64-4563-9f4a-4ac702f3ea34 tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:23.932283 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1271/2520] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:13:23 2022] PUT /identity/v3/projects/3cc006710530414f8627a37ddbffa73d/users/63fef14c06914a028f3de794dfc56d75/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:13:23.946556 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb04329-5061-4fee-92a8-6d8892e3c90a None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:23.946848 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb04329-5061-4fee-92a8-6d8892e3c90a None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:23.947413 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb04329-5061-4fee-92a8-6d8892e3c90a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:23.956319 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33c556f-bd64-4563-9f4a-4ac702f3ea34 tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:23.976263 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-5eb04329-5061-4fee-92a8-6d8892e3c90a None None] MFA Rules not processed for user `63fef14c06914a028f3de794dfc56d75`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:23.977628 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-5eb04329-5061-4fee-92a8-6d8892e3c90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:24.042852 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449f0e4d-d70c-4b1a-9b15-77186ba78ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:24.043777 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f0e4d-d70c-4b1a-9b15-77186ba78ffc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:24.044061 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f0e4d-d70c-4b1a-9b15-77186ba78ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:24.044336 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f0e4d-d70c-4b1a-9b15-77186ba78ffc admin admin] PATH_INFO: `/v3/users/b8df5657863d48799cc2c21ff9242d3f` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:24.046272 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449f0e4d-d70c-4b1a-9b15-77186ba78ffc admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8df5657863d48799cc2c21ff9242d3f)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:24.051624 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449f0e4d-d70c-4b1a-9b15-77186ba78ffc admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:24.074525 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1272/2521] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:13:23 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:13:24.091503 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4ace5-f440-43af-8470-be1074e43825 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:24.092523 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4ace5-f440-43af-8470-be1074e43825 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:24.093616 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4ace5-f440-43af-8470-be1074e43825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:24.112834 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-62b4ace5-f440-43af-8470-be1074e43825 None None] MFA Rules not processed for user `d70bd5f4870740d8950b6033bdf74277`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:24.114021 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-62b4ace5-f440-43af-8470-be1074e43825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:24.194850 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1273/2522] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:13:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:13:24.245740 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-449f0e4d-d70c-4b1a-9b15-77186ba78ffc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8df5657863d48799cc2c21ff9242d3f'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:24.258432 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-449f0e4d-d70c-4b1a-9b15-77186ba78ffc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8df5657863d48799cc2c21ff9242d3f'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:24.259581 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-449f0e4d-d70c-4b1a-9b15-77186ba78ffc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8df5657863d48799cc2c21ff9242d3f'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:24.332808 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-449f0e4d-d70c-4b1a-9b15-77186ba78ffc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8df5657863d48799cc2c21ff9242d3f'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:24.348430 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-449f0e4d-d70c-4b1a-9b15-77186ba78ffc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8df5657863d48799cc2c21ff9242d3f'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:24.356270 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1250/2523] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:13:23 2022] DELETE /identity/v3/users/b8df5657863d48799cc2c21ff9242d3f => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:13:24.362075 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c688e-f9e9-4615-889f-a6ac59816756 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:24.362580 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c688e-f9e9-4615-889f-a6ac59816756 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:24.363060 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c688e-f9e9-4615-889f-a6ac59816756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:24.384817 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-cc0c688e-f9e9-4615-889f-a6ac59816756 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:24.386575 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-cc0c688e-f9e9-4615-889f-a6ac59816756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:24.440132 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449f0e4d-d70c-4b1a-9b15-77186ba78ffc admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:24.447445 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-449f0e4d-d70c-4b1a-9b15-77186ba78ffc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:24.463669 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1274/2524] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:13:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:13:24.475005 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0c688e-f9e9-4615-889f-a6ac59816756 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:24.476650 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-cc0c688e-f9e9-4615-889f-a6ac59816756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:24.549839 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0c688e-f9e9-4615-889f-a6ac59816756 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:24.556629 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fdf462-b92a-4a32-917b-2ce9601a8745 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:24.557343 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449f0e4d-d70c-4b1a-9b15-77186ba78ffc admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:24.557491 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fdf462-b92a-4a32-917b-2ce9601a8745 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:24.557758 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fdf462-b92a-4a32-917b-2ce9601a8745 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:24.558086 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fdf462-b92a-4a32-917b-2ce9601a8745 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:24.572587 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fdf462-b92a-4a32-917b-2ce9601a8745 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:24.574942 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fdf462-b92a-4a32-917b-2ce9601a8745 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:24.591119 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1275/2525] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:13:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:13:24.593234 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fdf462-b92a-4a32-917b-2ce9601a8745 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:24.595012 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-f5fdf462-b92a-4a32-917b-2ce9601a8745 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:24.600592 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1242855d-7379-49cc-94e7-e70b46ad4cbd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:24.600592 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242855d-7379-49cc-94e7-e70b46ad4cbd service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:24.600592 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242855d-7379-49cc-94e7-e70b46ad4cbd service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:24.605084 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242855d-7379-49cc-94e7-e70b46ad4cbd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:24.609307 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-1242855d-7379-49cc-94e7-e70b46ad4cbd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:24.612142 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fdf462-b92a-4a32-917b-2ce9601a8745 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:24.618590 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7bad04-6b81-464b-bddb-6414483129c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:24.619466 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7bad04-6b81-464b-bddb-6414483129c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:24.619779 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7bad04-6b81-464b-bddb-6414483129c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:24.620064 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7bad04-6b81-464b-bddb-6414483129c5 admin admin] PATH_INFO: `/v3/projects/8564671b8f374904898ab16b46f85158` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:24.623837 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7bad04-6b81-464b-bddb-6414483129c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8564671b8f374904898ab16b46f85158)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:24.624874 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7bad04-6b81-464b-bddb-6414483129c5 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:24.715386 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1242855d-7379-49cc-94e7-e70b46ad4cbd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:24.720614 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1242855d-7379-49cc-94e7-e70b46ad4cbd service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:24.765374 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1251/2526] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:13:24 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:13:24.786670 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-1b7bad04-6b81-464b-bddb-6414483129c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8564671b8f374904898ab16b46f85158', 'request_id': 'req-1b7bad04-6b81-464b-bddb-6414483129c5'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:24.797537 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-1b7bad04-6b81-464b-bddb-6414483129c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8564671b8f374904898ab16b46f85158', 'request_id': 'req-1b7bad04-6b81-464b-bddb-6414483129c5'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:24.888780 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-1b7bad04-6b81-464b-bddb-6414483129c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8564671b8f374904898ab16b46f85158', 'request_id': 'req-1b7bad04-6b81-464b-bddb-6414483129c5'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:24.903524 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-1b7bad04-6b81-464b-bddb-6414483129c5 admin admin] The token cache is being invalidate because project 8564671b8f374904898ab16b46f85158 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:13:24.906456 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-1b7bad04-6b81-464b-bddb-6414483129c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:24.907286 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-1b7bad04-6b81-464b-bddb-6414483129c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:24.910507 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1276/2527] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:13:24 2022] DELETE /identity/v3/projects/8564671b8f374904898ab16b46f85158 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:13:24.915132 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1242855d-7379-49cc-94e7-e70b46ad4cbd service nova] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:24.927890 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1242855d-7379-49cc-94e7-e70b46ad4cbd service nova] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:25.005534 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb49f9b3-5334-49a7-9144-6d0288dafec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:25.006887 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb49f9b3-5334-49a7-9144-6d0288dafec5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:25.007393 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb49f9b3-5334-49a7-9144-6d0288dafec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:25.008490 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb49f9b3-5334-49a7-9144-6d0288dafec5 admin admin] PATH_INFO: `/v3/users/890a2dd5d1444932af9257261d849888` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:25.010900 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb49f9b3-5334-49a7-9144-6d0288dafec5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=890a2dd5d1444932af9257261d849888)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:25.014687 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb49f9b3-5334-49a7-9144-6d0288dafec5 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:25.273753 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-eb49f9b3-5334-49a7-9144-6d0288dafec5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '890a2dd5d1444932af9257261d849888'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:25.286169 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-eb49f9b3-5334-49a7-9144-6d0288dafec5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '890a2dd5d1444932af9257261d849888'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:25.287559 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-eb49f9b3-5334-49a7-9144-6d0288dafec5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '890a2dd5d1444932af9257261d849888'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:25.400827 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-eb49f9b3-5334-49a7-9144-6d0288dafec5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '890a2dd5d1444932af9257261d849888'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:25.416800 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-eb49f9b3-5334-49a7-9144-6d0288dafec5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '890a2dd5d1444932af9257261d849888'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:25.425045 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1252/2528] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:13:24 2022] DELETE /identity/v3/users/890a2dd5d1444932af9257261d849888 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:13:25.554431 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7bad04-6b81-464b-bddb-6414483129c5 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:25.561164 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-1b7bad04-6b81-464b-bddb-6414483129c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:25.570132 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7bad04-6b81-464b-bddb-6414483129c5 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:25.732960 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a460eea4-8b33-4828-9ca7-b19a099ffaf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:25.733896 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a460eea4-8b33-4828-9ca7-b19a099ffaf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:25.734179 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a460eea4-8b33-4828-9ca7-b19a099ffaf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:25.734479 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a460eea4-8b33-4828-9ca7-b19a099ffaf5 admin admin] PATH_INFO: `/v3/projects/6050ab531fd2485d89bda80c4608ae95` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:25.737398 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a460eea4-8b33-4828-9ca7-b19a099ffaf5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6050ab531fd2485d89bda80c4608ae95)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:25.745389 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a460eea4-8b33-4828-9ca7-b19a099ffaf5 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:25.943994 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a460eea4-8b33-4828-9ca7-b19a099ffaf5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6050ab531fd2485d89bda80c4608ae95', 'request_id': 'req-a460eea4-8b33-4828-9ca7-b19a099ffaf5'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:25.961199 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a460eea4-8b33-4828-9ca7-b19a099ffaf5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6050ab531fd2485d89bda80c4608ae95', 'request_id': 'req-a460eea4-8b33-4828-9ca7-b19a099ffaf5'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:26.043442 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a460eea4-8b33-4828-9ca7-b19a099ffaf5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6050ab531fd2485d89bda80c4608ae95', 'request_id': 'req-a460eea4-8b33-4828-9ca7-b19a099ffaf5'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:26.059577 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a460eea4-8b33-4828-9ca7-b19a099ffaf5 admin admin] The token cache is being invalidate because project 6050ab531fd2485d89bda80c4608ae95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:13:26.060202 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a460eea4-8b33-4828-9ca7-b19a099ffaf5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:26.061238 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a460eea4-8b33-4828-9ca7-b19a099ffaf5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:26.064144 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1277/2529] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:13:25 2022] DELETE /identity/v3/projects/6050ab531fd2485d89bda80c4608ae95 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:13:26.067897 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb49f9b3-5334-49a7-9144-6d0288dafec5 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:26.071214 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-eb49f9b3-5334-49a7-9144-6d0288dafec5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:26.096194 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb49f9b3-5334-49a7-9144-6d0288dafec5 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:26.210113 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6391eb5e-6bb8-47a9-94ba-26cf586981fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:26.211171 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6391eb5e-6bb8-47a9-94ba-26cf586981fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:26.211519 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6391eb5e-6bb8-47a9-94ba-26cf586981fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:26.211801 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6391eb5e-6bb8-47a9-94ba-26cf586981fa admin admin] PATH_INFO: `/v3/users/6813cd145529475ba658be23403e599f` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:26.215470 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a460eea4-8b33-4828-9ca7-b19a099ffaf5 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:26.217533 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-a460eea4-8b33-4828-9ca7-b19a099ffaf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:26.221180 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6391eb5e-6bb8-47a9-94ba-26cf586981fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=6813cd145529475ba658be23403e599f)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:26.225557 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6391eb5e-6bb8-47a9-94ba-26cf586981fa admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:26.246299 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a460eea4-8b33-4828-9ca7-b19a099ffaf5 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:26.264253 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3743b0d5-ce72-4c07-9742-c154670f295b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:26.265132 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3743b0d5-ce72-4c07-9742-c154670f295b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:26.265411 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3743b0d5-ce72-4c07-9742-c154670f295b admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:26.265681 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3743b0d5-ce72-4c07-9742-c154670f295b admin admin] PATH_INFO: `/v3/projects/4c764d3d509c465491983c31928f42af` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:26.266873 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3743b0d5-ce72-4c07-9742-c154670f295b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c764d3d509c465491983c31928f42af)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:26.268861 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3743b0d5-ce72-4c07-9742-c154670f295b admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:26.407439 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-6391eb5e-6bb8-47a9-94ba-26cf586981fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6813cd145529475ba658be23403e599f'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:26.410460 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3743b0d5-ce72-4c07-9742-c154670f295b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c764d3d509c465491983c31928f42af', 'request_id': 'req-3743b0d5-ce72-4c07-9742-c154670f295b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:26.415442 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-6391eb5e-6bb8-47a9-94ba-26cf586981fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6813cd145529475ba658be23403e599f'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:26.416844 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-6391eb5e-6bb8-47a9-94ba-26cf586981fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6813cd145529475ba658be23403e599f'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:26.420644 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3743b0d5-ce72-4c07-9742-c154670f295b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c764d3d509c465491983c31928f42af', 'request_id': 'req-3743b0d5-ce72-4c07-9742-c154670f295b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:26.499931 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-6391eb5e-6bb8-47a9-94ba-26cf586981fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6813cd145529475ba658be23403e599f'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:26.513411 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-6391eb5e-6bb8-47a9-94ba-26cf586981fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6813cd145529475ba658be23403e599f'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:26.520313 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1253/2530] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:13:26 2022] DELETE /identity/v3/users/6813cd145529475ba658be23403e599f => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:13:26.612287 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3743b0d5-ce72-4c07-9742-c154670f295b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c764d3d509c465491983c31928f42af', 'request_id': 'req-3743b0d5-ce72-4c07-9742-c154670f295b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:26.641151 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3743b0d5-ce72-4c07-9742-c154670f295b admin admin] The token cache is being invalidate because project 4c764d3d509c465491983c31928f42af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:13:26.641436 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3743b0d5-ce72-4c07-9742-c154670f295b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:26.642144 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3743b0d5-ce72-4c07-9742-c154670f295b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:26.645322 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1278/2531] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:13:26 2022] DELETE /identity/v3/projects/4c764d3d509c465491983c31928f42af => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:13:26.650975 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03380eff-72df-4179-8053-42b88268f997 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:26.651513 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03380eff-72df-4179-8053-42b88268f997 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:26.651982 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03380eff-72df-4179-8053-42b88268f997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:26.712743 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-03380eff-72df-4179-8053-42b88268f997 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:26.718151 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-03380eff-72df-4179-8053-42b88268f997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:26.856514 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1254/2532] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:13:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:13:26.864162 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91285ef5-05b8-4023-82ba-6d370cc0c81e None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:26.864491 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91285ef5-05b8-4023-82ba-6d370cc0c81e None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:26.869014 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91285ef5-05b8-4023-82ba-6d370cc0c81e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:26.908744 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-91285ef5-05b8-4023-82ba-6d370cc0c81e None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:26.910534 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-91285ef5-05b8-4023-82ba-6d370cc0c81e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:26.948270 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1279/2533] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:13:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:13:26.964986 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03380eff-72df-4179-8053-42b88268f997 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:26.980795 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03380eff-72df-4179-8053-42b88268f997 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:27.002552 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e9f104-ecf5-4999-8c21-f27b778bc639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:27.002729 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9f104-ecf5-4999-8c21-f27b778bc639 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:27.003152 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9f104-ecf5-4999-8c21-f27b778bc639 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:27.003273 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9f104-ecf5-4999-8c21-f27b778bc639 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:27.004055 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e9f104-ecf5-4999-8c21-f27b778bc639 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:13:27.004494 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e9f104-ecf5-4999-8c21-f27b778bc639 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:27.010856 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e9f104-ecf5-4999-8c21-f27b778bc639 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:27.076901 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1255/2534] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:13:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:13:27.078071 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91285ef5-05b8-4023-82ba-6d370cc0c81e None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:27.094551 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91285ef5-05b8-4023-82ba-6d370cc0c81e None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:27.100761 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c889088-274c-46fa-a215-384369af5347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:27.101471 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c889088-274c-46fa-a215-384369af5347 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:27.110040 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c889088-274c-46fa-a215-384369af5347 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:27.110040 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c889088-274c-46fa-a215-384369af5347 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:27.110040 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c889088-274c-46fa-a215-384369af5347 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:27.110040 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c889088-274c-46fa-a215-384369af5347 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:27.264122 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1280/2535] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:13:27 2022] POST /identity/v3/projects => generated 399 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:13:27.268561 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e9f104-ecf5-4999-8c21-f27b778bc639 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:27.279104 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e9f104-ecf5-4999-8c21-f27b778bc639 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:27.385178 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e3e33a-840c-4c29-9006-fbcfdd0fe051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:27.385890 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3e33a-840c-4c29-9006-fbcfdd0fe051 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:27.386180 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3e33a-840c-4c29-9006-fbcfdd0fe051 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:27.386459 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3e33a-840c-4c29-9006-fbcfdd0fe051 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:27.387660 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e3e33a-840c-4c29-9006-fbcfdd0fe051 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:27.390174 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e3e33a-840c-4c29-9006-fbcfdd0fe051 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:27.548791 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1256/2536] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:13:27 2022] POST /identity/v3/users => generated 300 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:13:27.553086 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c889088-274c-46fa-a215-384369af5347 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:27.567346 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c889088-274c-46fa-a215-384369af5347 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:27.582508 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3811d4a7-8c03-4818-88bf-158f0590f635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:27.583206 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3811d4a7-8c03-4818-88bf-158f0590f635 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:27.583522 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3811d4a7-8c03-4818-88bf-158f0590f635 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:27.583794 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3811d4a7-8c03-4818-88bf-158f0590f635 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:27.584532 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3811d4a7-8c03-4818-88bf-158f0590f635 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:27.592670 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3811d4a7-8c03-4818-88bf-158f0590f635 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:27.621084 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e3e33a-840c-4c29-9006-fbcfdd0fe051 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:27.623676 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-f9e3e33a-840c-4c29-9006-fbcfdd0fe051 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:27.640865 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1281/2537] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:13:27 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:13:27.641958 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3811d4a7-8c03-4818-88bf-158f0590f635 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:27.667661 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e3e33a-840c-4c29-9006-fbcfdd0fe051 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:27.686294 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3811d4a7-8c03-4818-88bf-158f0590f635 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:27.689957 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212737ea-557f-48f1-879a-ef90999a1ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:27.690848 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212737ea-557f-48f1-879a-ef90999a1ebb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:27.691132 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212737ea-557f-48f1-879a-ef90999a1ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:27.697024 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212737ea-557f-48f1-879a-ef90999a1ebb admin admin] PATH_INFO: `/v3/projects/1ffb39ca25b845f8bad2446128f0afb2` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:27.697024 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212737ea-557f-48f1-879a-ef90999a1ebb admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ffb39ca25b845f8bad2446128f0afb2)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:27.697024 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212737ea-557f-48f1-879a-ef90999a1ebb admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:27.706546 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff2232-d9cb-4ef9-9208-781eb6332a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:27.707236 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff2232-d9cb-4ef9-9208-781eb6332a23 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:27.707553 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff2232-d9cb-4ef9-9208-781eb6332a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:27.707836 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff2232-d9cb-4ef9-9208-781eb6332a23 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:27.708599 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ff2232-d9cb-4ef9-9208-781eb6332a23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:27.725354 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ff2232-d9cb-4ef9-9208-781eb6332a23 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:27.749413 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1282/2538] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:13:27 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:13:27.751184 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff2232-d9cb-4ef9-9208-781eb6332a23 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:27.781474 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff2232-d9cb-4ef9-9208-781eb6332a23 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:27.794513 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db2ada6-f805-48bb-8aed-8423ba426c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:27.796255 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2ada6-f805-48bb-8aed-8423ba426c51 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:27.796548 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2ada6-f805-48bb-8aed-8423ba426c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:27.796832 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2ada6-f805-48bb-8aed-8423ba426c51 admin admin] PATH_INFO: `/v3/projects/c337931c7391427c8dbda4f75806d7d2/users/dd162992e0bd406cb3f660676ddc23a5/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:27.823671 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db2ada6-f805-48bb-8aed-8423ba426c51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c337931c7391427c8dbda4f75806d7d2, user_id=dd162992e0bd406cb3f660676ddc23a5, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:27.828064 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db2ada6-f805-48bb-8aed-8423ba426c51 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:27.893176 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1283/2539] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:13:27 2022] PUT /identity/v3/projects/c337931c7391427c8dbda4f75806d7d2/users/dd162992e0bd406cb3f660676ddc23a5/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:13:27.905528 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9924fe27-1739-4490-a629-39f398e6d495 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:27.905810 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9924fe27-1739-4490-a629-39f398e6d495 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:27.906080 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9924fe27-1739-4490-a629-39f398e6d495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:27.909867 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-212737ea-557f-48f1-879a-ef90999a1ebb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ffb39ca25b845f8bad2446128f0afb2', 'request_id': 'req-212737ea-557f-48f1-879a-ef90999a1ebb'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:27.918123 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-212737ea-557f-48f1-879a-ef90999a1ebb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ffb39ca25b845f8bad2446128f0afb2', 'request_id': 'req-212737ea-557f-48f1-879a-ef90999a1ebb'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:27.927463 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-212737ea-557f-48f1-879a-ef90999a1ebb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ffb39ca25b845f8bad2446128f0afb2', 'request_id': 'req-212737ea-557f-48f1-879a-ef90999a1ebb'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:27.943783 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-9924fe27-1739-4490-a629-39f398e6d495 None None] MFA Rules not processed for user `dd162992e0bd406cb3f660676ddc23a5`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:27.945296 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-9924fe27-1739-4490-a629-39f398e6d495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:28.071903 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1284/2540] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:13:27 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:13:28.076838 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9924fe27-1739-4490-a629-39f398e6d495 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:28.240533 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9924fe27-1739-4490-a629-39f398e6d495 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:28.240533 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441963ee-0db1-4124-9e10-4b6baa55c346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:28.240533 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441963ee-0db1-4124-9e10-4b6baa55c346 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:28.240533 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441963ee-0db1-4124-9e10-4b6baa55c346 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:28.241423 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441963ee-0db1-4124-9e10-4b6baa55c346 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:28.241423 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441963ee-0db1-4124-9e10-4b6baa55c346 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:28.241423 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441963ee-0db1-4124-9e10-4b6baa55c346 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:28.264256 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-212737ea-557f-48f1-879a-ef90999a1ebb admin admin] The token cache is being invalidate because project 1ffb39ca25b845f8bad2446128f0afb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:13:28.288434 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-212737ea-557f-48f1-879a-ef90999a1ebb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:28.288434 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-212737ea-557f-48f1-879a-ef90999a1ebb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:28.288434 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1257/2541] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:13:27 2022] DELETE /identity/v3/projects/1ffb39ca25b845f8bad2446128f0afb2 => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:13:28.291987 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5047f-0adf-45c6-8afd-abe6bc19cd0e None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:28.292619 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5047f-0adf-45c6-8afd-abe6bc19cd0e None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:28.292969 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5047f-0adf-45c6-8afd-abe6bc19cd0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:28.316506 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-e8e5047f-0adf-45c6-8afd-abe6bc19cd0e None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:28.318345 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e8e5047f-0adf-45c6-8afd-abe6bc19cd0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:28.327563 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1258/2542] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:13:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:13:28.335971 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8f8ee-f68b-4770-bc2b-4d340d7fe9f3 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:28.336258 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8f8ee-f68b-4770-bc2b-4d340d7fe9f3 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:28.336730 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8f8ee-f68b-4770-bc2b-4d340d7fe9f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:28.356522 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-bda8f8ee-f68b-4770-bc2b-4d340d7fe9f3 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:28.358247 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-bda8f8ee-f68b-4770-bc2b-4d340d7fe9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:28.367907 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1259/2543] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:13:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:13:28.371460 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda8f8ee-f68b-4770-bc2b-4d340d7fe9f3 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:28.382872 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda8f8ee-f68b-4770-bc2b-4d340d7fe9f3 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:28.389658 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca7c707-cde7-4559-8dc3-5d4258bd2111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:28.390743 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca7c707-cde7-4559-8dc3-5d4258bd2111 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:28.391195 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca7c707-cde7-4559-8dc3-5d4258bd2111 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:28.391657 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca7c707-cde7-4559-8dc3-5d4258bd2111 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:28.392704 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca7c707-cde7-4559-8dc3-5d4258bd2111 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:13:28.393174 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca7c707-cde7-4559-8dc3-5d4258bd2111 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:28.394962 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca7c707-cde7-4559-8dc3-5d4258bd2111 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:28.414125 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1260/2544] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:13:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:13:28.418213 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca7c707-cde7-4559-8dc3-5d4258bd2111 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:28.430086 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca7c707-cde7-4559-8dc3-5d4258bd2111 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:28.436635 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4077fa6-7e0b-4d44-ac86-62d245b436b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:28.437691 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4077fa6-7e0b-4d44-ac86-62d245b436b4 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:28.438145 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4077fa6-7e0b-4d44-ac86-62d245b436b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:28.438605 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4077fa6-7e0b-4d44-ac86-62d245b436b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:28.439459 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4077fa6-7e0b-4d44-ac86-62d245b436b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:28.441657 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4077fa6-7e0b-4d44-ac86-62d245b436b4 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:28.644102 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1285/2545] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:13:28 2022] POST /identity/v3/projects => generated 399 bytes in 565 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:13:28.646423 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441963ee-0db1-4124-9e10-4b6baa55c346 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:28.650225 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-441963ee-0db1-4124-9e10-4b6baa55c346 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:28.722736 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1261/2546] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:13:28 2022] POST /identity/v3/projects => generated 375 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:13:28.726480 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4077fa6-7e0b-4d44-ac86-62d245b436b4 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:28.803321 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441963ee-0db1-4124-9e10-4b6baa55c346 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:28.836186 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4077fa6-7e0b-4d44-ac86-62d245b436b4 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:28.847905 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5326c00-75e7-423f-930e-3bea876cacc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:28.849263 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5326c00-75e7-423f-930e-3bea876cacc8 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:28.851006 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5326c00-75e7-423f-930e-3bea876cacc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:28.851569 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5326c00-75e7-423f-930e-3bea876cacc8 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:28.853437 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5326c00-75e7-423f-930e-3bea876cacc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:28.856686 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5326c00-75e7-423f-930e-3bea876cacc8 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:28.902933 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79997da4-a3cc-4c03-87e3-fc4fddecd012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:28.903658 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79997da4-a3cc-4c03-87e3-fc4fddecd012 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:28.904914 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79997da4-a3cc-4c03-87e3-fc4fddecd012 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:28.905565 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79997da4-a3cc-4c03-87e3-fc4fddecd012 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:28.907017 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79997da4-a3cc-4c03-87e3-fc4fddecd012 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:28.909945 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79997da4-a3cc-4c03-87e3-fc4fddecd012 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:28.987711 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1262/2547] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:13:28 2022] POST /identity/v3/users => generated 288 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:13:28.993685 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5326c00-75e7-423f-930e-3bea876cacc8 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:29.011619 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5326c00-75e7-423f-930e-3bea876cacc8 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:29.022855 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1286/2548] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:13:28 2022] POST /identity/v3/users => generated 306 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:13:29.025146 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7c5b15-02c7-4a1f-a930-eb49f92db9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:29.025921 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c5b15-02c7-4a1f-a930-eb49f92db9dd admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:29.026219 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c5b15-02c7-4a1f-a930-eb49f92db9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:29.026501 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c5b15-02c7-4a1f-a930-eb49f92db9dd admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:29.027242 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7c5b15-02c7-4a1f-a930-eb49f92db9dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:29.027498 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79997da4-a3cc-4c03-87e3-fc4fddecd012 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:29.029594 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7c5b15-02c7-4a1f-a930-eb49f92db9dd admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:29.046860 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79997da4-a3cc-4c03-87e3-fc4fddecd012 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:29.060769 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1263/2549] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:13:28 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:13:29.061021 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9bcb4c-d310-48e2-9e66-6271a1917f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:29.061021 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9bcb4c-d310-48e2-9e66-6271a1917f1d admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:29.061021 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9bcb4c-d310-48e2-9e66-6271a1917f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:29.061021 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9bcb4c-d310-48e2-9e66-6271a1917f1d admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:29.061555 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9bcb4c-d310-48e2-9e66-6271a1917f1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:29.061909 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7c5b15-02c7-4a1f-a930-eb49f92db9dd admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:29.062696 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9bcb4c-d310-48e2-9e66-6271a1917f1d admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:29.081061 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7c5b15-02c7-4a1f-a930-eb49f92db9dd admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:29.085349 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc38611-9f2d-4fff-a2dd-65b38a8d7e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:29.086110 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc38611-9f2d-4fff-a2dd-65b38a8d7e74 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:29.086522 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc38611-9f2d-4fff-a2dd-65b38a8d7e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:29.086949 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc38611-9f2d-4fff-a2dd-65b38a8d7e74 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:29.088635 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc38611-9f2d-4fff-a2dd-65b38a8d7e74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:29.090933 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc38611-9f2d-4fff-a2dd-65b38a8d7e74 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:29.094503 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1287/2550] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:13:29.098544 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9bcb4c-d310-48e2-9e66-6271a1917f1d admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:29.107851 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1264/2551] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:13:29.114493 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9bcb4c-d310-48e2-9e66-6271a1917f1d admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:29.119503 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24efa5bd-660f-4f8d-b24c-3ae9e3573d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:29.120528 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24efa5bd-660f-4f8d-b24c-3ae9e3573d81 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:29.121118 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24efa5bd-660f-4f8d-b24c-3ae9e3573d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:29.121242 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc38611-9f2d-4fff-a2dd-65b38a8d7e74 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:29.121628 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24efa5bd-660f-4f8d-b24c-3ae9e3573d81 admin admin] PATH_INFO: `/v3/projects/4282dcf3855e48dcafc787d50f0d7be8/users/a001c1a49ec347b790c55b13adbce8a2/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:29.143649 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc38611-9f2d-4fff-a2dd-65b38a8d7e74 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:29.146334 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24efa5bd-660f-4f8d-b24c-3ae9e3573d81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4282dcf3855e48dcafc787d50f0d7be8, user_id=a001c1a49ec347b790c55b13adbce8a2, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:29.149310 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24efa5bd-660f-4f8d-b24c-3ae9e3573d81 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:29.150177 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb7571a-18c8-4f16-9a97-c09bfd0b3e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:29.151097 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7571a-18c8-4f16-9a97-c09bfd0b3e49 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:29.151598 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7571a-18c8-4f16-9a97-c09bfd0b3e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:29.151884 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7571a-18c8-4f16-9a97-c09bfd0b3e49 admin admin] PATH_INFO: `/v3/projects/5a6c575ceb0943a28b7a724a562cc4c8/users/946d6c15bc21438fb1992efd7025a747/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:29.171882 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb7571a-18c8-4f16-9a97-c09bfd0b3e49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a6c575ceb0943a28b7a724a562cc4c8, user_id=946d6c15bc21438fb1992efd7025a747, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:29.175129 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb7571a-18c8-4f16-9a97-c09bfd0b3e49 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:29.262348 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1288/2552] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:13:29 2022] PUT /identity/v3/projects/4282dcf3855e48dcafc787d50f0d7be8/users/a001c1a49ec347b790c55b13adbce8a2/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:13:29.272429 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24efa5bd-660f-4f8d-b24c-3ae9e3573d81 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:29.317203 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1265/2553] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:13:29 2022] PUT /identity/v3/projects/5a6c575ceb0943a28b7a724a562cc4c8/users/946d6c15bc21438fb1992efd7025a747/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:13:29.319781 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e132a692-64f7-4f67-a0a8-099871e33ce8 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:29.320078 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e132a692-64f7-4f67-a0a8-099871e33ce8 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:29.320361 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e132a692-64f7-4f67-a0a8-099871e33ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:29.390732 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-e132a692-64f7-4f67-a0a8-099871e33ce8 None None] MFA Rules not processed for user `946d6c15bc21438fb1992efd7025a747`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:29.392014 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e132a692-64f7-4f67-a0a8-099871e33ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:29.393006 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24efa5bd-660f-4f8d-b24c-3ae9e3573d81 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:29.468039 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610d28ba-a3a4-492c-ba33-b76e0cc890e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:29.469031 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d28ba-a3a4-492c-ba33-b76e0cc890e4 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:29.469321 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d28ba-a3a4-492c-ba33-b76e0cc890e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:29.470267 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d28ba-a3a4-492c-ba33-b76e0cc890e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:29.470421 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610d28ba-a3a4-492c-ba33-b76e0cc890e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:29.473218 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610d28ba-a3a4-492c-ba33-b76e0cc890e4 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:29.488600 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1289/2554] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:13:29.490340 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610d28ba-a3a4-492c-ba33-b76e0cc890e4 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:29.508618 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610d28ba-a3a4-492c-ba33-b76e0cc890e4 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:29.515611 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d98e80c-12da-4647-836f-5ef0eaac54d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:29.516134 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d98e80c-12da-4647-836f-5ef0eaac54d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:29.516420 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d98e80c-12da-4647-836f-5ef0eaac54d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:29.516701 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d98e80c-12da-4647-836f-5ef0eaac54d6 admin admin] PATH_INFO: `/v3/projects/4282dcf3855e48dcafc787d50f0d7be8/users/a001c1a49ec347b790c55b13adbce8a2/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:29.518840 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d98e80c-12da-4647-836f-5ef0eaac54d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4282dcf3855e48dcafc787d50f0d7be8, user_id=a001c1a49ec347b790c55b13adbce8a2, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:29.521665 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d98e80c-12da-4647-836f-5ef0eaac54d6 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:29.546291 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1266/2555] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:13:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:13:29.547775 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e132a692-64f7-4f67-a0a8-099871e33ce8 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:29.563531 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1290/2556] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:13:29 2022] PUT /identity/v3/projects/4282dcf3855e48dcafc787d50f0d7be8/users/a001c1a49ec347b790c55b13adbce8a2/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:13:29.568664 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a601c13-a8fa-456a-844a-48d93eb06482 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:29.568962 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a601c13-a8fa-456a-844a-48d93eb06482 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:29.569242 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a601c13-a8fa-456a-844a-48d93eb06482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:29.577681 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e132a692-64f7-4f67-a0a8-099871e33ce8 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:29.602374 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-4a601c13-a8fa-456a-844a-48d93eb06482 None None] MFA Rules not processed for user `a001c1a49ec347b790c55b13adbce8a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:29.604143 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-4a601c13-a8fa-456a-844a-48d93eb06482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:29.717670 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe494c1-60a0-42b0-b498-ee030b83dd21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:29.745608 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe494c1-60a0-42b0-b498-ee030b83dd21 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:29.746093 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe494c1-60a0-42b0-b498-ee030b83dd21 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:29.746747 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe494c1-60a0-42b0-b498-ee030b83dd21 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:29.748511 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe494c1-60a0-42b0-b498-ee030b83dd21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:29.752066 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe494c1-60a0-42b0-b498-ee030b83dd21 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:29.781454 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1291/2557] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:13:29 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:13:29.854824 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1267/2558] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:13:29 2022] POST /identity/v3/projects => generated 375 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:13:29.859083 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a601c13-a8fa-456a-844a-48d93eb06482 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:29.870177 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a601c13-a8fa-456a-844a-48d93eb06482 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:29.978342 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb51ea-5dbb-45b9-81f5-53913009f963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:29.979260 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb51ea-5dbb-45b9-81f5-53913009f963 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:29.979386 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb51ea-5dbb-45b9-81f5-53913009f963 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:29.979664 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb51ea-5dbb-45b9-81f5-53913009f963 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:29.985399 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eb51ea-5dbb-45b9-81f5-53913009f963 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:29.985399 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eb51ea-5dbb-45b9-81f5-53913009f963 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:30.084804 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1292/2559] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:13:29 2022] POST /identity/v3/users => generated 294 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:13:30.088912 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe494c1-60a0-42b0-b498-ee030b83dd21 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:30.100571 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe494c1-60a0-42b0-b498-ee030b83dd21 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:30.105434 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09bdef2-fb2f-49af-bf8c-3d3c96376dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:30.106386 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09bdef2-fb2f-49af-bf8c-3d3c96376dc7 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:30.106794 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09bdef2-fb2f-49af-bf8c-3d3c96376dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:30.107463 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09bdef2-fb2f-49af-bf8c-3d3c96376dc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:30.109220 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09bdef2-fb2f-49af-bf8c-3d3c96376dc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:30.110985 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09bdef2-fb2f-49af-bf8c-3d3c96376dc7 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:30.129034 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1268/2560] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:13:30 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:13:30.130158 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb51ea-5dbb-45b9-81f5-53913009f963 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:30.145365 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb51ea-5dbb-45b9-81f5-53913009f963 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:30.151317 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abfff93-18d5-4df0-9a8a-153d0b57b1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:30.152314 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abfff93-18d5-4df0-9a8a-153d0b57b1df admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:30.152593 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abfff93-18d5-4df0-9a8a-153d0b57b1df admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:30.152871 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abfff93-18d5-4df0-9a8a-153d0b57b1df admin admin] PATH_INFO: `/v3/projects/91d9fcdd33414763b21ba3e9832a6f67/users/c84c10959353491aa4cdbdda9d4102a6/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:30.176266 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abfff93-18d5-4df0-9a8a-153d0b57b1df admin admin] RBAC: Authorizing `identity:create_grant(project_id=91d9fcdd33414763b21ba3e9832a6f67, user_id=c84c10959353491aa4cdbdda9d4102a6, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:30.180562 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abfff93-18d5-4df0-9a8a-153d0b57b1df admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:30.250295 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1293/2561] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:13:30 2022] PUT /identity/v3/projects/91d9fcdd33414763b21ba3e9832a6f67/users/c84c10959353491aa4cdbdda9d4102a6/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:13:30.254264 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09bdef2-fb2f-49af-bf8c-3d3c96376dc7 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:30.268135 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09bdef2-fb2f-49af-bf8c-3d3c96376dc7 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:30.326395 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce9c13-38e0-4063-8cca-a1b79c930c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:30.327223 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce9c13-38e0-4063-8cca-a1b79c930c30 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:30.327521 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce9c13-38e0-4063-8cca-a1b79c930c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:30.327873 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce9c13-38e0-4063-8cca-a1b79c930c30 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:30.328818 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ce9c13-38e0-4063-8cca-a1b79c930c30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:30.331112 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ce9c13-38e0-4063-8cca-a1b79c930c30 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:30.346595 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1269/2562] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:13:30 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:13:30.349270 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abfff93-18d5-4df0-9a8a-153d0b57b1df admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:30.364385 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce9c13-38e0-4063-8cca-a1b79c930c30 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:30.368847 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abfff93-18d5-4df0-9a8a-153d0b57b1df admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:30.370193 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-81ce9c13-38e0-4063-8cca-a1b79c930c30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:30.382007 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2392c7b-df7f-4365-83d6-18bbe5489367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:30.382909 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2392c7b-df7f-4365-83d6-18bbe5489367 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:30.383193 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2392c7b-df7f-4365-83d6-18bbe5489367 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:30.383461 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2392c7b-df7f-4365-83d6-18bbe5489367 admin admin] PATH_INFO: `/v3/projects/91d9fcdd33414763b21ba3e9832a6f67/users/c84c10959353491aa4cdbdda9d4102a6/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:30.390644 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2392c7b-df7f-4365-83d6-18bbe5489367 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91d9fcdd33414763b21ba3e9832a6f67, user_id=c84c10959353491aa4cdbdda9d4102a6, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:30.393555 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2392c7b-df7f-4365-83d6-18bbe5489367 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:30.419665 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1294/2563] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:13:30 2022] PUT /identity/v3/projects/91d9fcdd33414763b21ba3e9832a6f67/users/c84c10959353491aa4cdbdda9d4102a6/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:13:30.421157 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7abe2-93b6-4516-b1be-154cc20b2265 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:30.421450 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7abe2-93b6-4516-b1be-154cc20b2265 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:30.422191 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7abe2-93b6-4516-b1be-154cc20b2265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:30.455091 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-46b7abe2-93b6-4516-b1be-154cc20b2265 None None] MFA Rules not processed for user `c84c10959353491aa4cdbdda9d4102a6`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:30.457065 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-46b7abe2-93b6-4516-b1be-154cc20b2265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:30.549045 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce9c13-38e0-4063-8cca-a1b79c930c30 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:30.557554 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1295/2564] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:13:30 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:13:30.558518 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b7abe2-93b6-4516-b1be-154cc20b2265 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:30.569926 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b7abe2-93b6-4516-b1be-154cc20b2265 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:30.575572 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b802dcd-07a3-47fd-88cf-806d31734e0b tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84c10959353491aa4cdbdda9d4102a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91d9fcdd33414763b21ba3e9832a6f67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:30.576329 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b802dcd-07a3-47fd-88cf-806d31734e0b tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:30.576663 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b802dcd-07a3-47fd-88cf-806d31734e0b tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:30.576946 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b802dcd-07a3-47fd-88cf-806d31734e0b tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:30.579120 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b802dcd-07a3-47fd-88cf-806d31734e0b tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:13:30.579440 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b802dcd-07a3-47fd-88cf-806d31734e0b tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:30.581707 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b802dcd-07a3-47fd-88cf-806d31734e0b tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:30.599748 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1296/2565] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:13:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:13:30.606279 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b802dcd-07a3-47fd-88cf-806d31734e0b tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:30.613360 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b802dcd-07a3-47fd-88cf-806d31734e0b tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:30.623168 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad8b62-6da2-4d86-8347-1eb4f90d77d4 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84c10959353491aa4cdbdda9d4102a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91d9fcdd33414763b21ba3e9832a6f67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:30.623951 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad8b62-6da2-4d86-8347-1eb4f90d77d4 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:30.626167 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad8b62-6da2-4d86-8347-1eb4f90d77d4 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:30.626479 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad8b62-6da2-4d86-8347-1eb4f90d77d4 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:30.627215 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ad8b62-6da2-4d86-8347-1eb4f90d77d4 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:30.629179 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ad8b62-6da2-4d86-8347-1eb4f90d77d4 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:30.681148 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1b0267-c6be-4a9e-9c57-c40d832fa404 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:30.681826 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b0267-c6be-4a9e-9c57-c40d832fa404 service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:30.682110 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b0267-c6be-4a9e-9c57-c40d832fa404 service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:30.682383 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b0267-c6be-4a9e-9c57-c40d832fa404 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:30.684333 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-fa1b0267-c6be-4a9e-9c57-c40d832fa404 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:30.753887 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1b0267-c6be-4a9e-9c57-c40d832fa404 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:30.754674 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1297/2566] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:13:30 2022] POST /identity/v3/projects => generated 371 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:13:30.759041 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad8b62-6da2-4d86-8347-1eb4f90d77d4 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:30.759219 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1b0267-c6be-4a9e-9c57-c40d832fa404 service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:30.786868 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1270/2567] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:13:30 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:13:30.845822 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad8b62-6da2-4d86-8347-1eb4f90d77d4 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:30.852382 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e339a4a6-3d5b-428c-8c2a-df34604ee7d3 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84c10959353491aa4cdbdda9d4102a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91d9fcdd33414763b21ba3e9832a6f67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:30.853753 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339a4a6-3d5b-428c-8c2a-df34604ee7d3 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:30.854049 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339a4a6-3d5b-428c-8c2a-df34604ee7d3 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:30.854332 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339a4a6-3d5b-428c-8c2a-df34604ee7d3 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:30.855080 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e339a4a6-3d5b-428c-8c2a-df34604ee7d3 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:13:30.855397 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e339a4a6-3d5b-428c-8c2a-df34604ee7d3 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:30.857109 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e339a4a6-3d5b-428c-8c2a-df34604ee7d3 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:30.875846 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1298/2568] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:13:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:13:31.532582 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1b0267-c6be-4a9e-9c57-c40d832fa404 service nova] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:31.533996 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-fa1b0267-c6be-4a9e-9c57-c40d832fa404 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:31.549361 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1b0267-c6be-4a9e-9c57-c40d832fa404 service nova] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:31.616538 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed2f650-1dd6-4625-8d5d-c36d00057a90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:31.617388 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed2f650-1dd6-4625-8d5d-c36d00057a90 service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:31.617707 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed2f650-1dd6-4625-8d5d-c36d00057a90 service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:31.617989 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed2f650-1dd6-4625-8d5d-c36d00057a90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:31.627834 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed2f650-1dd6-4625-8d5d-c36d00057a90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:31.629496 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed2f650-1dd6-4625-8d5d-c36d00057a90 service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:31.641810 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1271/2569] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:13:31 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:13:31.660350 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c4786-f2c2-4971-913a-a5feb4a1ef61 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:31.660836 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c4786-f2c2-4971-913a-a5feb4a1ef61 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:31.660932 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c4786-f2c2-4971-913a-a5feb4a1ef61 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:31.662264 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1299/2570] 10.222.0.52 () {54 vars in 912 bytes} [Sat May 14 21:13:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:13:31.667385 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed2f650-1dd6-4625-8d5d-c36d00057a90 service nova] Authenticating service token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 14 21:13:31.678673 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed2f650-1dd6-4625-8d5d-c36d00057a90 service nova] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:31.687875 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed2f650-1dd6-4625-8d5d-c36d00057a90 service nova] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:31.692576 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb848e16-e7d5-45eb-9754-560f61dd3fc6 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84c10959353491aa4cdbdda9d4102a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91d9fcdd33414763b21ba3e9832a6f67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:31.693431 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb848e16-e7d5-45eb-9754-560f61dd3fc6 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:31.693733 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb848e16-e7d5-45eb-9754-560f61dd3fc6 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:31.693997 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb848e16-e7d5-45eb-9754-560f61dd3fc6 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] PATH_INFO: `/v3/projects/72e435aa5a414295b990584ccd3904a7` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:31.695195 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb848e16-e7d5-45eb-9754-560f61dd3fc6 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] RBAC: Authorizing `identity:get_project(project_id=72e435aa5a414295b990584ccd3904a7)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:31.697300 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb848e16-e7d5-45eb-9754-560f61dd3fc6 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:31.699168 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1272/2571] 10.222.0.52 () {58 vars in 1443 bytes} [Sat May 14 21:13:31 2022] GET /identity/v3/projects/72e435aa5a414295b990584ccd3904a7 => generated 371 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:13:32.321658 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f00d55-277a-4a40-90d1-82b8c907bac0 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:32.322692 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f00d55-277a-4a40-90d1-82b8c907bac0 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:32.323707 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f00d55-277a-4a40-90d1-82b8c907bac0 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:32.326224 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1300/2572] 10.222.0.52 () {54 vars in 912 bytes} [Sat May 14 21:13:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:13:32.332917 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb848e16-e7d5-45eb-9754-560f61dd3fc6 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] Authenticating service token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 14 21:13:32.349804 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb848e16-e7d5-45eb-9754-560f61dd3fc6 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:32.360496 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb848e16-e7d5-45eb-9754-560f61dd3fc6 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:32.366607 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c31bc5-4847-4026-ba41-cbd9336bc843 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84c10959353491aa4cdbdda9d4102a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91d9fcdd33414763b21ba3e9832a6f67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:32.367504 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c31bc5-4847-4026-ba41-cbd9336bc843 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:32.367796 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c31bc5-4847-4026-ba41-cbd9336bc843 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:32.368071 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c31bc5-4847-4026-ba41-cbd9336bc843 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] PATH_INFO: `/v3/projects/72e435aa5a414295b990584ccd3904a7` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:32.369268 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c31bc5-4847-4026-ba41-cbd9336bc843 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] RBAC: Authorizing `identity:get_project(project_id=72e435aa5a414295b990584ccd3904a7)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:32.371333 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c31bc5-4847-4026-ba41-cbd9336bc843 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:32.387738 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1273/2573] 10.222.0.52 () {58 vars in 1443 bytes} [Sat May 14 21:13:32 2022] GET /identity/v3/projects/72e435aa5a414295b990584ccd3904a7 => generated 371 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:13:32.424480 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f00d55-277a-4a40-90d1-82b8c907bac0 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:32.424700 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c31bc5-4847-4026-ba41-cbd9336bc843 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:32.445497 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c31bc5-4847-4026-ba41-cbd9336bc843 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:32.447637 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f00d55-277a-4a40-90d1-82b8c907bac0 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:32.460571 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b83743-9825-41cc-b89c-c45cb408b1a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:32.461242 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b83743-9825-41cc-b89c-c45cb408b1a7 service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:32.463087 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6dd3fe-9c49-428f-9337-ec7553d405f4 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84c10959353491aa4cdbdda9d4102a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91d9fcdd33414763b21ba3e9832a6f67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:32.463797 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6dd3fe-9c49-428f-9337-ec7553d405f4 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:32.464081 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6dd3fe-9c49-428f-9337-ec7553d405f4 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:32.464360 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6dd3fe-9c49-428f-9337-ec7553d405f4 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:32.464597 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b83743-9825-41cc-b89c-c45cb408b1a7 service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:32.465015 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b83743-9825-41cc-b89c-c45cb408b1a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:32.469271 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6dd3fe-9c49-428f-9337-ec7553d405f4 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:13:32.469609 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6dd3fe-9c49-428f-9337-ec7553d405f4 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:32.471744 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6dd3fe-9c49-428f-9337-ec7553d405f4 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:32.504817 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1301/2574] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:13:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:13:32.509451 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6dd3fe-9c49-428f-9337-ec7553d405f4 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:32.529909 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6dd3fe-9c49-428f-9337-ec7553d405f4 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:32.540481 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21f6620-be3e-44f3-8bc0-a37e78a99b49 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84c10959353491aa4cdbdda9d4102a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91d9fcdd33414763b21ba3e9832a6f67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:32.541124 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f6620-be3e-44f3-8bc0-a37e78a99b49 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:32.541410 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f6620-be3e-44f3-8bc0-a37e78a99b49 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:32.541681 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f6620-be3e-44f3-8bc0-a37e78a99b49 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:32.542612 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21f6620-be3e-44f3-8bc0-a37e78a99b49 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:32.552013 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21f6620-be3e-44f3-8bc0-a37e78a99b49 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:32.589144 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b83743-9825-41cc-b89c-c45cb408b1a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:32.591323 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b83743-9825-41cc-b89c-c45cb408b1a7 service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:32.607954 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1274/2575] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:13:32 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:13:32.675283 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1302/2576] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:13:32 2022] POST /identity/v3/users => generated 383 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:13:32.679122 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b83743-9825-41cc-b89c-c45cb408b1a7 service nova] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:32.691263 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b83743-9825-41cc-b89c-c45cb408b1a7 service nova] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:32.713905 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449857e-8760-43ab-8602-513ac9923710 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84c10959353491aa4cdbdda9d4102a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91d9fcdd33414763b21ba3e9832a6f67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:32.714997 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449857e-8760-43ab-8602-513ac9923710 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:32.717585 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449857e-8760-43ab-8602-513ac9923710 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:32.718151 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449857e-8760-43ab-8602-513ac9923710 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:32.720942 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6449857e-8760-43ab-8602-513ac9923710 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:13:32.721484 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6449857e-8760-43ab-8602-513ac9923710 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:32.724480 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6449857e-8760-43ab-8602-513ac9923710 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:32.747928 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1275/2577] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:13:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:13:33.217290 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b1426b-0f98-4f85-a56b-88d7b99c67e3 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:33.217785 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b1426b-0f98-4f85-a56b-88d7b99c67e3 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:33.218186 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b1426b-0f98-4f85-a56b-88d7b99c67e3 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:33.219742 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1303/2578] 10.222.0.52 () {54 vars in 912 bytes} [Sat May 14 21:13:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:13:33.224661 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449857e-8760-43ab-8602-513ac9923710 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] Authenticating service token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 14 21:13:33.237880 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449857e-8760-43ab-8602-513ac9923710 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:33.247150 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449857e-8760-43ab-8602-513ac9923710 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:33.252872 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3542812f-5bc7-49d5-b03a-67b717167cc6 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84c10959353491aa4cdbdda9d4102a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91d9fcdd33414763b21ba3e9832a6f67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:33.253801 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3542812f-5bc7-49d5-b03a-67b717167cc6 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:33.254144 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3542812f-5bc7-49d5-b03a-67b717167cc6 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:33.254438 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3542812f-5bc7-49d5-b03a-67b717167cc6 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] PATH_INFO: `/v3/projects/72e435aa5a414295b990584ccd3904a7` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:33.256030 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3542812f-5bc7-49d5-b03a-67b717167cc6 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] RBAC: Authorizing `identity:get_project(project_id=72e435aa5a414295b990584ccd3904a7)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:33.258647 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3542812f-5bc7-49d5-b03a-67b717167cc6 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:33.260591 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1276/2579] 10.222.0.52 () {58 vars in 1443 bytes} [Sat May 14 21:13:33 2022] GET /identity/v3/projects/72e435aa5a414295b990584ccd3904a7 => generated 371 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:13:33.898997 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e55bed-51f5-4d34-89b6-4b2419aaa47f None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:33.899704 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e55bed-51f5-4d34-89b6-4b2419aaa47f None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:33.899704 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e55bed-51f5-4d34-89b6-4b2419aaa47f None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:33.900900 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1304/2580] 10.222.0.52 () {54 vars in 912 bytes} [Sat May 14 21:13:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:13:33.906609 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3542812f-5bc7-49d5-b03a-67b717167cc6 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] Authenticating service token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 14 21:13:33.925166 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3542812f-5bc7-49d5-b03a-67b717167cc6 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:33.939193 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3542812f-5bc7-49d5-b03a-67b717167cc6 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:33.951598 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7742f1-09ce-497b-8e87-391aa28091a8 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84c10959353491aa4cdbdda9d4102a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91d9fcdd33414763b21ba3e9832a6f67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:33.953324 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7742f1-09ce-497b-8e87-391aa28091a8 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:33.953806 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7742f1-09ce-497b-8e87-391aa28091a8 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:33.954291 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7742f1-09ce-497b-8e87-391aa28091a8 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] PATH_INFO: `/v3/projects/72e435aa5a414295b990584ccd3904a7` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:33.956954 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7742f1-09ce-497b-8e87-391aa28091a8 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] RBAC: Authorizing `identity:get_project(project_id=72e435aa5a414295b990584ccd3904a7)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:33.959743 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7742f1-09ce-497b-8e87-391aa28091a8 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:33.962588 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1277/2581] 10.222.0.52 () {58 vars in 1443 bytes} [Sat May 14 21:13:33 2022] GET /identity/v3/projects/72e435aa5a414295b990584ccd3904a7 => generated 371 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:13:34.009224 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e55bed-51f5-4d34-89b6-4b2419aaa47f None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:34.022768 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e55bed-51f5-4d34-89b6-4b2419aaa47f None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:34.031128 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd0b6ea-1e34-44fb-8364-0bd551848718 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84c10959353491aa4cdbdda9d4102a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91d9fcdd33414763b21ba3e9832a6f67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:34.032528 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd0b6ea-1e34-44fb-8364-0bd551848718 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:34.033072 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd0b6ea-1e34-44fb-8364-0bd551848718 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:34.033545 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd0b6ea-1e34-44fb-8364-0bd551848718 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] PATH_INFO: `/v3/users/aa1f20066a404c08b847a6e03b2e8e2b` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:34.059276 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd0b6ea-1e34-44fb-8364-0bd551848718 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] RBAC: Authorizing `identity:delete_user(user_id=aa1f20066a404c08b847a6e03b2e8e2b)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:34.059276 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd0b6ea-1e34-44fb-8364-0bd551848718 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:34.176784 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6cd0b6ea-1e34-44fb-8364-0bd551848718 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa1f20066a404c08b847a6e03b2e8e2b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:34.191764 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6cd0b6ea-1e34-44fb-8364-0bd551848718 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa1f20066a404c08b847a6e03b2e8e2b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:34.201446 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6cd0b6ea-1e34-44fb-8364-0bd551848718 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa1f20066a404c08b847a6e03b2e8e2b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:34.264341 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6cd0b6ea-1e34-44fb-8364-0bd551848718 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa1f20066a404c08b847a6e03b2e8e2b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:34.265226 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6cd0b6ea-1e34-44fb-8364-0bd551848718 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa1f20066a404c08b847a6e03b2e8e2b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:34.278972 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1305/2582] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:13:34 2022] DELETE /identity/v3/users/aa1f20066a404c08b847a6e03b2e8e2b => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:13:34.280455 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7742f1-09ce-497b-8e87-391aa28091a8 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:34.283667 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-4c7742f1-09ce-497b-8e87-391aa28091a8 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:34.304263 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7742f1-09ce-497b-8e87-391aa28091a8 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:34.369289 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cc0d2a-3c82-41b6-a3f0-94aacdc01d69 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84c10959353491aa4cdbdda9d4102a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91d9fcdd33414763b21ba3e9832a6f67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:34.370452 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc0d2a-3c82-41b6-a3f0-94aacdc01d69 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:34.371024 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc0d2a-3c82-41b6-a3f0-94aacdc01d69 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:34.371557 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc0d2a-3c82-41b6-a3f0-94aacdc01d69 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] PATH_INFO: `/v3/projects/72e435aa5a414295b990584ccd3904a7` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:34.373611 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cc0d2a-3c82-41b6-a3f0-94aacdc01d69 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] RBAC: Authorizing `identity:delete_project(project_id=72e435aa5a414295b990584ccd3904a7)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:34.375821 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cc0d2a-3c82-41b6-a3f0-94aacdc01d69 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:34.525191 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-68cc0d2a-3c82-41b6-a3f0-94aacdc01d69 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72e435aa5a414295b990584ccd3904a7', 'request_id': 'req-68cc0d2a-3c82-41b6-a3f0-94aacdc01d69'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:34.539084 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-68cc0d2a-3c82-41b6-a3f0-94aacdc01d69 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72e435aa5a414295b990584ccd3904a7', 'request_id': 'req-68cc0d2a-3c82-41b6-a3f0-94aacdc01d69'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:34.548187 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-68cc0d2a-3c82-41b6-a3f0-94aacdc01d69 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72e435aa5a414295b990584ccd3904a7', 'request_id': 'req-68cc0d2a-3c82-41b6-a3f0-94aacdc01d69'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:34.658747 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-68cc0d2a-3c82-41b6-a3f0-94aacdc01d69 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] The token cache is being invalidate because project 72e435aa5a414295b990584ccd3904a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:13:34.660621 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-68cc0d2a-3c82-41b6-a3f0-94aacdc01d69 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:34.660621 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-68cc0d2a-3c82-41b6-a3f0-94aacdc01d69 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:34.661900 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1278/2583] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:13:34 2022] DELETE /identity/v3/projects/72e435aa5a414295b990584ccd3904a7 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:13:34.667810 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd0b6ea-1e34-44fb-8364-0bd551848718 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:34.671149 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-6cd0b6ea-1e34-44fb-8364-0bd551848718 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:34.780240 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd0b6ea-1e34-44fb-8364-0bd551848718 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:34.877932 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed635a-334e-49dc-a074-35d75e5a8c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:34.880736 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed635a-334e-49dc-a074-35d75e5a8c5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:34.880736 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed635a-334e-49dc-a074-35d75e5a8c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:34.880736 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed635a-334e-49dc-a074-35d75e5a8c5a admin admin] PATH_INFO: `/v3/users/946d6c15bc21438fb1992efd7025a747` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:34.884191 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ed635a-334e-49dc-a074-35d75e5a8c5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=946d6c15bc21438fb1992efd7025a747)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:34.887387 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ed635a-334e-49dc-a074-35d75e5a8c5a admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:35.097685 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-03ed635a-334e-49dc-a074-35d75e5a8c5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '946d6c15bc21438fb1992efd7025a747'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:35.115567 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-03ed635a-334e-49dc-a074-35d75e5a8c5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '946d6c15bc21438fb1992efd7025a747'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:35.123321 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-03ed635a-334e-49dc-a074-35d75e5a8c5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '946d6c15bc21438fb1992efd7025a747'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:35.282828 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-03ed635a-334e-49dc-a074-35d75e5a8c5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '946d6c15bc21438fb1992efd7025a747'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:35.283905 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-03ed635a-334e-49dc-a074-35d75e5a8c5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '946d6c15bc21438fb1992efd7025a747'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:35.291812 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1306/2584] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:13:34 2022] DELETE /identity/v3/users/946d6c15bc21438fb1992efd7025a747 => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:13:35.298519 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638bcc0-524f-4063-bf67-4291265bb99d None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:35.299090 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638bcc0-524f-4063-bf67-4291265bb99d None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:35.299090 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638bcc0-524f-4063-bf67-4291265bb99d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:35.331584 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-8638bcc0-524f-4063-bf67-4291265bb99d None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:35.334972 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8638bcc0-524f-4063-bf67-4291265bb99d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:35.371706 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed635a-334e-49dc-a074-35d75e5a8c5a admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:35.372188 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-03ed635a-334e-49dc-a074-35d75e5a8c5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:35.428357 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1279/2585] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:13:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:13:35.440496 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8638bcc0-524f-4063-bf67-4291265bb99d None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:35.442947 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8638bcc0-524f-4063-bf67-4291265bb99d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:35.532444 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed635a-334e-49dc-a074-35d75e5a8c5a admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:35.539904 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab2c5b4-b10e-4233-a626-d171fffe9ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:35.539904 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2c5b4-b10e-4233-a626-d171fffe9ec1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:35.539904 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2c5b4-b10e-4233-a626-d171fffe9ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:35.539904 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2c5b4-b10e-4233-a626-d171fffe9ec1 admin admin] PATH_INFO: `/v3/users/dd162992e0bd406cb3f660676ddc23a5` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:35.540962 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab2c5b4-b10e-4233-a626-d171fffe9ec1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd162992e0bd406cb3f660676ddc23a5)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:35.543408 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab2c5b4-b10e-4233-a626-d171fffe9ec1 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:35.555079 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8638bcc0-524f-4063-bf67-4291265bb99d None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:35.560738 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7f9dda-3e47-4d3e-ad4c-a82b3592332f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:35.561799 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f9dda-3e47-4d3e-ad4c-a82b3592332f service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:35.562311 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f9dda-3e47-4d3e-ad4c-a82b3592332f service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:35.562735 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f9dda-3e47-4d3e-ad4c-a82b3592332f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:35.577696 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7f9dda-3e47-4d3e-ad4c-a82b3592332f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:35.581446 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7f9dda-3e47-4d3e-ad4c-a82b3592332f service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:35.596242 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1280/2586] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:13:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:13:35.822254 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-fab2c5b4-b10e-4233-a626-d171fffe9ec1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd162992e0bd406cb3f660676ddc23a5'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:35.835892 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-fab2c5b4-b10e-4233-a626-d171fffe9ec1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd162992e0bd406cb3f660676ddc23a5'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:35.845139 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-fab2c5b4-b10e-4233-a626-d171fffe9ec1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd162992e0bd406cb3f660676ddc23a5'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:36.008639 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-fab2c5b4-b10e-4233-a626-d171fffe9ec1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd162992e0bd406cb3f660676ddc23a5'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:36.014326 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-fab2c5b4-b10e-4233-a626-d171fffe9ec1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd162992e0bd406cb3f660676ddc23a5'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:36.026223 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1307/2587] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:13:35 2022] DELETE /identity/v3/users/dd162992e0bd406cb3f660676ddc23a5 => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:13:36.032451 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97a61e-91a5-47e1-8819-1330f39df3e4 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:36.033009 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97a61e-91a5-47e1-8819-1330f39df3e4 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:36.033484 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97a61e-91a5-47e1-8819-1330f39df3e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:36.057321 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-fa97a61e-91a5-47e1-8819-1330f39df3e4 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:36.058569 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-fa97a61e-91a5-47e1-8819-1330f39df3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:36.168088 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1281/2588] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:13:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:13:36.179322 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab2c5b4-b10e-4233-a626-d171fffe9ec1 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:36.180784 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-fab2c5b4-b10e-4233-a626-d171fffe9ec1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:36.241807 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab2c5b4-b10e-4233-a626-d171fffe9ec1 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:36.245455 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466a9286-c212-40bd-a011-65be476b7d68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:36.246125 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a9286-c212-40bd-a011-65be476b7d68 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:36.246450 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a9286-c212-40bd-a011-65be476b7d68 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:36.246728 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a9286-c212-40bd-a011-65be476b7d68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:36.256874 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466a9286-c212-40bd-a011-65be476b7d68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:36.258349 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466a9286-c212-40bd-a011-65be476b7d68 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:36.269294 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1308/2589] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:13:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:13:36.711999 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa97a61e-91a5-47e1-8819-1330f39df3e4 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:36.713843 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-fa97a61e-91a5-47e1-8819-1330f39df3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:36.737905 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa97a61e-91a5-47e1-8819-1330f39df3e4 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:36.751177 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf213c0-718b-4e1f-a876-5b8cb4b71d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:36.752519 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf213c0-718b-4e1f-a876-5b8cb4b71d41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:36.753024 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf213c0-718b-4e1f-a876-5b8cb4b71d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:36.753558 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf213c0-718b-4e1f-a876-5b8cb4b71d41 admin admin] PATH_INFO: `/v3/projects/5a6c575ceb0943a28b7a724a562cc4c8` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:36.755135 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf213c0-718b-4e1f-a876-5b8cb4b71d41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a6c575ceb0943a28b7a724a562cc4c8)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:36.757451 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf213c0-718b-4e1f-a876-5b8cb4b71d41 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:36.777210 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466a9286-c212-40bd-a011-65be476b7d68 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:36.779415 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-466a9286-c212-40bd-a011-65be476b7d68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:36.797717 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466a9286-c212-40bd-a011-65be476b7d68 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:36.813202 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fcd41a-a121-456d-a4fa-e72b40457a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:36.814273 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fcd41a-a121-456d-a4fa-e72b40457a3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:36.814729 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fcd41a-a121-456d-a4fa-e72b40457a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:36.815150 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fcd41a-a121-456d-a4fa-e72b40457a3f admin admin] PATH_INFO: `/v3/projects/c337931c7391427c8dbda4f75806d7d2` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:36.819272 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fcd41a-a121-456d-a4fa-e72b40457a3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c337931c7391427c8dbda4f75806d7d2)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:36.822310 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fcd41a-a121-456d-a4fa-e72b40457a3f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:36.964393 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-8bf213c0-718b-4e1f-a876-5b8cb4b71d41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a6c575ceb0943a28b7a724a562cc4c8', 'request_id': 'req-8bf213c0-718b-4e1f-a876-5b8cb4b71d41'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:36.973692 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-8bf213c0-718b-4e1f-a876-5b8cb4b71d41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a6c575ceb0943a28b7a724a562cc4c8', 'request_id': 'req-8bf213c0-718b-4e1f-a876-5b8cb4b71d41'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:36.978609 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e0fcd41a-a121-456d-a4fa-e72b40457a3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c337931c7391427c8dbda4f75806d7d2', 'request_id': 'req-e0fcd41a-a121-456d-a4fa-e72b40457a3f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:36.984377 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-8bf213c0-718b-4e1f-a876-5b8cb4b71d41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a6c575ceb0943a28b7a724a562cc4c8', 'request_id': 'req-8bf213c0-718b-4e1f-a876-5b8cb4b71d41'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:36.997293 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e0fcd41a-a121-456d-a4fa-e72b40457a3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c337931c7391427c8dbda4f75806d7d2', 'request_id': 'req-e0fcd41a-a121-456d-a4fa-e72b40457a3f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:37.128753 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-8bf213c0-718b-4e1f-a876-5b8cb4b71d41 admin admin] The token cache is being invalidate because project 5a6c575ceb0943a28b7a724a562cc4c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:13:37.129431 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-8bf213c0-718b-4e1f-a876-5b8cb4b71d41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:37.131873 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-8bf213c0-718b-4e1f-a876-5b8cb4b71d41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:37.136883 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1282/2590] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:13:36 2022] DELETE /identity/v3/projects/5a6c575ceb0943a28b7a724a562cc4c8 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:13:37.142523 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf213c0-718b-4e1f-a876-5b8cb4b71d41 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:37.144978 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8bf213c0-718b-4e1f-a876-5b8cb4b71d41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:37.231389 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e0fcd41a-a121-456d-a4fa-e72b40457a3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c337931c7391427c8dbda4f75806d7d2', 'request_id': 'req-e0fcd41a-a121-456d-a4fa-e72b40457a3f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:37.247975 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e0fcd41a-a121-456d-a4fa-e72b40457a3f admin admin] The token cache is being invalidate because project c337931c7391427c8dbda4f75806d7d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:13:37.248258 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e0fcd41a-a121-456d-a4fa-e72b40457a3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:37.252373 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e0fcd41a-a121-456d-a4fa-e72b40457a3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:37.260937 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1309/2591] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:13:36 2022] DELETE /identity/v3/projects/c337931c7391427c8dbda4f75806d7d2 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:13:37.261992 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fcd41a-a121-456d-a4fa-e72b40457a3f admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:37.265406 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e0fcd41a-a121-456d-a4fa-e72b40457a3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:37.341481 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf213c0-718b-4e1f-a876-5b8cb4b71d41 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:37.374644 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fcd41a-a121-456d-a4fa-e72b40457a3f admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:37.389524 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c618bee8-e63d-4955-b66a-ff3e7ae2e333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:37.391847 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618bee8-e63d-4955-b66a-ff3e7ae2e333 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:37.392329 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618bee8-e63d-4955-b66a-ff3e7ae2e333 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:37.392828 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618bee8-e63d-4955-b66a-ff3e7ae2e333 admin admin] PATH_INFO: `/v3/users/a001c1a49ec347b790c55b13adbce8a2` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:37.395143 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c618bee8-e63d-4955-b66a-ff3e7ae2e333 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a001c1a49ec347b790c55b13adbce8a2)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:37.398363 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c618bee8-e63d-4955-b66a-ff3e7ae2e333 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:37.466664 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f904cbc4-7834-4429-80e5-644fe844b199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:37.468939 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f904cbc4-7834-4429-80e5-644fe844b199 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:37.473131 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f904cbc4-7834-4429-80e5-644fe844b199 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:37.473520 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f904cbc4-7834-4429-80e5-644fe844b199 admin admin] PATH_INFO: `/v3/users/c84c10959353491aa4cdbdda9d4102a6` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:37.475277 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f904cbc4-7834-4429-80e5-644fe844b199 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c84c10959353491aa4cdbdda9d4102a6)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:37.478007 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f904cbc4-7834-4429-80e5-644fe844b199 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:37.643411 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c618bee8-e63d-4955-b66a-ff3e7ae2e333 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a001c1a49ec347b790c55b13adbce8a2'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:37.666498 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c618bee8-e63d-4955-b66a-ff3e7ae2e333 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a001c1a49ec347b790c55b13adbce8a2'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:37.675190 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c618bee8-e63d-4955-b66a-ff3e7ae2e333 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a001c1a49ec347b790c55b13adbce8a2'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:37.705795 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f904cbc4-7834-4429-80e5-644fe844b199 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c84c10959353491aa4cdbdda9d4102a6'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:37.714390 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f904cbc4-7834-4429-80e5-644fe844b199 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c84c10959353491aa4cdbdda9d4102a6'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:37.715906 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f904cbc4-7834-4429-80e5-644fe844b199 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c84c10959353491aa4cdbdda9d4102a6'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:37.979019 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c618bee8-e63d-4955-b66a-ff3e7ae2e333 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a001c1a49ec347b790c55b13adbce8a2'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:37.979019 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c618bee8-e63d-4955-b66a-ff3e7ae2e333 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a001c1a49ec347b790c55b13adbce8a2'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:37.979019 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1310/2592] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:13:37 2022] DELETE /identity/v3/users/a001c1a49ec347b790c55b13adbce8a2 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:13:38.085100 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f904cbc4-7834-4429-80e5-644fe844b199 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c84c10959353491aa4cdbdda9d4102a6'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:38.111866 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f904cbc4-7834-4429-80e5-644fe844b199 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c84c10959353491aa4cdbdda9d4102a6'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:38.122024 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1283/2593] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:13:37 2022] DELETE /identity/v3/users/c84c10959353491aa4cdbdda9d4102a6 => generated 0 bytes in 977 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:13:38.463595 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c618bee8-e63d-4955-b66a-ff3e7ae2e333 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:38.467783 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c618bee8-e63d-4955-b66a-ff3e7ae2e333 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:38.556115 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c618bee8-e63d-4955-b66a-ff3e7ae2e333 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:38.628189 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab4981e-2a91-4a59-b016-a409d2ca3846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:38.629200 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab4981e-2a91-4a59-b016-a409d2ca3846 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:38.629583 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab4981e-2a91-4a59-b016-a409d2ca3846 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:38.629927 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab4981e-2a91-4a59-b016-a409d2ca3846 admin admin] PATH_INFO: `/v3/projects/4282dcf3855e48dcafc787d50f0d7be8` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:38.631398 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab4981e-2a91-4a59-b016-a409d2ca3846 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4282dcf3855e48dcafc787d50f0d7be8)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:38.633840 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab4981e-2a91-4a59-b016-a409d2ca3846 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:38.775145 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9ab4981e-2a91-4a59-b016-a409d2ca3846 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4282dcf3855e48dcafc787d50f0d7be8', 'request_id': 'req-9ab4981e-2a91-4a59-b016-a409d2ca3846'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:38.782248 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9ab4981e-2a91-4a59-b016-a409d2ca3846 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4282dcf3855e48dcafc787d50f0d7be8', 'request_id': 'req-9ab4981e-2a91-4a59-b016-a409d2ca3846'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:38.823521 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f904cbc4-7834-4429-80e5-644fe844b199 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:38.825097 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-f904cbc4-7834-4429-80e5-644fe844b199 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:38.845795 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f904cbc4-7834-4429-80e5-644fe844b199 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:38.873093 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9ab4981e-2a91-4a59-b016-a409d2ca3846 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4282dcf3855e48dcafc787d50f0d7be8', 'request_id': 'req-9ab4981e-2a91-4a59-b016-a409d2ca3846'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:38.891110 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9ab4981e-2a91-4a59-b016-a409d2ca3846 admin admin] The token cache is being invalidate because project 4282dcf3855e48dcafc787d50f0d7be8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:13:38.891389 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9ab4981e-2a91-4a59-b016-a409d2ca3846 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:38.896597 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9ab4981e-2a91-4a59-b016-a409d2ca3846 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:38.899201 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1311/2594] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:13:38 2022] DELETE /identity/v3/projects/4282dcf3855e48dcafc787d50f0d7be8 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:13:38.904835 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026b06f-6d0d-4e9f-b317-8e16204f4231 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:38.905506 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026b06f-6d0d-4e9f-b317-8e16204f4231 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:38.905957 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026b06f-6d0d-4e9f-b317-8e16204f4231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:38.950755 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-e026b06f-6d0d-4e9f-b317-8e16204f4231 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:38.953174 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e026b06f-6d0d-4e9f-b317-8e16204f4231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:39.002647 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08881838-b969-4c98-829b-86e67c057813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:39.002647 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08881838-b969-4c98-829b-86e67c057813 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:39.002647 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08881838-b969-4c98-829b-86e67c057813 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:39.003333 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08881838-b969-4c98-829b-86e67c057813 admin admin] PATH_INFO: `/v3/projects/91d9fcdd33414763b21ba3e9832a6f67` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:39.005454 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08881838-b969-4c98-829b-86e67c057813 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91d9fcdd33414763b21ba3e9832a6f67)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:39.007468 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08881838-b969-4c98-829b-86e67c057813 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:39.055312 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1312/2595] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:13:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:13:39.064038 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22168d-38a9-4a75-91a2-d1be0ca66254 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:39.068208 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22168d-38a9-4a75-91a2-d1be0ca66254 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:39.068208 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22168d-38a9-4a75-91a2-d1be0ca66254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:39.085143 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-ea22168d-38a9-4a75-91a2-d1be0ca66254 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:39.089318 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ea22168d-38a9-4a75-91a2-d1be0ca66254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:39.098388 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1313/2596] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:13:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:13:39.099963 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea22168d-38a9-4a75-91a2-d1be0ca66254 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:39.113227 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea22168d-38a9-4a75-91a2-d1be0ca66254 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:39.115156 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1052e6a-5cf8-4efc-ab0d-4894874a7ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:39.115981 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1052e6a-5cf8-4efc-ab0d-4894874a7ed2 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:39.116231 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1052e6a-5cf8-4efc-ab0d-4894874a7ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:39.116491 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1052e6a-5cf8-4efc-ab0d-4894874a7ed2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:39.117428 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1052e6a-5cf8-4efc-ab0d-4894874a7ed2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:13:39.117762 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1052e6a-5cf8-4efc-ab0d-4894874a7ed2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:39.119453 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1052e6a-5cf8-4efc-ab0d-4894874a7ed2 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:39.140983 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1314/2597] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:13:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:13:39.142105 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1052e6a-5cf8-4efc-ab0d-4894874a7ed2 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:39.152699 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1052e6a-5cf8-4efc-ab0d-4894874a7ed2 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:39.153834 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-08881838-b969-4c98-829b-86e67c057813 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91d9fcdd33414763b21ba3e9832a6f67', 'request_id': 'req-08881838-b969-4c98-829b-86e67c057813'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:39.159917 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-08881838-b969-4c98-829b-86e67c057813 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91d9fcdd33414763b21ba3e9832a6f67', 'request_id': 'req-08881838-b969-4c98-829b-86e67c057813'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:39.172222 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-08881838-b969-4c98-829b-86e67c057813 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91d9fcdd33414763b21ba3e9832a6f67', 'request_id': 'req-08881838-b969-4c98-829b-86e67c057813'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:39.215816 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5541a06-4689-4b3a-a3d8-ade1dbd2c8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:39.216657 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5541a06-4689-4b3a-a3d8-ade1dbd2c8f6 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:39.216966 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5541a06-4689-4b3a-a3d8-ade1dbd2c8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:39.217255 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5541a06-4689-4b3a-a3d8-ade1dbd2c8f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:39.218116 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5541a06-4689-4b3a-a3d8-ade1dbd2c8f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:39.219821 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5541a06-4689-4b3a-a3d8-ade1dbd2c8f6 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:39.257682 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-08881838-b969-4c98-829b-86e67c057813 admin admin] The token cache is being invalidate because project 91d9fcdd33414763b21ba3e9832a6f67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:13:39.257682 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-08881838-b969-4c98-829b-86e67c057813 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:39.257682 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-08881838-b969-4c98-829b-86e67c057813 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:39.257682 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1284/2598] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:13:38 2022] DELETE /identity/v3/projects/91d9fcdd33414763b21ba3e9832a6f67 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:13:39.262781 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948acf2-c7fb-42f0-a502-343047164489 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:39.263126 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948acf2-c7fb-42f0-a502-343047164489 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:39.263511 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948acf2-c7fb-42f0-a502-343047164489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:39.286284 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-9948acf2-c7fb-42f0-a502-343047164489 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:39.287695 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-9948acf2-c7fb-42f0-a502-343047164489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:39.303033 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1285/2599] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:13:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:13:39.312251 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d671344-4344-4d68-9ce9-a0ae96c78956 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:39.312512 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d671344-4344-4d68-9ce9-a0ae96c78956 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:39.312791 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d671344-4344-4d68-9ce9-a0ae96c78956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:39.330987 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1315/2600] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:13:39 2022] POST /identity/v3/projects => generated 363 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:13:39.335630 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5541a06-4689-4b3a-a3d8-ade1dbd2c8f6 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:39.337600 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d5541a06-4689-4b3a-a3d8-ade1dbd2c8f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:39.350176 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-2d671344-4344-4d68-9ce9-a0ae96c78956 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:39.351699 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-2d671344-4344-4d68-9ce9-a0ae96c78956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:39.431628 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5541a06-4689-4b3a-a3d8-ade1dbd2c8f6 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:39.438665 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1286/2601] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:13:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:13:39.438665 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d671344-4344-4d68-9ce9-a0ae96c78956 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:39.443836 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4ff737-5d74-4e6c-a8a6-162114cfe059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:39.444930 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ff737-5d74-4e6c-a8a6-162114cfe059 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:39.445402 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ff737-5d74-4e6c-a8a6-162114cfe059 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:39.445869 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ff737-5d74-4e6c-a8a6-162114cfe059 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:39.446751 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4ff737-5d74-4e6c-a8a6-162114cfe059 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:39.448336 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d671344-4344-4d68-9ce9-a0ae96c78956 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:39.449135 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4ff737-5d74-4e6c-a8a6-162114cfe059 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:39.455079 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776d57a-6eee-4077-88c6-ac70153f18f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:39.464258 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776d57a-6eee-4077-88c6-ac70153f18f2 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:39.465631 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776d57a-6eee-4077-88c6-ac70153f18f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:39.466790 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776d57a-6eee-4077-88c6-ac70153f18f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:39.467801 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3776d57a-6eee-4077-88c6-ac70153f18f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:13:39.468310 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3776d57a-6eee-4077-88c6-ac70153f18f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:39.470316 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3776d57a-6eee-4077-88c6-ac70153f18f2 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:39.484647 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1287/2602] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:13:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:13:39.488977 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776d57a-6eee-4077-88c6-ac70153f18f2 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:39.500418 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776d57a-6eee-4077-88c6-ac70153f18f2 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:39.509264 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3266fa-09d1-4a38-bb8a-532ffd25de95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:39.509997 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3266fa-09d1-4a38-bb8a-532ffd25de95 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:39.510288 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3266fa-09d1-4a38-bb8a-532ffd25de95 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:39.510570 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3266fa-09d1-4a38-bb8a-532ffd25de95 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:39.511315 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3266fa-09d1-4a38-bb8a-532ffd25de95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:39.514283 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3266fa-09d1-4a38-bb8a-532ffd25de95 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:39.576687 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1316/2603] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:13:39 2022] POST /identity/v3/users => generated 282 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:13:39.580374 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4ff737-5d74-4e6c-a8a6-162114cfe059 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:39.594124 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4ff737-5d74-4e6c-a8a6-162114cfe059 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:39.601096 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984c46a2-1107-47a5-870e-e5f18a5f1964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:39.603953 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c46a2-1107-47a5-870e-e5f18a5f1964 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:39.603953 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c46a2-1107-47a5-870e-e5f18a5f1964 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:39.603953 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c46a2-1107-47a5-870e-e5f18a5f1964 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:39.603953 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984c46a2-1107-47a5-870e-e5f18a5f1964 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:39.604835 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984c46a2-1107-47a5-870e-e5f18a5f1964 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:39.618253 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1317/2604] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:13:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:13:39.618253 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e9158-ba07-4ba9-908e-fc2981c97aef None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:39.618253 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e9158-ba07-4ba9-908e-fc2981c97aef None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:39.618253 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e9158-ba07-4ba9-908e-fc2981c97aef None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:39.618956 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1318/2605] 10.222.0.52 () {54 vars in 921 bytes} [Sat May 14 21:13:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:13:39.619343 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609e9158-ba07-4ba9-908e-fc2981c97aef None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:39.632613 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609e9158-ba07-4ba9-908e-fc2981c97aef None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:39.637977 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fce990-91f1-442c-ac2b-20c6954fc5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:39.639709 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1288/2606] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:13:39 2022] POST /identity/v3/projects => generated 383 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:13:39.645971 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fce990-91f1-442c-ac2b-20c6954fc5fd admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:39.645971 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fce990-91f1-442c-ac2b-20c6954fc5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:39.645971 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fce990-91f1-442c-ac2b-20c6954fc5fd admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:39.645971 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fce990-91f1-442c-ac2b-20c6954fc5fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:39.646408 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d34dd90-f7af-4b43-94f0-008c2deecb70 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:39.646408 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d34dd90-f7af-4b43-94f0-008c2deecb70 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:39.646408 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d34dd90-f7af-4b43-94f0-008c2deecb70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:39.646670 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fce990-91f1-442c-ac2b-20c6954fc5fd admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:39.652573 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1319/2607] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:13:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:13:39.654456 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fce990-91f1-442c-ac2b-20c6954fc5fd admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:39.665548 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-7d34dd90-f7af-4b43-94f0-008c2deecb70 None None] MFA Rules not processed for user `99ed32a6d699453bb7e088540e8fc980`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:39.666876 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-7d34dd90-f7af-4b43-94f0-008c2deecb70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:39.675591 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fce990-91f1-442c-ac2b-20c6954fc5fd admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:39.735705 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1289/2608] 10.222.0.52 () {58 vars in 1018 bytes} [Sat May 14 21:13:39 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:13:39.736922 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d34dd90-f7af-4b43-94f0-008c2deecb70 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:39.737276 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143510cd-a7e7-4fa7-8201-611923339fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:39.738000 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143510cd-a7e7-4fa7-8201-611923339fc4 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:39.738290 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143510cd-a7e7-4fa7-8201-611923339fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:39.738567 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143510cd-a7e7-4fa7-8201-611923339fc4 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:39.739248 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143510cd-a7e7-4fa7-8201-611923339fc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:39.741386 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143510cd-a7e7-4fa7-8201-611923339fc4 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:39.755971 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d34dd90-f7af-4b43-94f0-008c2deecb70 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:39.764274 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c299f727-67f1-4d9e-959a-15227119d7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:39.764274 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c299f727-67f1-4d9e-959a-15227119d7ef admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:39.764274 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c299f727-67f1-4d9e-959a-15227119d7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:39.764274 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c299f727-67f1-4d9e-959a-15227119d7ef admin admin] PATH_INFO: `/v3/projects/763cf73206604d8abbe1542afe44fa95/users/038739f45c3d4ab09457d6eed20b41d4/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:39.781668 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c299f727-67f1-4d9e-959a-15227119d7ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=763cf73206604d8abbe1542afe44fa95, user_id=038739f45c3d4ab09457d6eed20b41d4, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:39.784710 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c299f727-67f1-4d9e-959a-15227119d7ef admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:39.847275 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1320/2609] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:13:39 2022] POST /identity/v3/users => generated 292 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:13:39.848152 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143510cd-a7e7-4fa7-8201-611923339fc4 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:39.849756 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-143510cd-a7e7-4fa7-8201-611923339fc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:39.861489 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143510cd-a7e7-4fa7-8201-611923339fc4 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:39.865127 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb69f506-c1f5-445d-84a5-f221b428b971 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:39.865739 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb69f506-c1f5-445d-84a5-f221b428b971 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:39.866023 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb69f506-c1f5-445d-84a5-f221b428b971 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:39.866306 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb69f506-c1f5-445d-84a5-f221b428b971 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:39.877608 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb69f506-c1f5-445d-84a5-f221b428b971 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:39.879116 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb69f506-c1f5-445d-84a5-f221b428b971 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:39.886273 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1290/2610] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:13:39 2022] PUT /identity/v3/projects/763cf73206604d8abbe1542afe44fa95/users/038739f45c3d4ab09457d6eed20b41d4/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:13:39.887224 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c299f727-67f1-4d9e-959a-15227119d7ef admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:39.891109 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1321/2611] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:13:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:13:39.894489 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9037e907-4993-4f69-91b6-ee306c4a172b None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:39.894851 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9037e907-4993-4f69-91b6-ee306c4a172b None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:39.895200 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9037e907-4993-4f69-91b6-ee306c4a172b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:39.941155 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-9037e907-4993-4f69-91b6-ee306c4a172b None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:39.942411 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-9037e907-4993-4f69-91b6-ee306c4a172b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:40.015200 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c299f727-67f1-4d9e-959a-15227119d7ef admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:40.021255 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7122ba92-289f-4872-a5ae-5b379f47910b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:40.021864 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7122ba92-289f-4872-a5ae-5b379f47910b admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:40.022151 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7122ba92-289f-4872-a5ae-5b379f47910b admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:40.022434 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7122ba92-289f-4872-a5ae-5b379f47910b admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:40.023162 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7122ba92-289f-4872-a5ae-5b379f47910b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:40.024887 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7122ba92-289f-4872-a5ae-5b379f47910b admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:40.032130 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1322/2612] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:13:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:13:40.036087 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1291/2613] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:13:39 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:13:40.040557 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9037e907-4993-4f69-91b6-ee306c4a172b None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:40.041943 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7122ba92-289f-4872-a5ae-5b379f47910b admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:40.043787 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-7122ba92-289f-4872-a5ae-5b379f47910b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:40.053347 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9037e907-4993-4f69-91b6-ee306c4a172b None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:40.060249 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d301e005-f5c3-44a4-84b4-740f118050c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:40.061095 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301e005-f5c3-44a4-84b4-740f118050c9 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:40.061302 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301e005-f5c3-44a4-84b4-740f118050c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:40.061590 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301e005-f5c3-44a4-84b4-740f118050c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:40.062327 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d301e005-f5c3-44a4-84b4-740f118050c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:40.064329 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d301e005-f5c3-44a4-84b4-740f118050c9 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:40.076860 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1323/2614] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:13:40.081516 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d301e005-f5c3-44a4-84b4-740f118050c9 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:40.093338 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d301e005-f5c3-44a4-84b4-740f118050c9 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:40.098554 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef11fb7-19fa-4814-91b9-dba4dd7bb7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:40.099548 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef11fb7-19fa-4814-91b9-dba4dd7bb7d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:40.099973 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef11fb7-19fa-4814-91b9-dba4dd7bb7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:40.100275 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef11fb7-19fa-4814-91b9-dba4dd7bb7d9 admin admin] PATH_INFO: `/v3/projects/37f9dbed24f74b7bae0335805743c94e/users/b23781a2caba4b6e9b1995a63c557c48/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:40.119082 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7122ba92-289f-4872-a5ae-5b379f47910b admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:40.119082 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbcb251-c987-404c-9f2a-ba5e51221d14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:40.119082 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbcb251-c987-404c-9f2a-ba5e51221d14 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:40.119082 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbcb251-c987-404c-9f2a-ba5e51221d14 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:40.119506 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef11fb7-19fa-4814-91b9-dba4dd7bb7d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37f9dbed24f74b7bae0335805743c94e, user_id=b23781a2caba4b6e9b1995a63c557c48, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:40.119612 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbcb251-c987-404c-9f2a-ba5e51221d14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:40.120240 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef11fb7-19fa-4814-91b9-dba4dd7bb7d9 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:40.127359 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbcb251-c987-404c-9f2a-ba5e51221d14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:40.130154 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbcb251-c987-404c-9f2a-ba5e51221d14 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:40.139822 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1292/2615] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:13:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:13:40.174439 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d81ff9-96f6-49bb-a964-3c77226bdfe2 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:40.174731 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d81ff9-96f6-49bb-a964-3c77226bdfe2 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:40.175016 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d81ff9-96f6-49bb-a964-3c77226bdfe2 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:40.176471 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1293/2616] 10.222.0.52 () {54 vars in 921 bytes} [Sat May 14 21:13:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 14 21:13:40.180889 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2578ea-ee17-4dab-8225-effd41d61cdb None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:40.181174 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2578ea-ee17-4dab-8225-effd41d61cdb None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:40.181475 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2578ea-ee17-4dab-8225-effd41d61cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:40.199674 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-8b2578ea-ee17-4dab-8225-effd41d61cdb None None] MFA Rules not processed for user `0812ae67e44d483baf2dbb1a5332a1d7`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:40.200376 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1324/2617] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:13:40 2022] PUT /identity/v3/projects/37f9dbed24f74b7bae0335805743c94e/users/b23781a2caba4b6e9b1995a63c557c48/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:13:40.201846 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8b2578ea-ee17-4dab-8225-effd41d61cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:40.213971 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95c2597-0d23-4ccf-ae44-4added5afbd1 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:40.214217 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95c2597-0d23-4ccf-ae44-4added5afbd1 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:40.214378 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95c2597-0d23-4ccf-ae44-4added5afbd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:40.245356 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-f95c2597-0d23-4ccf-ae44-4added5afbd1 None None] MFA Rules not processed for user `b23781a2caba4b6e9b1995a63c557c48`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:40.246571 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-f95c2597-0d23-4ccf-ae44-4added5afbd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:40.277012 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1294/2618] 10.222.0.52 () {58 vars in 1018 bytes} [Sat May 14 21:13:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:13:40.301880 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2578ea-ee17-4dab-8225-effd41d61cdb None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:40.303335 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8b2578ea-ee17-4dab-8225-effd41d61cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:40.316700 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2578ea-ee17-4dab-8225-effd41d61cdb None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:40.323084 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8430dfd8-1255-4a29-860b-9e8fd0a1df7e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:40.324194 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8430dfd8-1255-4a29-860b-9e8fd0a1df7e service placement] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:40.324194 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8430dfd8-1255-4a29-860b-9e8fd0a1df7e service placement] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:40.324420 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8430dfd8-1255-4a29-860b-9e8fd0a1df7e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:40.326733 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1325/2619] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:13:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:13:40.332514 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95c2597-0d23-4ccf-ae44-4added5afbd1 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:40.335845 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8430dfd8-1255-4a29-860b-9e8fd0a1df7e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:40.337553 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8430dfd8-1255-4a29-860b-9e8fd0a1df7e service placement] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:40.348324 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1295/2620] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:13:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:13:40.400807 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95c2597-0d23-4ccf-ae44-4added5afbd1 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:40.402567 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61720cb-8aa2-433c-8048-0c393bc3dc89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:40.403352 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61720cb-8aa2-433c-8048-0c393bc3dc89 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:40.403810 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61720cb-8aa2-433c-8048-0c393bc3dc89 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:40.404124 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61720cb-8aa2-433c-8048-0c393bc3dc89 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:40.405149 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61720cb-8aa2-433c-8048-0c393bc3dc89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:40.407105 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61720cb-8aa2-433c-8048-0c393bc3dc89 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:40.507546 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1326/2621] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:13:40 2022] POST /identity/v3/projects => generated 381 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:13:40.512307 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8430dfd8-1255-4a29-860b-9e8fd0a1df7e service placement] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:40.525041 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8430dfd8-1255-4a29-860b-9e8fd0a1df7e service placement] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:40.586780 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe332a4-b38e-4b19-859a-0fb73a4288d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:40.587449 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe332a4-b38e-4b19-859a-0fb73a4288d1 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:40.587885 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe332a4-b38e-4b19-859a-0fb73a4288d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:40.588158 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe332a4-b38e-4b19-859a-0fb73a4288d1 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:40.588847 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe332a4-b38e-4b19-859a-0fb73a4288d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:40.590886 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe332a4-b38e-4b19-859a-0fb73a4288d1 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:40.677668 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411d5467-6ca8-4fc9-b9e8-4f1dd26173ed None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:40.678530 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411d5467-6ca8-4fc9-b9e8-4f1dd26173ed None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:40.678954 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411d5467-6ca8-4fc9-b9e8-4f1dd26173ed None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:40.681444 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1327/2622] 10.222.0.52 () {54 vars in 921 bytes} [Sat May 14 21:13:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:13:40.704202 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1296/2623] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:13:40 2022] POST /identity/v3/users => generated 297 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:13:40.704812 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411d5467-6ca8-4fc9-b9e8-4f1dd26173ed None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:40.706931 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e15e71-ea86-46a7-8973-d65a3887f4d5 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:40.707227 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e15e71-ea86-46a7-8973-d65a3887f4d5 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:40.707526 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e15e71-ea86-46a7-8973-d65a3887f4d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:40.727198 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411d5467-6ca8-4fc9-b9e8-4f1dd26173ed None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:40.738930 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3ef705-c981-474b-b22f-e458260b95d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:40.738930 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3ef705-c981-474b-b22f-e458260b95d4 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:40.738930 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3ef705-c981-474b-b22f-e458260b95d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:40.738930 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3ef705-c981-474b-b22f-e458260b95d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:40.739373 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3ef705-c981-474b-b22f-e458260b95d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:40.740637 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3ef705-c981-474b-b22f-e458260b95d4 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:40.746329 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-80e15e71-ea86-46a7-8973-d65a3887f4d5 None None] MFA Rules not processed for user `0f1b0e2b025d4eceaa90e1616d0a9db8`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:40.750455 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-80e15e71-ea86-46a7-8973-d65a3887f4d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:40.770702 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1328/2624] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:13:40.771916 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3ef705-c981-474b-b22f-e458260b95d4 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:40.786396 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3ef705-c981-474b-b22f-e458260b95d4 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:40.795146 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f16be0d-db44-4af8-96fb-fe525eea2690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:40.796599 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f16be0d-db44-4af8-96fb-fe525eea2690 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:40.797080 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f16be0d-db44-4af8-96fb-fe525eea2690 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:40.797598 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f16be0d-db44-4af8-96fb-fe525eea2690 admin admin] PATH_INFO: `/v3/projects/bff1efe6d3cd429fbf441ca3d926b3bf/users/825a7cb92f82484a86ed0f9f72167e0e/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:40.855779 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f16be0d-db44-4af8-96fb-fe525eea2690 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bff1efe6d3cd429fbf441ca3d926b3bf, user_id=825a7cb92f82484a86ed0f9f72167e0e, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:40.860323 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f16be0d-db44-4af8-96fb-fe525eea2690 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:40.893933 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1297/2625] 10.222.0.52 () {58 vars in 1018 bytes} [Sat May 14 21:13:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:13:40.911166 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e15e71-ea86-46a7-8973-d65a3887f4d5 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:40.936012 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1329/2626] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:13:40 2022] PUT /identity/v3/projects/bff1efe6d3cd429fbf441ca3d926b3bf/users/825a7cb92f82484a86ed0f9f72167e0e/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:13:40.939863 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f16be0d-db44-4af8-96fb-fe525eea2690 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:40.986229 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e15e71-ea86-46a7-8973-d65a3887f4d5 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:41.023500 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f16be0d-db44-4af8-96fb-fe525eea2690 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:41.035583 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dfbb59-181d-4755-af13-be87ff3c52fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:41.036538 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dfbb59-181d-4755-af13-be87ff3c52fc admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:41.036836 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dfbb59-181d-4755-af13-be87ff3c52fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:41.037200 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dfbb59-181d-4755-af13-be87ff3c52fc admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:41.037996 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dfbb59-181d-4755-af13-be87ff3c52fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:41.039879 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dfbb59-181d-4755-af13-be87ff3c52fc admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:41.058672 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767eda61-e956-49d6-9d32-6c9b590de6a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:41.058896 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1330/2627] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:13:41.059002 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767eda61-e956-49d6-9d32-6c9b590de6a5 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:41.059002 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767eda61-e956-49d6-9d32-6c9b590de6a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:41.059002 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767eda61-e956-49d6-9d32-6c9b590de6a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:41.062295 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dfbb59-181d-4755-af13-be87ff3c52fc admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:41.091126 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dfbb59-181d-4755-af13-be87ff3c52fc admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:41.091126 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d961f9-7576-4f63-aaac-2513e058202a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:41.091126 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d961f9-7576-4f63-aaac-2513e058202a admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:41.091126 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d961f9-7576-4f63-aaac-2513e058202a admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:41.091606 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d961f9-7576-4f63-aaac-2513e058202a admin admin] PATH_INFO: `/v3/projects/bff1efe6d3cd429fbf441ca3d926b3bf/users/825a7cb92f82484a86ed0f9f72167e0e/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:41.093440 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d961f9-7576-4f63-aaac-2513e058202a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bff1efe6d3cd429fbf441ca3d926b3bf, user_id=825a7cb92f82484a86ed0f9f72167e0e, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:41.096334 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d961f9-7576-4f63-aaac-2513e058202a admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:41.111787 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1331/2628] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:13:41 2022] PUT /identity/v3/projects/bff1efe6d3cd429fbf441ca3d926b3bf/users/825a7cb92f82484a86ed0f9f72167e0e/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:13:41.123313 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2965d3-034d-4476-9968-8f84fae4c30a None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:41.123822 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2965d3-034d-4476-9968-8f84fae4c30a None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:41.124016 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2965d3-034d-4476-9968-8f84fae4c30a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:41.156114 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-7e2965d3-034d-4476-9968-8f84fae4c30a None None] MFA Rules not processed for user `825a7cb92f82484a86ed0f9f72167e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:41.157431 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-7e2965d3-034d-4476-9968-8f84fae4c30a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:41.185629 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767eda61-e956-49d6-9d32-6c9b590de6a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:41.189860 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767eda61-e956-49d6-9d32-6c9b590de6a5 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:41.199080 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1298/2629] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:13:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:13:41.245750 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1332/2630] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:13:41 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:13:41.257706 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767eda61-e956-49d6-9d32-6c9b590de6a5 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:41.259318 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-767eda61-e956-49d6-9d32-6c9b590de6a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:41.275312 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767eda61-e956-49d6-9d32-6c9b590de6a5 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:41.347107 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b031609f-ec0c-4303-82de-69421b05018a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:41.348417 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b031609f-ec0c-4303-82de-69421b05018a service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:41.348417 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b031609f-ec0c-4303-82de-69421b05018a service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:41.348417 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b031609f-ec0c-4303-82de-69421b05018a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:41.359521 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b031609f-ec0c-4303-82de-69421b05018a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:41.360675 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b031609f-ec0c-4303-82de-69421b05018a service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:41.372881 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1299/2631] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:13:41 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:13:41.392971 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fdaafa-7364-4455-89da-e3e4319d7bd6 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:41.393554 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fdaafa-7364-4455-89da-e3e4319d7bd6 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:41.394158 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fdaafa-7364-4455-89da-e3e4319d7bd6 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:41.397936 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1333/2632] 10.222.0.52 () {54 vars in 912 bytes} [Sat May 14 21:13:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:13:41.402644 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b031609f-ec0c-4303-82de-69421b05018a service nova] Authenticating service token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 14 21:13:41.415271 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b031609f-ec0c-4303-82de-69421b05018a service nova] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:41.425259 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b031609f-ec0c-4303-82de-69421b05018a service nova] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:41.441324 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98916f6-d776-45ae-9542-404e7cce1a4d tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '825a7cb92f82484a86ed0f9f72167e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bff1efe6d3cd429fbf441ca3d926b3bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:41.445740 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98916f6-d776-45ae-9542-404e7cce1a4d tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:41.445740 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98916f6-d776-45ae-9542-404e7cce1a4d tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:41.445740 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98916f6-d776-45ae-9542-404e7cce1a4d tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] PATH_INFO: `/v3/projects/37f9dbed24f74b7bae0335805743c94e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:41.445740 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98916f6-d776-45ae-9542-404e7cce1a4d tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] RBAC: Authorizing `identity:get_project(project_id=37f9dbed24f74b7bae0335805743c94e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:41.447150 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98916f6-d776-45ae-9542-404e7cce1a4d tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:41.449329 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1300/2633] 10.222.0.52 () {58 vars in 1443 bytes} [Sat May 14 21:13:41 2022] GET /identity/v3/projects/37f9dbed24f74b7bae0335805743c94e => generated 383 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:13:41.492881 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19346cf-125e-4c0c-b8d7-a935af7f03ef None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:41.493201 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19346cf-125e-4c0c-b8d7-a935af7f03ef None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:41.493450 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19346cf-125e-4c0c-b8d7-a935af7f03ef None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:41.494813 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1334/2634] 10.222.0.52 () {54 vars in 912 bytes} [Sat May 14 21:13:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:13:41.502235 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98916f6-d776-45ae-9542-404e7cce1a4d tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] Authenticating service token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 14 21:13:41.504160 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c98916f6-d776-45ae-9542-404e7cce1a4d tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:41.520370 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98916f6-d776-45ae-9542-404e7cce1a4d tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:41.536702 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98916f6-d776-45ae-9542-404e7cce1a4d tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:41.536702 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1187ef34-33a2-492f-9fba-4bf6ee98b9a5 tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '825a7cb92f82484a86ed0f9f72167e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bff1efe6d3cd429fbf441ca3d926b3bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:41.537161 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187ef34-33a2-492f-9fba-4bf6ee98b9a5 tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:41.538595 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187ef34-33a2-492f-9fba-4bf6ee98b9a5 tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:41.538595 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187ef34-33a2-492f-9fba-4bf6ee98b9a5 tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] PATH_INFO: `/v3/projects/37f9dbed24f74b7bae0335805743c94e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:41.539742 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1187ef34-33a2-492f-9fba-4bf6ee98b9a5 tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] RBAC: Authorizing `identity:get_project(project_id=37f9dbed24f74b7bae0335805743c94e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:41.542353 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1187ef34-33a2-492f-9fba-4bf6ee98b9a5 tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:41.545101 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1301/2635] 10.222.0.52 () {58 vars in 1443 bytes} [Sat May 14 21:13:41 2022] GET /identity/v3/projects/37f9dbed24f74b7bae0335805743c94e => generated 383 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:13:41.628869 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b276b-1830-4454-8127-41ba3cba24d7 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:41.629200 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b276b-1830-4454-8127-41ba3cba24d7 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:41.629826 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b276b-1830-4454-8127-41ba3cba24d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:41.658659 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-6e2b276b-1830-4454-8127-41ba3cba24d7 None None] MFA Rules not processed for user `038739f45c3d4ab09457d6eed20b41d4`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:41.659941 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-6e2b276b-1830-4454-8127-41ba3cba24d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:41.744766 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1335/2636] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:13:41 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:13:41.756813 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1187ef34-33a2-492f-9fba-4bf6ee98b9a5 tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:41.761512 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576c3af-f704-496b-9b8a-b40138c4754c None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:41.761512 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576c3af-f704-496b-9b8a-b40138c4754c None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:41.769003 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576c3af-f704-496b-9b8a-b40138c4754c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:41.796065 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-8576c3af-f704-496b-9b8a-b40138c4754c None None] MFA Rules not processed for user `b23781a2caba4b6e9b1995a63c557c48`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:41.797384 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-8576c3af-f704-496b-9b8a-b40138c4754c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:41.850566 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1187ef34-33a2-492f-9fba-4bf6ee98b9a5 tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:41.856474 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dadff4b-493a-49e4-a558-224c77003c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:41.857836 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dadff4b-493a-49e4-a558-224c77003c82 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:41.858221 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dadff4b-493a-49e4-a558-224c77003c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:41.858732 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dadff4b-493a-49e4-a558-224c77003c82 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:41.860614 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dadff4b-493a-49e4-a558-224c77003c82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:41.863201 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dadff4b-493a-49e4-a558-224c77003c82 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:41.885180 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1336/2637] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:13:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:13:42.011133 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1302/2638] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:13:41 2022] POST /identity/v3/projects => generated 369 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:13:42.016080 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8576c3af-f704-496b-9b8a-b40138c4754c None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:42.030877 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8576c3af-f704-496b-9b8a-b40138c4754c None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:42.117761 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dadff4b-493a-49e4-a558-224c77003c82 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:42.154393 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d7e00b-ecaf-43c2-945b-a4ef17e90423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:42.155457 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d7e00b-ecaf-43c2-945b-a4ef17e90423 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:42.155917 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d7e00b-ecaf-43c2-945b-a4ef17e90423 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:42.156208 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d7e00b-ecaf-43c2-945b-a4ef17e90423 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:42.157358 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d7e00b-ecaf-43c2-945b-a4ef17e90423 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:42.160168 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d7e00b-ecaf-43c2-945b-a4ef17e90423 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:42.233519 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dadff4b-493a-49e4-a558-224c77003c82 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:42.239559 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeafca1-fb0d-4756-b41b-d296f828e00f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:42.240317 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeafca1-fb0d-4756-b41b-d296f828e00f service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:42.240722 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeafca1-fb0d-4756-b41b-d296f828e00f service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:42.241077 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeafca1-fb0d-4756-b41b-d296f828e00f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:42.263916 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1337/2639] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:13:42 2022] POST /identity/v3/users => generated 291 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:13:42.268154 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d7e00b-ecaf-43c2-945b-a4ef17e90423 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:42.279918 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d7e00b-ecaf-43c2-945b-a4ef17e90423 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:42.290447 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650ab87a-8ed4-4377-a028-2d790c54ca22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:42.293064 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ab87a-8ed4-4377-a028-2d790c54ca22 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:42.293064 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ab87a-8ed4-4377-a028-2d790c54ca22 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:42.293064 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ab87a-8ed4-4377-a028-2d790c54ca22 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:42.296541 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650ab87a-8ed4-4377-a028-2d790c54ca22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:42.298784 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650ab87a-8ed4-4377-a028-2d790c54ca22 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:42.312648 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeafca1-fb0d-4756-b41b-d296f828e00f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:42.314402 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeafca1-fb0d-4756-b41b-d296f828e00f service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:42.322799 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1338/2640] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:13:42 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:13:42.328523 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650ab87a-8ed4-4377-a028-2d790c54ca22 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:42.336758 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1303/2641] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:13:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:13:42.352460 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650ab87a-8ed4-4377-a028-2d790c54ca22 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:42.358912 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab31ca97-40b8-48fa-aca1-ce3cb27cb4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:42.360726 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31ca97-40b8-48fa-aca1-ce3cb27cb4b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:42.360726 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31ca97-40b8-48fa-aca1-ce3cb27cb4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:42.360726 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31ca97-40b8-48fa-aca1-ce3cb27cb4b5 admin admin] PATH_INFO: `/v3/projects/f6c4c973d1e544538b031b0d123cd1b2/users/f704e225fb7d435da26a4f1339a0faf1/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:42.376850 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab31ca97-40b8-48fa-aca1-ce3cb27cb4b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6c4c973d1e544538b031b0d123cd1b2, user_id=f704e225fb7d435da26a4f1339a0faf1, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:42.389097 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab31ca97-40b8-48fa-aca1-ce3cb27cb4b5 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:42.389949 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeafca1-fb0d-4756-b41b-d296f828e00f service nova] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:42.397689 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeafca1-fb0d-4756-b41b-d296f828e00f service nova] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:42.404179 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d1d24b-2d85-405d-93fb-b10f5753f156 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:42.404986 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d1d24b-2d85-405d-93fb-b10f5753f156 service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:42.405340 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d1d24b-2d85-405d-93fb-b10f5753f156 service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:42.405694 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d1d24b-2d85-405d-93fb-b10f5753f156 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:42.408670 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c9d1d24b-2d85-405d-93fb-b10f5753f156 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:42.469650 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1339/2642] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:13:42 2022] PUT /identity/v3/projects/f6c4c973d1e544538b031b0d123cd1b2/users/f704e225fb7d435da26a4f1339a0faf1/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:13:42.476539 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab31ca97-40b8-48fa-aca1-ce3cb27cb4b5 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:42.500292 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d1d24b-2d85-405d-93fb-b10f5753f156 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:42.502454 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d1d24b-2d85-405d-93fb-b10f5753f156 service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:42.517795 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1304/2643] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:13:42 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:13:42.566788 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab31ca97-40b8-48fa-aca1-ce3cb27cb4b5 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:42.571944 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8505a773-f4a4-4137-9c1b-4cc918bef4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:42.572801 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505a773-f4a4-4137-9c1b-4cc918bef4fb admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:42.572921 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505a773-f4a4-4137-9c1b-4cc918bef4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:42.573170 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505a773-f4a4-4137-9c1b-4cc918bef4fb admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:42.573880 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8505a773-f4a4-4137-9c1b-4cc918bef4fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:42.579288 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8505a773-f4a4-4137-9c1b-4cc918bef4fb admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:42.590609 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1340/2644] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:13:42 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:13:42.595573 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d1d24b-2d85-405d-93fb-b10f5753f156 service nova] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:42.612267 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d1d24b-2d85-405d-93fb-b10f5753f156 service nova] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:42.618988 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada9c51d-02f5-4fe8-8ad2-b23b294386dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:42.619936 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9c51d-02f5-4fe8-8ad2-b23b294386dc admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:42.625458 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9c51d-02f5-4fe8-8ad2-b23b294386dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:42.625749 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9c51d-02f5-4fe8-8ad2-b23b294386dc admin admin] PATH_INFO: `/v3/projects/f6c4c973d1e544538b031b0d123cd1b2/users/f704e225fb7d435da26a4f1339a0faf1/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:42.627970 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada9c51d-02f5-4fe8-8ad2-b23b294386dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6c4c973d1e544538b031b0d123cd1b2, user_id=f704e225fb7d435da26a4f1339a0faf1, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:42.630656 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada9c51d-02f5-4fe8-8ad2-b23b294386dc admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:42.644494 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1305/2645] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:13:42 2022] PUT /identity/v3/projects/f6c4c973d1e544538b031b0d123cd1b2/users/f704e225fb7d435da26a4f1339a0faf1/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:13:42.814120 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b4d455-95d6-42e8-9caa-c9d1e19eae04 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:42.814665 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b4d455-95d6-42e8-9caa-c9d1e19eae04 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:42.814665 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b4d455-95d6-42e8-9caa-c9d1e19eae04 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:42.816518 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1341/2646] 10.222.0.52 () {54 vars in 912 bytes} [Sat May 14 21:13:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:13:42.826449 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada9c51d-02f5-4fe8-8ad2-b23b294386dc admin admin] Authenticating service token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 14 21:13:42.930364 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada9c51d-02f5-4fe8-8ad2-b23b294386dc admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:42.993216 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada9c51d-02f5-4fe8-8ad2-b23b294386dc admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:43.000837 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c252e5-79e4-4957-b0ca-f70058e3236b tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '825a7cb92f82484a86ed0f9f72167e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bff1efe6d3cd429fbf441ca3d926b3bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:43.000837 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c252e5-79e4-4957-b0ca-f70058e3236b tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:43.000837 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c252e5-79e4-4957-b0ca-f70058e3236b tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:43.001157 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c252e5-79e4-4957-b0ca-f70058e3236b tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] PATH_INFO: `/v3/projects/37f9dbed24f74b7bae0335805743c94e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:43.002171 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c252e5-79e4-4957-b0ca-f70058e3236b tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] RBAC: Authorizing `identity:get_project(project_id=37f9dbed24f74b7bae0335805743c94e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:43.004279 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c252e5-79e4-4957-b0ca-f70058e3236b tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:43.005995 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1306/2647] 10.222.0.52 () {58 vars in 1443 bytes} [Sat May 14 21:13:42 2022] GET /identity/v3/projects/37f9dbed24f74b7bae0335805743c94e => generated 383 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:13:43.279719 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e787290c-8c51-4d84-b823-39040cf2b668 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:43.280351 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e787290c-8c51-4d84-b823-39040cf2b668 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:43.281447 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e787290c-8c51-4d84-b823-39040cf2b668 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:43.283970 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1342/2648] 10.222.0.52 () {54 vars in 912 bytes} [Sat May 14 21:13:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:13:43.290342 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c252e5-79e4-4957-b0ca-f70058e3236b tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] Authenticating service token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 14 21:13:43.304358 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c252e5-79e4-4957-b0ca-f70058e3236b tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:43.313767 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c252e5-79e4-4957-b0ca-f70058e3236b tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:43.318582 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43bf7c3-0027-42b7-a916-edb295374928 tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '825a7cb92f82484a86ed0f9f72167e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bff1efe6d3cd429fbf441ca3d926b3bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:43.319600 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43bf7c3-0027-42b7-a916-edb295374928 tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:43.319989 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43bf7c3-0027-42b7-a916-edb295374928 tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:43.320468 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43bf7c3-0027-42b7-a916-edb295374928 tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] PATH_INFO: `/v3/projects/37f9dbed24f74b7bae0335805743c94e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:43.321713 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43bf7c3-0027-42b7-a916-edb295374928 tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] RBAC: Authorizing `identity:get_project(project_id=37f9dbed24f74b7bae0335805743c94e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:43.323879 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43bf7c3-0027-42b7-a916-edb295374928 tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:43.329789 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1307/2649] 10.222.0.52 () {58 vars in 1443 bytes} [Sat May 14 21:13:43 2022] GET /identity/v3/projects/37f9dbed24f74b7bae0335805743c94e => generated 383 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:13:43.460294 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51526c88-5c5a-4a45-b8e4-3cd2c3d1c722 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:43.460498 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51526c88-5c5a-4a45-b8e4-3cd2c3d1c722 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:43.460771 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51526c88-5c5a-4a45-b8e4-3cd2c3d1c722 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:43.462255 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1343/2650] 10.222.0.52 () {54 vars in 912 bytes} [Sat May 14 21:13:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:13:43.468979 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43bf7c3-0027-42b7-a916-edb295374928 tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] Authenticating service token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 14 21:13:43.483391 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43bf7c3-0027-42b7-a916-edb295374928 tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:43.492605 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43bf7c3-0027-42b7-a916-edb295374928 tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:43.498373 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e10e0-b23d-4944-b964-a49186e41f3d tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '825a7cb92f82484a86ed0f9f72167e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bff1efe6d3cd429fbf441ca3d926b3bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:43.499455 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e10e0-b23d-4944-b964-a49186e41f3d tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:43.499846 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e10e0-b23d-4944-b964-a49186e41f3d tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:43.500126 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e10e0-b23d-4944-b964-a49186e41f3d tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] PATH_INFO: `/v3/projects/37f9dbed24f74b7bae0335805743c94e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:43.501319 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976e10e0-b23d-4944-b964-a49186e41f3d tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] RBAC: Authorizing `identity:get_project(project_id=37f9dbed24f74b7bae0335805743c94e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:43.503582 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976e10e0-b23d-4944-b964-a49186e41f3d tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:43.505873 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1308/2651] 10.222.0.52 () {58 vars in 1443 bytes} [Sat May 14 21:13:43 2022] GET /identity/v3/projects/37f9dbed24f74b7bae0335805743c94e => generated 383 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:13:43.645931 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dbf6f0-211e-4ca8-b88f-9abc31580787 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:43.647082 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dbf6f0-211e-4ca8-b88f-9abc31580787 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:43.648286 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dbf6f0-211e-4ca8-b88f-9abc31580787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:43.680571 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-98dbf6f0-211e-4ca8-b88f-9abc31580787 None None] MFA Rules not processed for user `b23781a2caba4b6e9b1995a63c557c48`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:43.681940 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-98dbf6f0-211e-4ca8-b88f-9abc31580787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:43.757603 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1344/2652] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:13:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:13:44.161669 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df4281-3d8d-4690-9c48-b952b53492e1 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:44.161956 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df4281-3d8d-4690-9c48-b952b53492e1 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:44.162669 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df4281-3d8d-4690-9c48-b952b53492e1 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:44.163625 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1309/2653] 10.222.0.52 () {54 vars in 912 bytes} [Sat May 14 21:13:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:13:44.168503 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dbf6f0-211e-4ca8-b88f-9abc31580787 None None] Authenticating service token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 14 21:13:44.182745 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dbf6f0-211e-4ca8-b88f-9abc31580787 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:44.192515 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dbf6f0-211e-4ca8-b88f-9abc31580787 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:44.197039 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffb2eab-7a2c-4dad-bf7e-2f36e397f04c tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '825a7cb92f82484a86ed0f9f72167e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bff1efe6d3cd429fbf441ca3d926b3bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:44.197901 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb2eab-7a2c-4dad-bf7e-2f36e397f04c tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:44.198187 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb2eab-7a2c-4dad-bf7e-2f36e397f04c tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:44.198518 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb2eab-7a2c-4dad-bf7e-2f36e397f04c tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] PATH_INFO: `/v3/projects/37f9dbed24f74b7bae0335805743c94e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:44.199683 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffb2eab-7a2c-4dad-bf7e-2f36e397f04c tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] RBAC: Authorizing `identity:get_project(project_id=37f9dbed24f74b7bae0335805743c94e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:44.202259 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffb2eab-7a2c-4dad-bf7e-2f36e397f04c tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:44.204281 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1345/2654] 10.222.0.52 () {58 vars in 1443 bytes} [Sat May 14 21:13:44 2022] GET /identity/v3/projects/37f9dbed24f74b7bae0335805743c94e => generated 383 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:13:44.483499 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591fdf4-f4df-4b79-a72d-958dfd72ca89 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:44.483970 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591fdf4-f4df-4b79-a72d-958dfd72ca89 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:44.484217 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591fdf4-f4df-4b79-a72d-958dfd72ca89 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:44.485582 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1310/2655] 10.222.0.52 () {54 vars in 912 bytes} [Sat May 14 21:13:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:13:44.492131 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffb2eab-7a2c-4dad-bf7e-2f36e397f04c tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] Authenticating service token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 14 21:13:44.513686 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffb2eab-7a2c-4dad-bf7e-2f36e397f04c tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:44.530455 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffb2eab-7a2c-4dad-bf7e-2f36e397f04c tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:44.546527 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b523908-7670-42e2-ab04-51d6c0429bd1 tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '825a7cb92f82484a86ed0f9f72167e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bff1efe6d3cd429fbf441ca3d926b3bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:44.548627 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b523908-7670-42e2-ab04-51d6c0429bd1 tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:44.549102 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b523908-7670-42e2-ab04-51d6c0429bd1 tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:44.549558 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b523908-7670-42e2-ab04-51d6c0429bd1 tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] PATH_INFO: `/v3/projects/37f9dbed24f74b7bae0335805743c94e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:44.551450 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b523908-7670-42e2-ab04-51d6c0429bd1 tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] RBAC: Authorizing `identity:get_project(project_id=37f9dbed24f74b7bae0335805743c94e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:44.554013 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b523908-7670-42e2-ab04-51d6c0429bd1 tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:44.559847 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1346/2656] 10.222.0.52 () {58 vars in 1443 bytes} [Sat May 14 21:13:44 2022] GET /identity/v3/projects/37f9dbed24f74b7bae0335805743c94e => generated 383 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:13:44.604654 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea829a83-ffb2-48b0-ada1-089a56baf224 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:44.606052 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea829a83-ffb2-48b0-ada1-089a56baf224 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:44.607548 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea829a83-ffb2-48b0-ada1-089a56baf224 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:44.610496 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1311/2657] 10.222.0.52 () {54 vars in 912 bytes} [Sat May 14 21:13:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 14 21:13:44.618846 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b523908-7670-42e2-ab04-51d6c0429bd1 tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] Authenticating service token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 14 21:13:44.643864 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b523908-7670-42e2-ab04-51d6c0429bd1 tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:44.670336 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b523908-7670-42e2-ab04-51d6c0429bd1 tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:44.689329 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0a7004-dd67-46cb-884c-cd76e8733c6d tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '825a7cb92f82484a86ed0f9f72167e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bff1efe6d3cd429fbf441ca3d926b3bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:44.690783 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a7004-dd67-46cb-884c-cd76e8733c6d tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:44.691233 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a7004-dd67-46cb-884c-cd76e8733c6d tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:44.691547 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a7004-dd67-46cb-884c-cd76e8733c6d tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] PATH_INFO: `/v3/projects/37f9dbed24f74b7bae0335805743c94e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:44.693395 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0a7004-dd67-46cb-884c-cd76e8733c6d tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] RBAC: Authorizing `identity:get_project(project_id=37f9dbed24f74b7bae0335805743c94e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:44.695548 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0a7004-dd67-46cb-884c-cd76e8733c6d tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:44.712792 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1347/2658] 10.222.0.52 () {58 vars in 1443 bytes} [Sat May 14 21:13:44 2022] GET /identity/v3/projects/37f9dbed24f74b7bae0335805743c94e => generated 383 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:13:44.832100 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd8d64-daea-4788-a71b-5180ae586988 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:44.832674 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd8d64-daea-4788-a71b-5180ae586988 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:44.833120 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd8d64-daea-4788-a71b-5180ae586988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:44.863135 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-9efd8d64-daea-4788-a71b-5180ae586988 None None] MFA Rules not processed for user `f704e225fb7d435da26a4f1339a0faf1`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:44.864844 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-9efd8d64-daea-4788-a71b-5180ae586988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:44.897624 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832dc284-faef-4692-8093-3315cf5e098c None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:44.898324 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832dc284-faef-4692-8093-3315cf5e098c None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:44.899023 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832dc284-faef-4692-8093-3315cf5e098c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:44.940992 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-832dc284-faef-4692-8093-3315cf5e098c None None] MFA Rules not processed for user `b23781a2caba4b6e9b1995a63c557c48`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:44.944388 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-832dc284-faef-4692-8093-3315cf5e098c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:44.982060 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1348/2659] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:13:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:13:45.001026 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1312/2660] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:13:44 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:13:45.001898 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f2900-3bff-4eae-bfdc-0adf647603cf None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:45.002623 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f2900-3bff-4eae-bfdc-0adf647603cf None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:45.004173 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f2900-3bff-4eae-bfdc-0adf647603cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:45.024396 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-312f2900-3bff-4eae-bfdc-0adf647603cf None None] MFA Rules not processed for user `038739f45c3d4ab09457d6eed20b41d4`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:45.026027 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-312f2900-3bff-4eae-bfdc-0adf647603cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:45.087761 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1349/2661] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:13:44 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:13:45.373536 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd8d64-daea-4788-a71b-5180ae586988 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:45.387459 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd8d64-daea-4788-a71b-5180ae586988 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:45.393527 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cd57a3-5d99-445c-bbbd-b4a014631776 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:45.394388 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd57a3-5d99-445c-bbbd-b4a014631776 service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:45.394813 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd57a3-5d99-445c-bbbd-b4a014631776 service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:45.395244 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd57a3-5d99-445c-bbbd-b4a014631776 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:45.404361 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cd57a3-5d99-445c-bbbd-b4a014631776 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:45.405975 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cd57a3-5d99-445c-bbbd-b4a014631776 service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:45.421985 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1313/2662] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:13:45 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:13:45.430343 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5f608-5e19-47f0-81bf-f06f3ba9b609 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:45.430829 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5f608-5e19-47f0-81bf-f06f3ba9b609 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:45.430945 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5f608-5e19-47f0-81bf-f06f3ba9b609 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:45.432292 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1350/2663] 10.222.0.52 () {54 vars in 912 bytes} [Sat May 14 21:13:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:13:45.442502 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cd57a3-5d99-445c-bbbd-b4a014631776 service nova] Authenticating service token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 14 21:13:45.455787 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cd57a3-5d99-445c-bbbd-b4a014631776 service nova] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:45.467446 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cd57a3-5d99-445c-bbbd-b4a014631776 service nova] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:45.472255 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68ccc5d-eeb4-491d-90b8-e1d794f2118e tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '825a7cb92f82484a86ed0f9f72167e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bff1efe6d3cd429fbf441ca3d926b3bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:45.473118 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ccc5d-eeb4-491d-90b8-e1d794f2118e tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:45.473410 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ccc5d-eeb4-491d-90b8-e1d794f2118e tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:45.473725 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ccc5d-eeb4-491d-90b8-e1d794f2118e tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] PATH_INFO: `/v3/projects/37f9dbed24f74b7bae0335805743c94e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:45.475002 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68ccc5d-eeb4-491d-90b8-e1d794f2118e tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] RBAC: Authorizing `identity:get_project(project_id=37f9dbed24f74b7bae0335805743c94e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:45.477827 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68ccc5d-eeb4-491d-90b8-e1d794f2118e tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:45.479896 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1314/2664] 10.222.0.52 () {58 vars in 1443 bytes} [Sat May 14 21:13:45 2022] GET /identity/v3/projects/37f9dbed24f74b7bae0335805743c94e => generated 383 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:13:45.648163 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b5f608-5e19-47f0-81bf-f06f3ba9b609 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:45.717363 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b5f608-5e19-47f0-81bf-f06f3ba9b609 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:45.721923 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115c4d06-5303-4a52-8143-ecb25f4b8f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:45.722801 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c4d06-5303-4a52-8143-ecb25f4b8f78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:45.723083 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c4d06-5303-4a52-8143-ecb25f4b8f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:45.724760 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c4d06-5303-4a52-8143-ecb25f4b8f78 admin admin] PATH_INFO: `/v3/users/b23781a2caba4b6e9b1995a63c557c48` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:45.725993 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115c4d06-5303-4a52-8143-ecb25f4b8f78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b23781a2caba4b6e9b1995a63c557c48)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:45.727952 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115c4d06-5303-4a52-8143-ecb25f4b8f78 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:46.020620 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-115c4d06-5303-4a52-8143-ecb25f4b8f78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b23781a2caba4b6e9b1995a63c557c48'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:46.050199 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-115c4d06-5303-4a52-8143-ecb25f4b8f78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b23781a2caba4b6e9b1995a63c557c48'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:46.060104 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-115c4d06-5303-4a52-8143-ecb25f4b8f78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b23781a2caba4b6e9b1995a63c557c48'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:46.141576 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-115c4d06-5303-4a52-8143-ecb25f4b8f78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b23781a2caba4b6e9b1995a63c557c48'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:46.142524 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-115c4d06-5303-4a52-8143-ecb25f4b8f78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b23781a2caba4b6e9b1995a63c557c48'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:46.152850 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1351/2665] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:13:45 2022] DELETE /identity/v3/users/b23781a2caba4b6e9b1995a63c557c48 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:13:46.157217 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7dbe1-9f7d-4e31-89f5-b12a6dd2fd81 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:46.157736 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7dbe1-9f7d-4e31-89f5-b12a6dd2fd81 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:46.157832 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7dbe1-9f7d-4e31-89f5-b12a6dd2fd81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:46.187857 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-a6f7dbe1-9f7d-4e31-89f5-b12a6dd2fd81 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:46.189109 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-a6f7dbe1-9f7d-4e31-89f5-b12a6dd2fd81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:46.267725 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1315/2666] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:13:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:13:46.305221 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115c4d06-5303-4a52-8143-ecb25f4b8f78 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:46.305221 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-115c4d06-5303-4a52-8143-ecb25f4b8f78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:46.404465 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115c4d06-5303-4a52-8143-ecb25f4b8f78 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:46.406276 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94d3362-00fd-49e3-9970-fc00eed3a820 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:46.407073 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d3362-00fd-49e3-9970-fc00eed3a820 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:46.407439 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d3362-00fd-49e3-9970-fc00eed3a820 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:46.407810 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d3362-00fd-49e3-9970-fc00eed3a820 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:46.422473 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94d3362-00fd-49e3-9970-fc00eed3a820 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:46.423715 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94d3362-00fd-49e3-9970-fc00eed3a820 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:46.434655 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1352/2667] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:13:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:13:47.220123 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f7dbe1-9f7d-4e31-89f5-b12a6dd2fd81 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:47.220123 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-a6f7dbe1-9f7d-4e31-89f5-b12a6dd2fd81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:47.244487 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f7dbe1-9f7d-4e31-89f5-b12a6dd2fd81 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:47.256008 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d80604-2f0f-4e41-943a-a04ce5e6102f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:47.257436 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d80604-2f0f-4e41-943a-a04ce5e6102f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:47.257920 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d80604-2f0f-4e41-943a-a04ce5e6102f admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:47.258203 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d80604-2f0f-4e41-943a-a04ce5e6102f admin admin] PATH_INFO: `/v3/projects/37f9dbed24f74b7bae0335805743c94e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:47.259593 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d80604-2f0f-4e41-943a-a04ce5e6102f admin admin] RBAC: Authorizing `identity:delete_project(project_id=37f9dbed24f74b7bae0335805743c94e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:47.261689 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d80604-2f0f-4e41-943a-a04ce5e6102f admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:47.414793 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-75d80604-2f0f-4e41-943a-a04ce5e6102f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37f9dbed24f74b7bae0335805743c94e', 'request_id': 'req-75d80604-2f0f-4e41-943a-a04ce5e6102f'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:47.434057 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-75d80604-2f0f-4e41-943a-a04ce5e6102f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37f9dbed24f74b7bae0335805743c94e', 'request_id': 'req-75d80604-2f0f-4e41-943a-a04ce5e6102f'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:47.450193 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-75d80604-2f0f-4e41-943a-a04ce5e6102f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37f9dbed24f74b7bae0335805743c94e', 'request_id': 'req-75d80604-2f0f-4e41-943a-a04ce5e6102f'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:47.525579 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-75d80604-2f0f-4e41-943a-a04ce5e6102f admin admin] The token cache is being invalidate because project 37f9dbed24f74b7bae0335805743c94e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:13:47.526488 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-75d80604-2f0f-4e41-943a-a04ce5e6102f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:47.527404 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-75d80604-2f0f-4e41-943a-a04ce5e6102f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:47.531311 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1316/2668] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:13:47 2022] DELETE /identity/v3/projects/37f9dbed24f74b7bae0335805743c94e => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:13:47.535248 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94d3362-00fd-49e3-9970-fc00eed3a820 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:47.550872 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94d3362-00fd-49e3-9970-fc00eed3a820 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:47.623161 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21942b6-7a38-4dbf-8776-f42f53fbf892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:47.624157 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21942b6-7a38-4dbf-8776-f42f53fbf892 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:47.624447 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21942b6-7a38-4dbf-8776-f42f53fbf892 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:47.624759 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21942b6-7a38-4dbf-8776-f42f53fbf892 admin admin] PATH_INFO: `/v3/users/825a7cb92f82484a86ed0f9f72167e0e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:47.626109 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21942b6-7a38-4dbf-8776-f42f53fbf892 admin admin] RBAC: Authorizing `identity:delete_user(user_id=825a7cb92f82484a86ed0f9f72167e0e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:47.628178 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21942b6-7a38-4dbf-8776-f42f53fbf892 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:47.891137 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f21942b6-7a38-4dbf-8776-f42f53fbf892 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '825a7cb92f82484a86ed0f9f72167e0e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:47.904922 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f21942b6-7a38-4dbf-8776-f42f53fbf892 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '825a7cb92f82484a86ed0f9f72167e0e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:47.913505 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f21942b6-7a38-4dbf-8776-f42f53fbf892 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '825a7cb92f82484a86ed0f9f72167e0e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:48.031252 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f21942b6-7a38-4dbf-8776-f42f53fbf892 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '825a7cb92f82484a86ed0f9f72167e0e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:48.032248 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f21942b6-7a38-4dbf-8776-f42f53fbf892 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '825a7cb92f82484a86ed0f9f72167e0e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:48.046361 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1353/2669] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:13:47 2022] DELETE /identity/v3/users/825a7cb92f82484a86ed0f9f72167e0e => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:13:48.322688 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d80604-2f0f-4e41-943a-a04ce5e6102f admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:48.322688 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-75d80604-2f0f-4e41-943a-a04ce5e6102f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:48.333525 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d80604-2f0f-4e41-943a-a04ce5e6102f admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:48.404151 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7f77c9-84bc-4a49-972e-6195e474fb52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:48.405234 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f77c9-84bc-4a49-972e-6195e474fb52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:48.405644 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f77c9-84bc-4a49-972e-6195e474fb52 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:48.406023 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f77c9-84bc-4a49-972e-6195e474fb52 admin admin] PATH_INFO: `/v3/users/d70bd5f4870740d8950b6033bdf74277` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:48.407552 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7f77c9-84bc-4a49-972e-6195e474fb52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d70bd5f4870740d8950b6033bdf74277)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:48.409939 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7f77c9-84bc-4a49-972e-6195e474fb52 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:48.574484 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-5e7f77c9-84bc-4a49-972e-6195e474fb52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd70bd5f4870740d8950b6033bdf74277'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:48.584052 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-5e7f77c9-84bc-4a49-972e-6195e474fb52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd70bd5f4870740d8950b6033bdf74277'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:48.585356 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-5e7f77c9-84bc-4a49-972e-6195e474fb52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd70bd5f4870740d8950b6033bdf74277'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:48.659731 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-5e7f77c9-84bc-4a49-972e-6195e474fb52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd70bd5f4870740d8950b6033bdf74277'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:48.672620 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-5e7f77c9-84bc-4a49-972e-6195e474fb52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd70bd5f4870740d8950b6033bdf74277'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:48.678514 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1317/2670] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:13:48 2022] DELETE /identity/v3/users/d70bd5f4870740d8950b6033bdf74277 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:13:48.683456 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5aa0c3-2da7-4311-a3da-5411a01e541a None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:48.684010 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5aa0c3-2da7-4311-a3da-5411a01e541a None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:48.684010 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5aa0c3-2da7-4311-a3da-5411a01e541a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:48.695329 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7f77c9-84bc-4a49-972e-6195e474fb52 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:48.703828 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-5e7f77c9-84bc-4a49-972e-6195e474fb52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:48.722974 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-7d5aa0c3-2da7-4311-a3da-5411a01e541a None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:48.728945 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-7d5aa0c3-2da7-4311-a3da-5411a01e541a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:48.791368 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7f77c9-84bc-4a49-972e-6195e474fb52 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:48.796691 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d73a4c-71fc-40a8-a102-a0c50fecd72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:48.797603 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d73a4c-71fc-40a8-a102-a0c50fecd72e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:48.798055 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d73a4c-71fc-40a8-a102-a0c50fecd72e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:48.798509 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d73a4c-71fc-40a8-a102-a0c50fecd72e admin admin] PATH_INFO: `/v3/projects/bff1efe6d3cd429fbf441ca3d926b3bf` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:48.799953 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d73a4c-71fc-40a8-a102-a0c50fecd72e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bff1efe6d3cd429fbf441ca3d926b3bf)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:48.802310 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d73a4c-71fc-40a8-a102-a0c50fecd72e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:48.810884 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1354/2671] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:13:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:13:48.822687 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5aa0c3-2da7-4311-a3da-5411a01e541a None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:48.824345 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-7d5aa0c3-2da7-4311-a3da-5411a01e541a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:48.973114 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f7d73a4c-71fc-40a8-a102-a0c50fecd72e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bff1efe6d3cd429fbf441ca3d926b3bf', 'request_id': 'req-f7d73a4c-71fc-40a8-a102-a0c50fecd72e'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:48.982570 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5aa0c3-2da7-4311-a3da-5411a01e541a None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:48.987230 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f7d73a4c-71fc-40a8-a102-a0c50fecd72e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bff1efe6d3cd429fbf441ca3d926b3bf', 'request_id': 'req-f7d73a4c-71fc-40a8-a102-a0c50fecd72e'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:48.994480 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f7d73a4c-71fc-40a8-a102-a0c50fecd72e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bff1efe6d3cd429fbf441ca3d926b3bf', 'request_id': 'req-f7d73a4c-71fc-40a8-a102-a0c50fecd72e'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:49.080192 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f7d73a4c-71fc-40a8-a102-a0c50fecd72e admin admin] The token cache is being invalidate because project bff1efe6d3cd429fbf441ca3d926b3bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:13:49.080728 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f7d73a4c-71fc-40a8-a102-a0c50fecd72e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:49.081529 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f81c42-ad0a-413b-b79b-1aa763bea14f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:49.082181 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f81c42-ad0a-413b-b79b-1aa763bea14f service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:49.082461 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f81c42-ad0a-413b-b79b-1aa763bea14f service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:49.082670 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f7d73a4c-71fc-40a8-a102-a0c50fecd72e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:49.082769 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f81c42-ad0a-413b-b79b-1aa763bea14f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:49.084938 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c4f81c42-ad0a-413b-b79b-1aa763bea14f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:49.085665 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1318/2672] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:13:48 2022] DELETE /identity/v3/projects/bff1efe6d3cd429fbf441ca3d926b3bf => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:13:49.105224 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d6194-6b47-4ed9-9ef5-44266c095969 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:49.105224 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d6194-6b47-4ed9-9ef5-44266c095969 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:49.105224 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d6194-6b47-4ed9-9ef5-44266c095969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:49.128492 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-613d6194-6b47-4ed9-9ef5-44266c095969 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:49.129731 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-613d6194-6b47-4ed9-9ef5-44266c095969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:49.171895 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f81c42-ad0a-413b-b79b-1aa763bea14f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:49.173417 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f81c42-ad0a-413b-b79b-1aa763bea14f service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:49.183182 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1355/2673] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:13:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:13:49.192925 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1319/2674] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:13:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:13:49.201518 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8bbb2-baf5-4ae6-ab5d-5d7150874b5a None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:49.201941 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8bbb2-baf5-4ae6-ab5d-5d7150874b5a None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:49.202324 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8bbb2-baf5-4ae6-ab5d-5d7150874b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:49.220749 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-c7e8bbb2-baf5-4ae6-ab5d-5d7150874b5a None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:49.224477 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c7e8bbb2-baf5-4ae6-ab5d-5d7150874b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:49.230813 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1356/2675] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:13:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:13:49.235059 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d6194-6b47-4ed9-9ef5-44266c095969 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:49.245068 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d6194-6b47-4ed9-9ef5-44266c095969 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:49.250171 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2def25-2854-460b-b22f-396cd64a61dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:49.250829 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2def25-2854-460b-b22f-396cd64a61dd admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:49.251110 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2def25-2854-460b-b22f-396cd64a61dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:49.251411 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2def25-2854-460b-b22f-396cd64a61dd admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:49.252169 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2def25-2854-460b-b22f-396cd64a61dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:13:49.252471 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2def25-2854-460b-b22f-396cd64a61dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:49.254060 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2def25-2854-460b-b22f-396cd64a61dd admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:49.267227 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1320/2676] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:13:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:13:49.271150 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e8bbb2-baf5-4ae6-ab5d-5d7150874b5a None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:49.280666 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e8bbb2-baf5-4ae6-ab5d-5d7150874b5a None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:49.285674 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a16ae84-f5ea-4b6f-9f85-1807ff9de188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:49.286398 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16ae84-f5ea-4b6f-9f85-1807ff9de188 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:49.286811 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16ae84-f5ea-4b6f-9f85-1807ff9de188 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:49.287093 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16ae84-f5ea-4b6f-9f85-1807ff9de188 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:49.288002 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a16ae84-f5ea-4b6f-9f85-1807ff9de188 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:49.290027 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a16ae84-f5ea-4b6f-9f85-1807ff9de188 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:49.388105 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1357/2677] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:13:49 2022] POST /identity/v3/projects => generated 391 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:13:49.393510 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2def25-2854-460b-b22f-396cd64a61dd admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:49.407736 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2def25-2854-460b-b22f-396cd64a61dd admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:49.522347 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a16ae84-f5ea-4b6f-9f85-1807ff9de188 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:49.524398 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-4a16ae84-f5ea-4b6f-9f85-1807ff9de188 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:49.528215 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d144fdae-7255-4428-bc29-79cca1c25ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:49.529168 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d144fdae-7255-4428-bc29-79cca1c25ad8 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:49.529578 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d144fdae-7255-4428-bc29-79cca1c25ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:49.530032 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d144fdae-7255-4428-bc29-79cca1c25ad8 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:49.530883 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d144fdae-7255-4428-bc29-79cca1c25ad8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:49.533487 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d144fdae-7255-4428-bc29-79cca1c25ad8 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:49.547068 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a16ae84-f5ea-4b6f-9f85-1807ff9de188 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:49.560555 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419357a8-a9b2-4006-bf53-27b4be359680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:49.562888 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419357a8-a9b2-4006-bf53-27b4be359680 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:49.563206 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419357a8-a9b2-4006-bf53-27b4be359680 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:49.564513 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419357a8-a9b2-4006-bf53-27b4be359680 admin admin] PATH_INFO: `/v3/projects/e22dc54ae5e448b1ab5ebec0483c5dff` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:49.567105 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419357a8-a9b2-4006-bf53-27b4be359680 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e22dc54ae5e448b1ab5ebec0483c5dff)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:49.571560 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419357a8-a9b2-4006-bf53-27b4be359680 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:49.670398 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1321/2678] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:13:49 2022] POST /identity/v3/users => generated 296 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:13:49.686051 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d144fdae-7255-4428-bc29-79cca1c25ad8 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:49.693185 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d144fdae-7255-4428-bc29-79cca1c25ad8 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:49.698992 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0281139a-bb29-4f9e-8d67-4a7d1cd1c053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:49.699737 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281139a-bb29-4f9e-8d67-4a7d1cd1c053 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:49.700159 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281139a-bb29-4f9e-8d67-4a7d1cd1c053 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:49.701117 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281139a-bb29-4f9e-8d67-4a7d1cd1c053 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:49.702238 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0281139a-bb29-4f9e-8d67-4a7d1cd1c053 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:49.704063 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0281139a-bb29-4f9e-8d67-4a7d1cd1c053 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:49.717971 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1322/2679] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:13:49 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:13:49.719983 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0281139a-bb29-4f9e-8d67-4a7d1cd1c053 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:49.730780 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0281139a-bb29-4f9e-8d67-4a7d1cd1c053 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:49.736638 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72cbb1f-1bf7-4a82-9534-edbda0c25363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:49.737501 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72cbb1f-1bf7-4a82-9534-edbda0c25363 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:49.738048 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72cbb1f-1bf7-4a82-9534-edbda0c25363 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:49.738214 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72cbb1f-1bf7-4a82-9534-edbda0c25363 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:49.739118 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72cbb1f-1bf7-4a82-9534-edbda0c25363 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:49.740923 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72cbb1f-1bf7-4a82-9534-edbda0c25363 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:49.761163 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1323/2680] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:13:49 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:13:49.764875 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72cbb1f-1bf7-4a82-9534-edbda0c25363 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:49.781948 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-419357a8-a9b2-4006-bf53-27b4be359680 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e22dc54ae5e448b1ab5ebec0483c5dff', 'request_id': 'req-419357a8-a9b2-4006-bf53-27b4be359680'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:49.788191 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72cbb1f-1bf7-4a82-9534-edbda0c25363 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:49.795913 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-419357a8-a9b2-4006-bf53-27b4be359680 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e22dc54ae5e448b1ab5ebec0483c5dff', 'request_id': 'req-419357a8-a9b2-4006-bf53-27b4be359680'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:49.867058 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe401b5-f385-4453-82df-900ce866d56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:49.869551 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe401b5-f385-4453-82df-900ce866d56b admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:49.869974 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe401b5-f385-4453-82df-900ce866d56b admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:49.870287 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe401b5-f385-4453-82df-900ce866d56b admin admin] PATH_INFO: `/v3/projects/f04e1accfc534fb18e36d789a9cefde3/users/32240804909d4572880a0f419f49f61e/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:49.876959 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-419357a8-a9b2-4006-bf53-27b4be359680 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e22dc54ae5e448b1ab5ebec0483c5dff', 'request_id': 'req-419357a8-a9b2-4006-bf53-27b4be359680'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:49.891633 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe401b5-f385-4453-82df-900ce866d56b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f04e1accfc534fb18e36d789a9cefde3, user_id=32240804909d4572880a0f419f49f61e, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:49.895182 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe401b5-f385-4453-82df-900ce866d56b admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:49.896143 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-419357a8-a9b2-4006-bf53-27b4be359680 admin admin] The token cache is being invalidate because project e22dc54ae5e448b1ab5ebec0483c5dff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:13:49.896929 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-419357a8-a9b2-4006-bf53-27b4be359680 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:49.899203 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-419357a8-a9b2-4006-bf53-27b4be359680 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:49.908665 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1358/2681] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:13:49 2022] DELETE /identity/v3/projects/e22dc54ae5e448b1ab5ebec0483c5dff => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:13:49.912247 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419357a8-a9b2-4006-bf53-27b4be359680 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:49.913891 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-419357a8-a9b2-4006-bf53-27b4be359680 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:49.933845 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419357a8-a9b2-4006-bf53-27b4be359680 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:49.941003 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef49568-363a-4176-b3ac-68c8953c5822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:49.941883 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef49568-363a-4176-b3ac-68c8953c5822 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:49.942160 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef49568-363a-4176-b3ac-68c8953c5822 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:49.942437 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef49568-363a-4176-b3ac-68c8953c5822 admin admin] PATH_INFO: `/v3/users/63fef14c06914a028f3de794dfc56d75` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:49.943675 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef49568-363a-4176-b3ac-68c8953c5822 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63fef14c06914a028f3de794dfc56d75)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:49.945605 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef49568-363a-4176-b3ac-68c8953c5822 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:49.999909 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1324/2682] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:13:49 2022] PUT /identity/v3/projects/f04e1accfc534fb18e36d789a9cefde3/users/32240804909d4572880a0f419f49f61e/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:13:50.070008 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1f69e-f72a-4fcd-beaf-36f8a8d1f879 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:50.070338 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1f69e-f72a-4fcd-beaf-36f8a8d1f879 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:50.071279 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1f69e-f72a-4fcd-beaf-36f8a8d1f879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:50.101199 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-e1e1f69e-f72a-4fcd-beaf-36f8a8d1f879 None None] MFA Rules not processed for user `32240804909d4572880a0f419f49f61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:50.102862 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e1e1f69e-f72a-4fcd-beaf-36f8a8d1f879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:50.132509 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-eef49568-363a-4176-b3ac-68c8953c5822 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63fef14c06914a028f3de794dfc56d75'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:50.145815 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-eef49568-363a-4176-b3ac-68c8953c5822 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63fef14c06914a028f3de794dfc56d75'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:50.155233 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-eef49568-363a-4176-b3ac-68c8953c5822 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63fef14c06914a028f3de794dfc56d75'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:50.255513 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-eef49568-363a-4176-b3ac-68c8953c5822 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63fef14c06914a028f3de794dfc56d75'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:50.256222 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-eef49568-363a-4176-b3ac-68c8953c5822 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63fef14c06914a028f3de794dfc56d75'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:50.266060 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1359/2683] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:13:49 2022] DELETE /identity/v3/users/63fef14c06914a028f3de794dfc56d75 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:13:50.276844 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1325/2684] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:13:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:13:50.281990 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef49568-363a-4176-b3ac-68c8953c5822 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:50.283971 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-eef49568-363a-4176-b3ac-68c8953c5822 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:50.444005 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef49568-363a-4176-b3ac-68c8953c5822 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:50.449975 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9686c0a0-8c54-4476-8e31-07df9a32e430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:50.450974 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686c0a0-8c54-4476-8e31-07df9a32e430 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:50.451448 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686c0a0-8c54-4476-8e31-07df9a32e430 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:50.451756 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686c0a0-8c54-4476-8e31-07df9a32e430 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:50.452763 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9686c0a0-8c54-4476-8e31-07df9a32e430 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:50.454392 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9686c0a0-8c54-4476-8e31-07df9a32e430 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:50.566738 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1360/2685] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:13:50 2022] POST /identity/v3/projects => generated 391 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:13:50.570685 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1f69e-f72a-4fcd-beaf-36f8a8d1f879 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:50.572424 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e1e1f69e-f72a-4fcd-beaf-36f8a8d1f879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:50.736890 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1f69e-f72a-4fcd-beaf-36f8a8d1f879 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:50.793698 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9686c0a0-8c54-4476-8e31-07df9a32e430 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:50.796623 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-9686c0a0-8c54-4476-8e31-07df9a32e430 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:50.803155 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b75f1b2-906b-4319-8125-2eabf803db4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:50.804075 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b75f1b2-906b-4319-8125-2eabf803db4c admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:50.804490 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b75f1b2-906b-4319-8125-2eabf803db4c admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:50.804889 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b75f1b2-906b-4319-8125-2eabf803db4c admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:50.805674 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b75f1b2-906b-4319-8125-2eabf803db4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:50.807756 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b75f1b2-906b-4319-8125-2eabf803db4c admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:50.889156 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9686c0a0-8c54-4476-8e31-07df9a32e430 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:50.895019 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f84df76-8a56-4a87-a211-79ee437e6f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:50.895917 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84df76-8a56-4a87-a211-79ee437e6f9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:50.896197 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84df76-8a56-4a87-a211-79ee437e6f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:50.896471 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84df76-8a56-4a87-a211-79ee437e6f9d admin admin] PATH_INFO: `/v3/projects/3cc006710530414f8627a37ddbffa73d` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:50.897744 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f84df76-8a56-4a87-a211-79ee437e6f9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cc006710530414f8627a37ddbffa73d)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:50.899725 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f84df76-8a56-4a87-a211-79ee437e6f9d admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:50.909615 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1326/2686] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:13:50 2022] POST /identity/v3/users => generated 302 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:13:50.911301 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b75f1b2-906b-4319-8125-2eabf803db4c admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:50.923775 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b75f1b2-906b-4319-8125-2eabf803db4c admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:50.932700 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95d5a85-7700-4bc5-9bf6-c741b5591e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:50.936397 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d5a85-7700-4bc5-9bf6-c741b5591e97 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:50.936397 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d5a85-7700-4bc5-9bf6-c741b5591e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:50.936397 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d5a85-7700-4bc5-9bf6-c741b5591e97 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:50.937285 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95d5a85-7700-4bc5-9bf6-c741b5591e97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:50.939433 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95d5a85-7700-4bc5-9bf6-c741b5591e97 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:50.951634 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1327/2687] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:13:50 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:13:50.956642 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95d5a85-7700-4bc5-9bf6-c741b5591e97 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:50.969075 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95d5a85-7700-4bc5-9bf6-c741b5591e97 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:50.976208 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353b90fc-62ba-4cfe-a3f6-5875fc71746d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:50.976517 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b90fc-62ba-4cfe-a3f6-5875fc71746d admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:50.976882 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b90fc-62ba-4cfe-a3f6-5875fc71746d admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:50.977230 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b90fc-62ba-4cfe-a3f6-5875fc71746d admin admin] PATH_INFO: `/v3/projects/224e7cf6cf474b02ac095458aa4add5d/users/f936cc3ccd8b4fcdb55ab14c013ae684/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:50.999831 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353b90fc-62ba-4cfe-a3f6-5875fc71746d admin admin] RBAC: Authorizing `identity:create_grant(project_id=224e7cf6cf474b02ac095458aa4add5d, user_id=f936cc3ccd8b4fcdb55ab14c013ae684, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:51.003764 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353b90fc-62ba-4cfe-a3f6-5875fc71746d admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:51.129263 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1328/2688] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:13:50 2022] PUT /identity/v3/projects/224e7cf6cf474b02ac095458aa4add5d/users/f936cc3ccd8b4fcdb55ab14c013ae684/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:13:51.130171 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353b90fc-62ba-4cfe-a3f6-5875fc71746d admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:51.132817 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-353b90fc-62ba-4cfe-a3f6-5875fc71746d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:51.136656 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2f84df76-8a56-4a87-a211-79ee437e6f9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cc006710530414f8627a37ddbffa73d', 'request_id': 'req-2f84df76-8a56-4a87-a211-79ee437e6f9d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:51.142396 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2f84df76-8a56-4a87-a211-79ee437e6f9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cc006710530414f8627a37ddbffa73d', 'request_id': 'req-2f84df76-8a56-4a87-a211-79ee437e6f9d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:51.205174 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353b90fc-62ba-4cfe-a3f6-5875fc71746d admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:51.217455 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2f84df76-8a56-4a87-a211-79ee437e6f9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cc006710530414f8627a37ddbffa73d', 'request_id': 'req-2f84df76-8a56-4a87-a211-79ee437e6f9d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:51.230657 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2f84df76-8a56-4a87-a211-79ee437e6f9d admin admin] The token cache is being invalidate because project 3cc006710530414f8627a37ddbffa73d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:13:51.231051 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2f84df76-8a56-4a87-a211-79ee437e6f9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:51.232393 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2f84df76-8a56-4a87-a211-79ee437e6f9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:51.234388 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1361/2689] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:13:50 2022] DELETE /identity/v3/projects/3cc006710530414f8627a37ddbffa73d => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:13:51.235210 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f84df76-8a56-4a87-a211-79ee437e6f9d admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:51.236617 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-2f84df76-8a56-4a87-a211-79ee437e6f9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:51.276774 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eaf832-0f1a-404a-b915-a1fdbafa1f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:51.278228 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eaf832-0f1a-404a-b915-a1fdbafa1f2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:51.278654 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eaf832-0f1a-404a-b915-a1fdbafa1f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:51.278940 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eaf832-0f1a-404a-b915-a1fdbafa1f2e admin admin] PATH_INFO: `/v3/users/34cd5580db494d05a9ea9cb37f714d27` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:51.280435 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eaf832-0f1a-404a-b915-a1fdbafa1f2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=34cd5580db494d05a9ea9cb37f714d27)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:51.283811 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eaf832-0f1a-404a-b915-a1fdbafa1f2e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:51.320339 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f84df76-8a56-4a87-a211-79ee437e6f9d admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:51.327367 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a8c06d-43bd-4ac4-af81-2af8aa3cb9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:51.328145 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a8c06d-43bd-4ac4-af81-2af8aa3cb9b8 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:51.328448 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a8c06d-43bd-4ac4-af81-2af8aa3cb9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:51.328712 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a8c06d-43bd-4ac4-af81-2af8aa3cb9b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:51.329451 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a8c06d-43bd-4ac4-af81-2af8aa3cb9b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:51.334230 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a8c06d-43bd-4ac4-af81-2af8aa3cb9b8 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:51.347565 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1362/2690] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:13:51 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:13:51.347565 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a1451-45ca-4706-a475-97e7c63d9bbd None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:51.347565 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a1451-45ca-4706-a475-97e7c63d9bbd None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:51.347565 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a1451-45ca-4706-a475-97e7c63d9bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:51.367468 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-206a1451-45ca-4706-a475-97e7c63d9bbd None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:51.368718 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-206a1451-45ca-4706-a475-97e7c63d9bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:51.382361 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1363/2691] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:13:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:13:51.383272 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a1451-45ca-4706-a475-97e7c63d9bbd None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:51.394538 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a1451-45ca-4706-a475-97e7c63d9bbd None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:51.399636 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1be629c-1b96-4b0e-961f-e61e8fbdf511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:51.400586 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be629c-1b96-4b0e-961f-e61e8fbdf511 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:51.400949 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be629c-1b96-4b0e-961f-e61e8fbdf511 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:51.401232 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be629c-1b96-4b0e-961f-e61e8fbdf511 admin admin] PATH_INFO: `/v3/projects/224e7cf6cf474b02ac095458aa4add5d/users/f936cc3ccd8b4fcdb55ab14c013ae684/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:51.403334 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1be629c-1b96-4b0e-961f-e61e8fbdf511 admin admin] RBAC: Authorizing `identity:create_grant(project_id=224e7cf6cf474b02ac095458aa4add5d, user_id=f936cc3ccd8b4fcdb55ab14c013ae684, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:51.406009 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1be629c-1b96-4b0e-961f-e61e8fbdf511 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:51.416950 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1364/2692] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:13:51 2022] PUT /identity/v3/projects/224e7cf6cf474b02ac095458aa4add5d/users/f936cc3ccd8b4fcdb55ab14c013ae684/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:13:51.418056 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f843674c-70fd-4ad4-a3e1-d316db475146 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:51.418334 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f843674c-70fd-4ad4-a3e1-d316db475146 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:51.418610 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f843674c-70fd-4ad4-a3e1-d316db475146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:51.437430 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-f843674c-70fd-4ad4-a3e1-d316db475146 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:51.438721 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-f843674c-70fd-4ad4-a3e1-d316db475146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:51.516845 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1365/2693] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:13:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:13:51.518999 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b376ae-7894-4a39-b7c5-a18da69b60a0 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:51.519382 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b376ae-7894-4a39-b7c5-a18da69b60a0 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:51.519926 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b376ae-7894-4a39-b7c5-a18da69b60a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:51.522802 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e9eaf832-0f1a-404a-b915-a1fdbafa1f2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34cd5580db494d05a9ea9cb37f714d27'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:51.532212 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e9eaf832-0f1a-404a-b915-a1fdbafa1f2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34cd5580db494d05a9ea9cb37f714d27'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:51.532405 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e9eaf832-0f1a-404a-b915-a1fdbafa1f2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34cd5580db494d05a9ea9cb37f714d27'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:51.553993 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-47b376ae-7894-4a39-b7c5-a18da69b60a0 None None] MFA Rules not processed for user `f936cc3ccd8b4fcdb55ab14c013ae684`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:51.555513 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-47b376ae-7894-4a39-b7c5-a18da69b60a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:51.602963 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e9eaf832-0f1a-404a-b915-a1fdbafa1f2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34cd5580db494d05a9ea9cb37f714d27'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:51.623158 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e9eaf832-0f1a-404a-b915-a1fdbafa1f2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34cd5580db494d05a9ea9cb37f714d27'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:51.634421 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1329/2694] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:13:51 2022] DELETE /identity/v3/users/34cd5580db494d05a9ea9cb37f714d27 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:13:51.634421 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eaf832-0f1a-404a-b915-a1fdbafa1f2e admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:51.634421 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e9eaf832-0f1a-404a-b915-a1fdbafa1f2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:51.662248 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1366/2695] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:13:51 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:13:51.665256 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0993bc-f09a-40a8-9415-191bf5529336 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:51.665836 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0993bc-f09a-40a8-9415-191bf5529336 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:51.670971 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0993bc-f09a-40a8-9415-191bf5529336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:51.691857 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-5d0993bc-f09a-40a8-9415-191bf5529336 None None] MFA Rules not processed for user `32240804909d4572880a0f419f49f61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:51.696927 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-5d0993bc-f09a-40a8-9415-191bf5529336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:51.719853 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eaf832-0f1a-404a-b915-a1fdbafa1f2e admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:51.725652 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4231f3-7e60-4427-b543-282ff926017c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:51.726330 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4231f3-7e60-4427-b543-282ff926017c admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:51.726611 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4231f3-7e60-4427-b543-282ff926017c admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:51.726887 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4231f3-7e60-4427-b543-282ff926017c admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:51.727767 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4231f3-7e60-4427-b543-282ff926017c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:13:51.728017 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4231f3-7e60-4427-b543-282ff926017c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:51.729793 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4231f3-7e60-4427-b543-282ff926017c admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:51.745478 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1330/2696] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:13:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:13:51.751103 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4231f3-7e60-4427-b543-282ff926017c admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:51.764698 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4231f3-7e60-4427-b543-282ff926017c admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:51.769554 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fd0072-e0b5-411d-8540-3e42e2575082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:51.771810 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd0072-e0b5-411d-8540-3e42e2575082 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:51.771810 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd0072-e0b5-411d-8540-3e42e2575082 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:51.771810 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd0072-e0b5-411d-8540-3e42e2575082 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:51.771810 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fd0072-e0b5-411d-8540-3e42e2575082 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:51.773536 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fd0072-e0b5-411d-8540-3e42e2575082 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:51.782325 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1367/2697] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:13:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:13:51.789412 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0993bc-f09a-40a8-9415-191bf5529336 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:51.796121 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-5d0993bc-f09a-40a8-9415-191bf5529336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:51.891680 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1331/2698] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:13:51 2022] POST /identity/v3/projects => generated 375 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:13:51.898444 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fd0072-e0b5-411d-8540-3e42e2575082 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:51.929219 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0993bc-f09a-40a8-9415-191bf5529336 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:51.996026 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fd0072-e0b5-411d-8540-3e42e2575082 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:52.001779 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9008a66b-5bcd-4768-b1fc-46622013b04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:52.002964 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008a66b-5bcd-4768-b1fc-46622013b04a admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:52.003266 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008a66b-5bcd-4768-b1fc-46622013b04a admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:52.003573 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008a66b-5bcd-4768-b1fc-46622013b04a admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:52.004276 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9008a66b-5bcd-4768-b1fc-46622013b04a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:52.007883 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9008a66b-5bcd-4768-b1fc-46622013b04a admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:52.034520 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632518df-f31b-4afa-b8af-f9ff2ee68644 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:52.035333 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632518df-f31b-4afa-b8af-f9ff2ee68644 service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:52.035729 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632518df-f31b-4afa-b8af-f9ff2ee68644 service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:52.036171 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632518df-f31b-4afa-b8af-f9ff2ee68644 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:52.038092 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-632518df-f31b-4afa-b8af-f9ff2ee68644 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:52.104342 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632518df-f31b-4afa-b8af-f9ff2ee68644 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:52.105893 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632518df-f31b-4afa-b8af-f9ff2ee68644 service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:52.115978 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1368/2699] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:13:51 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:13:52.119778 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632518df-f31b-4afa-b8af-f9ff2ee68644 service nova] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:52.121738 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-632518df-f31b-4afa-b8af-f9ff2ee68644 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:52.128000 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1332/2700] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:13:51 2022] POST /identity/v3/users => generated 288 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:13:52.133709 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9008a66b-5bcd-4768-b1fc-46622013b04a admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:52.144568 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632518df-f31b-4afa-b8af-f9ff2ee68644 service nova] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:52.146266 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9008a66b-5bcd-4768-b1fc-46622013b04a admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:52.153131 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aff525-3cb4-41a1-acc8-31060af61994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:52.153873 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aff525-3cb4-41a1-acc8-31060af61994 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:52.154159 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aff525-3cb4-41a1-acc8-31060af61994 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:52.154438 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aff525-3cb4-41a1-acc8-31060af61994 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:52.155175 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aff525-3cb4-41a1-acc8-31060af61994 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:52.156890 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aff525-3cb4-41a1-acc8-31060af61994 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:52.158917 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2681cbed-f3ea-4c93-b279-6306b71f6c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:52.159813 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2681cbed-f3ea-4c93-b279-6306b71f6c83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:52.160095 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2681cbed-f3ea-4c93-b279-6306b71f6c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:52.160373 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2681cbed-f3ea-4c93-b279-6306b71f6c83 admin admin] PATH_INFO: `/v3/projects/f9d24089740246829e483d7d6177125c` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:52.161704 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2681cbed-f3ea-4c93-b279-6306b71f6c83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9d24089740246829e483d7d6177125c)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:52.163973 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2681cbed-f3ea-4c93-b279-6306b71f6c83 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:52.167614 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1333/2701] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:13:52.172465 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aff525-3cb4-41a1-acc8-31060af61994 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:52.184383 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aff525-3cb4-41a1-acc8-31060af61994 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:52.190637 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70973798-fa1d-4521-a08c-cc7e56fe231a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:52.192024 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70973798-fa1d-4521-a08c-cc7e56fe231a admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:52.192305 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70973798-fa1d-4521-a08c-cc7e56fe231a admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:52.192579 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70973798-fa1d-4521-a08c-cc7e56fe231a admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:52.193306 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70973798-fa1d-4521-a08c-cc7e56fe231a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:52.194925 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70973798-fa1d-4521-a08c-cc7e56fe231a admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:52.206014 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1334/2702] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:13:52.210038 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70973798-fa1d-4521-a08c-cc7e56fe231a admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:52.220222 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70973798-fa1d-4521-a08c-cc7e56fe231a admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:52.224997 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93ebc6d-33ce-4166-8888-7951e1ca2fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:52.225870 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ebc6d-33ce-4166-8888-7951e1ca2fda admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:52.226151 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ebc6d-33ce-4166-8888-7951e1ca2fda admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:52.226423 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ebc6d-33ce-4166-8888-7951e1ca2fda admin admin] PATH_INFO: `/v3/projects/c2856369dca645e88c940652f218dc3b/users/66699357d8fd4f3c95d417bafdec8e39/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:52.242525 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93ebc6d-33ce-4166-8888-7951e1ca2fda admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2856369dca645e88c940652f218dc3b, user_id=66699357d8fd4f3c95d417bafdec8e39, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:52.245452 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93ebc6d-33ce-4166-8888-7951e1ca2fda admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:52.329315 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1335/2703] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:13:52 2022] PUT /identity/v3/projects/c2856369dca645e88c940652f218dc3b/users/66699357d8fd4f3c95d417bafdec8e39/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:13:52.334403 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25a832-b99c-4450-9089-c182924c70dd None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:52.337619 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25a832-b99c-4450-9089-c182924c70dd None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:52.337619 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25a832-b99c-4450-9089-c182924c70dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:52.338692 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2681cbed-f3ea-4c93-b279-6306b71f6c83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9d24089740246829e483d7d6177125c', 'request_id': 'req-2681cbed-f3ea-4c93-b279-6306b71f6c83'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:52.345215 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2681cbed-f3ea-4c93-b279-6306b71f6c83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9d24089740246829e483d7d6177125c', 'request_id': 'req-2681cbed-f3ea-4c93-b279-6306b71f6c83'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:52.360660 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-6e25a832-b99c-4450-9089-c182924c70dd None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:52.361835 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-6e25a832-b99c-4450-9089-c182924c70dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:52.417534 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2681cbed-f3ea-4c93-b279-6306b71f6c83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9d24089740246829e483d7d6177125c', 'request_id': 'req-2681cbed-f3ea-4c93-b279-6306b71f6c83'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:52.431824 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2681cbed-f3ea-4c93-b279-6306b71f6c83 admin admin] The token cache is being invalidate because project f9d24089740246829e483d7d6177125c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:13:52.432184 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2681cbed-f3ea-4c93-b279-6306b71f6c83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:52.432914 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2681cbed-f3ea-4c93-b279-6306b71f6c83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:52.434709 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1369/2704] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:13:52 2022] DELETE /identity/v3/projects/f9d24089740246829e483d7d6177125c => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:13:52.436752 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1336/2705] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:13:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:13:52.440386 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44da4d-2697-47c3-862f-e92ccd5891b4 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:52.440991 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44da4d-2697-47c3-862f-e92ccd5891b4 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:52.441304 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44da4d-2697-47c3-862f-e92ccd5891b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:52.448582 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e25a832-b99c-4450-9089-c182924c70dd None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:52.450846 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-6e25a832-b99c-4450-9089-c182924c70dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:52.462480 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-3e44da4d-2697-47c3-862f-e92ccd5891b4 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:52.463835 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-3e44da4d-2697-47c3-862f-e92ccd5891b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:52.473921 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1370/2706] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:13:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:13:52.482340 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4757ff-1d7b-4cec-86e7-0ee15d4852ce None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:52.484226 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4757ff-1d7b-4cec-86e7-0ee15d4852ce None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:52.484226 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4757ff-1d7b-4cec-86e7-0ee15d4852ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:52.504528 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-cb4757ff-1d7b-4cec-86e7-0ee15d4852ce None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:52.505941 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-cb4757ff-1d7b-4cec-86e7-0ee15d4852ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:52.516982 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1371/2707] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:13:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:13:52.520844 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4757ff-1d7b-4cec-86e7-0ee15d4852ce None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:52.527895 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e25a832-b99c-4450-9089-c182924c70dd None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:52.533379 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0a984f-a297-455a-9925-1d5f8e48fe87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:52.533562 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4757ff-1d7b-4cec-86e7-0ee15d4852ce None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:52.534153 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a984f-a297-455a-9925-1d5f8e48fe87 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:52.534434 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a984f-a297-455a-9925-1d5f8e48fe87 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:52.534776 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a984f-a297-455a-9925-1d5f8e48fe87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:52.536580 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-aa0a984f-a297-455a-9925-1d5f8e48fe87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:52.538893 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759b0f97-e4af-43d8-bb0a-a68063932b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:52.539584 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759b0f97-e4af-43d8-bb0a-a68063932b93 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:52.539938 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759b0f97-e4af-43d8-bb0a-a68063932b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:52.540284 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759b0f97-e4af-43d8-bb0a-a68063932b93 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:52.541087 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759b0f97-e4af-43d8-bb0a-a68063932b93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:13:52.541617 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759b0f97-e4af-43d8-bb0a-a68063932b93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:52.543340 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759b0f97-e4af-43d8-bb0a-a68063932b93 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:52.550977 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0a984f-a297-455a-9925-1d5f8e48fe87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:52.552787 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0a984f-a297-455a-9925-1d5f8e48fe87 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:52.556857 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1372/2708] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:13:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:13:52.560714 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759b0f97-e4af-43d8-bb0a-a68063932b93 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:52.567234 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1337/2709] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:13:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:13:52.570434 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759b0f97-e4af-43d8-bb0a-a68063932b93 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:52.575236 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e182ddc-246b-4c84-a230-342b626f3d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:52.575919 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e182ddc-246b-4c84-a230-342b626f3d89 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:52.576199 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e182ddc-246b-4c84-a230-342b626f3d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:52.576477 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e182ddc-246b-4c84-a230-342b626f3d89 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:52.577162 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e182ddc-246b-4c84-a230-342b626f3d89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:52.579179 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e182ddc-246b-4c84-a230-342b626f3d89 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:52.698072 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1373/2710] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:13:52 2022] POST /identity/v3/projects => generated 385 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:13:52.702528 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0a984f-a297-455a-9925-1d5f8e48fe87 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:52.714299 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0a984f-a297-455a-9925-1d5f8e48fe87 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:52.803985 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebed0aa-ee17-4455-a637-e6ac26f5aff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:52.804939 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebed0aa-ee17-4455-a637-e6ac26f5aff7 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:52.805272 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebed0aa-ee17-4455-a637-e6ac26f5aff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:52.805589 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebed0aa-ee17-4455-a637-e6ac26f5aff7 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:52.806319 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebed0aa-ee17-4455-a637-e6ac26f5aff7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:52.808298 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebed0aa-ee17-4455-a637-e6ac26f5aff7 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:52.890410 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1338/2711] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:13:52 2022] POST /identity/v3/users => generated 293 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:13:52.892146 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e182ddc-246b-4c84-a230-342b626f3d89 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:52.904461 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e182ddc-246b-4c84-a230-342b626f3d89 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:52.911331 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe43c08-7de2-4544-8b6a-ce685d73e053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:52.919551 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe43c08-7de2-4544-8b6a-ce685d73e053 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:52.919551 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe43c08-7de2-4544-8b6a-ce685d73e053 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:52.919551 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe43c08-7de2-4544-8b6a-ce685d73e053 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:52.919551 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe43c08-7de2-4544-8b6a-ce685d73e053 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:52.919551 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe43c08-7de2-4544-8b6a-ce685d73e053 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:52.926909 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1374/2712] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:13:52.931462 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebed0aa-ee17-4455-a637-e6ac26f5aff7 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:52.946467 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebed0aa-ee17-4455-a637-e6ac26f5aff7 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:52.953625 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1d5a87-2a29-4f8d-852a-c4f6b9619930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:52.954612 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d5a87-2a29-4f8d-852a-c4f6b9619930 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:52.955105 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d5a87-2a29-4f8d-852a-c4f6b9619930 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:52.955602 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d5a87-2a29-4f8d-852a-c4f6b9619930 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:52.957370 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1d5a87-2a29-4f8d-852a-c4f6b9619930 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:52.959676 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1d5a87-2a29-4f8d-852a-c4f6b9619930 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:52.972577 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1339/2713] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:13:52.976940 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe43c08-7de2-4544-8b6a-ce685d73e053 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:52.988425 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe43c08-7de2-4544-8b6a-ce685d73e053 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:52.993771 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cf5e86-8686-4827-a7f4-c124cb68eb65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:52.994724 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf5e86-8686-4827-a7f4-c124cb68eb65 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:52.995006 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf5e86-8686-4827-a7f4-c124cb68eb65 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:52.995279 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf5e86-8686-4827-a7f4-c124cb68eb65 admin admin] PATH_INFO: `/v3/projects/366727f0fe304593ae0a789b2f0eb0b2/users/dd53fb02767e4912bd762fa7d1e80a06/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:53.013580 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cf5e86-8686-4827-a7f4-c124cb68eb65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=366727f0fe304593ae0a789b2f0eb0b2, user_id=dd53fb02767e4912bd762fa7d1e80a06, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:53.016315 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cf5e86-8686-4827-a7f4-c124cb68eb65 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:53.095528 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1375/2714] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:13:52 2022] PUT /identity/v3/projects/366727f0fe304593ae0a789b2f0eb0b2/users/dd53fb02767e4912bd762fa7d1e80a06/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:13:53.106949 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d0003-126e-415e-8ecd-30fffd14d89f None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:53.107544 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d0003-126e-415e-8ecd-30fffd14d89f None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:53.107918 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d0003-126e-415e-8ecd-30fffd14d89f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:53.161078 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-ff7d0003-126e-415e-8ecd-30fffd14d89f None None] MFA Rules not processed for user `dd53fb02767e4912bd762fa7d1e80a06`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:53.162776 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-ff7d0003-126e-415e-8ecd-30fffd14d89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:53.251626 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1340/2715] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:13:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:13:53.263494 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cf5e86-8686-4827-a7f4-c124cb68eb65 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:53.265507 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-07cf5e86-8686-4827-a7f4-c124cb68eb65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:53.349931 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cf5e86-8686-4827-a7f4-c124cb68eb65 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:53.353802 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bcdb28-dbbd-4ae5-b231-7050ed7b2d05 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b5cb86f190f4fcfb06d66cb8f14643f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:53.354452 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bcdb28-dbbd-4ae5-b231-7050ed7b2d05 service glance] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:53.354741 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bcdb28-dbbd-4ae5-b231-7050ed7b2d05 service glance] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:53.355042 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bcdb28-dbbd-4ae5-b231-7050ed7b2d05 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:53.364724 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bcdb28-dbbd-4ae5-b231-7050ed7b2d05 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:53.366163 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bcdb28-dbbd-4ae5-b231-7050ed7b2d05 service glance] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:53.383853 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1376/2716] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:13:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:13:54.739586 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74640f2-01aa-433e-b799-fe6ab17550f8 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:54.740630 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74640f2-01aa-433e-b799-fe6ab17550f8 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:54.741108 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74640f2-01aa-433e-b799-fe6ab17550f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:54.810804 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-f74640f2-01aa-433e-b799-fe6ab17550f8 None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:54.811970 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-f74640f2-01aa-433e-b799-fe6ab17550f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:54.942342 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1341/2717] 10.222.0.52 () {58 vars in 1009 bytes} [Sat May 14 21:13:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:13:55.015448 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bcdb28-dbbd-4ae5-b231-7050ed7b2d05 service glance] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:55.017719 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-80bcdb28-dbbd-4ae5-b231-7050ed7b2d05 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:55.063265 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74640f2-01aa-433e-b799-fe6ab17550f8 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:55.064641 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-f74640f2-01aa-433e-b799-fe6ab17550f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:55.155272 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74640f2-01aa-433e-b799-fe6ab17550f8 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:55.161344 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abcedde-ecb0-45df-adcf-ddf3e6a2738f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:55.162256 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abcedde-ecb0-45df-adcf-ddf3e6a2738f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:55.162588 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abcedde-ecb0-45df-adcf-ddf3e6a2738f admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:55.162889 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abcedde-ecb0-45df-adcf-ddf3e6a2738f admin admin] PATH_INFO: `/v3/users/3bff40a84e6f4a82b0c9fb0b155684c4` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:55.165971 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abcedde-ecb0-45df-adcf-ddf3e6a2738f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bff40a84e6f4a82b0c9fb0b155684c4)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:55.169801 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abcedde-ecb0-45df-adcf-ddf3e6a2738f admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:55.192266 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bcdb28-dbbd-4ae5-b231-7050ed7b2d05 service glance] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:55.206975 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea97f6-0cae-43ab-bf2c-2ddb83e29644 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:55.207683 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea97f6-0cae-43ab-bf2c-2ddb83e29644 service swift] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:55.207976 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea97f6-0cae-43ab-bf2c-2ddb83e29644 service swift] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:55.208281 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea97f6-0cae-43ab-bf2c-2ddb83e29644 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:55.225916 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fea97f6-0cae-43ab-bf2c-2ddb83e29644 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:55.227728 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fea97f6-0cae-43ab-bf2c-2ddb83e29644 service swift] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:55.260525 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1377/2718] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 21:13:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 14 21:13:55.484466 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-2abcedde-ecb0-45df-adcf-ddf3e6a2738f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bff40a84e6f4a82b0c9fb0b155684c4'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:55.507420 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-2abcedde-ecb0-45df-adcf-ddf3e6a2738f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bff40a84e6f4a82b0c9fb0b155684c4'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:55.510074 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-2abcedde-ecb0-45df-adcf-ddf3e6a2738f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bff40a84e6f4a82b0c9fb0b155684c4'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:55.585799 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-2abcedde-ecb0-45df-adcf-ddf3e6a2738f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bff40a84e6f4a82b0c9fb0b155684c4'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:55.605797 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-2abcedde-ecb0-45df-adcf-ddf3e6a2738f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bff40a84e6f4a82b0c9fb0b155684c4'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:55.617819 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1342/2719] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:13:55 2022] DELETE /identity/v3/users/3bff40a84e6f4a82b0c9fb0b155684c4 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:13:55.624067 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1554e039-641d-49ba-98a0-98fbf00a335b None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:55.624683 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1554e039-641d-49ba-98a0-98fbf00a335b None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:55.625525 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1554e039-641d-49ba-98a0-98fbf00a335b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:55.646415 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-1554e039-641d-49ba-98a0-98fbf00a335b None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:55.647774 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-1554e039-641d-49ba-98a0-98fbf00a335b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:55.751957 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1378/2720] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:13:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:13:55.765715 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abcedde-ecb0-45df-adcf-ddf3e6a2738f admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:55.768284 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-2abcedde-ecb0-45df-adcf-ddf3e6a2738f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:55.867920 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abcedde-ecb0-45df-adcf-ddf3e6a2738f admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:55.873658 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f19722-f390-4f8d-be60-5d589825dd78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:55.874916 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f19722-f390-4f8d-be60-5d589825dd78 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:55.875819 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f19722-f390-4f8d-be60-5d589825dd78 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:55.876341 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f19722-f390-4f8d-be60-5d589825dd78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:55.891769 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f19722-f390-4f8d-be60-5d589825dd78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:55.895142 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f19722-f390-4f8d-be60-5d589825dd78 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:55.916420 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1343/2721] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:13:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:13:57.066052 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1554e039-641d-49ba-98a0-98fbf00a335b None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:57.068108 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-1554e039-641d-49ba-98a0-98fbf00a335b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:57.078059 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff41e82-df22-41ba-b612-dd37bc99dcdf None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:57.078944 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff41e82-df22-41ba-b612-dd37bc99dcdf None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:57.079404 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff41e82-df22-41ba-b612-dd37bc99dcdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:57.097065 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1554e039-641d-49ba-98a0-98fbf00a335b None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:57.106987 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-7ff41e82-df22-41ba-b612-dd37bc99dcdf None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:57.111110 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-7ff41e82-df22-41ba-b612-dd37bc99dcdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:57.111895 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036c372d-e188-4db2-8824-ab4ecc2f5ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:57.112769 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c372d-e188-4db2-8824-ab4ecc2f5ce4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:57.113211 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c372d-e188-4db2-8824-ab4ecc2f5ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:57.115150 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c372d-e188-4db2-8824-ab4ecc2f5ce4 admin admin] PATH_INFO: `/v3/projects/f6c833726abf47f49b561df1966764d5` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:57.115999 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036c372d-e188-4db2-8824-ab4ecc2f5ce4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6c833726abf47f49b561df1966764d5)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:57.119106 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036c372d-e188-4db2-8824-ab4ecc2f5ce4 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:57.228538 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1344/2722] 10.222.0.52 () {58 vars in 1009 bytes} [Sat May 14 21:13:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:13:57.248514 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff41e82-df22-41ba-b612-dd37bc99dcdf None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:57.251368 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-7ff41e82-df22-41ba-b612-dd37bc99dcdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:57.269214 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-036c372d-e188-4db2-8824-ab4ecc2f5ce4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6c833726abf47f49b561df1966764d5', 'request_id': 'req-036c372d-e188-4db2-8824-ab4ecc2f5ce4'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:57.276406 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-036c372d-e188-4db2-8824-ab4ecc2f5ce4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6c833726abf47f49b561df1966764d5', 'request_id': 'req-036c372d-e188-4db2-8824-ab4ecc2f5ce4'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:57.345487 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-036c372d-e188-4db2-8824-ab4ecc2f5ce4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6c833726abf47f49b561df1966764d5', 'request_id': 'req-036c372d-e188-4db2-8824-ab4ecc2f5ce4'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:57.349513 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff41e82-df22-41ba-b612-dd37bc99dcdf None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:57.363840 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-036c372d-e188-4db2-8824-ab4ecc2f5ce4 admin admin] The token cache is being invalidate because project f6c833726abf47f49b561df1966764d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:13:57.364723 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-036c372d-e188-4db2-8824-ab4ecc2f5ce4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:57.365644 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-036c372d-e188-4db2-8824-ab4ecc2f5ce4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:57.371572 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1379/2723] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:13:57 2022] DELETE /identity/v3/projects/f6c833726abf47f49b561df1966764d5 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:13:57.374312 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036c372d-e188-4db2-8824-ab4ecc2f5ce4 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:57.376004 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-036c372d-e188-4db2-8824-ab4ecc2f5ce4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:57.438001 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd14eba-fc8d-43b0-a4a8-ccbe574a1ce5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:57.439425 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd14eba-fc8d-43b0-a4a8-ccbe574a1ce5 service swift] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:57.440060 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd14eba-fc8d-43b0-a4a8-ccbe574a1ce5 service swift] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:57.440397 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd14eba-fc8d-43b0-a4a8-ccbe574a1ce5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:57.443170 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-7fd14eba-fc8d-43b0-a4a8-ccbe574a1ce5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:57.466003 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036c372d-e188-4db2-8824-ab4ecc2f5ce4 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:57.473020 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f607e2d-e5e6-48ee-8545-dd2ab2052ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:57.474600 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f607e2d-e5e6-48ee-8545-dd2ab2052ea6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:57.475241 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f607e2d-e5e6-48ee-8545-dd2ab2052ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:57.475703 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f607e2d-e5e6-48ee-8545-dd2ab2052ea6 admin admin] PATH_INFO: `/v3/users/24a03e5587064a5284568ac644aaa419` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:57.477765 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f607e2d-e5e6-48ee-8545-dd2ab2052ea6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24a03e5587064a5284568ac644aaa419)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:57.480015 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f607e2d-e5e6-48ee-8545-dd2ab2052ea6 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:57.544993 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd14eba-fc8d-43b0-a4a8-ccbe574a1ce5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:57.546805 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd14eba-fc8d-43b0-a4a8-ccbe574a1ce5 service swift] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:57.566378 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1345/2724] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 21:13:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 21:13:57.765038 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6f607e2d-e5e6-48ee-8545-dd2ab2052ea6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24a03e5587064a5284568ac644aaa419'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:57.783967 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6f607e2d-e5e6-48ee-8545-dd2ab2052ea6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24a03e5587064a5284568ac644aaa419'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:57.803596 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6f607e2d-e5e6-48ee-8545-dd2ab2052ea6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24a03e5587064a5284568ac644aaa419'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:57.888157 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6f607e2d-e5e6-48ee-8545-dd2ab2052ea6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24a03e5587064a5284568ac644aaa419'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:57.888958 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6f607e2d-e5e6-48ee-8545-dd2ab2052ea6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24a03e5587064a5284568ac644aaa419'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:57.905664 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1380/2725] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:13:57 2022] DELETE /identity/v3/users/24a03e5587064a5284568ac644aaa419 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:13:58.440990 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd14eba-fc8d-43b0-a4a8-ccbe574a1ce5 service swift] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:58.453754 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd14eba-fc8d-43b0-a4a8-ccbe574a1ce5 service swift] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:58.532605 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c481f4-e44a-4dde-9ed7-030ba9a94777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:58.533827 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c481f4-e44a-4dde-9ed7-030ba9a94777 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:58.534185 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c481f4-e44a-4dde-9ed7-030ba9a94777 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:58.535105 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c481f4-e44a-4dde-9ed7-030ba9a94777 admin admin] PATH_INFO: `/v3/projects/0582724f730b425cbe166533699aa291` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:58.536416 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c481f4-e44a-4dde-9ed7-030ba9a94777 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0582724f730b425cbe166533699aa291)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:58.539877 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c481f4-e44a-4dde-9ed7-030ba9a94777 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:58.691559 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-37c481f4-e44a-4dde-9ed7-030ba9a94777 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0582724f730b425cbe166533699aa291', 'request_id': 'req-37c481f4-e44a-4dde-9ed7-030ba9a94777'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:58.709541 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-37c481f4-e44a-4dde-9ed7-030ba9a94777 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0582724f730b425cbe166533699aa291', 'request_id': 'req-37c481f4-e44a-4dde-9ed7-030ba9a94777'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:58.722495 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-37c481f4-e44a-4dde-9ed7-030ba9a94777 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0582724f730b425cbe166533699aa291', 'request_id': 'req-37c481f4-e44a-4dde-9ed7-030ba9a94777'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:58.807263 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-37c481f4-e44a-4dde-9ed7-030ba9a94777 admin admin] The token cache is being invalidate because project 0582724f730b425cbe166533699aa291 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:13:58.808504 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-37c481f4-e44a-4dde-9ed7-030ba9a94777 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:58.808504 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-37c481f4-e44a-4dde-9ed7-030ba9a94777 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:13:58.810265 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1346/2726] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:13:58 2022] DELETE /identity/v3/projects/0582724f730b425cbe166533699aa291 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:13:58.816289 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8cde3-71e0-4949-a981-e54c98d73979 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:58.817625 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8cde3-71e0-4949-a981-e54c98d73979 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:58.818156 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8cde3-71e0-4949-a981-e54c98d73979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:58.855341 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-ade8cde3-71e0-4949-a981-e54c98d73979 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:58.856950 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ade8cde3-71e0-4949-a981-e54c98d73979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:58.948021 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1381/2727] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:13:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:13:58.957145 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ceb27-729b-4dd3-bd30-ef16d4fe78f1 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:58.957145 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ceb27-729b-4dd3-bd30-ef16d4fe78f1 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:58.957145 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ceb27-729b-4dd3-bd30-ef16d4fe78f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:59.045250 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-5e3ceb27-729b-4dd3-bd30-ef16d4fe78f1 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:59.045250 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-5e3ceb27-729b-4dd3-bd30-ef16d4fe78f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:59.045250 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1347/2728] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:13:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:13:59.048110 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade8cde3-71e0-4949-a981-e54c98d73979 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:59.059265 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade8cde3-71e0-4949-a981-e54c98d73979 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:59.074325 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7f5527-4669-4a4d-8dc4-d4d8e8cc36a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:59.078171 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f5527-4669-4a4d-8dc4-d4d8e8cc36a9 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:59.078651 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f5527-4669-4a4d-8dc4-d4d8e8cc36a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:59.079413 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f5527-4669-4a4d-8dc4-d4d8e8cc36a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:59.080416 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7f5527-4669-4a4d-8dc4-d4d8e8cc36a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:13:59.080952 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7f5527-4669-4a4d-8dc4-d4d8e8cc36a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:59.082764 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7f5527-4669-4a4d-8dc4-d4d8e8cc36a9 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:59.103116 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1382/2729] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:13:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:13:59.108264 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3ceb27-729b-4dd3-bd30-ef16d4fe78f1 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:59.124835 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3ceb27-729b-4dd3-bd30-ef16d4fe78f1 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:59.145171 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5610014f-b057-4c26-8c9b-e5d47a6f729c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:59.183112 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610014f-b057-4c26-8c9b-e5d47a6f729c admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:59.183112 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610014f-b057-4c26-8c9b-e5d47a6f729c admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:59.183112 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610014f-b057-4c26-8c9b-e5d47a6f729c admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:59.183112 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5610014f-b057-4c26-8c9b-e5d47a6f729c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:59.183112 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5610014f-b057-4c26-8c9b-e5d47a6f729c admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:59.463536 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7f5527-4669-4a4d-8dc4-d4d8e8cc36a9 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:59.464677 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1348/2730] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:13:59 2022] POST /identity/v3/projects => generated 375 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:13:59.477186 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7f5527-4669-4a4d-8dc4-d4d8e8cc36a9 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:59.611634 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e37b5d4-f951-4eb2-b447-c06e435aaccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:59.613179 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e37b5d4-f951-4eb2-b447-c06e435aaccd admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:59.613468 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e37b5d4-f951-4eb2-b447-c06e435aaccd admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:59.613750 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e37b5d4-f951-4eb2-b447-c06e435aaccd admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:59.614457 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e37b5d4-f951-4eb2-b447-c06e435aaccd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:59.616905 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e37b5d4-f951-4eb2-b447-c06e435aaccd admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:59.732811 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1383/2731] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:13:59 2022] POST /identity/v3/users => generated 288 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:13:59.733951 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5610014f-b057-4c26-8c9b-e5d47a6f729c admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:59.748171 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91c584-fd66-47c7-b3ef-817d59e1cddf None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:59.748741 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91c584-fd66-47c7-b3ef-817d59e1cddf None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:59.749095 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91c584-fd66-47c7-b3ef-817d59e1cddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:59.753715 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5610014f-b057-4c26-8c9b-e5d47a6f729c admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:59.761312 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675da9b8-e52b-4f7c-8fc3-0486cbe08af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:59.762087 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675da9b8-e52b-4f7c-8fc3-0486cbe08af1 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:59.762955 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675da9b8-e52b-4f7c-8fc3-0486cbe08af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:59.763299 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675da9b8-e52b-4f7c-8fc3-0486cbe08af1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:59.764141 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675da9b8-e52b-4f7c-8fc3-0486cbe08af1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:59.766819 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675da9b8-e52b-4f7c-8fc3-0486cbe08af1 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:59.771151 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-5a91c584-fd66-47c7-b3ef-817d59e1cddf None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:13:59.772549 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-5a91c584-fd66-47c7-b3ef-817d59e1cddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:59.783986 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1349/2732] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:13:59 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:13:59.789194 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675da9b8-e52b-4f7c-8fc3-0486cbe08af1 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:59.802773 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675da9b8-e52b-4f7c-8fc3-0486cbe08af1 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:59.809648 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c6ba44-0f59-49fb-86aa-684c1eeb56cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:59.810677 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6ba44-0f59-49fb-86aa-684c1eeb56cd admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:59.811182 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6ba44-0f59-49fb-86aa-684c1eeb56cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:59.812415 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6ba44-0f59-49fb-86aa-684c1eeb56cd admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:59.813558 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c6ba44-0f59-49fb-86aa-684c1eeb56cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:59.815670 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c6ba44-0f59-49fb-86aa-684c1eeb56cd admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:59.848757 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1350/2733] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:13:59 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:13:59.860326 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c6ba44-0f59-49fb-86aa-684c1eeb56cd admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:59.860642 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1384/2734] 10.222.0.52 () {58 vars in 1009 bytes} [Sat May 14 21:13:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:13:59.878744 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c6ba44-0f59-49fb-86aa-684c1eeb56cd admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:59.878944 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a91c584-fd66-47c7-b3ef-817d59e1cddf None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:13:59.880646 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-5a91c584-fd66-47c7-b3ef-817d59e1cddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:13:59.890709 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79086439-2b2d-4ed5-8430-2beb17bf0e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:59.891926 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79086439-2b2d-4ed5-8430-2beb17bf0e3c admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:59.892557 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79086439-2b2d-4ed5-8430-2beb17bf0e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:59.893024 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79086439-2b2d-4ed5-8430-2beb17bf0e3c admin admin] PATH_INFO: `/v3/projects/873c930e94574326a2aa94a76fda4f0d/users/3a998f4a4cc94a63ac7e939ffdb10917/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:59.916623 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79086439-2b2d-4ed5-8430-2beb17bf0e3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=873c930e94574326a2aa94a76fda4f0d, user_id=3a998f4a4cc94a63ac7e939ffdb10917, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:59.920442 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79086439-2b2d-4ed5-8430-2beb17bf0e3c admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:13:59.976059 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a91c584-fd66-47c7-b3ef-817d59e1cddf None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:13:59.982455 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca8d75e-bfc1-4664-abdd-f94c998493a0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:13:59.983287 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8d75e-bfc1-4664-abdd-f94c998493a0 service swift] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:13:59.983749 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8d75e-bfc1-4664-abdd-f94c998493a0 service swift] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:13:59.984205 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8d75e-bfc1-4664-abdd-f94c998493a0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:13:59.993500 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca8d75e-bfc1-4664-abdd-f94c998493a0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:13:59.995397 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca8d75e-bfc1-4664-abdd-f94c998493a0 service swift] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:14:00.018905 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1385/2735] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 21:13:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 14 21:14:00.020906 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1351/2736] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:13:59 2022] PUT /identity/v3/projects/873c930e94574326a2aa94a76fda4f0d/users/3a998f4a4cc94a63ac7e939ffdb10917/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:14:00.033597 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc4660-ef15-4441-8fe3-f7ac2c1ba2dd None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:00.034500 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc4660-ef15-4441-8fe3-f7ac2c1ba2dd None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:00.034500 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc4660-ef15-4441-8fe3-f7ac2c1ba2dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:00.064928 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-36dc4660-ef15-4441-8fe3-f7ac2c1ba2dd None None] MFA Rules not processed for user `3a998f4a4cc94a63ac7e939ffdb10917`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:14:00.066141 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-36dc4660-ef15-4441-8fe3-f7ac2c1ba2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:14:00.157666 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1386/2737] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:14:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:14:00.163172 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79086439-2b2d-4ed5-8430-2beb17bf0e3c admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:14:00.254486 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79086439-2b2d-4ed5-8430-2beb17bf0e3c admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:14:00.264762 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38832568-ab8d-4a43-8059-b4235c480177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:14:00.266223 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38832568-ab8d-4a43-8059-b4235c480177 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:00.266223 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38832568-ab8d-4a43-8059-b4235c480177 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:00.266223 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38832568-ab8d-4a43-8059-b4235c480177 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:00.267081 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38832568-ab8d-4a43-8059-b4235c480177 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:14:00.269469 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38832568-ab8d-4a43-8059-b4235c480177 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:14:00.419820 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1352/2738] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:14:00 2022] POST /identity/v3/projects => generated 377 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:14:00.422697 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dc4660-ef15-4441-8fe3-f7ac2c1ba2dd None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:14:00.454782 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dc4660-ef15-4441-8fe3-f7ac2c1ba2dd None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:14:00.583816 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6d5e5-912f-4ca7-909a-b880794e5ee0 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:00.584400 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6d5e5-912f-4ca7-909a-b880794e5ee0 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:00.584400 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6d5e5-912f-4ca7-909a-b880794e5ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:00.604262 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-e7e6d5e5-912f-4ca7-909a-b880794e5ee0 None None] MFA Rules not processed for user `dd53fb02767e4912bd762fa7d1e80a06`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:14:00.605559 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e7e6d5e5-912f-4ca7-909a-b880794e5ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:14:00.607125 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ab669-c292-4782-a78a-ec6f28a10bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:14:00.608153 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ab669-c292-4782-a78a-ec6f28a10bc1 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:00.608618 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ab669-c292-4782-a78a-ec6f28a10bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:00.609224 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ab669-c292-4782-a78a-ec6f28a10bc1 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:00.611383 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4ab669-c292-4782-a78a-ec6f28a10bc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:14:00.614373 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4ab669-c292-4782-a78a-ec6f28a10bc1 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:14:00.669913 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1353/2739] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:14:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:14:00.741337 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1387/2740] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:14:00 2022] POST /identity/v3/users => generated 295 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:14:00.745350 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e6d5e5-912f-4ca7-909a-b880794e5ee0 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:14:00.775768 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e6d5e5-912f-4ca7-909a-b880794e5ee0 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:14:00.792308 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5604839f-3609-4665-bd39-871adc3ba57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:14:00.793866 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604839f-3609-4665-bd39-871adc3ba57c admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:00.794136 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604839f-3609-4665-bd39-871adc3ba57c admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:00.794955 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604839f-3609-4665-bd39-871adc3ba57c admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:00.795920 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5604839f-3609-4665-bd39-871adc3ba57c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:14:00.800540 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5604839f-3609-4665-bd39-871adc3ba57c admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:14:00.822641 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1354/2741] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:14:00 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:14:00.826992 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ab669-c292-4782-a78a-ec6f28a10bc1 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:14:00.837880 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ab669-c292-4782-a78a-ec6f28a10bc1 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:14:00.848636 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c995076-c4ca-4f7d-baa0-ee9443d7e357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:14:00.850003 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c995076-c4ca-4f7d-baa0-ee9443d7e357 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:00.850451 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c995076-c4ca-4f7d-baa0-ee9443d7e357 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:00.850904 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c995076-c4ca-4f7d-baa0-ee9443d7e357 admin admin] PATH_INFO: `/v3/projects/95cb2bc0a93a4b919a2d65a7576e6038/users/92c6db39df0e4e018915d468b790b58b/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:00.869271 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c995076-c4ca-4f7d-baa0-ee9443d7e357 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95cb2bc0a93a4b919a2d65a7576e6038, user_id=92c6db39df0e4e018915d468b790b58b, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:14:00.873696 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c995076-c4ca-4f7d-baa0-ee9443d7e357 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:14:00.970829 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1388/2742] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:14:00 2022] PUT /identity/v3/projects/95cb2bc0a93a4b919a2d65a7576e6038/users/92c6db39df0e4e018915d468b790b58b/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:14:00.974841 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5604839f-3609-4665-bd39-871adc3ba57c admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:14:00.994504 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5604839f-3609-4665-bd39-871adc3ba57c admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:14:01.114690 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9421994-427b-4189-964e-b7cb6b7a0a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:14:01.115795 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9421994-427b-4189-964e-b7cb6b7a0a6e admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:01.116277 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9421994-427b-4189-964e-b7cb6b7a0a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:01.116712 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9421994-427b-4189-964e-b7cb6b7a0a6e admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:01.124164 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9421994-427b-4189-964e-b7cb6b7a0a6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:14:01.130736 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9421994-427b-4189-964e-b7cb6b7a0a6e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:14:01.162069 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1355/2743] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:14:00 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:14:01.165328 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c995076-c4ca-4f7d-baa0-ee9443d7e357 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:14:01.179843 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c995076-c4ca-4f7d-baa0-ee9443d7e357 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:14:01.195273 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea3ba87-7f73-4924-9feb-e397e22c7ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:14:01.196536 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3ba87-7f73-4924-9feb-e397e22c7ac5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:01.196816 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3ba87-7f73-4924-9feb-e397e22c7ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:01.197093 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3ba87-7f73-4924-9feb-e397e22c7ac5 admin admin] PATH_INFO: `/v3/projects/95cb2bc0a93a4b919a2d65a7576e6038/users/92c6db39df0e4e018915d468b790b58b/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:01.199456 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea3ba87-7f73-4924-9feb-e397e22c7ac5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95cb2bc0a93a4b919a2d65a7576e6038, user_id=92c6db39df0e4e018915d468b790b58b, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:14:01.202641 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea3ba87-7f73-4924-9feb-e397e22c7ac5 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:14:01.214769 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1389/2744] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:14:01 2022] PUT /identity/v3/projects/95cb2bc0a93a4b919a2d65a7576e6038/users/92c6db39df0e4e018915d468b790b58b/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:14:01.226070 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ecfdc-e021-4d5c-91c2-a78afd72ee96 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:01.232302 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ecfdc-e021-4d5c-91c2-a78afd72ee96 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:01.232302 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ecfdc-e021-4d5c-91c2-a78afd72ee96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:01.296733 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-7d4ecfdc-e021-4d5c-91c2-a78afd72ee96 None None] MFA Rules not processed for user `92c6db39df0e4e018915d468b790b58b`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:14:01.301002 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-7d4ecfdc-e021-4d5c-91c2-a78afd72ee96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:14:01.400294 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1356/2745] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:14:01 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:14:01.401037 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ad71f-a150-4e01-b8e1-136c52fe5057 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:01.401329 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ad71f-a150-4e01-b8e1-136c52fe5057 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:01.401610 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ad71f-a150-4e01-b8e1-136c52fe5057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:01.428083 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-f40ad71f-a150-4e01-b8e1-136c52fe5057 None None] MFA Rules not processed for user `3a998f4a4cc94a63ac7e939ffdb10917`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:14:01.429884 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-f40ad71f-a150-4e01-b8e1-136c52fe5057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:14:01.513645 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1390/2746] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:14:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:14:01.573907 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed010ee2-ec82-48ed-95f2-9df2e95978c5 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:01.574198 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed010ee2-ec82-48ed-95f2-9df2e95978c5 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:01.574480 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed010ee2-ec82-48ed-95f2-9df2e95978c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:01.595516 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ad71f-a150-4e01-b8e1-136c52fe5057 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:14:01.596939 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-f40ad71f-a150-4e01-b8e1-136c52fe5057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:14:01.613915 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-ed010ee2-ec82-48ed-95f2-9df2e95978c5 None None] MFA Rules not processed for user `66699357d8fd4f3c95d417bafdec8e39`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:14:01.615141 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-ed010ee2-ec82-48ed-95f2-9df2e95978c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:14:01.688496 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1357/2747] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:14:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:14:01.689800 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a06cfc-5e9c-40ef-b99e-367736ee1813 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:01.690086 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a06cfc-5e9c-40ef-b99e-367736ee1813 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:01.690359 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a06cfc-5e9c-40ef-b99e-367736ee1813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:01.696939 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ad71f-a150-4e01-b8e1-136c52fe5057 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:14:01.706156 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5061f3-e2ce-4cd5-bcf6-2fa38aeebec8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:14:01.707309 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5061f3-e2ce-4cd5-bcf6-2fa38aeebec8 service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:01.707309 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5061f3-e2ce-4cd5-bcf6-2fa38aeebec8 service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:01.707611 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5061f3-e2ce-4cd5-bcf6-2fa38aeebec8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:01.709498 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-21a06cfc-5e9c-40ef-b99e-367736ee1813 None None] MFA Rules not processed for user `dd53fb02767e4912bd762fa7d1e80a06`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:14:01.710702 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-21a06cfc-5e9c-40ef-b99e-367736ee1813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:14:01.718953 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5061f3-e2ce-4cd5-bcf6-2fa38aeebec8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:14:01.720857 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5061f3-e2ce-4cd5-bcf6-2fa38aeebec8 service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:14:01.745928 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1391/2748] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:14:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:14:01.811684 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1358/2749] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:14:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:14:01.902730 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5061f3-e2ce-4cd5-bcf6-2fa38aeebec8 service nova] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:14:01.904727 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-eb5061f3-e2ce-4cd5-bcf6-2fa38aeebec8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:14:01.920285 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5061f3-e2ce-4cd5-bcf6-2fa38aeebec8 service nova] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:14:01.928069 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060ed671-eea8-4bc2-b0b5-6b9e06bb87c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:14:01.931155 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ed671-eea8-4bc2-b0b5-6b9e06bb87c5 service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:01.931155 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ed671-eea8-4bc2-b0b5-6b9e06bb87c5 service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:01.931155 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ed671-eea8-4bc2-b0b5-6b9e06bb87c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:01.942509 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060ed671-eea8-4bc2-b0b5-6b9e06bb87c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:14:01.944494 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060ed671-eea8-4bc2-b0b5-6b9e06bb87c5 service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:14:01.954729 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1392/2750] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:14:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:14:02.248017 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2278d22-97d8-4b4c-859e-e419bfb7ac12 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:02.251688 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2278d22-97d8-4b4c-859e-e419bfb7ac12 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:02.251688 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2278d22-97d8-4b4c-859e-e419bfb7ac12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:02.307918 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-c2278d22-97d8-4b4c-859e-e419bfb7ac12 None None] MFA Rules not processed for user `3a998f4a4cc94a63ac7e939ffdb10917`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:14:02.320106 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c2278d22-97d8-4b4c-859e-e419bfb7ac12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:14:02.338802 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1359/2751] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:14:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:14:05.233659 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060ed671-eea8-4bc2-b0b5-6b9e06bb87c5 service nova] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:14:05.246576 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060ed671-eea8-4bc2-b0b5-6b9e06bb87c5 service nova] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:14:05.253357 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50edfaa8-6587-4c05-af28-dc01dfb40f22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:14:05.254317 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50edfaa8-6587-4c05-af28-dc01dfb40f22 service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:05.254861 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50edfaa8-6587-4c05-af28-dc01dfb40f22 service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:05.255296 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50edfaa8-6587-4c05-af28-dc01dfb40f22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:05.257601 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-50edfaa8-6587-4c05-af28-dc01dfb40f22 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:14:05.382415 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50edfaa8-6587-4c05-af28-dc01dfb40f22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:14:05.384337 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50edfaa8-6587-4c05-af28-dc01dfb40f22 service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:14:05.397393 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1393/2752] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:14:05 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:14:08.146611 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1244cd89-c946-495d-9cf8-ebd1453f07aa None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:08.147207 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1244cd89-c946-495d-9cf8-ebd1453f07aa None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:08.147330 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1244cd89-c946-495d-9cf8-ebd1453f07aa None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:08.149580 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1360/2753] 10.222.0.52 () {54 vars in 921 bytes} [Sat May 14 21:14:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:14:08.156552 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e96af-922b-4a1d-b314-a4016d843602 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:08.157602 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e96af-922b-4a1d-b314-a4016d843602 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:08.158093 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e96af-922b-4a1d-b314-a4016d843602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:08.189580 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-152e96af-922b-4a1d-b314-a4016d843602 None None] MFA Rules not processed for user `0812ae67e44d483baf2dbb1a5332a1d7`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:14:08.191299 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-152e96af-922b-4a1d-b314-a4016d843602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:14:08.285029 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1394/2754] 10.222.0.52 () {58 vars in 1018 bytes} [Sat May 14 21:14:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:14:08.308083 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1244cd89-c946-495d-9cf8-ebd1453f07aa None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:14:08.311538 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-1244cd89-c946-495d-9cf8-ebd1453f07aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:14:08.335018 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1244cd89-c946-495d-9cf8-ebd1453f07aa None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:14:08.341634 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca02ce3-a480-4e82-aefc-1d77379bb3dc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:14:08.342296 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca02ce3-a480-4e82-aefc-1d77379bb3dc service placement] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:08.342580 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca02ce3-a480-4e82-aefc-1d77379bb3dc service placement] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:08.342858 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca02ce3-a480-4e82-aefc-1d77379bb3dc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:08.352622 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca02ce3-a480-4e82-aefc-1d77379bb3dc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:14:08.354286 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca02ce3-a480-4e82-aefc-1d77379bb3dc service placement] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:14:08.366586 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1361/2755] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:14:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:14:08.750989 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e96af-922b-4a1d-b314-a4016d843602 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:14:08.771430 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e96af-922b-4a1d-b314-a4016d843602 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:14:08.787077 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea020ff-c19c-4941-b3c8-48f1bf7a7642 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:14:08.789317 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea020ff-c19c-4941-b3c8-48f1bf7a7642 service placement] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:08.790028 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea020ff-c19c-4941-b3c8-48f1bf7a7642 service placement] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:08.793828 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea020ff-c19c-4941-b3c8-48f1bf7a7642 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:08.801607 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-6ea020ff-c19c-4941-b3c8-48f1bf7a7642 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:14:08.827031 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea020ff-c19c-4941-b3c8-48f1bf7a7642 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:14:08.828699 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea020ff-c19c-4941-b3c8-48f1bf7a7642 service placement] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:14:08.843709 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1395/2756] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:14:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:14:10.811147 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf90aed3-0668-4328-98a3-44649a189752 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:10.814989 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf90aed3-0668-4328-98a3-44649a189752 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:10.814989 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf90aed3-0668-4328-98a3-44649a189752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:10.837464 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-bf90aed3-0668-4328-98a3-44649a189752 None None] MFA Rules not processed for user `0f1b0e2b025d4eceaa90e1616d0a9db8`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:14:10.839036 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-bf90aed3-0668-4328-98a3-44649a189752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:14:10.851598 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1362/2757] 10.222.0.52 () {58 vars in 1018 bytes} [Sat May 14 21:14:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:14:10.869079 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea020ff-c19c-4941-b3c8-48f1bf7a7642 service placement] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:14:10.870467 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-6ea020ff-c19c-4941-b3c8-48f1bf7a7642 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:14:10.955468 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea020ff-c19c-4941-b3c8-48f1bf7a7642 service placement] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:14:10.961431 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e9dc97-c6e8-40a8-acb0-8fe36a7441b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:14:10.962306 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e9dc97-c6e8-40a8-acb0-8fe36a7441b0 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:10.962733 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e9dc97-c6e8-40a8-acb0-8fe36a7441b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:10.963219 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e9dc97-c6e8-40a8-acb0-8fe36a7441b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:10.983001 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e9dc97-c6e8-40a8-acb0-8fe36a7441b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:14:10.985646 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e9dc97-c6e8-40a8-acb0-8fe36a7441b0 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:14:11.001065 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1396/2758] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:14:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:14:13.655064 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf90aed3-0668-4328-98a3-44649a189752 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:14:13.673688 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf90aed3-0668-4328-98a3-44649a189752 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:14:13.681062 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e327b1c-af88-46a1-b9af-219be9b39296 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:14:13.682329 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e327b1c-af88-46a1-b9af-219be9b39296 service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:13.683520 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e327b1c-af88-46a1-b9af-219be9b39296 service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:13.683960 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e327b1c-af88-46a1-b9af-219be9b39296 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:13.688627 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-6e327b1c-af88-46a1-b9af-219be9b39296 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:14:13.812945 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e327b1c-af88-46a1-b9af-219be9b39296 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:14:13.814633 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e327b1c-af88-46a1-b9af-219be9b39296 service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:14:13.830061 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1363/2759] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:14:13 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:14:13.862747 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66006a96-46d1-4091-9d67-15f2ca531910 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:13.862747 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66006a96-46d1-4091-9d67-15f2ca531910 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:13.862747 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66006a96-46d1-4091-9d67-15f2ca531910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:13.907243 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-66006a96-46d1-4091-9d67-15f2ca531910 None None] MFA Rules not processed for user `32240804909d4572880a0f419f49f61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:14:13.909032 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-66006a96-46d1-4091-9d67-15f2ca531910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:14:14.008679 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1397/2760] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:14:13 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:14:16.811699 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e74b93-4cb2-42bf-b754-95bb8b39d957 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:16.812576 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e74b93-4cb2-42bf-b754-95bb8b39d957 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:16.813011 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e74b93-4cb2-42bf-b754-95bb8b39d957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:16.850261 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-01e74b93-4cb2-42bf-b754-95bb8b39d957 None None] MFA Rules not processed for user `911b9cf4e9bc424bba387e2ff966cb46`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:14:16.852452 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-01e74b93-4cb2-42bf-b754-95bb8b39d957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:14:16.976016 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1364/2761] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:14:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:14:17.867980 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66006a96-46d1-4091-9d67-15f2ca531910 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:14:17.910364 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66006a96-46d1-4091-9d67-15f2ca531910 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:14:17.925664 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725205ae-bd46-471c-bef3-f90e504864af service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:14:17.926486 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725205ae-bd46-471c-bef3-f90e504864af service placement] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:17.926865 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725205ae-bd46-471c-bef3-f90e504864af service placement] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:17.927736 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725205ae-bd46-471c-bef3-f90e504864af service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:17.933450 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-725205ae-bd46-471c-bef3-f90e504864af service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:14:17.989412 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725205ae-bd46-471c-bef3-f90e504864af service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:14:17.996903 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725205ae-bd46-471c-bef3-f90e504864af service placement] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:14:18.022684 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1398/2762] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:14:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:14:18.430005 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e74b93-4cb2-42bf-b754-95bb8b39d957 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:14:18.431533 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-01e74b93-4cb2-42bf-b754-95bb8b39d957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:14:18.460863 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e74b93-4cb2-42bf-b754-95bb8b39d957 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:14:18.477404 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b356264-fb32-4719-8080-b65deb87fc71 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:14:18.478453 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b356264-fb32-4719-8080-b65deb87fc71 service placement] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:18.479007 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b356264-fb32-4719-8080-b65deb87fc71 service placement] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:18.479393 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b356264-fb32-4719-8080-b65deb87fc71 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:18.486470 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-7b356264-fb32-4719-8080-b65deb87fc71 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:14:18.513471 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b356264-fb32-4719-8080-b65deb87fc71 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:14:18.520207 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b356264-fb32-4719-8080-b65deb87fc71 service placement] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:14:18.541613 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725205ae-bd46-471c-bef3-f90e504864af service placement] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:14:18.555344 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1365/2763] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:14:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:14:18.578493 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725205ae-bd46-471c-bef3-f90e504864af service placement] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:14:18.594820 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d4a166-b01a-4a4e-845b-38322cef259c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:14:18.595898 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d4a166-b01a-4a4e-845b-38322cef259c service placement] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:18.596186 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d4a166-b01a-4a4e-845b-38322cef259c service placement] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:18.596461 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d4a166-b01a-4a4e-845b-38322cef259c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:18.628573 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d4a166-b01a-4a4e-845b-38322cef259c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:14:18.630692 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d4a166-b01a-4a4e-845b-38322cef259c service placement] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:14:18.649375 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1399/2764] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:14:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:14:24.496274 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b356264-fb32-4719-8080-b65deb87fc71 service placement] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:14:24.497729 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-7b356264-fb32-4719-8080-b65deb87fc71 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:14:24.586021 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b356264-fb32-4719-8080-b65deb87fc71 service placement] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:14:24.601292 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbc03a1-519c-4291-ae6f-43fa256ff6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:14:24.602511 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc03a1-519c-4291-ae6f-43fa256ff6ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:24.603054 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc03a1-519c-4291-ae6f-43fa256ff6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:24.603544 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc03a1-519c-4291-ae6f-43fa256ff6ca admin admin] PATH_INFO: `/v3/users/66699357d8fd4f3c95d417bafdec8e39` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:24.605045 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbc03a1-519c-4291-ae6f-43fa256ff6ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=66699357d8fd4f3c95d417bafdec8e39)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:14:24.607382 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbc03a1-519c-4291-ae6f-43fa256ff6ca admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:14:24.830105 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3cbc03a1-519c-4291-ae6f-43fa256ff6ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66699357d8fd4f3c95d417bafdec8e39'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:14:24.845860 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3cbc03a1-519c-4291-ae6f-43fa256ff6ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66699357d8fd4f3c95d417bafdec8e39'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:14:24.846760 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3cbc03a1-519c-4291-ae6f-43fa256ff6ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66699357d8fd4f3c95d417bafdec8e39'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:14:24.979436 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3cbc03a1-519c-4291-ae6f-43fa256ff6ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66699357d8fd4f3c95d417bafdec8e39'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:14:25.030628 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3cbc03a1-519c-4291-ae6f-43fa256ff6ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66699357d8fd4f3c95d417bafdec8e39'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:14:25.066719 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1366/2765] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:14:24 2022] DELETE /identity/v3/users/66699357d8fd4f3c95d417bafdec8e39 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:14:25.513797 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d4a166-b01a-4a4e-845b-38322cef259c service placement] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:14:25.528317 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d4a166-b01a-4a4e-845b-38322cef259c service placement] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:14:25.653081 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0ebf76-d47d-4800-b842-1770973d3340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:14:25.654276 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ebf76-d47d-4800-b842-1770973d3340 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:25.654740 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ebf76-d47d-4800-b842-1770973d3340 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:25.655169 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ebf76-d47d-4800-b842-1770973d3340 admin admin] PATH_INFO: `/v3/projects/c2856369dca645e88c940652f218dc3b` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:25.666894 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0ebf76-d47d-4800-b842-1770973d3340 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2856369dca645e88c940652f218dc3b)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:14:25.674775 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0ebf76-d47d-4800-b842-1770973d3340 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:14:25.872486 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-4d0ebf76-d47d-4800-b842-1770973d3340 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2856369dca645e88c940652f218dc3b', 'request_id': 'req-4d0ebf76-d47d-4800-b842-1770973d3340'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:14:25.886033 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-4d0ebf76-d47d-4800-b842-1770973d3340 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2856369dca645e88c940652f218dc3b', 'request_id': 'req-4d0ebf76-d47d-4800-b842-1770973d3340'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:14:26.011919 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-4d0ebf76-d47d-4800-b842-1770973d3340 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2856369dca645e88c940652f218dc3b', 'request_id': 'req-4d0ebf76-d47d-4800-b842-1770973d3340'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:14:26.029918 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-4d0ebf76-d47d-4800-b842-1770973d3340 admin admin] The token cache is being invalidate because project c2856369dca645e88c940652f218dc3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:14:26.033030 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-4d0ebf76-d47d-4800-b842-1770973d3340 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:14:26.037061 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-4d0ebf76-d47d-4800-b842-1770973d3340 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:14:26.043261 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1400/2766] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:14:25 2022] DELETE /identity/v3/projects/c2856369dca645e88c940652f218dc3b => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:14:26.054692 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb768b37-b33a-4e4a-95d3-00b5801a3daf None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:26.054692 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb768b37-b33a-4e4a-95d3-00b5801a3daf None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:26.054692 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb768b37-b33a-4e4a-95d3-00b5801a3daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:26.098663 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-eb768b37-b33a-4e4a-95d3-00b5801a3daf None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:14:26.100813 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-eb768b37-b33a-4e4a-95d3-00b5801a3daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:14:26.203549 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1367/2767] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:14:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:14:26.211142 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7dfa63-f020-4fa3-b3e5-57923c13c87a None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:26.211429 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7dfa63-f020-4fa3-b3e5-57923c13c87a None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:26.211932 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7dfa63-f020-4fa3-b3e5-57923c13c87a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:26.232446 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-1d7dfa63-f020-4fa3-b3e5-57923c13c87a None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:14:26.233747 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-1d7dfa63-f020-4fa3-b3e5-57923c13c87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:14:26.241981 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1401/2768] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:14:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:14:26.246503 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb768b37-b33a-4e4a-95d3-00b5801a3daf None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:14:26.256330 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb768b37-b33a-4e4a-95d3-00b5801a3daf None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:14:26.262477 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c4a25f-78ab-4446-a559-608614382b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:14:26.263142 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4a25f-78ab-4446-a559-608614382b5d admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:26.263620 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4a25f-78ab-4446-a559-608614382b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:26.264068 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4a25f-78ab-4446-a559-608614382b5d admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:26.265029 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c4a25f-78ab-4446-a559-608614382b5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:14:26.265578 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c4a25f-78ab-4446-a559-608614382b5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:14:26.267350 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c4a25f-78ab-4446-a559-608614382b5d admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:14:26.283758 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1368/2769] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:14:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:14:26.284946 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7dfa63-f020-4fa3-b3e5-57923c13c87a None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:14:26.294170 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7dfa63-f020-4fa3-b3e5-57923c13c87a None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:14:26.300139 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ddcf0f-38cf-4e25-a810-59018cbb4e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:14:26.300798 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ddcf0f-38cf-4e25-a810-59018cbb4e93 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:26.301368 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ddcf0f-38cf-4e25-a810-59018cbb4e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:26.301905 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ddcf0f-38cf-4e25-a810-59018cbb4e93 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:26.302897 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ddcf0f-38cf-4e25-a810-59018cbb4e93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:14:26.315913 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ddcf0f-38cf-4e25-a810-59018cbb4e93 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:14:26.327121 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f2ba8-02dd-4474-b2df-b1f9eaa2f020 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:26.328626 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f2ba8-02dd-4474-b2df-b1f9eaa2f020 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:26.329117 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f2ba8-02dd-4474-b2df-b1f9eaa2f020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:26.353508 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-d76f2ba8-02dd-4474-b2df-b1f9eaa2f020 None None] MFA Rules not processed for user `3a998f4a4cc94a63ac7e939ffdb10917`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:14:26.356154 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-d76f2ba8-02dd-4474-b2df-b1f9eaa2f020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:14:26.427634 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1369/2770] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:14:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:14:26.467458 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1402/2771] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:14:26 2022] POST /identity/v3/projects => generated 381 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:14:26.467928 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76f2ba8-02dd-4474-b2df-b1f9eaa2f020 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:14:26.480772 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76f2ba8-02dd-4474-b2df-b1f9eaa2f020 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:14:26.547533 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df472480-1b55-49ca-93d0-a83813bb4c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:14:26.548370 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df472480-1b55-49ca-93d0-a83813bb4c9b admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:26.548666 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df472480-1b55-49ca-93d0-a83813bb4c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:26.548978 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df472480-1b55-49ca-93d0-a83813bb4c9b admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:26.549826 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df472480-1b55-49ca-93d0-a83813bb4c9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:14:26.551994 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df472480-1b55-49ca-93d0-a83813bb4c9b admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:14:26.678521 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1370/2772] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:14:26 2022] POST /identity/v3/users => generated 291 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:14:26.682858 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ddcf0f-38cf-4e25-a810-59018cbb4e93 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:14:26.697555 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ddcf0f-38cf-4e25-a810-59018cbb4e93 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:14:26.703991 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1b91d9-1a5b-4eea-b1ec-4134f340d52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:14:26.705627 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b91d9-1a5b-4eea-b1ec-4134f340d52e admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:26.706120 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b91d9-1a5b-4eea-b1ec-4134f340d52e admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:26.706676 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b91d9-1a5b-4eea-b1ec-4134f340d52e admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:26.707364 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1b91d9-1a5b-4eea-b1ec-4134f340d52e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:14:26.709046 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1b91d9-1a5b-4eea-b1ec-4134f340d52e admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:14:26.733089 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1403/2773] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:14:26 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:14:26.737016 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df472480-1b55-49ca-93d0-a83813bb4c9b admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:14:26.752611 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df472480-1b55-49ca-93d0-a83813bb4c9b admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:14:26.760189 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a30033f-8449-42b2-9f4b-3971e297cb29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:14:26.761080 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a30033f-8449-42b2-9f4b-3971e297cb29 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:26.762019 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a30033f-8449-42b2-9f4b-3971e297cb29 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:26.764771 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a30033f-8449-42b2-9f4b-3971e297cb29 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:26.764771 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a30033f-8449-42b2-9f4b-3971e297cb29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:14:26.765561 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a30033f-8449-42b2-9f4b-3971e297cb29 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:14:26.782368 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1371/2774] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:14:26 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:14:26.783278 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1b91d9-1a5b-4eea-b1ec-4134f340d52e admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:14:26.794948 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1b91d9-1a5b-4eea-b1ec-4134f340d52e admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:14:26.800300 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d0f04-2e36-4bf7-a3bf-71436d242b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:14:26.801445 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d0f04-2e36-4bf7-a3bf-71436d242b2d admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:26.801899 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d0f04-2e36-4bf7-a3bf-71436d242b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:26.802331 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d0f04-2e36-4bf7-a3bf-71436d242b2d admin admin] PATH_INFO: `/v3/projects/5c422d08f9df4a1eb5f3a3476f83db55/users/73c669f55bbc46cdad7770a07f28d9d2/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:26.821728 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1d0f04-2e36-4bf7-a3bf-71436d242b2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c422d08f9df4a1eb5f3a3476f83db55, user_id=73c669f55bbc46cdad7770a07f28d9d2, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:14:26.825368 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1d0f04-2e36-4bf7-a3bf-71436d242b2d admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:14:26.905109 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1404/2775] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:14:26 2022] PUT /identity/v3/projects/5c422d08f9df4a1eb5f3a3476f83db55/users/73c669f55bbc46cdad7770a07f28d9d2/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:14:26.934310 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e0982-6235-4145-b62b-db5f73050d4d None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:26.934310 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e0982-6235-4145-b62b-db5f73050d4d None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:26.934310 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e0982-6235-4145-b62b-db5f73050d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:26.992961 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-934e0982-6235-4145-b62b-db5f73050d4d None None] MFA Rules not processed for user `73c669f55bbc46cdad7770a07f28d9d2`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:14:26.994302 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-934e0982-6235-4145-b62b-db5f73050d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:14:27.157616 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1372/2776] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:14:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:14:27.169934 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49778244-b369-4504-908b-509860bdd8b3 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:27.170465 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49778244-b369-4504-908b-509860bdd8b3 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:27.170926 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49778244-b369-4504-908b-509860bdd8b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:27.214109 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-49778244-b369-4504-908b-509860bdd8b3 None None] MFA Rules not processed for user `73c669f55bbc46cdad7770a07f28d9d2`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:14:27.216540 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-49778244-b369-4504-908b-509860bdd8b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:14:27.240454 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1405/2777] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:14:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:14:27.550508 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e0982-6235-4145-b62b-db5f73050d4d None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:14:27.550961 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-934e0982-6235-4145-b62b-db5f73050d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:14:27.776982 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e0982-6235-4145-b62b-db5f73050d4d None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:14:27.796993 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3184e370-df12-4e12-9d23-7ac2ef239413 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:14:27.797790 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3184e370-df12-4e12-9d23-7ac2ef239413 service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:27.798608 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3184e370-df12-4e12-9d23-7ac2ef239413 service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:27.798965 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3184e370-df12-4e12-9d23-7ac2ef239413 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:27.820841 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3184e370-df12-4e12-9d23-7ac2ef239413 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:14:27.822656 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3184e370-df12-4e12-9d23-7ac2ef239413 service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:14:27.848706 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1373/2778] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:14:27 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:14:29.526045 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ac116-75f8-4caa-947d-545167cdf2f4 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:29.526591 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ac116-75f8-4caa-947d-545167cdf2f4 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:29.526591 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ac116-75f8-4caa-947d-545167cdf2f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:29.554791 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-b44ac116-75f8-4caa-947d-545167cdf2f4 None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:14:29.554791 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b44ac116-75f8-4caa-947d-545167cdf2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:14:29.701794 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1406/2779] 10.222.0.52 () {58 vars in 1009 bytes} [Sat May 14 21:14:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:14:29.723081 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3184e370-df12-4e12-9d23-7ac2ef239413 service nova] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:14:29.725046 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-3184e370-df12-4e12-9d23-7ac2ef239413 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:14:29.824816 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3184e370-df12-4e12-9d23-7ac2ef239413 service nova] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:14:29.830602 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44556eb2-648a-46a6-a926-5388ff369218 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:14:29.831265 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44556eb2-648a-46a6-a926-5388ff369218 service swift] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:29.831994 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44556eb2-648a-46a6-a926-5388ff369218 service swift] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:29.831994 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44556eb2-648a-46a6-a926-5388ff369218 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:29.843826 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44556eb2-648a-46a6-a926-5388ff369218 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:14:29.845609 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44556eb2-648a-46a6-a926-5388ff369218 service swift] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:14:29.854979 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1374/2780] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 21:14:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 21:14:32.061218 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929bd612-5dce-475e-9cdb-2919df4f324c None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:32.062192 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929bd612-5dce-475e-9cdb-2919df4f324c None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:32.062636 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929bd612-5dce-475e-9cdb-2919df4f324c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:32.106434 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-929bd612-5dce-475e-9cdb-2919df4f324c None None] MFA Rules not processed for user `5b93d6c3d03d407f8be4aa38e2fbb154`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:14:32.108153 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-929bd612-5dce-475e-9cdb-2919df4f324c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:14:32.319355 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1407/2781] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:14:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:14:41.771295 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f0b36-f580-40d5-9bed-e827821c5481 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:41.772358 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f0b36-f580-40d5-9bed-e827821c5481 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:41.772797 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f0b36-f580-40d5-9bed-e827821c5481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:41.803268 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-000f0b36-f580-40d5-9bed-e827821c5481 None None] MFA Rules not processed for user `038739f45c3d4ab09457d6eed20b41d4`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:14:41.804789 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-000f0b36-f580-40d5-9bed-e827821c5481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:14:41.893324 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1375/2782] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:14:41 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:14:43.497968 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929bd612-5dce-475e-9cdb-2919df4f324c None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:14:43.500304 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-929bd612-5dce-475e-9cdb-2919df4f324c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:14:43.608617 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929bd612-5dce-475e-9cdb-2919df4f324c None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:14:43.613837 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4a0173-1fdc-482b-a96b-63b4a61bc1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:14:43.614853 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a0173-1fdc-482b-a96b-63b4a61bc1af admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:43.615146 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a0173-1fdc-482b-a96b-63b4a61bc1af admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:43.615431 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a0173-1fdc-482b-a96b-63b4a61bc1af admin admin] PATH_INFO: `/v3/users/36c32d3de24045bdbfce30559ea022e7` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:43.620116 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4a0173-1fdc-482b-a96b-63b4a61bc1af admin admin] RBAC: Authorizing `identity:delete_user(user_id=36c32d3de24045bdbfce30559ea022e7)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:14:43.620532 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4a0173-1fdc-482b-a96b-63b4a61bc1af admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:14:43.826320 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0f4a0173-1fdc-482b-a96b-63b4a61bc1af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36c32d3de24045bdbfce30559ea022e7'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:14:43.878829 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0f4a0173-1fdc-482b-a96b-63b4a61bc1af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36c32d3de24045bdbfce30559ea022e7'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:14:43.921997 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0f4a0173-1fdc-482b-a96b-63b4a61bc1af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36c32d3de24045bdbfce30559ea022e7'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:14:44.102684 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0f4a0173-1fdc-482b-a96b-63b4a61bc1af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36c32d3de24045bdbfce30559ea022e7'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:14:44.103470 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0f4a0173-1fdc-482b-a96b-63b4a61bc1af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36c32d3de24045bdbfce30559ea022e7'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:14:44.129676 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1408/2783] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:14:43 2022] DELETE /identity/v3/users/36c32d3de24045bdbfce30559ea022e7 => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:14:44.923414 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000f0b36-f580-40d5-9bed-e827821c5481 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:14:44.940314 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000f0b36-f580-40d5-9bed-e827821c5481 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:14:45.113336 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740228cb-0d8a-44a8-8db7-104e5044457f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:14:45.116011 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740228cb-0d8a-44a8-8db7-104e5044457f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:45.116300 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740228cb-0d8a-44a8-8db7-104e5044457f admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:45.116581 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740228cb-0d8a-44a8-8db7-104e5044457f admin admin] PATH_INFO: `/v3/projects/97eb48c86b4d49f1b11b2b6380020f4b` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:45.119149 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740228cb-0d8a-44a8-8db7-104e5044457f admin admin] RBAC: Authorizing `identity:delete_project(project_id=97eb48c86b4d49f1b11b2b6380020f4b)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:14:45.125665 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740228cb-0d8a-44a8-8db7-104e5044457f admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:14:45.367958 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-740228cb-0d8a-44a8-8db7-104e5044457f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97eb48c86b4d49f1b11b2b6380020f4b', 'request_id': 'req-740228cb-0d8a-44a8-8db7-104e5044457f'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:14:45.379695 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-740228cb-0d8a-44a8-8db7-104e5044457f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97eb48c86b4d49f1b11b2b6380020f4b', 'request_id': 'req-740228cb-0d8a-44a8-8db7-104e5044457f'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:14:45.421810 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-740228cb-0d8a-44a8-8db7-104e5044457f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97eb48c86b4d49f1b11b2b6380020f4b', 'request_id': 'req-740228cb-0d8a-44a8-8db7-104e5044457f'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:14:45.538627 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-740228cb-0d8a-44a8-8db7-104e5044457f admin admin] The token cache is being invalidate because project 97eb48c86b4d49f1b11b2b6380020f4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:14:45.539215 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-740228cb-0d8a-44a8-8db7-104e5044457f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:14:45.540080 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-740228cb-0d8a-44a8-8db7-104e5044457f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:14:45.543585 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1376/2784] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:14:44 2022] DELETE /identity/v3/projects/97eb48c86b4d49f1b11b2b6380020f4b => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:14:45.547341 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4a0173-1fdc-482b-a96b-63b4a61bc1af admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:14:45.548989 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-0f4a0173-1fdc-482b-a96b-63b4a61bc1af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:14:45.577649 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4a0173-1fdc-482b-a96b-63b4a61bc1af admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:14:45.687762 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350b89ac-8565-4828-bd83-865b0f0fddde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:14:45.694523 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b89ac-8565-4828-bd83-865b0f0fddde admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:45.696930 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b89ac-8565-4828-bd83-865b0f0fddde admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:45.696930 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b89ac-8565-4828-bd83-865b0f0fddde admin admin] PATH_INFO: `/v3/users/3e7721c1487c423bbdba825f336234bb` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:45.700471 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350b89ac-8565-4828-bd83-865b0f0fddde admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e7721c1487c423bbdba825f336234bb)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:14:45.707850 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350b89ac-8565-4828-bd83-865b0f0fddde admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:14:46.003425 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-350b89ac-8565-4828-bd83-865b0f0fddde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e7721c1487c423bbdba825f336234bb'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:14:46.024180 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-350b89ac-8565-4828-bd83-865b0f0fddde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e7721c1487c423bbdba825f336234bb'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:14:46.034592 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-350b89ac-8565-4828-bd83-865b0f0fddde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e7721c1487c423bbdba825f336234bb'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:14:46.143220 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-350b89ac-8565-4828-bd83-865b0f0fddde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e7721c1487c423bbdba825f336234bb'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:14:46.144334 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-350b89ac-8565-4828-bd83-865b0f0fddde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e7721c1487c423bbdba825f336234bb'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:14:46.155453 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1409/2785] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:14:45 2022] DELETE /identity/v3/users/3e7721c1487c423bbdba825f336234bb => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:14:46.694887 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740228cb-0d8a-44a8-8db7-104e5044457f admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:14:46.696360 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-740228cb-0d8a-44a8-8db7-104e5044457f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:14:46.714031 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740228cb-0d8a-44a8-8db7-104e5044457f admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:14:46.787925 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6407ed8-d2ef-4ef6-acb4-9590768cf698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:14:46.788843 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6407ed8-d2ef-4ef6-acb4-9590768cf698 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:46.789112 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6407ed8-d2ef-4ef6-acb4-9590768cf698 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:46.789383 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6407ed8-d2ef-4ef6-acb4-9590768cf698 admin admin] PATH_INFO: `/v3/projects/899b3d5b2ffd4706b856c765063b8536` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:46.790717 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6407ed8-d2ef-4ef6-acb4-9590768cf698 admin admin] RBAC: Authorizing `identity:delete_project(project_id=899b3d5b2ffd4706b856c765063b8536)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:14:46.793680 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6407ed8-d2ef-4ef6-acb4-9590768cf698 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:14:46.947335 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b6407ed8-d2ef-4ef6-acb4-9590768cf698 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '899b3d5b2ffd4706b856c765063b8536', 'request_id': 'req-b6407ed8-d2ef-4ef6-acb4-9590768cf698'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:14:46.956742 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b6407ed8-d2ef-4ef6-acb4-9590768cf698 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '899b3d5b2ffd4706b856c765063b8536', 'request_id': 'req-b6407ed8-d2ef-4ef6-acb4-9590768cf698'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:14:46.964433 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b6407ed8-d2ef-4ef6-acb4-9590768cf698 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '899b3d5b2ffd4706b856c765063b8536', 'request_id': 'req-b6407ed8-d2ef-4ef6-acb4-9590768cf698'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:14:47.047948 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b6407ed8-d2ef-4ef6-acb4-9590768cf698 admin admin] The token cache is being invalidate because project 899b3d5b2ffd4706b856c765063b8536 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:14:47.048243 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b6407ed8-d2ef-4ef6-acb4-9590768cf698 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:14:47.048932 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b6407ed8-d2ef-4ef6-acb4-9590768cf698 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:14:47.054161 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1377/2786] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:14:46 2022] DELETE /identity/v3/projects/899b3d5b2ffd4706b856c765063b8536 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:14:47.056463 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a03748-0de7-4335-acfc-faa5481df3ba None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:47.057563 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a03748-0de7-4335-acfc-faa5481df3ba None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:47.058074 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a03748-0de7-4335-acfc-faa5481df3ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:47.082250 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-51a03748-0de7-4335-acfc-faa5481df3ba None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:14:47.083671 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-51a03748-0de7-4335-acfc-faa5481df3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:14:47.191916 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1410/2787] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:14:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:14:47.197312 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668bdae0-0481-4c2e-8c1e-f7ecfdba82a2 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:47.202676 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668bdae0-0481-4c2e-8c1e-f7ecfdba82a2 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:47.202676 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668bdae0-0481-4c2e-8c1e-f7ecfdba82a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:47.235103 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-668bdae0-0481-4c2e-8c1e-f7ecfdba82a2 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:14:47.236757 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-668bdae0-0481-4c2e-8c1e-f7ecfdba82a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:14:47.252384 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1378/2788] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:14:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:14:47.256649 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a03748-0de7-4335-acfc-faa5481df3ba None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:14:47.270962 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a03748-0de7-4335-acfc-faa5481df3ba None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:14:47.289517 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d26f271-d427-4df7-9da2-4ab01628ac22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:14:47.292115 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d26f271-d427-4df7-9da2-4ab01628ac22 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:47.292115 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d26f271-d427-4df7-9da2-4ab01628ac22 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:47.292115 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d26f271-d427-4df7-9da2-4ab01628ac22 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:47.293484 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d26f271-d427-4df7-9da2-4ab01628ac22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:14:47.294052 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d26f271-d427-4df7-9da2-4ab01628ac22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:14:47.298624 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d26f271-d427-4df7-9da2-4ab01628ac22 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:14:47.333358 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1411/2789] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:14:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:14:47.354741 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668bdae0-0481-4c2e-8c1e-f7ecfdba82a2 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:14:47.406516 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668bdae0-0481-4c2e-8c1e-f7ecfdba82a2 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:14:47.420478 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1250f0e-043e-4b81-91c8-77bd9aa893d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:14:47.421174 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1250f0e-043e-4b81-91c8-77bd9aa893d2 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:47.421559 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1250f0e-043e-4b81-91c8-77bd9aa893d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:47.421844 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1250f0e-043e-4b81-91c8-77bd9aa893d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:47.422553 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1250f0e-043e-4b81-91c8-77bd9aa893d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:14:47.424686 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1250f0e-043e-4b81-91c8-77bd9aa893d2 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:14:48.205046 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1379/2790] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:14:47 2022] POST /identity/v3/projects => generated 387 bytes in 848 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:14:48.206089 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d26f271-d427-4df7-9da2-4ab01628ac22 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:14:48.215921 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d26f271-d427-4df7-9da2-4ab01628ac22 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:14:48.279471 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf169c6-29e3-4769-9abf-03e7d25b9b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:14:48.280115 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf169c6-29e3-4769-9abf-03e7d25b9b4d admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:48.280589 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf169c6-29e3-4769-9abf-03e7d25b9b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:48.281031 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf169c6-29e3-4769-9abf-03e7d25b9b4d admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:48.281911 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf169c6-29e3-4769-9abf-03e7d25b9b4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:14:48.284065 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf169c6-29e3-4769-9abf-03e7d25b9b4d admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:14:48.386978 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1412/2791] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:14:48 2022] POST /identity/v3/users => generated 294 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:14:48.391765 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1250f0e-043e-4b81-91c8-77bd9aa893d2 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:14:48.406474 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1250f0e-043e-4b81-91c8-77bd9aa893d2 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:14:48.418054 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42dfd9a-4259-4686-9abc-7014583001d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:14:48.419427 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42dfd9a-4259-4686-9abc-7014583001d0 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:48.420039 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42dfd9a-4259-4686-9abc-7014583001d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:48.420555 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42dfd9a-4259-4686-9abc-7014583001d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:48.424274 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42dfd9a-4259-4686-9abc-7014583001d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:14:48.427546 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42dfd9a-4259-4686-9abc-7014583001d0 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:14:48.450319 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf169c6-29e3-4769-9abf-03e7d25b9b4d admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:14:48.458431 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1380/2792] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:14:48 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:14:48.471671 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf169c6-29e3-4769-9abf-03e7d25b9b4d admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:14:48.471671 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b096ee8-f010-4d5e-99bb-041b433426e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:14:48.471671 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b096ee8-f010-4d5e-99bb-041b433426e0 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:48.472404 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b096ee8-f010-4d5e-99bb-041b433426e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:48.472904 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b096ee8-f010-4d5e-99bb-041b433426e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:48.473995 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b096ee8-f010-4d5e-99bb-041b433426e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:14:48.476694 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b096ee8-f010-4d5e-99bb-041b433426e0 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:14:48.493986 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42dfd9a-4259-4686-9abc-7014583001d0 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:14:48.504959 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1413/2793] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:14:48 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:14:48.507333 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42dfd9a-4259-4686-9abc-7014583001d0 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:14:48.515785 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b7e4e0-7458-43de-8650-87f7a226fa5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:14:48.517350 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7e4e0-7458-43de-8650-87f7a226fa5e admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:48.517857 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7e4e0-7458-43de-8650-87f7a226fa5e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:48.518138 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7e4e0-7458-43de-8650-87f7a226fa5e admin admin] PATH_INFO: `/v3/projects/f15161169aaf4f1e89389598bdc8e710/users/8888db1ad60b4d5fac18c12a1feb7dea/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:48.552759 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b7e4e0-7458-43de-8650-87f7a226fa5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f15161169aaf4f1e89389598bdc8e710, user_id=8888db1ad60b4d5fac18c12a1feb7dea, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:14:48.559906 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b7e4e0-7458-43de-8650-87f7a226fa5e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:14:48.658813 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1381/2794] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:14:48 2022] PUT /identity/v3/projects/f15161169aaf4f1e89389598bdc8e710/users/8888db1ad60b4d5fac18c12a1feb7dea/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:14:48.673171 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e9accf-1916-4fa9-8e78-b9e173d05894 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:48.673852 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e9accf-1916-4fa9-8e78-b9e173d05894 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:48.674390 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e9accf-1916-4fa9-8e78-b9e173d05894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:48.741619 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-03e9accf-1916-4fa9-8e78-b9e173d05894 None None] MFA Rules not processed for user `8888db1ad60b4d5fac18c12a1feb7dea`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:14:48.743454 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-03e9accf-1916-4fa9-8e78-b9e173d05894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:14:48.902753 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b7e4e0-7458-43de-8650-87f7a226fa5e admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:14:48.903084 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1414/2795] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:14:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:14:49.033439 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b7e4e0-7458-43de-8650-87f7a226fa5e admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:14:49.040994 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e801bab3-caa8-47f6-b8c8-b6297d5b381e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:14:49.042497 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e801bab3-caa8-47f6-b8c8-b6297d5b381e admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:49.043038 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e801bab3-caa8-47f6-b8c8-b6297d5b381e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:49.043579 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e801bab3-caa8-47f6-b8c8-b6297d5b381e admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:49.044520 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e801bab3-caa8-47f6-b8c8-b6297d5b381e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:14:49.046800 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e801bab3-caa8-47f6-b8c8-b6297d5b381e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:14:49.203281 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1382/2796] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:14:48 2022] POST /identity/v3/projects => generated 389 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:14:49.203981 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e9accf-1916-4fa9-8e78-b9e173d05894 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:14:49.219766 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e9accf-1916-4fa9-8e78-b9e173d05894 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:14:49.287939 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93acce23-185d-4ae1-ae70-7206d41109a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:14:49.288621 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acce23-185d-4ae1-ae70-7206d41109a1 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:49.288915 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acce23-185d-4ae1-ae70-7206d41109a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:49.289324 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acce23-185d-4ae1-ae70-7206d41109a1 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:49.306740 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93acce23-185d-4ae1-ae70-7206d41109a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:14:49.306740 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93acce23-185d-4ae1-ae70-7206d41109a1 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:14:49.436830 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1415/2797] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:14:49 2022] POST /identity/v3/users => generated 301 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:14:49.440586 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e801bab3-caa8-47f6-b8c8-b6297d5b381e admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:14:49.450993 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e801bab3-caa8-47f6-b8c8-b6297d5b381e admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:14:49.464150 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52febe7-9182-40af-a538-0ea5511d3b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:14:49.464150 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52febe7-9182-40af-a538-0ea5511d3b53 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:49.464150 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52febe7-9182-40af-a538-0ea5511d3b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:49.464150 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52febe7-9182-40af-a538-0ea5511d3b53 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:49.464874 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52febe7-9182-40af-a538-0ea5511d3b53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:14:49.464874 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52febe7-9182-40af-a538-0ea5511d3b53 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:14:49.472648 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1383/2798] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:14:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:14:49.476740 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93acce23-185d-4ae1-ae70-7206d41109a1 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:14:49.489462 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93acce23-185d-4ae1-ae70-7206d41109a1 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:14:49.496880 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bace254-000c-4cf0-812b-453300ba99fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:14:49.498117 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bace254-000c-4cf0-812b-453300ba99fc admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:49.498835 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bace254-000c-4cf0-812b-453300ba99fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:49.499341 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bace254-000c-4cf0-812b-453300ba99fc admin admin] PATH_INFO: `/v3/projects/d6d5a5a312a04908bd46b42df3cd9245/users/c2419b9173474f89b32442d47ba667f2/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:49.517914 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bace254-000c-4cf0-812b-453300ba99fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6d5a5a312a04908bd46b42df3cd9245, user_id=c2419b9173474f89b32442d47ba667f2, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:14:49.521588 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bace254-000c-4cf0-812b-453300ba99fc admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:14:49.607681 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1416/2799] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:14:49 2022] PUT /identity/v3/projects/d6d5a5a312a04908bd46b42df3cd9245/users/c2419b9173474f89b32442d47ba667f2/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:14:49.612315 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52febe7-9182-40af-a538-0ea5511d3b53 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:14:49.623661 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52febe7-9182-40af-a538-0ea5511d3b53 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:14:49.688468 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bdb7dd-eed3-4738-a6de-b02b1c138715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:14:49.689492 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bdb7dd-eed3-4738-a6de-b02b1c138715 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:49.689983 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bdb7dd-eed3-4738-a6de-b02b1c138715 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:49.690347 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bdb7dd-eed3-4738-a6de-b02b1c138715 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:49.691444 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bdb7dd-eed3-4738-a6de-b02b1c138715 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:14:49.693369 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bdb7dd-eed3-4738-a6de-b02b1c138715 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:14:49.708664 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1384/2800] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:14:49 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:14:49.712604 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bace254-000c-4cf0-812b-453300ba99fc admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:14:49.729765 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bace254-000c-4cf0-812b-453300ba99fc admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:14:49.737507 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcf04c4-56b5-49f1-b3c9-e5ce942b64e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:14:49.738434 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf04c4-56b5-49f1-b3c9-e5ce942b64e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:49.738707 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf04c4-56b5-49f1-b3c9-e5ce942b64e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:49.738997 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf04c4-56b5-49f1-b3c9-e5ce942b64e0 admin admin] PATH_INFO: `/v3/projects/d6d5a5a312a04908bd46b42df3cd9245/users/c2419b9173474f89b32442d47ba667f2/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:49.741185 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcf04c4-56b5-49f1-b3c9-e5ce942b64e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6d5a5a312a04908bd46b42df3cd9245, user_id=c2419b9173474f89b32442d47ba667f2, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:14:49.743912 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcf04c4-56b5-49f1-b3c9-e5ce942b64e0 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:14:49.756637 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1417/2801] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:14:49 2022] PUT /identity/v3/projects/d6d5a5a312a04908bd46b42df3cd9245/users/c2419b9173474f89b32442d47ba667f2/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:14:49.769276 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9674fb-3e5c-4bfc-8a92-aceb845f49a6 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:49.769475 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9674fb-3e5c-4bfc-8a92-aceb845f49a6 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:49.769619 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9674fb-3e5c-4bfc-8a92-aceb845f49a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:49.799099 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-4c9674fb-3e5c-4bfc-8a92-aceb845f49a6 None None] MFA Rules not processed for user `c2419b9173474f89b32442d47ba667f2`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:14:49.800406 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-4c9674fb-3e5c-4bfc-8a92-aceb845f49a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:14:49.889578 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1385/2802] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:14:49 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:14:49.899471 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcf04c4-56b5-49f1-b3c9-e5ce942b64e0 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:14:49.901373 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-fdcf04c4-56b5-49f1-b3c9-e5ce942b64e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:14:50.023629 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcf04c4-56b5-49f1-b3c9-e5ce942b64e0 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:14:50.038179 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63404898-10d9-438d-8ce0-334d9bc0174d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:14:50.039090 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63404898-10d9-438d-8ce0-334d9bc0174d service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:50.039503 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63404898-10d9-438d-8ce0-334d9bc0174d service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:50.040044 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63404898-10d9-438d-8ce0-334d9bc0174d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:50.049890 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63404898-10d9-438d-8ce0-334d9bc0174d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:14:50.054994 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63404898-10d9-438d-8ce0-334d9bc0174d service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:14:50.064100 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1418/2803] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:14:49 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:14:50.155748 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9674fb-3e5c-4bfc-8a92-aceb845f49a6 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:14:50.157081 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-4c9674fb-3e5c-4bfc-8a92-aceb845f49a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:14:50.177374 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9674fb-3e5c-4bfc-8a92-aceb845f49a6 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:14:50.184844 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a45ddb-d90e-478d-9641-15b06ba28f1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:14:50.185690 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a45ddb-d90e-478d-9641-15b06ba28f1a service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:50.185973 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a45ddb-d90e-478d-9641-15b06ba28f1a service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:50.186647 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a45ddb-d90e-478d-9641-15b06ba28f1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:50.270192 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a45ddb-d90e-478d-9641-15b06ba28f1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:14:50.274386 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a45ddb-d90e-478d-9641-15b06ba28f1a service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:14:50.287223 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1386/2804] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:14:50 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:14:52.472695 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63404898-10d9-438d-8ce0-334d9bc0174d service nova] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:14:52.484934 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63404898-10d9-438d-8ce0-334d9bc0174d service nova] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:14:52.490392 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e23e1-d5a5-4236-9b7d-ef8b24ed232a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:14:52.491030 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e23e1-d5a5-4236-9b7d-ef8b24ed232a service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:52.491318 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e23e1-d5a5-4236-9b7d-ef8b24ed232a service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:52.491637 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e23e1-d5a5-4236-9b7d-ef8b24ed232a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:52.493435 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-2a4e23e1-d5a5-4236-9b7d-ef8b24ed232a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:14:52.556908 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4e23e1-d5a5-4236-9b7d-ef8b24ed232a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:14:52.558544 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4e23e1-d5a5-4236-9b7d-ef8b24ed232a service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:14:52.568241 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1419/2805] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:14:52 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:14:52.844404 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a45ddb-d90e-478d-9641-15b06ba28f1a service nova] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:14:52.909759 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a45ddb-d90e-478d-9641-15b06ba28f1a service nova] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:14:52.917512 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe61a2-7f8b-4a0c-a7a3-66add53268ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:14:52.917512 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe61a2-7f8b-4a0c-a7a3-66add53268ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:52.917512 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe61a2-7f8b-4a0c-a7a3-66add53268ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:52.917512 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe61a2-7f8b-4a0c-a7a3-66add53268ef admin admin] PATH_INFO: `/v3/users/8888db1ad60b4d5fac18c12a1feb7dea` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:52.921384 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fe61a2-7f8b-4a0c-a7a3-66add53268ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=8888db1ad60b4d5fac18c12a1feb7dea)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:14:52.921384 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fe61a2-7f8b-4a0c-a7a3-66add53268ef admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:14:53.113604 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c8fe61a2-7f8b-4a0c-a7a3-66add53268ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8888db1ad60b4d5fac18c12a1feb7dea'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:14:53.122727 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c8fe61a2-7f8b-4a0c-a7a3-66add53268ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8888db1ad60b4d5fac18c12a1feb7dea'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:14:53.123949 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c8fe61a2-7f8b-4a0c-a7a3-66add53268ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8888db1ad60b4d5fac18c12a1feb7dea'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:14:53.217862 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c8fe61a2-7f8b-4a0c-a7a3-66add53268ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8888db1ad60b4d5fac18c12a1feb7dea'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:14:53.232365 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c8fe61a2-7f8b-4a0c-a7a3-66add53268ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8888db1ad60b4d5fac18c12a1feb7dea'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:14:53.240240 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1387/2806] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:14:52 2022] DELETE /identity/v3/users/8888db1ad60b4d5fac18c12a1feb7dea => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:14:53.245262 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5dd7ce-5c26-4a0f-96cf-6c6d207f70e6 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:53.247688 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5dd7ce-5c26-4a0f-96cf-6c6d207f70e6 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:53.247688 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5dd7ce-5c26-4a0f-96cf-6c6d207f70e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:53.284900 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-3f5dd7ce-5c26-4a0f-96cf-6c6d207f70e6 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:14:53.287801 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-3f5dd7ce-5c26-4a0f-96cf-6c6d207f70e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:14:53.343373 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe61a2-7f8b-4a0c-a7a3-66add53268ef admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:14:53.345199 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c8fe61a2-7f8b-4a0c-a7a3-66add53268ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:14:53.400159 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1420/2807] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:14:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:14:53.413110 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5dd7ce-5c26-4a0f-96cf-6c6d207f70e6 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:14:53.414977 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-3f5dd7ce-5c26-4a0f-96cf-6c6d207f70e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:14:53.508780 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe61a2-7f8b-4a0c-a7a3-66add53268ef admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:14:53.522002 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb5766c-013c-4762-b0b2-8dcc988035ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:14:53.522793 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5dd7ce-5c26-4a0f-96cf-6c6d207f70e6 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:14:53.528157 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb5766c-013c-4762-b0b2-8dcc988035ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:53.528667 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b04fe-cafb-465d-941b-751b62f30f1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:14:53.528992 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb5766c-013c-4762-b0b2-8dcc988035ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:53.529472 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b04fe-cafb-465d-941b-751b62f30f1e service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:53.529660 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb5766c-013c-4762-b0b2-8dcc988035ea admin admin] PATH_INFO: `/v3/users/32240804909d4572880a0f419f49f61e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:53.529775 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b04fe-cafb-465d-941b-751b62f30f1e service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:53.530017 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b04fe-cafb-465d-941b-751b62f30f1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:53.532919 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb5766c-013c-4762-b0b2-8dcc988035ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=32240804909d4572880a0f419f49f61e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:14:53.535560 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb5766c-013c-4762-b0b2-8dcc988035ea admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:14:53.542735 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2b04fe-cafb-465d-941b-751b62f30f1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:14:53.544430 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2b04fe-cafb-465d-941b-751b62f30f1e service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:14:53.556309 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1421/2808] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:14:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:14:53.773511 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ebb5766c-013c-4762-b0b2-8dcc988035ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32240804909d4572880a0f419f49f61e'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:14:53.789752 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ebb5766c-013c-4762-b0b2-8dcc988035ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32240804909d4572880a0f419f49f61e'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:14:53.790758 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ebb5766c-013c-4762-b0b2-8dcc988035ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32240804909d4572880a0f419f49f61e'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:14:53.891538 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ebb5766c-013c-4762-b0b2-8dcc988035ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32240804909d4572880a0f419f49f61e'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:14:53.913796 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ebb5766c-013c-4762-b0b2-8dcc988035ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32240804909d4572880a0f419f49f61e'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:14:53.933793 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1388/2809] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:14:53 2022] DELETE /identity/v3/users/32240804909d4572880a0f419f49f61e => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:14:53.938885 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce130ffb-0bbe-48d7-8b04-fb401ce8bad6 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:53.939545 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce130ffb-0bbe-48d7-8b04-fb401ce8bad6 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:53.940041 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce130ffb-0bbe-48d7-8b04-fb401ce8bad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:53.965324 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-ce130ffb-0bbe-48d7-8b04-fb401ce8bad6 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:14:53.967360 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ce130ffb-0bbe-48d7-8b04-fb401ce8bad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:14:54.057542 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1422/2810] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:14:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:14:54.073859 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb5766c-013c-4762-b0b2-8dcc988035ea admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:14:54.075719 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-ebb5766c-013c-4762-b0b2-8dcc988035ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:14:54.227683 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb5766c-013c-4762-b0b2-8dcc988035ea admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:14:54.227683 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0895cb4-5694-451d-9189-25623fbfd7ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:14:54.227683 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0895cb4-5694-451d-9189-25623fbfd7ce service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:54.227683 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0895cb4-5694-451d-9189-25623fbfd7ce service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:54.228060 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0895cb4-5694-451d-9189-25623fbfd7ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:54.240369 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0895cb4-5694-451d-9189-25623fbfd7ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:14:54.241831 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0895cb4-5694-451d-9189-25623fbfd7ce service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:14:54.256057 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1389/2811] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:14:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:14:54.272456 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce130ffb-0bbe-48d7-8b04-fb401ce8bad6 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:14:54.273939 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ce130ffb-0bbe-48d7-8b04-fb401ce8bad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:14:54.288055 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce130ffb-0bbe-48d7-8b04-fb401ce8bad6 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:14:54.298942 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb68551a-b2a3-4b96-a3d1-eb0298848712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:14:54.301896 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68551a-b2a3-4b96-a3d1-eb0298848712 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:54.302590 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68551a-b2a3-4b96-a3d1-eb0298848712 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:54.302590 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68551a-b2a3-4b96-a3d1-eb0298848712 admin admin] PATH_INFO: `/v3/projects/f15161169aaf4f1e89389598bdc8e710` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:54.303899 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb68551a-b2a3-4b96-a3d1-eb0298848712 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f15161169aaf4f1e89389598bdc8e710)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:14:54.307854 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb68551a-b2a3-4b96-a3d1-eb0298848712 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:14:54.450411 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-fb68551a-b2a3-4b96-a3d1-eb0298848712 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f15161169aaf4f1e89389598bdc8e710', 'request_id': 'req-fb68551a-b2a3-4b96-a3d1-eb0298848712'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:14:54.460127 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-fb68551a-b2a3-4b96-a3d1-eb0298848712 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f15161169aaf4f1e89389598bdc8e710', 'request_id': 'req-fb68551a-b2a3-4b96-a3d1-eb0298848712'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:14:54.538220 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-fb68551a-b2a3-4b96-a3d1-eb0298848712 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f15161169aaf4f1e89389598bdc8e710', 'request_id': 'req-fb68551a-b2a3-4b96-a3d1-eb0298848712'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:14:54.553479 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-fb68551a-b2a3-4b96-a3d1-eb0298848712 admin admin] The token cache is being invalidate because project f15161169aaf4f1e89389598bdc8e710 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:14:54.553852 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-fb68551a-b2a3-4b96-a3d1-eb0298848712 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:14:54.554667 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-fb68551a-b2a3-4b96-a3d1-eb0298848712 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:14:54.557866 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1423/2812] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:14:54 2022] DELETE /identity/v3/projects/f15161169aaf4f1e89389598bdc8e710 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:14:54.562048 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0895cb4-5694-451d-9189-25623fbfd7ce service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:14:54.572573 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0895cb4-5694-451d-9189-25623fbfd7ce service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:14:54.633415 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb68551a-b2a3-4b96-a3d1-eb0298848712 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:14:54.635441 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-fb68551a-b2a3-4b96-a3d1-eb0298848712 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:14:54.663783 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd7f227-c0b3-452f-a5c8-69d6079420bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:14:54.668389 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7f227-c0b3-452f-a5c8-69d6079420bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:54.668389 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7f227-c0b3-452f-a5c8-69d6079420bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:54.668389 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7f227-c0b3-452f-a5c8-69d6079420bb admin admin] PATH_INFO: `/v3/users/c2419b9173474f89b32442d47ba667f2` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:54.668389 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd7f227-c0b3-452f-a5c8-69d6079420bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2419b9173474f89b32442d47ba667f2)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:14:54.671133 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd7f227-c0b3-452f-a5c8-69d6079420bb admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:14:54.741860 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb68551a-b2a3-4b96-a3d1-eb0298848712 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:14:54.748733 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0312242e-d890-49f7-9f22-210d063906d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:14:54.749602 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312242e-d890-49f7-9f22-210d063906d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:54.749888 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312242e-d890-49f7-9f22-210d063906d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:54.750172 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312242e-d890-49f7-9f22-210d063906d8 admin admin] PATH_INFO: `/v3/projects/f04e1accfc534fb18e36d789a9cefde3` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:54.751381 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0312242e-d890-49f7-9f22-210d063906d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f04e1accfc534fb18e36d789a9cefde3)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:14:54.753383 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0312242e-d890-49f7-9f22-210d063906d8 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:14:54.954010 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-efd7f227-c0b3-452f-a5c8-69d6079420bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2419b9173474f89b32442d47ba667f2'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:14:54.957862 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0312242e-d890-49f7-9f22-210d063906d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f04e1accfc534fb18e36d789a9cefde3', 'request_id': 'req-0312242e-d890-49f7-9f22-210d063906d8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:14:54.961435 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-efd7f227-c0b3-452f-a5c8-69d6079420bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2419b9173474f89b32442d47ba667f2'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:14:54.962466 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-efd7f227-c0b3-452f-a5c8-69d6079420bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2419b9173474f89b32442d47ba667f2'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:14:54.964284 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0312242e-d890-49f7-9f22-210d063906d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f04e1accfc534fb18e36d789a9cefde3', 'request_id': 'req-0312242e-d890-49f7-9f22-210d063906d8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:14:55.041540 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-efd7f227-c0b3-452f-a5c8-69d6079420bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2419b9173474f89b32442d47ba667f2'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:14:55.060279 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-efd7f227-c0b3-452f-a5c8-69d6079420bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2419b9173474f89b32442d47ba667f2'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:14:55.069934 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1390/2813] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:14:54 2022] DELETE /identity/v3/users/c2419b9173474f89b32442d47ba667f2 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:14:55.115594 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0312242e-d890-49f7-9f22-210d063906d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f04e1accfc534fb18e36d789a9cefde3', 'request_id': 'req-0312242e-d890-49f7-9f22-210d063906d8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:14:55.128841 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0312242e-d890-49f7-9f22-210d063906d8 admin admin] The token cache is being invalidate because project f04e1accfc534fb18e36d789a9cefde3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:14:55.129137 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0312242e-d890-49f7-9f22-210d063906d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:14:55.129814 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0312242e-d890-49f7-9f22-210d063906d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:14:55.131888 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1424/2814] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:14:54 2022] DELETE /identity/v3/projects/f04e1accfc534fb18e36d789a9cefde3 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:14:55.136124 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd7f227-c0b3-452f-a5c8-69d6079420bb admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:14:55.137751 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-efd7f227-c0b3-452f-a5c8-69d6079420bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:14:55.208823 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd7f227-c0b3-452f-a5c8-69d6079420bb admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:14:55.214024 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94af5c0-690e-4f17-bc1d-e62135392e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:14:55.214890 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94af5c0-690e-4f17-bc1d-e62135392e76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:55.215175 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94af5c0-690e-4f17-bc1d-e62135392e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:55.215448 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94af5c0-690e-4f17-bc1d-e62135392e76 admin admin] PATH_INFO: `/v3/users/f936cc3ccd8b4fcdb55ab14c013ae684` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:55.216668 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94af5c0-690e-4f17-bc1d-e62135392e76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f936cc3ccd8b4fcdb55ab14c013ae684)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:14:55.218595 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94af5c0-690e-4f17-bc1d-e62135392e76 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:14:55.456060 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d94af5c0-690e-4f17-bc1d-e62135392e76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f936cc3ccd8b4fcdb55ab14c013ae684'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:14:55.462812 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d94af5c0-690e-4f17-bc1d-e62135392e76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f936cc3ccd8b4fcdb55ab14c013ae684'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:14:55.468640 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d94af5c0-690e-4f17-bc1d-e62135392e76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f936cc3ccd8b4fcdb55ab14c013ae684'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:14:55.545804 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0312242e-d890-49f7-9f22-210d063906d8 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:14:55.556537 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-0312242e-d890-49f7-9f22-210d063906d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:14:55.576507 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d94af5c0-690e-4f17-bc1d-e62135392e76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f936cc3ccd8b4fcdb55ab14c013ae684'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:14:55.592166 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d94af5c0-690e-4f17-bc1d-e62135392e76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f936cc3ccd8b4fcdb55ab14c013ae684'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:14:55.604392 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1391/2815] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:14:55 2022] DELETE /identity/v3/users/f936cc3ccd8b4fcdb55ab14c013ae684 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:14:55.650271 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0312242e-d890-49f7-9f22-210d063906d8 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:14:55.768056 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae521f57-a425-4533-bd1c-0f761c71b2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:14:55.769769 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae521f57-a425-4533-bd1c-0f761c71b2fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:55.770222 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae521f57-a425-4533-bd1c-0f761c71b2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:55.770659 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae521f57-a425-4533-bd1c-0f761c71b2fc admin admin] PATH_INFO: `/v3/projects/d6d5a5a312a04908bd46b42df3cd9245` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:55.772459 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae521f57-a425-4533-bd1c-0f761c71b2fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6d5a5a312a04908bd46b42df3cd9245)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:14:55.775461 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae521f57-a425-4533-bd1c-0f761c71b2fc admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:14:55.906232 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ae521f57-a425-4533-bd1c-0f761c71b2fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6d5a5a312a04908bd46b42df3cd9245', 'request_id': 'req-ae521f57-a425-4533-bd1c-0f761c71b2fc'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:14:55.910917 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ae521f57-a425-4533-bd1c-0f761c71b2fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6d5a5a312a04908bd46b42df3cd9245', 'request_id': 'req-ae521f57-a425-4533-bd1c-0f761c71b2fc'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:14:55.935690 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94af5c0-690e-4f17-bc1d-e62135392e76 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:14:55.937934 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-d94af5c0-690e-4f17-bc1d-e62135392e76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:14:55.958350 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94af5c0-690e-4f17-bc1d-e62135392e76 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:14:56.023914 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbf8594-f1d3-4674-8a18-6986dc007451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:14:56.024792 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf8594-f1d3-4674-8a18-6986dc007451 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:56.025760 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf8594-f1d3-4674-8a18-6986dc007451 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:56.026054 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf8594-f1d3-4674-8a18-6986dc007451 admin admin] PATH_INFO: `/v3/projects/224e7cf6cf474b02ac095458aa4add5d` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:56.027647 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbf8594-f1d3-4674-8a18-6986dc007451 admin admin] RBAC: Authorizing `identity:delete_project(project_id=224e7cf6cf474b02ac095458aa4add5d)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:14:56.027905 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ae521f57-a425-4533-bd1c-0f761c71b2fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6d5a5a312a04908bd46b42df3cd9245', 'request_id': 'req-ae521f57-a425-4533-bd1c-0f761c71b2fc'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:14:56.042489 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ae521f57-a425-4533-bd1c-0f761c71b2fc admin admin] The token cache is being invalidate because project d6d5a5a312a04908bd46b42df3cd9245 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:14:56.042839 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ae521f57-a425-4533-bd1c-0f761c71b2fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:14:56.043136 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbf8594-f1d3-4674-8a18-6986dc007451 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:14:56.043660 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ae521f57-a425-4533-bd1c-0f761c71b2fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:14:56.046381 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1425/2816] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:14:55 2022] DELETE /identity/v3/projects/d6d5a5a312a04908bd46b42df3cd9245 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:14:56.051140 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1124026-51f4-420e-bd8e-c2366127099a None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:56.051518 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1124026-51f4-420e-bd8e-c2366127099a None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:56.051926 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1124026-51f4-420e-bd8e-c2366127099a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:56.073180 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-c1124026-51f4-420e-bd8e-c2366127099a None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:14:56.074682 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c1124026-51f4-420e-bd8e-c2366127099a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:14:56.084979 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1426/2817] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:14:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:14:56.093369 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c281f-2c2d-4579-ba8e-ea17ad27ffec None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:56.093712 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c281f-2c2d-4579-ba8e-ea17ad27ffec None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:56.093992 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c281f-2c2d-4579-ba8e-ea17ad27ffec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:56.113420 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-f37c281f-2c2d-4579-ba8e-ea17ad27ffec None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:14:56.114681 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-f37c281f-2c2d-4579-ba8e-ea17ad27ffec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:14:56.127637 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1427/2818] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:14:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:14:56.129969 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c281f-2c2d-4579-ba8e-ea17ad27ffec None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:14:56.140500 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c281f-2c2d-4579-ba8e-ea17ad27ffec None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:14:56.145452 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9051d73a-8986-420d-a099-cf85c0edc506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:14:56.147465 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9051d73a-8986-420d-a099-cf85c0edc506 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:56.147465 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9051d73a-8986-420d-a099-cf85c0edc506 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:56.147465 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9051d73a-8986-420d-a099-cf85c0edc506 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:56.147465 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9051d73a-8986-420d-a099-cf85c0edc506 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:14:56.147853 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9051d73a-8986-420d-a099-cf85c0edc506 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:14:56.149286 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9051d73a-8986-420d-a099-cf85c0edc506 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:14:56.169861 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1428/2819] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:14:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:14:56.171130 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9051d73a-8986-420d-a099-cf85c0edc506 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:14:56.187408 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9051d73a-8986-420d-a099-cf85c0edc506 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:14:56.198550 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-afbf8594-f1d3-4674-8a18-6986dc007451 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '224e7cf6cf474b02ac095458aa4add5d', 'request_id': 'req-afbf8594-f1d3-4674-8a18-6986dc007451'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:14:56.205543 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-afbf8594-f1d3-4674-8a18-6986dc007451 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '224e7cf6cf474b02ac095458aa4add5d', 'request_id': 'req-afbf8594-f1d3-4674-8a18-6986dc007451'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:14:56.216133 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-afbf8594-f1d3-4674-8a18-6986dc007451 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '224e7cf6cf474b02ac095458aa4add5d', 'request_id': 'req-afbf8594-f1d3-4674-8a18-6986dc007451'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:14:56.252207 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777fd84b-c8a6-43dd-ab24-e6c60dda8433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:14:56.252877 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777fd84b-c8a6-43dd-ab24-e6c60dda8433 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:56.253163 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777fd84b-c8a6-43dd-ab24-e6c60dda8433 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:56.253442 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777fd84b-c8a6-43dd-ab24-e6c60dda8433 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:56.254137 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777fd84b-c8a6-43dd-ab24-e6c60dda8433 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:14:56.256161 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777fd84b-c8a6-43dd-ab24-e6c60dda8433 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:14:56.301863 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-afbf8594-f1d3-4674-8a18-6986dc007451 admin admin] The token cache is being invalidate because project 224e7cf6cf474b02ac095458aa4add5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:14:56.302205 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-afbf8594-f1d3-4674-8a18-6986dc007451 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:14:56.302918 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-afbf8594-f1d3-4674-8a18-6986dc007451 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:14:56.304510 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1392/2820] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:14:55 2022] DELETE /identity/v3/projects/224e7cf6cf474b02ac095458aa4add5d => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:14:56.310709 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eebf175-95de-4116-a02e-69ca6c521632 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:56.310999 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eebf175-95de-4116-a02e-69ca6c521632 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:56.311277 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eebf175-95de-4116-a02e-69ca6c521632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:56.330619 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-8eebf175-95de-4116-a02e-69ca6c521632 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:14:56.331908 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8eebf175-95de-4116-a02e-69ca6c521632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:14:56.340289 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1393/2821] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:14:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:14:56.348315 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed48a1f-c80b-44bf-8b40-df7b01b550cf None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:56.349148 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed48a1f-c80b-44bf-8b40-df7b01b550cf None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:56.349148 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed48a1f-c80b-44bf-8b40-df7b01b550cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:56.365361 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1429/2822] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:14:56 2022] POST /identity/v3/projects => generated 397 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:14:56.366211 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777fd84b-c8a6-43dd-ab24-e6c60dda8433 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:14:56.367901 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-777fd84b-c8a6-43dd-ab24-e6c60dda8433 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:14:56.371425 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-eed48a1f-c80b-44bf-8b40-df7b01b550cf None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:14:56.372637 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-eed48a1f-c80b-44bf-8b40-df7b01b550cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:14:56.451006 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777fd84b-c8a6-43dd-ab24-e6c60dda8433 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:14:56.456804 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff4162-1949-43a0-8aca-17e0b894fdc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:14:56.457476 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff4162-1949-43a0-8aca-17e0b894fdc2 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:56.457759 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff4162-1949-43a0-8aca-17e0b894fdc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:56.458062 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff4162-1949-43a0-8aca-17e0b894fdc2 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:56.458808 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efff4162-1949-43a0-8aca-17e0b894fdc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:14:56.460881 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efff4162-1949-43a0-8aca-17e0b894fdc2 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:14:56.479049 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1394/2823] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:14:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:14:56.483626 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed48a1f-c80b-44bf-8b40-df7b01b550cf None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:14:56.494147 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed48a1f-c80b-44bf-8b40-df7b01b550cf None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:14:56.500480 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa2a240-071c-4f24-82f1-ef5dd3f1ae7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:14:56.501324 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2a240-071c-4f24-82f1-ef5dd3f1ae7b admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:56.501619 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2a240-071c-4f24-82f1-ef5dd3f1ae7b admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:56.502210 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2a240-071c-4f24-82f1-ef5dd3f1ae7b admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:56.502946 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa2a240-071c-4f24-82f1-ef5dd3f1ae7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:14:56.503275 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa2a240-071c-4f24-82f1-ef5dd3f1ae7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:14:56.505225 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa2a240-071c-4f24-82f1-ef5dd3f1ae7b admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:14:56.525026 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1395/2824] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:14:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:14:56.526793 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa2a240-071c-4f24-82f1-ef5dd3f1ae7b admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:14:56.538638 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa2a240-071c-4f24-82f1-ef5dd3f1ae7b admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:14:56.544195 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7fc893-8232-4bca-9f11-64c78730b94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:14:56.544915 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7fc893-8232-4bca-9f11-64c78730b94d admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:56.545202 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7fc893-8232-4bca-9f11-64c78730b94d admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:56.545518 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7fc893-8232-4bca-9f11-64c78730b94d admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:56.546338 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7fc893-8232-4bca-9f11-64c78730b94d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:14:56.548346 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7fc893-8232-4bca-9f11-64c78730b94d admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:14:56.564039 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1430/2825] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:14:56 2022] POST /identity/v3/users => generated 299 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:14:56.567855 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff4162-1949-43a0-8aca-17e0b894fdc2 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:14:56.582370 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff4162-1949-43a0-8aca-17e0b894fdc2 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:14:56.587949 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781da755-b9cb-4d53-b1b5-796cba10d892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:14:56.589416 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781da755-b9cb-4d53-b1b5-796cba10d892 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:56.590061 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781da755-b9cb-4d53-b1b5-796cba10d892 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:56.590556 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781da755-b9cb-4d53-b1b5-796cba10d892 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:56.591598 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781da755-b9cb-4d53-b1b5-796cba10d892 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:14:56.594557 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781da755-b9cb-4d53-b1b5-796cba10d892 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:14:56.607006 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1431/2826] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:14:56 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:14:56.611944 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781da755-b9cb-4d53-b1b5-796cba10d892 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:14:56.623874 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781da755-b9cb-4d53-b1b5-796cba10d892 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:14:56.631105 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049513d3-a6df-4a03-8c79-68b92b358e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:14:56.631945 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049513d3-a6df-4a03-8c79-68b92b358e6b admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:56.632490 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049513d3-a6df-4a03-8c79-68b92b358e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:56.632766 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049513d3-a6df-4a03-8c79-68b92b358e6b admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:56.633609 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049513d3-a6df-4a03-8c79-68b92b358e6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:14:56.636716 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049513d3-a6df-4a03-8c79-68b92b358e6b admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:14:56.649875 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1432/2827] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:14:56 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:14:56.654443 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049513d3-a6df-4a03-8c79-68b92b358e6b admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:14:56.665821 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049513d3-a6df-4a03-8c79-68b92b358e6b admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:14:56.674010 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ffe41a-1c32-4742-826d-eeb152f4a7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:14:56.674010 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ffe41a-1c32-4742-826d-eeb152f4a7a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:56.674010 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ffe41a-1c32-4742-826d-eeb152f4a7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:56.674477 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ffe41a-1c32-4742-826d-eeb152f4a7a5 admin admin] PATH_INFO: `/v3/projects/74bb7b020fae4bcaa3a440acc60c7a1d/users/cfcb989a491440b3bf74ddc055ee14d3/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:56.701084 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1396/2828] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:14:56 2022] POST /identity/v3/projects => generated 369 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:14:56.702766 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ffe41a-1c32-4742-826d-eeb152f4a7a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74bb7b020fae4bcaa3a440acc60c7a1d, user_id=cfcb989a491440b3bf74ddc055ee14d3, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:14:56.705229 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7fc893-8232-4bca-9f11-64c78730b94d admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:14:56.705792 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ffe41a-1c32-4742-826d-eeb152f4a7a5 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:14:56.790428 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7fc893-8232-4bca-9f11-64c78730b94d admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:14:56.796912 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272b8786-9427-4791-9380-7f3c0dc77ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:14:56.797595 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272b8786-9427-4791-9380-7f3c0dc77ac8 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:56.797877 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272b8786-9427-4791-9380-7f3c0dc77ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:56.798152 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272b8786-9427-4791-9380-7f3c0dc77ac8 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:56.799037 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272b8786-9427-4791-9380-7f3c0dc77ac8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:14:56.801187 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272b8786-9427-4791-9380-7f3c0dc77ac8 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:14:56.835237 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1433/2829] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:14:56 2022] PUT /identity/v3/projects/74bb7b020fae4bcaa3a440acc60c7a1d/users/cfcb989a491440b3bf74ddc055ee14d3/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:14:56.841697 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df164ae4-120b-4fd9-892a-4ea1180551e3 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:56.842075 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df164ae4-120b-4fd9-892a-4ea1180551e3 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:56.842829 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df164ae4-120b-4fd9-892a-4ea1180551e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:56.863108 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-df164ae4-120b-4fd9-892a-4ea1180551e3 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:14:56.864482 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-df164ae4-120b-4fd9-892a-4ea1180551e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:14:56.937289 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1397/2830] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:14:56 2022] POST /identity/v3/users => generated 285 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:14:56.938448 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272b8786-9427-4791-9380-7f3c0dc77ac8 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:14:56.947773 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1434/2831] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:14:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:14:56.954954 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272b8786-9427-4791-9380-7f3c0dc77ac8 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:14:56.961048 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df164ae4-120b-4fd9-892a-4ea1180551e3 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:14:56.964510 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-df164ae4-120b-4fd9-892a-4ea1180551e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:14:56.965376 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3ef611-d6b9-469d-8057-77f34c1ebdfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:14:56.966254 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ef611-d6b9-469d-8057-77f34c1ebdfd admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:56.967052 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ef611-d6b9-469d-8057-77f34c1ebdfd admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:56.967596 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ef611-d6b9-469d-8057-77f34c1ebdfd admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:56.968573 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3ef611-d6b9-469d-8057-77f34c1ebdfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:14:56.970429 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3ef611-d6b9-469d-8057-77f34c1ebdfd admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:14:56.983110 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1398/2832] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:14:56 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:14:56.986520 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3ef611-d6b9-469d-8057-77f34c1ebdfd admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:14:56.998657 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3ef611-d6b9-469d-8057-77f34c1ebdfd admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:14:57.004028 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2deae98-2ac2-4c95-8d9b-cdaf331e9108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:14:57.004983 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2deae98-2ac2-4c95-8d9b-cdaf331e9108 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:57.005426 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2deae98-2ac2-4c95-8d9b-cdaf331e9108 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:57.005856 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2deae98-2ac2-4c95-8d9b-cdaf331e9108 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:57.006734 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2deae98-2ac2-4c95-8d9b-cdaf331e9108 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:14:57.016772 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2deae98-2ac2-4c95-8d9b-cdaf331e9108 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:14:57.022988 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1399/2833] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:14:56 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:14:57.028786 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2deae98-2ac2-4c95-8d9b-cdaf331e9108 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:14:57.046331 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df164ae4-120b-4fd9-892a-4ea1180551e3 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:14:57.050141 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2deae98-2ac2-4c95-8d9b-cdaf331e9108 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:14:57.051556 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee6e01a-7f7e-43e6-a516-1237f69e93f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:14:57.052604 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6e01a-7f7e-43e6-a516-1237f69e93f8 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:57.053050 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6e01a-7f7e-43e6-a516-1237f69e93f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:57.053516 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6e01a-7f7e-43e6-a516-1237f69e93f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:57.055688 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aac7c3-f639-48dc-b187-a84ef68b1ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:14:57.056690 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aac7c3-f639-48dc-b187-a84ef68b1ee8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:57.057144 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aac7c3-f639-48dc-b187-a84ef68b1ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:57.057527 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aac7c3-f639-48dc-b187-a84ef68b1ee8 admin admin] PATH_INFO: `/v3/projects/d3f3922f65094861b37de2779faf426d/users/90422d521a274c7d84652235a88037ab/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:57.066095 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee6e01a-7f7e-43e6-a516-1237f69e93f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:14:57.068453 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee6e01a-7f7e-43e6-a516-1237f69e93f8 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:14:57.077539 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aac7c3-f639-48dc-b187-a84ef68b1ee8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3f3922f65094861b37de2779faf426d, user_id=90422d521a274c7d84652235a88037ab, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:14:57.080501 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1435/2834] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:14:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:14:57.080771 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aac7c3-f639-48dc-b187-a84ef68b1ee8 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:14:57.162590 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1400/2835] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:14:57 2022] PUT /identity/v3/projects/d3f3922f65094861b37de2779faf426d/users/90422d521a274c7d84652235a88037ab/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:14:57.163655 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de2aa1f-1085-4383-8c17-ed59f147467a None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:57.164070 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de2aa1f-1085-4383-8c17-ed59f147467a None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:57.164444 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de2aa1f-1085-4383-8c17-ed59f147467a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:57.209284 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-3de2aa1f-1085-4383-8c17-ed59f147467a None None] MFA Rules not processed for user `90422d521a274c7d84652235a88037ab`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:14:57.214090 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-3de2aa1f-1085-4383-8c17-ed59f147467a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:14:57.361175 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1436/2836] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:14:57 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:14:57.372979 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aac7c3-f639-48dc-b187-a84ef68b1ee8 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:14:57.377521 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-23aac7c3-f639-48dc-b187-a84ef68b1ee8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:14:57.481729 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aac7c3-f639-48dc-b187-a84ef68b1ee8 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:14:57.487778 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f32a8e0-735a-4c8b-88f4-e929ad8e33de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:14:57.488684 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f32a8e0-735a-4c8b-88f4-e929ad8e33de service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:57.488951 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f32a8e0-735a-4c8b-88f4-e929ad8e33de service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:57.489035 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f32a8e0-735a-4c8b-88f4-e929ad8e33de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:57.500056 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f32a8e0-735a-4c8b-88f4-e929ad8e33de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:14:57.507828 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f32a8e0-735a-4c8b-88f4-e929ad8e33de service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:14:57.526067 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1401/2837] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:14:57 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:14:58.664279 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a3576-927e-47ef-9d66-b232c15973b7 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:58.664755 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a3576-927e-47ef-9d66-b232c15973b7 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:58.664863 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a3576-927e-47ef-9d66-b232c15973b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:58.685001 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-017a3576-927e-47ef-9d66-b232c15973b7 None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:14:58.686619 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-017a3576-927e-47ef-9d66-b232c15973b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:14:58.761479 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1437/2838] 10.222.0.52 () {58 vars in 1009 bytes} [Sat May 14 21:14:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:14:58.790851 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f32a8e0-735a-4c8b-88f4-e929ad8e33de service nova] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:14:58.793238 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-0f32a8e0-735a-4c8b-88f4-e929ad8e33de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:14:58.903125 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f32a8e0-735a-4c8b-88f4-e929ad8e33de service nova] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:14:58.909269 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba1e1e8-9775-4061-a612-7c90a04f8288 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:14:58.910191 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba1e1e8-9775-4061-a612-7c90a04f8288 service swift] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:58.910645 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba1e1e8-9775-4061-a612-7c90a04f8288 service swift] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:58.911135 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba1e1e8-9775-4061-a612-7c90a04f8288 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:58.917940 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd76423-129a-498f-a82b-42d088dd2af6 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:58.918515 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd76423-129a-498f-a82b-42d088dd2af6 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:58.919000 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd76423-129a-498f-a82b-42d088dd2af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:58.937606 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba1e1e8-9775-4061-a612-7c90a04f8288 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:14:58.939233 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba1e1e8-9775-4061-a612-7c90a04f8288 service swift] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:14:58.957739 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1402/2839] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 21:14:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 21:14:58.968141 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-fdd76423-129a-498f-a82b-42d088dd2af6 None None] MFA Rules not processed for user `cfcb989a491440b3bf74ddc055ee14d3`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:14:58.969406 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-fdd76423-129a-498f-a82b-42d088dd2af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:14:59.063108 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba1e1e8-9775-4061-a612-7c90a04f8288 service swift] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:14:59.138848 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1438/2840] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:14:58 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:14:59.138848 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd76423-129a-498f-a82b-42d088dd2af6 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:14:59.177744 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba1e1e8-9775-4061-a612-7c90a04f8288 service swift] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:14:59.185896 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbbb0d4-a759-4603-8dc2-b78a92c39f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:14:59.187065 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbbb0d4-a759-4603-8dc2-b78a92c39f1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:59.187846 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbbb0d4-a759-4603-8dc2-b78a92c39f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:59.188126 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbbb0d4-a759-4603-8dc2-b78a92c39f1d admin admin] PATH_INFO: `/v3/users/90422d521a274c7d84652235a88037ab` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:59.189591 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbbb0d4-a759-4603-8dc2-b78a92c39f1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=90422d521a274c7d84652235a88037ab)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:14:59.191889 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbbb0d4-a759-4603-8dc2-b78a92c39f1d admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:14:59.228530 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd76423-129a-498f-a82b-42d088dd2af6 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:14:59.233515 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d1a697-e464-425e-af06-d5817af7bb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:14:59.234175 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d1a697-e464-425e-af06-d5817af7bb03 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:59.234460 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d1a697-e464-425e-af06-d5817af7bb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:59.234739 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d1a697-e464-425e-af06-d5817af7bb03 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:59.235429 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d1a697-e464-425e-af06-d5817af7bb03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:14:59.237431 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d1a697-e464-425e-af06-d5817af7bb03 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:14:59.345170 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1439/2841] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:14:59 2022] POST /identity/v3/projects => generated 397 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:14:59.346288 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d1a697-e464-425e-af06-d5817af7bb03 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:14:59.348232 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d7d1a697-e464-425e-af06-d5817af7bb03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:14:59.441466 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d1a697-e464-425e-af06-d5817af7bb03 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:14:59.449922 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5161d2b-b14e-453a-a9ed-661b783cc276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:14:59.451074 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5161d2b-b14e-453a-a9ed-661b783cc276 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:59.451982 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5161d2b-b14e-453a-a9ed-661b783cc276 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:59.452425 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5161d2b-b14e-453a-a9ed-661b783cc276 admin admin] PATH_INFO: `/v3/users/73c669f55bbc46cdad7770a07f28d9d2` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:59.453865 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5161d2b-b14e-453a-a9ed-661b783cc276 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73c669f55bbc46cdad7770a07f28d9d2)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:14:59.456070 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5161d2b-b14e-453a-a9ed-661b783cc276 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:14:59.496485 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-2bbbb0d4-a759-4603-8dc2-b78a92c39f1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90422d521a274c7d84652235a88037ab'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:14:59.505813 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-2bbbb0d4-a759-4603-8dc2-b78a92c39f1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90422d521a274c7d84652235a88037ab'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:14:59.506592 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-2bbbb0d4-a759-4603-8dc2-b78a92c39f1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90422d521a274c7d84652235a88037ab'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:14:59.595612 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-2bbbb0d4-a759-4603-8dc2-b78a92c39f1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90422d521a274c7d84652235a88037ab'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:14:59.626038 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-2bbbb0d4-a759-4603-8dc2-b78a92c39f1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90422d521a274c7d84652235a88037ab'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:14:59.638686 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1403/2842] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:14:59 2022] DELETE /identity/v3/users/90422d521a274c7d84652235a88037ab => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:14:59.640835 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a5161d2b-b14e-453a-a9ed-661b783cc276 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73c669f55bbc46cdad7770a07f28d9d2'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:14:59.641023 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a649cf-208d-4654-aebc-91714a4b740b None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:59.641976 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a649cf-208d-4654-aebc-91714a4b740b None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:59.642272 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a649cf-208d-4654-aebc-91714a4b740b None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:59.644624 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1404/2843] 10.222.0.52 () {54 vars in 921 bytes} [Sat May 14 21:14:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:14:59.646064 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a649cf-208d-4654-aebc-91714a4b740b None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:14:59.648189 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-73a649cf-208d-4654-aebc-91714a4b740b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:14:59.672547 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a5161d2b-b14e-453a-a9ed-661b783cc276 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73c669f55bbc46cdad7770a07f28d9d2'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:14:59.681394 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a5161d2b-b14e-453a-a9ed-661b783cc276 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73c669f55bbc46cdad7770a07f28d9d2'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:14:59.749939 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a5161d2b-b14e-453a-a9ed-661b783cc276 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73c669f55bbc46cdad7770a07f28d9d2'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:14:59.750609 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a5161d2b-b14e-453a-a9ed-661b783cc276 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73c669f55bbc46cdad7770a07f28d9d2'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:14:59.757693 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1440/2844] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:14:59 2022] DELETE /identity/v3/users/73c669f55bbc46cdad7770a07f28d9d2 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:14:59.759318 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59f187-3887-483e-9b0a-83d30abc9ccb None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:59.761555 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59f187-3887-483e-9b0a-83d30abc9ccb None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:59.762016 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59f187-3887-483e-9b0a-83d30abc9ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:59.785422 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a649cf-208d-4654-aebc-91714a4b740b None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:14:59.798755 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-fa59f187-3887-483e-9b0a-83d30abc9ccb None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:14:59.803007 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-fa59f187-3887-483e-9b0a-83d30abc9ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:14:59.923592 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6178a488-5c4a-4e9c-8059-f96a9cd37062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:14:59.925426 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178a488-5c4a-4e9c-8059-f96a9cd37062 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:14:59.925749 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178a488-5c4a-4e9c-8059-f96a9cd37062 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:14:59.928482 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178a488-5c4a-4e9c-8059-f96a9cd37062 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:14:59.929417 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6178a488-5c4a-4e9c-8059-f96a9cd37062 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:14:59.931429 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6178a488-5c4a-4e9c-8059-f96a9cd37062 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:15:00.013975 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1441/2845] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:14:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:15:00.015971 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e946862-acaf-4bf5-9abf-9ccdbfa95125 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:15:00.016456 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e946862-acaf-4bf5-9abf-9ccdbfa95125 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:15:00.016921 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e946862-acaf-4bf5-9abf-9ccdbfa95125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:15:00.054355 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1405/2846] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:14:59 2022] POST /identity/v3/users => generated 305 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:15:00.054699 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d0d37c-8101-43d7-90d5-10c3829647d1 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:15:00.054994 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d0d37c-8101-43d7-90d5-10c3829647d1 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:15:00.055279 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d0d37c-8101-43d7-90d5-10c3829647d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:15:00.082015 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-a7d0d37c-8101-43d7-90d5-10c3829647d1 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:15:00.083860 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-a7d0d37c-8101-43d7-90d5-10c3829647d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:15:00.096014 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1406/2847] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:15:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:15:00.097030 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d0d37c-8101-43d7-90d5-10c3829647d1 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:15:00.098457 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-a7d0d37c-8101-43d7-90d5-10c3829647d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:15:00.102341 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-9e946862-acaf-4bf5-9abf-9ccdbfa95125 None None] MFA Rules not processed for user `0812ae67e44d483baf2dbb1a5332a1d7`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:15:00.103618 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-9e946862-acaf-4bf5-9abf-9ccdbfa95125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:15:00.201007 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1442/2848] 10.222.0.52 () {58 vars in 1018 bytes} [Sat May 14 21:15:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:15:00.202067 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e946862-acaf-4bf5-9abf-9ccdbfa95125 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:15:00.204428 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-9e946862-acaf-4bf5-9abf-9ccdbfa95125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:15:00.210118 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d0d37c-8101-43d7-90d5-10c3829647d1 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:15:00.217153 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac35a7-dbd4-4df0-ae0e-6a2b29cdc572 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:15:00.217963 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac35a7-dbd4-4df0-ae0e-6a2b29cdc572 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:15:00.218323 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac35a7-dbd4-4df0-ae0e-6a2b29cdc572 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:15:00.218681 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac35a7-dbd4-4df0-ae0e-6a2b29cdc572 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:15:00.238272 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ac35a7-dbd4-4df0-ae0e-6a2b29cdc572 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:15:00.241201 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ac35a7-dbd4-4df0-ae0e-6a2b29cdc572 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:15:00.248390 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e946862-acaf-4bf5-9abf-9ccdbfa95125 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:15:00.258830 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a77535-c884-4a2f-9f13-5161cb328e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:15:00.260070 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a77535-c884-4a2f-9f13-5161cb328e52 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:15:00.260649 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a77535-c884-4a2f-9f13-5161cb328e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:15:00.261224 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a77535-c884-4a2f-9f13-5161cb328e52 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:15:00.266239 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a77535-c884-4a2f-9f13-5161cb328e52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:15:00.268514 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a77535-c884-4a2f-9f13-5161cb328e52 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:15:00.269960 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1407/2849] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:15:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:15:00.270831 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac35a7-dbd4-4df0-ae0e-6a2b29cdc572 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:15:00.274872 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b0ac35a7-dbd4-4df0-ae0e-6a2b29cdc572 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:15:00.297421 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1443/2850] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:15:00 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:15:00.298706 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a77535-c884-4a2f-9f13-5161cb328e52 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:15:00.301448 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b6a77535-c884-4a2f-9f13-5161cb328e52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:15:00.315847 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac35a7-dbd4-4df0-ae0e-6a2b29cdc572 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:15:00.326939 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a77535-c884-4a2f-9f13-5161cb328e52 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:15:00.327434 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773afd53-a22a-4056-b325-c35b91abea9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:15:00.328171 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773afd53-a22a-4056-b325-c35b91abea9c service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:15:00.328459 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773afd53-a22a-4056-b325-c35b91abea9c service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:15:00.328738 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773afd53-a22a-4056-b325-c35b91abea9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:15:00.341378 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cae9e38-733f-4b95-94eb-ca8314a6d830 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:15:00.342145 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae9e38-733f-4b95-94eb-ca8314a6d830 service placement] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:15:00.342524 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae9e38-733f-4b95-94eb-ca8314a6d830 service placement] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:15:00.342876 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae9e38-733f-4b95-94eb-ca8314a6d830 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:15:00.349288 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773afd53-a22a-4056-b325-c35b91abea9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:15:00.350887 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773afd53-a22a-4056-b325-c35b91abea9c service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:15:00.352854 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cae9e38-733f-4b95-94eb-ca8314a6d830 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:15:00.355235 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cae9e38-733f-4b95-94eb-ca8314a6d830 service placement] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:15:00.363371 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1408/2851] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:15:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:15:00.364077 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773afd53-a22a-4056-b325-c35b91abea9c service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:15:00.374943 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773afd53-a22a-4056-b325-c35b91abea9c service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:15:00.389111 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46196404-532a-4296-9b55-4a299ec09c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:15:00.390215 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46196404-532a-4296-9b55-4a299ec09c81 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:15:00.390486 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46196404-532a-4296-9b55-4a299ec09c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:15:00.390626 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1444/2852] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:15:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:15:00.390908 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46196404-532a-4296-9b55-4a299ec09c81 admin admin] PATH_INFO: `/v3/projects/c79f31fb90604938b4bd03091dea4a49/users/f92bc689e5984b699f7fbae8194faac8/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:15:00.436915 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46196404-532a-4296-9b55-4a299ec09c81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c79f31fb90604938b4bd03091dea4a49, user_id=f92bc689e5984b699f7fbae8194faac8, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:15:00.436915 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46196404-532a-4296-9b55-4a299ec09c81 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:15:00.537887 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1409/2853] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:15:00 2022] PUT /identity/v3/projects/c79f31fb90604938b4bd03091dea4a49/users/f92bc689e5984b699f7fbae8194faac8/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:15:00.542162 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cae9e38-733f-4b95-94eb-ca8314a6d830 service placement] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:15:00.562584 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cae9e38-733f-4b95-94eb-ca8314a6d830 service placement] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:15:00.687123 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34023935-7a21-4837-a6e4-0c30a5ed406f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:15:00.687907 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34023935-7a21-4837-a6e4-0c30a5ed406f admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:15:00.688171 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34023935-7a21-4837-a6e4-0c30a5ed406f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:15:00.688457 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34023935-7a21-4837-a6e4-0c30a5ed406f admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:15:00.689280 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34023935-7a21-4837-a6e4-0c30a5ed406f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:15:00.695266 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34023935-7a21-4837-a6e4-0c30a5ed406f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:15:00.713740 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1445/2854] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:15:00 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:15:00.717978 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46196404-532a-4296-9b55-4a299ec09c81 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:15:00.734626 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46196404-532a-4296-9b55-4a299ec09c81 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:15:00.763269 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb52323-d564-4000-aafc-16e33dfe7d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:15:00.765458 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb52323-d564-4000-aafc-16e33dfe7d2a admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:15:00.765778 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb52323-d564-4000-aafc-16e33dfe7d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:15:00.766073 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb52323-d564-4000-aafc-16e33dfe7d2a admin admin] PATH_INFO: `/v3/projects/c79f31fb90604938b4bd03091dea4a49/users/f92bc689e5984b699f7fbae8194faac8/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:15:00.773559 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb52323-d564-4000-aafc-16e33dfe7d2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c79f31fb90604938b4bd03091dea4a49, user_id=f92bc689e5984b699f7fbae8194faac8, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:15:00.785891 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb52323-d564-4000-aafc-16e33dfe7d2a admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:15:00.817424 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1410/2855] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:15:00 2022] PUT /identity/v3/projects/c79f31fb90604938b4bd03091dea4a49/users/f92bc689e5984b699f7fbae8194faac8/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:15:00.832763 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34023935-7a21-4837-a6e4-0c30a5ed406f admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:15:00.835003 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-34023935-7a21-4837-a6e4-0c30a5ed406f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:15:00.862957 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34023935-7a21-4837-a6e4-0c30a5ed406f admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:15:00.992962 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dafe8b-cfcc-40ec-a6f9-8a057b426869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:15:00.994015 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dafe8b-cfcc-40ec-a6f9-8a057b426869 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:15:00.995100 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dafe8b-cfcc-40ec-a6f9-8a057b426869 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:15:00.995447 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dafe8b-cfcc-40ec-a6f9-8a057b426869 admin admin] PATH_INFO: `/v3/projects/5c422d08f9df4a1eb5f3a3476f83db55` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:15:00.997031 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dafe8b-cfcc-40ec-a6f9-8a057b426869 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c422d08f9df4a1eb5f3a3476f83db55)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:15:00.999098 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dafe8b-cfcc-40ec-a6f9-8a057b426869 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:15:01.137838 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-52dafe8b-cfcc-40ec-a6f9-8a057b426869 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c422d08f9df4a1eb5f3a3476f83db55', 'request_id': 'req-52dafe8b-cfcc-40ec-a6f9-8a057b426869'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:15:01.147371 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-52dafe8b-cfcc-40ec-a6f9-8a057b426869 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c422d08f9df4a1eb5f3a3476f83db55', 'request_id': 'req-52dafe8b-cfcc-40ec-a6f9-8a057b426869'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:15:01.227858 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-52dafe8b-cfcc-40ec-a6f9-8a057b426869 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c422d08f9df4a1eb5f3a3476f83db55', 'request_id': 'req-52dafe8b-cfcc-40ec-a6f9-8a057b426869'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:15:01.263563 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-52dafe8b-cfcc-40ec-a6f9-8a057b426869 admin admin] The token cache is being invalidate because project 5c422d08f9df4a1eb5f3a3476f83db55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:15:01.263869 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-52dafe8b-cfcc-40ec-a6f9-8a057b426869 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:15:01.265249 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-52dafe8b-cfcc-40ec-a6f9-8a057b426869 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:15:01.277728 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1446/2856] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:15:00 2022] DELETE /identity/v3/projects/5c422d08f9df4a1eb5f3a3476f83db55 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:15:01.281028 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f8a5b-f25b-4bfb-b988-7a320d127ba9 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:15:01.281520 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f8a5b-f25b-4bfb-b988-7a320d127ba9 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:15:01.281630 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f8a5b-f25b-4bfb-b988-7a320d127ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:15:01.319929 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-fd5f8a5b-f25b-4bfb-b988-7a320d127ba9 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:15:01.321331 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-fd5f8a5b-f25b-4bfb-b988-7a320d127ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:15:01.436306 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1411/2857] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:15:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:15:01.445196 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0b605-a051-4c5d-8037-753d1a1af9c6 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:15:01.445543 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0b605-a051-4c5d-8037-753d1a1af9c6 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:15:01.445833 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0b605-a051-4c5d-8037-753d1a1af9c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:15:01.493920 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5f8a5b-f25b-4bfb-b988-7a320d127ba9 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:15:01.496046 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-fd5f8a5b-f25b-4bfb-b988-7a320d127ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:15:01.516644 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-0ad0b605-a051-4c5d-8037-753d1a1af9c6 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:15:01.517337 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-0ad0b605-a051-4c5d-8037-753d1a1af9c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:15:01.522457 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5f8a5b-f25b-4bfb-b988-7a320d127ba9 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:15:01.540411 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283e65aa-9351-4da9-a97c-aa1eff9dfc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:15:01.541937 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e65aa-9351-4da9-a97c-aa1eff9dfc7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:15:01.542489 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e65aa-9351-4da9-a97c-aa1eff9dfc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:15:01.542607 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e65aa-9351-4da9-a97c-aa1eff9dfc7c admin admin] PATH_INFO: `/v3/projects/d3f3922f65094861b37de2779faf426d` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:15:01.544296 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283e65aa-9351-4da9-a97c-aa1eff9dfc7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3f3922f65094861b37de2779faf426d)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:15:01.550297 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1447/2858] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:15:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:15:01.551242 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad0b605-a051-4c5d-8037-753d1a1af9c6 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:15:01.556886 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283e65aa-9351-4da9-a97c-aa1eff9dfc7c admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:15:01.569623 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad0b605-a051-4c5d-8037-753d1a1af9c6 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:15:01.593166 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3087a286-e4f7-4a71-a670-331db2faccd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:15:01.593877 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3087a286-e4f7-4a71-a670-331db2faccd2 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:15:01.594174 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3087a286-e4f7-4a71-a670-331db2faccd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:15:01.594458 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3087a286-e4f7-4a71-a670-331db2faccd2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:15:01.595169 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3087a286-e4f7-4a71-a670-331db2faccd2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:15:01.595506 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3087a286-e4f7-4a71-a670-331db2faccd2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:15:01.597689 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3087a286-e4f7-4a71-a670-331db2faccd2 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:15:01.612514 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1448/2859] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:15:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:15:01.617521 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3087a286-e4f7-4a71-a670-331db2faccd2 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:15:01.643314 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3087a286-e4f7-4a71-a670-331db2faccd2 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:15:01.648625 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c8d02d-fd5b-42cd-8058-a9934899b6ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:15:01.651424 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c8d02d-fd5b-42cd-8058-a9934899b6ad admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:15:01.651424 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c8d02d-fd5b-42cd-8058-a9934899b6ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:15:01.651424 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c8d02d-fd5b-42cd-8058-a9934899b6ad admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:15:01.651424 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c8d02d-fd5b-42cd-8058-a9934899b6ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:15:01.653070 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c8d02d-fd5b-42cd-8058-a9934899b6ad admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:15:01.700254 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-283e65aa-9351-4da9-a97c-aa1eff9dfc7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3f3922f65094861b37de2779faf426d', 'request_id': 'req-283e65aa-9351-4da9-a97c-aa1eff9dfc7c'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:15:01.712140 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-283e65aa-9351-4da9-a97c-aa1eff9dfc7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3f3922f65094861b37de2779faf426d', 'request_id': 'req-283e65aa-9351-4da9-a97c-aa1eff9dfc7c'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:15:01.727607 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-283e65aa-9351-4da9-a97c-aa1eff9dfc7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3f3922f65094861b37de2779faf426d', 'request_id': 'req-283e65aa-9351-4da9-a97c-aa1eff9dfc7c'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:15:01.794436 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1449/2860] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:15:01 2022] POST /identity/v3/projects => generated 383 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:15:01.797465 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c8d02d-fd5b-42cd-8058-a9934899b6ad admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:15:01.835269 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-283e65aa-9351-4da9-a97c-aa1eff9dfc7c admin admin] The token cache is being invalidate because project d3f3922f65094861b37de2779faf426d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:15:01.836543 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-283e65aa-9351-4da9-a97c-aa1eff9dfc7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:15:01.847668 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-283e65aa-9351-4da9-a97c-aa1eff9dfc7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:15:01.850684 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1412/2861] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:15:01 2022] DELETE /identity/v3/projects/d3f3922f65094861b37de2779faf426d => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:15:01.870540 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80377587-bd7b-46ec-870e-89343618f550 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:15:01.871075 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80377587-bd7b-46ec-870e-89343618f550 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:15:01.871899 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80377587-bd7b-46ec-870e-89343618f550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:15:01.919587 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-80377587-bd7b-46ec-870e-89343618f550 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:15:01.921404 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-80377587-bd7b-46ec-870e-89343618f550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:15:01.935158 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c8d02d-fd5b-42cd-8058-a9934899b6ad admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:15:01.940348 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1413/2862] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:15:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:15:01.950579 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a59887f-3eda-4d26-9a69-8f0dc7af11ec None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:15:01.950874 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a59887f-3eda-4d26-9a69-8f0dc7af11ec None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:15:01.952390 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a59887f-3eda-4d26-9a69-8f0dc7af11ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:15:01.969921 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc31de3-a147-4c64-99c3-5c6925d16fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:15:01.970616 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc31de3-a147-4c64-99c3-5c6925d16fd1 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:15:01.971332 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc31de3-a147-4c64-99c3-5c6925d16fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:15:01.971332 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc31de3-a147-4c64-99c3-5c6925d16fd1 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:15:01.971892 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc31de3-a147-4c64-99c3-5c6925d16fd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:15:01.980840 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-3a59887f-3eda-4d26-9a69-8f0dc7af11ec None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:15:01.984470 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc31de3-a147-4c64-99c3-5c6925d16fd1 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:15:01.985135 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-3a59887f-3eda-4d26-9a69-8f0dc7af11ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:15:02.000858 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1414/2863] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:15:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:15:02.004751 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a59887f-3eda-4d26-9a69-8f0dc7af11ec None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:15:02.025555 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a59887f-3eda-4d26-9a69-8f0dc7af11ec None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:15:02.043302 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b21a4ca-e4e4-4da6-8c13-ee03bba0ba36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:15:02.044017 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b21a4ca-e4e4-4da6-8c13-ee03bba0ba36 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:15:02.044305 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b21a4ca-e4e4-4da6-8c13-ee03bba0ba36 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:15:02.044586 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b21a4ca-e4e4-4da6-8c13-ee03bba0ba36 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:15:02.045352 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b21a4ca-e4e4-4da6-8c13-ee03bba0ba36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:15:02.045639 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b21a4ca-e4e4-4da6-8c13-ee03bba0ba36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:15:02.047243 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b21a4ca-e4e4-4da6-8c13-ee03bba0ba36 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:15:02.083812 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1415/2864] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:15:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:15:02.087565 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b21a4ca-e4e4-4da6-8c13-ee03bba0ba36 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:15:02.110891 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1450/2865] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:15:01 2022] POST /identity/v3/users => generated 292 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:15:02.121876 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc31de3-a147-4c64-99c3-5c6925d16fd1 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:15:02.123779 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ecc31de3-a147-4c64-99c3-5c6925d16fd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:15:02.149779 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b21a4ca-e4e4-4da6-8c13-ee03bba0ba36 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:15:02.170047 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f9e1f1-aeaa-4718-935c-4fbe4d17ce51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:15:02.172050 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f9e1f1-aeaa-4718-935c-4fbe4d17ce51 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:15:02.172342 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f9e1f1-aeaa-4718-935c-4fbe4d17ce51 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:15:02.173390 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc31de3-a147-4c64-99c3-5c6925d16fd1 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:15:02.173735 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f9e1f1-aeaa-4718-935c-4fbe4d17ce51 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:15:02.174454 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f9e1f1-aeaa-4718-935c-4fbe4d17ce51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:15:02.179947 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f9e1f1-aeaa-4718-935c-4fbe4d17ce51 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:15:02.188720 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f418c554-6932-48f7-bad0-226905283f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:15:02.189404 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418c554-6932-48f7-bad0-226905283f3d admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:15:02.189687 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418c554-6932-48f7-bad0-226905283f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:15:02.189966 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418c554-6932-48f7-bad0-226905283f3d admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:15:02.192968 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f418c554-6932-48f7-bad0-226905283f3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:15:02.194514 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f418c554-6932-48f7-bad0-226905283f3d admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:15:02.233273 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1451/2866] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:15:02 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:15:02.236561 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f418c554-6932-48f7-bad0-226905283f3d admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:15:02.254087 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f418c554-6932-48f7-bad0-226905283f3d admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:15:02.265603 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38666f75-71d7-4c97-bd10-8cceb87fd6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:15:02.266305 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38666f75-71d7-4c97-bd10-8cceb87fd6c6 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:15:02.266594 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38666f75-71d7-4c97-bd10-8cceb87fd6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:15:02.267312 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38666f75-71d7-4c97-bd10-8cceb87fd6c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:15:02.268246 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38666f75-71d7-4c97-bd10-8cceb87fd6c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:15:02.276997 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38666f75-71d7-4c97-bd10-8cceb87fd6c6 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:15:02.323655 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1416/2867] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:15:02 2022] POST /identity/v3/projects => generated 381 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:15:02.327868 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f9e1f1-aeaa-4718-935c-4fbe4d17ce51 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:15:02.335720 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1452/2868] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:15:02 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:15:02.342485 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38666f75-71d7-4c97-bd10-8cceb87fd6c6 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:15:02.361937 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38666f75-71d7-4c97-bd10-8cceb87fd6c6 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:15:02.451526 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f9e1f1-aeaa-4718-935c-4fbe4d17ce51 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:15:02.463627 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6255ed0-6990-45b7-afb7-b3849b0d3194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:15:02.464956 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6255ed0-6990-45b7-afb7-b3849b0d3194 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:15:02.465350 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6255ed0-6990-45b7-afb7-b3849b0d3194 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:15:02.465511 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6255ed0-6990-45b7-afb7-b3849b0d3194 admin admin] PATH_INFO: `/v3/projects/b30891c9ccaf4e1bbdec0c910805d504/users/e87dae577e6c42ba8d14094bd6cad9de/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:15:02.473352 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f82794-25a3-40e2-9cbe-3230ac173918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:15:02.473801 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f82794-25a3-40e2-9cbe-3230ac173918 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:15:02.474094 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f82794-25a3-40e2-9cbe-3230ac173918 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:15:02.474371 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f82794-25a3-40e2-9cbe-3230ac173918 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:15:02.475070 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f82794-25a3-40e2-9cbe-3230ac173918 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:15:02.482927 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f82794-25a3-40e2-9cbe-3230ac173918 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:15:02.515925 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6255ed0-6990-45b7-afb7-b3849b0d3194 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b30891c9ccaf4e1bbdec0c910805d504, user_id=e87dae577e6c42ba8d14094bd6cad9de, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:15:02.518610 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6255ed0-6990-45b7-afb7-b3849b0d3194 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:15:02.621047 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1417/2869] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:15:02 2022] POST /identity/v3/users => generated 291 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:15:02.621983 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1453/2870] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:15:02 2022] PUT /identity/v3/projects/b30891c9ccaf4e1bbdec0c910805d504/users/e87dae577e6c42ba8d14094bd6cad9de/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:15:02.626782 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6255ed0-6990-45b7-afb7-b3849b0d3194 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:15:02.635830 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ccfede-a3b7-4d2c-8619-a8c10cec5460 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:15:02.637201 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ccfede-a3b7-4d2c-8619-a8c10cec5460 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:15:02.637201 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ccfede-a3b7-4d2c-8619-a8c10cec5460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:15:02.727007 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6255ed0-6990-45b7-afb7-b3849b0d3194 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:15:02.727576 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-f7ccfede-a3b7-4d2c-8619-a8c10cec5460 None None] MFA Rules not processed for user `e87dae577e6c42ba8d14094bd6cad9de`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:15:02.730527 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-f7ccfede-a3b7-4d2c-8619-a8c10cec5460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:15:02.734855 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346c915-2d5c-4bf7-bece-e11af254b0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:15:02.735701 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346c915-2d5c-4bf7-bece-e11af254b0e2 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:15:02.736210 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346c915-2d5c-4bf7-bece-e11af254b0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:15:02.736610 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346c915-2d5c-4bf7-bece-e11af254b0e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:15:02.738216 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3346c915-2d5c-4bf7-bece-e11af254b0e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:15:02.741385 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3346c915-2d5c-4bf7-bece-e11af254b0e2 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:15:02.754450 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1454/2871] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:15:02 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:15:02.758656 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346c915-2d5c-4bf7-bece-e11af254b0e2 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:15:02.769246 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346c915-2d5c-4bf7-bece-e11af254b0e2 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:15:02.784421 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c2e9a-d06d-4a13-a5d8-55e92a2adac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:15:02.785654 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c2e9a-d06d-4a13-a5d8-55e92a2adac1 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:15:02.786018 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c2e9a-d06d-4a13-a5d8-55e92a2adac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:15:02.786376 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c2e9a-d06d-4a13-a5d8-55e92a2adac1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:15:02.787211 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0c2e9a-d06d-4a13-a5d8-55e92a2adac1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:15:02.789014 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0c2e9a-d06d-4a13-a5d8-55e92a2adac1 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:15:02.807523 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1455/2872] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:15:02 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:15:02.811673 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c2e9a-d06d-4a13-a5d8-55e92a2adac1 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:15:02.826674 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c2e9a-d06d-4a13-a5d8-55e92a2adac1 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:15:02.831846 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dbf99e-dc63-4fe8-bd18-5b5f776f64dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:15:02.834497 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dbf99e-dc63-4fe8-bd18-5b5f776f64dc admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:15:02.834497 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dbf99e-dc63-4fe8-bd18-5b5f776f64dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:15:02.834497 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dbf99e-dc63-4fe8-bd18-5b5f776f64dc admin admin] PATH_INFO: `/v3/projects/524b620ba1184991b80e9a72efa9a9a4/users/c7fbe69d10fc47f0b0699483e75f88e3/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:15:02.851567 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1418/2873] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:15:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:15:02.854455 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dbf99e-dc63-4fe8-bd18-5b5f776f64dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=524b620ba1184991b80e9a72efa9a9a4, user_id=c7fbe69d10fc47f0b0699483e75f88e3, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:15:02.857409 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dbf99e-dc63-4fe8-bd18-5b5f776f64dc admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:15:02.863713 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad2bba-b044-4b19-8a0e-c4e3d5804b98 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:15:02.864006 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad2bba-b044-4b19-8a0e-c4e3d5804b98 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:15:02.864330 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad2bba-b044-4b19-8a0e-c4e3d5804b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:15:02.909275 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-c6ad2bba-b044-4b19-8a0e-c4e3d5804b98 None None] MFA Rules not processed for user `e87dae577e6c42ba8d14094bd6cad9de`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:15:02.912976 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c6ad2bba-b044-4b19-8a0e-c4e3d5804b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:15:02.946583 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1419/2874] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:15:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:15:02.965549 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ad2bba-b044-4b19-8a0e-c4e3d5804b98 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:15:02.967332 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c6ad2bba-b044-4b19-8a0e-c4e3d5804b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:15:02.967945 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1456/2875] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:15:02 2022] PUT /identity/v3/projects/524b620ba1184991b80e9a72efa9a9a4/users/c7fbe69d10fc47f0b0699483e75f88e3/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:15:02.979278 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec12d0-fe65-4bb5-ac75-a73e840b04d9 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:15:02.979682 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec12d0-fe65-4bb5-ac75-a73e840b04d9 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:15:02.980035 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec12d0-fe65-4bb5-ac75-a73e840b04d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:15:03.015303 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-bfec12d0-fe65-4bb5-ac75-a73e840b04d9 None None] MFA Rules not processed for user `c7fbe69d10fc47f0b0699483e75f88e3`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:15:03.017266 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-bfec12d0-fe65-4bb5-ac75-a73e840b04d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:15:03.203450 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ad2bba-b044-4b19-8a0e-c4e3d5804b98 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:15:03.204615 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1457/2876] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:15:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:15:03.206535 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69a358-c927-4009-a6e1-3db64dc5f66f None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:15:03.206834 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69a358-c927-4009-a6e1-3db64dc5f66f None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:15:03.207119 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69a358-c927-4009-a6e1-3db64dc5f66f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:15:03.314246 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-0f69a358-c927-4009-a6e1-3db64dc5f66f None None] MFA Rules not processed for user `f92bc689e5984b699f7fbae8194faac8`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:15:03.314246 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-0f69a358-c927-4009-a6e1-3db64dc5f66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:15:03.368841 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc91e27-8401-410c-a8a0-bec49fd70296 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:15:03.371241 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc91e27-8401-410c-a8a0-bec49fd70296 service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:15:03.371916 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc91e27-8401-410c-a8a0-bec49fd70296 service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:15:03.372419 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc91e27-8401-410c-a8a0-bec49fd70296 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:15:03.592554 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1458/2877] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:15:03 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:15:03.592554 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f69a358-c927-4009-a6e1-3db64dc5f66f None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:15:03.592554 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-0f69a358-c927-4009-a6e1-3db64dc5f66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:15:03.600908 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f69a358-c927-4009-a6e1-3db64dc5f66f None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:15:03.608898 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2a00a-5d35-4489-80fd-fa65829be360 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:15:03.609648 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2a00a-5d35-4489-80fd-fa65829be360 service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:15:03.610016 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2a00a-5d35-4489-80fd-fa65829be360 service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:15:03.610348 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2a00a-5d35-4489-80fd-fa65829be360 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:15:03.614157 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc91e27-8401-410c-a8a0-bec49fd70296 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:15:03.616016 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc91e27-8401-410c-a8a0-bec49fd70296 service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:15:03.619205 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df2a00a-5d35-4489-80fd-fa65829be360 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:15:03.620907 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df2a00a-5d35-4489-80fd-fa65829be360 service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:15:03.640963 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1420/2879] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:15:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 676 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:15:03.642149 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee6d98-81e3-4b31-bba7-523dd13149f4 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:15:03.642839 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1459/2879] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:15:03 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:15:03.643215 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee6d98-81e3-4b31-bba7-523dd13149f4 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:15:03.643592 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee6d98-81e3-4b31-bba7-523dd13149f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:15:03.668474 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-7dee6d98-81e3-4b31-bba7-523dd13149f4 None None] MFA Rules not processed for user `cfcb989a491440b3bf74ddc055ee14d3`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:15:03.669825 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-7dee6d98-81e3-4b31-bba7-523dd13149f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:15:03.726698 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2a00a-5d35-4489-80fd-fa65829be360 service nova] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:15:03.764706 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1421/2880] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:15:03 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:15:03.847035 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2a00a-5d35-4489-80fd-fa65829be360 service nova] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:15:03.852304 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8588921-4a74-459c-8fdb-223e2d0eb984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:15:03.853527 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8588921-4a74-459c-8fdb-223e2d0eb984 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:15:03.853822 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8588921-4a74-459c-8fdb-223e2d0eb984 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:15:03.854096 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8588921-4a74-459c-8fdb-223e2d0eb984 admin admin] PATH_INFO: `/v3/users/c7fbe69d10fc47f0b0699483e75f88e3` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:15:03.855344 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8588921-4a74-459c-8fdb-223e2d0eb984 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7fbe69d10fc47f0b0699483e75f88e3)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:15:03.859328 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8588921-4a74-459c-8fdb-223e2d0eb984 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:15:04.209636 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b8588921-4a74-459c-8fdb-223e2d0eb984 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7fbe69d10fc47f0b0699483e75f88e3'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:15:04.221803 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b8588921-4a74-459c-8fdb-223e2d0eb984 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7fbe69d10fc47f0b0699483e75f88e3'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:15:04.238349 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b8588921-4a74-459c-8fdb-223e2d0eb984 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7fbe69d10fc47f0b0699483e75f88e3'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:15:04.343134 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b8588921-4a74-459c-8fdb-223e2d0eb984 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7fbe69d10fc47f0b0699483e75f88e3'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:15:04.344467 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b8588921-4a74-459c-8fdb-223e2d0eb984 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7fbe69d10fc47f0b0699483e75f88e3'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:15:04.344873 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dee6d98-81e3-4b31-bba7-523dd13149f4 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:15:04.380365 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1460/2881] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:15:03 2022] DELETE /identity/v3/users/c7fbe69d10fc47f0b0699483e75f88e3 => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:15:04.381082 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dee6d98-81e3-4b31-bba7-523dd13149f4 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:15:04.386012 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47111c-95f4-4775-ae3a-7a27fde6de59 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:15:04.386589 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47111c-95f4-4775-ae3a-7a27fde6de59 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:15:04.386992 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47111c-95f4-4775-ae3a-7a27fde6de59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:15:04.425928 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-cc47111c-95f4-4775-ae3a-7a27fde6de59 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:15:04.428674 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-cc47111c-95f4-4775-ae3a-7a27fde6de59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:15:04.487273 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a16cbfa-9fa7-4ac7-92bf-108e99d18938 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:15:04.488162 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16cbfa-9fa7-4ac7-92bf-108e99d18938 service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:15:04.491897 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16cbfa-9fa7-4ac7-92bf-108e99d18938 service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:15:04.495374 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16cbfa-9fa7-4ac7-92bf-108e99d18938 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:15:04.501810 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-2a16cbfa-9fa7-4ac7-92bf-108e99d18938 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:15:04.570240 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1461/2882] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:15:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:15:04.579813 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc47111c-95f4-4775-ae3a-7a27fde6de59 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:15:04.581449 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-cc47111c-95f4-4775-ae3a-7a27fde6de59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:15:04.615190 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a16cbfa-9fa7-4ac7-92bf-108e99d18938 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:15:04.627381 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a16cbfa-9fa7-4ac7-92bf-108e99d18938 service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:15:04.647998 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1422/2883] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:15:04 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:15:04.710712 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc47111c-95f4-4775-ae3a-7a27fde6de59 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:15:04.717701 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd4dbb-9235-4ece-b0a8-786466470317 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:15:04.717701 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd4dbb-9235-4ece-b0a8-786466470317 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:15:04.717701 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd4dbb-9235-4ece-b0a8-786466470317 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:15:04.717701 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd4dbb-9235-4ece-b0a8-786466470317 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:15:04.736069 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcd4dbb-9235-4ece-b0a8-786466470317 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:15:04.738944 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcd4dbb-9235-4ece-b0a8-786466470317 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:15:04.752206 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1462/2884] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:15:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:15:05.419110 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a16cbfa-9fa7-4ac7-92bf-108e99d18938 service nova] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:15:05.424069 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-2a16cbfa-9fa7-4ac7-92bf-108e99d18938 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:15:05.458932 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a16cbfa-9fa7-4ac7-92bf-108e99d18938 service nova] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:15:05.468197 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbe5476-e7b9-4045-bcc9-9b2be989d8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:15:05.469368 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe5476-e7b9-4045-bcc9-9b2be989d8c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:15:05.469827 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe5476-e7b9-4045-bcc9-9b2be989d8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:15:05.470253 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe5476-e7b9-4045-bcc9-9b2be989d8c1 admin admin] PATH_INFO: `/v3/projects/524b620ba1184991b80e9a72efa9a9a4` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:15:05.471781 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbe5476-e7b9-4045-bcc9-9b2be989d8c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=524b620ba1184991b80e9a72efa9a9a4)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:15:05.474227 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbe5476-e7b9-4045-bcc9-9b2be989d8c1 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:15:05.740534 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7bbe5476-e7b9-4045-bcc9-9b2be989d8c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '524b620ba1184991b80e9a72efa9a9a4', 'request_id': 'req-7bbe5476-e7b9-4045-bcc9-9b2be989d8c1'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:15:05.768133 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7bbe5476-e7b9-4045-bcc9-9b2be989d8c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '524b620ba1184991b80e9a72efa9a9a4', 'request_id': 'req-7bbe5476-e7b9-4045-bcc9-9b2be989d8c1'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:15:05.787420 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7bbe5476-e7b9-4045-bcc9-9b2be989d8c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '524b620ba1184991b80e9a72efa9a9a4', 'request_id': 'req-7bbe5476-e7b9-4045-bcc9-9b2be989d8c1'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:15:05.860108 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7bbe5476-e7b9-4045-bcc9-9b2be989d8c1 admin admin] The token cache is being invalidate because project 524b620ba1184991b80e9a72efa9a9a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:15:05.860476 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7bbe5476-e7b9-4045-bcc9-9b2be989d8c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:15:05.861445 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7bbe5476-e7b9-4045-bcc9-9b2be989d8c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:15:05.866825 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1423/2885] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:15:05 2022] DELETE /identity/v3/projects/524b620ba1184991b80e9a72efa9a9a4 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:15:05.873744 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353cf32-d7e0-4313-bbbb-a402e722cc7a None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:15:05.874282 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353cf32-d7e0-4313-bbbb-a402e722cc7a None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:15:05.874498 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353cf32-d7e0-4313-bbbb-a402e722cc7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:15:05.898369 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-b353cf32-d7e0-4313-bbbb-a402e722cc7a None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:15:05.900018 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b353cf32-d7e0-4313-bbbb-a402e722cc7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:15:05.959594 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36276302-3f16-4813-aa63-35bbd5100b9d None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:15:05.959594 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36276302-3f16-4813-aa63-35bbd5100b9d None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:15:05.959594 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36276302-3f16-4813-aa63-35bbd5100b9d None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:15:05.959594 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1424/2886] 10.222.0.52 () {54 vars in 921 bytes} [Sat May 14 21:15:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:15:05.961080 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784bcd33-707f-453c-9d44-7867c49c9f9f None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:15:05.962016 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784bcd33-707f-453c-9d44-7867c49c9f9f None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:15:05.962359 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784bcd33-707f-453c-9d44-7867c49c9f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:15:05.991858 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-784bcd33-707f-453c-9d44-7867c49c9f9f None None] MFA Rules not processed for user `0812ae67e44d483baf2dbb1a5332a1d7`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:15:05.993357 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-784bcd33-707f-453c-9d44-7867c49c9f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:15:06.004057 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1463/2887] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:15:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:15:06.013265 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e7838-ebd7-4879-86df-df618854703f None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:15:06.013877 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e7838-ebd7-4879-86df-df618854703f None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:15:06.014907 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e7838-ebd7-4879-86df-df618854703f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:15:06.054515 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-bf9e7838-ebd7-4879-86df-df618854703f None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:15:06.054515 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-bf9e7838-ebd7-4879-86df-df618854703f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:15:06.078244 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1464/2888] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:15:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:15:06.090424 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9e7838-ebd7-4879-86df-df618854703f None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:15:06.100245 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9e7838-ebd7-4879-86df-df618854703f None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:15:06.106153 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddbf600-946d-4b74-a4c4-37a9abd0cc4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:15:06.110954 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddbf600-946d-4b74-a4c4-37a9abd0cc4d admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:15:06.110954 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddbf600-946d-4b74-a4c4-37a9abd0cc4d admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:15:06.110954 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddbf600-946d-4b74-a4c4-37a9abd0cc4d admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:15:06.110954 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddbf600-946d-4b74-a4c4-37a9abd0cc4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:15:06.110954 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddbf600-946d-4b74-a4c4-37a9abd0cc4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:15:06.110954 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddbf600-946d-4b74-a4c4-37a9abd0cc4d admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:15:06.133713 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1465/2889] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:15:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:15:06.138147 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddbf600-946d-4b74-a4c4-37a9abd0cc4d admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:15:06.151033 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddbf600-946d-4b74-a4c4-37a9abd0cc4d admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:15:06.157131 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6725874e-9675-446e-a55d-2f9c87bc03ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:15:06.157708 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1425/2890] 10.222.0.52 () {58 vars in 1018 bytes} [Sat May 14 21:15:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:15:06.161765 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725874e-9675-446e-a55d-2f9c87bc03ac admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:15:06.162304 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725874e-9675-446e-a55d-2f9c87bc03ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:15:06.162853 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725874e-9675-446e-a55d-2f9c87bc03ac admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:15:06.163988 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6725874e-9675-446e-a55d-2f9c87bc03ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:15:06.166709 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784bcd33-707f-453c-9d44-7867c49c9f9f None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:15:06.170339 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6725874e-9675-446e-a55d-2f9c87bc03ac admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:15:06.170478 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-784bcd33-707f-453c-9d44-7867c49c9f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:15:06.187002 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784bcd33-707f-453c-9d44-7867c49c9f9f None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:15:06.192850 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f81978-a892-4b44-8459-5a21b66b6c1b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:15:06.195416 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f81978-a892-4b44-8459-5a21b66b6c1b service placement] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:15:06.195416 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f81978-a892-4b44-8459-5a21b66b6c1b service placement] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:15:06.195416 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f81978-a892-4b44-8459-5a21b66b6c1b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:15:06.206719 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f81978-a892-4b44-8459-5a21b66b6c1b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:15:06.209679 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f81978-a892-4b44-8459-5a21b66b6c1b service placement] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:15:06.232509 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1426/2891] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:15:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:15:06.305817 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f81978-a892-4b44-8459-5a21b66b6c1b service placement] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:15:06.306158 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1466/2892] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:15:06 2022] POST /identity/v3/projects => generated 383 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:15:06.320335 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f81978-a892-4b44-8459-5a21b66b6c1b service placement] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:15:06.439133 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9915c510-38f9-43ad-bd2b-8201d1550230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:15:06.439848 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9915c510-38f9-43ad-bd2b-8201d1550230 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:15:06.443294 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9915c510-38f9-43ad-bd2b-8201d1550230 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:15:06.443294 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9915c510-38f9-43ad-bd2b-8201d1550230 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:15:06.443294 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9915c510-38f9-43ad-bd2b-8201d1550230 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:15:06.444988 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9915c510-38f9-43ad-bd2b-8201d1550230 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:15:06.577244 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1427/2893] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:15:06 2022] POST /identity/v3/users => generated 292 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:15:06.581938 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6725874e-9675-446e-a55d-2f9c87bc03ac admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:15:06.593245 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6725874e-9675-446e-a55d-2f9c87bc03ac admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:15:06.602557 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627f9839-4552-4d66-a523-8c9072681ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:15:06.603809 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f9839-4552-4d66-a523-8c9072681ded admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:15:06.604309 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f9839-4552-4d66-a523-8c9072681ded admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:15:06.604694 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f9839-4552-4d66-a523-8c9072681ded admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:15:06.605430 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627f9839-4552-4d66-a523-8c9072681ded admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:15:06.607110 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627f9839-4552-4d66-a523-8c9072681ded admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:15:06.621807 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1467/2894] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:15:06 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:15:06.631054 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9915c510-38f9-43ad-bd2b-8201d1550230 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:15:06.645069 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9915c510-38f9-43ad-bd2b-8201d1550230 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:15:06.652832 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd7a1a-96c1-4bb7-a33c-aca323ff96fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:15:06.653655 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd7a1a-96c1-4bb7-a33c-aca323ff96fa admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:15:06.653965 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd7a1a-96c1-4bb7-a33c-aca323ff96fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:15:06.654245 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd7a1a-96c1-4bb7-a33c-aca323ff96fa admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:15:06.655149 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddd7a1a-96c1-4bb7-a33c-aca323ff96fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:15:06.657219 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddd7a1a-96c1-4bb7-a33c-aca323ff96fa admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:15:06.676209 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1428/2895] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:15:06 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:15:06.677173 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627f9839-4552-4d66-a523-8c9072681ded admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:15:06.702295 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627f9839-4552-4d66-a523-8c9072681ded admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:15:06.702295 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae4940c-760c-4a86-8911-838d093c744c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:15:06.702295 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae4940c-760c-4a86-8911-838d093c744c admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:15:06.702295 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae4940c-760c-4a86-8911-838d093c744c admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:15:06.703030 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae4940c-760c-4a86-8911-838d093c744c admin admin] PATH_INFO: `/v3/projects/611dce182666487684bf1e2a687c523a/users/053ae4d2abd445968a2d0a953fdbfc63/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:15:06.721773 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae4940c-760c-4a86-8911-838d093c744c admin admin] RBAC: Authorizing `identity:create_grant(project_id=611dce182666487684bf1e2a687c523a, user_id=053ae4d2abd445968a2d0a953fdbfc63, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:15:06.725683 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae4940c-760c-4a86-8911-838d093c744c admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:15:06.817857 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1468/2896] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:15:06 2022] PUT /identity/v3/projects/611dce182666487684bf1e2a687c523a/users/053ae4d2abd445968a2d0a953fdbfc63/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:15:06.824332 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d801a-45a9-4627-9f96-aaaa8995aab3 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:15:06.824609 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d801a-45a9-4627-9f96-aaaa8995aab3 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:15:06.828620 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d801a-45a9-4627-9f96-aaaa8995aab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:15:06.879138 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-982d801a-45a9-4627-9f96-aaaa8995aab3 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:15:06.881181 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-982d801a-45a9-4627-9f96-aaaa8995aab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:15:06.975248 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1429/2897] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:15:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:15:06.991143 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae4940c-760c-4a86-8911-838d093c744c admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:15:06.994956 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-1ae4940c-760c-4a86-8911-838d093c744c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:15:07.100827 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae4940c-760c-4a86-8911-838d093c744c admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:15:07.111150 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a8016-c239-43f4-ac61-a80754539bc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:15:07.112283 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a8016-c239-43f4-ac61-a80754539bc0 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:15:07.112725 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a8016-c239-43f4-ac61-a80754539bc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:15:07.113156 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a8016-c239-43f4-ac61-a80754539bc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:15:07.133763 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083a8016-c239-43f4-ac61-a80754539bc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:15:07.135616 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083a8016-c239-43f4-ac61-a80754539bc0 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:15:07.148220 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1469/2898] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:15:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:15:19.600776 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b4bdfd-5d35-4644-ba86-d45684a73b76 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:15:19.601288 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b4bdfd-5d35-4644-ba86-d45684a73b76 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:15:19.601288 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b4bdfd-5d35-4644-ba86-d45684a73b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:15:19.638822 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-12b4bdfd-5d35-4644-ba86-d45684a73b76 None None] MFA Rules not processed for user `053ae4d2abd445968a2d0a953fdbfc63`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:15:19.640104 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-12b4bdfd-5d35-4644-ba86-d45684a73b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:15:19.737207 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1430/2899] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:15:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:15:19.972267 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a8016-c239-43f4-ac61-a80754539bc0 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:15:19.975026 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-083a8016-c239-43f4-ac61-a80754539bc0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:15:20.112710 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a8016-c239-43f4-ac61-a80754539bc0 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:15:20.134608 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c95a9-176a-4482-9723-b5d04869f011 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:15:20.135291 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c95a9-176a-4482-9723-b5d04869f011 service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:15:20.137110 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c95a9-176a-4482-9723-b5d04869f011 service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:15:20.137809 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c95a9-176a-4482-9723-b5d04869f011 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:15:20.159198 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579c95a9-176a-4482-9723-b5d04869f011 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:15:20.160882 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579c95a9-176a-4482-9723-b5d04869f011 service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:15:20.183348 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1470/2900] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:15:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:15:24.206955 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad549c38-9796-4639-84ff-01cb5185d19f None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:15:24.208052 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad549c38-9796-4639-84ff-01cb5185d19f None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:15:24.208543 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad549c38-9796-4639-84ff-01cb5185d19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:15:24.229082 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-ad549c38-9796-4639-84ff-01cb5185d19f None None] MFA Rules not processed for user `053ae4d2abd445968a2d0a953fdbfc63`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:15:24.230496 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-ad549c38-9796-4639-84ff-01cb5185d19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:15:24.260750 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1431/2901] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:15:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:15:24.567454 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb8779d-7452-429c-bfe0-0c3a768ae559 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:15:24.568039 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb8779d-7452-429c-bfe0-0c3a768ae559 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:15:24.568277 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb8779d-7452-429c-bfe0-0c3a768ae559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:15:24.592863 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-5cb8779d-7452-429c-bfe0-0c3a768ae559 None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:15:24.594094 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-5cb8779d-7452-429c-bfe0-0c3a768ae559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:15:24.713031 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1471/2902] 10.222.0.52 () {58 vars in 1009 bytes} [Sat May 14 21:15:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:15:24.726986 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad549c38-9796-4639-84ff-01cb5185d19f None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:15:24.730163 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-ad549c38-9796-4639-84ff-01cb5185d19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:15:24.865375 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad549c38-9796-4639-84ff-01cb5185d19f None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:15:24.876955 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a690dfd0-265e-474d-afa7-d57569f89e13 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:15:24.877927 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690dfd0-265e-474d-afa7-d57569f89e13 service swift] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:15:24.878375 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690dfd0-265e-474d-afa7-d57569f89e13 service swift] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:15:24.878810 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690dfd0-265e-474d-afa7-d57569f89e13 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:15:24.898856 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a690dfd0-265e-474d-afa7-d57569f89e13 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:15:24.901381 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a690dfd0-265e-474d-afa7-d57569f89e13 service swift] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:15:24.931678 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1432/2903] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 21:15:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 21:15:24.993469 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09160821-6e13-4a5d-a42e-47c339c6eb74 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:15:24.994021 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09160821-6e13-4a5d-a42e-47c339c6eb74 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:15:24.994364 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09160821-6e13-4a5d-a42e-47c339c6eb74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:15:25.017151 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-09160821-6e13-4a5d-a42e-47c339c6eb74 None None] MFA Rules not processed for user `038739f45c3d4ab09457d6eed20b41d4`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:15:25.022369 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-09160821-6e13-4a5d-a42e-47c339c6eb74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:15:25.170953 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1472/2904] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:15:24 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:15:31.050739 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b665103-3389-4456-966c-0af68f23ee30 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:15:31.051374 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b665103-3389-4456-966c-0af68f23ee30 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:15:31.051374 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b665103-3389-4456-966c-0af68f23ee30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:15:31.076057 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-2b665103-3389-4456-966c-0af68f23ee30 None None] MFA Rules not processed for user `911b9cf4e9bc424bba387e2ff966cb46`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:15:31.077611 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-2b665103-3389-4456-966c-0af68f23ee30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:15:31.154425 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1433/2905] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:15:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:15:32.084367 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09160821-6e13-4a5d-a42e-47c339c6eb74 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:15:32.086751 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-09160821-6e13-4a5d-a42e-47c339c6eb74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:15:32.111383 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09160821-6e13-4a5d-a42e-47c339c6eb74 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:15:32.121259 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e784580c-37f4-411f-b49b-45e03a628af0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:15:32.122256 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e784580c-37f4-411f-b49b-45e03a628af0 service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:15:32.122737 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e784580c-37f4-411f-b49b-45e03a628af0 service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:15:32.123013 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e784580c-37f4-411f-b49b-45e03a628af0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:15:32.125122 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e784580c-37f4-411f-b49b-45e03a628af0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:15:32.222816 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e784580c-37f4-411f-b49b-45e03a628af0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:15:32.226796 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e784580c-37f4-411f-b49b-45e03a628af0 service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:15:32.267921 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1473/2906] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:15:32 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:15:36.260387 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2dcded-1731-4380-9c6f-35f080a3d3c2 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:15:36.261503 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2dcded-1731-4380-9c6f-35f080a3d3c2 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:15:36.261794 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2dcded-1731-4380-9c6f-35f080a3d3c2 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:15:36.263230 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1434/2907] 10.222.0.52 () {54 vars in 921 bytes} [Sat May 14 21:15:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:15:36.284811 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a0a9b-34db-41de-9ca9-82758e4597d8 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:15:36.284811 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a0a9b-34db-41de-9ca9-82758e4597d8 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:15:36.285396 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a0a9b-34db-41de-9ca9-82758e4597d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:15:36.308733 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-9c8a0a9b-34db-41de-9ca9-82758e4597d8 None None] MFA Rules not processed for user `0812ae67e44d483baf2dbb1a5332a1d7`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:15:36.311034 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-9c8a0a9b-34db-41de-9ca9-82758e4597d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:15:36.407963 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1474/2908] 10.222.0.52 () {58 vars in 1018 bytes} [Sat May 14 21:15:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:15:36.433291 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2dcded-1731-4380-9c6f-35f080a3d3c2 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:15:36.458906 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2dcded-1731-4380-9c6f-35f080a3d3c2 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:15:36.467869 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d056c6-8d5a-4bf9-b1c5-829ef1fb3fa1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:15:36.469719 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d056c6-8d5a-4bf9-b1c5-829ef1fb3fa1 service placement] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:15:36.470241 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d056c6-8d5a-4bf9-b1c5-829ef1fb3fa1 service placement] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:15:36.470689 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d056c6-8d5a-4bf9-b1c5-829ef1fb3fa1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:15:36.480506 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d056c6-8d5a-4bf9-b1c5-829ef1fb3fa1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:15:36.482119 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d056c6-8d5a-4bf9-b1c5-829ef1fb3fa1 service placement] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:15:36.492717 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1435/2909] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:15:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:15:37.786199 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd79e02-f090-40a1-be12-18d2e97734ca None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:15:37.790251 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd79e02-f090-40a1-be12-18d2e97734ca None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:15:37.790251 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd79e02-f090-40a1-be12-18d2e97734ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:15:37.822816 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-5bd79e02-f090-40a1-be12-18d2e97734ca None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:15:37.825429 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-5bd79e02-f090-40a1-be12-18d2e97734ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:15:37.835421 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1475/2910] 10.222.0.52 () {58 vars in 1009 bytes} [Sat May 14 21:15:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:15:37.858684 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d056c6-8d5a-4bf9-b1c5-829ef1fb3fa1 service placement] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:15:37.870450 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d056c6-8d5a-4bf9-b1c5-829ef1fb3fa1 service placement] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:15:37.879888 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b205e1-1a17-448f-b0a7-ca3e6414c395 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:15:37.880549 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b205e1-1a17-448f-b0a7-ca3e6414c395 service swift] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:15:37.880839 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b205e1-1a17-448f-b0a7-ca3e6414c395 service swift] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:15:37.881124 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b205e1-1a17-448f-b0a7-ca3e6414c395 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:15:37.893883 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b205e1-1a17-448f-b0a7-ca3e6414c395 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:15:37.895953 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b205e1-1a17-448f-b0a7-ca3e6414c395 service swift] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:15:37.906818 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1436/2911] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 21:15:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 21:15:39.228925 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc2c0e7-b730-4a66-9616-5667f53e0695 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:15:39.229531 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc2c0e7-b730-4a66-9616-5667f53e0695 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:15:39.229531 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc2c0e7-b730-4a66-9616-5667f53e0695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:15:39.280559 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-6cc2c0e7-b730-4a66-9616-5667f53e0695 None None] MFA Rules not processed for user `0f1b0e2b025d4eceaa90e1616d0a9db8`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:15:39.282171 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-6cc2c0e7-b730-4a66-9616-5667f53e0695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:15:39.315720 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1476/2912] 10.222.0.52 () {58 vars in 1018 bytes} [Sat May 14 21:15:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:15:39.341988 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b205e1-1a17-448f-b0a7-ca3e6414c395 service swift] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:15:39.344884 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-55b205e1-1a17-448f-b0a7-ca3e6414c395 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:15:39.376924 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b205e1-1a17-448f-b0a7-ca3e6414c395 service swift] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:15:39.387733 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c8b2f-dc4e-40a3-8341-b9dad8187238 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:15:39.388713 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c8b2f-dc4e-40a3-8341-b9dad8187238 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:15:39.388990 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c8b2f-dc4e-40a3-8341-b9dad8187238 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:15:39.389437 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c8b2f-dc4e-40a3-8341-b9dad8187238 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:15:39.420781 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44c8b2f-dc4e-40a3-8341-b9dad8187238 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:15:39.422252 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44c8b2f-dc4e-40a3-8341-b9dad8187238 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:15:39.461682 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1437/2913] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:15:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:15:50.035797 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4884f6c-358d-415b-92ec-0b433d595e59 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:15:50.039231 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4884f6c-358d-415b-92ec-0b433d595e59 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:15:50.041227 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4884f6c-358d-415b-92ec-0b433d595e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:15:50.086729 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-b4884f6c-358d-415b-92ec-0b433d595e59 None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:15:50.088532 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b4884f6c-358d-415b-92ec-0b433d595e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:15:50.100191 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1477/2914] 10.222.0.52 () {58 vars in 967 bytes} [Sat May 14 21:15:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:15:50.120289 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c8b2f-dc4e-40a3-8341-b9dad8187238 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:15:50.133217 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c8b2f-dc4e-40a3-8341-b9dad8187238 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:15:50.139069 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1e1573-711e-4073-b643-f9260271823d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:15:50.139806 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e1573-711e-4073-b643-f9260271823d service swift] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:15:50.140075 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e1573-711e-4073-b643-f9260271823d service swift] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:15:50.140538 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e1573-711e-4073-b643-f9260271823d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:15:50.150987 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1e1573-711e-4073-b643-f9260271823d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:15:50.153274 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1e1573-711e-4073-b643-f9260271823d service swift] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:15:50.187702 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1438/2915] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 21:15:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 21:15:52.376797 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a030606-e75b-4265-8118-1aca76432052 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:15:52.377404 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a030606-e75b-4265-8118-1aca76432052 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:15:52.377568 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a030606-e75b-4265-8118-1aca76432052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:15:52.397627 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-9a030606-e75b-4265-8118-1aca76432052 None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:15:52.398938 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-9a030606-e75b-4265-8118-1aca76432052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:15:52.407347 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1478/2916] 10.222.0.52 () {58 vars in 967 bytes} [Sat May 14 21:15:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:15:52.443249 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1e1573-711e-4073-b643-f9260271823d service swift] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:15:52.454541 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1e1573-711e-4073-b643-f9260271823d service swift] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:15:52.460336 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4793068-962a-4bf0-97ba-33b8d9b7c518 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:15:52.461303 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4793068-962a-4bf0-97ba-33b8d9b7c518 service swift] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:15:52.461729 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4793068-962a-4bf0-97ba-33b8d9b7c518 service swift] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:15:52.462692 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4793068-962a-4bf0-97ba-33b8d9b7c518 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:15:52.475876 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4793068-962a-4bf0-97ba-33b8d9b7c518 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:15:52.477737 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4793068-962a-4bf0-97ba-33b8d9b7c518 service swift] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:15:52.487229 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1439/2917] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 21:15:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 21:15:52.656920 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3cc23-ba0d-417d-82db-09471e909a13 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:15:52.657303 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3cc23-ba0d-417d-82db-09471e909a13 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:15:52.657467 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3cc23-ba0d-417d-82db-09471e909a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:15:52.682495 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-74f3cc23-ba0d-417d-82db-09471e909a13 None None] MFA Rules not processed for user `5b93d6c3d03d407f8be4aa38e2fbb154`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:15:52.684083 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-74f3cc23-ba0d-417d-82db-09471e909a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:15:52.775901 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1479/2918] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:15:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:15:54.947782 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b0045-985b-4de7-aa28-6648f237c2ad None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:15:54.948409 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b0045-985b-4de7-aa28-6648f237c2ad None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:15:54.948409 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b0045-985b-4de7-aa28-6648f237c2ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:15:54.970593 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-4a9b0045-985b-4de7-aa28-6648f237c2ad None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:15:54.971842 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-4a9b0045-985b-4de7-aa28-6648f237c2ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:15:54.979360 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1440/2919] 10.222.0.52 () {58 vars in 967 bytes} [Sat May 14 21:15:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:15:54.995510 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f3cc23-ba0d-417d-82db-09471e909a13 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:15:55.007320 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f3cc23-ba0d-417d-82db-09471e909a13 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:15:55.013747 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eefcca5-26a1-49ac-adc0-e12ffc34599a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:15:55.014576 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eefcca5-26a1-49ac-adc0-e12ffc34599a service swift] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:15:55.014847 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eefcca5-26a1-49ac-adc0-e12ffc34599a service swift] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:15:55.015129 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eefcca5-26a1-49ac-adc0-e12ffc34599a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:15:55.023704 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eefcca5-26a1-49ac-adc0-e12ffc34599a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:15:55.025328 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eefcca5-26a1-49ac-adc0-e12ffc34599a service swift] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:15:55.033774 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1480/2920] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 21:15:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 14 21:15:56.267888 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3442b5ee-eeea-4a0d-9833-7413921eaf89 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:15:56.267888 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3442b5ee-eeea-4a0d-9833-7413921eaf89 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:15:56.267888 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3442b5ee-eeea-4a0d-9833-7413921eaf89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:15:56.288024 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-3442b5ee-eeea-4a0d-9833-7413921eaf89 None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:15:56.289396 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-3442b5ee-eeea-4a0d-9833-7413921eaf89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:15:56.298037 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1441/2921] 10.222.0.52 () {58 vars in 967 bytes} [Sat May 14 21:15:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:15:56.312905 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eefcca5-26a1-49ac-adc0-e12ffc34599a service swift] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:15:56.324808 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eefcca5-26a1-49ac-adc0-e12ffc34599a service swift] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:15:56.331375 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1bbdf6-2ba7-402d-9109-984169c914f5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:15:56.332787 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1bbdf6-2ba7-402d-9109-984169c914f5 service swift] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:15:56.332906 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1bbdf6-2ba7-402d-9109-984169c914f5 service swift] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:15:56.333190 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1bbdf6-2ba7-402d-9109-984169c914f5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:15:56.348715 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1bbdf6-2ba7-402d-9109-984169c914f5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:15:56.350732 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1bbdf6-2ba7-402d-9109-984169c914f5 service swift] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:15:56.394342 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1481/2922] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 21:15:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 21:15:58.340615 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca493ad-d914-4693-937a-9dc9e14f3796 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:15:58.340615 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca493ad-d914-4693-937a-9dc9e14f3796 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:15:58.340615 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca493ad-d914-4693-937a-9dc9e14f3796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:15:58.372344 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-fca493ad-d914-4693-937a-9dc9e14f3796 None None] MFA Rules not processed for user `cfcb989a491440b3bf74ddc055ee14d3`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:15:58.373625 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-fca493ad-d914-4693-937a-9dc9e14f3796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:15:58.434367 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1442/2923] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:15:58 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:16:04.739938 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54d044-e267-4e9b-8164-7300205c37ac None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:04.741084 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54d044-e267-4e9b-8164-7300205c37ac None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:04.742407 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54d044-e267-4e9b-8164-7300205c37ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:04.767444 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-4a54d044-e267-4e9b-8164-7300205c37ac None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:16:04.769127 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-4a54d044-e267-4e9b-8164-7300205c37ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:04.785530 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1482/2924] 10.222.0.52 () {58 vars in 1009 bytes} [Sat May 14 21:16:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:16:04.810942 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca493ad-d914-4693-937a-9dc9e14f3796 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:04.825472 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca493ad-d914-4693-937a-9dc9e14f3796 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:04.832091 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932933c7-dcbc-47d1-9190-5aef8fa9a80a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:04.832750 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932933c7-dcbc-47d1-9190-5aef8fa9a80a service swift] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:04.833304 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932933c7-dcbc-47d1-9190-5aef8fa9a80a service swift] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:04.833591 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932933c7-dcbc-47d1-9190-5aef8fa9a80a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:04.846500 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932933c7-dcbc-47d1-9190-5aef8fa9a80a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:04.848287 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932933c7-dcbc-47d1-9190-5aef8fa9a80a service swift] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:04.859528 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1443/2925] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 21:16:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 21:16:06.779409 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a54d044-e267-4e9b-8164-7300205c37ac None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:06.781324 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-4a54d044-e267-4e9b-8164-7300205c37ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:06.825886 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a54d044-e267-4e9b-8164-7300205c37ac None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:06.836470 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee18692-ae10-4ac9-8c09-2d893584ec0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:06.837348 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee18692-ae10-4ac9-8c09-2d893584ec0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:06.838590 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee18692-ae10-4ac9-8c09-2d893584ec0d admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:06.839285 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee18692-ae10-4ac9-8c09-2d893584ec0d admin admin] PATH_INFO: `/v3/users/911b9cf4e9bc424bba387e2ff966cb46` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:06.841588 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee18692-ae10-4ac9-8c09-2d893584ec0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=911b9cf4e9bc424bba387e2ff966cb46)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:06.843826 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee18692-ae10-4ac9-8c09-2d893584ec0d admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:07.037106 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-dee18692-ae10-4ac9-8c09-2d893584ec0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '911b9cf4e9bc424bba387e2ff966cb46'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:07.051666 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-dee18692-ae10-4ac9-8c09-2d893584ec0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '911b9cf4e9bc424bba387e2ff966cb46'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:07.061863 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-dee18692-ae10-4ac9-8c09-2d893584ec0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '911b9cf4e9bc424bba387e2ff966cb46'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:07.129404 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-dee18692-ae10-4ac9-8c09-2d893584ec0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '911b9cf4e9bc424bba387e2ff966cb46'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:07.133844 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-dee18692-ae10-4ac9-8c09-2d893584ec0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '911b9cf4e9bc424bba387e2ff966cb46'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:07.138752 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1483/2926] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:16:06 2022] DELETE /identity/v3/users/911b9cf4e9bc424bba387e2ff966cb46 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:16:07.456082 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932933c7-dcbc-47d1-9190-5aef8fa9a80a service swift] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:07.477234 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932933c7-dcbc-47d1-9190-5aef8fa9a80a service swift] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:07.577250 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cb1caf-5cba-4dd2-bdac-088f33734380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:07.581248 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb1caf-5cba-4dd2-bdac-088f33734380 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:07.581718 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb1caf-5cba-4dd2-bdac-088f33734380 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:07.582299 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb1caf-5cba-4dd2-bdac-088f33734380 admin admin] PATH_INFO: `/v3/projects/e4af8109ce4a4e98a2e7104125651db0` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:07.584197 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cb1caf-5cba-4dd2-bdac-088f33734380 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4af8109ce4a4e98a2e7104125651db0)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:07.586484 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cb1caf-5cba-4dd2-bdac-088f33734380 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:07.724320 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a6cb1caf-5cba-4dd2-bdac-088f33734380 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4af8109ce4a4e98a2e7104125651db0', 'request_id': 'req-a6cb1caf-5cba-4dd2-bdac-088f33734380'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:07.733828 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a6cb1caf-5cba-4dd2-bdac-088f33734380 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4af8109ce4a4e98a2e7104125651db0', 'request_id': 'req-a6cb1caf-5cba-4dd2-bdac-088f33734380'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:07.745600 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a6cb1caf-5cba-4dd2-bdac-088f33734380 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4af8109ce4a4e98a2e7104125651db0', 'request_id': 'req-a6cb1caf-5cba-4dd2-bdac-088f33734380'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:07.904431 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a6cb1caf-5cba-4dd2-bdac-088f33734380 admin admin] The token cache is being invalidate because project e4af8109ce4a4e98a2e7104125651db0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:16:07.904805 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a6cb1caf-5cba-4dd2-bdac-088f33734380 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:07.907447 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a6cb1caf-5cba-4dd2-bdac-088f33734380 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:07.911356 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1444/2927] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:16:07 2022] DELETE /identity/v3/projects/e4af8109ce4a4e98a2e7104125651db0 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:16:07.917849 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361374d8-e4d9-47e9-88ca-fcbee837a86f None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:07.918369 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361374d8-e4d9-47e9-88ca-fcbee837a86f None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:07.918466 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361374d8-e4d9-47e9-88ca-fcbee837a86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:07.948895 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-361374d8-e4d9-47e9-88ca-fcbee837a86f None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:16:07.950380 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-361374d8-e4d9-47e9-88ca-fcbee837a86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:08.044858 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1484/2928] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:16:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:16:08.052391 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d8c50c-61b4-4777-b67b-39a8e48186f5 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:08.053024 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d8c50c-61b4-4777-b67b-39a8e48186f5 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:08.053346 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d8c50c-61b4-4777-b67b-39a8e48186f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:08.077190 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-f8d8c50c-61b4-4777-b67b-39a8e48186f5 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:16:08.078708 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-f8d8c50c-61b4-4777-b67b-39a8e48186f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:08.091068 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1445/2929] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:16:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:16:08.095062 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361374d8-e4d9-47e9-88ca-fcbee837a86f None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:08.107372 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361374d8-e4d9-47e9-88ca-fcbee837a86f None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:08.116017 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a87bef-342d-4d5d-8fea-704c18897d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:08.122019 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a87bef-342d-4d5d-8fea-704c18897d3f admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:08.122019 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a87bef-342d-4d5d-8fea-704c18897d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:08.122019 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a87bef-342d-4d5d-8fea-704c18897d3f admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:08.122019 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a87bef-342d-4d5d-8fea-704c18897d3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:16:08.122019 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a87bef-342d-4d5d-8fea-704c18897d3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:08.122019 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a87bef-342d-4d5d-8fea-704c18897d3f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:08.139017 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1485/2930] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:16:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:16:08.143502 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d8c50c-61b4-4777-b67b-39a8e48186f5 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:08.156734 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d8c50c-61b4-4777-b67b-39a8e48186f5 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:08.164924 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22d214e-3991-43d0-b76c-9b5b51f86feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:08.166482 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d214e-3991-43d0-b76c-9b5b51f86feb admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:08.166957 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d214e-3991-43d0-b76c-9b5b51f86feb admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:08.167510 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d214e-3991-43d0-b76c-9b5b51f86feb admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:08.171677 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22d214e-3991-43d0-b76c-9b5b51f86feb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:08.174462 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22d214e-3991-43d0-b76c-9b5b51f86feb admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:08.279677 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1446/2931] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:16:08 2022] POST /identity/v3/projects => generated 381 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:16:08.295675 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a87bef-342d-4d5d-8fea-704c18897d3f admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:08.300000 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a87bef-342d-4d5d-8fea-704c18897d3f admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:08.385974 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33629f0-8de9-4326-9abb-9132d5fca074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:08.386682 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33629f0-8de9-4326-9abb-9132d5fca074 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:08.386964 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33629f0-8de9-4326-9abb-9132d5fca074 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:08.387245 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33629f0-8de9-4326-9abb-9132d5fca074 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:08.387998 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33629f0-8de9-4326-9abb-9132d5fca074 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:08.390438 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33629f0-8de9-4326-9abb-9132d5fca074 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:08.797025 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1486/2932] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:16:08 2022] POST /identity/v3/users => generated 291 bytes in 510 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:16:08.798093 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22d214e-3991-43d0-b76c-9b5b51f86feb admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:08.809193 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22d214e-3991-43d0-b76c-9b5b51f86feb admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:08.815073 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bb35c3-c52d-444c-a1a6-d518c0f49274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:08.823116 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb35c3-c52d-444c-a1a6-d518c0f49274 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:08.823116 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb35c3-c52d-444c-a1a6-d518c0f49274 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:08.823116 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb35c3-c52d-444c-a1a6-d518c0f49274 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:08.823116 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bb35c3-c52d-444c-a1a6-d518c0f49274 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:08.823116 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bb35c3-c52d-444c-a1a6-d518c0f49274 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:08.832053 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1447/2933] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:16:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:16:08.836568 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33629f0-8de9-4326-9abb-9132d5fca074 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:08.848035 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33629f0-8de9-4326-9abb-9132d5fca074 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:08.855751 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fbc8db-f687-4cd6-a9cb-4c285c04e9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:08.856426 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fbc8db-f687-4cd6-a9cb-4c285c04e9f5 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:08.856754 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fbc8db-f687-4cd6-a9cb-4c285c04e9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:08.857041 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fbc8db-f687-4cd6-a9cb-4c285c04e9f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:08.857773 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fbc8db-f687-4cd6-a9cb-4c285c04e9f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:08.859545 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fbc8db-f687-4cd6-a9cb-4c285c04e9f5 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:08.877292 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1487/2934] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:16:08 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:16:08.881644 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bb35c3-c52d-444c-a1a6-d518c0f49274 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:08.893849 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bb35c3-c52d-444c-a1a6-d518c0f49274 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:08.900687 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2baedb-fbcd-44a2-a551-7d221ba32ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:08.911758 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2baedb-fbcd-44a2-a551-7d221ba32ad8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:08.911758 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2baedb-fbcd-44a2-a551-7d221ba32ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:08.911758 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2baedb-fbcd-44a2-a551-7d221ba32ad8 admin admin] PATH_INFO: `/v3/projects/ac56d68252fb4633b27be1d5f4a18d0b/users/33cf6f96b2ef4a3bb222abf3ce89c2fb/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:08.932152 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2baedb-fbcd-44a2-a551-7d221ba32ad8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac56d68252fb4633b27be1d5f4a18d0b, user_id=33cf6f96b2ef4a3bb222abf3ce89c2fb, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:08.932152 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2baedb-fbcd-44a2-a551-7d221ba32ad8 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:09.045092 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1448/2935] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:16:08 2022] PUT /identity/v3/projects/ac56d68252fb4633b27be1d5f4a18d0b/users/33cf6f96b2ef4a3bb222abf3ce89c2fb/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:16:09.052396 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f9c69-68e9-455c-b0ec-24f01261051f None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:09.052396 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f9c69-68e9-455c-b0ec-24f01261051f None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:09.052396 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f9c69-68e9-455c-b0ec-24f01261051f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:09.085879 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-6b8f9c69-68e9-455c-b0ec-24f01261051f None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:16:09.085879 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-6b8f9c69-68e9-455c-b0ec-24f01261051f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:09.153166 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1488/2936] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:16:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:16:09.167442 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2baedb-fbcd-44a2-a551-7d221ba32ad8 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:09.169485 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-fb2baedb-fbcd-44a2-a551-7d221ba32ad8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:09.313185 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2baedb-fbcd-44a2-a551-7d221ba32ad8 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:09.321614 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a73340-4fc7-405c-ab93-6c70d044b4e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:09.328526 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a73340-4fc7-405c-ab93-6c70d044b4e7 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:09.328526 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a73340-4fc7-405c-ab93-6c70d044b4e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:09.328526 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a73340-4fc7-405c-ab93-6c70d044b4e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:09.340745 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a73340-4fc7-405c-ab93-6c70d044b4e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:09.342315 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a73340-4fc7-405c-ab93-6c70d044b4e7 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:09.354020 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1449/2937] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:16:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:16:11.716355 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d382fd-3b6d-44f0-b5ff-7483ec56eae5 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:11.717303 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d382fd-3b6d-44f0-b5ff-7483ec56eae5 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:11.717849 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d382fd-3b6d-44f0-b5ff-7483ec56eae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:11.758950 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-e1d382fd-3b6d-44f0-b5ff-7483ec56eae5 None None] MFA Rules not processed for user `33cf6f96b2ef4a3bb222abf3ce89c2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:16:11.761210 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e1d382fd-3b6d-44f0-b5ff-7483ec56eae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:11.921649 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1489/2938] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:16:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:16:11.931981 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b47d2f-e17e-48c5-a8aa-41edc41f4fbb None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:11.933001 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b47d2f-e17e-48c5-a8aa-41edc41f4fbb None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:11.933447 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b47d2f-e17e-48c5-a8aa-41edc41f4fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:11.987450 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-63b47d2f-e17e-48c5-a8aa-41edc41f4fbb None None] MFA Rules not processed for user `33cf6f96b2ef4a3bb222abf3ce89c2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:16:11.995243 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-63b47d2f-e17e-48c5-a8aa-41edc41f4fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:12.013973 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1450/2939] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:16:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:16:12.246956 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7985cc23-b34b-4a62-836f-f942946d8605 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:12.247240 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7985cc23-b34b-4a62-836f-f942946d8605 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:12.247714 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7985cc23-b34b-4a62-836f-f942946d8605 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:12.249383 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1490/2940] 10.222.0.52 () {54 vars in 921 bytes} [Sat May 14 21:16:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:16:12.266499 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758bd7a-06c2-4234-b6fd-0ef5c4bc6382 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:12.267216 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758bd7a-06c2-4234-b6fd-0ef5c4bc6382 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:12.268035 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758bd7a-06c2-4234-b6fd-0ef5c4bc6382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:12.284336 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7985cc23-b34b-4a62-836f-f942946d8605 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:12.286434 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-7985cc23-b34b-4a62-836f-f942946d8605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:12.325407 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-8758bd7a-06c2-4234-b6fd-0ef5c4bc6382 None None] MFA Rules not processed for user `0812ae67e44d483baf2dbb1a5332a1d7`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:16:12.327118 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8758bd7a-06c2-4234-b6fd-0ef5c4bc6382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:12.435206 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1451/2941] 10.222.0.52 () {58 vars in 1018 bytes} [Sat May 14 21:16:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:16:12.461440 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7985cc23-b34b-4a62-836f-f942946d8605 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:12.472454 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8758bd7a-06c2-4234-b6fd-0ef5c4bc6382 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:12.474277 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8758bd7a-06c2-4234-b6fd-0ef5c4bc6382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:12.476317 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb3acde-660c-4f61-acaa-7970d048f90f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:12.481623 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3acde-660c-4f61-acaa-7970d048f90f service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:12.481623 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3acde-660c-4f61-acaa-7970d048f90f service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:12.481623 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3acde-660c-4f61-acaa-7970d048f90f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:12.489834 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb3acde-660c-4f61-acaa-7970d048f90f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:12.492084 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8758bd7a-06c2-4234-b6fd-0ef5c4bc6382 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:12.492778 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb3acde-660c-4f61-acaa-7970d048f90f service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:12.501597 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6061cfa-6d8c-45aa-b62e-d20ddeeb880e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:12.502842 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6061cfa-6d8c-45aa-b62e-d20ddeeb880e service placement] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:12.503341 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6061cfa-6d8c-45aa-b62e-d20ddeeb880e service placement] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:12.503800 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6061cfa-6d8c-45aa-b62e-d20ddeeb880e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:12.512538 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1491/2942] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:16:12 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:16:12.539115 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6061cfa-6d8c-45aa-b62e-d20ddeeb880e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:12.541757 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6061cfa-6d8c-45aa-b62e-d20ddeeb880e service placement] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:12.599646 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1452/2943] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:16:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:16:14.780037 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488fed99-c165-4573-9536-45af57c6eb68 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:14.780735 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488fed99-c165-4573-9536-45af57c6eb68 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:14.780735 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488fed99-c165-4573-9536-45af57c6eb68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:14.807204 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-488fed99-c165-4573-9536-45af57c6eb68 None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:16:14.808703 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-488fed99-c165-4573-9536-45af57c6eb68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:14.945513 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1492/2944] 10.222.0.52 () {58 vars in 967 bytes} [Sat May 14 21:16:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:16:15.003871 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6061cfa-6d8c-45aa-b62e-d20ddeeb880e service placement] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:15.005670 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-d6061cfa-6d8c-45aa-b62e-d20ddeeb880e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:15.128450 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6061cfa-6d8c-45aa-b62e-d20ddeeb880e service placement] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:15.139409 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262a9e3d-fae1-4c8c-bcfb-89b29413e36b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:15.140165 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a9e3d-fae1-4c8c-bcfb-89b29413e36b service swift] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:15.140450 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a9e3d-fae1-4c8c-bcfb-89b29413e36b service swift] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:15.141041 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a9e3d-fae1-4c8c-bcfb-89b29413e36b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:15.156633 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262a9e3d-fae1-4c8c-bcfb-89b29413e36b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:15.158732 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262a9e3d-fae1-4c8c-bcfb-89b29413e36b service swift] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:15.169009 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1453/2945] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 21:16:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 21:16:15.562939 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2d491-78e0-4a01-900f-1036428ffb1e None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:15.563257 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2d491-78e0-4a01-900f-1036428ffb1e None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:15.563516 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2d491-78e0-4a01-900f-1036428ffb1e None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:15.565398 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1493/2946] 10.222.0.52 () {54 vars in 912 bytes} [Sat May 14 21:16:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 14 21:16:15.573018 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf783cc-a10b-44d3-a1a5-48028ab1f9bd None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:15.573646 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf783cc-a10b-44d3-a1a5-48028ab1f9bd None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:15.575812 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf783cc-a10b-44d3-a1a5-48028ab1f9bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:15.598041 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-bdf783cc-a10b-44d3-a1a5-48028ab1f9bd None None] MFA Rules not processed for user `0812ae67e44d483baf2dbb1a5332a1d7`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:16:15.600868 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-bdf783cc-a10b-44d3-a1a5-48028ab1f9bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:15.611225 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1454/2947] 10.222.0.52 () {58 vars in 1009 bytes} [Sat May 14 21:16:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:16:15.644874 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec2d491-78e0-4a01-900f-1036428ffb1e None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:15.669908 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec2d491-78e0-4a01-900f-1036428ffb1e None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:15.677942 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edde318f-5d77-4629-b085-3ebd7e29d236 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:15.678610 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde318f-5d77-4629-b085-3ebd7e29d236 service placement] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:15.678899 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde318f-5d77-4629-b085-3ebd7e29d236 service placement] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:15.679366 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde318f-5d77-4629-b085-3ebd7e29d236 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:15.692897 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edde318f-5d77-4629-b085-3ebd7e29d236 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:15.698500 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edde318f-5d77-4629-b085-3ebd7e29d236 service placement] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:15.708811 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1494/2948] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:16:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:16:16.356771 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe3cd5-fe72-476c-b914-98a7295955d9 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:16.357452 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe3cd5-fe72-476c-b914-98a7295955d9 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:16.357452 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe3cd5-fe72-476c-b914-98a7295955d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:16.402302 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-ddfe3cd5-fe72-476c-b914-98a7295955d9 None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:16:16.407192 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-ddfe3cd5-fe72-476c-b914-98a7295955d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:16.429722 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1455/2949] 10.222.0.52 () {58 vars in 967 bytes} [Sat May 14 21:16:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:16:16.446222 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edde318f-5d77-4629-b085-3ebd7e29d236 service placement] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:16.460575 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edde318f-5d77-4629-b085-3ebd7e29d236 service placement] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:16.467175 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ae8ac8-f4bf-438f-b2d3-fbe4eff2819a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:16.468217 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae8ac8-f4bf-438f-b2d3-fbe4eff2819a service swift] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:16.468824 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae8ac8-f4bf-438f-b2d3-fbe4eff2819a service swift] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:16.469271 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae8ac8-f4bf-438f-b2d3-fbe4eff2819a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:16.479662 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ae8ac8-f4bf-438f-b2d3-fbe4eff2819a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:16.481539 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ae8ac8-f4bf-438f-b2d3-fbe4eff2819a service swift] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:16.491722 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1495/2950] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 21:16:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 21:16:16.744671 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e53ad-ac1f-46f7-986b-bfd0e776846c None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:16.745089 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e53ad-ac1f-46f7-986b-bfd0e776846c None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:16.746737 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e53ad-ac1f-46f7-986b-bfd0e776846c None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:16.749190 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1456/2951] 10.222.0.52 () {54 vars in 921 bytes} [Sat May 14 21:16:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:16:16.754855 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f7d31-0808-4ea2-8d0d-a3e0240f4be7 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:16.756159 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f7d31-0808-4ea2-8d0d-a3e0240f4be7 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:16.756660 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f7d31-0808-4ea2-8d0d-a3e0240f4be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:16.814968 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-0c1f7d31-0808-4ea2-8d0d-a3e0240f4be7 None None] MFA Rules not processed for user `0812ae67e44d483baf2dbb1a5332a1d7`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:16:16.816236 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-0c1f7d31-0808-4ea2-8d0d-a3e0240f4be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:16.849859 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1496/2952] 10.222.0.52 () {58 vars in 1018 bytes} [Sat May 14 21:16:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:16:16.889422 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963e53ad-ac1f-46f7-986b-bfd0e776846c None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:16.908049 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963e53ad-ac1f-46f7-986b-bfd0e776846c None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:16.919361 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779bd63d-5774-43d9-88c2-0daddb9c95ab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:16.925436 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779bd63d-5774-43d9-88c2-0daddb9c95ab service placement] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:16.926370 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779bd63d-5774-43d9-88c2-0daddb9c95ab service placement] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:16.926370 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779bd63d-5774-43d9-88c2-0daddb9c95ab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:16.940010 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779bd63d-5774-43d9-88c2-0daddb9c95ab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:16.941953 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779bd63d-5774-43d9-88c2-0daddb9c95ab service placement] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:16.956549 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1457/2953] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:16:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:16:17.287887 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72651f7-6656-41f6-b1ce-c9676a7c99a1 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:17.292776 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72651f7-6656-41f6-b1ce-c9676a7c99a1 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:17.292776 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72651f7-6656-41f6-b1ce-c9676a7c99a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:17.319552 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-a72651f7-6656-41f6-b1ce-c9676a7c99a1 None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:16:17.320823 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-a72651f7-6656-41f6-b1ce-c9676a7c99a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:17.331924 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1497/2954] 10.222.0.52 () {58 vars in 967 bytes} [Sat May 14 21:16:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:16:17.399353 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779bd63d-5774-43d9-88c2-0daddb9c95ab service placement] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:17.418278 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779bd63d-5774-43d9-88c2-0daddb9c95ab service placement] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:17.440049 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99861ef2-db51-4a58-b917-c34fedcb6642 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:17.442006 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99861ef2-db51-4a58-b917-c34fedcb6642 service swift] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:17.442006 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99861ef2-db51-4a58-b917-c34fedcb6642 service swift] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:17.442006 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99861ef2-db51-4a58-b917-c34fedcb6642 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:17.469803 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99861ef2-db51-4a58-b917-c34fedcb6642 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:17.471310 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99861ef2-db51-4a58-b917-c34fedcb6642 service swift] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:17.498383 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1458/2955] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 21:16:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 21:16:18.338822 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72651f7-6656-41f6-b1ce-c9676a7c99a1 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:18.340355 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-a72651f7-6656-41f6-b1ce-c9676a7c99a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:18.364558 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72651f7-6656-41f6-b1ce-c9676a7c99a1 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:18.371511 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccfbf9f-3dbe-46b6-9199-fe4106b61a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:18.372688 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccfbf9f-3dbe-46b6-9199-fe4106b61a02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:18.373321 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccfbf9f-3dbe-46b6-9199-fe4106b61a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:18.374051 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccfbf9f-3dbe-46b6-9199-fe4106b61a02 admin admin] PATH_INFO: `/v3/users/dd53fb02767e4912bd762fa7d1e80a06` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:18.375673 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccfbf9f-3dbe-46b6-9199-fe4106b61a02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd53fb02767e4912bd762fa7d1e80a06)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:18.378790 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccfbf9f-3dbe-46b6-9199-fe4106b61a02 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:18.615624 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5ccfbf9f-3dbe-46b6-9199-fe4106b61a02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd53fb02767e4912bd762fa7d1e80a06'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:18.657465 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5ccfbf9f-3dbe-46b6-9199-fe4106b61a02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd53fb02767e4912bd762fa7d1e80a06'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:18.677006 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5ccfbf9f-3dbe-46b6-9199-fe4106b61a02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd53fb02767e4912bd762fa7d1e80a06'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:18.793020 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5ccfbf9f-3dbe-46b6-9199-fe4106b61a02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd53fb02767e4912bd762fa7d1e80a06'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:18.798436 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5ccfbf9f-3dbe-46b6-9199-fe4106b61a02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd53fb02767e4912bd762fa7d1e80a06'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:18.849365 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1498/2956] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:16:18 2022] DELETE /identity/v3/users/dd53fb02767e4912bd762fa7d1e80a06 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:16:18.849462 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ee478-a3c8-4090-b0ba-9e1cc6d32f0a None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:18.849462 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ee478-a3c8-4090-b0ba-9e1cc6d32f0a None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:18.849462 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ee478-a3c8-4090-b0ba-9e1cc6d32f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:18.859821 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-147ee478-a3c8-4090-b0ba-9e1cc6d32f0a None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:16:18.861384 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-147ee478-a3c8-4090-b0ba-9e1cc6d32f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:19.016291 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1459/2957] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:16:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:16:19.035111 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccfbf9f-3dbe-46b6-9199-fe4106b61a02 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:19.036742 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-5ccfbf9f-3dbe-46b6-9199-fe4106b61a02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:19.111776 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccfbf9f-3dbe-46b6-9199-fe4106b61a02 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:19.124157 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e29163-0242-4474-ae1d-e86ad09083ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:19.125364 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e29163-0242-4474-ae1d-e86ad09083ee service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:19.125714 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e29163-0242-4474-ae1d-e86ad09083ee service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:19.126063 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e29163-0242-4474-ae1d-e86ad09083ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:19.141374 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e29163-0242-4474-ae1d-e86ad09083ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:19.153150 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e29163-0242-4474-ae1d-e86ad09083ee service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:19.195983 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1499/2958] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:16:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:16:19.738377 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ee478-a3c8-4090-b0ba-9e1cc6d32f0a None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:19.740487 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-147ee478-a3c8-4090-b0ba-9e1cc6d32f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:19.756378 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ee478-a3c8-4090-b0ba-9e1cc6d32f0a None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:19.765946 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37717ecd-d31a-4427-b2dc-7b3641d73733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:19.767839 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37717ecd-d31a-4427-b2dc-7b3641d73733 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:19.768358 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37717ecd-d31a-4427-b2dc-7b3641d73733 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:19.768810 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37717ecd-d31a-4427-b2dc-7b3641d73733 admin admin] PATH_INFO: `/v3/projects/366727f0fe304593ae0a789b2f0eb0b2` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:19.771283 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37717ecd-d31a-4427-b2dc-7b3641d73733 admin admin] RBAC: Authorizing `identity:delete_project(project_id=366727f0fe304593ae0a789b2f0eb0b2)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:19.773870 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37717ecd-d31a-4427-b2dc-7b3641d73733 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:19.914544 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-37717ecd-d31a-4427-b2dc-7b3641d73733 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '366727f0fe304593ae0a789b2f0eb0b2', 'request_id': 'req-37717ecd-d31a-4427-b2dc-7b3641d73733'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:19.950616 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-37717ecd-d31a-4427-b2dc-7b3641d73733 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '366727f0fe304593ae0a789b2f0eb0b2', 'request_id': 'req-37717ecd-d31a-4427-b2dc-7b3641d73733'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:19.971440 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-37717ecd-d31a-4427-b2dc-7b3641d73733 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '366727f0fe304593ae0a789b2f0eb0b2', 'request_id': 'req-37717ecd-d31a-4427-b2dc-7b3641d73733'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:20.068383 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-37717ecd-d31a-4427-b2dc-7b3641d73733 admin admin] The token cache is being invalidate because project 366727f0fe304593ae0a789b2f0eb0b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:16:20.075042 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-37717ecd-d31a-4427-b2dc-7b3641d73733 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:20.075042 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-37717ecd-d31a-4427-b2dc-7b3641d73733 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:20.075042 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1460/2959] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:16:19 2022] DELETE /identity/v3/projects/366727f0fe304593ae0a789b2f0eb0b2 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:16:20.077887 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447df0d4-45f5-48b2-a79c-9b1ffa3b27ec None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:20.078408 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447df0d4-45f5-48b2-a79c-9b1ffa3b27ec None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:20.078504 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447df0d4-45f5-48b2-a79c-9b1ffa3b27ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:20.111186 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-447df0d4-45f5-48b2-a79c-9b1ffa3b27ec None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:16:20.112888 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-447df0d4-45f5-48b2-a79c-9b1ffa3b27ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:20.272467 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1500/2960] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:16:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:16:20.281554 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97f318-1301-42d6-abfb-b69a8aa0b418 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:20.288513 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97f318-1301-42d6-abfb-b69a8aa0b418 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:20.288513 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97f318-1301-42d6-abfb-b69a8aa0b418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:20.318466 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-2a97f318-1301-42d6-abfb-b69a8aa0b418 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:16:20.321188 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-2a97f318-1301-42d6-abfb-b69a8aa0b418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:20.347647 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1461/2961] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:16:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:16:20.350698 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447df0d4-45f5-48b2-a79c-9b1ffa3b27ec None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:20.372347 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447df0d4-45f5-48b2-a79c-9b1ffa3b27ec None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:20.388766 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc9d82-d746-41d6-aebd-1562605126cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:20.390010 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc9d82-d746-41d6-aebd-1562605126cd admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:20.390459 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc9d82-d746-41d6-aebd-1562605126cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:20.390906 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc9d82-d746-41d6-aebd-1562605126cd admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:20.391664 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbc9d82-d746-41d6-aebd-1562605126cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:16:20.392140 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbc9d82-d746-41d6-aebd-1562605126cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:20.393895 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbc9d82-d746-41d6-aebd-1562605126cd admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:20.408939 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1501/2962] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:16:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:16:20.413085 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a97f318-1301-42d6-abfb-b69a8aa0b418 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:20.427880 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a97f318-1301-42d6-abfb-b69a8aa0b418 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:20.434093 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90493293-776e-40f3-8ca8-7a7574c311fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:20.434978 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90493293-776e-40f3-8ca8-7a7574c311fc admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:20.435500 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90493293-776e-40f3-8ca8-7a7574c311fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:20.436050 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90493293-776e-40f3-8ca8-7a7574c311fc admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:20.436937 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90493293-776e-40f3-8ca8-7a7574c311fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:20.439066 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90493293-776e-40f3-8ca8-7a7574c311fc admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:20.581666 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1462/2963] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:16:20 2022] POST /identity/v3/projects => generated 373 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:16:20.586257 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc9d82-d746-41d6-aebd-1562605126cd admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:20.601082 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc9d82-d746-41d6-aebd-1562605126cd admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:20.658625 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20bb395-cb3d-4c67-95b7-9bbe3b03ceb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:20.659364 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20bb395-cb3d-4c67-95b7-9bbe3b03ceb5 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:20.659633 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20bb395-cb3d-4c67-95b7-9bbe3b03ceb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:20.659916 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20bb395-cb3d-4c67-95b7-9bbe3b03ceb5 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:20.661008 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20bb395-cb3d-4c67-95b7-9bbe3b03ceb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:20.662536 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20bb395-cb3d-4c67-95b7-9bbe3b03ceb5 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:20.821980 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1502/2964] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:16:20 2022] POST /identity/v3/users => generated 287 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:16:20.823205 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90493293-776e-40f3-8ca8-7a7574c311fc admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:20.834340 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90493293-776e-40f3-8ca8-7a7574c311fc admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:20.840694 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1ccfc2-5e6a-4ee6-b5f9-16cb0ab60240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:20.844209 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ccfc2-5e6a-4ee6-b5f9-16cb0ab60240 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:20.844209 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ccfc2-5e6a-4ee6-b5f9-16cb0ab60240 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:20.844209 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ccfc2-5e6a-4ee6-b5f9-16cb0ab60240 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:20.844209 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1ccfc2-5e6a-4ee6-b5f9-16cb0ab60240 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:20.845144 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1ccfc2-5e6a-4ee6-b5f9-16cb0ab60240 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:20.868921 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20bb395-cb3d-4c67-95b7-9bbe3b03ceb5 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:20.873035 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1463/2965] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:16:20 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:16:20.880198 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20bb395-cb3d-4c67-95b7-9bbe3b03ceb5 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:20.885708 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc1d81-c93e-4fca-9f68-3788a02161db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:20.886403 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc1d81-c93e-4fca-9f68-3788a02161db admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:20.887020 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc1d81-c93e-4fca-9f68-3788a02161db admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:20.887020 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc1d81-c93e-4fca-9f68-3788a02161db admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:20.887712 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fc1d81-c93e-4fca-9f68-3788a02161db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:20.889692 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fc1d81-c93e-4fca-9f68-3788a02161db admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:20.901666 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1503/2966] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:16:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:16:20.907773 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1ccfc2-5e6a-4ee6-b5f9-16cb0ab60240 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:20.922405 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1ccfc2-5e6a-4ee6-b5f9-16cb0ab60240 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:20.933640 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db701ac0-43c0-45c3-bd67-ee93d8c3207f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:20.934558 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db701ac0-43c0-45c3-bd67-ee93d8c3207f admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:20.934844 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db701ac0-43c0-45c3-bd67-ee93d8c3207f admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:20.935120 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db701ac0-43c0-45c3-bd67-ee93d8c3207f admin admin] PATH_INFO: `/v3/projects/9cd3efb132bd4c4da3730331e5b15792/users/0df8b006c5314616a9d91bd2975b5eba/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:20.950959 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db701ac0-43c0-45c3-bd67-ee93d8c3207f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cd3efb132bd4c4da3730331e5b15792, user_id=0df8b006c5314616a9d91bd2975b5eba, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:20.953842 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db701ac0-43c0-45c3-bd67-ee93d8c3207f admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:21.068257 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1464/2967] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:16:20 2022] PUT /identity/v3/projects/9cd3efb132bd4c4da3730331e5b15792/users/0df8b006c5314616a9d91bd2975b5eba/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:16:21.082055 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e4cb3d-6183-45b2-8214-283e25839e62 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:21.084443 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e4cb3d-6183-45b2-8214-283e25839e62 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:21.084443 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e4cb3d-6183-45b2-8214-283e25839e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:21.120694 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-81e4cb3d-6183-45b2-8214-283e25839e62 None None] MFA Rules not processed for user `0df8b006c5314616a9d91bd2975b5eba`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:16:21.122179 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-81e4cb3d-6183-45b2-8214-283e25839e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:21.239039 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1504/2968] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:16:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:16:21.268261 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71322ce-f8ab-4a47-9441-d1b1c43fc8b2 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:21.268558 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71322ce-f8ab-4a47-9441-d1b1c43fc8b2 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:21.268863 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71322ce-f8ab-4a47-9441-d1b1c43fc8b2 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:21.270596 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1465/2969] 10.222.0.52 () {54 vars in 921 bytes} [Sat May 14 21:16:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:16:21.276060 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbba4a2-4aba-4276-be8c-70144a2b3e8f None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:21.276586 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbba4a2-4aba-4276-be8c-70144a2b3e8f None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:21.277043 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbba4a2-4aba-4276-be8c-70144a2b3e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:21.296359 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-7bbba4a2-4aba-4276-be8c-70144a2b3e8f None None] MFA Rules not processed for user `0812ae67e44d483baf2dbb1a5332a1d7`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:16:21.297668 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-7bbba4a2-4aba-4276-be8c-70144a2b3e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:21.369049 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1505/2970] 10.222.0.52 () {58 vars in 1018 bytes} [Sat May 14 21:16:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:16:21.392750 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71322ce-f8ab-4a47-9441-d1b1c43fc8b2 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:21.394593 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b71322ce-f8ab-4a47-9441-d1b1c43fc8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:21.417007 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71322ce-f8ab-4a47-9441-d1b1c43fc8b2 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:21.423770 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa79ec1e-2623-4282-9aec-7b686c701f08 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:21.424583 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79ec1e-2623-4282-9aec-7b686c701f08 service placement] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:21.424990 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79ec1e-2623-4282-9aec-7b686c701f08 service placement] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:21.425387 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79ec1e-2623-4282-9aec-7b686c701f08 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:21.436380 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa79ec1e-2623-4282-9aec-7b686c701f08 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:21.438973 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa79ec1e-2623-4282-9aec-7b686c701f08 service placement] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:21.452169 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1466/2971] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:16:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:16:21.616137 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbba4a2-4aba-4276-be8c-70144a2b3e8f None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:21.617226 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-7bbba4a2-4aba-4276-be8c-70144a2b3e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:21.694997 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbba4a2-4aba-4276-be8c-70144a2b3e8f None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:21.700609 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a216496-5cc2-42df-8a97-3b3c46b70527 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:21.701260 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a216496-5cc2-42df-8a97-3b3c46b70527 service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:21.701545 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a216496-5cc2-42df-8a97-3b3c46b70527 service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:21.701913 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a216496-5cc2-42df-8a97-3b3c46b70527 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:21.710746 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a216496-5cc2-42df-8a97-3b3c46b70527 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:21.713094 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a216496-5cc2-42df-8a97-3b3c46b70527 service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:21.728496 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1506/2972] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:16:21 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:16:22.411541 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2197d22-bf25-461c-9a4c-1dd526667803 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:22.412057 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2197d22-bf25-461c-9a4c-1dd526667803 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:22.412245 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2197d22-bf25-461c-9a4c-1dd526667803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:22.430179 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-f2197d22-bf25-461c-9a4c-1dd526667803 None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:16:22.432083 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-f2197d22-bf25-461c-9a4c-1dd526667803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:22.487635 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1467/2973] 10.222.0.52 () {58 vars in 967 bytes} [Sat May 14 21:16:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:16:22.501241 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a216496-5cc2-42df-8a97-3b3c46b70527 service nova] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:22.502720 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-4a216496-5cc2-42df-8a97-3b3c46b70527 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:22.574076 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a216496-5cc2-42df-8a97-3b3c46b70527 service nova] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:22.579037 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2ad667-177d-42b3-af3d-6e726711113d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:22.579736 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ad667-177d-42b3-af3d-6e726711113d service swift] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:22.580025 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ad667-177d-42b3-af3d-6e726711113d service swift] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:22.580323 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ad667-177d-42b3-af3d-6e726711113d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:22.589445 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2ad667-177d-42b3-af3d-6e726711113d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:22.591220 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2ad667-177d-42b3-af3d-6e726711113d service swift] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:22.600137 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1507/2974] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 21:16:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 21:16:25.198220 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2197d22-bf25-461c-9a4c-1dd526667803 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:25.199842 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-f2197d22-bf25-461c-9a4c-1dd526667803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:25.291907 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2197d22-bf25-461c-9a4c-1dd526667803 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:25.299554 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478c4083-351c-45c7-9e57-517035b7c530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:25.300775 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c4083-351c-45c7-9e57-517035b7c530 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:25.301213 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c4083-351c-45c7-9e57-517035b7c530 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:25.302170 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c4083-351c-45c7-9e57-517035b7c530 admin admin] PATH_INFO: `/v3/users/3a998f4a4cc94a63ac7e939ffdb10917` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:25.303644 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478c4083-351c-45c7-9e57-517035b7c530 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a998f4a4cc94a63ac7e939ffdb10917)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:25.306383 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478c4083-351c-45c7-9e57-517035b7c530 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:25.527145 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-478c4083-351c-45c7-9e57-517035b7c530 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a998f4a4cc94a63ac7e939ffdb10917'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:25.534427 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-478c4083-351c-45c7-9e57-517035b7c530 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a998f4a4cc94a63ac7e939ffdb10917'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:25.535295 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-478c4083-351c-45c7-9e57-517035b7c530 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a998f4a4cc94a63ac7e939ffdb10917'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:25.605625 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-478c4083-351c-45c7-9e57-517035b7c530 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a998f4a4cc94a63ac7e939ffdb10917'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:25.618486 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-478c4083-351c-45c7-9e57-517035b7c530 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a998f4a4cc94a63ac7e939ffdb10917'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:25.624632 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1468/2975] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:16:25 2022] DELETE /identity/v3/users/3a998f4a4cc94a63ac7e939ffdb10917 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:16:25.631272 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca47763-fd28-4312-9a03-87831f2001c2 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:25.631272 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca47763-fd28-4312-9a03-87831f2001c2 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:25.631272 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca47763-fd28-4312-9a03-87831f2001c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:25.647300 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-0ca47763-fd28-4312-9a03-87831f2001c2 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:16:25.648647 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-0ca47763-fd28-4312-9a03-87831f2001c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:25.721348 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1508/2976] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:16:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:16:25.732063 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478c4083-351c-45c7-9e57-517035b7c530 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:25.733630 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-478c4083-351c-45c7-9e57-517035b7c530 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:25.799381 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478c4083-351c-45c7-9e57-517035b7c530 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:25.803246 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e6d87b-115f-438b-8ff2-09e52d8d0cbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:25.804001 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e6d87b-115f-438b-8ff2-09e52d8d0cbd service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:25.804422 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e6d87b-115f-438b-8ff2-09e52d8d0cbd service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:25.804716 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e6d87b-115f-438b-8ff2-09e52d8d0cbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:25.815696 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e6d87b-115f-438b-8ff2-09e52d8d0cbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:25.825469 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e6d87b-115f-438b-8ff2-09e52d8d0cbd service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:25.831850 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1469/2977] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:16:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:16:26.099510 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca47763-fd28-4312-9a03-87831f2001c2 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:26.101737 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-0ca47763-fd28-4312-9a03-87831f2001c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:26.118225 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca47763-fd28-4312-9a03-87831f2001c2 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:26.123286 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec4e779-62cf-40ce-9ac5-d628128b9e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:26.124279 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec4e779-62cf-40ce-9ac5-d628128b9e29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:26.126856 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec4e779-62cf-40ce-9ac5-d628128b9e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:26.127377 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec4e779-62cf-40ce-9ac5-d628128b9e29 admin admin] PATH_INFO: `/v3/projects/873c930e94574326a2aa94a76fda4f0d` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:26.136078 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec4e779-62cf-40ce-9ac5-d628128b9e29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=873c930e94574326a2aa94a76fda4f0d)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:26.139392 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec4e779-62cf-40ce-9ac5-d628128b9e29 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:26.253386 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8ec4e779-62cf-40ce-9ac5-d628128b9e29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '873c930e94574326a2aa94a76fda4f0d', 'request_id': 'req-8ec4e779-62cf-40ce-9ac5-d628128b9e29'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:26.260831 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8ec4e779-62cf-40ce-9ac5-d628128b9e29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '873c930e94574326a2aa94a76fda4f0d', 'request_id': 'req-8ec4e779-62cf-40ce-9ac5-d628128b9e29'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:26.348411 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8ec4e779-62cf-40ce-9ac5-d628128b9e29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '873c930e94574326a2aa94a76fda4f0d', 'request_id': 'req-8ec4e779-62cf-40ce-9ac5-d628128b9e29'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:26.363219 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8ec4e779-62cf-40ce-9ac5-d628128b9e29 admin admin] The token cache is being invalidate because project 873c930e94574326a2aa94a76fda4f0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:16:26.363816 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8ec4e779-62cf-40ce-9ac5-d628128b9e29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:26.364674 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8ec4e779-62cf-40ce-9ac5-d628128b9e29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:26.366386 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1509/2978] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:16:26 2022] DELETE /identity/v3/projects/873c930e94574326a2aa94a76fda4f0d => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:16:26.371104 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e6d87b-115f-438b-8ff2-09e52d8d0cbd service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:26.381967 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e6d87b-115f-438b-8ff2-09e52d8d0cbd service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:26.450170 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a0665d-f673-4e55-9154-0b8d2a6fab24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:26.451391 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a0665d-f673-4e55-9154-0b8d2a6fab24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:26.451907 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a0665d-f673-4e55-9154-0b8d2a6fab24 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:26.452390 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a0665d-f673-4e55-9154-0b8d2a6fab24 admin admin] PATH_INFO: `/v3/users/92c6db39df0e4e018915d468b790b58b` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:26.453890 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a0665d-f673-4e55-9154-0b8d2a6fab24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92c6db39df0e4e018915d468b790b58b)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:26.456082 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a0665d-f673-4e55-9154-0b8d2a6fab24 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:26.681935 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c5a0665d-f673-4e55-9154-0b8d2a6fab24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92c6db39df0e4e018915d468b790b58b'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:26.692478 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c5a0665d-f673-4e55-9154-0b8d2a6fab24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92c6db39df0e4e018915d468b790b58b'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:26.698881 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c5a0665d-f673-4e55-9154-0b8d2a6fab24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92c6db39df0e4e018915d468b790b58b'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:26.785919 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c5a0665d-f673-4e55-9154-0b8d2a6fab24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92c6db39df0e4e018915d468b790b58b'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:26.800293 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c5a0665d-f673-4e55-9154-0b8d2a6fab24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92c6db39df0e4e018915d468b790b58b'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:26.808556 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1470/2979] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:16:26 2022] DELETE /identity/v3/users/92c6db39df0e4e018915d468b790b58b => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:16:27.195118 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec4e779-62cf-40ce-9ac5-d628128b9e29 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:27.196957 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-8ec4e779-62cf-40ce-9ac5-d628128b9e29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:27.210932 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec4e779-62cf-40ce-9ac5-d628128b9e29 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:27.372681 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e576c473-f860-4bef-88d1-b3a32039c359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:27.374252 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e576c473-f860-4bef-88d1-b3a32039c359 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:27.374729 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e576c473-f860-4bef-88d1-b3a32039c359 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:27.375145 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e576c473-f860-4bef-88d1-b3a32039c359 admin admin] PATH_INFO: `/v3/users/0df8b006c5314616a9d91bd2975b5eba` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:27.377020 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e576c473-f860-4bef-88d1-b3a32039c359 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0df8b006c5314616a9d91bd2975b5eba)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:27.382284 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e576c473-f860-4bef-88d1-b3a32039c359 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:27.463917 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a0665d-f673-4e55-9154-0b8d2a6fab24 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:27.468577 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c5a0665d-f673-4e55-9154-0b8d2a6fab24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:27.491925 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a0665d-f673-4e55-9154-0b8d2a6fab24 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:27.500902 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cc1aef-b695-444a-a25a-b75665f73b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:27.502937 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cc1aef-b695-444a-a25a-b75665f73b0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:27.503395 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cc1aef-b695-444a-a25a-b75665f73b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:27.503856 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cc1aef-b695-444a-a25a-b75665f73b0f admin admin] PATH_INFO: `/v3/projects/95cb2bc0a93a4b919a2d65a7576e6038` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:27.505302 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cc1aef-b695-444a-a25a-b75665f73b0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=95cb2bc0a93a4b919a2d65a7576e6038)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:27.509140 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cc1aef-b695-444a-a25a-b75665f73b0f admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:27.720048 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-77cc1aef-b695-444a-a25a-b75665f73b0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95cb2bc0a93a4b919a2d65a7576e6038', 'request_id': 'req-77cc1aef-b695-444a-a25a-b75665f73b0f'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:27.733664 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-77cc1aef-b695-444a-a25a-b75665f73b0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95cb2bc0a93a4b919a2d65a7576e6038', 'request_id': 'req-77cc1aef-b695-444a-a25a-b75665f73b0f'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:27.744058 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e576c473-f860-4bef-88d1-b3a32039c359 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0df8b006c5314616a9d91bd2975b5eba'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:27.744871 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-77cc1aef-b695-444a-a25a-b75665f73b0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95cb2bc0a93a4b919a2d65a7576e6038', 'request_id': 'req-77cc1aef-b695-444a-a25a-b75665f73b0f'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:27.791847 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e576c473-f860-4bef-88d1-b3a32039c359 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0df8b006c5314616a9d91bd2975b5eba'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:27.805386 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e576c473-f860-4bef-88d1-b3a32039c359 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0df8b006c5314616a9d91bd2975b5eba'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:27.856700 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-77cc1aef-b695-444a-a25a-b75665f73b0f admin admin] The token cache is being invalidate because project 95cb2bc0a93a4b919a2d65a7576e6038 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:16:27.856700 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-77cc1aef-b695-444a-a25a-b75665f73b0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:27.857338 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-77cc1aef-b695-444a-a25a-b75665f73b0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:27.859189 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1471/2980] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:16:27 2022] DELETE /identity/v3/projects/95cb2bc0a93a4b919a2d65a7576e6038 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:16:27.869611 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e48e0-5346-4ce9-a765-94d8cbf5978c None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:27.870374 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e48e0-5346-4ce9-a765-94d8cbf5978c None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:27.871074 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e48e0-5346-4ce9-a765-94d8cbf5978c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:27.910054 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-489e48e0-5346-4ce9-a765-94d8cbf5978c None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:16:27.911467 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-489e48e0-5346-4ce9-a765-94d8cbf5978c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:27.957104 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e576c473-f860-4bef-88d1-b3a32039c359 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0df8b006c5314616a9d91bd2975b5eba'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:27.958272 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e576c473-f860-4bef-88d1-b3a32039c359 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0df8b006c5314616a9d91bd2975b5eba'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:27.969095 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1510/2981] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:16:27 2022] DELETE /identity/v3/users/0df8b006c5314616a9d91bd2975b5eba => generated 0 bytes in 774 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:16:27.975437 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24170b6-4e49-4ec3-8e11-355cb5626df2 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:27.976250 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24170b6-4e49-4ec3-8e11-355cb5626df2 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:27.976686 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24170b6-4e49-4ec3-8e11-355cb5626df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:28.015283 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1472/2982] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:16:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:16:28.016291 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951aa865-4a12-4b0d-8ca8-89ff149fbff6 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:28.018369 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951aa865-4a12-4b0d-8ca8-89ff149fbff6 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:28.018369 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951aa865-4a12-4b0d-8ca8-89ff149fbff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:28.049094 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-b24170b6-4e49-4ec3-8e11-355cb5626df2 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:16:28.050342 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b24170b6-4e49-4ec3-8e11-355cb5626df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:28.073877 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-951aa865-4a12-4b0d-8ca8-89ff149fbff6 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:16:28.075206 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-951aa865-4a12-4b0d-8ca8-89ff149fbff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:28.155593 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1511/2983] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:16:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:16:28.161415 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1473/2984] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:16:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:16:28.164584 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24170b6-4e49-4ec3-8e11-355cb5626df2 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:28.165945 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b24170b6-4e49-4ec3-8e11-355cb5626df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:28.167329 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951aa865-4a12-4b0d-8ca8-89ff149fbff6 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:28.179019 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951aa865-4a12-4b0d-8ca8-89ff149fbff6 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:28.189335 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b7e641-4b3f-41a2-90e7-03a59cc0cbcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:28.190778 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7e641-4b3f-41a2-90e7-03a59cc0cbcd admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:28.191247 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7e641-4b3f-41a2-90e7-03a59cc0cbcd admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:28.191779 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7e641-4b3f-41a2-90e7-03a59cc0cbcd admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:28.192904 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b7e641-4b3f-41a2-90e7-03a59cc0cbcd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:16:28.193430 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b7e641-4b3f-41a2-90e7-03a59cc0cbcd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:28.195793 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b7e641-4b3f-41a2-90e7-03a59cc0cbcd admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:28.217259 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1474/2985] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:16:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:16:28.218382 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b7e641-4b3f-41a2-90e7-03a59cc0cbcd admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:28.230286 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b7e641-4b3f-41a2-90e7-03a59cc0cbcd admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:28.235378 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d0561b-095c-4663-8362-ecd278d06a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:28.236122 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d0561b-095c-4663-8362-ecd278d06a09 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:28.236398 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d0561b-095c-4663-8362-ecd278d06a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:28.236753 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d0561b-095c-4663-8362-ecd278d06a09 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:28.237493 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d0561b-095c-4663-8362-ecd278d06a09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:28.238235 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24170b6-4e49-4ec3-8e11-355cb5626df2 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:28.239742 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d0561b-095c-4663-8362-ecd278d06a09 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:28.242361 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499f23a3-d912-40a1-af2e-b990f2bcd9fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:28.244681 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f23a3-d912-40a1-af2e-b990f2bcd9fa service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:28.245858 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f23a3-d912-40a1-af2e-b990f2bcd9fa service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:28.246155 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f23a3-d912-40a1-af2e-b990f2bcd9fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:28.259693 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499f23a3-d912-40a1-af2e-b990f2bcd9fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:28.261227 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499f23a3-d912-40a1-af2e-b990f2bcd9fa service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:28.275669 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1512/2986] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:16:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:16:28.340258 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1475/2987] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:16:28 2022] POST /identity/v3/projects => generated 381 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:16:28.344470 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499f23a3-d912-40a1-af2e-b990f2bcd9fa service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:28.356761 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499f23a3-d912-40a1-af2e-b990f2bcd9fa service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:28.416605 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5febf8-98c5-4dcb-849d-b935a97aebdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:28.417308 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5febf8-98c5-4dcb-849d-b935a97aebdb admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:28.417591 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5febf8-98c5-4dcb-849d-b935a97aebdb admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:28.417864 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5febf8-98c5-4dcb-849d-b935a97aebdb admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:28.418545 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5febf8-98c5-4dcb-849d-b935a97aebdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:28.420519 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5febf8-98c5-4dcb-849d-b935a97aebdb admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:28.515183 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1513/2988] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:16:28 2022] POST /identity/v3/users => generated 291 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:16:28.519085 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d0561b-095c-4663-8362-ecd278d06a09 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:28.530667 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d0561b-095c-4663-8362-ecd278d06a09 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:28.535941 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e10fffb-abcb-4c29-a322-9584d6c41824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:28.536713 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10fffb-abcb-4c29-a322-9584d6c41824 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:28.537126 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10fffb-abcb-4c29-a322-9584d6c41824 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:28.537526 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10fffb-abcb-4c29-a322-9584d6c41824 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:28.538275 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e10fffb-abcb-4c29-a322-9584d6c41824 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:28.540682 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e10fffb-abcb-4c29-a322-9584d6c41824 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:28.554266 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1476/2989] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:16:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:16:28.556005 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5febf8-98c5-4dcb-849d-b935a97aebdb admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:28.566580 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5febf8-98c5-4dcb-849d-b935a97aebdb admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:28.571437 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c25761-4307-4df2-8029-8ab1250cc144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:28.574332 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c25761-4307-4df2-8029-8ab1250cc144 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:28.574332 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c25761-4307-4df2-8029-8ab1250cc144 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:28.574332 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c25761-4307-4df2-8029-8ab1250cc144 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:28.574332 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c25761-4307-4df2-8029-8ab1250cc144 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:28.575107 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c25761-4307-4df2-8029-8ab1250cc144 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:28.585262 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1514/2990] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:16:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:16:28.590434 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e10fffb-abcb-4c29-a322-9584d6c41824 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:28.600518 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e10fffb-abcb-4c29-a322-9584d6c41824 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:28.605890 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc4f76-3144-4591-ad08-07b45ab3ed0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:28.606768 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc4f76-3144-4591-ad08-07b45ab3ed0f admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:28.607048 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc4f76-3144-4591-ad08-07b45ab3ed0f admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:28.607322 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc4f76-3144-4591-ad08-07b45ab3ed0f admin admin] PATH_INFO: `/v3/projects/a1c562e1e1414d32b858e08cb6379e8a/users/154d05e107d74202beabaa0b60dab8c8/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:28.633297 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fc4f76-3144-4591-ad08-07b45ab3ed0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1c562e1e1414d32b858e08cb6379e8a, user_id=154d05e107d74202beabaa0b60dab8c8, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:28.637196 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fc4f76-3144-4591-ad08-07b45ab3ed0f admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:28.738672 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1477/2991] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:16:28 2022] PUT /identity/v3/projects/a1c562e1e1414d32b858e08cb6379e8a/users/154d05e107d74202beabaa0b60dab8c8/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:16:28.750051 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5380f08-3bfd-4f14-82e3-abcc5eabb300 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:28.751454 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5380f08-3bfd-4f14-82e3-abcc5eabb300 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:28.752744 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5380f08-3bfd-4f14-82e3-abcc5eabb300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:28.793667 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-e5380f08-3bfd-4f14-82e3-abcc5eabb300 None None] MFA Rules not processed for user `154d05e107d74202beabaa0b60dab8c8`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:16:28.795010 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e5380f08-3bfd-4f14-82e3-abcc5eabb300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:28.878433 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1515/2992] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:16:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:16:28.883390 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc4f76-3144-4591-ad08-07b45ab3ed0f admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:28.912257 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5380f08-3bfd-4f14-82e3-abcc5eabb300 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:28.912830 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e5380f08-3bfd-4f14-82e3-abcc5eabb300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:29.011221 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc4f76-3144-4591-ad08-07b45ab3ed0f admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:29.016253 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8f7be5-2b1a-4adc-ad60-71b156327377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:29.017020 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f7be5-2b1a-4adc-ad60-71b156327377 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:29.017323 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f7be5-2b1a-4adc-ad60-71b156327377 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:29.017563 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f7be5-2b1a-4adc-ad60-71b156327377 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:29.018265 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8f7be5-2b1a-4adc-ad60-71b156327377 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:29.020716 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8f7be5-2b1a-4adc-ad60-71b156327377 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:29.043770 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5380f08-3bfd-4f14-82e3-abcc5eabb300 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:29.049414 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff2aec0-a140-43fd-9939-fb14480c2114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:29.050702 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff2aec0-a140-43fd-9939-fb14480c2114 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:29.051035 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff2aec0-a140-43fd-9939-fb14480c2114 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:29.051321 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff2aec0-a140-43fd-9939-fb14480c2114 admin admin] PATH_INFO: `/v3/projects/9cd3efb132bd4c4da3730331e5b15792` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:29.052791 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff2aec0-a140-43fd-9939-fb14480c2114 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cd3efb132bd4c4da3730331e5b15792)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:29.055199 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff2aec0-a140-43fd-9939-fb14480c2114 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:29.107280 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1478/2993] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:16:28 2022] POST /identity/v3/projects => generated 383 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:16:29.111256 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8f7be5-2b1a-4adc-ad60-71b156327377 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:29.218233 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-4ff2aec0-a140-43fd-9939-fb14480c2114 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cd3efb132bd4c4da3730331e5b15792', 'request_id': 'req-4ff2aec0-a140-43fd-9939-fb14480c2114'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:29.222960 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8f7be5-2b1a-4adc-ad60-71b156327377 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:29.234417 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-4ff2aec0-a140-43fd-9939-fb14480c2114 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cd3efb132bd4c4da3730331e5b15792', 'request_id': 'req-4ff2aec0-a140-43fd-9939-fb14480c2114'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:29.328949 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d64ee3-4404-4afa-bfe8-d461d259ae7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:29.329768 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d64ee3-4404-4afa-bfe8-d461d259ae7c admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:29.330124 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d64ee3-4404-4afa-bfe8-d461d259ae7c admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:29.330481 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d64ee3-4404-4afa-bfe8-d461d259ae7c admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:29.331282 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d64ee3-4404-4afa-bfe8-d461d259ae7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:29.333509 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d64ee3-4404-4afa-bfe8-d461d259ae7c admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:29.349710 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-4ff2aec0-a140-43fd-9939-fb14480c2114 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cd3efb132bd4c4da3730331e5b15792', 'request_id': 'req-4ff2aec0-a140-43fd-9939-fb14480c2114'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:29.366768 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-4ff2aec0-a140-43fd-9939-fb14480c2114 admin admin] The token cache is being invalidate because project 9cd3efb132bd4c4da3730331e5b15792 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:16:29.367106 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-4ff2aec0-a140-43fd-9939-fb14480c2114 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:29.367843 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-4ff2aec0-a140-43fd-9939-fb14480c2114 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:29.370655 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1516/2994] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:16:28 2022] DELETE /identity/v3/projects/9cd3efb132bd4c4da3730331e5b15792 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:16:29.376020 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd89b2f8-2675-432d-98fe-749e1f19d831 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:29.377410 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd89b2f8-2675-432d-98fe-749e1f19d831 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:29.384704 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd89b2f8-2675-432d-98fe-749e1f19d831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:29.398626 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-fd89b2f8-2675-432d-98fe-749e1f19d831 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:16:29.399907 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-fd89b2f8-2675-432d-98fe-749e1f19d831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:29.408375 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1517/2995] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:16:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:16:29.411938 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1479/2996] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:16:29 2022] POST /identity/v3/users => generated 298 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:16:29.412998 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd89b2f8-2675-432d-98fe-749e1f19d831 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:29.414629 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-fd89b2f8-2675-432d-98fe-749e1f19d831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:29.420819 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d28c1-c1e4-4842-8b58-cb46a5c1ea3f None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:29.420819 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d28c1-c1e4-4842-8b58-cb46a5c1ea3f None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:29.420819 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d28c1-c1e4-4842-8b58-cb46a5c1ea3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:29.438257 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd89b2f8-2675-432d-98fe-749e1f19d831 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:29.444083 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-d95d28c1-c1e4-4842-8b58-cb46a5c1ea3f None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:16:29.444883 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-d95d28c1-c1e4-4842-8b58-cb46a5c1ea3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:29.449303 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480210fd-5725-4682-84fe-a0e66cce15c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:29.450325 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480210fd-5725-4682-84fe-a0e66cce15c6 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:29.450798 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480210fd-5725-4682-84fe-a0e66cce15c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:29.452135 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480210fd-5725-4682-84fe-a0e66cce15c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:29.453203 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480210fd-5725-4682-84fe-a0e66cce15c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:29.455261 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480210fd-5725-4682-84fe-a0e66cce15c6 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:29.459725 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1480/2997] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:16:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:16:29.465038 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d28c1-c1e4-4842-8b58-cb46a5c1ea3f None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:29.468337 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1518/2998] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:16:29 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:16:29.474056 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d28c1-c1e4-4842-8b58-cb46a5c1ea3f None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:29.478449 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480210fd-5725-4682-84fe-a0e66cce15c6 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:29.479282 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50053aea-a2d4-4a1f-b702-efb4921c1728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:29.479990 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50053aea-a2d4-4a1f-b702-efb4921c1728 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:29.480273 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50053aea-a2d4-4a1f-b702-efb4921c1728 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:29.480555 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50053aea-a2d4-4a1f-b702-efb4921c1728 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:29.481277 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50053aea-a2d4-4a1f-b702-efb4921c1728 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:16:29.481629 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50053aea-a2d4-4a1f-b702-efb4921c1728 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:29.483434 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50053aea-a2d4-4a1f-b702-efb4921c1728 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:29.491708 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480210fd-5725-4682-84fe-a0e66cce15c6 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:29.501044 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1481/2999] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:16:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:16:29.506668 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2fc064-c715-4e90-9380-666babece1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:29.507212 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50053aea-a2d4-4a1f-b702-efb4921c1728 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:29.509392 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2fc064-c715-4e90-9380-666babece1db admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:29.510760 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2fc064-c715-4e90-9380-666babece1db admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:29.514718 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2fc064-c715-4e90-9380-666babece1db admin admin] PATH_INFO: `/v3/projects/704ee73b20f34a9d8786979f32b6da08/users/8c7d9001553b47e5aa8a0dc0a90dc409/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:29.528345 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50053aea-a2d4-4a1f-b702-efb4921c1728 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:29.535110 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2efa6e-3f0c-4b60-84bd-011bee9314ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:29.536251 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2efa6e-3f0c-4b60-84bd-011bee9314ba admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:29.536713 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2efa6e-3f0c-4b60-84bd-011bee9314ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:29.537185 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2efa6e-3f0c-4b60-84bd-011bee9314ba admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:29.538023 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2efa6e-3f0c-4b60-84bd-011bee9314ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:29.538669 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2fc064-c715-4e90-9380-666babece1db admin admin] RBAC: Authorizing `identity:create_grant(project_id=704ee73b20f34a9d8786979f32b6da08, user_id=8c7d9001553b47e5aa8a0dc0a90dc409, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:29.541121 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2efa6e-3f0c-4b60-84bd-011bee9314ba admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:29.555007 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2fc064-c715-4e90-9380-666babece1db admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:29.676429 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1482/3000] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:16:29 2022] POST /identity/v3/projects => generated 397 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:16:29.680350 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2efa6e-3f0c-4b60-84bd-011bee9314ba admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:29.713263 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1519/3001] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:16:29 2022] PUT /identity/v3/projects/704ee73b20f34a9d8786979f32b6da08/users/8c7d9001553b47e5aa8a0dc0a90dc409/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:16:29.718172 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2fc064-c715-4e90-9380-666babece1db admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:29.771469 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2efa6e-3f0c-4b60-84bd-011bee9314ba admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:29.800994 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2fc064-c715-4e90-9380-666babece1db admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:29.808619 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc4070-7747-483d-9249-c2daf211eaae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:29.809365 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc4070-7747-483d-9249-c2daf211eaae admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:29.809655 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc4070-7747-483d-9249-c2daf211eaae admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:29.810079 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc4070-7747-483d-9249-c2daf211eaae admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:29.810815 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccc4070-7747-483d-9249-c2daf211eaae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:29.812599 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccc4070-7747-483d-9249-c2daf211eaae admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:29.830589 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1520/3002] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:16:29 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:16:29.830589 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc4070-7747-483d-9249-c2daf211eaae admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:29.853038 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f19d561-62cf-4d28-9498-d719559cf0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:29.854587 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f19d561-62cf-4d28-9498-d719559cf0d5 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:29.855091 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f19d561-62cf-4d28-9498-d719559cf0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:29.855819 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f19d561-62cf-4d28-9498-d719559cf0d5 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:29.856374 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc4070-7747-483d-9249-c2daf211eaae admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:29.856983 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f19d561-62cf-4d28-9498-d719559cf0d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:29.861459 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f19d561-62cf-4d28-9498-d719559cf0d5 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:29.873273 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c7035c-9443-460a-81c0-6dd9fe8bbabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:29.874180 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7035c-9443-460a-81c0-6dd9fe8bbabf admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:29.877040 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7035c-9443-460a-81c0-6dd9fe8bbabf admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:29.877040 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7035c-9443-460a-81c0-6dd9fe8bbabf admin admin] PATH_INFO: `/v3/projects/704ee73b20f34a9d8786979f32b6da08/users/8c7d9001553b47e5aa8a0dc0a90dc409/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:29.878968 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c7035c-9443-460a-81c0-6dd9fe8bbabf admin admin] RBAC: Authorizing `identity:create_grant(project_id=704ee73b20f34a9d8786979f32b6da08, user_id=8c7d9001553b47e5aa8a0dc0a90dc409, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:29.881958 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c7035c-9443-460a-81c0-6dd9fe8bbabf admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:29.895907 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1521/3003] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:16:29 2022] PUT /identity/v3/projects/704ee73b20f34a9d8786979f32b6da08/users/8c7d9001553b47e5aa8a0dc0a90dc409/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:16:29.907317 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2604d46c-2324-4024-93d3-a55d8dcc69dd None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:29.907776 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2604d46c-2324-4024-93d3-a55d8dcc69dd None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:29.908126 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2604d46c-2324-4024-93d3-a55d8dcc69dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:29.941743 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-2604d46c-2324-4024-93d3-a55d8dcc69dd None None] MFA Rules not processed for user `8c7d9001553b47e5aa8a0dc0a90dc409`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:16:29.943051 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-2604d46c-2324-4024-93d3-a55d8dcc69dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:30.021500 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1483/3004] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:16:29 2022] POST /identity/v3/users => generated 299 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:16:30.023881 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f19d561-62cf-4d28-9498-d719559cf0d5 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:30.044238 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1522/3005] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:16:29 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:16:30.044509 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f19d561-62cf-4d28-9498-d719559cf0d5 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:30.098231 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2604d46c-2324-4024-93d3-a55d8dcc69dd None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:30.099152 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-2604d46c-2324-4024-93d3-a55d8dcc69dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:30.132383 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2162615-4877-4f33-9a15-3ed5ef45f792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:30.133541 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2162615-4877-4f33-9a15-3ed5ef45f792 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:30.133924 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2162615-4877-4f33-9a15-3ed5ef45f792 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:30.134304 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2162615-4877-4f33-9a15-3ed5ef45f792 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:30.135268 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2162615-4877-4f33-9a15-3ed5ef45f792 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:30.137032 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2162615-4877-4f33-9a15-3ed5ef45f792 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:30.154562 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1484/3006] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:16:30 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:16:30.157030 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79587b4e-1070-4d69-8946-6139d62ca67b None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:30.157513 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79587b4e-1070-4d69-8946-6139d62ca67b None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:30.157901 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79587b4e-1070-4d69-8946-6139d62ca67b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:30.177203 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-79587b4e-1070-4d69-8946-6139d62ca67b None None] MFA Rules not processed for user `154d05e107d74202beabaa0b60dab8c8`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:16:30.178670 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-79587b4e-1070-4d69-8946-6139d62ca67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:30.191081 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2604d46c-2324-4024-93d3-a55d8dcc69dd None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:30.195818 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd434230-c5c6-4112-8c9c-ef030e95381b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:30.196781 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd434230-c5c6-4112-8c9c-ef030e95381b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:30.197063 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd434230-c5c6-4112-8c9c-ef030e95381b admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:30.197343 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd434230-c5c6-4112-8c9c-ef030e95381b admin admin] PATH_INFO: `/v3/users/e87dae577e6c42ba8d14094bd6cad9de` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:30.198570 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd434230-c5c6-4112-8c9c-ef030e95381b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e87dae577e6c42ba8d14094bd6cad9de)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:30.200697 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd434230-c5c6-4112-8c9c-ef030e95381b admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:30.259380 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1485/3007] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:16:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:16:30.261137 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79587b4e-1070-4d69-8946-6139d62ca67b None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:30.276743 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79587b4e-1070-4d69-8946-6139d62ca67b None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:30.284963 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4030d38-edb5-4c52-9881-b8d6c8b3c649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:30.286226 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4030d38-edb5-4c52-9881-b8d6c8b3c649 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:30.286885 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4030d38-edb5-4c52-9881-b8d6c8b3c649 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:30.286885 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4030d38-edb5-4c52-9881-b8d6c8b3c649 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:30.287747 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4030d38-edb5-4c52-9881-b8d6c8b3c649 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:30.291189 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4030d38-edb5-4c52-9881-b8d6c8b3c649 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:30.303184 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1486/3008] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:16:30 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:16:30.308447 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4030d38-edb5-4c52-9881-b8d6c8b3c649 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:30.320910 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4030d38-edb5-4c52-9881-b8d6c8b3c649 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:30.326874 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9768ebc-52b3-44c1-947e-95cbb157b61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:30.327809 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9768ebc-52b3-44c1-947e-95cbb157b61a admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:30.328095 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9768ebc-52b3-44c1-947e-95cbb157b61a admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:30.328409 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9768ebc-52b3-44c1-947e-95cbb157b61a admin admin] PATH_INFO: `/v3/projects/87efca1c13a8404896728ea606abde39/users/ef788d4f59b2492db17db14f497b74c4/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:30.345088 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9768ebc-52b3-44c1-947e-95cbb157b61a admin admin] RBAC: Authorizing `identity:create_grant(project_id=87efca1c13a8404896728ea606abde39, user_id=ef788d4f59b2492db17db14f497b74c4, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:30.348066 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9768ebc-52b3-44c1-947e-95cbb157b61a admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:30.429558 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-cd434230-c5c6-4112-8c9c-ef030e95381b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e87dae577e6c42ba8d14094bd6cad9de'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:30.438620 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1487/3009] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:16:30 2022] PUT /identity/v3/projects/87efca1c13a8404896728ea606abde39/users/ef788d4f59b2492db17db14f497b74c4/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:16:30.441224 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9768ebc-52b3-44c1-947e-95cbb157b61a admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:30.443820 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b9768ebc-52b3-44c1-947e-95cbb157b61a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:30.444948 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-cd434230-c5c6-4112-8c9c-ef030e95381b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e87dae577e6c42ba8d14094bd6cad9de'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:30.453707 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-cd434230-c5c6-4112-8c9c-ef030e95381b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e87dae577e6c42ba8d14094bd6cad9de'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:30.520479 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9768ebc-52b3-44c1-947e-95cbb157b61a admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:30.528748 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a118532-aae6-4696-be4c-fb00543b9533 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:30.529411 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a118532-aae6-4696-be4c-fb00543b9533 service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:30.531652 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a118532-aae6-4696-be4c-fb00543b9533 service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:30.531652 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a118532-aae6-4696-be4c-fb00543b9533 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:30.532379 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-9a118532-aae6-4696-be4c-fb00543b9533 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:30.555325 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-cd434230-c5c6-4112-8c9c-ef030e95381b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e87dae577e6c42ba8d14094bd6cad9de'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:30.560649 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-cd434230-c5c6-4112-8c9c-ef030e95381b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e87dae577e6c42ba8d14094bd6cad9de'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:30.569786 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1523/3010] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:16:30 2022] DELETE /identity/v3/users/e87dae577e6c42ba8d14094bd6cad9de => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:16:30.573591 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b49f6f-c503-4b8e-ac6a-7f59bb4e4296 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:30.574210 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b49f6f-c503-4b8e-ac6a-7f59bb4e4296 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:30.574672 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b49f6f-c503-4b8e-ac6a-7f59bb4e4296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:30.598653 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-36b49f6f-c503-4b8e-ac6a-7f59bb4e4296 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:16:30.600276 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-36b49f6f-c503-4b8e-ac6a-7f59bb4e4296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:30.609112 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a118532-aae6-4696-be4c-fb00543b9533 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:30.610724 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a118532-aae6-4696-be4c-fb00543b9533 service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:30.633371 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1488/3011] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:16:30 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:16:30.636118 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c920fc-d4d9-4baf-aec0-4ab71fca41c3 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:30.636566 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c920fc-d4d9-4baf-aec0-4ab71fca41c3 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:30.637152 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c920fc-d4d9-4baf-aec0-4ab71fca41c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:30.660826 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-08c920fc-d4d9-4baf-aec0-4ab71fca41c3 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:16:30.663025 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-08c920fc-d4d9-4baf-aec0-4ab71fca41c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:30.686784 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1524/3012] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:16:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:16:30.693247 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b49f6f-c503-4b8e-ac6a-7f59bb4e4296 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:30.700773 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-36b49f6f-c503-4b8e-ac6a-7f59bb4e4296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:30.787620 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b49f6f-c503-4b8e-ac6a-7f59bb4e4296 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:30.793311 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1489/3013] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:16:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:16:30.796003 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c477bac-350e-4c1b-9010-44515e81a27b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:30.796948 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c477bac-350e-4c1b-9010-44515e81a27b service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:30.797425 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c477bac-350e-4c1b-9010-44515e81a27b service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:30.797917 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c477bac-350e-4c1b-9010-44515e81a27b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:30.815109 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c477bac-350e-4c1b-9010-44515e81a27b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:30.816654 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c477bac-350e-4c1b-9010-44515e81a27b service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:30.828471 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c920fc-d4d9-4baf-aec0-4ab71fca41c3 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:30.844039 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c920fc-d4d9-4baf-aec0-4ab71fca41c3 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:30.848872 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1525/3014] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:16:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:16:30.851514 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af16472b-8c40-4a0d-bde9-6d652a43529d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:30.853060 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af16472b-8c40-4a0d-bde9-6d652a43529d service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:30.853698 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af16472b-8c40-4a0d-bde9-6d652a43529d service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:30.854267 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af16472b-8c40-4a0d-bde9-6d652a43529d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:30.866609 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af16472b-8c40-4a0d-bde9-6d652a43529d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:30.868880 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af16472b-8c40-4a0d-bde9-6d652a43529d service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:30.881994 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1490/3015] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:16:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:16:31.324236 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c477bac-350e-4c1b-9010-44515e81a27b service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:31.325877 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-8c477bac-350e-4c1b-9010-44515e81a27b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:31.342693 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c477bac-350e-4c1b-9010-44515e81a27b service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:31.348825 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9346184f-66d3-46b4-b2db-ae35e058c58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:31.349928 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9346184f-66d3-46b4-b2db-ae35e058c58d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:31.350727 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9346184f-66d3-46b4-b2db-ae35e058c58d admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:31.351368 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9346184f-66d3-46b4-b2db-ae35e058c58d admin admin] PATH_INFO: `/v3/projects/b30891c9ccaf4e1bbdec0c910805d504` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:31.353898 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9346184f-66d3-46b4-b2db-ae35e058c58d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b30891c9ccaf4e1bbdec0c910805d504)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:31.356282 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9346184f-66d3-46b4-b2db-ae35e058c58d admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:31.474084 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9346184f-66d3-46b4-b2db-ae35e058c58d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b30891c9ccaf4e1bbdec0c910805d504', 'request_id': 'req-9346184f-66d3-46b4-b2db-ae35e058c58d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:31.481924 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9346184f-66d3-46b4-b2db-ae35e058c58d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b30891c9ccaf4e1bbdec0c910805d504', 'request_id': 'req-9346184f-66d3-46b4-b2db-ae35e058c58d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:31.573013 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9346184f-66d3-46b4-b2db-ae35e058c58d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b30891c9ccaf4e1bbdec0c910805d504', 'request_id': 'req-9346184f-66d3-46b4-b2db-ae35e058c58d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:31.620169 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9346184f-66d3-46b4-b2db-ae35e058c58d admin admin] The token cache is being invalidate because project b30891c9ccaf4e1bbdec0c910805d504 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:16:31.620432 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9346184f-66d3-46b4-b2db-ae35e058c58d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:31.621555 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9346184f-66d3-46b4-b2db-ae35e058c58d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:31.623662 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1526/3016] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:16:31 2022] DELETE /identity/v3/projects/b30891c9ccaf4e1bbdec0c910805d504 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:16:31.628110 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ca04b-a88f-465d-bff0-cbfdf87a8517 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:31.628596 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ca04b-a88f-465d-bff0-cbfdf87a8517 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:31.629210 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ca04b-a88f-465d-bff0-cbfdf87a8517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:31.655454 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-6f1ca04b-a88f-465d-bff0-cbfdf87a8517 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:16:31.656725 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-6f1ca04b-a88f-465d-bff0-cbfdf87a8517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:31.753902 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1491/3017] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:16:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:16:31.827226 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0164640b-6ad3-465c-bc56-cc31207d452c None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:31.827506 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0164640b-6ad3-465c-bc56-cc31207d452c None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:31.827673 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0164640b-6ad3-465c-bc56-cc31207d452c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:31.850870 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-0164640b-6ad3-465c-bc56-cc31207d452c None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:16:31.853460 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-0164640b-6ad3-465c-bc56-cc31207d452c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:31.867641 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1527/3018] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:16:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:16:31.870511 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ca04b-a88f-465d-bff0-cbfdf87a8517 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:31.888949 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ca04b-a88f-465d-bff0-cbfdf87a8517 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:31.904848 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec5f57-dc77-4561-b989-347121629da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:31.905548 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec5f57-dc77-4561-b989-347121629da9 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:31.905836 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec5f57-dc77-4561-b989-347121629da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:31.906099 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec5f57-dc77-4561-b989-347121629da9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:31.906831 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ec5f57-dc77-4561-b989-347121629da9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:16:31.907173 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ec5f57-dc77-4561-b989-347121629da9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:31.908873 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ec5f57-dc77-4561-b989-347121629da9 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:31.944214 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1492/3019] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:16:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:16:31.948527 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0164640b-6ad3-465c-bc56-cc31207d452c None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:31.957813 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0164640b-6ad3-465c-bc56-cc31207d452c None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:31.962879 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b6c81e-fa7c-4f06-a149-db10dad5307e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:31.963570 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6c81e-fa7c-4f06-a149-db10dad5307e admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:31.963860 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6c81e-fa7c-4f06-a149-db10dad5307e admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:31.964247 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6c81e-fa7c-4f06-a149-db10dad5307e admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:31.964987 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b6c81e-fa7c-4f06-a149-db10dad5307e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:31.966942 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b6c81e-fa7c-4f06-a149-db10dad5307e admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:32.113189 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1528/3020] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:16:31 2022] POST /identity/v3/projects => generated 399 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:16:32.118548 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec5f57-dc77-4561-b989-347121629da9 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:32.132576 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec5f57-dc77-4561-b989-347121629da9 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:32.216753 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c0e59a-0389-41a9-9ec3-37d8d12f09ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:32.217566 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0e59a-0389-41a9-9ec3-37d8d12f09ca admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:32.217850 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0e59a-0389-41a9-9ec3-37d8d12f09ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:32.218124 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0e59a-0389-41a9-9ec3-37d8d12f09ca admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:32.218809 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c0e59a-0389-41a9-9ec3-37d8d12f09ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:32.220763 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c0e59a-0389-41a9-9ec3-37d8d12f09ca admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:32.325928 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1493/3021] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:16:32 2022] POST /identity/v3/users => generated 300 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:16:32.330066 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b6c81e-fa7c-4f06-a149-db10dad5307e admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:32.341673 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b6c81e-fa7c-4f06-a149-db10dad5307e admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:32.350654 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a56703b-566f-4e75-a02d-0b3b5e12a228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:32.351362 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a56703b-566f-4e75-a02d-0b3b5e12a228 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:32.351675 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a56703b-566f-4e75-a02d-0b3b5e12a228 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:32.351949 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a56703b-566f-4e75-a02d-0b3b5e12a228 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:32.353315 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a56703b-566f-4e75-a02d-0b3b5e12a228 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:32.354974 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a56703b-566f-4e75-a02d-0b3b5e12a228 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:32.369060 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1529/3022] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:16:32 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:16:32.375876 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c0e59a-0389-41a9-9ec3-37d8d12f09ca admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:32.384477 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c0e59a-0389-41a9-9ec3-37d8d12f09ca admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:32.391962 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488555a4-186f-4e85-8ee0-b9735b3f6ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:32.393261 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488555a4-186f-4e85-8ee0-b9735b3f6ee6 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:32.394441 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488555a4-186f-4e85-8ee0-b9735b3f6ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:32.394441 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488555a4-186f-4e85-8ee0-b9735b3f6ee6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:32.394790 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488555a4-186f-4e85-8ee0-b9735b3f6ee6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:32.396425 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488555a4-186f-4e85-8ee0-b9735b3f6ee6 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:32.407951 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1494/3023] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:16:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:16:32.412353 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a56703b-566f-4e75-a02d-0b3b5e12a228 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:32.423401 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a56703b-566f-4e75-a02d-0b3b5e12a228 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:32.427997 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bb4bce-9789-41ce-b635-4b9d24b6ebcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:32.432501 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb4bce-9789-41ce-b635-4b9d24b6ebcb admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:32.432501 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb4bce-9789-41ce-b635-4b9d24b6ebcb admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:32.432501 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb4bce-9789-41ce-b635-4b9d24b6ebcb admin admin] PATH_INFO: `/v3/projects/dfdcd319144a4bfc900bc852e5af53a5/users/b4a4535d476449dcb26b5aad77ec636d/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:32.445536 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bb4bce-9789-41ce-b635-4b9d24b6ebcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfdcd319144a4bfc900bc852e5af53a5, user_id=b4a4535d476449dcb26b5aad77ec636d, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:32.448527 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bb4bce-9789-41ce-b635-4b9d24b6ebcb admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:32.552178 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1530/3024] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:16:32 2022] PUT /identity/v3/projects/dfdcd319144a4bfc900bc852e5af53a5/users/b4a4535d476449dcb26b5aad77ec636d/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:16:32.563295 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f101d07-540f-4857-9400-cc6a66a6cf2c None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:32.563632 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f101d07-540f-4857-9400-cc6a66a6cf2c None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:32.563913 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f101d07-540f-4857-9400-cc6a66a6cf2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:32.587834 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baff107-18aa-42fe-b23e-6b8b217003f2 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:32.588430 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baff107-18aa-42fe-b23e-6b8b217003f2 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:32.588929 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baff107-18aa-42fe-b23e-6b8b217003f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:32.599975 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-9f101d07-540f-4857-9400-cc6a66a6cf2c None None] MFA Rules not processed for user `b4a4535d476449dcb26b5aad77ec636d`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:16:32.603459 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-9f101d07-540f-4857-9400-cc6a66a6cf2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:32.664284 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-3baff107-18aa-42fe-b23e-6b8b217003f2 None None] MFA Rules not processed for user `ef788d4f59b2492db17db14f497b74c4`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:16:32.666366 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-3baff107-18aa-42fe-b23e-6b8b217003f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:32.739090 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1495/3025] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:16:32 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:16:32.821515 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1531/3026] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:16:32 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:16:32.860263 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f101d07-540f-4857-9400-cc6a66a6cf2c None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:32.861807 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-9f101d07-540f-4857-9400-cc6a66a6cf2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:32.951812 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f101d07-540f-4857-9400-cc6a66a6cf2c None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:32.958189 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812c3d93-66b0-4107-83c6-f5c91036f679 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:32.958900 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c3d93-66b0-4107-83c6-f5c91036f679 service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:32.959264 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c3d93-66b0-4107-83c6-f5c91036f679 service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:32.959445 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c3d93-66b0-4107-83c6-f5c91036f679 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:32.974673 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baff107-18aa-42fe-b23e-6b8b217003f2 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:32.976373 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812c3d93-66b0-4107-83c6-f5c91036f679 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:32.976569 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-3baff107-18aa-42fe-b23e-6b8b217003f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:32.980754 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812c3d93-66b0-4107-83c6-f5c91036f679 service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:32.993976 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1496/3027] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:16:32 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:16:33.002225 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baff107-18aa-42fe-b23e-6b8b217003f2 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:33.011102 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45250bf3-ece9-449b-aab4-04d75e5cc292 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:33.011102 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45250bf3-ece9-449b-aab4-04d75e5cc292 service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:33.011102 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45250bf3-ece9-449b-aab4-04d75e5cc292 service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:33.011387 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45250bf3-ece9-449b-aab4-04d75e5cc292 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:33.019801 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45250bf3-ece9-449b-aab4-04d75e5cc292 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:33.021449 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45250bf3-ece9-449b-aab4-04d75e5cc292 service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:33.043461 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812c3d93-66b0-4107-83c6-f5c91036f679 service nova] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:33.046789 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1532/3028] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:16:32 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:16:33.150643 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812c3d93-66b0-4107-83c6-f5c91036f679 service nova] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:33.163694 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098d96c0-ff45-4e1b-a331-04257e38ada0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:33.164690 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d96c0-ff45-4e1b-a331-04257e38ada0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:33.165124 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d96c0-ff45-4e1b-a331-04257e38ada0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:33.165648 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d96c0-ff45-4e1b-a331-04257e38ada0 admin admin] PATH_INFO: `/v3/users/b4a4535d476449dcb26b5aad77ec636d` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:33.169276 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098d96c0-ff45-4e1b-a331-04257e38ada0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4a4535d476449dcb26b5aad77ec636d)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:33.174158 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098d96c0-ff45-4e1b-a331-04257e38ada0 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:33.468719 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-098d96c0-ff45-4e1b-a331-04257e38ada0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4a4535d476449dcb26b5aad77ec636d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:33.486673 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-098d96c0-ff45-4e1b-a331-04257e38ada0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4a4535d476449dcb26b5aad77ec636d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:33.486673 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-098d96c0-ff45-4e1b-a331-04257e38ada0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4a4535d476449dcb26b5aad77ec636d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:33.566201 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-098d96c0-ff45-4e1b-a331-04257e38ada0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4a4535d476449dcb26b5aad77ec636d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:33.596105 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-098d96c0-ff45-4e1b-a331-04257e38ada0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4a4535d476449dcb26b5aad77ec636d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:33.605040 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1497/3029] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:16:33 2022] DELETE /identity/v3/users/b4a4535d476449dcb26b5aad77ec636d => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:16:33.610233 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca28a723-53d9-4145-bdaf-d42dd35a09b9 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:33.610837 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca28a723-53d9-4145-bdaf-d42dd35a09b9 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:33.610837 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca28a723-53d9-4145-bdaf-d42dd35a09b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:33.633632 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-ca28a723-53d9-4145-bdaf-d42dd35a09b9 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:16:33.636571 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ca28a723-53d9-4145-bdaf-d42dd35a09b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:33.707586 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1533/3030] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:16:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:16:33.718213 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098d96c0-ff45-4e1b-a331-04257e38ada0 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:33.719698 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-098d96c0-ff45-4e1b-a331-04257e38ada0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:33.780629 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098d96c0-ff45-4e1b-a331-04257e38ada0 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:33.784429 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd18f28f-bc48-4b00-aac2-11dd6bea8011 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:33.785088 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd18f28f-bc48-4b00-aac2-11dd6bea8011 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:33.785377 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd18f28f-bc48-4b00-aac2-11dd6bea8011 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:33.785657 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd18f28f-bc48-4b00-aac2-11dd6bea8011 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:33.796037 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd18f28f-bc48-4b00-aac2-11dd6bea8011 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:33.797544 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd18f28f-bc48-4b00-aac2-11dd6bea8011 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:33.808239 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1498/3031] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:16:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:16:34.513765 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca28a723-53d9-4145-bdaf-d42dd35a09b9 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:34.515329 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ca28a723-53d9-4145-bdaf-d42dd35a09b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:34.536736 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca28a723-53d9-4145-bdaf-d42dd35a09b9 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:34.546467 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09202470-587b-4152-93ce-fc802d03ef20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:34.547645 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09202470-587b-4152-93ce-fc802d03ef20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:34.548091 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09202470-587b-4152-93ce-fc802d03ef20 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:34.548552 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09202470-587b-4152-93ce-fc802d03ef20 admin admin] PATH_INFO: `/v3/users/ef788d4f59b2492db17db14f497b74c4` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:34.554740 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09202470-587b-4152-93ce-fc802d03ef20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef788d4f59b2492db17db14f497b74c4)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:34.557684 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09202470-587b-4152-93ce-fc802d03ef20 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:34.771897 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-09202470-587b-4152-93ce-fc802d03ef20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef788d4f59b2492db17db14f497b74c4'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:34.784842 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-09202470-587b-4152-93ce-fc802d03ef20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef788d4f59b2492db17db14f497b74c4'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:34.796163 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-09202470-587b-4152-93ce-fc802d03ef20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef788d4f59b2492db17db14f497b74c4'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:34.860528 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd18f28f-bc48-4b00-aac2-11dd6bea8011 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:34.862764 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-bd18f28f-bc48-4b00-aac2-11dd6bea8011 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:34.871225 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-09202470-587b-4152-93ce-fc802d03ef20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef788d4f59b2492db17db14f497b74c4'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:34.872211 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-09202470-587b-4152-93ce-fc802d03ef20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef788d4f59b2492db17db14f497b74c4'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:34.878009 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd18f28f-bc48-4b00-aac2-11dd6bea8011 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:34.880759 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1534/3032] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:16:34 2022] DELETE /identity/v3/users/ef788d4f59b2492db17db14f497b74c4 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:16:34.972404 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de474624-11ca-437f-bb10-08d941de9d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:34.973700 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de474624-11ca-437f-bb10-08d941de9d5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:34.973975 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de474624-11ca-437f-bb10-08d941de9d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:34.974426 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de474624-11ca-437f-bb10-08d941de9d5b admin admin] PATH_INFO: `/v3/projects/dfdcd319144a4bfc900bc852e5af53a5` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:34.976056 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de474624-11ca-437f-bb10-08d941de9d5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfdcd319144a4bfc900bc852e5af53a5)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:34.980550 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de474624-11ca-437f-bb10-08d941de9d5b admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:35.199595 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-de474624-11ca-437f-bb10-08d941de9d5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfdcd319144a4bfc900bc852e5af53a5', 'request_id': 'req-de474624-11ca-437f-bb10-08d941de9d5b'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:35.205291 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-de474624-11ca-437f-bb10-08d941de9d5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfdcd319144a4bfc900bc852e5af53a5', 'request_id': 'req-de474624-11ca-437f-bb10-08d941de9d5b'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:35.212755 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-de474624-11ca-437f-bb10-08d941de9d5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfdcd319144a4bfc900bc852e5af53a5', 'request_id': 'req-de474624-11ca-437f-bb10-08d941de9d5b'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:35.280672 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09202470-587b-4152-93ce-fc802d03ef20 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:35.282241 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-09202470-587b-4152-93ce-fc802d03ef20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:35.300968 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09202470-587b-4152-93ce-fc802d03ef20 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:35.343571 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-de474624-11ca-437f-bb10-08d941de9d5b admin admin] The token cache is being invalidate because project dfdcd319144a4bfc900bc852e5af53a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:16:35.343870 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-de474624-11ca-437f-bb10-08d941de9d5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:35.344954 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-de474624-11ca-437f-bb10-08d941de9d5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:35.348314 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1499/3033] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:16:34 2022] DELETE /identity/v3/projects/dfdcd319144a4bfc900bc852e5af53a5 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:16:35.353080 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc52f3-d91d-4652-b484-5d28fc91a700 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:35.353871 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc52f3-d91d-4652-b484-5d28fc91a700 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:35.354390 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc52f3-d91d-4652-b484-5d28fc91a700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:35.381867 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-60fc52f3-d91d-4652-b484-5d28fc91a700 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:16:35.384470 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-60fc52f3-d91d-4652-b484-5d28fc91a700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:35.396285 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6590d3-d1de-41cc-a40b-3e1cbe6628fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:35.397792 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6590d3-d1de-41cc-a40b-3e1cbe6628fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:35.398671 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6590d3-d1de-41cc-a40b-3e1cbe6628fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:35.399208 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6590d3-d1de-41cc-a40b-3e1cbe6628fc admin admin] PATH_INFO: `/v3/projects/87efca1c13a8404896728ea606abde39` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:35.401119 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6590d3-d1de-41cc-a40b-3e1cbe6628fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=87efca1c13a8404896728ea606abde39)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:35.403753 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6590d3-d1de-41cc-a40b-3e1cbe6628fc admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:35.469064 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1500/3034] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:16:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:16:35.477287 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0e1d9-7c07-46b2-bc7f-d206c11ec533 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:35.478876 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0e1d9-7c07-46b2-bc7f-d206c11ec533 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:35.478876 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0e1d9-7c07-46b2-bc7f-d206c11ec533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:35.497124 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-4ff0e1d9-7c07-46b2-bc7f-d206c11ec533 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:16:35.498322 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-4ff0e1d9-7c07-46b2-bc7f-d206c11ec533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:35.510918 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1501/3035] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:16:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:16:35.513348 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff0e1d9-7c07-46b2-bc7f-d206c11ec533 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:35.520832 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff0e1d9-7c07-46b2-bc7f-d206c11ec533 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:35.526327 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d25acbe-5cab-41cc-bba6-d0783a9a16e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:35.527036 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25acbe-5cab-41cc-bba6-d0783a9a16e8 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:35.527651 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25acbe-5cab-41cc-bba6-d0783a9a16e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:35.528065 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25acbe-5cab-41cc-bba6-d0783a9a16e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:35.528885 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d25acbe-5cab-41cc-bba6-d0783a9a16e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:16:35.529359 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d25acbe-5cab-41cc-bba6-d0783a9a16e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:35.531409 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d25acbe-5cab-41cc-bba6-d0783a9a16e8 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:35.546014 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1502/3036] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:16:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:16:35.550380 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d25acbe-5cab-41cc-bba6-d0783a9a16e8 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:35.564488 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d25acbe-5cab-41cc-bba6-d0783a9a16e8 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:35.579344 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-4c6590d3-d1de-41cc-a40b-3e1cbe6628fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87efca1c13a8404896728ea606abde39', 'request_id': 'req-4c6590d3-d1de-41cc-a40b-3e1cbe6628fc'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:35.621145 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-4c6590d3-d1de-41cc-a40b-3e1cbe6628fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87efca1c13a8404896728ea606abde39', 'request_id': 'req-4c6590d3-d1de-41cc-a40b-3e1cbe6628fc'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:35.653396 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f60395-8391-4893-9351-35e5f0af2d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:35.654396 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f60395-8391-4893-9351-35e5f0af2d50 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:35.654873 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f60395-8391-4893-9351-35e5f0af2d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:35.655312 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f60395-8391-4893-9351-35e5f0af2d50 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:35.656201 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f60395-8391-4893-9351-35e5f0af2d50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:35.658547 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f60395-8391-4893-9351-35e5f0af2d50 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:35.667616 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-4c6590d3-d1de-41cc-a40b-3e1cbe6628fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87efca1c13a8404896728ea606abde39', 'request_id': 'req-4c6590d3-d1de-41cc-a40b-3e1cbe6628fc'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:35.681500 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-4c6590d3-d1de-41cc-a40b-3e1cbe6628fc admin admin] The token cache is being invalidate because project 87efca1c13a8404896728ea606abde39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:16:35.681748 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-4c6590d3-d1de-41cc-a40b-3e1cbe6628fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:35.683943 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-4c6590d3-d1de-41cc-a40b-3e1cbe6628fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:35.686436 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1535/3037] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:16:35 2022] DELETE /identity/v3/projects/87efca1c13a8404896728ea606abde39 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:16:35.700106 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c4082c-2b0b-4448-80fb-4fd57f0fbaae None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:35.700649 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c4082c-2b0b-4448-80fb-4fd57f0fbaae None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:35.701026 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c4082c-2b0b-4448-80fb-4fd57f0fbaae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:35.720543 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-97c4082c-2b0b-4448-80fb-4fd57f0fbaae None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:16:35.721859 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-97c4082c-2b0b-4448-80fb-4fd57f0fbaae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:35.737845 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1536/3038] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:16:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:16:35.747037 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47949b78-67c5-485e-8bd4-24bf5bb88412 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:35.747373 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47949b78-67c5-485e-8bd4-24bf5bb88412 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:35.747687 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47949b78-67c5-485e-8bd4-24bf5bb88412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:35.769559 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-47949b78-67c5-485e-8bd4-24bf5bb88412 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:16:35.770778 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-47949b78-67c5-485e-8bd4-24bf5bb88412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:35.779204 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1537/3039] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:16:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:16:35.784151 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47949b78-67c5-485e-8bd4-24bf5bb88412 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:35.797822 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1503/3040] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:16:35 2022] POST /identity/v3/projects => generated 371 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:16:35.799135 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47949b78-67c5-485e-8bd4-24bf5bb88412 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:35.801736 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f60395-8391-4893-9351-35e5f0af2d50 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:35.808676 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-67f60395-8391-4893-9351-35e5f0af2d50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:35.892257 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c5c2e0-6851-491a-acae-22408c863846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:35.893866 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c5c2e0-6851-491a-acae-22408c863846 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:35.894862 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c5c2e0-6851-491a-acae-22408c863846 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:35.895468 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c5c2e0-6851-491a-acae-22408c863846 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:35.897616 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c5c2e0-6851-491a-acae-22408c863846 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:16:35.898040 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c5c2e0-6851-491a-acae-22408c863846 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:35.901191 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c5c2e0-6851-491a-acae-22408c863846 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:35.914126 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f60395-8391-4893-9351-35e5f0af2d50 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:35.924287 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1538/3041] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:16:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:16:35.928664 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594a639a-82e9-4a5d-a09a-1061e40e89b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:35.929764 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a639a-82e9-4a5d-a09a-1061e40e89b4 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:35.930813 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a639a-82e9-4a5d-a09a-1061e40e89b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:35.931302 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a639a-82e9-4a5d-a09a-1061e40e89b4 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:35.932199 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594a639a-82e9-4a5d-a09a-1061e40e89b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:35.935085 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594a639a-82e9-4a5d-a09a-1061e40e89b4 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:35.936775 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c5c2e0-6851-491a-acae-22408c863846 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:35.951279 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c5c2e0-6851-491a-acae-22408c863846 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:35.957506 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e09396e-f890-43c9-b8b8-fd877e5fe54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:35.963341 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e09396e-f890-43c9-b8b8-fd877e5fe54a admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:35.963341 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e09396e-f890-43c9-b8b8-fd877e5fe54a admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:35.963341 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e09396e-f890-43c9-b8b8-fd877e5fe54a admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:35.963341 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e09396e-f890-43c9-b8b8-fd877e5fe54a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:35.963341 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e09396e-f890-43c9-b8b8-fd877e5fe54a admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:36.046359 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1504/3042] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:16:35 2022] POST /identity/v3/users => generated 286 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:16:36.050377 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594a639a-82e9-4a5d-a09a-1061e40e89b4 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:36.061887 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594a639a-82e9-4a5d-a09a-1061e40e89b4 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:36.068677 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a3c14-9a63-4215-8d4a-90d7c298781b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:36.069478 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a3c14-9a63-4215-8d4a-90d7c298781b admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:36.069960 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a3c14-9a63-4215-8d4a-90d7c298781b admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:36.070416 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a3c14-9a63-4215-8d4a-90d7c298781b admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:36.071953 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018a3c14-9a63-4215-8d4a-90d7c298781b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:36.074690 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018a3c14-9a63-4215-8d4a-90d7c298781b admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:36.078861 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1539/3043] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:16:35 2022] POST /identity/v3/projects => generated 373 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:16:36.085122 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e09396e-f890-43c9-b8b8-fd877e5fe54a admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:36.091786 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1505/3044] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:16:36 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:16:36.093608 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a3c14-9a63-4215-8d4a-90d7c298781b admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:36.107032 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a3c14-9a63-4215-8d4a-90d7c298781b admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:36.160377 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e09396e-f890-43c9-b8b8-fd877e5fe54a admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:36.170436 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf091e7-463a-4d25-97a3-0354ddd31d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:36.171748 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf091e7-463a-4d25-97a3-0354ddd31d3c admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:36.172185 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf091e7-463a-4d25-97a3-0354ddd31d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:36.174164 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf091e7-463a-4d25-97a3-0354ddd31d3c admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:36.174164 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf091e7-463a-4d25-97a3-0354ddd31d3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:36.175972 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf091e7-463a-4d25-97a3-0354ddd31d3c admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:36.177999 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a089e4db-4cb8-4c09-956c-f05c2cce8c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:36.178706 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a089e4db-4cb8-4c09-956c-f05c2cce8c56 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:36.178990 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a089e4db-4cb8-4c09-956c-f05c2cce8c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:36.179267 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a089e4db-4cb8-4c09-956c-f05c2cce8c56 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:36.180041 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a089e4db-4cb8-4c09-956c-f05c2cce8c56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:36.181674 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a089e4db-4cb8-4c09-956c-f05c2cce8c56 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:36.192246 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1506/3045] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:16:36 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:16:36.196560 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a089e4db-4cb8-4c09-956c-f05c2cce8c56 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:36.206820 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a089e4db-4cb8-4c09-956c-f05c2cce8c56 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:36.212235 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb06e1-b637-46c4-835e-3f3a5cac5653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:36.213268 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb06e1-b637-46c4-835e-3f3a5cac5653 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:36.213552 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb06e1-b637-46c4-835e-3f3a5cac5653 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:36.213844 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb06e1-b637-46c4-835e-3f3a5cac5653 admin admin] PATH_INFO: `/v3/projects/bbf6d1ac2f3f4c29a66d25f3044f163e/users/c3bed22a17b24698a4dc1edb62e55feb/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:36.231009 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fb06e1-b637-46c4-835e-3f3a5cac5653 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbf6d1ac2f3f4c29a66d25f3044f163e, user_id=c3bed22a17b24698a4dc1edb62e55feb, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:36.233789 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fb06e1-b637-46c4-835e-3f3a5cac5653 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:36.301590 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1540/3046] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:16:36 2022] POST /identity/v3/users => generated 287 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:16:36.302878 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf091e7-463a-4d25-97a3-0354ddd31d3c admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:36.312936 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf091e7-463a-4d25-97a3-0354ddd31d3c admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:36.317726 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257408a4-43ab-4741-8e8a-f37a26bae5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:36.318419 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257408a4-43ab-4741-8e8a-f37a26bae5e0 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:36.318671 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257408a4-43ab-4741-8e8a-f37a26bae5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:36.318953 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257408a4-43ab-4741-8e8a-f37a26bae5e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:36.319700 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257408a4-43ab-4741-8e8a-f37a26bae5e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:36.321949 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257408a4-43ab-4741-8e8a-f37a26bae5e0 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:36.327655 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1507/3047] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:16:36 2022] PUT /identity/v3/projects/bbf6d1ac2f3f4c29a66d25f3044f163e/users/c3bed22a17b24698a4dc1edb62e55feb/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:16:36.344648 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2906c79-41ad-4e94-958d-f145b1e3d598 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:36.345553 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1541/3048] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:16:36 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:16:36.348272 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2906c79-41ad-4e94-958d-f145b1e3d598 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:36.348616 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2906c79-41ad-4e94-958d-f145b1e3d598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:36.350343 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257408a4-43ab-4741-8e8a-f37a26bae5e0 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:36.368883 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257408a4-43ab-4741-8e8a-f37a26bae5e0 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:36.395196 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-e2906c79-41ad-4e94-958d-f145b1e3d598 None None] MFA Rules not processed for user `c3bed22a17b24698a4dc1edb62e55feb`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:16:36.396702 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e2906c79-41ad-4e94-958d-f145b1e3d598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:36.473817 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54741679-4952-426a-9996-f219db9cd433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:36.474603 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54741679-4952-426a-9996-f219db9cd433 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:36.475115 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54741679-4952-426a-9996-f219db9cd433 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:36.475591 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54741679-4952-426a-9996-f219db9cd433 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:36.476402 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54741679-4952-426a-9996-f219db9cd433 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:36.478364 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54741679-4952-426a-9996-f219db9cd433 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:36.494437 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1508/3049] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:16:36 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:16:36.502354 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2906c79-41ad-4e94-958d-f145b1e3d598 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:36.504052 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e2906c79-41ad-4e94-958d-f145b1e3d598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:36.511659 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1542/3050] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:16:36 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:16:36.516195 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54741679-4952-426a-9996-f219db9cd433 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:36.546270 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54741679-4952-426a-9996-f219db9cd433 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:36.568823 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb07337-537a-41da-a904-49d55af53d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:36.571677 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb07337-537a-41da-a904-49d55af53d2c admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:36.572054 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb07337-537a-41da-a904-49d55af53d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:36.572358 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb07337-537a-41da-a904-49d55af53d2c admin admin] PATH_INFO: `/v3/projects/9197ea49e7544e7c96dd2d4b1a55fa29/users/6ae75ac4b3ed44eda1e8717ff641cd0c/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:36.609113 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb07337-537a-41da-a904-49d55af53d2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9197ea49e7544e7c96dd2d4b1a55fa29, user_id=6ae75ac4b3ed44eda1e8717ff641cd0c, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:36.609548 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2906c79-41ad-4e94-958d-f145b1e3d598 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:36.618219 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd603d8-f57a-4f5e-821d-d0531ec1f22c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:36.618994 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb07337-537a-41da-a904-49d55af53d2c admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:36.619135 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd603d8-f57a-4f5e-821d-d0531ec1f22c service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:36.619242 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd603d8-f57a-4f5e-821d-d0531ec1f22c service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:36.619459 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd603d8-f57a-4f5e-821d-d0531ec1f22c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:36.629784 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd603d8-f57a-4f5e-821d-d0531ec1f22c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:36.631609 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd603d8-f57a-4f5e-821d-d0531ec1f22c service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:36.651667 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1509/3051] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:16:36 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:16:36.737542 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1543/3052] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:16:36 2022] PUT /identity/v3/projects/9197ea49e7544e7c96dd2d4b1a55fa29/users/6ae75ac4b3ed44eda1e8717ff641cd0c/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:16:36.740384 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af742c35-645d-4309-aca0-33628cff96f3 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:36.740384 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af742c35-645d-4309-aca0-33628cff96f3 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:36.740384 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af742c35-645d-4309-aca0-33628cff96f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:36.796607 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-af742c35-645d-4309-aca0-33628cff96f3 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:16:36.799539 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-af742c35-645d-4309-aca0-33628cff96f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:36.882456 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1510/3053] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:16:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:16:36.898130 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb07337-537a-41da-a904-49d55af53d2c admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:36.900148 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-adb07337-537a-41da-a904-49d55af53d2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:36.992404 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb07337-537a-41da-a904-49d55af53d2c admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:36.996839 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e331c-31e2-4e5b-9f8c-72742263eb2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:36.997479 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e331c-31e2-4e5b-9f8c-72742263eb2f service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:36.997766 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e331c-31e2-4e5b-9f8c-72742263eb2f service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:36.998047 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e331c-31e2-4e5b-9f8c-72742263eb2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:37.009074 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667e331c-31e2-4e5b-9f8c-72742263eb2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:37.010877 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667e331c-31e2-4e5b-9f8c-72742263eb2f service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:37.021795 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1544/3054] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:16:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:16:37.321715 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af742c35-645d-4309-aca0-33628cff96f3 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:37.324330 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-af742c35-645d-4309-aca0-33628cff96f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:37.393633 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af742c35-645d-4309-aca0-33628cff96f3 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:37.395553 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f84eb43-57fb-4acb-a87e-2fe14f910121 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b5cb86f190f4fcfb06d66cb8f14643f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:37.396332 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84eb43-57fb-4acb-a87e-2fe14f910121 service glance] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:37.396680 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84eb43-57fb-4acb-a87e-2fe14f910121 service glance] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:37.397024 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84eb43-57fb-4acb-a87e-2fe14f910121 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:37.399779 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-0f84eb43-57fb-4acb-a87e-2fe14f910121 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:37.490957 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f84eb43-57fb-4acb-a87e-2fe14f910121 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:37.492464 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f84eb43-57fb-4acb-a87e-2fe14f910121 service glance] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:37.505643 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1511/3055] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:16:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:16:37.567686 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e331c-31e2-4e5b-9f8c-72742263eb2f service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:37.575545 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e331c-31e2-4e5b-9f8c-72742263eb2f service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:37.580839 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de94040-ea9c-4c84-96b2-84ec0d6d9805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:37.581940 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de94040-ea9c-4c84-96b2-84ec0d6d9805 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:37.582307 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de94040-ea9c-4c84-96b2-84ec0d6d9805 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:37.582680 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de94040-ea9c-4c84-96b2-84ec0d6d9805 admin admin] PATH_INFO: `/v3/users/c3bed22a17b24698a4dc1edb62e55feb` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:37.585477 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de94040-ea9c-4c84-96b2-84ec0d6d9805 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3bed22a17b24698a4dc1edb62e55feb)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:37.589221 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de94040-ea9c-4c84-96b2-84ec0d6d9805 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:37.821233 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3de94040-ea9c-4c84-96b2-84ec0d6d9805 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3bed22a17b24698a4dc1edb62e55feb'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:37.834542 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3de94040-ea9c-4c84-96b2-84ec0d6d9805 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3bed22a17b24698a4dc1edb62e55feb'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:37.844314 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3de94040-ea9c-4c84-96b2-84ec0d6d9805 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3bed22a17b24698a4dc1edb62e55feb'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:37.937553 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3de94040-ea9c-4c84-96b2-84ec0d6d9805 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3bed22a17b24698a4dc1edb62e55feb'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:37.938559 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3de94040-ea9c-4c84-96b2-84ec0d6d9805 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3bed22a17b24698a4dc1edb62e55feb'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:37.947696 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1545/3056] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:16:37 2022] DELETE /identity/v3/users/c3bed22a17b24698a4dc1edb62e55feb => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:16:37.952159 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07d3bff-4e0d-434e-8db3-a750d07548d5 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:37.952612 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07d3bff-4e0d-434e-8db3-a750d07548d5 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:37.953611 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07d3bff-4e0d-434e-8db3-a750d07548d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:37.989571 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-f07d3bff-4e0d-434e-8db3-a750d07548d5 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:16:37.993212 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-f07d3bff-4e0d-434e-8db3-a750d07548d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:38.074348 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1512/3057] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:16:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:16:38.116768 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de94040-ea9c-4c84-96b2-84ec0d6d9805 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:38.118929 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-3de94040-ea9c-4c84-96b2-84ec0d6d9805 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:38.199544 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de94040-ea9c-4c84-96b2-84ec0d6d9805 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:38.205799 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be296a0b-975e-4c85-aab3-2d2dad6d9765 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:38.206469 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be296a0b-975e-4c85-aab3-2d2dad6d9765 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:38.206783 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be296a0b-975e-4c85-aab3-2d2dad6d9765 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:38.207062 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be296a0b-975e-4c85-aab3-2d2dad6d9765 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:38.218301 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be296a0b-975e-4c85-aab3-2d2dad6d9765 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:38.225494 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be296a0b-975e-4c85-aab3-2d2dad6d9765 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:38.237331 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1546/3058] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:16:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:16:38.942081 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07d3bff-4e0d-434e-8db3-a750d07548d5 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:38.943834 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-f07d3bff-4e0d-434e-8db3-a750d07548d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:38.971642 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07d3bff-4e0d-434e-8db3-a750d07548d5 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:38.982224 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e797d98d-3b68-4751-9e7e-d2bd9e70ec0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:38.983125 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797d98d-3b68-4751-9e7e-d2bd9e70ec0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:38.983414 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797d98d-3b68-4751-9e7e-d2bd9e70ec0e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:38.983725 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797d98d-3b68-4751-9e7e-d2bd9e70ec0e admin admin] PATH_INFO: `/v3/projects/bbf6d1ac2f3f4c29a66d25f3044f163e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:38.985465 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e797d98d-3b68-4751-9e7e-d2bd9e70ec0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbf6d1ac2f3f4c29a66d25f3044f163e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:38.987719 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e797d98d-3b68-4751-9e7e-d2bd9e70ec0e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:39.189517 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e797d98d-3b68-4751-9e7e-d2bd9e70ec0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbf6d1ac2f3f4c29a66d25f3044f163e', 'request_id': 'req-e797d98d-3b68-4751-9e7e-d2bd9e70ec0e'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:39.196316 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e797d98d-3b68-4751-9e7e-d2bd9e70ec0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbf6d1ac2f3f4c29a66d25f3044f163e', 'request_id': 'req-e797d98d-3b68-4751-9e7e-d2bd9e70ec0e'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:39.203268 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e797d98d-3b68-4751-9e7e-d2bd9e70ec0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbf6d1ac2f3f4c29a66d25f3044f163e', 'request_id': 'req-e797d98d-3b68-4751-9e7e-d2bd9e70ec0e'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:39.390877 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e797d98d-3b68-4751-9e7e-d2bd9e70ec0e admin admin] The token cache is being invalidate because project bbf6d1ac2f3f4c29a66d25f3044f163e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:16:39.390877 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e797d98d-3b68-4751-9e7e-d2bd9e70ec0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:39.391508 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e797d98d-3b68-4751-9e7e-d2bd9e70ec0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:39.395144 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1513/3059] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:16:38 2022] DELETE /identity/v3/projects/bbf6d1ac2f3f4c29a66d25f3044f163e => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:16:39.400314 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c83965-7d2f-4071-acb2-ebf070762772 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:39.400781 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c83965-7d2f-4071-acb2-ebf070762772 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:39.406917 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c83965-7d2f-4071-acb2-ebf070762772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:39.432843 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-72c83965-7d2f-4071-acb2-ebf070762772 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:16:39.434012 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-72c83965-7d2f-4071-acb2-ebf070762772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:39.512819 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e797d98d-3b68-4751-9e7e-d2bd9e70ec0e admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:39.514556 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e797d98d-3b68-4751-9e7e-d2bd9e70ec0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:39.521666 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1547/3060] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:16:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:16:39.530453 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2126a29b-7d50-4be5-9868-3deba584d0fd None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:39.530864 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2126a29b-7d50-4be5-9868-3deba584d0fd None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:39.531241 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2126a29b-7d50-4be5-9868-3deba584d0fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:39.573507 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-2126a29b-7d50-4be5-9868-3deba584d0fd None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:16:39.574751 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-2126a29b-7d50-4be5-9868-3deba584d0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:39.585525 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1548/3061] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:16:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:16:39.590098 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2126a29b-7d50-4be5-9868-3deba584d0fd None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:39.604084 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e797d98d-3b68-4751-9e7e-d2bd9e70ec0e admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:39.614053 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5998e21f-6482-4a31-9503-ccd1c0be74cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:39.615365 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5998e21f-6482-4a31-9503-ccd1c0be74cf service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:39.615881 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5998e21f-6482-4a31-9503-ccd1c0be74cf service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:39.615996 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2126a29b-7d50-4be5-9868-3deba584d0fd None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:39.617106 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5998e21f-6482-4a31-9503-ccd1c0be74cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:39.621094 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-5998e21f-6482-4a31-9503-ccd1c0be74cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:39.626954 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51852368-6fcb-4286-9996-6dc3a8016660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:39.630908 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51852368-6fcb-4286-9996-6dc3a8016660 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:39.631525 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51852368-6fcb-4286-9996-6dc3a8016660 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:39.634755 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51852368-6fcb-4286-9996-6dc3a8016660 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:39.635654 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51852368-6fcb-4286-9996-6dc3a8016660 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:16:39.636050 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51852368-6fcb-4286-9996-6dc3a8016660 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:39.637777 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51852368-6fcb-4286-9996-6dc3a8016660 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:39.686763 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1549/3062] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:16:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:16:39.687719 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51852368-6fcb-4286-9996-6dc3a8016660 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:39.710667 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51852368-6fcb-4286-9996-6dc3a8016660 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:39.718838 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b40b3a-56be-407a-acbb-dfae31909560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:39.720219 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b40b3a-56be-407a-acbb-dfae31909560 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:39.720745 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b40b3a-56be-407a-acbb-dfae31909560 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:39.721257 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b40b3a-56be-407a-acbb-dfae31909560 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:39.722727 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b40b3a-56be-407a-acbb-dfae31909560 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:39.726324 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b40b3a-56be-407a-acbb-dfae31909560 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:39.800981 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5998e21f-6482-4a31-9503-ccd1c0be74cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:39.802659 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5998e21f-6482-4a31-9503-ccd1c0be74cf service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:39.817358 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1514/3063] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:16:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:16:39.833988 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1550/3064] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:16:39 2022] POST /identity/v3/projects => generated 397 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:16:39.839385 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5998e21f-6482-4a31-9503-ccd1c0be74cf service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:39.857868 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5998e21f-6482-4a31-9503-ccd1c0be74cf service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:39.992848 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b43001d-3c5f-4313-a95d-f00bf0c4ff2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:39.993700 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b43001d-3c5f-4313-a95d-f00bf0c4ff2d admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:39.994235 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b43001d-3c5f-4313-a95d-f00bf0c4ff2d admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:39.994612 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b43001d-3c5f-4313-a95d-f00bf0c4ff2d admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:39.995444 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b43001d-3c5f-4313-a95d-f00bf0c4ff2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:39.998337 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b43001d-3c5f-4313-a95d-f00bf0c4ff2d admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:40.108814 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1515/3065] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:16:39 2022] POST /identity/v3/users => generated 299 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:16:40.114523 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b40b3a-56be-407a-acbb-dfae31909560 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:40.153173 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b40b3a-56be-407a-acbb-dfae31909560 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:40.160610 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5a5430-669e-4f31-8051-a1c24ff39fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:40.161380 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a5430-669e-4f31-8051-a1c24ff39fea admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:40.161668 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a5430-669e-4f31-8051-a1c24ff39fea admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:40.161950 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a5430-669e-4f31-8051-a1c24ff39fea admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:40.162688 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5a5430-669e-4f31-8051-a1c24ff39fea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:40.164376 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5a5430-669e-4f31-8051-a1c24ff39fea admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:40.183551 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1551/3066] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:16:40 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:16:40.186664 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b43001d-3c5f-4313-a95d-f00bf0c4ff2d admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:40.200392 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b43001d-3c5f-4313-a95d-f00bf0c4ff2d admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:40.213893 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0584386-40fc-45a8-a284-d017ccb3f6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:40.214965 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0584386-40fc-45a8-a284-d017ccb3f6a3 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:40.215446 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0584386-40fc-45a8-a284-d017ccb3f6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:40.215952 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0584386-40fc-45a8-a284-d017ccb3f6a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:40.218041 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0584386-40fc-45a8-a284-d017ccb3f6a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:40.220635 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0584386-40fc-45a8-a284-d017ccb3f6a3 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:40.235254 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1516/3067] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:16:40 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:16:40.239179 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5a5430-669e-4f31-8051-a1c24ff39fea admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:40.252507 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5a5430-669e-4f31-8051-a1c24ff39fea admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:40.258475 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6c60ac-fb65-49c9-a2f5-e88c80e799d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:40.259706 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c60ac-fb65-49c9-a2f5-e88c80e799d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:40.260157 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c60ac-fb65-49c9-a2f5-e88c80e799d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:40.260597 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c60ac-fb65-49c9-a2f5-e88c80e799d2 admin admin] PATH_INFO: `/v3/projects/f9acbb04d9b6439bb94b5f602dceb932/users/5a7c8b811af04d7f90b0a68849ac7957/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:40.279990 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6c60ac-fb65-49c9-a2f5-e88c80e799d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9acbb04d9b6439bb94b5f602dceb932, user_id=5a7c8b811af04d7f90b0a68849ac7957, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:40.283761 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6c60ac-fb65-49c9-a2f5-e88c80e799d2 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:40.408741 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1552/3068] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:16:40 2022] PUT /identity/v3/projects/f9acbb04d9b6439bb94b5f602dceb932/users/5a7c8b811af04d7f90b0a68849ac7957/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:16:40.421019 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c715ac8-389b-4997-9377-f773863ad049 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:40.421550 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c715ac8-389b-4997-9377-f773863ad049 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:40.422138 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c715ac8-389b-4997-9377-f773863ad049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:40.481482 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-3c715ac8-389b-4997-9377-f773863ad049 None None] MFA Rules not processed for user `5a7c8b811af04d7f90b0a68849ac7957`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:16:40.483185 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-3c715ac8-389b-4997-9377-f773863ad049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:40.580635 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1517/3069] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:16:40 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:16:40.591929 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6c60ac-fb65-49c9-a2f5-e88c80e799d2 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:40.594440 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-cd6c60ac-fb65-49c9-a2f5-e88c80e799d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:40.685601 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6c60ac-fb65-49c9-a2f5-e88c80e799d2 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:40.692991 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceff70a-dd49-45b6-bf33-786755cb6358 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:40.693333 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceff70a-dd49-45b6-bf33-786755cb6358 service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:40.693790 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceff70a-dd49-45b6-bf33-786755cb6358 service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:40.694235 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceff70a-dd49-45b6-bf33-786755cb6358 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:40.705935 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceff70a-dd49-45b6-bf33-786755cb6358 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:40.708106 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceff70a-dd49-45b6-bf33-786755cb6358 service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:40.727176 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1553/3070] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:16:40 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:16:40.802262 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae2f0f-1fe3-438d-a445-044d6c45dc78 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:40.802568 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae2f0f-1fe3-438d-a445-044d6c45dc78 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:40.802850 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae2f0f-1fe3-438d-a445-044d6c45dc78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:40.844722 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-7bae2f0f-1fe3-438d-a445-044d6c45dc78 None None] MFA Rules not processed for user `5a7c8b811af04d7f90b0a68849ac7957`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:16:40.846520 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-7bae2f0f-1fe3-438d-a445-044d6c45dc78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:40.858161 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1518/3071] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:16:40 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:16:41.464025 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceff70a-dd49-45b6-bf33-786755cb6358 service nova] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:41.566337 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceff70a-dd49-45b6-bf33-786755cb6358 service nova] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:41.573000 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7d84cf-77eb-4678-a042-085cc4aa87f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:41.574088 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d84cf-77eb-4678-a042-085cc4aa87f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:41.574547 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d84cf-77eb-4678-a042-085cc4aa87f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:41.574982 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d84cf-77eb-4678-a042-085cc4aa87f7 admin admin] PATH_INFO: `/v3/users/5a7c8b811af04d7f90b0a68849ac7957` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:41.576507 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7d84cf-77eb-4678-a042-085cc4aa87f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a7c8b811af04d7f90b0a68849ac7957)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:41.578686 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7d84cf-77eb-4678-a042-085cc4aa87f7 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:41.839662 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0a7d84cf-77eb-4678-a042-085cc4aa87f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a7c8b811af04d7f90b0a68849ac7957'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:41.859738 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0a7d84cf-77eb-4678-a042-085cc4aa87f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a7c8b811af04d7f90b0a68849ac7957'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:41.870448 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0a7d84cf-77eb-4678-a042-085cc4aa87f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a7c8b811af04d7f90b0a68849ac7957'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:41.943246 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0a7d84cf-77eb-4678-a042-085cc4aa87f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a7c8b811af04d7f90b0a68849ac7957'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:41.944168 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0a7d84cf-77eb-4678-a042-085cc4aa87f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a7c8b811af04d7f90b0a68849ac7957'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:41.955358 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1554/3072] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:16:41 2022] DELETE /identity/v3/users/5a7c8b811af04d7f90b0a68849ac7957 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:16:41.958021 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd48258-caa1-4d69-8d2f-5b8201808921 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:41.958502 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd48258-caa1-4d69-8d2f-5b8201808921 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:41.958589 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd48258-caa1-4d69-8d2f-5b8201808921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:41.981334 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-7fd48258-caa1-4d69-8d2f-5b8201808921 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:16:41.982927 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-7fd48258-caa1-4d69-8d2f-5b8201808921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:42.058566 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1519/3073] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:16:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:16:42.077118 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7d84cf-77eb-4678-a042-085cc4aa87f7 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:42.077118 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-0a7d84cf-77eb-4678-a042-085cc4aa87f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:42.221283 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7d84cf-77eb-4678-a042-085cc4aa87f7 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:42.236838 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820a0de8-b6f0-4b85-b476-521324434ff8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:42.236838 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a0de8-b6f0-4b85-b476-521324434ff8 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:42.236838 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a0de8-b6f0-4b85-b476-521324434ff8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:42.236838 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a0de8-b6f0-4b85-b476-521324434ff8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:42.268136 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820a0de8-b6f0-4b85-b476-521324434ff8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:42.270701 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820a0de8-b6f0-4b85-b476-521324434ff8 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:42.309258 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1555/3074] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:16:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:16:43.099051 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd48258-caa1-4d69-8d2f-5b8201808921 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:43.100673 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-7fd48258-caa1-4d69-8d2f-5b8201808921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:43.144463 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd48258-caa1-4d69-8d2f-5b8201808921 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:43.158069 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdd08e6-b363-44fb-af92-d1a98bb88325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:43.158965 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd08e6-b363-44fb-af92-d1a98bb88325 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:43.159247 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd08e6-b363-44fb-af92-d1a98bb88325 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:43.161208 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd08e6-b363-44fb-af92-d1a98bb88325 admin admin] PATH_INFO: `/v3/projects/f9acbb04d9b6439bb94b5f602dceb932` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:43.169090 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdd08e6-b363-44fb-af92-d1a98bb88325 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9acbb04d9b6439bb94b5f602dceb932)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:43.171335 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdd08e6-b363-44fb-af92-d1a98bb88325 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:43.320666 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-1fdd08e6-b363-44fb-af92-d1a98bb88325 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9acbb04d9b6439bb94b5f602dceb932', 'request_id': 'req-1fdd08e6-b363-44fb-af92-d1a98bb88325'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:43.328809 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-1fdd08e6-b363-44fb-af92-d1a98bb88325 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9acbb04d9b6439bb94b5f602dceb932', 'request_id': 'req-1fdd08e6-b363-44fb-af92-d1a98bb88325'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:43.335831 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-1fdd08e6-b363-44fb-af92-d1a98bb88325 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9acbb04d9b6439bb94b5f602dceb932', 'request_id': 'req-1fdd08e6-b363-44fb-af92-d1a98bb88325'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:43.415807 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-1fdd08e6-b363-44fb-af92-d1a98bb88325 admin admin] The token cache is being invalidate because project f9acbb04d9b6439bb94b5f602dceb932 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:16:43.415807 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-1fdd08e6-b363-44fb-af92-d1a98bb88325 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:43.423811 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-1fdd08e6-b363-44fb-af92-d1a98bb88325 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:43.423811 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1520/3075] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:16:43 2022] DELETE /identity/v3/projects/f9acbb04d9b6439bb94b5f602dceb932 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:16:43.428880 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8556ec-742d-45e1-acba-81fb6cdddc5c None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:43.429429 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8556ec-742d-45e1-acba-81fb6cdddc5c None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:43.429554 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8556ec-742d-45e1-acba-81fb6cdddc5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:43.475086 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-6e8556ec-742d-45e1-acba-81fb6cdddc5c None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:16:43.481308 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-6e8556ec-742d-45e1-acba-81fb6cdddc5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:43.671244 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519fabb6-146e-4730-ac52-2760e9a74d62 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:43.676232 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1556/3076] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:16:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:16:43.678567 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519fabb6-146e-4730-ac52-2760e9a74d62 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:43.678873 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519fabb6-146e-4730-ac52-2760e9a74d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:43.724033 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-519fabb6-146e-4730-ac52-2760e9a74d62 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:16:43.725493 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-519fabb6-146e-4730-ac52-2760e9a74d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:43.757258 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1521/3077] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:16:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:16:43.763351 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8556ec-742d-45e1-acba-81fb6cdddc5c None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:43.777160 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8556ec-742d-45e1-acba-81fb6cdddc5c None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:43.782282 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac469ca7-1a28-46dd-af95-517f2a252cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:43.782946 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac469ca7-1a28-46dd-af95-517f2a252cba admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:43.783395 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac469ca7-1a28-46dd-af95-517f2a252cba admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:43.783878 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac469ca7-1a28-46dd-af95-517f2a252cba admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:43.784664 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac469ca7-1a28-46dd-af95-517f2a252cba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:16:43.784965 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac469ca7-1a28-46dd-af95-517f2a252cba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:43.786728 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac469ca7-1a28-46dd-af95-517f2a252cba admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:43.802933 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1557/3078] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:16:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:16:43.808605 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519fabb6-146e-4730-ac52-2760e9a74d62 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:43.819538 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519fabb6-146e-4730-ac52-2760e9a74d62 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:43.825449 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee235269-85f7-403f-8e4d-37a54ac53e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:43.826337 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee235269-85f7-403f-8e4d-37a54ac53e54 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:43.826778 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee235269-85f7-403f-8e4d-37a54ac53e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:43.827302 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee235269-85f7-403f-8e4d-37a54ac53e54 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:43.828098 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee235269-85f7-403f-8e4d-37a54ac53e54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:43.830110 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee235269-85f7-403f-8e4d-37a54ac53e54 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:43.991571 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1522/3079] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:16:43 2022] POST /identity/v3/projects => generated 385 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:16:43.993897 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac469ca7-1a28-46dd-af95-517f2a252cba admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:44.005779 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac469ca7-1a28-46dd-af95-517f2a252cba admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:44.076324 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e594771-f5a4-4c60-8fb6-d4f1d690fd51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:44.077139 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e594771-f5a4-4c60-8fb6-d4f1d690fd51 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:44.077338 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e594771-f5a4-4c60-8fb6-d4f1d690fd51 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:44.077629 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e594771-f5a4-4c60-8fb6-d4f1d690fd51 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:44.078539 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e594771-f5a4-4c60-8fb6-d4f1d690fd51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:44.083260 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e594771-f5a4-4c60-8fb6-d4f1d690fd51 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:44.213180 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1558/3080] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:16:43 2022] POST /identity/v3/users => generated 293 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:16:44.217622 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee235269-85f7-403f-8e4d-37a54ac53e54 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:44.233208 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee235269-85f7-403f-8e4d-37a54ac53e54 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:44.246693 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1388ad6-99c6-4360-9727-e069196eb35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:44.247513 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1388ad6-99c6-4360-9727-e069196eb35e admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:44.247847 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1388ad6-99c6-4360-9727-e069196eb35e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:44.248189 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1388ad6-99c6-4360-9727-e069196eb35e admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:44.248978 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1388ad6-99c6-4360-9727-e069196eb35e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:44.251372 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1388ad6-99c6-4360-9727-e069196eb35e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:44.272883 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1523/3081] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:16:44 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:16:44.278074 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e594771-f5a4-4c60-8fb6-d4f1d690fd51 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:44.293043 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e594771-f5a4-4c60-8fb6-d4f1d690fd51 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:44.305819 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e23e83-31f0-47fd-91eb-5461ba48babf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:44.306776 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e23e83-31f0-47fd-91eb-5461ba48babf admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:44.307182 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e23e83-31f0-47fd-91eb-5461ba48babf admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:44.307590 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e23e83-31f0-47fd-91eb-5461ba48babf admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:44.308501 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e23e83-31f0-47fd-91eb-5461ba48babf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:44.310260 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e23e83-31f0-47fd-91eb-5461ba48babf admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:44.341707 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1559/3082] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:16:44 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:16:44.343569 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1388ad6-99c6-4360-9727-e069196eb35e admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:44.355103 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1388ad6-99c6-4360-9727-e069196eb35e admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:44.369998 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da399dfb-1e6b-488d-b879-0c135d187bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:44.370969 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da399dfb-1e6b-488d-b879-0c135d187bb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:44.371175 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da399dfb-1e6b-488d-b879-0c135d187bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:44.371451 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da399dfb-1e6b-488d-b879-0c135d187bb0 admin admin] PATH_INFO: `/v3/projects/ef1f3155d52e42bb9c54f43a8360a74e/users/4e87a5a5713748b6a0d73984a279009b/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:44.389263 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da399dfb-1e6b-488d-b879-0c135d187bb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef1f3155d52e42bb9c54f43a8360a74e, user_id=4e87a5a5713748b6a0d73984a279009b, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:44.392281 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da399dfb-1e6b-488d-b879-0c135d187bb0 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:44.497131 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1524/3083] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:16:44 2022] PUT /identity/v3/projects/ef1f3155d52e42bb9c54f43a8360a74e/users/4e87a5a5713748b6a0d73984a279009b/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:16:44.506346 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75edd2eb-f08a-49a1-91af-53f9a6b15617 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:44.506810 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75edd2eb-f08a-49a1-91af-53f9a6b15617 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:44.506894 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75edd2eb-f08a-49a1-91af-53f9a6b15617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:44.539020 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-75edd2eb-f08a-49a1-91af-53f9a6b15617 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:16:44.545944 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-75edd2eb-f08a-49a1-91af-53f9a6b15617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:44.739315 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1560/3084] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:16:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:16:44.760734 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da399dfb-1e6b-488d-b879-0c135d187bb0 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:44.763442 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-da399dfb-1e6b-488d-b879-0c135d187bb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:44.857121 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75edd2eb-f08a-49a1-91af-53f9a6b15617 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:44.857353 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-75edd2eb-f08a-49a1-91af-53f9a6b15617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:44.884978 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da399dfb-1e6b-488d-b879-0c135d187bb0 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:44.891122 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e3633d-ec65-4cfa-9203-1df564bc3dcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:44.892113 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e3633d-ec65-4cfa-9203-1df564bc3dcf service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:44.893134 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e3633d-ec65-4cfa-9203-1df564bc3dcf service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:44.893615 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e3633d-ec65-4cfa-9203-1df564bc3dcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:44.895277 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75edd2eb-f08a-49a1-91af-53f9a6b15617 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:44.908138 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e3633d-ec65-4cfa-9203-1df564bc3dcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:44.909941 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e3633d-ec65-4cfa-9203-1df564bc3dcf service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:44.928181 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f4088-dbdb-4b01-8938-b188b7e1b3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:44.929178 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f4088-dbdb-4b01-8938-b188b7e1b3b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:44.931453 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f4088-dbdb-4b01-8938-b188b7e1b3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:44.935839 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f4088-dbdb-4b01-8938-b188b7e1b3b2 admin admin] PATH_INFO: `/v3/users/33cf6f96b2ef4a3bb222abf3ce89c2fb` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:44.937570 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1525/3085] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:16:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:16:44.954781 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0f4088-dbdb-4b01-8938-b188b7e1b3b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33cf6f96b2ef4a3bb222abf3ce89c2fb)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:44.956780 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0f4088-dbdb-4b01-8938-b188b7e1b3b2 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:44.980792 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04164f6a-6f62-42dd-b1ee-d96c26b2cd52 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:44.983663 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04164f6a-6f62-42dd-b1ee-d96c26b2cd52 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:44.983663 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04164f6a-6f62-42dd-b1ee-d96c26b2cd52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:45.010804 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-04164f6a-6f62-42dd-b1ee-d96c26b2cd52 None None] MFA Rules not processed for user `cfcb989a491440b3bf74ddc055ee14d3`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:16:45.017356 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-04164f6a-6f62-42dd-b1ee-d96c26b2cd52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:45.138033 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1526/3086] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:16:44 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:16:45.138033 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f960a-0d9c-44dc-b00e-1143f2724c5a None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:45.138033 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f960a-0d9c-44dc-b00e-1143f2724c5a None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:45.138033 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f960a-0d9c-44dc-b00e-1143f2724c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:45.159259 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-a97f960a-0d9c-44dc-b00e-1143f2724c5a None None] MFA Rules not processed for user `038739f45c3d4ab09457d6eed20b41d4`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:16:45.160537 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-a97f960a-0d9c-44dc-b00e-1143f2724c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:45.296339 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1527/3087] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:16:45 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:16:45.333164 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-cc0f4088-dbdb-4b01-8938-b188b7e1b3b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33cf6f96b2ef4a3bb222abf3ce89c2fb'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:45.348753 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-cc0f4088-dbdb-4b01-8938-b188b7e1b3b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33cf6f96b2ef4a3bb222abf3ce89c2fb'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:45.366148 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-cc0f4088-dbdb-4b01-8938-b188b7e1b3b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33cf6f96b2ef4a3bb222abf3ce89c2fb'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:45.436905 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-cc0f4088-dbdb-4b01-8938-b188b7e1b3b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33cf6f96b2ef4a3bb222abf3ce89c2fb'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:45.437853 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-cc0f4088-dbdb-4b01-8938-b188b7e1b3b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33cf6f96b2ef4a3bb222abf3ce89c2fb'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:45.445130 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1561/3088] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:16:44 2022] DELETE /identity/v3/users/33cf6f96b2ef4a3bb222abf3ce89c2fb => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:16:46.171595 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b4cf3-575b-4bf7-93b5-2b54708fab62 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:46.171892 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b4cf3-575b-4bf7-93b5-2b54708fab62 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:46.172173 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b4cf3-575b-4bf7-93b5-2b54708fab62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:46.228990 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-a30b4cf3-575b-4bf7-93b5-2b54708fab62 None None] MFA Rules not processed for user `6ae75ac4b3ed44eda1e8717ff641cd0c`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:16:46.230227 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-a30b4cf3-575b-4bf7-93b5-2b54708fab62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:46.440438 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1528/3089] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:16:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:16:46.465257 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f4088-dbdb-4b01-8938-b188b7e1b3b2 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:46.467555 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-cc0f4088-dbdb-4b01-8938-b188b7e1b3b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:46.619286 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f4088-dbdb-4b01-8938-b188b7e1b3b2 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:46.628972 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c598fa0-35b7-4e37-93c2-0e84ff76452a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:46.631732 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c598fa0-35b7-4e37-93c2-0e84ff76452a service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:46.634513 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c598fa0-35b7-4e37-93c2-0e84ff76452a service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:46.635080 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c598fa0-35b7-4e37-93c2-0e84ff76452a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:46.647882 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c598fa0-35b7-4e37-93c2-0e84ff76452a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:46.650047 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c598fa0-35b7-4e37-93c2-0e84ff76452a service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:46.663780 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1562/3090] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:16:46 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:16:46.911951 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30b4cf3-575b-4bf7-93b5-2b54708fab62 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:46.918008 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-a30b4cf3-575b-4bf7-93b5-2b54708fab62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:47.112873 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30b4cf3-575b-4bf7-93b5-2b54708fab62 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:47.123163 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5490d11-0bfd-4543-bcca-9f67e9fe33a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:47.124513 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5490d11-0bfd-4543-bcca-9f67e9fe33a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:47.127299 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5490d11-0bfd-4543-bcca-9f67e9fe33a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:47.127299 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5490d11-0bfd-4543-bcca-9f67e9fe33a7 admin admin] PATH_INFO: `/v3/projects/ac56d68252fb4633b27be1d5f4a18d0b` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:47.127783 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5490d11-0bfd-4543-bcca-9f67e9fe33a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac56d68252fb4633b27be1d5f4a18d0b)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:47.130896 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5490d11-0bfd-4543-bcca-9f67e9fe33a7 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:47.384782 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e5490d11-0bfd-4543-bcca-9f67e9fe33a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac56d68252fb4633b27be1d5f4a18d0b', 'request_id': 'req-e5490d11-0bfd-4543-bcca-9f67e9fe33a7'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:47.424652 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e5490d11-0bfd-4543-bcca-9f67e9fe33a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac56d68252fb4633b27be1d5f4a18d0b', 'request_id': 'req-e5490d11-0bfd-4543-bcca-9f67e9fe33a7'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:47.434437 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e5490d11-0bfd-4543-bcca-9f67e9fe33a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac56d68252fb4633b27be1d5f4a18d0b', 'request_id': 'req-e5490d11-0bfd-4543-bcca-9f67e9fe33a7'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:47.451828 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c598fa0-35b7-4e37-93c2-0e84ff76452a service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:47.453716 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-9c598fa0-35b7-4e37-93c2-0e84ff76452a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:47.580654 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e5490d11-0bfd-4543-bcca-9f67e9fe33a7 admin admin] The token cache is being invalidate because project ac56d68252fb4633b27be1d5f4a18d0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:16:47.582258 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e5490d11-0bfd-4543-bcca-9f67e9fe33a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:47.583854 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e5490d11-0bfd-4543-bcca-9f67e9fe33a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:16:47.591445 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1529/3091] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:16:46 2022] DELETE /identity/v3/projects/ac56d68252fb4633b27be1d5f4a18d0b => generated 0 bytes in 675 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:16:47.603551 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da4837-d5be-4c8c-98b7-9eed4877bf7d None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:47.608520 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da4837-d5be-4c8c-98b7-9eed4877bf7d None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:47.610916 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da4837-d5be-4c8c-98b7-9eed4877bf7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:47.644034 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-f4da4837-d5be-4c8c-98b7-9eed4877bf7d None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:16:47.646607 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-f4da4837-d5be-4c8c-98b7-9eed4877bf7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:47.687026 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c598fa0-35b7-4e37-93c2-0e84ff76452a service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:47.819066 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1530/3092] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:16:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:16:47.826679 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab2f6d-ece6-43ed-8920-75ba59c1c7b2 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:47.831517 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab2f6d-ece6-43ed-8920-75ba59c1c7b2 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:47.834289 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab2f6d-ece6-43ed-8920-75ba59c1c7b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:47.863637 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-89ab2f6d-ece6-43ed-8920-75ba59c1c7b2 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:16:47.863904 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a4a4ae-4ea0-4ee6-9f41-64bbe5665ad7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:47.922934 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a4a4ae-4ea0-4ee6-9f41-64bbe5665ad7 service placement] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:47.922934 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a4a4ae-4ea0-4ee6-9f41-64bbe5665ad7 service placement] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:47.922934 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a4a4ae-4ea0-4ee6-9f41-64bbe5665ad7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:47.923804 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-89ab2f6d-ece6-43ed-8920-75ba59c1c7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:47.924410 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e1a4a4ae-4ea0-4ee6-9f41-64bbe5665ad7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:47.924505 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1531/3093] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:16:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:16:47.924600 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a4a4ae-4ea0-4ee6-9f41-64bbe5665ad7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:47.924600 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a4a4ae-4ea0-4ee6-9f41-64bbe5665ad7 service placement] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:47.924600 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1563/3094] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:16:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:16:47.924816 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab2f6d-ece6-43ed-8920-75ba59c1c7b2 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:47.934802 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab2f6d-ece6-43ed-8920-75ba59c1c7b2 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:47.950220 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9240a8a1-1605-4e5e-ae75-fde0110779d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:47.950985 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9240a8a1-1605-4e5e-ae75-fde0110779d2 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:47.951276 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9240a8a1-1605-4e5e-ae75-fde0110779d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:47.951583 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9240a8a1-1605-4e5e-ae75-fde0110779d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:47.954221 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9240a8a1-1605-4e5e-ae75-fde0110779d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:16:47.956814 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9240a8a1-1605-4e5e-ae75-fde0110779d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:47.959807 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9240a8a1-1605-4e5e-ae75-fde0110779d2 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:47.985594 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1532/3095] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:16:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:16:47.988982 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a4a4ae-4ea0-4ee6-9f41-64bbe5665ad7 service placement] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:48.003845 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a4a4ae-4ea0-4ee6-9f41-64bbe5665ad7 service placement] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:48.020974 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c135fb-c265-4183-af64-a924159650ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:48.022278 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c135fb-c265-4183-af64-a924159650ef admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:48.022492 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c135fb-c265-4183-af64-a924159650ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:48.023574 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c135fb-c265-4183-af64-a924159650ef admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:48.024812 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c135fb-c265-4183-af64-a924159650ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:48.029617 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c135fb-c265-4183-af64-a924159650ef admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:48.180272 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9240a8a1-1605-4e5e-ae75-fde0110779d2 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:48.190470 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1564/3096] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:16:47 2022] POST /identity/v3/projects => generated 379 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:16:48.208501 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9240a8a1-1605-4e5e-ae75-fde0110779d2 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:48.344245 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b1cf8-63d5-41ee-aa99-655668c2ba93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:48.345364 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b1cf8-63d5-41ee-aa99-655668c2ba93 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:48.345810 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b1cf8-63d5-41ee-aa99-655668c2ba93 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:48.349249 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b1cf8-63d5-41ee-aa99-655668c2ba93 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:48.350156 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5b1cf8-63d5-41ee-aa99-655668c2ba93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:48.354605 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5b1cf8-63d5-41ee-aa99-655668c2ba93 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:48.543297 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1533/3097] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:16:48 2022] POST /identity/v3/users => generated 290 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:16:48.546433 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c135fb-c265-4183-af64-a924159650ef admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:48.550750 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-f8c135fb-c265-4183-af64-a924159650ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:48.557531 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b1cf8-63d5-41ee-aa99-655668c2ba93 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:48.580571 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b1cf8-63d5-41ee-aa99-655668c2ba93 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:48.595636 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0e0706-c588-46a8-bd1f-3a1751a8d302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:48.596469 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e0706-c588-46a8-bd1f-3a1751a8d302 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:48.597013 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e0706-c588-46a8-bd1f-3a1751a8d302 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:48.597389 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e0706-c588-46a8-bd1f-3a1751a8d302 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:48.598395 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0e0706-c588-46a8-bd1f-3a1751a8d302 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:48.601299 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0e0706-c588-46a8-bd1f-3a1751a8d302 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:48.625355 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1534/3098] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:16:48 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:16:48.629458 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0e0706-c588-46a8-bd1f-3a1751a8d302 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:48.652149 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0e0706-c588-46a8-bd1f-3a1751a8d302 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:48.686454 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c135fb-c265-4183-af64-a924159650ef admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:48.687372 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ec55a3-1ff7-438b-805e-d1981aab0c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:48.687372 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec55a3-1ff7-438b-805e-d1981aab0c39 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:48.687372 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec55a3-1ff7-438b-805e-d1981aab0c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:48.687372 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec55a3-1ff7-438b-805e-d1981aab0c39 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:48.687755 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ec55a3-1ff7-438b-805e-d1981aab0c39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:48.687755 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ec55a3-1ff7-438b-805e-d1981aab0c39 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:48.687917 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1445fe88-f06f-41b3-9de8-1396b36f27a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:48.687917 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1445fe88-f06f-41b3-9de8-1396b36f27a3 service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:48.687917 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1445fe88-f06f-41b3-9de8-1396b36f27a3 service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:48.687917 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1445fe88-f06f-41b3-9de8-1396b36f27a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:48.688521 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-1445fe88-f06f-41b3-9de8-1396b36f27a3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:48.725490 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1535/3099] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:16:48 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:16:48.738080 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ec55a3-1ff7-438b-805e-d1981aab0c39 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:48.771574 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ec55a3-1ff7-438b-805e-d1981aab0c39 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:48.784804 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8920e6b5-bf3f-443f-a03e-d47eb65c1417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:48.785926 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920e6b5-bf3f-443f-a03e-d47eb65c1417 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:48.786209 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920e6b5-bf3f-443f-a03e-d47eb65c1417 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:48.790760 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920e6b5-bf3f-443f-a03e-d47eb65c1417 admin admin] PATH_INFO: `/v3/projects/a924ca59a9ac44cf96e53be012a43af1/users/a42e0caa0878447f98544e74f767c7ca/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:48.799638 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1445fe88-f06f-41b3-9de8-1396b36f27a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:48.801657 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1445fe88-f06f-41b3-9de8-1396b36f27a3 service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:48.822475 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8920e6b5-bf3f-443f-a03e-d47eb65c1417 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a924ca59a9ac44cf96e53be012a43af1, user_id=a42e0caa0878447f98544e74f767c7ca, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:48.829012 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8920e6b5-bf3f-443f-a03e-d47eb65c1417 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:48.833288 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1565/3100] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:16:48 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:16:48.940164 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1536/3101] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:16:48 2022] PUT /identity/v3/projects/a924ca59a9ac44cf96e53be012a43af1/users/a42e0caa0878447f98544e74f767c7ca/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:16:48.945195 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412d22d2-87ed-4a24-aedd-718fedb8745d None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:48.946036 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412d22d2-87ed-4a24-aedd-718fedb8745d None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:48.946294 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412d22d2-87ed-4a24-aedd-718fedb8745d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:49.013750 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-412d22d2-87ed-4a24-aedd-718fedb8745d None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:16:49.018996 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-412d22d2-87ed-4a24-aedd-718fedb8745d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:49.270763 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1566/3102] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:16:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:16:49.317888 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8920e6b5-bf3f-443f-a03e-d47eb65c1417 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:49.320716 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8920e6b5-bf3f-443f-a03e-d47eb65c1417 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:49.453331 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8920e6b5-bf3f-443f-a03e-d47eb65c1417 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:49.460669 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa507ab-96cf-487b-91a2-4e115578b035 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:49.462516 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa507ab-96cf-487b-91a2-4e115578b035 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:49.464602 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa507ab-96cf-487b-91a2-4e115578b035 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:49.465860 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa507ab-96cf-487b-91a2-4e115578b035 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:49.490314 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa507ab-96cf-487b-91a2-4e115578b035 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:49.496102 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa507ab-96cf-487b-91a2-4e115578b035 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:49.545620 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1537/3103] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:16:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:16:50.267333 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3186920b-65bc-4965-ba6b-73ace303869d None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:50.267952 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3186920b-65bc-4965-ba6b-73ace303869d None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:50.267952 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3186920b-65bc-4965-ba6b-73ace303869d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:50.291205 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-3186920b-65bc-4965-ba6b-73ace303869d None None] MFA Rules not processed for user `154d05e107d74202beabaa0b60dab8c8`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:16:50.308654 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-3186920b-65bc-4965-ba6b-73ace303869d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:50.450829 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1567/3104] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:16:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:16:52.379078 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa507ab-96cf-487b-91a2-4e115578b035 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:52.663335 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa507ab-96cf-487b-91a2-4e115578b035 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:52.685993 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a27e880-235b-49c2-b1c4-e221dd81a06e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:52.686778 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a27e880-235b-49c2-b1c4-e221dd81a06e service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:52.687168 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a27e880-235b-49c2-b1c4-e221dd81a06e service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:52.687589 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a27e880-235b-49c2-b1c4-e221dd81a06e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:52.696224 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-5a27e880-235b-49c2-b1c4-e221dd81a06e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:52.719833 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a27e880-235b-49c2-b1c4-e221dd81a06e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:52.722097 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a27e880-235b-49c2-b1c4-e221dd81a06e service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:52.750319 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1538/3105] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:16:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:16:53.661998 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54ea0e-1632-4582-bfdc-9d54e916f82f None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:53.663593 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54ea0e-1632-4582-bfdc-9d54e916f82f None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:53.664729 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54ea0e-1632-4582-bfdc-9d54e916f82f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:53.689512 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-cf54ea0e-1632-4582-bfdc-9d54e916f82f None None] MFA Rules not processed for user `6ae75ac4b3ed44eda1e8717ff641cd0c`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:16:53.692038 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-cf54ea0e-1632-4582-bfdc-9d54e916f82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:53.874509 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1568/3106] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:16:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:16:55.612661 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a27e880-235b-49c2-b1c4-e221dd81a06e service nova] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:16:55.617268 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-5a27e880-235b-49c2-b1c4-e221dd81a06e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:55.690865 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a27e880-235b-49c2-b1c4-e221dd81a06e service nova] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:16:55.702774 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32642d8-efd8-4dbb-8a6e-5f245698f59a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:16:55.704016 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32642d8-efd8-4dbb-8a6e-5f245698f59a service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:16:55.704539 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32642d8-efd8-4dbb-8a6e-5f245698f59a service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:16:55.704988 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32642d8-efd8-4dbb-8a6e-5f245698f59a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:16:55.707678 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-a32642d8-efd8-4dbb-8a6e-5f245698f59a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:16:55.752915 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32642d8-efd8-4dbb-8a6e-5f245698f59a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:16:55.760950 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32642d8-efd8-4dbb-8a6e-5f245698f59a service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:16:55.789360 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1539/3107] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:16:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:17:10.884581 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf54ea0e-1632-4582-bfdc-9d54e916f82f None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:17:10.886030 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-cf54ea0e-1632-4582-bfdc-9d54e916f82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:17:10.913824 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf54ea0e-1632-4582-bfdc-9d54e916f82f None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:17:10.924186 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e9b12a-3948-4b8a-88c1-8a1f7330aaf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:17:10.928072 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9b12a-3948-4b8a-88c1-8a1f7330aaf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:17:10.928638 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9b12a-3948-4b8a-88c1-8a1f7330aaf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:17:10.929644 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9b12a-3948-4b8a-88c1-8a1f7330aaf1 admin admin] PATH_INFO: `/v3/users/053ae4d2abd445968a2d0a953fdbfc63` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:17:10.931315 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e9b12a-3948-4b8a-88c1-8a1f7330aaf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=053ae4d2abd445968a2d0a953fdbfc63)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:17:10.934493 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e9b12a-3948-4b8a-88c1-8a1f7330aaf1 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:17:11.256381 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d602dff-2c1c-4fb9-84de-0180ff1727d9 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:17:11.257848 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d602dff-2c1c-4fb9-84de-0180ff1727d9 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:17:11.258711 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d602dff-2c1c-4fb9-84de-0180ff1727d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:17:11.292253 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-2d602dff-2c1c-4fb9-84de-0180ff1727d9 None None] MFA Rules not processed for user `4e87a5a5713748b6a0d73984a279009b`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:17:11.294123 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-2d602dff-2c1c-4fb9-84de-0180ff1727d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:17:11.383711 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-53e9b12a-3948-4b8a-88c1-8a1f7330aaf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '053ae4d2abd445968a2d0a953fdbfc63'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:17:11.409158 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-53e9b12a-3948-4b8a-88c1-8a1f7330aaf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '053ae4d2abd445968a2d0a953fdbfc63'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:17:11.425811 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-53e9b12a-3948-4b8a-88c1-8a1f7330aaf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '053ae4d2abd445968a2d0a953fdbfc63'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:17:11.462842 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1540/3108] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:17:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:17:11.476722 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d602dff-2c1c-4fb9-84de-0180ff1727d9 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:17:11.495129 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d602dff-2c1c-4fb9-84de-0180ff1727d9 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:17:11.505353 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c8530f-6883-4395-a4b5-1d96e9635a19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:17:11.506444 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8530f-6883-4395-a4b5-1d96e9635a19 service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:17:11.507634 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8530f-6883-4395-a4b5-1d96e9635a19 service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:17:11.508964 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8530f-6883-4395-a4b5-1d96e9635a19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:17:11.522899 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c8530f-6883-4395-a4b5-1d96e9635a19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:17:11.524975 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c8530f-6883-4395-a4b5-1d96e9635a19 service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:17:11.547704 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-53e9b12a-3948-4b8a-88c1-8a1f7330aaf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '053ae4d2abd445968a2d0a953fdbfc63'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:17:11.550813 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-53e9b12a-3948-4b8a-88c1-8a1f7330aaf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '053ae4d2abd445968a2d0a953fdbfc63'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:17:11.563353 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1541/3109] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:17:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:17:11.577890 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1569/3110] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:17:10 2022] DELETE /identity/v3/users/053ae4d2abd445968a2d0a953fdbfc63 => generated 0 bytes in 694 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:17:12.539787 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c8530f-6883-4395-a4b5-1d96e9635a19 service nova] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:17:12.552203 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c8530f-6883-4395-a4b5-1d96e9635a19 service nova] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:17:12.706773 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb66c01-3aa1-4109-b7a7-c97757925e81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:17:12.708268 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb66c01-3aa1-4109-b7a7-c97757925e81 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:17:12.708950 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb66c01-3aa1-4109-b7a7-c97757925e81 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:17:12.709237 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb66c01-3aa1-4109-b7a7-c97757925e81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:17:12.715312 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-feb66c01-3aa1-4109-b7a7-c97757925e81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:17:12.796835 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb66c01-3aa1-4109-b7a7-c97757925e81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:17:12.798973 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb66c01-3aa1-4109-b7a7-c97757925e81 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:17:12.820389 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1542/3111] 10.222.0.52 () {60 vars in 1396 bytes} [Sat May 14 21:17:12 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3242 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:17:12.880066 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e9b12a-3948-4b8a-88c1-8a1f7330aaf1 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:17:12.882970 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-53e9b12a-3948-4b8a-88c1-8a1f7330aaf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:17:13.030889 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e9b12a-3948-4b8a-88c1-8a1f7330aaf1 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:17:13.037352 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fb004d-a659-4ade-81f6-b6e1ab82782a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:17:13.038425 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb004d-a659-4ade-81f6-b6e1ab82782a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:17:13.039268 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb004d-a659-4ade-81f6-b6e1ab82782a admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:17:13.039612 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb004d-a659-4ade-81f6-b6e1ab82782a admin admin] PATH_INFO: `/v3/projects/611dce182666487684bf1e2a687c523a` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:17:13.041137 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fb004d-a659-4ade-81f6-b6e1ab82782a admin admin] RBAC: Authorizing `identity:delete_project(project_id=611dce182666487684bf1e2a687c523a)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:17:13.047335 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fb004d-a659-4ade-81f6-b6e1ab82782a admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:17:13.223836 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-87fb004d-a659-4ade-81f6-b6e1ab82782a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '611dce182666487684bf1e2a687c523a', 'request_id': 'req-87fb004d-a659-4ade-81f6-b6e1ab82782a'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:17:13.244518 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-87fb004d-a659-4ade-81f6-b6e1ab82782a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '611dce182666487684bf1e2a687c523a', 'request_id': 'req-87fb004d-a659-4ade-81f6-b6e1ab82782a'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:17:13.321017 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-87fb004d-a659-4ade-81f6-b6e1ab82782a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '611dce182666487684bf1e2a687c523a', 'request_id': 'req-87fb004d-a659-4ade-81f6-b6e1ab82782a'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:17:13.357297 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-87fb004d-a659-4ade-81f6-b6e1ab82782a admin admin] The token cache is being invalidate because project 611dce182666487684bf1e2a687c523a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:17:13.357563 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-87fb004d-a659-4ade-81f6-b6e1ab82782a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:17:13.365939 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-87fb004d-a659-4ade-81f6-b6e1ab82782a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:17:13.374724 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1570/3112] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:17:12 2022] DELETE /identity/v3/projects/611dce182666487684bf1e2a687c523a => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:17:13.379960 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e5b99c-1875-4377-9810-21e90a69f07c None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:17:13.380252 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e5b99c-1875-4377-9810-21e90a69f07c None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:17:13.380536 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e5b99c-1875-4377-9810-21e90a69f07c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:17:13.441249 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-69e5b99c-1875-4377-9810-21e90a69f07c None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:17:13.445831 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-69e5b99c-1875-4377-9810-21e90a69f07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:17:13.578857 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1543/3113] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:17:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:17:13.587733 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3dd303-c02c-4210-9cfa-b750765bdff9 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:17:13.588028 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3dd303-c02c-4210-9cfa-b750765bdff9 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:17:13.588315 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3dd303-c02c-4210-9cfa-b750765bdff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:17:13.619277 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-3f3dd303-c02c-4210-9cfa-b750765bdff9 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:17:13.620504 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-3f3dd303-c02c-4210-9cfa-b750765bdff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:17:13.655249 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1571/3114] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:17:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:17:13.656718 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e5b99c-1875-4377-9810-21e90a69f07c None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:17:13.681090 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e5b99c-1875-4377-9810-21e90a69f07c None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:17:13.690147 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5081304-0025-4024-8ae9-d5b9704b7154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:17:13.693385 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5081304-0025-4024-8ae9-d5b9704b7154 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:17:13.693718 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5081304-0025-4024-8ae9-d5b9704b7154 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:17:13.694003 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5081304-0025-4024-8ae9-d5b9704b7154 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:17:13.696081 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5081304-0025-4024-8ae9-d5b9704b7154 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:17:13.696672 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5081304-0025-4024-8ae9-d5b9704b7154 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:17:13.701795 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5081304-0025-4024-8ae9-d5b9704b7154 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:17:13.721073 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1544/3115] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:17:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:17:13.726282 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3dd303-c02c-4210-9cfa-b750765bdff9 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:17:13.736649 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3dd303-c02c-4210-9cfa-b750765bdff9 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:17:13.742428 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e44581-f903-4a7b-8019-820c45f96caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:17:13.743252 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e44581-f903-4a7b-8019-820c45f96caf admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:17:13.744149 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e44581-f903-4a7b-8019-820c45f96caf admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:17:13.744149 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e44581-f903-4a7b-8019-820c45f96caf admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:17:13.745037 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e44581-f903-4a7b-8019-820c45f96caf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:17:13.748100 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e44581-f903-4a7b-8019-820c45f96caf admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:17:13.902275 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1572/3116] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:17:13 2022] POST /identity/v3/projects => generated 377 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:17:13.912978 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5081304-0025-4024-8ae9-d5b9704b7154 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:17:13.927308 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5081304-0025-4024-8ae9-d5b9704b7154 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:17:14.045176 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c894cbc-4c2f-438b-9527-258976b3ab88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:17:14.046480 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c894cbc-4c2f-438b-9527-258976b3ab88 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:17:14.048109 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c894cbc-4c2f-438b-9527-258976b3ab88 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:17:14.048109 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c894cbc-4c2f-438b-9527-258976b3ab88 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:17:14.050255 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c894cbc-4c2f-438b-9527-258976b3ab88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:17:14.052738 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c894cbc-4c2f-438b-9527-258976b3ab88 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:17:14.230931 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e44581-f903-4a7b-8019-820c45f96caf admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:17:14.238261 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1545/3117] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:17:13 2022] POST /identity/v3/users => generated 289 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:17:14.245126 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e44581-f903-4a7b-8019-820c45f96caf admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:17:14.273739 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cd4aba-8d09-49bf-90c8-b4cff47aa1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:17:14.275243 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd4aba-8d09-49bf-90c8-b4cff47aa1ec admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:17:14.275753 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd4aba-8d09-49bf-90c8-b4cff47aa1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:17:14.276192 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd4aba-8d09-49bf-90c8-b4cff47aa1ec admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:17:14.277105 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cd4aba-8d09-49bf-90c8-b4cff47aa1ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:17:14.283876 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cd4aba-8d09-49bf-90c8-b4cff47aa1ec admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:17:14.313486 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1573/3118] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:17:14.314967 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c894cbc-4c2f-438b-9527-258976b3ab88 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:17:14.338526 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c894cbc-4c2f-438b-9527-258976b3ab88 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:17:14.344260 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfca666-3aa5-4d20-b5df-ced46e732752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:17:14.345040 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfca666-3aa5-4d20-b5df-ced46e732752 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:17:14.345397 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfca666-3aa5-4d20-b5df-ced46e732752 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:17:14.346198 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfca666-3aa5-4d20-b5df-ced46e732752 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:17:14.347090 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfca666-3aa5-4d20-b5df-ced46e732752 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:17:14.361424 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfca666-3aa5-4d20-b5df-ced46e732752 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:17:14.387703 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1546/3119] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:17:14.392157 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cd4aba-8d09-49bf-90c8-b4cff47aa1ec admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:17:14.406067 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cd4aba-8d09-49bf-90c8-b4cff47aa1ec admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:17:14.424191 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bf219a-2ec5-4937-a35b-76333f13f28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:17:14.425460 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf219a-2ec5-4937-a35b-76333f13f28a admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:17:14.425961 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf219a-2ec5-4937-a35b-76333f13f28a admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:17:14.426470 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf219a-2ec5-4937-a35b-76333f13f28a admin admin] PATH_INFO: `/v3/projects/7c7360a8f423452e97311ffc9675e801/users/8bb480362ced445da9819798a17819c3/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:17:14.464208 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfca666-3aa5-4d20-b5df-ced46e732752 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:17:14.466478 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-dcfca666-3aa5-4d20-b5df-ced46e732752 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:17:14.476843 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bf219a-2ec5-4937-a35b-76333f13f28a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c7360a8f423452e97311ffc9675e801, user_id=8bb480362ced445da9819798a17819c3, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:17:14.483949 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bf219a-2ec5-4937-a35b-76333f13f28a admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:17:14.598145 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1574/3120] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:17:14 2022] PUT /identity/v3/projects/7c7360a8f423452e97311ffc9675e801/users/8bb480362ced445da9819798a17819c3/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:17:14.605692 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf1332-0fd6-47c0-b8a9-31c7bb1bf5f6 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:17:14.605983 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf1332-0fd6-47c0-b8a9-31c7bb1bf5f6 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:17:14.606472 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf1332-0fd6-47c0-b8a9-31c7bb1bf5f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:17:14.650913 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfca666-3aa5-4d20-b5df-ced46e732752 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:17:14.666014 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-ebaf1332-0fd6-47c0-b8a9-31c7bb1bf5f6 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:17:14.667247 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ebaf1332-0fd6-47c0-b8a9-31c7bb1bf5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:17:14.776138 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67e0556-8616-4b0c-9718-d51395c0f02d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:17:14.776843 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e0556-8616-4b0c-9718-d51395c0f02d service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:17:14.777128 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e0556-8616-4b0c-9718-d51395c0f02d service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:17:14.777404 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e0556-8616-4b0c-9718-d51395c0f02d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:17:14.783103 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-a67e0556-8616-4b0c-9718-d51395c0f02d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:17:14.802905 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67e0556-8616-4b0c-9718-d51395c0f02d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:17:14.805903 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67e0556-8616-4b0c-9718-d51395c0f02d service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:17:14.816693 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1547/3121] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:17:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:17:14.821247 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1575/3122] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:17:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:17:14.832571 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67e0556-8616-4b0c-9718-d51395c0f02d service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:17:14.834599 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-a67e0556-8616-4b0c-9718-d51395c0f02d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:17:14.865085 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67e0556-8616-4b0c-9718-d51395c0f02d service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:17:14.877526 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028eb5c2-ea8e-4f76-bccd-207fed456ffa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:17:14.880616 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028eb5c2-ea8e-4f76-bccd-207fed456ffa service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:17:14.881115 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028eb5c2-ea8e-4f76-bccd-207fed456ffa service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:17:14.881556 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028eb5c2-ea8e-4f76-bccd-207fed456ffa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:17:14.908568 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028eb5c2-ea8e-4f76-bccd-207fed456ffa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:17:14.911319 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028eb5c2-ea8e-4f76-bccd-207fed456ffa service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:17:14.937697 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1548/3123] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:17:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:17:16.368409 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaf1332-0fd6-47c0-b8a9-31c7bb1bf5f6 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:17:16.371282 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ebaf1332-0fd6-47c0-b8a9-31c7bb1bf5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:17:16.563394 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaf1332-0fd6-47c0-b8a9-31c7bb1bf5f6 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:17:16.582154 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760853e8-0056-4edd-bd8b-071a19de6548 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:17:16.584246 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760853e8-0056-4edd-bd8b-071a19de6548 service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:17:16.584840 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760853e8-0056-4edd-bd8b-071a19de6548 service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:17:16.585984 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760853e8-0056-4edd-bd8b-071a19de6548 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:17:16.591028 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-760853e8-0056-4edd-bd8b-071a19de6548 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:17:16.634987 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760853e8-0056-4edd-bd8b-071a19de6548 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:17:16.638854 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760853e8-0056-4edd-bd8b-071a19de6548 service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:17:16.668137 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1576/3124] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:17:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:17:17.342181 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af29e66-fe51-479d-9bda-8b71d13443e3 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:17:17.342181 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af29e66-fe51-479d-9bda-8b71d13443e3 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:17:17.342181 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af29e66-fe51-479d-9bda-8b71d13443e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:17:17.438129 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-4af29e66-fe51-479d-9bda-8b71d13443e3 None None] MFA Rules not processed for user `a42e0caa0878447f98544e74f767c7ca`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:17:17.441837 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-4af29e66-fe51-479d-9bda-8b71d13443e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:17:17.590718 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1549/3125] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:17:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:17:18.184189 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c354d-7f7f-4ef3-9c0a-e93b6d9c6d9b None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:17:18.184758 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c354d-7f7f-4ef3-9c0a-e93b6d9c6d9b None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:17:18.184858 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c354d-7f7f-4ef3-9c0a-e93b6d9c6d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:17:18.213750 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af29e66-fe51-479d-9bda-8b71d13443e3 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:17:18.238737 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-7f5c354d-7f7f-4ef3-9c0a-e93b6d9c6d9b None None] MFA Rules not processed for user `4e87a5a5713748b6a0d73984a279009b`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:17:18.240068 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-7f5c354d-7f7f-4ef3-9c0a-e93b6d9c6d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:17:18.249750 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af29e66-fe51-479d-9bda-8b71d13443e3 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:17:18.263590 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90026b7-1f06-49fb-aa58-b72cd192caec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:17:18.264878 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90026b7-1f06-49fb-aa58-b72cd192caec service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:17:18.265171 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90026b7-1f06-49fb-aa58-b72cd192caec service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:17:18.265449 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90026b7-1f06-49fb-aa58-b72cd192caec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:17:18.282237 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90026b7-1f06-49fb-aa58-b72cd192caec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:17:18.283972 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90026b7-1f06-49fb-aa58-b72cd192caec service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:17:18.309621 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1550/3126] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:17:18 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:17:18.377877 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1577/3127] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:17:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:17:25.847053 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669984c6-f1f5-480e-b511-8e84f625c143 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:17:25.848319 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669984c6-f1f5-480e-b511-8e84f625c143 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:17:25.848843 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669984c6-f1f5-480e-b511-8e84f625c143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:17:25.883682 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-669984c6-f1f5-480e-b511-8e84f625c143 None None] MFA Rules not processed for user `a42e0caa0878447f98544e74f767c7ca`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:17:25.883682 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-669984c6-f1f5-480e-b511-8e84f625c143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:17:25.905778 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1551/3128] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:17:25 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:17:29.533755 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f5caf-313c-47da-8956-afec2ace18e6 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:17:29.534852 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f5caf-313c-47da-8956-afec2ace18e6 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:17:29.535372 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f5caf-313c-47da-8956-afec2ace18e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:17:29.571786 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-494f5caf-313c-47da-8956-afec2ace18e6 None None] MFA Rules not processed for user `154d05e107d74202beabaa0b60dab8c8`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:17:29.573423 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-494f5caf-313c-47da-8956-afec2ace18e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:17:29.663551 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1578/3129] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:17:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:17:30.222603 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f9f26-f4cf-4c2d-951c-6156721692eb None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:17:30.223140 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f9f26-f4cf-4c2d-951c-6156721692eb None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:17:30.223140 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f9f26-f4cf-4c2d-951c-6156721692eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:17:30.273508 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-e80f9f26-f4cf-4c2d-951c-6156721692eb None None] MFA Rules not processed for user `8bb480362ced445da9819798a17819c3`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:17:30.274729 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e80f9f26-f4cf-4c2d-951c-6156721692eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:17:30.453895 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387efa7d-c645-4d79-8000-a66979ebb945 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:17:30.455589 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387efa7d-c645-4d79-8000-a66979ebb945 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:17:30.456043 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387efa7d-c645-4d79-8000-a66979ebb945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:17:30.457010 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1552/3130] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:17:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:17:30.477016 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-387efa7d-c645-4d79-8000-a66979ebb945 None None] MFA Rules not processed for user `8bb480362ced445da9819798a17819c3`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:17:30.479652 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-387efa7d-c645-4d79-8000-a66979ebb945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:17:30.488118 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1579/3131] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:17:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:17:30.501952 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f9f26-f4cf-4c2d-951c-6156721692eb None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:17:30.521118 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f9f26-f4cf-4c2d-951c-6156721692eb None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:17:30.534532 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eaaad7-6acb-400d-8b01-52d63c2669dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:17:30.535220 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eaaad7-6acb-400d-8b01-52d63c2669dd service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:17:30.537786 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eaaad7-6acb-400d-8b01-52d63c2669dd service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:17:30.538141 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eaaad7-6acb-400d-8b01-52d63c2669dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:17:30.560012 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eaaad7-6acb-400d-8b01-52d63c2669dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:17:30.561925 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eaaad7-6acb-400d-8b01-52d63c2669dd service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:17:30.580958 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1553/3132] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:17:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:17:37.687534 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75979822-4505-40a0-8b5f-ca25d600a9ea None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:17:37.688696 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75979822-4505-40a0-8b5f-ca25d600a9ea None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:17:37.689135 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75979822-4505-40a0-8b5f-ca25d600a9ea None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:17:37.690747 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1580/3133] 10.222.0.52 () {54 vars in 921 bytes} [Sat May 14 21:17:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:17:37.699277 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7151dd99-c8b0-44b8-869e-949a343a2760 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:17:37.705962 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7151dd99-c8b0-44b8-869e-949a343a2760 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:17:37.705962 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7151dd99-c8b0-44b8-869e-949a343a2760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:17:37.729256 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-7151dd99-c8b0-44b8-869e-949a343a2760 None None] MFA Rules not processed for user `0812ae67e44d483baf2dbb1a5332a1d7`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:17:37.740512 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-7151dd99-c8b0-44b8-869e-949a343a2760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:17:37.878854 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1554/3134] 10.222.0.52 () {58 vars in 1018 bytes} [Sat May 14 21:17:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:17:37.901566 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75979822-4505-40a0-8b5f-ca25d600a9ea None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:17:37.903591 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-75979822-4505-40a0-8b5f-ca25d600a9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:17:37.945663 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75979822-4505-40a0-8b5f-ca25d600a9ea None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:17:37.954481 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a80bd1-05cf-4df1-ac75-588cf346dfd1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:17:37.955602 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a80bd1-05cf-4df1-ac75-588cf346dfd1 service placement] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:17:37.956111 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a80bd1-05cf-4df1-ac75-588cf346dfd1 service placement] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:17:37.956617 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a80bd1-05cf-4df1-ac75-588cf346dfd1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:17:37.972175 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a80bd1-05cf-4df1-ac75-588cf346dfd1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:17:37.974770 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a80bd1-05cf-4df1-ac75-588cf346dfd1 service placement] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:17:38.004401 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1581/3135] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:17:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:17:40.285443 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7151dd99-c8b0-44b8-869e-949a343a2760 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:17:40.300012 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7151dd99-c8b0-44b8-869e-949a343a2760 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:17:40.309004 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c0e237-8e57-4ae8-ae70-f092cf24929d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:17:40.314000 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0e237-8e57-4ae8-ae70-f092cf24929d service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:17:40.315502 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0e237-8e57-4ae8-ae70-f092cf24929d service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:17:40.317854 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0e237-8e57-4ae8-ae70-f092cf24929d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:17:40.324471 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c4c0e237-8e57-4ae8-ae70-f092cf24929d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:17:40.344662 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c0e237-8e57-4ae8-ae70-f092cf24929d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:17:40.346760 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c0e237-8e57-4ae8-ae70-f092cf24929d service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:17:40.372151 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1555/3136] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:17:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:17:56.687348 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406331ab-7d18-4914-9744-298fc75f07f1 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:17:56.687962 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406331ab-7d18-4914-9744-298fc75f07f1 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:17:56.688158 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406331ab-7d18-4914-9744-298fc75f07f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:17:56.709330 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-406331ab-7d18-4914-9744-298fc75f07f1 None None] MFA Rules not processed for user `154d05e107d74202beabaa0b60dab8c8`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:17:56.710598 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-406331ab-7d18-4914-9744-298fc75f07f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:17:56.718811 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1582/3137] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:17:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:17:56.966756 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c0e237-8e57-4ae8-ae70-f092cf24929d service nova] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:17:56.967423 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c4c0e237-8e57-4ae8-ae70-f092cf24929d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:17:56.982192 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c0e237-8e57-4ae8-ae70-f092cf24929d service nova] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:17:56.987317 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5788139-a8b7-46ae-b30a-b40e04b30e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:17:56.988311 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5788139-a8b7-46ae-b30a-b40e04b30e74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:17:56.988666 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5788139-a8b7-46ae-b30a-b40e04b30e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:17:56.988947 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5788139-a8b7-46ae-b30a-b40e04b30e74 admin admin] PATH_INFO: `/v3/users/5b93d6c3d03d407f8be4aa38e2fbb154` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:17:56.990133 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5788139-a8b7-46ae-b30a-b40e04b30e74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b93d6c3d03d407f8be4aa38e2fbb154)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:17:56.992704 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5788139-a8b7-46ae-b30a-b40e04b30e74 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:17:57.264380 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e5788139-a8b7-46ae-b30a-b40e04b30e74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b93d6c3d03d407f8be4aa38e2fbb154'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:17:57.268577 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e5788139-a8b7-46ae-b30a-b40e04b30e74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b93d6c3d03d407f8be4aa38e2fbb154'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:17:57.269263 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e5788139-a8b7-46ae-b30a-b40e04b30e74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b93d6c3d03d407f8be4aa38e2fbb154'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:17:57.345516 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e5788139-a8b7-46ae-b30a-b40e04b30e74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b93d6c3d03d407f8be4aa38e2fbb154'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:17:57.354729 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e5788139-a8b7-46ae-b30a-b40e04b30e74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b93d6c3d03d407f8be4aa38e2fbb154'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:17:57.360748 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1556/3138] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:17:56 2022] DELETE /identity/v3/users/5b93d6c3d03d407f8be4aa38e2fbb154 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:17:57.365100 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea5b8f3-503e-4546-9b4c-025fd90bfb61 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:17:57.365441 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea5b8f3-503e-4546-9b4c-025fd90bfb61 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:17:57.368543 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea5b8f3-503e-4546-9b4c-025fd90bfb61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:17:57.385783 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-4ea5b8f3-503e-4546-9b4c-025fd90bfb61 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:17:57.386996 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-4ea5b8f3-503e-4546-9b4c-025fd90bfb61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:17:57.445806 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1583/3139] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:17:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:17:57.455420 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5788139-a8b7-46ae-b30a-b40e04b30e74 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:17:57.456886 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e5788139-a8b7-46ae-b30a-b40e04b30e74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:17:57.516157 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5788139-a8b7-46ae-b30a-b40e04b30e74 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:17:57.542330 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f3e1c6-1278-4192-ba46-cb331ba0c010 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:17:57.542330 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f3e1c6-1278-4192-ba46-cb331ba0c010 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:17:57.542330 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f3e1c6-1278-4192-ba46-cb331ba0c010 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:17:57.542330 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f3e1c6-1278-4192-ba46-cb331ba0c010 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:17:57.551552 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f3e1c6-1278-4192-ba46-cb331ba0c010 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:17:57.553357 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f3e1c6-1278-4192-ba46-cb331ba0c010 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:17:57.564976 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1557/3140] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:17:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:17:57.908845 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea5b8f3-503e-4546-9b4c-025fd90bfb61 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:17:57.910947 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-4ea5b8f3-503e-4546-9b4c-025fd90bfb61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:17:57.922976 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea5b8f3-503e-4546-9b4c-025fd90bfb61 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:17:57.929674 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbd143b-cfc0-42a9-bb72-6f218b64e8db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:17:57.930767 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd143b-cfc0-42a9-bb72-6f218b64e8db admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:17:57.931142 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd143b-cfc0-42a9-bb72-6f218b64e8db admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:17:57.932589 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd143b-cfc0-42a9-bb72-6f218b64e8db admin admin] PATH_INFO: `/v3/projects/35a0e2c4a9054b4b962b9bc72c64517c` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:17:57.939983 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbd143b-cfc0-42a9-bb72-6f218b64e8db admin admin] RBAC: Authorizing `identity:delete_project(project_id=35a0e2c4a9054b4b962b9bc72c64517c)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:17:57.942129 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbd143b-cfc0-42a9-bb72-6f218b64e8db admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:17:58.111644 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-7bbd143b-cfc0-42a9-bb72-6f218b64e8db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35a0e2c4a9054b4b962b9bc72c64517c', 'request_id': 'req-7bbd143b-cfc0-42a9-bb72-6f218b64e8db'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:17:58.118029 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-7bbd143b-cfc0-42a9-bb72-6f218b64e8db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35a0e2c4a9054b4b962b9bc72c64517c', 'request_id': 'req-7bbd143b-cfc0-42a9-bb72-6f218b64e8db'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:17:58.189185 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-7bbd143b-cfc0-42a9-bb72-6f218b64e8db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35a0e2c4a9054b4b962b9bc72c64517c', 'request_id': 'req-7bbd143b-cfc0-42a9-bb72-6f218b64e8db'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:17:58.208686 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-7bbd143b-cfc0-42a9-bb72-6f218b64e8db admin admin] The token cache is being invalidate because project 35a0e2c4a9054b4b962b9bc72c64517c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:17:58.208686 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-7bbd143b-cfc0-42a9-bb72-6f218b64e8db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:17:58.208686 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-7bbd143b-cfc0-42a9-bb72-6f218b64e8db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:17:58.208686 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1584/3141] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:17:57 2022] DELETE /identity/v3/projects/35a0e2c4a9054b4b962b9bc72c64517c => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:17:58.211468 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f3e1c6-1278-4192-ba46-cb331ba0c010 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:17:58.221568 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f3e1c6-1278-4192-ba46-cb331ba0c010 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:17:58.281095 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371c3bc5-22c0-4563-b8de-a9f59eb62235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:17:58.281967 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c3bc5-22c0-4563-b8de-a9f59eb62235 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:17:58.282248 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c3bc5-22c0-4563-b8de-a9f59eb62235 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:17:58.282518 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c3bc5-22c0-4563-b8de-a9f59eb62235 admin admin] PATH_INFO: `/v3/users/9847c635058343c096bb44d95e70bc82` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:17:58.285648 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371c3bc5-22c0-4563-b8de-a9f59eb62235 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9847c635058343c096bb44d95e70bc82)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:17:58.289071 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371c3bc5-22c0-4563-b8de-a9f59eb62235 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:17:58.550500 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-371c3bc5-22c0-4563-b8de-a9f59eb62235 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9847c635058343c096bb44d95e70bc82'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:17:58.559014 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-371c3bc5-22c0-4563-b8de-a9f59eb62235 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9847c635058343c096bb44d95e70bc82'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:17:58.560156 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-371c3bc5-22c0-4563-b8de-a9f59eb62235 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9847c635058343c096bb44d95e70bc82'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:17:58.671423 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-371c3bc5-22c0-4563-b8de-a9f59eb62235 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9847c635058343c096bb44d95e70bc82'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:17:58.691424 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-371c3bc5-22c0-4563-b8de-a9f59eb62235 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9847c635058343c096bb44d95e70bc82'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:17:58.698193 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1558/3142] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:17:58 2022] DELETE /identity/v3/users/9847c635058343c096bb44d95e70bc82 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:17:59.149567 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbd143b-cfc0-42a9-bb72-6f218b64e8db admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:17:59.149567 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-7bbd143b-cfc0-42a9-bb72-6f218b64e8db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:17:59.149567 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbd143b-cfc0-42a9-bb72-6f218b64e8db admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:17:59.220685 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f998226-0fb3-4ee1-84e3-2846c664a7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:17:59.220685 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f998226-0fb3-4ee1-84e3-2846c664a7a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:17:59.220937 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f998226-0fb3-4ee1-84e3-2846c664a7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:17:59.221136 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f998226-0fb3-4ee1-84e3-2846c664a7a1 admin admin] PATH_INFO: `/v3/projects/8a4ed51cf6684302bed4497b2547ef09` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:17:59.223332 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f998226-0fb3-4ee1-84e3-2846c664a7a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a4ed51cf6684302bed4497b2547ef09)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:17:59.225386 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f998226-0fb3-4ee1-84e3-2846c664a7a1 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:17:59.340174 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-7f998226-0fb3-4ee1-84e3-2846c664a7a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a4ed51cf6684302bed4497b2547ef09', 'request_id': 'req-7f998226-0fb3-4ee1-84e3-2846c664a7a1'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:17:59.345959 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-7f998226-0fb3-4ee1-84e3-2846c664a7a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a4ed51cf6684302bed4497b2547ef09', 'request_id': 'req-7f998226-0fb3-4ee1-84e3-2846c664a7a1'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:17:59.410061 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-7f998226-0fb3-4ee1-84e3-2846c664a7a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a4ed51cf6684302bed4497b2547ef09', 'request_id': 'req-7f998226-0fb3-4ee1-84e3-2846c664a7a1'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:17:59.422669 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-7f998226-0fb3-4ee1-84e3-2846c664a7a1 admin admin] The token cache is being invalidate because project 8a4ed51cf6684302bed4497b2547ef09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:17:59.422963 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-7f998226-0fb3-4ee1-84e3-2846c664a7a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:17:59.423661 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-7f998226-0fb3-4ee1-84e3-2846c664a7a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:17:59.425762 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1585/3143] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:17:59 2022] DELETE /identity/v3/projects/8a4ed51cf6684302bed4497b2547ef09 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:17:59.431716 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ba2b73-c019-4015-8719-f1fbc18281cc None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:17:59.446253 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ba2b73-c019-4015-8719-f1fbc18281cc None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:17:59.446253 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ba2b73-c019-4015-8719-f1fbc18281cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:17:59.453225 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-97ba2b73-c019-4015-8719-f1fbc18281cc None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:17:59.454450 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-97ba2b73-c019-4015-8719-f1fbc18281cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:17:59.525817 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1559/3144] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:17:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:17:59.534200 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8cc16-3a91-4fcd-942d-eca244b2bbe6 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:17:59.534574 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8cc16-3a91-4fcd-942d-eca244b2bbe6 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:17:59.534853 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8cc16-3a91-4fcd-942d-eca244b2bbe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:17:59.555139 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-8bf8cc16-3a91-4fcd-942d-eca244b2bbe6 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:17:59.556377 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-8bf8cc16-3a91-4fcd-942d-eca244b2bbe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:17:59.570652 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1586/3145] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:17:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:17:59.571406 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ba2b73-c019-4015-8719-f1fbc18281cc None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:17:59.582643 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ba2b73-c019-4015-8719-f1fbc18281cc None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:17:59.588652 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee5897f-832d-4149-91eb-13e2a32ae5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:17:59.589318 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee5897f-832d-4149-91eb-13e2a32ae5df admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:17:59.589601 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee5897f-832d-4149-91eb-13e2a32ae5df admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:17:59.589873 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee5897f-832d-4149-91eb-13e2a32ae5df admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:17:59.590621 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee5897f-832d-4149-91eb-13e2a32ae5df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:17:59.590925 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee5897f-832d-4149-91eb-13e2a32ae5df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:17:59.592643 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee5897f-832d-4149-91eb-13e2a32ae5df admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:17:59.604336 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1560/3146] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:17:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:17:59.608700 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf8cc16-3a91-4fcd-942d-eca244b2bbe6 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:17:59.618210 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf8cc16-3a91-4fcd-942d-eca244b2bbe6 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:17:59.623424 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de9adc-3753-44ed-8b8e-35daca6c4d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:17:59.624153 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de9adc-3753-44ed-8b8e-35daca6c4d5b admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:17:59.628751 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de9adc-3753-44ed-8b8e-35daca6c4d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:17:59.628751 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de9adc-3753-44ed-8b8e-35daca6c4d5b admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:17:59.628751 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0de9adc-3753-44ed-8b8e-35daca6c4d5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:17:59.628751 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0de9adc-3753-44ed-8b8e-35daca6c4d5b admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:17:59.769194 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1587/3147] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:17:59 2022] POST /identity/v3/projects => generated 409 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:17:59.770704 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee5897f-832d-4149-91eb-13e2a32ae5df admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:17:59.783747 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee5897f-832d-4149-91eb-13e2a32ae5df admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:17:59.857553 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4182933-b548-4653-9d87-85e3afef6546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:17:59.858512 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4182933-b548-4653-9d87-85e3afef6546 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:17:59.858857 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4182933-b548-4653-9d87-85e3afef6546 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:17:59.859202 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4182933-b548-4653-9d87-85e3afef6546 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:17:59.860174 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4182933-b548-4653-9d87-85e3afef6546 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:17:59.862260 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4182933-b548-4653-9d87-85e3afef6546 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:17:59.968715 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1561/3148] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:17:59 2022] POST /identity/v3/users => generated 305 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:17:59.972722 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de9adc-3753-44ed-8b8e-35daca6c4d5b admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:17:59.984770 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de9adc-3753-44ed-8b8e-35daca6c4d5b admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:17:59.996409 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1549ea33-5f6a-45ac-92bd-dee09e0070f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:17:59.998445 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1549ea33-5f6a-45ac-92bd-dee09e0070f0 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:17:59.998733 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1549ea33-5f6a-45ac-92bd-dee09e0070f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:17:59.999596 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1549ea33-5f6a-45ac-92bd-dee09e0070f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:18:00.002959 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1549ea33-5f6a-45ac-92bd-dee09e0070f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:18:00.002959 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1549ea33-5f6a-45ac-92bd-dee09e0070f0 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:18:00.019547 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1588/3149] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:17:59 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:18:00.020675 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4182933-b548-4653-9d87-85e3afef6546 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:18:00.039828 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4182933-b548-4653-9d87-85e3afef6546 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:18:00.050150 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cde0cf1-a3b0-4956-af7b-3e66835eb445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:18:00.052332 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde0cf1-a3b0-4956-af7b-3e66835eb445 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:18:00.054049 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde0cf1-a3b0-4956-af7b-3e66835eb445 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:18:00.054420 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde0cf1-a3b0-4956-af7b-3e66835eb445 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:18:00.056305 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cde0cf1-a3b0-4956-af7b-3e66835eb445 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:18:00.057957 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cde0cf1-a3b0-4956-af7b-3e66835eb445 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:18:00.076251 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1562/3150] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:18:00 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:18:00.080792 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1549ea33-5f6a-45ac-92bd-dee09e0070f0 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:18:00.092562 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1549ea33-5f6a-45ac-92bd-dee09e0070f0 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:18:00.098514 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8983f83-e490-4330-8d87-061304fee1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:18:00.099727 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8983f83-e490-4330-8d87-061304fee1ee admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:18:00.100892 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8983f83-e490-4330-8d87-061304fee1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:18:00.101192 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8983f83-e490-4330-8d87-061304fee1ee admin admin] PATH_INFO: `/v3/projects/12f48ec9349545898ace7011ec67979e/users/12aaa8ee31364e8b89665a037582aa38/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:18:00.117399 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8983f83-e490-4330-8d87-061304fee1ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=12f48ec9349545898ace7011ec67979e, user_id=12aaa8ee31364e8b89665a037582aa38, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:18:00.120295 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8983f83-e490-4330-8d87-061304fee1ee admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:18:00.229916 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1589/3151] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:18:00 2022] PUT /identity/v3/projects/12f48ec9349545898ace7011ec67979e/users/12aaa8ee31364e8b89665a037582aa38/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:18:00.231369 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08054f58-f1cf-4ec8-b872-456a39c15fc9 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:18:00.231696 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08054f58-f1cf-4ec8-b872-456a39c15fc9 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:18:00.231975 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08054f58-f1cf-4ec8-b872-456a39c15fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:18:00.264405 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-08054f58-f1cf-4ec8-b872-456a39c15fc9 None None] MFA Rules not processed for user `12aaa8ee31364e8b89665a037582aa38`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:18:00.266421 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-08054f58-f1cf-4ec8-b872-456a39c15fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:18:00.347278 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1563/3152] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:18:00 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:18:00.352591 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8983f83-e490-4330-8d87-061304fee1ee admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:18:00.491815 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8983f83-e490-4330-8d87-061304fee1ee admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:18:00.521695 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a21d09-3201-4b78-9a8e-f79ff006e142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:18:00.523204 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a21d09-3201-4b78-9a8e-f79ff006e142 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:18:00.523506 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a21d09-3201-4b78-9a8e-f79ff006e142 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:18:00.523856 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a21d09-3201-4b78-9a8e-f79ff006e142 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:18:00.528720 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a21d09-3201-4b78-9a8e-f79ff006e142 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:18:00.531472 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a21d09-3201-4b78-9a8e-f79ff006e142 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:18:00.675013 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1590/3153] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:18:00 2022] POST /identity/v3/projects => generated 409 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:18:00.680211 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08054f58-f1cf-4ec8-b872-456a39c15fc9 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:18:00.693623 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08054f58-f1cf-4ec8-b872-456a39c15fc9 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:18:00.753493 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394f0f5c-68fa-4651-ab13-00b79e16f7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:18:00.754894 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f0f5c-68fa-4651-ab13-00b79e16f7dc admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:18:00.755183 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f0f5c-68fa-4651-ab13-00b79e16f7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:18:00.762819 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f0f5c-68fa-4651-ab13-00b79e16f7dc admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:18:00.762819 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394f0f5c-68fa-4651-ab13-00b79e16f7dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:18:00.762819 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394f0f5c-68fa-4651-ab13-00b79e16f7dc admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:18:00.873078 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1564/3154] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:18:00 2022] POST /identity/v3/users => generated 311 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:18:00.878702 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a21d09-3201-4b78-9a8e-f79ff006e142 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:18:00.912087 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a21d09-3201-4b78-9a8e-f79ff006e142 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:18:00.927189 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0beab87-7fc1-4407-8163-6a378ebb510f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:18:00.930008 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0beab87-7fc1-4407-8163-6a378ebb510f admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:18:00.930008 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0beab87-7fc1-4407-8163-6a378ebb510f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:18:00.930008 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0beab87-7fc1-4407-8163-6a378ebb510f admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:18:00.930008 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0beab87-7fc1-4407-8163-6a378ebb510f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:18:00.932889 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0beab87-7fc1-4407-8163-6a378ebb510f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:18:00.950258 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1591/3155] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:18:00 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:18:00.956657 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394f0f5c-68fa-4651-ab13-00b79e16f7dc admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:18:00.971107 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394f0f5c-68fa-4651-ab13-00b79e16f7dc admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:18:00.977615 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f3c9e7-521b-41b5-906d-dfdcc556f8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:18:00.978741 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3c9e7-521b-41b5-906d-dfdcc556f8f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:18:00.979133 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3c9e7-521b-41b5-906d-dfdcc556f8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:18:00.979744 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3c9e7-521b-41b5-906d-dfdcc556f8f1 admin admin] PATH_INFO: `/v3/projects/d91310b0d08a4547b8e783bcaddbc217/users/a1308d582fa44ef882e59563d218a8d3/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:18:00.999162 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f3c9e7-521b-41b5-906d-dfdcc556f8f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d91310b0d08a4547b8e783bcaddbc217, user_id=a1308d582fa44ef882e59563d218a8d3, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:18:01.002134 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f3c9e7-521b-41b5-906d-dfdcc556f8f1 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:18:01.129075 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1565/3156] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:18:00 2022] PUT /identity/v3/projects/d91310b0d08a4547b8e783bcaddbc217/users/a1308d582fa44ef882e59563d218a8d3/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:18:01.130139 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0beab87-7fc1-4407-8163-6a378ebb510f admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:18:01.141713 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0beab87-7fc1-4407-8163-6a378ebb510f admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:18:01.222160 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7fc17f-f85a-48c3-af39-173f0e70248a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:18:01.223211 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7fc17f-f85a-48c3-af39-173f0e70248a admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:18:01.223894 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7fc17f-f85a-48c3-af39-173f0e70248a admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:18:01.224406 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7fc17f-f85a-48c3-af39-173f0e70248a admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:18:01.226120 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7fc17f-f85a-48c3-af39-173f0e70248a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:18:01.228388 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7fc17f-f85a-48c3-af39-173f0e70248a admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:18:01.288340 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f3c9e7-521b-41b5-906d-dfdcc556f8f1 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:18:01.295046 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1592/3157] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:18:01 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:18:01.313380 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f3c9e7-521b-41b5-906d-dfdcc556f8f1 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:18:01.322250 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdbdff4-a795-48d2-ac2a-3ae2aae9c67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:18:01.323234 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbdff4-a795-48d2-ac2a-3ae2aae9c67d admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:18:01.323549 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbdff4-a795-48d2-ac2a-3ae2aae9c67d admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:18:01.323834 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbdff4-a795-48d2-ac2a-3ae2aae9c67d admin admin] PATH_INFO: `/v3/projects/d91310b0d08a4547b8e783bcaddbc217/users/a1308d582fa44ef882e59563d218a8d3/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:18:01.330036 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdbdff4-a795-48d2-ac2a-3ae2aae9c67d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d91310b0d08a4547b8e783bcaddbc217, user_id=a1308d582fa44ef882e59563d218a8d3, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:18:01.339145 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84937a7-40cd-4b79-92c3-41ceb10b3e2b None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:18:01.340289 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84937a7-40cd-4b79-92c3-41ceb10b3e2b None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:18:01.340441 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdbdff4-a795-48d2-ac2a-3ae2aae9c67d admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:18:01.340959 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84937a7-40cd-4b79-92c3-41ceb10b3e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:18:01.377987 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1566/3158] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:18:01 2022] PUT /identity/v3/projects/d91310b0d08a4547b8e783bcaddbc217/users/a1308d582fa44ef882e59563d218a8d3/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:18:01.386562 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-b84937a7-40cd-4b79-92c3-41ceb10b3e2b None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:18:01.388152 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b84937a7-40cd-4b79-92c3-41ceb10b3e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:18:01.389143 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a77948-5668-4cec-bbce-0aefd2655f8e None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:18:01.389439 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a77948-5668-4cec-bbce-0aefd2655f8e None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:18:01.389750 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a77948-5668-4cec-bbce-0aefd2655f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:18:01.457924 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1593/3159] 10.222.0.52 () {58 vars in 1009 bytes} [Sat May 14 21:18:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:18:01.472503 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-61a77948-5668-4cec-bbce-0aefd2655f8e None None] MFA Rules not processed for user `a1308d582fa44ef882e59563d218a8d3`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:18:01.475692 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-61a77948-5668-4cec-bbce-0aefd2655f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:18:01.595869 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1567/3160] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:18:01 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:18:01.596883 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84937a7-40cd-4b79-92c3-41ceb10b3e2b None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:18:01.703937 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84937a7-40cd-4b79-92c3-41ceb10b3e2b None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:18:01.710257 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaf6c52-57dc-4970-8fb0-81a0734e9d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:18:01.711814 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf6c52-57dc-4970-8fb0-81a0734e9d4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:18:01.712344 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf6c52-57dc-4970-8fb0-81a0734e9d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:18:01.712795 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf6c52-57dc-4970-8fb0-81a0734e9d4e admin admin] PATH_INFO: `/v3/users/12aaa8ee31364e8b89665a037582aa38` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:18:01.714310 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaf6c52-57dc-4970-8fb0-81a0734e9d4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=12aaa8ee31364e8b89665a037582aa38)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:18:01.716529 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaf6c52-57dc-4970-8fb0-81a0734e9d4e admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:18:02.010903 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a77948-5668-4cec-bbce-0aefd2655f8e None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:18:02.012857 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-61a77948-5668-4cec-bbce-0aefd2655f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:18:02.107724 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-eeaf6c52-57dc-4970-8fb0-81a0734e9d4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12aaa8ee31364e8b89665a037582aa38'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:18:02.129427 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-eeaf6c52-57dc-4970-8fb0-81a0734e9d4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12aaa8ee31364e8b89665a037582aa38'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:18:02.143170 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-eeaf6c52-57dc-4970-8fb0-81a0734e9d4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12aaa8ee31364e8b89665a037582aa38'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:18:02.169774 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a77948-5668-4cec-bbce-0aefd2655f8e None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:18:02.176852 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff56d9d-4fa0-4c5d-b21c-d5abcf6343d9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:18:02.178030 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff56d9d-4fa0-4c5d-b21c-d5abcf6343d9 service swift] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:18:02.178625 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff56d9d-4fa0-4c5d-b21c-d5abcf6343d9 service swift] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:18:02.179181 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff56d9d-4fa0-4c5d-b21c-d5abcf6343d9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:18:02.190609 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff56d9d-4fa0-4c5d-b21c-d5abcf6343d9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:18:02.201171 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff56d9d-4fa0-4c5d-b21c-d5abcf6343d9 service swift] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:18:02.204958 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1568/3161] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 21:18:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 14 21:18:02.247104 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-eeaf6c52-57dc-4970-8fb0-81a0734e9d4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12aaa8ee31364e8b89665a037582aa38'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:18:02.252001 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-eeaf6c52-57dc-4970-8fb0-81a0734e9d4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12aaa8ee31364e8b89665a037582aa38'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:18:02.257427 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1594/3162] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:18:01 2022] DELETE /identity/v3/users/12aaa8ee31364e8b89665a037582aa38 => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:18:02.262742 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e6d94-a19e-4b71-b327-115ddac5e98e None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:18:02.263394 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e6d94-a19e-4b71-b327-115ddac5e98e None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:18:02.263927 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e6d94-a19e-4b71-b327-115ddac5e98e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:18:02.287469 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-fa5e6d94-a19e-4b71-b327-115ddac5e98e None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:18:02.289168 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-fa5e6d94-a19e-4b71-b327-115ddac5e98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:18:02.396713 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1569/3163] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:18:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:18:02.408386 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaf6c52-57dc-4970-8fb0-81a0734e9d4e admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:18:02.411181 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-eeaf6c52-57dc-4970-8fb0-81a0734e9d4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:18:02.545334 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaf6c52-57dc-4970-8fb0-81a0734e9d4e admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:18:02.555777 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e09cc07-4e29-4bfc-a372-8dc2f32ba02b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:18:02.556958 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e09cc07-4e29-4bfc-a372-8dc2f32ba02b service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:18:02.557411 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e09cc07-4e29-4bfc-a372-8dc2f32ba02b service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:18:02.558106 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e09cc07-4e29-4bfc-a372-8dc2f32ba02b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:18:02.576452 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e09cc07-4e29-4bfc-a372-8dc2f32ba02b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:18:02.580519 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e09cc07-4e29-4bfc-a372-8dc2f32ba02b service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:18:02.598273 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1595/3164] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:18:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:18:03.417779 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e6d94-a19e-4b71-b327-115ddac5e98e None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:18:03.419975 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-fa5e6d94-a19e-4b71-b327-115ddac5e98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:18:03.458127 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e6d94-a19e-4b71-b327-115ddac5e98e None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:18:03.473610 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6bb851-aee9-4129-979c-f73e2c216711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:18:03.478320 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6bb851-aee9-4129-979c-f73e2c216711 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:18:03.478616 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6bb851-aee9-4129-979c-f73e2c216711 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:18:03.478886 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6bb851-aee9-4129-979c-f73e2c216711 admin admin] PATH_INFO: `/v3/projects/12f48ec9349545898ace7011ec67979e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:18:03.482128 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6bb851-aee9-4129-979c-f73e2c216711 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12f48ec9349545898ace7011ec67979e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:18:03.512917 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6bb851-aee9-4129-979c-f73e2c216711 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:18:03.742827 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-1d6bb851-aee9-4129-979c-f73e2c216711 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12f48ec9349545898ace7011ec67979e', 'request_id': 'req-1d6bb851-aee9-4129-979c-f73e2c216711'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:18:03.750750 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-1d6bb851-aee9-4129-979c-f73e2c216711 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12f48ec9349545898ace7011ec67979e', 'request_id': 'req-1d6bb851-aee9-4129-979c-f73e2c216711'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:18:03.777862 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-1d6bb851-aee9-4129-979c-f73e2c216711 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12f48ec9349545898ace7011ec67979e', 'request_id': 'req-1d6bb851-aee9-4129-979c-f73e2c216711'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:18:03.864996 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-1d6bb851-aee9-4129-979c-f73e2c216711 admin admin] The token cache is being invalidate because project 12f48ec9349545898ace7011ec67979e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:18:03.864996 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-1d6bb851-aee9-4129-979c-f73e2c216711 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:18:03.864996 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-1d6bb851-aee9-4129-979c-f73e2c216711 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:18:03.865572 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1570/3165] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:18:03 2022] DELETE /identity/v3/projects/12f48ec9349545898ace7011ec67979e => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:18:03.870044 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e09cc07-4e29-4bfc-a372-8dc2f32ba02b service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:18:03.888372 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e09cc07-4e29-4bfc-a372-8dc2f32ba02b service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:18:04.124768 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a52370-7f13-48c6-8a51-2f31fbcb27f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:18:04.126134 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a52370-7f13-48c6-8a51-2f31fbcb27f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:18:04.126419 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a52370-7f13-48c6-8a51-2f31fbcb27f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:18:04.126700 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a52370-7f13-48c6-8a51-2f31fbcb27f3 admin admin] PATH_INFO: `/v3/users/a1308d582fa44ef882e59563d218a8d3` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:18:04.133029 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a52370-7f13-48c6-8a51-2f31fbcb27f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1308d582fa44ef882e59563d218a8d3)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:18:04.135315 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a52370-7f13-48c6-8a51-2f31fbcb27f3 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:18:04.585017 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-06a52370-7f13-48c6-8a51-2f31fbcb27f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1308d582fa44ef882e59563d218a8d3'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:18:04.617648 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-06a52370-7f13-48c6-8a51-2f31fbcb27f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1308d582fa44ef882e59563d218a8d3'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:18:04.635550 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-06a52370-7f13-48c6-8a51-2f31fbcb27f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1308d582fa44ef882e59563d218a8d3'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:18:04.778441 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-06a52370-7f13-48c6-8a51-2f31fbcb27f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1308d582fa44ef882e59563d218a8d3'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:18:04.788835 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-06a52370-7f13-48c6-8a51-2f31fbcb27f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1308d582fa44ef882e59563d218a8d3'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:18:04.794784 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1596/3166] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:18:03 2022] DELETE /identity/v3/users/a1308d582fa44ef882e59563d218a8d3 => generated 0 bytes in 925 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:18:05.954500 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6bb851-aee9-4129-979c-f73e2c216711 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:18:05.957956 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-1d6bb851-aee9-4129-979c-f73e2c216711 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:18:05.999431 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6bb851-aee9-4129-979c-f73e2c216711 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:18:06.065890 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0030863-241f-4f45-add0-8dc3527d4972 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:18:06.066787 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0030863-241f-4f45-add0-8dc3527d4972 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:18:06.067250 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0030863-241f-4f45-add0-8dc3527d4972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:18:06.096718 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-d0030863-241f-4f45-add0-8dc3527d4972 None None] MFA Rules not processed for user `6ae75ac4b3ed44eda1e8717ff641cd0c`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:18:06.098729 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d0030863-241f-4f45-add0-8dc3527d4972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:18:06.173439 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1597/3167] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:18:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:18:06.176457 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd3cb3-8fa1-4058-b639-bc32966c0425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:18:06.177979 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd3cb3-8fa1-4058-b639-bc32966c0425 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:18:06.178764 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd3cb3-8fa1-4058-b639-bc32966c0425 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:18:06.179307 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd3cb3-8fa1-4058-b639-bc32966c0425 admin admin] PATH_INFO: `/v3/projects/d91310b0d08a4547b8e783bcaddbc217` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:18:06.185111 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cd3cb3-8fa1-4058-b639-bc32966c0425 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d91310b0d08a4547b8e783bcaddbc217)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:18:06.187090 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cd3cb3-8fa1-4058-b639-bc32966c0425 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:18:06.407005 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-40cd3cb3-8fa1-4058-b639-bc32966c0425 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd91310b0d08a4547b8e783bcaddbc217', 'request_id': 'req-40cd3cb3-8fa1-4058-b639-bc32966c0425'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:18:06.421478 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-40cd3cb3-8fa1-4058-b639-bc32966c0425 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd91310b0d08a4547b8e783bcaddbc217', 'request_id': 'req-40cd3cb3-8fa1-4058-b639-bc32966c0425'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:18:06.434837 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-40cd3cb3-8fa1-4058-b639-bc32966c0425 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd91310b0d08a4547b8e783bcaddbc217', 'request_id': 'req-40cd3cb3-8fa1-4058-b639-bc32966c0425'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:18:06.602796 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-40cd3cb3-8fa1-4058-b639-bc32966c0425 admin admin] The token cache is being invalidate because project d91310b0d08a4547b8e783bcaddbc217 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:18:06.602796 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-40cd3cb3-8fa1-4058-b639-bc32966c0425 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:18:06.604253 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-40cd3cb3-8fa1-4058-b639-bc32966c0425 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:18:06.615064 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1571/3168] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:18:05 2022] DELETE /identity/v3/projects/d91310b0d08a4547b8e783bcaddbc217 => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:18:06.615345 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e303f-3184-4d64-8e08-986605c7d945 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:18:06.616228 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e303f-3184-4d64-8e08-986605c7d945 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:18:06.616513 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e303f-3184-4d64-8e08-986605c7d945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:18:06.689637 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-bc8e303f-3184-4d64-8e08-986605c7d945 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:18:06.690898 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-bc8e303f-3184-4d64-8e08-986605c7d945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:18:06.872052 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1598/3169] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:18:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:18:06.872301 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d70956-9a1f-4021-8fb7-c9bb90a67b57 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:18:06.872642 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d70956-9a1f-4021-8fb7-c9bb90a67b57 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:18:06.873042 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d70956-9a1f-4021-8fb7-c9bb90a67b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:18:06.943131 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-73d70956-9a1f-4021-8fb7-c9bb90a67b57 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:18:06.952432 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-73d70956-9a1f-4021-8fb7-c9bb90a67b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:18:06.968759 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1572/3170] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:18:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:18:06.972712 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e303f-3184-4d64-8e08-986605c7d945 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:18:07.005709 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e303f-3184-4d64-8e08-986605c7d945 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:18:07.005709 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0378f703-4f09-46cf-a84b-03bd9f9505c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:18:07.005709 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0378f703-4f09-46cf-a84b-03bd9f9505c4 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:18:07.005709 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0378f703-4f09-46cf-a84b-03bd9f9505c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:18:07.006832 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0378f703-4f09-46cf-a84b-03bd9f9505c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:18:07.008325 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0378f703-4f09-46cf-a84b-03bd9f9505c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:18:07.009203 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0378f703-4f09-46cf-a84b-03bd9f9505c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:18:07.013843 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0378f703-4f09-46cf-a84b-03bd9f9505c4 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:18:07.036794 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1599/3171] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:18:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:18:07.037160 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d70956-9a1f-4021-8fb7-c9bb90a67b57 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:18:07.040241 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0378f703-4f09-46cf-a84b-03bd9f9505c4 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:18:07.042070 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-0378f703-4f09-46cf-a84b-03bd9f9505c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:18:07.057862 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d70956-9a1f-4021-8fb7-c9bb90a67b57 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:18:07.076817 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864bcc92-02cc-4fa4-aaaa-3bfed22a5200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:18:07.078642 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864bcc92-02cc-4fa4-aaaa-3bfed22a5200 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:18:07.078642 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864bcc92-02cc-4fa4-aaaa-3bfed22a5200 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:18:07.078642 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864bcc92-02cc-4fa4-aaaa-3bfed22a5200 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:18:07.080907 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864bcc92-02cc-4fa4-aaaa-3bfed22a5200 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:18:07.083318 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864bcc92-02cc-4fa4-aaaa-3bfed22a5200 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:18:07.206555 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0378f703-4f09-46cf-a84b-03bd9f9505c4 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:18:07.222487 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1573/3172] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:18:07 2022] POST /identity/v3/projects => generated 391 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:18:07.227368 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864bcc92-02cc-4fa4-aaaa-3bfed22a5200 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:18:07.228010 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da56d3f-c23e-4bc5-8e23-da441fb340c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:18:07.229919 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da56d3f-c23e-4bc5-8e23-da441fb340c8 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:18:07.229919 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da56d3f-c23e-4bc5-8e23-da441fb340c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:18:07.229919 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da56d3f-c23e-4bc5-8e23-da441fb340c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:18:07.238318 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-9da56d3f-c23e-4bc5-8e23-da441fb340c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:18:07.264419 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da56d3f-c23e-4bc5-8e23-da441fb340c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:18:07.271381 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da56d3f-c23e-4bc5-8e23-da441fb340c8 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:18:07.295671 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1600/3173] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:18:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:18:07.435059 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864bcc92-02cc-4fa4-aaaa-3bfed22a5200 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:18:07.447763 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cdbebe-24e0-4568-b05d-690feb8d06c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:18:07.448459 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cdbebe-24e0-4568-b05d-690feb8d06c1 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:18:07.449691 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cdbebe-24e0-4568-b05d-690feb8d06c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:18:07.450196 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cdbebe-24e0-4568-b05d-690feb8d06c1 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:18:07.451332 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cdbebe-24e0-4568-b05d-690feb8d06c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:18:07.454070 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cdbebe-24e0-4568-b05d-690feb8d06c1 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:18:07.637732 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1574/3174] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:18:07 2022] POST /identity/v3/users => generated 296 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:18:07.641930 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da56d3f-c23e-4bc5-8e23-da441fb340c8 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:18:07.660393 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da56d3f-c23e-4bc5-8e23-da441fb340c8 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:18:07.677638 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f5dde4-6eb8-452c-9d9c-3f1b142389df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:18:07.678941 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5dde4-6eb8-452c-9d9c-3f1b142389df admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:18:07.687320 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5dde4-6eb8-452c-9d9c-3f1b142389df admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:18:07.687320 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5dde4-6eb8-452c-9d9c-3f1b142389df admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:18:07.687320 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f5dde4-6eb8-452c-9d9c-3f1b142389df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:18:07.687320 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f5dde4-6eb8-452c-9d9c-3f1b142389df admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:18:07.726563 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1601/3175] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:18:07 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:18:07.729243 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cdbebe-24e0-4568-b05d-690feb8d06c1 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:18:07.759927 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cdbebe-24e0-4568-b05d-690feb8d06c1 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:18:07.789102 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e68e06-1edc-45c2-b5da-97b9d61688fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:18:07.790291 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e68e06-1edc-45c2-b5da-97b9d61688fe admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:18:07.790754 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e68e06-1edc-45c2-b5da-97b9d61688fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:18:07.792145 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e68e06-1edc-45c2-b5da-97b9d61688fe admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:18:07.793659 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e68e06-1edc-45c2-b5da-97b9d61688fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:18:07.796237 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e68e06-1edc-45c2-b5da-97b9d61688fe admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:18:07.814539 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1575/3176] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:18:07 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:18:07.820062 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f5dde4-6eb8-452c-9d9c-3f1b142389df admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:18:07.840564 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f5dde4-6eb8-452c-9d9c-3f1b142389df admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:18:07.854044 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d223037-26e4-49f4-a70b-dcbc1c98adad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:18:07.859610 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d223037-26e4-49f4-a70b-dcbc1c98adad admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:18:07.859610 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d223037-26e4-49f4-a70b-dcbc1c98adad admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:18:07.859610 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d223037-26e4-49f4-a70b-dcbc1c98adad admin admin] PATH_INFO: `/v3/projects/811e6ec5009a4bc09493edbdac6ee64b/users/2f9db469c467477abf9f9f25bafaaf11/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:18:07.907563 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d223037-26e4-49f4-a70b-dcbc1c98adad admin admin] RBAC: Authorizing `identity:create_grant(project_id=811e6ec5009a4bc09493edbdac6ee64b, user_id=2f9db469c467477abf9f9f25bafaaf11, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:18:07.917860 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d223037-26e4-49f4-a70b-dcbc1c98adad admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:18:08.035401 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1602/3177] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:18:07 2022] PUT /identity/v3/projects/811e6ec5009a4bc09493edbdac6ee64b/users/2f9db469c467477abf9f9f25bafaaf11/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:18:08.037358 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a51b26-4ec4-48e9-859e-c87875d881f1 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:18:08.038073 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a51b26-4ec4-48e9-859e-c87875d881f1 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:18:08.038073 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a51b26-4ec4-48e9-859e-c87875d881f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:18:08.097054 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-c3a51b26-4ec4-48e9-859e-c87875d881f1 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:18:08.098330 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c3a51b26-4ec4-48e9-859e-c87875d881f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:18:08.268433 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1576/3178] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:18:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:18:08.288207 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d223037-26e4-49f4-a70b-dcbc1c98adad admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:18:08.291080 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-6d223037-26e4-49f4-a70b-dcbc1c98adad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:18:08.450549 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d223037-26e4-49f4-a70b-dcbc1c98adad admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:18:08.458033 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f36a72d-5542-47ed-acf2-394aff9fff40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:18:08.458811 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36a72d-5542-47ed-acf2-394aff9fff40 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:18:08.462149 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36a72d-5542-47ed-acf2-394aff9fff40 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:18:08.462260 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36a72d-5542-47ed-acf2-394aff9fff40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:18:08.495390 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f36a72d-5542-47ed-acf2-394aff9fff40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:18:08.495390 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f36a72d-5542-47ed-acf2-394aff9fff40 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:18:08.538034 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1603/3179] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:18:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:18:14.715033 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5cf47-736a-443a-88ea-a76f0289d7a2 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:18:14.720308 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5cf47-736a-443a-88ea-a76f0289d7a2 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:18:14.720308 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5cf47-736a-443a-88ea-a76f0289d7a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:18:14.743920 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-97c5cf47-736a-443a-88ea-a76f0289d7a2 None None] MFA Rules not processed for user `154d05e107d74202beabaa0b60dab8c8`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:18:14.745288 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-97c5cf47-736a-443a-88ea-a76f0289d7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:18:14.916257 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1577/3180] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:18:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:18:15.949551 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217077f8-efef-4183-a0d0-1b6f5f7f78e4 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:18:15.953891 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217077f8-efef-4183-a0d0-1b6f5f7f78e4 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:18:15.953891 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217077f8-efef-4183-a0d0-1b6f5f7f78e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:18:15.995347 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-217077f8-efef-4183-a0d0-1b6f5f7f78e4 None None] MFA Rules not processed for user `cfcb989a491440b3bf74ddc055ee14d3`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:18:15.998636 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-217077f8-efef-4183-a0d0-1b6f5f7f78e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:18:16.198943 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1604/3181] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:18:15 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:18:23.263816 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfa7df5-f280-4b35-8bdc-8c841a68c4a5 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:18:23.264774 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfa7df5-f280-4b35-8bdc-8c841a68c4a5 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:18:23.265272 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfa7df5-f280-4b35-8bdc-8c841a68c4a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:18:23.294488 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-5dfa7df5-f280-4b35-8bdc-8c841a68c4a5 None None] MFA Rules not processed for user `2f9db469c467477abf9f9f25bafaaf11`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:18:23.295993 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-5dfa7df5-f280-4b35-8bdc-8c841a68c4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:18:23.368667 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1578/3182] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:18:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:18:23.383764 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217077f8-efef-4183-a0d0-1b6f5f7f78e4 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:18:23.386252 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-217077f8-efef-4183-a0d0-1b6f5f7f78e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:18:23.481809 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217077f8-efef-4183-a0d0-1b6f5f7f78e4 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:18:23.488312 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa943be-864a-4ac9-908b-bcb25f17ac98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:18:23.489226 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa943be-864a-4ac9-908b-bcb25f17ac98 service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:18:23.489880 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa943be-864a-4ac9-908b-bcb25f17ac98 service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:18:23.490524 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa943be-864a-4ac9-908b-bcb25f17ac98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:18:23.506173 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa943be-864a-4ac9-908b-bcb25f17ac98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:18:23.508402 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa943be-864a-4ac9-908b-bcb25f17ac98 service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:18:23.523514 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1605/3183] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:18:23 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:18:29.347594 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f7ef32-43a3-4df8-8f3f-88b0cbaacd20 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:18:29.348138 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f7ef32-43a3-4df8-8f3f-88b0cbaacd20 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:18:29.353140 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f7ef32-43a3-4df8-8f3f-88b0cbaacd20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:18:29.382334 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-b9f7ef32-43a3-4df8-8f3f-88b0cbaacd20 None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:18:29.385520 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b9f7ef32-43a3-4df8-8f3f-88b0cbaacd20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:18:29.466463 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1579/3184] 10.222.0.52 () {58 vars in 1009 bytes} [Sat May 14 21:18:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:18:29.480547 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa943be-864a-4ac9-908b-bcb25f17ac98 service nova] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:18:29.484190 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-daa943be-864a-4ac9-908b-bcb25f17ac98 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:18:29.593801 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa943be-864a-4ac9-908b-bcb25f17ac98 service nova] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:18:29.605042 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f26594-13bd-4171-a911-2265a748b23c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:18:29.614385 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f26594-13bd-4171-a911-2265a748b23c service swift] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:18:29.615101 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f26594-13bd-4171-a911-2265a748b23c service swift] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:18:29.615101 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f26594-13bd-4171-a911-2265a748b23c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:18:29.625899 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f26594-13bd-4171-a911-2265a748b23c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:18:29.627552 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f26594-13bd-4171-a911-2265a748b23c service swift] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:18:29.638264 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1606/3185] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 21:18:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 21:18:30.438287 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f7ef32-43a3-4df8-8f3f-88b0cbaacd20 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:18:30.466379 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f7ef32-43a3-4df8-8f3f-88b0cbaacd20 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:18:30.502532 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7d043c-cdec-4119-9a01-80ceed25976f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:18:30.508546 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d043c-cdec-4119-9a01-80ceed25976f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:18:30.508546 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d043c-cdec-4119-9a01-80ceed25976f admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:18:30.508546 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d043c-cdec-4119-9a01-80ceed25976f admin admin] PATH_INFO: `/v3/users/2f9db469c467477abf9f9f25bafaaf11` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:18:30.517157 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7d043c-cdec-4119-9a01-80ceed25976f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f9db469c467477abf9f9f25bafaaf11)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:18:30.525270 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7d043c-cdec-4119-9a01-80ceed25976f admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:18:30.666150 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0481c9f-5fda-4591-817d-af6d04bf0b43 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:18:30.666150 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0481c9f-5fda-4591-817d-af6d04bf0b43 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:18:30.666150 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0481c9f-5fda-4591-817d-af6d04bf0b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:18:30.711372 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-c0481c9f-5fda-4591-817d-af6d04bf0b43 None None] MFA Rules not processed for user `8bb480362ced445da9819798a17819c3`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:18:30.715432 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c0481c9f-5fda-4591-817d-af6d04bf0b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:18:30.825273 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1607/3186] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:18:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:18:30.852417 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dd7d043c-cdec-4119-9a01-80ceed25976f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f9db469c467477abf9f9f25bafaaf11'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:18:30.868925 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dd7d043c-cdec-4119-9a01-80ceed25976f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f9db469c467477abf9f9f25bafaaf11'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:18:30.876704 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dd7d043c-cdec-4119-9a01-80ceed25976f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f9db469c467477abf9f9f25bafaaf11'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:18:30.994798 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dd7d043c-cdec-4119-9a01-80ceed25976f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f9db469c467477abf9f9f25bafaaf11'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:18:31.023557 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dd7d043c-cdec-4119-9a01-80ceed25976f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f9db469c467477abf9f9f25bafaaf11'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:18:31.034808 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1580/3187] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:18:30 2022] DELETE /identity/v3/users/2f9db469c467477abf9f9f25bafaaf11 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:18:31.444878 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0481c9f-5fda-4591-817d-af6d04bf0b43 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:18:31.475195 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0481c9f-5fda-4591-817d-af6d04bf0b43 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:18:31.590880 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d52ad9-2732-440d-b46a-f6295574b5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:18:31.592792 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d52ad9-2732-440d-b46a-f6295574b5fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:18:31.593280 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d52ad9-2732-440d-b46a-f6295574b5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:18:31.594236 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d52ad9-2732-440d-b46a-f6295574b5fd admin admin] PATH_INFO: `/v3/projects/811e6ec5009a4bc09493edbdac6ee64b` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:18:31.595838 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d52ad9-2732-440d-b46a-f6295574b5fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=811e6ec5009a4bc09493edbdac6ee64b)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:18:31.598643 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d52ad9-2732-440d-b46a-f6295574b5fd admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:18:31.804942 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-25d52ad9-2732-440d-b46a-f6295574b5fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '811e6ec5009a4bc09493edbdac6ee64b', 'request_id': 'req-25d52ad9-2732-440d-b46a-f6295574b5fd'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:18:31.819873 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-25d52ad9-2732-440d-b46a-f6295574b5fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '811e6ec5009a4bc09493edbdac6ee64b', 'request_id': 'req-25d52ad9-2732-440d-b46a-f6295574b5fd'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:18:31.929210 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-25d52ad9-2732-440d-b46a-f6295574b5fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '811e6ec5009a4bc09493edbdac6ee64b', 'request_id': 'req-25d52ad9-2732-440d-b46a-f6295574b5fd'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:18:31.948877 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-25d52ad9-2732-440d-b46a-f6295574b5fd admin admin] The token cache is being invalidate because project 811e6ec5009a4bc09493edbdac6ee64b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:18:31.952132 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-25d52ad9-2732-440d-b46a-f6295574b5fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:18:31.952132 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-25d52ad9-2732-440d-b46a-f6295574b5fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:18:31.952132 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1608/3188] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:18:31 2022] DELETE /identity/v3/projects/811e6ec5009a4bc09493edbdac6ee64b => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:18:31.957921 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d942d846-5008-4559-944a-88f345985f40 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:18:31.958470 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d942d846-5008-4559-944a-88f345985f40 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:18:31.958704 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d942d846-5008-4559-944a-88f345985f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:18:31.982011 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-d942d846-5008-4559-944a-88f345985f40 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:18:31.983235 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-d942d846-5008-4559-944a-88f345985f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:18:32.057897 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1581/3189] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:18:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:18:32.065756 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69228ac-a503-48b1-a5c2-5ba9e5ec8b4d None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:18:32.066051 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69228ac-a503-48b1-a5c2-5ba9e5ec8b4d None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:18:32.066339 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69228ac-a503-48b1-a5c2-5ba9e5ec8b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:18:32.088970 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-e69228ac-a503-48b1-a5c2-5ba9e5ec8b4d None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:18:32.091218 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e69228ac-a503-48b1-a5c2-5ba9e5ec8b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:18:32.103304 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1609/3190] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:18:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:18:32.104427 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d942d846-5008-4559-944a-88f345985f40 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:18:32.120251 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d942d846-5008-4559-944a-88f345985f40 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:18:32.125941 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a8ca2-83db-43f8-8fdc-5ba3c883f234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:18:32.127205 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a8ca2-83db-43f8-8fdc-5ba3c883f234 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:18:32.127596 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a8ca2-83db-43f8-8fdc-5ba3c883f234 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:18:32.127976 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a8ca2-83db-43f8-8fdc-5ba3c883f234 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:18:32.128940 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475a8ca2-83db-43f8-8fdc-5ba3c883f234 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:18:32.129323 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475a8ca2-83db-43f8-8fdc-5ba3c883f234 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:18:32.133190 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475a8ca2-83db-43f8-8fdc-5ba3c883f234 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:18:32.157991 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69228ac-a503-48b1-a5c2-5ba9e5ec8b4d None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:18:32.158151 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1582/3191] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:18:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:18:32.170331 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69228ac-a503-48b1-a5c2-5ba9e5ec8b4d None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:18:32.191351 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce84a080-cfe0-4ce1-83df-cf5368ee4e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:18:32.192206 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce84a080-cfe0-4ce1-83df-cf5368ee4e17 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:18:32.193644 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce84a080-cfe0-4ce1-83df-cf5368ee4e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:18:32.194143 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce84a080-cfe0-4ce1-83df-cf5368ee4e17 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:18:32.195091 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce84a080-cfe0-4ce1-83df-cf5368ee4e17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:18:32.197340 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce84a080-cfe0-4ce1-83df-cf5368ee4e17 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:18:32.296670 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1610/3192] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:18:32 2022] POST /identity/v3/projects => generated 387 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:18:32.300547 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a8ca2-83db-43f8-8fdc-5ba3c883f234 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:18:32.325525 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a8ca2-83db-43f8-8fdc-5ba3c883f234 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:18:32.452022 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b9cccb-a1f6-4c8d-9235-47c5e6998f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:18:32.452703 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b9cccb-a1f6-4c8d-9235-47c5e6998f02 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:18:32.452990 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b9cccb-a1f6-4c8d-9235-47c5e6998f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:18:32.453268 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b9cccb-a1f6-4c8d-9235-47c5e6998f02 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:18:32.453960 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b9cccb-a1f6-4c8d-9235-47c5e6998f02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:18:32.456521 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b9cccb-a1f6-4c8d-9235-47c5e6998f02 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:18:32.575122 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1583/3193] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:18:32 2022] POST /identity/v3/users => generated 294 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:18:32.576901 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce84a080-cfe0-4ce1-83df-cf5368ee4e17 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:18:32.590604 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce84a080-cfe0-4ce1-83df-cf5368ee4e17 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:18:32.605044 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6d3dba-9abd-411f-b018-623bc5b0369f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:18:32.605044 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d3dba-9abd-411f-b018-623bc5b0369f admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:18:32.605044 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d3dba-9abd-411f-b018-623bc5b0369f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:18:32.605044 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d3dba-9abd-411f-b018-623bc5b0369f admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:18:32.605513 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6d3dba-9abd-411f-b018-623bc5b0369f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:18:32.605513 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6d3dba-9abd-411f-b018-623bc5b0369f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:18:32.620175 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1611/3194] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:18:32 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:18:32.625016 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b9cccb-a1f6-4c8d-9235-47c5e6998f02 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:18:32.641818 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b9cccb-a1f6-4c8d-9235-47c5e6998f02 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:18:32.648438 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2715536-7244-4127-8b4a-c5c216b79819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:18:32.649193 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2715536-7244-4127-8b4a-c5c216b79819 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:18:32.649556 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2715536-7244-4127-8b4a-c5c216b79819 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:18:32.650636 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2715536-7244-4127-8b4a-c5c216b79819 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:18:32.650636 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2715536-7244-4127-8b4a-c5c216b79819 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:18:32.654310 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2715536-7244-4127-8b4a-c5c216b79819 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:18:32.670049 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1584/3195] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:18:32 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:18:32.672292 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6d3dba-9abd-411f-b018-623bc5b0369f admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:18:32.690251 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6d3dba-9abd-411f-b018-623bc5b0369f admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:18:32.697741 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a1d986-65d7-4fec-ab67-77d1145f56c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:18:32.699692 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1d986-65d7-4fec-ab67-77d1145f56c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:18:32.703733 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1d986-65d7-4fec-ab67-77d1145f56c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:18:32.703733 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1d986-65d7-4fec-ab67-77d1145f56c2 admin admin] PATH_INFO: `/v3/projects/53796174427e4e69b8d21e0b25f709d7/users/9193be6fcfa44aaab04681ac9bb91fe7/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:18:32.725878 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a1d986-65d7-4fec-ab67-77d1145f56c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53796174427e4e69b8d21e0b25f709d7, user_id=9193be6fcfa44aaab04681ac9bb91fe7, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:18:32.728628 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a1d986-65d7-4fec-ab67-77d1145f56c2 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:18:32.828990 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1612/3196] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:18:32 2022] PUT /identity/v3/projects/53796174427e4e69b8d21e0b25f709d7/users/9193be6fcfa44aaab04681ac9bb91fe7/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:18:32.830400 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e40e0d-6138-4b15-a477-7c828a85e33a None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:18:32.830722 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e40e0d-6138-4b15-a477-7c828a85e33a None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:18:32.831634 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e40e0d-6138-4b15-a477-7c828a85e33a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:18:32.856632 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-b1e40e0d-6138-4b15-a477-7c828a85e33a None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:18:32.857858 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b1e40e0d-6138-4b15-a477-7c828a85e33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:18:32.985264 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1585/3197] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:18:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:18:32.999191 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a1d986-65d7-4fec-ab67-77d1145f56c2 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:18:33.002100 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-54a1d986-65d7-4fec-ab67-77d1145f56c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:18:33.077910 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a1d986-65d7-4fec-ab67-77d1145f56c2 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:18:33.082429 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ee156b-7f77-4fba-85f9-a1a737816702 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:18:33.083093 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee156b-7f77-4fba-85f9-a1a737816702 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:18:33.083957 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee156b-7f77-4fba-85f9-a1a737816702 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:18:33.084452 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee156b-7f77-4fba-85f9-a1a737816702 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:18:33.112795 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ee156b-7f77-4fba-85f9-a1a737816702 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:18:33.114497 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ee156b-7f77-4fba-85f9-a1a737816702 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:18:33.130285 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1613/3198] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:18:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:18:37.078564 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23813db0-211d-4ff7-8039-7e8e57f334c0 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:18:37.079027 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23813db0-211d-4ff7-8039-7e8e57f334c0 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:18:37.079117 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23813db0-211d-4ff7-8039-7e8e57f334c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:18:37.103945 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-23813db0-211d-4ff7-8039-7e8e57f334c0 None None] MFA Rules not processed for user `154d05e107d74202beabaa0b60dab8c8`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:18:37.105561 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-23813db0-211d-4ff7-8039-7e8e57f334c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:18:37.212831 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1586/3199] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:18:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:18:37.966121 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ee156b-7f77-4fba-85f9-a1a737816702 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:18:37.966121 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-02ee156b-7f77-4fba-85f9-a1a737816702 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:18:37.986142 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ee156b-7f77-4fba-85f9-a1a737816702 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:18:38.000516 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54a995e-ff29-4526-a0d5-d13cc9d2660d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:18:38.001399 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a995e-ff29-4526-a0d5-d13cc9d2660d service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:18:38.001745 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a995e-ff29-4526-a0d5-d13cc9d2660d service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:18:38.002097 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a995e-ff29-4526-a0d5-d13cc9d2660d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:18:38.005038 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b54a995e-ff29-4526-a0d5-d13cc9d2660d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:18:38.025019 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54a995e-ff29-4526-a0d5-d13cc9d2660d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:18:38.029594 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54a995e-ff29-4526-a0d5-d13cc9d2660d service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:18:38.067732 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1614/3200] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:18:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:18:44.965796 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23813db0-211d-4ff7-8039-7e8e57f334c0 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:18:44.982853 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23813db0-211d-4ff7-8039-7e8e57f334c0 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:18:45.007176 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4f7238-42f4-4e39-ad81-c52ee1c9835e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:18:45.008405 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f7238-42f4-4e39-ad81-c52ee1c9835e service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:18:45.009424 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f7238-42f4-4e39-ad81-c52ee1c9835e service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:18:45.016351 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f7238-42f4-4e39-ad81-c52ee1c9835e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:18:45.021791 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-9a4f7238-42f4-4e39-ad81-c52ee1c9835e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:18:45.210555 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4f7238-42f4-4e39-ad81-c52ee1c9835e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:18:45.212693 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4f7238-42f4-4e39-ad81-c52ee1c9835e service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:18:45.228417 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1587/3201] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:18:44 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:18:47.874863 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e65e49-75d8-4588-a573-e6f6502d1bae None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:18:47.875388 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e65e49-75d8-4588-a573-e6f6502d1bae None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:18:47.876712 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e65e49-75d8-4588-a573-e6f6502d1bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:18:47.944531 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-b7e65e49-75d8-4588-a573-e6f6502d1bae None None] MFA Rules not processed for user `9193be6fcfa44aaab04681ac9bb91fe7`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:18:47.946533 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b7e65e49-75d8-4588-a573-e6f6502d1bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:18:48.130042 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1615/3202] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:18:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:18:49.453598 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4f7238-42f4-4e39-ad81-c52ee1c9835e service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:18:49.455906 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-9a4f7238-42f4-4e39-ad81-c52ee1c9835e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:18:49.803715 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4f7238-42f4-4e39-ad81-c52ee1c9835e service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:18:49.813235 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01dd7a4-c0c5-4156-939a-4f236fafcd86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:18:49.814335 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01dd7a4-c0c5-4156-939a-4f236fafcd86 service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:18:49.815421 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01dd7a4-c0c5-4156-939a-4f236fafcd86 service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:18:49.816170 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01dd7a4-c0c5-4156-939a-4f236fafcd86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:18:49.835438 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01dd7a4-c0c5-4156-939a-4f236fafcd86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:18:49.835438 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01dd7a4-c0c5-4156-939a-4f236fafcd86 service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:18:49.907366 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1588/3203] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:18:49 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:18:59.145849 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e44b56-d770-44f9-a919-0c985d62d14b None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:18:59.146408 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e44b56-d770-44f9-a919-0c985d62d14b None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:18:59.146408 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e44b56-d770-44f9-a919-0c985d62d14b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:18:59.166052 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-e8e44b56-d770-44f9-a919-0c985d62d14b None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:18:59.167707 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e8e44b56-d770-44f9-a919-0c985d62d14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:18:59.239651 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1616/3204] 10.222.0.52 () {58 vars in 1009 bytes} [Sat May 14 21:18:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:18:59.254697 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01dd7a4-c0c5-4156-939a-4f236fafcd86 service nova] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:18:59.256589 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-d01dd7a4-c0c5-4156-939a-4f236fafcd86 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:18:59.361693 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01dd7a4-c0c5-4156-939a-4f236fafcd86 service nova] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:18:59.368760 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eddd1c-85b5-4a52-a07c-3fca18815a6f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:18:59.369915 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eddd1c-85b5-4a52-a07c-3fca18815a6f service swift] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:18:59.370641 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eddd1c-85b5-4a52-a07c-3fca18815a6f service swift] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:18:59.371121 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eddd1c-85b5-4a52-a07c-3fca18815a6f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:18:59.390061 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eddd1c-85b5-4a52-a07c-3fca18815a6f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:18:59.392010 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eddd1c-85b5-4a52-a07c-3fca18815a6f service swift] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:18:59.405064 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1589/3205] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 21:18:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 21:19:08.944866 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e44b56-d770-44f9-a919-0c985d62d14b None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:08.946577 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e8e44b56-d770-44f9-a919-0c985d62d14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:19:08.972052 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e44b56-d770-44f9-a919-0c985d62d14b None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:08.983919 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f6daff-28da-4f17-95bc-2187494714f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:08.985138 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f6daff-28da-4f17-95bc-2187494714f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:08.985682 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f6daff-28da-4f17-95bc-2187494714f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:08.986224 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f6daff-28da-4f17-95bc-2187494714f7 admin admin] PATH_INFO: `/v3/users/6ae75ac4b3ed44eda1e8717ff641cd0c` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:08.990920 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f6daff-28da-4f17-95bc-2187494714f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ae75ac4b3ed44eda1e8717ff641cd0c)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:08.993546 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f6daff-28da-4f17-95bc-2187494714f7 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:09.267082 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-60f6daff-28da-4f17-95bc-2187494714f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ae75ac4b3ed44eda1e8717ff641cd0c'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:09.335255 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-60f6daff-28da-4f17-95bc-2187494714f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ae75ac4b3ed44eda1e8717ff641cd0c'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:09.353078 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-60f6daff-28da-4f17-95bc-2187494714f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ae75ac4b3ed44eda1e8717ff641cd0c'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:09.523690 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-60f6daff-28da-4f17-95bc-2187494714f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ae75ac4b3ed44eda1e8717ff641cd0c'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:09.524351 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-60f6daff-28da-4f17-95bc-2187494714f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ae75ac4b3ed44eda1e8717ff641cd0c'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:09.537846 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1617/3206] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:19:08 2022] DELETE /identity/v3/users/6ae75ac4b3ed44eda1e8717ff641cd0c => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:19:09.999431 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eddd1c-85b5-4a52-a07c-3fca18815a6f service swift] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:10.013576 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eddd1c-85b5-4a52-a07c-3fca18815a6f service swift] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:10.077454 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884d0aac-6176-459b-a22f-7c90ca0f26dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:10.078126 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d0aac-6176-459b-a22f-7c90ca0f26dd service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:10.078564 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d0aac-6176-459b-a22f-7c90ca0f26dd service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:10.078851 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d0aac-6176-459b-a22f-7c90ca0f26dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:10.080766 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-884d0aac-6176-459b-a22f-7c90ca0f26dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:19:10.165079 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884d0aac-6176-459b-a22f-7c90ca0f26dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:10.166718 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884d0aac-6176-459b-a22f-7c90ca0f26dd service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:10.180337 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1590/3207] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:19:09 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:19:10.409602 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f6daff-28da-4f17-95bc-2187494714f7 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:10.411856 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-60f6daff-28da-4f17-95bc-2187494714f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:19:10.612729 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f6daff-28da-4f17-95bc-2187494714f7 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:10.619645 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93550a19-2b66-4bdb-8212-b89806c91b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:10.620465 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93550a19-2b66-4bdb-8212-b89806c91b80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:10.620744 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93550a19-2b66-4bdb-8212-b89806c91b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:10.621019 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93550a19-2b66-4bdb-8212-b89806c91b80 admin admin] PATH_INFO: `/v3/projects/9197ea49e7544e7c96dd2d4b1a55fa29` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:10.622206 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93550a19-2b66-4bdb-8212-b89806c91b80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9197ea49e7544e7c96dd2d4b1a55fa29)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:10.624639 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93550a19-2b66-4bdb-8212-b89806c91b80 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:10.794113 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-93550a19-2b66-4bdb-8212-b89806c91b80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9197ea49e7544e7c96dd2d4b1a55fa29', 'request_id': 'req-93550a19-2b66-4bdb-8212-b89806c91b80'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:10.803634 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-93550a19-2b66-4bdb-8212-b89806c91b80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9197ea49e7544e7c96dd2d4b1a55fa29', 'request_id': 'req-93550a19-2b66-4bdb-8212-b89806c91b80'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:10.884088 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-93550a19-2b66-4bdb-8212-b89806c91b80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9197ea49e7544e7c96dd2d4b1a55fa29', 'request_id': 'req-93550a19-2b66-4bdb-8212-b89806c91b80'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:10.922533 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-93550a19-2b66-4bdb-8212-b89806c91b80 admin admin] The token cache is being invalidate because project 9197ea49e7544e7c96dd2d4b1a55fa29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:19:10.924465 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-93550a19-2b66-4bdb-8212-b89806c91b80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:10.927486 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-93550a19-2b66-4bdb-8212-b89806c91b80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:10.936384 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1618/3208] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:19:10 2022] DELETE /identity/v3/projects/9197ea49e7544e7c96dd2d4b1a55fa29 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:19:10.942845 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c87e2-2fb4-46ce-a578-50d94be6ebde None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:10.943185 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c87e2-2fb4-46ce-a578-50d94be6ebde None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:10.943522 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c87e2-2fb4-46ce-a578-50d94be6ebde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:10.973831 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-c18c87e2-2fb4-46ce-a578-50d94be6ebde None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:19:10.975065 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c18c87e2-2fb4-46ce-a578-50d94be6ebde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:19:11.144132 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1591/3209] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:19:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:19:11.149633 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039bdc8-9966-4f84-a893-a9c50846fd36 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:11.149927 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039bdc8-9966-4f84-a893-a9c50846fd36 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:11.150211 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039bdc8-9966-4f84-a893-a9c50846fd36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:11.182889 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-6039bdc8-9966-4f84-a893-a9c50846fd36 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:19:11.184417 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-6039bdc8-9966-4f84-a893-a9c50846fd36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:19:11.199332 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18c87e2-2fb4-46ce-a578-50d94be6ebde None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:11.200771 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1619/3210] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:19:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:19:11.217172 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18c87e2-2fb4-46ce-a578-50d94be6ebde None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:11.224165 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d0b18c-b2ac-41df-a52f-708c41b42249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:11.225119 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0b18c-b2ac-41df-a52f-708c41b42249 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:11.226244 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0b18c-b2ac-41df-a52f-708c41b42249 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:11.226727 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0b18c-b2ac-41df-a52f-708c41b42249 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:11.227604 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d0b18c-b2ac-41df-a52f-708c41b42249 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:19:11.228771 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d0b18c-b2ac-41df-a52f-708c41b42249 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:11.236081 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d0b18c-b2ac-41df-a52f-708c41b42249 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:11.276489 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6039bdc8-9966-4f84-a893-a9c50846fd36 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:11.295501 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1592/3211] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:19:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:19:11.301260 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6039bdc8-9966-4f84-a893-a9c50846fd36 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:11.306666 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e7194-5ae3-4d38-8081-18ed25ab13bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:11.308016 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e7194-5ae3-4d38-8081-18ed25ab13bf admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:11.308365 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e7194-5ae3-4d38-8081-18ed25ab13bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:11.308797 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e7194-5ae3-4d38-8081-18ed25ab13bf admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:11.309903 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63e7194-5ae3-4d38-8081-18ed25ab13bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:11.312264 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63e7194-5ae3-4d38-8081-18ed25ab13bf admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:11.472526 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d0b18c-b2ac-41df-a52f-708c41b42249 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:11.485410 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1620/3212] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:19:11 2022] POST /identity/v3/projects => generated 379 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:19:11.487130 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d0b18c-b2ac-41df-a52f-708c41b42249 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:11.586096 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b596ec3f-1a71-4a2b-b47b-1e7463a348f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:11.588330 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b596ec3f-1a71-4a2b-b47b-1e7463a348f2 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:11.588672 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b596ec3f-1a71-4a2b-b47b-1e7463a348f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:11.593655 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b596ec3f-1a71-4a2b-b47b-1e7463a348f2 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:11.593655 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b596ec3f-1a71-4a2b-b47b-1e7463a348f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:11.595659 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b596ec3f-1a71-4a2b-b47b-1e7463a348f2 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:11.736063 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1593/3213] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:19:11 2022] POST /identity/v3/users => generated 290 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:19:11.742399 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e7194-5ae3-4d38-8081-18ed25ab13bf admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:11.758256 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e7194-5ae3-4d38-8081-18ed25ab13bf admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:11.764280 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866eb3e0-30de-4aab-a2f6-0c4f9f85176f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:11.765126 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866eb3e0-30de-4aab-a2f6-0c4f9f85176f admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:11.765531 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866eb3e0-30de-4aab-a2f6-0c4f9f85176f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:11.765905 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866eb3e0-30de-4aab-a2f6-0c4f9f85176f admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:11.766777 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866eb3e0-30de-4aab-a2f6-0c4f9f85176f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:11.770630 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866eb3e0-30de-4aab-a2f6-0c4f9f85176f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:11.797550 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b596ec3f-1a71-4a2b-b47b-1e7463a348f2 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:11.798110 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1621/3214] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:19:11 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:19:11.818349 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b596ec3f-1a71-4a2b-b47b-1e7463a348f2 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:11.824078 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00693007-db10-454c-aae0-62163aeb8e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:11.825069 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00693007-db10-454c-aae0-62163aeb8e22 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:11.825543 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00693007-db10-454c-aae0-62163aeb8e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:11.828328 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00693007-db10-454c-aae0-62163aeb8e22 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:11.829281 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00693007-db10-454c-aae0-62163aeb8e22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:11.831021 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00693007-db10-454c-aae0-62163aeb8e22 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:11.869091 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1594/3215] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:19:11 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:19:11.873275 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866eb3e0-30de-4aab-a2f6-0c4f9f85176f admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:11.889041 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866eb3e0-30de-4aab-a2f6-0c4f9f85176f admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:11.904107 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec296ec-a24c-47a7-9306-bc01e5c1dfbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:11.905036 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec296ec-a24c-47a7-9306-bc01e5c1dfbb admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:11.905322 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec296ec-a24c-47a7-9306-bc01e5c1dfbb admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:11.905603 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec296ec-a24c-47a7-9306-bc01e5c1dfbb admin admin] PATH_INFO: `/v3/projects/b031454047774b4fb8b459f226f645d2/users/71080496c33c4e2c8b2e16b950f0b9ea/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:11.946374 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec296ec-a24c-47a7-9306-bc01e5c1dfbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b031454047774b4fb8b459f226f645d2, user_id=71080496c33c4e2c8b2e16b950f0b9ea, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:11.949477 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec296ec-a24c-47a7-9306-bc01e5c1dfbb admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:12.116146 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1622/3216] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:19:11 2022] PUT /identity/v3/projects/b031454047774b4fb8b459f226f645d2/users/71080496c33c4e2c8b2e16b950f0b9ea/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:19:12.121171 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a71a05-80b2-40b6-80de-5377df4a9362 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:12.121470 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a71a05-80b2-40b6-80de-5377df4a9362 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:12.121778 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a71a05-80b2-40b6-80de-5377df4a9362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:12.145671 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-e3a71a05-80b2-40b6-80de-5377df4a9362 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:19:12.148026 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e3a71a05-80b2-40b6-80de-5377df4a9362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:19:12.233843 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1595/3217] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:19:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:19:12.246111 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec296ec-a24c-47a7-9306-bc01e5c1dfbb admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:12.248172 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-8ec296ec-a24c-47a7-9306-bc01e5c1dfbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:19:12.355765 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec296ec-a24c-47a7-9306-bc01e5c1dfbb admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:12.363523 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fdf3f1-a57c-4fd1-9293-631574d8ff88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:12.364108 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fdf3f1-a57c-4fd1-9293-631574d8ff88 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:12.364397 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fdf3f1-a57c-4fd1-9293-631574d8ff88 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:12.364678 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fdf3f1-a57c-4fd1-9293-631574d8ff88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:12.378793 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fdf3f1-a57c-4fd1-9293-631574d8ff88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:12.379408 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fdf3f1-a57c-4fd1-9293-631574d8ff88 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:12.399336 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1623/3218] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:19:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:19:13.019912 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d2d7bf-12fa-427a-9f2b-cc7dc064fd08 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:13.021017 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d2d7bf-12fa-427a-9f2b-cc7dc064fd08 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:13.021480 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d2d7bf-12fa-427a-9f2b-cc7dc064fd08 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:13.024124 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1596/3219] 10.222.0.52 () {54 vars in 921 bytes} [Sat May 14 21:19:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:19:13.038345 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20396e0-9d21-4ffb-8828-ca4e9f5697f0 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:13.038907 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20396e0-9d21-4ffb-8828-ca4e9f5697f0 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:13.039095 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20396e0-9d21-4ffb-8828-ca4e9f5697f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:13.115653 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-d20396e0-9d21-4ffb-8828-ca4e9f5697f0 None None] MFA Rules not processed for user `0812ae67e44d483baf2dbb1a5332a1d7`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:19:13.118197 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d20396e0-9d21-4ffb-8828-ca4e9f5697f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:19:13.268225 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1624/3220] 10.222.0.52 () {58 vars in 1018 bytes} [Sat May 14 21:19:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:19:13.294599 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d2d7bf-12fa-427a-9f2b-cc7dc064fd08 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:13.297615 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-19d2d7bf-12fa-427a-9f2b-cc7dc064fd08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:19:13.325797 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d2d7bf-12fa-427a-9f2b-cc7dc064fd08 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:13.332318 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9dc826-57a7-4745-8337-a69b16126fb3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:13.334824 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9dc826-57a7-4745-8337-a69b16126fb3 service placement] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:13.334824 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9dc826-57a7-4745-8337-a69b16126fb3 service placement] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:13.334824 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9dc826-57a7-4745-8337-a69b16126fb3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:13.343987 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9dc826-57a7-4745-8337-a69b16126fb3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:13.345966 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9dc826-57a7-4745-8337-a69b16126fb3 service placement] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:13.389081 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1597/3221] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:19:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:19:13.799303 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20396e0-9d21-4ffb-8828-ca4e9f5697f0 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:13.801454 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d20396e0-9d21-4ffb-8828-ca4e9f5697f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:19:13.840527 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20396e0-9d21-4ffb-8828-ca4e9f5697f0 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:13.849054 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5affbdc-79cd-425e-a16d-cbba21ef692c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:13.850223 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5affbdc-79cd-425e-a16d-cbba21ef692c service placement] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:13.850785 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5affbdc-79cd-425e-a16d-cbba21ef692c service placement] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:13.851317 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5affbdc-79cd-425e-a16d-cbba21ef692c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:13.853478 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-f5affbdc-79cd-425e-a16d-cbba21ef692c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:19:13.879873 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5affbdc-79cd-425e-a16d-cbba21ef692c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:13.881601 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5affbdc-79cd-425e-a16d-cbba21ef692c service placement] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:13.897094 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1625/3222] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:19:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:19:14.380064 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ad0b2-a6be-4061-98e0-928527cc148f None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:14.381062 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ad0b2-a6be-4061-98e0-928527cc148f None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:14.381554 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ad0b2-a6be-4061-98e0-928527cc148f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:14.421287 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-c11ad0b2-a6be-4061-98e0-928527cc148f None None] MFA Rules not processed for user `71080496c33c4e2c8b2e16b950f0b9ea`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:19:14.422526 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c11ad0b2-a6be-4061-98e0-928527cc148f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:19:14.553597 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1598/3223] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:19:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:19:14.564012 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71740e3-daff-47b7-91ea-15fa73e62aed None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:14.565130 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71740e3-daff-47b7-91ea-15fa73e62aed None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:14.565671 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71740e3-daff-47b7-91ea-15fa73e62aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:14.596944 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-f71740e3-daff-47b7-91ea-15fa73e62aed None None] MFA Rules not processed for user `71080496c33c4e2c8b2e16b950f0b9ea`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:19:14.598613 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-f71740e3-daff-47b7-91ea-15fa73e62aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:19:14.615530 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1626/3224] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:19:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:19:15.329076 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11ad0b2-a6be-4061-98e0-928527cc148f None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:15.339946 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11ad0b2-a6be-4061-98e0-928527cc148f None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:15.343614 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba20f6-1b19-4411-85e0-ff6742241f27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:15.344207 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba20f6-1b19-4411-85e0-ff6742241f27 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:15.344490 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba20f6-1b19-4411-85e0-ff6742241f27 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:15.344766 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba20f6-1b19-4411-85e0-ff6742241f27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:15.346604 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-10ba20f6-1b19-4411-85e0-ff6742241f27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:19:15.437401 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ba20f6-1b19-4411-85e0-ff6742241f27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:15.439903 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ba20f6-1b19-4411-85e0-ff6742241f27 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:15.467709 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1599/3225] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:19:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:19:15.482570 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71740e3-daff-47b7-91ea-15fa73e62aed None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:15.497125 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71740e3-daff-47b7-91ea-15fa73e62aed None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:15.501009 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ef49a-df86-46fa-9fc6-fb454eda517f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:15.501942 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ef49a-df86-46fa-9fc6-fb454eda517f service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:15.502317 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ef49a-df86-46fa-9fc6-fb454eda517f service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:15.502702 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ef49a-df86-46fa-9fc6-fb454eda517f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:15.504890 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-cb8ef49a-df86-46fa-9fc6-fb454eda517f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:19:15.520606 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8ef49a-df86-46fa-9fc6-fb454eda517f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:15.522175 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8ef49a-df86-46fa-9fc6-fb454eda517f service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:15.547234 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1627/3226] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:19:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:19:16.371025 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba20f6-1b19-4411-85e0-ff6742241f27 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:16.372787 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-10ba20f6-1b19-4411-85e0-ff6742241f27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:19:16.397066 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba20f6-1b19-4411-85e0-ff6742241f27 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:16.406822 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e1e83-b191-4a80-91b6-81012a410415 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:16.407540 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e1e83-b191-4a80-91b6-81012a410415 service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:16.407825 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e1e83-b191-4a80-91b6-81012a410415 service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:16.408099 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e1e83-b191-4a80-91b6-81012a410415 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:16.419756 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6e1e83-b191-4a80-91b6-81012a410415 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:16.421626 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6e1e83-b191-4a80-91b6-81012a410415 service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:16.431960 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1600/3227] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:19:16 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:19:17.403252 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ae829-a7b7-4db8-ac9a-15e50bbb899c None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:17.403784 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ae829-a7b7-4db8-ac9a-15e50bbb899c None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:17.403925 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ae829-a7b7-4db8-ac9a-15e50bbb899c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:17.429368 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-6d9ae829-a7b7-4db8-ac9a-15e50bbb899c None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:19:17.430878 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-6d9ae829-a7b7-4db8-ac9a-15e50bbb899c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:19:17.515383 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1628/3228] 10.222.0.52 () {58 vars in 967 bytes} [Sat May 14 21:19:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:19:17.544787 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e1e83-b191-4a80-91b6-81012a410415 service nova] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:17.547039 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-1f6e1e83-b191-4a80-91b6-81012a410415 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:19:17.657442 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e1e83-b191-4a80-91b6-81012a410415 service nova] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:17.671040 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94651e94-4180-4769-a193-6f359e682b0e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:17.671748 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94651e94-4180-4769-a193-6f359e682b0e service swift] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:17.686493 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94651e94-4180-4769-a193-6f359e682b0e service swift] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:17.687255 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94651e94-4180-4769-a193-6f359e682b0e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:17.703060 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94651e94-4180-4769-a193-6f359e682b0e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:17.705393 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94651e94-4180-4769-a193-6f359e682b0e service swift] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:17.728901 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1601/3229] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 21:19:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 21:19:18.585981 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6514bb-857f-4f72-b3ba-f08707f4211f None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:18.586483 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6514bb-857f-4f72-b3ba-f08707f4211f None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:18.586664 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6514bb-857f-4f72-b3ba-f08707f4211f None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:18.588659 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1629/3230] 10.222.0.52 () {54 vars in 921 bytes} [Sat May 14 21:19:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:19:18.594777 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba7926-d6b7-4b22-9cea-77e9286751c1 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:18.595902 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba7926-d6b7-4b22-9cea-77e9286751c1 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:18.596358 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba7926-d6b7-4b22-9cea-77e9286751c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:18.616436 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-b5ba7926-d6b7-4b22-9cea-77e9286751c1 None None] MFA Rules not processed for user `0812ae67e44d483baf2dbb1a5332a1d7`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:19:18.617928 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b5ba7926-d6b7-4b22-9cea-77e9286751c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:19:18.627351 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1602/3231] 10.222.0.52 () {58 vars in 1018 bytes} [Sat May 14 21:19:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:19:18.653448 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6514bb-857f-4f72-b3ba-f08707f4211f None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:18.669463 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6514bb-857f-4f72-b3ba-f08707f4211f None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:18.688053 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07863432-2b30-40d2-9650-7c18edd3d343 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:18.689018 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07863432-2b30-40d2-9650-7c18edd3d343 service placement] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:18.689464 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07863432-2b30-40d2-9650-7c18edd3d343 service placement] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:18.690015 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07863432-2b30-40d2-9650-7c18edd3d343 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:18.722382 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07863432-2b30-40d2-9650-7c18edd3d343 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:18.725507 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07863432-2b30-40d2-9650-7c18edd3d343 service placement] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:18.740376 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1630/3232] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:19:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:19:19.543132 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba7926-d6b7-4b22-9cea-77e9286751c1 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:19.560506 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba7926-d6b7-4b22-9cea-77e9286751c1 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:19.569148 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea57f8a-f55c-4535-8434-499407ccff58 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:19.570491 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea57f8a-f55c-4535-8434-499407ccff58 service placement] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:19.570491 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea57f8a-f55c-4535-8434-499407ccff58 service placement] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:19.571014 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea57f8a-f55c-4535-8434-499407ccff58 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:19.573820 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-7ea57f8a-f55c-4535-8434-499407ccff58 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:19:19.588219 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea57f8a-f55c-4535-8434-499407ccff58 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:19.590387 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea57f8a-f55c-4535-8434-499407ccff58 service placement] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:19.615015 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1603/3233] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:19:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:19:20.331072 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07863432-2b30-40d2-9650-7c18edd3d343 service placement] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:20.348214 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07863432-2b30-40d2-9650-7c18edd3d343 service placement] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:20.364259 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b587e8-aca2-426b-b2ad-2e4a9499a1ab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:20.364940 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b587e8-aca2-426b-b2ad-2e4a9499a1ab service placement] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:20.365438 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b587e8-aca2-426b-b2ad-2e4a9499a1ab service placement] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:20.365956 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b587e8-aca2-426b-b2ad-2e4a9499a1ab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:20.374755 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e7b587e8-aca2-426b-b2ad-2e4a9499a1ab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:19:20.406162 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b587e8-aca2-426b-b2ad-2e4a9499a1ab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:20.419190 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b587e8-aca2-426b-b2ad-2e4a9499a1ab service placement] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:20.437249 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1631/3234] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:19:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:19:20.636703 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621aea5-76c2-44d6-8ae2-8adb07c073e8 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:20.637588 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621aea5-76c2-44d6-8ae2-8adb07c073e8 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:20.638083 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621aea5-76c2-44d6-8ae2-8adb07c073e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:20.678604 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-2621aea5-76c2-44d6-8ae2-8adb07c073e8 None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:19:20.688995 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-2621aea5-76c2-44d6-8ae2-8adb07c073e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:19:20.717943 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1604/3235] 10.222.0.52 () {58 vars in 967 bytes} [Sat May 14 21:19:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:19:20.755987 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b587e8-aca2-426b-b2ad-2e4a9499a1ab service placement] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:20.765417 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b587e8-aca2-426b-b2ad-2e4a9499a1ab service placement] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:20.783297 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40382df5-4246-4803-8dcf-401e911f0804 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:20.786194 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40382df5-4246-4803-8dcf-401e911f0804 service swift] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:20.786671 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40382df5-4246-4803-8dcf-401e911f0804 service swift] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:20.787095 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40382df5-4246-4803-8dcf-401e911f0804 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:20.809707 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40382df5-4246-4803-8dcf-401e911f0804 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:20.819955 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40382df5-4246-4803-8dcf-401e911f0804 service swift] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:20.839968 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1632/3236] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 21:19:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 21:19:22.698139 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64a173-9b3c-4187-831a-7287e265bbba None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:22.699121 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64a173-9b3c-4187-831a-7287e265bbba None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:22.699653 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64a173-9b3c-4187-831a-7287e265bbba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:22.723265 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-6c64a173-9b3c-4187-831a-7287e265bbba None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:19:22.725569 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-6c64a173-9b3c-4187-831a-7287e265bbba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:19:22.735181 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1605/3237] 10.222.0.52 () {58 vars in 967 bytes} [Sat May 14 21:19:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:19:22.749164 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40382df5-4246-4803-8dcf-401e911f0804 service swift] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:22.763195 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40382df5-4246-4803-8dcf-401e911f0804 service swift] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:22.770580 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3b738e-fdc4-47ef-a48f-647ad393df78 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:22.771338 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b738e-fdc4-47ef-a48f-647ad393df78 service swift] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:22.771729 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b738e-fdc4-47ef-a48f-647ad393df78 service swift] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:22.772095 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b738e-fdc4-47ef-a48f-647ad393df78 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:22.784729 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3b738e-fdc4-47ef-a48f-647ad393df78 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:22.791911 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3b738e-fdc4-47ef-a48f-647ad393df78 service swift] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:22.813568 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1633/3238] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 21:19:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 21:19:25.813433 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c64a173-9b3c-4187-831a-7287e265bbba None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:25.815821 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-6c64a173-9b3c-4187-831a-7287e265bbba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:19:25.861825 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c64a173-9b3c-4187-831a-7287e265bbba None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:25.893813 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b22756b-260a-4c20-957f-f23d9bcc1c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:25.896443 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b22756b-260a-4c20-957f-f23d9bcc1c01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:25.896849 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b22756b-260a-4c20-957f-f23d9bcc1c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:25.901060 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b22756b-260a-4c20-957f-f23d9bcc1c01 admin admin] PATH_INFO: `/v3/users/9193be6fcfa44aaab04681ac9bb91fe7` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:25.901060 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b22756b-260a-4c20-957f-f23d9bcc1c01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9193be6fcfa44aaab04681ac9bb91fe7)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:25.906096 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b22756b-260a-4c20-957f-f23d9bcc1c01 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:26.268337 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-8b22756b-260a-4c20-957f-f23d9bcc1c01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9193be6fcfa44aaab04681ac9bb91fe7'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:26.309515 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-8b22756b-260a-4c20-957f-f23d9bcc1c01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9193be6fcfa44aaab04681ac9bb91fe7'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:26.312201 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-8b22756b-260a-4c20-957f-f23d9bcc1c01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9193be6fcfa44aaab04681ac9bb91fe7'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:26.426874 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-8b22756b-260a-4c20-957f-f23d9bcc1c01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9193be6fcfa44aaab04681ac9bb91fe7'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:26.461438 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-8b22756b-260a-4c20-957f-f23d9bcc1c01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9193be6fcfa44aaab04681ac9bb91fe7'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:26.497001 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1606/3239] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:19:25 2022] DELETE /identity/v3/users/9193be6fcfa44aaab04681ac9bb91fe7 => generated 0 bytes in 685 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:19:27.383923 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3b738e-fdc4-47ef-a48f-647ad393df78 service swift] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:27.442850 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3b738e-fdc4-47ef-a48f-647ad393df78 service swift] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:27.627652 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fe03f4-7f48-4280-8a9b-400b42ffa5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:27.632960 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe03f4-7f48-4280-8a9b-400b42ffa5bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:27.635605 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe03f4-7f48-4280-8a9b-400b42ffa5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:27.636004 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe03f4-7f48-4280-8a9b-400b42ffa5bf admin admin] PATH_INFO: `/v3/projects/53796174427e4e69b8d21e0b25f709d7` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:27.641768 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fe03f4-7f48-4280-8a9b-400b42ffa5bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=53796174427e4e69b8d21e0b25f709d7)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:27.648440 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fe03f4-7f48-4280-8a9b-400b42ffa5bf admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:27.854427 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b0fe03f4-7f48-4280-8a9b-400b42ffa5bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53796174427e4e69b8d21e0b25f709d7', 'request_id': 'req-b0fe03f4-7f48-4280-8a9b-400b42ffa5bf'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:27.861961 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b0fe03f4-7f48-4280-8a9b-400b42ffa5bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53796174427e4e69b8d21e0b25f709d7', 'request_id': 'req-b0fe03f4-7f48-4280-8a9b-400b42ffa5bf'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:27.959944 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b0fe03f4-7f48-4280-8a9b-400b42ffa5bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53796174427e4e69b8d21e0b25f709d7', 'request_id': 'req-b0fe03f4-7f48-4280-8a9b-400b42ffa5bf'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:27.975641 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b0fe03f4-7f48-4280-8a9b-400b42ffa5bf admin admin] The token cache is being invalidate because project 53796174427e4e69b8d21e0b25f709d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:19:27.975928 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b0fe03f4-7f48-4280-8a9b-400b42ffa5bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:27.976870 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b0fe03f4-7f48-4280-8a9b-400b42ffa5bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:27.978804 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1634/3240] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:19:27 2022] DELETE /identity/v3/projects/53796174427e4e69b8d21e0b25f709d7 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:19:27.983789 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186bfd5-5436-4803-a614-c3923368df4a None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:27.987625 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186bfd5-5436-4803-a614-c3923368df4a None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:27.987625 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186bfd5-5436-4803-a614-c3923368df4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:28.005831 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-1186bfd5-5436-4803-a614-c3923368df4a None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:19:28.007409 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-1186bfd5-5436-4803-a614-c3923368df4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:19:28.088290 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1607/3241] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:19:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:19:28.096203 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c92b0b-9562-4562-8453-b2d2e41d79b0 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:28.096497 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c92b0b-9562-4562-8453-b2d2e41d79b0 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:28.097383 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c92b0b-9562-4562-8453-b2d2e41d79b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:28.118586 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-55c92b0b-9562-4562-8453-b2d2e41d79b0 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:19:28.120022 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-55c92b0b-9562-4562-8453-b2d2e41d79b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:19:28.139468 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1635/3242] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:19:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:19:28.141352 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186bfd5-5436-4803-a614-c3923368df4a None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:28.153823 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186bfd5-5436-4803-a614-c3923368df4a None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:28.171916 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59358101-db1e-4156-9a73-d2a20ffe3c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:28.172601 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59358101-db1e-4156-9a73-d2a20ffe3c04 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:28.172886 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59358101-db1e-4156-9a73-d2a20ffe3c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:28.173199 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59358101-db1e-4156-9a73-d2a20ffe3c04 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:28.173941 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59358101-db1e-4156-9a73-d2a20ffe3c04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:19:28.174249 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59358101-db1e-4156-9a73-d2a20ffe3c04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:28.177487 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59358101-db1e-4156-9a73-d2a20ffe3c04 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:28.199022 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1608/3243] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:19:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:19:28.209007 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c92b0b-9562-4562-8453-b2d2e41d79b0 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:28.225369 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c92b0b-9562-4562-8453-b2d2e41d79b0 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:28.231927 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f838cd-b778-446e-be3f-bc3472ed99d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:28.232764 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f838cd-b778-446e-be3f-bc3472ed99d5 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:28.233159 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f838cd-b778-446e-be3f-bc3472ed99d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:28.233515 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f838cd-b778-446e-be3f-bc3472ed99d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:28.234311 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f838cd-b778-446e-be3f-bc3472ed99d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:28.236798 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f838cd-b778-446e-be3f-bc3472ed99d5 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:28.334511 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1636/3244] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:19:28 2022] POST /identity/v3/projects => generated 395 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:19:28.343450 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59358101-db1e-4156-9a73-d2a20ffe3c04 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:28.354576 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59358101-db1e-4156-9a73-d2a20ffe3c04 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:28.433252 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61f1dab-5928-452a-95d6-dac0ba72c5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:28.433932 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f1dab-5928-452a-95d6-dac0ba72c5a3 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:28.434251 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f1dab-5928-452a-95d6-dac0ba72c5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:28.434781 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f1dab-5928-452a-95d6-dac0ba72c5a3 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:28.435724 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61f1dab-5928-452a-95d6-dac0ba72c5a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:28.437702 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61f1dab-5928-452a-95d6-dac0ba72c5a3 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:28.560245 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1609/3245] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:19:28 2022] POST /identity/v3/users => generated 298 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:19:28.561313 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f838cd-b778-446e-be3f-bc3472ed99d5 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:28.586355 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f838cd-b778-446e-be3f-bc3472ed99d5 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:28.592093 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94c91bd-7837-485b-a74d-1112a0821a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:28.592764 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c91bd-7837-485b-a74d-1112a0821a01 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:28.593047 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c91bd-7837-485b-a74d-1112a0821a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:28.593323 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c91bd-7837-485b-a74d-1112a0821a01 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:28.594049 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94c91bd-7837-485b-a74d-1112a0821a01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:28.595682 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94c91bd-7837-485b-a74d-1112a0821a01 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:28.609993 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1637/3246] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:19:28 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:19:28.614418 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61f1dab-5928-452a-95d6-dac0ba72c5a3 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:28.634038 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61f1dab-5928-452a-95d6-dac0ba72c5a3 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:28.645650 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b55c1c-f180-4ffe-8b6d-d49e179f2a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:28.645955 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b55c1c-f180-4ffe-8b6d-d49e179f2a0b admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:28.646181 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b55c1c-f180-4ffe-8b6d-d49e179f2a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:28.646468 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b55c1c-f180-4ffe-8b6d-d49e179f2a0b admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:28.647174 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b55c1c-f180-4ffe-8b6d-d49e179f2a0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:28.648829 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b55c1c-f180-4ffe-8b6d-d49e179f2a0b admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:28.677509 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1610/3247] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:19:28 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:19:28.686356 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94c91bd-7837-485b-a74d-1112a0821a01 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:28.705034 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94c91bd-7837-485b-a74d-1112a0821a01 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:28.712609 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d22c969-a83b-4145-b555-2b548cafd017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:28.716067 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d22c969-a83b-4145-b555-2b548cafd017 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:28.716812 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d22c969-a83b-4145-b555-2b548cafd017 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:28.717683 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d22c969-a83b-4145-b555-2b548cafd017 admin admin] PATH_INFO: `/v3/projects/ba3b55bf19d34bd69c9c7b0259f2b164/users/0d57e5af9dcf42238802ccc5007e3559/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:28.749989 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d22c969-a83b-4145-b555-2b548cafd017 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba3b55bf19d34bd69c9c7b0259f2b164, user_id=0d57e5af9dcf42238802ccc5007e3559, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:28.753763 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d22c969-a83b-4145-b555-2b548cafd017 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:28.869565 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1638/3248] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:19:28 2022] PUT /identity/v3/projects/ba3b55bf19d34bd69c9c7b0259f2b164/users/0d57e5af9dcf42238802ccc5007e3559/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:19:28.881223 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4341986-9ac9-4aeb-8b44-41b1470dd12f None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:28.886431 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4341986-9ac9-4aeb-8b44-41b1470dd12f None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:28.886431 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4341986-9ac9-4aeb-8b44-41b1470dd12f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:28.920497 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-b4341986-9ac9-4aeb-8b44-41b1470dd12f None None] MFA Rules not processed for user `0d57e5af9dcf42238802ccc5007e3559`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:19:28.922328 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b4341986-9ac9-4aeb-8b44-41b1470dd12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:19:29.048023 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1611/3249] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:19:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:19:29.170080 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d22c969-a83b-4145-b555-2b548cafd017 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:29.172386 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-4d22c969-a83b-4145-b555-2b548cafd017 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:19:29.253921 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d22c969-a83b-4145-b555-2b548cafd017 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:29.259987 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35db56d-7433-40fe-b38d-32d03ddc7a53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:29.260841 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35db56d-7433-40fe-b38d-32d03ddc7a53 service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:29.261138 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35db56d-7433-40fe-b38d-32d03ddc7a53 service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:29.261416 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35db56d-7433-40fe-b38d-32d03ddc7a53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:29.269649 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35db56d-7433-40fe-b38d-32d03ddc7a53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:29.272486 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35db56d-7433-40fe-b38d-32d03ddc7a53 service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:29.280733 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1639/3250] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:19:29 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:19:29.883054 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4341986-9ac9-4aeb-8b44-41b1470dd12f None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:30.008361 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4341986-9ac9-4aeb-8b44-41b1470dd12f None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:30.014059 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a105443-f089-4bcc-8d73-b8bb3f170d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:30.014956 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a105443-f089-4bcc-8d73-b8bb3f170d45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:30.015241 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a105443-f089-4bcc-8d73-b8bb3f170d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:30.015540 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a105443-f089-4bcc-8d73-b8bb3f170d45 admin admin] PATH_INFO: `/v3/users/0d57e5af9dcf42238802ccc5007e3559` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:30.016775 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a105443-f089-4bcc-8d73-b8bb3f170d45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d57e5af9dcf42238802ccc5007e3559)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:30.019674 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a105443-f089-4bcc-8d73-b8bb3f170d45 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:30.184737 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0a105443-f089-4bcc-8d73-b8bb3f170d45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d57e5af9dcf42238802ccc5007e3559'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:30.194769 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0a105443-f089-4bcc-8d73-b8bb3f170d45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d57e5af9dcf42238802ccc5007e3559'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:30.196043 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0a105443-f089-4bcc-8d73-b8bb3f170d45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d57e5af9dcf42238802ccc5007e3559'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:30.274159 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0a105443-f089-4bcc-8d73-b8bb3f170d45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d57e5af9dcf42238802ccc5007e3559'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:30.288875 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0a105443-f089-4bcc-8d73-b8bb3f170d45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d57e5af9dcf42238802ccc5007e3559'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:30.299277 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1612/3251] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:19:29 2022] DELETE /identity/v3/users/0d57e5af9dcf42238802ccc5007e3559 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:19:30.304189 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8fe61-7a60-4910-97c7-b28d0daa880a None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:30.304708 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8fe61-7a60-4910-97c7-b28d0daa880a None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:30.304800 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8fe61-7a60-4910-97c7-b28d0daa880a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:30.328859 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-9ef8fe61-7a60-4910-97c7-b28d0daa880a None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:19:30.330195 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-9ef8fe61-7a60-4910-97c7-b28d0daa880a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:19:30.414468 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1640/3252] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:19:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:19:30.425871 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a105443-f089-4bcc-8d73-b8bb3f170d45 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:30.427321 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-0a105443-f089-4bcc-8d73-b8bb3f170d45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:19:30.510202 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a105443-f089-4bcc-8d73-b8bb3f170d45 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:30.515169 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf440b4e-d9dc-4c2f-8ff9-1479832053ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:30.516104 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf440b4e-d9dc-4c2f-8ff9-1479832053ca service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:30.516522 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf440b4e-d9dc-4c2f-8ff9-1479832053ca service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:30.516892 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf440b4e-d9dc-4c2f-8ff9-1479832053ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:30.529088 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf440b4e-d9dc-4c2f-8ff9-1479832053ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:30.530807 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf440b4e-d9dc-4c2f-8ff9-1479832053ca service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:30.542588 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1613/3253] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:19:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:19:31.199872 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef8fe61-7a60-4910-97c7-b28d0daa880a None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:31.201579 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-9ef8fe61-7a60-4910-97c7-b28d0daa880a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:19:31.216102 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef8fe61-7a60-4910-97c7-b28d0daa880a None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:31.223130 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdbd0a2-f688-42df-870c-f0342ad9f07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:31.224400 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdbd0a2-f688-42df-870c-f0342ad9f07a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:31.225170 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdbd0a2-f688-42df-870c-f0342ad9f07a admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:31.225918 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdbd0a2-f688-42df-870c-f0342ad9f07a admin admin] PATH_INFO: `/v3/projects/ba3b55bf19d34bd69c9c7b0259f2b164` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:31.227432 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdbd0a2-f688-42df-870c-f0342ad9f07a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba3b55bf19d34bd69c9c7b0259f2b164)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:31.230232 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdbd0a2-f688-42df-870c-f0342ad9f07a admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:31.342112 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ffdbd0a2-f688-42df-870c-f0342ad9f07a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba3b55bf19d34bd69c9c7b0259f2b164', 'request_id': 'req-ffdbd0a2-f688-42df-870c-f0342ad9f07a'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:31.348679 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ffdbd0a2-f688-42df-870c-f0342ad9f07a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba3b55bf19d34bd69c9c7b0259f2b164', 'request_id': 'req-ffdbd0a2-f688-42df-870c-f0342ad9f07a'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:31.457413 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ffdbd0a2-f688-42df-870c-f0342ad9f07a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba3b55bf19d34bd69c9c7b0259f2b164', 'request_id': 'req-ffdbd0a2-f688-42df-870c-f0342ad9f07a'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:31.469165 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ffdbd0a2-f688-42df-870c-f0342ad9f07a admin admin] The token cache is being invalidate because project ba3b55bf19d34bd69c9c7b0259f2b164 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:19:31.469460 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ffdbd0a2-f688-42df-870c-f0342ad9f07a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:31.470232 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ffdbd0a2-f688-42df-870c-f0342ad9f07a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:31.472470 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1641/3254] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:19:31 2022] DELETE /identity/v3/projects/ba3b55bf19d34bd69c9c7b0259f2b164 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:19:31.477518 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa12063-1f16-4f0f-8103-4a4c14a82739 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:31.478044 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa12063-1f16-4f0f-8103-4a4c14a82739 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:31.478257 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa12063-1f16-4f0f-8103-4a4c14a82739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:31.501833 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-efa12063-1f16-4f0f-8103-4a4c14a82739 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:19:31.503043 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-efa12063-1f16-4f0f-8103-4a4c14a82739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:19:31.578080 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1614/3255] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:19:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:19:31.646883 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595116b7-bfaf-4356-bda3-9ee598d52f4b None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:31.647553 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595116b7-bfaf-4356-bda3-9ee598d52f4b None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:31.650055 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595116b7-bfaf-4356-bda3-9ee598d52f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:31.679897 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-595116b7-bfaf-4356-bda3-9ee598d52f4b None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:19:31.681527 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-595116b7-bfaf-4356-bda3-9ee598d52f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:19:31.690780 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1642/3256] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:19:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:19:31.695720 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa12063-1f16-4f0f-8103-4a4c14a82739 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:31.706716 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa12063-1f16-4f0f-8103-4a4c14a82739 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:31.711442 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00a7e40-23fe-4c92-a41d-94702cd1cc95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:31.712104 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a7e40-23fe-4c92-a41d-94702cd1cc95 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:31.712420 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a7e40-23fe-4c92-a41d-94702cd1cc95 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:31.712717 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a7e40-23fe-4c92-a41d-94702cd1cc95 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:31.713456 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00a7e40-23fe-4c92-a41d-94702cd1cc95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:19:31.713769 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00a7e40-23fe-4c92-a41d-94702cd1cc95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:31.715377 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00a7e40-23fe-4c92-a41d-94702cd1cc95 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:31.727834 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1615/3257] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:19:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:19:31.736160 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595116b7-bfaf-4356-bda3-9ee598d52f4b None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:31.742444 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595116b7-bfaf-4356-bda3-9ee598d52f4b None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:31.747432 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d3cb97-e0ee-4e7e-9637-00de755d8c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:31.748196 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d3cb97-e0ee-4e7e-9637-00de755d8c26 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:31.748489 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d3cb97-e0ee-4e7e-9637-00de755d8c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:31.748840 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d3cb97-e0ee-4e7e-9637-00de755d8c26 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:31.749522 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d3cb97-e0ee-4e7e-9637-00de755d8c26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:31.751441 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d3cb97-e0ee-4e7e-9637-00de755d8c26 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:31.899420 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1643/3258] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:19:31 2022] POST /identity/v3/projects => generated 385 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:19:31.903074 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00a7e40-23fe-4c92-a41d-94702cd1cc95 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:31.913277 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00a7e40-23fe-4c92-a41d-94702cd1cc95 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:31.977908 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a414dc1-3c7b-4626-9d50-c433b3a2d3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:31.978586 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a414dc1-3c7b-4626-9d50-c433b3a2d3de admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:31.979094 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a414dc1-3c7b-4626-9d50-c433b3a2d3de admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:31.979373 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a414dc1-3c7b-4626-9d50-c433b3a2d3de admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:31.980124 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a414dc1-3c7b-4626-9d50-c433b3a2d3de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:31.982020 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a414dc1-3c7b-4626-9d50-c433b3a2d3de admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:32.060611 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1616/3259] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:19:31 2022] POST /identity/v3/users => generated 293 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:19:32.064754 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d3cb97-e0ee-4e7e-9637-00de755d8c26 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:32.076224 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d3cb97-e0ee-4e7e-9637-00de755d8c26 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:32.081696 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19342e6d-3c1e-445b-a8fc-c6b8591c6dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:32.082486 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19342e6d-3c1e-445b-a8fc-c6b8591c6dac admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:32.082834 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19342e6d-3c1e-445b-a8fc-c6b8591c6dac admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:32.083330 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19342e6d-3c1e-445b-a8fc-c6b8591c6dac admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:32.084478 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19342e6d-3c1e-445b-a8fc-c6b8591c6dac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:32.086078 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19342e6d-3c1e-445b-a8fc-c6b8591c6dac admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:32.096998 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1644/3260] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:19:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:19:32.101791 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a414dc1-3c7b-4626-9d50-c433b3a2d3de admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:32.115755 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a414dc1-3c7b-4626-9d50-c433b3a2d3de admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:32.121621 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe2592c-eba7-43b4-9b43-53844a838829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:32.122292 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe2592c-eba7-43b4-9b43-53844a838829 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:32.123302 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe2592c-eba7-43b4-9b43-53844a838829 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:32.123618 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe2592c-eba7-43b4-9b43-53844a838829 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:32.124347 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe2592c-eba7-43b4-9b43-53844a838829 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:32.126704 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe2592c-eba7-43b4-9b43-53844a838829 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:32.146094 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19342e6d-3c1e-445b-a8fc-c6b8591c6dac admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:32.147563 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1617/3261] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:19:32 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:19:32.156934 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19342e6d-3c1e-445b-a8fc-c6b8591c6dac admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:32.161959 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2298bdd1-7088-4381-b6cb-58feeaf5a903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:32.163055 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2298bdd1-7088-4381-b6cb-58feeaf5a903 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:32.163586 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2298bdd1-7088-4381-b6cb-58feeaf5a903 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:32.164036 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2298bdd1-7088-4381-b6cb-58feeaf5a903 admin admin] PATH_INFO: `/v3/projects/65e462b8fb9a4a45b1fa6305c738e24d/users/100d512e54924bc1bb24cb21684f6fdc/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:32.180390 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2298bdd1-7088-4381-b6cb-58feeaf5a903 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65e462b8fb9a4a45b1fa6305c738e24d, user_id=100d512e54924bc1bb24cb21684f6fdc, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:32.183715 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2298bdd1-7088-4381-b6cb-58feeaf5a903 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:32.287454 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1645/3262] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:19:32 2022] PUT /identity/v3/projects/65e462b8fb9a4a45b1fa6305c738e24d/users/100d512e54924bc1bb24cb21684f6fdc/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:19:32.297658 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a41bd5-4bdd-402c-8cda-a6d672511def None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:32.298043 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a41bd5-4bdd-402c-8cda-a6d672511def None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:32.298324 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a41bd5-4bdd-402c-8cda-a6d672511def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:32.339685 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-00a41bd5-4bdd-402c-8cda-a6d672511def None None] MFA Rules not processed for user `100d512e54924bc1bb24cb21684f6fdc`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:19:32.341177 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-00a41bd5-4bdd-402c-8cda-a6d672511def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:19:32.424309 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1618/3263] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:19:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:19:32.488992 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2298bdd1-7088-4381-b6cb-58feeaf5a903 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:32.491212 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-2298bdd1-7088-4381-b6cb-58feeaf5a903 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:19:32.597621 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2298bdd1-7088-4381-b6cb-58feeaf5a903 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:32.603283 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4c4efa-54a9-453f-bfb1-694ec0b28f37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:32.604256 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c4efa-54a9-453f-bfb1-694ec0b28f37 service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:32.604428 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c4efa-54a9-453f-bfb1-694ec0b28f37 service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:32.604620 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c4efa-54a9-453f-bfb1-694ec0b28f37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:32.614137 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4c4efa-54a9-453f-bfb1-694ec0b28f37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:32.615793 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4c4efa-54a9-453f-bfb1-694ec0b28f37 service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:32.625236 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1646/3264] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:19:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:19:33.990608 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a41bd5-4bdd-402c-8cda-a6d672511def None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:34.078127 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a41bd5-4bdd-402c-8cda-a6d672511def None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:34.091802 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323ac650-ed44-452b-a268-0c3816a345c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:34.092437 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ac650-ed44-452b-a268-0c3816a345c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:34.092720 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ac650-ed44-452b-a268-0c3816a345c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:34.092998 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ac650-ed44-452b-a268-0c3816a345c4 admin admin] PATH_INFO: `/v3/users/100d512e54924bc1bb24cb21684f6fdc` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:34.099054 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323ac650-ed44-452b-a268-0c3816a345c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=100d512e54924bc1bb24cb21684f6fdc)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:34.106116 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323ac650-ed44-452b-a268-0c3816a345c4 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:34.345498 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-323ac650-ed44-452b-a268-0c3816a345c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '100d512e54924bc1bb24cb21684f6fdc'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:34.354132 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-323ac650-ed44-452b-a268-0c3816a345c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '100d512e54924bc1bb24cb21684f6fdc'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:34.354991 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-323ac650-ed44-452b-a268-0c3816a345c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '100d512e54924bc1bb24cb21684f6fdc'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:34.465604 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-323ac650-ed44-452b-a268-0c3816a345c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '100d512e54924bc1bb24cb21684f6fdc'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:34.506685 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-323ac650-ed44-452b-a268-0c3816a345c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '100d512e54924bc1bb24cb21684f6fdc'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:34.519287 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1619/3265] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:19:33 2022] DELETE /identity/v3/users/100d512e54924bc1bb24cb21684f6fdc => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:19:34.521587 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac47394-101b-43a6-85f6-f547be657379 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:34.522126 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac47394-101b-43a6-85f6-f547be657379 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:34.522234 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac47394-101b-43a6-85f6-f547be657379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:34.547267 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-7ac47394-101b-43a6-85f6-f547be657379 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:19:34.549804 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-7ac47394-101b-43a6-85f6-f547be657379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:19:34.633708 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1647/3266] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:19:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:19:34.670358 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323ac650-ed44-452b-a268-0c3816a345c4 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:34.670358 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-323ac650-ed44-452b-a268-0c3816a345c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:19:34.745514 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323ac650-ed44-452b-a268-0c3816a345c4 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:34.751246 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5347be1e-f99f-4fc5-9b1f-4ec5010e4c0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:34.753208 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347be1e-f99f-4fc5-9b1f-4ec5010e4c0f service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:34.754048 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347be1e-f99f-4fc5-9b1f-4ec5010e4c0f service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:34.754652 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347be1e-f99f-4fc5-9b1f-4ec5010e4c0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:34.767987 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5347be1e-f99f-4fc5-9b1f-4ec5010e4c0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:34.776668 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5347be1e-f99f-4fc5-9b1f-4ec5010e4c0f service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:34.790566 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1620/3267] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:19:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:19:35.521893 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac47394-101b-43a6-85f6-f547be657379 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:35.523651 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-7ac47394-101b-43a6-85f6-f547be657379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:19:35.538917 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac47394-101b-43a6-85f6-f547be657379 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:35.545807 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f84798f-7de1-4984-8107-91dae7a16ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:35.547223 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f84798f-7de1-4984-8107-91dae7a16ba2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:35.548141 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f84798f-7de1-4984-8107-91dae7a16ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:35.548806 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f84798f-7de1-4984-8107-91dae7a16ba2 admin admin] PATH_INFO: `/v3/projects/65e462b8fb9a4a45b1fa6305c738e24d` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:35.552553 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f84798f-7de1-4984-8107-91dae7a16ba2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65e462b8fb9a4a45b1fa6305c738e24d)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:35.555074 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f84798f-7de1-4984-8107-91dae7a16ba2 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:35.722686 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6f84798f-7de1-4984-8107-91dae7a16ba2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65e462b8fb9a4a45b1fa6305c738e24d', 'request_id': 'req-6f84798f-7de1-4984-8107-91dae7a16ba2'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:35.741160 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6f84798f-7de1-4984-8107-91dae7a16ba2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65e462b8fb9a4a45b1fa6305c738e24d', 'request_id': 'req-6f84798f-7de1-4984-8107-91dae7a16ba2'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:35.880055 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6f84798f-7de1-4984-8107-91dae7a16ba2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65e462b8fb9a4a45b1fa6305c738e24d', 'request_id': 'req-6f84798f-7de1-4984-8107-91dae7a16ba2'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:35.892324 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6f84798f-7de1-4984-8107-91dae7a16ba2 admin admin] The token cache is being invalidate because project 65e462b8fb9a4a45b1fa6305c738e24d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:19:35.892829 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6f84798f-7de1-4984-8107-91dae7a16ba2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:35.893576 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6f84798f-7de1-4984-8107-91dae7a16ba2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:35.895177 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1648/3268] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:19:35 2022] DELETE /identity/v3/projects/65e462b8fb9a4a45b1fa6305c738e24d => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:19:35.900290 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d234e-9356-42f2-a8ac-9eae00e44531 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:35.900823 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d234e-9356-42f2-a8ac-9eae00e44531 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:35.901448 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d234e-9356-42f2-a8ac-9eae00e44531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:35.925409 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-ee7d234e-9356-42f2-a8ac-9eae00e44531 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:19:35.926633 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-ee7d234e-9356-42f2-a8ac-9eae00e44531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:19:35.994535 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1621/3269] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:19:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:19:36.005211 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34369789-49cd-4aae-ad1a-8cefefbd60cf None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:36.005567 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34369789-49cd-4aae-ad1a-8cefefbd60cf None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:36.008481 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34369789-49cd-4aae-ad1a-8cefefbd60cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:36.025477 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-34369789-49cd-4aae-ad1a-8cefefbd60cf None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:19:36.027405 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-34369789-49cd-4aae-ad1a-8cefefbd60cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:19:36.059666 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1649/3270] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:19:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:19:36.063767 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7d234e-9356-42f2-a8ac-9eae00e44531 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:36.086969 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7d234e-9356-42f2-a8ac-9eae00e44531 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:36.106432 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e786b83-e533-4be0-95c8-162a0a586532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:36.107057 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e786b83-e533-4be0-95c8-162a0a586532 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:36.107341 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e786b83-e533-4be0-95c8-162a0a586532 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:36.107679 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e786b83-e533-4be0-95c8-162a0a586532 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:36.108417 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e786b83-e533-4be0-95c8-162a0a586532 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:19:36.108835 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e786b83-e533-4be0-95c8-162a0a586532 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:36.111115 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e786b83-e533-4be0-95c8-162a0a586532 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:36.127146 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff273e2-d8bf-479d-84f3-1bcd23104651 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:36.127433 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff273e2-d8bf-479d-84f3-1bcd23104651 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:36.129388 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff273e2-d8bf-479d-84f3-1bcd23104651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:36.161247 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1622/3271] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:19:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:19:36.162849 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-eff273e2-d8bf-479d-84f3-1bcd23104651 None None] MFA Rules not processed for user `a42e0caa0878447f98544e74f767c7ca`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:19:36.165998 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-eff273e2-d8bf-479d-84f3-1bcd23104651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:19:36.167203 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e786b83-e533-4be0-95c8-162a0a586532 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:36.205910 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e786b83-e533-4be0-95c8-162a0a586532 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:36.223633 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c91385-9ad7-4f0f-861a-407b8fa9d61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:36.224506 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c91385-9ad7-4f0f-861a-407b8fa9d61e admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:36.224897 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c91385-9ad7-4f0f-861a-407b8fa9d61e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:36.225255 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c91385-9ad7-4f0f-861a-407b8fa9d61e admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:36.226026 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c91385-9ad7-4f0f-861a-407b8fa9d61e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:36.228116 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c91385-9ad7-4f0f-861a-407b8fa9d61e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:36.240310 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1650/3272] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:19:36 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:19:36.345885 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1623/3273] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:19:36 2022] POST /identity/v3/projects => generated 405 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:19:36.347979 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff273e2-d8bf-479d-84f3-1bcd23104651 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:36.369481 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff273e2-d8bf-479d-84f3-1bcd23104651 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:36.475196 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e535fb82-4f75-4e5e-a483-eeec153197f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:36.475980 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535fb82-4f75-4e5e-a483-eeec153197f7 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:36.476225 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535fb82-4f75-4e5e-a483-eeec153197f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:36.476506 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535fb82-4f75-4e5e-a483-eeec153197f7 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:36.477208 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e535fb82-4f75-4e5e-a483-eeec153197f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:36.479128 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e535fb82-4f75-4e5e-a483-eeec153197f7 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:36.621377 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1651/3274] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:19:36 2022] POST /identity/v3/users => generated 303 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:19:36.622254 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c91385-9ad7-4f0f-861a-407b8fa9d61e admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:36.646829 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c91385-9ad7-4f0f-861a-407b8fa9d61e admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:36.653348 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044e3c8c-b7ce-4b3a-b858-7ff4265683bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:36.655142 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e3c8c-b7ce-4b3a-b858-7ff4265683bb admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:36.655433 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e3c8c-b7ce-4b3a-b858-7ff4265683bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:36.655859 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e3c8c-b7ce-4b3a-b858-7ff4265683bb admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:36.656683 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044e3c8c-b7ce-4b3a-b858-7ff4265683bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:36.658343 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044e3c8c-b7ce-4b3a-b858-7ff4265683bb admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:36.676943 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1624/3275] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:19:36 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:19:36.679049 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e535fb82-4f75-4e5e-a483-eeec153197f7 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:36.693259 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e535fb82-4f75-4e5e-a483-eeec153197f7 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:36.698420 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a8572-2ae8-438d-a47e-d3ff5904089a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:36.699124 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a8572-2ae8-438d-a47e-d3ff5904089a admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:36.699401 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a8572-2ae8-438d-a47e-d3ff5904089a admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:36.699714 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a8572-2ae8-438d-a47e-d3ff5904089a admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:36.700443 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344a8572-2ae8-438d-a47e-d3ff5904089a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:36.702640 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344a8572-2ae8-438d-a47e-d3ff5904089a admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:36.717733 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1652/3276] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:19:36 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:19:36.722084 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044e3c8c-b7ce-4b3a-b858-7ff4265683bb admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:36.733776 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044e3c8c-b7ce-4b3a-b858-7ff4265683bb admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:36.743430 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629fd629-c96e-4632-aac1-a75f53d0272f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:36.744528 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629fd629-c96e-4632-aac1-a75f53d0272f admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:36.744959 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629fd629-c96e-4632-aac1-a75f53d0272f admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:36.745237 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629fd629-c96e-4632-aac1-a75f53d0272f admin admin] PATH_INFO: `/v3/projects/167a02a955b249cd9d3bd1bd34d95954/users/35a7420bb78247a7a0c3af7878af6bcc/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:36.764199 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629fd629-c96e-4632-aac1-a75f53d0272f admin admin] RBAC: Authorizing `identity:create_grant(project_id=167a02a955b249cd9d3bd1bd34d95954, user_id=35a7420bb78247a7a0c3af7878af6bcc, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:36.767234 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629fd629-c96e-4632-aac1-a75f53d0272f admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:36.857051 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1625/3277] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:19:36 2022] PUT /identity/v3/projects/167a02a955b249cd9d3bd1bd34d95954/users/35a7420bb78247a7a0c3af7878af6bcc/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:19:36.863116 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace78e41-94d8-4f17-af1d-76926f9149c4 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:36.863559 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace78e41-94d8-4f17-af1d-76926f9149c4 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:36.864121 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace78e41-94d8-4f17-af1d-76926f9149c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:36.883870 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-ace78e41-94d8-4f17-af1d-76926f9149c4 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:19:36.885615 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ace78e41-94d8-4f17-af1d-76926f9149c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:19:36.966538 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1653/3278] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:19:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:19:36.976348 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629fd629-c96e-4632-aac1-a75f53d0272f admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:36.978387 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-629fd629-c96e-4632-aac1-a75f53d0272f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:19:37.035587 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629fd629-c96e-4632-aac1-a75f53d0272f admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:37.039294 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d407aaf6-6238-4bbe-b4f6-88bba4565ca2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:37.039986 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407aaf6-6238-4bbe-b4f6-88bba4565ca2 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:37.040268 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407aaf6-6238-4bbe-b4f6-88bba4565ca2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:37.040546 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407aaf6-6238-4bbe-b4f6-88bba4565ca2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:37.050803 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d407aaf6-6238-4bbe-b4f6-88bba4565ca2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:37.054482 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d407aaf6-6238-4bbe-b4f6-88bba4565ca2 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:37.062776 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1626/3279] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:19:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:19:39.148775 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1067cf42-df6f-4794-a528-47b1f105e25f None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:39.149352 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1067cf42-df6f-4794-a528-47b1f105e25f None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:39.149518 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1067cf42-df6f-4794-a528-47b1f105e25f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:39.214049 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-1067cf42-df6f-4794-a528-47b1f105e25f None None] MFA Rules not processed for user `35a7420bb78247a7a0c3af7878af6bcc`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:19:39.215949 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-1067cf42-df6f-4794-a528-47b1f105e25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:19:39.305159 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1654/3280] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:19:39 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:19:39.369302 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d407aaf6-6238-4bbe-b4f6-88bba4565ca2 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:39.370911 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-d407aaf6-6238-4bbe-b4f6-88bba4565ca2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:19:39.462994 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d407aaf6-6238-4bbe-b4f6-88bba4565ca2 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:39.476441 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c945492a-8a34-460d-bb33-00e9f697c2ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:39.477108 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945492a-8a34-460d-bb33-00e9f697c2ef service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:39.477738 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945492a-8a34-460d-bb33-00e9f697c2ef service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:39.478077 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945492a-8a34-460d-bb33-00e9f697c2ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:39.488775 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c945492a-8a34-460d-bb33-00e9f697c2ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:39.490663 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c945492a-8a34-460d-bb33-00e9f697c2ef service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:39.507689 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1627/3281] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:19:39 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:19:40.495114 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e0467f-5e09-47a0-91d0-6c7940db3984 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:40.495680 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e0467f-5e09-47a0-91d0-6c7940db3984 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:40.496446 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e0467f-5e09-47a0-91d0-6c7940db3984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:40.515285 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-99e0467f-5e09-47a0-91d0-6c7940db3984 None None] MFA Rules not processed for user `71080496c33c4e2c8b2e16b950f0b9ea`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:19:40.522187 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-99e0467f-5e09-47a0-91d0-6c7940db3984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:19:40.583464 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1655/3282] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:19:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:19:47.189674 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c945492a-8a34-460d-bb33-00e9f697c2ef service nova] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:47.192735 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c945492a-8a34-460d-bb33-00e9f697c2ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:19:47.207405 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c945492a-8a34-460d-bb33-00e9f697c2ef service nova] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:47.212873 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2974c5-7af8-4374-9dbf-577228758b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:47.213979 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2974c5-7af8-4374-9dbf-577228758b39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:47.214267 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2974c5-7af8-4374-9dbf-577228758b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:47.214544 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2974c5-7af8-4374-9dbf-577228758b39 admin admin] PATH_INFO: `/v3/users/154d05e107d74202beabaa0b60dab8c8` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:47.215780 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2974c5-7af8-4374-9dbf-577228758b39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=154d05e107d74202beabaa0b60dab8c8)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:47.217898 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2974c5-7af8-4374-9dbf-577228758b39 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:47.744685 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-2b2974c5-7af8-4374-9dbf-577228758b39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '154d05e107d74202beabaa0b60dab8c8'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:47.754885 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-2b2974c5-7af8-4374-9dbf-577228758b39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '154d05e107d74202beabaa0b60dab8c8'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:47.755669 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-2b2974c5-7af8-4374-9dbf-577228758b39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '154d05e107d74202beabaa0b60dab8c8'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:47.957115 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-2b2974c5-7af8-4374-9dbf-577228758b39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '154d05e107d74202beabaa0b60dab8c8'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:47.969828 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-2b2974c5-7af8-4374-9dbf-577228758b39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '154d05e107d74202beabaa0b60dab8c8'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:47.976427 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1628/3283] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:19:47 2022] DELETE /identity/v3/users/154d05e107d74202beabaa0b60dab8c8 => generated 0 bytes in 788 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:19:47.980983 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc3a692-579e-4428-a710-abd1d1a1852f None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:47.981485 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc3a692-579e-4428-a710-abd1d1a1852f None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:47.981616 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc3a692-579e-4428-a710-abd1d1a1852f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:48.000425 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-0dc3a692-579e-4428-a710-abd1d1a1852f None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:19:48.001557 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-0dc3a692-579e-4428-a710-abd1d1a1852f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:19:48.081645 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1656/3284] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:19:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:19:48.092764 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2974c5-7af8-4374-9dbf-577228758b39 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:48.095230 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-2b2974c5-7af8-4374-9dbf-577228758b39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:19:48.168495 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2974c5-7af8-4374-9dbf-577228758b39 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:48.172189 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85666b1e-0ccb-4431-8aa5-87cd2e458aba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:48.172991 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85666b1e-0ccb-4431-8aa5-87cd2e458aba service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:48.173405 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85666b1e-0ccb-4431-8aa5-87cd2e458aba service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:48.173528 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85666b1e-0ccb-4431-8aa5-87cd2e458aba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:48.186477 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85666b1e-0ccb-4431-8aa5-87cd2e458aba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:48.188630 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85666b1e-0ccb-4431-8aa5-87cd2e458aba service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:48.201561 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1629/3285] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:19:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:19:48.739164 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc3a692-579e-4428-a710-abd1d1a1852f None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:48.740637 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-0dc3a692-579e-4428-a710-abd1d1a1852f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:19:48.753793 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc3a692-579e-4428-a710-abd1d1a1852f None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:48.758892 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e348c33-42fb-402d-bff8-d18608d97f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:48.760063 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e348c33-42fb-402d-bff8-d18608d97f49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:48.760350 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e348c33-42fb-402d-bff8-d18608d97f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:48.760627 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e348c33-42fb-402d-bff8-d18608d97f49 admin admin] PATH_INFO: `/v3/projects/a1c562e1e1414d32b858e08cb6379e8a` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:48.761833 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e348c33-42fb-402d-bff8-d18608d97f49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1c562e1e1414d32b858e08cb6379e8a)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:48.763856 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e348c33-42fb-402d-bff8-d18608d97f49 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:48.934123 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3e348c33-42fb-402d-bff8-d18608d97f49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1c562e1e1414d32b858e08cb6379e8a', 'request_id': 'req-3e348c33-42fb-402d-bff8-d18608d97f49'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:48.944882 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3e348c33-42fb-402d-bff8-d18608d97f49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1c562e1e1414d32b858e08cb6379e8a', 'request_id': 'req-3e348c33-42fb-402d-bff8-d18608d97f49'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:49.011596 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3e348c33-42fb-402d-bff8-d18608d97f49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1c562e1e1414d32b858e08cb6379e8a', 'request_id': 'req-3e348c33-42fb-402d-bff8-d18608d97f49'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:49.027645 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3e348c33-42fb-402d-bff8-d18608d97f49 admin admin] The token cache is being invalidate because project a1c562e1e1414d32b858e08cb6379e8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:19:49.028217 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3e348c33-42fb-402d-bff8-d18608d97f49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:49.029063 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3e348c33-42fb-402d-bff8-d18608d97f49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:49.031386 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1657/3286] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:19:48 2022] DELETE /identity/v3/projects/a1c562e1e1414d32b858e08cb6379e8a => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:19:49.036789 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85666b1e-0ccb-4431-8aa5-87cd2e458aba service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:49.050662 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85666b1e-0ccb-4431-8aa5-87cd2e458aba service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:49.143569 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1512333-c6c9-4ead-a048-74da80428814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:49.149072 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1512333-c6c9-4ead-a048-74da80428814 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:49.149072 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1512333-c6c9-4ead-a048-74da80428814 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:49.149072 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1512333-c6c9-4ead-a048-74da80428814 admin admin] PATH_INFO: `/v3/users/8c7d9001553b47e5aa8a0dc0a90dc409` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:49.149072 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1512333-c6c9-4ead-a048-74da80428814 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c7d9001553b47e5aa8a0dc0a90dc409)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:49.149755 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1512333-c6c9-4ead-a048-74da80428814 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:49.408190 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b1512333-c6c9-4ead-a048-74da80428814 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c7d9001553b47e5aa8a0dc0a90dc409'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:49.419616 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b1512333-c6c9-4ead-a048-74da80428814 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c7d9001553b47e5aa8a0dc0a90dc409'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:49.421372 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b1512333-c6c9-4ead-a048-74da80428814 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c7d9001553b47e5aa8a0dc0a90dc409'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:49.513978 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b1512333-c6c9-4ead-a048-74da80428814 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c7d9001553b47e5aa8a0dc0a90dc409'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:49.529010 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b1512333-c6c9-4ead-a048-74da80428814 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c7d9001553b47e5aa8a0dc0a90dc409'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:49.540294 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1630/3287] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:19:49 2022] DELETE /identity/v3/users/8c7d9001553b47e5aa8a0dc0a90dc409 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:19:50.096702 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e348c33-42fb-402d-bff8-d18608d97f49 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:50.098495 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-3e348c33-42fb-402d-bff8-d18608d97f49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:19:50.134033 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e348c33-42fb-402d-bff8-d18608d97f49 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:50.212904 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c9e4fe-4c50-41c1-9026-87c1d3588d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:50.213853 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c9e4fe-4c50-41c1-9026-87c1d3588d21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:50.214219 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c9e4fe-4c50-41c1-9026-87c1d3588d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:50.214564 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c9e4fe-4c50-41c1-9026-87c1d3588d21 admin admin] PATH_INFO: `/v3/projects/704ee73b20f34a9d8786979f32b6da08` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:50.215915 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c9e4fe-4c50-41c1-9026-87c1d3588d21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=704ee73b20f34a9d8786979f32b6da08)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:50.218343 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c9e4fe-4c50-41c1-9026-87c1d3588d21 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:50.269602 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1512333-c6c9-4ead-a048-74da80428814 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:50.271432 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b1512333-c6c9-4ead-a048-74da80428814 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:19:50.295353 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1512333-c6c9-4ead-a048-74da80428814 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:50.307471 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6480e5-fdaa-4799-8734-0a24649f4085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:50.308550 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6480e5-fdaa-4799-8734-0a24649f4085 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:50.308953 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6480e5-fdaa-4799-8734-0a24649f4085 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:50.309231 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6480e5-fdaa-4799-8734-0a24649f4085 admin admin] PATH_INFO: `/v3/users/35a7420bb78247a7a0c3af7878af6bcc` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:50.310610 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6480e5-fdaa-4799-8734-0a24649f4085 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35a7420bb78247a7a0c3af7878af6bcc)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:50.312647 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6480e5-fdaa-4799-8734-0a24649f4085 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:50.347762 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-22c9e4fe-4c50-41c1-9026-87c1d3588d21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '704ee73b20f34a9d8786979f32b6da08', 'request_id': 'req-22c9e4fe-4c50-41c1-9026-87c1d3588d21'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:50.353992 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-22c9e4fe-4c50-41c1-9026-87c1d3588d21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '704ee73b20f34a9d8786979f32b6da08', 'request_id': 'req-22c9e4fe-4c50-41c1-9026-87c1d3588d21'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:50.473857 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-22c9e4fe-4c50-41c1-9026-87c1d3588d21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '704ee73b20f34a9d8786979f32b6da08', 'request_id': 'req-22c9e4fe-4c50-41c1-9026-87c1d3588d21'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:50.490176 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-22c9e4fe-4c50-41c1-9026-87c1d3588d21 admin admin] The token cache is being invalidate because project 704ee73b20f34a9d8786979f32b6da08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:19:50.491023 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-22c9e4fe-4c50-41c1-9026-87c1d3588d21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:50.492003 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-22c9e4fe-4c50-41c1-9026-87c1d3588d21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:50.495027 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1658/3288] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:19:50 2022] DELETE /identity/v3/projects/704ee73b20f34a9d8786979f32b6da08 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:19:50.505035 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f276769b-9871-491b-9df0-37f32102593d None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:50.505440 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f276769b-9871-491b-9df0-37f32102593d None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:50.505821 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f276769b-9871-491b-9df0-37f32102593d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:50.524415 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ae6480e5-fdaa-4799-8734-0a24649f4085 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35a7420bb78247a7a0c3af7878af6bcc'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:50.544986 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-f276769b-9871-491b-9df0-37f32102593d None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:19:50.547277 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-f276769b-9871-491b-9df0-37f32102593d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:19:50.547519 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ae6480e5-fdaa-4799-8734-0a24649f4085 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35a7420bb78247a7a0c3af7878af6bcc'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:50.548466 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ae6480e5-fdaa-4799-8734-0a24649f4085 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35a7420bb78247a7a0c3af7878af6bcc'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:50.644307 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1659/3289] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:19:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:19:50.650700 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ae6480e5-fdaa-4799-8734-0a24649f4085 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35a7420bb78247a7a0c3af7878af6bcc'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:50.653024 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2032d-03b0-4ead-96b4-952daac2f94c None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:50.653322 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2032d-03b0-4ead-96b4-952daac2f94c None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:50.654952 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2032d-03b0-4ead-96b4-952daac2f94c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:50.671077 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ae6480e5-fdaa-4799-8734-0a24649f4085 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35a7420bb78247a7a0c3af7878af6bcc'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:50.673036 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-8ec2032d-03b0-4ead-96b4-952daac2f94c None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:19:50.674908 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-8ec2032d-03b0-4ead-96b4-952daac2f94c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:19:50.678152 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1631/3290] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:19:50 2022] DELETE /identity/v3/users/35a7420bb78247a7a0c3af7878af6bcc => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:19:50.683782 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1660/3291] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:19:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:19:50.687077 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6480e5-fdaa-4799-8734-0a24649f4085 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:50.753208 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6480e5-fdaa-4799-8734-0a24649f4085 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:50.758706 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a2e0cf-078d-4387-9ffb-0d529320ef82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:50.759544 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a2e0cf-078d-4387-9ffb-0d529320ef82 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:50.763516 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a2e0cf-078d-4387-9ffb-0d529320ef82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:50.763516 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a2e0cf-078d-4387-9ffb-0d529320ef82 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:50.763516 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a2e0cf-078d-4387-9ffb-0d529320ef82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:19:50.763516 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a2e0cf-078d-4387-9ffb-0d529320ef82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:50.763516 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a2e0cf-078d-4387-9ffb-0d529320ef82 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:50.780890 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec2032d-03b0-4ead-96b4-952daac2f94c None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:50.784993 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1632/3292] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:19:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:19:50.810997 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec2032d-03b0-4ead-96b4-952daac2f94c None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:50.822496 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c84864-baa8-496d-b268-0087289b80ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:50.822496 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c84864-baa8-496d-b268-0087289b80ed admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:50.822496 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c84864-baa8-496d-b268-0087289b80ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:50.822496 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c84864-baa8-496d-b268-0087289b80ed admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:50.822984 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c84864-baa8-496d-b268-0087289b80ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:50.824319 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c84864-baa8-496d-b268-0087289b80ed admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:50.935513 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1661/3293] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:19:50 2022] POST /identity/v3/projects => generated 379 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:19:50.938465 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a2e0cf-078d-4387-9ffb-0d529320ef82 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:50.949438 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a2e0cf-078d-4387-9ffb-0d529320ef82 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:51.014581 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f53916-f666-4a82-96c7-9fc214e8f108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:51.018597 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f53916-f666-4a82-96c7-9fc214e8f108 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:51.018597 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f53916-f666-4a82-96c7-9fc214e8f108 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:51.018597 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f53916-f666-4a82-96c7-9fc214e8f108 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:51.018597 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f53916-f666-4a82-96c7-9fc214e8f108 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:51.019615 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c84864-baa8-496d-b268-0087289b80ed admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:51.021527 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-27c84864-baa8-496d-b268-0087289b80ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:19:51.027867 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f53916-f666-4a82-96c7-9fc214e8f108 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:51.036799 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c84864-baa8-496d-b268-0087289b80ed admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:51.046826 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c613da00-e971-4a1c-abc7-3699c58d3aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:51.048173 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c613da00-e971-4a1c-abc7-3699c58d3aed admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:51.048555 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c613da00-e971-4a1c-abc7-3699c58d3aed admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:51.048991 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c613da00-e971-4a1c-abc7-3699c58d3aed admin admin] PATH_INFO: `/v3/projects/167a02a955b249cd9d3bd1bd34d95954` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:51.050536 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c613da00-e971-4a1c-abc7-3699c58d3aed admin admin] RBAC: Authorizing `identity:delete_project(project_id=167a02a955b249cd9d3bd1bd34d95954)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:51.052695 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c613da00-e971-4a1c-abc7-3699c58d3aed admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:51.138438 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1633/3294] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:19:50 2022] POST /identity/v3/users => generated 290 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:19:51.142194 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f53916-f666-4a82-96c7-9fc214e8f108 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:51.153570 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f53916-f666-4a82-96c7-9fc214e8f108 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:51.162828 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd1c9fc-f6dd-442b-ba74-899b9060c381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:51.170073 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd1c9fc-f6dd-442b-ba74-899b9060c381 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:51.170073 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd1c9fc-f6dd-442b-ba74-899b9060c381 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:51.170073 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd1c9fc-f6dd-442b-ba74-899b9060c381 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:51.170073 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd1c9fc-f6dd-442b-ba74-899b9060c381 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:51.171397 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd1c9fc-f6dd-442b-ba74-899b9060c381 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:51.187806 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c613da00-e971-4a1c-abc7-3699c58d3aed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '167a02a955b249cd9d3bd1bd34d95954', 'request_id': 'req-c613da00-e971-4a1c-abc7-3699c58d3aed'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:51.192769 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1634/3295] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:19:51 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:19:51.197276 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd1c9fc-f6dd-442b-ba74-899b9060c381 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:51.199543 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c613da00-e971-4a1c-abc7-3699c58d3aed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '167a02a955b249cd9d3bd1bd34d95954', 'request_id': 'req-c613da00-e971-4a1c-abc7-3699c58d3aed'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:51.208844 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd1c9fc-f6dd-442b-ba74-899b9060c381 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:51.265874 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d5d5c8-201e-4785-898f-47be1c62b4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:51.266651 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5d5c8-201e-4785-898f-47be1c62b4ca admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:51.266833 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5d5c8-201e-4785-898f-47be1c62b4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:51.267246 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5d5c8-201e-4785-898f-47be1c62b4ca admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:51.268590 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d5d5c8-201e-4785-898f-47be1c62b4ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:51.270336 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d5d5c8-201e-4785-898f-47be1c62b4ca admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:51.282501 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1635/3296] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:19:51 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:19:51.286554 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d5d5c8-201e-4785-898f-47be1c62b4ca admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:51.297511 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d5d5c8-201e-4785-898f-47be1c62b4ca admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:51.303709 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c613da00-e971-4a1c-abc7-3699c58d3aed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '167a02a955b249cd9d3bd1bd34d95954', 'request_id': 'req-c613da00-e971-4a1c-abc7-3699c58d3aed'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:51.317780 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f214eba-126e-4749-abf9-a4fd5c4ceeeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:51.318927 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f214eba-126e-4749-abf9-a4fd5c4ceeeb admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:51.319539 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f214eba-126e-4749-abf9-a4fd5c4ceeeb admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:51.320102 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f214eba-126e-4749-abf9-a4fd5c4ceeeb admin admin] PATH_INFO: `/v3/projects/5fa2838f6bea4fd5a945d7e52fc4f98b/users/fd43529ae5024e8484edd1d6fdce3b8c/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:51.323458 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c613da00-e971-4a1c-abc7-3699c58d3aed admin admin] The token cache is being invalidate because project 167a02a955b249cd9d3bd1bd34d95954 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:19:51.325642 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c613da00-e971-4a1c-abc7-3699c58d3aed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:51.331542 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c613da00-e971-4a1c-abc7-3699c58d3aed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:51.334202 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1662/3297] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:19:51 2022] DELETE /identity/v3/projects/167a02a955b249cd9d3bd1bd34d95954 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:19:51.339583 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8965a5e5-31e2-41f0-af8d-812eb8f04e03 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:51.340118 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8965a5e5-31e2-41f0-af8d-812eb8f04e03 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:51.340597 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8965a5e5-31e2-41f0-af8d-812eb8f04e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:51.346025 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f214eba-126e-4749-abf9-a4fd5c4ceeeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fa2838f6bea4fd5a945d7e52fc4f98b, user_id=fd43529ae5024e8484edd1d6fdce3b8c, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:51.351323 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f214eba-126e-4749-abf9-a4fd5c4ceeeb admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:51.360637 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-8965a5e5-31e2-41f0-af8d-812eb8f04e03 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:19:51.361995 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-8965a5e5-31e2-41f0-af8d-812eb8f04e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:19:51.375621 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1663/3298] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:19:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:19:51.384425 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd46ff-f812-467b-a054-746241f7e24a None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:51.385242 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd46ff-f812-467b-a054-746241f7e24a None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:51.385598 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd46ff-f812-467b-a054-746241f7e24a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:51.407407 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-90fd46ff-f812-467b-a054-746241f7e24a None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:19:51.408826 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-90fd46ff-f812-467b-a054-746241f7e24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:19:51.418512 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1664/3299] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:19:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:19:51.423083 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd46ff-f812-467b-a054-746241f7e24a None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:51.433969 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd46ff-f812-467b-a054-746241f7e24a None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:51.448206 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca594f8-9e3e-401c-ac9d-828edd54925c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:51.449267 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca594f8-9e3e-401c-ac9d-828edd54925c admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:51.450247 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca594f8-9e3e-401c-ac9d-828edd54925c admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:51.450621 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca594f8-9e3e-401c-ac9d-828edd54925c admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:51.451589 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca594f8-9e3e-401c-ac9d-828edd54925c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:19:51.452042 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca594f8-9e3e-401c-ac9d-828edd54925c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:51.453917 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca594f8-9e3e-401c-ac9d-828edd54925c admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:51.470149 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1665/3300] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:19:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:19:51.474789 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca594f8-9e3e-401c-ac9d-828edd54925c admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:51.487098 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca594f8-9e3e-401c-ac9d-828edd54925c admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:51.500779 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1636/3301] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:19:51 2022] PUT /identity/v3/projects/5fa2838f6bea4fd5a945d7e52fc4f98b/users/fd43529ae5024e8484edd1d6fdce3b8c/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:19:51.513220 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e373f11-7e3b-4a82-9f30-d6ebff36a640 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:51.513774 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e373f11-7e3b-4a82-9f30-d6ebff36a640 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:51.514103 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e373f11-7e3b-4a82-9f30-d6ebff36a640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:51.555027 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-8e373f11-7e3b-4a82-9f30-d6ebff36a640 None None] MFA Rules not processed for user `fd43529ae5024e8484edd1d6fdce3b8c`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:19:51.556621 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8e373f11-7e3b-4a82-9f30-d6ebff36a640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:19:51.573062 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3a0ec-09e2-4831-aff4-98b7d573284d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:51.574197 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3a0ec-09e2-4831-aff4-98b7d573284d admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:51.574705 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3a0ec-09e2-4831-aff4-98b7d573284d admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:51.575294 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3a0ec-09e2-4831-aff4-98b7d573284d admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:51.576427 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c3a0ec-09e2-4831-aff4-98b7d573284d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:51.578956 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c3a0ec-09e2-4831-aff4-98b7d573284d admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:51.645598 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1637/3302] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:19:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:19:51.646792 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e373f11-7e3b-4a82-9f30-d6ebff36a640 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:51.649482 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8e373f11-7e3b-4a82-9f30-d6ebff36a640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:19:51.664236 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e373f11-7e3b-4a82-9f30-d6ebff36a640 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:51.670554 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3516b6ff-13e1-4c96-abc7-fee62f65b016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:51.672560 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516b6ff-13e1-4c96-abc7-fee62f65b016 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:51.672560 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516b6ff-13e1-4c96-abc7-fee62f65b016 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:51.672560 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516b6ff-13e1-4c96-abc7-fee62f65b016 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:51.673393 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3516b6ff-13e1-4c96-abc7-fee62f65b016 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:51.675113 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3516b6ff-13e1-4c96-abc7-fee62f65b016 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:51.689877 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1666/3303] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:19:51 2022] POST /identity/v3/projects => generated 379 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:19:51.691040 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3a0ec-09e2-4831-aff4-98b7d573284d admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:51.765068 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3a0ec-09e2-4831-aff4-98b7d573284d admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:51.773375 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29cd8a9-b4ec-4b29-bd43-1ca712e07ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:51.774093 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29cd8a9-b4ec-4b29-bd43-1ca712e07ff6 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:51.774375 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29cd8a9-b4ec-4b29-bd43-1ca712e07ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:51.774656 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29cd8a9-b4ec-4b29-bd43-1ca712e07ff6 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:51.775535 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29cd8a9-b4ec-4b29-bd43-1ca712e07ff6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:51.777874 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29cd8a9-b4ec-4b29-bd43-1ca712e07ff6 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:51.800825 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1638/3304] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:19:51 2022] POST /identity/v3/projects => generated 379 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:19:51.805233 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3516b6ff-13e1-4c96-abc7-fee62f65b016 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:51.879219 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3516b6ff-13e1-4c96-abc7-fee62f65b016 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:51.885350 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb5acb1-b633-4e83-94c0-3028c24cf7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:51.886100 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5acb1-b633-4e83-94c0-3028c24cf7a3 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:51.886460 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5acb1-b633-4e83-94c0-3028c24cf7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:51.886809 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5acb1-b633-4e83-94c0-3028c24cf7a3 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:51.887579 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb5acb1-b633-4e83-94c0-3028c24cf7a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:51.889681 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb5acb1-b633-4e83-94c0-3028c24cf7a3 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:51.921056 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1667/3305] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:19:51 2022] POST /identity/v3/users => generated 290 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:19:51.932340 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29cd8a9-b4ec-4b29-bd43-1ca712e07ff6 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:51.943097 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29cd8a9-b4ec-4b29-bd43-1ca712e07ff6 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:51.948224 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7018f931-6971-412b-84a2-8f4c6df816df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:51.948924 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7018f931-6971-412b-84a2-8f4c6df816df admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:51.949222 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7018f931-6971-412b-84a2-8f4c6df816df admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:51.949536 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7018f931-6971-412b-84a2-8f4c6df816df admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:51.956578 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7018f931-6971-412b-84a2-8f4c6df816df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:51.958349 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7018f931-6971-412b-84a2-8f4c6df816df admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:51.969131 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1668/3306] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:19:51 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:19:51.974026 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7018f931-6971-412b-84a2-8f4c6df816df admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:51.984875 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7018f931-6971-412b-84a2-8f4c6df816df admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:51.993472 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56db3c0d-d369-4556-b618-f3341f3b928d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:51.994144 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db3c0d-d369-4556-b618-f3341f3b928d admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:51.994564 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db3c0d-d369-4556-b618-f3341f3b928d admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:51.994848 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db3c0d-d369-4556-b618-f3341f3b928d admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:51.995636 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56db3c0d-d369-4556-b618-f3341f3b928d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:51.997243 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56db3c0d-d369-4556-b618-f3341f3b928d admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:52.009036 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1669/3307] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:19:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:19:52.013362 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56db3c0d-d369-4556-b618-f3341f3b928d admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:52.023003 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1639/3308] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:19:51 2022] POST /identity/v3/users => generated 296 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:19:52.025793 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56db3c0d-d369-4556-b618-f3341f3b928d admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:52.026709 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb5acb1-b633-4e83-94c0-3028c24cf7a3 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:52.030577 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d6b450-bb21-4639-8555-8937cf06832e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:52.031462 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6b450-bb21-4639-8555-8937cf06832e admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:52.031781 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6b450-bb21-4639-8555-8937cf06832e admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:52.032063 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6b450-bb21-4639-8555-8937cf06832e admin admin] PATH_INFO: `/v3/projects/62ef4614a33040a7b0ae010a6b1c7fb1/users/985e9f2f783e4a329e9a4c100a06134c/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:52.037578 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb5acb1-b633-4e83-94c0-3028c24cf7a3 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:52.043383 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b303d9d-700c-4e55-be78-673960b17803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:52.044085 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b303d9d-700c-4e55-be78-673960b17803 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:52.045295 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b303d9d-700c-4e55-be78-673960b17803 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:52.045295 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b303d9d-700c-4e55-be78-673960b17803 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:52.045484 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b303d9d-700c-4e55-be78-673960b17803 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:52.046934 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b303d9d-700c-4e55-be78-673960b17803 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:52.048022 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d6b450-bb21-4639-8555-8937cf06832e admin admin] RBAC: Authorizing `identity:create_grant(project_id=62ef4614a33040a7b0ae010a6b1c7fb1, user_id=985e9f2f783e4a329e9a4c100a06134c, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:52.050942 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d6b450-bb21-4639-8555-8937cf06832e admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:52.057300 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1640/3309] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:19:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:19:52.061418 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b303d9d-700c-4e55-be78-673960b17803 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:52.071612 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b303d9d-700c-4e55-be78-673960b17803 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:52.076311 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb050df2-1c5b-41af-993a-7397df696b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:52.077189 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb050df2-1c5b-41af-993a-7397df696b86 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:52.077504 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb050df2-1c5b-41af-993a-7397df696b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:52.077845 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb050df2-1c5b-41af-993a-7397df696b86 admin admin] PATH_INFO: `/v3/projects/904c346b4498441ea9b47d0338b1467d/users/f7f42e7df2b54920ab214f04af115ea8/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:52.093816 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb050df2-1c5b-41af-993a-7397df696b86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=904c346b4498441ea9b47d0338b1467d, user_id=f7f42e7df2b54920ab214f04af115ea8, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:52.097401 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb050df2-1c5b-41af-993a-7397df696b86 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:52.121050 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1670/3310] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:19:52 2022] PUT /identity/v3/projects/62ef4614a33040a7b0ae010a6b1c7fb1/users/985e9f2f783e4a329e9a4c100a06134c/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:19:52.131722 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f68d4f-654d-486f-ae6b-aa3bc19b2e60 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:52.131722 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f68d4f-654d-486f-ae6b-aa3bc19b2e60 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:52.131722 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f68d4f-654d-486f-ae6b-aa3bc19b2e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:52.157008 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-84f68d4f-654d-486f-ae6b-aa3bc19b2e60 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:19:52.158559 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-84f68d4f-654d-486f-ae6b-aa3bc19b2e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:19:52.206525 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1641/3311] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:19:52 2022] PUT /identity/v3/projects/904c346b4498441ea9b47d0338b1467d/users/f7f42e7df2b54920ab214f04af115ea8/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:19:52.212762 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb050df2-1c5b-41af-993a-7397df696b86 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:52.274700 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1671/3312] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:19:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:19:52.294158 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f68d4f-654d-486f-ae6b-aa3bc19b2e60 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:52.297043 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-84f68d4f-654d-486f-ae6b-aa3bc19b2e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:19:52.344268 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb050df2-1c5b-41af-993a-7397df696b86 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:52.356575 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d3379-84c5-4fae-9568-23e3bae4c56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:52.358050 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d3379-84c5-4fae-9568-23e3bae4c56c admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:52.358565 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d3379-84c5-4fae-9568-23e3bae4c56c admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:52.359005 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d3379-84c5-4fae-9568-23e3bae4c56c admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:52.360312 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067d3379-84c5-4fae-9568-23e3bae4c56c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:52.365128 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067d3379-84c5-4fae-9568-23e3bae4c56c admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:52.395196 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1642/3313] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:19:52 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:19:52.403570 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d3379-84c5-4fae-9568-23e3bae4c56c admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:52.437929 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d3379-84c5-4fae-9568-23e3bae4c56c admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:52.453016 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86169ad6-1d8b-498b-85ca-ba4c61ec9ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:52.453917 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86169ad6-1d8b-498b-85ca-ba4c61ec9ceb admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:52.454393 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86169ad6-1d8b-498b-85ca-ba4c61ec9ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:52.454664 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86169ad6-1d8b-498b-85ca-ba4c61ec9ceb admin admin] PATH_INFO: `/v3/projects/904c346b4498441ea9b47d0338b1467d/users/f7f42e7df2b54920ab214f04af115ea8/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:52.457622 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86169ad6-1d8b-498b-85ca-ba4c61ec9ceb admin admin] RBAC: Authorizing `identity:create_grant(project_id=904c346b4498441ea9b47d0338b1467d, user_id=f7f42e7df2b54920ab214f04af115ea8, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:52.460807 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86169ad6-1d8b-498b-85ca-ba4c61ec9ceb admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:52.513096 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f68d4f-654d-486f-ae6b-aa3bc19b2e60 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:52.513700 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1643/3314] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:19:52 2022] PUT /identity/v3/projects/904c346b4498441ea9b47d0338b1467d/users/f7f42e7df2b54920ab214f04af115ea8/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:19:52.513700 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2300b2-55de-405a-8bd6-fa7240b48934 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:52.513994 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2300b2-55de-405a-8bd6-fa7240b48934 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:52.514217 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2300b2-55de-405a-8bd6-fa7240b48934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:52.630805 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-ea2300b2-55de-405a-8bd6-fa7240b48934 None None] MFA Rules not processed for user `f7f42e7df2b54920ab214f04af115ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:19:52.631962 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e3ba48-8e8c-4230-a15b-f9d4c91c377f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:52.632495 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-ea2300b2-55de-405a-8bd6-fa7240b48934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:19:52.632932 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e3ba48-8e8c-4230-a15b-f9d4c91c377f service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:52.633291 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e3ba48-8e8c-4230-a15b-f9d4c91c377f service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:52.633651 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e3ba48-8e8c-4230-a15b-f9d4c91c377f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:52.720420 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e3ba48-8e8c-4230-a15b-f9d4c91c377f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:52.722559 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e3ba48-8e8c-4230-a15b-f9d4c91c377f service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:52.734975 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1644/3315] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:19:52 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:19:52.743719 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1672/3316] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:19:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:19:52.751578 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2300b2-55de-405a-8bd6-fa7240b48934 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:52.755323 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-ea2300b2-55de-405a-8bd6-fa7240b48934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:19:52.851527 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2300b2-55de-405a-8bd6-fa7240b48934 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:52.859243 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aac19d3-161a-4f56-a65a-9eb1cf395628 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:52.860361 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac19d3-161a-4f56-a65a-9eb1cf395628 service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:52.860679 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac19d3-161a-4f56-a65a-9eb1cf395628 service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:52.860983 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac19d3-161a-4f56-a65a-9eb1cf395628 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:52.875462 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aac19d3-161a-4f56-a65a-9eb1cf395628 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:52.876097 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aac19d3-161a-4f56-a65a-9eb1cf395628 service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:52.890248 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1645/3317] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:19:52 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:19:53.110256 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e3ba48-8e8c-4230-a15b-f9d4c91c377f service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:53.121293 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e3ba48-8e8c-4230-a15b-f9d4c91c377f service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:53.130366 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358a4437-a74b-4ea5-b04d-5654239dd006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:53.131336 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a4437-a74b-4ea5-b04d-5654239dd006 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:53.131720 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a4437-a74b-4ea5-b04d-5654239dd006 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:53.131996 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a4437-a74b-4ea5-b04d-5654239dd006 admin admin] PATH_INFO: `/v3/users/fd43529ae5024e8484edd1d6fdce3b8c` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:53.133483 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358a4437-a74b-4ea5-b04d-5654239dd006 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd43529ae5024e8484edd1d6fdce3b8c)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:53.135783 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358a4437-a74b-4ea5-b04d-5654239dd006 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:53.400954 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-358a4437-a74b-4ea5-b04d-5654239dd006 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd43529ae5024e8484edd1d6fdce3b8c'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:53.414439 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-358a4437-a74b-4ea5-b04d-5654239dd006 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd43529ae5024e8484edd1d6fdce3b8c'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:53.421256 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-358a4437-a74b-4ea5-b04d-5654239dd006 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd43529ae5024e8484edd1d6fdce3b8c'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:53.553853 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-358a4437-a74b-4ea5-b04d-5654239dd006 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd43529ae5024e8484edd1d6fdce3b8c'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:53.554774 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-358a4437-a74b-4ea5-b04d-5654239dd006 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd43529ae5024e8484edd1d6fdce3b8c'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:53.561862 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1673/3318] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:19:53 2022] DELETE /identity/v3/users/fd43529ae5024e8484edd1d6fdce3b8c => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:19:53.567657 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca9718-c6c5-4078-8e87-637778f3830b None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:53.568739 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca9718-c6c5-4078-8e87-637778f3830b None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:53.569417 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca9718-c6c5-4078-8e87-637778f3830b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:53.597397 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-9aca9718-c6c5-4078-8e87-637778f3830b None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:19:53.598923 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-9aca9718-c6c5-4078-8e87-637778f3830b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:19:53.731213 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1646/3319] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:19:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:19:53.744748 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358a4437-a74b-4ea5-b04d-5654239dd006 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:53.747342 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-358a4437-a74b-4ea5-b04d-5654239dd006 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:19:53.865430 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358a4437-a74b-4ea5-b04d-5654239dd006 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:53.869524 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb8f73a-e085-43db-9b95-76d5f1bdb3f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:53.870188 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb8f73a-e085-43db-9b95-76d5f1bdb3f5 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:53.870455 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb8f73a-e085-43db-9b95-76d5f1bdb3f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:53.870922 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb8f73a-e085-43db-9b95-76d5f1bdb3f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:53.888786 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb8f73a-e085-43db-9b95-76d5f1bdb3f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:53.890669 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb8f73a-e085-43db-9b95-76d5f1bdb3f5 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:53.903965 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1674/3320] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:19:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:19:54.910305 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf2b4d-b216-4260-bf11-30da0d0314db None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:54.910305 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf2b4d-b216-4260-bf11-30da0d0314db None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:54.910305 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf2b4d-b216-4260-bf11-30da0d0314db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:54.943241 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb8f73a-e085-43db-9b95-76d5f1bdb3f5 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:54.945406 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-1eb8f73a-e085-43db-9b95-76d5f1bdb3f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:19:54.967030 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-4ebf2b4d-b216-4260-bf11-30da0d0314db None None] MFA Rules not processed for user `985e9f2f783e4a329e9a4c100a06134c`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:19:54.968271 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-4ebf2b4d-b216-4260-bf11-30da0d0314db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:19:54.970362 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb8f73a-e085-43db-9b95-76d5f1bdb3f5 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:54.978394 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff98f6e-b2b2-4824-a85a-6fd704d95568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:54.979306 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff98f6e-b2b2-4824-a85a-6fd704d95568 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:54.979622 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff98f6e-b2b2-4824-a85a-6fd704d95568 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:54.988346 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff98f6e-b2b2-4824-a85a-6fd704d95568 admin admin] PATH_INFO: `/v3/projects/5fa2838f6bea4fd5a945d7e52fc4f98b` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:54.999742 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff98f6e-b2b2-4824-a85a-6fd704d95568 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fa2838f6bea4fd5a945d7e52fc4f98b)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:55.001693 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff98f6e-b2b2-4824-a85a-6fd704d95568 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:55.076555 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1647/3321] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:19:54 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:19:55.162885 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebf2b4d-b216-4260-bf11-30da0d0314db None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:55.164383 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-4ebf2b4d-b216-4260-bf11-30da0d0314db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:19:55.202194 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2ff98f6e-b2b2-4824-a85a-6fd704d95568 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fa2838f6bea4fd5a945d7e52fc4f98b', 'request_id': 'req-2ff98f6e-b2b2-4824-a85a-6fd704d95568'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:55.209984 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2ff98f6e-b2b2-4824-a85a-6fd704d95568 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fa2838f6bea4fd5a945d7e52fc4f98b', 'request_id': 'req-2ff98f6e-b2b2-4824-a85a-6fd704d95568'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:55.261245 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebf2b4d-b216-4260-bf11-30da0d0314db None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:55.299723 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2ff98f6e-b2b2-4824-a85a-6fd704d95568 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fa2838f6bea4fd5a945d7e52fc4f98b', 'request_id': 'req-2ff98f6e-b2b2-4824-a85a-6fd704d95568'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:55.321043 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2ff98f6e-b2b2-4824-a85a-6fd704d95568 admin admin] The token cache is being invalidate because project 5fa2838f6bea4fd5a945d7e52fc4f98b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:19:55.325870 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2ff98f6e-b2b2-4824-a85a-6fd704d95568 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:55.325870 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2ff98f6e-b2b2-4824-a85a-6fd704d95568 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:55.325870 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1675/3322] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:19:54 2022] DELETE /identity/v3/projects/5fa2838f6bea4fd5a945d7e52fc4f98b => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:19:55.330315 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff98f6e-b2b2-4824-a85a-6fd704d95568 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:55.332919 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-2ff98f6e-b2b2-4824-a85a-6fd704d95568 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:19:55.342493 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2a93de-c946-4b81-b368-fdba1f460f70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:55.343154 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a93de-c946-4b81-b368-fdba1f460f70 service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:55.343436 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a93de-c946-4b81-b368-fdba1f460f70 service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:55.343763 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a93de-c946-4b81-b368-fdba1f460f70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:55.348287 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-bb2a93de-c946-4b81-b368-fdba1f460f70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:19:55.427019 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff98f6e-b2b2-4824-a85a-6fd704d95568 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:55.433487 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6530a3-f224-42fb-85cf-57814a74b196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:55.434519 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6530a3-f224-42fb-85cf-57814a74b196 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:55.434870 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6530a3-f224-42fb-85cf-57814a74b196 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:55.435218 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6530a3-f224-42fb-85cf-57814a74b196 admin admin] PATH_INFO: `/v3/users/f7f42e7df2b54920ab214f04af115ea8` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:55.436746 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6530a3-f224-42fb-85cf-57814a74b196 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7f42e7df2b54920ab214f04af115ea8)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:55.438888 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6530a3-f224-42fb-85cf-57814a74b196 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:55.439326 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2a93de-c946-4b81-b368-fdba1f460f70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:55.441555 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2a93de-c946-4b81-b368-fdba1f460f70 service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:55.454623 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1648/3323] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:19:55 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:19:55.644850 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5f6530a3-f224-42fb-85cf-57814a74b196 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7f42e7df2b54920ab214f04af115ea8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:55.658967 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5f6530a3-f224-42fb-85cf-57814a74b196 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7f42e7df2b54920ab214f04af115ea8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:55.666562 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5f6530a3-f224-42fb-85cf-57814a74b196 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7f42e7df2b54920ab214f04af115ea8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:55.740578 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5f6530a3-f224-42fb-85cf-57814a74b196 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7f42e7df2b54920ab214f04af115ea8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:55.744684 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5f6530a3-f224-42fb-85cf-57814a74b196 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7f42e7df2b54920ab214f04af115ea8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:55.752542 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1676/3324] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:19:55 2022] DELETE /identity/v3/users/f7f42e7df2b54920ab214f04af115ea8 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:19:56.304456 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2a93de-c946-4b81-b368-fdba1f460f70 service nova] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:56.345458 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2a93de-c946-4b81-b368-fdba1f460f70 service nova] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:56.424166 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47be8c79-4815-41c0-a5da-fc35ce50ef19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:56.425402 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be8c79-4815-41c0-a5da-fc35ce50ef19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:56.425830 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be8c79-4815-41c0-a5da-fc35ce50ef19 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:56.426142 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be8c79-4815-41c0-a5da-fc35ce50ef19 admin admin] PATH_INFO: `/v3/projects/904c346b4498441ea9b47d0338b1467d` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:56.427616 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47be8c79-4815-41c0-a5da-fc35ce50ef19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=904c346b4498441ea9b47d0338b1467d)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:56.429673 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47be8c79-4815-41c0-a5da-fc35ce50ef19 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:56.569590 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-47be8c79-4815-41c0-a5da-fc35ce50ef19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '904c346b4498441ea9b47d0338b1467d', 'request_id': 'req-47be8c79-4815-41c0-a5da-fc35ce50ef19'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:56.576322 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-47be8c79-4815-41c0-a5da-fc35ce50ef19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '904c346b4498441ea9b47d0338b1467d', 'request_id': 'req-47be8c79-4815-41c0-a5da-fc35ce50ef19'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:56.598685 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-47be8c79-4815-41c0-a5da-fc35ce50ef19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '904c346b4498441ea9b47d0338b1467d', 'request_id': 'req-47be8c79-4815-41c0-a5da-fc35ce50ef19'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:56.679505 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-47be8c79-4815-41c0-a5da-fc35ce50ef19 admin admin] The token cache is being invalidate because project 904c346b4498441ea9b47d0338b1467d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:19:56.679900 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-47be8c79-4815-41c0-a5da-fc35ce50ef19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:56.680753 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-47be8c79-4815-41c0-a5da-fc35ce50ef19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:56.682525 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1649/3325] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:19:56 2022] DELETE /identity/v3/projects/904c346b4498441ea9b47d0338b1467d => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:19:56.687450 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd268bb7-bd40-4f12-bcfe-8d08705ddd3a None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:56.687973 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd268bb7-bd40-4f12-bcfe-8d08705ddd3a None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:56.688131 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd268bb7-bd40-4f12-bcfe-8d08705ddd3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:56.710927 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-fd268bb7-bd40-4f12-bcfe-8d08705ddd3a None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:19:56.712432 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-fd268bb7-bd40-4f12-bcfe-8d08705ddd3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:19:56.823718 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1677/3326] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:19:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:19:56.826673 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158955d-942a-440d-ad80-391225682eed None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:56.826970 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158955d-942a-440d-ad80-391225682eed None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:56.827249 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158955d-942a-440d-ad80-391225682eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:56.860775 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-f158955d-942a-440d-ad80-391225682eed None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:19:56.862529 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-f158955d-942a-440d-ad80-391225682eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:19:56.878804 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1650/3327] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:19:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:19:56.879933 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd268bb7-bd40-4f12-bcfe-8d08705ddd3a None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:56.891221 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd268bb7-bd40-4f12-bcfe-8d08705ddd3a None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:56.904004 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb4eba3-dcbb-46e0-ae04-8c7b678f34cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:56.904749 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4eba3-dcbb-46e0-ae04-8c7b678f34cb admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:56.905031 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4eba3-dcbb-46e0-ae04-8c7b678f34cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:56.905305 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4eba3-dcbb-46e0-ae04-8c7b678f34cb admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:56.906068 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb4eba3-dcbb-46e0-ae04-8c7b678f34cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:19:56.906374 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb4eba3-dcbb-46e0-ae04-8c7b678f34cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:56.908080 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb4eba3-dcbb-46e0-ae04-8c7b678f34cb admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:56.927537 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1678/3328] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:19:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:19:56.929583 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f158955d-942a-440d-ad80-391225682eed None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:56.940251 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f158955d-942a-440d-ad80-391225682eed None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:56.948054 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfae512a-b8da-45e8-af0b-a85bf7e6891a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:56.948771 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae512a-b8da-45e8-af0b-a85bf7e6891a admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:56.949055 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae512a-b8da-45e8-af0b-a85bf7e6891a admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:56.949442 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae512a-b8da-45e8-af0b-a85bf7e6891a admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:56.950028 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfae512a-b8da-45e8-af0b-a85bf7e6891a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:56.952529 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfae512a-b8da-45e8-af0b-a85bf7e6891a admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:57.063708 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb84cd-3744-46b8-b98c-05a9dda96af9 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:57.064007 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb84cd-3744-46b8-b98c-05a9dda96af9 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:57.064287 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb84cd-3744-46b8-b98c-05a9dda96af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:57.078761 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1651/3329] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:19:56 2022] POST /identity/v3/projects => generated 381 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:19:57.083501 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfae512a-b8da-45e8-af0b-a85bf7e6891a admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:57.097078 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-40cb84cd-3744-46b8-b98c-05a9dda96af9 None None] MFA Rules not processed for user `985e9f2f783e4a329e9a4c100a06134c`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:19:57.099709 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-40cb84cd-3744-46b8-b98c-05a9dda96af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:19:57.191915 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1679/3330] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:19:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:19:57.217051 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfae512a-b8da-45e8-af0b-a85bf7e6891a admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:57.224386 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b4d0da-3b4a-4c55-9cfe-b9bc6b165c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:57.225552 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b4d0da-3b4a-4c55-9cfe-b9bc6b165c39 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:57.226004 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b4d0da-3b4a-4c55-9cfe-b9bc6b165c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:57.226437 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b4d0da-3b4a-4c55-9cfe-b9bc6b165c39 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:57.227305 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b4d0da-3b4a-4c55-9cfe-b9bc6b165c39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:57.230234 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b4d0da-3b4a-4c55-9cfe-b9bc6b165c39 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:57.332052 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1652/3331] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:19:57 2022] POST /identity/v3/users => generated 291 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:19:57.334050 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cb84cd-3744-46b8-b98c-05a9dda96af9 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:57.347371 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cb84cd-3744-46b8-b98c-05a9dda96af9 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:57.354020 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a99abf5-b0d7-4c96-b60a-3408a35fbe59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:57.354772 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99abf5-b0d7-4c96-b60a-3408a35fbe59 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:57.355066 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99abf5-b0d7-4c96-b60a-3408a35fbe59 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:57.355347 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99abf5-b0d7-4c96-b60a-3408a35fbe59 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:57.356130 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a99abf5-b0d7-4c96-b60a-3408a35fbe59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:57.357864 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a99abf5-b0d7-4c96-b60a-3408a35fbe59 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:57.372285 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1680/3332] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:19:57 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:19:57.373557 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b4d0da-3b4a-4c55-9cfe-b9bc6b165c39 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:57.387394 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b4d0da-3b4a-4c55-9cfe-b9bc6b165c39 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:57.394374 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b17753-0ef4-4990-b385-558122544667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:57.395246 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b17753-0ef4-4990-b385-558122544667 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:57.395681 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b17753-0ef4-4990-b385-558122544667 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:57.396055 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b17753-0ef4-4990-b385-558122544667 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:57.396891 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b17753-0ef4-4990-b385-558122544667 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:57.398702 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b17753-0ef4-4990-b385-558122544667 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:57.412136 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1653/3333] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:19:57 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:19:57.415939 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a99abf5-b0d7-4c96-b60a-3408a35fbe59 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:57.431132 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a99abf5-b0d7-4c96-b60a-3408a35fbe59 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:57.441145 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d8e304-2589-4a9b-89c1-d8d9f94aa98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:57.442321 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d8e304-2589-4a9b-89c1-d8d9f94aa98e admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:57.442751 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d8e304-2589-4a9b-89c1-d8d9f94aa98e admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:57.443185 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d8e304-2589-4a9b-89c1-d8d9f94aa98e admin admin] PATH_INFO: `/v3/projects/0836fd7ee18244cca109e577b9194b2a/users/3e9d68295c424cd29e55832142029113/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:57.463081 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d8e304-2589-4a9b-89c1-d8d9f94aa98e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0836fd7ee18244cca109e577b9194b2a, user_id=3e9d68295c424cd29e55832142029113, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:57.466687 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d8e304-2589-4a9b-89c1-d8d9f94aa98e admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:57.579605 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1681/3334] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:19:57 2022] PUT /identity/v3/projects/0836fd7ee18244cca109e577b9194b2a/users/3e9d68295c424cd29e55832142029113/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:19:57.582745 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3a6380-7593-40b4-ae4f-badf0664db2b None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:57.583043 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3a6380-7593-40b4-ae4f-badf0664db2b None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:57.583324 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3a6380-7593-40b4-ae4f-badf0664db2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:57.615243 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-0f3a6380-7593-40b4-ae4f-badf0664db2b None None] MFA Rules not processed for user `3e9d68295c424cd29e55832142029113`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:19:57.616521 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-0f3a6380-7593-40b4-ae4f-badf0664db2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:19:57.760436 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1654/3335] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:19:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:19:57.771546 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d8e304-2589-4a9b-89c1-d8d9f94aa98e admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:57.776305 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e3d8e304-2589-4a9b-89c1-d8d9f94aa98e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:19:57.869633 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d8e304-2589-4a9b-89c1-d8d9f94aa98e admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:57.874339 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434f8e54-4d9f-44bd-98ef-b3c6a5242cf5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b5cb86f190f4fcfb06d66cb8f14643f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:57.875048 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f8e54-4d9f-44bd-98ef-b3c6a5242cf5 service glance] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:57.875371 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f8e54-4d9f-44bd-98ef-b3c6a5242cf5 service glance] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:57.875684 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f8e54-4d9f-44bd-98ef-b3c6a5242cf5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:57.886817 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434f8e54-4d9f-44bd-98ef-b3c6a5242cf5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:57.888961 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434f8e54-4d9f-44bd-98ef-b3c6a5242cf5 service glance] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:57.913407 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1682/3336] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:19:57 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:19:58.291056 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee7f210-791a-45a2-abc8-1427b8d14f74 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:58.291351 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee7f210-791a-45a2-abc8-1427b8d14f74 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:58.291680 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee7f210-791a-45a2-abc8-1427b8d14f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:58.314003 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-7ee7f210-791a-45a2-abc8-1427b8d14f74 None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:19:58.314003 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-7ee7f210-791a-45a2-abc8-1427b8d14f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:19:58.402703 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1655/3337] 10.222.0.52 () {58 vars in 1009 bytes} [Sat May 14 21:19:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:19:58.416477 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434f8e54-4d9f-44bd-98ef-b3c6a5242cf5 service glance] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:58.417992 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-434f8e54-4d9f-44bd-98ef-b3c6a5242cf5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:19:58.520076 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434f8e54-4d9f-44bd-98ef-b3c6a5242cf5 service glance] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:58.520076 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3dc397-7f8b-4efc-9e5f-69f0f8fd310b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:58.520076 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3dc397-7f8b-4efc-9e5f-69f0f8fd310b service swift] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:58.520076 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3dc397-7f8b-4efc-9e5f-69f0f8fd310b service swift] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:58.520954 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3dc397-7f8b-4efc-9e5f-69f0f8fd310b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:58.553189 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3dc397-7f8b-4efc-9e5f-69f0f8fd310b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:58.558278 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3dc397-7f8b-4efc-9e5f-69f0f8fd310b service swift] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:58.575043 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1683/3338] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 21:19:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 21:19:59.057034 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee7f210-791a-45a2-abc8-1427b8d14f74 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:59.057455 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-7ee7f210-791a-45a2-abc8-1427b8d14f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:19:59.119534 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee7f210-791a-45a2-abc8-1427b8d14f74 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:59.123264 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d47a7-fb29-4c2b-a5bb-49e0de38e8ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:59.123939 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d47a7-fb29-4c2b-a5bb-49e0de38e8ff service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:59.124414 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d47a7-fb29-4c2b-a5bb-49e0de38e8ff service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:59.124686 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d47a7-fb29-4c2b-a5bb-49e0de38e8ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:59.126553 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-922d47a7-fb29-4c2b-a5bb-49e0de38e8ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:19:59.190034 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3dc397-7f8b-4efc-9e5f-69f0f8fd310b service swift] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:19:59.191622 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-cc3dc397-7f8b-4efc-9e5f-69f0f8fd310b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:19:59.224645 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922d47a7-fb29-4c2b-a5bb-49e0de38e8ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:59.226134 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922d47a7-fb29-4c2b-a5bb-49e0de38e8ff service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:59.239218 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1656/3339] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:19:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:19:59.295603 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3dc397-7f8b-4efc-9e5f-69f0f8fd310b service swift] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:19:59.304100 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5d1753-4fa6-4397-9963-947c7e8f29e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:19:59.304100 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d1753-4fa6-4397-9963-947c7e8f29e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:19:59.304100 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d1753-4fa6-4397-9963-947c7e8f29e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:19:59.304100 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d1753-4fa6-4397-9963-947c7e8f29e8 admin admin] PATH_INFO: `/v3/users/8bb480362ced445da9819798a17819c3` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:19:59.305283 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5d1753-4fa6-4397-9963-947c7e8f29e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bb480362ced445da9819798a17819c3)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:19:59.307240 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5d1753-4fa6-4397-9963-947c7e8f29e8 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:19:59.525420 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0a5d1753-4fa6-4397-9963-947c7e8f29e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bb480362ced445da9819798a17819c3'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:59.546274 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0a5d1753-4fa6-4397-9963-947c7e8f29e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bb480362ced445da9819798a17819c3'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:59.557298 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0a5d1753-4fa6-4397-9963-947c7e8f29e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bb480362ced445da9819798a17819c3'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:59.700849 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0a5d1753-4fa6-4397-9963-947c7e8f29e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bb480362ced445da9819798a17819c3'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:59.702597 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0a5d1753-4fa6-4397-9963-947c7e8f29e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bb480362ced445da9819798a17819c3'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:19:59.710663 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1684/3340] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:19:59 2022] DELETE /identity/v3/users/8bb480362ced445da9819798a17819c3 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:20:00.071507 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d47a7-fb29-4c2b-a5bb-49e0de38e8ff service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:00.084616 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d47a7-fb29-4c2b-a5bb-49e0de38e8ff service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:00.152885 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9f8e05-6e72-42cf-acd5-cbbfdd2ed7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:00.153831 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f8e05-6e72-42cf-acd5-cbbfdd2ed7fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:00.154300 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f8e05-6e72-42cf-acd5-cbbfdd2ed7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:00.154642 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f8e05-6e72-42cf-acd5-cbbfdd2ed7fd admin admin] PATH_INFO: `/v3/projects/7c7360a8f423452e97311ffc9675e801` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:00.155955 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9f8e05-6e72-42cf-acd5-cbbfdd2ed7fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c7360a8f423452e97311ffc9675e801)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:00.157998 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9f8e05-6e72-42cf-acd5-cbbfdd2ed7fd admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:00.296117 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3f9f8e05-6e72-42cf-acd5-cbbfdd2ed7fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c7360a8f423452e97311ffc9675e801', 'request_id': 'req-3f9f8e05-6e72-42cf-acd5-cbbfdd2ed7fd'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:00.302420 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3f9f8e05-6e72-42cf-acd5-cbbfdd2ed7fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c7360a8f423452e97311ffc9675e801', 'request_id': 'req-3f9f8e05-6e72-42cf-acd5-cbbfdd2ed7fd'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:00.310181 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3f9f8e05-6e72-42cf-acd5-cbbfdd2ed7fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c7360a8f423452e97311ffc9675e801', 'request_id': 'req-3f9f8e05-6e72-42cf-acd5-cbbfdd2ed7fd'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:00.393493 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3f9f8e05-6e72-42cf-acd5-cbbfdd2ed7fd admin admin] The token cache is being invalidate because project 7c7360a8f423452e97311ffc9675e801 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:20:00.396518 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3f9f8e05-6e72-42cf-acd5-cbbfdd2ed7fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:00.396518 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3f9f8e05-6e72-42cf-acd5-cbbfdd2ed7fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:00.396766 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1657/3341] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:20:00 2022] DELETE /identity/v3/projects/7c7360a8f423452e97311ffc9675e801 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:20:00.401787 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c4ebc-0fce-4994-8f1b-1710b94821fa None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:00.402330 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c4ebc-0fce-4994-8f1b-1710b94821fa None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:00.402451 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c4ebc-0fce-4994-8f1b-1710b94821fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:00.433000 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-dc7c4ebc-0fce-4994-8f1b-1710b94821fa None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:20:00.434555 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-dc7c4ebc-0fce-4994-8f1b-1710b94821fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:00.510450 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1685/3342] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:20:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:20:00.519239 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348efa2e-464e-447f-97a6-1d78fbe452c7 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:00.519598 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348efa2e-464e-447f-97a6-1d78fbe452c7 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:00.520058 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348efa2e-464e-447f-97a6-1d78fbe452c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:00.541567 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-348efa2e-464e-447f-97a6-1d78fbe452c7 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:20:00.543078 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-348efa2e-464e-447f-97a6-1d78fbe452c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:00.553464 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1658/3343] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:20:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:20:00.557914 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7c4ebc-0fce-4994-8f1b-1710b94821fa None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:00.568227 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7c4ebc-0fce-4994-8f1b-1710b94821fa None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:00.573473 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713f16b3-d1f0-4bfa-acf4-5272454d8a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:00.574173 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f16b3-d1f0-4bfa-acf4-5272454d8a77 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:00.574642 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f16b3-d1f0-4bfa-acf4-5272454d8a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:00.575128 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f16b3-d1f0-4bfa-acf4-5272454d8a77 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:00.576049 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713f16b3-d1f0-4bfa-acf4-5272454d8a77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:20:00.576541 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713f16b3-d1f0-4bfa-acf4-5272454d8a77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:00.591774 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713f16b3-d1f0-4bfa-acf4-5272454d8a77 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:00.607537 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1686/3344] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:20:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:20:00.608732 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348efa2e-464e-447f-97a6-1d78fbe452c7 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:00.621578 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348efa2e-464e-447f-97a6-1d78fbe452c7 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:00.642771 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf177e-0e67-462b-8642-b13fa11f73c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:00.645810 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf177e-0e67-462b-8642-b13fa11f73c5 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:00.646218 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf177e-0e67-462b-8642-b13fa11f73c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:00.647391 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf177e-0e67-462b-8642-b13fa11f73c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:00.649151 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccf177e-0e67-462b-8642-b13fa11f73c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:00.651998 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccf177e-0e67-462b-8642-b13fa11f73c5 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:00.778352 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1659/3345] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:20:00 2022] POST /identity/v3/projects => generated 395 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:20:00.781898 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713f16b3-d1f0-4bfa-acf4-5272454d8a77 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:00.797617 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713f16b3-d1f0-4bfa-acf4-5272454d8a77 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:00.921893 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68337b07-3b0d-45ff-b24a-3757594e2ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:00.923294 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68337b07-3b0d-45ff-b24a-3757594e2ecd admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:00.923745 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68337b07-3b0d-45ff-b24a-3757594e2ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:00.924925 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68337b07-3b0d-45ff-b24a-3757594e2ecd admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:00.926278 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68337b07-3b0d-45ff-b24a-3757594e2ecd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:00.928570 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68337b07-3b0d-45ff-b24a-3757594e2ecd admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:01.040417 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1687/3346] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:20:00 2022] POST /identity/v3/users => generated 298 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:20:01.044550 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf177e-0e67-462b-8642-b13fa11f73c5 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:01.056022 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf177e-0e67-462b-8642-b13fa11f73c5 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:01.065925 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc19ddec-94ac-425e-ab62-aaf196cd69fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:01.066803 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc19ddec-94ac-425e-ab62-aaf196cd69fb admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:01.067192 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc19ddec-94ac-425e-ab62-aaf196cd69fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:01.068524 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc19ddec-94ac-425e-ab62-aaf196cd69fb admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:01.071128 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc19ddec-94ac-425e-ab62-aaf196cd69fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:01.071874 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc19ddec-94ac-425e-ab62-aaf196cd69fb admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:01.094566 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68337b07-3b0d-45ff-b24a-3757594e2ecd admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:01.095137 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1660/3347] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:20:01 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:20:01.108157 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68337b07-3b0d-45ff-b24a-3757594e2ecd admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:01.118431 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe8230b-171c-4df3-914d-dc0cdb7d3db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:01.119330 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8230b-171c-4df3-914d-dc0cdb7d3db5 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:01.119740 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8230b-171c-4df3-914d-dc0cdb7d3db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:01.120091 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8230b-171c-4df3-914d-dc0cdb7d3db5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:01.121031 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe8230b-171c-4df3-914d-dc0cdb7d3db5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:01.122859 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe8230b-171c-4df3-914d-dc0cdb7d3db5 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:01.137022 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1688/3348] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:20:01 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:20:01.141275 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc19ddec-94ac-425e-ab62-aaf196cd69fb admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:01.152644 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc19ddec-94ac-425e-ab62-aaf196cd69fb admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:01.158763 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47d4a6e-51a5-414a-85dc-0f9decdb056c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:01.160775 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d4a6e-51a5-414a-85dc-0f9decdb056c admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:01.161180 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d4a6e-51a5-414a-85dc-0f9decdb056c admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:01.161550 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d4a6e-51a5-414a-85dc-0f9decdb056c admin admin] PATH_INFO: `/v3/projects/d272971274514577b827dd8ac81c9e58/users/b3b5b688171045d586128236e85aee0b/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:01.180328 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47d4a6e-51a5-414a-85dc-0f9decdb056c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d272971274514577b827dd8ac81c9e58, user_id=b3b5b688171045d586128236e85aee0b, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:01.183213 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47d4a6e-51a5-414a-85dc-0f9decdb056c admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:01.252046 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1661/3349] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:20:01 2022] PUT /identity/v3/projects/d272971274514577b827dd8ac81c9e58/users/b3b5b688171045d586128236e85aee0b/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:20:01.257254 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958880fb-1d0b-4d72-b409-2bb2f4f0459a None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:01.257548 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958880fb-1d0b-4d72-b409-2bb2f4f0459a None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:01.257835 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958880fb-1d0b-4d72-b409-2bb2f4f0459a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:01.280739 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-958880fb-1d0b-4d72-b409-2bb2f4f0459a None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:20:01.295705 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-958880fb-1d0b-4d72-b409-2bb2f4f0459a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:01.298423 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47d4a6e-51a5-414a-85dc-0f9decdb056c admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:01.300872 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-f47d4a6e-51a5-414a-85dc-0f9decdb056c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:01.379432 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1689/3350] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:20:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:20:01.390263 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958880fb-1d0b-4d72-b409-2bb2f4f0459a None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:01.391832 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-958880fb-1d0b-4d72-b409-2bb2f4f0459a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:01.403462 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47d4a6e-51a5-414a-85dc-0f9decdb056c admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:01.409571 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061084d1-5f49-462b-8998-b2c8c90bb2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:01.410947 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061084d1-5f49-462b-8998-b2c8c90bb2cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:01.411340 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061084d1-5f49-462b-8998-b2c8c90bb2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:01.411960 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061084d1-5f49-462b-8998-b2c8c90bb2cb admin admin] PATH_INFO: `/v3/users/038739f45c3d4ab09457d6eed20b41d4` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:01.413878 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061084d1-5f49-462b-8998-b2c8c90bb2cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=038739f45c3d4ab09457d6eed20b41d4)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:01.415988 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061084d1-5f49-462b-8998-b2c8c90bb2cb admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:01.459050 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958880fb-1d0b-4d72-b409-2bb2f4f0459a None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:01.463743 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d395c74f-35e2-48bc-bdec-643cef0f6b38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:01.464542 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d395c74f-35e2-48bc-bdec-643cef0f6b38 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:01.464909 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d395c74f-35e2-48bc-bdec-643cef0f6b38 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:01.465346 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d395c74f-35e2-48bc-bdec-643cef0f6b38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:01.477338 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d395c74f-35e2-48bc-bdec-643cef0f6b38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:01.478884 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d395c74f-35e2-48bc-bdec-643cef0f6b38 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:01.489110 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1690/3351] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:20:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:20:01.659573 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-061084d1-5f49-462b-8998-b2c8c90bb2cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '038739f45c3d4ab09457d6eed20b41d4'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:01.671598 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-061084d1-5f49-462b-8998-b2c8c90bb2cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '038739f45c3d4ab09457d6eed20b41d4'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:01.672556 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-061084d1-5f49-462b-8998-b2c8c90bb2cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '038739f45c3d4ab09457d6eed20b41d4'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:01.769100 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-061084d1-5f49-462b-8998-b2c8c90bb2cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '038739f45c3d4ab09457d6eed20b41d4'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:01.782808 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-061084d1-5f49-462b-8998-b2c8c90bb2cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '038739f45c3d4ab09457d6eed20b41d4'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:01.793328 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1662/3352] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:20:01 2022] DELETE /identity/v3/users/038739f45c3d4ab09457d6eed20b41d4 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:20:02.247561 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d395c74f-35e2-48bc-bdec-643cef0f6b38 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:02.269221 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d395c74f-35e2-48bc-bdec-643cef0f6b38 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:02.399580 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8907c664-d7a6-4719-b7d6-786d0b38d694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:02.403644 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907c664-d7a6-4719-b7d6-786d0b38d694 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:02.403644 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907c664-d7a6-4719-b7d6-786d0b38d694 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:02.403644 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907c664-d7a6-4719-b7d6-786d0b38d694 admin admin] PATH_INFO: `/v3/projects/763cf73206604d8abbe1542afe44fa95` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:02.403644 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8907c664-d7a6-4719-b7d6-786d0b38d694 admin admin] RBAC: Authorizing `identity:delete_project(project_id=763cf73206604d8abbe1542afe44fa95)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:02.405589 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8907c664-d7a6-4719-b7d6-786d0b38d694 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:02.542553 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8907c664-d7a6-4719-b7d6-786d0b38d694 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '763cf73206604d8abbe1542afe44fa95', 'request_id': 'req-8907c664-d7a6-4719-b7d6-786d0b38d694'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:02.566158 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8907c664-d7a6-4719-b7d6-786d0b38d694 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '763cf73206604d8abbe1542afe44fa95', 'request_id': 'req-8907c664-d7a6-4719-b7d6-786d0b38d694'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:02.665139 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8907c664-d7a6-4719-b7d6-786d0b38d694 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '763cf73206604d8abbe1542afe44fa95', 'request_id': 'req-8907c664-d7a6-4719-b7d6-786d0b38d694'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:02.678918 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8907c664-d7a6-4719-b7d6-786d0b38d694 admin admin] The token cache is being invalidate because project 763cf73206604d8abbe1542afe44fa95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:20:02.679299 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8907c664-d7a6-4719-b7d6-786d0b38d694 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:02.680059 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8907c664-d7a6-4719-b7d6-786d0b38d694 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:02.681965 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1691/3353] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:20:02 2022] DELETE /identity/v3/projects/763cf73206604d8abbe1542afe44fa95 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:20:02.685897 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061084d1-5f49-462b-8998-b2c8c90bb2cb admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:02.688178 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-061084d1-5f49-462b-8998-b2c8c90bb2cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:02.719916 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061084d1-5f49-462b-8998-b2c8c90bb2cb admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:02.835910 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f25b06-388c-4819-8f4b-c2e9dbe07b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:02.837249 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f25b06-388c-4819-8f4b-c2e9dbe07b12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:02.837696 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f25b06-388c-4819-8f4b-c2e9dbe07b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:02.838137 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f25b06-388c-4819-8f4b-c2e9dbe07b12 admin admin] PATH_INFO: `/v3/users/f704e225fb7d435da26a4f1339a0faf1` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:02.839780 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f25b06-388c-4819-8f4b-c2e9dbe07b12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f704e225fb7d435da26a4f1339a0faf1)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:02.842737 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f25b06-388c-4819-8f4b-c2e9dbe07b12 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:03.155346 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-16f25b06-388c-4819-8f4b-c2e9dbe07b12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f704e225fb7d435da26a4f1339a0faf1'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:03.203911 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-16f25b06-388c-4819-8f4b-c2e9dbe07b12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f704e225fb7d435da26a4f1339a0faf1'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:03.207707 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-16f25b06-388c-4819-8f4b-c2e9dbe07b12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f704e225fb7d435da26a4f1339a0faf1'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:03.356028 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-16f25b06-388c-4819-8f4b-c2e9dbe07b12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f704e225fb7d435da26a4f1339a0faf1'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:03.380816 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-16f25b06-388c-4819-8f4b-c2e9dbe07b12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f704e225fb7d435da26a4f1339a0faf1'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:03.398008 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1663/3354] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:20:02 2022] DELETE /identity/v3/users/f704e225fb7d435da26a4f1339a0faf1 => generated 0 bytes in 713 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:20:03.782164 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8907c664-d7a6-4719-b7d6-786d0b38d694 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:03.786007 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-8907c664-d7a6-4719-b7d6-786d0b38d694 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:03.818900 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8907c664-d7a6-4719-b7d6-786d0b38d694 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:03.918999 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e9c8b-7591-4afa-ad84-8df4f98a54a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:03.921835 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e9c8b-7591-4afa-ad84-8df4f98a54a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:03.922111 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e9c8b-7591-4afa-ad84-8df4f98a54a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:03.922387 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e9c8b-7591-4afa-ad84-8df4f98a54a3 admin admin] PATH_INFO: `/v3/projects/f6c4c973d1e544538b031b0d123cd1b2` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:03.927128 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8e9c8b-7591-4afa-ad84-8df4f98a54a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6c4c973d1e544538b031b0d123cd1b2)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:03.931823 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8e9c8b-7591-4afa-ad84-8df4f98a54a3 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:04.110352 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9a8e9c8b-7591-4afa-ad84-8df4f98a54a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6c4c973d1e544538b031b0d123cd1b2', 'request_id': 'req-9a8e9c8b-7591-4afa-ad84-8df4f98a54a3'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:04.119225 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9a8e9c8b-7591-4afa-ad84-8df4f98a54a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6c4c973d1e544538b031b0d123cd1b2', 'request_id': 'req-9a8e9c8b-7591-4afa-ad84-8df4f98a54a3'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:04.210358 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9a8e9c8b-7591-4afa-ad84-8df4f98a54a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6c4c973d1e544538b031b0d123cd1b2', 'request_id': 'req-9a8e9c8b-7591-4afa-ad84-8df4f98a54a3'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:04.239823 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9a8e9c8b-7591-4afa-ad84-8df4f98a54a3 admin admin] The token cache is being invalidate because project f6c4c973d1e544538b031b0d123cd1b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:20:04.240119 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9a8e9c8b-7591-4afa-ad84-8df4f98a54a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:04.244181 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9a8e9c8b-7591-4afa-ad84-8df4f98a54a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:04.248094 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1692/3355] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:20:03 2022] DELETE /identity/v3/projects/f6c4c973d1e544538b031b0d123cd1b2 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:20:04.254252 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245afa34-f9d2-4fe4-9f69-4cfbd6016715 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:04.254252 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245afa34-f9d2-4fe4-9f69-4cfbd6016715 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:04.254252 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245afa34-f9d2-4fe4-9f69-4cfbd6016715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:04.280618 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-245afa34-f9d2-4fe4-9f69-4cfbd6016715 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:20:04.282834 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-245afa34-f9d2-4fe4-9f69-4cfbd6016715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:04.283168 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e9c8b-7591-4afa-ad84-8df4f98a54a3 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:04.285433 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-9a8e9c8b-7591-4afa-ad84-8df4f98a54a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:04.396244 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1664/3356] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:20:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:20:04.404503 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7a776-5db0-4569-87be-8b5c9e4d0ae0 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:04.409630 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7a776-5db0-4569-87be-8b5c9e4d0ae0 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:04.409630 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7a776-5db0-4569-87be-8b5c9e4d0ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:04.436185 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e9c8b-7591-4afa-ad84-8df4f98a54a3 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:04.443963 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-4ce7a776-5db0-4569-87be-8b5c9e4d0ae0 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:20:04.445464 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-4ce7a776-5db0-4569-87be-8b5c9e4d0ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:04.462001 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932525e1-c5f0-4614-80fd-98d090768cef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198271d1c0d44cb58bace41a65f4b94c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:04.463047 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932525e1-c5f0-4614-80fd-98d090768cef service cinder] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:04.463520 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932525e1-c5f0-4614-80fd-98d090768cef service cinder] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:04.464015 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932525e1-c5f0-4614-80fd-98d090768cef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:04.466155 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1665/3357] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:20:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:20:04.470908 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-932525e1-c5f0-4614-80fd-98d090768cef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:04.472523 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce7a776-5db0-4569-87be-8b5c9e4d0ae0 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:04.485455 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce7a776-5db0-4569-87be-8b5c9e4d0ae0 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:04.491899 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c716eab3-23c5-4d44-9c93-287d91bc38ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:04.492806 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c716eab3-23c5-4d44-9c93-287d91bc38ae admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:04.493260 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c716eab3-23c5-4d44-9c93-287d91bc38ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:04.493535 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c716eab3-23c5-4d44-9c93-287d91bc38ae admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:04.494262 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c716eab3-23c5-4d44-9c93-287d91bc38ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:20:04.494623 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c716eab3-23c5-4d44-9c93-287d91bc38ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:04.496956 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c716eab3-23c5-4d44-9c93-287d91bc38ae admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:04.527653 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1666/3358] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:20:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:20:04.531031 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c716eab3-23c5-4d44-9c93-287d91bc38ae admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:04.561330 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c716eab3-23c5-4d44-9c93-287d91bc38ae admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:04.569207 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932525e1-c5f0-4614-80fd-98d090768cef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:04.570659 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932525e1-c5f0-4614-80fd-98d090768cef service cinder] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:04.572719 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e378f69-5f97-47a0-a334-038f52dfb525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:04.574622 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e378f69-5f97-47a0-a334-038f52dfb525 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:04.576256 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e378f69-5f97-47a0-a334-038f52dfb525 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:04.578102 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e378f69-5f97-47a0-a334-038f52dfb525 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:04.578985 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e378f69-5f97-47a0-a334-038f52dfb525 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:04.581845 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e378f69-5f97-47a0-a334-038f52dfb525 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:04.583142 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1693/3359] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:20:04 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:20:04.714988 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1667/3360] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:20:04 2022] POST /identity/v3/projects => generated 361 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:20:04.719276 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932525e1-c5f0-4614-80fd-98d090768cef service cinder] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:04.731005 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932525e1-c5f0-4614-80fd-98d090768cef service cinder] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:04.799940 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb11d233-571a-46d0-9ce6-7895fffe99fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:04.803204 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb11d233-571a-46d0-9ce6-7895fffe99fb admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:04.803204 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb11d233-571a-46d0-9ce6-7895fffe99fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:04.803204 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb11d233-571a-46d0-9ce6-7895fffe99fb admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:04.803204 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb11d233-571a-46d0-9ce6-7895fffe99fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:04.804477 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb11d233-571a-46d0-9ce6-7895fffe99fb admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:04.881789 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1694/3361] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:20:04 2022] POST /identity/v3/users => generated 281 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:20:04.886251 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e378f69-5f97-47a0-a334-038f52dfb525 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:04.898850 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e378f69-5f97-47a0-a334-038f52dfb525 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:04.904241 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28535b34-e55c-4359-b066-dce8d23c5e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:04.905155 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28535b34-e55c-4359-b066-dce8d23c5e6d admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:04.905667 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28535b34-e55c-4359-b066-dce8d23c5e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:04.906349 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28535b34-e55c-4359-b066-dce8d23c5e6d admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:04.907440 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28535b34-e55c-4359-b066-dce8d23c5e6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:04.910945 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28535b34-e55c-4359-b066-dce8d23c5e6d admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:04.925182 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1668/3362] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:20:04.929155 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb11d233-571a-46d0-9ce6-7895fffe99fb admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:04.942675 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb11d233-571a-46d0-9ce6-7895fffe99fb admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:04.948322 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590a4df7-9076-445c-a14b-37d57996da50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:04.950392 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a4df7-9076-445c-a14b-37d57996da50 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:04.950685 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a4df7-9076-445c-a14b-37d57996da50 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:04.950963 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a4df7-9076-445c-a14b-37d57996da50 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:04.951923 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590a4df7-9076-445c-a14b-37d57996da50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:04.954823 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590a4df7-9076-445c-a14b-37d57996da50 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:04.967612 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1695/3363] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:20:04.971845 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28535b34-e55c-4359-b066-dce8d23c5e6d admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:04.982620 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28535b34-e55c-4359-b066-dce8d23c5e6d admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:04.987845 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf5a1d-c663-47ea-bfe8-8daa02635788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:04.988830 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf5a1d-c663-47ea-bfe8-8daa02635788 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:04.989210 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf5a1d-c663-47ea-bfe8-8daa02635788 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:04.989552 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf5a1d-c663-47ea-bfe8-8daa02635788 admin admin] PATH_INFO: `/v3/projects/0a19f369532d48d79359e08ece1a2569/users/3a58da9b748d48c9b8969800f01f9c3b/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:05.006402 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cf5a1d-c663-47ea-bfe8-8daa02635788 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a19f369532d48d79359e08ece1a2569, user_id=3a58da9b748d48c9b8969800f01f9c3b, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:05.009113 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cf5a1d-c663-47ea-bfe8-8daa02635788 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:05.120383 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1669/3364] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:20:04 2022] PUT /identity/v3/projects/0a19f369532d48d79359e08ece1a2569/users/3a58da9b748d48c9b8969800f01f9c3b/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:20:05.130656 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1721e4c-a208-4212-9de5-19cfa62ad72e None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:05.130995 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1721e4c-a208-4212-9de5-19cfa62ad72e None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:05.131279 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1721e4c-a208-4212-9de5-19cfa62ad72e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:05.176440 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-a1721e4c-a208-4212-9de5-19cfa62ad72e None None] MFA Rules not processed for user `3a58da9b748d48c9b8969800f01f9c3b`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:20:05.178366 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-a1721e4c-a208-4212-9de5-19cfa62ad72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:05.275201 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1696/3365] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:20:05 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:20:05.279843 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf5a1d-c663-47ea-bfe8-8daa02635788 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:05.310095 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ffed8c-0b39-4253-a90b-8eef7fcf08c0 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:05.310381 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ffed8c-0b39-4253-a90b-8eef7fcf08c0 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:05.310672 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ffed8c-0b39-4253-a90b-8eef7fcf08c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:05.330324 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-a5ffed8c-0b39-4253-a90b-8eef7fcf08c0 None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:20:05.332479 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-a5ffed8c-0b39-4253-a90b-8eef7fcf08c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:05.359742 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf5a1d-c663-47ea-bfe8-8daa02635788 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:05.368598 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f29ca1-9883-42db-bde8-461ff01e5bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:05.369888 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f29ca1-9883-42db-bde8-461ff01e5bc5 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:05.371133 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f29ca1-9883-42db-bde8-461ff01e5bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:05.371434 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f29ca1-9883-42db-bde8-461ff01e5bc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:05.372155 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f29ca1-9883-42db-bde8-461ff01e5bc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:05.379689 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f29ca1-9883-42db-bde8-461ff01e5bc5 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:05.438456 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1697/3366] 10.222.0.52 () {58 vars in 967 bytes} [Sat May 14 21:20:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:20:05.467920 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ffed8c-0b39-4253-a90b-8eef7fcf08c0 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:05.469328 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-a5ffed8c-0b39-4253-a90b-8eef7fcf08c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:05.549734 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ffed8c-0b39-4253-a90b-8eef7fcf08c0 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:05.555518 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce24db8-6f11-4791-8527-5a0bdee298f7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:05.556181 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce24db8-6f11-4791-8527-5a0bdee298f7 service swift] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:05.556471 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce24db8-6f11-4791-8527-5a0bdee298f7 service swift] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:05.556751 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce24db8-6f11-4791-8527-5a0bdee298f7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:05.566021 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce24db8-6f11-4791-8527-5a0bdee298f7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:05.566224 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1670/3367] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:20:05 2022] POST /identity/v3/projects => generated 361 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:20:05.567739 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce24db8-6f11-4791-8527-5a0bdee298f7 service swift] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:05.570440 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f29ca1-9883-42db-bde8-461ff01e5bc5 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:05.576712 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1698/3368] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 21:20:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 14 21:20:05.659368 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f29ca1-9883-42db-bde8-461ff01e5bc5 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:05.667126 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181acb9a-e35b-4cbf-b72d-dfc7f757a35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:05.668010 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181acb9a-e35b-4cbf-b72d-dfc7f757a35f admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:05.668430 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181acb9a-e35b-4cbf-b72d-dfc7f757a35f admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:05.668800 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181acb9a-e35b-4cbf-b72d-dfc7f757a35f admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:05.669613 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181acb9a-e35b-4cbf-b72d-dfc7f757a35f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:05.671701 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181acb9a-e35b-4cbf-b72d-dfc7f757a35f admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:06.009005 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1671/3369] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:20:05 2022] POST /identity/v3/users => generated 287 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:20:06.012920 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce24db8-6f11-4791-8527-5a0bdee298f7 service swift] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:06.024158 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce24db8-6f11-4791-8527-5a0bdee298f7 service swift] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:06.035459 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7c5e2-e5af-4fc2-bc5d-f97a45ce3072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:06.035459 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7c5e2-e5af-4fc2-bc5d-f97a45ce3072 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:06.035459 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7c5e2-e5af-4fc2-bc5d-f97a45ce3072 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:06.035459 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7c5e2-e5af-4fc2-bc5d-f97a45ce3072 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:06.035836 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d7c5e2-e5af-4fc2-bc5d-f97a45ce3072 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:06.037526 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d7c5e2-e5af-4fc2-bc5d-f97a45ce3072 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:06.048019 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1699/3370] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:20:06.052634 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181acb9a-e35b-4cbf-b72d-dfc7f757a35f admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:06.063777 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181acb9a-e35b-4cbf-b72d-dfc7f757a35f admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:06.068808 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409be445-66f0-446e-b546-452ca9d1ffce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:06.069552 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409be445-66f0-446e-b546-452ca9d1ffce admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:06.069835 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409be445-66f0-446e-b546-452ca9d1ffce admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:06.070109 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409be445-66f0-446e-b546-452ca9d1ffce admin admin] PATH_INFO: `/v3/projects/c9336dafb81e46eab8cdc6cb066634e7/users/78a873e502ca4c82b0d22e0de7180010/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:06.089435 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409be445-66f0-446e-b546-452ca9d1ffce admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9336dafb81e46eab8cdc6cb066634e7, user_id=78a873e502ca4c82b0d22e0de7180010, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:06.089609 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7c5e2-e5af-4fc2-bc5d-f97a45ce3072 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:06.091641 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-94d7c5e2-e5af-4fc2-bc5d-f97a45ce3072 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:06.093079 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409be445-66f0-446e-b546-452ca9d1ffce admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:06.106351 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7c5e2-e5af-4fc2-bc5d-f97a45ce3072 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:06.111488 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c9283a-90a4-4583-ad5d-a346a9ca03f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:06.112477 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c9283a-90a4-4583-ad5d-a346a9ca03f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:06.112764 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c9283a-90a4-4583-ad5d-a346a9ca03f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:06.113055 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c9283a-90a4-4583-ad5d-a346a9ca03f0 admin admin] PATH_INFO: `/v3/users/3e9d68295c424cd29e55832142029113` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:06.114319 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c9283a-90a4-4583-ad5d-a346a9ca03f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e9d68295c424cd29e55832142029113)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:06.116282 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c9283a-90a4-4583-ad5d-a346a9ca03f0 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:06.171071 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1672/3371] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:20:06 2022] PUT /identity/v3/projects/c9336dafb81e46eab8cdc6cb066634e7/users/78a873e502ca4c82b0d22e0de7180010/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:20:06.175256 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409be445-66f0-446e-b546-452ca9d1ffce admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:06.279705 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409be445-66f0-446e-b546-452ca9d1ffce admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:06.295449 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d5c9283a-90a4-4583-ad5d-a346a9ca03f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e9d68295c424cd29e55832142029113'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:06.301209 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13029d6f-01d9-460a-bed3-9789819ebe5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:06.302637 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13029d6f-01d9-460a-bed3-9789819ebe5c admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:06.303955 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13029d6f-01d9-460a-bed3-9789819ebe5c admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:06.304393 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13029d6f-01d9-460a-bed3-9789819ebe5c admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:06.308338 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13029d6f-01d9-460a-bed3-9789819ebe5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:06.310177 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d5c9283a-90a4-4583-ad5d-a346a9ca03f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e9d68295c424cd29e55832142029113'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:06.311507 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13029d6f-01d9-460a-bed3-9789819ebe5c admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:06.321244 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d5c9283a-90a4-4583-ad5d-a346a9ca03f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e9d68295c424cd29e55832142029113'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:06.334139 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1673/3372] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:20:06.338461 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13029d6f-01d9-460a-bed3-9789819ebe5c admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:06.355837 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13029d6f-01d9-460a-bed3-9789819ebe5c admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:06.367300 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc235b1-15f6-473d-86ea-fea0abb6d3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:06.368590 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc235b1-15f6-473d-86ea-fea0abb6d3ba admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:06.368874 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc235b1-15f6-473d-86ea-fea0abb6d3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:06.369144 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc235b1-15f6-473d-86ea-fea0abb6d3ba admin admin] PATH_INFO: `/v3/projects/c9336dafb81e46eab8cdc6cb066634e7/users/78a873e502ca4c82b0d22e0de7180010/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:06.371447 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc235b1-15f6-473d-86ea-fea0abb6d3ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9336dafb81e46eab8cdc6cb066634e7, user_id=78a873e502ca4c82b0d22e0de7180010, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:06.377448 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc235b1-15f6-473d-86ea-fea0abb6d3ba admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:06.409238 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1674/3373] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:20:06 2022] PUT /identity/v3/projects/c9336dafb81e46eab8cdc6cb066634e7/users/78a873e502ca4c82b0d22e0de7180010/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:20:06.417045 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d5c9283a-90a4-4583-ad5d-a346a9ca03f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e9d68295c424cd29e55832142029113'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:06.417982 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d5c9283a-90a4-4583-ad5d-a346a9ca03f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e9d68295c424cd29e55832142029113'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:06.421587 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149f259a-bbe2-411d-94bc-247243f4c60a None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:06.424226 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149f259a-bbe2-411d-94bc-247243f4c60a None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:06.424226 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149f259a-bbe2-411d-94bc-247243f4c60a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:06.428803 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1700/3374] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:20:06 2022] DELETE /identity/v3/users/3e9d68295c424cd29e55832142029113 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:20:06.431217 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f0b0c9-1732-483c-baa5-f6815c561c60 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:06.431871 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f0b0c9-1732-483c-baa5-f6815c561c60 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:06.432313 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f0b0c9-1732-483c-baa5-f6815c561c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:06.453928 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-149f259a-bbe2-411d-94bc-247243f4c60a None None] MFA Rules not processed for user `78a873e502ca4c82b0d22e0de7180010`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:20:06.455164 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-149f259a-bbe2-411d-94bc-247243f4c60a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:06.461034 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-87f0b0c9-1732-483c-baa5-f6815c561c60 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:20:06.462341 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-87f0b0c9-1732-483c-baa5-f6815c561c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:06.554083 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1701/3375] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:20:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:20:06.575472 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f0b0c9-1732-483c-baa5-f6815c561c60 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:06.576980 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-87f0b0c9-1732-483c-baa5-f6815c561c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:06.600312 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1675/3376] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:20:06 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:20:06.652803 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f0b0c9-1732-483c-baa5-f6815c561c60 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:06.656730 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd7653d-8378-417d-a81c-20518124ccb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:06.657382 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd7653d-8378-417d-a81c-20518124ccb5 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:06.657666 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd7653d-8378-417d-a81c-20518124ccb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:06.657941 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd7653d-8378-417d-a81c-20518124ccb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:06.670847 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd7653d-8378-417d-a81c-20518124ccb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:06.676235 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd7653d-8378-417d-a81c-20518124ccb5 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:06.688965 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1702/3377] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:20:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:20:06.816772 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149f259a-bbe2-411d-94bc-247243f4c60a None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:06.818196 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-149f259a-bbe2-411d-94bc-247243f4c60a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:06.920447 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149f259a-bbe2-411d-94bc-247243f4c60a None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:06.940791 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12959f8-ae81-47ce-891b-b78fcef2ae45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:06.942181 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12959f8-ae81-47ce-891b-b78fcef2ae45 service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:06.942707 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12959f8-ae81-47ce-891b-b78fcef2ae45 service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:06.943205 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12959f8-ae81-47ce-891b-b78fcef2ae45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:06.954200 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12959f8-ae81-47ce-891b-b78fcef2ae45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:06.958290 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12959f8-ae81-47ce-891b-b78fcef2ae45 service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:06.975077 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1676/3378] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:20:06 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:20:07.572517 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd7653d-8378-417d-a81c-20518124ccb5 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:07.574008 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-3dd7653d-8378-417d-a81c-20518124ccb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:07.587398 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd7653d-8378-417d-a81c-20518124ccb5 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:07.592707 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa3e632-89c2-4ee0-be8e-d5e9baa0b0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:07.596978 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3e632-89c2-4ee0-be8e-d5e9baa0b0c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:07.596978 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3e632-89c2-4ee0-be8e-d5e9baa0b0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:07.596978 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3e632-89c2-4ee0-be8e-d5e9baa0b0c4 admin admin] PATH_INFO: `/v3/users/3a58da9b748d48c9b8969800f01f9c3b` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:07.596978 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa3e632-89c2-4ee0-be8e-d5e9baa0b0c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a58da9b748d48c9b8969800f01f9c3b)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:07.598561 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa3e632-89c2-4ee0-be8e-d5e9baa0b0c4 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:07.665917 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12959f8-ae81-47ce-891b-b78fcef2ae45 service nova] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:07.667387 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b12959f8-ae81-47ce-891b-b78fcef2ae45 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:07.685490 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12959f8-ae81-47ce-891b-b78fcef2ae45 service nova] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:07.691928 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097bfabc-2652-47bf-a558-32261c607ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:07.693108 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097bfabc-2652-47bf-a558-32261c607ea4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:07.693392 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097bfabc-2652-47bf-a558-32261c607ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:07.693821 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097bfabc-2652-47bf-a558-32261c607ea4 admin admin] PATH_INFO: `/v3/projects/0836fd7ee18244cca109e577b9194b2a` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:07.695081 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097bfabc-2652-47bf-a558-32261c607ea4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0836fd7ee18244cca109e577b9194b2a)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:07.697253 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097bfabc-2652-47bf-a558-32261c607ea4 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:07.949399 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2fa3e632-89c2-4ee0-be8e-d5e9baa0b0c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a58da9b748d48c9b8969800f01f9c3b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:07.973778 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2fa3e632-89c2-4ee0-be8e-d5e9baa0b0c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a58da9b748d48c9b8969800f01f9c3b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:07.986938 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-097bfabc-2652-47bf-a558-32261c607ea4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0836fd7ee18244cca109e577b9194b2a', 'request_id': 'req-097bfabc-2652-47bf-a558-32261c607ea4'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:07.988504 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2fa3e632-89c2-4ee0-be8e-d5e9baa0b0c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a58da9b748d48c9b8969800f01f9c3b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:07.994989 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-097bfabc-2652-47bf-a558-32261c607ea4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0836fd7ee18244cca109e577b9194b2a', 'request_id': 'req-097bfabc-2652-47bf-a558-32261c607ea4'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:08.001529 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-097bfabc-2652-47bf-a558-32261c607ea4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0836fd7ee18244cca109e577b9194b2a', 'request_id': 'req-097bfabc-2652-47bf-a558-32261c607ea4'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:08.161043 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2fa3e632-89c2-4ee0-be8e-d5e9baa0b0c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a58da9b748d48c9b8969800f01f9c3b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:08.161043 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2fa3e632-89c2-4ee0-be8e-d5e9baa0b0c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a58da9b748d48c9b8969800f01f9c3b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:08.167170 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1703/3379] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:20:07 2022] DELETE /identity/v3/users/3a58da9b748d48c9b8969800f01f9c3b => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:20:08.171744 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1663f0d-b120-4e0d-a752-da2ea1b75ae6 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:08.172105 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1663f0d-b120-4e0d-a752-da2ea1b75ae6 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:08.172462 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1663f0d-b120-4e0d-a752-da2ea1b75ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:08.191097 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-c1663f0d-b120-4e0d-a752-da2ea1b75ae6 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:20:08.192340 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c1663f0d-b120-4e0d-a752-da2ea1b75ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:08.296532 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-097bfabc-2652-47bf-a558-32261c607ea4 admin admin] The token cache is being invalidate because project 0836fd7ee18244cca109e577b9194b2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:20:08.297672 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-097bfabc-2652-47bf-a558-32261c607ea4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:08.300309 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-097bfabc-2652-47bf-a558-32261c607ea4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:08.304446 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1677/3380] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:20:07 2022] DELETE /identity/v3/projects/0836fd7ee18244cca109e577b9194b2a => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:20:08.306311 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1704/3381] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:20:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:20:08.313090 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a092edc-f7b0-4934-89a4-9ca59d5801ed None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:08.313628 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a092edc-f7b0-4934-89a4-9ca59d5801ed None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:08.314081 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a092edc-f7b0-4934-89a4-9ca59d5801ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:08.320342 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1663f0d-b120-4e0d-a752-da2ea1b75ae6 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:08.322194 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c1663f0d-b120-4e0d-a752-da2ea1b75ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:08.359470 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-1a092edc-f7b0-4934-89a4-9ca59d5801ed None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:20:08.364697 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-1a092edc-f7b0-4934-89a4-9ca59d5801ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:08.394184 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1678/3382] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:20:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:20:08.403267 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9671f7-08b2-4537-8cf5-f63cf452c4e2 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:08.403995 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1663f0d-b120-4e0d-a752-da2ea1b75ae6 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:08.404153 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9671f7-08b2-4537-8cf5-f63cf452c4e2 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:08.404344 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9671f7-08b2-4537-8cf5-f63cf452c4e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:08.409535 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f15080a-23d9-4c0b-bce9-cadea68d75c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:08.410936 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f15080a-23d9-4c0b-bce9-cadea68d75c9 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:08.411553 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f15080a-23d9-4c0b-bce9-cadea68d75c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:08.412030 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f15080a-23d9-4c0b-bce9-cadea68d75c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:08.413877 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-7f15080a-23d9-4c0b-bce9-cadea68d75c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:08.429616 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f15080a-23d9-4c0b-bce9-cadea68d75c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:08.431511 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f15080a-23d9-4c0b-bce9-cadea68d75c9 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:08.442205 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-de9671f7-08b2-4537-8cf5-f63cf452c4e2 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:20:08.444528 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1705/3383] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:20:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:20:08.445021 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-de9671f7-08b2-4537-8cf5-f63cf452c4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:08.458748 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1679/3384] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:20:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:20:08.463928 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f15080a-23d9-4c0b-bce9-cadea68d75c9 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:08.476717 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f15080a-23d9-4c0b-bce9-cadea68d75c9 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:08.499203 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915aa489-760d-4a02-b0c4-85aad01d8fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:08.500321 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915aa489-760d-4a02-b0c4-85aad01d8fab admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:08.500321 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915aa489-760d-4a02-b0c4-85aad01d8fab admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:08.503276 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915aa489-760d-4a02-b0c4-85aad01d8fab admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:08.503276 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915aa489-760d-4a02-b0c4-85aad01d8fab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:20:08.503276 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915aa489-760d-4a02-b0c4-85aad01d8fab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:08.505964 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915aa489-760d-4a02-b0c4-85aad01d8fab admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:08.536184 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1706/3385] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:20:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:20:08.536570 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9671f7-08b2-4537-8cf5-f63cf452c4e2 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:08.564836 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9671f7-08b2-4537-8cf5-f63cf452c4e2 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:08.586952 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57758ec-35f1-46f0-afe1-faed26e3509b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:08.587907 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57758ec-35f1-46f0-afe1-faed26e3509b admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:08.588195 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57758ec-35f1-46f0-afe1-faed26e3509b admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:08.588473 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57758ec-35f1-46f0-afe1-faed26e3509b admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:08.589204 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57758ec-35f1-46f0-afe1-faed26e3509b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:08.595076 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57758ec-35f1-46f0-afe1-faed26e3509b admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:08.722590 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1680/3386] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:20:08 2022] POST /identity/v3/projects => generated 393 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:20:08.726863 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915aa489-760d-4a02-b0c4-85aad01d8fab admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:08.739463 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915aa489-760d-4a02-b0c4-85aad01d8fab admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:08.874040 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bea4c4f-4931-43cf-9ac1-9a6d49b414fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:08.875141 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bea4c4f-4931-43cf-9ac1-9a6d49b414fa admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:08.875768 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bea4c4f-4931-43cf-9ac1-9a6d49b414fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:08.876252 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bea4c4f-4931-43cf-9ac1-9a6d49b414fa admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:08.877964 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bea4c4f-4931-43cf-9ac1-9a6d49b414fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:08.881190 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bea4c4f-4931-43cf-9ac1-9a6d49b414fa admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:09.025295 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1707/3387] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:20:08 2022] POST /identity/v3/users => generated 297 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:20:09.025422 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57758ec-35f1-46f0-afe1-faed26e3509b admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:09.036356 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57758ec-35f1-46f0-afe1-faed26e3509b admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:09.044921 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0de064e-8f7b-43b3-acac-26e408864dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:09.045611 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0de064e-8f7b-43b3-acac-26e408864dda admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:09.045972 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0de064e-8f7b-43b3-acac-26e408864dda admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:09.046257 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0de064e-8f7b-43b3-acac-26e408864dda admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:09.046987 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0de064e-8f7b-43b3-acac-26e408864dda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:09.054521 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbcc775-4bfd-4bb6-a248-97b8b87b42f3 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:09.057097 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbcc775-4bfd-4bb6-a248-97b8b87b42f3 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:09.057097 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbcc775-4bfd-4bb6-a248-97b8b87b42f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:09.060171 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0de064e-8f7b-43b3-acac-26e408864dda admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:09.074300 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1681/3388] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:20:09.078682 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0de064e-8f7b-43b3-acac-26e408864dda admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:09.086575 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-6cbcc775-4bfd-4bb6-a248-97b8b87b42f3 None None] MFA Rules not processed for user `b3b5b688171045d586128236e85aee0b`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:20:09.088260 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-6cbcc775-4bfd-4bb6-a248-97b8b87b42f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:09.094750 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0de064e-8f7b-43b3-acac-26e408864dda admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:09.100422 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9c7d08-254a-42d4-9a36-f5f854a508de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:09.101260 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9c7d08-254a-42d4-9a36-f5f854a508de admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:09.101605 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9c7d08-254a-42d4-9a36-f5f854a508de admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:09.101973 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9c7d08-254a-42d4-9a36-f5f854a508de admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:09.102855 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9c7d08-254a-42d4-9a36-f5f854a508de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:09.104771 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9c7d08-254a-42d4-9a36-f5f854a508de admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:09.126187 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1682/3389] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:20:09.127235 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9c7d08-254a-42d4-9a36-f5f854a508de admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:09.138612 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9c7d08-254a-42d4-9a36-f5f854a508de admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:09.147466 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9814c0-b111-4814-a0b6-6de22e0ffea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:09.148585 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9814c0-b111-4814-a0b6-6de22e0ffea2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:09.148966 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9814c0-b111-4814-a0b6-6de22e0ffea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:09.149341 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9814c0-b111-4814-a0b6-6de22e0ffea2 admin admin] PATH_INFO: `/v3/projects/9a85582b3e294f99828623a9a7331bee/users/55c6e0dec0484d9bb0fe104203a6e4cb/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:09.171570 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9814c0-b111-4814-a0b6-6de22e0ffea2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a85582b3e294f99828623a9a7331bee, user_id=55c6e0dec0484d9bb0fe104203a6e4cb, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:09.175708 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9814c0-b111-4814-a0b6-6de22e0ffea2 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:09.254418 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1708/3390] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:20:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:20:09.267063 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1683/3391] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:20:09 2022] PUT /identity/v3/projects/9a85582b3e294f99828623a9a7331bee/users/55c6e0dec0484d9bb0fe104203a6e4cb/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:20:09.267680 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b823bc-799a-4569-b103-382fcc46b8e2 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:09.268240 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b823bc-799a-4569-b103-382fcc46b8e2 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:09.268586 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b823bc-799a-4569-b103-382fcc46b8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:09.278987 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d94a4-846e-47df-8931-fc84d4b2d186 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:09.279387 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d94a4-846e-47df-8931-fc84d4b2d186 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:09.280359 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d94a4-846e-47df-8931-fc84d4b2d186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:09.304447 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-f7b823bc-799a-4569-b103-382fcc46b8e2 None None] MFA Rules not processed for user `b3b5b688171045d586128236e85aee0b`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:20:09.306315 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-f7b823bc-799a-4569-b103-382fcc46b8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:09.323150 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-254d94a4-846e-47df-8931-fc84d4b2d186 None None] MFA Rules not processed for user `55c6e0dec0484d9bb0fe104203a6e4cb`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:20:09.325290 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-254d94a4-846e-47df-8931-fc84d4b2d186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:09.421453 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1709/3392] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:20:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:20:09.463744 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1684/3393] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:20:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:20:09.532535 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b823bc-799a-4569-b103-382fcc46b8e2 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:09.535230 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-f7b823bc-799a-4569-b103-382fcc46b8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:09.549871 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254d94a4-846e-47df-8931-fc84d4b2d186 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:09.551432 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-254d94a4-846e-47df-8931-fc84d4b2d186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:09.627226 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b823bc-799a-4569-b103-382fcc46b8e2 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:09.637954 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254d94a4-846e-47df-8931-fc84d4b2d186 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:09.638160 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359efef5-0472-4485-b8f5-b06dd06ab4b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:09.638160 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359efef5-0472-4485-b8f5-b06dd06ab4b0 service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:09.638160 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359efef5-0472-4485-b8f5-b06dd06ab4b0 service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:09.638160 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359efef5-0472-4485-b8f5-b06dd06ab4b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:09.641518 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a2171-1b1a-4291-8b6c-90225933b421 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:09.642171 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a2171-1b1a-4291-8b6c-90225933b421 service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:09.642498 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a2171-1b1a-4291-8b6c-90225933b421 service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:09.642767 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a2171-1b1a-4291-8b6c-90225933b421 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:09.646397 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359efef5-0472-4485-b8f5-b06dd06ab4b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:09.648115 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359efef5-0472-4485-b8f5-b06dd06ab4b0 service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:09.651378 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1a2171-1b1a-4291-8b6c-90225933b421 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:09.653100 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1a2171-1b1a-4291-8b6c-90225933b421 service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:09.657873 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1710/3394] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:20:09 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:20:09.665678 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359efef5-0472-4485-b8f5-b06dd06ab4b0 service nova] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:09.667378 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-359efef5-0472-4485-b8f5-b06dd06ab4b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:09.677335 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1685/3395] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:20:09 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:20:09.801496 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359efef5-0472-4485-b8f5-b06dd06ab4b0 service nova] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:09.814196 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeeaec8-df3c-40e3-9fe4-0bd72868c515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:09.815829 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeeaec8-df3c-40e3-9fe4-0bd72868c515 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:09.816197 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeeaec8-df3c-40e3-9fe4-0bd72868c515 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:09.816477 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeeaec8-df3c-40e3-9fe4-0bd72868c515 admin admin] PATH_INFO: `/v3/projects/0a19f369532d48d79359e08ece1a2569` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:09.818288 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeeaec8-df3c-40e3-9fe4-0bd72868c515 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a19f369532d48d79359e08ece1a2569)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:09.822152 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeeaec8-df3c-40e3-9fe4-0bd72868c515 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:10.008294 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-4aeeaec8-df3c-40e3-9fe4-0bd72868c515 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a19f369532d48d79359e08ece1a2569', 'request_id': 'req-4aeeaec8-df3c-40e3-9fe4-0bd72868c515'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:10.024031 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-4aeeaec8-df3c-40e3-9fe4-0bd72868c515 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a19f369532d48d79359e08ece1a2569', 'request_id': 'req-4aeeaec8-df3c-40e3-9fe4-0bd72868c515'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:10.182919 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-4aeeaec8-df3c-40e3-9fe4-0bd72868c515 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a19f369532d48d79359e08ece1a2569', 'request_id': 'req-4aeeaec8-df3c-40e3-9fe4-0bd72868c515'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:10.198325 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-4aeeaec8-df3c-40e3-9fe4-0bd72868c515 admin admin] The token cache is being invalidate because project 0a19f369532d48d79359e08ece1a2569 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:20:10.203078 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-4aeeaec8-df3c-40e3-9fe4-0bd72868c515 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:10.203078 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-4aeeaec8-df3c-40e3-9fe4-0bd72868c515 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:10.203078 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1711/3396] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:20:09 2022] DELETE /identity/v3/projects/0a19f369532d48d79359e08ece1a2569 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:20:10.207092 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a2171-1b1a-4291-8b6c-90225933b421 service nova] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:10.223685 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a2171-1b1a-4291-8b6c-90225933b421 service nova] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:10.320203 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9692d2c7-0008-4a86-8f47-c3c6fc036e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:10.321160 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692d2c7-0008-4a86-8f47-c3c6fc036e48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:10.321444 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692d2c7-0008-4a86-8f47-c3c6fc036e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:10.333736 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692d2c7-0008-4a86-8f47-c3c6fc036e48 admin admin] PATH_INFO: `/v3/users/78a873e502ca4c82b0d22e0de7180010` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:10.333736 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9692d2c7-0008-4a86-8f47-c3c6fc036e48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78a873e502ca4c82b0d22e0de7180010)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:10.333736 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9692d2c7-0008-4a86-8f47-c3c6fc036e48 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:10.608544 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9692d2c7-0008-4a86-8f47-c3c6fc036e48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78a873e502ca4c82b0d22e0de7180010'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:10.617069 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9692d2c7-0008-4a86-8f47-c3c6fc036e48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78a873e502ca4c82b0d22e0de7180010'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:10.617771 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9692d2c7-0008-4a86-8f47-c3c6fc036e48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78a873e502ca4c82b0d22e0de7180010'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:10.692465 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9692d2c7-0008-4a86-8f47-c3c6fc036e48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78a873e502ca4c82b0d22e0de7180010'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:10.723424 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9692d2c7-0008-4a86-8f47-c3c6fc036e48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78a873e502ca4c82b0d22e0de7180010'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:10.732450 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1686/3397] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:20:10 2022] DELETE /identity/v3/users/78a873e502ca4c82b0d22e0de7180010 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:20:11.232725 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeeaec8-df3c-40e3-9fe4-0bd72868c515 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:11.239172 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-4aeeaec8-df3c-40e3-9fe4-0bd72868c515 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:11.266064 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeeaec8-df3c-40e3-9fe4-0bd72868c515 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:11.362524 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2536453a-0d68-4bc7-a5ea-41ee66c0a615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:11.363680 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2536453a-0d68-4bc7-a5ea-41ee66c0a615 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:11.364001 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2536453a-0d68-4bc7-a5ea-41ee66c0a615 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:11.369812 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2536453a-0d68-4bc7-a5ea-41ee66c0a615 admin admin] PATH_INFO: `/v3/users/55c6e0dec0484d9bb0fe104203a6e4cb` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:11.369812 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2536453a-0d68-4bc7-a5ea-41ee66c0a615 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55c6e0dec0484d9bb0fe104203a6e4cb)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:11.375343 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2536453a-0d68-4bc7-a5ea-41ee66c0a615 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:11.650761 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9692d2c7-0008-4a86-8f47-c3c6fc036e48 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:11.653749 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-9692d2c7-0008-4a86-8f47-c3c6fc036e48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:11.687076 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9692d2c7-0008-4a86-8f47-c3c6fc036e48 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:11.692394 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2536453a-0d68-4bc7-a5ea-41ee66c0a615 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55c6e0dec0484d9bb0fe104203a6e4cb'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:11.702745 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e56367-6820-49a6-ad40-92cca78ed154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:11.705237 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e56367-6820-49a6-ad40-92cca78ed154 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:11.707149 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e56367-6820-49a6-ad40-92cca78ed154 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:11.707439 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e56367-6820-49a6-ad40-92cca78ed154 admin admin] PATH_INFO: `/v3/projects/c9336dafb81e46eab8cdc6cb066634e7` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:11.709893 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e56367-6820-49a6-ad40-92cca78ed154 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9336dafb81e46eab8cdc6cb066634e7)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:11.712237 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e56367-6820-49a6-ad40-92cca78ed154 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:11.721927 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2536453a-0d68-4bc7-a5ea-41ee66c0a615 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55c6e0dec0484d9bb0fe104203a6e4cb'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:11.733239 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2536453a-0d68-4bc7-a5ea-41ee66c0a615 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55c6e0dec0484d9bb0fe104203a6e4cb'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:11.828997 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2536453a-0d68-4bc7-a5ea-41ee66c0a615 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55c6e0dec0484d9bb0fe104203a6e4cb'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:11.832721 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2536453a-0d68-4bc7-a5ea-41ee66c0a615 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55c6e0dec0484d9bb0fe104203a6e4cb'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:11.865486 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-20e56367-6820-49a6-ad40-92cca78ed154 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9336dafb81e46eab8cdc6cb066634e7', 'request_id': 'req-20e56367-6820-49a6-ad40-92cca78ed154'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:11.870993 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1712/3398] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:20:11 2022] DELETE /identity/v3/users/55c6e0dec0484d9bb0fe104203a6e4cb => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:20:11.879541 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-20e56367-6820-49a6-ad40-92cca78ed154 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9336dafb81e46eab8cdc6cb066634e7', 'request_id': 'req-20e56367-6820-49a6-ad40-92cca78ed154'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:11.880432 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642a4e0-32db-4601-9a77-75de9e6c3a32 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:11.881179 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642a4e0-32db-4601-9a77-75de9e6c3a32 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:11.881560 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642a4e0-32db-4601-9a77-75de9e6c3a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:11.889453 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-20e56367-6820-49a6-ad40-92cca78ed154 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9336dafb81e46eab8cdc6cb066634e7', 'request_id': 'req-20e56367-6820-49a6-ad40-92cca78ed154'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:11.905187 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-8642a4e0-32db-4601-9a77-75de9e6c3a32 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:20:11.906777 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-8642a4e0-32db-4601-9a77-75de9e6c3a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:11.979764 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-20e56367-6820-49a6-ad40-92cca78ed154 admin admin] The token cache is being invalidate because project c9336dafb81e46eab8cdc6cb066634e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:20:11.980859 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-20e56367-6820-49a6-ad40-92cca78ed154 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:11.981899 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-20e56367-6820-49a6-ad40-92cca78ed154 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:11.990023 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1687/3399] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:20:11 2022] DELETE /identity/v3/projects/c9336dafb81e46eab8cdc6cb066634e7 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:20:11.991823 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc00c4-fd6c-47b0-b7ad-058bbcd47cfd None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:11.992498 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc00c4-fd6c-47b0-b7ad-058bbcd47cfd None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:11.993429 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc00c4-fd6c-47b0-b7ad-058bbcd47cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:12.037270 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-69cc00c4-fd6c-47b0-b7ad-058bbcd47cfd None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:20:12.037270 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-69cc00c4-fd6c-47b0-b7ad-058bbcd47cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:12.037640 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1713/3400] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:20:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:20:12.052753 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1688/3401] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:20:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:20:12.056614 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8642a4e0-32db-4601-9a77-75de9e6c3a32 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:12.060133 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-8642a4e0-32db-4601-9a77-75de9e6c3a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:12.062114 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901aac3-1c20-48c5-a1ce-af5433faae7f None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:12.067647 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901aac3-1c20-48c5-a1ce-af5433faae7f None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:12.067647 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901aac3-1c20-48c5-a1ce-af5433faae7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:12.129943 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-7901aac3-1c20-48c5-a1ce-af5433faae7f None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:20:12.146785 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-7901aac3-1c20-48c5-a1ce-af5433faae7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:12.187551 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1689/3402] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:20:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:20:12.193208 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7901aac3-1c20-48c5-a1ce-af5433faae7f None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:12.215871 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7901aac3-1c20-48c5-a1ce-af5433faae7f None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:12.240124 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4cf469-3327-49fb-a6bf-7ad1a7f90d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:12.242854 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4cf469-3327-49fb-a6bf-7ad1a7f90d34 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:12.243672 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4cf469-3327-49fb-a6bf-7ad1a7f90d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:12.243952 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4cf469-3327-49fb-a6bf-7ad1a7f90d34 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:12.246269 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4cf469-3327-49fb-a6bf-7ad1a7f90d34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:20:12.246572 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4cf469-3327-49fb-a6bf-7ad1a7f90d34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:12.247755 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8642a4e0-32db-4601-9a77-75de9e6c3a32 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:12.253331 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4cf469-3327-49fb-a6bf-7ad1a7f90d34 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:12.259653 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de057edb-f96e-4eb9-83ad-522aef812607 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:12.265183 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de057edb-f96e-4eb9-83ad-522aef812607 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:12.265183 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de057edb-f96e-4eb9-83ad-522aef812607 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:12.266562 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de057edb-f96e-4eb9-83ad-522aef812607 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:12.304364 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1690/3403] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:20:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:20:12.306545 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4cf469-3327-49fb-a6bf-7ad1a7f90d34 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:12.307096 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de057edb-f96e-4eb9-83ad-522aef812607 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:12.310647 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de057edb-f96e-4eb9-83ad-522aef812607 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:12.350789 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4cf469-3327-49fb-a6bf-7ad1a7f90d34 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:12.353097 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1714/3404] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:20:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:20:12.357730 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e07b99-f411-4446-b55e-0cdd1777c0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:12.359080 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e07b99-f411-4446-b55e-0cdd1777c0c2 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:12.359548 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e07b99-f411-4446-b55e-0cdd1777c0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:12.359974 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e07b99-f411-4446-b55e-0cdd1777c0c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:12.363734 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e07b99-f411-4446-b55e-0cdd1777c0c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:12.363734 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e07b99-f411-4446-b55e-0cdd1777c0c2 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:12.511071 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1691/3405] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:20:12 2022] POST /identity/v3/projects => generated 393 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:20:12.513968 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de057edb-f96e-4eb9-83ad-522aef812607 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:12.531045 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de057edb-f96e-4eb9-83ad-522aef812607 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:12.640547 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86175cd8-701d-405a-8937-bfc029f85cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:12.641685 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86175cd8-701d-405a-8937-bfc029f85cd0 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:12.642135 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86175cd8-701d-405a-8937-bfc029f85cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:12.642811 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86175cd8-701d-405a-8937-bfc029f85cd0 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:12.644320 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86175cd8-701d-405a-8937-bfc029f85cd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:12.647547 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86175cd8-701d-405a-8937-bfc029f85cd0 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:12.745594 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1715/3406] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:20:12 2022] POST /identity/v3/users => generated 297 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:20:12.750123 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e07b99-f411-4446-b55e-0cdd1777c0c2 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:12.769080 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e07b99-f411-4446-b55e-0cdd1777c0c2 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:12.772357 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772abbd4-a348-4cb6-a44f-9d0406cb97f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:12.773115 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772abbd4-a348-4cb6-a44f-9d0406cb97f5 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:12.773549 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772abbd4-a348-4cb6-a44f-9d0406cb97f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:12.773903 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772abbd4-a348-4cb6-a44f-9d0406cb97f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:12.774688 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772abbd4-a348-4cb6-a44f-9d0406cb97f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:12.777916 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772abbd4-a348-4cb6-a44f-9d0406cb97f5 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:12.788162 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d903f-9d07-4dd7-a952-c5b84c262be6 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:12.788847 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d903f-9d07-4dd7-a952-c5b84c262be6 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:12.789371 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d903f-9d07-4dd7-a952-c5b84c262be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:12.815560 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1692/3407] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:20:12.817459 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772abbd4-a348-4cb6-a44f-9d0406cb97f5 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:12.832793 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-a28d903f-9d07-4dd7-a952-c5b84c262be6 None None] MFA Rules not processed for user `71080496c33c4e2c8b2e16b950f0b9ea`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:20:12.836088 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-a28d903f-9d07-4dd7-a952-c5b84c262be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:12.837927 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772abbd4-a348-4cb6-a44f-9d0406cb97f5 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:12.844686 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1522c3-2ebb-486a-8790-fed320466631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:12.845685 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1522c3-2ebb-486a-8790-fed320466631 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:12.846328 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1522c3-2ebb-486a-8790-fed320466631 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:12.846777 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1522c3-2ebb-486a-8790-fed320466631 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:12.848338 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1522c3-2ebb-486a-8790-fed320466631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:12.850284 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1522c3-2ebb-486a-8790-fed320466631 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:12.871633 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1693/3408] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:20:12.876830 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1522c3-2ebb-486a-8790-fed320466631 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:12.891856 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1522c3-2ebb-486a-8790-fed320466631 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:12.900393 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08398629-3418-4342-8cab-bda1bfacdcbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:12.902068 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08398629-3418-4342-8cab-bda1bfacdcbf admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:12.903187 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08398629-3418-4342-8cab-bda1bfacdcbf admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:12.903187 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08398629-3418-4342-8cab-bda1bfacdcbf admin admin] PATH_INFO: `/v3/projects/86e98defef1b46aca7b944826148ce8b/users/864bf93bab484c59baf94bb474d22b17/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:12.949082 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08398629-3418-4342-8cab-bda1bfacdcbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=86e98defef1b46aca7b944826148ce8b, user_id=864bf93bab484c59baf94bb474d22b17, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:12.953454 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08398629-3418-4342-8cab-bda1bfacdcbf admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:12.979040 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1716/3409] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:20:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:20:13.048242 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1694/3410] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:20:12 2022] PUT /identity/v3/projects/86e98defef1b46aca7b944826148ce8b/users/864bf93bab484c59baf94bb474d22b17/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:20:13.050990 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedcbfc2-6e9d-4240-b300-c2b2291bed40 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:13.051398 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedcbfc2-6e9d-4240-b300-c2b2291bed40 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:13.052590 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedcbfc2-6e9d-4240-b300-c2b2291bed40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:13.142361 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-fedcbfc2-6e9d-4240-b300-c2b2291bed40 None None] MFA Rules not processed for user `864bf93bab484c59baf94bb474d22b17`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:20:13.143903 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-fedcbfc2-6e9d-4240-b300-c2b2291bed40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:13.287730 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1717/3411] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:20:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:20:13.299193 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08398629-3418-4342-8cab-bda1bfacdcbf admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:13.352032 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedcbfc2-6e9d-4240-b300-c2b2291bed40 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:13.357457 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-fedcbfc2-6e9d-4240-b300-c2b2291bed40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:13.491976 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08398629-3418-4342-8cab-bda1bfacdcbf admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:13.508304 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6d5586-3441-4d45-b7e5-19fbabf3ecac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:13.508900 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d5586-3441-4d45-b7e5-19fbabf3ecac admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:13.509181 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d5586-3441-4d45-b7e5-19fbabf3ecac admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:13.509458 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d5586-3441-4d45-b7e5-19fbabf3ecac admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:13.510422 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6d5586-3441-4d45-b7e5-19fbabf3ecac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:13.512668 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6d5586-3441-4d45-b7e5-19fbabf3ecac admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:13.593324 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedcbfc2-6e9d-4240-b300-c2b2291bed40 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:13.604371 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c521ff-1372-4d59-aa85-7e4275ef1b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:13.605585 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c521ff-1372-4d59-aa85-7e4275ef1b55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:13.605928 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c521ff-1372-4d59-aa85-7e4275ef1b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:13.606139 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c521ff-1372-4d59-aa85-7e4275ef1b55 admin admin] PATH_INFO: `/v3/projects/9a85582b3e294f99828623a9a7331bee` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:13.607646 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c521ff-1372-4d59-aa85-7e4275ef1b55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a85582b3e294f99828623a9a7331bee)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:13.609589 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c521ff-1372-4d59-aa85-7e4275ef1b55 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:13.675670 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1695/3412] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:20:13 2022] POST /identity/v3/projects => generated 395 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:20:13.679990 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6d5586-3441-4d45-b7e5-19fbabf3ecac admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:13.770766 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-12c521ff-1372-4d59-aa85-7e4275ef1b55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a85582b3e294f99828623a9a7331bee', 'request_id': 'req-12c521ff-1372-4d59-aa85-7e4275ef1b55'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:13.785326 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-12c521ff-1372-4d59-aa85-7e4275ef1b55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a85582b3e294f99828623a9a7331bee', 'request_id': 'req-12c521ff-1372-4d59-aa85-7e4275ef1b55'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:13.814586 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6d5586-3441-4d45-b7e5-19fbabf3ecac admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:13.876557 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47fb7d0-8e46-4c96-aa6e-48a4c796a753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:13.877770 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47fb7d0-8e46-4c96-aa6e-48a4c796a753 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:13.878216 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47fb7d0-8e46-4c96-aa6e-48a4c796a753 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:13.878494 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47fb7d0-8e46-4c96-aa6e-48a4c796a753 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:13.879188 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47fb7d0-8e46-4c96-aa6e-48a4c796a753 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:13.881199 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47fb7d0-8e46-4c96-aa6e-48a4c796a753 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:13.929236 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-12c521ff-1372-4d59-aa85-7e4275ef1b55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a85582b3e294f99828623a9a7331bee', 'request_id': 'req-12c521ff-1372-4d59-aa85-7e4275ef1b55'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:13.951109 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-12c521ff-1372-4d59-aa85-7e4275ef1b55 admin admin] The token cache is being invalidate because project 9a85582b3e294f99828623a9a7331bee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:20:13.951544 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-12c521ff-1372-4d59-aa85-7e4275ef1b55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:13.955885 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-12c521ff-1372-4d59-aa85-7e4275ef1b55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:13.955885 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1718/3413] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:20:13 2022] DELETE /identity/v3/projects/9a85582b3e294f99828623a9a7331bee => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:20:13.966863 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6356ae24-50e9-498c-bd42-428103dd4647 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:13.967257 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6356ae24-50e9-498c-bd42-428103dd4647 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:13.967752 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6356ae24-50e9-498c-bd42-428103dd4647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:14.003923 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-6356ae24-50e9-498c-bd42-428103dd4647 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:20:14.006276 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-6356ae24-50e9-498c-bd42-428103dd4647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:14.008909 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1696/3414] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:20:13 2022] POST /identity/v3/users => generated 304 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:20:14.013280 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47fb7d0-8e46-4c96-aa6e-48a4c796a753 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:14.016432 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b47fb7d0-8e46-4c96-aa6e-48a4c796a753 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:14.022419 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1719/3415] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:20:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:20:14.031322 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b33ba-abe3-447c-8b68-74695ce548a1 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:14.031685 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b33ba-abe3-447c-8b68-74695ce548a1 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:14.031947 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b33ba-abe3-447c-8b68-74695ce548a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:14.041849 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47fb7d0-8e46-4c96-aa6e-48a4c796a753 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:14.050794 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334b304a-b676-4d2f-a432-0c1921e116ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:14.051506 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b304a-b676-4d2f-a432-0c1921e116ca admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:14.051959 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b304a-b676-4d2f-a432-0c1921e116ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:14.052243 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b304a-b676-4d2f-a432-0c1921e116ca admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:14.053165 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334b304a-b676-4d2f-a432-0c1921e116ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:14.056084 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334b304a-b676-4d2f-a432-0c1921e116ca admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:14.067021 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-c84b33ba-abe3-447c-8b68-74695ce548a1 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:20:14.071635 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c84b33ba-abe3-447c-8b68-74695ce548a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:14.071772 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1697/3416] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:20:14.084685 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334b304a-b676-4d2f-a432-0c1921e116ca admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:14.096969 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1720/3417] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:20:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:20:14.102886 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84b33ba-abe3-447c-8b68-74695ce548a1 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:14.115802 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334b304a-b676-4d2f-a432-0c1921e116ca admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:14.119342 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84b33ba-abe3-447c-8b68-74695ce548a1 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:14.123844 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b0e1ef-e11a-4490-ab64-c2b923a5c8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:14.128140 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b0e1ef-e11a-4490-ab64-c2b923a5c8bb admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:14.132871 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b0e1ef-e11a-4490-ab64-c2b923a5c8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:14.132871 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b0e1ef-e11a-4490-ab64-c2b923a5c8bb admin admin] PATH_INFO: `/v3/projects/610a4977340042f6a112eddeae090c85/users/726af9dc72be4568bddeea8b6b48533a/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:14.135947 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fdfdf4-f099-4f40-83a8-f174d158c4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:14.136631 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fdfdf4-f099-4f40-83a8-f174d158c4c9 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:14.136915 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fdfdf4-f099-4f40-83a8-f174d158c4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:14.137192 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fdfdf4-f099-4f40-83a8-f174d158c4c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:14.137927 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fdfdf4-f099-4f40-83a8-f174d158c4c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:20:14.138235 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fdfdf4-f099-4f40-83a8-f174d158c4c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:14.149386 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fdfdf4-f099-4f40-83a8-f174d158c4c9 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:14.169116 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b0e1ef-e11a-4490-ab64-c2b923a5c8bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=610a4977340042f6a112eddeae090c85, user_id=726af9dc72be4568bddeea8b6b48533a, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:14.173860 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b0e1ef-e11a-4490-ab64-c2b923a5c8bb admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:14.177868 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1721/3418] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:20:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:20:14.181855 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fdfdf4-f099-4f40-83a8-f174d158c4c9 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:14.199976 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fdfdf4-f099-4f40-83a8-f174d158c4c9 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:14.215381 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92aef88-04b1-4e89-94b8-df549c1a2aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:14.216372 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92aef88-04b1-4e89-94b8-df549c1a2aa0 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:14.216907 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92aef88-04b1-4e89-94b8-df549c1a2aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:14.217411 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92aef88-04b1-4e89-94b8-df549c1a2aa0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:14.218716 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92aef88-04b1-4e89-94b8-df549c1a2aa0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:14.240030 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92aef88-04b1-4e89-94b8-df549c1a2aa0 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:14.267349 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1698/3419] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:20:14 2022] PUT /identity/v3/projects/610a4977340042f6a112eddeae090c85/users/726af9dc72be4568bddeea8b6b48533a/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:20:14.272077 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b0e1ef-e11a-4490-ab64-c2b923a5c8bb admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:14.383442 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1722/3420] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:20:14 2022] POST /identity/v3/projects => generated 371 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:20:14.393647 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92aef88-04b1-4e89-94b8-df549c1a2aa0 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:14.475736 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b0e1ef-e11a-4490-ab64-c2b923a5c8bb admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:14.584881 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92aef88-04b1-4e89-94b8-df549c1a2aa0 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:14.593414 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27030345-53ca-4b93-844e-91c0175db1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:14.594822 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27030345-53ca-4b93-844e-91c0175db1e5 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:14.595124 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27030345-53ca-4b93-844e-91c0175db1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:14.601023 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27030345-53ca-4b93-844e-91c0175db1e5 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:14.601023 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27030345-53ca-4b93-844e-91c0175db1e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:14.601023 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27030345-53ca-4b93-844e-91c0175db1e5 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:14.613292 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bef317-18cc-45c4-abdf-08f966329732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:14.614364 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bef317-18cc-45c4-abdf-08f966329732 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:14.614912 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bef317-18cc-45c4-abdf-08f966329732 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:14.615562 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bef317-18cc-45c4-abdf-08f966329732 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:14.616519 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bef317-18cc-45c4-abdf-08f966329732 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:14.618529 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bef317-18cc-45c4-abdf-08f966329732 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:14.630089 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1699/3421] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:20:14.634434 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bef317-18cc-45c4-abdf-08f966329732 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:14.669133 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bef317-18cc-45c4-abdf-08f966329732 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:14.676853 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e5b2c5-7c4d-4c0b-9953-a18dc9ce08da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:14.677975 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e5b2c5-7c4d-4c0b-9953-a18dc9ce08da admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:14.678599 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e5b2c5-7c4d-4c0b-9953-a18dc9ce08da admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:14.679039 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e5b2c5-7c4d-4c0b-9953-a18dc9ce08da admin admin] PATH_INFO: `/v3/projects/610a4977340042f6a112eddeae090c85/users/726af9dc72be4568bddeea8b6b48533a/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:14.681503 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e5b2c5-7c4d-4c0b-9953-a18dc9ce08da admin admin] RBAC: Authorizing `identity:create_grant(project_id=610a4977340042f6a112eddeae090c85, user_id=726af9dc72be4568bddeea8b6b48533a, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:14.684785 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e5b2c5-7c4d-4c0b-9953-a18dc9ce08da admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:14.728859 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1700/3422] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:20:14 2022] PUT /identity/v3/projects/610a4977340042f6a112eddeae090c85/users/726af9dc72be4568bddeea8b6b48533a/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:20:14.741729 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1723/3423] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:20:14 2022] POST /identity/v3/users => generated 286 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:20:14.744843 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e5b2c5-7c4d-4c0b-9953-a18dc9ce08da admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:14.751751 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715daf4-2015-42dd-a511-bd725f3d90eb None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:14.752059 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715daf4-2015-42dd-a511-bd725f3d90eb None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:14.752879 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715daf4-2015-42dd-a511-bd725f3d90eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:14.828779 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-e715daf4-2015-42dd-a511-bd725f3d90eb None None] MFA Rules not processed for user `726af9dc72be4568bddeea8b6b48533a`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:20:14.832570 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e715daf4-2015-42dd-a511-bd725f3d90eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:14.911760 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e5b2c5-7c4d-4c0b-9953-a18dc9ce08da admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:14.937969 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe80495-a1a1-42f7-96ca-a962f274e937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:14.938910 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe80495-a1a1-42f7-96ca-a962f274e937 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:14.939395 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe80495-a1a1-42f7-96ca-a962f274e937 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:14.939847 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe80495-a1a1-42f7-96ca-a962f274e937 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:14.940838 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe80495-a1a1-42f7-96ca-a962f274e937 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:14.942734 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe80495-a1a1-42f7-96ca-a962f274e937 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:14.977494 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1701/3424] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:20:14.981073 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe80495-a1a1-42f7-96ca-a962f274e937 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:15.000901 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe80495-a1a1-42f7-96ca-a962f274e937 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:15.015839 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02f333a-4eb5-454a-bdfe-7928c234c49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:15.016916 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f333a-4eb5-454a-bdfe-7928c234c49b admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:15.017451 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f333a-4eb5-454a-bdfe-7928c234c49b admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:15.018063 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f333a-4eb5-454a-bdfe-7928c234c49b admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:15.019032 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02f333a-4eb5-454a-bdfe-7928c234c49b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:15.025267 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02f333a-4eb5-454a-bdfe-7928c234c49b admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:15.036881 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1724/3425] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:20:14 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:20:15.053993 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1702/3426] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:20:15.064135 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e715daf4-2015-42dd-a511-bd725f3d90eb None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:15.094830 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e715daf4-2015-42dd-a511-bd725f3d90eb None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:15.118177 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaa917f-574c-4dda-8b32-3a8da43638e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:15.119104 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa917f-574c-4dda-8b32-3a8da43638e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:15.119394 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa917f-574c-4dda-8b32-3a8da43638e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:15.119705 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa917f-574c-4dda-8b32-3a8da43638e2 admin admin] PATH_INFO: `/v3/projects/b4708f1ec57540ffbf2076b94d3acd40/users/79454ddcd2be44858ebeec32e97eed54/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:15.169819 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaa917f-574c-4dda-8b32-3a8da43638e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4708f1ec57540ffbf2076b94d3acd40, user_id=79454ddcd2be44858ebeec32e97eed54, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:15.172595 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaa917f-574c-4dda-8b32-3a8da43638e2 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:15.305908 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1725/3427] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:20:15 2022] PUT /identity/v3/projects/b4708f1ec57540ffbf2076b94d3acd40/users/79454ddcd2be44858ebeec32e97eed54/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:20:15.317056 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fab2ea-9f61-4545-a182-bb3269d1a3dc None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:15.317627 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fab2ea-9f61-4545-a182-bb3269d1a3dc None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:15.317969 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fab2ea-9f61-4545-a182-bb3269d1a3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:15.387756 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-90fab2ea-9f61-4545-a182-bb3269d1a3dc None None] MFA Rules not processed for user `79454ddcd2be44858ebeec32e97eed54`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:20:15.389576 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-90fab2ea-9f61-4545-a182-bb3269d1a3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:15.547423 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1703/3428] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:20:15 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:20:16.089339 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaa917f-574c-4dda-8b32-3a8da43638e2 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:16.091257 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-baaa917f-574c-4dda-8b32-3a8da43638e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:16.225072 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58040077-3f70-45c6-97e2-30c66cbbaecb None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:16.225688 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58040077-3f70-45c6-97e2-30c66cbbaecb None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:16.225688 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58040077-3f70-45c6-97e2-30c66cbbaecb None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:16.227123 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1704/3429] 10.222.0.52 () {54 vars in 912 bytes} [Sat May 14 21:20:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:20:16.233385 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b8ea95-1e8b-4e64-ac14-0dfe0450c659 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:16.233697 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b8ea95-1e8b-4e64-ac14-0dfe0450c659 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:16.234031 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b8ea95-1e8b-4e64-ac14-0dfe0450c659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:16.268440 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-c2b8ea95-1e8b-4e64-ac14-0dfe0450c659 None None] MFA Rules not processed for user `0812ae67e44d483baf2dbb1a5332a1d7`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:20:16.272539 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c2b8ea95-1e8b-4e64-ac14-0dfe0450c659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:16.291620 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaa917f-574c-4dda-8b32-3a8da43638e2 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:16.298885 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2047cc8f-b08a-4d38-9252-57adc266be55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:16.300856 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047cc8f-b08a-4d38-9252-57adc266be55 service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:16.301361 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047cc8f-b08a-4d38-9252-57adc266be55 service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:16.301839 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047cc8f-b08a-4d38-9252-57adc266be55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:16.371944 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1705/3430] 10.222.0.52 () {58 vars in 1009 bytes} [Sat May 14 21:20:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:20:16.402500 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b8ea95-1e8b-4e64-ac14-0dfe0450c659 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:16.404492 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c2b8ea95-1e8b-4e64-ac14-0dfe0450c659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:16.426249 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b8ea95-1e8b-4e64-ac14-0dfe0450c659 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:16.433470 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acfabad-7398-423d-990a-c3344f27d0a2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:16.434263 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acfabad-7398-423d-990a-c3344f27d0a2 service placement] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:16.434680 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acfabad-7398-423d-990a-c3344f27d0a2 service placement] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:16.435066 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acfabad-7398-423d-990a-c3344f27d0a2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:16.447871 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acfabad-7398-423d-990a-c3344f27d0a2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:16.449996 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acfabad-7398-423d-990a-c3344f27d0a2 service placement] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:16.476678 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1706/3431] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:20:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:20:16.538985 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2047cc8f-b08a-4d38-9252-57adc266be55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:16.541571 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2047cc8f-b08a-4d38-9252-57adc266be55 service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:16.602980 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1726/3432] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:20:16 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:20:16.857850 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acfabad-7398-423d-990a-c3344f27d0a2 service placement] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:16.874378 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acfabad-7398-423d-990a-c3344f27d0a2 service placement] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:16.881122 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa232028-593d-436e-941a-4f3111e6c80e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:16.888427 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa232028-593d-436e-941a-4f3111e6c80e service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:16.888427 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa232028-593d-436e-941a-4f3111e6c80e service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:16.888427 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa232028-593d-436e-941a-4f3111e6c80e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:16.893431 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa232028-593d-436e-941a-4f3111e6c80e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:16.895180 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa232028-593d-436e-941a-4f3111e6c80e service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:16.906038 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1707/3433] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:20:16 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:20:17.368166 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb848d4-1567-4b06-a8cd-ac89af59084e None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:17.370977 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb848d4-1567-4b06-a8cd-ac89af59084e None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:17.370977 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb848d4-1567-4b06-a8cd-ac89af59084e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:17.398608 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-8bb848d4-1567-4b06-a8cd-ac89af59084e None None] MFA Rules not processed for user `71080496c33c4e2c8b2e16b950f0b9ea`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:20:17.398608 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-8bb848d4-1567-4b06-a8cd-ac89af59084e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:17.477798 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1727/3434] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:20:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:20:19.079093 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa232028-593d-436e-941a-4f3111e6c80e service nova] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:19.080992 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-fa232028-593d-436e-941a-4f3111e6c80e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:19.095745 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa232028-593d-436e-941a-4f3111e6c80e service nova] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:19.102613 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f8c4a6-1d84-4d72-9d67-7a8cbd1d84de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:19.103260 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8c4a6-1d84-4d72-9d67-7a8cbd1d84de service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:19.103600 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8c4a6-1d84-4d72-9d67-7a8cbd1d84de service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:19.104010 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8c4a6-1d84-4d72-9d67-7a8cbd1d84de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:19.105828 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-77f8c4a6-1d84-4d72-9d67-7a8cbd1d84de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:19.169159 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f8c4a6-1d84-4d72-9d67-7a8cbd1d84de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:19.170793 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f8c4a6-1d84-4d72-9d67-7a8cbd1d84de service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:19.180467 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1708/3435] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:20:19 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:20:19.201796 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb848d4-1567-4b06-a8cd-ac89af59084e None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:19.263425 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb848d4-1567-4b06-a8cd-ac89af59084e None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:19.269179 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad9ca35-f206-4949-84ab-fc2611990bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:19.270108 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9ca35-f206-4949-84ab-fc2611990bf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:19.270413 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9ca35-f206-4949-84ab-fc2611990bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:19.270716 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9ca35-f206-4949-84ab-fc2611990bf3 admin admin] PATH_INFO: `/v3/users/864bf93bab484c59baf94bb474d22b17` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:19.272263 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad9ca35-f206-4949-84ab-fc2611990bf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=864bf93bab484c59baf94bb474d22b17)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:19.274309 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad9ca35-f206-4949-84ab-fc2611990bf3 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:19.613596 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6ad9ca35-f206-4949-84ab-fc2611990bf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '864bf93bab484c59baf94bb474d22b17'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:19.641256 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6ad9ca35-f206-4949-84ab-fc2611990bf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '864bf93bab484c59baf94bb474d22b17'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:19.661543 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6ad9ca35-f206-4949-84ab-fc2611990bf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '864bf93bab484c59baf94bb474d22b17'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:19.803813 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6ad9ca35-f206-4949-84ab-fc2611990bf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '864bf93bab484c59baf94bb474d22b17'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:19.804892 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6ad9ca35-f206-4949-84ab-fc2611990bf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '864bf93bab484c59baf94bb474d22b17'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:19.812297 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1728/3436] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:20:19 2022] DELETE /identity/v3/users/864bf93bab484c59baf94bb474d22b17 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:20:19.818343 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c89c683-1675-4e16-8509-4bf5492e51b0 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:19.819003 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c89c683-1675-4e16-8509-4bf5492e51b0 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:19.819579 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c89c683-1675-4e16-8509-4bf5492e51b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:19.844881 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-6c89c683-1675-4e16-8509-4bf5492e51b0 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:20:19.846396 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-6c89c683-1675-4e16-8509-4bf5492e51b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:19.914406 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1709/3437] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:20:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:20:19.925224 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad9ca35-f206-4949-84ab-fc2611990bf3 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:19.926833 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-6ad9ca35-f206-4949-84ab-fc2611990bf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:20.015897 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad9ca35-f206-4949-84ab-fc2611990bf3 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:20.021776 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b79bb5b-2942-4708-a34a-9c18719596fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:20.025181 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79bb5b-2942-4708-a34a-9c18719596fb service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:20.025181 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79bb5b-2942-4708-a34a-9c18719596fb service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:20.025181 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79bb5b-2942-4708-a34a-9c18719596fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:20.035535 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b79bb5b-2942-4708-a34a-9c18719596fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:20.037045 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b79bb5b-2942-4708-a34a-9c18719596fb service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:20.059634 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1729/3438] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:20:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:20:20.708081 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c89c683-1675-4e16-8509-4bf5492e51b0 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:20.709571 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-6c89c683-1675-4e16-8509-4bf5492e51b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:20.723944 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c89c683-1675-4e16-8509-4bf5492e51b0 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:20.729001 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ace6042-7c61-401a-9c6d-a4389812483b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:20.730593 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace6042-7c61-401a-9c6d-a4389812483b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:20.731077 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace6042-7c61-401a-9c6d-a4389812483b admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:20.731806 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace6042-7c61-401a-9c6d-a4389812483b admin admin] PATH_INFO: `/v3/projects/86e98defef1b46aca7b944826148ce8b` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:20.733823 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ace6042-7c61-401a-9c6d-a4389812483b admin admin] RBAC: Authorizing `identity:delete_project(project_id=86e98defef1b46aca7b944826148ce8b)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:20.738985 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ace6042-7c61-401a-9c6d-a4389812483b admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:20.868747 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7ace6042-7c61-401a-9c6d-a4389812483b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86e98defef1b46aca7b944826148ce8b', 'request_id': 'req-7ace6042-7c61-401a-9c6d-a4389812483b'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:20.894200 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7ace6042-7c61-401a-9c6d-a4389812483b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86e98defef1b46aca7b944826148ce8b', 'request_id': 'req-7ace6042-7c61-401a-9c6d-a4389812483b'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:20.905224 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7ace6042-7c61-401a-9c6d-a4389812483b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86e98defef1b46aca7b944826148ce8b', 'request_id': 'req-7ace6042-7c61-401a-9c6d-a4389812483b'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:21.057676 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7ace6042-7c61-401a-9c6d-a4389812483b admin admin] The token cache is being invalidate because project 86e98defef1b46aca7b944826148ce8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:20:21.058711 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7ace6042-7c61-401a-9c6d-a4389812483b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:21.060038 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7ace6042-7c61-401a-9c6d-a4389812483b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:21.061995 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1710/3439] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:20:20 2022] DELETE /identity/v3/projects/86e98defef1b46aca7b944826148ce8b => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:20:21.066376 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b79bb5b-2942-4708-a34a-9c18719596fb service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:21.077536 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b79bb5b-2942-4708-a34a-9c18719596fb service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:21.148274 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ed1b0-52fa-4751-86b4-6862d0df6cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:21.149281 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ed1b0-52fa-4751-86b4-6862d0df6cb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:21.149564 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ed1b0-52fa-4751-86b4-6862d0df6cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:21.149833 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ed1b0-52fa-4751-86b4-6862d0df6cb1 admin admin] PATH_INFO: `/v3/users/726af9dc72be4568bddeea8b6b48533a` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:21.151184 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203ed1b0-52fa-4751-86b4-6862d0df6cb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=726af9dc72be4568bddeea8b6b48533a)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:21.153151 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203ed1b0-52fa-4751-86b4-6862d0df6cb1 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:21.388987 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-203ed1b0-52fa-4751-86b4-6862d0df6cb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '726af9dc72be4568bddeea8b6b48533a'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:21.403676 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-203ed1b0-52fa-4751-86b4-6862d0df6cb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '726af9dc72be4568bddeea8b6b48533a'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:21.410985 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-203ed1b0-52fa-4751-86b4-6862d0df6cb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '726af9dc72be4568bddeea8b6b48533a'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:21.548905 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-203ed1b0-52fa-4751-86b4-6862d0df6cb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '726af9dc72be4568bddeea8b6b48533a'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:21.552020 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-203ed1b0-52fa-4751-86b4-6862d0df6cb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '726af9dc72be4568bddeea8b6b48533a'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:21.558823 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1730/3440] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:20:21 2022] DELETE /identity/v3/users/726af9dc72be4568bddeea8b6b48533a => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:20:21.873040 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043440f3-1b8e-492d-ad31-3c8049426935 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:21.873509 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043440f3-1b8e-492d-ad31-3c8049426935 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:21.874186 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043440f3-1b8e-492d-ad31-3c8049426935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:21.907462 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-043440f3-1b8e-492d-ad31-3c8049426935 None None] MFA Rules not processed for user `a42e0caa0878447f98544e74f767c7ca`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:20:21.909774 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-043440f3-1b8e-492d-ad31-3c8049426935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:22.056137 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1711/3441] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:20:21 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:20:22.120603 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ed1b0-52fa-4751-86b4-6862d0df6cb1 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:22.122899 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-203ed1b0-52fa-4751-86b4-6862d0df6cb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:22.285363 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ed1b0-52fa-4751-86b4-6862d0df6cb1 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:22.295199 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bc7df6-8dda-476d-99f5-3527b6661ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:22.296321 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc7df6-8dda-476d-99f5-3527b6661ef6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:22.296709 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc7df6-8dda-476d-99f5-3527b6661ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:22.297234 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc7df6-8dda-476d-99f5-3527b6661ef6 admin admin] PATH_INFO: `/v3/users/79454ddcd2be44858ebeec32e97eed54` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:22.298583 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bc7df6-8dda-476d-99f5-3527b6661ef6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79454ddcd2be44858ebeec32e97eed54)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:22.302866 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bc7df6-8dda-476d-99f5-3527b6661ef6 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:22.322298 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043440f3-1b8e-492d-ad31-3c8049426935 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:22.325220 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-043440f3-1b8e-492d-ad31-3c8049426935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:22.355278 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043440f3-1b8e-492d-ad31-3c8049426935 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:22.371270 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a46ef6-2d0c-4956-9c03-8db3b05e1d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:22.373195 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a46ef6-2d0c-4956-9c03-8db3b05e1d4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:22.374482 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a46ef6-2d0c-4956-9c03-8db3b05e1d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:22.388769 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a46ef6-2d0c-4956-9c03-8db3b05e1d4c admin admin] PATH_INFO: `/v3/projects/610a4977340042f6a112eddeae090c85` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:22.388769 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a46ef6-2d0c-4956-9c03-8db3b05e1d4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=610a4977340042f6a112eddeae090c85)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:22.388769 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a46ef6-2d0c-4956-9c03-8db3b05e1d4c admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:22.572174 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c9a46ef6-2d0c-4956-9c03-8db3b05e1d4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '610a4977340042f6a112eddeae090c85', 'request_id': 'req-c9a46ef6-2d0c-4956-9c03-8db3b05e1d4c'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:22.572654 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f5bc7df6-8dda-476d-99f5-3527b6661ef6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79454ddcd2be44858ebeec32e97eed54'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:22.584694 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c9a46ef6-2d0c-4956-9c03-8db3b05e1d4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '610a4977340042f6a112eddeae090c85', 'request_id': 'req-c9a46ef6-2d0c-4956-9c03-8db3b05e1d4c'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:22.597155 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c9a46ef6-2d0c-4956-9c03-8db3b05e1d4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '610a4977340042f6a112eddeae090c85', 'request_id': 'req-c9a46ef6-2d0c-4956-9c03-8db3b05e1d4c'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:22.602287 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f5bc7df6-8dda-476d-99f5-3527b6661ef6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79454ddcd2be44858ebeec32e97eed54'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:22.617155 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f5bc7df6-8dda-476d-99f5-3527b6661ef6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79454ddcd2be44858ebeec32e97eed54'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:22.684991 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c9a46ef6-2d0c-4956-9c03-8db3b05e1d4c admin admin] The token cache is being invalidate because project 610a4977340042f6a112eddeae090c85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:20:22.686259 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c9a46ef6-2d0c-4956-9c03-8db3b05e1d4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:22.686945 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c9a46ef6-2d0c-4956-9c03-8db3b05e1d4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:22.688760 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1712/3442] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:20:22 2022] DELETE /identity/v3/projects/610a4977340042f6a112eddeae090c85 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:20:22.695011 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3acf7a-0d79-43f5-80e4-81a640158e16 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:22.695395 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3acf7a-0d79-43f5-80e4-81a640158e16 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:22.695775 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3acf7a-0d79-43f5-80e4-81a640158e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:22.717574 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-5e3acf7a-0d79-43f5-80e4-81a640158e16 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:20:22.718893 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-5e3acf7a-0d79-43f5-80e4-81a640158e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:22.762602 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f5bc7df6-8dda-476d-99f5-3527b6661ef6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79454ddcd2be44858ebeec32e97eed54'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:22.763912 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f5bc7df6-8dda-476d-99f5-3527b6661ef6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79454ddcd2be44858ebeec32e97eed54'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:22.772898 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1731/3443] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:20:22 2022] DELETE /identity/v3/users/79454ddcd2be44858ebeec32e97eed54 => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:20:22.778177 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e322c869-65cf-418e-a723-93a7d0bc66bc None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:22.779014 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e322c869-65cf-418e-a723-93a7d0bc66bc None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:22.779678 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e322c869-65cf-418e-a723-93a7d0bc66bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:22.810004 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1713/3444] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:20:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:20:22.811045 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3acf7a-0d79-43f5-80e4-81a640158e16 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:22.812591 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-5e3acf7a-0d79-43f5-80e4-81a640158e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:22.829139 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-e322c869-65cf-418e-a723-93a7d0bc66bc None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:20:22.831178 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e322c869-65cf-418e-a723-93a7d0bc66bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:22.902920 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3acf7a-0d79-43f5-80e4-81a640158e16 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:22.959250 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1732/3445] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:20:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:20:22.960970 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a29e3e-3d80-403a-a279-1f68cee23bc0 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:22.961365 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a29e3e-3d80-403a-a279-1f68cee23bc0 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:22.961744 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a29e3e-3d80-403a-a279-1f68cee23bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:22.965685 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a74df90-4896-46af-9184-5881dd7e3760 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:22.966587 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a74df90-4896-46af-9184-5881dd7e3760 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:22.967038 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a74df90-4896-46af-9184-5881dd7e3760 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:22.967572 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a74df90-4896-46af-9184-5881dd7e3760 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:22.969762 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-0a74df90-4896-46af-9184-5881dd7e3760 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:22.985824 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-48a29e3e-3d80-403a-a279-1f68cee23bc0 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:20:22.987713 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-48a29e3e-3d80-403a-a279-1f68cee23bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:22.990022 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a74df90-4896-46af-9184-5881dd7e3760 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:22.992511 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a74df90-4896-46af-9184-5881dd7e3760 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:22.997807 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1733/3446] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:20:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:20:22.999004 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a29e3e-3d80-403a-a279-1f68cee23bc0 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:23.008714 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1714/3447] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:20:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:20:23.010136 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a74df90-4896-46af-9184-5881dd7e3760 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:23.014267 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a29e3e-3d80-403a-a279-1f68cee23bc0 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:23.018329 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f091c2-dd63-4e99-bf95-13d55d4abe3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:23.018861 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f091c2-dd63-4e99-bf95-13d55d4abe3c service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:23.019276 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f091c2-dd63-4e99-bf95-13d55d4abe3c service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:23.020260 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f091c2-dd63-4e99-bf95-13d55d4abe3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:23.023840 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a74df90-4896-46af-9184-5881dd7e3760 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:23.030224 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d34016-5825-40e3-9901-1d94b9a556fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:23.031892 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d34016-5825-40e3-9901-1d94b9a556fb admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:23.032419 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d34016-5825-40e3-9901-1d94b9a556fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:23.032590 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f091c2-dd63-4e99-bf95-13d55d4abe3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:23.033039 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d34016-5825-40e3-9901-1d94b9a556fb admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:23.034670 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d34016-5825-40e3-9901-1d94b9a556fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:20:23.035027 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f091c2-dd63-4e99-bf95-13d55d4abe3c service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:23.035329 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d34016-5825-40e3-9901-1d94b9a556fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:23.038458 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d34016-5825-40e3-9901-1d94b9a556fb admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:23.048867 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1734/3448] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:20:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:20:23.055231 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1715/3449] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:20:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:20:23.059142 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f091c2-dd63-4e99-bf95-13d55d4abe3c service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:23.071429 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f091c2-dd63-4e99-bf95-13d55d4abe3c service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:23.077545 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499bb393-0d99-49ee-b11f-88fe941f85f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:23.083259 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499bb393-0d99-49ee-b11f-88fe941f85f9 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:23.083259 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499bb393-0d99-49ee-b11f-88fe941f85f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:23.083259 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499bb393-0d99-49ee-b11f-88fe941f85f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:23.083259 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499bb393-0d99-49ee-b11f-88fe941f85f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:23.083259 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499bb393-0d99-49ee-b11f-88fe941f85f9 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:23.184831 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1735/3450] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:20:23 2022] POST /identity/v3/projects => generated 385 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:20:23.186076 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d34016-5825-40e3-9901-1d94b9a556fb admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:23.201314 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d34016-5825-40e3-9901-1d94b9a556fb admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:23.324311 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0af6f2b-d24b-4520-8355-08fb135e3376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:23.325420 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af6f2b-d24b-4520-8355-08fb135e3376 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:23.325715 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af6f2b-d24b-4520-8355-08fb135e3376 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:23.325975 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af6f2b-d24b-4520-8355-08fb135e3376 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:23.326676 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0af6f2b-d24b-4520-8355-08fb135e3376 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:23.330834 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0af6f2b-d24b-4520-8355-08fb135e3376 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:23.465386 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1716/3451] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:20:23 2022] POST /identity/v3/users => generated 293 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:20:23.468678 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499bb393-0d99-49ee-b11f-88fe941f85f9 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:23.480240 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499bb393-0d99-49ee-b11f-88fe941f85f9 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:23.485807 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0867a310-b953-4b64-8dd0-9729b76e86b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:23.486726 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0867a310-b953-4b64-8dd0-9729b76e86b4 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:23.487389 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0867a310-b953-4b64-8dd0-9729b76e86b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:23.487770 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0867a310-b953-4b64-8dd0-9729b76e86b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:23.488603 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0867a310-b953-4b64-8dd0-9729b76e86b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:23.490311 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0867a310-b953-4b64-8dd0-9729b76e86b4 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:23.509238 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1736/3452] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:20:23.513282 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0af6f2b-d24b-4520-8355-08fb135e3376 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:23.520406 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0af6f2b-d24b-4520-8355-08fb135e3376 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:23.526288 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d4aa1a-06d9-4af3-b63a-ef4d77ad4f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:23.526532 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d4aa1a-06d9-4af3-b63a-ef4d77ad4f91 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:23.526966 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d4aa1a-06d9-4af3-b63a-ef4d77ad4f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:23.527253 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d4aa1a-06d9-4af3-b63a-ef4d77ad4f91 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:23.528021 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d4aa1a-06d9-4af3-b63a-ef4d77ad4f91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:23.529696 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d4aa1a-06d9-4af3-b63a-ef4d77ad4f91 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:23.542355 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1717/3453] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:20:23.546495 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0867a310-b953-4b64-8dd0-9729b76e86b4 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:23.559604 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0867a310-b953-4b64-8dd0-9729b76e86b4 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:23.568614 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef80afdf-28c0-4cdb-ba82-225a075c991f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:23.569613 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80afdf-28c0-4cdb-ba82-225a075c991f admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:23.569877 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80afdf-28c0-4cdb-ba82-225a075c991f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:23.570149 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80afdf-28c0-4cdb-ba82-225a075c991f admin admin] PATH_INFO: `/v3/projects/44c96286063c40ac948610903a50e98f/users/f2ef9ae6c6d24ba0b85fd8f41afb9c05/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:23.591820 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef80afdf-28c0-4cdb-ba82-225a075c991f admin admin] RBAC: Authorizing `identity:create_grant(project_id=44c96286063c40ac948610903a50e98f, user_id=f2ef9ae6c6d24ba0b85fd8f41afb9c05, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:23.595838 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef80afdf-28c0-4cdb-ba82-225a075c991f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:23.680099 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1737/3454] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:20:23 2022] PUT /identity/v3/projects/44c96286063c40ac948610903a50e98f/users/f2ef9ae6c6d24ba0b85fd8f41afb9c05/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:20:23.685324 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf63d3-0b26-4aea-a01b-8abec4c17a16 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:23.688848 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf63d3-0b26-4aea-a01b-8abec4c17a16 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:23.688848 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf63d3-0b26-4aea-a01b-8abec4c17a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:23.762128 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-ebcf63d3-0b26-4aea-a01b-8abec4c17a16 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:20:23.762128 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-ebcf63d3-0b26-4aea-a01b-8abec4c17a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:23.884378 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1718/3455] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:20:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:20:23.897899 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef80afdf-28c0-4cdb-ba82-225a075c991f admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:23.968558 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef80afdf-28c0-4cdb-ba82-225a075c991f admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:23.973540 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891228e7-708e-44c4-a48b-d0dfebfdf6fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:23.974260 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891228e7-708e-44c4-a48b-d0dfebfdf6fe service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:23.974617 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891228e7-708e-44c4-a48b-d0dfebfdf6fe service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:23.974811 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891228e7-708e-44c4-a48b-d0dfebfdf6fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:23.986052 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891228e7-708e-44c4-a48b-d0dfebfdf6fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:23.987827 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891228e7-708e-44c4-a48b-d0dfebfdf6fe service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:24.001006 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1738/3456] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:20:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:20:24.350313 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcf63d3-0b26-4aea-a01b-8abec4c17a16 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:24.351584 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-ebcf63d3-0b26-4aea-a01b-8abec4c17a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:24.372473 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcf63d3-0b26-4aea-a01b-8abec4c17a16 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:24.377591 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d6cffb-e349-4c99-b286-d5fe0febd03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:24.378473 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d6cffb-e349-4c99-b286-d5fe0febd03b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:24.378755 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d6cffb-e349-4c99-b286-d5fe0febd03b admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:24.379035 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d6cffb-e349-4c99-b286-d5fe0febd03b admin admin] PATH_INFO: `/v3/projects/b4708f1ec57540ffbf2076b94d3acd40` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:24.380546 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d6cffb-e349-4c99-b286-d5fe0febd03b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4708f1ec57540ffbf2076b94d3acd40)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:24.382488 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d6cffb-e349-4c99-b286-d5fe0febd03b admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:24.560687 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-43d6cffb-e349-4c99-b286-d5fe0febd03b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4708f1ec57540ffbf2076b94d3acd40', 'request_id': 'req-43d6cffb-e349-4c99-b286-d5fe0febd03b'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:24.577272 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-43d6cffb-e349-4c99-b286-d5fe0febd03b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4708f1ec57540ffbf2076b94d3acd40', 'request_id': 'req-43d6cffb-e349-4c99-b286-d5fe0febd03b'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:24.909977 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-43d6cffb-e349-4c99-b286-d5fe0febd03b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4708f1ec57540ffbf2076b94d3acd40', 'request_id': 'req-43d6cffb-e349-4c99-b286-d5fe0febd03b'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:24.909977 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-43d6cffb-e349-4c99-b286-d5fe0febd03b admin admin] The token cache is being invalidate because project b4708f1ec57540ffbf2076b94d3acd40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:20:24.909977 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-43d6cffb-e349-4c99-b286-d5fe0febd03b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:24.909977 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-43d6cffb-e349-4c99-b286-d5fe0febd03b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:24.909977 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1719/3457] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:20:24 2022] DELETE /identity/v3/projects/b4708f1ec57540ffbf2076b94d3acd40 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:20:24.913497 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58964f4-5544-4218-bd5e-205c1e77463f None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:24.913497 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58964f4-5544-4218-bd5e-205c1e77463f None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:24.913497 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58964f4-5544-4218-bd5e-205c1e77463f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:24.913497 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-a58964f4-5544-4218-bd5e-205c1e77463f None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:20:24.913497 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-a58964f4-5544-4218-bd5e-205c1e77463f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:24.913497 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1739/3458] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:20:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:20:24.914770 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca366f67-b15e-4243-bf9d-72a5062a22b8 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:24.914770 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca366f67-b15e-4243-bf9d-72a5062a22b8 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:24.914770 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca366f67-b15e-4243-bf9d-72a5062a22b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:24.914770 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-ca366f67-b15e-4243-bf9d-72a5062a22b8 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:20:24.914770 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-ca366f67-b15e-4243-bf9d-72a5062a22b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:24.914770 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1720/3459] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:20:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:20:24.916101 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58964f4-5544-4218-bd5e-205c1e77463f None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:24.916101 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58964f4-5544-4218-bd5e-205c1e77463f None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:24.925097 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b0ccdd-8a8d-42d1-8e28-5bdba8b18d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:24.925097 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b0ccdd-8a8d-42d1-8e28-5bdba8b18d7d admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:24.925097 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b0ccdd-8a8d-42d1-8e28-5bdba8b18d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:24.925097 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b0ccdd-8a8d-42d1-8e28-5bdba8b18d7d admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:24.925533 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b0ccdd-8a8d-42d1-8e28-5bdba8b18d7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:20:24.925533 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b0ccdd-8a8d-42d1-8e28-5bdba8b18d7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:24.925533 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b0ccdd-8a8d-42d1-8e28-5bdba8b18d7d admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:24.953145 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca366f67-b15e-4243-bf9d-72a5062a22b8 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:24.954731 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1740/3460] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:20:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:20:24.963525 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca366f67-b15e-4243-bf9d-72a5062a22b8 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:24.972597 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35037f71-eba9-465f-b9dd-d9f2583d15ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:24.973670 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35037f71-eba9-465f-b9dd-d9f2583d15ad admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:24.973966 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35037f71-eba9-465f-b9dd-d9f2583d15ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:24.974977 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35037f71-eba9-465f-b9dd-d9f2583d15ad admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:24.975077 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35037f71-eba9-465f-b9dd-d9f2583d15ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:24.977275 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35037f71-eba9-465f-b9dd-d9f2583d15ad admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:25.177898 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1721/3461] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:20:24 2022] POST /identity/v3/projects => generated 389 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:20:25.181597 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b0ccdd-8a8d-42d1-8e28-5bdba8b18d7d admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:25.195210 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b0ccdd-8a8d-42d1-8e28-5bdba8b18d7d admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:25.306190 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f74e0-0ba6-4b2b-9241-d9b11da5cb93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:25.306877 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f74e0-0ba6-4b2b-9241-d9b11da5cb93 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:25.311280 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f74e0-0ba6-4b2b-9241-d9b11da5cb93 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:25.311280 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f74e0-0ba6-4b2b-9241-d9b11da5cb93 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:25.311280 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708f74e0-0ba6-4b2b-9241-d9b11da5cb93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:25.311280 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708f74e0-0ba6-4b2b-9241-d9b11da5cb93 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:25.429584 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35037f71-eba9-465f-b9dd-d9f2583d15ad admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:25.430081 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1741/3462] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:20:25 2022] POST /identity/v3/users => generated 295 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:20:25.446023 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35037f71-eba9-465f-b9dd-d9f2583d15ad admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:25.450238 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4ff041-7b59-477c-b18f-fcd2eba71d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:25.451040 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ff041-7b59-477c-b18f-fcd2eba71d8f admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:25.451575 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ff041-7b59-477c-b18f-fcd2eba71d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:25.452077 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ff041-7b59-477c-b18f-fcd2eba71d8f admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:25.452958 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4ff041-7b59-477c-b18f-fcd2eba71d8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:25.454653 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4ff041-7b59-477c-b18f-fcd2eba71d8f admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:25.476285 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1722/3463] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:20:25 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:20:25.477609 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f74e0-0ba6-4b2b-9241-d9b11da5cb93 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:25.491319 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f74e0-0ba6-4b2b-9241-d9b11da5cb93 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:25.496429 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a57786-72a9-4718-892e-79f5bb508818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:25.497182 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a57786-72a9-4718-892e-79f5bb508818 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:25.497539 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a57786-72a9-4718-892e-79f5bb508818 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:25.497889 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a57786-72a9-4718-892e-79f5bb508818 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:25.498713 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a57786-72a9-4718-892e-79f5bb508818 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:25.500472 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a57786-72a9-4718-892e-79f5bb508818 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:25.512506 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1742/3464] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:20:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:20:25.519811 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4ff041-7b59-477c-b18f-fcd2eba71d8f admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:25.531955 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4ff041-7b59-477c-b18f-fcd2eba71d8f admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:25.541626 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c963ff-5c6e-4953-bcf8-7451a291d177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:25.542621 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c963ff-5c6e-4953-bcf8-7451a291d177 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:25.543417 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c963ff-5c6e-4953-bcf8-7451a291d177 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:25.543732 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c963ff-5c6e-4953-bcf8-7451a291d177 admin admin] PATH_INFO: `/v3/projects/040d1a9c0d014b1697cfa93771ebfefa/users/fc192a867aa243259c5c2722f8f8f304/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:25.565788 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c963ff-5c6e-4953-bcf8-7451a291d177 admin admin] RBAC: Authorizing `identity:create_grant(project_id=040d1a9c0d014b1697cfa93771ebfefa, user_id=fc192a867aa243259c5c2722f8f8f304, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:25.568582 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c963ff-5c6e-4953-bcf8-7451a291d177 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:25.650339 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1723/3465] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:20:25 2022] PUT /identity/v3/projects/040d1a9c0d014b1697cfa93771ebfefa/users/fc192a867aa243259c5c2722f8f8f304/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:20:25.653991 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc2a423-ba95-4ef7-9fce-2764d0336564 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:25.654278 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc2a423-ba95-4ef7-9fce-2764d0336564 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:25.654559 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc2a423-ba95-4ef7-9fce-2764d0336564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:25.703598 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-2cc2a423-ba95-4ef7-9fce-2764d0336564 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:20:25.706302 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-2cc2a423-ba95-4ef7-9fce-2764d0336564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:25.785196 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1743/3466] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:20:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:20:25.802194 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c963ff-5c6e-4953-bcf8-7451a291d177 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:25.805137 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-87c963ff-5c6e-4953-bcf8-7451a291d177 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:25.879876 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c963ff-5c6e-4953-bcf8-7451a291d177 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:25.883597 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90745783-1e9a-4d52-977d-74a2113e5aee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:25.884239 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90745783-1e9a-4d52-977d-74a2113e5aee service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:25.884521 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90745783-1e9a-4d52-977d-74a2113e5aee service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:25.884795 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90745783-1e9a-4d52-977d-74a2113e5aee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:25.894787 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90745783-1e9a-4d52-977d-74a2113e5aee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:25.896314 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90745783-1e9a-4d52-977d-74a2113e5aee service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:25.906534 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1724/3467] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:20:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:20:25.984274 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc2a423-ba95-4ef7-9fce-2764d0336564 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:25.986526 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-2cc2a423-ba95-4ef7-9fce-2764d0336564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:25.999038 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc2a423-ba95-4ef7-9fce-2764d0336564 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:26.004970 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2032b5-7f1f-4fa4-a616-949ec028cb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:26.006125 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2032b5-7f1f-4fa4-a616-949ec028cb6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:26.006785 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2032b5-7f1f-4fa4-a616-949ec028cb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:26.007271 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2032b5-7f1f-4fa4-a616-949ec028cb6f admin admin] PATH_INFO: `/v3/users/cfcb989a491440b3bf74ddc055ee14d3` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:26.008601 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2032b5-7f1f-4fa4-a616-949ec028cb6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfcb989a491440b3bf74ddc055ee14d3)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:26.011289 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2032b5-7f1f-4fa4-a616-949ec028cb6f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:26.238874 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-7f2032b5-7f1f-4fa4-a616-949ec028cb6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfcb989a491440b3bf74ddc055ee14d3'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:26.306911 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-7f2032b5-7f1f-4fa4-a616-949ec028cb6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfcb989a491440b3bf74ddc055ee14d3'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:26.326010 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-7f2032b5-7f1f-4fa4-a616-949ec028cb6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfcb989a491440b3bf74ddc055ee14d3'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:26.522965 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-7f2032b5-7f1f-4fa4-a616-949ec028cb6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfcb989a491440b3bf74ddc055ee14d3'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:26.523322 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-7f2032b5-7f1f-4fa4-a616-949ec028cb6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfcb989a491440b3bf74ddc055ee14d3'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:26.535627 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1744/3468] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:20:25 2022] DELETE /identity/v3/users/cfcb989a491440b3bf74ddc055ee14d3 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:20:27.044281 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1617eab9-69e8-4420-bcfa-90d57dcf0e9a None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:27.044828 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1617eab9-69e8-4420-bcfa-90d57dcf0e9a None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:27.045233 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1617eab9-69e8-4420-bcfa-90d57dcf0e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:27.075349 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-1617eab9-69e8-4420-bcfa-90d57dcf0e9a None None] MFA Rules not processed for user `985e9f2f783e4a329e9a4c100a06134c`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:20:27.077322 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-1617eab9-69e8-4420-bcfa-90d57dcf0e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:27.150918 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1725/3469] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:20:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:20:27.521099 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2032b5-7f1f-4fa4-a616-949ec028cb6f admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:27.524723 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-7f2032b5-7f1f-4fa4-a616-949ec028cb6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:27.689115 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2032b5-7f1f-4fa4-a616-949ec028cb6f admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:27.701715 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5973ef3-3c40-409b-8ce0-cf469891b801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:27.702659 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5973ef3-3c40-409b-8ce0-cf469891b801 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:27.703273 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5973ef3-3c40-409b-8ce0-cf469891b801 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:27.703828 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5973ef3-3c40-409b-8ce0-cf469891b801 admin admin] PATH_INFO: `/v3/projects/74bb7b020fae4bcaa3a440acc60c7a1d` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:27.706139 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5973ef3-3c40-409b-8ce0-cf469891b801 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74bb7b020fae4bcaa3a440acc60c7a1d)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:27.708640 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5973ef3-3c40-409b-8ce0-cf469891b801 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:27.867088 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d5973ef3-3c40-409b-8ce0-cf469891b801 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74bb7b020fae4bcaa3a440acc60c7a1d', 'request_id': 'req-d5973ef3-3c40-409b-8ce0-cf469891b801'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:27.873680 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d5973ef3-3c40-409b-8ce0-cf469891b801 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74bb7b020fae4bcaa3a440acc60c7a1d', 'request_id': 'req-d5973ef3-3c40-409b-8ce0-cf469891b801'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:28.135296 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d5973ef3-3c40-409b-8ce0-cf469891b801 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74bb7b020fae4bcaa3a440acc60c7a1d', 'request_id': 'req-d5973ef3-3c40-409b-8ce0-cf469891b801'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:28.169882 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d5973ef3-3c40-409b-8ce0-cf469891b801 admin admin] The token cache is being invalidate because project 74bb7b020fae4bcaa3a440acc60c7a1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:20:28.170158 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d5973ef3-3c40-409b-8ce0-cf469891b801 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:28.171500 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d5973ef3-3c40-409b-8ce0-cf469891b801 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:28.174017 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1745/3470] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:20:27 2022] DELETE /identity/v3/projects/74bb7b020fae4bcaa3a440acc60c7a1d => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:20:28.178031 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1617eab9-69e8-4420-bcfa-90d57dcf0e9a None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:28.198994 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1617eab9-69e8-4420-bcfa-90d57dcf0e9a None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:28.316559 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e40e1af-4c24-41fd-be86-928d740bdda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:28.317634 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e40e1af-4c24-41fd-be86-928d740bdda0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:28.318126 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e40e1af-4c24-41fd-be86-928d740bdda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:28.318590 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e40e1af-4c24-41fd-be86-928d740bdda0 admin admin] PATH_INFO: `/v3/users/f92bc689e5984b699f7fbae8194faac8` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:28.320696 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e40e1af-4c24-41fd-be86-928d740bdda0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f92bc689e5984b699f7fbae8194faac8)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:28.325707 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e40e1af-4c24-41fd-be86-928d740bdda0 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:28.724735 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3e40e1af-4c24-41fd-be86-928d740bdda0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f92bc689e5984b699f7fbae8194faac8'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:28.736440 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3e40e1af-4c24-41fd-be86-928d740bdda0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f92bc689e5984b699f7fbae8194faac8'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:28.737262 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3e40e1af-4c24-41fd-be86-928d740bdda0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f92bc689e5984b699f7fbae8194faac8'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:28.821356 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3e40e1af-4c24-41fd-be86-928d740bdda0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f92bc689e5984b699f7fbae8194faac8'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:28.858715 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3e40e1af-4c24-41fd-be86-928d740bdda0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f92bc689e5984b699f7fbae8194faac8'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:28.874034 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1726/3471] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:20:28 2022] DELETE /identity/v3/users/f92bc689e5984b699f7fbae8194faac8 => generated 0 bytes in 692 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:20:29.149845 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc92c5-b1c2-4a1a-b4e2-09a0e3512f86 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:29.150255 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc92c5-b1c2-4a1a-b4e2-09a0e3512f86 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:29.150402 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc92c5-b1c2-4a1a-b4e2-09a0e3512f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:29.188600 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-9dcc92c5-b1c2-4a1a-b4e2-09a0e3512f86 None None] MFA Rules not processed for user `fc192a867aa243259c5c2722f8f8f304`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:20:29.190183 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-9dcc92c5-b1c2-4a1a-b4e2-09a0e3512f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:29.322479 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1746/3472] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:20:29 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:20:29.536061 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e40e1af-4c24-41fd-be86-928d740bdda0 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:29.539030 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-3e40e1af-4c24-41fd-be86-928d740bdda0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:29.731022 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e40e1af-4c24-41fd-be86-928d740bdda0 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:29.751180 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44221b3c-8a48-40ac-8c3d-13dea46c08d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:29.753840 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44221b3c-8a48-40ac-8c3d-13dea46c08d3 service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:29.755149 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44221b3c-8a48-40ac-8c3d-13dea46c08d3 service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:29.755921 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44221b3c-8a48-40ac-8c3d-13dea46c08d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:29.769103 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44221b3c-8a48-40ac-8c3d-13dea46c08d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:29.771050 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44221b3c-8a48-40ac-8c3d-13dea46c08d3 service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:29.784609 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1727/3473] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:20:29 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:20:30.120755 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcc92c5-b1c2-4a1a-b4e2-09a0e3512f86 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:30.122382 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-9dcc92c5-b1c2-4a1a-b4e2-09a0e3512f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:30.208807 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcc92c5-b1c2-4a1a-b4e2-09a0e3512f86 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:30.214089 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc78da-36ee-4535-8887-3816eb0acd80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:30.215220 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc78da-36ee-4535-8887-3816eb0acd80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:30.215731 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc78da-36ee-4535-8887-3816eb0acd80 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:30.216011 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc78da-36ee-4535-8887-3816eb0acd80 admin admin] PATH_INFO: `/v3/projects/c79f31fb90604938b4bd03091dea4a49` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:30.217206 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cc78da-36ee-4535-8887-3816eb0acd80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c79f31fb90604938b4bd03091dea4a49)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:30.219118 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cc78da-36ee-4535-8887-3816eb0acd80 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:30.327561 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c3cc78da-36ee-4535-8887-3816eb0acd80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c79f31fb90604938b4bd03091dea4a49', 'request_id': 'req-c3cc78da-36ee-4535-8887-3816eb0acd80'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:30.336384 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c3cc78da-36ee-4535-8887-3816eb0acd80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c79f31fb90604938b4bd03091dea4a49', 'request_id': 'req-c3cc78da-36ee-4535-8887-3816eb0acd80'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:30.422094 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c3cc78da-36ee-4535-8887-3816eb0acd80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c79f31fb90604938b4bd03091dea4a49', 'request_id': 'req-c3cc78da-36ee-4535-8887-3816eb0acd80'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:30.434903 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c3cc78da-36ee-4535-8887-3816eb0acd80 admin admin] The token cache is being invalidate because project c79f31fb90604938b4bd03091dea4a49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:20:30.435253 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c3cc78da-36ee-4535-8887-3816eb0acd80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:30.435928 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c3cc78da-36ee-4535-8887-3816eb0acd80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:30.437781 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1747/3474] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:20:30 2022] DELETE /identity/v3/projects/c79f31fb90604938b4bd03091dea4a49 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:20:30.442888 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d87fe-baa7-43eb-a5b1-33b755a7fbc4 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:30.443576 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d87fe-baa7-43eb-a5b1-33b755a7fbc4 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:30.443955 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d87fe-baa7-43eb-a5b1-33b755a7fbc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:30.473696 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-934d87fe-baa7-43eb-a5b1-33b755a7fbc4 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:20:30.475027 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-934d87fe-baa7-43eb-a5b1-33b755a7fbc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:30.583925 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1728/3475] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:20:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:20:30.591001 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef40e731-aa98-4b01-addf-78dad6ac2b84 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:30.591294 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef40e731-aa98-4b01-addf-78dad6ac2b84 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:30.591613 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef40e731-aa98-4b01-addf-78dad6ac2b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:30.634079 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-ef40e731-aa98-4b01-addf-78dad6ac2b84 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:20:30.636609 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ef40e731-aa98-4b01-addf-78dad6ac2b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:30.652807 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d87fe-baa7-43eb-a5b1-33b755a7fbc4 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:30.663915 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1748/3476] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:20:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:20:30.669511 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d87fe-baa7-43eb-a5b1-33b755a7fbc4 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:30.679222 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c313ab-d842-4b88-a4e2-adeb74d48d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:30.680196 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c313ab-d842-4b88-a4e2-adeb74d48d3e admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:30.680634 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c313ab-d842-4b88-a4e2-adeb74d48d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:30.681048 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c313ab-d842-4b88-a4e2-adeb74d48d3e admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:30.681995 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c313ab-d842-4b88-a4e2-adeb74d48d3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:20:30.682487 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c313ab-d842-4b88-a4e2-adeb74d48d3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:30.684439 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c313ab-d842-4b88-a4e2-adeb74d48d3e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:30.705783 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef40e731-aa98-4b01-addf-78dad6ac2b84 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:30.706601 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1729/3477] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:20:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:20:30.723675 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef40e731-aa98-4b01-addf-78dad6ac2b84 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:30.733272 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c669d42-874c-4a59-b005-c2e92734859b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:30.733955 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c669d42-874c-4a59-b005-c2e92734859b admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:30.734240 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c669d42-874c-4a59-b005-c2e92734859b admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:30.734521 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c669d42-874c-4a59-b005-c2e92734859b admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:30.735213 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c669d42-874c-4a59-b005-c2e92734859b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:30.745384 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c669d42-874c-4a59-b005-c2e92734859b admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:31.106347 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c313ab-d842-4b88-a4e2-adeb74d48d3e admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:31.106924 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1749/3478] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:20:30 2022] POST /identity/v3/projects => generated 405 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:20:31.133668 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c313ab-d842-4b88-a4e2-adeb74d48d3e admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:31.298393 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853d69b9-9947-4a43-bc7c-d32f2ab24b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:31.300066 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d69b9-9947-4a43-bc7c-d32f2ab24b6a admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:31.300656 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d69b9-9947-4a43-bc7c-d32f2ab24b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:31.301196 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d69b9-9947-4a43-bc7c-d32f2ab24b6a admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:31.301978 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853d69b9-9947-4a43-bc7c-d32f2ab24b6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:31.304817 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853d69b9-9947-4a43-bc7c-d32f2ab24b6a admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:31.413358 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1730/3479] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:20:31 2022] POST /identity/v3/users => generated 303 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:20:31.417482 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c669d42-874c-4a59-b005-c2e92734859b admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:31.431754 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c669d42-874c-4a59-b005-c2e92734859b admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:31.438791 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56efe64-8a79-4f45-a5e7-77f8ea1f0cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:31.441110 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56efe64-8a79-4f45-a5e7-77f8ea1f0cf7 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:31.441110 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56efe64-8a79-4f45-a5e7-77f8ea1f0cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:31.441110 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56efe64-8a79-4f45-a5e7-77f8ea1f0cf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:31.441337 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56efe64-8a79-4f45-a5e7-77f8ea1f0cf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:31.443000 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56efe64-8a79-4f45-a5e7-77f8ea1f0cf7 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:31.468086 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1750/3480] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:20:31 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:20:31.470897 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853d69b9-9947-4a43-bc7c-d32f2ab24b6a admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:31.484854 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853d69b9-9947-4a43-bc7c-d32f2ab24b6a admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:31.497788 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b7bccb-488b-4212-8182-01e53b2df0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:31.498791 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7bccb-488b-4212-8182-01e53b2df0d9 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:31.499086 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7bccb-488b-4212-8182-01e53b2df0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:31.499368 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7bccb-488b-4212-8182-01e53b2df0d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:31.500860 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b7bccb-488b-4212-8182-01e53b2df0d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:31.504366 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b7bccb-488b-4212-8182-01e53b2df0d9 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:31.521005 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1731/3481] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:20:31 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:20:31.525284 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56efe64-8a79-4f45-a5e7-77f8ea1f0cf7 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:31.540854 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56efe64-8a79-4f45-a5e7-77f8ea1f0cf7 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:31.546663 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013410ce-3802-46bc-9798-b0e5a8220abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:31.547836 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013410ce-3802-46bc-9798-b0e5a8220abb admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:31.548267 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013410ce-3802-46bc-9798-b0e5a8220abb admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:31.548885 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013410ce-3802-46bc-9798-b0e5a8220abb admin admin] PATH_INFO: `/v3/projects/66fc055a2aec4a6eb2f751ebde2d777d/users/6c54054c2785400b8f36b09683913333/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:31.572215 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013410ce-3802-46bc-9798-b0e5a8220abb admin admin] RBAC: Authorizing `identity:create_grant(project_id=66fc055a2aec4a6eb2f751ebde2d777d, user_id=6c54054c2785400b8f36b09683913333, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:31.575756 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013410ce-3802-46bc-9798-b0e5a8220abb admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:31.700526 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1751/3482] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:20:31 2022] PUT /identity/v3/projects/66fc055a2aec4a6eb2f751ebde2d777d/users/6c54054c2785400b8f36b09683913333/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:20:31.706533 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af0f4e-b68f-4f42-abaa-5e019e8f5ed4 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:31.707033 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af0f4e-b68f-4f42-abaa-5e019e8f5ed4 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:31.707117 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af0f4e-b68f-4f42-abaa-5e019e8f5ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:31.733344 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-11af0f4e-b68f-4f42-abaa-5e019e8f5ed4 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:20:31.734894 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-11af0f4e-b68f-4f42-abaa-5e019e8f5ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:31.841922 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1732/3483] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:20:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:20:31.863408 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013410ce-3802-46bc-9798-b0e5a8220abb admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:31.866964 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-013410ce-3802-46bc-9798-b0e5a8220abb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:32.009288 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013410ce-3802-46bc-9798-b0e5a8220abb admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:32.019282 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b34f26-c2be-46f2-abe4-5c71bf26621f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:32.020902 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b34f26-c2be-46f2-abe4-5c71bf26621f service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:32.021357 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b34f26-c2be-46f2-abe4-5c71bf26621f service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:32.021792 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b34f26-c2be-46f2-abe4-5c71bf26621f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:32.036021 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b34f26-c2be-46f2-abe4-5c71bf26621f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:32.037878 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b34f26-c2be-46f2-abe4-5c71bf26621f service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:32.053241 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1752/3484] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:20:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:20:34.712661 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98266a6-1b44-4e8d-9ab2-89e695baadb1 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:34.713475 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98266a6-1b44-4e8d-9ab2-89e695baadb1 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:34.713901 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98266a6-1b44-4e8d-9ab2-89e695baadb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:34.761540 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-a98266a6-1b44-4e8d-9ab2-89e695baadb1 None None] MFA Rules not processed for user `f2ef9ae6c6d24ba0b85fd8f41afb9c05`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:20:34.763226 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-a98266a6-1b44-4e8d-9ab2-89e695baadb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:34.884687 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1733/3485] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:20:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:20:34.885948 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b34f26-c2be-46f2-abe4-5c71bf26621f service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:34.887888 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e0b34f26-c2be-46f2-abe4-5c71bf26621f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:34.903631 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b34f26-c2be-46f2-abe4-5c71bf26621f service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:34.920492 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4912ee08-7e5f-4477-8849-48987bb94b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:34.921869 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4912ee08-7e5f-4477-8849-48987bb94b2f admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:34.924662 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4912ee08-7e5f-4477-8849-48987bb94b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:34.924662 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4912ee08-7e5f-4477-8849-48987bb94b2f admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:34.924662 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4912ee08-7e5f-4477-8849-48987bb94b2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:34.926322 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15813410-bce2-4a49-b61c-9e30c1411607 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:34.926870 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15813410-bce2-4a49-b61c-9e30c1411607 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:34.927403 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15813410-bce2-4a49-b61c-9e30c1411607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:34.942977 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4912ee08-7e5f-4477-8849-48987bb94b2f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:34.969587 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-15813410-bce2-4a49-b61c-9e30c1411607 None None] MFA Rules not processed for user `6c54054c2785400b8f36b09683913333`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:20:34.971724 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-15813410-bce2-4a49-b61c-9e30c1411607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:35.059079 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1753/3486] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:20:34 2022] POST /identity/v3/projects => generated 385 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:20:35.060547 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4912ee08-7e5f-4477-8849-48987bb94b2f admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:35.100367 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1734/3487] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:20:34 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:20:35.104923 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15813410-bce2-4a49-b61c-9e30c1411607 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:35.131903 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15813410-bce2-4a49-b61c-9e30c1411607 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:35.219715 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cc35a1-fb2e-4e53-9bc0-4188d0a7efc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:35.221239 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc35a1-fb2e-4e53-9bc0-4188d0a7efc2 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:35.221412 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc35a1-fb2e-4e53-9bc0-4188d0a7efc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:35.221767 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc35a1-fb2e-4e53-9bc0-4188d0a7efc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:35.222541 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cc35a1-fb2e-4e53-9bc0-4188d0a7efc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:35.226445 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cc35a1-fb2e-4e53-9bc0-4188d0a7efc2 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:35.308951 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4912ee08-7e5f-4477-8849-48987bb94b2f admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:35.316905 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00198700-13a4-458b-8b5c-1192f9e554cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:35.318208 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00198700-13a4-458b-8b5c-1192f9e554cb admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:35.318495 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00198700-13a4-458b-8b5c-1192f9e554cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:35.318768 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00198700-13a4-458b-8b5c-1192f9e554cb admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:35.319461 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00198700-13a4-458b-8b5c-1192f9e554cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:35.322938 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00198700-13a4-458b-8b5c-1192f9e554cb admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:35.326545 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1735/3488] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:20:35 2022] POST /identity/v3/projects => generated 405 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:20:35.338716 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cc35a1-fb2e-4e53-9bc0-4188d0a7efc2 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:35.433220 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1754/3489] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:20:35 2022] POST /identity/v3/users => generated 299 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:20:35.434386 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00198700-13a4-458b-8b5c-1192f9e554cb admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:35.460590 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00198700-13a4-458b-8b5c-1192f9e554cb admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:35.492557 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cc35a1-fb2e-4e53-9bc0-4188d0a7efc2 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:35.509443 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a584a64-56b2-46f8-a6d1-5121f60e1653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:35.510409 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a584a64-56b2-46f8-a6d1-5121f60e1653 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:35.510749 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a584a64-56b2-46f8-a6d1-5121f60e1653 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:35.511022 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a584a64-56b2-46f8-a6d1-5121f60e1653 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:35.514342 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a584a64-56b2-46f8-a6d1-5121f60e1653 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:35.519731 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a584a64-56b2-46f8-a6d1-5121f60e1653 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:35.570116 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dae2aa6-bb2c-4775-b4fd-064bc3d68733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:35.570965 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae2aa6-bb2c-4775-b4fd-064bc3d68733 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:35.571074 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae2aa6-bb2c-4775-b4fd-064bc3d68733 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:35.571347 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae2aa6-bb2c-4775-b4fd-064bc3d68733 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:35.572253 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dae2aa6-bb2c-4775-b4fd-064bc3d68733 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:35.573872 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dae2aa6-bb2c-4775-b4fd-064bc3d68733 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:35.594048 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1755/3490] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:20:35 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:20:35.596209 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dae2aa6-bb2c-4775-b4fd-064bc3d68733 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:35.609021 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dae2aa6-bb2c-4775-b4fd-064bc3d68733 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:35.615655 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fbb8aa-22a1-488b-8f46-dfd27db08b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:35.616812 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fbb8aa-22a1-488b-8f46-dfd27db08b56 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:35.617278 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fbb8aa-22a1-488b-8f46-dfd27db08b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:35.617765 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fbb8aa-22a1-488b-8f46-dfd27db08b56 admin admin] PATH_INFO: `/v3/projects/d024008800d2448688d2f18f2ba173de/users/1981905ab1664082abd54822f9ae7c9a/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:35.656780 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fbb8aa-22a1-488b-8f46-dfd27db08b56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d024008800d2448688d2f18f2ba173de, user_id=1981905ab1664082abd54822f9ae7c9a, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:35.656780 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fbb8aa-22a1-488b-8f46-dfd27db08b56 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:35.658256 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1736/3491] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:20:35 2022] POST /identity/v3/users => generated 309 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:20:35.662142 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a584a64-56b2-46f8-a6d1-5121f60e1653 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:35.675433 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a584a64-56b2-46f8-a6d1-5121f60e1653 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:35.687839 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138763fd-0307-47fe-b7b8-a91fd2f732f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:35.688811 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138763fd-0307-47fe-b7b8-a91fd2f732f1 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:35.689515 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138763fd-0307-47fe-b7b8-a91fd2f732f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:35.689823 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138763fd-0307-47fe-b7b8-a91fd2f732f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:35.691839 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138763fd-0307-47fe-b7b8-a91fd2f732f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:35.693512 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138763fd-0307-47fe-b7b8-a91fd2f732f1 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:35.706295 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1737/3492] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:20:35 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:20:35.711585 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138763fd-0307-47fe-b7b8-a91fd2f732f1 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:35.723723 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138763fd-0307-47fe-b7b8-a91fd2f732f1 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:35.730558 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c2f73e-5a6b-4941-801d-79ccf52d8160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:35.731785 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c2f73e-5a6b-4941-801d-79ccf52d8160 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:35.732145 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c2f73e-5a6b-4941-801d-79ccf52d8160 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:35.732496 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c2f73e-5a6b-4941-801d-79ccf52d8160 admin admin] PATH_INFO: `/v3/projects/e4343aaaab754f549258a96e6219da56/users/dab5972289c3443a8c08db0d074590c5/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:35.755985 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c2f73e-5a6b-4941-801d-79ccf52d8160 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4343aaaab754f549258a96e6219da56, user_id=dab5972289c3443a8c08db0d074590c5, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:35.759056 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c2f73e-5a6b-4941-801d-79ccf52d8160 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:35.790041 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1756/3493] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:20:35 2022] PUT /identity/v3/projects/d024008800d2448688d2f18f2ba173de/users/1981905ab1664082abd54822f9ae7c9a/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:20:35.793954 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fbb8aa-22a1-488b-8f46-dfd27db08b56 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:35.859567 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1738/3494] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:20:35 2022] PUT /identity/v3/projects/e4343aaaab754f549258a96e6219da56/users/dab5972289c3443a8c08db0d074590c5/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:20:35.865539 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c2f73e-5a6b-4941-801d-79ccf52d8160 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:35.893434 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fbb8aa-22a1-488b-8f46-dfd27db08b56 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:35.986528 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1033737d-294d-4bce-bd57-66cd32a57aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:35.987754 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033737d-294d-4bce-bd57-66cd32a57aca admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:35.988031 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033737d-294d-4bce-bd57-66cd32a57aca admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:35.989015 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033737d-294d-4bce-bd57-66cd32a57aca admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:35.990066 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1033737d-294d-4bce-bd57-66cd32a57aca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:35.993515 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1033737d-294d-4bce-bd57-66cd32a57aca admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:36.009330 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1757/3495] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:20:35 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:20:36.013283 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c2f73e-5a6b-4941-801d-79ccf52d8160 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:36.016509 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1033737d-294d-4bce-bd57-66cd32a57aca admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:36.020171 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b499b4-f22d-4507-b0e6-79f64f8d8753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:36.020900 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b499b4-f22d-4507-b0e6-79f64f8d8753 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:36.021242 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b499b4-f22d-4507-b0e6-79f64f8d8753 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:36.021557 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b499b4-f22d-4507-b0e6-79f64f8d8753 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:36.022531 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b499b4-f22d-4507-b0e6-79f64f8d8753 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:36.024926 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b499b4-f22d-4507-b0e6-79f64f8d8753 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:36.031809 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1033737d-294d-4bce-bd57-66cd32a57aca admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:36.037203 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1739/3496] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:20:35 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:20:36.049617 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b499b4-f22d-4507-b0e6-79f64f8d8753 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:36.055865 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a7e950-c60d-4424-893b-ed930b1f719c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:36.058661 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a7e950-c60d-4424-893b-ed930b1f719c admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:36.060264 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a7e950-c60d-4424-893b-ed930b1f719c admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:36.062142 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a7e950-c60d-4424-893b-ed930b1f719c admin admin] PATH_INFO: `/v3/projects/d024008800d2448688d2f18f2ba173de/users/1981905ab1664082abd54822f9ae7c9a/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:36.063469 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b499b4-f22d-4507-b0e6-79f64f8d8753 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:36.068584 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a7e950-c60d-4424-893b-ed930b1f719c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d024008800d2448688d2f18f2ba173de, user_id=1981905ab1664082abd54822f9ae7c9a, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:36.072442 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966edf15-4c69-4e6c-96c6-d984c99e3fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:36.073424 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a7e950-c60d-4424-893b-ed930b1f719c admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:36.073704 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966edf15-4c69-4e6c-96c6-d984c99e3fd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:36.074090 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966edf15-4c69-4e6c-96c6-d984c99e3fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:36.074850 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966edf15-4c69-4e6c-96c6-d984c99e3fd0 admin admin] PATH_INFO: `/v3/projects/e4343aaaab754f549258a96e6219da56/users/dab5972289c3443a8c08db0d074590c5/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:36.078268 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966edf15-4c69-4e6c-96c6-d984c99e3fd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4343aaaab754f549258a96e6219da56, user_id=dab5972289c3443a8c08db0d074590c5, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:36.083419 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966edf15-4c69-4e6c-96c6-d984c99e3fd0 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:36.097921 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1758/3497] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:20:36 2022] PUT /identity/v3/projects/d024008800d2448688d2f18f2ba173de/users/1981905ab1664082abd54822f9ae7c9a/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:20:36.099997 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1740/3498] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:20:36 2022] PUT /identity/v3/projects/e4343aaaab754f549258a96e6219da56/users/dab5972289c3443a8c08db0d074590c5/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:20:38.568066 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a73e23-52e3-49cb-9549-c15641fe81bb None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:38.568544 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a73e23-52e3-49cb-9549-c15641fe81bb None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:38.568916 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a73e23-52e3-49cb-9549-c15641fe81bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:38.651202 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-b8a73e23-52e3-49cb-9549-c15641fe81bb None None] MFA Rules not processed for user `dab5972289c3443a8c08db0d074590c5`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:20:38.655038 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b8a73e23-52e3-49cb-9549-c15641fe81bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:38.814710 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1759/3499] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:20:38 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:20:40.880411 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966edf15-4c69-4e6c-96c6-d984c99e3fd0 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:40.999221 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966edf15-4c69-4e6c-96c6-d984c99e3fd0 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:41.005121 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1a0be7-9b16-460b-8ce2-d2917512296b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:41.006122 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1a0be7-9b16-460b-8ce2-d2917512296b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:41.006669 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1a0be7-9b16-460b-8ce2-d2917512296b admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:41.007072 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1a0be7-9b16-460b-8ce2-d2917512296b admin admin] PATH_INFO: `/v3/users/6c54054c2785400b8f36b09683913333` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:41.008441 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1a0be7-9b16-460b-8ce2-d2917512296b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c54054c2785400b8f36b09683913333)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:41.010755 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1a0be7-9b16-460b-8ce2-d2917512296b admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:41.295788 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ef1a0be7-9b16-460b-8ce2-d2917512296b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c54054c2785400b8f36b09683913333'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:41.305195 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ef1a0be7-9b16-460b-8ce2-d2917512296b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c54054c2785400b8f36b09683913333'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:41.306647 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ef1a0be7-9b16-460b-8ce2-d2917512296b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c54054c2785400b8f36b09683913333'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:41.417668 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ef1a0be7-9b16-460b-8ce2-d2917512296b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c54054c2785400b8f36b09683913333'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:41.442088 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ef1a0be7-9b16-460b-8ce2-d2917512296b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c54054c2785400b8f36b09683913333'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:41.456556 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1741/3500] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:20:40 2022] DELETE /identity/v3/users/6c54054c2785400b8f36b09683913333 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:20:41.841298 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a73e23-52e3-49cb-9549-c15641fe81bb None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:41.874470 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a73e23-52e3-49cb-9549-c15641fe81bb None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:41.993254 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d6c9c2-a2b8-4497-827d-df97d088fc94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:41.994455 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d6c9c2-a2b8-4497-827d-df97d088fc94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:41.994918 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d6c9c2-a2b8-4497-827d-df97d088fc94 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:41.995954 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d6c9c2-a2b8-4497-827d-df97d088fc94 admin admin] PATH_INFO: `/v3/projects/66fc055a2aec4a6eb2f751ebde2d777d` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:41.998246 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d6c9c2-a2b8-4497-827d-df97d088fc94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66fc055a2aec4a6eb2f751ebde2d777d)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:42.006968 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d6c9c2-a2b8-4497-827d-df97d088fc94 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:42.158589 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d4d6c9c2-a2b8-4497-827d-df97d088fc94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66fc055a2aec4a6eb2f751ebde2d777d', 'request_id': 'req-d4d6c9c2-a2b8-4497-827d-df97d088fc94'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:42.169081 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d4d6c9c2-a2b8-4497-827d-df97d088fc94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66fc055a2aec4a6eb2f751ebde2d777d', 'request_id': 'req-d4d6c9c2-a2b8-4497-827d-df97d088fc94'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:42.255787 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d4d6c9c2-a2b8-4497-827d-df97d088fc94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66fc055a2aec4a6eb2f751ebde2d777d', 'request_id': 'req-d4d6c9c2-a2b8-4497-827d-df97d088fc94'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:42.269915 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d4d6c9c2-a2b8-4497-827d-df97d088fc94 admin admin] The token cache is being invalidate because project 66fc055a2aec4a6eb2f751ebde2d777d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:20:42.270525 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d4d6c9c2-a2b8-4497-827d-df97d088fc94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:42.271389 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d4d6c9c2-a2b8-4497-827d-df97d088fc94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:42.274983 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1760/3501] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:20:41 2022] DELETE /identity/v3/projects/66fc055a2aec4a6eb2f751ebde2d777d => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:20:42.279025 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1a0be7-9b16-460b-8ce2-d2917512296b admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:42.281241 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-ef1a0be7-9b16-460b-8ce2-d2917512296b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:42.307429 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1a0be7-9b16-460b-8ce2-d2917512296b admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:42.405872 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc88daf-fd7b-4932-8b8f-6cef1730a763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:42.407176 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc88daf-fd7b-4932-8b8f-6cef1730a763 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:42.408638 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc88daf-fd7b-4932-8b8f-6cef1730a763 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:42.409068 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc88daf-fd7b-4932-8b8f-6cef1730a763 admin admin] PATH_INFO: `/v3/users/dab5972289c3443a8c08db0d074590c5` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:42.411325 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc88daf-fd7b-4932-8b8f-6cef1730a763 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dab5972289c3443a8c08db0d074590c5)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:42.414337 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc88daf-fd7b-4932-8b8f-6cef1730a763 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:42.703460 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9cc88daf-fd7b-4932-8b8f-6cef1730a763 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dab5972289c3443a8c08db0d074590c5'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:42.721178 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9cc88daf-fd7b-4932-8b8f-6cef1730a763 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dab5972289c3443a8c08db0d074590c5'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:42.723242 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9cc88daf-fd7b-4932-8b8f-6cef1730a763 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dab5972289c3443a8c08db0d074590c5'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:42.812322 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9cc88daf-fd7b-4932-8b8f-6cef1730a763 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dab5972289c3443a8c08db0d074590c5'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:42.850263 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9cc88daf-fd7b-4932-8b8f-6cef1730a763 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dab5972289c3443a8c08db0d074590c5'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:42.862193 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1742/3502] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:20:42 2022] DELETE /identity/v3/users/dab5972289c3443a8c08db0d074590c5 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:20:43.964622 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d6c9c2-a2b8-4497-827d-df97d088fc94 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:43.967293 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d4d6c9c2-a2b8-4497-827d-df97d088fc94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:43.982515 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d6c9c2-a2b8-4497-827d-df97d088fc94 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:44.068474 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f55461-9725-4c5f-a89a-4b842a4cf336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:44.069605 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f55461-9725-4c5f-a89a-4b842a4cf336 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:44.070036 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f55461-9725-4c5f-a89a-4b842a4cf336 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:44.070491 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f55461-9725-4c5f-a89a-4b842a4cf336 admin admin] PATH_INFO: `/v3/projects/e4343aaaab754f549258a96e6219da56` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:44.071891 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f55461-9725-4c5f-a89a-4b842a4cf336 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4343aaaab754f549258a96e6219da56)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:44.076598 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f55461-9725-4c5f-a89a-4b842a4cf336 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:44.226710 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b1f55461-9725-4c5f-a89a-4b842a4cf336 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4343aaaab754f549258a96e6219da56', 'request_id': 'req-b1f55461-9725-4c5f-a89a-4b842a4cf336'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:44.233116 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b1f55461-9725-4c5f-a89a-4b842a4cf336 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4343aaaab754f549258a96e6219da56', 'request_id': 'req-b1f55461-9725-4c5f-a89a-4b842a4cf336'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:44.347258 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b1f55461-9725-4c5f-a89a-4b842a4cf336 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4343aaaab754f549258a96e6219da56', 'request_id': 'req-b1f55461-9725-4c5f-a89a-4b842a4cf336'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:44.371792 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b1f55461-9725-4c5f-a89a-4b842a4cf336 admin admin] The token cache is being invalidate because project e4343aaaab754f549258a96e6219da56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:20:44.372109 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b1f55461-9725-4c5f-a89a-4b842a4cf336 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:44.376682 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b1f55461-9725-4c5f-a89a-4b842a4cf336 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:44.380042 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1761/3503] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:20:43 2022] DELETE /identity/v3/projects/e4343aaaab754f549258a96e6219da56 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:20:44.385747 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b30324-3ee3-488b-94ae-a1c2d49e5677 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:44.386105 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b30324-3ee3-488b-94ae-a1c2d49e5677 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:44.386186 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b30324-3ee3-488b-94ae-a1c2d49e5677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:44.409105 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-88b30324-3ee3-488b-94ae-a1c2d49e5677 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:20:44.410678 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-88b30324-3ee3-488b-94ae-a1c2d49e5677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:44.514490 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1743/3504] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:20:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:20:44.517434 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6949bb73-a9aa-4440-9d85-588a1668208a None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:44.517964 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6949bb73-a9aa-4440-9d85-588a1668208a None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:44.518355 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6949bb73-a9aa-4440-9d85-588a1668208a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:44.538192 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-6949bb73-a9aa-4440-9d85-588a1668208a None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:20:44.541360 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-6949bb73-a9aa-4440-9d85-588a1668208a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:44.556708 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1762/3505] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:20:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:20:44.559447 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b30324-3ee3-488b-94ae-a1c2d49e5677 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:44.570958 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b30324-3ee3-488b-94ae-a1c2d49e5677 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:44.576523 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f00b7-83df-42b5-8e2f-fbeae5858533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:44.577244 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f00b7-83df-42b5-8e2f-fbeae5858533 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:44.577674 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f00b7-83df-42b5-8e2f-fbeae5858533 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:44.577953 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f00b7-83df-42b5-8e2f-fbeae5858533 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:44.578843 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7f00b7-83df-42b5-8e2f-fbeae5858533 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:20:44.579996 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7f00b7-83df-42b5-8e2f-fbeae5858533 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:44.581464 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7f00b7-83df-42b5-8e2f-fbeae5858533 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:44.595289 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1744/3506] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:20:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:20:44.599531 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6949bb73-a9aa-4440-9d85-588a1668208a None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:44.609376 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6949bb73-a9aa-4440-9d85-588a1668208a None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:44.615221 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4615297-02cd-4b8a-b40e-0c55fd1649cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:44.615944 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4615297-02cd-4b8a-b40e-0c55fd1649cd admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:44.619665 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4615297-02cd-4b8a-b40e-0c55fd1649cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:44.619665 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4615297-02cd-4b8a-b40e-0c55fd1649cd admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:44.619665 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4615297-02cd-4b8a-b40e-0c55fd1649cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:44.619665 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4615297-02cd-4b8a-b40e-0c55fd1649cd admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:44.751947 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1763/3507] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:20:44 2022] POST /identity/v3/projects => generated 391 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:20:44.756206 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f00b7-83df-42b5-8e2f-fbeae5858533 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:44.769552 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f00b7-83df-42b5-8e2f-fbeae5858533 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:44.875695 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b119a3-de8f-4dd3-b9a4-1121db58a405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:44.876552 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b119a3-de8f-4dd3-b9a4-1121db58a405 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:44.876907 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b119a3-de8f-4dd3-b9a4-1121db58a405 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:44.877295 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b119a3-de8f-4dd3-b9a4-1121db58a405 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:44.878395 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b119a3-de8f-4dd3-b9a4-1121db58a405 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:44.881165 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b119a3-de8f-4dd3-b9a4-1121db58a405 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:45.030383 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1745/3508] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:20:44 2022] POST /identity/v3/users => generated 296 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:20:45.034976 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4615297-02cd-4b8a-b40e-0c55fd1649cd admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:45.052548 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4615297-02cd-4b8a-b40e-0c55fd1649cd admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:45.059658 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b6a597-b3aa-46e8-ae4e-ab99683adc03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:45.060613 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6a597-b3aa-46e8-ae4e-ab99683adc03 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:45.060941 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6a597-b3aa-46e8-ae4e-ab99683adc03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:45.061625 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6a597-b3aa-46e8-ae4e-ab99683adc03 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:45.061979 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b6a597-b3aa-46e8-ae4e-ab99683adc03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:45.064581 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b6a597-b3aa-46e8-ae4e-ab99683adc03 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:45.084474 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1764/3509] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:20:45 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:20:45.093769 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b119a3-de8f-4dd3-b9a4-1121db58a405 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:45.112263 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b119a3-de8f-4dd3-b9a4-1121db58a405 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:45.123166 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3901c745-d1d0-4528-a0a4-bc81ede11ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:45.123971 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3901c745-d1d0-4528-a0a4-bc81ede11ab8 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:45.124323 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3901c745-d1d0-4528-a0a4-bc81ede11ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:45.124713 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3901c745-d1d0-4528-a0a4-bc81ede11ab8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:45.125470 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3901c745-d1d0-4528-a0a4-bc81ede11ab8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:45.127762 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3901c745-d1d0-4528-a0a4-bc81ede11ab8 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:45.142385 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1746/3510] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:20:45 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:20:45.146175 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b6a597-b3aa-46e8-ae4e-ab99683adc03 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:45.163202 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b6a597-b3aa-46e8-ae4e-ab99683adc03 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:45.182718 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ee8984-c385-4c8b-87e9-779940bd2a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:45.183729 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee8984-c385-4c8b-87e9-779940bd2a98 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:45.185430 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee8984-c385-4c8b-87e9-779940bd2a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:45.185884 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee8984-c385-4c8b-87e9-779940bd2a98 admin admin] PATH_INFO: `/v3/projects/236a7e87d3af4de2a0ef55f9cbd9dd7a/users/38106105b3a2426a9b4af14185a80031/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:45.213116 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ee8984-c385-4c8b-87e9-779940bd2a98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=236a7e87d3af4de2a0ef55f9cbd9dd7a, user_id=38106105b3a2426a9b4af14185a80031, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:45.216343 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ee8984-c385-4c8b-87e9-779940bd2a98 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:45.328146 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1765/3511] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:20:45 2022] PUT /identity/v3/projects/236a7e87d3af4de2a0ef55f9cbd9dd7a/users/38106105b3a2426a9b4af14185a80031/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:20:45.336382 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2953307-2b99-4678-9201-6fd831377534 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:45.336761 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2953307-2b99-4678-9201-6fd831377534 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:45.337128 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2953307-2b99-4678-9201-6fd831377534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:45.376998 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-e2953307-2b99-4678-9201-6fd831377534 None None] MFA Rules not processed for user `38106105b3a2426a9b4af14185a80031`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:20:45.378379 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e2953307-2b99-4678-9201-6fd831377534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:45.474770 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1747/3512] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:20:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:20:45.479257 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ee8984-c385-4c8b-87e9-779940bd2a98 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:45.578945 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ee8984-c385-4c8b-87e9-779940bd2a98 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:45.587562 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ec537-a546-43fd-8890-4d3bfc610111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:45.588246 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ec537-a546-43fd-8890-4d3bfc610111 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:45.588529 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ec537-a546-43fd-8890-4d3bfc610111 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:45.588854 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ec537-a546-43fd-8890-4d3bfc610111 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:45.589546 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88ec537-a546-43fd-8890-4d3bfc610111 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:45.591659 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88ec537-a546-43fd-8890-4d3bfc610111 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:45.721105 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d87a97a-7ba4-4496-a264-0049657e3b08 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:45.721826 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d87a97a-7ba4-4496-a264-0049657e3b08 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:45.722311 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d87a97a-7ba4-4496-a264-0049657e3b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:45.734674 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1766/3513] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:20:45 2022] POST /identity/v3/projects => generated 393 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:20:45.741110 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ec537-a546-43fd-8890-4d3bfc610111 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:45.760507 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-8d87a97a-7ba4-4496-a264-0049657e3b08 None None] MFA Rules not processed for user `71080496c33c4e2c8b2e16b950f0b9ea`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:20:45.769285 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8d87a97a-7ba4-4496-a264-0049657e3b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:45.851145 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1748/3514] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:20:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:20:45.866316 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ec537-a546-43fd-8890-4d3bfc610111 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:45.871947 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff5d24-7c0c-4195-b26a-bd91a7e3ad6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:45.873286 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff5d24-7c0c-4195-b26a-bd91a7e3ad6b admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:45.876044 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff5d24-7c0c-4195-b26a-bd91a7e3ad6b admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:45.876885 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff5d24-7c0c-4195-b26a-bd91a7e3ad6b admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:45.878359 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ff5d24-7c0c-4195-b26a-bd91a7e3ad6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:45.880390 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ff5d24-7c0c-4195-b26a-bd91a7e3ad6b admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:46.004731 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1767/3515] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:20:45 2022] POST /identity/v3/users => generated 303 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:20:46.009108 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d87a97a-7ba4-4496-a264-0049657e3b08 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:46.022471 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d87a97a-7ba4-4496-a264-0049657e3b08 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:46.027462 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20f3ec7-e93b-4c8d-892f-adeaa553fd9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:46.028170 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f3ec7-e93b-4c8d-892f-adeaa553fd9f admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:46.028454 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f3ec7-e93b-4c8d-892f-adeaa553fd9f admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:46.028732 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f3ec7-e93b-4c8d-892f-adeaa553fd9f admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:46.029546 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20f3ec7-e93b-4c8d-892f-adeaa553fd9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:46.031205 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20f3ec7-e93b-4c8d-892f-adeaa553fd9f admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:46.041833 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1749/3516] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:20:46.046063 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff5d24-7c0c-4195-b26a-bd91a7e3ad6b admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:46.056698 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff5d24-7c0c-4195-b26a-bd91a7e3ad6b admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:46.062490 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529cf5f4-314d-48ff-a7f3-2b249a3d570a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:46.064201 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529cf5f4-314d-48ff-a7f3-2b249a3d570a admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:46.064533 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529cf5f4-314d-48ff-a7f3-2b249a3d570a admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:46.064815 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529cf5f4-314d-48ff-a7f3-2b249a3d570a admin admin] PATH_INFO: `/v3/projects/d4d51eb830dc44dcbc203378797df1a8/users/4696a4e3ba5248108ec9a2b266e10178/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:46.086984 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529cf5f4-314d-48ff-a7f3-2b249a3d570a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4d51eb830dc44dcbc203378797df1a8, user_id=4696a4e3ba5248108ec9a2b266e10178, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:46.091228 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529cf5f4-314d-48ff-a7f3-2b249a3d570a admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:46.190074 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1768/3517] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:20:46 2022] PUT /identity/v3/projects/d4d51eb830dc44dcbc203378797df1a8/users/4696a4e3ba5248108ec9a2b266e10178/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:20:46.193969 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20f3ec7-e93b-4c8d-892f-adeaa553fd9f admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:46.206547 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20f3ec7-e93b-4c8d-892f-adeaa553fd9f admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:46.305836 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfa6296-5d08-478a-8400-75a5dfcac745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:46.306641 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa6296-5d08-478a-8400-75a5dfcac745 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:46.307000 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa6296-5d08-478a-8400-75a5dfcac745 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:46.308251 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa6296-5d08-478a-8400-75a5dfcac745 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:46.311424 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfa6296-5d08-478a-8400-75a5dfcac745 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:46.324227 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfa6296-5d08-478a-8400-75a5dfcac745 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:46.345259 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1750/3518] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:20:46.349629 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529cf5f4-314d-48ff-a7f3-2b249a3d570a admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:46.365605 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529cf5f4-314d-48ff-a7f3-2b249a3d570a admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:46.373865 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dcce05-b07f-4e95-a45e-ef9230cc933c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:46.375563 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dcce05-b07f-4e95-a45e-ef9230cc933c admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:46.376731 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dcce05-b07f-4e95-a45e-ef9230cc933c admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:46.377645 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dcce05-b07f-4e95-a45e-ef9230cc933c admin admin] PATH_INFO: `/v3/projects/d4d51eb830dc44dcbc203378797df1a8/users/4696a4e3ba5248108ec9a2b266e10178/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:46.382818 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dcce05-b07f-4e95-a45e-ef9230cc933c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4d51eb830dc44dcbc203378797df1a8, user_id=4696a4e3ba5248108ec9a2b266e10178, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:46.387400 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dcce05-b07f-4e95-a45e-ef9230cc933c admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:46.400631 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1769/3519] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:20:46 2022] PUT /identity/v3/projects/d4d51eb830dc44dcbc203378797df1a8/users/4696a4e3ba5248108ec9a2b266e10178/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:20:46.413744 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d7fae-5b2f-4ae2-8d70-d20855a80281 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:46.414473 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d7fae-5b2f-4ae2-8d70-d20855a80281 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:46.414769 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d7fae-5b2f-4ae2-8d70-d20855a80281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:46.473231 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-c84d7fae-5b2f-4ae2-8d70-d20855a80281 None None] MFA Rules not processed for user `4696a4e3ba5248108ec9a2b266e10178`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:20:46.474944 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c84d7fae-5b2f-4ae2-8d70-d20855a80281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:46.538065 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92452207-f1a2-49bf-a0ff-5a7400436c89 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:46.538363 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92452207-f1a2-49bf-a0ff-5a7400436c89 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:46.538656 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92452207-f1a2-49bf-a0ff-5a7400436c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:46.643624 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-92452207-f1a2-49bf-a0ff-5a7400436c89 None None] MFA Rules not processed for user `1981905ab1664082abd54822f9ae7c9a`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:20:46.648472 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-92452207-f1a2-49bf-a0ff-5a7400436c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:46.692480 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1751/3520] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:20:46 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:20:46.702261 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a1d916-8f9b-48a2-8e02-ed0f9ddf22ba None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:46.702577 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a1d916-8f9b-48a2-8e02-ed0f9ddf22ba None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:46.702861 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a1d916-8f9b-48a2-8e02-ed0f9ddf22ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:46.747836 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-03a1d916-8f9b-48a2-8e02-ed0f9ddf22ba None None] MFA Rules not processed for user `38106105b3a2426a9b4af14185a80031`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:20:46.749102 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-03a1d916-8f9b-48a2-8e02-ed0f9ddf22ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:46.838589 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1770/3521] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:20:46 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:20:46.852673 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92452207-f1a2-49bf-a0ff-5a7400436c89 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:46.854462 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-92452207-f1a2-49bf-a0ff-5a7400436c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:46.893257 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1752/3522] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:20:46 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:20:46.991809 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92452207-f1a2-49bf-a0ff-5a7400436c89 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:47.002783 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f765652-0e29-4cf8-83d7-eec5eb2b95c1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b5cb86f190f4fcfb06d66cb8f14643f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:47.003455 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f765652-0e29-4cf8-83d7-eec5eb2b95c1 service glance] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:47.003762 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f765652-0e29-4cf8-83d7-eec5eb2b95c1 service glance] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:47.004039 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f765652-0e29-4cf8-83d7-eec5eb2b95c1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:47.028528 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f765652-0e29-4cf8-83d7-eec5eb2b95c1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:47.030529 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f765652-0e29-4cf8-83d7-eec5eb2b95c1 service glance] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:47.061060 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1771/3523] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:20:46 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:20:47.299404 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a1d916-8f9b-48a2-8e02-ed0f9ddf22ba None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:47.301019 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-03a1d916-8f9b-48a2-8e02-ed0f9ddf22ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:47.574951 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a1d916-8f9b-48a2-8e02-ed0f9ddf22ba None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:47.593646 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40acb28-5ac9-4361-9ee8-640a36873db2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:47.602420 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40acb28-5ac9-4361-9ee8-640a36873db2 service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:47.602420 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40acb28-5ac9-4361-9ee8-640a36873db2 service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:47.602420 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40acb28-5ac9-4361-9ee8-640a36873db2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:47.623150 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40acb28-5ac9-4361-9ee8-640a36873db2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:47.624814 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40acb28-5ac9-4361-9ee8-640a36873db2 service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:47.645543 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1753/3524] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:20:47 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:20:48.092943 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f765652-0e29-4cf8-83d7-eec5eb2b95c1 service glance] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:48.098933 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-1f765652-0e29-4cf8-83d7-eec5eb2b95c1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:48.321035 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f765652-0e29-4cf8-83d7-eec5eb2b95c1 service glance] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:48.341115 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85b2d97-a696-43fe-98ad-35f30debcb31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:48.341972 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b2d97-a696-43fe-98ad-35f30debcb31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:48.342255 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b2d97-a696-43fe-98ad-35f30debcb31 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:48.342530 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b2d97-a696-43fe-98ad-35f30debcb31 admin admin] PATH_INFO: `/v3/users/fc192a867aa243259c5c2722f8f8f304` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:48.343865 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85b2d97-a696-43fe-98ad-35f30debcb31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc192a867aa243259c5c2722f8f8f304)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:48.346579 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85b2d97-a696-43fe-98ad-35f30debcb31 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:48.772270 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f85b2d97-a696-43fe-98ad-35f30debcb31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc192a867aa243259c5c2722f8f8f304'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:48.814026 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f85b2d97-a696-43fe-98ad-35f30debcb31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc192a867aa243259c5c2722f8f8f304'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:48.848728 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f85b2d97-a696-43fe-98ad-35f30debcb31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc192a867aa243259c5c2722f8f8f304'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:49.015676 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f85b2d97-a696-43fe-98ad-35f30debcb31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc192a867aa243259c5c2722f8f8f304'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:49.023221 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f85b2d97-a696-43fe-98ad-35f30debcb31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc192a867aa243259c5c2722f8f8f304'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:49.054100 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1772/3525] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:20:48 2022] DELETE /identity/v3/users/fc192a867aa243259c5c2722f8f8f304 => generated 0 bytes in 962 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:20:49.623773 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40acb28-5ac9-4361-9ee8-640a36873db2 service nova] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:49.672485 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40acb28-5ac9-4361-9ee8-640a36873db2 service nova] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:49.850205 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970b153a-daa3-4a3a-84cf-4fd311b863d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:49.851560 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b153a-daa3-4a3a-84cf-4fd311b863d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:49.851560 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b153a-daa3-4a3a-84cf-4fd311b863d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:49.851920 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b153a-daa3-4a3a-84cf-4fd311b863d3 admin admin] PATH_INFO: `/v3/projects/040d1a9c0d014b1697cfa93771ebfefa` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:49.853377 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970b153a-daa3-4a3a-84cf-4fd311b863d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=040d1a9c0d014b1697cfa93771ebfefa)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:49.856770 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970b153a-daa3-4a3a-84cf-4fd311b863d3 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:50.084670 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-970b153a-daa3-4a3a-84cf-4fd311b863d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '040d1a9c0d014b1697cfa93771ebfefa', 'request_id': 'req-970b153a-daa3-4a3a-84cf-4fd311b863d3'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:50.103467 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-970b153a-daa3-4a3a-84cf-4fd311b863d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '040d1a9c0d014b1697cfa93771ebfefa', 'request_id': 'req-970b153a-daa3-4a3a-84cf-4fd311b863d3'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:50.116229 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-970b153a-daa3-4a3a-84cf-4fd311b863d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '040d1a9c0d014b1697cfa93771ebfefa', 'request_id': 'req-970b153a-daa3-4a3a-84cf-4fd311b863d3'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:50.224817 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-970b153a-daa3-4a3a-84cf-4fd311b863d3 admin admin] The token cache is being invalidate because project 040d1a9c0d014b1697cfa93771ebfefa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:20:50.225485 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-970b153a-daa3-4a3a-84cf-4fd311b863d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:50.226383 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-970b153a-daa3-4a3a-84cf-4fd311b863d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:20:50.230178 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1754/3526] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:20:49 2022] DELETE /identity/v3/projects/040d1a9c0d014b1697cfa93771ebfefa => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:20:50.236832 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d23168-5659-451f-97bf-f4ea589e8b00 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:50.237375 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d23168-5659-451f-97bf-f4ea589e8b00 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:50.237450 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d23168-5659-451f-97bf-f4ea589e8b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:50.279452 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-57d23168-5659-451f-97bf-f4ea589e8b00 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:20:50.285322 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-57d23168-5659-451f-97bf-f4ea589e8b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:50.510638 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1773/3527] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:20:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:20:50.520393 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50af11-7f93-4b27-93a9-0f5d712569b4 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:50.521098 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50af11-7f93-4b27-93a9-0f5d712569b4 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:50.521098 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50af11-7f93-4b27-93a9-0f5d712569b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:50.571447 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-ac50af11-7f93-4b27-93a9-0f5d712569b4 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:20:50.572919 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-ac50af11-7f93-4b27-93a9-0f5d712569b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:50.638253 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d23168-5659-451f-97bf-f4ea589e8b00 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:50.650081 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d23168-5659-451f-97bf-f4ea589e8b00 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:50.656788 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1755/3528] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:20:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:20:50.697081 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1c9ffe-daa2-48ae-b864-217dd512540d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:50.700860 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c9ffe-daa2-48ae-b864-217dd512540d admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:50.702097 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c9ffe-daa2-48ae-b864-217dd512540d admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:50.703059 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c9ffe-daa2-48ae-b864-217dd512540d admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:50.704676 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1c9ffe-daa2-48ae-b864-217dd512540d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:20:50.706265 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1c9ffe-daa2-48ae-b864-217dd512540d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:50.721371 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1c9ffe-daa2-48ae-b864-217dd512540d admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:50.795915 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac50af11-7f93-4b27-93a9-0f5d712569b4 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:50.808909 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac50af11-7f93-4b27-93a9-0f5d712569b4 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:50.821352 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1774/3529] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:20:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:20:50.839994 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98117bde-f03b-4d45-a9bf-d042ece50bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:50.840691 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98117bde-f03b-4d45-a9bf-d042ece50bdf admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:50.840970 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98117bde-f03b-4d45-a9bf-d042ece50bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:50.841242 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98117bde-f03b-4d45-a9bf-d042ece50bdf admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:50.846340 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98117bde-f03b-4d45-a9bf-d042ece50bdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:50.857374 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98117bde-f03b-4d45-a9bf-d042ece50bdf admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:51.056981 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1756/3530] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:20:50 2022] POST /identity/v3/projects => generated 377 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:20:51.058553 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1c9ffe-daa2-48ae-b864-217dd512540d admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:51.140497 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1c9ffe-daa2-48ae-b864-217dd512540d admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:51.292610 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f98b550-90f6-4292-ba49-7e0498469f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:51.296216 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98b550-90f6-4292-ba49-7e0498469f4d admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:51.296697 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98b550-90f6-4292-ba49-7e0498469f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:51.297143 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98b550-90f6-4292-ba49-7e0498469f4d admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:51.298099 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f98b550-90f6-4292-ba49-7e0498469f4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:51.306517 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f98b550-90f6-4292-ba49-7e0498469f4d admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:51.467561 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98117bde-f03b-4d45-a9bf-d042ece50bdf admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:51.474050 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1775/3531] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:20:51 2022] POST /identity/v3/users => generated 289 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:20:51.483965 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98117bde-f03b-4d45-a9bf-d042ece50bdf admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:51.529780 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fa2ee9-b036-4934-bcaf-14ef3a7c73a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:51.531106 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa2ee9-b036-4934-bcaf-14ef3a7c73a9 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:51.538337 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa2ee9-b036-4934-bcaf-14ef3a7c73a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:51.538619 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa2ee9-b036-4934-bcaf-14ef3a7c73a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:51.548730 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fa2ee9-b036-4934-bcaf-14ef3a7c73a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:51.558107 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fa2ee9-b036-4934-bcaf-14ef3a7c73a9 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:51.588735 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1757/3532] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:20:51.592836 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f98b550-90f6-4292-ba49-7e0498469f4d admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:51.611902 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f98b550-90f6-4292-ba49-7e0498469f4d admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:51.649085 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbbc060-f439-493e-89c7-5104d68db811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:51.649789 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbbc060-f439-493e-89c7-5104d68db811 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:51.650080 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbbc060-f439-493e-89c7-5104d68db811 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:51.650349 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbbc060-f439-493e-89c7-5104d68db811 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:51.651105 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbbc060-f439-493e-89c7-5104d68db811 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:51.673331 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbbc060-f439-493e-89c7-5104d68db811 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:51.692688 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1776/3533] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:20:51.699572 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fa2ee9-b036-4934-bcaf-14ef3a7c73a9 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:51.721006 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fa2ee9-b036-4934-bcaf-14ef3a7c73a9 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:51.726382 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faaa5d9-f053-4dd6-9577-2119413f5685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:51.727925 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faaa5d9-f053-4dd6-9577-2119413f5685 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:51.728359 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faaa5d9-f053-4dd6-9577-2119413f5685 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:51.728962 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faaa5d9-f053-4dd6-9577-2119413f5685 admin admin] PATH_INFO: `/v3/projects/ba969692dac24c5bab4062ca210bef43/users/b54f1f777ca2448bb3ba65643cfcb530/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:51.765975 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faaa5d9-f053-4dd6-9577-2119413f5685 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba969692dac24c5bab4062ca210bef43, user_id=b54f1f777ca2448bb3ba65643cfcb530, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:51.814997 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faaa5d9-f053-4dd6-9577-2119413f5685 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:51.974653 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4967c0-25b6-4aa1-9444-0c59c672b983 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:51.974943 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4967c0-25b6-4aa1-9444-0c59c672b983 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:51.975220 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4967c0-25b6-4aa1-9444-0c59c672b983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:51.986623 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1758/3534] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:20:51 2022] PUT /identity/v3/projects/ba969692dac24c5bab4062ca210bef43/users/b54f1f777ca2448bb3ba65643cfcb530/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:20:52.024470 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-3c4967c0-25b6-4aa1-9444-0c59c672b983 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:20:52.029375 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-3c4967c0-25b6-4aa1-9444-0c59c672b983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:52.120471 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1777/3535] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:20:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:20:52.151639 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faaa5d9-f053-4dd6-9577-2119413f5685 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:20:52.157541 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-5faaa5d9-f053-4dd6-9577-2119413f5685 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:20:52.234750 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faaa5d9-f053-4dd6-9577-2119413f5685 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:20:52.249313 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46404bfa-95f6-421d-a100-6980213f585e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:20:52.250459 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46404bfa-95f6-421d-a100-6980213f585e service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:20:52.251053 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46404bfa-95f6-421d-a100-6980213f585e service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:20:52.251677 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46404bfa-95f6-421d-a100-6980213f585e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:20:52.267878 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46404bfa-95f6-421d-a100-6980213f585e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:20:52.273198 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46404bfa-95f6-421d-a100-6980213f585e service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:20:52.290797 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1759/3536] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:20:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:21:01.440982 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a4556-1f56-4cf6-909d-55c9189153d6 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:21:01.442090 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a4556-1f56-4cf6-909d-55c9189153d6 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:21:01.442090 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a4556-1f56-4cf6-909d-55c9189153d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:21:01.470558 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-0f1a4556-1f56-4cf6-909d-55c9189153d6 None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:21:01.470558 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-0f1a4556-1f56-4cf6-909d-55c9189153d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:21:01.566074 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1778/3537] 10.222.0.52 () {58 vars in 1009 bytes} [Sat May 14 21:21:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:21:01.763931 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46404bfa-95f6-421d-a100-6980213f585e service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:21:01.765484 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-46404bfa-95f6-421d-a100-6980213f585e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:21:01.884320 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46404bfa-95f6-421d-a100-6980213f585e service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:21:01.894031 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f9ed3e-7b62-412f-87df-ba290125e243 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:21:01.894839 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9ed3e-7b62-412f-87df-ba290125e243 service swift] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:21:01.895221 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9ed3e-7b62-412f-87df-ba290125e243 service swift] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:21:01.895632 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9ed3e-7b62-412f-87df-ba290125e243 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:21:01.904693 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f9ed3e-7b62-412f-87df-ba290125e243 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:21:01.907133 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f9ed3e-7b62-412f-87df-ba290125e243 service swift] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:21:01.918823 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1760/3538] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 21:21:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 21:21:03.044729 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9da2d-948e-4deb-981c-98e17cd5e35e None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:21:03.044729 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9da2d-948e-4deb-981c-98e17cd5e35e None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:21:03.044729 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9da2d-948e-4deb-981c-98e17cd5e35e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:21:03.128999 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-24d9da2d-948e-4deb-981c-98e17cd5e35e None None] MFA Rules not processed for user `b54f1f777ca2448bb3ba65643cfcb530`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:21:03.131051 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-24d9da2d-948e-4deb-981c-98e17cd5e35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:21:03.335736 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1779/3539] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:21:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:21:03.618980 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f9ed3e-7b62-412f-87df-ba290125e243 service swift] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:21:03.620493 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-47f9ed3e-7b62-412f-87df-ba290125e243 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:21:03.729300 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f9ed3e-7b62-412f-87df-ba290125e243 service swift] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:21:03.737310 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f547f-7c25-4cd7-a71d-d79aba1fb253 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:21:03.738361 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f547f-7c25-4cd7-a71d-d79aba1fb253 service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:21:03.739245 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f547f-7c25-4cd7-a71d-d79aba1fb253 service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:21:03.739741 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f547f-7c25-4cd7-a71d-d79aba1fb253 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:21:03.752090 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5f547f-7c25-4cd7-a71d-d79aba1fb253 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:21:03.754170 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5f547f-7c25-4cd7-a71d-d79aba1fb253 service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:21:03.769380 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1761/3540] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:21:03 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:21:09.225702 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19320d47-cd65-4b70-845b-97193e0126f2 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:21:09.226687 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19320d47-cd65-4b70-845b-97193e0126f2 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:21:09.227205 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19320d47-cd65-4b70-845b-97193e0126f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:21:09.262298 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-19320d47-cd65-4b70-845b-97193e0126f2 None None] MFA Rules not processed for user `b54f1f777ca2448bb3ba65643cfcb530`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:21:09.270143 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-19320d47-cd65-4b70-845b-97193e0126f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:21:09.292773 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1780/3541] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:21:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:21:19.973505 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f547f-7c25-4cd7-a71d-d79aba1fb253 service nova] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:21:19.985490 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f547f-7c25-4cd7-a71d-d79aba1fb253 service nova] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:21:19.991213 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e216d648-9f7d-4d0d-838c-e2b367e8342b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:21:19.991891 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e216d648-9f7d-4d0d-838c-e2b367e8342b service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:21:19.992175 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e216d648-9f7d-4d0d-838c-e2b367e8342b service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:21:19.992452 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e216d648-9f7d-4d0d-838c-e2b367e8342b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:21:19.994207 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e216d648-9f7d-4d0d-838c-e2b367e8342b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:21:20.052923 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e216d648-9f7d-4d0d-838c-e2b367e8342b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:21:20.054882 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e216d648-9f7d-4d0d-838c-e2b367e8342b service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:21:20.066739 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1762/3542] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:21:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:21:20.168621 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19320d47-cd65-4b70-845b-97193e0126f2 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:21:20.170160 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-19320d47-cd65-4b70-845b-97193e0126f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:21:20.183772 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19320d47-cd65-4b70-845b-97193e0126f2 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:21:20.188416 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d197e64-08d5-428e-9021-20c7488027eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:21:20.189277 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d197e64-08d5-428e-9021-20c7488027eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:21:20.189557 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d197e64-08d5-428e-9021-20c7488027eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:21:20.189870 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d197e64-08d5-428e-9021-20c7488027eb admin admin] PATH_INFO: `/v3/users/38106105b3a2426a9b4af14185a80031` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:21:20.191302 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d197e64-08d5-428e-9021-20c7488027eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=38106105b3a2426a9b4af14185a80031)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:21:20.193542 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d197e64-08d5-428e-9021-20c7488027eb admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:21:20.399011 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9d197e64-08d5-428e-9021-20c7488027eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38106105b3a2426a9b4af14185a80031'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:21:20.415354 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9d197e64-08d5-428e-9021-20c7488027eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38106105b3a2426a9b4af14185a80031'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:21:20.426383 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9d197e64-08d5-428e-9021-20c7488027eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38106105b3a2426a9b4af14185a80031'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:21:20.542078 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9d197e64-08d5-428e-9021-20c7488027eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38106105b3a2426a9b4af14185a80031'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:21:20.543079 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9d197e64-08d5-428e-9021-20c7488027eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38106105b3a2426a9b4af14185a80031'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:21:20.552864 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1781/3543] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:21:20 2022] DELETE /identity/v3/users/38106105b3a2426a9b4af14185a80031 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:21:20.557961 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2bd67b-2c29-40be-afe8-66942b2fb13a None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:21:20.558290 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2bd67b-2c29-40be-afe8-66942b2fb13a None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:21:20.558584 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2bd67b-2c29-40be-afe8-66942b2fb13a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:21:20.590133 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-3c2bd67b-2c29-40be-afe8-66942b2fb13a None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:21:20.591866 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-3c2bd67b-2c29-40be-afe8-66942b2fb13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:21:20.670557 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1763/3544] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:21:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:21:20.688200 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d197e64-08d5-428e-9021-20c7488027eb admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:21:20.689479 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-9d197e64-08d5-428e-9021-20c7488027eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:21:20.818996 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d197e64-08d5-428e-9021-20c7488027eb admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:21:20.823412 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8eafa8-74b9-4e79-bef6-e76153f2c952 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:21:20.824269 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8eafa8-74b9-4e79-bef6-e76153f2c952 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:21:20.824759 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8eafa8-74b9-4e79-bef6-e76153f2c952 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:21:20.825401 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8eafa8-74b9-4e79-bef6-e76153f2c952 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:21:20.835966 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8eafa8-74b9-4e79-bef6-e76153f2c952 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:21:20.837390 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8eafa8-74b9-4e79-bef6-e76153f2c952 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:21:20.850248 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1782/3545] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:21:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:21:21.640772 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2bd67b-2c29-40be-afe8-66942b2fb13a None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:21:21.642242 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-3c2bd67b-2c29-40be-afe8-66942b2fb13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:21:21.663467 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2bd67b-2c29-40be-afe8-66942b2fb13a None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:21:21.668181 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca0a0cf-5e11-48ba-9339-b9778fa1aaaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:21:21.669258 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca0a0cf-5e11-48ba-9339-b9778fa1aaaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:21:21.669530 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca0a0cf-5e11-48ba-9339-b9778fa1aaaa admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:21:21.669957 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca0a0cf-5e11-48ba-9339-b9778fa1aaaa admin admin] PATH_INFO: `/v3/projects/236a7e87d3af4de2a0ef55f9cbd9dd7a` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:21:21.671200 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca0a0cf-5e11-48ba-9339-b9778fa1aaaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=236a7e87d3af4de2a0ef55f9cbd9dd7a)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:21:21.673788 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca0a0cf-5e11-48ba-9339-b9778fa1aaaa admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:21:21.840578 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-aca0a0cf-5e11-48ba-9339-b9778fa1aaaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '236a7e87d3af4de2a0ef55f9cbd9dd7a', 'request_id': 'req-aca0a0cf-5e11-48ba-9339-b9778fa1aaaa'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:21:21.846512 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-aca0a0cf-5e11-48ba-9339-b9778fa1aaaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '236a7e87d3af4de2a0ef55f9cbd9dd7a', 'request_id': 'req-aca0a0cf-5e11-48ba-9339-b9778fa1aaaa'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:21:21.854084 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-aca0a0cf-5e11-48ba-9339-b9778fa1aaaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '236a7e87d3af4de2a0ef55f9cbd9dd7a', 'request_id': 'req-aca0a0cf-5e11-48ba-9339-b9778fa1aaaa'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:21:21.974513 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-aca0a0cf-5e11-48ba-9339-b9778fa1aaaa admin admin] The token cache is being invalidate because project 236a7e87d3af4de2a0ef55f9cbd9dd7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:21:21.974844 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-aca0a0cf-5e11-48ba-9339-b9778fa1aaaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:21:21.975539 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-aca0a0cf-5e11-48ba-9339-b9778fa1aaaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:21:21.977100 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1764/3546] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:21:21 2022] DELETE /identity/v3/projects/236a7e87d3af4de2a0ef55f9cbd9dd7a => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:21:21.981111 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8eafa8-74b9-4e79-bef6-e76153f2c952 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:21:21.992555 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8eafa8-74b9-4e79-bef6-e76153f2c952 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:21:22.055152 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400b4625-8804-45fa-997e-21d8b8c84172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:21:22.056066 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b4625-8804-45fa-997e-21d8b8c84172 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:21:22.056353 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b4625-8804-45fa-997e-21d8b8c84172 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:21:22.056627 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b4625-8804-45fa-997e-21d8b8c84172 admin admin] PATH_INFO: `/v3/users/4696a4e3ba5248108ec9a2b266e10178` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:21:22.058011 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400b4625-8804-45fa-997e-21d8b8c84172 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4696a4e3ba5248108ec9a2b266e10178)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:21:22.059971 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400b4625-8804-45fa-997e-21d8b8c84172 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:21:22.263322 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-400b4625-8804-45fa-997e-21d8b8c84172 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4696a4e3ba5248108ec9a2b266e10178'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:21:22.278392 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-400b4625-8804-45fa-997e-21d8b8c84172 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4696a4e3ba5248108ec9a2b266e10178'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:21:22.287405 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-400b4625-8804-45fa-997e-21d8b8c84172 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4696a4e3ba5248108ec9a2b266e10178'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:21:22.385153 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-400b4625-8804-45fa-997e-21d8b8c84172 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4696a4e3ba5248108ec9a2b266e10178'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:21:22.388742 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-400b4625-8804-45fa-997e-21d8b8c84172 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4696a4e3ba5248108ec9a2b266e10178'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:21:22.396626 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1783/3547] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:21:21 2022] DELETE /identity/v3/users/4696a4e3ba5248108ec9a2b266e10178 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:21:23.173103 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca0a0cf-5e11-48ba-9339-b9778fa1aaaa admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:21:23.175353 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-aca0a0cf-5e11-48ba-9339-b9778fa1aaaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:21:23.189367 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca0a0cf-5e11-48ba-9339-b9778fa1aaaa admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:21:23.260884 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b2ad0-5c19-42dc-b348-3e1bed021722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:21:23.261751 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b2ad0-5c19-42dc-b348-3e1bed021722 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:21:23.262027 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b2ad0-5c19-42dc-b348-3e1bed021722 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:21:23.262298 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b2ad0-5c19-42dc-b348-3e1bed021722 admin admin] PATH_INFO: `/v3/users/985e9f2f783e4a329e9a4c100a06134c` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:21:23.263471 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2b2ad0-5c19-42dc-b348-3e1bed021722 admin admin] RBAC: Authorizing `identity:delete_user(user_id=985e9f2f783e4a329e9a4c100a06134c)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:21:23.266072 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2b2ad0-5c19-42dc-b348-3e1bed021722 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:21:23.454660 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400b4625-8804-45fa-997e-21d8b8c84172 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:21:23.457739 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-400b4625-8804-45fa-997e-21d8b8c84172 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:21:23.480706 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400b4625-8804-45fa-997e-21d8b8c84172 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:21:23.486521 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd79b5a2-5f9b-499c-b1e1-4c42051b8c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:21:23.488225 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd79b5a2-5f9b-499c-b1e1-4c42051b8c21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:21:23.488514 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd79b5a2-5f9b-499c-b1e1-4c42051b8c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:21:23.488784 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd79b5a2-5f9b-499c-b1e1-4c42051b8c21 admin admin] PATH_INFO: `/v3/projects/d4d51eb830dc44dcbc203378797df1a8` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:21:23.490338 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd79b5a2-5f9b-499c-b1e1-4c42051b8c21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4d51eb830dc44dcbc203378797df1a8)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:21:23.492677 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd79b5a2-5f9b-499c-b1e1-4c42051b8c21 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:21:23.544648 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3a2b2ad0-5c19-42dc-b348-3e1bed021722 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '985e9f2f783e4a329e9a4c100a06134c'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:21:23.555228 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3a2b2ad0-5c19-42dc-b348-3e1bed021722 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '985e9f2f783e4a329e9a4c100a06134c'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:21:23.557040 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3a2b2ad0-5c19-42dc-b348-3e1bed021722 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '985e9f2f783e4a329e9a4c100a06134c'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:21:23.664594 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-dd79b5a2-5f9b-499c-b1e1-4c42051b8c21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4d51eb830dc44dcbc203378797df1a8', 'request_id': 'req-dd79b5a2-5f9b-499c-b1e1-4c42051b8c21'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:21:23.671290 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-dd79b5a2-5f9b-499c-b1e1-4c42051b8c21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4d51eb830dc44dcbc203378797df1a8', 'request_id': 'req-dd79b5a2-5f9b-499c-b1e1-4c42051b8c21'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:21:23.676571 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3a2b2ad0-5c19-42dc-b348-3e1bed021722 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '985e9f2f783e4a329e9a4c100a06134c'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:21:23.695307 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3a2b2ad0-5c19-42dc-b348-3e1bed021722 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '985e9f2f783e4a329e9a4c100a06134c'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:21:23.709914 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1765/3548] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:21:23 2022] DELETE /identity/v3/users/985e9f2f783e4a329e9a4c100a06134c => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:21:23.711248 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c309e-1bef-4d24-98d3-2024cdb721d9 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:21:23.711568 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c309e-1bef-4d24-98d3-2024cdb721d9 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:21:23.712009 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c309e-1bef-4d24-98d3-2024cdb721d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:21:23.740897 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-016c309e-1bef-4d24-98d3-2024cdb721d9 None None] MFA Rules not processed for user `f2ef9ae6c6d24ba0b85fd8f41afb9c05`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:21:23.742244 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-016c309e-1bef-4d24-98d3-2024cdb721d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:21:23.758036 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-dd79b5a2-5f9b-499c-b1e1-4c42051b8c21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4d51eb830dc44dcbc203378797df1a8', 'request_id': 'req-dd79b5a2-5f9b-499c-b1e1-4c42051b8c21'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:21:23.774566 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-dd79b5a2-5f9b-499c-b1e1-4c42051b8c21 admin admin] The token cache is being invalidate because project d4d51eb830dc44dcbc203378797df1a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:21:23.774968 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-dd79b5a2-5f9b-499c-b1e1-4c42051b8c21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:21:23.775764 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-dd79b5a2-5f9b-499c-b1e1-4c42051b8c21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:21:23.778416 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1784/3549] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:21:23 2022] DELETE /identity/v3/projects/d4d51eb830dc44dcbc203378797df1a8 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:21:23.787300 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e1a7e9-8700-42e2-b6d3-1a79bf7b5eff None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:21:23.787820 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e1a7e9-8700-42e2-b6d3-1a79bf7b5eff None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:21:23.788278 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e1a7e9-8700-42e2-b6d3-1a79bf7b5eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:21:23.816885 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1766/3550] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:21:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:21:23.826428 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-39e1a7e9-8700-42e2-b6d3-1a79bf7b5eff None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:21:23.828911 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-39e1a7e9-8700-42e2-b6d3-1a79bf7b5eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:21:23.923519 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1785/3551] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:21:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:21:23.926852 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce2eab-623c-4183-8091-ff248a725c13 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:21:23.927655 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce2eab-623c-4183-8091-ff248a725c13 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:21:23.928919 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce2eab-623c-4183-8091-ff248a725c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:21:23.964393 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-e9ce2eab-623c-4183-8091-ff248a725c13 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:21:23.966513 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e9ce2eab-623c-4183-8091-ff248a725c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:21:23.980642 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1767/3552] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:21:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:21:23.987286 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e1a7e9-8700-42e2-b6d3-1a79bf7b5eff None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:21:23.998623 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e1a7e9-8700-42e2-b6d3-1a79bf7b5eff None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:21:24.011541 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b720af-622d-426d-921f-b21a0f4a38ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:21:24.012150 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b720af-622d-426d-921f-b21a0f4a38ec admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:21:24.012446 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b720af-622d-426d-921f-b21a0f4a38ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:21:24.012798 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b720af-622d-426d-921f-b21a0f4a38ec admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:21:24.014137 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b720af-622d-426d-921f-b21a0f4a38ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:21:24.014561 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b720af-622d-426d-921f-b21a0f4a38ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:21:24.019715 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b720af-622d-426d-921f-b21a0f4a38ec admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:21:24.035912 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1786/3553] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:21:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:21:24.040412 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ce2eab-623c-4183-8091-ff248a725c13 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:21:24.051604 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ce2eab-623c-4183-8091-ff248a725c13 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:21:24.062349 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22decc9-f294-4217-8987-b2cce6f8e22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:21:24.063785 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22decc9-f294-4217-8987-b2cce6f8e22c admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:21:24.064305 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22decc9-f294-4217-8987-b2cce6f8e22c admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:21:24.064940 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22decc9-f294-4217-8987-b2cce6f8e22c admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:21:24.066414 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22decc9-f294-4217-8987-b2cce6f8e22c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:21:24.069506 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22decc9-f294-4217-8987-b2cce6f8e22c admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:21:24.212037 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b720af-622d-426d-921f-b21a0f4a38ec admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:21:24.214213 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-f5b720af-622d-426d-921f-b21a0f4a38ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:21:24.242239 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b720af-622d-426d-921f-b21a0f4a38ec admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:21:24.248474 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1768/3554] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:21:24 2022] POST /identity/v3/projects => generated 385 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:21:24.250257 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22decc9-f294-4217-8987-b2cce6f8e22c admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:21:24.254731 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3c86a8-8657-4673-858f-1f703d1d43ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:21:24.257079 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c86a8-8657-4673-858f-1f703d1d43ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:21:24.257079 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c86a8-8657-4673-858f-1f703d1d43ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:21:24.257079 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c86a8-8657-4673-858f-1f703d1d43ff admin admin] PATH_INFO: `/v3/projects/62ef4614a33040a7b0ae010a6b1c7fb1` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:21:24.258374 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3c86a8-8657-4673-858f-1f703d1d43ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=62ef4614a33040a7b0ae010a6b1c7fb1)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:21:24.266188 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3c86a8-8657-4673-858f-1f703d1d43ff admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:21:24.381169 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22decc9-f294-4217-8987-b2cce6f8e22c admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:21:24.391714 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e449510-2bd0-45d1-b40e-3e2ccb823438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:21:24.394108 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e449510-2bd0-45d1-b40e-3e2ccb823438 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:21:24.394426 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e449510-2bd0-45d1-b40e-3e2ccb823438 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:21:24.394706 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e449510-2bd0-45d1-b40e-3e2ccb823438 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:21:24.395421 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e449510-2bd0-45d1-b40e-3e2ccb823438 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:21:24.397943 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e449510-2bd0-45d1-b40e-3e2ccb823438 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:21:24.453185 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6e3c86a8-8657-4673-858f-1f703d1d43ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62ef4614a33040a7b0ae010a6b1c7fb1', 'request_id': 'req-6e3c86a8-8657-4673-858f-1f703d1d43ff'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:21:24.460596 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6e3c86a8-8657-4673-858f-1f703d1d43ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62ef4614a33040a7b0ae010a6b1c7fb1', 'request_id': 'req-6e3c86a8-8657-4673-858f-1f703d1d43ff'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:21:24.503631 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1769/3555] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:21:24 2022] POST /identity/v3/users => generated 293 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:21:24.512946 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e449510-2bd0-45d1-b40e-3e2ccb823438 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:21:24.523102 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6e3c86a8-8657-4673-858f-1f703d1d43ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62ef4614a33040a7b0ae010a6b1c7fb1', 'request_id': 'req-6e3c86a8-8657-4673-858f-1f703d1d43ff'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:21:24.539093 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e449510-2bd0-45d1-b40e-3e2ccb823438 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:21:24.547267 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6e3c86a8-8657-4673-858f-1f703d1d43ff admin admin] The token cache is being invalidate because project 62ef4614a33040a7b0ae010a6b1c7fb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:21:24.547915 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6e3c86a8-8657-4673-858f-1f703d1d43ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:21:24.549986 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6e3c86a8-8657-4673-858f-1f703d1d43ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:21:24.552263 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1787/3556] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:21:24 2022] DELETE /identity/v3/projects/62ef4614a33040a7b0ae010a6b1c7fb1 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:21:24.560125 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8924c73b-b453-4f0f-90f1-afbcc2764cd4 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:21:24.560619 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8924c73b-b453-4f0f-90f1-afbcc2764cd4 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:21:24.561041 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8924c73b-b453-4f0f-90f1-afbcc2764cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:21:24.612652 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-8924c73b-b453-4f0f-90f1-afbcc2764cd4 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:21:24.615960 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-8924c73b-b453-4f0f-90f1-afbcc2764cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:21:24.629699 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5e7ba1-c354-48e8-bee9-ed4dbc96d71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:21:24.631816 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e7ba1-c354-48e8-bee9-ed4dbc96d71d admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:21:24.632314 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e7ba1-c354-48e8-bee9-ed4dbc96d71d admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:21:24.632753 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e7ba1-c354-48e8-bee9-ed4dbc96d71d admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:21:24.634012 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5e7ba1-c354-48e8-bee9-ed4dbc96d71d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:21:24.636337 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5e7ba1-c354-48e8-bee9-ed4dbc96d71d admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:21:24.649873 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1770/3557] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:21:24 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:21:24.654355 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5e7ba1-c354-48e8-bee9-ed4dbc96d71d admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:21:24.662860 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8b5e7ba1-c354-48e8-bee9-ed4dbc96d71d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:21:24.683531 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5e7ba1-c354-48e8-bee9-ed4dbc96d71d admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:21:24.694427 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdb54d9-37c9-4608-bb6d-1bb592b20652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:21:24.699887 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb54d9-37c9-4608-bb6d-1bb592b20652 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:21:24.700545 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb54d9-37c9-4608-bb6d-1bb592b20652 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:21:24.701130 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb54d9-37c9-4608-bb6d-1bb592b20652 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:21:24.702189 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdb54d9-37c9-4608-bb6d-1bb592b20652 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:21:24.705004 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdb54d9-37c9-4608-bb6d-1bb592b20652 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:21:24.707846 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1788/3558] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:21:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:21:24.720422 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e40ca-d26d-4bb9-9f5b-4f357a417da2 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:21:24.720598 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e40ca-d26d-4bb9-9f5b-4f357a417da2 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:21:24.723873 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e40ca-d26d-4bb9-9f5b-4f357a417da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:21:24.724078 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1771/3559] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:21:24 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:21:24.725258 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdb54d9-37c9-4608-bb6d-1bb592b20652 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:21:24.744738 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdb54d9-37c9-4608-bb6d-1bb592b20652 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:21:24.748403 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-874e40ca-d26d-4bb9-9f5b-4f357a417da2 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:21:24.749744 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-874e40ca-d26d-4bb9-9f5b-4f357a417da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:21:24.760743 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34139385-1bbb-4f63-96de-e25a21eb961b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:21:24.762047 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34139385-1bbb-4f63-96de-e25a21eb961b admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:21:24.762377 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1789/3560] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:21:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:21:24.762792 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34139385-1bbb-4f63-96de-e25a21eb961b admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:21:24.763356 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e40ca-d26d-4bb9-9f5b-4f357a417da2 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:21:24.764132 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34139385-1bbb-4f63-96de-e25a21eb961b admin admin] PATH_INFO: `/v3/projects/cabbde4fba484c6d83f6ae32716cf82b/users/07186d1e535e4de2ae6b8269ca10b4c6/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:21:24.778201 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e40ca-d26d-4bb9-9f5b-4f357a417da2 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:21:24.784361 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f1bd8d-a308-4712-aaf7-3b53d6ce9379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:21:24.785047 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1bd8d-a308-4712-aaf7-3b53d6ce9379 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:21:24.785333 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1bd8d-a308-4712-aaf7-3b53d6ce9379 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:21:24.785616 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1bd8d-a308-4712-aaf7-3b53d6ce9379 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:21:24.787223 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f1bd8d-a308-4712-aaf7-3b53d6ce9379 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:21:24.787609 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f1bd8d-a308-4712-aaf7-3b53d6ce9379 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:21:24.789605 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f1bd8d-a308-4712-aaf7-3b53d6ce9379 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:21:24.802716 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34139385-1bbb-4f63-96de-e25a21eb961b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cabbde4fba484c6d83f6ae32716cf82b, user_id=07186d1e535e4de2ae6b8269ca10b4c6, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:21:24.803351 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1790/3561] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:21:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:21:24.805599 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34139385-1bbb-4f63-96de-e25a21eb961b admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:21:24.808334 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f1bd8d-a308-4712-aaf7-3b53d6ce9379 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:21:24.823299 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f1bd8d-a308-4712-aaf7-3b53d6ce9379 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:21:24.829186 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ef9439-d19b-45f5-92b9-1cd3f4ed8dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:21:24.829752 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef9439-d19b-45f5-92b9-1cd3f4ed8dd6 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:21:24.830155 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef9439-d19b-45f5-92b9-1cd3f4ed8dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:21:24.830328 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef9439-d19b-45f5-92b9-1cd3f4ed8dd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:21:24.831260 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ef9439-d19b-45f5-92b9-1cd3f4ed8dd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:21:24.833170 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ef9439-d19b-45f5-92b9-1cd3f4ed8dd6 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:21:24.914051 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1772/3562] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:21:24 2022] PUT /identity/v3/projects/cabbde4fba484c6d83f6ae32716cf82b/users/07186d1e535e4de2ae6b8269ca10b4c6/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:21:24.919195 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f123667-e71f-4402-99ea-f19ea49e1703 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:21:24.919510 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f123667-e71f-4402-99ea-f19ea49e1703 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:21:24.919819 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f123667-e71f-4402-99ea-f19ea49e1703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:21:24.941467 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-3f123667-e71f-4402-99ea-f19ea49e1703 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:21:24.942686 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-3f123667-e71f-4402-99ea-f19ea49e1703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:21:25.004352 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1773/3563] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:21:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:21:25.014164 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f123667-e71f-4402-99ea-f19ea49e1703 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:21:25.016590 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-3f123667-e71f-4402-99ea-f19ea49e1703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:21:25.020073 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1791/3564] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:21:24 2022] POST /identity/v3/projects => generated 387 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:21:25.021113 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ef9439-d19b-45f5-92b9-1cd3f4ed8dd6 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:21:25.072580 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f123667-e71f-4402-99ea-f19ea49e1703 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:21:25.082506 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ef9439-d19b-45f5-92b9-1cd3f4ed8dd6 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:21:25.087447 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd587877-13e9-467b-b0c9-09051e8c8540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:21:25.088073 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd587877-13e9-467b-b0c9-09051e8c8540 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:21:25.088355 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd587877-13e9-467b-b0c9-09051e8c8540 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:21:25.088630 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd587877-13e9-467b-b0c9-09051e8c8540 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:21:25.089308 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd587877-13e9-467b-b0c9-09051e8c8540 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:21:25.091303 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd587877-13e9-467b-b0c9-09051e8c8540 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:21:25.130587 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ffa565-d103-469b-aa1b-3be74b66c1b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:21:25.131239 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ffa565-d103-469b-aa1b-3be74b66c1b9 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:21:25.131877 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ffa565-d103-469b-aa1b-3be74b66c1b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:21:25.132158 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ffa565-d103-469b-aa1b-3be74b66c1b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:21:25.142895 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ffa565-d103-469b-aa1b-3be74b66c1b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:21:25.144399 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ffa565-d103-469b-aa1b-3be74b66c1b9 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:21:25.181739 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1774/3565] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:21:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:21:25.216602 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ffa565-d103-469b-aa1b-3be74b66c1b9 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:21:25.217223 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1792/3566] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:21:25 2022] POST /identity/v3/users => generated 294 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:21:25.231698 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ffa565-d103-469b-aa1b-3be74b66c1b9 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:21:25.238996 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e443d4-cc46-4fd7-8acc-1bf07f4f59c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:21:25.239693 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e443d4-cc46-4fd7-8acc-1bf07f4f59c0 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:21:25.240060 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e443d4-cc46-4fd7-8acc-1bf07f4f59c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:21:25.240232 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e443d4-cc46-4fd7-8acc-1bf07f4f59c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:21:25.241803 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e443d4-cc46-4fd7-8acc-1bf07f4f59c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:21:25.243744 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e443d4-cc46-4fd7-8acc-1bf07f4f59c0 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:21:25.263568 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1775/3567] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:21:25 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:21:25.272945 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd587877-13e9-467b-b0c9-09051e8c8540 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:21:25.286147 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd587877-13e9-467b-b0c9-09051e8c8540 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:21:25.293175 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b2177f-a32a-444b-a338-36215a8cd11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:21:25.303334 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b2177f-a32a-444b-a338-36215a8cd11a admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:21:25.303334 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b2177f-a32a-444b-a338-36215a8cd11a admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:21:25.303334 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b2177f-a32a-444b-a338-36215a8cd11a admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:21:25.303334 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b2177f-a32a-444b-a338-36215a8cd11a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:21:25.303334 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b2177f-a32a-444b-a338-36215a8cd11a admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:21:25.311582 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1793/3568] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:21:25 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:21:25.316093 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e443d4-cc46-4fd7-8acc-1bf07f4f59c0 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:21:25.326540 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e443d4-cc46-4fd7-8acc-1bf07f4f59c0 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:21:25.333280 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b98778-c86e-4f5b-98ab-7b87135ac0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:21:25.333280 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b98778-c86e-4f5b-98ab-7b87135ac0e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:21:25.333426 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b98778-c86e-4f5b-98ab-7b87135ac0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:21:25.333674 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b98778-c86e-4f5b-98ab-7b87135ac0e5 admin admin] PATH_INFO: `/v3/projects/c8d3f937d0cc40e6b1cd90e72b6fb07e/users/2d0ac47523ba4f288bcd89f8228ef910/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:21:25.350896 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b98778-c86e-4f5b-98ab-7b87135ac0e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8d3f937d0cc40e6b1cd90e72b6fb07e, user_id=2d0ac47523ba4f288bcd89f8228ef910, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:21:25.353599 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b98778-c86e-4f5b-98ab-7b87135ac0e5 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:21:25.427080 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1776/3569] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:21:25 2022] PUT /identity/v3/projects/c8d3f937d0cc40e6b1cd90e72b6fb07e/users/2d0ac47523ba4f288bcd89f8228ef910/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:21:25.432462 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e1da7-6903-476f-9a0a-747c4fe8e91d None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:21:25.432831 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e1da7-6903-476f-9a0a-747c4fe8e91d None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:21:25.433122 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e1da7-6903-476f-9a0a-747c4fe8e91d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:21:25.451824 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-1a5e1da7-6903-476f-9a0a-747c4fe8e91d None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:21:25.453979 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-1a5e1da7-6903-476f-9a0a-747c4fe8e91d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:21:25.523876 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1794/3570] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:21:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:21:25.539182 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b98778-c86e-4f5b-98ab-7b87135ac0e5 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:21:25.543063 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c0b98778-c86e-4f5b-98ab-7b87135ac0e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:21:25.627791 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b98778-c86e-4f5b-98ab-7b87135ac0e5 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:21:25.632368 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb3c3ae-31e4-4fe6-a3db-ef639cc73701 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:21:25.632721 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb3c3ae-31e4-4fe6-a3db-ef639cc73701 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:21:25.633740 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb3c3ae-31e4-4fe6-a3db-ef639cc73701 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:21:25.634032 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb3c3ae-31e4-4fe6-a3db-ef639cc73701 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:21:25.652939 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb3c3ae-31e4-4fe6-a3db-ef639cc73701 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:21:25.655278 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb3c3ae-31e4-4fe6-a3db-ef639cc73701 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:21:25.670938 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1777/3571] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:21:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:21:27.900482 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505220ec-c3eb-4eaa-8099-6510a389d6e9 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:21:27.904900 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505220ec-c3eb-4eaa-8099-6510a389d6e9 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:21:27.904900 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505220ec-c3eb-4eaa-8099-6510a389d6e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:21:27.953555 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-505220ec-c3eb-4eaa-8099-6510a389d6e9 None None] MFA Rules not processed for user `07186d1e535e4de2ae6b8269ca10b4c6`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:21:27.955298 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-505220ec-c3eb-4eaa-8099-6510a389d6e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:21:28.057900 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1795/3572] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:21:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:21:28.063063 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb3c3ae-31e4-4fe6-a3db-ef639cc73701 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:21:28.073781 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb3c3ae-31e4-4fe6-a3db-ef639cc73701 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:21:28.079280 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1152b5-e4cc-4f2f-868a-4764ef2593ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:21:28.080033 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1152b5-e4cc-4f2f-868a-4764ef2593ce admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:21:28.080381 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1152b5-e4cc-4f2f-868a-4764ef2593ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:21:28.080646 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1152b5-e4cc-4f2f-868a-4764ef2593ce admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:21:28.081516 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1152b5-e4cc-4f2f-868a-4764ef2593ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:21:28.083664 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1152b5-e4cc-4f2f-868a-4764ef2593ce admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:21:28.268862 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1778/3573] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:21:28 2022] POST /identity/v3/projects => generated 383 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:21:28.272726 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505220ec-c3eb-4eaa-8099-6510a389d6e9 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:21:28.285698 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505220ec-c3eb-4eaa-8099-6510a389d6e9 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:21:28.350023 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312070a4-e2a7-4fda-a0da-28a821e996d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:21:28.350905 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312070a4-e2a7-4fda-a0da-28a821e996d6 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:21:28.351285 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312070a4-e2a7-4fda-a0da-28a821e996d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:21:28.351691 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312070a4-e2a7-4fda-a0da-28a821e996d6 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:21:28.352492 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312070a4-e2a7-4fda-a0da-28a821e996d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:21:28.354551 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312070a4-e2a7-4fda-a0da-28a821e996d6 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:21:28.474228 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1152b5-e4cc-4f2f-868a-4764ef2593ce admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:21:28.488037 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1796/3574] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:21:28 2022] POST /identity/v3/users => generated 298 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:21:28.492189 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1152b5-e4cc-4f2f-868a-4764ef2593ce admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:21:28.497886 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a907de2-0b2a-4522-a30a-a6b69fc9e1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:21:28.498520 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a907de2-0b2a-4522-a30a-a6b69fc9e1b2 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:21:28.498903 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a907de2-0b2a-4522-a30a-a6b69fc9e1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:21:28.499421 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a907de2-0b2a-4522-a30a-a6b69fc9e1b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:21:28.501523 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a907de2-0b2a-4522-a30a-a6b69fc9e1b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:21:28.503554 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a907de2-0b2a-4522-a30a-a6b69fc9e1b2 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:21:28.523344 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1779/3575] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:21:28.529096 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312070a4-e2a7-4fda-a0da-28a821e996d6 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:21:28.542253 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312070a4-e2a7-4fda-a0da-28a821e996d6 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:21:28.547880 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f13f85f-a3bd-4e57-879e-1b66d990200c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:21:28.549074 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13f85f-a3bd-4e57-879e-1b66d990200c admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:21:28.549419 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13f85f-a3bd-4e57-879e-1b66d990200c admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:21:28.550136 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13f85f-a3bd-4e57-879e-1b66d990200c admin admin] PATH_INFO: `/v3/projects/a7b652f4fb414727b68ba9078a657cb9/users/4c7b0ab4127a45869ce524ae057735b4/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:21:28.569120 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f13f85f-a3bd-4e57-879e-1b66d990200c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7b652f4fb414727b68ba9078a657cb9, user_id=4c7b0ab4127a45869ce524ae057735b4, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:21:28.572347 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f13f85f-a3bd-4e57-879e-1b66d990200c admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:21:28.716825 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1797/3576] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:21:28 2022] PUT /identity/v3/projects/a7b652f4fb414727b68ba9078a657cb9/users/4c7b0ab4127a45869ce524ae057735b4/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:21:28.721355 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a907de2-0b2a-4522-a30a-a6b69fc9e1b2 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:21:28.737912 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a907de2-0b2a-4522-a30a-a6b69fc9e1b2 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:21:28.886285 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ae27e9-2ca0-4e21-99f4-9bc65d71b8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:21:28.887142 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae27e9-2ca0-4e21-99f4-9bc65d71b8f7 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:21:28.887581 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae27e9-2ca0-4e21-99f4-9bc65d71b8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:21:28.887977 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae27e9-2ca0-4e21-99f4-9bc65d71b8f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:21:28.888716 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ae27e9-2ca0-4e21-99f4-9bc65d71b8f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:21:28.892677 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ae27e9-2ca0-4e21-99f4-9bc65d71b8f7 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:21:28.903396 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1780/3577] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:21:28.907606 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f13f85f-a3bd-4e57-879e-1b66d990200c admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:21:28.937506 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f13f85f-a3bd-4e57-879e-1b66d990200c admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:21:28.945361 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33791b4-d978-44a1-a1c3-e3cd8d8b74de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:21:28.946562 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33791b4-d978-44a1-a1c3-e3cd8d8b74de admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:21:28.947028 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33791b4-d978-44a1-a1c3-e3cd8d8b74de admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:21:28.947513 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33791b4-d978-44a1-a1c3-e3cd8d8b74de admin admin] PATH_INFO: `/v3/projects/a7b652f4fb414727b68ba9078a657cb9/users/4c7b0ab4127a45869ce524ae057735b4/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:21:28.949868 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33791b4-d978-44a1-a1c3-e3cd8d8b74de admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7b652f4fb414727b68ba9078a657cb9, user_id=4c7b0ab4127a45869ce524ae057735b4, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:21:28.953583 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33791b4-d978-44a1-a1c3-e3cd8d8b74de admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:21:28.966662 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1798/3578] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:21:28 2022] PUT /identity/v3/projects/a7b652f4fb414727b68ba9078a657cb9/users/4c7b0ab4127a45869ce524ae057735b4/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:21:29.116649 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f74702-b10b-4904-a36e-b073c13ee777 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:21:29.117628 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f74702-b10b-4904-a36e-b073c13ee777 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:21:29.118097 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f74702-b10b-4904-a36e-b073c13ee777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:21:29.145366 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-d6f74702-b10b-4904-a36e-b073c13ee777 None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:21:29.148654 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-d6f74702-b10b-4904-a36e-b073c13ee777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:21:29.223799 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1781/3579] 10.222.0.52 () {58 vars in 1009 bytes} [Sat May 14 21:21:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:21:29.241674 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33791b4-d978-44a1-a1c3-e3cd8d8b74de admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:21:29.244973 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e33791b4-d978-44a1-a1c3-e3cd8d8b74de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:21:29.351386 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33791b4-d978-44a1-a1c3-e3cd8d8b74de admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:21:29.358134 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1da29c-acf3-4269-bdeb-2523d58836bf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:21:29.359719 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1da29c-acf3-4269-bdeb-2523d58836bf service swift] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:21:29.359973 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1da29c-acf3-4269-bdeb-2523d58836bf service swift] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:21:29.360454 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1da29c-acf3-4269-bdeb-2523d58836bf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:21:29.373951 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1da29c-acf3-4269-bdeb-2523d58836bf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:21:29.377752 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1da29c-acf3-4269-bdeb-2523d58836bf service swift] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:21:29.394614 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1799/3580] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 21:21:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 21:21:34.399792 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cdcdf3-56a1-45f8-9a18-16d2b9be8cb6 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:21:34.400683 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cdcdf3-56a1-45f8-9a18-16d2b9be8cb6 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:21:34.401198 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cdcdf3-56a1-45f8-9a18-16d2b9be8cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:21:34.541285 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-33cdcdf3-56a1-45f8-9a18-16d2b9be8cb6 None None] MFA Rules not processed for user `4c7b0ab4127a45869ce524ae057735b4`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:21:34.552046 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-33cdcdf3-56a1-45f8-9a18-16d2b9be8cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:21:34.721835 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1782/3581] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:21:34 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:21:34.723692 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f336b33-25c6-4e88-a454-d77aa42850f6 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:21:34.724169 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f336b33-25c6-4e88-a454-d77aa42850f6 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:21:34.724317 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f336b33-25c6-4e88-a454-d77aa42850f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:21:34.767079 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-2f336b33-25c6-4e88-a454-d77aa42850f6 None None] MFA Rules not processed for user `07186d1e535e4de2ae6b8269ca10b4c6`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:21:34.768572 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-2f336b33-25c6-4e88-a454-d77aa42850f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:21:34.930773 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1800/3582] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:21:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:21:34.942456 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cdcdf3-56a1-45f8-9a18-16d2b9be8cb6 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:21:34.957561 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-33cdcdf3-56a1-45f8-9a18-16d2b9be8cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:21:35.262134 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cdcdf3-56a1-45f8-9a18-16d2b9be8cb6 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:21:35.281765 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e48759d-ffc6-45c7-b1c3-976fbdad775e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:21:35.282484 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48759d-ffc6-45c7-b1c3-976fbdad775e service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:21:35.282773 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48759d-ffc6-45c7-b1c3-976fbdad775e service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:21:35.283060 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48759d-ffc6-45c7-b1c3-976fbdad775e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:21:35.306274 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e48759d-ffc6-45c7-b1c3-976fbdad775e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:21:35.307996 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e48759d-ffc6-45c7-b1c3-976fbdad775e service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:21:35.322385 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f336b33-25c6-4e88-a454-d77aa42850f6 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:21:35.323981 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-2f336b33-25c6-4e88-a454-d77aa42850f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:21:35.347569 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1783/3583] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:21:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:21:35.688463 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f336b33-25c6-4e88-a454-d77aa42850f6 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:21:35.697674 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae6d16e-54bf-4f25-aa8f-273add21cafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:21:35.702636 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6d16e-54bf-4f25-aa8f-273add21cafe admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:21:35.702936 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6d16e-54bf-4f25-aa8f-273add21cafe admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:21:35.703227 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6d16e-54bf-4f25-aa8f-273add21cafe admin admin] PATH_INFO: `/v3/users/b3b5b688171045d586128236e85aee0b` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:21:35.708250 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae6d16e-54bf-4f25-aa8f-273add21cafe admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3b5b688171045d586128236e85aee0b)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:21:35.710855 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae6d16e-54bf-4f25-aa8f-273add21cafe admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:21:36.076567 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-cae6d16e-54bf-4f25-aa8f-273add21cafe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3b5b688171045d586128236e85aee0b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:21:36.118546 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-cae6d16e-54bf-4f25-aa8f-273add21cafe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3b5b688171045d586128236e85aee0b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:21:36.142178 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-cae6d16e-54bf-4f25-aa8f-273add21cafe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3b5b688171045d586128236e85aee0b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:21:36.249994 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-cae6d16e-54bf-4f25-aa8f-273add21cafe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3b5b688171045d586128236e85aee0b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:21:36.251303 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-cae6d16e-54bf-4f25-aa8f-273add21cafe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3b5b688171045d586128236e85aee0b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:21:36.261130 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1801/3584] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:21:35 2022] DELETE /identity/v3/users/b3b5b688171045d586128236e85aee0b => generated 0 bytes in 939 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:21:36.746699 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e48759d-ffc6-45c7-b1c3-976fbdad775e service nova] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:21:36.774734 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae6d16e-54bf-4f25-aa8f-273add21cafe admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:21:36.779260 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-cae6d16e-54bf-4f25-aa8f-273add21cafe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:21:36.880980 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e48759d-ffc6-45c7-b1c3-976fbdad775e service nova] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:21:36.977627 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d55dd5a-12fc-479b-8a0c-a744798a7888 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:21:36.978759 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55dd5a-12fc-479b-8a0c-a744798a7888 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:21:36.978759 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55dd5a-12fc-479b-8a0c-a744798a7888 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:21:36.978759 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55dd5a-12fc-479b-8a0c-a744798a7888 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:21:36.980993 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-4d55dd5a-12fc-479b-8a0c-a744798a7888 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:21:37.032384 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae6d16e-54bf-4f25-aa8f-273add21cafe admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:21:37.063851 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd1ce75-c18b-44b3-b826-13190b20441a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:21:37.066289 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd1ce75-c18b-44b3-b826-13190b20441a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:21:37.066859 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd1ce75-c18b-44b3-b826-13190b20441a admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:21:37.067358 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd1ce75-c18b-44b3-b826-13190b20441a admin admin] PATH_INFO: `/v3/projects/d272971274514577b827dd8ac81c9e58` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:21:37.076626 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd1ce75-c18b-44b3-b826-13190b20441a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d272971274514577b827dd8ac81c9e58)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:21:37.076626 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd1ce75-c18b-44b3-b826-13190b20441a admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:21:37.218876 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d55dd5a-12fc-479b-8a0c-a744798a7888 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:21:37.222690 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d55dd5a-12fc-479b-8a0c-a744798a7888 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:21:37.250848 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1784/3585] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:21:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:21:37.326074 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ccd1ce75-c18b-44b3-b826-13190b20441a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd272971274514577b827dd8ac81c9e58', 'request_id': 'req-ccd1ce75-c18b-44b3-b826-13190b20441a'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:21:37.333345 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ccd1ce75-c18b-44b3-b826-13190b20441a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd272971274514577b827dd8ac81c9e58', 'request_id': 'req-ccd1ce75-c18b-44b3-b826-13190b20441a'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:21:37.471740 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ccd1ce75-c18b-44b3-b826-13190b20441a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd272971274514577b827dd8ac81c9e58', 'request_id': 'req-ccd1ce75-c18b-44b3-b826-13190b20441a'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:21:37.493149 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ccd1ce75-c18b-44b3-b826-13190b20441a admin admin] The token cache is being invalidate because project d272971274514577b827dd8ac81c9e58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:21:37.493149 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ccd1ce75-c18b-44b3-b826-13190b20441a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:21:37.493579 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ccd1ce75-c18b-44b3-b826-13190b20441a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:21:37.498061 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1802/3586] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:21:36 2022] DELETE /identity/v3/projects/d272971274514577b827dd8ac81c9e58 => generated 0 bytes in 724 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:21:37.503022 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a003d3-4f33-4615-8b83-1676b9bbfec3 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:21:37.503897 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a003d3-4f33-4615-8b83-1676b9bbfec3 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:21:37.504453 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a003d3-4f33-4615-8b83-1676b9bbfec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:21:37.620424 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-b8a003d3-4f33-4615-8b83-1676b9bbfec3 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:21:37.621671 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b8a003d3-4f33-4615-8b83-1676b9bbfec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:21:37.711672 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1785/3587] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:21:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:21:37.721698 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917e82ad-d814-4554-ab68-cb53f717caec None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:21:37.722021 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917e82ad-d814-4554-ab68-cb53f717caec None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:21:37.722302 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917e82ad-d814-4554-ab68-cb53f717caec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:21:37.778573 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-917e82ad-d814-4554-ab68-cb53f717caec None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:21:37.780943 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-917e82ad-d814-4554-ab68-cb53f717caec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:21:37.798130 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1803/3588] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:21:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:21:37.801711 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a003d3-4f33-4615-8b83-1676b9bbfec3 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:21:37.809579 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a003d3-4f33-4615-8b83-1676b9bbfec3 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:21:37.825438 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d234fbf-02c6-43a7-a266-baef5a22799b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:21:37.825438 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d234fbf-02c6-43a7-a266-baef5a22799b admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:21:37.825438 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d234fbf-02c6-43a7-a266-baef5a22799b admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:21:37.825438 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d234fbf-02c6-43a7-a266-baef5a22799b admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:21:37.826333 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d234fbf-02c6-43a7-a266-baef5a22799b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:21:37.826333 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d234fbf-02c6-43a7-a266-baef5a22799b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:21:37.834312 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d234fbf-02c6-43a7-a266-baef5a22799b admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:21:37.851514 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1786/3589] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:21:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:21:37.853725 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917e82ad-d814-4554-ab68-cb53f717caec None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:21:37.871691 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917e82ad-d814-4554-ab68-cb53f717caec None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:21:37.879785 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688bb174-1cf5-4c3d-a32b-3b5aa08182f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:21:37.881539 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688bb174-1cf5-4c3d-a32b-3b5aa08182f5 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:21:37.882040 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688bb174-1cf5-4c3d-a32b-3b5aa08182f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:21:37.882504 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688bb174-1cf5-4c3d-a32b-3b5aa08182f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:21:37.883199 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688bb174-1cf5-4c3d-a32b-3b5aa08182f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:21:37.886297 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688bb174-1cf5-4c3d-a32b-3b5aa08182f5 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:21:38.047046 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1804/3590] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:21:37 2022] POST /identity/v3/projects => generated 371 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:21:38.050836 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d234fbf-02c6-43a7-a266-baef5a22799b admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:21:38.064334 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d234fbf-02c6-43a7-a266-baef5a22799b admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:21:38.192219 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05183686-4ca8-4c25-9852-b40dea161020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:21:38.193238 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05183686-4ca8-4c25-9852-b40dea161020 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:21:38.193790 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05183686-4ca8-4c25-9852-b40dea161020 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:21:38.194019 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05183686-4ca8-4c25-9852-b40dea161020 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:21:38.195319 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05183686-4ca8-4c25-9852-b40dea161020 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:21:38.197851 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05183686-4ca8-4c25-9852-b40dea161020 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:21:38.337872 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1787/3591] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:21:38 2022] POST /identity/v3/users => generated 286 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:21:38.343029 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688bb174-1cf5-4c3d-a32b-3b5aa08182f5 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:21:38.360233 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688bb174-1cf5-4c3d-a32b-3b5aa08182f5 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:21:38.366890 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666ea1e0-ecaa-4248-875c-99206438a022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:21:38.368208 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ea1e0-ecaa-4248-875c-99206438a022 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:21:38.368828 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ea1e0-ecaa-4248-875c-99206438a022 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:21:38.369246 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ea1e0-ecaa-4248-875c-99206438a022 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:21:38.370348 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666ea1e0-ecaa-4248-875c-99206438a022 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:21:38.373032 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666ea1e0-ecaa-4248-875c-99206438a022 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:21:38.433083 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1805/3592] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:21:38 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:21:38.434881 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05183686-4ca8-4c25-9852-b40dea161020 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:21:38.456125 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05183686-4ca8-4c25-9852-b40dea161020 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:21:38.462262 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ee3d10-c00e-47eb-8ca0-6f02761e2c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:21:38.464451 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee3d10-c00e-47eb-8ca0-6f02761e2c40 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:21:38.464944 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee3d10-c00e-47eb-8ca0-6f02761e2c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:21:38.465746 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee3d10-c00e-47eb-8ca0-6f02761e2c40 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:21:38.466779 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ee3d10-c00e-47eb-8ca0-6f02761e2c40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:21:38.476741 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ee3d10-c00e-47eb-8ca0-6f02761e2c40 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:21:38.493540 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1788/3593] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:21:38 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:21:38.494765 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666ea1e0-ecaa-4248-875c-99206438a022 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:21:38.513339 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666ea1e0-ecaa-4248-875c-99206438a022 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:21:38.523815 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc1e8d8-e69b-413c-a52f-e89e0a01e909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:21:38.524719 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1e8d8-e69b-413c-a52f-e89e0a01e909 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:21:38.525372 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1e8d8-e69b-413c-a52f-e89e0a01e909 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:21:38.525372 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1e8d8-e69b-413c-a52f-e89e0a01e909 admin admin] PATH_INFO: `/v3/projects/d750e4cf6fab4bc4983f5f2f37a01ae6/users/d59910b5e81045dc9ec13cded4cb41d5/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:21:38.551064 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ee3d10-c00e-47eb-8ca0-6f02761e2c40 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:21:38.553185 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-75ee3d10-c00e-47eb-8ca0-6f02761e2c40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:21:38.567556 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc1e8d8-e69b-413c-a52f-e89e0a01e909 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d750e4cf6fab4bc4983f5f2f37a01ae6, user_id=d59910b5e81045dc9ec13cded4cb41d5, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:21:38.571693 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc1e8d8-e69b-413c-a52f-e89e0a01e909 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:21:38.672945 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1806/3594] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:21:38 2022] PUT /identity/v3/projects/d750e4cf6fab4bc4983f5f2f37a01ae6/users/d59910b5e81045dc9ec13cded4cb41d5/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:21:38.689216 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d1ea52-c62e-48e6-9b68-178533d6ab74 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:21:38.689931 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d1ea52-c62e-48e6-9b68-178533d6ab74 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:21:38.690513 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d1ea52-c62e-48e6-9b68-178533d6ab74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:21:38.742528 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ee3d10-c00e-47eb-8ca0-6f02761e2c40 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:21:38.760131 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-b3d1ea52-c62e-48e6-9b68-178533d6ab74 None None] MFA Rules not processed for user `d59910b5e81045dc9ec13cded4cb41d5`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:21:38.762866 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b3d1ea52-c62e-48e6-9b68-178533d6ab74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:21:38.867751 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1807/3595] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:21:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:21:38.880999 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7006c95-03b5-464c-8a62-2520f8a943d4 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:21:38.881430 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7006c95-03b5-464c-8a62-2520f8a943d4 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:21:38.881692 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7006c95-03b5-464c-8a62-2520f8a943d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:21:38.926073 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e6f854-f3dd-486e-9138-54f49998a297 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:21:38.927378 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-a7006c95-03b5-464c-8a62-2520f8a943d4 None None] MFA Rules not processed for user `d59910b5e81045dc9ec13cded4cb41d5`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:21:38.927521 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e6f854-f3dd-486e-9138-54f49998a297 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:21:38.927798 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e6f854-f3dd-486e-9138-54f49998a297 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:21:38.928084 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e6f854-f3dd-486e-9138-54f49998a297 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:21:38.930160 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-a7006c95-03b5-464c-8a62-2520f8a943d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:21:38.939873 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e0e6f854-f3dd-486e-9138-54f49998a297 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:21:38.974775 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1808/3596] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:21:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:21:39.152872 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e6f854-f3dd-486e-9138-54f49998a297 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:21:39.154883 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e6f854-f3dd-486e-9138-54f49998a297 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:21:39.192892 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1789/3597] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:21:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 642 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:21:39.335978 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7006c95-03b5-464c-8a62-2520f8a943d4 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:21:39.337573 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-a7006c95-03b5-464c-8a62-2520f8a943d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:21:39.372669 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7006c95-03b5-464c-8a62-2520f8a943d4 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:21:39.382599 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31122baf-15c5-49c6-931c-6fc285a64a26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:21:39.383648 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31122baf-15c5-49c6-931c-6fc285a64a26 service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:21:39.384172 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31122baf-15c5-49c6-931c-6fc285a64a26 service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:21:39.384662 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31122baf-15c5-49c6-931c-6fc285a64a26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:21:39.403089 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31122baf-15c5-49c6-931c-6fc285a64a26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:21:39.404745 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31122baf-15c5-49c6-931c-6fc285a64a26 service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:21:39.438308 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1809/3598] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:21:39 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:21:39.620057 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6dd50f-31f0-4539-9ec6-e0646667fe04 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:21:39.620356 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6dd50f-31f0-4539-9ec6-e0646667fe04 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:21:39.620639 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6dd50f-31f0-4539-9ec6-e0646667fe04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:21:39.761211 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-6f6dd50f-31f0-4539-9ec6-e0646667fe04 None None] MFA Rules not processed for user `2d0ac47523ba4f288bcd89f8228ef910`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:21:39.761211 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-6f6dd50f-31f0-4539-9ec6-e0646667fe04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:21:39.859192 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1790/3599] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:21:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:21:39.863880 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31122baf-15c5-49c6-931c-6fc285a64a26 service nova] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:21:39.865440 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-31122baf-15c5-49c6-931c-6fc285a64a26 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:21:40.016492 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31122baf-15c5-49c6-931c-6fc285a64a26 service nova] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:21:40.027516 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8f12c6-58ed-49be-b599-ee95db579e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:21:40.029714 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f12c6-58ed-49be-b599-ee95db579e3f admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:21:40.030301 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f12c6-58ed-49be-b599-ee95db579e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:21:40.031662 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f12c6-58ed-49be-b599-ee95db579e3f admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:21:40.033777 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8f12c6-58ed-49be-b599-ee95db579e3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:21:40.039667 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8f12c6-58ed-49be-b599-ee95db579e3f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:21:40.190099 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1810/3600] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:21:39 2022] POST /identity/v3/projects => generated 389 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:21:40.190837 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6dd50f-31f0-4539-9ec6-e0646667fe04 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:21:40.208861 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6dd50f-31f0-4539-9ec6-e0646667fe04 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:21:40.307542 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5dbe0-3f95-4a17-8a16-9b00d958b9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:21:40.310009 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5dbe0-3f95-4a17-8a16-9b00d958b9a3 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:21:40.310009 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5dbe0-3f95-4a17-8a16-9b00d958b9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:21:40.310009 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5dbe0-3f95-4a17-8a16-9b00d958b9a3 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:21:40.310367 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a5dbe0-3f95-4a17-8a16-9b00d958b9a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:21:40.312754 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a5dbe0-3f95-4a17-8a16-9b00d958b9a3 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:21:40.461296 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1791/3601] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:21:40 2022] POST /identity/v3/users => generated 301 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:21:40.462444 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8f12c6-58ed-49be-b599-ee95db579e3f admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:21:40.476268 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8f12c6-58ed-49be-b599-ee95db579e3f admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:21:40.482187 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef05fb0-9c1c-4b9b-bc4d-90dcb67fdfcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:21:40.484258 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef05fb0-9c1c-4b9b-bc4d-90dcb67fdfcf admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:21:40.484847 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef05fb0-9c1c-4b9b-bc4d-90dcb67fdfcf admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:21:40.485363 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef05fb0-9c1c-4b9b-bc4d-90dcb67fdfcf admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:21:40.486300 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef05fb0-9c1c-4b9b-bc4d-90dcb67fdfcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:21:40.488252 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef05fb0-9c1c-4b9b-bc4d-90dcb67fdfcf admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:21:40.500895 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1811/3602] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:21:40.505843 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5dbe0-3f95-4a17-8a16-9b00d958b9a3 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:21:40.532344 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5dbe0-3f95-4a17-8a16-9b00d958b9a3 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:21:40.548851 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d66f64-2e9a-44dc-bdee-1c5ecb6f1d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:21:40.549978 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d66f64-2e9a-44dc-bdee-1c5ecb6f1d33 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:21:40.550263 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d66f64-2e9a-44dc-bdee-1c5ecb6f1d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:21:40.550595 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d66f64-2e9a-44dc-bdee-1c5ecb6f1d33 admin admin] PATH_INFO: `/v3/projects/c5f5d25903a54e73ac56fef5225279c8/users/eab74b8b11144ce5ae668614ded520fe/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:21:40.573581 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d66f64-2e9a-44dc-bdee-1c5ecb6f1d33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5f5d25903a54e73ac56fef5225279c8, user_id=eab74b8b11144ce5ae668614ded520fe, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:21:40.577686 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d66f64-2e9a-44dc-bdee-1c5ecb6f1d33 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:21:40.829466 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1792/3603] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:21:40 2022] PUT /identity/v3/projects/c5f5d25903a54e73ac56fef5225279c8/users/eab74b8b11144ce5ae668614ded520fe/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:21:40.830411 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef05fb0-9c1c-4b9b-bc4d-90dcb67fdfcf admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:21:40.841405 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef05fb0-9c1c-4b9b-bc4d-90dcb67fdfcf admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:21:40.964079 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9258083-9140-4aad-a042-6b70d3353a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:21:40.965102 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9258083-9140-4aad-a042-6b70d3353a4b admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:21:40.976269 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9258083-9140-4aad-a042-6b70d3353a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:21:40.976960 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9258083-9140-4aad-a042-6b70d3353a4b admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:21:40.977921 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9258083-9140-4aad-a042-6b70d3353a4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:21:40.980247 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9258083-9140-4aad-a042-6b70d3353a4b admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:21:40.994130 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1812/3604] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:21:41.000160 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d66f64-2e9a-44dc-bdee-1c5ecb6f1d33 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:21:41.013749 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d66f64-2e9a-44dc-bdee-1c5ecb6f1d33 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:21:41.025129 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00fb20e-c158-4293-bba0-03f8ba12d21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:21:41.032459 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00fb20e-c158-4293-bba0-03f8ba12d21a admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:21:41.032459 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00fb20e-c158-4293-bba0-03f8ba12d21a admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:21:41.032459 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00fb20e-c158-4293-bba0-03f8ba12d21a admin admin] PATH_INFO: `/v3/projects/c5f5d25903a54e73ac56fef5225279c8/users/eab74b8b11144ce5ae668614ded520fe/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:21:41.035666 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00fb20e-c158-4293-bba0-03f8ba12d21a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5f5d25903a54e73ac56fef5225279c8, user_id=eab74b8b11144ce5ae668614ded520fe, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:21:41.044580 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00fb20e-c158-4293-bba0-03f8ba12d21a admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:21:41.075904 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1793/3605] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:21:40 2022] PUT /identity/v3/projects/c5f5d25903a54e73ac56fef5225279c8/users/eab74b8b11144ce5ae668614ded520fe/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:21:45.668328 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeef69e-02e7-45cb-a2c1-ab82ab659c22 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:21:45.668844 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeef69e-02e7-45cb-a2c1-ab82ab659c22 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:21:45.668844 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeef69e-02e7-45cb-a2c1-ab82ab659c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:21:45.699599 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-afeef69e-02e7-45cb-a2c1-ab82ab659c22 None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:21:45.700820 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-afeef69e-02e7-45cb-a2c1-ab82ab659c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:21:45.833959 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1813/3606] 10.222.0.52 () {58 vars in 1009 bytes} [Sat May 14 21:21:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:21:45.850878 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00fb20e-c158-4293-bba0-03f8ba12d21a admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:21:45.854595 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-f00fb20e-c158-4293-bba0-03f8ba12d21a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:21:45.949628 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00fb20e-c158-4293-bba0-03f8ba12d21a admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:21:45.957745 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c16a0-d781-4d53-872d-0d15a5ed3771 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:21:45.958961 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c16a0-d781-4d53-872d-0d15a5ed3771 service swift] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:21:45.959621 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c16a0-d781-4d53-872d-0d15a5ed3771 service swift] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:21:45.960059 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c16a0-d781-4d53-872d-0d15a5ed3771 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:21:45.971227 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3c16a0-d781-4d53-872d-0d15a5ed3771 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:21:45.973463 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3c16a0-d781-4d53-872d-0d15a5ed3771 service swift] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:21:45.986715 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1794/3607] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 21:21:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 21:21:51.248023 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c1ae5-9bb6-49ce-9c6e-24062069bc9c None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:21:51.249048 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c1ae5-9bb6-49ce-9c6e-24062069bc9c None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:21:51.249799 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c1ae5-9bb6-49ce-9c6e-24062069bc9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:21:51.298609 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-4e3c1ae5-9bb6-49ce-9c6e-24062069bc9c None None] MFA Rules not processed for user `eab74b8b11144ce5ae668614ded520fe`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:21:51.300212 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-4e3c1ae5-9bb6-49ce-9c6e-24062069bc9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:21:51.427885 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1814/3608] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:21:51 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:21:51.439567 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c16a0-d781-4d53-872d-0d15a5ed3771 service swift] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:21:51.441914 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-4b3c16a0-d781-4d53-872d-0d15a5ed3771 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:21:51.563949 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c16a0-d781-4d53-872d-0d15a5ed3771 service swift] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:21:51.575863 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4867c2c-7384-45ed-bd97-76864b6c06de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198271d1c0d44cb58bace41a65f4b94c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:21:51.576649 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4867c2c-7384-45ed-bd97-76864b6c06de service cinder] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:21:51.577028 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4867c2c-7384-45ed-bd97-76864b6c06de service cinder] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:21:51.577523 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4867c2c-7384-45ed-bd97-76864b6c06de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:21:51.712382 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4867c2c-7384-45ed-bd97-76864b6c06de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:21:51.713968 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4867c2c-7384-45ed-bd97-76864b6c06de service cinder] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:21:51.738322 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1795/3609] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:21:51 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:21:53.739710 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c1ae5-9bb6-49ce-9c6e-24062069bc9c None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:21:53.913890 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c1ae5-9bb6-49ce-9c6e-24062069bc9c None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:21:53.934754 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fefec34-82c7-40f9-ad2f-09bf4a05b48e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:21:53.935708 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fefec34-82c7-40f9-ad2f-09bf4a05b48e service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:21:53.936132 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fefec34-82c7-40f9-ad2f-09bf4a05b48e service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:21:53.936528 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fefec34-82c7-40f9-ad2f-09bf4a05b48e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:21:53.939800 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-2fefec34-82c7-40f9-ad2f-09bf4a05b48e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:21:54.007458 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fefec34-82c7-40f9-ad2f-09bf4a05b48e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:21:54.010200 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fefec34-82c7-40f9-ad2f-09bf4a05b48e service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:21:54.070287 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1815/3610] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:21:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:21:55.790510 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4867c2c-7384-45ed-bd97-76864b6c06de service cinder] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:21:55.994104 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4867c2c-7384-45ed-bd97-76864b6c06de service cinder] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:21:56.006408 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f942792c-f65e-4397-993e-97d053cd5408 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:21:56.007792 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f942792c-f65e-4397-993e-97d053cd5408 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:21:56.008256 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f942792c-f65e-4397-993e-97d053cd5408 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:21:56.008682 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f942792c-f65e-4397-993e-97d053cd5408 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:21:56.011729 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-f942792c-f65e-4397-993e-97d053cd5408 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:21:56.028774 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f942792c-f65e-4397-993e-97d053cd5408 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:21:56.030832 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f942792c-f65e-4397-993e-97d053cd5408 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:21:56.057555 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1796/3611] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:21:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:22:05.476816 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fefec34-82c7-40f9-ad2f-09bf4a05b48e service nova] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:05.490610 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fefec34-82c7-40f9-ad2f-09bf4a05b48e service nova] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:05.496686 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebdc7b1-1f00-4b3f-b1db-4ccfdaf3b58b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:05.497598 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebdc7b1-1f00-4b3f-b1db-4ccfdaf3b58b service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:05.497964 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebdc7b1-1f00-4b3f-b1db-4ccfdaf3b58b service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:05.498358 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebdc7b1-1f00-4b3f-b1db-4ccfdaf3b58b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:05.501212 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-0ebdc7b1-1f00-4b3f-b1db-4ccfdaf3b58b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:22:05.575222 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebdc7b1-1f00-4b3f-b1db-4ccfdaf3b58b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:05.576836 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebdc7b1-1f00-4b3f-b1db-4ccfdaf3b58b service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:05.587926 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1816/3612] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:22:05 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:22:07.253571 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719800fd-2ad5-4d70-9470-e4e2e0565a82 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:07.254111 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719800fd-2ad5-4d70-9470-e4e2e0565a82 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:07.254204 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719800fd-2ad5-4d70-9470-e4e2e0565a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:07.273751 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-719800fd-2ad5-4d70-9470-e4e2e0565a82 None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:22:07.274972 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-719800fd-2ad5-4d70-9470-e4e2e0565a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:22:07.283447 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1797/3613] 10.222.0.52 () {58 vars in 967 bytes} [Sat May 14 21:22:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:22:07.329429 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebdc7b1-1f00-4b3f-b1db-4ccfdaf3b58b service nova] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:07.350997 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebdc7b1-1f00-4b3f-b1db-4ccfdaf3b58b service nova] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:07.359803 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c633cc-e435-4f00-99ff-d1583fa78e25 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:07.360671 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c633cc-e435-4f00-99ff-d1583fa78e25 service swift] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:07.361032 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c633cc-e435-4f00-99ff-d1583fa78e25 service swift] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:07.362053 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c633cc-e435-4f00-99ff-d1583fa78e25 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:07.375385 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c633cc-e435-4f00-99ff-d1583fa78e25 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:07.377433 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c633cc-e435-4f00-99ff-d1583fa78e25 service swift] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:07.388818 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1817/3614] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 21:22:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 21:22:10.390180 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cee732-a1a8-4fb2-b932-156b8db488b6 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:10.390772 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cee732-a1a8-4fb2-b932-156b8db488b6 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:10.391083 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cee732-a1a8-4fb2-b932-156b8db488b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:10.425231 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-96cee732-a1a8-4fb2-b932-156b8db488b6 None None] MFA Rules not processed for user `71080496c33c4e2c8b2e16b950f0b9ea`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:22:10.426798 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-96cee732-a1a8-4fb2-b932-156b8db488b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:22:10.507402 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1798/3615] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:22:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:22:11.946978 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c633cc-e435-4f00-99ff-d1583fa78e25 service swift] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:11.948659 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-55c633cc-e435-4f00-99ff-d1583fa78e25 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:22:12.115945 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c633cc-e435-4f00-99ff-d1583fa78e25 service swift] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:12.121226 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bed67b-bbbe-4c15-a704-2f28199e13c0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:12.122086 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bed67b-bbbe-4c15-a704-2f28199e13c0 service placement] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:12.122367 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bed67b-bbbe-4c15-a704-2f28199e13c0 service placement] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:12.122646 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bed67b-bbbe-4c15-a704-2f28199e13c0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:12.125858 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b2bed67b-bbbe-4c15-a704-2f28199e13c0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:22:12.138391 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bed67b-bbbe-4c15-a704-2f28199e13c0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:12.140374 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bed67b-bbbe-4c15-a704-2f28199e13c0 service placement] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:12.152329 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1818/3616] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:22:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:22:16.718822 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cee732-a1a8-4fb2-b932-156b8db488b6 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:16.720173 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-96cee732-a1a8-4fb2-b932-156b8db488b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:22:16.851015 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cee732-a1a8-4fb2-b932-156b8db488b6 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:16.857031 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcf7897-9336-4058-9647-3df91e16fc78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:16.858065 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf7897-9336-4058-9647-3df91e16fc78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:16.858973 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf7897-9336-4058-9647-3df91e16fc78 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:16.859325 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf7897-9336-4058-9647-3df91e16fc78 admin admin] PATH_INFO: `/v3/users/b54f1f777ca2448bb3ba65643cfcb530` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:16.860627 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcf7897-9336-4058-9647-3df91e16fc78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b54f1f777ca2448bb3ba65643cfcb530)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:16.862627 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcf7897-9336-4058-9647-3df91e16fc78 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:17.147805 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0dcf7897-9336-4058-9647-3df91e16fc78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b54f1f777ca2448bb3ba65643cfcb530'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:17.154696 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0dcf7897-9336-4058-9647-3df91e16fc78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b54f1f777ca2448bb3ba65643cfcb530'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:17.156112 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0dcf7897-9336-4058-9647-3df91e16fc78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b54f1f777ca2448bb3ba65643cfcb530'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:17.281986 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0dcf7897-9336-4058-9647-3df91e16fc78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b54f1f777ca2448bb3ba65643cfcb530'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:17.295060 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0dcf7897-9336-4058-9647-3df91e16fc78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b54f1f777ca2448bb3ba65643cfcb530'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:17.302473 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1799/3617] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:22:16 2022] DELETE /identity/v3/users/b54f1f777ca2448bb3ba65643cfcb530 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:22:17.421453 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ca971-3e75-44c6-9a9f-9014f6c9cbb6 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:17.422529 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ca971-3e75-44c6-9a9f-9014f6c9cbb6 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:17.422529 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ca971-3e75-44c6-9a9f-9014f6c9cbb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:17.446741 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-ac2ca971-3e75-44c6-9a9f-9014f6c9cbb6 None None] MFA Rules not processed for user `2d0ac47523ba4f288bcd89f8228ef910`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:22:17.448762 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ac2ca971-3e75-44c6-9a9f-9014f6c9cbb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:22:17.511793 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1819/3618] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:22:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:22:17.523331 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508fa0ab-ad95-431d-9022-d5bd81534185 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:17.523764 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508fa0ab-ad95-431d-9022-d5bd81534185 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:17.524050 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508fa0ab-ad95-431d-9022-d5bd81534185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:17.543790 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-508fa0ab-ad95-431d-9022-d5bd81534185 None None] MFA Rules not processed for user `2d0ac47523ba4f288bcd89f8228ef910`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:22:17.545338 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-508fa0ab-ad95-431d-9022-d5bd81534185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:22:17.557716 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ca971-3e75-44c6-9a9f-9014f6c9cbb6 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:17.557716 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ac2ca971-3e75-44c6-9a9f-9014f6c9cbb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:22:17.558291 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1800/3619] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:22:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:22:17.649464 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ca971-3e75-44c6-9a9f-9014f6c9cbb6 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:17.654453 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268ccd4b-7ba1-44da-adb3-a99298990aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:17.656154 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268ccd4b-7ba1-44da-adb3-a99298990aca admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:17.656544 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268ccd4b-7ba1-44da-adb3-a99298990aca admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:17.656725 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268ccd4b-7ba1-44da-adb3-a99298990aca admin admin] PATH_INFO: `/v3/projects/ba969692dac24c5bab4062ca210bef43` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:17.661045 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268ccd4b-7ba1-44da-adb3-a99298990aca admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba969692dac24c5bab4062ca210bef43)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:17.661045 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268ccd4b-7ba1-44da-adb3-a99298990aca admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:17.799215 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-268ccd4b-7ba1-44da-adb3-a99298990aca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba969692dac24c5bab4062ca210bef43', 'request_id': 'req-268ccd4b-7ba1-44da-adb3-a99298990aca'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:17.822709 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-268ccd4b-7ba1-44da-adb3-a99298990aca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba969692dac24c5bab4062ca210bef43', 'request_id': 'req-268ccd4b-7ba1-44da-adb3-a99298990aca'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:17.922894 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-268ccd4b-7ba1-44da-adb3-a99298990aca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba969692dac24c5bab4062ca210bef43', 'request_id': 'req-268ccd4b-7ba1-44da-adb3-a99298990aca'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:17.942437 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-268ccd4b-7ba1-44da-adb3-a99298990aca admin admin] The token cache is being invalidate because project ba969692dac24c5bab4062ca210bef43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:22:17.942854 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-268ccd4b-7ba1-44da-adb3-a99298990aca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:17.943574 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-268ccd4b-7ba1-44da-adb3-a99298990aca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:17.945284 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1820/3620] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:22:17 2022] DELETE /identity/v3/projects/ba969692dac24c5bab4062ca210bef43 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:22:17.950220 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97c5db-24e5-416c-a7a2-e5434861b7bc None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:17.950732 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97c5db-24e5-416c-a7a2-e5434861b7bc None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:17.950842 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97c5db-24e5-416c-a7a2-e5434861b7bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:17.971107 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-2c97c5db-24e5-416c-a7a2-e5434861b7bc None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:22:17.972759 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-2c97c5db-24e5-416c-a7a2-e5434861b7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:22:18.073024 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1801/3621] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:22:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:22:18.083237 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca67b24-1355-4349-aea9-2b27e17729e4 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:18.083560 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca67b24-1355-4349-aea9-2b27e17729e4 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:18.085272 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca67b24-1355-4349-aea9-2b27e17729e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:18.102775 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-7ca67b24-1355-4349-aea9-2b27e17729e4 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:22:18.104085 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-7ca67b24-1355-4349-aea9-2b27e17729e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:22:18.117029 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1821/3622] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:22:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:22:18.121488 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c97c5db-24e5-416c-a7a2-e5434861b7bc None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:18.132611 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c97c5db-24e5-416c-a7a2-e5434861b7bc None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:18.138257 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec526f8-0bed-48a8-b19d-f805e89accc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:18.143017 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec526f8-0bed-48a8-b19d-f805e89accc8 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:18.143017 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec526f8-0bed-48a8-b19d-f805e89accc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:18.143017 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec526f8-0bed-48a8-b19d-f805e89accc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:18.143017 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec526f8-0bed-48a8-b19d-f805e89accc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:22:18.143017 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec526f8-0bed-48a8-b19d-f805e89accc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:18.143645 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec526f8-0bed-48a8-b19d-f805e89accc8 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:18.160520 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1802/3623] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:22:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:22:18.168592 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca67b24-1355-4349-aea9-2b27e17729e4 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:18.178923 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca67b24-1355-4349-aea9-2b27e17729e4 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:18.187426 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6863e0b5-ad5d-4289-a290-eb7e841d4af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:18.188350 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863e0b5-ad5d-4289-a290-eb7e841d4af9 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:18.188704 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863e0b5-ad5d-4289-a290-eb7e841d4af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:18.189094 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863e0b5-ad5d-4289-a290-eb7e841d4af9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:18.189867 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6863e0b5-ad5d-4289-a290-eb7e841d4af9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:18.192197 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6863e0b5-ad5d-4289-a290-eb7e841d4af9 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:18.295827 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1822/3624] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:22:18 2022] POST /identity/v3/projects => generated 381 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:22:18.298163 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec526f8-0bed-48a8-b19d-f805e89accc8 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:18.322081 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec526f8-0bed-48a8-b19d-f805e89accc8 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:18.414229 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15ed617-57c0-4535-85c3-22dba1aa493a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:18.416011 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ed617-57c0-4535-85c3-22dba1aa493a admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:18.416351 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ed617-57c0-4535-85c3-22dba1aa493a admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:18.416586 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ed617-57c0-4535-85c3-22dba1aa493a admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:18.417292 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15ed617-57c0-4535-85c3-22dba1aa493a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:18.419581 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15ed617-57c0-4535-85c3-22dba1aa493a admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:18.507064 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1803/3625] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:22:18 2022] POST /identity/v3/users => generated 291 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:22:18.511408 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6863e0b5-ad5d-4289-a290-eb7e841d4af9 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:18.523019 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6863e0b5-ad5d-4289-a290-eb7e841d4af9 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:18.528110 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f79485f-a4b2-422f-b449-7938a2e81148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:18.528908 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f79485f-a4b2-422f-b449-7938a2e81148 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:18.529281 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f79485f-a4b2-422f-b449-7938a2e81148 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:18.530460 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f79485f-a4b2-422f-b449-7938a2e81148 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:18.531528 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f79485f-a4b2-422f-b449-7938a2e81148 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:18.533524 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f79485f-a4b2-422f-b449-7938a2e81148 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:18.552296 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15ed617-57c0-4535-85c3-22dba1aa493a admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:18.559664 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1823/3626] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:22:18 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:22:18.566223 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15ed617-57c0-4535-85c3-22dba1aa493a admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:18.570819 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2613b2d-45ab-4ce7-8db5-8d9f4ec53fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:18.572023 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2613b2d-45ab-4ce7-8db5-8d9f4ec53fdc admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:18.572489 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2613b2d-45ab-4ce7-8db5-8d9f4ec53fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:18.572815 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2613b2d-45ab-4ce7-8db5-8d9f4ec53fdc admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:18.573935 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2613b2d-45ab-4ce7-8db5-8d9f4ec53fdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:18.576152 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2613b2d-45ab-4ce7-8db5-8d9f4ec53fdc admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:18.591879 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1804/3627] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:22:18 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:22:18.593875 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f79485f-a4b2-422f-b449-7938a2e81148 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:18.604995 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f79485f-a4b2-422f-b449-7938a2e81148 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:18.612092 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96794a54-3d67-4ddb-ad31-6b39581bfc64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:18.617438 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96794a54-3d67-4ddb-ad31-6b39581bfc64 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:18.617438 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96794a54-3d67-4ddb-ad31-6b39581bfc64 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:18.617438 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96794a54-3d67-4ddb-ad31-6b39581bfc64 admin admin] PATH_INFO: `/v3/projects/f589f7d7ad0f4b63afd4132efa4e798a/users/beb60582a8ae4b2499db4a45da00512f/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:18.630376 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96794a54-3d67-4ddb-ad31-6b39581bfc64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f589f7d7ad0f4b63afd4132efa4e798a, user_id=beb60582a8ae4b2499db4a45da00512f, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:18.633256 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96794a54-3d67-4ddb-ad31-6b39581bfc64 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:18.728918 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1824/3628] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:22:18 2022] PUT /identity/v3/projects/f589f7d7ad0f4b63afd4132efa4e798a/users/beb60582a8ae4b2499db4a45da00512f/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:22:18.735857 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c763d2e-ead3-4172-9f56-9025dbb01d9c None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:18.736146 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c763d2e-ead3-4172-9f56-9025dbb01d9c None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:18.736586 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c763d2e-ead3-4172-9f56-9025dbb01d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:18.757442 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-0c763d2e-ead3-4172-9f56-9025dbb01d9c None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:22:18.758649 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-0c763d2e-ead3-4172-9f56-9025dbb01d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:22:18.822025 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1805/3629] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:22:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:22:18.832739 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96794a54-3d67-4ddb-ad31-6b39581bfc64 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:18.834478 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-96794a54-3d67-4ddb-ad31-6b39581bfc64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:22:18.892377 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96794a54-3d67-4ddb-ad31-6b39581bfc64 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:18.895988 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ee7797-9e17-4922-835a-7cd4e1316341 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:18.896636 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee7797-9e17-4922-835a-7cd4e1316341 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:18.896915 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee7797-9e17-4922-835a-7cd4e1316341 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:18.897186 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee7797-9e17-4922-835a-7cd4e1316341 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:18.907541 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ee7797-9e17-4922-835a-7cd4e1316341 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:18.908996 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ee7797-9e17-4922-835a-7cd4e1316341 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:18.918912 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1825/3630] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:22:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:22:20.553993 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb43c2-f298-468c-80fc-ec59571c2d2b None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:20.555077 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb43c2-f298-468c-80fc-ec59571c2d2b None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:20.555347 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb43c2-f298-468c-80fc-ec59571c2d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:20.590190 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-a9bb43c2-f298-468c-80fc-ec59571c2d2b None None] MFA Rules not processed for user `beb60582a8ae4b2499db4a45da00512f`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:22:20.591314 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-a9bb43c2-f298-468c-80fc-ec59571c2d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:22:20.692830 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1806/3631] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:22:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:22:20.703852 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac6a00-2d25-48dc-9da1-36f590234553 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:20.704709 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac6a00-2d25-48dc-9da1-36f590234553 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:20.704994 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac6a00-2d25-48dc-9da1-36f590234553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:20.740721 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-25ac6a00-2d25-48dc-9da1-36f590234553 None None] MFA Rules not processed for user `beb60582a8ae4b2499db4a45da00512f`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:22:20.742383 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-25ac6a00-2d25-48dc-9da1-36f590234553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:22:20.753965 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1826/3632] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:22:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:22:20.773378 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb43c2-f298-468c-80fc-ec59571c2d2b None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:20.774815 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-a9bb43c2-f298-468c-80fc-ec59571c2d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:22:20.848770 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb43c2-f298-468c-80fc-ec59571c2d2b None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:20.854441 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bebfd7-239f-453f-b2ba-e7cda44a0467 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:20.855082 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bebfd7-239f-453f-b2ba-e7cda44a0467 service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:20.855364 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bebfd7-239f-453f-b2ba-e7cda44a0467 service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:20.855670 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bebfd7-239f-453f-b2ba-e7cda44a0467 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:20.864044 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bebfd7-239f-453f-b2ba-e7cda44a0467 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:20.865618 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bebfd7-239f-453f-b2ba-e7cda44a0467 service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:20.874874 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1807/3633] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:22:20 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:22:21.489970 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ac6a00-2d25-48dc-9da1-36f590234553 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:21.501552 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ac6a00-2d25-48dc-9da1-36f590234553 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:21.505359 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ed9e5-b89a-414a-9fd3-3860d648fa58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:21.506008 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ed9e5-b89a-414a-9fd3-3860d648fa58 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:21.506436 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ed9e5-b89a-414a-9fd3-3860d648fa58 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:21.506883 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ed9e5-b89a-414a-9fd3-3860d648fa58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:21.508722 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-402ed9e5-b89a-414a-9fd3-3860d648fa58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:22:21.524468 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402ed9e5-b89a-414a-9fd3-3860d648fa58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:21.526067 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402ed9e5-b89a-414a-9fd3-3860d648fa58 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:21.539264 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1827/3634] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:22:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:22:22.793050 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bebfd7-239f-453f-b2ba-e7cda44a0467 service nova] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:22.794556 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-64bebfd7-239f-453f-b2ba-e7cda44a0467 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:22:22.806838 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bebfd7-239f-453f-b2ba-e7cda44a0467 service nova] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:22.810633 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d87ef0-60d5-408e-a411-ab16b203b416 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:22.811912 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d87ef0-60d5-408e-a411-ab16b203b416 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:22.812251 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d87ef0-60d5-408e-a411-ab16b203b416 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:22.812609 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d87ef0-60d5-408e-a411-ab16b203b416 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:22.817406 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-74d87ef0-60d5-408e-a411-ab16b203b416 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:22:22.831098 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d87ef0-60d5-408e-a411-ab16b203b416 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:22.832746 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d87ef0-60d5-408e-a411-ab16b203b416 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:22.841842 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1808/3635] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:22:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:22:25.657920 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ed9e5-b89a-414a-9fd3-3860d648fa58 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:25.659613 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-402ed9e5-b89a-414a-9fd3-3860d648fa58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:22:25.682209 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ed9e5-b89a-414a-9fd3-3860d648fa58 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:25.690240 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1709068-6424-4640-bf9f-f5f73431d2e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:25.690903 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1709068-6424-4640-bf9f-f5f73431d2e6 service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:25.691814 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1709068-6424-4640-bf9f-f5f73431d2e6 service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:25.691814 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1709068-6424-4640-bf9f-f5f73431d2e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:25.693910 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e1709068-6424-4640-bf9f-f5f73431d2e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:22:25.715839 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1709068-6424-4640-bf9f-f5f73431d2e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:25.717846 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1709068-6424-4640-bf9f-f5f73431d2e6 service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:25.733497 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1828/3636] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:22:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:22:29.506333 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d87ef0-60d5-408e-a411-ab16b203b416 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:29.507990 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-74d87ef0-60d5-408e-a411-ab16b203b416 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:22:29.525815 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d87ef0-60d5-408e-a411-ab16b203b416 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:29.530954 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c2ec74-3d75-4394-9d27-7880b21d8d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:29.531982 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c2ec74-3d75-4394-9d27-7880b21d8d5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:29.532481 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c2ec74-3d75-4394-9d27-7880b21d8d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:29.532965 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c2ec74-3d75-4394-9d27-7880b21d8d5d admin admin] PATH_INFO: `/v3/users/d59910b5e81045dc9ec13cded4cb41d5` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:29.534548 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c2ec74-3d75-4394-9d27-7880b21d8d5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d59910b5e81045dc9ec13cded4cb41d5)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:29.539593 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c2ec74-3d75-4394-9d27-7880b21d8d5d admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:29.826774 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-27c2ec74-3d75-4394-9d27-7880b21d8d5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd59910b5e81045dc9ec13cded4cb41d5'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:29.834050 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-27c2ec74-3d75-4394-9d27-7880b21d8d5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd59910b5e81045dc9ec13cded4cb41d5'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:29.834717 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-27c2ec74-3d75-4394-9d27-7880b21d8d5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd59910b5e81045dc9ec13cded4cb41d5'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:29.960231 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-27c2ec74-3d75-4394-9d27-7880b21d8d5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd59910b5e81045dc9ec13cded4cb41d5'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:29.963421 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-27c2ec74-3d75-4394-9d27-7880b21d8d5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd59910b5e81045dc9ec13cded4cb41d5'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:29.970300 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1809/3637] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:22:29 2022] DELETE /identity/v3/users/d59910b5e81045dc9ec13cded4cb41d5 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:22:29.974833 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432d192-a4dc-4476-840d-e986049a40ff None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:29.975299 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432d192-a4dc-4476-840d-e986049a40ff None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:29.975377 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432d192-a4dc-4476-840d-e986049a40ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:29.992823 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-7432d192-a4dc-4476-840d-e986049a40ff None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:22:29.994028 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-7432d192-a4dc-4476-840d-e986049a40ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:22:30.052774 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1829/3638] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:22:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:22:30.062620 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c2ec74-3d75-4394-9d27-7880b21d8d5d admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:30.064093 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-27c2ec74-3d75-4394-9d27-7880b21d8d5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:22:30.122717 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c2ec74-3d75-4394-9d27-7880b21d8d5d admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:30.126595 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a3563a-9ba4-4ec7-a5f7-6bbe5b75c911 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:30.127251 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a3563a-9ba4-4ec7-a5f7-6bbe5b75c911 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:30.128499 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a3563a-9ba4-4ec7-a5f7-6bbe5b75c911 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:30.128778 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a3563a-9ba4-4ec7-a5f7-6bbe5b75c911 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:30.139164 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a3563a-9ba4-4ec7-a5f7-6bbe5b75c911 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:30.141209 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a3563a-9ba4-4ec7-a5f7-6bbe5b75c911 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:30.151267 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1810/3639] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:22:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:22:30.602179 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7432d192-a4dc-4476-840d-e986049a40ff None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:30.604101 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-7432d192-a4dc-4476-840d-e986049a40ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:22:30.631357 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7432d192-a4dc-4476-840d-e986049a40ff None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:30.639185 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a21fb6-9bd1-486b-920a-cc00bc595749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:30.640127 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a21fb6-9bd1-486b-920a-cc00bc595749 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:30.640602 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a21fb6-9bd1-486b-920a-cc00bc595749 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:30.640877 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a21fb6-9bd1-486b-920a-cc00bc595749 admin admin] PATH_INFO: `/v3/projects/d750e4cf6fab4bc4983f5f2f37a01ae6` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:30.642256 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a21fb6-9bd1-486b-920a-cc00bc595749 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d750e4cf6fab4bc4983f5f2f37a01ae6)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:30.644796 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a21fb6-9bd1-486b-920a-cc00bc595749 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:30.759519 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-33a21fb6-9bd1-486b-920a-cc00bc595749 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'request_id': 'req-33a21fb6-9bd1-486b-920a-cc00bc595749'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:30.776805 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-33a21fb6-9bd1-486b-920a-cc00bc595749 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'request_id': 'req-33a21fb6-9bd1-486b-920a-cc00bc595749'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:30.893821 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-33a21fb6-9bd1-486b-920a-cc00bc595749 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'request_id': 'req-33a21fb6-9bd1-486b-920a-cc00bc595749'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:30.910048 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-33a21fb6-9bd1-486b-920a-cc00bc595749 admin admin] The token cache is being invalidate because project d750e4cf6fab4bc4983f5f2f37a01ae6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:22:30.910621 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-33a21fb6-9bd1-486b-920a-cc00bc595749 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:30.911691 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-33a21fb6-9bd1-486b-920a-cc00bc595749 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:30.913812 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1830/3640] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:22:30 2022] DELETE /identity/v3/projects/d750e4cf6fab4bc4983f5f2f37a01ae6 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:22:30.921422 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b956020-cea9-4f91-9df2-228981933ed6 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:30.922273 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b956020-cea9-4f91-9df2-228981933ed6 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:30.922719 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b956020-cea9-4f91-9df2-228981933ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:30.944382 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-1b956020-cea9-4f91-9df2-228981933ed6 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:22:30.946022 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-1b956020-cea9-4f91-9df2-228981933ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:22:31.053478 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30081dab-c05b-4bd6-bd9f-dc2ea574af32 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:31.054002 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30081dab-c05b-4bd6-bd9f-dc2ea574af32 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:31.054086 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30081dab-c05b-4bd6-bd9f-dc2ea574af32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:31.054816 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1811/3641] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:22:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:22:31.088835 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-30081dab-c05b-4bd6-bd9f-dc2ea574af32 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:22:31.090034 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-30081dab-c05b-4bd6-bd9f-dc2ea574af32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:22:31.104434 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1831/3642] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:22:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:22:31.109306 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b956020-cea9-4f91-9df2-228981933ed6 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:31.123182 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b956020-cea9-4f91-9df2-228981933ed6 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:31.130577 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d9980e-af81-4661-acfb-70072433273a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:31.131462 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9980e-af81-4661-acfb-70072433273a admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:31.131956 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9980e-af81-4661-acfb-70072433273a admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:31.132448 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9980e-af81-4661-acfb-70072433273a admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:31.133324 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d9980e-af81-4661-acfb-70072433273a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:22:31.133781 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d9980e-af81-4661-acfb-70072433273a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:31.135848 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d9980e-af81-4661-acfb-70072433273a admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:31.165158 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1812/3643] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:22:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:22:31.169566 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30081dab-c05b-4bd6-bd9f-dc2ea574af32 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:31.183541 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30081dab-c05b-4bd6-bd9f-dc2ea574af32 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:31.191224 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8651eff-64c8-409f-a34e-0028ec8967d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:31.192027 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8651eff-64c8-409f-a34e-0028ec8967d6 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:31.192371 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8651eff-64c8-409f-a34e-0028ec8967d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:31.192852 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8651eff-64c8-409f-a34e-0028ec8967d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:31.193733 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8651eff-64c8-409f-a34e-0028ec8967d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:31.195946 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8651eff-64c8-409f-a34e-0028ec8967d6 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:31.311342 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1832/3644] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:22:31 2022] POST /identity/v3/projects => generated 369 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:22:31.316434 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d9980e-af81-4661-acfb-70072433273a admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:31.330606 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d9980e-af81-4661-acfb-70072433273a admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:31.432366 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57131469-0c9b-4440-b447-50dd1d117d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:31.433059 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57131469-0c9b-4440-b447-50dd1d117d56 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:31.434598 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57131469-0c9b-4440-b447-50dd1d117d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:31.434885 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57131469-0c9b-4440-b447-50dd1d117d56 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:31.435622 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57131469-0c9b-4440-b447-50dd1d117d56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:31.437808 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57131469-0c9b-4440-b447-50dd1d117d56 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:31.569187 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1813/3645] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:22:31 2022] POST /identity/v3/users => generated 285 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:22:31.577066 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8651eff-64c8-409f-a34e-0028ec8967d6 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:31.588426 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8651eff-64c8-409f-a34e-0028ec8967d6 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:31.594182 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42033be-451d-4f58-bfd1-ecf149bb9fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:31.594994 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42033be-451d-4f58-bfd1-ecf149bb9fdd admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:31.595511 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42033be-451d-4f58-bfd1-ecf149bb9fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:31.600402 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42033be-451d-4f58-bfd1-ecf149bb9fdd admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:31.600402 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42033be-451d-4f58-bfd1-ecf149bb9fdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:31.600402 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42033be-451d-4f58-bfd1-ecf149bb9fdd admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:31.617047 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1833/3646] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:22:31 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:22:31.618755 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57131469-0c9b-4440-b447-50dd1d117d56 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:31.633132 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57131469-0c9b-4440-b447-50dd1d117d56 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:31.639417 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9877d96f-1abb-4090-9c0e-0fd3f6365315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:31.641450 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9877d96f-1abb-4090-9c0e-0fd3f6365315 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:31.641942 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9877d96f-1abb-4090-9c0e-0fd3f6365315 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:31.642441 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9877d96f-1abb-4090-9c0e-0fd3f6365315 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:31.643455 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9877d96f-1abb-4090-9c0e-0fd3f6365315 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:31.645294 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9877d96f-1abb-4090-9c0e-0fd3f6365315 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:31.663202 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1814/3647] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:22:31 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:22:31.665615 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42033be-451d-4f58-bfd1-ecf149bb9fdd admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:31.678966 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42033be-451d-4f58-bfd1-ecf149bb9fdd admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:31.685131 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e21496-5814-4cbc-b156-c777ae99d317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:31.687921 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e21496-5814-4cbc-b156-c777ae99d317 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:31.692575 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e21496-5814-4cbc-b156-c777ae99d317 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:31.692575 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e21496-5814-4cbc-b156-c777ae99d317 admin admin] PATH_INFO: `/v3/projects/bbfb28dce919435ab430c5185e3023b8/users/fe2f1b35348e4cb198e6fa4bfcdf4470/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:31.707154 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e21496-5814-4cbc-b156-c777ae99d317 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbfb28dce919435ab430c5185e3023b8, user_id=fe2f1b35348e4cb198e6fa4bfcdf4470, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:31.710941 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e21496-5814-4cbc-b156-c777ae99d317 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:31.837276 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1834/3648] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:22:31 2022] PUT /identity/v3/projects/bbfb28dce919435ab430c5185e3023b8/users/fe2f1b35348e4cb198e6fa4bfcdf4470/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:22:31.850535 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525f27f7-872f-4513-a053-e6a6b32538b7 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:31.850816 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525f27f7-872f-4513-a053-e6a6b32538b7 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:31.851095 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525f27f7-872f-4513-a053-e6a6b32538b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:31.884526 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-525f27f7-872f-4513-a053-e6a6b32538b7 None None] MFA Rules not processed for user `fe2f1b35348e4cb198e6fa4bfcdf4470`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:22:31.885851 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-525f27f7-872f-4513-a053-e6a6b32538b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:22:31.965569 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1815/3649] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:22:31 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:22:31.970910 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e21496-5814-4cbc-b156-c777ae99d317 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:32.074711 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e21496-5814-4cbc-b156-c777ae99d317 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:32.080664 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315159a1-aa35-4c79-9b55-40f3c67a4b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:32.081509 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315159a1-aa35-4c79-9b55-40f3c67a4b05 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:32.081858 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315159a1-aa35-4c79-9b55-40f3c67a4b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:32.082223 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315159a1-aa35-4c79-9b55-40f3c67a4b05 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:32.083099 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315159a1-aa35-4c79-9b55-40f3c67a4b05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:32.091794 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315159a1-aa35-4c79-9b55-40f3c67a4b05 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:32.260163 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1835/3650] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:22:31 2022] POST /identity/v3/projects => generated 369 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:22:32.266984 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525f27f7-872f-4513-a053-e6a6b32538b7 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:32.287162 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525f27f7-872f-4513-a053-e6a6b32538b7 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:32.427445 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe856e91-105f-444f-ad22-c050d3ecc68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:32.428245 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe856e91-105f-444f-ad22-c050d3ecc68c admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:32.428531 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe856e91-105f-444f-ad22-c050d3ecc68c admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:32.428800 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe856e91-105f-444f-ad22-c050d3ecc68c admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:32.430145 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe856e91-105f-444f-ad22-c050d3ecc68c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:32.433308 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe856e91-105f-444f-ad22-c050d3ecc68c admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:32.559330 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1816/3651] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:22:32 2022] POST /identity/v3/users => generated 291 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:22:32.560791 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315159a1-aa35-4c79-9b55-40f3c67a4b05 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:32.574727 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315159a1-aa35-4c79-9b55-40f3c67a4b05 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:32.582622 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cb755e-3e47-4f6d-aa7b-e81999fb14fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:32.582622 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb755e-3e47-4f6d-aa7b-e81999fb14fe admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:32.582622 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb755e-3e47-4f6d-aa7b-e81999fb14fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:32.582622 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb755e-3e47-4f6d-aa7b-e81999fb14fe admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:32.583631 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cb755e-3e47-4f6d-aa7b-e81999fb14fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:32.584659 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cb755e-3e47-4f6d-aa7b-e81999fb14fe admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:32.598872 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1836/3652] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:22:32.603206 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe856e91-105f-444f-ad22-c050d3ecc68c admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:32.616210 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe856e91-105f-444f-ad22-c050d3ecc68c admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:32.626343 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77be064-0a4f-45bc-a006-dfec2d6e720d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:32.628352 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77be064-0a4f-45bc-a006-dfec2d6e720d admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:32.628719 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77be064-0a4f-45bc-a006-dfec2d6e720d admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:32.630197 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77be064-0a4f-45bc-a006-dfec2d6e720d admin admin] PATH_INFO: `/v3/projects/8c4851f5d89d4f69861ef9637667323b/users/9df4c1d6fab345a6b30cf4a0985fc7fb/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:32.697361 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77be064-0a4f-45bc-a006-dfec2d6e720d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c4851f5d89d4f69861ef9637667323b, user_id=9df4c1d6fab345a6b30cf4a0985fc7fb, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:32.703420 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77be064-0a4f-45bc-a006-dfec2d6e720d admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:32.839368 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1817/3653] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:22:32 2022] PUT /identity/v3/projects/8c4851f5d89d4f69861ef9637667323b/users/9df4c1d6fab345a6b30cf4a0985fc7fb/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:22:32.843563 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cb755e-3e47-4f6d-aa7b-e81999fb14fe admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:32.855718 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cb755e-3e47-4f6d-aa7b-e81999fb14fe admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:32.960210 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dfea92-32de-41cd-bdc7-a99c20e20da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:32.960900 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dfea92-32de-41cd-bdc7-a99c20e20da1 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:32.961188 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dfea92-32de-41cd-bdc7-a99c20e20da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:32.961519 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dfea92-32de-41cd-bdc7-a99c20e20da1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:32.974907 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dfea92-32de-41cd-bdc7-a99c20e20da1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:32.977483 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dfea92-32de-41cd-bdc7-a99c20e20da1 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:32.992151 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1837/3654] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:22:32.996248 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77be064-0a4f-45bc-a006-dfec2d6e720d admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:33.007942 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77be064-0a4f-45bc-a006-dfec2d6e720d admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:33.013840 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2092d7d-2844-4691-91f3-46af06f809f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:33.015332 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2092d7d-2844-4691-91f3-46af06f809f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:33.015859 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2092d7d-2844-4691-91f3-46af06f809f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:33.016024 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2092d7d-2844-4691-91f3-46af06f809f8 admin admin] PATH_INFO: `/v3/projects/8c4851f5d89d4f69861ef9637667323b/users/9df4c1d6fab345a6b30cf4a0985fc7fb/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:33.018956 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2092d7d-2844-4691-91f3-46af06f809f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c4851f5d89d4f69861ef9637667323b, user_id=9df4c1d6fab345a6b30cf4a0985fc7fb, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:33.021735 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2092d7d-2844-4691-91f3-46af06f809f8 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:33.047004 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1818/3655] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:22:32 2022] PUT /identity/v3/projects/8c4851f5d89d4f69861ef9637667323b/users/9df4c1d6fab345a6b30cf4a0985fc7fb/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:22:33.049147 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73dbc8a-6b43-4a98-9007-b1a0860c7118 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:33.049441 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73dbc8a-6b43-4a98-9007-b1a0860c7118 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:33.049767 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73dbc8a-6b43-4a98-9007-b1a0860c7118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:33.100722 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-a73dbc8a-6b43-4a98-9007-b1a0860c7118 None None] MFA Rules not processed for user `9df4c1d6fab345a6b30cf4a0985fc7fb`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:22:33.102010 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-a73dbc8a-6b43-4a98-9007-b1a0860c7118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:22:33.131912 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2092d7d-2844-4691-91f3-46af06f809f8 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:33.134223 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-a2092d7d-2844-4691-91f3-46af06f809f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:22:33.263211 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1838/3656] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:22:33 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:22:33.267775 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73dbc8a-6b43-4a98-9007-b1a0860c7118 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:33.283867 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73dbc8a-6b43-4a98-9007-b1a0860c7118 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:33.297640 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2092d7d-2844-4691-91f3-46af06f809f8 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:33.301375 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7c3ec5-8b3f-4416-9f6a-e723ba2d5769 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9df4c1d6fab345a6b30cf4a0985fc7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c4851f5d89d4f69861ef9637667323b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:33.302050 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7c3ec5-8b3f-4416-9f6a-e723ba2d5769 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:33.302334 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7c3ec5-8b3f-4416-9f6a-e723ba2d5769 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:33.302612 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7c3ec5-8b3f-4416-9f6a-e723ba2d5769 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:33.303306 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7c3ec5-8b3f-4416-9f6a-e723ba2d5769 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:33.305231 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7c3ec5-8b3f-4416-9f6a-e723ba2d5769 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:33.312819 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989cc12a-2263-4070-a455-2ebbdc2fdabc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:33.331768 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989cc12a-2263-4070-a455-2ebbdc2fdabc service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:33.332118 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989cc12a-2263-4070-a455-2ebbdc2fdabc service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:33.332411 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989cc12a-2263-4070-a455-2ebbdc2fdabc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:33.345767 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-989cc12a-2263-4070-a455-2ebbdc2fdabc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:22:33.476454 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989cc12a-2263-4070-a455-2ebbdc2fdabc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:33.478384 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989cc12a-2263-4070-a455-2ebbdc2fdabc service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:33.487367 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1839/3657] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:22:33 2022] POST /identity/v3/projects => generated 360 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:22:33.488775 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7c3ec5-8b3f-4416-9f6a-e723ba2d5769 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:33.494297 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1819/3658] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:22:33 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:22:33.731561 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7c3ec5-8b3f-4416-9f6a-e723ba2d5769 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:33.741699 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a93295b-47b6-4aaa-8bac-41db9f095409 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9df4c1d6fab345a6b30cf4a0985fc7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c4851f5d89d4f69861ef9637667323b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:33.743558 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93295b-47b6-4aaa-8bac-41db9f095409 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:33.744228 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93295b-47b6-4aaa-8bac-41db9f095409 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:33.744905 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93295b-47b6-4aaa-8bac-41db9f095409 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:33.761413 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a93295b-47b6-4aaa-8bac-41db9f095409 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:33.773094 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a93295b-47b6-4aaa-8bac-41db9f095409 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:33.985553 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1840/3659] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:22:33 2022] POST /identity/v3/users => generated 416 bytes in 497 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:22:33.991542 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989cc12a-2263-4070-a455-2ebbdc2fdabc service nova] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:34.006069 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989cc12a-2263-4070-a455-2ebbdc2fdabc service nova] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:34.011237 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90206ac5-5fc9-4ba9-858a-f8e4665c1c74 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9df4c1d6fab345a6b30cf4a0985fc7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c4851f5d89d4f69861ef9637667323b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:34.012185 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90206ac5-5fc9-4ba9-858a-f8e4665c1c74 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:34.012518 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90206ac5-5fc9-4ba9-858a-f8e4665c1c74 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:34.012847 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90206ac5-5fc9-4ba9-858a-f8e4665c1c74 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] PATH_INFO: `/v3/users/3d9b72ef719e4d99a5a71aeba4a4804c` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:34.029751 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90206ac5-5fc9-4ba9-858a-f8e4665c1c74 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorizing `identity:get_user(user_id=3d9b72ef719e4d99a5a71aeba4a4804c)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:34.032040 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90206ac5-5fc9-4ba9-858a-f8e4665c1c74 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:34.034360 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1820/3660] 10.222.0.52 () {58 vars in 1220 bytes} [Sat May 14 21:22:33 2022] GET /identity/v3/users/3d9b72ef719e4d99a5a71aeba4a4804c => generated 416 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:22:34.038674 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a93295b-47b6-4aaa-8bac-41db9f095409 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:34.050332 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a93295b-47b6-4aaa-8bac-41db9f095409 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:34.057629 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b844eaef-bfc3-4324-a0db-f43c43c977f6 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9df4c1d6fab345a6b30cf4a0985fc7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c4851f5d89d4f69861ef9637667323b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:34.058517 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b844eaef-bfc3-4324-a0db-f43c43c977f6 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:34.058805 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b844eaef-bfc3-4324-a0db-f43c43c977f6 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:34.059515 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b844eaef-bfc3-4324-a0db-f43c43c977f6 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] PATH_INFO: `/v3/users/3d9b72ef719e4d99a5a71aeba4a4804c` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:34.063180 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b844eaef-bfc3-4324-a0db-f43c43c977f6 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorizing `identity:delete_user(user_id=3d9b72ef719e4d99a5a71aeba4a4804c)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:34.063180 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b844eaef-bfc3-4324-a0db-f43c43c977f6 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:34.222706 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b844eaef-bfc3-4324-a0db-f43c43c977f6 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d9b72ef719e4d99a5a71aeba4a4804c'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:34.242235 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b844eaef-bfc3-4324-a0db-f43c43c977f6 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d9b72ef719e4d99a5a71aeba4a4804c'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:34.253809 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b844eaef-bfc3-4324-a0db-f43c43c977f6 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d9b72ef719e4d99a5a71aeba4a4804c'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:34.345887 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b844eaef-bfc3-4324-a0db-f43c43c977f6 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d9b72ef719e4d99a5a71aeba4a4804c'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:34.346633 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b844eaef-bfc3-4324-a0db-f43c43c977f6 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d9b72ef719e4d99a5a71aeba4a4804c'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:34.356881 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1841/3661] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:22:34 2022] DELETE /identity/v3/users/3d9b72ef719e4d99a5a71aeba4a4804c => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:22:34.357791 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90206ac5-5fc9-4ba9-858a-f8e4665c1c74 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:34.360474 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-90206ac5-5fc9-4ba9-858a-f8e4665c1c74 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:22:34.375351 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90206ac5-5fc9-4ba9-858a-f8e4665c1c74 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:34.437963 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab453f0-d6e3-49c7-b0e6-8e549592b89d tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9df4c1d6fab345a6b30cf4a0985fc7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c4851f5d89d4f69861ef9637667323b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:34.439002 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab453f0-d6e3-49c7-b0e6-8e549592b89d tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:34.439383 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab453f0-d6e3-49c7-b0e6-8e549592b89d tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:34.439784 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab453f0-d6e3-49c7-b0e6-8e549592b89d tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] PATH_INFO: `/v3/projects/8dd9665cbcf247efa6491d6b66b2b133` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:34.441093 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab453f0-d6e3-49c7-b0e6-8e549592b89d tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8dd9665cbcf247efa6491d6b66b2b133)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:34.443092 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab453f0-d6e3-49c7-b0e6-8e549592b89d tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:34.560469 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7ab453f0-d6e3-49c7-b0e6-8e549592b89d tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dd9665cbcf247efa6491d6b66b2b133', 'request_id': 'req-7ab453f0-d6e3-49c7-b0e6-8e549592b89d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:34.572239 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7ab453f0-d6e3-49c7-b0e6-8e549592b89d tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dd9665cbcf247efa6491d6b66b2b133', 'request_id': 'req-7ab453f0-d6e3-49c7-b0e6-8e549592b89d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:34.581413 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7ab453f0-d6e3-49c7-b0e6-8e549592b89d tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dd9665cbcf247efa6491d6b66b2b133', 'request_id': 'req-7ab453f0-d6e3-49c7-b0e6-8e549592b89d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:34.691748 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7ab453f0-d6e3-49c7-b0e6-8e549592b89d tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] The token cache is being invalidate because project 8dd9665cbcf247efa6491d6b66b2b133 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:22:34.694008 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7ab453f0-d6e3-49c7-b0e6-8e549592b89d tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:34.695758 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7ab453f0-d6e3-49c7-b0e6-8e549592b89d tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:34.706087 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1821/3662] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:22:34 2022] DELETE /identity/v3/projects/8dd9665cbcf247efa6491d6b66b2b133 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:22:34.710398 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b844eaef-bfc3-4324-a0db-f43c43c977f6 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:34.732138 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b844eaef-bfc3-4324-a0db-f43c43c977f6 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:34.840353 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a34f4c-7cf4-4dc5-81fb-9ff6c20abf6a tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9df4c1d6fab345a6b30cf4a0985fc7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c4851f5d89d4f69861ef9637667323b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:34.841139 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a34f4c-7cf4-4dc5-81fb-9ff6c20abf6a tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:34.841886 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a34f4c-7cf4-4dc5-81fb-9ff6c20abf6a tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:34.842171 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a34f4c-7cf4-4dc5-81fb-9ff6c20abf6a tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:34.843727 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a34f4c-7cf4-4dc5-81fb-9ff6c20abf6a tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:34.846015 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a34f4c-7cf4-4dc5-81fb-9ff6c20abf6a tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:34.974196 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1477b80-e23b-4486-b868-f64bc6b11ed9 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:34.974485 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1477b80-e23b-4486-b868-f64bc6b11ed9 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:34.974763 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1477b80-e23b-4486-b868-f64bc6b11ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:34.975716 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1842/3663] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:22:34 2022] POST /identity/v3/projects => generated 348 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:22:34.979880 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a34f4c-7cf4-4dc5-81fb-9ff6c20abf6a tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:34.983614 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d5a34f4c-7cf4-4dc5-81fb-9ff6c20abf6a tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:22:35.000613 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-a1477b80-e23b-4486-b868-f64bc6b11ed9 None None] MFA Rules not processed for user `a42e0caa0878447f98544e74f767c7ca`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:22:35.003614 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-a1477b80-e23b-4486-b868-f64bc6b11ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:22:35.092061 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1822/3664] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:22:34 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:22:35.144424 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a34f4c-7cf4-4dc5-81fb-9ff6c20abf6a tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:35.150867 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57641594-f740-4834-abb7-a24686431ff9 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9df4c1d6fab345a6b30cf4a0985fc7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c4851f5d89d4f69861ef9637667323b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:35.154393 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57641594-f740-4834-abb7-a24686431ff9 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:35.154393 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57641594-f740-4834-abb7-a24686431ff9 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:35.154393 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57641594-f740-4834-abb7-a24686431ff9 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:35.154393 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57641594-f740-4834-abb7-a24686431ff9 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Adding query filter params (is_domain=True) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:22:35.154393 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57641594-f740-4834-abb7-a24686431ff9 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:35.160883 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57641594-f740-4834-abb7-a24686431ff9 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:35.193740 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1843/3665] 10.222.0.52 () {58 vars in 1159 bytes} [Sat May 14 21:22:34 2022] GET /identity/v3/projects?is_domain=True => generated 1020 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:22:35.199227 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1477b80-e23b-4486-b868-f64bc6b11ed9 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:35.224440 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1477b80-e23b-4486-b868-f64bc6b11ed9 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:35.231059 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccfa892-5743-49d3-8e0f-a07cb2628736 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9df4c1d6fab345a6b30cf4a0985fc7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c4851f5d89d4f69861ef9637667323b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:35.232076 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccfa892-5743-49d3-8e0f-a07cb2628736 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:35.232365 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccfa892-5743-49d3-8e0f-a07cb2628736 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:35.232641 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccfa892-5743-49d3-8e0f-a07cb2628736 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:35.234016 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccfa892-5743-49d3-8e0f-a07cb2628736 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:35.237701 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccfa892-5743-49d3-8e0f-a07cb2628736 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:35.271870 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1823/3666] 10.222.0.52 () {58 vars in 1127 bytes} [Sat May 14 21:22:35 2022] GET /identity/v3/domains => generated 829 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:22:35.276750 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57641594-f740-4834-abb7-a24686431ff9 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:35.293477 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57641594-f740-4834-abb7-a24686431ff9 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:35.303657 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ffbdf7-0474-4593-9e62-a96553c26794 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9df4c1d6fab345a6b30cf4a0985fc7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c4851f5d89d4f69861ef9637667323b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:35.306376 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ffbdf7-0474-4593-9e62-a96553c26794 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:35.306376 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ffbdf7-0474-4593-9e62-a96553c26794 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:35.306376 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ffbdf7-0474-4593-9e62-a96553c26794 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] PATH_INFO: `/v3/projects/86825813c4c5476891589593af3445bf` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:35.307583 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ffbdf7-0474-4593-9e62-a96553c26794 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorizing `identity:update_project(project_id=86825813c4c5476891589593af3445bf)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:35.309898 ncdv-master-1 devstack@keystone.service[91106]: WARNING py.warnings [None req-75ffbdf7-0474-4593-9e62-a96553c26794 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 14 21:22:35.309898 ncdv-master-1 devstack@keystone.service[91106]: warnings.warn(msg) May 14 21:22:35.309898 ncdv-master-1 devstack@keystone.service[91106]: May 14 21:22:35.310166 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ffbdf7-0474-4593-9e62-a96553c26794 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:35.327780 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-75ffbdf7-0474-4593-9e62-a96553c26794 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '86825813c4c5476891589593af3445bf'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:35.329615 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-75ffbdf7-0474-4593-9e62-a96553c26794 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '86825813c4c5476891589593af3445bf'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:35.450190 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-75ffbdf7-0474-4593-9e62-a96553c26794 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '86825813c4c5476891589593af3445bf'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:35.450920 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-75ffbdf7-0474-4593-9e62-a96553c26794 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '86825813c4c5476891589593af3445bf'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:35.457346 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1844/3667] 10.222.0.52 () {60 vars in 1251 bytes} [Sat May 14 21:22:35 2022] PATCH /identity/v3/projects/86825813c4c5476891589593af3445bf => generated 362 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:22:35.458260 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccfa892-5743-49d3-8e0f-a07cb2628736 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:35.460038 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-7ccfa892-5743-49d3-8e0f-a07cb2628736 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:22:35.479748 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccfa892-5743-49d3-8e0f-a07cb2628736 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:35.614707 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7af7fe5-4f43-4093-9a4a-fa505a544fa0 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9df4c1d6fab345a6b30cf4a0985fc7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c4851f5d89d4f69861ef9637667323b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:35.615721 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af7fe5-4f43-4093-9a4a-fa505a544fa0 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:35.616116 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af7fe5-4f43-4093-9a4a-fa505a544fa0 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:35.616887 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af7fe5-4f43-4093-9a4a-fa505a544fa0 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] PATH_INFO: `/v3/projects/86825813c4c5476891589593af3445bf` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:35.635148 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7af7fe5-4f43-4093-9a4a-fa505a544fa0 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorizing `identity:delete_project(project_id=86825813c4c5476891589593af3445bf)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:35.639236 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7af7fe5-4f43-4093-9a4a-fa505a544fa0 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:35.679701 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f7af7fe5-4f43-4093-9a4a-fa505a544fa0 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '86825813c4c5476891589593af3445bf'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:35.701459 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f7af7fe5-4f43-4093-9a4a-fa505a544fa0 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '86825813c4c5476891589593af3445bf'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:35.849710 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f7af7fe5-4f43-4093-9a4a-fa505a544fa0 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86825813c4c5476891589593af3445bf', 'request_id': 'req-f7af7fe5-4f43-4093-9a4a-fa505a544fa0'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:35.862938 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f7af7fe5-4f43-4093-9a4a-fa505a544fa0 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86825813c4c5476891589593af3445bf', 'request_id': 'req-f7af7fe5-4f43-4093-9a4a-fa505a544fa0'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:35.870895 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f7af7fe5-4f43-4093-9a4a-fa505a544fa0 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86825813c4c5476891589593af3445bf', 'request_id': 'req-f7af7fe5-4f43-4093-9a4a-fa505a544fa0'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:35.994205 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f7af7fe5-4f43-4093-9a4a-fa505a544fa0 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] The token cache is being invalidate because project 86825813c4c5476891589593af3445bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:22:35.994567 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f7af7fe5-4f43-4093-9a4a-fa505a544fa0 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:35.995932 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f7af7fe5-4f43-4093-9a4a-fa505a544fa0 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:36.009975 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f7af7fe5-4f43-4093-9a4a-fa505a544fa0 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '86825813c4c5476891589593af3445bf', 'request_id': 'req-f7af7fe5-4f43-4093-9a4a-fa505a544fa0'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:36.011333 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f7af7fe5-4f43-4093-9a4a-fa505a544fa0 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '86825813c4c5476891589593af3445bf', 'request_id': 'req-f7af7fe5-4f43-4093-9a4a-fa505a544fa0'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:36.016266 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f7af7fe5-4f43-4093-9a4a-fa505a544fa0 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '86825813c4c5476891589593af3445bf', 'request_id': 'req-f7af7fe5-4f43-4093-9a4a-fa505a544fa0'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:36.026561 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1824/3668] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:22:35 2022] DELETE /identity/v3/projects/86825813c4c5476891589593af3445bf => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:22:36.035835 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ffbdf7-0474-4593-9e62-a96553c26794 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:36.047305 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ffbdf7-0474-4593-9e62-a96553c26794 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:36.147015 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43ddf48-6ee3-4441-98fe-c9def27cc317 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9df4c1d6fab345a6b30cf4a0985fc7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c4851f5d89d4f69861ef9637667323b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:36.147429 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ddf48-6ee3-4441-98fe-c9def27cc317 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:36.148723 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ddf48-6ee3-4441-98fe-c9def27cc317 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:36.148723 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ddf48-6ee3-4441-98fe-c9def27cc317 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:36.151539 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43ddf48-6ee3-4441-98fe-c9def27cc317 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:36.156168 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43ddf48-6ee3-4441-98fe-c9def27cc317 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:36.271234 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1845/3669] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:22:36 2022] POST /identity/v3/projects => generated 360 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:22:36.275552 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7af7fe5-4f43-4093-9a4a-fa505a544fa0 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:36.277165 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-f7af7fe5-4f43-4093-9a4a-fa505a544fa0 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:22:36.300563 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7af7fe5-4f43-4093-9a4a-fa505a544fa0 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:36.363140 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec775fe-3afa-4755-bdf0-036ec515b5ab tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9df4c1d6fab345a6b30cf4a0985fc7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c4851f5d89d4f69861ef9637667323b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:36.372889 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec775fe-3afa-4755-bdf0-036ec515b5ab tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:36.372889 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec775fe-3afa-4755-bdf0-036ec515b5ab tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:36.372889 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec775fe-3afa-4755-bdf0-036ec515b5ab tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] PATH_INFO: `/v3/projects/2102c0e7defb4adb965a1b4e5c489318` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:36.372889 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec775fe-3afa-4755-bdf0-036ec515b5ab tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorizing `identity:get_project(project_id=2102c0e7defb4adb965a1b4e5c489318)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:36.372889 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec775fe-3afa-4755-bdf0-036ec515b5ab tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:36.373404 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1825/3670] 10.222.0.52 () {58 vars in 1229 bytes} [Sat May 14 21:22:36 2022] GET /identity/v3/projects/2102c0e7defb4adb965a1b4e5c489318 => generated 360 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:22:36.379894 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43ddf48-6ee3-4441-98fe-c9def27cc317 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:36.398163 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43ddf48-6ee3-4441-98fe-c9def27cc317 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:36.403455 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989b65e0-fd4b-42ab-93af-435469ed7b89 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9df4c1d6fab345a6b30cf4a0985fc7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c4851f5d89d4f69861ef9637667323b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:36.404582 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b65e0-fd4b-42ab-93af-435469ed7b89 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:36.404975 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b65e0-fd4b-42ab-93af-435469ed7b89 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:36.406109 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b65e0-fd4b-42ab-93af-435469ed7b89 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] PATH_INFO: `/v3/projects/2102c0e7defb4adb965a1b4e5c489318` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:36.407987 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989b65e0-fd4b-42ab-93af-435469ed7b89 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2102c0e7defb4adb965a1b4e5c489318)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:36.425574 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989b65e0-fd4b-42ab-93af-435469ed7b89 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:36.602363 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-989b65e0-fd4b-42ab-93af-435469ed7b89 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2102c0e7defb4adb965a1b4e5c489318', 'request_id': 'req-989b65e0-fd4b-42ab-93af-435469ed7b89'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:36.612312 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-989b65e0-fd4b-42ab-93af-435469ed7b89 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2102c0e7defb4adb965a1b4e5c489318', 'request_id': 'req-989b65e0-fd4b-42ab-93af-435469ed7b89'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:36.751903 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-989b65e0-fd4b-42ab-93af-435469ed7b89 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2102c0e7defb4adb965a1b4e5c489318', 'request_id': 'req-989b65e0-fd4b-42ab-93af-435469ed7b89'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:36.780903 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-989b65e0-fd4b-42ab-93af-435469ed7b89 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] The token cache is being invalidate because project 2102c0e7defb4adb965a1b4e5c489318 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:22:36.781233 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-989b65e0-fd4b-42ab-93af-435469ed7b89 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:36.782940 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-989b65e0-fd4b-42ab-93af-435469ed7b89 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:36.786425 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1846/3671] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:22:36 2022] DELETE /identity/v3/projects/2102c0e7defb4adb965a1b4e5c489318 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:22:36.792260 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec775fe-3afa-4755-bdf0-036ec515b5ab tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:36.795694 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-6ec775fe-3afa-4755-bdf0-036ec515b5ab tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:22:36.814976 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec775fe-3afa-4755-bdf0-036ec515b5ab tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:36.940797 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dccf1a-177e-4858-92d9-92da11c87e84 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9df4c1d6fab345a6b30cf4a0985fc7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c4851f5d89d4f69861ef9637667323b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:36.941475 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dccf1a-177e-4858-92d9-92da11c87e84 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:36.941978 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dccf1a-177e-4858-92d9-92da11c87e84 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:36.942385 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dccf1a-177e-4858-92d9-92da11c87e84 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:36.943007 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dccf1a-177e-4858-92d9-92da11c87e84 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:36.945976 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dccf1a-177e-4858-92d9-92da11c87e84 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:36.947405 ncdv-master-1 devstack@keystone.service[91107]: WARNING keystone.server.flask.common [None req-34dccf1a-177e-4858-92d9-92da11c87e84 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 14 21:22:37.080856 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1826/3672] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:22:36 2022] POST /identity/v3/projects => generated 361 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:22:37.081266 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989b65e0-fd4b-42ab-93af-435469ed7b89 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:37.097289 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989b65e0-fd4b-42ab-93af-435469ed7b89 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:37.216457 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8447e3-58cc-4a03-8369-e971daa9682e tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9df4c1d6fab345a6b30cf4a0985fc7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c4851f5d89d4f69861ef9637667323b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:37.217332 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8447e3-58cc-4a03-8369-e971daa9682e tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:37.217620 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8447e3-58cc-4a03-8369-e971daa9682e tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:37.218454 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8447e3-58cc-4a03-8369-e971daa9682e tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] PATH_INFO: `/v3/projects/a432a6d7331148518d6aa06d44352b4f` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:37.219744 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8447e3-58cc-4a03-8369-e971daa9682e tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorizing `identity:get_project(project_id=a432a6d7331148518d6aa06d44352b4f)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:37.221951 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8447e3-58cc-4a03-8369-e971daa9682e tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:37.227396 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1847/3673] 10.222.0.52 () {58 vars in 1229 bytes} [Sat May 14 21:22:37 2022] GET /identity/v3/projects/a432a6d7331148518d6aa06d44352b4f => generated 361 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:22:37.229223 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dccf1a-177e-4858-92d9-92da11c87e84 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:37.256003 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dccf1a-177e-4858-92d9-92da11c87e84 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:37.265313 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c036b-1e3f-433a-93d9-96ef70c050eb tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9df4c1d6fab345a6b30cf4a0985fc7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c4851f5d89d4f69861ef9637667323b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:37.266351 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c036b-1e3f-433a-93d9-96ef70c050eb tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:37.266633 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c036b-1e3f-433a-93d9-96ef70c050eb tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:37.266910 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c036b-1e3f-433a-93d9-96ef70c050eb tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] PATH_INFO: `/v3/projects/a432a6d7331148518d6aa06d44352b4f` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:37.268254 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58c036b-1e3f-433a-93d9-96ef70c050eb tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a432a6d7331148518d6aa06d44352b4f)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:37.271359 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58c036b-1e3f-433a-93d9-96ef70c050eb tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:37.405188 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f58c036b-1e3f-433a-93d9-96ef70c050eb tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a432a6d7331148518d6aa06d44352b4f', 'request_id': 'req-f58c036b-1e3f-433a-93d9-96ef70c050eb'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:37.413872 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f58c036b-1e3f-433a-93d9-96ef70c050eb tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a432a6d7331148518d6aa06d44352b4f', 'request_id': 'req-f58c036b-1e3f-433a-93d9-96ef70c050eb'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:37.422487 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f58c036b-1e3f-433a-93d9-96ef70c050eb tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a432a6d7331148518d6aa06d44352b4f', 'request_id': 'req-f58c036b-1e3f-433a-93d9-96ef70c050eb'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:37.570866 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f58c036b-1e3f-433a-93d9-96ef70c050eb tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] The token cache is being invalidate because project a432a6d7331148518d6aa06d44352b4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:22:37.571467 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f58c036b-1e3f-433a-93d9-96ef70c050eb tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:37.572730 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f58c036b-1e3f-433a-93d9-96ef70c050eb tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:37.575275 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1827/3674] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:22:37 2022] DELETE /identity/v3/projects/a432a6d7331148518d6aa06d44352b4f => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:22:37.581886 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8447e3-58cc-4a03-8369-e971daa9682e tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:37.584596 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-0c8447e3-58cc-4a03-8369-e971daa9682e tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:22:37.608091 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8447e3-58cc-4a03-8369-e971daa9682e tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:37.697341 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4a3a53-4ddd-4832-9175-26452465a4ee tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9df4c1d6fab345a6b30cf4a0985fc7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c4851f5d89d4f69861ef9637667323b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:37.698001 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a3a53-4ddd-4832-9175-26452465a4ee tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:37.698453 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a3a53-4ddd-4832-9175-26452465a4ee tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:37.698910 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a3a53-4ddd-4832-9175-26452465a4ee tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:37.699649 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4a3a53-4ddd-4832-9175-26452465a4ee tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:37.701508 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4a3a53-4ddd-4832-9175-26452465a4ee tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:37.861761 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1848/3675] 10.222.0.52 () {60 vars in 1151 bytes} [Sat May 14 21:22:37 2022] POST /identity/v3/projects => generated 347 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:22:37.873112 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c036b-1e3f-433a-93d9-96ef70c050eb tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:37.891924 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4a3a53-4ddd-4832-9175-26452465a4ee tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:37.895229 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c036b-1e3f-433a-93d9-96ef70c050eb tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:37.896067 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-9d4a3a53-4ddd-4832-9175-26452465a4ee tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:22:38.013178 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cfe6c5-8b11-46fe-8374-ccf77a3d7f02 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9df4c1d6fab345a6b30cf4a0985fc7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c4851f5d89d4f69861ef9637667323b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:38.014406 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cfe6c5-8b11-46fe-8374-ccf77a3d7f02 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:38.015324 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cfe6c5-8b11-46fe-8374-ccf77a3d7f02 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:38.015891 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cfe6c5-8b11-46fe-8374-ccf77a3d7f02 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] PATH_INFO: `/v3/projects/62638b53a56441f589657cdd902810bf` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:38.018506 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cfe6c5-8b11-46fe-8374-ccf77a3d7f02 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorizing `identity:get_project(project_id=62638b53a56441f589657cdd902810bf)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:38.021282 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cfe6c5-8b11-46fe-8374-ccf77a3d7f02 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:38.029009 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1828/3676] 10.222.0.52 () {58 vars in 1229 bytes} [Sat May 14 21:22:37 2022] GET /identity/v3/projects/62638b53a56441f589657cdd902810bf => generated 347 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:22:38.029958 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cfe6c5-8b11-46fe-8374-ccf77a3d7f02 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:38.050224 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cfe6c5-8b11-46fe-8374-ccf77a3d7f02 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:38.054195 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4a3a53-4ddd-4832-9175-26452465a4ee tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:38.055523 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff114af-c202-4ac7-a9cd-0599c56ef038 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9df4c1d6fab345a6b30cf4a0985fc7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c4851f5d89d4f69861ef9637667323b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:38.056696 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff114af-c202-4ac7-a9cd-0599c56ef038 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:38.057282 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff114af-c202-4ac7-a9cd-0599c56ef038 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:38.057678 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff114af-c202-4ac7-a9cd-0599c56ef038 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] PATH_INFO: `/v3/projects/62638b53a56441f589657cdd902810bf` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:38.059083 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff114af-c202-4ac7-a9cd-0599c56ef038 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorizing `identity:delete_project(project_id=62638b53a56441f589657cdd902810bf)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:38.061237 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff114af-c202-4ac7-a9cd-0599c56ef038 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:38.075429 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2342b04b-f3d6-4b43-a93e-260ebc925c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:38.079036 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2342b04b-f3d6-4b43-a93e-260ebc925c0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:38.079371 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2342b04b-f3d6-4b43-a93e-260ebc925c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:38.079624 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2342b04b-f3d6-4b43-a93e-260ebc925c0e admin admin] PATH_INFO: `/v3/users/07186d1e535e4de2ae6b8269ca10b4c6` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:38.087091 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2342b04b-f3d6-4b43-a93e-260ebc925c0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=07186d1e535e4de2ae6b8269ca10b4c6)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:38.095123 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2342b04b-f3d6-4b43-a93e-260ebc925c0e admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:38.226033 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-8ff114af-c202-4ac7-a9cd-0599c56ef038 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62638b53a56441f589657cdd902810bf', 'request_id': 'req-8ff114af-c202-4ac7-a9cd-0599c56ef038'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:38.232910 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-8ff114af-c202-4ac7-a9cd-0599c56ef038 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62638b53a56441f589657cdd902810bf', 'request_id': 'req-8ff114af-c202-4ac7-a9cd-0599c56ef038'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:38.239960 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-8ff114af-c202-4ac7-a9cd-0599c56ef038 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62638b53a56441f589657cdd902810bf', 'request_id': 'req-8ff114af-c202-4ac7-a9cd-0599c56ef038'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:38.350308 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2342b04b-f3d6-4b43-a93e-260ebc925c0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07186d1e535e4de2ae6b8269ca10b4c6'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:38.363791 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2342b04b-f3d6-4b43-a93e-260ebc925c0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07186d1e535e4de2ae6b8269ca10b4c6'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:38.365963 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-8ff114af-c202-4ac7-a9cd-0599c56ef038 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] The token cache is being invalidate because project 62638b53a56441f589657cdd902810bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:22:38.367959 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-8ff114af-c202-4ac7-a9cd-0599c56ef038 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:38.368955 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-8ff114af-c202-4ac7-a9cd-0599c56ef038 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:38.371603 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2342b04b-f3d6-4b43-a93e-260ebc925c0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07186d1e535e4de2ae6b8269ca10b4c6'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:38.378489 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1829/3677] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:22:38 2022] DELETE /identity/v3/projects/62638b53a56441f589657cdd902810bf => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:22:38.379930 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff114af-c202-4ac7-a9cd-0599c56ef038 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:38.382303 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8ff114af-c202-4ac7-a9cd-0599c56ef038 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:22:38.469461 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff114af-c202-4ac7-a9cd-0599c56ef038 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:38.474492 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590b2bcb-53a0-462c-af5a-bb02e8f80928 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9df4c1d6fab345a6b30cf4a0985fc7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c4851f5d89d4f69861ef9637667323b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:38.479833 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b2bcb-53a0-462c-af5a-bb02e8f80928 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:38.479833 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b2bcb-53a0-462c-af5a-bb02e8f80928 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:38.479833 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b2bcb-53a0-462c-af5a-bb02e8f80928 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:38.479833 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590b2bcb-53a0-462c-af5a-bb02e8f80928 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:38.480201 ncdv-master-1 devstack@keystone.service[91107]: WARNING py.warnings [None req-590b2bcb-53a0-462c-af5a-bb02e8f80928 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:22:38.480201 ncdv-master-1 devstack@keystone.service[91107]: warnings.warn(msg) May 14 21:22:38.480201 ncdv-master-1 devstack@keystone.service[91107]: May 14 21:22:38.480385 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590b2bcb-53a0-462c-af5a-bb02e8f80928 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:38.502204 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2342b04b-f3d6-4b43-a93e-260ebc925c0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07186d1e535e4de2ae6b8269ca10b4c6'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:38.503192 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2342b04b-f3d6-4b43-a93e-260ebc925c0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07186d1e535e4de2ae6b8269ca10b4c6'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:38.514149 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1849/3678] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:22:37 2022] DELETE /identity/v3/users/07186d1e535e4de2ae6b8269ca10b4c6 => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:22:38.575547 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1830/3679] 10.222.0.52 () {60 vars in 1148 bytes} [Sat May 14 21:22:38 2022] POST /identity/v3/domains => generated 277 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:22:38.577800 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2342b04b-f3d6-4b43-a93e-260ebc925c0e admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:38.579950 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-2342b04b-f3d6-4b43-a93e-260ebc925c0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:22:38.740064 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2342b04b-f3d6-4b43-a93e-260ebc925c0e admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:38.823782 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c154c-07a0-4b69-b479-ea5e9324aee8 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9df4c1d6fab345a6b30cf4a0985fc7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c4851f5d89d4f69861ef9637667323b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:38.824566 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c154c-07a0-4b69-b479-ea5e9324aee8 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:38.825056 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c154c-07a0-4b69-b479-ea5e9324aee8 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:38.825402 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c154c-07a0-4b69-b479-ea5e9324aee8 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:38.826168 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876c154c-07a0-4b69-b479-ea5e9324aee8 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:38.829595 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876c154c-07a0-4b69-b479-ea5e9324aee8 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:39.016353 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590b2bcb-53a0-462c-af5a-bb02e8f80928 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:39.018428 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-590b2bcb-53a0-462c-af5a-bb02e8f80928 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:22:39.064704 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1850/3680] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:22:38 2022] POST /identity/v3/projects => generated 405 bytes in 488 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:22:39.069426 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c154c-07a0-4b69-b479-ea5e9324aee8 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:39.119596 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590b2bcb-53a0-462c-af5a-bb02e8f80928 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:39.158222 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c154c-07a0-4b69-b479-ea5e9324aee8 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:39.163434 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d79b1fb-9020-4b60-8b83-517c1ca404e4 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9df4c1d6fab345a6b30cf4a0985fc7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c4851f5d89d4f69861ef9637667323b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:39.164405 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d79b1fb-9020-4b60-8b83-517c1ca404e4 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:39.164754 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d79b1fb-9020-4b60-8b83-517c1ca404e4 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:39.165095 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d79b1fb-9020-4b60-8b83-517c1ca404e4 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] PATH_INFO: `/v3/projects/5adc816ec8274418bfd8458715e83474` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:39.166346 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d79b1fb-9020-4b60-8b83-517c1ca404e4 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorizing `identity:get_project(project_id=5adc816ec8274418bfd8458715e83474)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:39.168509 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d79b1fb-9020-4b60-8b83-517c1ca404e4 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:39.170278 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1851/3681] 10.222.0.52 () {58 vars in 1229 bytes} [Sat May 14 21:22:39 2022] GET /identity/v3/projects/5adc816ec8274418bfd8458715e83474 => generated 405 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:22:39.175224 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d79b1fb-9020-4b60-8b83-517c1ca404e4 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:39.184827 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1683ccb-d2fa-4097-a032-445d34a04426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:39.185681 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1683ccb-d2fa-4097-a032-445d34a04426 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:39.185962 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1683ccb-d2fa-4097-a032-445d34a04426 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:39.186143 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d79b1fb-9020-4b60-8b83-517c1ca404e4 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:39.186249 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1683ccb-d2fa-4097-a032-445d34a04426 admin admin] PATH_INFO: `/v3/projects/cabbde4fba484c6d83f6ae32716cf82b` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:39.187546 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1683ccb-d2fa-4097-a032-445d34a04426 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cabbde4fba484c6d83f6ae32716cf82b)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:39.189439 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1683ccb-d2fa-4097-a032-445d34a04426 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:39.191503 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daac0c8-49bb-4376-a2d4-8a93a7f16546 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9df4c1d6fab345a6b30cf4a0985fc7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c4851f5d89d4f69861ef9637667323b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:39.192354 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daac0c8-49bb-4376-a2d4-8a93a7f16546 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:39.192636 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daac0c8-49bb-4376-a2d4-8a93a7f16546 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:39.192911 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daac0c8-49bb-4376-a2d4-8a93a7f16546 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] PATH_INFO: `/v3/projects/5adc816ec8274418bfd8458715e83474` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:39.194091 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daac0c8-49bb-4376-a2d4-8a93a7f16546 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5adc816ec8274418bfd8458715e83474)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:39.196011 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daac0c8-49bb-4376-a2d4-8a93a7f16546 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:39.370019 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a1683ccb-d2fa-4097-a032-445d34a04426 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cabbde4fba484c6d83f6ae32716cf82b', 'request_id': 'req-a1683ccb-d2fa-4097-a032-445d34a04426'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:39.377213 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a1683ccb-d2fa-4097-a032-445d34a04426 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cabbde4fba484c6d83f6ae32716cf82b', 'request_id': 'req-a1683ccb-d2fa-4097-a032-445d34a04426'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:39.384641 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a1683ccb-d2fa-4097-a032-445d34a04426 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cabbde4fba484c6d83f6ae32716cf82b', 'request_id': 'req-a1683ccb-d2fa-4097-a032-445d34a04426'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:39.401536 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-4daac0c8-49bb-4376-a2d4-8a93a7f16546 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5adc816ec8274418bfd8458715e83474', 'request_id': 'req-4daac0c8-49bb-4376-a2d4-8a93a7f16546'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:39.414629 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-4daac0c8-49bb-4376-a2d4-8a93a7f16546 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5adc816ec8274418bfd8458715e83474', 'request_id': 'req-4daac0c8-49bb-4376-a2d4-8a93a7f16546'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:39.523237 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a1683ccb-d2fa-4097-a032-445d34a04426 admin admin] The token cache is being invalidate because project cabbde4fba484c6d83f6ae32716cf82b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:22:39.524531 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a1683ccb-d2fa-4097-a032-445d34a04426 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:39.524531 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a1683ccb-d2fa-4097-a032-445d34a04426 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:39.529295 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1831/3682] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:22:39 2022] DELETE /identity/v3/projects/cabbde4fba484c6d83f6ae32716cf82b => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:22:39.531259 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1683ccb-d2fa-4097-a032-445d34a04426 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:39.546770 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-a1683ccb-d2fa-4097-a032-445d34a04426 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:22:39.636730 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-4daac0c8-49bb-4376-a2d4-8a93a7f16546 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5adc816ec8274418bfd8458715e83474', 'request_id': 'req-4daac0c8-49bb-4376-a2d4-8a93a7f16546'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:39.649716 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1683ccb-d2fa-4097-a032-445d34a04426 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:39.656413 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-4daac0c8-49bb-4376-a2d4-8a93a7f16546 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] The token cache is being invalidate because project 5adc816ec8274418bfd8458715e83474 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:22:39.656955 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-4daac0c8-49bb-4376-a2d4-8a93a7f16546 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:39.659303 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-4daac0c8-49bb-4376-a2d4-8a93a7f16546 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:39.663041 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1852/3683] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:22:39 2022] DELETE /identity/v3/projects/5adc816ec8274418bfd8458715e83474 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:22:39.669067 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daac0c8-49bb-4376-a2d4-8a93a7f16546 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:39.671542 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-4daac0c8-49bb-4376-a2d4-8a93a7f16546 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:22:39.748709 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165d949b-b2e3-419d-8eba-f908713cc6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:39.750944 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d949b-b2e3-419d-8eba-f908713cc6df admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:39.751678 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d949b-b2e3-419d-8eba-f908713cc6df admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:39.752318 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d949b-b2e3-419d-8eba-f908713cc6df admin admin] PATH_INFO: `/v3/users/4c7b0ab4127a45869ce524ae057735b4` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:39.753738 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165d949b-b2e3-419d-8eba-f908713cc6df admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c7b0ab4127a45869ce524ae057735b4)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:39.756474 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165d949b-b2e3-419d-8eba-f908713cc6df admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:39.864328 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daac0c8-49bb-4376-a2d4-8a93a7f16546 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:39.881223 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5230057-c1b7-45c3-a11d-c48f7451c381 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9df4c1d6fab345a6b30cf4a0985fc7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c4851f5d89d4f69861ef9637667323b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:39.888292 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5230057-c1b7-45c3-a11d-c48f7451c381 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:39.888292 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5230057-c1b7-45c3-a11d-c48f7451c381 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:39.888292 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5230057-c1b7-45c3-a11d-c48f7451c381 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] PATH_INFO: `/v3/domains/4d4ac859c4e14f4da911e3bd5bace077` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:39.888292 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5230057-c1b7-45c3-a11d-c48f7451c381 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=4d4ac859c4e14f4da911e3bd5bace077)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:39.889426 ncdv-master-1 devstack@keystone.service[91106]: WARNING py.warnings [None req-b5230057-c1b7-45c3-a11d-c48f7451c381 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:22:39.889426 ncdv-master-1 devstack@keystone.service[91106]: warnings.warn(msg) May 14 21:22:39.889426 ncdv-master-1 devstack@keystone.service[91106]: May 14 21:22:39.891758 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5230057-c1b7-45c3-a11d-c48f7451c381 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:39.919988 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b5230057-c1b7-45c3-a11d-c48f7451c381 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '4d4ac859c4e14f4da911e3bd5bace077'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:39.925325 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b5230057-c1b7-45c3-a11d-c48f7451c381 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '4d4ac859c4e14f4da911e3bd5bace077'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:40.041838 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-165d949b-b2e3-419d-8eba-f908713cc6df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c7b0ab4127a45869ce524ae057735b4'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:40.050534 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-165d949b-b2e3-419d-8eba-f908713cc6df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c7b0ab4127a45869ce524ae057735b4'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:40.051372 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-165d949b-b2e3-419d-8eba-f908713cc6df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c7b0ab4127a45869ce524ae057735b4'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:40.058831 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b5230057-c1b7-45c3-a11d-c48f7451c381 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '4d4ac859c4e14f4da911e3bd5bace077'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:40.059467 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b5230057-c1b7-45c3-a11d-c48f7451c381 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '4d4ac859c4e14f4da911e3bd5bace077'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:40.066448 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1853/3684] 10.222.0.52 () {60 vars in 1248 bytes} [Sat May 14 21:22:39 2022] PATCH /identity/v3/domains/4d4ac859c4e14f4da911e3bd5bace077 => generated 278 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:22:40.068217 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5230057-c1b7-45c3-a11d-c48f7451c381 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:40.070648 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b5230057-c1b7-45c3-a11d-c48f7451c381 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:22:40.192679 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5230057-c1b7-45c3-a11d-c48f7451c381 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:40.201823 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e81abb8-30af-4e15-b03b-3c1ecd1e457d tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9df4c1d6fab345a6b30cf4a0985fc7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c4851f5d89d4f69861ef9637667323b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:40.204034 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e81abb8-30af-4e15-b03b-3c1ecd1e457d tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:40.204531 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e81abb8-30af-4e15-b03b-3c1ecd1e457d tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:40.205433 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e81abb8-30af-4e15-b03b-3c1ecd1e457d tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] PATH_INFO: `/v3/domains/4d4ac859c4e14f4da911e3bd5bace077` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:40.223956 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e81abb8-30af-4e15-b03b-3c1ecd1e457d tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=4d4ac859c4e14f4da911e3bd5bace077)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:40.225136 ncdv-master-1 devstack@keystone.service[91106]: WARNING py.warnings [None req-6e81abb8-30af-4e15-b03b-3c1ecd1e457d tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:22:40.225136 ncdv-master-1 devstack@keystone.service[91106]: warnings.warn(msg) May 14 21:22:40.225136 ncdv-master-1 devstack@keystone.service[91106]: May 14 21:22:40.226907 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e81abb8-30af-4e15-b03b-3c1ecd1e457d tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:40.230804 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-165d949b-b2e3-419d-8eba-f908713cc6df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c7b0ab4127a45869ce524ae057735b4'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:40.248404 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-165d949b-b2e3-419d-8eba-f908713cc6df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c7b0ab4127a45869ce524ae057735b4'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:40.261015 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1832/3685] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:22:39 2022] DELETE /identity/v3/users/4c7b0ab4127a45869ce524ae057735b4 => generated 0 bytes in 727 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:22:40.313149 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6e81abb8-30af-4e15-b03b-3c1ecd1e457d tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '4d4ac859c4e14f4da911e3bd5bace077'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:40.320016 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6e81abb8-30af-4e15-b03b-3c1ecd1e457d tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '4d4ac859c4e14f4da911e3bd5bace077'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:40.525180 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6e81abb8-30af-4e15-b03b-3c1ecd1e457d tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d4ac859c4e14f4da911e3bd5bace077', 'request_id': 'req-6e81abb8-30af-4e15-b03b-3c1ecd1e457d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:40.535793 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6e81abb8-30af-4e15-b03b-3c1ecd1e457d tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d4ac859c4e14f4da911e3bd5bace077', 'request_id': 'req-6e81abb8-30af-4e15-b03b-3c1ecd1e457d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:40.720909 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6e81abb8-30af-4e15-b03b-3c1ecd1e457d tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d4ac859c4e14f4da911e3bd5bace077', 'request_id': 'req-6e81abb8-30af-4e15-b03b-3c1ecd1e457d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:40.735754 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6e81abb8-30af-4e15-b03b-3c1ecd1e457d tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] The token cache is being invalidate because project 4d4ac859c4e14f4da911e3bd5bace077 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:22:40.736874 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6e81abb8-30af-4e15-b03b-3c1ecd1e457d tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:40.737580 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6e81abb8-30af-4e15-b03b-3c1ecd1e457d tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:40.748709 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6e81abb8-30af-4e15-b03b-3c1ecd1e457d tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '4d4ac859c4e14f4da911e3bd5bace077', 'request_id': 'req-6e81abb8-30af-4e15-b03b-3c1ecd1e457d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:40.750003 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6e81abb8-30af-4e15-b03b-3c1ecd1e457d tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '4d4ac859c4e14f4da911e3bd5bace077', 'request_id': 'req-6e81abb8-30af-4e15-b03b-3c1ecd1e457d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:40.754351 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6e81abb8-30af-4e15-b03b-3c1ecd1e457d tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '4d4ac859c4e14f4da911e3bd5bace077', 'request_id': 'req-6e81abb8-30af-4e15-b03b-3c1ecd1e457d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:40.760665 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1854/3686] 10.222.0.52 () {58 vars in 1229 bytes} [Sat May 14 21:22:40 2022] DELETE /identity/v3/domains/4d4ac859c4e14f4da911e3bd5bace077 => generated 0 bytes in 693 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:22:40.766673 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165d949b-b2e3-419d-8eba-f908713cc6df admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:40.775100 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-165d949b-b2e3-419d-8eba-f908713cc6df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:22:40.835901 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e81abb8-30af-4e15-b03b-3c1ecd1e457d tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:40.837516 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-6e81abb8-30af-4e15-b03b-3c1ecd1e457d tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:22:40.840884 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165d949b-b2e3-419d-8eba-f908713cc6df admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:40.966324 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b11631-0efb-4fac-9487-af4c39421ba6 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9df4c1d6fab345a6b30cf4a0985fc7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c4851f5d89d4f69861ef9637667323b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:40.967266 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b11631-0efb-4fac-9487-af4c39421ba6 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:40.969115 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b11631-0efb-4fac-9487-af4c39421ba6 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:40.969756 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b11631-0efb-4fac-9487-af4c39421ba6 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:40.970702 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b11631-0efb-4fac-9487-af4c39421ba6 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:40.973430 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b11631-0efb-4fac-9487-af4c39421ba6 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:40.991012 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e81abb8-30af-4e15-b03b-3c1ecd1e457d tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:40.995900 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b615f69-1014-43ad-b163-f17f71b303fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:40.996855 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b615f69-1014-43ad-b163-f17f71b303fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:40.997272 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b615f69-1014-43ad-b163-f17f71b303fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:40.997746 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b615f69-1014-43ad-b163-f17f71b303fb admin admin] PATH_INFO: `/v3/projects/a7b652f4fb414727b68ba9078a657cb9` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:40.999652 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b615f69-1014-43ad-b163-f17f71b303fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7b652f4fb414727b68ba9078a657cb9)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:41.001782 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b615f69-1014-43ad-b163-f17f71b303fb admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:41.127837 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1833/3687] 10.222.0.52 () {60 vars in 1148 bytes} [Sat May 14 21:22:40 2022] POST /identity/v3/domains => generated 275 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:22:41.129046 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b11631-0efb-4fac-9487-af4c39421ba6 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:41.131030 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-a7b11631-0efb-4fac-9487-af4c39421ba6 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:22:41.187936 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3b615f69-1014-43ad-b163-f17f71b303fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7b652f4fb414727b68ba9078a657cb9', 'request_id': 'req-3b615f69-1014-43ad-b163-f17f71b303fb'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:41.194713 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3b615f69-1014-43ad-b163-f17f71b303fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7b652f4fb414727b68ba9078a657cb9', 'request_id': 'req-3b615f69-1014-43ad-b163-f17f71b303fb'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:41.211077 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b11631-0efb-4fac-9487-af4c39421ba6 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:41.282767 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3b615f69-1014-43ad-b163-f17f71b303fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7b652f4fb414727b68ba9078a657cb9', 'request_id': 'req-3b615f69-1014-43ad-b163-f17f71b303fb'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:41.292162 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4062754a-0552-4a59-ad98-42345434abb0 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9df4c1d6fab345a6b30cf4a0985fc7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c4851f5d89d4f69861ef9637667323b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:41.293068 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062754a-0552-4a59-ad98-42345434abb0 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:41.296511 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062754a-0552-4a59-ad98-42345434abb0 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:41.296511 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062754a-0552-4a59-ad98-42345434abb0 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:41.298644 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4062754a-0552-4a59-ad98-42345434abb0 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:41.301796 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4062754a-0552-4a59-ad98-42345434abb0 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:41.308375 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3b615f69-1014-43ad-b163-f17f71b303fb admin admin] The token cache is being invalidate because project a7b652f4fb414727b68ba9078a657cb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:22:41.309697 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3b615f69-1014-43ad-b163-f17f71b303fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:41.312581 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3b615f69-1014-43ad-b163-f17f71b303fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:41.322800 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1855/3688] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:22:40 2022] DELETE /identity/v3/projects/a7b652f4fb414727b68ba9078a657cb9 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:22:41.332977 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c14b37-5d0c-4870-b8b0-87d6165a2d28 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:41.333979 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c14b37-5d0c-4870-b8b0-87d6165a2d28 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:41.334466 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c14b37-5d0c-4870-b8b0-87d6165a2d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:41.383289 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-23c14b37-5d0c-4870-b8b0-87d6165a2d28 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:22:41.384570 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-23c14b37-5d0c-4870-b8b0-87d6165a2d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:22:41.486229 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1834/3689] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:22:41 2022] POST /identity/v3/projects => generated 410 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:22:41.490102 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4062754a-0552-4a59-ad98-42345434abb0 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:41.492119 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-4062754a-0552-4a59-ad98-42345434abb0 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:22:41.519434 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1856/3690] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:22:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:22:41.521872 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce8b17-9553-41f7-bb04-c96df921974d None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:41.522830 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce8b17-9553-41f7-bb04-c96df921974d None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:41.522830 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce8b17-9553-41f7-bb04-c96df921974d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:41.559420 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-9bce8b17-9553-41f7-bb04-c96df921974d None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:22:41.562361 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-9bce8b17-9553-41f7-bb04-c96df921974d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:22:41.595446 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4062754a-0552-4a59-ad98-42345434abb0 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:41.601432 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfcf70f-98e7-4ded-818a-25356693a750 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9df4c1d6fab345a6b30cf4a0985fc7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c4851f5d89d4f69861ef9637667323b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:41.602314 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfcf70f-98e7-4ded-818a-25356693a750 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:41.602773 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfcf70f-98e7-4ded-818a-25356693a750 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:41.603208 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfcf70f-98e7-4ded-818a-25356693a750 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:41.604541 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfcf70f-98e7-4ded-818a-25356693a750 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:41.607666 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfcf70f-98e7-4ded-818a-25356693a750 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:41.686038 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1857/3691] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:22:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:22:41.691009 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bce8b17-9553-41f7-bb04-c96df921974d None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:41.703915 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bce8b17-9553-41f7-bb04-c96df921974d None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:41.719423 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af6326-a83b-4a6e-8f94-80e0f750891d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:41.719423 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af6326-a83b-4a6e-8f94-80e0f750891d admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:41.719423 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af6326-a83b-4a6e-8f94-80e0f750891d admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:41.719423 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af6326-a83b-4a6e-8f94-80e0f750891d admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:41.719818 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03af6326-a83b-4a6e-8f94-80e0f750891d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:22:41.719818 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03af6326-a83b-4a6e-8f94-80e0f750891d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:41.719818 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03af6326-a83b-4a6e-8f94-80e0f750891d admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:41.720055 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1835/3692] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:22:41 2022] POST /identity/v3/projects => generated 405 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:22:41.721719 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfcf70f-98e7-4ded-818a-25356693a750 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:41.732148 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1858/3693] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:22:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:22:41.737756 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af6326-a83b-4a6e-8f94-80e0f750891d admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:41.758082 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af6326-a83b-4a6e-8f94-80e0f750891d admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:41.832163 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfcf70f-98e7-4ded-818a-25356693a750 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:41.837501 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f3f161-3807-456f-838c-4c62015366fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:41.838739 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3f161-3807-456f-838c-4c62015366fb admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:41.839254 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3f161-3807-456f-838c-4c62015366fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:41.839726 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3f161-3807-456f-838c-4c62015366fb admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:41.840526 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39037763-5e28-42c1-a5c7-f0d08d08168e tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9df4c1d6fab345a6b30cf4a0985fc7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c4851f5d89d4f69861ef9637667323b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:41.841062 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f3f161-3807-456f-838c-4c62015366fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:41.841844 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39037763-5e28-42c1-a5c7-f0d08d08168e tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:41.842206 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39037763-5e28-42c1-a5c7-f0d08d08168e tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:41.842412 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39037763-5e28-42c1-a5c7-f0d08d08168e tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] PATH_INFO: `/v3/projects/384ffb7b7f5b4226a2f9de03e451803c` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:41.860404 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f3f161-3807-456f-838c-4c62015366fb admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:41.860809 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39037763-5e28-42c1-a5c7-f0d08d08168e tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorizing `identity:delete_project(project_id=384ffb7b7f5b4226a2f9de03e451803c)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:41.860809 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39037763-5e28-42c1-a5c7-f0d08d08168e tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:42.025995 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1859/3694] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:22:41 2022] POST /identity/v3/projects => generated 393 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:22:42.027834 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f3f161-3807-456f-838c-4c62015366fb admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:42.039078 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-39037763-5e28-42c1-a5c7-f0d08d08168e tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '384ffb7b7f5b4226a2f9de03e451803c', 'request_id': 'req-39037763-5e28-42c1-a5c7-f0d08d08168e'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:42.048484 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-39037763-5e28-42c1-a5c7-f0d08d08168e tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '384ffb7b7f5b4226a2f9de03e451803c', 'request_id': 'req-39037763-5e28-42c1-a5c7-f0d08d08168e'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:42.056536 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-39037763-5e28-42c1-a5c7-f0d08d08168e tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '384ffb7b7f5b4226a2f9de03e451803c', 'request_id': 'req-39037763-5e28-42c1-a5c7-f0d08d08168e'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:42.110442 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f3f161-3807-456f-838c-4c62015366fb admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:42.115816 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a8a429-129f-40c8-ae0a-62bff29de726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:42.116613 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8a429-129f-40c8-ae0a-62bff29de726 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:42.116889 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8a429-129f-40c8-ae0a-62bff29de726 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:42.117757 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8a429-129f-40c8-ae0a-62bff29de726 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:42.118016 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a8a429-129f-40c8-ae0a-62bff29de726 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:42.120492 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a8a429-129f-40c8-ae0a-62bff29de726 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:42.196044 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-39037763-5e28-42c1-a5c7-f0d08d08168e tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] The token cache is being invalidate because project 384ffb7b7f5b4226a2f9de03e451803c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:22:42.196337 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-39037763-5e28-42c1-a5c7-f0d08d08168e tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:42.197007 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-39037763-5e28-42c1-a5c7-f0d08d08168e tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:42.202262 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1836/3695] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:22:41 2022] DELETE /identity/v3/projects/384ffb7b7f5b4226a2f9de03e451803c => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:22:42.203604 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39037763-5e28-42c1-a5c7-f0d08d08168e tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:42.204978 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-39037763-5e28-42c1-a5c7-f0d08d08168e tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:22:42.281248 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1860/3696] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:22:42 2022] POST /identity/v3/users => generated 297 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:22:42.281513 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39037763-5e28-42c1-a5c7-f0d08d08168e tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:42.282943 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a8a429-129f-40c8-ae0a-62bff29de726 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:42.285366 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c8a8a429-129f-40c8-ae0a-62bff29de726 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:22:42.303532 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a8a429-129f-40c8-ae0a-62bff29de726 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:42.311074 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109521e3-4ded-49da-98a8-180e1df2f191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:42.312548 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109521e3-4ded-49da-98a8-180e1df2f191 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:42.312979 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109521e3-4ded-49da-98a8-180e1df2f191 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:42.313553 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109521e3-4ded-49da-98a8-180e1df2f191 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:42.314539 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109521e3-4ded-49da-98a8-180e1df2f191 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:42.316467 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109521e3-4ded-49da-98a8-180e1df2f191 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:42.328285 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1861/3697] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:22:42 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:22:42.336749 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109521e3-4ded-49da-98a8-180e1df2f191 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:42.365312 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109521e3-4ded-49da-98a8-180e1df2f191 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:42.372177 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54d008e-6f63-4401-bc9e-f15f0e87ac6f tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9df4c1d6fab345a6b30cf4a0985fc7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c4851f5d89d4f69861ef9637667323b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:42.373054 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d008e-6f63-4401-bc9e-f15f0e87ac6f tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:42.373335 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d008e-6f63-4401-bc9e-f15f0e87ac6f tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:42.373606 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d008e-6f63-4401-bc9e-f15f0e87ac6f tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] PATH_INFO: `/v3/projects/401bc2150c1c4315863ccff6ebe055c2` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:42.376789 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54d008e-6f63-4401-bc9e-f15f0e87ac6f tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorizing `identity:delete_project(project_id=401bc2150c1c4315863ccff6ebe055c2)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:42.379390 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81caa9-ee68-4492-a33b-670dff905323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:42.380107 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81caa9-ee68-4492-a33b-670dff905323 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:42.380382 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81caa9-ee68-4492-a33b-670dff905323 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:42.380650 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81caa9-ee68-4492-a33b-670dff905323 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:42.381361 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e81caa9-ee68-4492-a33b-670dff905323 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:42.382961 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e81caa9-ee68-4492-a33b-670dff905323 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:42.383803 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54d008e-6f63-4401-bc9e-f15f0e87ac6f tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:42.395360 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1862/3698] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:22:42 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:22:42.399575 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81caa9-ee68-4492-a33b-670dff905323 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:42.414292 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81caa9-ee68-4492-a33b-670dff905323 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:42.424518 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a813df9a-a377-4f9f-a4cb-8316e39f52ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:42.425565 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813df9a-a377-4f9f-a4cb-8316e39f52ad admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:42.425756 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813df9a-a377-4f9f-a4cb-8316e39f52ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:42.426033 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813df9a-a377-4f9f-a4cb-8316e39f52ad admin admin] PATH_INFO: `/v3/projects/155b6f457be24818bb00db2560ef96fe/users/a7f2d4818aa7461da8f30ddfe7641d93/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:42.446393 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a813df9a-a377-4f9f-a4cb-8316e39f52ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=155b6f457be24818bb00db2560ef96fe, user_id=a7f2d4818aa7461da8f30ddfe7641d93, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:42.450042 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a813df9a-a377-4f9f-a4cb-8316e39f52ad admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:42.581650 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1863/3699] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:22:42 2022] PUT /identity/v3/projects/155b6f457be24818bb00db2560ef96fe/users/a7f2d4818aa7461da8f30ddfe7641d93/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:22:42.583143 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc16ad4-19c4-44d2-993e-fed9ff24b9d5 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:42.583457 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc16ad4-19c4-44d2-993e-fed9ff24b9d5 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:42.585167 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc16ad4-19c4-44d2-993e-fed9ff24b9d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:42.606062 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-5bc16ad4-19c4-44d2-993e-fed9ff24b9d5 None None] MFA Rules not processed for user `beb60582a8ae4b2499db4a45da00512f`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:22:42.606408 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f54d008e-6f63-4401-bc9e-f15f0e87ac6f tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '401bc2150c1c4315863ccff6ebe055c2', 'request_id': 'req-f54d008e-6f63-4401-bc9e-f15f0e87ac6f'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:42.607583 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-5bc16ad4-19c4-44d2-993e-fed9ff24b9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:22:42.613750 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f54d008e-6f63-4401-bc9e-f15f0e87ac6f tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '401bc2150c1c4315863ccff6ebe055c2', 'request_id': 'req-f54d008e-6f63-4401-bc9e-f15f0e87ac6f'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:42.623180 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f54d008e-6f63-4401-bc9e-f15f0e87ac6f tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '401bc2150c1c4315863ccff6ebe055c2', 'request_id': 'req-f54d008e-6f63-4401-bc9e-f15f0e87ac6f'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:42.698859 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1864/3700] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:22:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:22:42.700478 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff70af-b428-46b8-b7fd-0544d59681a0 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:42.700960 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff70af-b428-46b8-b7fd-0544d59681a0 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:42.702929 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff70af-b428-46b8-b7fd-0544d59681a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:42.720497 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f54d008e-6f63-4401-bc9e-f15f0e87ac6f tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] The token cache is being invalidate because project 401bc2150c1c4315863ccff6ebe055c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:22:42.720956 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f54d008e-6f63-4401-bc9e-f15f0e87ac6f tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:42.723230 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f54d008e-6f63-4401-bc9e-f15f0e87ac6f tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:42.726911 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1837/3701] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:22:42 2022] DELETE /identity/v3/projects/401bc2150c1c4315863ccff6ebe055c2 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:22:42.731846 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54d008e-6f63-4401-bc9e-f15f0e87ac6f tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:42.732052 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-a2ff70af-b428-46b8-b7fd-0544d59681a0 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:22:42.734757 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-a2ff70af-b428-46b8-b7fd-0544d59681a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:22:42.735440 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-f54d008e-6f63-4401-bc9e-f15f0e87ac6f tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:22:42.877962 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1865/3702] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:22:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:22:42.917965 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54d008e-6f63-4401-bc9e-f15f0e87ac6f tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:42.933615 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ff70af-b428-46b8-b7fd-0544d59681a0 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:42.935963 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-a2ff70af-b428-46b8-b7fd-0544d59681a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:22:42.942667 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ef0d8a-7526-4422-b70e-2ecbcbb67ecd tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9df4c1d6fab345a6b30cf4a0985fc7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c4851f5d89d4f69861ef9637667323b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:42.944137 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef0d8a-7526-4422-b70e-2ecbcbb67ecd tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:42.944672 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef0d8a-7526-4422-b70e-2ecbcbb67ecd tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:42.957085 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef0d8a-7526-4422-b70e-2ecbcbb67ecd tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] PATH_INFO: `/v3/domains/41c846c739824243b73116269e92afdc` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:42.957085 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ef0d8a-7526-4422-b70e-2ecbcbb67ecd tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=41c846c739824243b73116269e92afdc)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:42.957085 ncdv-master-1 devstack@keystone.service[91107]: WARNING py.warnings [None req-68ef0d8a-7526-4422-b70e-2ecbcbb67ecd tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:22:42.957085 ncdv-master-1 devstack@keystone.service[91107]: warnings.warn(msg) May 14 21:22:42.957085 ncdv-master-1 devstack@keystone.service[91107]: May 14 21:22:42.957737 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ef0d8a-7526-4422-b70e-2ecbcbb67ecd tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:43.012529 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-68ef0d8a-7526-4422-b70e-2ecbcbb67ecd tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '41c846c739824243b73116269e92afdc'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:43.016069 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-68ef0d8a-7526-4422-b70e-2ecbcbb67ecd tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '41c846c739824243b73116269e92afdc'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:43.086276 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ff70af-b428-46b8-b7fd-0544d59681a0 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:43.163310 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-68ef0d8a-7526-4422-b70e-2ecbcbb67ecd tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '41c846c739824243b73116269e92afdc'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:43.164171 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-68ef0d8a-7526-4422-b70e-2ecbcbb67ecd tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '41c846c739824243b73116269e92afdc'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:43.168350 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1838/3703] 10.222.0.52 () {60 vars in 1248 bytes} [Sat May 14 21:22:42 2022] PATCH /identity/v3/domains/41c846c739824243b73116269e92afdc => generated 276 bytes in 437 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:22:43.173024 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ef0d8a-7526-4422-b70e-2ecbcbb67ecd tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:43.174558 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-68ef0d8a-7526-4422-b70e-2ecbcbb67ecd tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:22:43.202625 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedfc7bb-9772-40e7-8735-ae59d6f5b21f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:43.203507 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedfc7bb-9772-40e7-8735-ae59d6f5b21f service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:43.203834 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedfc7bb-9772-40e7-8735-ae59d6f5b21f service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:43.204135 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedfc7bb-9772-40e7-8735-ae59d6f5b21f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:43.206500 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-bedfc7bb-9772-40e7-8735-ae59d6f5b21f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:22:43.310875 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ef0d8a-7526-4422-b70e-2ecbcbb67ecd tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:43.317635 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedfc7bb-9772-40e7-8735-ae59d6f5b21f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:43.317798 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec48ce93-da80-4510-95d4-4593d1ab362e tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9df4c1d6fab345a6b30cf4a0985fc7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c4851f5d89d4f69861ef9637667323b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:43.319412 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedfc7bb-9772-40e7-8735-ae59d6f5b21f service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:43.319745 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec48ce93-da80-4510-95d4-4593d1ab362e tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:43.320260 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec48ce93-da80-4510-95d4-4593d1ab362e tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:43.320739 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec48ce93-da80-4510-95d4-4593d1ab362e tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] PATH_INFO: `/v3/domains/41c846c739824243b73116269e92afdc` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:43.335115 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec48ce93-da80-4510-95d4-4593d1ab362e tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=41c846c739824243b73116269e92afdc)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:43.335650 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1866/3704] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:22:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:22:43.336085 ncdv-master-1 devstack@keystone.service[91107]: WARNING py.warnings [None req-ec48ce93-da80-4510-95d4-4593d1ab362e tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:22:43.336085 ncdv-master-1 devstack@keystone.service[91107]: warnings.warn(msg) May 14 21:22:43.336085 ncdv-master-1 devstack@keystone.service[91107]: May 14 21:22:43.337188 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec48ce93-da80-4510-95d4-4593d1ab362e tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:43.365105 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ec48ce93-da80-4510-95d4-4593d1ab362e tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '41c846c739824243b73116269e92afdc'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:43.380917 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ec48ce93-da80-4510-95d4-4593d1ab362e tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '41c846c739824243b73116269e92afdc'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:43.504632 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ec48ce93-da80-4510-95d4-4593d1ab362e tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41c846c739824243b73116269e92afdc', 'request_id': 'req-ec48ce93-da80-4510-95d4-4593d1ab362e'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:43.512370 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ec48ce93-da80-4510-95d4-4593d1ab362e tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41c846c739824243b73116269e92afdc', 'request_id': 'req-ec48ce93-da80-4510-95d4-4593d1ab362e'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:43.524381 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ec48ce93-da80-4510-95d4-4593d1ab362e tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41c846c739824243b73116269e92afdc', 'request_id': 'req-ec48ce93-da80-4510-95d4-4593d1ab362e'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:43.615298 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ec48ce93-da80-4510-95d4-4593d1ab362e tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] The token cache is being invalidate because project 41c846c739824243b73116269e92afdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:22:43.615939 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ec48ce93-da80-4510-95d4-4593d1ab362e tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:43.616532 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ec48ce93-da80-4510-95d4-4593d1ab362e tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:43.628347 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ec48ce93-da80-4510-95d4-4593d1ab362e tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '41c846c739824243b73116269e92afdc', 'request_id': 'req-ec48ce93-da80-4510-95d4-4593d1ab362e'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:43.629026 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ec48ce93-da80-4510-95d4-4593d1ab362e tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '41c846c739824243b73116269e92afdc', 'request_id': 'req-ec48ce93-da80-4510-95d4-4593d1ab362e'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:43.632549 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ec48ce93-da80-4510-95d4-4593d1ab362e tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '41c846c739824243b73116269e92afdc', 'request_id': 'req-ec48ce93-da80-4510-95d4-4593d1ab362e'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:43.640667 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1839/3705] 10.222.0.52 () {58 vars in 1229 bytes} [Sat May 14 21:22:43 2022] DELETE /identity/v3/domains/41c846c739824243b73116269e92afdc => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:22:43.645797 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedfc7bb-9772-40e7-8735-ae59d6f5b21f service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:43.671321 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedfc7bb-9772-40e7-8735-ae59d6f5b21f service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:43.748862 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7df514-ee5d-480c-99ee-047cec7ad487 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9df4c1d6fab345a6b30cf4a0985fc7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c4851f5d89d4f69861ef9637667323b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:43.749444 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7df514-ee5d-480c-99ee-047cec7ad487 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:43.750330 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7df514-ee5d-480c-99ee-047cec7ad487 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:43.750516 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7df514-ee5d-480c-99ee-047cec7ad487 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:43.751261 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7df514-ee5d-480c-99ee-047cec7ad487 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:43.753220 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7df514-ee5d-480c-99ee-047cec7ad487 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:43.956019 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1867/3706] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:22:43 2022] POST /identity/v3/projects => generated 378 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:22:43.960344 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec48ce93-da80-4510-95d4-4593d1ab362e tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:43.963333 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-ec48ce93-da80-4510-95d4-4593d1ab362e tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:22:43.982122 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec48ce93-da80-4510-95d4-4593d1ab362e tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:44.052509 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb83cb2-522e-4194-b5f3-975611de9079 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9df4c1d6fab345a6b30cf4a0985fc7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c4851f5d89d4f69861ef9637667323b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:44.053564 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb83cb2-522e-4194-b5f3-975611de9079 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:44.054107 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb83cb2-522e-4194-b5f3-975611de9079 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:44.055357 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb83cb2-522e-4194-b5f3-975611de9079 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] PATH_INFO: `/v3/projects/410f68c06edf478da3cc944f5a05e98d` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:44.056131 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb83cb2-522e-4194-b5f3-975611de9079 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorizing `identity:get_project(project_id=410f68c06edf478da3cc944f5a05e98d)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:44.058601 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb83cb2-522e-4194-b5f3-975611de9079 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:44.061100 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1840/3707] 10.222.0.52 () {58 vars in 1229 bytes} [Sat May 14 21:22:43 2022] GET /identity/v3/projects/410f68c06edf478da3cc944f5a05e98d => generated 378 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:22:44.065287 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7df514-ee5d-480c-99ee-047cec7ad487 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:44.077727 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7df514-ee5d-480c-99ee-047cec7ad487 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:44.086675 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d334323f-aa3e-4aa4-8435-4daab92125bb tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9df4c1d6fab345a6b30cf4a0985fc7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c4851f5d89d4f69861ef9637667323b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:44.087548 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d334323f-aa3e-4aa4-8435-4daab92125bb tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:44.087939 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d334323f-aa3e-4aa4-8435-4daab92125bb tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:44.088527 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d334323f-aa3e-4aa4-8435-4daab92125bb tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:44.090289 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d334323f-aa3e-4aa4-8435-4daab92125bb tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:44.092914 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d334323f-aa3e-4aa4-8435-4daab92125bb tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:44.123210 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1868/3708] 10.222.0.52 () {58 vars in 1130 bytes} [Sat May 14 21:22:44 2022] GET /identity/v3/projects => generated 6988 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:22:44.127918 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb83cb2-522e-4194-b5f3-975611de9079 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:44.138529 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb83cb2-522e-4194-b5f3-975611de9079 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:44.144127 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae1a5ef-0f2e-41e5-b2d8-25207a334f02 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9df4c1d6fab345a6b30cf4a0985fc7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c4851f5d89d4f69861ef9637667323b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:44.145034 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae1a5ef-0f2e-41e5-b2d8-25207a334f02 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:44.145320 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae1a5ef-0f2e-41e5-b2d8-25207a334f02 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:44.145655 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae1a5ef-0f2e-41e5-b2d8-25207a334f02 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] PATH_INFO: `/v3/projects/410f68c06edf478da3cc944f5a05e98d` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:44.146964 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae1a5ef-0f2e-41e5-b2d8-25207a334f02 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorizing `identity:delete_project(project_id=410f68c06edf478da3cc944f5a05e98d)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:44.148962 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae1a5ef-0f2e-41e5-b2d8-25207a334f02 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:44.293627 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-5ae1a5ef-0f2e-41e5-b2d8-25207a334f02 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '410f68c06edf478da3cc944f5a05e98d', 'request_id': 'req-5ae1a5ef-0f2e-41e5-b2d8-25207a334f02'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:44.307520 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-5ae1a5ef-0f2e-41e5-b2d8-25207a334f02 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '410f68c06edf478da3cc944f5a05e98d', 'request_id': 'req-5ae1a5ef-0f2e-41e5-b2d8-25207a334f02'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:44.315121 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-5ae1a5ef-0f2e-41e5-b2d8-25207a334f02 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '410f68c06edf478da3cc944f5a05e98d', 'request_id': 'req-5ae1a5ef-0f2e-41e5-b2d8-25207a334f02'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:44.471713 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-5ae1a5ef-0f2e-41e5-b2d8-25207a334f02 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] The token cache is being invalidate because project 410f68c06edf478da3cc944f5a05e98d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:22:44.472088 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-5ae1a5ef-0f2e-41e5-b2d8-25207a334f02 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:44.472904 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-5ae1a5ef-0f2e-41e5-b2d8-25207a334f02 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:44.480000 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1841/3709] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:22:44 2022] DELETE /identity/v3/projects/410f68c06edf478da3cc944f5a05e98d => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:22:44.481390 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d334323f-aa3e-4aa4-8435-4daab92125bb tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:44.483444 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d334323f-aa3e-4aa4-8435-4daab92125bb tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:22:44.498677 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d334323f-aa3e-4aa4-8435-4daab92125bb tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:44.574484 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ea997-b637-4830-8543-75c3ecadb521 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9df4c1d6fab345a6b30cf4a0985fc7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c4851f5d89d4f69861ef9637667323b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:44.575402 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ea997-b637-4830-8543-75c3ecadb521 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:44.575927 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ea997-b637-4830-8543-75c3ecadb521 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:44.576330 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ea997-b637-4830-8543-75c3ecadb521 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:44.578082 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9ea997-b637-4830-8543-75c3ecadb521 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:44.580656 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9ea997-b637-4830-8543-75c3ecadb521 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:44.946593 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1869/3710] 10.222.0.52 () {60 vars in 1151 bytes} [Sat May 14 21:22:44 2022] POST /identity/v3/projects => generated 348 bytes in 465 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:22:44.951357 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae1a5ef-0f2e-41e5-b2d8-25207a334f02 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:44.962722 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae1a5ef-0f2e-41e5-b2d8-25207a334f02 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:45.048384 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e27c62d-c1d4-4ac4-be72-c60868dc1665 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9df4c1d6fab345a6b30cf4a0985fc7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c4851f5d89d4f69861ef9637667323b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:45.049468 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27c62d-c1d4-4ac4-be72-c60868dc1665 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:45.049823 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27c62d-c1d4-4ac4-be72-c60868dc1665 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:45.050249 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27c62d-c1d4-4ac4-be72-c60868dc1665 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] PATH_INFO: `/v3/projects/a3e5ffa73d474d23829fe8b4410166f9` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:45.051692 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e27c62d-c1d4-4ac4-be72-c60868dc1665 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorizing `identity:update_project(project_id=a3e5ffa73d474d23829fe8b4410166f9)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:45.054832 ncdv-master-1 devstack@keystone.service[91107]: WARNING py.warnings [None req-2e27c62d-c1d4-4ac4-be72-c60868dc1665 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 14 21:22:45.054832 ncdv-master-1 devstack@keystone.service[91107]: warnings.warn(msg) May 14 21:22:45.054832 ncdv-master-1 devstack@keystone.service[91107]: May 14 21:22:45.054832 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e27c62d-c1d4-4ac4-be72-c60868dc1665 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:45.211790 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1842/3711] 10.222.0.52 () {60 vars in 1251 bytes} [Sat May 14 21:22:44 2022] PATCH /identity/v3/projects/a3e5ffa73d474d23829fe8b4410166f9 => generated 361 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:22:45.213326 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ea997-b637-4830-8543-75c3ecadb521 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:45.229219 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ea997-b637-4830-8543-75c3ecadb521 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:45.237595 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e5f97-1a1e-46f0-be2d-3b4080007c23 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9df4c1d6fab345a6b30cf4a0985fc7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c4851f5d89d4f69861ef9637667323b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:45.238933 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e5f97-1a1e-46f0-be2d-3b4080007c23 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:45.239382 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e5f97-1a1e-46f0-be2d-3b4080007c23 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:45.239851 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e5f97-1a1e-46f0-be2d-3b4080007c23 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] PATH_INFO: `/v3/projects/a3e5ffa73d474d23829fe8b4410166f9` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:45.254005 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347e5f97-1a1e-46f0-be2d-3b4080007c23 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorizing `identity:get_project(project_id=a3e5ffa73d474d23829fe8b4410166f9)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:45.256573 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347e5f97-1a1e-46f0-be2d-3b4080007c23 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:45.259533 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1870/3712] 10.222.0.52 () {58 vars in 1229 bytes} [Sat May 14 21:22:45 2022] GET /identity/v3/projects/a3e5ffa73d474d23829fe8b4410166f9 => generated 348 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:22:45.262952 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e27c62d-c1d4-4ac4-be72-c60868dc1665 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:45.276438 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e27c62d-c1d4-4ac4-be72-c60868dc1665 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:45.284104 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d5f79-b954-4a37-a37f-008a64a6f4fb tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9df4c1d6fab345a6b30cf4a0985fc7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c4851f5d89d4f69861ef9637667323b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:45.285058 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d5f79-b954-4a37-a37f-008a64a6f4fb tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:45.285534 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d5f79-b954-4a37-a37f-008a64a6f4fb tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:45.285825 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d5f79-b954-4a37-a37f-008a64a6f4fb tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] PATH_INFO: `/v3/projects/a3e5ffa73d474d23829fe8b4410166f9` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:45.287056 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d5f79-b954-4a37-a37f-008a64a6f4fb tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a3e5ffa73d474d23829fe8b4410166f9)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:45.289132 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d5f79-b954-4a37-a37f-008a64a6f4fb tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:45.478230 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-2a9d5f79-b954-4a37-a37f-008a64a6f4fb tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3e5ffa73d474d23829fe8b4410166f9', 'request_id': 'req-2a9d5f79-b954-4a37-a37f-008a64a6f4fb'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:45.483999 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-2a9d5f79-b954-4a37-a37f-008a64a6f4fb tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3e5ffa73d474d23829fe8b4410166f9', 'request_id': 'req-2a9d5f79-b954-4a37-a37f-008a64a6f4fb'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:45.490630 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-2a9d5f79-b954-4a37-a37f-008a64a6f4fb tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3e5ffa73d474d23829fe8b4410166f9', 'request_id': 'req-2a9d5f79-b954-4a37-a37f-008a64a6f4fb'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:45.604207 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-2a9d5f79-b954-4a37-a37f-008a64a6f4fb tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] The token cache is being invalidate because project a3e5ffa73d474d23829fe8b4410166f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:22:45.604599 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-2a9d5f79-b954-4a37-a37f-008a64a6f4fb tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:45.611301 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-2a9d5f79-b954-4a37-a37f-008a64a6f4fb tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:45.613553 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1843/3713] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:22:45 2022] DELETE /identity/v3/projects/a3e5ffa73d474d23829fe8b4410166f9 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:22:45.623452 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e5f97-1a1e-46f0-be2d-3b4080007c23 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:45.626585 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-347e5f97-1a1e-46f0-be2d-3b4080007c23 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:22:45.669339 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e5f97-1a1e-46f0-be2d-3b4080007c23 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:45.813369 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be288a3b-391c-4a2f-a90c-faeb6429ffc1 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9df4c1d6fab345a6b30cf4a0985fc7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c4851f5d89d4f69861ef9637667323b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:45.814052 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be288a3b-391c-4a2f-a90c-faeb6429ffc1 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:45.814340 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be288a3b-391c-4a2f-a90c-faeb6429ffc1 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:45.814620 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be288a3b-391c-4a2f-a90c-faeb6429ffc1 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:45.815360 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be288a3b-391c-4a2f-a90c-faeb6429ffc1 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:45.817347 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be288a3b-391c-4a2f-a90c-faeb6429ffc1 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:45.960268 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1871/3714] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:22:45 2022] POST /identity/v3/projects => generated 361 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:22:45.964507 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d5f79-b954-4a37-a37f-008a64a6f4fb tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:45.976790 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d5f79-b954-4a37-a37f-008a64a6f4fb tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:46.085669 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa56ab-3704-4ca7-9d8f-2f73be4108f9 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9df4c1d6fab345a6b30cf4a0985fc7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c4851f5d89d4f69861ef9637667323b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:46.086541 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa56ab-3704-4ca7-9d8f-2f73be4108f9 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:46.086826 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa56ab-3704-4ca7-9d8f-2f73be4108f9 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:46.087104 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa56ab-3704-4ca7-9d8f-2f73be4108f9 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] PATH_INFO: `/v3/projects/76465916e1a040db9bad1378c2d15c1b` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:46.088428 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaa56ab-3704-4ca7-9d8f-2f73be4108f9 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorizing `identity:update_project(project_id=76465916e1a040db9bad1378c2d15c1b)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:46.091609 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaa56ab-3704-4ca7-9d8f-2f73be4108f9 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:46.259728 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1844/3715] 10.222.0.52 () {60 vars in 1251 bytes} [Sat May 14 21:22:45 2022] PATCH /identity/v3/projects/76465916e1a040db9bad1378c2d15c1b => generated 373 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:22:46.259925 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be288a3b-391c-4a2f-a90c-faeb6429ffc1 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:46.274715 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be288a3b-391c-4a2f-a90c-faeb6429ffc1 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:46.285450 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3857fb52-0302-4426-af0b-21a5445c66a0 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9df4c1d6fab345a6b30cf4a0985fc7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c4851f5d89d4f69861ef9637667323b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:46.286871 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3857fb52-0302-4426-af0b-21a5445c66a0 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:46.287383 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3857fb52-0302-4426-af0b-21a5445c66a0 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:46.288071 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3857fb52-0302-4426-af0b-21a5445c66a0 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] PATH_INFO: `/v3/projects/76465916e1a040db9bad1378c2d15c1b` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:46.318347 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3857fb52-0302-4426-af0b-21a5445c66a0 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorizing `identity:get_project(project_id=76465916e1a040db9bad1378c2d15c1b)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:46.320798 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3857fb52-0302-4426-af0b-21a5445c66a0 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:46.322476 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1872/3716] 10.222.0.52 () {58 vars in 1229 bytes} [Sat May 14 21:22:46 2022] GET /identity/v3/projects/76465916e1a040db9bad1378c2d15c1b => generated 360 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:22:46.327438 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa56ab-3704-4ca7-9d8f-2f73be4108f9 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:46.343428 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa56ab-3704-4ca7-9d8f-2f73be4108f9 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:46.351548 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b963b07-d329-4e9b-8aae-216d0b370dc7 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9df4c1d6fab345a6b30cf4a0985fc7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c4851f5d89d4f69861ef9637667323b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:46.353166 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b963b07-d329-4e9b-8aae-216d0b370dc7 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:46.353166 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b963b07-d329-4e9b-8aae-216d0b370dc7 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:46.353166 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b963b07-d329-4e9b-8aae-216d0b370dc7 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] PATH_INFO: `/v3/projects/76465916e1a040db9bad1378c2d15c1b` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:46.354817 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b963b07-d329-4e9b-8aae-216d0b370dc7 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorizing `identity:delete_project(project_id=76465916e1a040db9bad1378c2d15c1b)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:46.357540 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b963b07-d329-4e9b-8aae-216d0b370dc7 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:46.560117 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-5b963b07-d329-4e9b-8aae-216d0b370dc7 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76465916e1a040db9bad1378c2d15c1b', 'request_id': 'req-5b963b07-d329-4e9b-8aae-216d0b370dc7'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:46.569532 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-5b963b07-d329-4e9b-8aae-216d0b370dc7 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76465916e1a040db9bad1378c2d15c1b', 'request_id': 'req-5b963b07-d329-4e9b-8aae-216d0b370dc7'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:46.582433 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-5b963b07-d329-4e9b-8aae-216d0b370dc7 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76465916e1a040db9bad1378c2d15c1b', 'request_id': 'req-5b963b07-d329-4e9b-8aae-216d0b370dc7'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:46.691556 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-5b963b07-d329-4e9b-8aae-216d0b370dc7 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] The token cache is being invalidate because project 76465916e1a040db9bad1378c2d15c1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:22:46.692175 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-5b963b07-d329-4e9b-8aae-216d0b370dc7 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:46.693413 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-5b963b07-d329-4e9b-8aae-216d0b370dc7 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:46.698700 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1845/3717] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:22:46 2022] DELETE /identity/v3/projects/76465916e1a040db9bad1378c2d15c1b => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:22:46.703744 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3857fb52-0302-4426-af0b-21a5445c66a0 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:46.707050 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-3857fb52-0302-4426-af0b-21a5445c66a0 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:22:46.729301 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3857fb52-0302-4426-af0b-21a5445c66a0 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:46.802121 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f388e7f-8782-4468-8eee-8ac35c815aed tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9df4c1d6fab345a6b30cf4a0985fc7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c4851f5d89d4f69861ef9637667323b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:46.802858 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f388e7f-8782-4468-8eee-8ac35c815aed tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:46.803234 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f388e7f-8782-4468-8eee-8ac35c815aed tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:46.803580 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f388e7f-8782-4468-8eee-8ac35c815aed tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:46.804283 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f388e7f-8782-4468-8eee-8ac35c815aed tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:46.806400 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f388e7f-8782-4468-8eee-8ac35c815aed tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:47.046029 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1873/3718] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:22:46 2022] POST /identity/v3/projects => generated 353 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:22:47.052825 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b963b07-d329-4e9b-8aae-216d0b370dc7 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:47.104135 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b963b07-d329-4e9b-8aae-216d0b370dc7 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:47.228743 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4166e8-710d-4713-95a5-9b57ddbc7450 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9df4c1d6fab345a6b30cf4a0985fc7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c4851f5d89d4f69861ef9637667323b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:47.229998 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4166e8-710d-4713-95a5-9b57ddbc7450 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:47.232864 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4166e8-710d-4713-95a5-9b57ddbc7450 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:47.232864 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4166e8-710d-4713-95a5-9b57ddbc7450 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] PATH_INFO: `/v3/projects/2d2577b899ce4fb39e171e2abc466fd3` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:47.233838 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4166e8-710d-4713-95a5-9b57ddbc7450 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorizing `identity:update_project(project_id=2d2577b899ce4fb39e171e2abc466fd3)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:47.236066 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4166e8-710d-4713-95a5-9b57ddbc7450 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:47.383400 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1846/3719] 10.222.0.52 () {60 vars in 1251 bytes} [Sat May 14 21:22:47 2022] PATCH /identity/v3/projects/2d2577b899ce4fb39e171e2abc466fd3 => generated 368 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:22:47.388138 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f388e7f-8782-4468-8eee-8ac35c815aed tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:47.402355 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f388e7f-8782-4468-8eee-8ac35c815aed tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:47.408662 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42d7ec9-de84-497c-b791-049416833ef5 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9df4c1d6fab345a6b30cf4a0985fc7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c4851f5d89d4f69861ef9637667323b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:47.410004 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d7ec9-de84-497c-b791-049416833ef5 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:47.410441 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d7ec9-de84-497c-b791-049416833ef5 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:47.411458 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d7ec9-de84-497c-b791-049416833ef5 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] PATH_INFO: `/v3/projects/2d2577b899ce4fb39e171e2abc466fd3` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:47.450820 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42d7ec9-de84-497c-b791-049416833ef5 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorizing `identity:get_project(project_id=2d2577b899ce4fb39e171e2abc466fd3)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:47.456197 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42d7ec9-de84-497c-b791-049416833ef5 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:47.463987 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4166e8-710d-4713-95a5-9b57ddbc7450 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:47.466374 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1874/3720] 10.222.0.52 () {58 vars in 1229 bytes} [Sat May 14 21:22:47 2022] GET /identity/v3/projects/2d2577b899ce4fb39e171e2abc466fd3 => generated 355 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:22:47.486436 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4166e8-710d-4713-95a5-9b57ddbc7450 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:47.496212 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f663bc7-2d3c-4e27-a9d1-4194080a5409 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9df4c1d6fab345a6b30cf4a0985fc7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c4851f5d89d4f69861ef9637667323b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:47.497104 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f663bc7-2d3c-4e27-a9d1-4194080a5409 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:47.497392 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f663bc7-2d3c-4e27-a9d1-4194080a5409 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:47.497672 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f663bc7-2d3c-4e27-a9d1-4194080a5409 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] PATH_INFO: `/v3/projects/2d2577b899ce4fb39e171e2abc466fd3` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:47.499451 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f663bc7-2d3c-4e27-a9d1-4194080a5409 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2d2577b899ce4fb39e171e2abc466fd3)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:47.508465 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f663bc7-2d3c-4e27-a9d1-4194080a5409 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:47.709127 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3f663bc7-2d3c-4e27-a9d1-4194080a5409 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d2577b899ce4fb39e171e2abc466fd3', 'request_id': 'req-3f663bc7-2d3c-4e27-a9d1-4194080a5409'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:47.715726 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3f663bc7-2d3c-4e27-a9d1-4194080a5409 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d2577b899ce4fb39e171e2abc466fd3', 'request_id': 'req-3f663bc7-2d3c-4e27-a9d1-4194080a5409'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:47.727549 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3f663bc7-2d3c-4e27-a9d1-4194080a5409 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d2577b899ce4fb39e171e2abc466fd3', 'request_id': 'req-3f663bc7-2d3c-4e27-a9d1-4194080a5409'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:47.860301 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3f663bc7-2d3c-4e27-a9d1-4194080a5409 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] The token cache is being invalidate because project 2d2577b899ce4fb39e171e2abc466fd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:22:47.860700 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3f663bc7-2d3c-4e27-a9d1-4194080a5409 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:47.862952 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3f663bc7-2d3c-4e27-a9d1-4194080a5409 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:47.864785 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1847/3721] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:22:47 2022] DELETE /identity/v3/projects/2d2577b899ce4fb39e171e2abc466fd3 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:22:47.870114 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42d7ec9-de84-497c-b791-049416833ef5 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:47.872132 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-a42d7ec9-de84-497c-b791-049416833ef5 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:22:47.891635 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42d7ec9-de84-497c-b791-049416833ef5 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:48.024477 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b12cf0-c1e5-4008-b4d1-728257c7dfdb tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9df4c1d6fab345a6b30cf4a0985fc7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c4851f5d89d4f69861ef9637667323b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:48.025359 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b12cf0-c1e5-4008-b4d1-728257c7dfdb tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:48.025645 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b12cf0-c1e5-4008-b4d1-728257c7dfdb tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:48.025922 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b12cf0-c1e5-4008-b4d1-728257c7dfdb tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] PATH_INFO: `/v3/domains/41c846c739824243b73116269e92afdc` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:48.036987 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b12cf0-c1e5-4008-b4d1-728257c7dfdb tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 21:22:48.125004 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-26b12cf0-c1e5-4008-b4d1-728257c7dfdb tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Could not find domain: 41c846c739824243b73116269e92afdc.: keystone.exception.DomainNotFound: Could not find domain: 41c846c739824243b73116269e92afdc. May 14 21:22:48.125004 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:22:48.125004 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 14 21:22:48.125004 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 14 21:22:48.125004 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 21:22:48.125004 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 21:22:48.125004 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 21:22:48.125004 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 21:22:48.125004 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 41c846c739824243b73116269e92afdc. May 14 21:22:48.125004 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:22:48.125004 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 21:22:48.125004 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:22:48.125004 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:22:48.125004 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 21:22:48.125004 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 21:22:48.125004 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 21:22:48.126143 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 21:22:48.126143 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 21:22:48.126143 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 21:22:48.126143 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 21:22:48.126143 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 21:22:48.126143 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 21:22:48.126143 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 21:22:48.126143 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch May 14 21:22:48.126143 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') May 14 21:22:48.126143 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 21:22:48.126143 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 21:22:48.126143 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 21:22:48.126143 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 21:22:48.126143 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 21:22:48.126143 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 21:22:48.126143 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 21:22:48.127074 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 21:22:48.127074 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 21:22:48.127074 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 21:22:48.127074 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 21:22:48.127074 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 21:22:48.127074 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 21:22:48.127074 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 21:22:48.127074 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 21:22:48.127074 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 21:22:48.127074 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 21:22:48.127074 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 21:22:48.127074 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 21:22:48.127074 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 21:22:48.127074 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 14 21:22:48.127074 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 21:22:48.127074 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 41c846c739824243b73116269e92afdc. May 14 21:22:48.127074 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:22:48.128381 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1875/3722] 10.222.0.52 () {60 vars in 1248 bytes} [Sat May 14 21:22:47 2022] PATCH /identity/v3/domains/41c846c739824243b73116269e92afdc => generated 112 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 14 21:22:48.130497 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f663bc7-2d3c-4e27-a9d1-4194080a5409 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:48.153099 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f663bc7-2d3c-4e27-a9d1-4194080a5409 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:48.160676 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e6b9d6-0272-4d84-a1a3-57aeeff64365 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9df4c1d6fab345a6b30cf4a0985fc7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c4851f5d89d4f69861ef9637667323b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:48.164235 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e6b9d6-0272-4d84-a1a3-57aeeff64365 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:48.165737 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e6b9d6-0272-4d84-a1a3-57aeeff64365 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:48.166027 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e6b9d6-0272-4d84-a1a3-57aeeff64365 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] PATH_INFO: `/v3/domains/4d4ac859c4e14f4da911e3bd5bace077` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:48.192801 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e6b9d6-0272-4d84-a1a3-57aeeff64365 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 21:22:48.208531 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-b1e6b9d6-0272-4d84-a1a3-57aeeff64365 tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Could not find domain: 4d4ac859c4e14f4da911e3bd5bace077.: keystone.exception.DomainNotFound: Could not find domain: 4d4ac859c4e14f4da911e3bd5bace077. May 14 21:22:48.208531 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:22:48.208531 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 14 21:22:48.208531 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 14 21:22:48.208531 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 21:22:48.208531 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 21:22:48.208531 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 21:22:48.208531 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 21:22:48.208531 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 4d4ac859c4e14f4da911e3bd5bace077. May 14 21:22:48.208531 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:22:48.208531 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 21:22:48.208531 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:22:48.208531 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:22:48.208531 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 21:22:48.208531 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 21:22:48.208531 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 21:22:48.209608 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 21:22:48.209608 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 21:22:48.209608 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 21:22:48.209608 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 21:22:48.209608 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 21:22:48.209608 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 21:22:48.209608 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 21:22:48.209608 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch May 14 21:22:48.209608 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') May 14 21:22:48.209608 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 21:22:48.209608 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 21:22:48.209608 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 21:22:48.209608 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 21:22:48.209608 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 21:22:48.209608 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 21:22:48.209608 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 21:22:48.210480 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 21:22:48.210480 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 21:22:48.210480 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 21:22:48.210480 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 21:22:48.210480 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 21:22:48.210480 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 21:22:48.210480 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 21:22:48.210480 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 21:22:48.210480 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 21:22:48.210480 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 21:22:48.210480 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 21:22:48.210480 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 21:22:48.210480 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 21:22:48.210480 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 14 21:22:48.210480 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 21:22:48.210480 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 4d4ac859c4e14f4da911e3bd5bace077. May 14 21:22:48.210480 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:22:48.213574 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1848/3723] 10.222.0.52 () {60 vars in 1248 bytes} [Sat May 14 21:22:48 2022] PATCH /identity/v3/domains/4d4ac859c4e14f4da911e3bd5bace077 => generated 112 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 14 21:22:48.214960 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b12cf0-c1e5-4008-b4d1-728257c7dfdb tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:48.216851 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-26b12cf0-c1e5-4008-b4d1-728257c7dfdb tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:22:48.315467 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b12cf0-c1e5-4008-b4d1-728257c7dfdb tempest-ProjectsTestJSON-1694952953 tempest-ProjectsTestJSON-1694952953-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:48.320796 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90d2109-34cf-4f15-b5a8-9e2572d9ed49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:48.322071 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90d2109-34cf-4f15-b5a8-9e2572d9ed49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:48.322454 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90d2109-34cf-4f15-b5a8-9e2572d9ed49 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:48.322732 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90d2109-34cf-4f15-b5a8-9e2572d9ed49 admin admin] PATH_INFO: `/v3/users/fe2f1b35348e4cb198e6fa4bfcdf4470` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:48.324215 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90d2109-34cf-4f15-b5a8-9e2572d9ed49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe2f1b35348e4cb198e6fa4bfcdf4470)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:48.326482 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90d2109-34cf-4f15-b5a8-9e2572d9ed49 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:48.619713 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b90d2109-34cf-4f15-b5a8-9e2572d9ed49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe2f1b35348e4cb198e6fa4bfcdf4470'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:48.675752 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b90d2109-34cf-4f15-b5a8-9e2572d9ed49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe2f1b35348e4cb198e6fa4bfcdf4470'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:48.695008 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b90d2109-34cf-4f15-b5a8-9e2572d9ed49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe2f1b35348e4cb198e6fa4bfcdf4470'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:48.837120 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b90d2109-34cf-4f15-b5a8-9e2572d9ed49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe2f1b35348e4cb198e6fa4bfcdf4470'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:48.841851 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b90d2109-34cf-4f15-b5a8-9e2572d9ed49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe2f1b35348e4cb198e6fa4bfcdf4470'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:48.855335 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1876/3724] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:22:48 2022] DELETE /identity/v3/users/fe2f1b35348e4cb198e6fa4bfcdf4470 => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:22:48.860900 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e13d57-119c-44da-a715-46670608bd6d None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:48.861239 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e13d57-119c-44da-a715-46670608bd6d None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:48.861518 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e13d57-119c-44da-a715-46670608bd6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:48.911671 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-00e13d57-119c-44da-a715-46670608bd6d None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:22:48.912834 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-00e13d57-119c-44da-a715-46670608bd6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:22:49.034994 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1849/3725] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:22:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:22:49.101732 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90d2109-34cf-4f15-b5a8-9e2572d9ed49 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:49.103392 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b90d2109-34cf-4f15-b5a8-9e2572d9ed49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:22:49.259650 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90d2109-34cf-4f15-b5a8-9e2572d9ed49 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:49.264956 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004dc953-05c0-414a-9147-0d457fcb2647 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:49.265975 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004dc953-05c0-414a-9147-0d457fcb2647 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:49.266417 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004dc953-05c0-414a-9147-0d457fcb2647 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:49.266968 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004dc953-05c0-414a-9147-0d457fcb2647 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:49.278198 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004dc953-05c0-414a-9147-0d457fcb2647 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:49.281216 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004dc953-05c0-414a-9147-0d457fcb2647 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:49.298082 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1877/3726] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:22:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:22:51.266764 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e13d57-119c-44da-a715-46670608bd6d None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:51.268260 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-00e13d57-119c-44da-a715-46670608bd6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:22:51.287582 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e13d57-119c-44da-a715-46670608bd6d None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:51.295636 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a07e5e-f70d-470b-a395-4435c842853e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:51.296501 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a07e5e-f70d-470b-a395-4435c842853e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:51.296805 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a07e5e-f70d-470b-a395-4435c842853e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:51.297231 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a07e5e-f70d-470b-a395-4435c842853e admin admin] PATH_INFO: `/v3/projects/bbfb28dce919435ab430c5185e3023b8` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:51.298793 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a07e5e-f70d-470b-a395-4435c842853e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbfb28dce919435ab430c5185e3023b8)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:51.301351 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a07e5e-f70d-470b-a395-4435c842853e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:51.503923 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-12a07e5e-f70d-470b-a395-4435c842853e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbfb28dce919435ab430c5185e3023b8', 'request_id': 'req-12a07e5e-f70d-470b-a395-4435c842853e'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:51.503923 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-12a07e5e-f70d-470b-a395-4435c842853e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbfb28dce919435ab430c5185e3023b8', 'request_id': 'req-12a07e5e-f70d-470b-a395-4435c842853e'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:51.503923 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-12a07e5e-f70d-470b-a395-4435c842853e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbfb28dce919435ab430c5185e3023b8', 'request_id': 'req-12a07e5e-f70d-470b-a395-4435c842853e'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:51.581611 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-12a07e5e-f70d-470b-a395-4435c842853e admin admin] The token cache is being invalidate because project bbfb28dce919435ab430c5185e3023b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:22:51.582386 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-12a07e5e-f70d-470b-a395-4435c842853e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:51.586075 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-12a07e5e-f70d-470b-a395-4435c842853e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:51.592105 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004dc953-05c0-414a-9147-0d457fcb2647 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:51.594145 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1850/3727] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:22:51 2022] DELETE /identity/v3/projects/bbfb28dce919435ab430c5185e3023b8 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:22:51.604427 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004dc953-05c0-414a-9147-0d457fcb2647 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:51.697260 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c292394-5463-43b4-8bd5-541b82ef846a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:51.697874 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c292394-5463-43b4-8bd5-541b82ef846a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:51.698279 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c292394-5463-43b4-8bd5-541b82ef846a admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:51.699172 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c292394-5463-43b4-8bd5-541b82ef846a admin admin] PATH_INFO: `/v3/users/9df4c1d6fab345a6b30cf4a0985fc7fb` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:51.704214 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c292394-5463-43b4-8bd5-541b82ef846a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9df4c1d6fab345a6b30cf4a0985fc7fb)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:51.707758 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c292394-5463-43b4-8bd5-541b82ef846a admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:52.044781 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-7c292394-5463-43b4-8bd5-541b82ef846a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9df4c1d6fab345a6b30cf4a0985fc7fb'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:52.062835 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-7c292394-5463-43b4-8bd5-541b82ef846a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9df4c1d6fab345a6b30cf4a0985fc7fb'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:52.077314 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-7c292394-5463-43b4-8bd5-541b82ef846a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9df4c1d6fab345a6b30cf4a0985fc7fb'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:52.207943 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-7c292394-5463-43b4-8bd5-541b82ef846a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9df4c1d6fab345a6b30cf4a0985fc7fb'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:52.209194 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-7c292394-5463-43b4-8bd5-541b82ef846a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9df4c1d6fab345a6b30cf4a0985fc7fb'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:52.218739 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1878/3728] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:22:51 2022] DELETE /identity/v3/users/9df4c1d6fab345a6b30cf4a0985fc7fb => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:22:52.888127 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36407500-708e-4547-9a90-7b3f0b09aad2 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:52.889066 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36407500-708e-4547-9a90-7b3f0b09aad2 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:52.890120 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36407500-708e-4547-9a90-7b3f0b09aad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:52.913846 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-36407500-708e-4547-9a90-7b3f0b09aad2 None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:22:52.915657 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-36407500-708e-4547-9a90-7b3f0b09aad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:22:52.994110 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1851/3729] 10.222.0.52 () {58 vars in 967 bytes} [Sat May 14 21:22:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:22:53.025918 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c292394-5463-43b4-8bd5-541b82ef846a admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:53.027464 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-7c292394-5463-43b4-8bd5-541b82ef846a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:22:53.185505 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c292394-5463-43b4-8bd5-541b82ef846a admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:53.192510 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88444c9-ecbc-424e-9ee9-855beefba056 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:53.193454 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88444c9-ecbc-424e-9ee9-855beefba056 service swift] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:53.193891 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88444c9-ecbc-424e-9ee9-855beefba056 service swift] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:53.194339 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88444c9-ecbc-424e-9ee9-855beefba056 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:53.212679 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88444c9-ecbc-424e-9ee9-855beefba056 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:53.214502 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88444c9-ecbc-424e-9ee9-855beefba056 service swift] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:53.230862 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1879/3730] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 21:22:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 21:22:53.818902 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36407500-708e-4547-9a90-7b3f0b09aad2 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:53.820833 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-36407500-708e-4547-9a90-7b3f0b09aad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:22:53.917679 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36407500-708e-4547-9a90-7b3f0b09aad2 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:53.922467 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d99ba1a-c1bf-411a-923d-b2b6fdc5fded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:53.923407 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99ba1a-c1bf-411a-923d-b2b6fdc5fded admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:53.923814 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99ba1a-c1bf-411a-923d-b2b6fdc5fded admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:53.924167 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99ba1a-c1bf-411a-923d-b2b6fdc5fded admin admin] PATH_INFO: `/v3/projects/8c4851f5d89d4f69861ef9637667323b` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:53.925554 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d99ba1a-c1bf-411a-923d-b2b6fdc5fded admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c4851f5d89d4f69861ef9637667323b)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:53.927861 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d99ba1a-c1bf-411a-923d-b2b6fdc5fded admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:54.061763 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-5d99ba1a-c1bf-411a-923d-b2b6fdc5fded admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c4851f5d89d4f69861ef9637667323b', 'request_id': 'req-5d99ba1a-c1bf-411a-923d-b2b6fdc5fded'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:54.069675 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-5d99ba1a-c1bf-411a-923d-b2b6fdc5fded admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c4851f5d89d4f69861ef9637667323b', 'request_id': 'req-5d99ba1a-c1bf-411a-923d-b2b6fdc5fded'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:54.080288 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-5d99ba1a-c1bf-411a-923d-b2b6fdc5fded admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c4851f5d89d4f69861ef9637667323b', 'request_id': 'req-5d99ba1a-c1bf-411a-923d-b2b6fdc5fded'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:54.184277 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-5d99ba1a-c1bf-411a-923d-b2b6fdc5fded admin admin] The token cache is being invalidate because project 8c4851f5d89d4f69861ef9637667323b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:22:54.184747 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-5d99ba1a-c1bf-411a-923d-b2b6fdc5fded admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:54.185609 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-5d99ba1a-c1bf-411a-923d-b2b6fdc5fded admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:54.190407 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1852/3731] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:22:53 2022] DELETE /identity/v3/projects/8c4851f5d89d4f69861ef9637667323b => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:22:54.195301 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a51f56-f5df-4ae9-9afb-799b3c812836 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:54.195817 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a51f56-f5df-4ae9-9afb-799b3c812836 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:54.195909 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a51f56-f5df-4ae9-9afb-799b3c812836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:54.240743 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-37a51f56-f5df-4ae9-9afb-799b3c812836 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:22:54.241990 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-37a51f56-f5df-4ae9-9afb-799b3c812836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:22:54.343591 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1880/3732] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:22:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:22:54.351961 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5fdbaa-d292-4cb7-a1c4-e501b7cc7f37 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:54.354131 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5fdbaa-d292-4cb7-a1c4-e501b7cc7f37 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:54.364845 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5fdbaa-d292-4cb7-a1c4-e501b7cc7f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:54.408130 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-7d5fdbaa-d292-4cb7-a1c4-e501b7cc7f37 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:22:54.413064 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-7d5fdbaa-d292-4cb7-a1c4-e501b7cc7f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:22:54.439658 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1853/3733] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:22:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:22:54.443601 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a51f56-f5df-4ae9-9afb-799b3c812836 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:54.458670 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a51f56-f5df-4ae9-9afb-799b3c812836 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:54.469274 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e55b242-04ba-4754-831f-daf079c1486d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:54.469972 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e55b242-04ba-4754-831f-daf079c1486d admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:54.470255 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e55b242-04ba-4754-831f-daf079c1486d admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:54.470531 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e55b242-04ba-4754-831f-daf079c1486d admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:54.471267 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e55b242-04ba-4754-831f-daf079c1486d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:22:54.471599 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e55b242-04ba-4754-831f-daf079c1486d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:54.473221 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e55b242-04ba-4754-831f-daf079c1486d admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:54.506413 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1881/3734] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:22:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:22:54.508860 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5fdbaa-d292-4cb7-a1c4-e501b7cc7f37 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:54.522990 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5fdbaa-d292-4cb7-a1c4-e501b7cc7f37 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:54.541102 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04632eed-b958-4be2-9b58-184a3da58986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:54.542045 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04632eed-b958-4be2-9b58-184a3da58986 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:54.542326 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04632eed-b958-4be2-9b58-184a3da58986 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:54.542600 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04632eed-b958-4be2-9b58-184a3da58986 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:54.543388 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04632eed-b958-4be2-9b58-184a3da58986 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:54.546191 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04632eed-b958-4be2-9b58-184a3da58986 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:54.662401 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1854/3735] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:22:54 2022] POST /identity/v3/projects => generated 363 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:22:54.667957 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e55b242-04ba-4754-831f-daf079c1486d admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:54.689724 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e55b242-04ba-4754-831f-daf079c1486d admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:54.840329 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c3d5ff-7fac-421c-93be-b701ae44bd43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:54.841405 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c3d5ff-7fac-421c-93be-b701ae44bd43 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:54.841405 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c3d5ff-7fac-421c-93be-b701ae44bd43 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:54.841931 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c3d5ff-7fac-421c-93be-b701ae44bd43 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:54.843875 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c3d5ff-7fac-421c-93be-b701ae44bd43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:54.846210 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c3d5ff-7fac-421c-93be-b701ae44bd43 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:54.980775 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1882/3736] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:22:54 2022] POST /identity/v3/users => generated 282 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:22:54.982012 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04632eed-b958-4be2-9b58-184a3da58986 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:54.993306 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04632eed-b958-4be2-9b58-184a3da58986 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:55.002391 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac5a72-2ac8-4f05-812a-57f710e53be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:55.003296 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac5a72-2ac8-4f05-812a-57f710e53be3 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:55.003880 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac5a72-2ac8-4f05-812a-57f710e53be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:55.004533 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac5a72-2ac8-4f05-812a-57f710e53be3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:55.005323 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ac5a72-2ac8-4f05-812a-57f710e53be3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:55.007180 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ac5a72-2ac8-4f05-812a-57f710e53be3 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:55.020370 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1855/3737] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:22:54 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:22:55.024187 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c3d5ff-7fac-421c-93be-b701ae44bd43 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:55.039233 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c3d5ff-7fac-421c-93be-b701ae44bd43 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:55.049348 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217e44bc-a365-4eb2-b5be-67af036bffb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:55.050663 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e44bc-a365-4eb2-b5be-67af036bffb3 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:55.051038 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e44bc-a365-4eb2-b5be-67af036bffb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:55.051374 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e44bc-a365-4eb2-b5be-67af036bffb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:55.052204 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217e44bc-a365-4eb2-b5be-67af036bffb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:55.054667 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217e44bc-a365-4eb2-b5be-67af036bffb3 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:55.071982 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1883/3738] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:22:55 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:22:55.072724 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac5a72-2ac8-4f05-812a-57f710e53be3 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:55.084413 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac5a72-2ac8-4f05-812a-57f710e53be3 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:55.097344 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957a367d-2d8a-41eb-8684-3bc1c0b2fc74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:55.098372 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a367d-2d8a-41eb-8684-3bc1c0b2fc74 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:55.098735 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a367d-2d8a-41eb-8684-3bc1c0b2fc74 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:55.099084 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a367d-2d8a-41eb-8684-3bc1c0b2fc74 admin admin] PATH_INFO: `/v3/projects/a2e5c220abfa42d7aaef5da670fa01eb/users/4cbf1a872d1d4130a7f35d24aa2efa98/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:55.148382 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957a367d-2d8a-41eb-8684-3bc1c0b2fc74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2e5c220abfa42d7aaef5da670fa01eb, user_id=4cbf1a872d1d4130a7f35d24aa2efa98, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:55.151245 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957a367d-2d8a-41eb-8684-3bc1c0b2fc74 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:55.284345 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1856/3739] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:22:55 2022] PUT /identity/v3/projects/a2e5c220abfa42d7aaef5da670fa01eb/users/4cbf1a872d1d4130a7f35d24aa2efa98/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:22:55.298521 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf4e44-7109-4c9f-9114-b789606c061c None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:55.298521 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf4e44-7109-4c9f-9114-b789606c061c None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:55.298521 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf4e44-7109-4c9f-9114-b789606c061c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:55.305775 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957a367d-2d8a-41eb-8684-3bc1c0b2fc74 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:55.308222 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-957a367d-2d8a-41eb-8684-3bc1c0b2fc74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:22:55.348157 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-06bf4e44-7109-4c9f-9114-b789606c061c None None] MFA Rules not processed for user `4cbf1a872d1d4130a7f35d24aa2efa98`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:22:55.349731 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-06bf4e44-7109-4c9f-9114-b789606c061c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:22:55.456476 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1884/3740] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:22:55 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:22:55.466627 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bf4e44-7109-4c9f-9114-b789606c061c None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:55.512943 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957a367d-2d8a-41eb-8684-3bc1c0b2fc74 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:55.531924 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7897d3c-9878-42d2-a349-a1ced46aeb75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:55.532591 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7897d3c-9878-42d2-a349-a1ced46aeb75 service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:55.533064 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7897d3c-9878-42d2-a349-a1ced46aeb75 service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:55.533498 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7897d3c-9878-42d2-a349-a1ced46aeb75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:55.535598 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-a7897d3c-9878-42d2-a349-a1ced46aeb75 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:22:55.593643 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bf4e44-7109-4c9f-9114-b789606c061c None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:55.607622 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8458b958-5477-4ef5-8838-6ce71fc80238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:55.608968 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458b958-5477-4ef5-8838-6ce71fc80238 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:55.609251 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458b958-5477-4ef5-8838-6ce71fc80238 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:55.609526 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458b958-5477-4ef5-8838-6ce71fc80238 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:55.610220 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8458b958-5477-4ef5-8838-6ce71fc80238 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:55.612427 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8458b958-5477-4ef5-8838-6ce71fc80238 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:55.673403 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7897d3c-9878-42d2-a349-a1ced46aeb75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:55.677040 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7897d3c-9878-42d2-a349-a1ced46aeb75 service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:55.705605 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1857/3741] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:22:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:22:55.745442 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1885/3742] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:22:55 2022] POST /identity/v3/projects => generated 367 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:22:55.746753 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7897d3c-9878-42d2-a349-a1ced46aeb75 service nova] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:55.765523 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7897d3c-9878-42d2-a349-a1ced46aeb75 service nova] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:55.954415 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5082aa-807f-42e7-99e0-6bec7f1948b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:55.955676 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5082aa-807f-42e7-99e0-6bec7f1948b0 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:55.956577 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5082aa-807f-42e7-99e0-6bec7f1948b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:55.957137 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5082aa-807f-42e7-99e0-6bec7f1948b0 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:55.958000 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5082aa-807f-42e7-99e0-6bec7f1948b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:55.968340 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5082aa-807f-42e7-99e0-6bec7f1948b0 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:56.069446 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1858/3743] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:22:55 2022] POST /identity/v3/users => generated 290 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:22:56.074828 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8458b958-5477-4ef5-8838-6ce71fc80238 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:56.091628 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8458b958-5477-4ef5-8838-6ce71fc80238 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:56.105896 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f32e2-7b56-4e0e-9f63-9cc9993e0f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:56.106681 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f32e2-7b56-4e0e-9f63-9cc9993e0f19 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:56.107033 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f32e2-7b56-4e0e-9f63-9cc9993e0f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:56.107397 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f32e2-7b56-4e0e-9f63-9cc9993e0f19 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:56.108952 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866f32e2-7b56-4e0e-9f63-9cc9993e0f19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:56.110944 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866f32e2-7b56-4e0e-9f63-9cc9993e0f19 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:56.143821 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1886/3744] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:22:56 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:22:56.147179 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5082aa-807f-42e7-99e0-6bec7f1948b0 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:56.157222 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5082aa-807f-42e7-99e0-6bec7f1948b0 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:56.168496 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef45503-ab26-4c77-a186-59520134a979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:56.169956 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef45503-ab26-4c77-a186-59520134a979 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:56.171837 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef45503-ab26-4c77-a186-59520134a979 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:56.172358 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef45503-ab26-4c77-a186-59520134a979 admin admin] PATH_INFO: `/v3/projects/497ca270ba674ce0a99b58dc33040a13/users/b7ab66d718ae41ff878dcef4d37c369e/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:56.209317 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef45503-ab26-4c77-a186-59520134a979 admin admin] RBAC: Authorizing `identity:create_grant(project_id=497ca270ba674ce0a99b58dc33040a13, user_id=b7ab66d718ae41ff878dcef4d37c369e, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:56.212599 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef45503-ab26-4c77-a186-59520134a979 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:56.351626 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1859/3745] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:22:56 2022] PUT /identity/v3/projects/497ca270ba674ce0a99b58dc33040a13/users/b7ab66d718ae41ff878dcef4d37c369e/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:22:56.356029 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f32e2-7b56-4e0e-9f63-9cc9993e0f19 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:56.371311 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f32e2-7b56-4e0e-9f63-9cc9993e0f19 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:56.428366 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda72e7e-3e4a-45d2-8268-72af0cc4a7d0 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:56.429837 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda72e7e-3e4a-45d2-8268-72af0cc4a7d0 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:56.430137 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda72e7e-3e4a-45d2-8268-72af0cc4a7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:56.455950 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75264d09-5583-4b75-80e7-1365ffe74770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:56.457027 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75264d09-5583-4b75-80e7-1365ffe74770 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:56.457506 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75264d09-5583-4b75-80e7-1365ffe74770 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:56.457964 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75264d09-5583-4b75-80e7-1365ffe74770 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:56.458958 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75264d09-5583-4b75-80e7-1365ffe74770 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:56.461309 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75264d09-5583-4b75-80e7-1365ffe74770 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:56.473084 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-cda72e7e-3e4a-45d2-8268-72af0cc4a7d0 None None] MFA Rules not processed for user `a7f2d4818aa7461da8f30ddfe7641d93`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:22:56.474631 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-cda72e7e-3e4a-45d2-8268-72af0cc4a7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:22:56.478077 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1887/3746] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:22:56 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:22:56.479553 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75264d09-5583-4b75-80e7-1365ffe74770 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:56.491494 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75264d09-5583-4b75-80e7-1365ffe74770 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:56.500193 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe2a53-9a85-4432-90f3-0012631c2a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:56.501100 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe2a53-9a85-4432-90f3-0012631c2a13 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:56.501369 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe2a53-9a85-4432-90f3-0012631c2a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:56.501647 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe2a53-9a85-4432-90f3-0012631c2a13 admin admin] PATH_INFO: `/v3/projects/497ca270ba674ce0a99b58dc33040a13/users/b7ab66d718ae41ff878dcef4d37c369e/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:56.504067 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbe2a53-9a85-4432-90f3-0012631c2a13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=497ca270ba674ce0a99b58dc33040a13, user_id=b7ab66d718ae41ff878dcef4d37c369e, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:56.507195 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbe2a53-9a85-4432-90f3-0012631c2a13 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:56.536627 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1888/3747] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:22:56 2022] PUT /identity/v3/projects/497ca270ba674ce0a99b58dc33040a13/users/b7ab66d718ae41ff878dcef4d37c369e/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:22:56.547867 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e72fce-1594-4614-872f-ddcdaf8126c6 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:56.548446 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e72fce-1594-4614-872f-ddcdaf8126c6 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:56.548719 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e72fce-1594-4614-872f-ddcdaf8126c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:56.581470 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-d3e72fce-1594-4614-872f-ddcdaf8126c6 None None] MFA Rules not processed for user `b7ab66d718ae41ff878dcef4d37c369e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:22:56.583207 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d3e72fce-1594-4614-872f-ddcdaf8126c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:22:56.588503 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1860/3748] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:22:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:22:56.601393 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23233b57-7845-4716-bc27-ef624b421107 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:56.601693 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23233b57-7845-4716-bc27-ef624b421107 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:56.602167 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23233b57-7845-4716-bc27-ef624b421107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:56.647588 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-23233b57-7845-4716-bc27-ef624b421107 None None] MFA Rules not processed for user `a7f2d4818aa7461da8f30ddfe7641d93`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:22:56.650270 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-23233b57-7845-4716-bc27-ef624b421107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:22:56.760177 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1889/3749] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:22:56 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:22:56.764989 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e72fce-1594-4614-872f-ddcdaf8126c6 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:56.776390 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e72fce-1594-4614-872f-ddcdaf8126c6 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:56.785081 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba035a21-6c91-44d4-b042-16e2d48c83b8 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:56.786382 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba035a21-6c91-44d4-b042-16e2d48c83b8 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:56.787105 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba035a21-6c91-44d4-b042-16e2d48c83b8 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:56.787682 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba035a21-6c91-44d4-b042-16e2d48c83b8 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:56.788809 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba035a21-6c91-44d4-b042-16e2d48c83b8 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:56.790170 ncdv-master-1 devstack@keystone.service[91106]: WARNING py.warnings [None req-ba035a21-6c91-44d4-b042-16e2d48c83b8 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:22:56.790170 ncdv-master-1 devstack@keystone.service[91106]: warnings.warn(msg) May 14 21:22:56.790170 ncdv-master-1 devstack@keystone.service[91106]: May 14 21:22:56.791685 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba035a21-6c91-44d4-b042-16e2d48c83b8 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:56.803545 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1861/3750] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:22:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:22:56.878831 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1890/3751] 10.222.0.52 () {60 vars in 1142 bytes} [Sat May 14 21:22:56 2022] POST /identity/v3/roles => generated 235 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:22:56.884879 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23233b57-7845-4716-bc27-ef624b421107 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:56.901334 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23233b57-7845-4716-bc27-ef624b421107 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:56.906769 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbdb55a-ee81-4ef9-8c05-ad4023d59d65 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:56.908411 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbdb55a-ee81-4ef9-8c05-ad4023d59d65 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:56.909501 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbdb55a-ee81-4ef9-8c05-ad4023d59d65 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:56.909501 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbdb55a-ee81-4ef9-8c05-ad4023d59d65 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:56.910204 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbdb55a-ee81-4ef9-8c05-ad4023d59d65 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:56.911322 ncdv-master-1 devstack@keystone.service[91107]: WARNING py.warnings [None req-9fbdb55a-ee81-4ef9-8c05-ad4023d59d65 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:22:56.911322 ncdv-master-1 devstack@keystone.service[91107]: warnings.warn(msg) May 14 21:22:56.911322 ncdv-master-1 devstack@keystone.service[91107]: May 14 21:22:56.912520 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbdb55a-ee81-4ef9-8c05-ad4023d59d65 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:56.996073 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1862/3752] 10.222.0.52 () {60 vars in 1142 bytes} [Sat May 14 21:22:56 2022] POST /identity/v3/roles => generated 235 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:22:56.999202 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba035a21-6c91-44d4-b042-16e2d48c83b8 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:57.015331 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba035a21-6c91-44d4-b042-16e2d48c83b8 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:57.030695 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8605fd2e-4d41-442e-b20c-e575471cf53b tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:57.031880 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605fd2e-4d41-442e-b20c-e575471cf53b tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:57.032166 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605fd2e-4d41-442e-b20c-e575471cf53b tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:57.034316 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605fd2e-4d41-442e-b20c-e575471cf53b tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:57.035097 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8605fd2e-4d41-442e-b20c-e575471cf53b tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:57.044881 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8605fd2e-4d41-442e-b20c-e575471cf53b tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:57.118074 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1891/3753] 10.222.0.52 () {60 vars in 1142 bytes} [Sat May 14 21:22:56 2022] POST /identity/v3/roles => generated 235 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:22:57.121856 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbdb55a-ee81-4ef9-8c05-ad4023d59d65 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:57.134391 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbdb55a-ee81-4ef9-8c05-ad4023d59d65 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:57.161931 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873598cd-9c5b-4a87-af45-d25ffad0e0cb tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:57.166081 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873598cd-9c5b-4a87-af45-d25ffad0e0cb tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:57.166081 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873598cd-9c5b-4a87-af45-d25ffad0e0cb tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:57.166081 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873598cd-9c5b-4a87-af45-d25ffad0e0cb tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:57.166081 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873598cd-9c5b-4a87-af45-d25ffad0e0cb tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:57.166081 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873598cd-9c5b-4a87-af45-d25ffad0e0cb tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:57.281855 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1863/3754] 10.222.0.52 () {60 vars in 1148 bytes} [Sat May 14 21:22:57 2022] POST /identity/v3/domains => generated 275 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:22:57.283356 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8605fd2e-4d41-442e-b20c-e575471cf53b tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:57.311692 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8605fd2e-4d41-442e-b20c-e575471cf53b tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:57.406528 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751e3cae-8e30-4ee9-b609-d35622ae0d27 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:57.408816 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e3cae-8e30-4ee9-b609-d35622ae0d27 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:57.409316 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e3cae-8e30-4ee9-b609-d35622ae0d27 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:57.409882 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e3cae-8e30-4ee9-b609-d35622ae0d27 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:57.410885 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751e3cae-8e30-4ee9-b609-d35622ae0d27 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:57.413164 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751e3cae-8e30-4ee9-b609-d35622ae0d27 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:57.482413 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873598cd-9c5b-4a87-af45-d25ffad0e0cb tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:57.573252 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873598cd-9c5b-4a87-af45-d25ffad0e0cb tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:57.588606 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e4b3a7-6906-4940-8498-6daf849d2697 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:57.588606 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4b3a7-6906-4940-8498-6daf849d2697 service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:57.588606 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4b3a7-6906-4940-8498-6daf849d2697 service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:57.588606 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4b3a7-6906-4940-8498-6daf849d2697 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:57.593721 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1892/3755] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:22:57 2022] POST /identity/v3/projects => generated 401 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:22:57.598640 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751e3cae-8e30-4ee9-b609-d35622ae0d27 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:57.670605 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e4b3a7-6906-4940-8498-6daf849d2697 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:57.672592 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e4b3a7-6906-4940-8498-6daf849d2697 service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:57.683094 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1864/3756] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:22:57 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:22:57.706398 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751e3cae-8e30-4ee9-b609-d35622ae0d27 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:57.712756 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0569919b-b97b-4b78-a4b9-eb8a627f0fc4 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:57.713569 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569919b-b97b-4b78-a4b9-eb8a627f0fc4 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:57.714098 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569919b-b97b-4b78-a4b9-eb8a627f0fc4 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:57.714496 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569919b-b97b-4b78-a4b9-eb8a627f0fc4 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/groups` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:57.715293 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0569919b-b97b-4b78-a4b9-eb8a627f0fc4 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:57.717803 ncdv-master-1 devstack@keystone.service[91106]: WARNING py.warnings [None req-0569919b-b97b-4b78-a4b9-eb8a627f0fc4 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 14 21:22:57.717803 ncdv-master-1 devstack@keystone.service[91106]: warnings.warn(msg) May 14 21:22:57.717803 ncdv-master-1 devstack@keystone.service[91106]: May 14 21:22:57.720442 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0569919b-b97b-4b78-a4b9-eb8a627f0fc4 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:57.821110 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1893/3757] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:22:57 2022] POST /identity/v3/groups => generated 300 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:22:57.825743 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e4b3a7-6906-4940-8498-6daf849d2697 service nova] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:57.840687 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e4b3a7-6906-4940-8498-6daf849d2697 service nova] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:57.845945 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd87c413-bfeb-4fa9-bf6d-936f2d128c15 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:57.847328 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87c413-bfeb-4fa9-bf6d-936f2d128c15 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:57.847967 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87c413-bfeb-4fa9-bf6d-936f2d128c15 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:57.848399 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87c413-bfeb-4fa9-bf6d-936f2d128c15 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:57.849326 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd87c413-bfeb-4fa9-bf6d-936f2d128c15 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:57.850948 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd87c413-bfeb-4fa9-bf6d-936f2d128c15 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:57.946028 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1865/3758] 10.222.0.52 () {60 vars in 1142 bytes} [Sat May 14 21:22:57 2022] POST /identity/v3/roles => generated 234 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:22:57.950535 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0569919b-b97b-4b78-a4b9-eb8a627f0fc4 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:57.962199 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0569919b-b97b-4b78-a4b9-eb8a627f0fc4 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:57.967360 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d716b3-0616-43f5-ad8f-02a05831090a tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:57.968283 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d716b3-0616-43f5-ad8f-02a05831090a tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:57.968728 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d716b3-0616-43f5-ad8f-02a05831090a tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:57.969157 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d716b3-0616-43f5-ad8f-02a05831090a tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:57.970050 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d716b3-0616-43f5-ad8f-02a05831090a tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:57.972470 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d716b3-0616-43f5-ad8f-02a05831090a tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:58.083400 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1894/3759] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:22:57 2022] POST /identity/v3/users => generated 439 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:22:58.088312 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd87c413-bfeb-4fa9-bf6d-936f2d128c15 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:58.101927 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd87c413-bfeb-4fa9-bf6d-936f2d128c15 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:58.108669 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f5b22-92eb-4f2f-a046-922b2b93a1c2 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:58.109511 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f5b22-92eb-4f2f-a046-922b2b93a1c2 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:58.109912 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f5b22-92eb-4f2f-a046-922b2b93a1c2 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:58.110301 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f5b22-92eb-4f2f-a046-922b2b93a1c2 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:58.111184 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22f5b22-92eb-4f2f-a046-922b2b93a1c2 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:58.112517 ncdv-master-1 devstack@keystone.service[91107]: WARNING py.warnings [None req-c22f5b22-92eb-4f2f-a046-922b2b93a1c2 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:22:58.112517 ncdv-master-1 devstack@keystone.service[91107]: warnings.warn(msg) May 14 21:22:58.112517 ncdv-master-1 devstack@keystone.service[91107]: May 14 21:22:58.114383 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22f5b22-92eb-4f2f-a046-922b2b93a1c2 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:58.213780 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1866/3760] 10.222.0.52 () {60 vars in 1142 bytes} [Sat May 14 21:22:58 2022] POST /identity/v3/roles => generated 269 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:22:58.214913 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d716b3-0616-43f5-ad8f-02a05831090a tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:58.227857 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d716b3-0616-43f5-ad8f-02a05831090a tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:58.232038 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c6e774-f35e-42a2-8894-08998e904f2d tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:58.233269 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c6e774-f35e-42a2-8894-08998e904f2d tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:58.233884 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c6e774-f35e-42a2-8894-08998e904f2d tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:58.234431 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c6e774-f35e-42a2-8894-08998e904f2d tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/projects/6f4b500359af402b8d57e382a9011442/users/c93b213be1a94a1794b8760cb36c2b4e/roles/2fa66a8aa6474b2a93f1556cc9764b8d` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:58.262823 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c6e774-f35e-42a2-8894-08998e904f2d tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:create_grant(project_id=6f4b500359af402b8d57e382a9011442, user_id=c93b213be1a94a1794b8760cb36c2b4e, role_id=2fa66a8aa6474b2a93f1556cc9764b8d)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:58.265787 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c6e774-f35e-42a2-8894-08998e904f2d tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:58.372988 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1895/3761] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:22:58 2022] PUT /identity/v3/projects/6f4b500359af402b8d57e382a9011442/users/c93b213be1a94a1794b8760cb36c2b4e/roles/2fa66a8aa6474b2a93f1556cc9764b8d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:22:58.378105 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f5b22-92eb-4f2f-a046-922b2b93a1c2 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:58.391111 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f5b22-92eb-4f2f-a046-922b2b93a1c2 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:58.556077 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f4fdbe-6027-4900-a480-793673523f06 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:58.557013 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4fdbe-6027-4900-a480-793673523f06 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:58.557451 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4fdbe-6027-4900-a480-793673523f06 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:58.557900 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4fdbe-6027-4900-a480-793673523f06 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:58.559072 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f4fdbe-6027-4900-a480-793673523f06 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Adding query filter params (scope.project.id=6f4b500359af402b8d57e382a9011442, user.id=c93b213be1a94a1794b8760cb36c2b4e) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:22:58.562571 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f4fdbe-6027-4900-a480-793673523f06 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:58.565215 ncdv-master-1 devstack@keystone.service[91107]: WARNING py.warnings [None req-71f4fdbe-6027-4900-a480-793673523f06 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 14 21:22:58.565215 ncdv-master-1 devstack@keystone.service[91107]: warnings.warn(msg) May 14 21:22:58.565215 ncdv-master-1 devstack@keystone.service[91107]: May 14 21:22:58.567523 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f4fdbe-6027-4900-a480-793673523f06 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:58.693023 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1867/3762] 10.222.0.52 () {58 vars in 1355 bytes} [Sat May 14 21:22:58 2022] GET /identity/v3/role_assignments?scope.project.id=6f4b500359af402b8d57e382a9011442&user.id=c93b213be1a94a1794b8760cb36c2b4e&effective => generated 228 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:22:58.693356 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c6e774-f35e-42a2-8894-08998e904f2d tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:58.704751 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c6e774-f35e-42a2-8894-08998e904f2d tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:58.721809 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7a6b85-713b-4cb1-9d7d-4444007d0874 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:58.721809 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a6b85-713b-4cb1-9d7d-4444007d0874 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:58.721809 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a6b85-713b-4cb1-9d7d-4444007d0874 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:58.722746 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a6b85-713b-4cb1-9d7d-4444007d0874 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/projects/6f4b500359af402b8d57e382a9011442/users/c93b213be1a94a1794b8760cb36c2b4e/roles/2fa66a8aa6474b2a93f1556cc9764b8d` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:58.722746 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7a6b85-713b-4cb1-9d7d-4444007d0874 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=6f4b500359af402b8d57e382a9011442, user_id=c93b213be1a94a1794b8760cb36c2b4e, role_id=2fa66a8aa6474b2a93f1556cc9764b8d)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:58.722746 ncdv-master-1 devstack@keystone.service[91106]: WARNING py.warnings [None req-4e7a6b85-713b-4cb1-9d7d-4444007d0874 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 14 21:22:58.723002 ncdv-master-1 devstack@keystone.service[91106]: warnings.warn(msg) May 14 21:22:58.723002 ncdv-master-1 devstack@keystone.service[91106]: May 14 21:22:58.723002 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7a6b85-713b-4cb1-9d7d-4444007d0874 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:58.730148 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-4e7a6b85-713b-4cb1-9d7d-4444007d0874 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invalidating the token cache because role 2fa66a8aa6474b2a93f1556cc9764b8d was removed from user c93b213be1a94a1794b8760cb36c2b4e on project 6f4b500359af402b8d57e382a9011442. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:22:58.730649 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-4e7a6b85-713b-4cb1-9d7d-4444007d0874 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:58.731577 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-4e7a6b85-713b-4cb1-9d7d-4444007d0874 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:58.841541 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1896/3763] 10.222.0.52 () {58 vars in 1466 bytes} [Sat May 14 21:22:58 2022] DELETE /identity/v3/projects/6f4b500359af402b8d57e382a9011442/users/c93b213be1a94a1794b8760cb36c2b4e/roles/2fa66a8aa6474b2a93f1556cc9764b8d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:22:58.846257 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f4fdbe-6027-4900-a480-793673523f06 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:58.853696 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-71f4fdbe-6027-4900-a480-793673523f06 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:22:58.893871 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f4fdbe-6027-4900-a480-793673523f06 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:59.025679 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382a4d97-4916-4a16-9148-8c5f08f7d898 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:59.029184 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a4d97-4916-4a16-9148-8c5f08f7d898 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:59.029184 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a4d97-4916-4a16-9148-8c5f08f7d898 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:59.029184 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a4d97-4916-4a16-9148-8c5f08f7d898 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/roles/2fa66a8aa6474b2a93f1556cc9764b8d` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:59.030981 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382a4d97-4916-4a16-9148-8c5f08f7d898 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=2fa66a8aa6474b2a93f1556cc9764b8d)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:59.034939 ncdv-master-1 devstack@keystone.service[91107]: WARNING py.warnings [None req-382a4d97-4916-4a16-9148-8c5f08f7d898 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:22:59.034939 ncdv-master-1 devstack@keystone.service[91107]: warnings.warn(msg) May 14 21:22:59.034939 ncdv-master-1 devstack@keystone.service[91107]: May 14 21:22:59.036229 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382a4d97-4916-4a16-9148-8c5f08f7d898 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:59.275667 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-382a4d97-4916-4a16-9148-8c5f08f7d898 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invalidating the token cache because role 2fa66a8aa6474b2a93f1556cc9764b8d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:22:59.276784 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-382a4d97-4916-4a16-9148-8c5f08f7d898 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:59.278407 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-382a4d97-4916-4a16-9148-8c5f08f7d898 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:22:59.285659 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1868/3764] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:22:58 2022] DELETE /identity/v3/roles/2fa66a8aa6474b2a93f1556cc9764b8d => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:22:59.292360 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7a6b85-713b-4cb1-9d7d-4444007d0874 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:59.315966 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7a6b85-713b-4cb1-9d7d-4444007d0874 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:59.485766 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3228a5-d7ec-49b9-ac57-2c175d5495ef tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:59.487022 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3228a5-d7ec-49b9-ac57-2c175d5495ef tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:59.487788 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3228a5-d7ec-49b9-ac57-2c175d5495ef tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:59.489077 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3228a5-d7ec-49b9-ac57-2c175d5495ef tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/projects/6f4b500359af402b8d57e382a9011442/users/c93b213be1a94a1794b8760cb36c2b4e/roles/4d93c1ee22da4498b1f9f05435b22d5a` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:59.494939 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3228a5-d7ec-49b9-ac57-2c175d5495ef tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:create_grant(project_id=6f4b500359af402b8d57e382a9011442, user_id=c93b213be1a94a1794b8760cb36c2b4e, role_id=4d93c1ee22da4498b1f9f05435b22d5a)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:59.502436 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3228a5-d7ec-49b9-ac57-2c175d5495ef tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:59.615464 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1897/3765] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:22:59 2022] PUT /identity/v3/projects/6f4b500359af402b8d57e382a9011442/users/c93b213be1a94a1794b8760cb36c2b4e/roles/4d93c1ee22da4498b1f9f05435b22d5a => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:22:59.619587 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382a4d97-4916-4a16-9148-8c5f08f7d898 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:59.621056 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-382a4d97-4916-4a16-9148-8c5f08f7d898 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:22:59.650642 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382a4d97-4916-4a16-9148-8c5f08f7d898 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:22:59.783229 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da770036-a893-4e6f-8b4c-373704fd3540 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:22:59.784145 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da770036-a893-4e6f-8b4c-373704fd3540 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:22:59.784430 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da770036-a893-4e6f-8b4c-373704fd3540 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:22:59.784885 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da770036-a893-4e6f-8b4c-373704fd3540 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/roles/4d93c1ee22da4498b1f9f05435b22d5a/implies/04d9c7f2728f4fafb1d6b659f755e40a` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:22:59.788780 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da770036-a893-4e6f-8b4c-373704fd3540 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=4d93c1ee22da4498b1f9f05435b22d5a, implied_role_id=04d9c7f2728f4fafb1d6b659f755e40a)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:22:59.789952 ncdv-master-1 devstack@keystone.service[91107]: WARNING py.warnings [None req-da770036-a893-4e6f-8b4c-373704fd3540 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:22:59.789952 ncdv-master-1 devstack@keystone.service[91107]: warnings.warn(msg) May 14 21:22:59.789952 ncdv-master-1 devstack@keystone.service[91107]: May 14 21:22:59.791183 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da770036-a893-4e6f-8b4c-373704fd3540 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:22:59.965727 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1869/3766] 10.222.0.52 () {60 vars in 1362 bytes} [Sat May 14 21:22:59 2022] PUT /identity/v3/roles/4d93c1ee22da4498b1f9f05435b22d5a/implies/04d9c7f2728f4fafb1d6b659f755e40a => generated 521 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:22:59.967396 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3228a5-d7ec-49b9-ac57-2c175d5495ef tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:22:59.984737 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3228a5-d7ec-49b9-ac57-2c175d5495ef tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:00.139949 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d2a7ab-d8a0-4d69-954f-8055e83b5da5 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:00.139949 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d2a7ab-d8a0-4d69-954f-8055e83b5da5 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:00.139949 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d2a7ab-d8a0-4d69-954f-8055e83b5da5 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:00.140340 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d2a7ab-d8a0-4d69-954f-8055e83b5da5 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:00.140340 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d2a7ab-d8a0-4d69-954f-8055e83b5da5 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Adding query filter params (scope.project.id=6f4b500359af402b8d57e382a9011442, user.id=c93b213be1a94a1794b8760cb36c2b4e) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:23:00.140340 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d2a7ab-d8a0-4d69-954f-8055e83b5da5 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:00.140340 ncdv-master-1 devstack@keystone.service[91106]: WARNING py.warnings [None req-41d2a7ab-d8a0-4d69-954f-8055e83b5da5 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 14 21:23:00.140340 ncdv-master-1 devstack@keystone.service[91106]: warnings.warn(msg) May 14 21:23:00.140340 ncdv-master-1 devstack@keystone.service[91106]: May 14 21:23:00.140990 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d2a7ab-d8a0-4d69-954f-8055e83b5da5 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:00.286182 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1898/3767] 10.222.0.52 () {58 vars in 1355 bytes} [Sat May 14 21:22:59 2022] GET /identity/v3/role_assignments?scope.project.id=6f4b500359af402b8d57e382a9011442&user.id=c93b213be1a94a1794b8760cb36c2b4e&effective => generated 1061 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:23:00.289912 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da770036-a893-4e6f-8b4c-373704fd3540 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:00.311989 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da770036-a893-4e6f-8b4c-373704fd3540 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:00.314838 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e16916-179f-4377-8322-0652746508ef tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:00.316022 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e16916-179f-4377-8322-0652746508ef tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:00.316462 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e16916-179f-4377-8322-0652746508ef tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:00.316890 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e16916-179f-4377-8322-0652746508ef tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/roles/4d93c1ee22da4498b1f9f05435b22d5a/implies/04d9c7f2728f4fafb1d6b659f755e40a` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:00.318994 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e16916-179f-4377-8322-0652746508ef tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=4d93c1ee22da4498b1f9f05435b22d5a, implied_role_id=04d9c7f2728f4fafb1d6b659f755e40a)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:00.320289 ncdv-master-1 devstack@keystone.service[91107]: WARNING py.warnings [None req-00e16916-179f-4377-8322-0652746508ef tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:23:00.320289 ncdv-master-1 devstack@keystone.service[91107]: warnings.warn(msg) May 14 21:23:00.320289 ncdv-master-1 devstack@keystone.service[91107]: May 14 21:23:00.321719 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e16916-179f-4377-8322-0652746508ef tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:00.414534 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1870/3768] 10.222.0.52 () {58 vars in 1346 bytes} [Sat May 14 21:23:00 2022] DELETE /identity/v3/roles/4d93c1ee22da4498b1f9f05435b22d5a/implies/04d9c7f2728f4fafb1d6b659f755e40a => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:23:00.418589 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d2a7ab-d8a0-4d69-954f-8055e83b5da5 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:00.430493 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d2a7ab-d8a0-4d69-954f-8055e83b5da5 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:00.534131 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2838baad-a0d7-4896-901d-7d6c74b86750 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:00.541013 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838baad-a0d7-4896-901d-7d6c74b86750 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:00.541511 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838baad-a0d7-4896-901d-7d6c74b86750 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:00.541967 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838baad-a0d7-4896-901d-7d6c74b86750 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:00.542964 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2838baad-a0d7-4896-901d-7d6c74b86750 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Adding query filter params (scope.project.id=6f4b500359af402b8d57e382a9011442, user.id=c93b213be1a94a1794b8760cb36c2b4e) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:23:00.543451 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2838baad-a0d7-4896-901d-7d6c74b86750 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:00.545758 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2838baad-a0d7-4896-901d-7d6c74b86750 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:00.625639 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1899/3769] 10.222.0.52 () {58 vars in 1355 bytes} [Sat May 14 21:23:00 2022] GET /identity/v3/role_assignments?scope.project.id=6f4b500359af402b8d57e382a9011442&user.id=c93b213be1a94a1794b8760cb36c2b4e&effective => generated 577 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:23:00.629662 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e16916-179f-4377-8322-0652746508ef tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:00.645656 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e16916-179f-4377-8322-0652746508ef tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:00.658560 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642179c7-4634-4f91-913e-c85468259b31 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:00.659702 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642179c7-4634-4f91-913e-c85468259b31 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:00.660005 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642179c7-4634-4f91-913e-c85468259b31 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:00.660741 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642179c7-4634-4f91-913e-c85468259b31 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/roles/4d93c1ee22da4498b1f9f05435b22d5a/implies/04d9c7f2728f4fafb1d6b659f755e40a` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:00.663865 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642179c7-4634-4f91-913e-c85468259b31 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=4d93c1ee22da4498b1f9f05435b22d5a, implied_role_id=04d9c7f2728f4fafb1d6b659f755e40a)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:00.665479 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642179c7-4634-4f91-913e-c85468259b31 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:00.748572 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-642179c7-4634-4f91-913e-c85468259b31 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] 4d93c1ee22da4498b1f9f05435b22d5a does not imply 04d9c7f2728f4fafb1d6b659f755e40a.: keystone.exception.ImpliedRoleNotFound: 4d93c1ee22da4498b1f9f05435b22d5a does not imply 04d9c7f2728f4fafb1d6b659f755e40a. May 14 21:23:00.748572 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:23:00.748572 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role May 14 21:23:00.748572 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ref = query.one() May 14 21:23:00.748572 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2865, in one May 14 21:23:00.748572 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._iter().one() May 14 21:23:00.748572 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1417, in one May 14 21:23:00.748572 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._only_one_row( May 14 21:23:00.748572 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row May 14 21:23:00.748572 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exc.NoResultFound( May 14 21:23:00.748572 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required May 14 21:23:00.748572 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:23:00.748572 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 21:23:00.748572 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:23:00.748572 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:23:00.748572 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 21:23:00.749807 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 21:23:00.749807 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 21:23:00.749807 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 21:23:00.749807 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 21:23:00.749807 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 21:23:00.749807 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 21:23:00.749807 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 21:23:00.749807 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 21:23:00.749807 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 21:23:00.749807 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete May 14 21:23:00.749807 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) May 14 21:23:00.749807 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 21:23:00.749807 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 21:23:00.749807 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role May 14 21:23:00.749807 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) May 14 21:23:00.749807 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role May 14 21:23:00.750929 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, May 14 21:23:00.750929 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role May 14 21:23:00.750929 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( May 14 21:23:00.750929 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: 4d93c1ee22da4498b1f9f05435b22d5a does not imply 04d9c7f2728f4fafb1d6b659f755e40a. May 14 21:23:00.750929 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:23:00.752539 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1871/3770] 10.222.0.52 () {58 vars in 1346 bytes} [Sat May 14 21:23:00 2022] DELETE /identity/v3/roles/4d93c1ee22da4498b1f9f05435b22d5a/implies/04d9c7f2728f4fafb1d6b659f755e40a => generated 137 bytes in 123 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 14 21:23:00.756511 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2838baad-a0d7-4896-901d-7d6c74b86750 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:00.775650 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2838baad-a0d7-4896-901d-7d6c74b86750 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:00.793805 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5331f58-21d1-4c7e-bc82-7a8023cdfb53 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:00.799687 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5331f58-21d1-4c7e-bc82-7a8023cdfb53 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:00.799687 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5331f58-21d1-4c7e-bc82-7a8023cdfb53 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:00.799687 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5331f58-21d1-4c7e-bc82-7a8023cdfb53 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/projects/6f4b500359af402b8d57e382a9011442/users/c93b213be1a94a1794b8760cb36c2b4e/roles/4d93c1ee22da4498b1f9f05435b22d5a` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:00.802130 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5331f58-21d1-4c7e-bc82-7a8023cdfb53 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=6f4b500359af402b8d57e382a9011442, user_id=c93b213be1a94a1794b8760cb36c2b4e, role_id=4d93c1ee22da4498b1f9f05435b22d5a)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:00.815388 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5331f58-21d1-4c7e-bc82-7a8023cdfb53 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:00.823429 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e5331f58-21d1-4c7e-bc82-7a8023cdfb53 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invalidating the token cache because role 4d93c1ee22da4498b1f9f05435b22d5a was removed from user c93b213be1a94a1794b8760cb36c2b4e on project 6f4b500359af402b8d57e382a9011442. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:23:00.825687 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e5331f58-21d1-4c7e-bc82-7a8023cdfb53 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:00.826628 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e5331f58-21d1-4c7e-bc82-7a8023cdfb53 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:00.950590 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1900/3771] 10.222.0.52 () {58 vars in 1466 bytes} [Sat May 14 21:23:00 2022] DELETE /identity/v3/projects/6f4b500359af402b8d57e382a9011442/users/c93b213be1a94a1794b8760cb36c2b4e/roles/4d93c1ee22da4498b1f9f05435b22d5a => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:00.955969 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642179c7-4634-4f91-913e-c85468259b31 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:00.962642 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-642179c7-4634-4f91-913e-c85468259b31 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:00.989642 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642179c7-4634-4f91-913e-c85468259b31 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:01.147514 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a33f3a-0757-4d3a-a775-e90522057576 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:01.147514 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a33f3a-0757-4d3a-a775-e90522057576 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:01.147514 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a33f3a-0757-4d3a-a775-e90522057576 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:01.147915 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a33f3a-0757-4d3a-a775-e90522057576 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:01.147915 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a33f3a-0757-4d3a-a775-e90522057576 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:01.147915 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a33f3a-0757-4d3a-a775-e90522057576 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:01.155606 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4964bb1-1440-4ebc-999b-b6a77f391e6b None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:01.156671 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4964bb1-1440-4ebc-999b-b6a77f391e6b None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:01.157559 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4964bb1-1440-4ebc-999b-b6a77f391e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:01.188288 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-f4964bb1-1440-4ebc-999b-b6a77f391e6b None None] MFA Rules not processed for user `a42e0caa0878447f98544e74f767c7ca`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:23:01.189781 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-f4964bb1-1440-4ebc-999b-b6a77f391e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:01.250762 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1872/3772] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:23:00 2022] POST /identity/v3/roles => generated 272 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:23:01.254492 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a33f3a-0757-4d3a-a775-e90522057576 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:01.278045 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1901/3773] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:23:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:23:01.285527 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a33f3a-0757-4d3a-a775-e90522057576 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:01.299953 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49256da1-fdca-41e9-af92-3440751a0c74 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:01.302862 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49256da1-fdca-41e9-af92-3440751a0c74 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:01.303226 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49256da1-fdca-41e9-af92-3440751a0c74 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:01.306287 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49256da1-fdca-41e9-af92-3440751a0c74 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:01.308115 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49256da1-fdca-41e9-af92-3440751a0c74 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Adding query filter params (domain_id=3605c64c28454cd5805bf3a4dea46ae1) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:23:01.312958 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49256da1-fdca-41e9-af92-3440751a0c74 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:01.312958 ncdv-master-1 devstack@keystone.service[91107]: WARNING py.warnings [None req-49256da1-fdca-41e9-af92-3440751a0c74 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domain_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:23:01.312958 ncdv-master-1 devstack@keystone.service[91107]: warnings.warn(msg) May 14 21:23:01.312958 ncdv-master-1 devstack@keystone.service[91107]: May 14 21:23:01.314643 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49256da1-fdca-41e9-af92-3440751a0c74 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:01.345909 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1873/3774] 10.222.0.52 () {58 vars in 1206 bytes} [Sat May 14 21:23:01 2022] GET /identity/v3/roles?domain_id=3605c64c28454cd5805bf3a4dea46ae1 => generated 409 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:23:01.348908 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4964bb1-1440-4ebc-999b-b6a77f391e6b None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:01.370368 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4964bb1-1440-4ebc-999b-b6a77f391e6b None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:01.378227 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd87cd4-533f-4729-a713-74b774ef7478 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:01.384172 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd87cd4-533f-4729-a713-74b774ef7478 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:01.384172 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd87cd4-533f-4729-a713-74b774ef7478 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:01.384172 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd87cd4-533f-4729-a713-74b774ef7478 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/roles/b42a4d5512cd4166bd7928b45f7c383f` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:01.394403 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd87cd4-533f-4729-a713-74b774ef7478 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=b42a4d5512cd4166bd7928b45f7c383f)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:01.394403 ncdv-master-1 devstack@keystone.service[91106]: WARNING py.warnings [None req-bdd87cd4-533f-4729-a713-74b774ef7478 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:23:01.394403 ncdv-master-1 devstack@keystone.service[91106]: warnings.warn(msg) May 14 21:23:01.394403 ncdv-master-1 devstack@keystone.service[91106]: May 14 21:23:01.394403 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd87cd4-533f-4729-a713-74b774ef7478 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:01.532645 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-bdd87cd4-533f-4729-a713-74b774ef7478 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invalidating the token cache because role b42a4d5512cd4166bd7928b45f7c383f has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:23:01.533984 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-bdd87cd4-533f-4729-a713-74b774ef7478 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:01.535582 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-bdd87cd4-533f-4729-a713-74b774ef7478 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:01.552782 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1902/3775] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:23:01 2022] DELETE /identity/v3/roles/b42a4d5512cd4166bd7928b45f7c383f => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:01.556652 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49256da1-fdca-41e9-af92-3440751a0c74 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:01.558477 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-49256da1-fdca-41e9-af92-3440751a0c74 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:01.583840 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49256da1-fdca-41e9-af92-3440751a0c74 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:01.682991 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1308e4a-8db1-4d85-9564-4437963855e9 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:01.683898 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1308e4a-8db1-4d85-9564-4437963855e9 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:01.684442 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1308e4a-8db1-4d85-9564-4437963855e9 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:01.684907 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1308e4a-8db1-4d85-9564-4437963855e9 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:01.686266 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1308e4a-8db1-4d85-9564-4437963855e9 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Adding query filter params (domain_id=3605c64c28454cd5805bf3a4dea46ae1) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:23:01.686892 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1308e4a-8db1-4d85-9564-4437963855e9 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:01.689749 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1308e4a-8db1-4d85-9564-4437963855e9 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:01.701180 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1874/3776] 10.222.0.52 () {58 vars in 1206 bytes} [Sat May 14 21:23:01 2022] GET /identity/v3/roles?domain_id=3605c64c28454cd5805bf3a4dea46ae1 => generated 148 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:23:01.705220 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd87cd4-533f-4729-a713-74b774ef7478 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:01.719908 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd87cd4-533f-4729-a713-74b774ef7478 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:01.725851 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c61da7a-afef-45ad-b907-0043065d318d tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:01.726976 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c61da7a-afef-45ad-b907-0043065d318d tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:01.727512 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c61da7a-afef-45ad-b907-0043065d318d tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:01.728004 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c61da7a-afef-45ad-b907-0043065d318d tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/roles/b42a4d5512cd4166bd7928b45f7c383f` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:01.748867 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c61da7a-afef-45ad-b907-0043065d318d tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 21:23:01.761467 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-6c61da7a-afef-45ad-b907-0043065d318d tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Could not find role: b42a4d5512cd4166bd7928b45f7c383f.: keystone.exception.RoleNotFound: Could not find role: b42a4d5512cd4166bd7928b45f7c383f. May 14 21:23:01.761467 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:23:01.761467 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 21:23:01.761467 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 21:23:01.761467 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 21:23:01.761467 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 21:23:01.761467 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 21:23:01.761467 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 21:23:01.761467 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 21:23:01.761467 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 21:23:01.761467 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 21:23:01.761467 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 21:23:01.761467 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 165, in delete May 14 21:23:01.761467 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_role') May 14 21:23:01.766713 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 21:23:01.766713 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 21:23:01.766713 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 21:23:01.766713 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 21:23:01.766713 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 21:23:01.766713 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 21:23:01.766713 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 21:23:01.766713 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 21:23:01.766713 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 21:23:01.766713 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 21:23:01.766713 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 21:23:01.766713 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 21:23:01.766713 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 21:23:01.766713 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 21:23:01.766713 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 21:23:01.766713 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 21:23:01.767820 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 21:23:01.767820 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 21:23:01.767820 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 21:23:01.767820 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 21:23:01.767820 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 21:23:01.767820 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 21:23:01.767820 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 21:23:01.767820 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 21:23:01.767820 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 21:23:01.767820 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 21:23:01.767820 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: b42a4d5512cd4166bd7928b45f7c383f. May 14 21:23:01.767820 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:23:01.767820 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1903/3777] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:23:01 2022] DELETE /identity/v3/roles/b42a4d5512cd4166bd7928b45f7c383f => generated 110 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 14 21:23:01.768832 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1308e4a-8db1-4d85-9564-4437963855e9 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:01.780057 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1308e4a-8db1-4d85-9564-4437963855e9 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:01.792321 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac14ac62-2bbd-4145-a320-c2fc807d2d40 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:01.793351 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14ac62-2bbd-4145-a320-c2fc807d2d40 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:01.793711 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14ac62-2bbd-4145-a320-c2fc807d2d40 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:01.794069 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14ac62-2bbd-4145-a320-c2fc807d2d40 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/domains/3605c64c28454cd5805bf3a4dea46ae1/groups/5fb9af0dc93b43c9929099bba80fdc28/roles/cd713768bc0c4c3d9bf993588b682095` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:01.803280 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac14ac62-2bbd-4145-a320-c2fc807d2d40 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=3605c64c28454cd5805bf3a4dea46ae1, group_id=5fb9af0dc93b43c9929099bba80fdc28, role_id=cd713768bc0c4c3d9bf993588b682095)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:01.806157 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac14ac62-2bbd-4145-a320-c2fc807d2d40 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:01.918210 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1875/3778] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:23:01 2022] PUT /identity/v3/domains/3605c64c28454cd5805bf3a4dea46ae1/groups/5fb9af0dc93b43c9929099bba80fdc28/roles/cd713768bc0c4c3d9bf993588b682095 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:01.919114 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c61da7a-afef-45ad-b907-0043065d318d tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:01.934545 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c61da7a-afef-45ad-b907-0043065d318d tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:02.021266 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852f8b9b-fcc3-451a-9854-1a58e0bee8da tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:02.022193 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f8b9b-fcc3-451a-9854-1a58e0bee8da tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:02.022480 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f8b9b-fcc3-451a-9854-1a58e0bee8da tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:02.022937 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f8b9b-fcc3-451a-9854-1a58e0bee8da tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/domains/3605c64c28454cd5805bf3a4dea46ae1/groups/5fb9af0dc93b43c9929099bba80fdc28/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:02.043037 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852f8b9b-fcc3-451a-9854-1a58e0bee8da tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=3605c64c28454cd5805bf3a4dea46ae1, group_id=5fb9af0dc93b43c9929099bba80fdc28)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:02.044274 ncdv-master-1 devstack@keystone.service[91106]: WARNING py.warnings [None req-852f8b9b-fcc3-451a-9854-1a58e0bee8da tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 14 21:23:02.044274 ncdv-master-1 devstack@keystone.service[91106]: warnings.warn(msg) May 14 21:23:02.044274 ncdv-master-1 devstack@keystone.service[91106]: May 14 21:23:02.048297 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852f8b9b-fcc3-451a-9854-1a58e0bee8da tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:02.064074 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1904/3779] 10.222.0.52 () {58 vars in 1364 bytes} [Sat May 14 21:23:01 2022] GET /identity/v3/domains/3605c64c28454cd5805bf3a4dea46ae1/groups/5fb9af0dc93b43c9929099bba80fdc28/roles => generated 409 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:23:02.068006 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac14ac62-2bbd-4145-a320-c2fc807d2d40 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:02.080306 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac14ac62-2bbd-4145-a320-c2fc807d2d40 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:02.086150 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c014087b-92b3-4288-9e7c-3b7a6eefe37f tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:02.087316 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c014087b-92b3-4288-9e7c-3b7a6eefe37f tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:02.087644 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c014087b-92b3-4288-9e7c-3b7a6eefe37f tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:02.087936 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c014087b-92b3-4288-9e7c-3b7a6eefe37f tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/domains/3605c64c28454cd5805bf3a4dea46ae1/groups/5fb9af0dc93b43c9929099bba80fdc28/roles/cd713768bc0c4c3d9bf993588b682095` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:02.090208 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c014087b-92b3-4288-9e7c-3b7a6eefe37f tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=3605c64c28454cd5805bf3a4dea46ae1, group_id=5fb9af0dc93b43c9929099bba80fdc28, role_id=cd713768bc0c4c3d9bf993588b682095)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:02.091365 ncdv-master-1 devstack@keystone.service[91107]: WARNING py.warnings [None req-c014087b-92b3-4288-9e7c-3b7a6eefe37f tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 14 21:23:02.091365 ncdv-master-1 devstack@keystone.service[91107]: warnings.warn(msg) May 14 21:23:02.091365 ncdv-master-1 devstack@keystone.service[91107]: May 14 21:23:02.093538 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c014087b-92b3-4288-9e7c-3b7a6eefe37f tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:02.101752 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1876/3780] 10.222.0.52 () {58 vars in 1464 bytes} [Sat May 14 21:23:02 2022] HEAD /identity/v3/domains/3605c64c28454cd5805bf3a4dea46ae1/groups/5fb9af0dc93b43c9929099bba80fdc28/roles/cd713768bc0c4c3d9bf993588b682095 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:23:02.105894 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852f8b9b-fcc3-451a-9854-1a58e0bee8da tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:02.116645 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852f8b9b-fcc3-451a-9854-1a58e0bee8da tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:02.121306 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c55cfa-5094-4cb8-ad89-fd9e07c1f3e6 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:02.122398 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c55cfa-5094-4cb8-ad89-fd9e07c1f3e6 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:02.122688 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c55cfa-5094-4cb8-ad89-fd9e07c1f3e6 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:02.123235 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c55cfa-5094-4cb8-ad89-fd9e07c1f3e6 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/domains/3605c64c28454cd5805bf3a4dea46ae1/groups/5fb9af0dc93b43c9929099bba80fdc28/roles/cd713768bc0c4c3d9bf993588b682095` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:02.125771 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c55cfa-5094-4cb8-ad89-fd9e07c1f3e6 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=3605c64c28454cd5805bf3a4dea46ae1, group_id=5fb9af0dc93b43c9929099bba80fdc28, role_id=cd713768bc0c4c3d9bf993588b682095)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:02.128687 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c55cfa-5094-4cb8-ad89-fd9e07c1f3e6 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:02.134455 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-18c55cfa-5094-4cb8-ad89-fd9e07c1f3e6 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invalidating the token cache because role cd713768bc0c4c3d9bf993588b682095 was removed from group 5fb9af0dc93b43c9929099bba80fdc28 on domain 3605c64c28454cd5805bf3a4dea46ae1. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:23:02.134747 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-18c55cfa-5094-4cb8-ad89-fd9e07c1f3e6 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:02.135436 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-18c55cfa-5094-4cb8-ad89-fd9e07c1f3e6 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:02.246515 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1905/3781] 10.222.0.52 () {58 vars in 1466 bytes} [Sat May 14 21:23:02 2022] DELETE /identity/v3/domains/3605c64c28454cd5805bf3a4dea46ae1/groups/5fb9af0dc93b43c9929099bba80fdc28/roles/cd713768bc0c4c3d9bf993588b682095 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:02.263514 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c014087b-92b3-4288-9e7c-3b7a6eefe37f tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:02.263514 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c014087b-92b3-4288-9e7c-3b7a6eefe37f tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:02.287530 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c014087b-92b3-4288-9e7c-3b7a6eefe37f tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:02.364301 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3946e4e6-0227-44e4-9969-7fb7ec7d0565 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:02.365245 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3946e4e6-0227-44e4-9969-7fb7ec7d0565 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:02.365853 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3946e4e6-0227-44e4-9969-7fb7ec7d0565 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:02.366372 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3946e4e6-0227-44e4-9969-7fb7ec7d0565 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/projects/6f4b500359af402b8d57e382a9011442/groups/5fb9af0dc93b43c9929099bba80fdc28/roles/cd713768bc0c4c3d9bf993588b682095` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:02.370576 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3946e4e6-0227-44e4-9969-7fb7ec7d0565 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:create_grant(project_id=6f4b500359af402b8d57e382a9011442, group_id=5fb9af0dc93b43c9929099bba80fdc28, role_id=cd713768bc0c4c3d9bf993588b682095)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:02.373767 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3946e4e6-0227-44e4-9969-7fb7ec7d0565 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:02.484352 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1877/3782] 10.222.0.52 () {60 vars in 1485 bytes} [Sat May 14 21:23:02 2022] PUT /identity/v3/projects/6f4b500359af402b8d57e382a9011442/groups/5fb9af0dc93b43c9929099bba80fdc28/roles/cd713768bc0c4c3d9bf993588b682095 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:02.484792 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c55cfa-5094-4cb8-ad89-fd9e07c1f3e6 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:02.501516 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c55cfa-5094-4cb8-ad89-fd9e07c1f3e6 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:02.718879 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b3e2b8-0982-4961-b398-0bf93c3b6ada tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:02.728658 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b3e2b8-0982-4961-b398-0bf93c3b6ada tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:02.728658 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b3e2b8-0982-4961-b398-0bf93c3b6ada tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:02.728658 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b3e2b8-0982-4961-b398-0bf93c3b6ada tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/projects/6f4b500359af402b8d57e382a9011442/groups/5fb9af0dc93b43c9929099bba80fdc28/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:02.729360 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f94580c-7489-473c-8a13-fbeb3dd5dc01 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:02.729360 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f94580c-7489-473c-8a13-fbeb3dd5dc01 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:02.729360 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f94580c-7489-473c-8a13-fbeb3dd5dc01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:02.743081 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b3e2b8-0982-4961-b398-0bf93c3b6ada tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:list_grants(project_id=6f4b500359af402b8d57e382a9011442, group_id=5fb9af0dc93b43c9929099bba80fdc28)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:02.765531 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b3e2b8-0982-4961-b398-0bf93c3b6ada tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:02.783452 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-0f94580c-7489-473c-8a13-fbeb3dd5dc01 None None] MFA Rules not processed for user `71080496c33c4e2c8b2e16b950f0b9ea`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:23:02.784811 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-0f94580c-7489-473c-8a13-fbeb3dd5dc01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:02.788907 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1906/3783] 10.222.0.52 () {58 vars in 1367 bytes} [Sat May 14 21:23:02 2022] GET /identity/v3/projects/6f4b500359af402b8d57e382a9011442/groups/5fb9af0dc93b43c9929099bba80fdc28/roles => generated 410 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:23:02.790052 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b3e2b8-0982-4961-b398-0bf93c3b6ada tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:02.801574 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b3e2b8-0982-4961-b398-0bf93c3b6ada tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:02.812722 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41239eaa-914d-4bc3-972a-7dabbb1d09f1 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:02.812722 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41239eaa-914d-4bc3-972a-7dabbb1d09f1 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:02.812722 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41239eaa-914d-4bc3-972a-7dabbb1d09f1 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:02.813289 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41239eaa-914d-4bc3-972a-7dabbb1d09f1 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/groups/5fb9af0dc93b43c9929099bba80fdc28/users/c93b213be1a94a1794b8760cb36c2b4e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:02.813289 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41239eaa-914d-4bc3-972a-7dabbb1d09f1 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=5fb9af0dc93b43c9929099bba80fdc28, user_id=c93b213be1a94a1794b8760cb36c2b4e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:02.814122 ncdv-master-1 devstack@keystone.service[91106]: WARNING py.warnings [None req-41239eaa-914d-4bc3-972a-7dabbb1d09f1 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 14 21:23:02.814122 ncdv-master-1 devstack@keystone.service[91106]: warnings.warn(msg) May 14 21:23:02.814122 ncdv-master-1 devstack@keystone.service[91106]: May 14 21:23:02.815691 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41239eaa-914d-4bc3-972a-7dabbb1d09f1 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:02.892016 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1878/3784] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:23:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:23:02.985703 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1907/3785] 10.222.0.52 () {60 vars in 1359 bytes} [Sat May 14 21:23:02 2022] PUT /identity/v3/groups/5fb9af0dc93b43c9929099bba80fdc28/users/c93b213be1a94a1794b8760cb36c2b4e => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:02.990333 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61eea9c-e2ff-44bd-b8c1-bb6df9d9ddb3 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:02.990869 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61eea9c-e2ff-44bd-b8c1-bb6df9d9ddb3 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:02.991308 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61eea9c-e2ff-44bd-b8c1-bb6df9d9ddb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:03.037016 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-d61eea9c-e2ff-44bd-b8c1-bb6df9d9ddb3 None None] MFA Rules not processed for user `c93b213be1a94a1794b8760cb36c2b4e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:23:03.038427 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-d61eea9c-e2ff-44bd-b8c1-bb6df9d9ddb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:03.202854 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1879/3786] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:23:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:23:03.207551 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41239eaa-914d-4bc3-972a-7dabbb1d09f1 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:03.301800 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41239eaa-914d-4bc3-972a-7dabbb1d09f1 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:03.307365 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f244a624-14e4-4804-a875-084536e4d0dc tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:03.308821 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f244a624-14e4-4804-a875-084536e4d0dc tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:03.309187 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f244a624-14e4-4804-a875-084536e4d0dc tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:03.309548 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f244a624-14e4-4804-a875-084536e4d0dc tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/projects/6f4b500359af402b8d57e382a9011442/groups/5fb9af0dc93b43c9929099bba80fdc28/roles/cd713768bc0c4c3d9bf993588b682095` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:03.313112 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f244a624-14e4-4804-a875-084536e4d0dc tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:check_grant(project_id=6f4b500359af402b8d57e382a9011442, group_id=5fb9af0dc93b43c9929099bba80fdc28, role_id=cd713768bc0c4c3d9bf993588b682095)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:03.318879 ncdv-master-1 devstack@keystone.service[91106]: WARNING py.warnings [None req-f244a624-14e4-4804-a875-084536e4d0dc tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 14 21:23:03.318879 ncdv-master-1 devstack@keystone.service[91106]: warnings.warn(msg) May 14 21:23:03.318879 ncdv-master-1 devstack@keystone.service[91106]: May 14 21:23:03.329601 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f244a624-14e4-4804-a875-084536e4d0dc tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:03.359583 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61eea9c-e2ff-44bd-b8c1-bb6df9d9ddb3 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:03.360341 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1908/3787] 10.222.0.52 () {58 vars in 1467 bytes} [Sat May 14 21:23:03 2022] HEAD /identity/v3/projects/6f4b500359af402b8d57e382a9011442/groups/5fb9af0dc93b43c9929099bba80fdc28/roles/cd713768bc0c4c3d9bf993588b682095 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:03.374808 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61eea9c-e2ff-44bd-b8c1-bb6df9d9ddb3 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:03.385033 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4785257c-06c4-49cc-85b9-4ee21f672b3f tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:03.386001 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4785257c-06c4-49cc-85b9-4ee21f672b3f tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:03.386545 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4785257c-06c4-49cc-85b9-4ee21f672b3f tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:03.386826 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4785257c-06c4-49cc-85b9-4ee21f672b3f tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/projects/6f4b500359af402b8d57e382a9011442/groups/5fb9af0dc93b43c9929099bba80fdc28/roles/cd713768bc0c4c3d9bf993588b682095` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:03.390100 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4785257c-06c4-49cc-85b9-4ee21f672b3f tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=6f4b500359af402b8d57e382a9011442, group_id=5fb9af0dc93b43c9929099bba80fdc28, role_id=cd713768bc0c4c3d9bf993588b682095)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:03.392504 ncdv-master-1 devstack@keystone.service[91107]: WARNING py.warnings [None req-4785257c-06c4-49cc-85b9-4ee21f672b3f tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 14 21:23:03.392504 ncdv-master-1 devstack@keystone.service[91107]: warnings.warn(msg) May 14 21:23:03.392504 ncdv-master-1 devstack@keystone.service[91107]: May 14 21:23:03.393161 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4785257c-06c4-49cc-85b9-4ee21f672b3f tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:03.399015 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4785257c-06c4-49cc-85b9-4ee21f672b3f tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invalidating the token cache because role cd713768bc0c4c3d9bf993588b682095 was removed from group 5fb9af0dc93b43c9929099bba80fdc28 on project 6f4b500359af402b8d57e382a9011442. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:23:03.399308 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4785257c-06c4-49cc-85b9-4ee21f672b3f tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:03.400231 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4785257c-06c4-49cc-85b9-4ee21f672b3f tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:03.501257 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1880/3788] 10.222.0.52 () {58 vars in 1469 bytes} [Sat May 14 21:23:03 2022] DELETE /identity/v3/projects/6f4b500359af402b8d57e382a9011442/groups/5fb9af0dc93b43c9929099bba80fdc28/roles/cd713768bc0c4c3d9bf993588b682095 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:23:03.506979 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f244a624-14e4-4804-a875-084536e4d0dc tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:03.510244 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-f244a624-14e4-4804-a875-084536e4d0dc tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:03.535724 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f244a624-14e4-4804-a875-084536e4d0dc tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:03.637388 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fafc81-621e-435d-a8c0-0fd1cd5b4686 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:03.639059 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fafc81-621e-435d-a8c0-0fd1cd5b4686 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:03.639649 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fafc81-621e-435d-a8c0-0fd1cd5b4686 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:03.640161 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fafc81-621e-435d-a8c0-0fd1cd5b4686 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/groups/5fb9af0dc93b43c9929099bba80fdc28/users/c93b213be1a94a1794b8760cb36c2b4e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:03.643273 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fafc81-621e-435d-a8c0-0fd1cd5b4686 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=5fb9af0dc93b43c9929099bba80fdc28, user_id=c93b213be1a94a1794b8760cb36c2b4e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:03.644361 ncdv-master-1 devstack@keystone.service[91106]: WARNING py.warnings [None req-55fafc81-621e-435d-a8c0-0fd1cd5b4686 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 14 21:23:03.644361 ncdv-master-1 devstack@keystone.service[91106]: warnings.warn(msg) May 14 21:23:03.644361 ncdv-master-1 devstack@keystone.service[91106]: May 14 21:23:03.645682 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fafc81-621e-435d-a8c0-0fd1cd5b4686 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:03.721069 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-55fafc81-621e-435d-a8c0-0fd1cd5b4686 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'c93b213be1a94a1794b8760cb36c2b4e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:03.811379 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1909/3789] 10.222.0.52 () {58 vars in 1343 bytes} [Sat May 14 21:23:03 2022] DELETE /identity/v3/groups/5fb9af0dc93b43c9929099bba80fdc28/users/c93b213be1a94a1794b8760cb36c2b4e => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:03.822155 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4785257c-06c4-49cc-85b9-4ee21f672b3f tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:03.831022 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4785257c-06c4-49cc-85b9-4ee21f672b3f tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:03.898374 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf6b956-6176-49eb-9bd6-fa1e3c21f3d5 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:03.899333 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf6b956-6176-49eb-9bd6-fa1e3c21f3d5 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:03.899653 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf6b956-6176-49eb-9bd6-fa1e3c21f3d5 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:03.899939 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf6b956-6176-49eb-9bd6-fa1e3c21f3d5 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/system/groups/5fb9af0dc93b43c9929099bba80fdc28/roles/cd713768bc0c4c3d9bf993588b682095` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:03.903130 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf6b956-6176-49eb-9bd6-fa1e3c21f3d5 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:create_system_grant_for_group(group_id=5fb9af0dc93b43c9929099bba80fdc28, role_id=cd713768bc0c4c3d9bf993588b682095)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:03.903736 ncdv-master-1 devstack@keystone.service[91107]: WARNING py.warnings [None req-dcf6b956-6176-49eb-9bd6-fa1e3c21f3d5 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:23:03.903736 ncdv-master-1 devstack@keystone.service[91107]: warnings.warn(msg) May 14 21:23:03.903736 ncdv-master-1 devstack@keystone.service[91107]: May 14 21:23:03.905209 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf6b956-6176-49eb-9bd6-fa1e3c21f3d5 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:04.017133 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1881/3790] 10.222.0.52 () {60 vars in 1380 bytes} [Sat May 14 21:23:03 2022] PUT /identity/v3/system/groups/5fb9af0dc93b43c9929099bba80fdc28/roles/cd713768bc0c4c3d9bf993588b682095 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:04.018868 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fafc81-621e-435d-a8c0-0fd1cd5b4686 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:04.038706 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fafc81-621e-435d-a8c0-0fd1cd5b4686 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:04.044980 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108c1c5-5c7e-41ca-aadd-72b8e3ab20ea tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:04.047206 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108c1c5-5c7e-41ca-aadd-72b8e3ab20ea tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:04.047707 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108c1c5-5c7e-41ca-aadd-72b8e3ab20ea tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:04.048134 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108c1c5-5c7e-41ca-aadd-72b8e3ab20ea tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/system/groups/5fb9af0dc93b43c9929099bba80fdc28/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:04.049567 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d108c1c5-5c7e-41ca-aadd-72b8e3ab20ea tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:list_system_grants_for_group(group_id=5fb9af0dc93b43c9929099bba80fdc28)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:04.053010 ncdv-master-1 devstack@keystone.service[91106]: WARNING py.warnings [None req-d108c1c5-5c7e-41ca-aadd-72b8e3ab20ea tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:23:04.053010 ncdv-master-1 devstack@keystone.service[91106]: warnings.warn(msg) May 14 21:23:04.053010 ncdv-master-1 devstack@keystone.service[91106]: May 14 21:23:04.053010 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d108c1c5-5c7e-41ca-aadd-72b8e3ab20ea tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:04.069281 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1910/3791] 10.222.0.52 () {58 vars in 1262 bytes} [Sat May 14 21:23:04 2022] GET /identity/v3/system/groups/5fb9af0dc93b43c9929099bba80fdc28/roles => generated 375 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:23:04.072973 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf6b956-6176-49eb-9bd6-fa1e3c21f3d5 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:04.090071 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf6b956-6176-49eb-9bd6-fa1e3c21f3d5 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:04.096737 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ece1d1-9e53-40fe-99ec-804d5346abc6 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:04.097117 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ece1d1-9e53-40fe-99ec-804d5346abc6 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:04.097788 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ece1d1-9e53-40fe-99ec-804d5346abc6 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:04.097908 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ece1d1-9e53-40fe-99ec-804d5346abc6 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/system/groups/5fb9af0dc93b43c9929099bba80fdc28/roles/cd713768bc0c4c3d9bf993588b682095` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:04.100550 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ece1d1-9e53-40fe-99ec-804d5346abc6 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:check_system_grant_for_group(group_id=5fb9af0dc93b43c9929099bba80fdc28, role_id=cd713768bc0c4c3d9bf993588b682095)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:04.101633 ncdv-master-1 devstack@keystone.service[91107]: WARNING py.warnings [None req-14ece1d1-9e53-40fe-99ec-804d5346abc6 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:23:04.101633 ncdv-master-1 devstack@keystone.service[91107]: warnings.warn(msg) May 14 21:23:04.101633 ncdv-master-1 devstack@keystone.service[91107]: May 14 21:23:04.102724 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ece1d1-9e53-40fe-99ec-804d5346abc6 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:04.110731 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1882/3792] 10.222.0.52 () {58 vars in 1362 bytes} [Sat May 14 21:23:04 2022] HEAD /identity/v3/system/groups/5fb9af0dc93b43c9929099bba80fdc28/roles/cd713768bc0c4c3d9bf993588b682095 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:04.114823 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108c1c5-5c7e-41ca-aadd-72b8e3ab20ea tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:04.128040 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108c1c5-5c7e-41ca-aadd-72b8e3ab20ea tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:04.133409 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa96963-906a-402c-811d-c9f642cfc84f tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:04.139429 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa96963-906a-402c-811d-c9f642cfc84f tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:04.139429 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa96963-906a-402c-811d-c9f642cfc84f tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:04.139429 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa96963-906a-402c-811d-c9f642cfc84f tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/system/groups/5fb9af0dc93b43c9929099bba80fdc28/roles/cd713768bc0c4c3d9bf993588b682095` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:04.139429 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa96963-906a-402c-811d-c9f642cfc84f tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_group(group_id=5fb9af0dc93b43c9929099bba80fdc28, role_id=cd713768bc0c4c3d9bf993588b682095)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:04.139841 ncdv-master-1 devstack@keystone.service[91106]: WARNING py.warnings [None req-6fa96963-906a-402c-811d-c9f642cfc84f tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:23:04.139841 ncdv-master-1 devstack@keystone.service[91106]: warnings.warn(msg) May 14 21:23:04.139841 ncdv-master-1 devstack@keystone.service[91106]: May 14 21:23:04.140250 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa96963-906a-402c-811d-c9f642cfc84f tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:04.212457 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1911/3793] 10.222.0.52 () {58 vars in 1364 bytes} [Sat May 14 21:23:04 2022] DELETE /identity/v3/system/groups/5fb9af0dc93b43c9929099bba80fdc28/roles/cd713768bc0c4c3d9bf993588b682095 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:23:04.232567 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ece1d1-9e53-40fe-99ec-804d5346abc6 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:04.245239 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ece1d1-9e53-40fe-99ec-804d5346abc6 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:04.252249 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f1af6-9ad1-442a-90cd-7b8884d64298 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:04.253177 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f1af6-9ad1-442a-90cd-7b8884d64298 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:04.253464 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f1af6-9ad1-442a-90cd-7b8884d64298 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:04.253741 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f1af6-9ad1-442a-90cd-7b8884d64298 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/domains/3605c64c28454cd5805bf3a4dea46ae1/users/c93b213be1a94a1794b8760cb36c2b4e/roles/cd713768bc0c4c3d9bf993588b682095` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:04.256916 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513f1af6-9ad1-442a-90cd-7b8884d64298 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=3605c64c28454cd5805bf3a4dea46ae1, user_id=c93b213be1a94a1794b8760cb36c2b4e, role_id=cd713768bc0c4c3d9bf993588b682095)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:04.260322 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513f1af6-9ad1-442a-90cd-7b8884d64298 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:04.418732 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1883/3794] 10.222.0.52 () {60 vars in 1479 bytes} [Sat May 14 21:23:04 2022] PUT /identity/v3/domains/3605c64c28454cd5805bf3a4dea46ae1/users/c93b213be1a94a1794b8760cb36c2b4e/roles/cd713768bc0c4c3d9bf993588b682095 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:04.425796 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa96963-906a-402c-811d-c9f642cfc84f tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:04.442941 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa96963-906a-402c-811d-c9f642cfc84f tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:04.563308 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66904398-dd1c-40e4-9125-6937bb862453 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:04.564564 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66904398-dd1c-40e4-9125-6937bb862453 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:04.565010 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66904398-dd1c-40e4-9125-6937bb862453 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:04.565450 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66904398-dd1c-40e4-9125-6937bb862453 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/domains/3605c64c28454cd5805bf3a4dea46ae1/users/c93b213be1a94a1794b8760cb36c2b4e/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:04.568801 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66904398-dd1c-40e4-9125-6937bb862453 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=3605c64c28454cd5805bf3a4dea46ae1, user_id=c93b213be1a94a1794b8760cb36c2b4e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:04.572162 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66904398-dd1c-40e4-9125-6937bb862453 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:04.600789 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1912/3795] 10.222.0.52 () {58 vars in 1361 bytes} [Sat May 14 21:23:04 2022] GET /identity/v3/domains/3605c64c28454cd5805bf3a4dea46ae1/users/c93b213be1a94a1794b8760cb36c2b4e/roles => generated 408 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:23:04.605219 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f1af6-9ad1-442a-90cd-7b8884d64298 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:04.622811 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f1af6-9ad1-442a-90cd-7b8884d64298 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:04.649011 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68502856-c67d-4a08-9422-2a5df623fdba tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:04.651314 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68502856-c67d-4a08-9422-2a5df623fdba tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:04.651649 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68502856-c67d-4a08-9422-2a5df623fdba tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:04.651932 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68502856-c67d-4a08-9422-2a5df623fdba tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/domains/3605c64c28454cd5805bf3a4dea46ae1/users/c93b213be1a94a1794b8760cb36c2b4e/roles/cd713768bc0c4c3d9bf993588b682095` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:04.661631 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68502856-c67d-4a08-9422-2a5df623fdba tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=3605c64c28454cd5805bf3a4dea46ae1, user_id=c93b213be1a94a1794b8760cb36c2b4e, role_id=cd713768bc0c4c3d9bf993588b682095)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:04.671466 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68502856-c67d-4a08-9422-2a5df623fdba tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:04.692848 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1884/3796] 10.222.0.52 () {58 vars in 1461 bytes} [Sat May 14 21:23:04 2022] HEAD /identity/v3/domains/3605c64c28454cd5805bf3a4dea46ae1/users/c93b213be1a94a1794b8760cb36c2b4e/roles/cd713768bc0c4c3d9bf993588b682095 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:04.697565 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66904398-dd1c-40e4-9125-6937bb862453 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:04.709799 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66904398-dd1c-40e4-9125-6937bb862453 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:04.725138 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed24c664-8425-4af4-b808-4cf64966d4e2 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:04.729225 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24c664-8425-4af4-b808-4cf64966d4e2 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:04.731524 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24c664-8425-4af4-b808-4cf64966d4e2 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:04.735819 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24c664-8425-4af4-b808-4cf64966d4e2 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/domains/3605c64c28454cd5805bf3a4dea46ae1/users/c93b213be1a94a1794b8760cb36c2b4e/roles/cd713768bc0c4c3d9bf993588b682095` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:04.740386 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed24c664-8425-4af4-b808-4cf64966d4e2 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=3605c64c28454cd5805bf3a4dea46ae1, user_id=c93b213be1a94a1794b8760cb36c2b4e, role_id=cd713768bc0c4c3d9bf993588b682095)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:04.759089 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed24c664-8425-4af4-b808-4cf64966d4e2 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:04.777644 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ed24c664-8425-4af4-b808-4cf64966d4e2 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invalidating the token cache because role cd713768bc0c4c3d9bf993588b682095 was removed from user c93b213be1a94a1794b8760cb36c2b4e on domain 3605c64c28454cd5805bf3a4dea46ae1. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:23:04.777944 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ed24c664-8425-4af4-b808-4cf64966d4e2 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:04.781478 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ed24c664-8425-4af4-b808-4cf64966d4e2 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:04.947976 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1913/3797] 10.222.0.52 () {58 vars in 1463 bytes} [Sat May 14 21:23:04 2022] DELETE /identity/v3/domains/3605c64c28454cd5805bf3a4dea46ae1/users/c93b213be1a94a1794b8760cb36c2b4e/roles/cd713768bc0c4c3d9bf993588b682095 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:04.955276 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68502856-c67d-4a08-9422-2a5df623fdba tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:04.959438 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-68502856-c67d-4a08-9422-2a5df623fdba tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:04.979373 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68502856-c67d-4a08-9422-2a5df623fdba tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:05.079880 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561834d1-b88f-4ace-845d-531e6b79da30 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:05.080792 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561834d1-b88f-4ace-845d-531e6b79da30 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:05.081078 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561834d1-b88f-4ace-845d-531e6b79da30 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:05.081358 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561834d1-b88f-4ace-845d-531e6b79da30 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/projects/6f4b500359af402b8d57e382a9011442/users/c93b213be1a94a1794b8760cb36c2b4e/roles/cd713768bc0c4c3d9bf993588b682095` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:05.083991 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561834d1-b88f-4ace-845d-531e6b79da30 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:create_grant(project_id=6f4b500359af402b8d57e382a9011442, user_id=c93b213be1a94a1794b8760cb36c2b4e, role_id=cd713768bc0c4c3d9bf993588b682095)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:05.087259 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561834d1-b88f-4ace-845d-531e6b79da30 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:05.163404 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1885/3798] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:23:04 2022] PUT /identity/v3/projects/6f4b500359af402b8d57e382a9011442/users/c93b213be1a94a1794b8760cb36c2b4e/roles/cd713768bc0c4c3d9bf993588b682095 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:05.168080 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed24c664-8425-4af4-b808-4cf64966d4e2 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:05.183654 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed24c664-8425-4af4-b808-4cf64966d4e2 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:05.322062 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede29ac5-e669-4b3c-8f78-1d3c03dc0088 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:05.323341 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede29ac5-e669-4b3c-8f78-1d3c03dc0088 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:05.323723 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede29ac5-e669-4b3c-8f78-1d3c03dc0088 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:05.324010 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede29ac5-e669-4b3c-8f78-1d3c03dc0088 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/projects/6f4b500359af402b8d57e382a9011442/users/c93b213be1a94a1794b8760cb36c2b4e/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:05.326889 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede29ac5-e669-4b3c-8f78-1d3c03dc0088 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:list_grants(project_id=6f4b500359af402b8d57e382a9011442, user_id=c93b213be1a94a1794b8760cb36c2b4e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:05.329900 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede29ac5-e669-4b3c-8f78-1d3c03dc0088 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:05.355948 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1914/3799] 10.222.0.52 () {58 vars in 1364 bytes} [Sat May 14 21:23:05 2022] GET /identity/v3/projects/6f4b500359af402b8d57e382a9011442/users/c93b213be1a94a1794b8760cb36c2b4e/roles => generated 409 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:23:05.356162 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561834d1-b88f-4ace-845d-531e6b79da30 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:05.368275 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561834d1-b88f-4ace-845d-531e6b79da30 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:05.383333 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d624cb-979c-4f8e-8424-ef5ec490dd8f tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:05.384447 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d624cb-979c-4f8e-8424-ef5ec490dd8f tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:05.384746 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d624cb-979c-4f8e-8424-ef5ec490dd8f tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:05.385019 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d624cb-979c-4f8e-8424-ef5ec490dd8f tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/projects/6f4b500359af402b8d57e382a9011442/users/c93b213be1a94a1794b8760cb36c2b4e/roles/cd713768bc0c4c3d9bf993588b682095` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:05.390698 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d624cb-979c-4f8e-8424-ef5ec490dd8f tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:check_grant(project_id=6f4b500359af402b8d57e382a9011442, user_id=c93b213be1a94a1794b8760cb36c2b4e, role_id=cd713768bc0c4c3d9bf993588b682095)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:05.393975 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d624cb-979c-4f8e-8424-ef5ec490dd8f tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:05.409928 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1886/3800] 10.222.0.52 () {58 vars in 1464 bytes} [Sat May 14 21:23:05 2022] HEAD /identity/v3/projects/6f4b500359af402b8d57e382a9011442/users/c93b213be1a94a1794b8760cb36c2b4e/roles/cd713768bc0c4c3d9bf993588b682095 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:23:05.411109 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede29ac5-e669-4b3c-8f78-1d3c03dc0088 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:05.424228 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede29ac5-e669-4b3c-8f78-1d3c03dc0088 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:05.437782 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd469b-3fb4-4406-8d0f-480c95b1e54e tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:05.439975 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd469b-3fb4-4406-8d0f-480c95b1e54e tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:05.442701 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd469b-3fb4-4406-8d0f-480c95b1e54e tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:05.442701 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd469b-3fb4-4406-8d0f-480c95b1e54e tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/projects/6f4b500359af402b8d57e382a9011442/users/c93b213be1a94a1794b8760cb36c2b4e/roles/cd713768bc0c4c3d9bf993588b682095` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:05.444031 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cd469b-3fb4-4406-8d0f-480c95b1e54e tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=6f4b500359af402b8d57e382a9011442, user_id=c93b213be1a94a1794b8760cb36c2b4e, role_id=cd713768bc0c4c3d9bf993588b682095)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:05.446826 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cd469b-3fb4-4406-8d0f-480c95b1e54e tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:05.454069 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b8cd469b-3fb4-4406-8d0f-480c95b1e54e tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invalidating the token cache because role cd713768bc0c4c3d9bf993588b682095 was removed from user c93b213be1a94a1794b8760cb36c2b4e on project 6f4b500359af402b8d57e382a9011442. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:23:05.454396 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b8cd469b-3fb4-4406-8d0f-480c95b1e54e tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:05.455810 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b8cd469b-3fb4-4406-8d0f-480c95b1e54e tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:05.643016 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1915/3801] 10.222.0.52 () {58 vars in 1466 bytes} [Sat May 14 21:23:05 2022] DELETE /identity/v3/projects/6f4b500359af402b8d57e382a9011442/users/c93b213be1a94a1794b8760cb36c2b4e/roles/cd713768bc0c4c3d9bf993588b682095 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:05.649836 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d624cb-979c-4f8e-8424-ef5ec490dd8f tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:05.652493 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-29d624cb-979c-4f8e-8424-ef5ec490dd8f tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:05.683285 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d624cb-979c-4f8e-8424-ef5ec490dd8f tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:05.791513 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bae7ba-0b88-421c-a75c-323eb92f65c1 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:05.792829 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bae7ba-0b88-421c-a75c-323eb92f65c1 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:05.793300 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bae7ba-0b88-421c-a75c-323eb92f65c1 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:05.793733 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bae7ba-0b88-421c-a75c-323eb92f65c1 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/system/users/c93b213be1a94a1794b8760cb36c2b4e/roles/cd713768bc0c4c3d9bf993588b682095` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:05.796387 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bae7ba-0b88-421c-a75c-323eb92f65c1 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c93b213be1a94a1794b8760cb36c2b4e, role_id=cd713768bc0c4c3d9bf993588b682095)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:05.799187 ncdv-master-1 devstack@keystone.service[91107]: WARNING py.warnings [None req-c4bae7ba-0b88-421c-a75c-323eb92f65c1 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:23:05.799187 ncdv-master-1 devstack@keystone.service[91107]: warnings.warn(msg) May 14 21:23:05.799187 ncdv-master-1 devstack@keystone.service[91107]: May 14 21:23:05.802066 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bae7ba-0b88-421c-a75c-323eb92f65c1 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:05.969193 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1887/3802] 10.222.0.52 () {60 vars in 1377 bytes} [Sat May 14 21:23:05 2022] PUT /identity/v3/system/users/c93b213be1a94a1794b8760cb36c2b4e/roles/cd713768bc0c4c3d9bf993588b682095 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:05.972655 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd469b-3fb4-4406-8d0f-480c95b1e54e tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:05.984530 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd469b-3fb4-4406-8d0f-480c95b1e54e tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:05.990258 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a59626-8968-4705-95f0-eac7d5e4aad9 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:05.991352 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a59626-8968-4705-95f0-eac7d5e4aad9 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:05.992098 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a59626-8968-4705-95f0-eac7d5e4aad9 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:05.992596 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a59626-8968-4705-95f0-eac7d5e4aad9 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/system/users/c93b213be1a94a1794b8760cb36c2b4e/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:05.994376 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a59626-8968-4705-95f0-eac7d5e4aad9 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:list_system_grants_for_user(user_id=c93b213be1a94a1794b8760cb36c2b4e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:05.995646 ncdv-master-1 devstack@keystone.service[91106]: WARNING py.warnings [None req-24a59626-8968-4705-95f0-eac7d5e4aad9 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:23:05.995646 ncdv-master-1 devstack@keystone.service[91106]: warnings.warn(msg) May 14 21:23:05.995646 ncdv-master-1 devstack@keystone.service[91106]: May 14 21:23:05.996905 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a59626-8968-4705-95f0-eac7d5e4aad9 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:06.016513 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bae7ba-0b88-421c-a75c-323eb92f65c1 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:06.017482 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1916/3803] 10.222.0.52 () {58 vars in 1259 bytes} [Sat May 14 21:23:05 2022] GET /identity/v3/system/users/c93b213be1a94a1794b8760cb36c2b4e/roles => generated 374 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:23:06.031581 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bae7ba-0b88-421c-a75c-323eb92f65c1 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:06.043559 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a137b49-53b5-4466-8048-f2fdf03602d3 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:06.043559 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a137b49-53b5-4466-8048-f2fdf03602d3 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:06.043559 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a137b49-53b5-4466-8048-f2fdf03602d3 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:06.043872 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a137b49-53b5-4466-8048-f2fdf03602d3 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/system/users/c93b213be1a94a1794b8760cb36c2b4e/roles/cd713768bc0c4c3d9bf993588b682095` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:06.047423 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a137b49-53b5-4466-8048-f2fdf03602d3 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:check_system_grant_for_user(user_id=c93b213be1a94a1794b8760cb36c2b4e, role_id=cd713768bc0c4c3d9bf993588b682095)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:06.049139 ncdv-master-1 devstack@keystone.service[91107]: WARNING py.warnings [None req-8a137b49-53b5-4466-8048-f2fdf03602d3 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:23:06.049139 ncdv-master-1 devstack@keystone.service[91107]: warnings.warn(msg) May 14 21:23:06.049139 ncdv-master-1 devstack@keystone.service[91107]: May 14 21:23:06.050511 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a137b49-53b5-4466-8048-f2fdf03602d3 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:06.056638 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1888/3804] 10.222.0.52 () {58 vars in 1359 bytes} [Sat May 14 21:23:06 2022] HEAD /identity/v3/system/users/c93b213be1a94a1794b8760cb36c2b4e/roles/cd713768bc0c4c3d9bf993588b682095 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:06.062671 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a59626-8968-4705-95f0-eac7d5e4aad9 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:06.093389 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a59626-8968-4705-95f0-eac7d5e4aad9 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:06.110914 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f10d60-f480-46ba-9aaf-b321a1b8533b tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:06.116108 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f10d60-f480-46ba-9aaf-b321a1b8533b tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:06.116108 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f10d60-f480-46ba-9aaf-b321a1b8533b tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:06.116108 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f10d60-f480-46ba-9aaf-b321a1b8533b tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/system/users/c93b213be1a94a1794b8760cb36c2b4e/roles/cd713768bc0c4c3d9bf993588b682095` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:06.116108 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f10d60-f480-46ba-9aaf-b321a1b8533b tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_user(user_id=c93b213be1a94a1794b8760cb36c2b4e, role_id=cd713768bc0c4c3d9bf993588b682095)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:06.116907 ncdv-master-1 devstack@keystone.service[91106]: WARNING py.warnings [None req-45f10d60-f480-46ba-9aaf-b321a1b8533b tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:23:06.116907 ncdv-master-1 devstack@keystone.service[91106]: warnings.warn(msg) May 14 21:23:06.116907 ncdv-master-1 devstack@keystone.service[91106]: May 14 21:23:06.118157 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f10d60-f480-46ba-9aaf-b321a1b8533b tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:06.227241 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a137b49-53b5-4466-8048-f2fdf03602d3 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:06.228960 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1917/3805] 10.222.0.52 () {58 vars in 1361 bytes} [Sat May 14 21:23:06 2022] DELETE /identity/v3/system/users/c93b213be1a94a1794b8760cb36c2b4e/roles/cd713768bc0c4c3d9bf993588b682095 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:06.242361 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a137b49-53b5-4466-8048-f2fdf03602d3 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:06.259394 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7b5127-7838-4912-875b-69a3ac09b890 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:06.259394 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b5127-7838-4912-875b-69a3ac09b890 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:06.259394 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b5127-7838-4912-875b-69a3ac09b890 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:06.259746 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b5127-7838-4912-875b-69a3ac09b890 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:06.259746 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7b5127-7838-4912-875b-69a3ac09b890 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:06.259746 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7b5127-7838-4912-875b-69a3ac09b890 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:06.359457 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f10d60-f480-46ba-9aaf-b321a1b8533b tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:06.364259 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1889/3806] 10.222.0.52 () {60 vars in 1142 bytes} [Sat May 14 21:23:06 2022] POST /identity/v3/roles => generated 270 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:23:06.388761 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f10d60-f480-46ba-9aaf-b321a1b8533b tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:06.410272 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79868435-dff0-4e81-a66d-b7cfce1674b3 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:06.411411 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79868435-dff0-4e81-a66d-b7cfce1674b3 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:06.412191 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79868435-dff0-4e81-a66d-b7cfce1674b3 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:06.412480 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79868435-dff0-4e81-a66d-b7cfce1674b3 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:06.413235 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79868435-dff0-4e81-a66d-b7cfce1674b3 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:06.414330 ncdv-master-1 devstack@keystone.service[91106]: WARNING py.warnings [None req-79868435-dff0-4e81-a66d-b7cfce1674b3 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:23:06.414330 ncdv-master-1 devstack@keystone.service[91106]: warnings.warn(msg) May 14 21:23:06.414330 ncdv-master-1 devstack@keystone.service[91106]: May 14 21:23:06.415506 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79868435-dff0-4e81-a66d-b7cfce1674b3 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:06.534888 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1918/3807] 10.222.0.52 () {60 vars in 1142 bytes} [Sat May 14 21:23:06 2022] POST /identity/v3/roles => generated 269 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:23:06.538938 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7b5127-7838-4912-875b-69a3ac09b890 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:06.552676 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7b5127-7838-4912-875b-69a3ac09b890 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:06.558713 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2585e0f-2860-4120-86d5-05aafef601fb tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:06.559698 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2585e0f-2860-4120-86d5-05aafef601fb tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:06.559988 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2585e0f-2860-4120-86d5-05aafef601fb tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:06.560970 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2585e0f-2860-4120-86d5-05aafef601fb tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/roles/b36c93b4bb5d40659021f52bb29375c9/implies/228b0b0a2b6140c8bd44c8611e220b3a` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:06.563602 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2585e0f-2860-4120-86d5-05aafef601fb tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=b36c93b4bb5d40659021f52bb29375c9, implied_role_id=228b0b0a2b6140c8bd44c8611e220b3a)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:06.565402 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2585e0f-2860-4120-86d5-05aafef601fb tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:06.722215 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1890/3808] 10.222.0.52 () {60 vars in 1362 bytes} [Sat May 14 21:23:06 2022] PUT /identity/v3/roles/b36c93b4bb5d40659021f52bb29375c9/implies/228b0b0a2b6140c8bd44c8611e220b3a => generated 530 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:23:06.726395 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79868435-dff0-4e81-a66d-b7cfce1674b3 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:06.736739 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79868435-dff0-4e81-a66d-b7cfce1674b3 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:06.832573 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10516283-0525-4500-b0bd-452d8b2ea3f9 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:06.833772 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10516283-0525-4500-b0bd-452d8b2ea3f9 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:06.834433 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10516283-0525-4500-b0bd-452d8b2ea3f9 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:06.834887 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10516283-0525-4500-b0bd-452d8b2ea3f9 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:06.835912 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10516283-0525-4500-b0bd-452d8b2ea3f9 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:06.837310 ncdv-master-1 devstack@keystone.service[91106]: WARNING py.warnings [None req-10516283-0525-4500-b0bd-452d8b2ea3f9 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:23:06.837310 ncdv-master-1 devstack@keystone.service[91106]: warnings.warn(msg) May 14 21:23:06.837310 ncdv-master-1 devstack@keystone.service[91106]: May 14 21:23:06.839352 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10516283-0525-4500-b0bd-452d8b2ea3f9 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:07.006350 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1919/3809] 10.222.0.52 () {60 vars in 1148 bytes} [Sat May 14 21:23:06 2022] POST /identity/v3/domains => generated 275 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:23:07.011242 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2585e0f-2860-4120-86d5-05aafef601fb tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:07.027528 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2585e0f-2860-4120-86d5-05aafef601fb tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:07.192699 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5174575f-c3c5-4171-ace4-19ac0da7b511 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:07.194933 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5174575f-c3c5-4171-ace4-19ac0da7b511 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:07.195434 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5174575f-c3c5-4171-ace4-19ac0da7b511 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:07.195964 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5174575f-c3c5-4171-ace4-19ac0da7b511 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:07.204782 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5174575f-c3c5-4171-ace4-19ac0da7b511 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:07.213181 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5174575f-c3c5-4171-ace4-19ac0da7b511 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:07.332913 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10516283-0525-4500-b0bd-452d8b2ea3f9 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:07.343679 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1891/3810] 10.222.0.52 () {60 vars in 1142 bytes} [Sat May 14 21:23:07 2022] POST /identity/v3/roles => generated 269 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:23:07.351975 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10516283-0525-4500-b0bd-452d8b2ea3f9 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:07.356724 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ff131f-c654-4826-bf06-b71f306bd881 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:07.358155 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff131f-c654-4826-bf06-b71f306bd881 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:07.358155 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff131f-c654-4826-bf06-b71f306bd881 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:07.358471 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff131f-c654-4826-bf06-b71f306bd881 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/roles/b36c93b4bb5d40659021f52bb29375c9/implies/60e655059523423b9d0818b09568c865` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:07.360768 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ff131f-c654-4826-bf06-b71f306bd881 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=b36c93b4bb5d40659021f52bb29375c9, implied_role_id=60e655059523423b9d0818b09568c865)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:07.362065 ncdv-master-1 devstack@keystone.service[91106]: WARNING py.warnings [None req-29ff131f-c654-4826-bf06-b71f306bd881 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:23:07.362065 ncdv-master-1 devstack@keystone.service[91106]: warnings.warn(msg) May 14 21:23:07.362065 ncdv-master-1 devstack@keystone.service[91106]: May 14 21:23:07.364897 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ff131f-c654-4826-bf06-b71f306bd881 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:07.455111 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1920/3811] 10.222.0.52 () {60 vars in 1362 bytes} [Sat May 14 21:23:07 2022] PUT /identity/v3/roles/b36c93b4bb5d40659021f52bb29375c9/implies/60e655059523423b9d0818b09568c865 => generated 530 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:23:07.461604 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5174575f-c3c5-4171-ace4-19ac0da7b511 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:07.484050 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5174575f-c3c5-4171-ace4-19ac0da7b511 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:07.556515 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c06e76-97a9-4cb1-9844-291525224980 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:07.557456 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c06e76-97a9-4cb1-9844-291525224980 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:07.557723 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c06e76-97a9-4cb1-9844-291525224980 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:07.558000 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c06e76-97a9-4cb1-9844-291525224980 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/roles/b36c93b4bb5d40659021f52bb29375c9/implies/cd713768bc0c4c3d9bf993588b682095` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:07.563515 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c06e76-97a9-4cb1-9844-291525224980 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=b36c93b4bb5d40659021f52bb29375c9, implied_role_id=cd713768bc0c4c3d9bf993588b682095)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:07.565173 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c06e76-97a9-4cb1-9844-291525224980 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:07.689056 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1892/3812] 10.222.0.52 () {60 vars in 1362 bytes} [Sat May 14 21:23:07 2022] PUT /identity/v3/roles/b36c93b4bb5d40659021f52bb29375c9/implies/cd713768bc0c4c3d9bf993588b682095 => generated 525 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:23:07.689148 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ff131f-c654-4826-bf06-b71f306bd881 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:07.707789 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ff131f-c654-4826-bf06-b71f306bd881 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:07.836097 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd96c3-1b05-4c16-ba7b-687f3de8fcbc tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:07.837638 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd96c3-1b05-4c16-ba7b-687f3de8fcbc tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:07.838176 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd96c3-1b05-4c16-ba7b-687f3de8fcbc tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:07.838686 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd96c3-1b05-4c16-ba7b-687f3de8fcbc tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/roles/cd713768bc0c4c3d9bf993588b682095/implies/b36c93b4bb5d40659021f52bb29375c9` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:07.841380 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fd96c3-1b05-4c16-ba7b-687f3de8fcbc tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=cd713768bc0c4c3d9bf993588b682095, implied_role_id=b36c93b4bb5d40659021f52bb29375c9)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:07.845846 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fd96c3-1b05-4c16-ba7b-687f3de8fcbc tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:07.890113 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-e9fd96c3-1b05-4c16-ba7b-687f3de8fcbc tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] b36c93b4bb5d40659021f52bb29375c9 cannot be an implied roles.: keystone.exception.InvalidImpliedRole: b36c93b4bb5d40659021f52bb29375c9 cannot be an implied roles. May 14 21:23:07.890113 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:23:07.890113 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 21:23:07.890113 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 21:23:07.890113 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 21:23:07.890113 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 21:23:07.890113 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 21:23:07.890113 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 21:23:07.890113 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 21:23:07.890113 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 21:23:07.890113 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 21:23:07.890113 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 21:23:07.890113 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 259, in put May 14 21:23:07.890113 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application PROVIDERS.role_api.create_implied_role(prior_role_id, implied_role_id) May 14 21:23:07.891573 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 21:23:07.891573 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 21:23:07.891573 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1361, in create_implied_role May 14 21:23:07.891573 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.InvalidImpliedRole(msg, May 14 21:23:07.891573 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.InvalidImpliedRole: b36c93b4bb5d40659021f52bb29375c9 cannot be an implied roles. May 14 21:23:07.891573 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:23:07.893526 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1921/3813] 10.222.0.52 () {60 vars in 1362 bytes} [Sat May 14 21:23:07 2022] PUT /identity/v3/roles/cd713768bc0c4c3d9bf993588b682095/implies/b36c93b4bb5d40659021f52bb29375c9 => generated 116 bytes in 209 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) May 14 21:23:07.897834 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c06e76-97a9-4cb1-9844-291525224980 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:07.910158 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c06e76-97a9-4cb1-9844-291525224980 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:07.916711 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee29746f-185d-4fa3-945f-2e2a2d466d74 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:07.930586 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29746f-185d-4fa3-945f-2e2a2d466d74 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:07.930586 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29746f-185d-4fa3-945f-2e2a2d466d74 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:07.930586 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29746f-185d-4fa3-945f-2e2a2d466d74 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/roles/b36c93b4bb5d40659021f52bb29375c9/implies/cd713768bc0c4c3d9bf993588b682095` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:07.947272 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee29746f-185d-4fa3-945f-2e2a2d466d74 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=b36c93b4bb5d40659021f52bb29375c9, implied_role_id=cd713768bc0c4c3d9bf993588b682095)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:07.962349 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee29746f-185d-4fa3-945f-2e2a2d466d74 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:08.059721 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1893/3814] 10.222.0.52 () {58 vars in 1346 bytes} [Sat May 14 21:23:07 2022] DELETE /identity/v3/roles/b36c93b4bb5d40659021f52bb29375c9/implies/cd713768bc0c4c3d9bf993588b682095 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:08.064407 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd96c3-1b05-4c16-ba7b-687f3de8fcbc tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:08.080090 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd96c3-1b05-4c16-ba7b-687f3de8fcbc tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:08.163422 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d7a2e5-13a5-4d8f-8674-77c42b7f68e7 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:08.165041 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d7a2e5-13a5-4d8f-8674-77c42b7f68e7 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:08.165398 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d7a2e5-13a5-4d8f-8674-77c42b7f68e7 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:08.165777 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d7a2e5-13a5-4d8f-8674-77c42b7f68e7 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/roles/b36c93b4bb5d40659021f52bb29375c9/implies/60e655059523423b9d0818b09568c865` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:08.168793 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d7a2e5-13a5-4d8f-8674-77c42b7f68e7 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=b36c93b4bb5d40659021f52bb29375c9, implied_role_id=60e655059523423b9d0818b09568c865)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:08.171924 ncdv-master-1 devstack@keystone.service[91106]: WARNING py.warnings [None req-e7d7a2e5-13a5-4d8f-8674-77c42b7f68e7 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:23:08.171924 ncdv-master-1 devstack@keystone.service[91106]: warnings.warn(msg) May 14 21:23:08.171924 ncdv-master-1 devstack@keystone.service[91106]: May 14 21:23:08.174047 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d7a2e5-13a5-4d8f-8674-77c42b7f68e7 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:08.259973 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1922/3815] 10.222.0.52 () {58 vars in 1346 bytes} [Sat May 14 21:23:08 2022] DELETE /identity/v3/roles/b36c93b4bb5d40659021f52bb29375c9/implies/60e655059523423b9d0818b09568c865 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:08.266214 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee29746f-185d-4fa3-945f-2e2a2d466d74 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:08.284998 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee29746f-185d-4fa3-945f-2e2a2d466d74 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:08.372346 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3092f952-9567-46ca-843b-82b7ba365234 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:08.373161 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3092f952-9567-46ca-843b-82b7ba365234 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:08.373520 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3092f952-9567-46ca-843b-82b7ba365234 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:08.373851 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3092f952-9567-46ca-843b-82b7ba365234 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/roles/60e655059523423b9d0818b09568c865` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:08.375132 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3092f952-9567-46ca-843b-82b7ba365234 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=60e655059523423b9d0818b09568c865)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:08.391194 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3092f952-9567-46ca-843b-82b7ba365234 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:08.510289 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3092f952-9567-46ca-843b-82b7ba365234 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invalidating the token cache because role 60e655059523423b9d0818b09568c865 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:23:08.510837 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3092f952-9567-46ca-843b-82b7ba365234 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:08.512328 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3092f952-9567-46ca-843b-82b7ba365234 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:08.515857 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1894/3816] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:23:08 2022] DELETE /identity/v3/roles/60e655059523423b9d0818b09568c865 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:08.519702 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d7a2e5-13a5-4d8f-8674-77c42b7f68e7 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:08.521738 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e7d7a2e5-13a5-4d8f-8674-77c42b7f68e7 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:08.538476 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d7a2e5-13a5-4d8f-8674-77c42b7f68e7 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:08.634814 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73969514-1f76-4c48-87de-23c750b68f40 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:08.636143 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73969514-1f76-4c48-87de-23c750b68f40 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:08.637104 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73969514-1f76-4c48-87de-23c750b68f40 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:08.637682 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73969514-1f76-4c48-87de-23c750b68f40 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/domains/7d80d5aeffad4783880afec94d88c61e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:08.651449 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73969514-1f76-4c48-87de-23c750b68f40 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=7d80d5aeffad4783880afec94d88c61e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:08.653779 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73969514-1f76-4c48-87de-23c750b68f40 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:08.746944 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-73969514-1f76-4c48-87de-23c750b68f40 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '7d80d5aeffad4783880afec94d88c61e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:08.752178 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-73969514-1f76-4c48-87de-23c750b68f40 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '7d80d5aeffad4783880afec94d88c61e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:08.972962 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-73969514-1f76-4c48-87de-23c750b68f40 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '7d80d5aeffad4783880afec94d88c61e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:08.976467 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-73969514-1f76-4c48-87de-23c750b68f40 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '7d80d5aeffad4783880afec94d88c61e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:08.983227 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1923/3817] 10.222.0.52 () {60 vars in 1248 bytes} [Sat May 14 21:23:08 2022] PATCH /identity/v3/domains/7d80d5aeffad4783880afec94d88c61e => generated 276 bytes in 464 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:23:08.987778 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3092f952-9567-46ca-843b-82b7ba365234 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:09.003681 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3092f952-9567-46ca-843b-82b7ba365234 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:09.180083 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea945dc-e38a-470f-8c35-87bab1f40ced tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:09.182211 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea945dc-e38a-470f-8c35-87bab1f40ced tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:09.182802 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea945dc-e38a-470f-8c35-87bab1f40ced tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:09.184718 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea945dc-e38a-470f-8c35-87bab1f40ced tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/domains/7d80d5aeffad4783880afec94d88c61e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:09.213815 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea945dc-e38a-470f-8c35-87bab1f40ced tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=7d80d5aeffad4783880afec94d88c61e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:09.220108 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea945dc-e38a-470f-8c35-87bab1f40ced tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:09.269746 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3ea945dc-e38a-470f-8c35-87bab1f40ced tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '7d80d5aeffad4783880afec94d88c61e'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:09.283737 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3ea945dc-e38a-470f-8c35-87bab1f40ced tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '7d80d5aeffad4783880afec94d88c61e'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:09.440575 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3ea945dc-e38a-470f-8c35-87bab1f40ced tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d80d5aeffad4783880afec94d88c61e', 'request_id': 'req-3ea945dc-e38a-470f-8c35-87bab1f40ced'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:09.450854 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3ea945dc-e38a-470f-8c35-87bab1f40ced tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d80d5aeffad4783880afec94d88c61e', 'request_id': 'req-3ea945dc-e38a-470f-8c35-87bab1f40ced'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:09.461645 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3ea945dc-e38a-470f-8c35-87bab1f40ced tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d80d5aeffad4783880afec94d88c61e', 'request_id': 'req-3ea945dc-e38a-470f-8c35-87bab1f40ced'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:09.566882 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3ea945dc-e38a-470f-8c35-87bab1f40ced tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] The token cache is being invalidate because project 7d80d5aeffad4783880afec94d88c61e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:23:09.567150 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3ea945dc-e38a-470f-8c35-87bab1f40ced tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:09.567856 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3ea945dc-e38a-470f-8c35-87bab1f40ced tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:09.580559 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3ea945dc-e38a-470f-8c35-87bab1f40ced tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '7d80d5aeffad4783880afec94d88c61e', 'request_id': 'req-3ea945dc-e38a-470f-8c35-87bab1f40ced'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:09.581311 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3ea945dc-e38a-470f-8c35-87bab1f40ced tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '7d80d5aeffad4783880afec94d88c61e', 'request_id': 'req-3ea945dc-e38a-470f-8c35-87bab1f40ced'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:09.586275 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3ea945dc-e38a-470f-8c35-87bab1f40ced tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '7d80d5aeffad4783880afec94d88c61e', 'request_id': 'req-3ea945dc-e38a-470f-8c35-87bab1f40ced'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:09.598239 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1895/3818] 10.222.0.52 () {58 vars in 1229 bytes} [Sat May 14 21:23:08 2022] DELETE /identity/v3/domains/7d80d5aeffad4783880afec94d88c61e => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:09.599372 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73969514-1f76-4c48-87de-23c750b68f40 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:09.601052 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-73969514-1f76-4c48-87de-23c750b68f40 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:09.615354 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73969514-1f76-4c48-87de-23c750b68f40 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:09.695363 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd55296-93a1-46ed-a964-c79e7b96b4a7 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:09.696720 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd55296-93a1-46ed-a964-c79e7b96b4a7 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:09.697186 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd55296-93a1-46ed-a964-c79e7b96b4a7 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:09.697628 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd55296-93a1-46ed-a964-c79e7b96b4a7 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/roles/b36c93b4bb5d40659021f52bb29375c9/implies/228b0b0a2b6140c8bd44c8611e220b3a` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:09.700820 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd55296-93a1-46ed-a964-c79e7b96b4a7 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=b36c93b4bb5d40659021f52bb29375c9, implied_role_id=228b0b0a2b6140c8bd44c8611e220b3a)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:09.708423 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd55296-93a1-46ed-a964-c79e7b96b4a7 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:09.832697 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1924/3819] 10.222.0.52 () {58 vars in 1346 bytes} [Sat May 14 21:23:09 2022] DELETE /identity/v3/roles/b36c93b4bb5d40659021f52bb29375c9/implies/228b0b0a2b6140c8bd44c8611e220b3a => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:09.845755 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea945dc-e38a-470f-8c35-87bab1f40ced tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:09.845755 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-3ea945dc-e38a-470f-8c35-87bab1f40ced tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:09.875699 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea945dc-e38a-470f-8c35-87bab1f40ced tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:10.022692 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb08be4-77c8-42cc-8ca5-dd38506e9068 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:10.024216 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb08be4-77c8-42cc-8ca5-dd38506e9068 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:10.025069 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb08be4-77c8-42cc-8ca5-dd38506e9068 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:10.025492 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb08be4-77c8-42cc-8ca5-dd38506e9068 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/roles/228b0b0a2b6140c8bd44c8611e220b3a` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:10.027057 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb08be4-77c8-42cc-8ca5-dd38506e9068 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=228b0b0a2b6140c8bd44c8611e220b3a)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:10.028981 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb08be4-77c8-42cc-8ca5-dd38506e9068 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:10.200225 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-1eb08be4-77c8-42cc-8ca5-dd38506e9068 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invalidating the token cache because role 228b0b0a2b6140c8bd44c8611e220b3a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:23:10.200442 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-1eb08be4-77c8-42cc-8ca5-dd38506e9068 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:10.202098 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-1eb08be4-77c8-42cc-8ca5-dd38506e9068 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:10.205085 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1896/3820] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:23:09 2022] DELETE /identity/v3/roles/228b0b0a2b6140c8bd44c8611e220b3a => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:10.209651 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd55296-93a1-46ed-a964-c79e7b96b4a7 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:10.211861 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-cbd55296-93a1-46ed-a964-c79e7b96b4a7 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:10.236438 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd55296-93a1-46ed-a964-c79e7b96b4a7 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:10.376677 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba9712e-aa6d-4942-bde3-cc57afffbfb9 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:10.377737 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9712e-aa6d-4942-bde3-cc57afffbfb9 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:10.378480 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9712e-aa6d-4942-bde3-cc57afffbfb9 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:10.378933 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9712e-aa6d-4942-bde3-cc57afffbfb9 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/roles/b36c93b4bb5d40659021f52bb29375c9` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:10.380526 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba9712e-aa6d-4942-bde3-cc57afffbfb9 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=b36c93b4bb5d40659021f52bb29375c9)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:10.382493 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba9712e-aa6d-4942-bde3-cc57afffbfb9 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:10.538847 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-bba9712e-aa6d-4942-bde3-cc57afffbfb9 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invalidating the token cache because role b36c93b4bb5d40659021f52bb29375c9 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:23:10.539146 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-bba9712e-aa6d-4942-bde3-cc57afffbfb9 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:10.539942 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-bba9712e-aa6d-4942-bde3-cc57afffbfb9 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:10.541910 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1925/3821] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:23:10 2022] DELETE /identity/v3/roles/b36c93b4bb5d40659021f52bb29375c9 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:10.548606 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb08be4-77c8-42cc-8ca5-dd38506e9068 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:10.560453 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb08be4-77c8-42cc-8ca5-dd38506e9068 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:10.664263 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86727e5b-7cf8-4604-948b-882ba7090d18 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:10.665223 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86727e5b-7cf8-4604-948b-882ba7090d18 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:10.665512 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86727e5b-7cf8-4604-948b-882ba7090d18 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:10.665795 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86727e5b-7cf8-4604-948b-882ba7090d18 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/roles/4d93c1ee22da4498b1f9f05435b22d5a/implies/04d9c7f2728f4fafb1d6b659f755e40a` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:10.667858 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86727e5b-7cf8-4604-948b-882ba7090d18 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=4d93c1ee22da4498b1f9f05435b22d5a, implied_role_id=04d9c7f2728f4fafb1d6b659f755e40a)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:10.669486 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86727e5b-7cf8-4604-948b-882ba7090d18 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:10.784412 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba9712e-aa6d-4942-bde3-cc57afffbfb9 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:10.784660 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1897/3822] 10.222.0.52 () {60 vars in 1362 bytes} [Sat May 14 21:23:10 2022] PUT /identity/v3/roles/4d93c1ee22da4498b1f9f05435b22d5a/implies/04d9c7f2728f4fafb1d6b659f755e40a => generated 521 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:23:10.787960 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-bba9712e-aa6d-4942-bde3-cc57afffbfb9 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:10.818107 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba9712e-aa6d-4942-bde3-cc57afffbfb9 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:10.950795 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b6e994-4568-4928-acf6-6bb50842b55d tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:10.952041 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b6e994-4568-4928-acf6-6bb50842b55d tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:10.952694 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b6e994-4568-4928-acf6-6bb50842b55d tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:10.953783 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b6e994-4568-4928-acf6-6bb50842b55d tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/roles/4d93c1ee22da4498b1f9f05435b22d5a/implies/04d9c7f2728f4fafb1d6b659f755e40a` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:10.957061 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b6e994-4568-4928-acf6-6bb50842b55d tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:check_implied_role(prior_role_id=4d93c1ee22da4498b1f9f05435b22d5a, implied_role_id=04d9c7f2728f4fafb1d6b659f755e40a)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:10.958278 ncdv-master-1 devstack@keystone.service[91106]: WARNING py.warnings [None req-f2b6e994-4568-4928-acf6-6bb50842b55d tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:23:10.958278 ncdv-master-1 devstack@keystone.service[91106]: warnings.warn(msg) May 14 21:23:10.958278 ncdv-master-1 devstack@keystone.service[91106]: May 14 21:23:10.960706 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b6e994-4568-4928-acf6-6bb50842b55d tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:10.965006 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b6e994-4568-4928-acf6-6bb50842b55d tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=4d93c1ee22da4498b1f9f05435b22d5a, implied_role_id=04d9c7f2728f4fafb1d6b659f755e40a)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:10.966027 ncdv-master-1 devstack@keystone.service[91106]: WARNING py.warnings [None req-f2b6e994-4568-4928-acf6-6bb50842b55d tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:23:10.966027 ncdv-master-1 devstack@keystone.service[91106]: warnings.warn(msg) May 14 21:23:10.966027 ncdv-master-1 devstack@keystone.service[91106]: May 14 21:23:10.967998 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b6e994-4568-4928-acf6-6bb50842b55d tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:10.984992 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1926/3823] 10.222.0.52 () {58 vars in 1344 bytes} [Sat May 14 21:23:10 2022] HEAD /identity/v3/roles/4d93c1ee22da4498b1f9f05435b22d5a/implies/04d9c7f2728f4fafb1d6b659f755e40a => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:23:10.989667 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86727e5b-7cf8-4604-948b-882ba7090d18 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:11.005522 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86727e5b-7cf8-4604-948b-882ba7090d18 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:11.011203 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1cc3a9-e756-4c73-9240-830fe31854ca tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:11.015210 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1cc3a9-e756-4c73-9240-830fe31854ca tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:11.016273 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1cc3a9-e756-4c73-9240-830fe31854ca tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:11.030036 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1cc3a9-e756-4c73-9240-830fe31854ca tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/roles/4d93c1ee22da4498b1f9f05435b22d5a/implies/04d9c7f2728f4fafb1d6b659f755e40a` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:11.030036 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1cc3a9-e756-4c73-9240-830fe31854ca tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=4d93c1ee22da4498b1f9f05435b22d5a, implied_role_id=04d9c7f2728f4fafb1d6b659f755e40a)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:11.030036 ncdv-master-1 devstack@keystone.service[91107]: WARNING py.warnings [None req-4b1cc3a9-e756-4c73-9240-830fe31854ca tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:23:11.030036 ncdv-master-1 devstack@keystone.service[91107]: warnings.warn(msg) May 14 21:23:11.030036 ncdv-master-1 devstack@keystone.service[91107]: May 14 21:23:11.030036 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1cc3a9-e756-4c73-9240-830fe31854ca tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:11.042687 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1898/3824] 10.222.0.52 () {58 vars in 1343 bytes} [Sat May 14 21:23:10 2022] GET /identity/v3/roles/4d93c1ee22da4498b1f9f05435b22d5a/implies/04d9c7f2728f4fafb1d6b659f755e40a => generated 521 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:23:11.048962 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b6e994-4568-4928-acf6-6bb50842b55d tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:11.063525 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b6e994-4568-4928-acf6-6bb50842b55d tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:11.070557 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cb817e-9b21-4dae-931d-1414497f10e4 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:11.071785 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb817e-9b21-4dae-931d-1414497f10e4 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:11.072255 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb817e-9b21-4dae-931d-1414497f10e4 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:11.072528 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb817e-9b21-4dae-931d-1414497f10e4 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/roles/4d93c1ee22da4498b1f9f05435b22d5a/implies/04d9c7f2728f4fafb1d6b659f755e40a` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:11.074607 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cb817e-9b21-4dae-931d-1414497f10e4 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=4d93c1ee22da4498b1f9f05435b22d5a, implied_role_id=04d9c7f2728f4fafb1d6b659f755e40a)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:11.076957 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cb817e-9b21-4dae-931d-1414497f10e4 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:11.151763 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1927/3825] 10.222.0.52 () {58 vars in 1346 bytes} [Sat May 14 21:23:11 2022] DELETE /identity/v3/roles/4d93c1ee22da4498b1f9f05435b22d5a/implies/04d9c7f2728f4fafb1d6b659f755e40a => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:11.163554 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1cc3a9-e756-4c73-9240-830fe31854ca tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:11.171029 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1cc3a9-e756-4c73-9240-830fe31854ca tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:11.271043 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1241da77-d866-4e30-9aa1-c6ecab683352 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:11.272149 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1241da77-d866-4e30-9aa1-c6ecab683352 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:11.272497 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1241da77-d866-4e30-9aa1-c6ecab683352 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:11.272833 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1241da77-d866-4e30-9aa1-c6ecab683352 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/roles/4d93c1ee22da4498b1f9f05435b22d5a/implies/04d9c7f2728f4fafb1d6b659f755e40a` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:11.275815 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1241da77-d866-4e30-9aa1-c6ecab683352 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=4d93c1ee22da4498b1f9f05435b22d5a, implied_role_id=04d9c7f2728f4fafb1d6b659f755e40a)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:11.277779 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1241da77-d866-4e30-9aa1-c6ecab683352 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:11.303305 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-1241da77-d866-4e30-9aa1-c6ecab683352 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] 4d93c1ee22da4498b1f9f05435b22d5a does not imply 04d9c7f2728f4fafb1d6b659f755e40a.: keystone.exception.ImpliedRoleNotFound: 4d93c1ee22da4498b1f9f05435b22d5a does not imply 04d9c7f2728f4fafb1d6b659f755e40a. May 14 21:23:11.303305 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:23:11.303305 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role May 14 21:23:11.303305 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ref = query.one() May 14 21:23:11.303305 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2865, in one May 14 21:23:11.303305 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._iter().one() May 14 21:23:11.303305 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1417, in one May 14 21:23:11.303305 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._only_one_row( May 14 21:23:11.303305 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row May 14 21:23:11.303305 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exc.NoResultFound( May 14 21:23:11.303305 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required May 14 21:23:11.303305 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:23:11.303305 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 21:23:11.303305 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:23:11.303305 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:23:11.303305 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 21:23:11.304381 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 21:23:11.304381 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 21:23:11.304381 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 21:23:11.304381 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 21:23:11.304381 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 21:23:11.304381 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 21:23:11.304381 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 21:23:11.304381 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 21:23:11.304381 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 21:23:11.304381 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 235, in get May 14 21:23:11.304381 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_implied_role(prior_role_id, implied_role_id) May 14 21:23:11.304381 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 239, in _get_implied_role May 14 21:23:11.304381 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application PROVIDERS.role_api.get_implied_role( May 14 21:23:11.304381 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 149, in get_implied_role May 14 21:23:11.304381 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, May 14 21:23:11.304381 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role May 14 21:23:11.305363 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( May 14 21:23:11.305363 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: 4d93c1ee22da4498b1f9f05435b22d5a does not imply 04d9c7f2728f4fafb1d6b659f755e40a. May 14 21:23:11.305363 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:23:11.312657 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1899/3826] 10.222.0.52 () {58 vars in 1343 bytes} [Sat May 14 21:23:11 2022] GET /identity/v3/roles/4d93c1ee22da4498b1f9f05435b22d5a/implies/04d9c7f2728f4fafb1d6b659f755e40a => generated 137 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) May 14 21:23:11.313053 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cb817e-9b21-4dae-931d-1414497f10e4 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:11.334853 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cb817e-9b21-4dae-931d-1414497f10e4 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:11.351058 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936bf2fe-56ba-4d78-9341-373f74f76be5 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:11.352959 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936bf2fe-56ba-4d78-9341-373f74f76be5 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:11.354469 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936bf2fe-56ba-4d78-9341-373f74f76be5 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:11.355012 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936bf2fe-56ba-4d78-9341-373f74f76be5 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/roles/4d93c1ee22da4498b1f9f05435b22d5a/implies/04d9c7f2728f4fafb1d6b659f755e40a` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:11.357951 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936bf2fe-56ba-4d78-9341-373f74f76be5 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=4d93c1ee22da4498b1f9f05435b22d5a, implied_role_id=04d9c7f2728f4fafb1d6b659f755e40a)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:11.362361 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936bf2fe-56ba-4d78-9341-373f74f76be5 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:11.389399 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-936bf2fe-56ba-4d78-9341-373f74f76be5 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] 4d93c1ee22da4498b1f9f05435b22d5a does not imply 04d9c7f2728f4fafb1d6b659f755e40a.: keystone.exception.ImpliedRoleNotFound: 4d93c1ee22da4498b1f9f05435b22d5a does not imply 04d9c7f2728f4fafb1d6b659f755e40a. May 14 21:23:11.389399 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:23:11.389399 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role May 14 21:23:11.389399 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ref = query.one() May 14 21:23:11.389399 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2865, in one May 14 21:23:11.389399 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._iter().one() May 14 21:23:11.389399 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1417, in one May 14 21:23:11.389399 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._only_one_row( May 14 21:23:11.389399 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row May 14 21:23:11.389399 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exc.NoResultFound( May 14 21:23:11.389399 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required May 14 21:23:11.389399 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:23:11.389399 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 21:23:11.389399 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:23:11.389399 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:23:11.389399 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 21:23:11.390674 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 21:23:11.390674 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 21:23:11.390674 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 21:23:11.390674 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 21:23:11.390674 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 21:23:11.390674 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 21:23:11.390674 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 21:23:11.390674 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 21:23:11.390674 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 21:23:11.390674 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete May 14 21:23:11.390674 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) May 14 21:23:11.390674 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 21:23:11.390674 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 21:23:11.390674 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role May 14 21:23:11.390674 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) May 14 21:23:11.390674 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role May 14 21:23:11.391846 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, May 14 21:23:11.391846 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role May 14 21:23:11.391846 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( May 14 21:23:11.391846 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: 4d93c1ee22da4498b1f9f05435b22d5a does not imply 04d9c7f2728f4fafb1d6b659f755e40a. May 14 21:23:11.391846 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:23:11.398334 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1241da77-d866-4e30-9aa1-c6ecab683352 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:11.405866 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1928/3827] 10.222.0.52 () {58 vars in 1346 bytes} [Sat May 14 21:23:11 2022] DELETE /identity/v3/roles/4d93c1ee22da4498b1f9f05435b22d5a/implies/04d9c7f2728f4fafb1d6b659f755e40a => generated 137 bytes in 91 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 14 21:23:11.411566 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1241da77-d866-4e30-9aa1-c6ecab683352 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:11.419229 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1af229c-574c-42c9-bcbd-827ad70c1592 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:11.419229 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af229c-574c-42c9-bcbd-827ad70c1592 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:11.419229 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af229c-574c-42c9-bcbd-827ad70c1592 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:11.420666 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af229c-574c-42c9-bcbd-827ad70c1592 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/roles/4d93c1ee22da4498b1f9f05435b22d5a/implies/04d9c7f2728f4fafb1d6b659f755e40a` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:11.422120 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1af229c-574c-42c9-bcbd-827ad70c1592 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=4d93c1ee22da4498b1f9f05435b22d5a, implied_role_id=04d9c7f2728f4fafb1d6b659f755e40a)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:11.424584 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1af229c-574c-42c9-bcbd-827ad70c1592 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:11.541499 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936bf2fe-56ba-4d78-9341-373f74f76be5 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:11.541921 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1900/3828] 10.222.0.52 () {60 vars in 1362 bytes} [Sat May 14 21:23:11 2022] PUT /identity/v3/roles/4d93c1ee22da4498b1f9f05435b22d5a/implies/04d9c7f2728f4fafb1d6b659f755e40a => generated 521 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:23:11.558145 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936bf2fe-56ba-4d78-9341-373f74f76be5 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:11.660152 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a5874-5ebf-40e8-bfe1-b3be1d4580eb tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:11.660152 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a5874-5ebf-40e8-bfe1-b3be1d4580eb tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:11.660152 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a5874-5ebf-40e8-bfe1-b3be1d4580eb tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:11.660625 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a5874-5ebf-40e8-bfe1-b3be1d4580eb tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/roles/4d93c1ee22da4498b1f9f05435b22d5a/implies/120a83e2f87043e78d22aae64fa0abab` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:11.668059 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987a5874-5ebf-40e8-bfe1-b3be1d4580eb tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=4d93c1ee22da4498b1f9f05435b22d5a, implied_role_id=120a83e2f87043e78d22aae64fa0abab)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:11.670997 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987a5874-5ebf-40e8-bfe1-b3be1d4580eb tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:11.850837 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1929/3829] 10.222.0.52 () {60 vars in 1362 bytes} [Sat May 14 21:23:11 2022] PUT /identity/v3/roles/4d93c1ee22da4498b1f9f05435b22d5a/implies/120a83e2f87043e78d22aae64fa0abab => generated 521 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:23:11.852153 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1af229c-574c-42c9-bcbd-827ad70c1592 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:11.863987 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1af229c-574c-42c9-bcbd-827ad70c1592 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:11.950021 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e0968d-4458-4dbd-8288-f1f7420dfbc4 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:11.951751 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e0968d-4458-4dbd-8288-f1f7420dfbc4 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:11.952097 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e0968d-4458-4dbd-8288-f1f7420dfbc4 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:11.952388 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e0968d-4458-4dbd-8288-f1f7420dfbc4 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/roles/120a83e2f87043e78d22aae64fa0abab/implies/cd713768bc0c4c3d9bf993588b682095` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:11.959849 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e0968d-4458-4dbd-8288-f1f7420dfbc4 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=120a83e2f87043e78d22aae64fa0abab, implied_role_id=cd713768bc0c4c3d9bf993588b682095)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:11.959849 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e0968d-4458-4dbd-8288-f1f7420dfbc4 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:12.093240 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1901/3830] 10.222.0.52 () {60 vars in 1362 bytes} [Sat May 14 21:23:11 2022] PUT /identity/v3/roles/120a83e2f87043e78d22aae64fa0abab/implies/cd713768bc0c4c3d9bf993588b682095 => generated 520 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:23:12.094457 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a5874-5ebf-40e8-bfe1-b3be1d4580eb tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:12.106031 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a5874-5ebf-40e8-bfe1-b3be1d4580eb tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:12.203566 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f629c9a7-1eac-43c7-b2d9-5d624c251818 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:12.204823 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f629c9a7-1eac-43c7-b2d9-5d624c251818 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:12.205188 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f629c9a7-1eac-43c7-b2d9-5d624c251818 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:12.205534 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f629c9a7-1eac-43c7-b2d9-5d624c251818 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/role_inferences` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:12.207521 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f629c9a7-1eac-43c7-b2d9-5d624c251818 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:list_role_inference_rules()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:12.208733 ncdv-master-1 devstack@keystone.service[91106]: WARNING py.warnings [None req-f629c9a7-1eac-43c7-b2d9-5d624c251818 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_inference_rules": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:23:12.208733 ncdv-master-1 devstack@keystone.service[91106]: warnings.warn(msg) May 14 21:23:12.208733 ncdv-master-1 devstack@keystone.service[91106]: May 14 21:23:12.209993 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f629c9a7-1eac-43c7-b2d9-5d624c251818 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:12.231237 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1930/3831] 10.222.0.52 () {58 vars in 1151 bytes} [Sat May 14 21:23:12 2022] GET /identity/v3/role_inferences => generated 1607 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:23:12.236433 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e0968d-4458-4dbd-8288-f1f7420dfbc4 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:12.249703 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e0968d-4458-4dbd-8288-f1f7420dfbc4 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:12.257480 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0944aa-ec4f-4859-8edf-5e082b8a7ec7 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:12.258900 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0944aa-ec4f-4859-8edf-5e082b8a7ec7 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:12.260153 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0944aa-ec4f-4859-8edf-5e082b8a7ec7 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:12.266247 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0944aa-ec4f-4859-8edf-5e082b8a7ec7 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/roles/120a83e2f87043e78d22aae64fa0abab/implies/cd713768bc0c4c3d9bf993588b682095` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:12.275199 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0944aa-ec4f-4859-8edf-5e082b8a7ec7 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=120a83e2f87043e78d22aae64fa0abab, implied_role_id=cd713768bc0c4c3d9bf993588b682095)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:12.276928 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0944aa-ec4f-4859-8edf-5e082b8a7ec7 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:12.357957 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1902/3832] 10.222.0.52 () {58 vars in 1346 bytes} [Sat May 14 21:23:12 2022] DELETE /identity/v3/roles/120a83e2f87043e78d22aae64fa0abab/implies/cd713768bc0c4c3d9bf993588b682095 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:12.362909 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f629c9a7-1eac-43c7-b2d9-5d624c251818 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:12.380166 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f629c9a7-1eac-43c7-b2d9-5d624c251818 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:12.559428 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabf607c-f668-4f1d-a51a-a90d687415bf tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:12.561332 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf607c-f668-4f1d-a51a-a90d687415bf tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:12.561853 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf607c-f668-4f1d-a51a-a90d687415bf tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:12.562856 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf607c-f668-4f1d-a51a-a90d687415bf tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/roles/4d93c1ee22da4498b1f9f05435b22d5a/implies/120a83e2f87043e78d22aae64fa0abab` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:12.568028 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabf607c-f668-4f1d-a51a-a90d687415bf tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=4d93c1ee22da4498b1f9f05435b22d5a, implied_role_id=120a83e2f87043e78d22aae64fa0abab)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:12.570599 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabf607c-f668-4f1d-a51a-a90d687415bf tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:12.651415 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1931/3833] 10.222.0.52 () {58 vars in 1346 bytes} [Sat May 14 21:23:12 2022] DELETE /identity/v3/roles/4d93c1ee22da4498b1f9f05435b22d5a/implies/120a83e2f87043e78d22aae64fa0abab => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:12.655807 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0944aa-ec4f-4859-8edf-5e082b8a7ec7 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:12.671426 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0944aa-ec4f-4859-8edf-5e082b8a7ec7 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:12.809920 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0690a9-3a2d-4025-9088-9a65f8289dc7 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:12.815032 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0690a9-3a2d-4025-9088-9a65f8289dc7 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:12.817309 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0690a9-3a2d-4025-9088-9a65f8289dc7 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:12.817757 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0690a9-3a2d-4025-9088-9a65f8289dc7 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/roles/4d93c1ee22da4498b1f9f05435b22d5a/implies/04d9c7f2728f4fafb1d6b659f755e40a` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:12.823491 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0690a9-3a2d-4025-9088-9a65f8289dc7 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=4d93c1ee22da4498b1f9f05435b22d5a, implied_role_id=04d9c7f2728f4fafb1d6b659f755e40a)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:12.826586 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0690a9-3a2d-4025-9088-9a65f8289dc7 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:13.006711 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1903/3834] 10.222.0.52 () {58 vars in 1346 bytes} [Sat May 14 21:23:12 2022] DELETE /identity/v3/roles/4d93c1ee22da4498b1f9f05435b22d5a/implies/04d9c7f2728f4fafb1d6b659f755e40a => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:13.012060 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabf607c-f668-4f1d-a51a-a90d687415bf tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:13.025729 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabf607c-f668-4f1d-a51a-a90d687415bf tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:13.095884 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a0e08d-7053-4327-8eef-b530df278e0e tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:13.097353 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a0e08d-7053-4327-8eef-b530df278e0e tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:13.102129 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a0e08d-7053-4327-8eef-b530df278e0e tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:13.102129 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a0e08d-7053-4327-8eef-b530df278e0e tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:13.102129 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a0e08d-7053-4327-8eef-b530df278e0e tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:13.102129 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a0e08d-7053-4327-8eef-b530df278e0e tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:13.114666 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1932/3835] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:23:13 2022] GET /identity/v3/roles => generated 2323 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:23:13.119300 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0690a9-3a2d-4025-9088-9a65f8289dc7 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:13.136876 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0690a9-3a2d-4025-9088-9a65f8289dc7 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:13.152756 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8de8906-caed-4960-84a7-db24fe4287e2 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:13.153993 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de8906-caed-4960-84a7-db24fe4287e2 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:13.154421 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de8906-caed-4960-84a7-db24fe4287e2 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:13.154764 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de8906-caed-4960-84a7-db24fe4287e2 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:13.156665 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8de8906-caed-4960-84a7-db24fe4287e2 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:13.158331 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8de8906-caed-4960-84a7-db24fe4287e2 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:13.266297 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1904/3836] 10.222.0.52 () {60 vars in 1142 bytes} [Sat May 14 21:23:13 2022] POST /identity/v3/roles => generated 235 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:23:13.270248 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a0e08d-7053-4327-8eef-b530df278e0e tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:13.290233 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a0e08d-7053-4327-8eef-b530df278e0e tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:13.303374 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3801872-1a2c-40d3-a500-25c08873c05c tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:13.304408 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3801872-1a2c-40d3-a500-25c08873c05c tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:13.305821 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3801872-1a2c-40d3-a500-25c08873c05c tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:13.306193 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3801872-1a2c-40d3-a500-25c08873c05c tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/roles/19c7fcf8ec3140de8c48d867b88489e8` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:13.311034 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3801872-1a2c-40d3-a500-25c08873c05c tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:update_role(role_id=19c7fcf8ec3140de8c48d867b88489e8)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:13.313746 ncdv-master-1 devstack@keystone.service[91106]: WARNING py.warnings [None req-d3801872-1a2c-40d3-a500-25c08873c05c tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:23:13.313746 ncdv-master-1 devstack@keystone.service[91106]: warnings.warn(msg) May 14 21:23:13.313746 ncdv-master-1 devstack@keystone.service[91106]: May 14 21:23:13.318276 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3801872-1a2c-40d3-a500-25c08873c05c tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:13.468081 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1933/3837] 10.222.0.52 () {60 vars in 1242 bytes} [Sat May 14 21:23:13 2022] PATCH /identity/v3/roles/19c7fcf8ec3140de8c48d867b88489e8 => generated 237 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:23:13.471817 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8de8906-caed-4960-84a7-db24fe4287e2 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:13.488953 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8de8906-caed-4960-84a7-db24fe4287e2 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:13.499372 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5435151d-bbf3-4e83-8e10-6fa2a0d42098 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:13.501425 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435151d-bbf3-4e83-8e10-6fa2a0d42098 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:13.503301 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435151d-bbf3-4e83-8e10-6fa2a0d42098 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:13.503647 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435151d-bbf3-4e83-8e10-6fa2a0d42098 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/roles/19c7fcf8ec3140de8c48d867b88489e8` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:13.529901 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5435151d-bbf3-4e83-8e10-6fa2a0d42098 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:get_role(role_id=19c7fcf8ec3140de8c48d867b88489e8)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:13.530894 ncdv-master-1 devstack@keystone.service[91107]: WARNING py.warnings [None req-5435151d-bbf3-4e83-8e10-6fa2a0d42098 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:23:13.530894 ncdv-master-1 devstack@keystone.service[91107]: warnings.warn(msg) May 14 21:23:13.530894 ncdv-master-1 devstack@keystone.service[91107]: May 14 21:23:13.532845 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5435151d-bbf3-4e83-8e10-6fa2a0d42098 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:13.534327 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1905/3838] 10.222.0.52 () {58 vars in 1220 bytes} [Sat May 14 21:23:13 2022] GET /identity/v3/roles/19c7fcf8ec3140de8c48d867b88489e8 => generated 237 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:23:13.539469 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3801872-1a2c-40d3-a500-25c08873c05c tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:13.555535 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3801872-1a2c-40d3-a500-25c08873c05c tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:13.577086 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cc9d55-15d8-4883-b62a-ca026c84e405 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:13.581903 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc9d55-15d8-4883-b62a-ca026c84e405 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:13.581903 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc9d55-15d8-4883-b62a-ca026c84e405 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:13.581903 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc9d55-15d8-4883-b62a-ca026c84e405 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:13.581903 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cc9d55-15d8-4883-b62a-ca026c84e405 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:13.581903 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cc9d55-15d8-4883-b62a-ca026c84e405 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:13.596011 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1934/3839] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:23:13 2022] GET /identity/v3/roles => generated 2551 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:23:13.607980 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5435151d-bbf3-4e83-8e10-6fa2a0d42098 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:13.623347 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5435151d-bbf3-4e83-8e10-6fa2a0d42098 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:13.625816 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cc9d55-15d8-4883-b62a-ca026c84e405 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:13.627540 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-f4cc9d55-15d8-4883-b62a-ca026c84e405 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:13.629698 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f801af6-8fbf-4221-b9ff-8d8e446017c6 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:13.630879 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f801af6-8fbf-4221-b9ff-8d8e446017c6 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:13.631363 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f801af6-8fbf-4221-b9ff-8d8e446017c6 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:13.631933 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f801af6-8fbf-4221-b9ff-8d8e446017c6 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/roles/19c7fcf8ec3140de8c48d867b88489e8` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:13.633823 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f801af6-8fbf-4221-b9ff-8d8e446017c6 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:delete_role(role_id=19c7fcf8ec3140de8c48d867b88489e8)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:13.635344 ncdv-master-1 devstack@keystone.service[91107]: WARNING py.warnings [None req-5f801af6-8fbf-4221-b9ff-8d8e446017c6 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:23:13.635344 ncdv-master-1 devstack@keystone.service[91107]: warnings.warn(msg) May 14 21:23:13.635344 ncdv-master-1 devstack@keystone.service[91107]: May 14 21:23:13.637143 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f801af6-8fbf-4221-b9ff-8d8e446017c6 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:13.762722 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-5f801af6-8fbf-4221-b9ff-8d8e446017c6 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invalidating the token cache because role 19c7fcf8ec3140de8c48d867b88489e8 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:23:13.763788 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-5f801af6-8fbf-4221-b9ff-8d8e446017c6 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:13.764426 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-5f801af6-8fbf-4221-b9ff-8d8e446017c6 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:13.770318 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1906/3840] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:23:13 2022] DELETE /identity/v3/roles/19c7fcf8ec3140de8c48d867b88489e8 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:13.775292 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f801af6-8fbf-4221-b9ff-8d8e446017c6 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:13.775746 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cc9d55-15d8-4883-b62a-ca026c84e405 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:13.776904 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-5f801af6-8fbf-4221-b9ff-8d8e446017c6 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:13.879534 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66468e1-b02e-4944-a6d3-d0ac4632c980 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:13.880192 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66468e1-b02e-4944-a6d3-d0ac4632c980 service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:13.880479 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66468e1-b02e-4944-a6d3-d0ac4632c980 service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:13.880747 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66468e1-b02e-4944-a6d3-d0ac4632c980 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:13.882554 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d66468e1-b02e-4944-a6d3-d0ac4632c980 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:13.890432 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f801af6-8fbf-4221-b9ff-8d8e446017c6 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:13.895525 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c33fd10-ad3b-4fed-872d-7f2196f5c7ac tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:13.896539 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c33fd10-ad3b-4fed-872d-7f2196f5c7ac tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:13.896804 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c33fd10-ad3b-4fed-872d-7f2196f5c7ac tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:13.897077 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c33fd10-ad3b-4fed-872d-7f2196f5c7ac tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/roles/4d93c1ee22da4498b1f9f05435b22d5a/implies/04d9c7f2728f4fafb1d6b659f755e40a` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:13.898794 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c33fd10-ad3b-4fed-872d-7f2196f5c7ac tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=4d93c1ee22da4498b1f9f05435b22d5a, implied_role_id=04d9c7f2728f4fafb1d6b659f755e40a)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:13.899467 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66468e1-b02e-4944-a6d3-d0ac4632c980 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:13.900424 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c33fd10-ad3b-4fed-872d-7f2196f5c7ac tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:13.901517 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66468e1-b02e-4944-a6d3-d0ac4632c980 service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:13.918170 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1935/3841] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:23:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:23:14.032319 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1907/3842] 10.222.0.52 () {60 vars in 1362 bytes} [Sat May 14 21:23:13 2022] PUT /identity/v3/roles/4d93c1ee22da4498b1f9f05435b22d5a/implies/04d9c7f2728f4fafb1d6b659f755e40a => generated 521 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:23:14.032630 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66468e1-b02e-4944-a6d3-d0ac4632c980 service nova] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:14.048221 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66468e1-b02e-4944-a6d3-d0ac4632c980 service nova] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:14.130612 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614edcd5-d9b0-4054-828d-985851fe164b tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:14.131638 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614edcd5-d9b0-4054-828d-985851fe164b tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:14.131935 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614edcd5-d9b0-4054-828d-985851fe164b tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:14.132219 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614edcd5-d9b0-4054-828d-985851fe164b tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/roles/4d93c1ee22da4498b1f9f05435b22d5a/implies/120a83e2f87043e78d22aae64fa0abab` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:14.134187 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614edcd5-d9b0-4054-828d-985851fe164b tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=4d93c1ee22da4498b1f9f05435b22d5a, implied_role_id=120a83e2f87043e78d22aae64fa0abab)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:14.135827 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614edcd5-d9b0-4054-828d-985851fe164b tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:14.251679 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1936/3843] 10.222.0.52 () {60 vars in 1362 bytes} [Sat May 14 21:23:14 2022] PUT /identity/v3/roles/4d93c1ee22da4498b1f9f05435b22d5a/implies/120a83e2f87043e78d22aae64fa0abab => generated 521 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:23:14.253264 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c33fd10-ad3b-4fed-872d-7f2196f5c7ac tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:14.278312 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c33fd10-ad3b-4fed-872d-7f2196f5c7ac tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:14.418473 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f29e5b3-7c3c-476b-908f-573458d012dc tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:14.421228 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f29e5b3-7c3c-476b-908f-573458d012dc tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:14.421870 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f29e5b3-7c3c-476b-908f-573458d012dc tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:14.423729 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f29e5b3-7c3c-476b-908f-573458d012dc tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/roles/120a83e2f87043e78d22aae64fa0abab/implies/cd713768bc0c4c3d9bf993588b682095` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:14.426629 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f29e5b3-7c3c-476b-908f-573458d012dc tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=120a83e2f87043e78d22aae64fa0abab, implied_role_id=cd713768bc0c4c3d9bf993588b682095)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:14.428590 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f29e5b3-7c3c-476b-908f-573458d012dc tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:14.545437 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1908/3844] 10.222.0.52 () {60 vars in 1362 bytes} [Sat May 14 21:23:14 2022] PUT /identity/v3/roles/120a83e2f87043e78d22aae64fa0abab/implies/cd713768bc0c4c3d9bf993588b682095 => generated 520 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:23:14.550133 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614edcd5-d9b0-4054-828d-985851fe164b tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:14.564633 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614edcd5-d9b0-4054-828d-985851fe164b tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:14.667567 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a05f9e0-c2e3-4ae7-b4f7-ab0f19b693f8 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:14.667567 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05f9e0-c2e3-4ae7-b4f7-ab0f19b693f8 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:14.667567 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05f9e0-c2e3-4ae7-b4f7-ab0f19b693f8 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:14.668134 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05f9e0-c2e3-4ae7-b4f7-ab0f19b693f8 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/roles/120a83e2f87043e78d22aae64fa0abab/implies` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:14.668134 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a05f9e0-c2e3-4ae7-b4f7-ab0f19b693f8 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=120a83e2f87043e78d22aae64fa0abab)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:14.668134 ncdv-master-1 devstack@keystone.service[91106]: WARNING py.warnings [None req-0a05f9e0-c2e3-4ae7-b4f7-ab0f19b693f8 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:23:14.668134 ncdv-master-1 devstack@keystone.service[91106]: warnings.warn(msg) May 14 21:23:14.668134 ncdv-master-1 devstack@keystone.service[91106]: May 14 21:23:14.668134 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a05f9e0-c2e3-4ae7-b4f7-ab0f19b693f8 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:14.675785 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1937/3845] 10.222.0.52 () {58 vars in 1244 bytes} [Sat May 14 21:23:14 2022] GET /identity/v3/roles/120a83e2f87043e78d22aae64fa0abab/implies => generated 489 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:23:14.688793 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f29e5b3-7c3c-476b-908f-573458d012dc tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:14.713169 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f29e5b3-7c3c-476b-908f-573458d012dc tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:14.722340 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284d6419-8ebd-4ea7-95d0-395573e01ab4 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:14.728743 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d6419-8ebd-4ea7-95d0-395573e01ab4 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:14.728743 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d6419-8ebd-4ea7-95d0-395573e01ab4 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:14.728743 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d6419-8ebd-4ea7-95d0-395573e01ab4 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/roles/4d93c1ee22da4498b1f9f05435b22d5a/implies` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:14.729357 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284d6419-8ebd-4ea7-95d0-395573e01ab4 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=4d93c1ee22da4498b1f9f05435b22d5a)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:14.731876 ncdv-master-1 devstack@keystone.service[91107]: WARNING py.warnings [None req-284d6419-8ebd-4ea7-95d0-395573e01ab4 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:23:14.731876 ncdv-master-1 devstack@keystone.service[91107]: warnings.warn(msg) May 14 21:23:14.731876 ncdv-master-1 devstack@keystone.service[91107]: May 14 21:23:14.733206 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284d6419-8ebd-4ea7-95d0-395573e01ab4 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:14.742276 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1909/3846] 10.222.0.52 () {58 vars in 1244 bytes} [Sat May 14 21:23:14 2022] GET /identity/v3/roles/4d93c1ee22da4498b1f9f05435b22d5a/implies => generated 661 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:23:14.746201 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a05f9e0-c2e3-4ae7-b4f7-ab0f19b693f8 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:14.759548 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a05f9e0-c2e3-4ae7-b4f7-ab0f19b693f8 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:14.769391 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396c9e8-dca9-439b-9e75-f86018d67ddb tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:14.770478 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396c9e8-dca9-439b-9e75-f86018d67ddb tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:14.770868 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396c9e8-dca9-439b-9e75-f86018d67ddb tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:14.771267 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396c9e8-dca9-439b-9e75-f86018d67ddb tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/roles/120a83e2f87043e78d22aae64fa0abab/implies/cd713768bc0c4c3d9bf993588b682095` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:14.773206 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f396c9e8-dca9-439b-9e75-f86018d67ddb tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=120a83e2f87043e78d22aae64fa0abab, implied_role_id=cd713768bc0c4c3d9bf993588b682095)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:14.775111 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f396c9e8-dca9-439b-9e75-f86018d67ddb tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:14.853571 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1938/3847] 10.222.0.52 () {58 vars in 1346 bytes} [Sat May 14 21:23:14 2022] DELETE /identity/v3/roles/120a83e2f87043e78d22aae64fa0abab/implies/cd713768bc0c4c3d9bf993588b682095 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:23:14.857892 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284d6419-8ebd-4ea7-95d0-395573e01ab4 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:14.870285 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284d6419-8ebd-4ea7-95d0-395573e01ab4 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:14.940408 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031aa2a9-604a-4ceb-9351-81dcf75b7bc7 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:14.941339 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031aa2a9-604a-4ceb-9351-81dcf75b7bc7 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:14.941616 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031aa2a9-604a-4ceb-9351-81dcf75b7bc7 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:14.941893 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031aa2a9-604a-4ceb-9351-81dcf75b7bc7 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/roles/4d93c1ee22da4498b1f9f05435b22d5a/implies/120a83e2f87043e78d22aae64fa0abab` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:14.944008 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031aa2a9-604a-4ceb-9351-81dcf75b7bc7 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=4d93c1ee22da4498b1f9f05435b22d5a, implied_role_id=120a83e2f87043e78d22aae64fa0abab)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:14.945613 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031aa2a9-604a-4ceb-9351-81dcf75b7bc7 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:15.025003 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1910/3848] 10.222.0.52 () {58 vars in 1346 bytes} [Sat May 14 21:23:14 2022] DELETE /identity/v3/roles/4d93c1ee22da4498b1f9f05435b22d5a/implies/120a83e2f87043e78d22aae64fa0abab => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:15.029382 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396c9e8-dca9-439b-9e75-f86018d67ddb tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:15.040182 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396c9e8-dca9-439b-9e75-f86018d67ddb tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:15.098066 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb40616-1746-4bc2-b997-66c117cd3f00 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:15.099078 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb40616-1746-4bc2-b997-66c117cd3f00 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:15.099365 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb40616-1746-4bc2-b997-66c117cd3f00 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:15.099695 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb40616-1746-4bc2-b997-66c117cd3f00 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/roles/4d93c1ee22da4498b1f9f05435b22d5a/implies/04d9c7f2728f4fafb1d6b659f755e40a` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:15.101429 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb40616-1746-4bc2-b997-66c117cd3f00 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=4d93c1ee22da4498b1f9f05435b22d5a, implied_role_id=04d9c7f2728f4fafb1d6b659f755e40a)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:15.103062 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb40616-1746-4bc2-b997-66c117cd3f00 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:15.236032 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1939/3849] 10.222.0.52 () {58 vars in 1346 bytes} [Sat May 14 21:23:15 2022] DELETE /identity/v3/roles/4d93c1ee22da4498b1f9f05435b22d5a/implies/04d9c7f2728f4fafb1d6b659f755e40a => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:23:15.241439 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031aa2a9-604a-4ceb-9351-81dcf75b7bc7 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:15.252609 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031aa2a9-604a-4ceb-9351-81dcf75b7bc7 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:15.317896 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f761733-de05-4699-a168-217323ca8b20 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:15.318890 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f761733-de05-4699-a168-217323ca8b20 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:15.319241 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f761733-de05-4699-a168-217323ca8b20 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:15.319716 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f761733-de05-4699-a168-217323ca8b20 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/domains/7d80d5aeffad4783880afec94d88c61e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:15.327709 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f761733-de05-4699-a168-217323ca8b20 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 21:23:15.338624 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-8f761733-de05-4699-a168-217323ca8b20 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Could not find domain: 7d80d5aeffad4783880afec94d88c61e.: keystone.exception.DomainNotFound: Could not find domain: 7d80d5aeffad4783880afec94d88c61e. May 14 21:23:15.338624 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:23:15.338624 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 14 21:23:15.338624 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 14 21:23:15.338624 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 21:23:15.338624 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 21:23:15.338624 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 21:23:15.338624 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 21:23:15.338624 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 7d80d5aeffad4783880afec94d88c61e. May 14 21:23:15.338624 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:23:15.338624 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 21:23:15.338624 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:23:15.338624 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:23:15.338624 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 21:23:15.338624 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 21:23:15.338624 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 21:23:15.339888 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 21:23:15.339888 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 21:23:15.339888 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 21:23:15.339888 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 21:23:15.339888 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 21:23:15.339888 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 21:23:15.339888 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 21:23:15.339888 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch May 14 21:23:15.339888 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') May 14 21:23:15.339888 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 21:23:15.339888 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 21:23:15.339888 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 21:23:15.339888 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 21:23:15.339888 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 21:23:15.339888 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 21:23:15.339888 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 21:23:15.344883 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 21:23:15.344883 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 21:23:15.344883 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 21:23:15.344883 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 21:23:15.344883 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 21:23:15.344883 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 21:23:15.344883 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 21:23:15.344883 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 21:23:15.344883 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 21:23:15.344883 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 21:23:15.344883 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 21:23:15.344883 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 21:23:15.344883 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 21:23:15.344883 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 14 21:23:15.344883 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 21:23:15.344883 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 7d80d5aeffad4783880afec94d88c61e. May 14 21:23:15.344883 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:23:15.345860 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1911/3850] 10.222.0.52 () {60 vars in 1248 bytes} [Sat May 14 21:23:15 2022] PATCH /identity/v3/domains/7d80d5aeffad4783880afec94d88c61e => generated 112 bytes in 99 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 14 21:23:15.348179 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb40616-1746-4bc2-b997-66c117cd3f00 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:15.365421 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb40616-1746-4bc2-b997-66c117cd3f00 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:15.380036 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab57ffb4-49f2-46c4-87b2-f14d2b5c0ae4 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:15.380036 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57ffb4-49f2-46c4-87b2-f14d2b5c0ae4 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:15.380036 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57ffb4-49f2-46c4-87b2-f14d2b5c0ae4 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:15.380333 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57ffb4-49f2-46c4-87b2-f14d2b5c0ae4 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/users/c93b213be1a94a1794b8760cb36c2b4e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:15.380333 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab57ffb4-49f2-46c4-87b2-f14d2b5c0ae4 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:delete_user(user_id=c93b213be1a94a1794b8760cb36c2b4e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:15.382247 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab57ffb4-49f2-46c4-87b2-f14d2b5c0ae4 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:15.521862 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ab57ffb4-49f2-46c4-87b2-f14d2b5c0ae4 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c93b213be1a94a1794b8760cb36c2b4e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:15.537034 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ab57ffb4-49f2-46c4-87b2-f14d2b5c0ae4 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c93b213be1a94a1794b8760cb36c2b4e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:15.547881 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ab57ffb4-49f2-46c4-87b2-f14d2b5c0ae4 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c93b213be1a94a1794b8760cb36c2b4e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:15.841713 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ab57ffb4-49f2-46c4-87b2-f14d2b5c0ae4 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c93b213be1a94a1794b8760cb36c2b4e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:15.841713 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ab57ffb4-49f2-46c4-87b2-f14d2b5c0ae4 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c93b213be1a94a1794b8760cb36c2b4e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:15.849467 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1940/3851] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:23:15 2022] DELETE /identity/v3/users/c93b213be1a94a1794b8760cb36c2b4e => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:15.854340 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f761733-de05-4699-a168-217323ca8b20 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:15.856321 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8f761733-de05-4699-a168-217323ca8b20 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:15.872033 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f761733-de05-4699-a168-217323ca8b20 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:15.957388 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da98bbd-5c7d-4344-8b87-3260bf007632 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:15.958247 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da98bbd-5c7d-4344-8b87-3260bf007632 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:15.958582 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da98bbd-5c7d-4344-8b87-3260bf007632 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:15.958804 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da98bbd-5c7d-4344-8b87-3260bf007632 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/roles/cd713768bc0c4c3d9bf993588b682095` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:15.960844 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da98bbd-5c7d-4344-8b87-3260bf007632 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:delete_role(role_id=cd713768bc0c4c3d9bf993588b682095)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:15.963159 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da98bbd-5c7d-4344-8b87-3260bf007632 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:16.053932 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-1da98bbd-5c7d-4344-8b87-3260bf007632 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invalidating the token cache because role cd713768bc0c4c3d9bf993588b682095 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:23:16.055191 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-1da98bbd-5c7d-4344-8b87-3260bf007632 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:16.056060 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-1da98bbd-5c7d-4344-8b87-3260bf007632 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:16.058565 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1912/3852] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:23:15 2022] DELETE /identity/v3/roles/cd713768bc0c4c3d9bf993588b682095 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:16.063073 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab57ffb4-49f2-46c4-87b2-f14d2b5c0ae4 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:16.078766 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab57ffb4-49f2-46c4-87b2-f14d2b5c0ae4 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:16.139526 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcd581f-6fc4-4879-bb06-260b5b6a65db tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:16.143781 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd581f-6fc4-4879-bb06-260b5b6a65db tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:16.143781 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd581f-6fc4-4879-bb06-260b5b6a65db tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:16.143781 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd581f-6fc4-4879-bb06-260b5b6a65db tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/groups/5fb9af0dc93b43c9929099bba80fdc28` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:16.143781 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcd581f-6fc4-4879-bb06-260b5b6a65db tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:delete_group(group_id=5fb9af0dc93b43c9929099bba80fdc28)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:16.144147 ncdv-master-1 devstack@keystone.service[91106]: WARNING py.warnings [None req-5dcd581f-6fc4-4879-bb06-260b5b6a65db tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 14 21:23:16.144147 ncdv-master-1 devstack@keystone.service[91106]: warnings.warn(msg) May 14 21:23:16.144147 ncdv-master-1 devstack@keystone.service[91106]: May 14 21:23:16.144614 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcd581f-6fc4-4879-bb06-260b5b6a65db tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:16.292895 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1941/3853] 10.222.0.52 () {58 vars in 1226 bytes} [Sat May 14 21:23:16 2022] DELETE /identity/v3/groups/5fb9af0dc93b43c9929099bba80fdc28 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:16.297432 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da98bbd-5c7d-4344-8b87-3260bf007632 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:16.298986 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-1da98bbd-5c7d-4344-8b87-3260bf007632 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:16.313040 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da98bbd-5c7d-4344-8b87-3260bf007632 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:16.377573 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8efcdf-695d-483c-9354-d9f9840b82f2 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:16.378739 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8efcdf-695d-483c-9354-d9f9840b82f2 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:16.379035 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8efcdf-695d-483c-9354-d9f9840b82f2 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:16.379319 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8efcdf-695d-483c-9354-d9f9840b82f2 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/projects/6f4b500359af402b8d57e382a9011442` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:16.380646 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8efcdf-695d-483c-9354-d9f9840b82f2 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6f4b500359af402b8d57e382a9011442)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:16.382630 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8efcdf-695d-483c-9354-d9f9840b82f2 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:16.515685 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-2f8efcdf-695d-483c-9354-d9f9840b82f2 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f4b500359af402b8d57e382a9011442', 'request_id': 'req-2f8efcdf-695d-483c-9354-d9f9840b82f2'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:16.524740 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-2f8efcdf-695d-483c-9354-d9f9840b82f2 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f4b500359af402b8d57e382a9011442', 'request_id': 'req-2f8efcdf-695d-483c-9354-d9f9840b82f2'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:16.536348 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-2f8efcdf-695d-483c-9354-d9f9840b82f2 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f4b500359af402b8d57e382a9011442', 'request_id': 'req-2f8efcdf-695d-483c-9354-d9f9840b82f2'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:16.646964 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-2f8efcdf-695d-483c-9354-d9f9840b82f2 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] The token cache is being invalidate because project 6f4b500359af402b8d57e382a9011442 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:23:16.647217 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-2f8efcdf-695d-483c-9354-d9f9840b82f2 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:16.648026 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-2f8efcdf-695d-483c-9354-d9f9840b82f2 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:16.650125 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1913/3854] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:23:16 2022] DELETE /identity/v3/projects/6f4b500359af402b8d57e382a9011442 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:16.654507 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcd581f-6fc4-4879-bb06-260b5b6a65db tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:16.656723 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-5dcd581f-6fc4-4879-bb06-260b5b6a65db tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:16.671279 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcd581f-6fc4-4879-bb06-260b5b6a65db tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:16.737379 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ee83c7-14ae-45c1-b6a1-d77500b16661 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:16.738337 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee83c7-14ae-45c1-b6a1-d77500b16661 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:16.738686 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee83c7-14ae-45c1-b6a1-d77500b16661 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:16.738963 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee83c7-14ae-45c1-b6a1-d77500b16661 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/domains/3605c64c28454cd5805bf3a4dea46ae1` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:16.740313 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ee83c7-14ae-45c1-b6a1-d77500b16661 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=3605c64c28454cd5805bf3a4dea46ae1)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:16.741907 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ee83c7-14ae-45c1-b6a1-d77500b16661 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:16.765154 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-77ee83c7-14ae-45c1-b6a1-d77500b16661 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '3605c64c28454cd5805bf3a4dea46ae1'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:16.765916 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-77ee83c7-14ae-45c1-b6a1-d77500b16661 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '3605c64c28454cd5805bf3a4dea46ae1'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:16.902986 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-77ee83c7-14ae-45c1-b6a1-d77500b16661 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '3605c64c28454cd5805bf3a4dea46ae1'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:16.905140 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-77ee83c7-14ae-45c1-b6a1-d77500b16661 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '3605c64c28454cd5805bf3a4dea46ae1'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:16.909220 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1942/3855] 10.222.0.52 () {60 vars in 1248 bytes} [Sat May 14 21:23:16 2022] PATCH /identity/v3/domains/3605c64c28454cd5805bf3a4dea46ae1 => generated 276 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:23:16.913074 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8efcdf-695d-483c-9354-d9f9840b82f2 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:16.934656 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8efcdf-695d-483c-9354-d9f9840b82f2 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:17.010612 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604e2510-13d6-442b-86b6-306a910c1094 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:17.014618 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e2510-13d6-442b-86b6-306a910c1094 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:17.020175 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e2510-13d6-442b-86b6-306a910c1094 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:17.020175 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e2510-13d6-442b-86b6-306a910c1094 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/domains/3605c64c28454cd5805bf3a4dea46ae1` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:17.032364 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604e2510-13d6-442b-86b6-306a910c1094 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=3605c64c28454cd5805bf3a4dea46ae1)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:17.034857 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604e2510-13d6-442b-86b6-306a910c1094 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:17.108995 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-604e2510-13d6-442b-86b6-306a910c1094 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '3605c64c28454cd5805bf3a4dea46ae1'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:17.121891 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-604e2510-13d6-442b-86b6-306a910c1094 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '3605c64c28454cd5805bf3a4dea46ae1'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:17.249017 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-604e2510-13d6-442b-86b6-306a910c1094 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3605c64c28454cd5805bf3a4dea46ae1', 'request_id': 'req-604e2510-13d6-442b-86b6-306a910c1094'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:17.254697 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-604e2510-13d6-442b-86b6-306a910c1094 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3605c64c28454cd5805bf3a4dea46ae1', 'request_id': 'req-604e2510-13d6-442b-86b6-306a910c1094'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:17.262848 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-604e2510-13d6-442b-86b6-306a910c1094 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3605c64c28454cd5805bf3a4dea46ae1', 'request_id': 'req-604e2510-13d6-442b-86b6-306a910c1094'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:17.323823 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-604e2510-13d6-442b-86b6-306a910c1094 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] The token cache is being invalidate because project 3605c64c28454cd5805bf3a4dea46ae1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:23:17.324464 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-604e2510-13d6-442b-86b6-306a910c1094 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:17.325495 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-604e2510-13d6-442b-86b6-306a910c1094 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:17.335413 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-604e2510-13d6-442b-86b6-306a910c1094 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '3605c64c28454cd5805bf3a4dea46ae1', 'request_id': 'req-604e2510-13d6-442b-86b6-306a910c1094'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:17.336310 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-604e2510-13d6-442b-86b6-306a910c1094 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '3605c64c28454cd5805bf3a4dea46ae1', 'request_id': 'req-604e2510-13d6-442b-86b6-306a910c1094'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:17.340709 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-604e2510-13d6-442b-86b6-306a910c1094 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '3605c64c28454cd5805bf3a4dea46ae1', 'request_id': 'req-604e2510-13d6-442b-86b6-306a910c1094'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:17.351059 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1914/3856] 10.222.0.52 () {58 vars in 1229 bytes} [Sat May 14 21:23:16 2022] DELETE /identity/v3/domains/3605c64c28454cd5805bf3a4dea46ae1 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:17.352111 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ee83c7-14ae-45c1-b6a1-d77500b16661 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:17.355703 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-77ee83c7-14ae-45c1-b6a1-d77500b16661 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:17.369330 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ee83c7-14ae-45c1-b6a1-d77500b16661 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:17.450092 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f146b3d9-b190-4d5b-b013-ceaf94e1f58f tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:17.452020 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146b3d9-b190-4d5b-b013-ceaf94e1f58f tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:17.452312 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146b3d9-b190-4d5b-b013-ceaf94e1f58f tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:17.452625 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146b3d9-b190-4d5b-b013-ceaf94e1f58f tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/roles/120a83e2f87043e78d22aae64fa0abab` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:17.454245 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f146b3d9-b190-4d5b-b013-ceaf94e1f58f tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:delete_role(role_id=120a83e2f87043e78d22aae64fa0abab)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:17.455531 ncdv-master-1 devstack@keystone.service[91106]: WARNING py.warnings [None req-f146b3d9-b190-4d5b-b013-ceaf94e1f58f tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:23:17.455531 ncdv-master-1 devstack@keystone.service[91106]: warnings.warn(msg) May 14 21:23:17.455531 ncdv-master-1 devstack@keystone.service[91106]: May 14 21:23:17.456322 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f146b3d9-b190-4d5b-b013-ceaf94e1f58f tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:17.551765 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f146b3d9-b190-4d5b-b013-ceaf94e1f58f tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invalidating the token cache because role 120a83e2f87043e78d22aae64fa0abab has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:23:17.552332 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f146b3d9-b190-4d5b-b013-ceaf94e1f58f tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:17.553287 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f146b3d9-b190-4d5b-b013-ceaf94e1f58f tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:17.558354 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1943/3857] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:23:17 2022] DELETE /identity/v3/roles/120a83e2f87043e78d22aae64fa0abab => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:17.559812 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604e2510-13d6-442b-86b6-306a910c1094 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:17.563415 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-604e2510-13d6-442b-86b6-306a910c1094 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:17.579287 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604e2510-13d6-442b-86b6-306a910c1094 tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:17.668086 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aad714-11b3-4313-9357-74bb76dd591f tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:17.669069 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aad714-11b3-4313-9357-74bb76dd591f tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:17.670178 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aad714-11b3-4313-9357-74bb76dd591f tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:17.671017 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aad714-11b3-4313-9357-74bb76dd591f tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/roles/04d9c7f2728f4fafb1d6b659f755e40a` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:17.672908 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aad714-11b3-4313-9357-74bb76dd591f tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:delete_role(role_id=04d9c7f2728f4fafb1d6b659f755e40a)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:17.675307 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aad714-11b3-4313-9357-74bb76dd591f tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:17.810290 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-66aad714-11b3-4313-9357-74bb76dd591f tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invalidating the token cache because role 04d9c7f2728f4fafb1d6b659f755e40a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:23:17.810290 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-66aad714-11b3-4313-9357-74bb76dd591f tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:17.812571 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-66aad714-11b3-4313-9357-74bb76dd591f tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:17.819176 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1915/3858] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:23:17 2022] DELETE /identity/v3/roles/04d9c7f2728f4fafb1d6b659f755e40a => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:17.820061 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f146b3d9-b190-4d5b-b013-ceaf94e1f58f tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:17.821972 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-f146b3d9-b190-4d5b-b013-ceaf94e1f58f tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:17.840307 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f146b3d9-b190-4d5b-b013-ceaf94e1f58f tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:17.962983 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08fdd03-adde-4e72-8d94-d6d456a2fe9f tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ab66d718ae41ff878dcef4d37c369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '497ca270ba674ce0a99b58dc33040a13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:17.964794 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08fdd03-adde-4e72-8d94-d6d456a2fe9f tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:17.965370 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08fdd03-adde-4e72-8d94-d6d456a2fe9f tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:17.965750 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08fdd03-adde-4e72-8d94-d6d456a2fe9f tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] PATH_INFO: `/v3/roles/4d93c1ee22da4498b1f9f05435b22d5a` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:17.967701 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08fdd03-adde-4e72-8d94-d6d456a2fe9f tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorizing `identity:delete_role(role_id=4d93c1ee22da4498b1f9f05435b22d5a)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:17.970229 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08fdd03-adde-4e72-8d94-d6d456a2fe9f tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:18.118332 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b08fdd03-adde-4e72-8d94-d6d456a2fe9f tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invalidating the token cache because role 4d93c1ee22da4498b1f9f05435b22d5a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:23:18.120108 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b08fdd03-adde-4e72-8d94-d6d456a2fe9f tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:18.120108 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b08fdd03-adde-4e72-8d94-d6d456a2fe9f tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:18.133805 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aad714-11b3-4313-9357-74bb76dd591f tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:18.133805 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-66aad714-11b3-4313-9357-74bb76dd591f tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:18.134204 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1944/3859] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:23:17 2022] DELETE /identity/v3/roles/4d93c1ee22da4498b1f9f05435b22d5a => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:23:18.228485 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aad714-11b3-4313-9357-74bb76dd591f tempest-RolesV3TestJSON-1711987751 tempest-RolesV3TestJSON-1711987751-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:18.360889 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de4e03f-4095-488c-b268-e30e94c1f535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:18.362296 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4e03f-4095-488c-b268-e30e94c1f535 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:18.362730 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4e03f-4095-488c-b268-e30e94c1f535 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:18.363114 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4e03f-4095-488c-b268-e30e94c1f535 admin admin] PATH_INFO: `/v3/users/4cbf1a872d1d4130a7f35d24aa2efa98` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:18.365662 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de4e03f-4095-488c-b268-e30e94c1f535 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cbf1a872d1d4130a7f35d24aa2efa98)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:18.368545 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de4e03f-4095-488c-b268-e30e94c1f535 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:18.581477 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7de4e03f-4095-488c-b268-e30e94c1f535 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cbf1a872d1d4130a7f35d24aa2efa98'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:18.598931 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7de4e03f-4095-488c-b268-e30e94c1f535 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cbf1a872d1d4130a7f35d24aa2efa98'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:18.599971 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7de4e03f-4095-488c-b268-e30e94c1f535 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cbf1a872d1d4130a7f35d24aa2efa98'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:18.720845 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7de4e03f-4095-488c-b268-e30e94c1f535 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cbf1a872d1d4130a7f35d24aa2efa98'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:18.747839 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7de4e03f-4095-488c-b268-e30e94c1f535 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cbf1a872d1d4130a7f35d24aa2efa98'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:18.758244 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1916/3860] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:23:18 2022] DELETE /identity/v3/users/4cbf1a872d1d4130a7f35d24aa2efa98 => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:18.767850 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d555c-d75d-4071-adcd-3b95d5adb4cc None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:18.767850 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d555c-d75d-4071-adcd-3b95d5adb4cc None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:18.767850 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d555c-d75d-4071-adcd-3b95d5adb4cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:18.807451 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-103d555c-d75d-4071-adcd-3b95d5adb4cc None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:23:18.811604 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-103d555c-d75d-4071-adcd-3b95d5adb4cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:18.953812 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1945/3861] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:23:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:23:18.966219 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de4e03f-4095-488c-b268-e30e94c1f535 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:18.968233 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-7de4e03f-4095-488c-b268-e30e94c1f535 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:19.041595 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de4e03f-4095-488c-b268-e30e94c1f535 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:19.047262 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062b91d7-a437-4da5-85ad-a66220fc46b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:19.048091 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b91d7-a437-4da5-85ad-a66220fc46b9 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:19.048535 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b91d7-a437-4da5-85ad-a66220fc46b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:19.049456 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b91d7-a437-4da5-85ad-a66220fc46b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:19.064095 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062b91d7-a437-4da5-85ad-a66220fc46b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:19.067435 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062b91d7-a437-4da5-85ad-a66220fc46b9 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:19.107168 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1917/3862] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:23:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:23:19.474429 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d555c-d75d-4071-adcd-3b95d5adb4cc None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:19.474429 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-103d555c-d75d-4071-adcd-3b95d5adb4cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:19.501525 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d555c-d75d-4071-adcd-3b95d5adb4cc None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:19.507121 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d44074-8e88-4915-912c-b658db3c06e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:19.508390 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d44074-8e88-4915-912c-b658db3c06e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:19.508831 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d44074-8e88-4915-912c-b658db3c06e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:19.509114 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d44074-8e88-4915-912c-b658db3c06e5 admin admin] PATH_INFO: `/v3/users/beb60582a8ae4b2499db4a45da00512f` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:19.511054 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d44074-8e88-4915-912c-b658db3c06e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=beb60582a8ae4b2499db4a45da00512f)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:19.514036 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d44074-8e88-4915-912c-b658db3c06e5 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:19.846136 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f2d44074-8e88-4915-912c-b658db3c06e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'beb60582a8ae4b2499db4a45da00512f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:19.868123 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f2d44074-8e88-4915-912c-b658db3c06e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'beb60582a8ae4b2499db4a45da00512f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:19.877788 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f2d44074-8e88-4915-912c-b658db3c06e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'beb60582a8ae4b2499db4a45da00512f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:19.977917 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f2d44074-8e88-4915-912c-b658db3c06e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'beb60582a8ae4b2499db4a45da00512f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:19.980009 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f2d44074-8e88-4915-912c-b658db3c06e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'beb60582a8ae4b2499db4a45da00512f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:19.986221 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1946/3863] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:23:19 2022] DELETE /identity/v3/users/beb60582a8ae4b2499db4a45da00512f => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:20.276493 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062b91d7-a437-4da5-85ad-a66220fc46b9 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:20.287711 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-062b91d7-a437-4da5-85ad-a66220fc46b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:20.317860 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062b91d7-a437-4da5-85ad-a66220fc46b9 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:20.455625 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db47e456-bc7b-4d3e-b2a2-42894de712da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:20.456499 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db47e456-bc7b-4d3e-b2a2-42894de712da admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:20.456781 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db47e456-bc7b-4d3e-b2a2-42894de712da admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:20.457056 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db47e456-bc7b-4d3e-b2a2-42894de712da admin admin] PATH_INFO: `/v3/projects/a2e5c220abfa42d7aaef5da670fa01eb` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:20.458482 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db47e456-bc7b-4d3e-b2a2-42894de712da admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2e5c220abfa42d7aaef5da670fa01eb)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:20.460648 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db47e456-bc7b-4d3e-b2a2-42894de712da admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:20.474081 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d44074-8e88-4915-912c-b658db3c06e5 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:20.475836 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-f2d44074-8e88-4915-912c-b658db3c06e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:20.501391 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d44074-8e88-4915-912c-b658db3c06e5 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:20.513468 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1696b1-adc0-4a8c-b97e-28cdc7eaed8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:20.514352 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1696b1-adc0-4a8c-b97e-28cdc7eaed8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:20.514836 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1696b1-adc0-4a8c-b97e-28cdc7eaed8b admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:20.515278 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1696b1-adc0-4a8c-b97e-28cdc7eaed8b admin admin] PATH_INFO: `/v3/projects/f589f7d7ad0f4b63afd4132efa4e798a` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:20.518151 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1696b1-adc0-4a8c-b97e-28cdc7eaed8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f589f7d7ad0f4b63afd4132efa4e798a)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:20.520987 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1696b1-adc0-4a8c-b97e-28cdc7eaed8b admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:20.602153 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-db47e456-bc7b-4d3e-b2a2-42894de712da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2e5c220abfa42d7aaef5da670fa01eb', 'request_id': 'req-db47e456-bc7b-4d3e-b2a2-42894de712da'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:20.618925 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-db47e456-bc7b-4d3e-b2a2-42894de712da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2e5c220abfa42d7aaef5da670fa01eb', 'request_id': 'req-db47e456-bc7b-4d3e-b2a2-42894de712da'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:20.632109 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-db47e456-bc7b-4d3e-b2a2-42894de712da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2e5c220abfa42d7aaef5da670fa01eb', 'request_id': 'req-db47e456-bc7b-4d3e-b2a2-42894de712da'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:20.697523 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8a1696b1-adc0-4a8c-b97e-28cdc7eaed8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f589f7d7ad0f4b63afd4132efa4e798a', 'request_id': 'req-8a1696b1-adc0-4a8c-b97e-28cdc7eaed8b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:20.704999 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8a1696b1-adc0-4a8c-b97e-28cdc7eaed8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f589f7d7ad0f4b63afd4132efa4e798a', 'request_id': 'req-8a1696b1-adc0-4a8c-b97e-28cdc7eaed8b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:20.722972 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-db47e456-bc7b-4d3e-b2a2-42894de712da admin admin] The token cache is being invalidate because project a2e5c220abfa42d7aaef5da670fa01eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:23:20.723871 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-db47e456-bc7b-4d3e-b2a2-42894de712da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:20.724512 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-db47e456-bc7b-4d3e-b2a2-42894de712da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:20.726887 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1918/3864] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:23:20 2022] DELETE /identity/v3/projects/a2e5c220abfa42d7aaef5da670fa01eb => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:20.730676 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db47e456-bc7b-4d3e-b2a2-42894de712da admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:20.732234 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-db47e456-bc7b-4d3e-b2a2-42894de712da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:20.812832 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db47e456-bc7b-4d3e-b2a2-42894de712da admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:20.821628 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8a1696b1-adc0-4a8c-b97e-28cdc7eaed8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f589f7d7ad0f4b63afd4132efa4e798a', 'request_id': 'req-8a1696b1-adc0-4a8c-b97e-28cdc7eaed8b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:20.843937 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8a1696b1-adc0-4a8c-b97e-28cdc7eaed8b admin admin] The token cache is being invalidate because project f589f7d7ad0f4b63afd4132efa4e798a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:23:20.846244 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8a1696b1-adc0-4a8c-b97e-28cdc7eaed8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:20.850432 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8a1696b1-adc0-4a8c-b97e-28cdc7eaed8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:20.853862 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1947/3865] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:23:20 2022] DELETE /identity/v3/projects/f589f7d7ad0f4b63afd4132efa4e798a => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:20.858916 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42366502-de30-4fce-b9c9-57f234c20f1a None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:20.859283 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42366502-de30-4fce-b9c9-57f234c20f1a None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:20.859707 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42366502-de30-4fce-b9c9-57f234c20f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:20.914193 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-42366502-de30-4fce-b9c9-57f234c20f1a None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:23:20.916210 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-42366502-de30-4fce-b9c9-57f234c20f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:20.945809 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663f82d3-52a2-4546-863c-bd0c2f2dc6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:20.946868 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f82d3-52a2-4546-863c-bd0c2f2dc6e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:20.946970 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f82d3-52a2-4546-863c-bd0c2f2dc6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:20.947250 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f82d3-52a2-4546-863c-bd0c2f2dc6e3 admin admin] PATH_INFO: `/v3/users/b7ab66d718ae41ff878dcef4d37c369e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:20.955794 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663f82d3-52a2-4546-863c-bd0c2f2dc6e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7ab66d718ae41ff878dcef4d37c369e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:20.957882 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663f82d3-52a2-4546-863c-bd0c2f2dc6e3 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:21.092677 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1948/3866] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:23:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:23:21.101371 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a52b1-c61b-40ce-a87e-f579cbd94133 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:21.102022 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a52b1-c61b-40ce-a87e-f579cbd94133 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:21.102592 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a52b1-c61b-40ce-a87e-f579cbd94133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:21.133072 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-c45a52b1-c61b-40ce-a87e-f579cbd94133 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:23:21.134535 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c45a52b1-c61b-40ce-a87e-f579cbd94133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:21.150055 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1949/3867] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:23:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:23:21.154423 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a52b1-c61b-40ce-a87e-f579cbd94133 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:21.163901 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a52b1-c61b-40ce-a87e-f579cbd94133 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:21.169565 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcc997e-112b-4b96-a23e-712f4c2c8f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:21.170513 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc997e-112b-4b96-a23e-712f4c2c8f28 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:21.170954 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc997e-112b-4b96-a23e-712f4c2c8f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:21.171653 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc997e-112b-4b96-a23e-712f4c2c8f28 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:21.172944 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcc997e-112b-4b96-a23e-712f4c2c8f28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:23:21.173438 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcc997e-112b-4b96-a23e-712f4c2c8f28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:21.175344 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcc997e-112b-4b96-a23e-712f4c2c8f28 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:21.191589 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1950/3868] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:23:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:23:21.195021 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcc997e-112b-4b96-a23e-712f4c2c8f28 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:21.206861 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcc997e-112b-4b96-a23e-712f4c2c8f28 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:21.212494 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be9365-ecee-4975-a2b2-2af502dec98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:21.213190 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be9365-ecee-4975-a2b2-2af502dec98d admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:21.213477 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be9365-ecee-4975-a2b2-2af502dec98d admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:21.213755 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be9365-ecee-4975-a2b2-2af502dec98d admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:21.215063 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30be9365-ecee-4975-a2b2-2af502dec98d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:21.217770 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30be9365-ecee-4975-a2b2-2af502dec98d admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:21.291141 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-663f82d3-52a2-4546-863c-bd0c2f2dc6e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7ab66d718ae41ff878dcef4d37c369e'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:21.300042 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-663f82d3-52a2-4546-863c-bd0c2f2dc6e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7ab66d718ae41ff878dcef4d37c369e'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:21.300768 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-663f82d3-52a2-4546-863c-bd0c2f2dc6e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7ab66d718ae41ff878dcef4d37c369e'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:21.319599 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1951/3869] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:23:21 2022] POST /identity/v3/projects => generated 395 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:23:21.325288 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be9365-ecee-4975-a2b2-2af502dec98d admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:21.401399 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-663f82d3-52a2-4546-863c-bd0c2f2dc6e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7ab66d718ae41ff878dcef4d37c369e'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:21.413576 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be9365-ecee-4975-a2b2-2af502dec98d admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:21.422871 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c3957-d9da-443a-a2f5-e2a00b68ae7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:21.422871 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c3957-d9da-443a-a2f5-e2a00b68ae7d admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:21.422871 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c3957-d9da-443a-a2f5-e2a00b68ae7d admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:21.422871 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c3957-d9da-443a-a2f5-e2a00b68ae7d admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:21.423938 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65c3957-d9da-443a-a2f5-e2a00b68ae7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:21.424755 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-663f82d3-52a2-4546-863c-bd0c2f2dc6e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7ab66d718ae41ff878dcef4d37c369e'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:21.427746 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65c3957-d9da-443a-a2f5-e2a00b68ae7d admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:21.443851 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1919/3870] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:23:20 2022] DELETE /identity/v3/users/b7ab66d718ae41ff878dcef4d37c369e => generated 0 bytes in 713 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:21.536905 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1952/3871] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:23:21 2022] POST /identity/v3/users => generated 298 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:23:21.540843 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663f82d3-52a2-4546-863c-bd0c2f2dc6e3 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:21.542379 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-663f82d3-52a2-4546-863c-bd0c2f2dc6e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:21.622935 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663f82d3-52a2-4546-863c-bd0c2f2dc6e3 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:21.629867 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede3369b-49b1-40a8-8a77-bef04eccf99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:21.635411 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede3369b-49b1-40a8-8a77-bef04eccf99d admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:21.636012 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede3369b-49b1-40a8-8a77-bef04eccf99d admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:21.636640 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede3369b-49b1-40a8-8a77-bef04eccf99d admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:21.638278 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede3369b-49b1-40a8-8a77-bef04eccf99d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:21.640197 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede3369b-49b1-40a8-8a77-bef04eccf99d admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:21.656493 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1920/3872] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:23:21 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:23:21.660708 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c3957-d9da-443a-a2f5-e2a00b68ae7d admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:21.679026 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c3957-d9da-443a-a2f5-e2a00b68ae7d admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:21.686950 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505644f3-ec69-449a-9c4b-052f49a166f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:21.687542 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505644f3-ec69-449a-9c4b-052f49a166f7 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:21.688290 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505644f3-ec69-449a-9c4b-052f49a166f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:21.688290 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505644f3-ec69-449a-9c4b-052f49a166f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:21.689416 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505644f3-ec69-449a-9c4b-052f49a166f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:21.691889 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505644f3-ec69-449a-9c4b-052f49a166f7 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:21.713143 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1953/3873] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:23:21 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:23:21.714507 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede3369b-49b1-40a8-8a77-bef04eccf99d admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:21.734155 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede3369b-49b1-40a8-8a77-bef04eccf99d admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:21.755043 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922b7412-a1e9-469e-ac52-281f97f90964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:21.757958 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b7412-a1e9-469e-ac52-281f97f90964 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:21.758338 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b7412-a1e9-469e-ac52-281f97f90964 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:21.758858 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b7412-a1e9-469e-ac52-281f97f90964 admin admin] PATH_INFO: `/v3/projects/386c2ac6c8354a37a6a22991fd1297a2/users/fddeac63ed6b4d968a00d93e16ba8f00/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:21.802558 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922b7412-a1e9-469e-ac52-281f97f90964 admin admin] RBAC: Authorizing `identity:create_grant(project_id=386c2ac6c8354a37a6a22991fd1297a2, user_id=fddeac63ed6b4d968a00d93e16ba8f00, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:21.805509 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922b7412-a1e9-469e-ac52-281f97f90964 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:21.836749 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db5d5d-d966-4757-99fc-6f4f35a93bec None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:21.837094 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db5d5d-d966-4757-99fc-6f4f35a93bec None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:21.837375 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db5d5d-d966-4757-99fc-6f4f35a93bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:21.861344 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-39db5d5d-d966-4757-99fc-6f4f35a93bec None None] MFA Rules not processed for user `a7f2d4818aa7461da8f30ddfe7641d93`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:23:21.861344 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-39db5d5d-d966-4757-99fc-6f4f35a93bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:21.963116 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1954/3874] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:23:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:23:21.997066 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1921/3875] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:23:21 2022] PUT /identity/v3/projects/386c2ac6c8354a37a6a22991fd1297a2/users/fddeac63ed6b4d968a00d93e16ba8f00/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:22.007657 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683a80d8-7786-4048-9f52-fbe29c50a6cb None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:22.007953 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683a80d8-7786-4048-9f52-fbe29c50a6cb None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:22.008236 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683a80d8-7786-4048-9f52-fbe29c50a6cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:22.042317 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-683a80d8-7786-4048-9f52-fbe29c50a6cb None None] MFA Rules not processed for user `fddeac63ed6b4d968a00d93e16ba8f00`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:23:22.043895 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-683a80d8-7786-4048-9f52-fbe29c50a6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:22.181731 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1955/3876] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:23:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:23:22.206905 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692cce44-9dbc-43cc-99f0-b6d93de951c4 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:22.206905 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692cce44-9dbc-43cc-99f0-b6d93de951c4 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:22.206905 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692cce44-9dbc-43cc-99f0-b6d93de951c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:22.212913 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-692cce44-9dbc-43cc-99f0-b6d93de951c4 None None] MFA Rules not processed for user `fddeac63ed6b4d968a00d93e16ba8f00`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:23:22.214309 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-692cce44-9dbc-43cc-99f0-b6d93de951c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:22.228094 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1922/3877] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:23:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:23:22.240561 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683a80d8-7786-4048-9f52-fbe29c50a6cb None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:22.244853 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-683a80d8-7786-4048-9f52-fbe29c50a6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:22.365257 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683a80d8-7786-4048-9f52-fbe29c50a6cb None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:22.373201 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a5495-1297-47c8-9d33-980e0c8432c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:22.374750 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a5495-1297-47c8-9d33-980e0c8432c9 service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:22.375232 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a5495-1297-47c8-9d33-980e0c8432c9 service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:22.375638 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a5495-1297-47c8-9d33-980e0c8432c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:22.385869 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34a5495-1297-47c8-9d33-980e0c8432c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:22.388407 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34a5495-1297-47c8-9d33-980e0c8432c9 service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:22.400062 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1956/3878] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:23:22 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:23:22.442726 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2515163-0b5c-4e00-8be6-56440c8e3341 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:22.443815 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2515163-0b5c-4e00-8be6-56440c8e3341 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:22.444307 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2515163-0b5c-4e00-8be6-56440c8e3341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:22.479361 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-a2515163-0b5c-4e00-8be6-56440c8e3341 None None] MFA Rules not processed for user `fddeac63ed6b4d968a00d93e16ba8f00`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:23:22.479361 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-a2515163-0b5c-4e00-8be6-56440c8e3341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:22.487458 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1923/3879] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:23:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:23:22.908268 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46bde2c-d345-493e-8f98-902830690648 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:22.908687 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46bde2c-d345-493e-8f98-902830690648 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:22.908838 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46bde2c-d345-493e-8f98-902830690648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:22.930767 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2515163-0b5c-4e00-8be6-56440c8e3341 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:22.932679 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-a2515163-0b5c-4e00-8be6-56440c8e3341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:22.945544 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-c46bde2c-d345-493e-8f98-902830690648 None None] MFA Rules not processed for user `fddeac63ed6b4d968a00d93e16ba8f00`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:23:22.947451 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c46bde2c-d345-493e-8f98-902830690648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:22.979511 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1957/3880] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:23:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:23:23.043213 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46bde2c-d345-493e-8f98-902830690648 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:23.047006 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c46bde2c-d345-493e-8f98-902830690648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:23.114712 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2515163-0b5c-4e00-8be6-56440c8e3341 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:23.144239 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde54775-c5c5-431f-9eae-dd1e38968e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:23.145137 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde54775-c5c5-431f-9eae-dd1e38968e1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:23.145640 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde54775-c5c5-431f-9eae-dd1e38968e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:23.145920 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde54775-c5c5-431f-9eae-dd1e38968e1a admin admin] PATH_INFO: `/v3/projects/497ca270ba674ce0a99b58dc33040a13` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:23.167424 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde54775-c5c5-431f-9eae-dd1e38968e1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=497ca270ba674ce0a99b58dc33040a13)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:23.173366 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde54775-c5c5-431f-9eae-dd1e38968e1a admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:23.205655 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46bde2c-d345-493e-8f98-902830690648 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:23.221247 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdd16a3-0e8f-4e4d-877c-8c7b139e807e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:23.222542 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd16a3-0e8f-4e4d-877c-8c7b139e807e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:23.222868 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd16a3-0e8f-4e4d-877c-8c7b139e807e admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:23.223161 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd16a3-0e8f-4e4d-877c-8c7b139e807e admin admin] PATH_INFO: `/v3/users/f2ef9ae6c6d24ba0b85fd8f41afb9c05` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:23.224740 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdd16a3-0e8f-4e4d-877c-8c7b139e807e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2ef9ae6c6d24ba0b85fd8f41afb9c05)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:23.226757 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdd16a3-0e8f-4e4d-877c-8c7b139e807e admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:23.374332 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dde54775-c5c5-431f-9eae-dd1e38968e1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '497ca270ba674ce0a99b58dc33040a13', 'request_id': 'req-dde54775-c5c5-431f-9eae-dd1e38968e1a'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:23.384541 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dde54775-c5c5-431f-9eae-dd1e38968e1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '497ca270ba674ce0a99b58dc33040a13', 'request_id': 'req-dde54775-c5c5-431f-9eae-dd1e38968e1a'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:23.393139 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dde54775-c5c5-431f-9eae-dd1e38968e1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '497ca270ba674ce0a99b58dc33040a13', 'request_id': 'req-dde54775-c5c5-431f-9eae-dd1e38968e1a'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:23.517716 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3fdd16a3-0e8f-4e4d-877c-8c7b139e807e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2ef9ae6c6d24ba0b85fd8f41afb9c05'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:23.531153 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3fdd16a3-0e8f-4e4d-877c-8c7b139e807e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2ef9ae6c6d24ba0b85fd8f41afb9c05'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:23.531895 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dde54775-c5c5-431f-9eae-dd1e38968e1a admin admin] The token cache is being invalidate because project 497ca270ba674ce0a99b58dc33040a13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:23:23.532406 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dde54775-c5c5-431f-9eae-dd1e38968e1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:23.532973 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dde54775-c5c5-431f-9eae-dd1e38968e1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:23.534655 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1924/3881] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:23:22 2022] DELETE /identity/v3/projects/497ca270ba674ce0a99b58dc33040a13 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:23.536149 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93beff4a-538d-4366-a94c-449ac5fd21f8 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:23.536538 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93beff4a-538d-4366-a94c-449ac5fd21f8 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:23.536918 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93beff4a-538d-4366-a94c-449ac5fd21f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:23.548318 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3fdd16a3-0e8f-4e4d-877c-8c7b139e807e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2ef9ae6c6d24ba0b85fd8f41afb9c05'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:23.559597 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-93beff4a-538d-4366-a94c-449ac5fd21f8 None None] MFA Rules not processed for user `fddeac63ed6b4d968a00d93e16ba8f00`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:23:23.561255 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-93beff4a-538d-4366-a94c-449ac5fd21f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:23.618204 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3fdd16a3-0e8f-4e4d-877c-8c7b139e807e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2ef9ae6c6d24ba0b85fd8f41afb9c05'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:23.619193 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3fdd16a3-0e8f-4e4d-877c-8c7b139e807e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2ef9ae6c6d24ba0b85fd8f41afb9c05'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:23.628879 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1958/3882] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:23:23 2022] DELETE /identity/v3/users/f2ef9ae6c6d24ba0b85fd8f41afb9c05 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:23.630485 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6c3c6-ec44-48e8-b97c-fbd0c942487d None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:23.630850 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6c3c6-ec44-48e8-b97c-fbd0c942487d None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:23.631204 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6c3c6-ec44-48e8-b97c-fbd0c942487d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:23.641597 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1925/3883] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:23:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:23:23.670841 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-c9d6c3c6-ec44-48e8-b97c-fbd0c942487d None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:23:23.670841 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c9d6c3c6-ec44-48e8-b97c-fbd0c942487d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:23.671021 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6b658-211c-44df-9b94-24885826780d None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:23.671021 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6b658-211c-44df-9b94-24885826780d None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:23.671021 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6b658-211c-44df-9b94-24885826780d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:23.698905 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-30d6b658-211c-44df-9b94-24885826780d None None] MFA Rules not processed for user `fddeac63ed6b4d968a00d93e16ba8f00`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:23:23.700187 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-30d6b658-211c-44df-9b94-24885826780d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:23.748152 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1959/3884] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:23:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:23:23.757368 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab1619-69cc-41e6-9fca-3cb36763c025 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:23.757689 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab1619-69cc-41e6-9fca-3cb36763c025 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:23.757948 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab1619-69cc-41e6-9fca-3cb36763c025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:23.781960 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-0aab1619-69cc-41e6-9fca-3cb36763c025 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:23:23.783360 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-0aab1619-69cc-41e6-9fca-3cb36763c025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:23.793809 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1960/3885] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:23:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:23:23.807945 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1926/3886] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:23:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:23:23.808088 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aab1619-69cc-41e6-9fca-3cb36763c025 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:23.839549 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6b658-211c-44df-9b94-24885826780d None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:23.839549 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-30d6b658-211c-44df-9b94-24885826780d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:23.841374 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aab1619-69cc-41e6-9fca-3cb36763c025 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:23.854781 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba4a2e-1795-4f21-9446-c6ad5fb8c601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:23.858110 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6b658-211c-44df-9b94-24885826780d None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:23.860037 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba4a2e-1795-4f21-9446-c6ad5fb8c601 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:23.860600 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba4a2e-1795-4f21-9446-c6ad5fb8c601 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:23.861107 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba4a2e-1795-4f21-9446-c6ad5fb8c601 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:23.862050 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ba4a2e-1795-4f21-9446-c6ad5fb8c601 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:23:23.866249 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ba4a2e-1795-4f21-9446-c6ad5fb8c601 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:23.867049 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be7283d-4cc2-4ae9-8eb4-f105acf9c288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:23.868792 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be7283d-4cc2-4ae9-8eb4-f105acf9c288 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:23.869318 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ba4a2e-1795-4f21-9446-c6ad5fb8c601 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:23.871076 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be7283d-4cc2-4ae9-8eb4-f105acf9c288 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:23.873216 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be7283d-4cc2-4ae9-8eb4-f105acf9c288 admin admin] PATH_INFO: `/v3/users/fddeac63ed6b4d968a00d93e16ba8f00` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:23.876700 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be7283d-4cc2-4ae9-8eb4-f105acf9c288 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fddeac63ed6b4d968a00d93e16ba8f00)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:23.883602 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be7283d-4cc2-4ae9-8eb4-f105acf9c288 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:23.894147 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1961/3887] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:23:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:23:23.900813 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba4a2e-1795-4f21-9446-c6ad5fb8c601 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:23.916259 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba4a2e-1795-4f21-9446-c6ad5fb8c601 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:23.922095 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35b5448-787e-4f17-8817-a9deff81ade7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:23.923019 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b5448-787e-4f17-8817-a9deff81ade7 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:23.923434 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b5448-787e-4f17-8817-a9deff81ade7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:23.924288 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b5448-787e-4f17-8817-a9deff81ade7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:23.925395 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35b5448-787e-4f17-8817-a9deff81ade7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:23.927674 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35b5448-787e-4f17-8817-a9deff81ade7 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:24.066231 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1962/3888] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:23:23 2022] POST /identity/v3/projects => generated 365 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:23:24.066231 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35b5448-787e-4f17-8817-a9deff81ade7 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:24.072193 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b35b5448-787e-4f17-8817-a9deff81ade7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:24.159749 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0be7283d-4cc2-4ae9-8eb4-f105acf9c288 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fddeac63ed6b4d968a00d93e16ba8f00'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:24.163660 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35b5448-787e-4f17-8817-a9deff81ade7 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:24.168004 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0be7283d-4cc2-4ae9-8eb4-f105acf9c288 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fddeac63ed6b4d968a00d93e16ba8f00'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:24.169956 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0be7283d-4cc2-4ae9-8eb4-f105acf9c288 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fddeac63ed6b4d968a00d93e16ba8f00'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:24.173813 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eecbf6c-0937-4915-b2e9-a8d214545926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:24.175116 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eecbf6c-0937-4915-b2e9-a8d214545926 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:24.175116 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eecbf6c-0937-4915-b2e9-a8d214545926 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:24.175467 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eecbf6c-0937-4915-b2e9-a8d214545926 admin admin] PATH_INFO: `/v3/projects/44c96286063c40ac948610903a50e98f` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:24.176906 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eecbf6c-0937-4915-b2e9-a8d214545926 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44c96286063c40ac948610903a50e98f)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:24.178874 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eecbf6c-0937-4915-b2e9-a8d214545926 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:24.235031 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0be7283d-4cc2-4ae9-8eb4-f105acf9c288 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fddeac63ed6b4d968a00d93e16ba8f00'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:24.247031 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0be7283d-4cc2-4ae9-8eb4-f105acf9c288 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fddeac63ed6b4d968a00d93e16ba8f00'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:24.252913 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1927/3889] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:23:23 2022] DELETE /identity/v3/users/fddeac63ed6b4d968a00d93e16ba8f00 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:24.255930 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be7283d-4cc2-4ae9-8eb4-f105acf9c288 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:24.255930 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-0be7283d-4cc2-4ae9-8eb4-f105acf9c288 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:24.291033 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3eecbf6c-0937-4915-b2e9-a8d214545926 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44c96286063c40ac948610903a50e98f', 'request_id': 'req-3eecbf6c-0937-4915-b2e9-a8d214545926'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:24.304277 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3eecbf6c-0937-4915-b2e9-a8d214545926 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44c96286063c40ac948610903a50e98f', 'request_id': 'req-3eecbf6c-0937-4915-b2e9-a8d214545926'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:24.343839 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be7283d-4cc2-4ae9-8eb4-f105acf9c288 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:24.395588 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3eecbf6c-0937-4915-b2e9-a8d214545926 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44c96286063c40ac948610903a50e98f', 'request_id': 'req-3eecbf6c-0937-4915-b2e9-a8d214545926'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:24.404213 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9fbff8-f0d1-4c56-8a7d-92f25eace6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:24.404944 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9fbff8-f0d1-4c56-8a7d-92f25eace6e9 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:24.405233 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9fbff8-f0d1-4c56-8a7d-92f25eace6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:24.405570 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9fbff8-f0d1-4c56-8a7d-92f25eace6e9 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:24.406320 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9fbff8-f0d1-4c56-8a7d-92f25eace6e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:24.408368 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9fbff8-f0d1-4c56-8a7d-92f25eace6e9 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:24.408538 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3eecbf6c-0937-4915-b2e9-a8d214545926 admin admin] The token cache is being invalidate because project 44c96286063c40ac948610903a50e98f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:23:24.408935 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3eecbf6c-0937-4915-b2e9-a8d214545926 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:24.409671 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3eecbf6c-0937-4915-b2e9-a8d214545926 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:24.411800 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1963/3890] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:23:24 2022] DELETE /identity/v3/projects/44c96286063c40ac948610903a50e98f => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:24.413489 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0449d9-063f-440d-bfb5-1608296a8208 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:24.413857 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0449d9-063f-440d-bfb5-1608296a8208 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:24.414309 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0449d9-063f-440d-bfb5-1608296a8208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:24.436353 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-6d0449d9-063f-440d-bfb5-1608296a8208 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:23:24.437680 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-6d0449d9-063f-440d-bfb5-1608296a8208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:24.446649 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1964/3891] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:23:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:23:24.455542 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0449d9-063f-440d-bfb5-1608296a8208 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:24.455542 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-6d0449d9-063f-440d-bfb5-1608296a8208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:24.465470 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0449d9-063f-440d-bfb5-1608296a8208 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:24.470981 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ea18bc-6924-4bc3-9f86-3b81d7308f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:24.471905 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea18bc-6924-4bc3-9f86-3b81d7308f40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:24.472186 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea18bc-6924-4bc3-9f86-3b81d7308f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:24.472464 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea18bc-6924-4bc3-9f86-3b81d7308f40 admin admin] PATH_INFO: `/v3/users/1981905ab1664082abd54822f9ae7c9a` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:24.473686 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ea18bc-6924-4bc3-9f86-3b81d7308f40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1981905ab1664082abd54822f9ae7c9a)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:24.475887 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ea18bc-6924-4bc3-9f86-3b81d7308f40 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:24.524460 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1928/3892] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:23:24 2022] POST /identity/v3/users => generated 283 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:23:24.525371 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9fbff8-f0d1-4c56-8a7d-92f25eace6e9 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:24.527367 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-5d9fbff8-f0d1-4c56-8a7d-92f25eace6e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:24.588678 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9fbff8-f0d1-4c56-8a7d-92f25eace6e9 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:24.592594 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e64c51-8947-4c76-91d6-bdbc4e0f2df1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:24.593236 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e64c51-8947-4c76-91d6-bdbc4e0f2df1 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:24.593519 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e64c51-8947-4c76-91d6-bdbc4e0f2df1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:24.599813 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e64c51-8947-4c76-91d6-bdbc4e0f2df1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:24.603142 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e64c51-8947-4c76-91d6-bdbc4e0f2df1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:24.604651 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e64c51-8947-4c76-91d6-bdbc4e0f2df1 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:24.614701 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1929/3893] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:23:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:23:24.615509 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e64c51-8947-4c76-91d6-bdbc4e0f2df1 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:24.616780 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-48e64c51-8947-4c76-91d6-bdbc4e0f2df1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:24.629576 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e64c51-8947-4c76-91d6-bdbc4e0f2df1 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:24.634490 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc347c3-721d-49aa-8d90-591f3c46dba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:24.635147 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc347c3-721d-49aa-8d90-591f3c46dba9 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:24.635432 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc347c3-721d-49aa-8d90-591f3c46dba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:24.635763 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc347c3-721d-49aa-8d90-591f3c46dba9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:24.636765 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc347c3-721d-49aa-8d90-591f3c46dba9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:24.638609 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc347c3-721d-49aa-8d90-591f3c46dba9 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:24.648655 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1930/3894] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:23:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:23:24.653358 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc347c3-721d-49aa-8d90-591f3c46dba9 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:24.666008 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc347c3-721d-49aa-8d90-591f3c46dba9 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:24.673001 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9793503-810a-46a0-93c7-8e6c9de7d821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:24.673773 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9793503-810a-46a0-93c7-8e6c9de7d821 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:24.674161 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9793503-810a-46a0-93c7-8e6c9de7d821 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:24.674634 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9793503-810a-46a0-93c7-8e6c9de7d821 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:24.675567 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9793503-810a-46a0-93c7-8e6c9de7d821 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:24.677365 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9793503-810a-46a0-93c7-8e6c9de7d821 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:24.689963 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1931/3895] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:23:24 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:23:24.694719 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9793503-810a-46a0-93c7-8e6c9de7d821 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:24.706043 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9793503-810a-46a0-93c7-8e6c9de7d821 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:24.708153 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c2ea18bc-6924-4bc3-9f86-3b81d7308f40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1981905ab1664082abd54822f9ae7c9a'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:24.712556 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c7fd68-e807-4a5c-93b6-202b8119cd08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:24.713843 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c7fd68-e807-4a5c-93b6-202b8119cd08 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:24.714357 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c7fd68-e807-4a5c-93b6-202b8119cd08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:24.714555 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c7fd68-e807-4a5c-93b6-202b8119cd08 admin admin] PATH_INFO: `/v3/projects/9d991808be6e44ba93806db5e4a77ae9/users/89cfa28cffc144ed8bcc59b2aa9311b5/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:24.722134 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c2ea18bc-6924-4bc3-9f86-3b81d7308f40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1981905ab1664082abd54822f9ae7c9a'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:24.729072 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c2ea18bc-6924-4bc3-9f86-3b81d7308f40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1981905ab1664082abd54822f9ae7c9a'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:24.730086 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c7fd68-e807-4a5c-93b6-202b8119cd08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d991808be6e44ba93806db5e4a77ae9, user_id=89cfa28cffc144ed8bcc59b2aa9311b5, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:24.733752 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c7fd68-e807-4a5c-93b6-202b8119cd08 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:24.824135 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c2ea18bc-6924-4bc3-9f86-3b81d7308f40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1981905ab1664082abd54822f9ae7c9a'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:24.824790 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c2ea18bc-6924-4bc3-9f86-3b81d7308f40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1981905ab1664082abd54822f9ae7c9a'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:24.832822 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1965/3896] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:23:24 2022] DELETE /identity/v3/users/1981905ab1664082abd54822f9ae7c9a => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:24.833620 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1932/3897] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:23:24 2022] PUT /identity/v3/projects/9d991808be6e44ba93806db5e4a77ae9/users/89cfa28cffc144ed8bcc59b2aa9311b5/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:23:24.846120 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79453f8e-5a89-4f98-b29d-af6ad5f42f40 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:24.846120 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79453f8e-5a89-4f98-b29d-af6ad5f42f40 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:24.846120 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79453f8e-5a89-4f98-b29d-af6ad5f42f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:24.874171 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-79453f8e-5a89-4f98-b29d-af6ad5f42f40 None None] MFA Rules not processed for user `89cfa28cffc144ed8bcc59b2aa9311b5`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:23:24.875399 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-79453f8e-5a89-4f98-b29d-af6ad5f42f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:24.974721 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1966/3898] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:23:24 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:23:24.978766 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c7fd68-e807-4a5c-93b6-202b8119cd08 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:24.981482 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c7c7fd68-e807-4a5c-93b6-202b8119cd08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:25.058766 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c7fd68-e807-4a5c-93b6-202b8119cd08 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:25.158314 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae1faae-3ea0-440c-8c6e-b21da5b3b221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:25.158314 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae1faae-3ea0-440c-8c6e-b21da5b3b221 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:25.158314 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae1faae-3ea0-440c-8c6e-b21da5b3b221 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:25.158314 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae1faae-3ea0-440c-8c6e-b21da5b3b221 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:25.158657 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae1faae-3ea0-440c-8c6e-b21da5b3b221 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:25.160986 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae1faae-3ea0-440c-8c6e-b21da5b3b221 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:25.186010 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79453f8e-5a89-4f98-b29d-af6ad5f42f40 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:25.187683 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-79453f8e-5a89-4f98-b29d-af6ad5f42f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:25.218800 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79453f8e-5a89-4f98-b29d-af6ad5f42f40 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:25.227187 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc11e4d0-8233-4176-98d5-218329994fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:25.228303 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11e4d0-8233-4176-98d5-218329994fe0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:25.228685 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11e4d0-8233-4176-98d5-218329994fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:25.229029 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11e4d0-8233-4176-98d5-218329994fe0 admin admin] PATH_INFO: `/v3/projects/386c2ac6c8354a37a6a22991fd1297a2` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:25.230353 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc11e4d0-8233-4176-98d5-218329994fe0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=386c2ac6c8354a37a6a22991fd1297a2)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:25.233179 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc11e4d0-8233-4176-98d5-218329994fe0 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:25.289580 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1933/3899] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:23:24 2022] POST /identity/v3/projects => generated 369 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:23:25.289580 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae1faae-3ea0-440c-8c6e-b21da5b3b221 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:25.290943 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-9ae1faae-3ea0-440c-8c6e-b21da5b3b221 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:25.363923 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae1faae-3ea0-440c-8c6e-b21da5b3b221 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:25.378055 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-cc11e4d0-8233-4176-98d5-218329994fe0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '386c2ac6c8354a37a6a22991fd1297a2', 'request_id': 'req-cc11e4d0-8233-4176-98d5-218329994fe0'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:25.385419 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-cc11e4d0-8233-4176-98d5-218329994fe0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '386c2ac6c8354a37a6a22991fd1297a2', 'request_id': 'req-cc11e4d0-8233-4176-98d5-218329994fe0'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:25.424194 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ead02c4-d509-48ea-a753-c34b3fd5481d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:25.425059 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead02c4-d509-48ea-a753-c34b3fd5481d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:25.425341 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead02c4-d509-48ea-a753-c34b3fd5481d admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:25.425615 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead02c4-d509-48ea-a753-c34b3fd5481d admin admin] PATH_INFO: `/v3/projects/d024008800d2448688d2f18f2ba173de` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:25.426815 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ead02c4-d509-48ea-a753-c34b3fd5481d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d024008800d2448688d2f18f2ba173de)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:25.428758 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ead02c4-d509-48ea-a753-c34b3fd5481d admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:25.502723 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-cc11e4d0-8233-4176-98d5-218329994fe0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '386c2ac6c8354a37a6a22991fd1297a2', 'request_id': 'req-cc11e4d0-8233-4176-98d5-218329994fe0'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:25.515816 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-cc11e4d0-8233-4176-98d5-218329994fe0 admin admin] The token cache is being invalidate because project 386c2ac6c8354a37a6a22991fd1297a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:23:25.516103 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-cc11e4d0-8233-4176-98d5-218329994fe0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:25.516746 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-cc11e4d0-8233-4176-98d5-218329994fe0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:25.518387 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1967/3900] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:23:25 2022] DELETE /identity/v3/projects/386c2ac6c8354a37a6a22991fd1297a2 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:25.519151 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc11e4d0-8233-4176-98d5-218329994fe0 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:25.520400 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-cc11e4d0-8233-4176-98d5-218329994fe0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:25.534722 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc11e4d0-8233-4176-98d5-218329994fe0 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:25.539456 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6af4ac-bb86-4a55-bbf5-86b13f6a1c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:25.540170 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6af4ac-bb86-4a55-bbf5-86b13f6a1c22 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:25.540454 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6af4ac-bb86-4a55-bbf5-86b13f6a1c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:25.540781 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6af4ac-bb86-4a55-bbf5-86b13f6a1c22 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:25.541663 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6af4ac-bb86-4a55-bbf5-86b13f6a1c22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:25.543661 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6af4ac-bb86-4a55-bbf5-86b13f6a1c22 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:25.570222 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9ead02c4-d509-48ea-a753-c34b3fd5481d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd024008800d2448688d2f18f2ba173de', 'request_id': 'req-9ead02c4-d509-48ea-a753-c34b3fd5481d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:25.578006 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9ead02c4-d509-48ea-a753-c34b3fd5481d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd024008800d2448688d2f18f2ba173de', 'request_id': 'req-9ead02c4-d509-48ea-a753-c34b3fd5481d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:25.583581 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9ead02c4-d509-48ea-a753-c34b3fd5481d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd024008800d2448688d2f18f2ba173de', 'request_id': 'req-9ead02c4-d509-48ea-a753-c34b3fd5481d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:25.652403 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9ead02c4-d509-48ea-a753-c34b3fd5481d admin admin] The token cache is being invalidate because project d024008800d2448688d2f18f2ba173de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:23:25.653061 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9ead02c4-d509-48ea-a753-c34b3fd5481d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:25.654959 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9ead02c4-d509-48ea-a753-c34b3fd5481d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:25.659353 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1968/3902] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:23:25 2022] POST /identity/v3/users => generated 291 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:23:25.660053 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1934/3902] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:23:25 2022] DELETE /identity/v3/projects/d024008800d2448688d2f18f2ba173de => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:25.661813 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ead02c4-d509-48ea-a753-c34b3fd5481d admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:25.662331 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde9596-eb3b-4095-be97-d38ec35eb10a None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:25.662526 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-9ead02c4-d509-48ea-a753-c34b3fd5481d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:25.662981 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde9596-eb3b-4095-be97-d38ec35eb10a None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:25.663671 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde9596-eb3b-4095-be97-d38ec35eb10a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:25.687342 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-4fde9596-eb3b-4095-be97-d38ec35eb10a None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:23:25.688659 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-4fde9596-eb3b-4095-be97-d38ec35eb10a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:25.743310 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ead02c4-d509-48ea-a753-c34b3fd5481d admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:25.750351 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243fdf34-03d0-4eb4-a542-d94fb3b5ea47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:25.751321 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243fdf34-03d0-4eb4-a542-d94fb3b5ea47 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:25.755374 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243fdf34-03d0-4eb4-a542-d94fb3b5ea47 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:25.755374 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243fdf34-03d0-4eb4-a542-d94fb3b5ea47 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:25.755374 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243fdf34-03d0-4eb4-a542-d94fb3b5ea47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:25.756748 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243fdf34-03d0-4eb4-a542-d94fb3b5ea47 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:25.774607 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1935/3903] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:23:25 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:23:25.776631 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8306efc6-ce35-4cc1-b8ae-62da6195a538 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:25.776917 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8306efc6-ce35-4cc1-b8ae-62da6195a538 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:25.777336 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8306efc6-ce35-4cc1-b8ae-62da6195a538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:25.793627 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1969/3904] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:23:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:23:25.794934 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fde9596-eb3b-4095-be97-d38ec35eb10a None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:25.804111 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-8306efc6-ce35-4cc1-b8ae-62da6195a538 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:23:25.805332 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8306efc6-ce35-4cc1-b8ae-62da6195a538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:25.808805 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fde9596-eb3b-4095-be97-d38ec35eb10a None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:25.820674 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ccc912-e107-48b4-b28f-54071ffe61bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:25.822338 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ccc912-e107-48b4-b28f-54071ffe61bb admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:25.822722 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ccc912-e107-48b4-b28f-54071ffe61bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:25.823798 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ccc912-e107-48b4-b28f-54071ffe61bb admin admin] PATH_INFO: `/v3/projects/e4ca399ec87f4044ad133caf08ffbdc6/users/b3b3021182184f0c80aff4920d5cc475/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:25.833300 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1936/3905] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:23:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:23:25.838617 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a58302-3464-4a1e-b38f-d4e7ff38466d None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:25.838617 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a58302-3464-4a1e-b38f-d4e7ff38466d None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:25.838617 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a58302-3464-4a1e-b38f-d4e7ff38466d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:25.861463 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ccc912-e107-48b4-b28f-54071ffe61bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4ca399ec87f4044ad133caf08ffbdc6, user_id=b3b3021182184f0c80aff4920d5cc475, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:25.864738 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ccc912-e107-48b4-b28f-54071ffe61bb admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:25.877460 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-94a58302-3464-4a1e-b38f-d4e7ff38466d None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:23:25.878680 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-94a58302-3464-4a1e-b38f-d4e7ff38466d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:25.892520 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1937/3906] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:23:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:23:25.894146 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9879f6c9-9179-4dda-9f5e-8524bc008310 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:25.894437 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9879f6c9-9179-4dda-9f5e-8524bc008310 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:25.900731 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9879f6c9-9179-4dda-9f5e-8524bc008310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:25.935613 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-9879f6c9-9179-4dda-9f5e-8524bc008310 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:23:25.936941 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-9879f6c9-9179-4dda-9f5e-8524bc008310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:25.947626 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1938/3907] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:23:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:23:25.948842 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9879f6c9-9179-4dda-9f5e-8524bc008310 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:25.961496 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9879f6c9-9179-4dda-9f5e-8524bc008310 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:25.970943 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70836a03-998e-4c06-8c86-3c44a4656b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:25.971688 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70836a03-998e-4c06-8c86-3c44a4656b9d admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:25.971976 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70836a03-998e-4c06-8c86-3c44a4656b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:25.972943 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70836a03-998e-4c06-8c86-3c44a4656b9d admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:25.973722 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70836a03-998e-4c06-8c86-3c44a4656b9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:23:25.974041 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70836a03-998e-4c06-8c86-3c44a4656b9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:25.975709 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70836a03-998e-4c06-8c86-3c44a4656b9d admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:25.989275 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1939/3908] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:23:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:23:25.990227 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70836a03-998e-4c06-8c86-3c44a4656b9d admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:26.007334 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70836a03-998e-4c06-8c86-3c44a4656b9d admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:26.015719 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ec814d-e98d-4b1d-a2a2-8eb294f79128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:26.016506 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec814d-e98d-4b1d-a2a2-8eb294f79128 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:26.016807 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec814d-e98d-4b1d-a2a2-8eb294f79128 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:26.017092 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec814d-e98d-4b1d-a2a2-8eb294f79128 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:26.017879 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ec814d-e98d-4b1d-a2a2-8eb294f79128 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:23:26.018184 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ec814d-e98d-4b1d-a2a2-8eb294f79128 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:26.019987 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ec814d-e98d-4b1d-a2a2-8eb294f79128 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:26.038013 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1940/3909] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:23:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:23:26.038013 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ec814d-e98d-4b1d-a2a2-8eb294f79128 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:26.047051 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1970/3910] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:23:25 2022] PUT /identity/v3/projects/e4ca399ec87f4044ad133caf08ffbdc6/users/b3b3021182184f0c80aff4920d5cc475/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:26.048484 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ccc912-e107-48b4-b28f-54071ffe61bb admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:26.053223 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ec814d-e98d-4b1d-a2a2-8eb294f79128 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:26.131952 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c49d721-b599-4e6a-9db1-37eef971bd26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:26.132926 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c49d721-b599-4e6a-9db1-37eef971bd26 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:26.133364 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c49d721-b599-4e6a-9db1-37eef971bd26 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:26.133647 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c49d721-b599-4e6a-9db1-37eef971bd26 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:26.134452 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c49d721-b599-4e6a-9db1-37eef971bd26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:26.136849 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c49d721-b599-4e6a-9db1-37eef971bd26 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:26.140392 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ccc912-e107-48b4-b28f-54071ffe61bb admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:26.145395 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e2f897-614e-42b9-a21a-e195d8a1c957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:26.146133 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2f897-614e-42b9-a21a-e195d8a1c957 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:26.146495 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2f897-614e-42b9-a21a-e195d8a1c957 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:26.147054 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2f897-614e-42b9-a21a-e195d8a1c957 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:26.147925 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e2f897-614e-42b9-a21a-e195d8a1c957 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:26.149921 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e2f897-614e-42b9-a21a-e195d8a1c957 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:26.258802 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1941/3911] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:23:26 2022] POST /identity/v3/projects => generated 381 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:23:26.259648 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c49d721-b599-4e6a-9db1-37eef971bd26 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:26.286284 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1971/3912] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:23:26 2022] POST /identity/v3/projects => generated 379 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:23:26.286284 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e2f897-614e-42b9-a21a-e195d8a1c957 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:26.343493 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c49d721-b599-4e6a-9db1-37eef971bd26 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:26.373643 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e2f897-614e-42b9-a21a-e195d8a1c957 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:26.381609 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9ac76d-0a48-4b74-b382-0ea98b23fc74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:26.381984 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ac76d-0a48-4b74-b382-0ea98b23fc74 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:26.382400 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ac76d-0a48-4b74-b382-0ea98b23fc74 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:26.382759 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ac76d-0a48-4b74-b382-0ea98b23fc74 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:26.383559 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9ac76d-0a48-4b74-b382-0ea98b23fc74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:26.386243 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9ac76d-0a48-4b74-b382-0ea98b23fc74 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:26.418796 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1bd14e-809c-4129-9b85-d41ee0f57c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:26.419536 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1bd14e-809c-4129-9b85-d41ee0f57c6f admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:26.419825 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1bd14e-809c-4129-9b85-d41ee0f57c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:26.421470 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1bd14e-809c-4129-9b85-d41ee0f57c6f admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:26.421470 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1bd14e-809c-4129-9b85-d41ee0f57c6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:26.422502 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1bd14e-809c-4129-9b85-d41ee0f57c6f admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:26.433037 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1942/3913] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:23:26 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:23:26.433843 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1bd14e-809c-4129-9b85-d41ee0f57c6f admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:26.445919 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1bd14e-809c-4129-9b85-d41ee0f57c6f admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:26.451691 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2674625e-e5eb-485c-ac71-eef112921d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:26.452420 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2674625e-e5eb-485c-ac71-eef112921d52 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:26.452702 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2674625e-e5eb-485c-ac71-eef112921d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:26.452973 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2674625e-e5eb-485c-ac71-eef112921d52 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:26.453672 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2674625e-e5eb-485c-ac71-eef112921d52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:26.455806 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2674625e-e5eb-485c-ac71-eef112921d52 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:26.479281 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1972/3914] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:23:26 2022] POST /identity/v3/users => generated 291 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:23:26.480163 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9ac76d-0a48-4b74-b382-0ea98b23fc74 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:26.492665 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9ac76d-0a48-4b74-b382-0ea98b23fc74 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:26.498818 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b19272f-9e44-4916-a5b1-321a844c0613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:26.499761 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19272f-9e44-4916-a5b1-321a844c0613 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:26.500051 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19272f-9e44-4916-a5b1-321a844c0613 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:26.500332 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19272f-9e44-4916-a5b1-321a844c0613 admin admin] PATH_INFO: `/v3/projects/e4ca399ec87f4044ad133caf08ffbdc6/users/b3b3021182184f0c80aff4920d5cc475/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:26.502327 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b19272f-9e44-4916-a5b1-321a844c0613 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4ca399ec87f4044ad133caf08ffbdc6, user_id=b3b3021182184f0c80aff4920d5cc475, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:26.505023 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b19272f-9e44-4916-a5b1-321a844c0613 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:26.520866 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1973/3915] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:23:26 2022] PUT /identity/v3/projects/e4ca399ec87f4044ad133caf08ffbdc6/users/b3b3021182184f0c80aff4920d5cc475/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:26.520866 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b19272f-9e44-4916-a5b1-321a844c0613 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:26.526852 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1943/3916] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:23:26 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:23:26.529052 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae2ea6-03c8-4513-9032-9a44ec564577 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:26.529358 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae2ea6-03c8-4513-9032-9a44ec564577 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:26.529695 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae2ea6-03c8-4513-9032-9a44ec564577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:26.566577 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-b7ae2ea6-03c8-4513-9032-9a44ec564577 None None] MFA Rules not processed for user `b3b3021182184f0c80aff4920d5cc475`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:23:26.568151 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b7ae2ea6-03c8-4513-9032-9a44ec564577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:26.626364 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b19272f-9e44-4916-a5b1-321a844c0613 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:26.641355 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ec5f0-b9c1-49d0-932d-39f9fdc38419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:26.642543 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ec5f0-b9c1-49d0-932d-39f9fdc38419 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:26.643127 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ec5f0-b9c1-49d0-932d-39f9fdc38419 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:26.651729 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ec5f0-b9c1-49d0-932d-39f9fdc38419 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:26.651729 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2ec5f0-b9c1-49d0-932d-39f9fdc38419 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:26.651729 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2ec5f0-b9c1-49d0-932d-39f9fdc38419 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:26.658032 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1944/3917] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:23:26 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:23:26.663030 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1974/3918] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:23:26 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:23:26.663553 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae2ea6-03c8-4513-9032-9a44ec564577 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:26.664473 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ec5f0-b9c1-49d0-932d-39f9fdc38419 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:26.677437 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae2ea6-03c8-4513-9032-9a44ec564577 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:26.678753 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ec5f0-b9c1-49d0-932d-39f9fdc38419 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:26.684372 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7516f692-a6f5-4cf9-b8d1-03e76a3285a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:26.686077 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516f692-a6f5-4cf9-b8d1-03e76a3285a9 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:26.686515 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516f692-a6f5-4cf9-b8d1-03e76a3285a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:26.687013 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516f692-a6f5-4cf9-b8d1-03e76a3285a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:26.687782 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa6d52c-480f-4bf0-acbf-ecd2dbb32bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:26.688285 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7516f692-a6f5-4cf9-b8d1-03e76a3285a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:26.688702 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6d52c-480f-4bf0-acbf-ecd2dbb32bff admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:26.689046 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6d52c-480f-4bf0-acbf-ecd2dbb32bff admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:26.689394 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6d52c-480f-4bf0-acbf-ecd2dbb32bff admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:26.690223 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa6d52c-480f-4bf0-acbf-ecd2dbb32bff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:26.690336 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7516f692-a6f5-4cf9-b8d1-03e76a3285a9 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:26.692755 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa6d52c-480f-4bf0-acbf-ecd2dbb32bff admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:26.702625 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1945/3919] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:23:26 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:23:26.702625 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7516f692-a6f5-4cf9-b8d1-03e76a3285a9 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:26.719201 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7516f692-a6f5-4cf9-b8d1-03e76a3285a9 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:26.725366 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26857999-2784-4ae7-9633-cdcf6345b0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:26.726353 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26857999-2784-4ae7-9633-cdcf6345b0b3 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:26.726635 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26857999-2784-4ae7-9633-cdcf6345b0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:26.726908 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26857999-2784-4ae7-9633-cdcf6345b0b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:26.727694 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26857999-2784-4ae7-9633-cdcf6345b0b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:26.730597 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26857999-2784-4ae7-9633-cdcf6345b0b3 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:26.742196 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1946/3920] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:23:26 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:23:26.743422 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26857999-2784-4ae7-9633-cdcf6345b0b3 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:26.756524 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26857999-2784-4ae7-9633-cdcf6345b0b3 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:26.762140 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09665e1e-b0f9-484a-a072-4b9265895db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:26.762805 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09665e1e-b0f9-484a-a072-4b9265895db3 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:26.763082 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09665e1e-b0f9-484a-a072-4b9265895db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:26.763357 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09665e1e-b0f9-484a-a072-4b9265895db3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:26.764284 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09665e1e-b0f9-484a-a072-4b9265895db3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:26.765878 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09665e1e-b0f9-484a-a072-4b9265895db3 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:26.777039 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1947/3921] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:23:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:23:26.777916 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09665e1e-b0f9-484a-a072-4b9265895db3 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:26.789289 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09665e1e-b0f9-484a-a072-4b9265895db3 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:26.796477 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a524d6b-ea49-4d81-96c4-bf7774ba172d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:26.797480 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a524d6b-ea49-4d81-96c4-bf7774ba172d admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:26.797758 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a524d6b-ea49-4d81-96c4-bf7774ba172d admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:26.798080 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a524d6b-ea49-4d81-96c4-bf7774ba172d admin admin] PATH_INFO: `/v3/projects/fe513cd0819f40d7866ce2aaa1b8ea8d/users/87538f2309714545bd47f228b6505883/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:26.814876 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a524d6b-ea49-4d81-96c4-bf7774ba172d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe513cd0819f40d7866ce2aaa1b8ea8d, user_id=87538f2309714545bd47f228b6505883, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:26.817971 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a524d6b-ea49-4d81-96c4-bf7774ba172d admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:26.821493 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1975/3922] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:23:26 2022] POST /identity/v3/projects => generated 367 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:23:26.822353 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa6d52c-480f-4bf0-acbf-ecd2dbb32bff admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:26.892458 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1948/3923] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:23:26 2022] PUT /identity/v3/projects/fe513cd0819f40d7866ce2aaa1b8ea8d/users/87538f2309714545bd47f228b6505883/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:26.892458 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a524d6b-ea49-4d81-96c4-bf7774ba172d admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:26.964658 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa6d52c-480f-4bf0-acbf-ecd2dbb32bff admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:27.001718 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a524d6b-ea49-4d81-96c4-bf7774ba172d admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:27.025775 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a5b783-c056-4d7e-b689-ebeab29a82dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:27.026754 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5b783-c056-4d7e-b689-ebeab29a82dc admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:27.030847 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5b783-c056-4d7e-b689-ebeab29a82dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:27.030847 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5b783-c056-4d7e-b689-ebeab29a82dc admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:27.030847 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a5b783-c056-4d7e-b689-ebeab29a82dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:27.038629 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a5b783-c056-4d7e-b689-ebeab29a82dc admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:27.146862 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9021b034-ad72-4397-a0f5-f368db42e430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:27.149396 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021b034-ad72-4397-a0f5-f368db42e430 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:27.149751 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021b034-ad72-4397-a0f5-f368db42e430 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:27.149995 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021b034-ad72-4397-a0f5-f368db42e430 admin admin] PATH_INFO: `/v3/projects/73731f1637db4792b4523545840a6f8c/users/1f256f3ef91b4df484d198fc7ce01296/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:27.160774 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1949/3924] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:23:26 2022] POST /identity/v3/users => generated 284 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:23:27.161942 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71713203-d759-4510-a074-d3afb0660781 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:27.162244 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71713203-d759-4510-a074-d3afb0660781 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:27.162679 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71713203-d759-4510-a074-d3afb0660781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:27.197988 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9021b034-ad72-4397-a0f5-f368db42e430 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73731f1637db4792b4523545840a6f8c, user_id=1f256f3ef91b4df484d198fc7ce01296, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:27.203499 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9021b034-ad72-4397-a0f5-f368db42e430 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:27.213520 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-71713203-d759-4510-a074-d3afb0660781 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:23:27.215243 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-71713203-d759-4510-a074-d3afb0660781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:27.235828 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1950/3925] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:23:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:23:27.243599 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71713203-d759-4510-a074-d3afb0660781 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:27.250736 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71713203-d759-4510-a074-d3afb0660781 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:27.254966 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53526f8c-0402-48a2-aba5-c12fe9535521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:27.255695 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53526f8c-0402-48a2-aba5-c12fe9535521 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:27.255968 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53526f8c-0402-48a2-aba5-c12fe9535521 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:27.256241 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53526f8c-0402-48a2-aba5-c12fe9535521 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:27.257087 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53526f8c-0402-48a2-aba5-c12fe9535521 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:27.258728 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53526f8c-0402-48a2-aba5-c12fe9535521 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:27.275374 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1951/3926] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:23:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:23:27.275374 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53526f8c-0402-48a2-aba5-c12fe9535521 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:27.277770 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-53526f8c-0402-48a2-aba5-c12fe9535521 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:27.288757 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1976/3927] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:23:26 2022] PUT /identity/v3/projects/73731f1637db4792b4523545840a6f8c/users/1f256f3ef91b4df484d198fc7ce01296/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:27.288757 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9021b034-ad72-4397-a0f5-f368db42e430 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:27.377247 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53526f8c-0402-48a2-aba5-c12fe9535521 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:27.390257 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9021b034-ad72-4397-a0f5-f368db42e430 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:27.397460 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f7a963-a447-4ee5-a506-fa163e7322c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:27.398554 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7a963-a447-4ee5-a506-fa163e7322c5 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:27.398554 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7a963-a447-4ee5-a506-fa163e7322c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:27.398940 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7a963-a447-4ee5-a506-fa163e7322c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:27.399809 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f7a963-a447-4ee5-a506-fa163e7322c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:27.401998 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f7a963-a447-4ee5-a506-fa163e7322c5 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:27.419873 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1977/3928] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:23:27 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:23:27.421999 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af33c6c2-4067-4098-a748-fab039197f4d None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:27.421999 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af33c6c2-4067-4098-a748-fab039197f4d None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:27.422385 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af33c6c2-4067-4098-a748-fab039197f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:27.472653 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-af33c6c2-4067-4098-a748-fab039197f4d None None] MFA Rules not processed for user `1f256f3ef91b4df484d198fc7ce01296`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:23:27.475258 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-af33c6c2-4067-4098-a748-fab039197f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:27.509380 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648be3bc-16fd-4c0f-bdf0-1142b82f1b3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:27.510493 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648be3bc-16fd-4c0f-bdf0-1142b82f1b3f service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:27.510788 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648be3bc-16fd-4c0f-bdf0-1142b82f1b3f service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:27.511068 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648be3bc-16fd-4c0f-bdf0-1142b82f1b3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:27.540739 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648be3bc-16fd-4c0f-bdf0-1142b82f1b3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:27.545953 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648be3bc-16fd-4c0f-bdf0-1142b82f1b3f service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:27.565398 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1952/3929] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:23:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:23:27.567270 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648be3bc-16fd-4c0f-bdf0-1142b82f1b3f service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:27.582106 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648be3bc-16fd-4c0f-bdf0-1142b82f1b3f service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:27.588673 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c631dd-34c2-43be-ba80-8197519227ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:27.589568 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c631dd-34c2-43be-ba80-8197519227ae admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:27.589850 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c631dd-34c2-43be-ba80-8197519227ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:27.590126 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c631dd-34c2-43be-ba80-8197519227ae admin admin] PATH_INFO: `/v3/projects/d82dae50b73e4752883ed8c6632ed10f/users/553d37b6560b45c3bd17b80c576a2026/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:27.609784 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c631dd-34c2-43be-ba80-8197519227ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=d82dae50b73e4752883ed8c6632ed10f, user_id=553d37b6560b45c3bd17b80c576a2026, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:27.614454 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c631dd-34c2-43be-ba80-8197519227ae admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:27.621619 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1978/3930] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:23:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:23:27.693404 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1953/3931] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:23:27 2022] PUT /identity/v3/projects/d82dae50b73e4752883ed8c6632ed10f/users/553d37b6560b45c3bd17b80c576a2026/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:27.705797 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacac808-2c4f-44b8-ab80-b8d1116429ae None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:27.706092 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacac808-2c4f-44b8-ab80-b8d1116429ae None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:27.706996 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacac808-2c4f-44b8-ab80-b8d1116429ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:27.746825 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-bacac808-2c4f-44b8-ab80-b8d1116429ae None None] MFA Rules not processed for user `553d37b6560b45c3bd17b80c576a2026`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:23:27.748831 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-bacac808-2c4f-44b8-ab80-b8d1116429ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:27.851371 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1979/3932] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:23:27 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:23:27.858322 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c631dd-34c2-43be-ba80-8197519227ae admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:27.861147 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacac808-2c4f-44b8-ab80-b8d1116429ae None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:27.864730 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-bacac808-2c4f-44b8-ab80-b8d1116429ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:28.000000 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c631dd-34c2-43be-ba80-8197519227ae admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:28.006816 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a958a4-31c5-43f1-b6c8-3f71327251fa tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b3021182184f0c80aff4920d5cc475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4ca399ec87f4044ad133caf08ffbdc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:28.008386 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a958a4-31c5-43f1-b6c8-3f71327251fa tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:28.008680 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a958a4-31c5-43f1-b6c8-3f71327251fa tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:28.008960 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a958a4-31c5-43f1-b6c8-3f71327251fa tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:28.009730 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a958a4-31c5-43f1-b6c8-3f71327251fa tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:28.011857 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a958a4-31c5-43f1-b6c8-3f71327251fa tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:28.023352 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacac808-2c4f-44b8-ab80-b8d1116429ae None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:28.030388 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74669219-b2d6-4004-a140-cef6bae55d44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:28.030944 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74669219-b2d6-4004-a140-cef6bae55d44 service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:28.031228 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74669219-b2d6-4004-a140-cef6bae55d44 service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:28.031537 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74669219-b2d6-4004-a140-cef6bae55d44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:28.097519 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74669219-b2d6-4004-a140-cef6bae55d44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:28.100892 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74669219-b2d6-4004-a140-cef6bae55d44 service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:28.110811 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1980/3933] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:23:27 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:23:28.134233 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1954/3934] 10.222.0.52 () {60 vars in 1148 bytes} [Sat May 14 21:23:27 2022] POST /identity/v3/domains => generated 277 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:23:28.141068 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74669219-b2d6-4004-a140-cef6bae55d44 service nova] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:28.166348 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74669219-b2d6-4004-a140-cef6bae55d44 service nova] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:28.284455 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddb1d09-1ae7-43c1-89b2-9f9293107c38 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b3021182184f0c80aff4920d5cc475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4ca399ec87f4044ad133caf08ffbdc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:28.288412 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb1d09-1ae7-43c1-89b2-9f9293107c38 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:28.288412 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb1d09-1ae7-43c1-89b2-9f9293107c38 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:28.288412 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb1d09-1ae7-43c1-89b2-9f9293107c38 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:28.288412 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddb1d09-1ae7-43c1-89b2-9f9293107c38 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:28.294754 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddb1d09-1ae7-43c1-89b2-9f9293107c38 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:28.458579 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1981/3935] 10.222.0.52 () {60 vars in 1142 bytes} [Sat May 14 21:23:28 2022] POST /identity/v3/roles => generated 240 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:23:28.465189 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a958a4-31c5-43f1-b6c8-3f71327251fa tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:28.485491 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a958a4-31c5-43f1-b6c8-3f71327251fa tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:28.508378 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feabe620-2cb0-44bd-bb35-38dcad5bd11d tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b3021182184f0c80aff4920d5cc475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4ca399ec87f4044ad133caf08ffbdc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:28.512441 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feabe620-2cb0-44bd-bb35-38dcad5bd11d tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:28.513207 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feabe620-2cb0-44bd-bb35-38dcad5bd11d tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:28.513536 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feabe620-2cb0-44bd-bb35-38dcad5bd11d tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] PATH_INFO: `/v3/domains/d34ed46f99a54acca0ca1a224a8022d1/users/553d37b6560b45c3bd17b80c576a2026/roles/bd147900ef3b4bc9a0e53657b03a5c7c` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:28.575257 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feabe620-2cb0-44bd-bb35-38dcad5bd11d tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=d34ed46f99a54acca0ca1a224a8022d1, user_id=553d37b6560b45c3bd17b80c576a2026, role_id=bd147900ef3b4bc9a0e53657b03a5c7c)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:28.577267 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2778609-c87c-4146-97f7-58283749dd31 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:28.580029 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2778609-c87c-4146-97f7-58283749dd31 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:28.580029 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2778609-c87c-4146-97f7-58283749dd31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:28.580219 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feabe620-2cb0-44bd-bb35-38dcad5bd11d tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:28.608422 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-f2778609-c87c-4146-97f7-58283749dd31 None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:23:28.609940 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-f2778609-c87c-4146-97f7-58283749dd31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:28.712787 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1955/3936] 10.222.0.52 () {60 vars in 1479 bytes} [Sat May 14 21:23:28 2022] PUT /identity/v3/domains/d34ed46f99a54acca0ca1a224a8022d1/users/553d37b6560b45c3bd17b80c576a2026/roles/bd147900ef3b4bc9a0e53657b03a5c7c => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:28.713605 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feabe620-2cb0-44bd-bb35-38dcad5bd11d tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:28.737467 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1982/3937] 10.222.0.52 () {58 vars in 1009 bytes} [Sat May 14 21:23:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:23:28.745363 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2778609-c87c-4146-97f7-58283749dd31 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:28.749546 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-f2778609-c87c-4146-97f7-58283749dd31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:28.810411 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feabe620-2cb0-44bd-bb35-38dcad5bd11d tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:28.815870 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac459da9-08ae-46ab-b23c-d0744aad39c6 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b3021182184f0c80aff4920d5cc475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4ca399ec87f4044ad133caf08ffbdc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:28.816971 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac459da9-08ae-46ab-b23c-d0744aad39c6 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:28.817136 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac459da9-08ae-46ab-b23c-d0744aad39c6 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:28.817324 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac459da9-08ae-46ab-b23c-d0744aad39c6 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:28.818179 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac459da9-08ae-46ab-b23c-d0744aad39c6 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:28.819967 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac459da9-08ae-46ab-b23c-d0744aad39c6 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:28.851779 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2778609-c87c-4146-97f7-58283749dd31 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:28.936714 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1956/3938] 10.222.0.52 () {60 vars in 1148 bytes} [Sat May 14 21:23:28 2022] POST /identity/v3/domains => generated 275 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:23:28.940509 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac459da9-08ae-46ab-b23c-d0744aad39c6 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:28.968939 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e183df62-5a50-4fa4-9e28-a9ae2a0c19d8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:28.969658 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e183df62-5a50-4fa4-9e28-a9ae2a0c19d8 service swift] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:28.969953 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e183df62-5a50-4fa4-9e28-a9ae2a0c19d8 service swift] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:28.970240 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e183df62-5a50-4fa4-9e28-a9ae2a0c19d8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:29.098820 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac459da9-08ae-46ab-b23c-d0744aad39c6 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:29.100743 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e183df62-5a50-4fa4-9e28-a9ae2a0c19d8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:29.102533 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e183df62-5a50-4fa4-9e28-a9ae2a0c19d8 service swift] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:29.115692 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1983/3939] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 21:23:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 21:23:29.128306 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b937223-3599-49af-a728-46e6e1be623d tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b3021182184f0c80aff4920d5cc475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4ca399ec87f4044ad133caf08ffbdc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:29.129061 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b937223-3599-49af-a728-46e6e1be623d tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:29.129349 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b937223-3599-49af-a728-46e6e1be623d tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:29.129626 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b937223-3599-49af-a728-46e6e1be623d tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:29.133009 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b937223-3599-49af-a728-46e6e1be623d tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:29.138415 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b937223-3599-49af-a728-46e6e1be623d tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:29.222969 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1957/3940] 10.222.0.52 () {60 vars in 1142 bytes} [Sat May 14 21:23:28 2022] POST /identity/v3/roles => generated 239 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:23:29.227689 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e183df62-5a50-4fa4-9e28-a9ae2a0c19d8 service swift] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:29.250040 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e183df62-5a50-4fa4-9e28-a9ae2a0c19d8 service swift] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:29.256670 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44ffb3a-38b1-4067-b307-e5c15e5e2255 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b3021182184f0c80aff4920d5cc475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4ca399ec87f4044ad133caf08ffbdc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:29.257783 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ffb3a-38b1-4067-b307-e5c15e5e2255 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:29.258082 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ffb3a-38b1-4067-b307-e5c15e5e2255 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:29.258547 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ffb3a-38b1-4067-b307-e5c15e5e2255 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] PATH_INFO: `/v3/groups` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:29.260276 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44ffb3a-38b1-4067-b307-e5c15e5e2255 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:29.265485 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44ffb3a-38b1-4067-b307-e5c15e5e2255 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:29.395772 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1984/3941] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:23:29 2022] POST /identity/v3/groups => generated 326 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:23:29.401410 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b937223-3599-49af-a728-46e6e1be623d tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:29.412177 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b937223-3599-49af-a728-46e6e1be623d tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:29.417154 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c165e766-307f-4fde-9e01-c0a7f3aa0565 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b3021182184f0c80aff4920d5cc475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4ca399ec87f4044ad133caf08ffbdc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:29.418054 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c165e766-307f-4fde-9e01-c0a7f3aa0565 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:29.418341 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c165e766-307f-4fde-9e01-c0a7f3aa0565 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:29.418612 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c165e766-307f-4fde-9e01-c0a7f3aa0565 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] PATH_INFO: `/v3/groups/19a0052863e84145a412c73ca92c0d5f/users/553d37b6560b45c3bd17b80c576a2026` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:29.425129 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c165e766-307f-4fde-9e01-c0a7f3aa0565 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=19a0052863e84145a412c73ca92c0d5f, user_id=553d37b6560b45c3bd17b80c576a2026)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:29.426153 ncdv-master-1 devstack@keystone.service[91107]: WARNING py.warnings [None req-c165e766-307f-4fde-9e01-c0a7f3aa0565 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 14 21:23:29.426153 ncdv-master-1 devstack@keystone.service[91107]: warnings.warn(msg) May 14 21:23:29.426153 ncdv-master-1 devstack@keystone.service[91107]: May 14 21:23:29.427336 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c165e766-307f-4fde-9e01-c0a7f3aa0565 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:29.525789 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8933c755-c74a-4552-bc4e-17b079402065 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:29.525789 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8933c755-c74a-4552-bc4e-17b079402065 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:29.533020 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8933c755-c74a-4552-bc4e-17b079402065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:29.538332 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1958/3942] 10.222.0.52 () {60 vars in 1359 bytes} [Sat May 14 21:23:29 2022] PUT /identity/v3/groups/19a0052863e84145a412c73ca92c0d5f/users/553d37b6560b45c3bd17b80c576a2026 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:29.538332 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c165e766-307f-4fde-9e01-c0a7f3aa0565 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:29.604262 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-8933c755-c74a-4552-bc4e-17b079402065 None None] MFA Rules not processed for user `1f256f3ef91b4df484d198fc7ce01296`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:23:29.606150 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-8933c755-c74a-4552-bc4e-17b079402065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:29.643454 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c165e766-307f-4fde-9e01-c0a7f3aa0565 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:29.651353 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0184ce6b-01d8-459d-91be-35a716cc12b8 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b3021182184f0c80aff4920d5cc475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4ca399ec87f4044ad133caf08ffbdc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:29.659334 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0184ce6b-01d8-459d-91be-35a716cc12b8 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:29.659334 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0184ce6b-01d8-459d-91be-35a716cc12b8 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:29.659334 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0184ce6b-01d8-459d-91be-35a716cc12b8 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] PATH_INFO: `/v3/domains/ab6c62b557744e2191dca10f39967bf8/groups/19a0052863e84145a412c73ca92c0d5f/roles/6bd320493ccc4cf0b8bc4f7ffd91e15b` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:29.662779 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0184ce6b-01d8-459d-91be-35a716cc12b8 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=ab6c62b557744e2191dca10f39967bf8, group_id=19a0052863e84145a412c73ca92c0d5f, role_id=6bd320493ccc4cf0b8bc4f7ffd91e15b)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:29.667823 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0184ce6b-01d8-459d-91be-35a716cc12b8 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:29.735752 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1985/3943] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:23:29 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:23:29.737460 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77024c5-146b-4f13-9937-84f7177dbfee None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:29.738103 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77024c5-146b-4f13-9937-84f7177dbfee None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:29.738770 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77024c5-146b-4f13-9937-84f7177dbfee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:29.763567 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1959/3944] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:23:29 2022] PUT /identity/v3/domains/ab6c62b557744e2191dca10f39967bf8/groups/19a0052863e84145a412c73ca92c0d5f/roles/6bd320493ccc4cf0b8bc4f7ffd91e15b => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:29.768235 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0184ce6b-01d8-459d-91be-35a716cc12b8 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:29.797461 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-a77024c5-146b-4f13-9937-84f7177dbfee None None] MFA Rules not processed for user `87538f2309714545bd47f228b6505883`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:23:29.797461 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-a77024c5-146b-4f13-9937-84f7177dbfee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:29.869227 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0184ce6b-01d8-459d-91be-35a716cc12b8 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:29.875626 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa81d61-d641-46df-8b0c-890ac6dcff87 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b3021182184f0c80aff4920d5cc475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4ca399ec87f4044ad133caf08ffbdc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:29.876694 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa81d61-d641-46df-8b0c-890ac6dcff87 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:29.876987 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa81d61-d641-46df-8b0c-890ac6dcff87 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:29.877676 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa81d61-d641-46df-8b0c-890ac6dcff87 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:29.878562 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa81d61-d641-46df-8b0c-890ac6dcff87 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:29.880764 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa81d61-d641-46df-8b0c-890ac6dcff87 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:29.915164 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1986/3945] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:23:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:23:29.930276 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82314dd6-3290-4b7e-a948-8babadd3c9cb None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:29.930472 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82314dd6-3290-4b7e-a948-8babadd3c9cb None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:29.930800 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82314dd6-3290-4b7e-a948-8babadd3c9cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:29.959882 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-82314dd6-3290-4b7e-a948-8babadd3c9cb None None] MFA Rules not processed for user `87538f2309714545bd47f228b6505883`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:23:29.961406 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-82314dd6-3290-4b7e-a948-8babadd3c9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:29.972201 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1987/3946] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:23:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:23:30.010498 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1960/3947] 10.222.0.52 () {60 vars in 1148 bytes} [Sat May 14 21:23:29 2022] POST /identity/v3/domains => generated 274 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:23:30.012049 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82314dd6-3290-4b7e-a948-8babadd3c9cb None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:30.024472 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82314dd6-3290-4b7e-a948-8babadd3c9cb None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:30.089025 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c4f4d1-e92c-42ed-83ba-d41c57de3fff tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b3021182184f0c80aff4920d5cc475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4ca399ec87f4044ad133caf08ffbdc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:30.090537 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4f4d1-e92c-42ed-83ba-d41c57de3fff tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:30.091817 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4f4d1-e92c-42ed-83ba-d41c57de3fff tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:30.092264 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4f4d1-e92c-42ed-83ba-d41c57de3fff tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:30.094823 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c4f4d1-e92c-42ed-83ba-d41c57de3fff tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:30.096722 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c4f4d1-e92c-42ed-83ba-d41c57de3fff tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:30.159408 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa81d61-d641-46df-8b0c-890ac6dcff87 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:30.161544 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-6aa81d61-d641-46df-8b0c-890ac6dcff87 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:30.237843 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1988/3948] 10.222.0.52 () {60 vars in 1142 bytes} [Sat May 14 21:23:30 2022] POST /identity/v3/roles => generated 240 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:23:30.239104 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610bc474-1f71-463f-8387-d3f76d3ec16f None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:30.239548 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610bc474-1f71-463f-8387-d3f76d3ec16f None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:30.239873 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610bc474-1f71-463f-8387-d3f76d3ec16f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:30.241888 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa81d61-d641-46df-8b0c-890ac6dcff87 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:30.249245 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c39f386-e981-4b9f-9a63-10d472c60231 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:30.249917 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c39f386-e981-4b9f-9a63-10d472c60231 service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:30.250201 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c39f386-e981-4b9f-9a63-10d472c60231 service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:30.254087 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c39f386-e981-4b9f-9a63-10d472c60231 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:30.261280 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-610bc474-1f71-463f-8387-d3f76d3ec16f None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:23:30.263181 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-610bc474-1f71-463f-8387-d3f76d3ec16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:30.322794 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c39f386-e981-4b9f-9a63-10d472c60231 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:30.324703 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c39f386-e981-4b9f-9a63-10d472c60231 service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:30.335975 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1961/3949] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:23:30 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:23:30.347120 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1989/3950] 10.222.0.52 () {58 vars in 967 bytes} [Sat May 14 21:23:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:23:30.348149 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610bc474-1f71-463f-8387-d3f76d3ec16f None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:30.361620 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610bc474-1f71-463f-8387-d3f76d3ec16f None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:30.367368 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8dcd30-6aef-400e-8d37-b13c23adcccb tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b3021182184f0c80aff4920d5cc475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4ca399ec87f4044ad133caf08ffbdc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:30.368534 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8dcd30-6aef-400e-8d37-b13c23adcccb tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:30.368888 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8dcd30-6aef-400e-8d37-b13c23adcccb tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:30.369546 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8dcd30-6aef-400e-8d37-b13c23adcccb tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] PATH_INFO: `/v3/domains/7e5ebd1ef22f4839bd60b9e01fa4abaf/users/553d37b6560b45c3bd17b80c576a2026/roles/0446dfbce1c641a1b1ef7ccc2f55bdb7` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:30.369644 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c39f386-e981-4b9f-9a63-10d472c60231 service nova] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:30.397977 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8dcd30-6aef-400e-8d37-b13c23adcccb tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=7e5ebd1ef22f4839bd60b9e01fa4abaf, user_id=553d37b6560b45c3bd17b80c576a2026, role_id=0446dfbce1c641a1b1ef7ccc2f55bdb7)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:30.400971 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8dcd30-6aef-400e-8d37-b13c23adcccb tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:30.463913 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c39f386-e981-4b9f-9a63-10d472c60231 service nova] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:30.471141 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c76452-2120-405c-9482-492bf1796c79 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:30.471836 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c76452-2120-405c-9482-492bf1796c79 service swift] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:30.472120 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c76452-2120-405c-9482-492bf1796c79 service swift] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:30.472395 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c76452-2120-405c-9482-492bf1796c79 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:30.483087 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1990/3951] 10.222.0.52 () {60 vars in 1479 bytes} [Sat May 14 21:23:30 2022] PUT /identity/v3/domains/7e5ebd1ef22f4839bd60b9e01fa4abaf/users/553d37b6560b45c3bd17b80c576a2026/roles/0446dfbce1c641a1b1ef7ccc2f55bdb7 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:30.483087 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8dcd30-6aef-400e-8d37-b13c23adcccb tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:30.484772 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c76452-2120-405c-9482-492bf1796c79 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:30.486384 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c76452-2120-405c-9482-492bf1796c79 service swift] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:30.498564 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1962/3952] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 21:23:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 21:23:30.595397 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8dcd30-6aef-400e-8d37-b13c23adcccb tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:30.603409 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64b51fb-bcfe-4e13-907c-fe20961f2db3 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b3021182184f0c80aff4920d5cc475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4ca399ec87f4044ad133caf08ffbdc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:30.604125 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b51fb-bcfe-4e13-907c-fe20961f2db3 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:30.604415 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b51fb-bcfe-4e13-907c-fe20961f2db3 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:30.604725 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b51fb-bcfe-4e13-907c-fe20961f2db3 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:30.605468 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64b51fb-bcfe-4e13-907c-fe20961f2db3 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:30.607699 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64b51fb-bcfe-4e13-907c-fe20961f2db3 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:30.669821 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c76452-2120-405c-9482-492bf1796c79 service swift] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:30.672132 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-55c76452-2120-405c-9482-492bf1796c79 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:30.727703 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1991/3953] 10.222.0.52 () {60 vars in 1148 bytes} [Sat May 14 21:23:30 2022] POST /identity/v3/domains => generated 277 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:23:30.732137 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64b51fb-bcfe-4e13-907c-fe20961f2db3 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:30.759697 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c76452-2120-405c-9482-492bf1796c79 service swift] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:30.813484 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64b51fb-bcfe-4e13-907c-fe20961f2db3 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:30.821264 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f00c6f-6676-4158-b6df-b6f31a742842 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b3021182184f0c80aff4920d5cc475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4ca399ec87f4044ad133caf08ffbdc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:30.822292 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f00c6f-6676-4158-b6df-b6f31a742842 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:30.822594 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f00c6f-6676-4158-b6df-b6f31a742842 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:30.823872 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f00c6f-6676-4158-b6df-b6f31a742842 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:30.824194 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f853c5-ff78-4806-a4d3-0ed0e69d72ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:30.824659 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f00c6f-6676-4158-b6df-b6f31a742842 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:30.826335 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f853c5-ff78-4806-a4d3-0ed0e69d72ae service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:30.826798 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f853c5-ff78-4806-a4d3-0ed0e69d72ae service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:30.827173 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f00c6f-6676-4158-b6df-b6f31a742842 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:30.827402 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f853c5-ff78-4806-a4d3-0ed0e69d72ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:30.829495 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-69f853c5-ff78-4806-a4d3-0ed0e69d72ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:30.840343 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f853c5-ff78-4806-a4d3-0ed0e69d72ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:30.841898 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f853c5-ff78-4806-a4d3-0ed0e69d72ae service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:30.850804 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1963/3954] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:23:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:23:30.969675 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f853c5-ff78-4806-a4d3-0ed0e69d72ae service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:30.971618 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1992/3955] 10.222.0.52 () {60 vars in 1142 bytes} [Sat May 14 21:23:30 2022] POST /identity/v3/roles => generated 239 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:23:30.975792 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f00c6f-6676-4158-b6df-b6f31a742842 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:30.986297 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f00c6f-6676-4158-b6df-b6f31a742842 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:30.991992 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2306056b-0757-4991-9268-334f2b77f7f9 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b3021182184f0c80aff4920d5cc475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4ca399ec87f4044ad133caf08ffbdc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:30.992947 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306056b-0757-4991-9268-334f2b77f7f9 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:30.993428 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306056b-0757-4991-9268-334f2b77f7f9 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:30.993898 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306056b-0757-4991-9268-334f2b77f7f9 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] PATH_INFO: `/v3/groups` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:30.994850 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2306056b-0757-4991-9268-334f2b77f7f9 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:30.997701 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2306056b-0757-4991-9268-334f2b77f7f9 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:31.057171 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f853c5-ff78-4806-a4d3-0ed0e69d72ae service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:31.064337 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ba6b5a-71bd-4b50-b776-d602f8e88484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:31.065184 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba6b5a-71bd-4b50-b776-d602f8e88484 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:31.065470 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba6b5a-71bd-4b50-b776-d602f8e88484 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:31.065744 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba6b5a-71bd-4b50-b776-d602f8e88484 admin admin] PATH_INFO: `/v3/users/1f256f3ef91b4df484d198fc7ce01296` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:31.067007 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ba6b5a-71bd-4b50-b776-d602f8e88484 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f256f3ef91b4df484d198fc7ce01296)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:31.069102 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ba6b5a-71bd-4b50-b776-d602f8e88484 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:31.095216 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1993/3956] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:23:30 2022] POST /identity/v3/groups => generated 326 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:23:31.099530 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2306056b-0757-4991-9268-334f2b77f7f9 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:31.117398 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2306056b-0757-4991-9268-334f2b77f7f9 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:31.125439 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b8ef1-7eb6-4cdc-95de-a95bdb9984f5 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b3021182184f0c80aff4920d5cc475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4ca399ec87f4044ad133caf08ffbdc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:31.126675 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b8ef1-7eb6-4cdc-95de-a95bdb9984f5 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:31.126956 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b8ef1-7eb6-4cdc-95de-a95bdb9984f5 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:31.127298 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b8ef1-7eb6-4cdc-95de-a95bdb9984f5 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] PATH_INFO: `/v3/groups/15528d9c659945ba9d523030ec41663f/users/553d37b6560b45c3bd17b80c576a2026` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:31.133298 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262b8ef1-7eb6-4cdc-95de-a95bdb9984f5 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=15528d9c659945ba9d523030ec41663f, user_id=553d37b6560b45c3bd17b80c576a2026)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:31.135242 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262b8ef1-7eb6-4cdc-95de-a95bdb9984f5 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:31.314161 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1994/3957] 10.222.0.52 () {60 vars in 1359 bytes} [Sat May 14 21:23:31 2022] PUT /identity/v3/groups/15528d9c659945ba9d523030ec41663f/users/553d37b6560b45c3bd17b80c576a2026 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:31.320069 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b8ef1-7eb6-4cdc-95de-a95bdb9984f5 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:31.334238 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-00ba6b5a-71bd-4b50-b776-d602f8e88484 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f256f3ef91b4df484d198fc7ce01296'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:31.348099 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-00ba6b5a-71bd-4b50-b776-d602f8e88484 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f256f3ef91b4df484d198fc7ce01296'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:31.353040 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-00ba6b5a-71bd-4b50-b776-d602f8e88484 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f256f3ef91b4df484d198fc7ce01296'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:31.423540 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b8ef1-7eb6-4cdc-95de-a95bdb9984f5 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:31.428857 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358148a7-d7c4-4fd4-9631-3be8e99a5ff1 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b3021182184f0c80aff4920d5cc475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4ca399ec87f4044ad133caf08ffbdc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:31.430051 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358148a7-d7c4-4fd4-9631-3be8e99a5ff1 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:31.430403 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358148a7-d7c4-4fd4-9631-3be8e99a5ff1 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:31.430748 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358148a7-d7c4-4fd4-9631-3be8e99a5ff1 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] PATH_INFO: `/v3/domains/8253ff4894014649aaef76797dd7b711/groups/15528d9c659945ba9d523030ec41663f/roles/3f3179a3fbd74d7bb2c6b255f36705ce` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:31.433701 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358148a7-d7c4-4fd4-9631-3be8e99a5ff1 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=8253ff4894014649aaef76797dd7b711, group_id=15528d9c659945ba9d523030ec41663f, role_id=3f3179a3fbd74d7bb2c6b255f36705ce)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:31.436697 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358148a7-d7c4-4fd4-9631-3be8e99a5ff1 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:31.476453 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-00ba6b5a-71bd-4b50-b776-d602f8e88484 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f256f3ef91b4df484d198fc7ce01296'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:31.498737 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-00ba6b5a-71bd-4b50-b776-d602f8e88484 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f256f3ef91b4df484d198fc7ce01296'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:31.511088 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1964/3958] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:23:30 2022] DELETE /identity/v3/users/1f256f3ef91b4df484d198fc7ce01296 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:31.520743 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629466c-7cb0-4ce6-ac67-e2a658f9b8c4 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:31.521141 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629466c-7cb0-4ce6-ac67-e2a658f9b8c4 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:31.521718 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629466c-7cb0-4ce6-ac67-e2a658f9b8c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:31.547760 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-8629466c-7cb0-4ce6-ac67-e2a658f9b8c4 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:23:31.550064 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8629466c-7cb0-4ce6-ac67-e2a658f9b8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:31.550684 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1995/3959] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:23:31 2022] PUT /identity/v3/domains/8253ff4894014649aaef76797dd7b711/groups/15528d9c659945ba9d523030ec41663f/roles/3f3179a3fbd74d7bb2c6b255f36705ce => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:31.552091 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358148a7-d7c4-4fd4-9631-3be8e99a5ff1 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:31.554004 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-358148a7-d7c4-4fd4-9631-3be8e99a5ff1 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:31.662981 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1965/3960] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:23:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:23:31.682820 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8629466c-7cb0-4ce6-ac67-e2a658f9b8c4 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:31.684480 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8629466c-7cb0-4ce6-ac67-e2a658f9b8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:31.723111 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358148a7-d7c4-4fd4-9631-3be8e99a5ff1 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:31.729821 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff48875-e2ce-45e0-9377-c9b8acfcd792 tempest-TokensV3TestJSON-768820606 tempest-TokensV3TestJSON-768820606-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '553d37b6560b45c3bd17b80c576a2026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82dae50b73e4752883ed8c6632ed10f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:31.730719 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff48875-e2ce-45e0-9377-c9b8acfcd792 tempest-TokensV3TestJSON-768820606 tempest-TokensV3TestJSON-768820606-project] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:31.731962 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff48875-e2ce-45e0-9377-c9b8acfcd792 tempest-TokensV3TestJSON-768820606 tempest-TokensV3TestJSON-768820606-project] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:31.733284 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff48875-e2ce-45e0-9377-c9b8acfcd792 tempest-TokensV3TestJSON-768820606 tempest-TokensV3TestJSON-768820606-project] PATH_INFO: `/v3/auth/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:31.733957 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff48875-e2ce-45e0-9377-c9b8acfcd792 tempest-TokensV3TestJSON-768820606 tempest-TokensV3TestJSON-768820606-project] RBAC: Authorizing `identity:get_auth_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:31.735396 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff48875-e2ce-45e0-9377-c9b8acfcd792 tempest-TokensV3TestJSON-768820606 tempest-TokensV3TestJSON-768820606-project] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:31.792237 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8629466c-7cb0-4ce6-ac67-e2a658f9b8c4 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:31.799615 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704fcfdc-e180-44de-be20-19768af67620 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:31.802177 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fcfdc-e180-44de-be20-19768af67620 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:31.802918 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fcfdc-e180-44de-be20-19768af67620 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:31.803428 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fcfdc-e180-44de-be20-19768af67620 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:31.824532 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704fcfdc-e180-44de-be20-19768af67620 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:31.827077 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704fcfdc-e180-44de-be20-19768af67620 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:31.844738 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1966/3961] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:23:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:23:31.857296 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1996/3962] 10.222.0.52 () {58 vars in 1142 bytes} [Sat May 14 21:23:31 2022] GET /identity/v3/auth/domains => generated 1171 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:23:31.861470 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704fcfdc-e180-44de-be20-19768af67620 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:31.864239 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-704fcfdc-e180-44de-be20-19768af67620 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:31.987102 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704fcfdc-e180-44de-be20-19768af67620 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:31.992840 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48c6ce6-9fa6-46c9-90a9-92cdb99f32a8 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b3021182184f0c80aff4920d5cc475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4ca399ec87f4044ad133caf08ffbdc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:31.993865 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48c6ce6-9fa6-46c9-90a9-92cdb99f32a8 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:31.994146 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48c6ce6-9fa6-46c9-90a9-92cdb99f32a8 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:31.994601 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48c6ce6-9fa6-46c9-90a9-92cdb99f32a8 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] PATH_INFO: `/v3/domains/8253ff4894014649aaef76797dd7b711/groups/15528d9c659945ba9d523030ec41663f/roles/3f3179a3fbd74d7bb2c6b255f36705ce` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:31.997117 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48c6ce6-9fa6-46c9-90a9-92cdb99f32a8 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=8253ff4894014649aaef76797dd7b711, group_id=15528d9c659945ba9d523030ec41663f, role_id=3f3179a3fbd74d7bb2c6b255f36705ce)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:32.001109 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48c6ce6-9fa6-46c9-90a9-92cdb99f32a8 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:32.008933 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b48c6ce6-9fa6-46c9-90a9-92cdb99f32a8 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invalidating the token cache because role 3f3179a3fbd74d7bb2c6b255f36705ce was removed from group 15528d9c659945ba9d523030ec41663f on domain 8253ff4894014649aaef76797dd7b711. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:23:32.009748 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b48c6ce6-9fa6-46c9-90a9-92cdb99f32a8 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:32.010516 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b48c6ce6-9fa6-46c9-90a9-92cdb99f32a8 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:32.096086 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1967/3963] 10.222.0.52 () {58 vars in 1466 bytes} [Sat May 14 21:23:31 2022] DELETE /identity/v3/domains/8253ff4894014649aaef76797dd7b711/groups/15528d9c659945ba9d523030ec41663f/roles/3f3179a3fbd74d7bb2c6b255f36705ce => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:32.100294 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff48875-e2ce-45e0-9377-c9b8acfcd792 tempest-TokensV3TestJSON-768820606 tempest-TokensV3TestJSON-768820606-project] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:32.102664 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-2ff48875-e2ce-45e0-9377-c9b8acfcd792 tempest-TokensV3TestJSON-768820606 tempest-TokensV3TestJSON-768820606-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:32.117775 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff48875-e2ce-45e0-9377-c9b8acfcd792 tempest-TokensV3TestJSON-768820606 tempest-TokensV3TestJSON-768820606-project] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:32.183561 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1cbfc8-c858-4d22-a82a-127df7bf3016 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b3021182184f0c80aff4920d5cc475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4ca399ec87f4044ad133caf08ffbdc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:32.185202 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1cbfc8-c858-4d22-a82a-127df7bf3016 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:32.185573 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1cbfc8-c858-4d22-a82a-127df7bf3016 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:32.185931 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1cbfc8-c858-4d22-a82a-127df7bf3016 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] PATH_INFO: `/v3/groups/15528d9c659945ba9d523030ec41663f/users/553d37b6560b45c3bd17b80c576a2026` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:32.188009 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1cbfc8-c858-4d22-a82a-127df7bf3016 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=15528d9c659945ba9d523030ec41663f, user_id=553d37b6560b45c3bd17b80c576a2026)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:32.190353 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1cbfc8-c858-4d22-a82a-127df7bf3016 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:32.269876 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6c1cbfc8-c858-4d22-a82a-127df7bf3016 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '553d37b6560b45c3bd17b80c576a2026'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:32.363870 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1997/3964] 10.222.0.52 () {58 vars in 1343 bytes} [Sat May 14 21:23:32 2022] DELETE /identity/v3/groups/15528d9c659945ba9d523030ec41663f/users/553d37b6560b45c3bd17b80c576a2026 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:32.367848 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48c6ce6-9fa6-46c9-90a9-92cdb99f32a8 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:32.391155 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48c6ce6-9fa6-46c9-90a9-92cdb99f32a8 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:32.514320 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc6408b-79e6-4a4b-b026-58580d1bd9cc tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b3021182184f0c80aff4920d5cc475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4ca399ec87f4044ad133caf08ffbdc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:32.515427 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6408b-79e6-4a4b-b026-58580d1bd9cc tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:32.515742 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6408b-79e6-4a4b-b026-58580d1bd9cc tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:32.516021 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6408b-79e6-4a4b-b026-58580d1bd9cc tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] PATH_INFO: `/v3/groups/15528d9c659945ba9d523030ec41663f` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:32.520431 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c808960-4690-4623-8a95-65cfb0497c5d None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:32.521200 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c808960-4690-4623-8a95-65cfb0497c5d None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:32.521635 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c808960-4690-4623-8a95-65cfb0497c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:32.523818 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc6408b-79e6-4a4b-b026-58580d1bd9cc tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorizing `identity:delete_group(group_id=15528d9c659945ba9d523030ec41663f)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:32.525277 ncdv-master-1 devstack@keystone.service[91107]: WARNING py.warnings [None req-bbc6408b-79e6-4a4b-b026-58580d1bd9cc tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 14 21:23:32.525277 ncdv-master-1 devstack@keystone.service[91107]: warnings.warn(msg) May 14 21:23:32.525277 ncdv-master-1 devstack@keystone.service[91107]: May 14 21:23:32.526517 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc6408b-79e6-4a4b-b026-58580d1bd9cc tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:32.565904 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-5c808960-4690-4623-8a95-65cfb0497c5d None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:23:32.568892 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-5c808960-4690-4623-8a95-65cfb0497c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:32.649937 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1998/3965] 10.222.0.52 () {58 vars in 1009 bytes} [Sat May 14 21:23:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:23:32.663052 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c808960-4690-4623-8a95-65cfb0497c5d None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:32.664527 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-5c808960-4690-4623-8a95-65cfb0497c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:32.710239 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1968/3966] 10.222.0.52 () {58 vars in 1226 bytes} [Sat May 14 21:23:32 2022] DELETE /identity/v3/groups/15528d9c659945ba9d523030ec41663f => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:32.711507 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc6408b-79e6-4a4b-b026-58580d1bd9cc tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:32.743682 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c808960-4690-4623-8a95-65cfb0497c5d None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:32.850462 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc6408b-79e6-4a4b-b026-58580d1bd9cc tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:32.856887 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a5cf36-8f06-4b8e-8473-087ebf433cfb tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b3021182184f0c80aff4920d5cc475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4ca399ec87f4044ad133caf08ffbdc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:32.858286 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a5cf36-8f06-4b8e-8473-087ebf433cfb tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:32.858577 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a5cf36-8f06-4b8e-8473-087ebf433cfb tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:32.858861 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a5cf36-8f06-4b8e-8473-087ebf433cfb tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] PATH_INFO: `/v3/roles/3f3179a3fbd74d7bb2c6b255f36705ce` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:32.860602 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a5cf36-8f06-4b8e-8473-087ebf433cfb tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorizing `identity:delete_role(role_id=3f3179a3fbd74d7bb2c6b255f36705ce)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:32.874802 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a5cf36-8f06-4b8e-8473-087ebf433cfb tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:32.889917 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d18a01-09c1-4d5a-a8dc-25f1c5f0c345 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:32.891121 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d18a01-09c1-4d5a-a8dc-25f1c5f0c345 service swift] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:32.891660 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d18a01-09c1-4d5a-a8dc-25f1c5f0c345 service swift] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:32.892062 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d18a01-09c1-4d5a-a8dc-25f1c5f0c345 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:32.988377 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d18a01-09c1-4d5a-a8dc-25f1c5f0c345 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:32.990700 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d18a01-09c1-4d5a-a8dc-25f1c5f0c345 service swift] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:33.001770 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 1999/3967] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 21:23:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 21:23:33.063618 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b6a5cf36-8f06-4b8e-8473-087ebf433cfb tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invalidating the token cache because role 3f3179a3fbd74d7bb2c6b255f36705ce has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:23:33.064201 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b6a5cf36-8f06-4b8e-8473-087ebf433cfb tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:33.065219 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b6a5cf36-8f06-4b8e-8473-087ebf433cfb tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:33.068327 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1969/3968] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:23:32 2022] DELETE /identity/v3/roles/3f3179a3fbd74d7bb2c6b255f36705ce => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:33.073318 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d18a01-09c1-4d5a-a8dc-25f1c5f0c345 service swift] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:33.092408 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d18a01-09c1-4d5a-a8dc-25f1c5f0c345 service swift] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:33.183537 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc20ff9-1c3f-41c5-88b4-49a99975ecd0 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b3021182184f0c80aff4920d5cc475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4ca399ec87f4044ad133caf08ffbdc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:33.185103 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc20ff9-1c3f-41c5-88b4-49a99975ecd0 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:33.185420 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc20ff9-1c3f-41c5-88b4-49a99975ecd0 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:33.185731 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc20ff9-1c3f-41c5-88b4-49a99975ecd0 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] PATH_INFO: `/v3/domains/8253ff4894014649aaef76797dd7b711` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:33.188052 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc20ff9-1c3f-41c5-88b4-49a99975ecd0 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=8253ff4894014649aaef76797dd7b711)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:33.190326 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc20ff9-1c3f-41c5-88b4-49a99975ecd0 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:33.219655 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9fc20ff9-1c3f-41c5-88b4-49a99975ecd0 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '8253ff4894014649aaef76797dd7b711'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:33.221373 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9fc20ff9-1c3f-41c5-88b4-49a99975ecd0 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '8253ff4894014649aaef76797dd7b711'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:33.430094 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9fc20ff9-1c3f-41c5-88b4-49a99975ecd0 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '8253ff4894014649aaef76797dd7b711'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:33.437094 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9fc20ff9-1c3f-41c5-88b4-49a99975ecd0 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '8253ff4894014649aaef76797dd7b711'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:33.448501 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a5cf36-8f06-4b8e-8473-087ebf433cfb tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:33.448911 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2000/3969] 10.222.0.52 () {60 vars in 1248 bytes} [Sat May 14 21:23:33 2022] PATCH /identity/v3/domains/8253ff4894014649aaef76797dd7b711 => generated 278 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:23:33.450193 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b6a5cf36-8f06-4b8e-8473-087ebf433cfb tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:33.484971 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a5cf36-8f06-4b8e-8473-087ebf433cfb tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:33.670782 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33c3437-fd56-47d8-98ed-6a348ffb0afa tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b3021182184f0c80aff4920d5cc475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4ca399ec87f4044ad133caf08ffbdc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:33.672528 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c3437-fd56-47d8-98ed-6a348ffb0afa tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:33.672822 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c3437-fd56-47d8-98ed-6a348ffb0afa tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:33.673104 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c3437-fd56-47d8-98ed-6a348ffb0afa tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] PATH_INFO: `/v3/domains/8253ff4894014649aaef76797dd7b711` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:33.706143 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33c3437-fd56-47d8-98ed-6a348ffb0afa tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=8253ff4894014649aaef76797dd7b711)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:33.708187 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33c3437-fd56-47d8-98ed-6a348ffb0afa tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:33.768940 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c33c3437-fd56-47d8-98ed-6a348ffb0afa tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '8253ff4894014649aaef76797dd7b711'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:33.782102 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c33c3437-fd56-47d8-98ed-6a348ffb0afa tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '8253ff4894014649aaef76797dd7b711'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:34.054147 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c33c3437-fd56-47d8-98ed-6a348ffb0afa tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8253ff4894014649aaef76797dd7b711', 'request_id': 'req-c33c3437-fd56-47d8-98ed-6a348ffb0afa'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:34.068801 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c33c3437-fd56-47d8-98ed-6a348ffb0afa tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8253ff4894014649aaef76797dd7b711', 'request_id': 'req-c33c3437-fd56-47d8-98ed-6a348ffb0afa'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:34.113249 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c33c3437-fd56-47d8-98ed-6a348ffb0afa tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8253ff4894014649aaef76797dd7b711', 'request_id': 'req-c33c3437-fd56-47d8-98ed-6a348ffb0afa'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:34.142457 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc20ff9-1c3f-41c5-88b4-49a99975ecd0 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:34.144992 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-9fc20ff9-1c3f-41c5-88b4-49a99975ecd0 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:34.277154 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c33c3437-fd56-47d8-98ed-6a348ffb0afa tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] The token cache is being invalidate because project 8253ff4894014649aaef76797dd7b711 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:23:34.277725 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c33c3437-fd56-47d8-98ed-6a348ffb0afa tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:34.279292 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c33c3437-fd56-47d8-98ed-6a348ffb0afa tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:34.290110 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc20ff9-1c3f-41c5-88b4-49a99975ecd0 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:34.301923 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c33c3437-fd56-47d8-98ed-6a348ffb0afa tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '8253ff4894014649aaef76797dd7b711', 'request_id': 'req-c33c3437-fd56-47d8-98ed-6a348ffb0afa'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:34.306561 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c33c3437-fd56-47d8-98ed-6a348ffb0afa tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '8253ff4894014649aaef76797dd7b711', 'request_id': 'req-c33c3437-fd56-47d8-98ed-6a348ffb0afa'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:34.328419 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c33c3437-fd56-47d8-98ed-6a348ffb0afa tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '8253ff4894014649aaef76797dd7b711', 'request_id': 'req-c33c3437-fd56-47d8-98ed-6a348ffb0afa'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:34.351725 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1970/3970] 10.222.0.52 () {58 vars in 1229 bytes} [Sat May 14 21:23:33 2022] DELETE /identity/v3/domains/8253ff4894014649aaef76797dd7b711 => generated 0 bytes in 900 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:34.353808 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33c3437-fd56-47d8-98ed-6a348ffb0afa tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:34.365861 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c33c3437-fd56-47d8-98ed-6a348ffb0afa tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:34.378469 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dcc9c4-612a-4056-85a7-a32cbf21b652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:34.379364 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dcc9c4-612a-4056-85a7-a32cbf21b652 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:34.379683 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dcc9c4-612a-4056-85a7-a32cbf21b652 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:34.380116 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dcc9c4-612a-4056-85a7-a32cbf21b652 admin admin] PATH_INFO: `/v3/projects/73731f1637db4792b4523545840a6f8c` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:34.381273 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dcc9c4-612a-4056-85a7-a32cbf21b652 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73731f1637db4792b4523545840a6f8c)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:34.383618 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dcc9c4-612a-4056-85a7-a32cbf21b652 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:34.547930 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33c3437-fd56-47d8-98ed-6a348ffb0afa tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:34.550490 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-57dcc9c4-612a-4056-85a7-a32cbf21b652 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73731f1637db4792b4523545840a6f8c', 'request_id': 'req-57dcc9c4-612a-4056-85a7-a32cbf21b652'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:34.561942 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-57dcc9c4-612a-4056-85a7-a32cbf21b652 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73731f1637db4792b4523545840a6f8c', 'request_id': 'req-57dcc9c4-612a-4056-85a7-a32cbf21b652'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:34.673205 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cd4531-dd47-4bc4-bead-d5e2e59c3ce4 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b3021182184f0c80aff4920d5cc475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4ca399ec87f4044ad133caf08ffbdc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:34.674180 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd4531-dd47-4bc4-bead-d5e2e59c3ce4 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:34.674470 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd4531-dd47-4bc4-bead-d5e2e59c3ce4 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:34.674744 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd4531-dd47-4bc4-bead-d5e2e59c3ce4 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] PATH_INFO: `/v3/domains/7e5ebd1ef22f4839bd60b9e01fa4abaf/users/553d37b6560b45c3bd17b80c576a2026/roles/0446dfbce1c641a1b1ef7ccc2f55bdb7` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:34.677535 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cd4531-dd47-4bc4-bead-d5e2e59c3ce4 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=7e5ebd1ef22f4839bd60b9e01fa4abaf, user_id=553d37b6560b45c3bd17b80c576a2026, role_id=0446dfbce1c641a1b1ef7ccc2f55bdb7)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:34.680435 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cd4531-dd47-4bc4-bead-d5e2e59c3ce4 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:34.692391 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f4cd4531-dd47-4bc4-bead-d5e2e59c3ce4 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invalidating the token cache because role 0446dfbce1c641a1b1ef7ccc2f55bdb7 was removed from user 553d37b6560b45c3bd17b80c576a2026 on domain 7e5ebd1ef22f4839bd60b9e01fa4abaf. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:23:34.692694 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f4cd4531-dd47-4bc4-bead-d5e2e59c3ce4 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:34.693505 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-57dcc9c4-612a-4056-85a7-a32cbf21b652 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73731f1637db4792b4523545840a6f8c', 'request_id': 'req-57dcc9c4-612a-4056-85a7-a32cbf21b652'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:34.694439 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f4cd4531-dd47-4bc4-bead-d5e2e59c3ce4 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:34.730194 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-57dcc9c4-612a-4056-85a7-a32cbf21b652 admin admin] The token cache is being invalidate because project 73731f1637db4792b4523545840a6f8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:23:34.730517 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-57dcc9c4-612a-4056-85a7-a32cbf21b652 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:34.734879 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-57dcc9c4-612a-4056-85a7-a32cbf21b652 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:34.742871 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2001/3971] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:23:34 2022] DELETE /identity/v3/projects/73731f1637db4792b4523545840a6f8c => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:34.745691 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e1b34-a508-49d8-9ccc-cfa39ac9219d None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:34.745991 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e1b34-a508-49d8-9ccc-cfa39ac9219d None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:34.746284 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e1b34-a508-49d8-9ccc-cfa39ac9219d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:34.788748 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-b92e1b34-a508-49d8-9ccc-cfa39ac9219d None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:23:34.790838 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b92e1b34-a508-49d8-9ccc-cfa39ac9219d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:34.906980 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2002/3972] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:23:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:23:34.909114 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1971/3973] 10.222.0.52 () {58 vars in 1463 bytes} [Sat May 14 21:23:34 2022] DELETE /identity/v3/domains/7e5ebd1ef22f4839bd60b9e01fa4abaf/users/553d37b6560b45c3bd17b80c576a2026/roles/0446dfbce1c641a1b1ef7ccc2f55bdb7 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:34.917791 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c81f55-3f78-4bb3-8fbd-f07dc69d653f None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:34.918229 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c81f55-3f78-4bb3-8fbd-f07dc69d653f None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:34.918593 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c81f55-3f78-4bb3-8fbd-f07dc69d653f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:34.919882 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e1b34-a508-49d8-9ccc-cfa39ac9219d None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:34.924580 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b92e1b34-a508-49d8-9ccc-cfa39ac9219d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:34.956682 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e1b34-a508-49d8-9ccc-cfa39ac9219d None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:34.958018 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-e5c81f55-3f78-4bb3-8fbd-f07dc69d653f None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:23:34.959490 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e5c81f55-3f78-4bb3-8fbd-f07dc69d653f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:35.071047 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee967b8c-da3f-4a18-ae56-7ce5a82443c5 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b3021182184f0c80aff4920d5cc475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4ca399ec87f4044ad133caf08ffbdc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:35.071685 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee967b8c-da3f-4a18-ae56-7ce5a82443c5 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:35.071979 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee967b8c-da3f-4a18-ae56-7ce5a82443c5 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:35.072293 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee967b8c-da3f-4a18-ae56-7ce5a82443c5 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] PATH_INFO: `/v3/roles/0446dfbce1c641a1b1ef7ccc2f55bdb7` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:35.074095 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee967b8c-da3f-4a18-ae56-7ce5a82443c5 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorizing `identity:delete_role(role_id=0446dfbce1c641a1b1ef7ccc2f55bdb7)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:35.075810 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee967b8c-da3f-4a18-ae56-7ce5a82443c5 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:35.121529 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1972/3974] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:23:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:23:35.126435 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c81f55-3f78-4bb3-8fbd-f07dc69d653f None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:35.144275 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c81f55-3f78-4bb3-8fbd-f07dc69d653f None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:35.160871 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeda2df-57fe-4808-adb2-84d4b425e471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:35.162881 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeda2df-57fe-4808-adb2-84d4b425e471 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:35.163183 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeda2df-57fe-4808-adb2-84d4b425e471 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:35.163484 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeda2df-57fe-4808-adb2-84d4b425e471 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:35.164782 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeda2df-57fe-4808-adb2-84d4b425e471 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:23:35.167279 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeda2df-57fe-4808-adb2-84d4b425e471 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:35.169869 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeda2df-57fe-4808-adb2-84d4b425e471 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:35.179903 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ee967b8c-da3f-4a18-ae56-7ce5a82443c5 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invalidating the token cache because role 0446dfbce1c641a1b1ef7ccc2f55bdb7 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:23:35.180235 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ee967b8c-da3f-4a18-ae56-7ce5a82443c5 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:35.180926 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ee967b8c-da3f-4a18-ae56-7ce5a82443c5 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:35.183246 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2003/3975] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:23:34 2022] DELETE /identity/v3/roles/0446dfbce1c641a1b1ef7ccc2f55bdb7 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:35.188253 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee967b8c-da3f-4a18-ae56-7ce5a82443c5 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:35.189979 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ee967b8c-da3f-4a18-ae56-7ce5a82443c5 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:35.213584 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1973/3976] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:23:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:23:35.218852 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeda2df-57fe-4808-adb2-84d4b425e471 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:35.227309 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-baeda2df-57fe-4808-adb2-84d4b425e471 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:35.259587 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeda2df-57fe-4808-adb2-84d4b425e471 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:35.312119 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee967b8c-da3f-4a18-ae56-7ce5a82443c5 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:35.320617 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3e1f94-19b3-4286-9aab-c68ae3a6584d tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b3021182184f0c80aff4920d5cc475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4ca399ec87f4044ad133caf08ffbdc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:35.322353 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e1f94-19b3-4286-9aab-c68ae3a6584d tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:35.322821 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e1f94-19b3-4286-9aab-c68ae3a6584d tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:35.323113 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e1f94-19b3-4286-9aab-c68ae3a6584d tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] PATH_INFO: `/v3/domains/7e5ebd1ef22f4839bd60b9e01fa4abaf` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:35.325498 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3e1f94-19b3-4286-9aab-c68ae3a6584d tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=7e5ebd1ef22f4839bd60b9e01fa4abaf)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:35.327960 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3e1f94-19b3-4286-9aab-c68ae3a6584d tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:35.376937 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d091fd5b-6bcb-4597-9896-349316ad934a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:35.377677 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d091fd5b-6bcb-4597-9896-349316ad934a admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:35.378163 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d091fd5b-6bcb-4597-9896-349316ad934a admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:35.378820 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d091fd5b-6bcb-4597-9896-349316ad934a admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:35.380131 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d091fd5b-6bcb-4597-9896-349316ad934a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:35.382396 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d091fd5b-6bcb-4597-9896-349316ad934a admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:35.395027 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9d3e1f94-19b3-4286-9aab-c68ae3a6584d tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '7e5ebd1ef22f4839bd60b9e01fa4abaf'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:35.395990 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9d3e1f94-19b3-4286-9aab-c68ae3a6584d tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '7e5ebd1ef22f4839bd60b9e01fa4abaf'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:35.507541 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1974/3977] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:23:35 2022] POST /identity/v3/projects => generated 403 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:23:35.512103 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d091fd5b-6bcb-4597-9896-349316ad934a admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:35.514829 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-d091fd5b-6bcb-4597-9896-349316ad934a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:35.576031 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9d3e1f94-19b3-4286-9aab-c68ae3a6584d tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '7e5ebd1ef22f4839bd60b9e01fa4abaf'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:35.577411 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9d3e1f94-19b3-4286-9aab-c68ae3a6584d tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '7e5ebd1ef22f4839bd60b9e01fa4abaf'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:35.581676 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2004/3978] 10.222.0.52 () {60 vars in 1248 bytes} [Sat May 14 21:23:35 2022] PATCH /identity/v3/domains/7e5ebd1ef22f4839bd60b9e01fa4abaf => generated 275 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:23:35.591116 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3e1f94-19b3-4286-9aab-c68ae3a6584d tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:35.592781 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-9d3e1f94-19b3-4286-9aab-c68ae3a6584d tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:35.654550 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d091fd5b-6bcb-4597-9896-349316ad934a admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:35.662324 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f04c66-47a9-4aa8-9100-2a714968a28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:35.663806 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f04c66-47a9-4aa8-9100-2a714968a28d admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:35.663806 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f04c66-47a9-4aa8-9100-2a714968a28d admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:35.664448 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f04c66-47a9-4aa8-9100-2a714968a28d admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:35.665268 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f04c66-47a9-4aa8-9100-2a714968a28d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:35.668917 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f04c66-47a9-4aa8-9100-2a714968a28d admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:35.724379 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3e1f94-19b3-4286-9aab-c68ae3a6584d tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:35.765469 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1975/3979] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:23:35 2022] POST /identity/v3/users => generated 302 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:23:35.766762 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f04c66-47a9-4aa8-9100-2a714968a28d admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:35.768843 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-f3f04c66-47a9-4aa8-9100-2a714968a28d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:35.783757 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f04c66-47a9-4aa8-9100-2a714968a28d admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:35.789555 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9478c937-239d-4b77-bc63-43d1f1bb37c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:35.790518 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478c937-239d-4b77-bc63-43d1f1bb37c5 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:35.791089 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478c937-239d-4b77-bc63-43d1f1bb37c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:35.791205 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478c937-239d-4b77-bc63-43d1f1bb37c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:35.792037 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9478c937-239d-4b77-bc63-43d1f1bb37c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:35.794805 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9478c937-239d-4b77-bc63-43d1f1bb37c5 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:35.805089 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f88890-8de9-4654-a09c-2784199b604d tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b3021182184f0c80aff4920d5cc475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4ca399ec87f4044ad133caf08ffbdc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:35.806464 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f88890-8de9-4654-a09c-2784199b604d tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:35.812706 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f88890-8de9-4654-a09c-2784199b604d tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:35.812706 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f88890-8de9-4654-a09c-2784199b604d tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] PATH_INFO: `/v3/domains/7e5ebd1ef22f4839bd60b9e01fa4abaf` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:35.812913 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1976/3980] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:23:35 2022] GET /identity/v3/roles => generated 1881 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:23:35.814418 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9478c937-239d-4b77-bc63-43d1f1bb37c5 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:35.823687 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f88890-8de9-4654-a09c-2784199b604d tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=7e5ebd1ef22f4839bd60b9e01fa4abaf)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:35.826406 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f88890-8de9-4654-a09c-2784199b604d tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:35.841060 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9478c937-239d-4b77-bc63-43d1f1bb37c5 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:35.853178 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a688f668-90e2-4935-af33-ba3a0cc1ef2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:35.853890 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688f668-90e2-4935-af33-ba3a0cc1ef2f admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:35.854163 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688f668-90e2-4935-af33-ba3a0cc1ef2f admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:35.854801 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688f668-90e2-4935-af33-ba3a0cc1ef2f admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:35.855616 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a688f668-90e2-4935-af33-ba3a0cc1ef2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:35.862239 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-58f88890-8de9-4654-a09c-2784199b604d tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '7e5ebd1ef22f4839bd60b9e01fa4abaf'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:35.863773 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a688f668-90e2-4935-af33-ba3a0cc1ef2f admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:35.869112 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-58f88890-8de9-4654-a09c-2784199b604d tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '7e5ebd1ef22f4839bd60b9e01fa4abaf'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:35.889211 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1977/3981] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:23:35 2022] GET /identity/v3/roles => generated 1881 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:23:35.891007 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a688f668-90e2-4935-af33-ba3a0cc1ef2f admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:35.930186 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a688f668-90e2-4935-af33-ba3a0cc1ef2f admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:35.940253 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec09a5-0c87-4b6f-861b-71dbd62267b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:35.941414 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec09a5-0c87-4b6f-861b-71dbd62267b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:35.941704 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec09a5-0c87-4b6f-861b-71dbd62267b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:35.941986 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec09a5-0c87-4b6f-861b-71dbd62267b7 admin admin] PATH_INFO: `/v3/projects/48cdf3efbfbc43d7bdce5958fd2ad1a4/users/00d9c6a6abe64522aca4b9a4f09f4258/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:35.968729 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bec09a5-0c87-4b6f-861b-71dbd62267b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48cdf3efbfbc43d7bdce5958fd2ad1a4, user_id=00d9c6a6abe64522aca4b9a4f09f4258, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:35.972048 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bec09a5-0c87-4b6f-861b-71dbd62267b7 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:36.094754 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1978/3982] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:23:35 2022] PUT /identity/v3/projects/48cdf3efbfbc43d7bdce5958fd2ad1a4/users/00d9c6a6abe64522aca4b9a4f09f4258/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:36.096974 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a69fe1-8491-441a-8b61-c6289fe87268 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:36.097274 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a69fe1-8491-441a-8b61-c6289fe87268 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:36.097549 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a69fe1-8491-441a-8b61-c6289fe87268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:36.120237 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-58f88890-8de9-4654-a09c-2784199b604d tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e5ebd1ef22f4839bd60b9e01fa4abaf', 'request_id': 'req-58f88890-8de9-4654-a09c-2784199b604d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:36.131377 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-e2a69fe1-8491-441a-8b61-c6289fe87268 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:23:36.134555 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e2a69fe1-8491-441a-8b61-c6289fe87268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:36.139607 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-58f88890-8de9-4654-a09c-2784199b604d tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e5ebd1ef22f4839bd60b9e01fa4abaf', 'request_id': 'req-58f88890-8de9-4654-a09c-2784199b604d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:36.234921 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-58f88890-8de9-4654-a09c-2784199b604d tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e5ebd1ef22f4839bd60b9e01fa4abaf', 'request_id': 'req-58f88890-8de9-4654-a09c-2784199b604d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:36.245469 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1979/3983] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:23:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:23:36.257562 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-58f88890-8de9-4654-a09c-2784199b604d tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] The token cache is being invalidate because project 7e5ebd1ef22f4839bd60b9e01fa4abaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:23:36.257857 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-58f88890-8de9-4654-a09c-2784199b604d tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:36.258535 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-58f88890-8de9-4654-a09c-2784199b604d tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:36.272625 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-58f88890-8de9-4654-a09c-2784199b604d tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '7e5ebd1ef22f4839bd60b9e01fa4abaf', 'request_id': 'req-58f88890-8de9-4654-a09c-2784199b604d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:36.272625 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-58f88890-8de9-4654-a09c-2784199b604d tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '7e5ebd1ef22f4839bd60b9e01fa4abaf', 'request_id': 'req-58f88890-8de9-4654-a09c-2784199b604d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:36.272959 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a69fe1-8491-441a-8b61-c6289fe87268 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:36.273159 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e2a69fe1-8491-441a-8b61-c6289fe87268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:36.275775 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-58f88890-8de9-4654-a09c-2784199b604d tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '7e5ebd1ef22f4839bd60b9e01fa4abaf', 'request_id': 'req-58f88890-8de9-4654-a09c-2784199b604d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:36.288296 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2005/3984] 10.222.0.52 () {58 vars in 1229 bytes} [Sat May 14 21:23:35 2022] DELETE /identity/v3/domains/7e5ebd1ef22f4839bd60b9e01fa4abaf => generated 0 bytes in 698 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:36.299198 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f88890-8de9-4654-a09c-2784199b604d tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:36.308071 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-58f88890-8de9-4654-a09c-2784199b604d tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:36.440490 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a69fe1-8491-441a-8b61-c6289fe87268 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:36.452187 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcf6a47-3d2e-4b37-80fc-fc3cdfb4b7c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:36.453781 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf6a47-3d2e-4b37-80fc-fc3cdfb4b7c8 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:36.454383 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf6a47-3d2e-4b37-80fc-fc3cdfb4b7c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:36.454895 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf6a47-3d2e-4b37-80fc-fc3cdfb4b7c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:36.457451 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-dfcf6a47-3d2e-4b37-80fc-fc3cdfb4b7c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:36.467438 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f88890-8de9-4654-a09c-2784199b604d tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:36.479008 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcf6a47-3d2e-4b37-80fc-fc3cdfb4b7c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:36.484888 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcf6a47-3d2e-4b37-80fc-fc3cdfb4b7c8 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:36.508525 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1980/3985] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:23:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:23:36.561327 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1018ef5-aec9-4382-9fb1-e42bf3702a3d tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b3021182184f0c80aff4920d5cc475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4ca399ec87f4044ad133caf08ffbdc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:36.562686 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1018ef5-aec9-4382-9fb1-e42bf3702a3d tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:36.562984 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1018ef5-aec9-4382-9fb1-e42bf3702a3d tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:36.563517 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1018ef5-aec9-4382-9fb1-e42bf3702a3d tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] PATH_INFO: `/v3/domains/ab6c62b557744e2191dca10f39967bf8/groups/19a0052863e84145a412c73ca92c0d5f/roles/6bd320493ccc4cf0b8bc4f7ffd91e15b` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:36.568570 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1018ef5-aec9-4382-9fb1-e42bf3702a3d tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=ab6c62b557744e2191dca10f39967bf8, group_id=19a0052863e84145a412c73ca92c0d5f, role_id=6bd320493ccc4cf0b8bc4f7ffd91e15b)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:36.571814 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1018ef5-aec9-4382-9fb1-e42bf3702a3d tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:36.581256 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f1018ef5-aec9-4382-9fb1-e42bf3702a3d tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invalidating the token cache because role 6bd320493ccc4cf0b8bc4f7ffd91e15b was removed from group 19a0052863e84145a412c73ca92c0d5f on domain ab6c62b557744e2191dca10f39967bf8. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:23:36.583816 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f1018ef5-aec9-4382-9fb1-e42bf3702a3d tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:36.583816 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f1018ef5-aec9-4382-9fb1-e42bf3702a3d tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:36.667273 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2006/3986] 10.222.0.52 () {58 vars in 1466 bytes} [Sat May 14 21:23:36 2022] DELETE /identity/v3/domains/ab6c62b557744e2191dca10f39967bf8/groups/19a0052863e84145a412c73ca92c0d5f/roles/6bd320493ccc4cf0b8bc4f7ffd91e15b => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:36.668738 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcf6a47-3d2e-4b37-80fc-fc3cdfb4b7c8 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:36.681869 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcf6a47-3d2e-4b37-80fc-fc3cdfb4b7c8 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:36.816096 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddb0b48-dbda-4af4-94fc-88a290b4d075 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b3021182184f0c80aff4920d5cc475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4ca399ec87f4044ad133caf08ffbdc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:36.817129 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb0b48-dbda-4af4-94fc-88a290b4d075 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:36.817573 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb0b48-dbda-4af4-94fc-88a290b4d075 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:36.817948 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb0b48-dbda-4af4-94fc-88a290b4d075 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] PATH_INFO: `/v3/groups/19a0052863e84145a412c73ca92c0d5f/users/553d37b6560b45c3bd17b80c576a2026` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:36.819952 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddb0b48-dbda-4af4-94fc-88a290b4d075 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=19a0052863e84145a412c73ca92c0d5f, user_id=553d37b6560b45c3bd17b80c576a2026)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:36.821380 ncdv-master-1 devstack@keystone.service[91107]: WARNING py.warnings [None req-6ddb0b48-dbda-4af4-94fc-88a290b4d075 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 14 21:23:36.821380 ncdv-master-1 devstack@keystone.service[91107]: warnings.warn(msg) May 14 21:23:36.821380 ncdv-master-1 devstack@keystone.service[91107]: May 14 21:23:36.824467 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddb0b48-dbda-4af4-94fc-88a290b4d075 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:36.909276 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-6ddb0b48-dbda-4af4-94fc-88a290b4d075 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '553d37b6560b45c3bd17b80c576a2026'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:37.019656 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1981/3987] 10.222.0.52 () {58 vars in 1343 bytes} [Sat May 14 21:23:36 2022] DELETE /identity/v3/groups/19a0052863e84145a412c73ca92c0d5f/users/553d37b6560b45c3bd17b80c576a2026 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:37.021363 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1018ef5-aec9-4382-9fb1-e42bf3702a3d tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:37.023202 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-f1018ef5-aec9-4382-9fb1-e42bf3702a3d tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:37.048400 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1018ef5-aec9-4382-9fb1-e42bf3702a3d tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:37.174431 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae105783-06ec-4b96-b824-9f11799e57fb tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b3021182184f0c80aff4920d5cc475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4ca399ec87f4044ad133caf08ffbdc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:37.175669 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae105783-06ec-4b96-b824-9f11799e57fb tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:37.176142 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae105783-06ec-4b96-b824-9f11799e57fb tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:37.176585 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae105783-06ec-4b96-b824-9f11799e57fb tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] PATH_INFO: `/v3/groups/19a0052863e84145a412c73ca92c0d5f` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:37.178217 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae105783-06ec-4b96-b824-9f11799e57fb tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorizing `identity:delete_group(group_id=19a0052863e84145a412c73ca92c0d5f)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:37.180375 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae105783-06ec-4b96-b824-9f11799e57fb tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:37.509734 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2007/3988] 10.222.0.52 () {58 vars in 1226 bytes} [Sat May 14 21:23:37 2022] DELETE /identity/v3/groups/19a0052863e84145a412c73ca92c0d5f => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:37.515015 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddb0b48-dbda-4af4-94fc-88a290b4d075 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:37.536080 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddb0b48-dbda-4af4-94fc-88a290b4d075 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:37.624323 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab353d-ff7e-4589-a738-85a2fc79e979 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b3021182184f0c80aff4920d5cc475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4ca399ec87f4044ad133caf08ffbdc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:37.625503 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab353d-ff7e-4589-a738-85a2fc79e979 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:37.626005 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab353d-ff7e-4589-a738-85a2fc79e979 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:37.627167 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab353d-ff7e-4589-a738-85a2fc79e979 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] PATH_INFO: `/v3/roles/6bd320493ccc4cf0b8bc4f7ffd91e15b` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:37.629041 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abab353d-ff7e-4589-a738-85a2fc79e979 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorizing `identity:delete_role(role_id=6bd320493ccc4cf0b8bc4f7ffd91e15b)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:37.639876 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abab353d-ff7e-4589-a738-85a2fc79e979 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:38.103879 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-abab353d-ff7e-4589-a738-85a2fc79e979 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invalidating the token cache because role 6bd320493ccc4cf0b8bc4f7ffd91e15b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:23:38.104249 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-abab353d-ff7e-4589-a738-85a2fc79e979 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:38.104852 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-abab353d-ff7e-4589-a738-85a2fc79e979 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:38.107463 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1982/3989] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:23:37 2022] DELETE /identity/v3/roles/6bd320493ccc4cf0b8bc4f7ffd91e15b => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:38.111554 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae105783-06ec-4b96-b824-9f11799e57fb tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:38.114001 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ae105783-06ec-4b96-b824-9f11799e57fb tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:38.129659 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae105783-06ec-4b96-b824-9f11799e57fb tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:38.225899 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae2065-f3d7-4869-badb-e0739897c04d tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b3021182184f0c80aff4920d5cc475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4ca399ec87f4044ad133caf08ffbdc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:38.227089 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae2065-f3d7-4869-badb-e0739897c04d tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:38.227211 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae2065-f3d7-4869-badb-e0739897c04d tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:38.227464 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae2065-f3d7-4869-badb-e0739897c04d tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] PATH_INFO: `/v3/domains/ab6c62b557744e2191dca10f39967bf8` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:38.228949 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbae2065-f3d7-4869-badb-e0739897c04d tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=ab6c62b557744e2191dca10f39967bf8)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:38.230451 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbae2065-f3d7-4869-badb-e0739897c04d tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:38.256558 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-bbae2065-f3d7-4869-badb-e0739897c04d tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'ab6c62b557744e2191dca10f39967bf8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:38.257581 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-bbae2065-f3d7-4869-badb-e0739897c04d tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'ab6c62b557744e2191dca10f39967bf8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:38.854634 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-bbae2065-f3d7-4869-badb-e0739897c04d tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'ab6c62b557744e2191dca10f39967bf8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:38.862211 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-bbae2065-f3d7-4869-badb-e0739897c04d tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'ab6c62b557744e2191dca10f39967bf8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:38.868219 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2008/3990] 10.222.0.52 () {60 vars in 1248 bytes} [Sat May 14 21:23:38 2022] PATCH /identity/v3/domains/ab6c62b557744e2191dca10f39967bf8 => generated 276 bytes in 757 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:23:38.873485 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab353d-ff7e-4589-a738-85a2fc79e979 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:38.890331 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab353d-ff7e-4589-a738-85a2fc79e979 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:38.982654 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf9f7d2-1e72-4666-abee-78101a378ed2 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b3021182184f0c80aff4920d5cc475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4ca399ec87f4044ad133caf08ffbdc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:38.982654 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9f7d2-1e72-4666-abee-78101a378ed2 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:38.983026 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9f7d2-1e72-4666-abee-78101a378ed2 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:38.983247 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9f7d2-1e72-4666-abee-78101a378ed2 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] PATH_INFO: `/v3/domains/ab6c62b557744e2191dca10f39967bf8` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:38.998831 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf9f7d2-1e72-4666-abee-78101a378ed2 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=ab6c62b557744e2191dca10f39967bf8)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:39.000935 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf9f7d2-1e72-4666-abee-78101a378ed2 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:39.032197 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4cf9f7d2-1e72-4666-abee-78101a378ed2 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'ab6c62b557744e2191dca10f39967bf8'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:39.048267 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4cf9f7d2-1e72-4666-abee-78101a378ed2 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'ab6c62b557744e2191dca10f39967bf8'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:39.187908 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4cf9f7d2-1e72-4666-abee-78101a378ed2 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab6c62b557744e2191dca10f39967bf8', 'request_id': 'req-4cf9f7d2-1e72-4666-abee-78101a378ed2'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:39.197412 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4cf9f7d2-1e72-4666-abee-78101a378ed2 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab6c62b557744e2191dca10f39967bf8', 'request_id': 'req-4cf9f7d2-1e72-4666-abee-78101a378ed2'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:39.205930 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4cf9f7d2-1e72-4666-abee-78101a378ed2 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab6c62b557744e2191dca10f39967bf8', 'request_id': 'req-4cf9f7d2-1e72-4666-abee-78101a378ed2'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:39.280423 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4cf9f7d2-1e72-4666-abee-78101a378ed2 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] The token cache is being invalidate because project ab6c62b557744e2191dca10f39967bf8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:23:39.281427 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4cf9f7d2-1e72-4666-abee-78101a378ed2 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:39.282737 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4cf9f7d2-1e72-4666-abee-78101a378ed2 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:39.298362 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4cf9f7d2-1e72-4666-abee-78101a378ed2 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'ab6c62b557744e2191dca10f39967bf8', 'request_id': 'req-4cf9f7d2-1e72-4666-abee-78101a378ed2'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:39.301394 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4cf9f7d2-1e72-4666-abee-78101a378ed2 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'ab6c62b557744e2191dca10f39967bf8', 'request_id': 'req-4cf9f7d2-1e72-4666-abee-78101a378ed2'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:39.306729 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4cf9f7d2-1e72-4666-abee-78101a378ed2 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'ab6c62b557744e2191dca10f39967bf8', 'request_id': 'req-4cf9f7d2-1e72-4666-abee-78101a378ed2'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:39.317722 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1983/3991] 10.222.0.52 () {58 vars in 1229 bytes} [Sat May 14 21:23:38 2022] DELETE /identity/v3/domains/ab6c62b557744e2191dca10f39967bf8 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:39.322350 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae2065-f3d7-4869-badb-e0739897c04d tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:39.324504 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-bbae2065-f3d7-4869-badb-e0739897c04d tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:39.338769 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae2065-f3d7-4869-badb-e0739897c04d tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:39.501054 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a7f2a1-7549-4a10-be4b-5dec3ece4e3b tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b3021182184f0c80aff4920d5cc475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4ca399ec87f4044ad133caf08ffbdc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:39.505814 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a7f2a1-7549-4a10-be4b-5dec3ece4e3b tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:39.506457 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a7f2a1-7549-4a10-be4b-5dec3ece4e3b tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:39.507277 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a7f2a1-7549-4a10-be4b-5dec3ece4e3b tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] PATH_INFO: `/v3/domains/d34ed46f99a54acca0ca1a224a8022d1/users/553d37b6560b45c3bd17b80c576a2026/roles/bd147900ef3b4bc9a0e53657b03a5c7c` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:39.510354 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a7f2a1-7549-4a10-be4b-5dec3ece4e3b tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=d34ed46f99a54acca0ca1a224a8022d1, user_id=553d37b6560b45c3bd17b80c576a2026, role_id=bd147900ef3b4bc9a0e53657b03a5c7c)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:39.515499 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a7f2a1-7549-4a10-be4b-5dec3ece4e3b tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:39.523342 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-19a7f2a1-7549-4a10-be4b-5dec3ece4e3b tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invalidating the token cache because role bd147900ef3b4bc9a0e53657b03a5c7c was removed from user 553d37b6560b45c3bd17b80c576a2026 on domain d34ed46f99a54acca0ca1a224a8022d1. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:23:39.524017 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-19a7f2a1-7549-4a10-be4b-5dec3ece4e3b tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:39.525788 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-19a7f2a1-7549-4a10-be4b-5dec3ece4e3b tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:39.612008 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2009/3992] 10.222.0.52 () {58 vars in 1463 bytes} [Sat May 14 21:23:39 2022] DELETE /identity/v3/domains/d34ed46f99a54acca0ca1a224a8022d1/users/553d37b6560b45c3bd17b80c576a2026/roles/bd147900ef3b4bc9a0e53657b03a5c7c => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:23:39.616408 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf9f7d2-1e72-4666-abee-78101a378ed2 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:39.618312 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-4cf9f7d2-1e72-4666-abee-78101a378ed2 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:39.638707 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf9f7d2-1e72-4666-abee-78101a378ed2 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:39.721518 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428ea5b1-35c8-4932-9373-d74ed349f371 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b3021182184f0c80aff4920d5cc475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4ca399ec87f4044ad133caf08ffbdc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:39.722541 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ea5b1-35c8-4932-9373-d74ed349f371 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:39.722850 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ea5b1-35c8-4932-9373-d74ed349f371 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:39.723134 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ea5b1-35c8-4932-9373-d74ed349f371 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] PATH_INFO: `/v3/roles/bd147900ef3b4bc9a0e53657b03a5c7c` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:39.724842 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428ea5b1-35c8-4932-9373-d74ed349f371 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorizing `identity:delete_role(role_id=bd147900ef3b4bc9a0e53657b03a5c7c)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:39.726637 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428ea5b1-35c8-4932-9373-d74ed349f371 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:39.872772 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-428ea5b1-35c8-4932-9373-d74ed349f371 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invalidating the token cache because role bd147900ef3b4bc9a0e53657b03a5c7c has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:23:39.873348 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-428ea5b1-35c8-4932-9373-d74ed349f371 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:39.875080 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-428ea5b1-35c8-4932-9373-d74ed349f371 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:39.882307 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1984/3993] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:23:39 2022] DELETE /identity/v3/roles/bd147900ef3b4bc9a0e53657b03a5c7c => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:39.888469 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a7f2a1-7549-4a10-be4b-5dec3ece4e3b tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:39.895855 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-19a7f2a1-7549-4a10-be4b-5dec3ece4e3b tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:39.917960 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a7f2a1-7549-4a10-be4b-5dec3ece4e3b tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:40.091875 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfef2fe-99af-4d90-8792-a9d2f1b9d7d8 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b3021182184f0c80aff4920d5cc475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4ca399ec87f4044ad133caf08ffbdc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:40.092768 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfef2fe-99af-4d90-8792-a9d2f1b9d7d8 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:40.093063 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfef2fe-99af-4d90-8792-a9d2f1b9d7d8 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:40.093971 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfef2fe-99af-4d90-8792-a9d2f1b9d7d8 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] PATH_INFO: `/v3/domains/d34ed46f99a54acca0ca1a224a8022d1` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:40.094986 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfef2fe-99af-4d90-8792-a9d2f1b9d7d8 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=d34ed46f99a54acca0ca1a224a8022d1)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:40.096799 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfef2fe-99af-4d90-8792-a9d2f1b9d7d8 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:40.131991 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-dbfef2fe-99af-4d90-8792-a9d2f1b9d7d8 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'd34ed46f99a54acca0ca1a224a8022d1'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:40.132802 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-dbfef2fe-99af-4d90-8792-a9d2f1b9d7d8 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'd34ed46f99a54acca0ca1a224a8022d1'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:40.276584 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-dbfef2fe-99af-4d90-8792-a9d2f1b9d7d8 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'd34ed46f99a54acca0ca1a224a8022d1'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:40.279337 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-dbfef2fe-99af-4d90-8792-a9d2f1b9d7d8 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'd34ed46f99a54acca0ca1a224a8022d1'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:40.283664 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2010/3994] 10.222.0.52 () {60 vars in 1248 bytes} [Sat May 14 21:23:39 2022] PATCH /identity/v3/domains/d34ed46f99a54acca0ca1a224a8022d1 => generated 278 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:23:40.288032 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428ea5b1-35c8-4932-9373-d74ed349f371 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:40.291581 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-428ea5b1-35c8-4932-9373-d74ed349f371 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:40.326661 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428ea5b1-35c8-4932-9373-d74ed349f371 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:40.469524 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82989d7-daf0-49fa-94d7-b292b5ed509b tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b3021182184f0c80aff4920d5cc475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4ca399ec87f4044ad133caf08ffbdc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:40.475057 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82989d7-daf0-49fa-94d7-b292b5ed509b tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:40.475057 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82989d7-daf0-49fa-94d7-b292b5ed509b tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:40.475057 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82989d7-daf0-49fa-94d7-b292b5ed509b tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] PATH_INFO: `/v3/domains/d34ed46f99a54acca0ca1a224a8022d1` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:40.492780 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82989d7-daf0-49fa-94d7-b292b5ed509b tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=d34ed46f99a54acca0ca1a224a8022d1)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:40.501842 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82989d7-daf0-49fa-94d7-b292b5ed509b tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:40.562145 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a82989d7-daf0-49fa-94d7-b292b5ed509b tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'd34ed46f99a54acca0ca1a224a8022d1'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:40.652005 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a82989d7-daf0-49fa-94d7-b292b5ed509b tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'd34ed46f99a54acca0ca1a224a8022d1'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:40.822517 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a82989d7-daf0-49fa-94d7-b292b5ed509b tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd34ed46f99a54acca0ca1a224a8022d1', 'request_id': 'req-a82989d7-daf0-49fa-94d7-b292b5ed509b'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:40.850021 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a82989d7-daf0-49fa-94d7-b292b5ed509b tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd34ed46f99a54acca0ca1a224a8022d1', 'request_id': 'req-a82989d7-daf0-49fa-94d7-b292b5ed509b'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:40.863415 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a82989d7-daf0-49fa-94d7-b292b5ed509b tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd34ed46f99a54acca0ca1a224a8022d1', 'request_id': 'req-a82989d7-daf0-49fa-94d7-b292b5ed509b'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:40.990178 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a82989d7-daf0-49fa-94d7-b292b5ed509b tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] The token cache is being invalidate because project d34ed46f99a54acca0ca1a224a8022d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:23:40.990875 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a82989d7-daf0-49fa-94d7-b292b5ed509b tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:40.991871 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a82989d7-daf0-49fa-94d7-b292b5ed509b tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:41.010943 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a82989d7-daf0-49fa-94d7-b292b5ed509b tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'd34ed46f99a54acca0ca1a224a8022d1', 'request_id': 'req-a82989d7-daf0-49fa-94d7-b292b5ed509b'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:41.012102 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a82989d7-daf0-49fa-94d7-b292b5ed509b tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'd34ed46f99a54acca0ca1a224a8022d1', 'request_id': 'req-a82989d7-daf0-49fa-94d7-b292b5ed509b'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:41.021340 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a82989d7-daf0-49fa-94d7-b292b5ed509b tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'd34ed46f99a54acca0ca1a224a8022d1', 'request_id': 'req-a82989d7-daf0-49fa-94d7-b292b5ed509b'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:41.036791 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1985/3995] 10.222.0.52 () {58 vars in 1229 bytes} [Sat May 14 21:23:40 2022] DELETE /identity/v3/domains/d34ed46f99a54acca0ca1a224a8022d1 => generated 0 bytes in 749 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:41.042947 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfef2fe-99af-4d90-8792-a9d2f1b9d7d8 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:41.047640 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-dbfef2fe-99af-4d90-8792-a9d2f1b9d7d8 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:41.067787 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfef2fe-99af-4d90-8792-a9d2f1b9d7d8 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:41.189512 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab534c7-f29a-4659-bdb7-d32d2d4633f7 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b3021182184f0c80aff4920d5cc475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4ca399ec87f4044ad133caf08ffbdc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:41.190099 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab534c7-f29a-4659-bdb7-d32d2d4633f7 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:41.190390 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab534c7-f29a-4659-bdb7-d32d2d4633f7 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:41.190678 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab534c7-f29a-4659-bdb7-d32d2d4633f7 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:41.191427 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab534c7-f29a-4659-bdb7-d32d2d4633f7 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:41.193116 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab534c7-f29a-4659-bdb7-d32d2d4633f7 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:41.222173 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2011/3996] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:23:41 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:23:41.222377 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82989d7-daf0-49fa-94d7-b292b5ed509b tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:41.224329 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-a82989d7-daf0-49fa-94d7-b292b5ed509b tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:41.247185 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82989d7-daf0-49fa-94d7-b292b5ed509b tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:41.253131 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b34fd7-e79b-4a88-83fb-8fc725fef2a2 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b3021182184f0c80aff4920d5cc475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4ca399ec87f4044ad133caf08ffbdc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:41.254686 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b34fd7-e79b-4a88-83fb-8fc725fef2a2 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:41.255212 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b34fd7-e79b-4a88-83fb-8fc725fef2a2 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:41.255761 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b34fd7-e79b-4a88-83fb-8fc725fef2a2 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] PATH_INFO: `/v3/projects/9d991808be6e44ba93806db5e4a77ae9/users/b3b3021182184f0c80aff4920d5cc475/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:41.264578 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b34fd7-e79b-4a88-83fb-8fc725fef2a2 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorizing `identity:create_grant(project_id=9d991808be6e44ba93806db5e4a77ae9, user_id=b3b3021182184f0c80aff4920d5cc475, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:41.264578 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b34fd7-e79b-4a88-83fb-8fc725fef2a2 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:41.371570 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1986/3997] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:23:41 2022] PUT /identity/v3/projects/9d991808be6e44ba93806db5e4a77ae9/users/b3b3021182184f0c80aff4920d5cc475/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:41.377900 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab534c7-f29a-4659-bdb7-d32d2d4633f7 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:41.399560 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab534c7-f29a-4659-bdb7-d32d2d4633f7 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:41.525146 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b45efa-d95e-44fb-898c-d91224d64fa6 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b3021182184f0c80aff4920d5cc475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4ca399ec87f4044ad133caf08ffbdc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:41.526728 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b45efa-d95e-44fb-898c-d91224d64fa6 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:41.527193 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b45efa-d95e-44fb-898c-d91224d64fa6 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:41.528393 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b45efa-d95e-44fb-898c-d91224d64fa6 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] PATH_INFO: `/v3/auth/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:41.529407 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b45efa-d95e-44fb-898c-d91224d64fa6 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorizing `identity:get_auth_projects()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:41.530917 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b45efa-d95e-44fb-898c-d91224d64fa6 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:41.669860 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2012/3998] 10.222.0.52 () {58 vars in 1145 bytes} [Sat May 14 21:23:41 2022] GET /identity/v3/auth/projects => generated 824 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:23:41.673906 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b34fd7-e79b-4a88-83fb-8fc725fef2a2 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:41.703648 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b34fd7-e79b-4a88-83fb-8fc725fef2a2 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:41.718095 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883ca84f-b3b5-434c-90b6-729547290094 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b3021182184f0c80aff4920d5cc475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4ca399ec87f4044ad133caf08ffbdc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:41.720282 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ca84f-b3b5-434c-90b6-729547290094 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:41.720760 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ca84f-b3b5-434c-90b6-729547290094 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:41.721207 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ca84f-b3b5-434c-90b6-729547290094 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] PATH_INFO: `/v3/projects/9d991808be6e44ba93806db5e4a77ae9/users/b3b3021182184f0c80aff4920d5cc475/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:41.724038 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883ca84f-b3b5-434c-90b6-729547290094 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=9d991808be6e44ba93806db5e4a77ae9, user_id=b3b3021182184f0c80aff4920d5cc475, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:41.728368 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883ca84f-b3b5-434c-90b6-729547290094 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:41.747175 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-883ca84f-b3b5-434c-90b6-729547290094 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invalidating the token cache because role 24c463e2b4d44dd28cd2723a69a8ed2e was removed from user b3b3021182184f0c80aff4920d5cc475 on project 9d991808be6e44ba93806db5e4a77ae9. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:23:41.748500 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-883ca84f-b3b5-434c-90b6-729547290094 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:41.751976 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-883ca84f-b3b5-434c-90b6-729547290094 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:42.086072 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1987/3999] 10.222.0.52 () {58 vars in 1466 bytes} [Sat May 14 21:23:41 2022] DELETE /identity/v3/projects/9d991808be6e44ba93806db5e4a77ae9/users/b3b3021182184f0c80aff4920d5cc475/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:42.091593 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b45efa-d95e-44fb-898c-d91224d64fa6 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:42.093364 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c5b45efa-d95e-44fb-898c-d91224d64fa6 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:42.115737 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b45efa-d95e-44fb-898c-d91224d64fa6 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:42.262775 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661a2c62-38fa-471f-98e1-469676df9f33 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b3021182184f0c80aff4920d5cc475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4ca399ec87f4044ad133caf08ffbdc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:42.263365 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a2c62-38fa-471f-98e1-469676df9f33 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:42.263683 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a2c62-38fa-471f-98e1-469676df9f33 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:42.263965 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a2c62-38fa-471f-98e1-469676df9f33 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:42.264679 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661a2c62-38fa-471f-98e1-469676df9f33 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:42.269324 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661a2c62-38fa-471f-98e1-469676df9f33 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:42.407777 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2013/4000] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:23:42 2022] POST /identity/v3/users => generated 323 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:23:42.412099 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883ca84f-b3b5-434c-90b6-729547290094 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:42.425445 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883ca84f-b3b5-434c-90b6-729547290094 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:42.443434 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177b92f3-ceda-4ea9-9797-e77ab82ae7f5 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b3021182184f0c80aff4920d5cc475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4ca399ec87f4044ad133caf08ffbdc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:42.444461 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177b92f3-ceda-4ea9-9797-e77ab82ae7f5 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:42.445007 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177b92f3-ceda-4ea9-9797-e77ab82ae7f5 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:42.445530 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177b92f3-ceda-4ea9-9797-e77ab82ae7f5 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:42.446678 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177b92f3-ceda-4ea9-9797-e77ab82ae7f5 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:42.448887 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177b92f3-ceda-4ea9-9797-e77ab82ae7f5 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:42.583717 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1988/4001] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:23:42 2022] POST /identity/v3/projects => generated 360 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:23:42.587872 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661a2c62-38fa-471f-98e1-469676df9f33 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:42.603731 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661a2c62-38fa-471f-98e1-469676df9f33 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:42.774688 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814e1758-85f8-42f4-ad0b-f96dcf07460a tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b3021182184f0c80aff4920d5cc475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4ca399ec87f4044ad133caf08ffbdc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:42.774688 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e1758-85f8-42f4-ad0b-f96dcf07460a tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:42.774688 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e1758-85f8-42f4-ad0b-f96dcf07460a tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:42.775187 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e1758-85f8-42f4-ad0b-f96dcf07460a tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:42.775187 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814e1758-85f8-42f4-ad0b-f96dcf07460a tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:42.775660 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814e1758-85f8-42f4-ad0b-f96dcf07460a tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:42.970734 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2014/4002] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:23:42 2022] POST /identity/v3/projects => generated 363 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:23:42.975149 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177b92f3-ceda-4ea9-9797-e77ab82ae7f5 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:42.992516 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177b92f3-ceda-4ea9-9797-e77ab82ae7f5 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:43.122476 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913a3d32-1200-410c-82bd-0813570a327f tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b3021182184f0c80aff4920d5cc475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4ca399ec87f4044ad133caf08ffbdc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:43.125677 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913a3d32-1200-410c-82bd-0813570a327f tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:43.126161 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913a3d32-1200-410c-82bd-0813570a327f tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:43.126844 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913a3d32-1200-410c-82bd-0813570a327f tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:43.127858 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913a3d32-1200-410c-82bd-0813570a327f tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:43.129842 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913a3d32-1200-410c-82bd-0813570a327f tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:43.237265 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1989/4003] 10.222.0.52 () {60 vars in 1142 bytes} [Sat May 14 21:23:42 2022] POST /identity/v3/roles => generated 239 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:23:43.243620 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814e1758-85f8-42f4-ad0b-f96dcf07460a tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:43.264126 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814e1758-85f8-42f4-ad0b-f96dcf07460a tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:43.277458 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532f6f37-c669-4270-b914-ea5fb35afb1b tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b3021182184f0c80aff4920d5cc475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4ca399ec87f4044ad133caf08ffbdc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:43.279516 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f6f37-c669-4270-b914-ea5fb35afb1b tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:43.284942 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f6f37-c669-4270-b914-ea5fb35afb1b tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:43.286311 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f6f37-c669-4270-b914-ea5fb35afb1b tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] PATH_INFO: `/v3/projects/8a2b278d6917421d93d66c21b89a3a3f/users/a0b5e9d1b8864936b2681163920686c9/roles/72e8256610654edfbe22edc8e508aec8` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:43.313892 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532f6f37-c669-4270-b914-ea5fb35afb1b tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorizing `identity:create_grant(project_id=8a2b278d6917421d93d66c21b89a3a3f, user_id=a0b5e9d1b8864936b2681163920686c9, role_id=72e8256610654edfbe22edc8e508aec8)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:43.318905 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532f6f37-c669-4270-b914-ea5fb35afb1b tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:43.385532 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2015/4004] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:23:43 2022] PUT /identity/v3/projects/8a2b278d6917421d93d66c21b89a3a3f/users/a0b5e9d1b8864936b2681163920686c9/roles/72e8256610654edfbe22edc8e508aec8 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:43.391568 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913a3d32-1200-410c-82bd-0813570a327f tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:43.407087 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913a3d32-1200-410c-82bd-0813570a327f tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:43.557248 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cfc7ca-ac37-46f5-a8c0-fc8d42093b35 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b3021182184f0c80aff4920d5cc475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4ca399ec87f4044ad133caf08ffbdc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:43.558195 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cfc7ca-ac37-46f5-a8c0-fc8d42093b35 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:43.558485 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cfc7ca-ac37-46f5-a8c0-fc8d42093b35 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:43.558762 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cfc7ca-ac37-46f5-a8c0-fc8d42093b35 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] PATH_INFO: `/v3/projects/2891b5279b6043fda2c92e04cc51f743/users/a0b5e9d1b8864936b2681163920686c9/roles/72e8256610654edfbe22edc8e508aec8` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:43.565104 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cfc7ca-ac37-46f5-a8c0-fc8d42093b35 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorizing `identity:create_grant(project_id=2891b5279b6043fda2c92e04cc51f743, user_id=a0b5e9d1b8864936b2681163920686c9, role_id=72e8256610654edfbe22edc8e508aec8)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:43.568350 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cfc7ca-ac37-46f5-a8c0-fc8d42093b35 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:43.708619 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1990/4005] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:23:43 2022] PUT /identity/v3/projects/2891b5279b6043fda2c92e04cc51f743/users/a0b5e9d1b8864936b2681163920686c9/roles/72e8256610654edfbe22edc8e508aec8 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:43.712411 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50f1f0-da67-4230-a8c2-f109eea2adb6 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:43.712700 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50f1f0-da67-4230-a8c2-f109eea2adb6 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:43.714105 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50f1f0-da67-4230-a8c2-f109eea2adb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:43.823458 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-2d50f1f0-da67-4230-a8c2-f109eea2adb6 None None] MFA Rules not processed for user `a0b5e9d1b8864936b2681163920686c9`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:23:43.825197 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-2d50f1f0-da67-4230-a8c2-f109eea2adb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:43.836442 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2016/4006] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:23:43 2022] POST /identity/v3/auth/tokens => generated 335 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 21:23:43.841633 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6520074d-cf0d-4f34-b439-3bdd78369818 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:43.841833 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6520074d-cf0d-4f34-b439-3bdd78369818 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:43.842019 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6520074d-cf0d-4f34-b439-3bdd78369818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:43.862461 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-6520074d-cf0d-4f34-b439-3bdd78369818 None None] MFA Rules not processed for user `a0b5e9d1b8864936b2681163920686c9`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:23:43.864930 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-6520074d-cf0d-4f34-b439-3bdd78369818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:43.962463 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1991/4007] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:23:43 2022] POST /identity/v3/auth/tokens => generated 3211 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) May 14 21:23:43.966994 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d50f1f0-da67-4230-a8c2-f109eea2adb6 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:44.111203 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d50f1f0-da67-4230-a8c2-f109eea2adb6 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:44.127984 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67fdb25-fd18-4a52-86d1-aa1d0661669e tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b3021182184f0c80aff4920d5cc475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4ca399ec87f4044ad133caf08ffbdc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:44.128838 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67fdb25-fd18-4a52-86d1-aa1d0661669e tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:44.129129 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67fdb25-fd18-4a52-86d1-aa1d0661669e tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:44.129410 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67fdb25-fd18-4a52-86d1-aa1d0661669e tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:44.152870 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67fdb25-fd18-4a52-86d1-aa1d0661669e tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorizing `identity:revoke_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:44.154869 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67fdb25-fd18-4a52-86d1-aa1d0661669e tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:44.322017 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2017/4008] 10.222.0.52 () {56 vars in 1307 bytes} [Sat May 14 21:23:43 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:44.329242 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd825a89-3957-47a1-a2f0-f109cd772c3b None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:44.329242 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd825a89-3957-47a1-a2f0-f109cd772c3b None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:44.329242 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd825a89-3957-47a1-a2f0-f109cd772c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:44.352238 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-cd825a89-3957-47a1-a2f0-f109cd772c3b None None] MFA Rules not processed for user `a0b5e9d1b8864936b2681163920686c9`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:23:44.355553 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-cd825a89-3957-47a1-a2f0-f109cd772c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:44.525807 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1992/4009] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:23:44 2022] POST /identity/v3/auth/tokens => generated 3215 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) May 14 21:23:44.531153 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67fdb25-fd18-4a52-86d1-aa1d0661669e tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:44.554289 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67fdb25-fd18-4a52-86d1-aa1d0661669e tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:44.562227 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e390eae-d2c1-4b4a-9102-9c2c38b12b70 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b3021182184f0c80aff4920d5cc475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4ca399ec87f4044ad133caf08ffbdc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:44.563351 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e390eae-d2c1-4b4a-9102-9c2c38b12b70 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:44.563855 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e390eae-d2c1-4b4a-9102-9c2c38b12b70 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:44.564304 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e390eae-d2c1-4b4a-9102-9c2c38b12b70 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] PATH_INFO: `/v3/roles/72e8256610654edfbe22edc8e508aec8` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:44.566759 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e390eae-d2c1-4b4a-9102-9c2c38b12b70 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorizing `identity:delete_role(role_id=72e8256610654edfbe22edc8e508aec8)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:44.569149 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e390eae-d2c1-4b4a-9102-9c2c38b12b70 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:44.819270 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9e390eae-d2c1-4b4a-9102-9c2c38b12b70 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invalidating the token cache because role 72e8256610654edfbe22edc8e508aec8 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:23:44.819647 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9e390eae-d2c1-4b4a-9102-9c2c38b12b70 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:44.820328 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9e390eae-d2c1-4b4a-9102-9c2c38b12b70 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:44.823732 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2018/4010] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:23:44 2022] DELETE /identity/v3/roles/72e8256610654edfbe22edc8e508aec8 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:44.828792 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd825a89-3957-47a1-a2f0-f109cd772c3b None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:44.846048 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd825a89-3957-47a1-a2f0-f109cd772c3b None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:44.977700 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f6fc19-fd41-48e3-9e2b-05519c3f6e67 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b3021182184f0c80aff4920d5cc475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4ca399ec87f4044ad133caf08ffbdc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:44.978936 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f6fc19-fd41-48e3-9e2b-05519c3f6e67 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:44.979405 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f6fc19-fd41-48e3-9e2b-05519c3f6e67 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:44.980105 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f6fc19-fd41-48e3-9e2b-05519c3f6e67 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] PATH_INFO: `/v3/projects/2891b5279b6043fda2c92e04cc51f743` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:44.992547 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f6fc19-fd41-48e3-9e2b-05519c3f6e67 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2891b5279b6043fda2c92e04cc51f743)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:44.994906 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f6fc19-fd41-48e3-9e2b-05519c3f6e67 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:45.173233 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c8f6fc19-fd41-48e3-9e2b-05519c3f6e67 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2891b5279b6043fda2c92e04cc51f743', 'request_id': 'req-c8f6fc19-fd41-48e3-9e2b-05519c3f6e67'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:45.180151 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c8f6fc19-fd41-48e3-9e2b-05519c3f6e67 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2891b5279b6043fda2c92e04cc51f743', 'request_id': 'req-c8f6fc19-fd41-48e3-9e2b-05519c3f6e67'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:45.189514 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c8f6fc19-fd41-48e3-9e2b-05519c3f6e67 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2891b5279b6043fda2c92e04cc51f743', 'request_id': 'req-c8f6fc19-fd41-48e3-9e2b-05519c3f6e67'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:45.322602 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c8f6fc19-fd41-48e3-9e2b-05519c3f6e67 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] The token cache is being invalidate because project 2891b5279b6043fda2c92e04cc51f743 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:23:45.322942 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c8f6fc19-fd41-48e3-9e2b-05519c3f6e67 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:45.325823 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c8f6fc19-fd41-48e3-9e2b-05519c3f6e67 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:45.331969 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1993/4011] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:23:44 2022] DELETE /identity/v3/projects/2891b5279b6043fda2c92e04cc51f743 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:45.332847 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e390eae-d2c1-4b4a-9102-9c2c38b12b70 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:45.334341 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-9e390eae-d2c1-4b4a-9102-9c2c38b12b70 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:45.365249 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e390eae-d2c1-4b4a-9102-9c2c38b12b70 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:45.573737 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b378b06-d3b0-49ea-b269-2feedda9bfcd tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b3021182184f0c80aff4920d5cc475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4ca399ec87f4044ad133caf08ffbdc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:45.575580 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b378b06-d3b0-49ea-b269-2feedda9bfcd tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:45.576063 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b378b06-d3b0-49ea-b269-2feedda9bfcd tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:45.576502 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b378b06-d3b0-49ea-b269-2feedda9bfcd tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] PATH_INFO: `/v3/projects/2891b5279b6043fda2c92e04cc51f743` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:45.588494 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b378b06-d3b0-49ea-b269-2feedda9bfcd tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2891b5279b6043fda2c92e04cc51f743)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:45.591277 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b378b06-d3b0-49ea-b269-2feedda9bfcd tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:45.609722 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-4b378b06-d3b0-49ea-b269-2feedda9bfcd tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Could not find project: 2891b5279b6043fda2c92e04cc51f743.: keystone.exception.ProjectNotFound: Could not find project: 2891b5279b6043fda2c92e04cc51f743. May 14 21:23:45.609722 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:23:45.609722 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 21:23:45.609722 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 21:23:45.609722 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 21:23:45.609722 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 21:23:45.609722 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 21:23:45.609722 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 21:23:45.609722 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 21:23:45.609722 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 21:23:45.609722 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 21:23:45.609722 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 21:23:45.609722 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete May 14 21:23:45.609722 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( May 14 21:23:45.610967 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 21:23:45.610967 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 21:23:45.610967 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project May 14 21:23:45.610967 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) May 14 21:23:45.610967 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 21:23:45.610967 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 21:23:45.610967 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 21:23:45.610967 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 21:23:45.610967 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 2891b5279b6043fda2c92e04cc51f743. May 14 21:23:45.610967 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:23:45.611692 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2019/4012] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:23:45 2022] DELETE /identity/v3/projects/2891b5279b6043fda2c92e04cc51f743 => generated 113 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 14 21:23:45.616435 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f6fc19-fd41-48e3-9e2b-05519c3f6e67 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:45.618517 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c8f6fc19-fd41-48e3-9e2b-05519c3f6e67 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:45.769403 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f6fc19-fd41-48e3-9e2b-05519c3f6e67 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:45.769403 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef0804b-7a3e-4f32-b248-e1598ea6d9b9 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b3021182184f0c80aff4920d5cc475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4ca399ec87f4044ad133caf08ffbdc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:45.769403 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0804b-7a3e-4f32-b248-e1598ea6d9b9 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:45.770191 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0804b-7a3e-4f32-b248-e1598ea6d9b9 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:45.770191 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0804b-7a3e-4f32-b248-e1598ea6d9b9 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] PATH_INFO: `/v3/projects/8a2b278d6917421d93d66c21b89a3a3f` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:45.770191 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef0804b-7a3e-4f32-b248-e1598ea6d9b9 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8a2b278d6917421d93d66c21b89a3a3f)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:45.770191 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef0804b-7a3e-4f32-b248-e1598ea6d9b9 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:45.942172 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7ef0804b-7a3e-4f32-b248-e1598ea6d9b9 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a2b278d6917421d93d66c21b89a3a3f', 'request_id': 'req-7ef0804b-7a3e-4f32-b248-e1598ea6d9b9'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:45.960154 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7ef0804b-7a3e-4f32-b248-e1598ea6d9b9 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a2b278d6917421d93d66c21b89a3a3f', 'request_id': 'req-7ef0804b-7a3e-4f32-b248-e1598ea6d9b9'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:45.977811 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7ef0804b-7a3e-4f32-b248-e1598ea6d9b9 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a2b278d6917421d93d66c21b89a3a3f', 'request_id': 'req-7ef0804b-7a3e-4f32-b248-e1598ea6d9b9'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:46.066911 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7ef0804b-7a3e-4f32-b248-e1598ea6d9b9 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] The token cache is being invalidate because project 8a2b278d6917421d93d66c21b89a3a3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:23:46.067544 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7ef0804b-7a3e-4f32-b248-e1598ea6d9b9 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:46.074916 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7ef0804b-7a3e-4f32-b248-e1598ea6d9b9 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:46.074916 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1994/4013] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:23:45 2022] DELETE /identity/v3/projects/8a2b278d6917421d93d66c21b89a3a3f => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:46.077473 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b378b06-d3b0-49ea-b269-2feedda9bfcd tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:46.079401 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-4b378b06-d3b0-49ea-b269-2feedda9bfcd tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:46.109971 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b378b06-d3b0-49ea-b269-2feedda9bfcd tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:46.274454 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e156ef-a57b-4fa5-b251-6c1baab9f087 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b3021182184f0c80aff4920d5cc475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4ca399ec87f4044ad133caf08ffbdc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:46.279981 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e156ef-a57b-4fa5-b251-6c1baab9f087 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:46.279981 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e156ef-a57b-4fa5-b251-6c1baab9f087 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:46.279981 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e156ef-a57b-4fa5-b251-6c1baab9f087 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] PATH_INFO: `/v3/users/a0b5e9d1b8864936b2681163920686c9` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:46.279981 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e156ef-a57b-4fa5-b251-6c1baab9f087 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorizing `identity:delete_user(user_id=a0b5e9d1b8864936b2681163920686c9)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:46.279981 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e156ef-a57b-4fa5-b251-6c1baab9f087 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:46.494101 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a7e156ef-a57b-4fa5-b251-6c1baab9f087 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0b5e9d1b8864936b2681163920686c9'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:46.538343 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a7e156ef-a57b-4fa5-b251-6c1baab9f087 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0b5e9d1b8864936b2681163920686c9'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:46.551026 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a7e156ef-a57b-4fa5-b251-6c1baab9f087 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0b5e9d1b8864936b2681163920686c9'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:46.723963 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a7e156ef-a57b-4fa5-b251-6c1baab9f087 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0b5e9d1b8864936b2681163920686c9'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:46.723963 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a7e156ef-a57b-4fa5-b251-6c1baab9f087 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0b5e9d1b8864936b2681163920686c9'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:46.730013 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2020/4014] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:23:46 2022] DELETE /identity/v3/users/a0b5e9d1b8864936b2681163920686c9 => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:46.736421 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef0804b-7a3e-4f32-b248-e1598ea6d9b9 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:46.750226 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef0804b-7a3e-4f32-b248-e1598ea6d9b9 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:46.935847 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f14bc7-8de5-473a-ae10-46963138244d tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b3021182184f0c80aff4920d5cc475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4ca399ec87f4044ad133caf08ffbdc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:46.935847 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f14bc7-8de5-473a-ae10-46963138244d tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:46.935847 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f14bc7-8de5-473a-ae10-46963138244d tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:46.936345 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f14bc7-8de5-473a-ae10-46963138244d tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] PATH_INFO: `/v3/domains/8253ff4894014649aaef76797dd7b711` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:46.950803 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f14bc7-8de5-473a-ae10-46963138244d tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 21:23:46.972027 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-70f14bc7-8de5-473a-ae10-46963138244d tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Could not find domain: 8253ff4894014649aaef76797dd7b711.: keystone.exception.DomainNotFound: Could not find domain: 8253ff4894014649aaef76797dd7b711. May 14 21:23:46.972027 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:23:46.972027 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 14 21:23:46.972027 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 14 21:23:46.972027 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 21:23:46.972027 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 21:23:46.972027 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 21:23:46.972027 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 21:23:46.972027 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 8253ff4894014649aaef76797dd7b711. May 14 21:23:46.972027 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:23:46.972027 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 21:23:46.972027 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:23:46.972027 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:23:46.972027 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 21:23:46.972027 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 21:23:46.972027 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 21:23:46.977843 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 21:23:46.977843 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 21:23:46.977843 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 21:23:46.977843 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 21:23:46.977843 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 21:23:46.977843 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 21:23:46.977843 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 21:23:46.977843 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch May 14 21:23:46.977843 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') May 14 21:23:46.977843 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 21:23:46.977843 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 21:23:46.977843 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 21:23:46.977843 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 21:23:46.977843 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 21:23:46.977843 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 21:23:46.977843 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 21:23:46.979202 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 21:23:46.979202 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 21:23:46.979202 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 21:23:46.979202 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 21:23:46.979202 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 21:23:46.979202 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 21:23:46.979202 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 21:23:46.979202 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 21:23:46.979202 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 21:23:46.979202 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 21:23:46.979202 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 21:23:46.979202 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 21:23:46.979202 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 21:23:46.979202 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 14 21:23:46.979202 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 21:23:46.979202 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 8253ff4894014649aaef76797dd7b711. May 14 21:23:46.979202 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:23:46.980465 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1995/4015] 10.222.0.52 () {60 vars in 1248 bytes} [Sat May 14 21:23:46 2022] PATCH /identity/v3/domains/8253ff4894014649aaef76797dd7b711 => generated 112 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 14 21:23:46.982911 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e156ef-a57b-4fa5-b251-6c1baab9f087 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:46.989705 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-a7e156ef-a57b-4fa5-b251-6c1baab9f087 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:47.045773 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e156ef-a57b-4fa5-b251-6c1baab9f087 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:47.058101 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a8b779-2abf-4d3d-b31e-38355fe8a1b1 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b3021182184f0c80aff4920d5cc475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4ca399ec87f4044ad133caf08ffbdc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:47.059156 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8b779-2abf-4d3d-b31e-38355fe8a1b1 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:47.059571 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8b779-2abf-4d3d-b31e-38355fe8a1b1 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:47.059959 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8b779-2abf-4d3d-b31e-38355fe8a1b1 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] PATH_INFO: `/v3/domains/7e5ebd1ef22f4839bd60b9e01fa4abaf` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:47.083179 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a8b779-2abf-4d3d-b31e-38355fe8a1b1 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 21:23:47.115410 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-92a8b779-2abf-4d3d-b31e-38355fe8a1b1 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Could not find domain: 7e5ebd1ef22f4839bd60b9e01fa4abaf.: keystone.exception.DomainNotFound: Could not find domain: 7e5ebd1ef22f4839bd60b9e01fa4abaf. May 14 21:23:47.115410 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:23:47.115410 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 14 21:23:47.115410 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 14 21:23:47.115410 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 21:23:47.115410 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 21:23:47.115410 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 21:23:47.115410 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 21:23:47.115410 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 7e5ebd1ef22f4839bd60b9e01fa4abaf. May 14 21:23:47.115410 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:23:47.115410 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 21:23:47.115410 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:23:47.115410 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:23:47.115410 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 21:23:47.115410 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 21:23:47.115410 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 21:23:47.119316 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 21:23:47.119316 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 21:23:47.119316 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 21:23:47.119316 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 21:23:47.119316 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 21:23:47.119316 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 21:23:47.119316 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 21:23:47.119316 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch May 14 21:23:47.119316 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') May 14 21:23:47.119316 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 21:23:47.119316 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 21:23:47.119316 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 21:23:47.119316 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 21:23:47.119316 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 21:23:47.119316 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 21:23:47.119316 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 21:23:47.120495 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 21:23:47.120495 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 21:23:47.120495 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 21:23:47.120495 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 21:23:47.120495 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 21:23:47.120495 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 21:23:47.120495 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 21:23:47.120495 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 21:23:47.120495 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 21:23:47.120495 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 21:23:47.120495 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 21:23:47.120495 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 21:23:47.120495 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 21:23:47.120495 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 14 21:23:47.120495 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 21:23:47.120495 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 7e5ebd1ef22f4839bd60b9e01fa4abaf. May 14 21:23:47.120495 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:23:47.126086 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2021/4016] 10.222.0.52 () {60 vars in 1248 bytes} [Sat May 14 21:23:46 2022] PATCH /identity/v3/domains/7e5ebd1ef22f4839bd60b9e01fa4abaf => generated 112 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 14 21:23:47.128121 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f14bc7-8de5-473a-ae10-46963138244d tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:47.146058 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f14bc7-8de5-473a-ae10-46963138244d tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:47.167873 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb76b0-8ce6-4bbe-af07-0908e7e9812b tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b3021182184f0c80aff4920d5cc475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4ca399ec87f4044ad133caf08ffbdc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:47.167873 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb76b0-8ce6-4bbe-af07-0908e7e9812b tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:47.172648 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb76b0-8ce6-4bbe-af07-0908e7e9812b tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:47.172946 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb76b0-8ce6-4bbe-af07-0908e7e9812b tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] PATH_INFO: `/v3/domains/ab6c62b557744e2191dca10f39967bf8` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:47.195687 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eb76b0-8ce6-4bbe-af07-0908e7e9812b tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 21:23:47.219608 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-23eb76b0-8ce6-4bbe-af07-0908e7e9812b tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Could not find domain: ab6c62b557744e2191dca10f39967bf8.: keystone.exception.DomainNotFound: Could not find domain: ab6c62b557744e2191dca10f39967bf8. May 14 21:23:47.219608 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:23:47.219608 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 14 21:23:47.219608 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 14 21:23:47.219608 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 21:23:47.219608 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 21:23:47.219608 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 21:23:47.219608 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 21:23:47.219608 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: ab6c62b557744e2191dca10f39967bf8. May 14 21:23:47.219608 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:23:47.219608 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 21:23:47.219608 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:23:47.219608 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:23:47.219608 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 21:23:47.219608 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 21:23:47.219608 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 21:23:47.220732 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 21:23:47.220732 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 21:23:47.220732 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 21:23:47.220732 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 21:23:47.220732 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 21:23:47.220732 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 21:23:47.220732 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 21:23:47.220732 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch May 14 21:23:47.220732 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') May 14 21:23:47.220732 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 21:23:47.220732 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 21:23:47.220732 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 21:23:47.220732 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 21:23:47.220732 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 21:23:47.220732 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 21:23:47.220732 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 21:23:47.221798 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 21:23:47.221798 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 21:23:47.221798 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 21:23:47.221798 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 21:23:47.221798 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 21:23:47.221798 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 21:23:47.221798 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 21:23:47.221798 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 21:23:47.221798 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 21:23:47.221798 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 21:23:47.221798 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 21:23:47.221798 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 21:23:47.221798 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 21:23:47.221798 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 14 21:23:47.221798 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 21:23:47.221798 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: ab6c62b557744e2191dca10f39967bf8. May 14 21:23:47.221798 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:23:47.229209 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a8b779-2abf-4d3d-b31e-38355fe8a1b1 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:47.230100 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1996/4017] 10.222.0.52 () {60 vars in 1248 bytes} [Sat May 14 21:23:47 2022] PATCH /identity/v3/domains/ab6c62b557744e2191dca10f39967bf8 => generated 112 bytes in 101 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 14 21:23:47.242278 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a8b779-2abf-4d3d-b31e-38355fe8a1b1 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:47.249732 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f38fc6-8c15-42ed-bdd4-1bc9c7686611 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b3021182184f0c80aff4920d5cc475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4ca399ec87f4044ad133caf08ffbdc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:47.250866 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f38fc6-8c15-42ed-bdd4-1bc9c7686611 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:47.251380 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f38fc6-8c15-42ed-bdd4-1bc9c7686611 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:47.252016 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f38fc6-8c15-42ed-bdd4-1bc9c7686611 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] PATH_INFO: `/v3/domains/d34ed46f99a54acca0ca1a224a8022d1` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:47.263783 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f38fc6-8c15-42ed-bdd4-1bc9c7686611 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 21:23:47.276916 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-36f38fc6-8c15-42ed-bdd4-1bc9c7686611 tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Could not find domain: d34ed46f99a54acca0ca1a224a8022d1.: keystone.exception.DomainNotFound: Could not find domain: d34ed46f99a54acca0ca1a224a8022d1. May 14 21:23:47.276916 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:23:47.276916 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 14 21:23:47.276916 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 14 21:23:47.276916 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 21:23:47.276916 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 21:23:47.276916 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 21:23:47.276916 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 21:23:47.276916 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: d34ed46f99a54acca0ca1a224a8022d1. May 14 21:23:47.276916 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:23:47.276916 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 21:23:47.276916 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:23:47.276916 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:23:47.276916 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 21:23:47.276916 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 21:23:47.276916 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 21:23:47.278480 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 21:23:47.278480 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 21:23:47.278480 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 21:23:47.278480 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 21:23:47.278480 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 21:23:47.278480 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 21:23:47.278480 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 21:23:47.278480 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch May 14 21:23:47.278480 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') May 14 21:23:47.278480 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 21:23:47.278480 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 21:23:47.278480 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 21:23:47.278480 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 21:23:47.278480 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 21:23:47.278480 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 21:23:47.278480 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 21:23:47.279609 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 21:23:47.279609 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 21:23:47.279609 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 21:23:47.279609 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 21:23:47.279609 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 21:23:47.279609 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 21:23:47.279609 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 21:23:47.279609 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 21:23:47.279609 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 21:23:47.279609 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 21:23:47.279609 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 21:23:47.279609 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 21:23:47.279609 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 21:23:47.279609 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 14 21:23:47.279609 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 21:23:47.279609 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: d34ed46f99a54acca0ca1a224a8022d1. May 14 21:23:47.279609 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:23:47.285946 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2022/4018] 10.222.0.52 () {60 vars in 1248 bytes} [Sat May 14 21:23:47 2022] PATCH /identity/v3/domains/d34ed46f99a54acca0ca1a224a8022d1 => generated 112 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 14 21:23:47.299771 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb76b0-8ce6-4bbe-af07-0908e7e9812b tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:47.302468 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-23eb76b0-8ce6-4bbe-af07-0908e7e9812b tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:47.427996 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb76b0-8ce6-4bbe-af07-0908e7e9812b tempest-TokensV3TestJSON-1856857421 tempest-TokensV3TestJSON-1856857421-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:47.437229 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e866def8-d7ee-43f9-abdd-2f5c2b130013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:47.439361 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866def8-d7ee-43f9-abdd-2f5c2b130013 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:47.440110 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866def8-d7ee-43f9-abdd-2f5c2b130013 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:47.441069 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866def8-d7ee-43f9-abdd-2f5c2b130013 admin admin] PATH_INFO: `/v3/users/89cfa28cffc144ed8bcc59b2aa9311b5` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:47.444056 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e866def8-d7ee-43f9-abdd-2f5c2b130013 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89cfa28cffc144ed8bcc59b2aa9311b5)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:47.445219 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e866def8-d7ee-43f9-abdd-2f5c2b130013 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:47.777405 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e866def8-d7ee-43f9-abdd-2f5c2b130013 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89cfa28cffc144ed8bcc59b2aa9311b5'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:47.786592 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e866def8-d7ee-43f9-abdd-2f5c2b130013 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89cfa28cffc144ed8bcc59b2aa9311b5'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:47.787663 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e866def8-d7ee-43f9-abdd-2f5c2b130013 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89cfa28cffc144ed8bcc59b2aa9311b5'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:47.876820 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e866def8-d7ee-43f9-abdd-2f5c2b130013 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89cfa28cffc144ed8bcc59b2aa9311b5'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:47.918972 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e866def8-d7ee-43f9-abdd-2f5c2b130013 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89cfa28cffc144ed8bcc59b2aa9311b5'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:47.952136 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1997/4019] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:23:47 2022] DELETE /identity/v3/users/89cfa28cffc144ed8bcc59b2aa9311b5 => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:47.956749 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb0969-00c7-4fc5-8b26-3abfd00f6965 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:47.957254 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb0969-00c7-4fc5-8b26-3abfd00f6965 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:47.957548 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb0969-00c7-4fc5-8b26-3abfd00f6965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:47.989810 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-10eb0969-00c7-4fc5-8b26-3abfd00f6965 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:23:47.991225 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-10eb0969-00c7-4fc5-8b26-3abfd00f6965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:48.190382 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2023/4020] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:23:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:23:48.203659 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e866def8-d7ee-43f9-abdd-2f5c2b130013 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:48.206130 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e866def8-d7ee-43f9-abdd-2f5c2b130013 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:48.450463 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf1a4d-bc54-42d3-a716-6f9aea5c650b None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:48.453694 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf1a4d-bc54-42d3-a716-6f9aea5c650b None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:48.454046 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf1a4d-bc54-42d3-a716-6f9aea5c650b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:48.475686 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e866def8-d7ee-43f9-abdd-2f5c2b130013 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:48.482465 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3d3129-4c54-4634-96d6-40621aac3ab4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:48.484348 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d3129-4c54-4634-96d6-40621aac3ab4 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:48.491199 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d3129-4c54-4634-96d6-40621aac3ab4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:48.492552 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d3129-4c54-4634-96d6-40621aac3ab4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:48.507062 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3d3129-4c54-4634-96d6-40621aac3ab4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:48.508819 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3d3129-4c54-4634-96d6-40621aac3ab4 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:48.541752 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1998/4021] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:23:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:23:48.545852 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-12cf1a4d-bc54-42d3-a716-6f9aea5c650b None None] MFA Rules not processed for user `00d9c6a6abe64522aca4b9a4f09f4258`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:23:48.547462 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-12cf1a4d-bc54-42d3-a716-6f9aea5c650b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:48.690129 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2024/4022] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:23:48 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:23:48.952298 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3d3129-4c54-4634-96d6-40621aac3ab4 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:48.953942 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-ff3d3129-4c54-4634-96d6-40621aac3ab4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:49.139726 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3d3129-4c54-4634-96d6-40621aac3ab4 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:49.155742 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e11bac-882a-4bd1-96f7-ce91091f28a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:49.156860 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e11bac-882a-4bd1-96f7-ce91091f28a6 service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:49.157983 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e11bac-882a-4bd1-96f7-ce91091f28a6 service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:49.158715 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e11bac-882a-4bd1-96f7-ce91091f28a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:49.170403 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e11bac-882a-4bd1-96f7-ce91091f28a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:49.173053 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e11bac-882a-4bd1-96f7-ce91091f28a6 service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:49.189037 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 1999/4023] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:23:48 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:23:49.588599 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cf1a4d-bc54-42d3-a716-6f9aea5c650b None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:49.592147 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-12cf1a4d-bc54-42d3-a716-6f9aea5c650b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:49.623428 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cf1a4d-bc54-42d3-a716-6f9aea5c650b None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:49.628826 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd72f63-6abc-43e0-aa24-5131fd476837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:49.630043 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd72f63-6abc-43e0-aa24-5131fd476837 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:49.630561 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd72f63-6abc-43e0-aa24-5131fd476837 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:49.631060 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd72f63-6abc-43e0-aa24-5131fd476837 admin admin] PATH_INFO: `/v3/projects/9d991808be6e44ba93806db5e4a77ae9` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:49.643238 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd72f63-6abc-43e0-aa24-5131fd476837 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d991808be6e44ba93806db5e4a77ae9)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:49.645629 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd72f63-6abc-43e0-aa24-5131fd476837 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:49.816844 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ecd72f63-6abc-43e0-aa24-5131fd476837 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d991808be6e44ba93806db5e4a77ae9', 'request_id': 'req-ecd72f63-6abc-43e0-aa24-5131fd476837'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:49.830622 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ecd72f63-6abc-43e0-aa24-5131fd476837 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d991808be6e44ba93806db5e4a77ae9', 'request_id': 'req-ecd72f63-6abc-43e0-aa24-5131fd476837'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:49.948594 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ecd72f63-6abc-43e0-aa24-5131fd476837 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d991808be6e44ba93806db5e4a77ae9', 'request_id': 'req-ecd72f63-6abc-43e0-aa24-5131fd476837'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:49.966326 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ecd72f63-6abc-43e0-aa24-5131fd476837 admin admin] The token cache is being invalidate because project 9d991808be6e44ba93806db5e4a77ae9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:23:49.968731 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ecd72f63-6abc-43e0-aa24-5131fd476837 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:49.975666 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ecd72f63-6abc-43e0-aa24-5131fd476837 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:49.976086 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2025/4024] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:23:49 2022] DELETE /identity/v3/projects/9d991808be6e44ba93806db5e4a77ae9 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:49.979809 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e11bac-882a-4bd1-96f7-ce91091f28a6 service nova] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:50.007630 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e11bac-882a-4bd1-96f7-ce91091f28a6 service nova] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:50.219716 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500bdf0d-81f0-4e7d-adcf-71840dc824cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:50.220760 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500bdf0d-81f0-4e7d-adcf-71840dc824cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:50.226863 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500bdf0d-81f0-4e7d-adcf-71840dc824cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:50.238970 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500bdf0d-81f0-4e7d-adcf-71840dc824cc admin admin] PATH_INFO: `/v3/users/b3b3021182184f0c80aff4920d5cc475` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:50.242429 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500bdf0d-81f0-4e7d-adcf-71840dc824cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3b3021182184f0c80aff4920d5cc475)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:50.249327 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500bdf0d-81f0-4e7d-adcf-71840dc824cc admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:50.555577 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-500bdf0d-81f0-4e7d-adcf-71840dc824cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3b3021182184f0c80aff4920d5cc475'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:50.573697 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-500bdf0d-81f0-4e7d-adcf-71840dc824cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3b3021182184f0c80aff4920d5cc475'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:50.574606 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-500bdf0d-81f0-4e7d-adcf-71840dc824cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3b3021182184f0c80aff4920d5cc475'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:50.674411 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-500bdf0d-81f0-4e7d-adcf-71840dc824cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3b3021182184f0c80aff4920d5cc475'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:50.705848 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-500bdf0d-81f0-4e7d-adcf-71840dc824cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3b3021182184f0c80aff4920d5cc475'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:50.735429 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2000/4025] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:23:49 2022] DELETE /identity/v3/users/b3b3021182184f0c80aff4920d5cc475 => generated 0 bytes in 753 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:51.671262 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb733fa7-ddde-4d30-b624-3246e60224dc None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:51.671262 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb733fa7-ddde-4d30-b624-3246e60224dc None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:51.671820 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb733fa7-ddde-4d30-b624-3246e60224dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:51.704082 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-eb733fa7-ddde-4d30-b624-3246e60224dc None None] MFA Rules not processed for user `87538f2309714545bd47f228b6505883`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:23:51.705359 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-eb733fa7-ddde-4d30-b624-3246e60224dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:51.813379 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2026/4026] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:23:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:23:51.828214 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500bdf0d-81f0-4e7d-adcf-71840dc824cc admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:51.828214 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-500bdf0d-81f0-4e7d-adcf-71840dc824cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:52.035724 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500bdf0d-81f0-4e7d-adcf-71840dc824cc admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:52.047548 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb8ebe5-1910-46f4-aac8-2a2f42efd1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:52.049704 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb8ebe5-1910-46f4-aac8-2a2f42efd1cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:52.050219 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb8ebe5-1910-46f4-aac8-2a2f42efd1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:52.050847 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb8ebe5-1910-46f4-aac8-2a2f42efd1cc admin admin] PATH_INFO: `/v3/users/71080496c33c4e2c8b2e16b950f0b9ea` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:52.053673 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb8ebe5-1910-46f4-aac8-2a2f42efd1cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=71080496c33c4e2c8b2e16b950f0b9ea)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:52.056073 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb8ebe5-1910-46f4-aac8-2a2f42efd1cc admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:52.367138 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-efb8ebe5-1910-46f4-aac8-2a2f42efd1cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71080496c33c4e2c8b2e16b950f0b9ea'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:52.396390 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-efb8ebe5-1910-46f4-aac8-2a2f42efd1cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71080496c33c4e2c8b2e16b950f0b9ea'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:52.397185 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-efb8ebe5-1910-46f4-aac8-2a2f42efd1cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71080496c33c4e2c8b2e16b950f0b9ea'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:52.445859 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb733fa7-ddde-4d30-b624-3246e60224dc None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:52.448221 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-eb733fa7-ddde-4d30-b624-3246e60224dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:52.472830 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb733fa7-ddde-4d30-b624-3246e60224dc None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:52.478683 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2105e20a-37da-481e-a46d-7e4649adee05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:52.480162 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2105e20a-37da-481e-a46d-7e4649adee05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:52.481010 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2105e20a-37da-481e-a46d-7e4649adee05 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:52.481540 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2105e20a-37da-481e-a46d-7e4649adee05 admin admin] PATH_INFO: `/v3/projects/e4ca399ec87f4044ad133caf08ffbdc6` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:52.482993 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2105e20a-37da-481e-a46d-7e4649adee05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4ca399ec87f4044ad133caf08ffbdc6)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:52.486213 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2105e20a-37da-481e-a46d-7e4649adee05 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:52.515555 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-efb8ebe5-1910-46f4-aac8-2a2f42efd1cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71080496c33c4e2c8b2e16b950f0b9ea'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:52.552458 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-efb8ebe5-1910-46f4-aac8-2a2f42efd1cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71080496c33c4e2c8b2e16b950f0b9ea'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:52.569455 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2001/4027] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:23:51 2022] DELETE /identity/v3/users/71080496c33c4e2c8b2e16b950f0b9ea => generated 0 bytes in 741 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:52.694017 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2105e20a-37da-481e-a46d-7e4649adee05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4ca399ec87f4044ad133caf08ffbdc6', 'request_id': 'req-2105e20a-37da-481e-a46d-7e4649adee05'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:52.725725 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2105e20a-37da-481e-a46d-7e4649adee05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4ca399ec87f4044ad133caf08ffbdc6', 'request_id': 'req-2105e20a-37da-481e-a46d-7e4649adee05'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:52.840991 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2105e20a-37da-481e-a46d-7e4649adee05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4ca399ec87f4044ad133caf08ffbdc6', 'request_id': 'req-2105e20a-37da-481e-a46d-7e4649adee05'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:52.868758 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2105e20a-37da-481e-a46d-7e4649adee05 admin admin] The token cache is being invalidate because project e4ca399ec87f4044ad133caf08ffbdc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:23:52.869403 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2105e20a-37da-481e-a46d-7e4649adee05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:52.872861 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2105e20a-37da-481e-a46d-7e4649adee05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:52.882805 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb8ebe5-1910-46f4-aac8-2a2f42efd1cc admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:52.883992 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2027/4028] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:23:52 2022] DELETE /identity/v3/projects/e4ca399ec87f4044ad133caf08ffbdc6 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:52.885157 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-efb8ebe5-1910-46f4-aac8-2a2f42efd1cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:53.025244 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb8ebe5-1910-46f4-aac8-2a2f42efd1cc admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:53.234305 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0189c8ef-d263-4151-bbf1-9cfb126af5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:53.236210 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189c8ef-d263-4151-bbf1-9cfb126af5de admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:53.236393 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189c8ef-d263-4151-bbf1-9cfb126af5de admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:53.238964 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189c8ef-d263-4151-bbf1-9cfb126af5de admin admin] PATH_INFO: `/v3/users/553d37b6560b45c3bd17b80c576a2026` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:53.242044 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0189c8ef-d263-4151-bbf1-9cfb126af5de admin admin] RBAC: Authorizing `identity:delete_user(user_id=553d37b6560b45c3bd17b80c576a2026)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:53.249301 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0189c8ef-d263-4151-bbf1-9cfb126af5de admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:53.371561 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2105e20a-37da-481e-a46d-7e4649adee05 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:53.373405 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-2105e20a-37da-481e-a46d-7e4649adee05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:53.532009 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2105e20a-37da-481e-a46d-7e4649adee05 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:53.548646 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2dfc3c-e685-4433-9fd7-e340a0a1adc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:53.551170 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2dfc3c-e685-4433-9fd7-e340a0a1adc1 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:53.552229 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2dfc3c-e685-4433-9fd7-e340a0a1adc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:53.552731 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2dfc3c-e685-4433-9fd7-e340a0a1adc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:53.556244 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-9e2dfc3c-e685-4433-9fd7-e340a0a1adc1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:53.569488 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2dfc3c-e685-4433-9fd7-e340a0a1adc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:53.571300 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2dfc3c-e685-4433-9fd7-e340a0a1adc1 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:53.584790 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2028/4029] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:23:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:23:53.614417 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0189c8ef-d263-4151-bbf1-9cfb126af5de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '553d37b6560b45c3bd17b80c576a2026'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:53.638007 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0189c8ef-d263-4151-bbf1-9cfb126af5de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '553d37b6560b45c3bd17b80c576a2026'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:53.639974 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0189c8ef-d263-4151-bbf1-9cfb126af5de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '553d37b6560b45c3bd17b80c576a2026'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:53.714691 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0189c8ef-d263-4151-bbf1-9cfb126af5de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '553d37b6560b45c3bd17b80c576a2026'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:53.767581 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0189c8ef-d263-4151-bbf1-9cfb126af5de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '553d37b6560b45c3bd17b80c576a2026'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:53.767581 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2002/4030] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:23:52 2022] DELETE /identity/v3/users/553d37b6560b45c3bd17b80c576a2026 => generated 0 bytes in 881 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:54.485343 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2dfc3c-e685-4433-9fd7-e340a0a1adc1 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:54.486797 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-9e2dfc3c-e685-4433-9fd7-e340a0a1adc1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:54.534112 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2dfc3c-e685-4433-9fd7-e340a0a1adc1 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:54.620437 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70bd4cf-cff0-4a70-87f7-30e54aa98413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:54.622034 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70bd4cf-cff0-4a70-87f7-30e54aa98413 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:54.626201 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70bd4cf-cff0-4a70-87f7-30e54aa98413 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:54.627221 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70bd4cf-cff0-4a70-87f7-30e54aa98413 admin admin] PATH_INFO: `/v3/projects/b031454047774b4fb8b459f226f645d2` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:54.629685 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70bd4cf-cff0-4a70-87f7-30e54aa98413 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b031454047774b4fb8b459f226f645d2)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:54.632015 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70bd4cf-cff0-4a70-87f7-30e54aa98413 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:54.778405 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d70bd4cf-cff0-4a70-87f7-30e54aa98413 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b031454047774b4fb8b459f226f645d2', 'request_id': 'req-d70bd4cf-cff0-4a70-87f7-30e54aa98413'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:54.785802 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d70bd4cf-cff0-4a70-87f7-30e54aa98413 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b031454047774b4fb8b459f226f645d2', 'request_id': 'req-d70bd4cf-cff0-4a70-87f7-30e54aa98413'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:54.936853 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d70bd4cf-cff0-4a70-87f7-30e54aa98413 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b031454047774b4fb8b459f226f645d2', 'request_id': 'req-d70bd4cf-cff0-4a70-87f7-30e54aa98413'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:54.957739 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d70bd4cf-cff0-4a70-87f7-30e54aa98413 admin admin] The token cache is being invalidate because project b031454047774b4fb8b459f226f645d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:23:54.958051 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d70bd4cf-cff0-4a70-87f7-30e54aa98413 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:54.959040 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d70bd4cf-cff0-4a70-87f7-30e54aa98413 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:54.966511 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2029/4031] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:23:54 2022] DELETE /identity/v3/projects/b031454047774b4fb8b459f226f645d2 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:54.967445 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ad170-25f9-4c0b-808d-092a07e760d5 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:54.967933 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ad170-25f9-4c0b-808d-092a07e760d5 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:54.968089 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ad170-25f9-4c0b-808d-092a07e760d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:55.022785 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-7f3ad170-25f9-4c0b-808d-092a07e760d5 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:23:55.024118 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-7f3ad170-25f9-4c0b-808d-092a07e760d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:55.178342 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e341f1-6047-4cc1-a753-a09868e22752 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:55.179133 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e341f1-6047-4cc1-a753-a09868e22752 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:55.179591 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e341f1-6047-4cc1-a753-a09868e22752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:55.189539 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2003/4032] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:23:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:23:55.203846 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-59e341f1-6047-4cc1-a753-a09868e22752 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:23:55.205244 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-59e341f1-6047-4cc1-a753-a09868e22752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:55.220304 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2030/4033] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:23:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:23:55.224449 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3ad170-25f9-4c0b-808d-092a07e760d5 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:55.237513 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3ad170-25f9-4c0b-808d-092a07e760d5 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:55.243372 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86273765-0112-4ceb-8f87-e0e52303a018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:55.244192 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86273765-0112-4ceb-8f87-e0e52303a018 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:55.244608 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86273765-0112-4ceb-8f87-e0e52303a018 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:55.245111 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86273765-0112-4ceb-8f87-e0e52303a018 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:55.246598 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86273765-0112-4ceb-8f87-e0e52303a018 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:23:55.247036 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86273765-0112-4ceb-8f87-e0e52303a018 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:55.248867 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86273765-0112-4ceb-8f87-e0e52303a018 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:55.290505 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2004/4034] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:23:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:23:55.293159 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e341f1-6047-4cc1-a753-a09868e22752 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:55.306191 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e341f1-6047-4cc1-a753-a09868e22752 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:55.325089 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d54376e-77b7-42ba-ac61-7471558a8635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:55.325089 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d54376e-77b7-42ba-ac61-7471558a8635 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:55.325089 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d54376e-77b7-42ba-ac61-7471558a8635 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:55.325089 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d54376e-77b7-42ba-ac61-7471558a8635 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:55.325529 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d54376e-77b7-42ba-ac61-7471558a8635 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:55.326333 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d54376e-77b7-42ba-ac61-7471558a8635 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:55.369307 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86273765-0112-4ceb-8f87-e0e52303a018 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:55.371967 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-86273765-0112-4ceb-8f87-e0e52303a018 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:55.397249 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86273765-0112-4ceb-8f87-e0e52303a018 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:55.404704 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35df6324-506d-4d0b-a978-1567585dc1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:55.407289 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35df6324-506d-4d0b-a978-1567585dc1f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:55.407840 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35df6324-506d-4d0b-a978-1567585dc1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:55.408149 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35df6324-506d-4d0b-a978-1567585dc1f4 admin admin] PATH_INFO: `/v3/projects/d82dae50b73e4752883ed8c6632ed10f` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:55.410185 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35df6324-506d-4d0b-a978-1567585dc1f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d82dae50b73e4752883ed8c6632ed10f)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:55.412424 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35df6324-506d-4d0b-a978-1567585dc1f4 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:55.442459 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2031/4035] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:23:55 2022] POST /identity/v3/projects => generated 389 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:23:55.443763 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d54376e-77b7-42ba-ac61-7471558a8635 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:55.648062 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-35df6324-506d-4d0b-a978-1567585dc1f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd82dae50b73e4752883ed8c6632ed10f', 'request_id': 'req-35df6324-506d-4d0b-a978-1567585dc1f4'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:55.657664 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-35df6324-506d-4d0b-a978-1567585dc1f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd82dae50b73e4752883ed8c6632ed10f', 'request_id': 'req-35df6324-506d-4d0b-a978-1567585dc1f4'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:55.676637 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-35df6324-506d-4d0b-a978-1567585dc1f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd82dae50b73e4752883ed8c6632ed10f', 'request_id': 'req-35df6324-506d-4d0b-a978-1567585dc1f4'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:55.677172 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d54376e-77b7-42ba-ac61-7471558a8635 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:55.764787 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac265fc-a42e-41e5-918a-1614228878e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:55.765783 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac265fc-a42e-41e5-918a-1614228878e1 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:55.766658 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac265fc-a42e-41e5-918a-1614228878e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:55.766996 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac265fc-a42e-41e5-918a-1614228878e1 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:55.768244 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac265fc-a42e-41e5-918a-1614228878e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:55.771189 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac265fc-a42e-41e5-918a-1614228878e1 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:55.875537 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-35df6324-506d-4d0b-a978-1567585dc1f4 admin admin] The token cache is being invalidate because project d82dae50b73e4752883ed8c6632ed10f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:23:55.875537 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-35df6324-506d-4d0b-a978-1567585dc1f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:55.876181 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-35df6324-506d-4d0b-a978-1567585dc1f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:55.881139 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2005/4036] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:23:55 2022] DELETE /identity/v3/projects/d82dae50b73e4752883ed8c6632ed10f => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:23:55.883708 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d5ff4-c3c2-43a0-a658-9b56078fed1a None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:55.884072 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d5ff4-c3c2-43a0-a658-9b56078fed1a None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:55.884672 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d5ff4-c3c2-43a0-a658-9b56078fed1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:55.945120 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-0b5d5ff4-c3c2-43a0-a658-9b56078fed1a None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:23:55.948141 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-0b5d5ff4-c3c2-43a0-a658-9b56078fed1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:55.949831 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2032/4037] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:23:55 2022] POST /identity/v3/users => generated 295 bytes in 507 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:23:55.953574 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac265fc-a42e-41e5-918a-1614228878e1 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:55.956554 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-4ac265fc-a42e-41e5-918a-1614228878e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:55.982398 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2006/4038] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:23:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:23:55.983679 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44ab0ec-552c-4bc5-94e2-0dcff4cec6e6 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:55.983972 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44ab0ec-552c-4bc5-94e2-0dcff4cec6e6 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:55.984251 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44ab0ec-552c-4bc5-94e2-0dcff4cec6e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:56.013008 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-c44ab0ec-552c-4bc5-94e2-0dcff4cec6e6 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:23:56.015070 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c44ab0ec-552c-4bc5-94e2-0dcff4cec6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:56.017388 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac265fc-a42e-41e5-918a-1614228878e1 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:56.031605 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2007/4039] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:23:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:23:56.032821 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44ab0ec-552c-4bc5-94e2-0dcff4cec6e6 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:56.035611 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f4711b-7457-43a1-ae4e-b0612cad2b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:56.036355 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4711b-7457-43a1-ae4e-b0612cad2b61 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:56.036643 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4711b-7457-43a1-ae4e-b0612cad2b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:56.036918 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4711b-7457-43a1-ae4e-b0612cad2b61 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:56.044539 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f4711b-7457-43a1-ae4e-b0612cad2b61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:56.046358 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f4711b-7457-43a1-ae4e-b0612cad2b61 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:56.046984 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44ab0ec-552c-4bc5-94e2-0dcff4cec6e6 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:56.054489 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9b8e62-df2a-46b1-8059-c158e7e4737f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:56.057359 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9b8e62-df2a-46b1-8059-c158e7e4737f admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:56.060258 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9b8e62-df2a-46b1-8059-c158e7e4737f admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:56.060774 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9b8e62-df2a-46b1-8059-c158e7e4737f admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:56.063367 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9b8e62-df2a-46b1-8059-c158e7e4737f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:23:56.073240 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9b8e62-df2a-46b1-8059-c158e7e4737f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:56.083222 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9b8e62-df2a-46b1-8059-c158e7e4737f admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:56.105234 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2033/4040] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:23:55 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:23:56.112554 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2008/4041] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:23:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:23:56.113165 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f4711b-7457-43a1-ae4e-b0612cad2b61 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:56.120700 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9b8e62-df2a-46b1-8059-c158e7e4737f admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:56.147303 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f4711b-7457-43a1-ae4e-b0612cad2b61 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:56.153477 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9b8e62-df2a-46b1-8059-c158e7e4737f admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:56.159392 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f8acd4-a334-4b70-9906-dbcd1bfda48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:56.161254 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8acd4-a334-4b70-9906-dbcd1bfda48e admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:56.161542 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8acd4-a334-4b70-9906-dbcd1bfda48e admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:56.161820 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8acd4-a334-4b70-9906-dbcd1bfda48e admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:56.162553 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f8acd4-a334-4b70-9906-dbcd1bfda48e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:56.164207 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f8acd4-a334-4b70-9906-dbcd1bfda48e admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:56.166162 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef10502f-e112-4365-bd89-0506d533ec9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:56.166909 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10502f-e112-4365-bd89-0506d533ec9d admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:56.167209 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10502f-e112-4365-bd89-0506d533ec9d admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:56.167466 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10502f-e112-4365-bd89-0506d533ec9d admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:56.168233 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef10502f-e112-4365-bd89-0506d533ec9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:56.170666 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef10502f-e112-4365-bd89-0506d533ec9d admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:56.194248 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2034/4042] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:23:56 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:23:56.197320 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f8acd4-a334-4b70-9906-dbcd1bfda48e admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:56.212380 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f8acd4-a334-4b70-9906-dbcd1bfda48e admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:56.223127 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b31a0c-8013-4e63-b5a1-ba6bf5fafa6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:56.223949 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b31a0c-8013-4e63-b5a1-ba6bf5fafa6b admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:56.224231 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b31a0c-8013-4e63-b5a1-ba6bf5fafa6b admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:56.224553 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b31a0c-8013-4e63-b5a1-ba6bf5fafa6b admin admin] PATH_INFO: `/v3/projects/9b6232491b674705b2c339c302ac9000/users/c4020cecd1174ff68101b6498780d00c/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:56.248637 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b31a0c-8013-4e63-b5a1-ba6bf5fafa6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b6232491b674705b2c339c302ac9000, user_id=c4020cecd1174ff68101b6498780d00c, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:56.251924 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b31a0c-8013-4e63-b5a1-ba6bf5fafa6b admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:56.300031 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2009/4043] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:23:56 2022] POST /identity/v3/projects => generated 369 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:23:56.301303 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef10502f-e112-4365-bd89-0506d533ec9d admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:56.330500 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2035/4044] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:23:56 2022] PUT /identity/v3/projects/9b6232491b674705b2c339c302ac9000/users/c4020cecd1174ff68101b6498780d00c/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:56.339679 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d4129-b753-405f-a588-4f2a9c90d0ef None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:56.341072 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d4129-b753-405f-a588-4f2a9c90d0ef None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:56.341367 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d4129-b753-405f-a588-4f2a9c90d0ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:56.384816 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-5f3d4129-b753-405f-a588-4f2a9c90d0ef None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:23:56.391574 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-5f3d4129-b753-405f-a588-4f2a9c90d0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:56.442412 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef10502f-e112-4365-bd89-0506d533ec9d admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:56.504754 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2036/4045] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:23:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:23:56.521271 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3d4129-b753-405f-a588-4f2a9c90d0ef None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:56.524043 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-5f3d4129-b753-405f-a588-4f2a9c90d0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:56.584103 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beed216-eb87-4a04-b792-ca4af6789996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:56.584797 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beed216-eb87-4a04-b792-ca4af6789996 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:56.586323 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beed216-eb87-4a04-b792-ca4af6789996 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:56.586323 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beed216-eb87-4a04-b792-ca4af6789996 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:56.586323 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beed216-eb87-4a04-b792-ca4af6789996 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:56.588116 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beed216-eb87-4a04-b792-ca4af6789996 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:56.618722 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3d4129-b753-405f-a588-4f2a9c90d0ef None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:56.622956 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9370a7bf-b6fe-46c0-bc2b-3414066c39d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:56.623730 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370a7bf-b6fe-46c0-bc2b-3414066c39d7 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:56.624089 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370a7bf-b6fe-46c0-bc2b-3414066c39d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:56.624438 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370a7bf-b6fe-46c0-bc2b-3414066c39d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:56.634405 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9370a7bf-b6fe-46c0-bc2b-3414066c39d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:56.636223 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9370a7bf-b6fe-46c0-bc2b-3414066c39d7 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:56.649736 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2037/4046] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:23:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:23:56.682400 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2010/4047] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:23:56 2022] POST /identity/v3/users => generated 285 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:23:56.686935 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9370a7bf-b6fe-46c0-bc2b-3414066c39d7 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:56.697616 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9370a7bf-b6fe-46c0-bc2b-3414066c39d7 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:56.704864 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a838eb4-d397-4b4d-85bd-699b7cb77563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:56.705641 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a838eb4-d397-4b4d-85bd-699b7cb77563 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:56.706001 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a838eb4-d397-4b4d-85bd-699b7cb77563 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:56.706408 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a838eb4-d397-4b4d-85bd-699b7cb77563 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:56.707291 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a838eb4-d397-4b4d-85bd-699b7cb77563 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:56.713081 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a838eb4-d397-4b4d-85bd-699b7cb77563 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:56.725166 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2038/4048] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:23:56 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:23:56.729246 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beed216-eb87-4a04-b792-ca4af6789996 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:56.741907 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beed216-eb87-4a04-b792-ca4af6789996 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:56.747585 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34b9714-e74b-47c5-bee6-0a7660295524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:56.748427 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b9714-e74b-47c5-bee6-0a7660295524 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:56.748785 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b9714-e74b-47c5-bee6-0a7660295524 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:56.749133 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b9714-e74b-47c5-bee6-0a7660295524 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:56.749930 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34b9714-e74b-47c5-bee6-0a7660295524 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:56.752532 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34b9714-e74b-47c5-bee6-0a7660295524 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:56.771533 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2011/4049] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:23:56 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:23:56.772839 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a838eb4-d397-4b4d-85bd-699b7cb77563 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:56.784939 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a838eb4-d397-4b4d-85bd-699b7cb77563 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:56.797331 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3b03e7-852d-4703-b25d-0694c8919f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:56.798227 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b03e7-852d-4703-b25d-0694c8919f1c admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:56.798523 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b03e7-852d-4703-b25d-0694c8919f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:56.798791 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b03e7-852d-4703-b25d-0694c8919f1c admin admin] PATH_INFO: `/v3/projects/1cdddc5b140348c1adb061d3e1960ee0/users/91211bd194d9441ca3b85918a8bacbd9/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:56.814713 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3b03e7-852d-4703-b25d-0694c8919f1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cdddc5b140348c1adb061d3e1960ee0, user_id=91211bd194d9441ca3b85918a8bacbd9, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:56.818087 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3b03e7-852d-4703-b25d-0694c8919f1c admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:56.870182 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2039/4050] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:23:56 2022] PUT /identity/v3/projects/1cdddc5b140348c1adb061d3e1960ee0/users/91211bd194d9441ca3b85918a8bacbd9/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:56.883120 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d204f868-ea0b-4b50-8ee8-9a95695576e3 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:56.883414 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d204f868-ea0b-4b50-8ee8-9a95695576e3 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:56.884458 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d204f868-ea0b-4b50-8ee8-9a95695576e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:56.961196 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-d204f868-ea0b-4b50-8ee8-9a95695576e3 None None] MFA Rules not processed for user `91211bd194d9441ca3b85918a8bacbd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:23:56.962535 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-d204f868-ea0b-4b50-8ee8-9a95695576e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:57.071680 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2012/4051] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:23:56 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:23:57.074856 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3b03e7-852d-4703-b25d-0694c8919f1c admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:57.122859 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3b03e7-852d-4703-b25d-0694c8919f1c admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:57.127989 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b006302d-ed02-43ed-89b2-ce1ad692fd1a tempest-TestApiDiscovery-1976703847 tempest-TestApiDiscovery-1976703847-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91211bd194d9441ca3b85918a8bacbd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cdddc5b140348c1adb061d3e1960ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:57.128832 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006302d-ed02-43ed-89b2-ce1ad692fd1a tempest-TestApiDiscovery-1976703847 tempest-TestApiDiscovery-1976703847-project] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:57.129124 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006302d-ed02-43ed-89b2-ce1ad692fd1a tempest-TestApiDiscovery-1976703847 tempest-TestApiDiscovery-1976703847-project] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:57.129410 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006302d-ed02-43ed-89b2-ce1ad692fd1a tempest-TestApiDiscovery-1976703847 tempest-TestApiDiscovery-1976703847-project] PATH_INFO: `/v3` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:57.130781 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2040/4052] 10.222.0.52 () {58 vars in 1103 bytes} [Sat May 14 21:23:57 2022] GET /identity/v3 => generated 255 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:23:57.136211 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d204f868-ea0b-4b50-8ee8-9a95695576e3 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:57.147381 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d204f868-ea0b-4b50-8ee8-9a95695576e3 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:57.154644 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e500b714-1874-46dc-9364-7a06cc3d313b tempest-TestApiDiscovery-1976703847 tempest-TestApiDiscovery-1976703847-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91211bd194d9441ca3b85918a8bacbd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cdddc5b140348c1adb061d3e1960ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:57.156101 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e500b714-1874-46dc-9364-7a06cc3d313b tempest-TestApiDiscovery-1976703847 tempest-TestApiDiscovery-1976703847-project] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:57.159461 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e500b714-1874-46dc-9364-7a06cc3d313b tempest-TestApiDiscovery-1976703847 tempest-TestApiDiscovery-1976703847-project] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:57.160026 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e500b714-1874-46dc-9364-7a06cc3d313b tempest-TestApiDiscovery-1976703847 tempest-TestApiDiscovery-1976703847-project] PATH_INFO: `/v3` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:57.169890 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b006302d-ed02-43ed-89b2-ce1ad692fd1a tempest-TestApiDiscovery-1976703847 tempest-TestApiDiscovery-1976703847-project] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:57.173072 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2013/4053] 10.222.0.52 () {58 vars in 1103 bytes} [Sat May 14 21:23:57 2022] GET /identity/v3 => generated 255 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:23:57.180589 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b006302d-ed02-43ed-89b2-ce1ad692fd1a tempest-TestApiDiscovery-1976703847 tempest-TestApiDiscovery-1976703847-project] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:57.187548 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9d642d-7171-4a84-9948-63d81874f02d tempest-TestApiDiscovery-1976703847 tempest-TestApiDiscovery-1976703847-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91211bd194d9441ca3b85918a8bacbd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cdddc5b140348c1adb061d3e1960ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:57.188537 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d642d-7171-4a84-9948-63d81874f02d tempest-TestApiDiscovery-1976703847 tempest-TestApiDiscovery-1976703847-project] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:57.188537 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d642d-7171-4a84-9948-63d81874f02d tempest-TestApiDiscovery-1976703847 tempest-TestApiDiscovery-1976703847-project] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:57.188963 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d642d-7171-4a84-9948-63d81874f02d tempest-TestApiDiscovery-1976703847 tempest-TestApiDiscovery-1976703847-project] PATH_INFO: `/v3` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:57.191608 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2041/4054] 10.222.0.52 () {58 vars in 1103 bytes} [Sat May 14 21:23:57 2022] GET /identity/v3 => generated 255 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:23:57.197225 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd80b11-0417-4414-92af-25b5989dfc98 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:57.197702 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd80b11-0417-4414-92af-25b5989dfc98 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:57.198113 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd80b11-0417-4414-92af-25b5989dfc98 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:57.201235 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2014/4055] 10.222.0.52 () {56 vars in 894 bytes} [Sat May 14 21:23:57 2022] GET /identity/ => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:23:57.206467 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb5cdb2-e3ca-40b7-8019-212a67fe13ec None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:57.206954 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb5cdb2-e3ca-40b7-8019-212a67fe13ec None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:57.207239 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb5cdb2-e3ca-40b7-8019-212a67fe13ec None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:57.212385 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2042/4056] 10.222.0.52 () {56 vars in 894 bytes} [Sat May 14 21:23:57 2022] GET /identity/ => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:23:57.213521 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd80b11-0417-4414-92af-25b5989dfc98 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:57.298571 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd80b11-0417-4414-92af-25b5989dfc98 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:57.305517 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db8b087-79c0-4323-8aaa-e359e89da0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:57.306758 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db8b087-79c0-4323-8aaa-e359e89da0db admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:57.307144 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db8b087-79c0-4323-8aaa-e359e89da0db admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:57.307564 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db8b087-79c0-4323-8aaa-e359e89da0db admin admin] PATH_INFO: `/v3/users/91211bd194d9441ca3b85918a8bacbd9` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:57.309483 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db8b087-79c0-4323-8aaa-e359e89da0db admin admin] RBAC: Authorizing `identity:delete_user(user_id=91211bd194d9441ca3b85918a8bacbd9)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:57.314916 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db8b087-79c0-4323-8aaa-e359e89da0db admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:57.608533 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3db8b087-79c0-4323-8aaa-e359e89da0db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91211bd194d9441ca3b85918a8bacbd9'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:57.615325 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3db8b087-79c0-4323-8aaa-e359e89da0db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91211bd194d9441ca3b85918a8bacbd9'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:57.616104 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3db8b087-79c0-4323-8aaa-e359e89da0db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91211bd194d9441ca3b85918a8bacbd9'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:57.750243 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3db8b087-79c0-4323-8aaa-e359e89da0db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91211bd194d9441ca3b85918a8bacbd9'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:57.774833 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3db8b087-79c0-4323-8aaa-e359e89da0db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91211bd194d9441ca3b85918a8bacbd9'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:57.784598 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2015/4057] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:23:57 2022] DELETE /identity/v3/users/91211bd194d9441ca3b85918a8bacbd9 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:57.788945 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eafe3f5-fc24-41d7-9a72-36aabe75dcef None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:57.800636 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eafe3f5-fc24-41d7-9a72-36aabe75dcef None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:57.800636 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eafe3f5-fc24-41d7-9a72-36aabe75dcef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:57.812402 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-7eafe3f5-fc24-41d7-9a72-36aabe75dcef None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:23:57.813715 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-7eafe3f5-fc24-41d7-9a72-36aabe75dcef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:57.899320 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2043/4058] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:23:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:23:57.948272 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db8b087-79c0-4323-8aaa-e359e89da0db admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:57.952105 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-3db8b087-79c0-4323-8aaa-e359e89da0db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:58.048401 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db8b087-79c0-4323-8aaa-e359e89da0db admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:58.052912 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f1dbec-ebbf-44be-bb8f-ce4f58a9aa2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:58.053775 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1dbec-ebbf-44be-bb8f-ce4f58a9aa2f service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:58.054061 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1dbec-ebbf-44be-bb8f-ce4f58a9aa2f service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:58.054343 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1dbec-ebbf-44be-bb8f-ce4f58a9aa2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:58.065748 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f1dbec-ebbf-44be-bb8f-ce4f58a9aa2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:58.067302 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f1dbec-ebbf-44be-bb8f-ce4f58a9aa2f service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:58.078509 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2016/4059] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:23:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:23:59.309290 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eafe3f5-fc24-41d7-9a72-36aabe75dcef None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:59.310814 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-7eafe3f5-fc24-41d7-9a72-36aabe75dcef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:59.334753 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eafe3f5-fc24-41d7-9a72-36aabe75dcef None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:59.348241 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9bf58b-9b8d-48bf-91eb-a4e9e60f0a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:59.349465 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9bf58b-9b8d-48bf-91eb-a4e9e60f0a72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:59.349911 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9bf58b-9b8d-48bf-91eb-a4e9e60f0a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:59.351723 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9bf58b-9b8d-48bf-91eb-a4e9e60f0a72 admin admin] PATH_INFO: `/v3/projects/1cdddc5b140348c1adb061d3e1960ee0` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:59.353469 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9bf58b-9b8d-48bf-91eb-a4e9e60f0a72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cdddc5b140348c1adb061d3e1960ee0)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:59.358158 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9bf58b-9b8d-48bf-91eb-a4e9e60f0a72 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:59.400604 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a4c52-38da-4832-b060-a49d1795482f None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:59.401583 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a4c52-38da-4832-b060-a49d1795482f None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:59.402603 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a4c52-38da-4832-b060-a49d1795482f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:59.440253 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-db0a4c52-38da-4832-b060-a49d1795482f None None] MFA Rules not processed for user `c4020cecd1174ff68101b6498780d00c`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:23:59.442611 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-db0a4c52-38da-4832-b060-a49d1795482f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:59.530588 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ac9bf58b-9b8d-48bf-91eb-a4e9e60f0a72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cdddc5b140348c1adb061d3e1960ee0', 'request_id': 'req-ac9bf58b-9b8d-48bf-91eb-a4e9e60f0a72'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:59.537248 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ac9bf58b-9b8d-48bf-91eb-a4e9e60f0a72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cdddc5b140348c1adb061d3e1960ee0', 'request_id': 'req-ac9bf58b-9b8d-48bf-91eb-a4e9e60f0a72'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:59.542801 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2017/4060] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:23:59 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:23:59.553112 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a2969-b5d8-430a-962a-44fbaa7dc569 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:59.553477 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a2969-b5d8-430a-962a-44fbaa7dc569 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:59.553818 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a2969-b5d8-430a-962a-44fbaa7dc569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:59.572293 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-858a2969-b5d8-430a-962a-44fbaa7dc569 None None] MFA Rules not processed for user `c4020cecd1174ff68101b6498780d00c`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:23:59.573591 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-858a2969-b5d8-430a-962a-44fbaa7dc569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:59.664423 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2018/4061] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:23:59 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:23:59.664423 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858a2969-b5d8-430a-962a-44fbaa7dc569 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:59.664423 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-858a2969-b5d8-430a-962a-44fbaa7dc569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:59.732991 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ac9bf58b-9b8d-48bf-91eb-a4e9e60f0a72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cdddc5b140348c1adb061d3e1960ee0', 'request_id': 'req-ac9bf58b-9b8d-48bf-91eb-a4e9e60f0a72'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:59.755098 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ac9bf58b-9b8d-48bf-91eb-a4e9e60f0a72 admin admin] The token cache is being invalidate because project 1cdddc5b140348c1adb061d3e1960ee0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:23:59.755774 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ac9bf58b-9b8d-48bf-91eb-a4e9e60f0a72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:59.757123 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ac9bf58b-9b8d-48bf-91eb-a4e9e60f0a72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:23:59.759414 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858a2969-b5d8-430a-962a-44fbaa7dc569 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:59.764895 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2044/4062] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:23:59 2022] DELETE /identity/v3/projects/1cdddc5b140348c1adb061d3e1960ee0 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:23:59.769223 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9bf58b-9b8d-48bf-91eb-a4e9e60f0a72 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:23:59.770145 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768af348-8fc5-4a2d-9757-0c7c772d579c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:59.771936 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768af348-8fc5-4a2d-9757-0c7c772d579c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:59.773551 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ac9bf58b-9b8d-48bf-91eb-a4e9e60f0a72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:59.775288 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768af348-8fc5-4a2d-9757-0c7c772d579c admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:59.775833 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768af348-8fc5-4a2d-9757-0c7c772d579c admin admin] PATH_INFO: `/v3/users/00d9c6a6abe64522aca4b9a4f09f4258` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:59.778630 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768af348-8fc5-4a2d-9757-0c7c772d579c admin admin] RBAC: Authorizing `identity:delete_user(user_id=00d9c6a6abe64522aca4b9a4f09f4258)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:59.780618 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768af348-8fc5-4a2d-9757-0c7c772d579c admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:59.863090 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9bf58b-9b8d-48bf-91eb-a4e9e60f0a72 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:23:59.870512 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba04d2ec-2e76-453a-aaab-7b4f46d6b813 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:23:59.871517 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04d2ec-2e76-453a-aaab-7b4f46d6b813 service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:59.871991 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04d2ec-2e76-453a-aaab-7b4f46d6b813 service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:59.872440 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04d2ec-2e76-453a-aaab-7b4f46d6b813 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:59.875973 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ba04d2ec-2e76-453a-aaab-7b4f46d6b813 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:59.890653 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba04d2ec-2e76-453a-aaab-7b4f46d6b813 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:23:59.893066 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba04d2ec-2e76-453a-aaab-7b4f46d6b813 service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:23:59.906676 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2045/4063] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:23:59 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:23:59.908531 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df9e71-f2b6-4cfb-9a3f-db9087b161f3 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:59.908981 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df9e71-f2b6-4cfb-9a3f-db9087b161f3 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:59.909415 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df9e71-f2b6-4cfb-9a3f-db9087b161f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:59.941281 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-d2df9e71-f2b6-4cfb-9a3f-db9087b161f3 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:23:59.944208 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d2df9e71-f2b6-4cfb-9a3f-db9087b161f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:23:59.954597 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2046/4064] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:23:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:23:59.964515 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da7e32-c0cb-4fb2-ae28-81ffb34df101 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:23:59.965144 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da7e32-c0cb-4fb2-ae28-81ffb34df101 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:23:59.965667 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da7e32-c0cb-4fb2-ae28-81ffb34df101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:23:59.986254 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-44da7e32-c0cb-4fb2-ae28-81ffb34df101 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:23:59.987603 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-44da7e32-c0cb-4fb2-ae28-81ffb34df101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:00.001985 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2047/4065] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:23:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:24:00.004116 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da7e32-c0cb-4fb2-ae28-81ffb34df101 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:00.018281 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da7e32-c0cb-4fb2-ae28-81ffb34df101 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:00.027357 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af1b1ac-969f-4175-b2b8-73ff6fcf4ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:00.028483 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af1b1ac-969f-4175-b2b8-73ff6fcf4ddf admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:00.029094 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af1b1ac-969f-4175-b2b8-73ff6fcf4ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:00.030237 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af1b1ac-969f-4175-b2b8-73ff6fcf4ddf admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:00.031364 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af1b1ac-969f-4175-b2b8-73ff6fcf4ddf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:24:00.031873 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af1b1ac-969f-4175-b2b8-73ff6fcf4ddf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:00.034893 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af1b1ac-969f-4175-b2b8-73ff6fcf4ddf admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:00.063140 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2048/4066] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:24:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:24:00.064336 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af1b1ac-969f-4175-b2b8-73ff6fcf4ddf admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:00.101951 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af1b1ac-969f-4175-b2b8-73ff6fcf4ddf admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:00.115333 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e0649c-ebf4-4154-9488-8fba9660d568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:00.116235 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0649c-ebf4-4154-9488-8fba9660d568 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:00.120697 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0649c-ebf4-4154-9488-8fba9660d568 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:00.120697 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0649c-ebf4-4154-9488-8fba9660d568 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:00.120697 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e0649c-ebf4-4154-9488-8fba9660d568 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:00.120697 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e0649c-ebf4-4154-9488-8fba9660d568 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:00.138488 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-768af348-8fc5-4a2d-9757-0c7c772d579c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00d9c6a6abe64522aca4b9a4f09f4258'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:00.162368 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-768af348-8fc5-4a2d-9757-0c7c772d579c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00d9c6a6abe64522aca4b9a4f09f4258'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:00.163410 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-768af348-8fc5-4a2d-9757-0c7c772d579c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00d9c6a6abe64522aca4b9a4f09f4258'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:00.234415 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2049/4067] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:24:00 2022] POST /identity/v3/projects => generated 397 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:24:00.235868 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e0649c-ebf4-4154-9488-8fba9660d568 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:00.280618 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-768af348-8fc5-4a2d-9757-0c7c772d579c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00d9c6a6abe64522aca4b9a4f09f4258'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:00.295404 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-768af348-8fc5-4a2d-9757-0c7c772d579c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00d9c6a6abe64522aca4b9a4f09f4258'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:00.303606 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2019/4068] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:23:59 2022] DELETE /identity/v3/users/00d9c6a6abe64522aca4b9a4f09f4258 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:24:00.333511 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e0649c-ebf4-4154-9488-8fba9660d568 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:00.412535 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f951c79e-995c-415a-86db-7d8f8ecf322c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:00.413448 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951c79e-995c-415a-86db-7d8f8ecf322c admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:00.413956 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951c79e-995c-415a-86db-7d8f8ecf322c admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:00.420816 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951c79e-995c-415a-86db-7d8f8ecf322c admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:00.421416 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f951c79e-995c-415a-86db-7d8f8ecf322c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:00.423680 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f951c79e-995c-415a-86db-7d8f8ecf322c admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:00.531829 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2050/4069] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:24:00 2022] POST /identity/v3/users => generated 305 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:24:00.532581 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768af348-8fc5-4a2d-9757-0c7c772d579c admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:00.534151 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-768af348-8fc5-4a2d-9757-0c7c772d579c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:00.556880 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768af348-8fc5-4a2d-9757-0c7c772d579c admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:00.567854 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8bcb03-6838-4ba6-bf81-c944a6e9f294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:00.568553 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8bcb03-6838-4ba6-bf81-c944a6e9f294 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:00.568844 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8bcb03-6838-4ba6-bf81-c944a6e9f294 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:00.569122 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8bcb03-6838-4ba6-bf81-c944a6e9f294 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:00.569858 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8bcb03-6838-4ba6-bf81-c944a6e9f294 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:00.571501 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8bcb03-6838-4ba6-bf81-c944a6e9f294 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:00.601098 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2020/4070] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:24:00 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:24:00.602320 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f951c79e-995c-415a-86db-7d8f8ecf322c admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:00.618103 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f951c79e-995c-415a-86db-7d8f8ecf322c admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:00.633903 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e667402-dd53-494b-8526-11fc4d7bca05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:00.634891 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e667402-dd53-494b-8526-11fc4d7bca05 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:00.635177 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e667402-dd53-494b-8526-11fc4d7bca05 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:00.635453 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e667402-dd53-494b-8526-11fc4d7bca05 admin admin] PATH_INFO: `/v3/projects/e42139e85af94363b5c5cc3f0b297b87/users/7e7fccd7b0a04a8196af6d94d7ed8aa4/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:00.667383 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e667402-dd53-494b-8526-11fc4d7bca05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e42139e85af94363b5c5cc3f0b297b87, user_id=7e7fccd7b0a04a8196af6d94d7ed8aa4, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:00.675652 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e667402-dd53-494b-8526-11fc4d7bca05 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:00.787890 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2051/4071] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:24:00 2022] PUT /identity/v3/projects/e42139e85af94363b5c5cc3f0b297b87/users/7e7fccd7b0a04a8196af6d94d7ed8aa4/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:24:00.790494 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8bcb03-6838-4ba6-bf81-c944a6e9f294 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:00.802379 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8bcb03-6838-4ba6-bf81-c944a6e9f294 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:00.826472 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e667402-dd53-494b-8526-11fc4d7bca05 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:00.829050 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-0e667402-dd53-494b-8526-11fc4d7bca05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:00.914845 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4255fe0-4754-4c0a-8a77-7012cf6520b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:00.921737 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4255fe0-4754-4c0a-8a77-7012cf6520b0 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:00.922160 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4255fe0-4754-4c0a-8a77-7012cf6520b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:00.922486 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4255fe0-4754-4c0a-8a77-7012cf6520b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:00.923246 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4255fe0-4754-4c0a-8a77-7012cf6520b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:00.925452 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4255fe0-4754-4c0a-8a77-7012cf6520b0 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:00.955257 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2021/4072] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:24:00 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:24:00.956640 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4255fe0-4754-4c0a-8a77-7012cf6520b0 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:00.974406 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4255fe0-4754-4c0a-8a77-7012cf6520b0 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:00.983024 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f1c19e-76f8-4abe-a08d-0226e0b24208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:00.983991 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1c19e-76f8-4abe-a08d-0226e0b24208 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:00.984280 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1c19e-76f8-4abe-a08d-0226e0b24208 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:00.984560 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1c19e-76f8-4abe-a08d-0226e0b24208 admin admin] PATH_INFO: `/v3/projects/e42139e85af94363b5c5cc3f0b297b87/users/7e7fccd7b0a04a8196af6d94d7ed8aa4/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:00.987003 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f1c19e-76f8-4abe-a08d-0226e0b24208 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e42139e85af94363b5c5cc3f0b297b87, user_id=7e7fccd7b0a04a8196af6d94d7ed8aa4, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:00.989840 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f1c19e-76f8-4abe-a08d-0226e0b24208 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:00.990190 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e667402-dd53-494b-8526-11fc4d7bca05 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:00.998856 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cce4101-8785-4a76-a159-6eff7a47697b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:01.000600 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce4101-8785-4a76-a159-6eff7a47697b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:01.001042 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce4101-8785-4a76-a159-6eff7a47697b admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:01.001582 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce4101-8785-4a76-a159-6eff7a47697b admin admin] PATH_INFO: `/v3/projects/48cdf3efbfbc43d7bdce5958fd2ad1a4` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:01.012198 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2022/4073] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:24:00 2022] PUT /identity/v3/projects/e42139e85af94363b5c5cc3f0b297b87/users/7e7fccd7b0a04a8196af6d94d7ed8aa4/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:24:01.012405 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cce4101-8785-4a76-a159-6eff7a47697b admin admin] RBAC: Authorizing `identity:delete_project(project_id=48cdf3efbfbc43d7bdce5958fd2ad1a4)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:01.012405 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cce4101-8785-4a76-a159-6eff7a47697b admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:01.013955 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e1a2d-5e6c-4e50-939e-9081e6d88b39 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:01.015575 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e1a2d-5e6c-4e50-939e-9081e6d88b39 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:01.015575 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e1a2d-5e6c-4e50-939e-9081e6d88b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:01.045924 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-4c3e1a2d-5e6c-4e50-939e-9081e6d88b39 None None] MFA Rules not processed for user `7e7fccd7b0a04a8196af6d94d7ed8aa4`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:24:01.047217 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-4c3e1a2d-5e6c-4e50-939e-9081e6d88b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:01.137188 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2023/4074] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:24:01 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:24:01.144522 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e1a2d-5e6c-4e50-939e-9081e6d88b39 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:01.175864 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6cce4101-8785-4a76-a159-6eff7a47697b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48cdf3efbfbc43d7bdce5958fd2ad1a4', 'request_id': 'req-6cce4101-8785-4a76-a159-6eff7a47697b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:01.185127 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6cce4101-8785-4a76-a159-6eff7a47697b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48cdf3efbfbc43d7bdce5958fd2ad1a4', 'request_id': 'req-6cce4101-8785-4a76-a159-6eff7a47697b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:01.235182 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e1a2d-5e6c-4e50-939e-9081e6d88b39 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:01.263216 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6cce4101-8785-4a76-a159-6eff7a47697b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48cdf3efbfbc43d7bdce5958fd2ad1a4', 'request_id': 'req-6cce4101-8785-4a76-a159-6eff7a47697b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:01.284491 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6cce4101-8785-4a76-a159-6eff7a47697b admin admin] The token cache is being invalidate because project 48cdf3efbfbc43d7bdce5958fd2ad1a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:24:01.284491 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6cce4101-8785-4a76-a159-6eff7a47697b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:01.288197 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6cce4101-8785-4a76-a159-6eff7a47697b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:01.294597 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2052/4075] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:24:00 2022] DELETE /identity/v3/projects/48cdf3efbfbc43d7bdce5958fd2ad1a4 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:24:01.302322 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85feca0d-8934-427b-bad3-8930ce77bd5d None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:01.304363 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85feca0d-8934-427b-bad3-8930ce77bd5d None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:01.305737 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85feca0d-8934-427b-bad3-8930ce77bd5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:01.336552 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-85feca0d-8934-427b-bad3-8930ce77bd5d None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:24:01.338673 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-85feca0d-8934-427b-bad3-8930ce77bd5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:01.344949 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7d35f6-37bd-433b-bf0f-6372faa7edf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:01.345538 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d35f6-37bd-433b-bf0f-6372faa7edf0 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:01.346427 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d35f6-37bd-433b-bf0f-6372faa7edf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:01.346716 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d35f6-37bd-433b-bf0f-6372faa7edf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:01.349574 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7d35f6-37bd-433b-bf0f-6372faa7edf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:01.350802 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2053/4076] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:24:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:24:01.354000 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7d35f6-37bd-433b-bf0f-6372faa7edf0 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:01.361045 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d13d7-b171-4805-91c1-ddba2fd2f1c8 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:01.361722 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d13d7-b171-4805-91c1-ddba2fd2f1c8 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:01.362103 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d13d7-b171-4805-91c1-ddba2fd2f1c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:01.398587 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-2c7d13d7-b171-4805-91c1-ddba2fd2f1c8 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:24:01.399845 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-2c7d13d7-b171-4805-91c1-ddba2fd2f1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:01.409329 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2054/4077] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:24:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:24:01.413117 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7d13d7-b171-4805-91c1-ddba2fd2f1c8 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:01.425517 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7d13d7-b171-4805-91c1-ddba2fd2f1c8 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:01.430966 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509a0c1f-acf4-4eb1-aef8-8b888b5f8470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:01.431830 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a0c1f-acf4-4eb1-aef8-8b888b5f8470 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:01.432119 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a0c1f-acf4-4eb1-aef8-8b888b5f8470 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:01.432400 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a0c1f-acf4-4eb1-aef8-8b888b5f8470 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:01.433136 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509a0c1f-acf4-4eb1-aef8-8b888b5f8470 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:24:01.433520 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509a0c1f-acf4-4eb1-aef8-8b888b5f8470 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:01.435580 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509a0c1f-acf4-4eb1-aef8-8b888b5f8470 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:01.452033 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2055/4078] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:24:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:24:01.458109 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509a0c1f-acf4-4eb1-aef8-8b888b5f8470 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:01.472548 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509a0c1f-acf4-4eb1-aef8-8b888b5f8470 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:01.478252 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc71197e-3861-461e-9d7b-d5d326b77359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:01.479119 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc71197e-3861-461e-9d7b-d5d326b77359 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:01.479629 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc71197e-3861-461e-9d7b-d5d326b77359 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:01.479957 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc71197e-3861-461e-9d7b-d5d326b77359 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:01.482179 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc71197e-3861-461e-9d7b-d5d326b77359 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:01.483848 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc71197e-3861-461e-9d7b-d5d326b77359 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:01.612434 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2024/4079] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:24:01 2022] POST /identity/v3/projects => generated 399 bytes in 471 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:24:01.613537 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7d35f6-37bd-433b-bf0f-6372faa7edf0 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:01.616581 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-bc7d35f6-37bd-433b-bf0f-6372faa7edf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:01.632145 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2056/4080] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:24:01 2022] POST /identity/v3/projects => generated 361 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:24:01.637557 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc71197e-3861-461e-9d7b-d5d326b77359 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:01.707318 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7d35f6-37bd-433b-bf0f-6372faa7edf0 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:01.763014 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc71197e-3861-461e-9d7b-d5d326b77359 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:01.768381 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7057d77e-e6fe-4570-af2e-d922487bc958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:01.769073 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7057d77e-e6fe-4570-af2e-d922487bc958 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:01.769362 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7057d77e-e6fe-4570-af2e-d922487bc958 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:01.769824 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7057d77e-e6fe-4570-af2e-d922487bc958 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:01.771236 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7057d77e-e6fe-4570-af2e-d922487bc958 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:01.774096 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7057d77e-e6fe-4570-af2e-d922487bc958 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:01.785223 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4d8f19-edc9-4b1d-b6dc-6390b36d5cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:01.786268 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4d8f19-edc9-4b1d-b6dc-6390b36d5cd5 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:01.786698 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4d8f19-edc9-4b1d-b6dc-6390b36d5cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:01.787241 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4d8f19-edc9-4b1d-b6dc-6390b36d5cd5 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:01.787796 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4d8f19-edc9-4b1d-b6dc-6390b36d5cd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:01.790277 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4d8f19-edc9-4b1d-b6dc-6390b36d5cd5 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:01.958910 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2057/4081] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:24:01 2022] POST /identity/v3/users => generated 281 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:24:01.960231 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7057d77e-e6fe-4570-af2e-d922487bc958 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:01.963837 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2025/4082] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:24:01 2022] POST /identity/v3/users => generated 300 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:24:01.966016 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4d8f19-edc9-4b1d-b6dc-6390b36d5cd5 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:01.972399 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7057d77e-e6fe-4570-af2e-d922487bc958 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:01.978719 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b0c8de-2175-4e5f-b323-311b2109a453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:01.979674 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b0c8de-2175-4e5f-b323-311b2109a453 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:01.979995 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b0c8de-2175-4e5f-b323-311b2109a453 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:01.981397 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b0c8de-2175-4e5f-b323-311b2109a453 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:01.982221 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b0c8de-2175-4e5f-b323-311b2109a453 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:01.984003 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b0c8de-2175-4e5f-b323-311b2109a453 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:01.988482 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4d8f19-edc9-4b1d-b6dc-6390b36d5cd5 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:01.997766 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa264ce7-2231-445e-8850-0c2a9cb5fdb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:01.998895 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa264ce7-2231-445e-8850-0c2a9cb5fdb5 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:02.004898 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2058/4083] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:24:01 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:24:02.005064 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa264ce7-2231-445e-8850-0c2a9cb5fdb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:02.005064 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa264ce7-2231-445e-8850-0c2a9cb5fdb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:02.005064 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa264ce7-2231-445e-8850-0c2a9cb5fdb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:02.005064 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa264ce7-2231-445e-8850-0c2a9cb5fdb5 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:02.005367 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b0c8de-2175-4e5f-b323-311b2109a453 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:02.014634 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b0c8de-2175-4e5f-b323-311b2109a453 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:02.017474 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2026/4084] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:24:01 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:24:02.020945 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3ab044-6378-4c0c-9550-0ea899a0db1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:02.021714 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa264ce7-2231-445e-8850-0c2a9cb5fdb5 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:02.028436 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ab044-6378-4c0c-9550-0ea899a0db1e admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:02.028436 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ab044-6378-4c0c-9550-0ea899a0db1e admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:02.028436 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ab044-6378-4c0c-9550-0ea899a0db1e admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:02.028436 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3ab044-6378-4c0c-9550-0ea899a0db1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:02.028436 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3ab044-6378-4c0c-9550-0ea899a0db1e admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:02.043582 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa264ce7-2231-445e-8850-0c2a9cb5fdb5 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:02.054179 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2059/4085] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:24:02 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:24:02.055445 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6579c6eb-8e17-4991-a472-26ae54bac78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:02.055641 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3ab044-6378-4c0c-9550-0ea899a0db1e admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:02.056165 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579c6eb-8e17-4991-a472-26ae54bac78f admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:02.056847 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579c6eb-8e17-4991-a472-26ae54bac78f admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:02.056847 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579c6eb-8e17-4991-a472-26ae54bac78f admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:02.057509 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6579c6eb-8e17-4991-a472-26ae54bac78f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:02.060460 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6579c6eb-8e17-4991-a472-26ae54bac78f admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:02.067980 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3ab044-6378-4c0c-9550-0ea899a0db1e admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:02.075124 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083ffefc-1211-4db4-acb3-2b047c001c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:02.076825 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ffefc-1211-4db4-acb3-2b047c001c99 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:02.077045 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ffefc-1211-4db4-acb3-2b047c001c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:02.077285 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ffefc-1211-4db4-acb3-2b047c001c99 admin admin] PATH_INFO: `/v3/projects/d321999c320f481398fe018d92e09e6c/users/94615a6b1610413d96cb13c46a19de68/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:02.087400 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2027/4086] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:24:02 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:24:02.088675 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6579c6eb-8e17-4991-a472-26ae54bac78f admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:02.103341 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6579c6eb-8e17-4991-a472-26ae54bac78f admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:02.109788 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6da2345-2043-463e-8bdc-e39308a6cea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:02.110692 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da2345-2043-463e-8bdc-e39308a6cea0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:02.110978 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da2345-2043-463e-8bdc-e39308a6cea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:02.111313 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da2345-2043-463e-8bdc-e39308a6cea0 admin admin] PATH_INFO: `/v3/projects/afb6c8f3d7414357bc178ffacaf9edf7/users/f75da825ae534ecb81121ca1561d2de1/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:02.112257 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083ffefc-1211-4db4-acb3-2b047c001c99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d321999c320f481398fe018d92e09e6c, user_id=94615a6b1610413d96cb13c46a19de68, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:02.116688 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083ffefc-1211-4db4-acb3-2b047c001c99 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:02.142489 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6da2345-2043-463e-8bdc-e39308a6cea0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afb6c8f3d7414357bc178ffacaf9edf7, user_id=f75da825ae534ecb81121ca1561d2de1, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:02.150127 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6da2345-2043-463e-8bdc-e39308a6cea0 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:02.259330 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2060/4087] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:24:02 2022] PUT /identity/v3/projects/d321999c320f481398fe018d92e09e6c/users/94615a6b1610413d96cb13c46a19de68/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:24:02.260863 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb83c8b7-2cfb-4970-b949-c1c75cb346c1 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:02.261157 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb83c8b7-2cfb-4970-b949-c1c75cb346c1 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:02.261475 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb83c8b7-2cfb-4970-b949-c1c75cb346c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:02.294489 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2028/4088] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:24:02 2022] PUT /identity/v3/projects/afb6c8f3d7414357bc178ffacaf9edf7/users/f75da825ae534ecb81121ca1561d2de1/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:24:02.298715 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-eb83c8b7-2cfb-4970-b949-c1c75cb346c1 None None] MFA Rules not processed for user `94615a6b1610413d96cb13c46a19de68`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:24:02.300164 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-eb83c8b7-2cfb-4970-b949-c1c75cb346c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:02.304422 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d01ec0-7a42-4117-b547-8a9ea442f5b5 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:02.304713 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d01ec0-7a42-4117-b547-8a9ea442f5b5 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:02.304994 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d01ec0-7a42-4117-b547-8a9ea442f5b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:02.367588 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-75d01ec0-7a42-4117-b547-8a9ea442f5b5 None None] MFA Rules not processed for user `f75da825ae534ecb81121ca1561d2de1`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:24:02.369191 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-75d01ec0-7a42-4117-b547-8a9ea442f5b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:02.435286 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2061/4089] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:24:02 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:24:02.457534 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb83c8b7-2cfb-4970-b949-c1c75cb346c1 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:02.461906 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-eb83c8b7-2cfb-4970-b949-c1c75cb346c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:02.516218 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2029/4090] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:24:02 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:24:02.651799 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb83c8b7-2cfb-4970-b949-c1c75cb346c1 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:02.662631 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231617d1-2fca-41aa-b7dd-8d012923c9dd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b5cb86f190f4fcfb06d66cb8f14643f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:02.663455 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231617d1-2fca-41aa-b7dd-8d012923c9dd service glance] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:02.663834 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231617d1-2fca-41aa-b7dd-8d012923c9dd service glance] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:02.664178 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231617d1-2fca-41aa-b7dd-8d012923c9dd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:02.668546 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-231617d1-2fca-41aa-b7dd-8d012923c9dd service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:02.790930 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231617d1-2fca-41aa-b7dd-8d012923c9dd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:02.794718 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231617d1-2fca-41aa-b7dd-8d012923c9dd service glance] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:02.809624 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2062/4091] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:24:02 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:24:03.151869 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d01ec0-7a42-4117-b547-8a9ea442f5b5 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:03.158067 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-75d01ec0-7a42-4117-b547-8a9ea442f5b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:03.263734 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d01ec0-7a42-4117-b547-8a9ea442f5b5 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:03.269449 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503afaac-65e6-471a-a8c3-afc271a59fab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:03.270102 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503afaac-65e6-471a-a8c3-afc271a59fab service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:03.270384 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503afaac-65e6-471a-a8c3-afc271a59fab service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:03.270664 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503afaac-65e6-471a-a8c3-afc271a59fab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:03.281593 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503afaac-65e6-471a-a8c3-afc271a59fab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:03.283800 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503afaac-65e6-471a-a8c3-afc271a59fab service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:03.299992 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2030/4092] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:24:03 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:24:03.345245 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231617d1-2fca-41aa-b7dd-8d012923c9dd service glance] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:03.449721 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231617d1-2fca-41aa-b7dd-8d012923c9dd service glance] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:03.455064 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd3c2b9-a868-44e0-aa1e-6ab50a5d8449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:03.455791 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3c2b9-a868-44e0-aa1e-6ab50a5d8449 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:03.456108 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3c2b9-a868-44e0-aa1e-6ab50a5d8449 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:03.456351 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3c2b9-a868-44e0-aa1e-6ab50a5d8449 admin admin] PATH_INFO: `/v3/users/f75da825ae534ecb81121ca1561d2de1` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:03.457723 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd3c2b9-a868-44e0-aa1e-6ab50a5d8449 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f75da825ae534ecb81121ca1561d2de1)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:03.460089 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd3c2b9-a868-44e0-aa1e-6ab50a5d8449 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:03.696304 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-abd3c2b9-a868-44e0-aa1e-6ab50a5d8449 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f75da825ae534ecb81121ca1561d2de1'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:03.743914 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-abd3c2b9-a868-44e0-aa1e-6ab50a5d8449 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f75da825ae534ecb81121ca1561d2de1'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:03.752827 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-abd3c2b9-a868-44e0-aa1e-6ab50a5d8449 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f75da825ae534ecb81121ca1561d2de1'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:03.845767 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-abd3c2b9-a868-44e0-aa1e-6ab50a5d8449 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f75da825ae534ecb81121ca1561d2de1'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:03.846824 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-abd3c2b9-a868-44e0-aa1e-6ab50a5d8449 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f75da825ae534ecb81121ca1561d2de1'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:03.859763 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2063/4093] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:24:03 2022] DELETE /identity/v3/users/f75da825ae534ecb81121ca1561d2de1 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:24:03.864236 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda25070-fa2b-4fe2-b227-313f2cc0086a None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:03.864529 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda25070-fa2b-4fe2-b227-313f2cc0086a None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:03.864813 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda25070-fa2b-4fe2-b227-313f2cc0086a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:03.909441 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-cda25070-fa2b-4fe2-b227-313f2cc0086a None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:24:03.912027 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-cda25070-fa2b-4fe2-b227-313f2cc0086a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:04.013363 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd3c2b9-a868-44e0-aa1e-6ab50a5d8449 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:04.015785 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-abd3c2b9-a868-44e0-aa1e-6ab50a5d8449 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:04.022060 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2031/4094] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:24:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:24:04.032347 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd3c2b9-a868-44e0-aa1e-6ab50a5d8449 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:04.038353 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f7ac52-95e7-4365-918c-abeaf9c3b06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:04.040216 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7ac52-95e7-4365-918c-abeaf9c3b06e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:04.040506 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7ac52-95e7-4365-918c-abeaf9c3b06e admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:04.040842 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7ac52-95e7-4365-918c-abeaf9c3b06e admin admin] PATH_INFO: `/v3/users/7e7fccd7b0a04a8196af6d94d7ed8aa4` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:04.043429 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f7ac52-95e7-4365-918c-abeaf9c3b06e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e7fccd7b0a04a8196af6d94d7ed8aa4)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:04.045438 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f7ac52-95e7-4365-918c-abeaf9c3b06e admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:04.069523 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda25070-fa2b-4fe2-b227-313f2cc0086a None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:04.072940 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-cda25070-fa2b-4fe2-b227-313f2cc0086a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:04.160340 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda25070-fa2b-4fe2-b227-313f2cc0086a None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:04.165262 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a292df55-7094-4b95-b6a3-2ba3dd0c23b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:04.172089 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a292df55-7094-4b95-b6a3-2ba3dd0c23b3 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:04.172089 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a292df55-7094-4b95-b6a3-2ba3dd0c23b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:04.172089 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a292df55-7094-4b95-b6a3-2ba3dd0c23b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:04.178462 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a292df55-7094-4b95-b6a3-2ba3dd0c23b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:04.180098 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a292df55-7094-4b95-b6a3-2ba3dd0c23b3 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:04.195025 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2032/4095] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:24:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:24:04.334373 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f6f7ac52-95e7-4365-918c-abeaf9c3b06e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e7fccd7b0a04a8196af6d94d7ed8aa4'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:04.379862 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f6f7ac52-95e7-4365-918c-abeaf9c3b06e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e7fccd7b0a04a8196af6d94d7ed8aa4'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:04.393598 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f6f7ac52-95e7-4365-918c-abeaf9c3b06e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e7fccd7b0a04a8196af6d94d7ed8aa4'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:04.494820 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f6f7ac52-95e7-4365-918c-abeaf9c3b06e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e7fccd7b0a04a8196af6d94d7ed8aa4'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:04.504549 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f6f7ac52-95e7-4365-918c-abeaf9c3b06e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e7fccd7b0a04a8196af6d94d7ed8aa4'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:04.523526 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2064/4096] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:24:04 2022] DELETE /identity/v3/users/7e7fccd7b0a04a8196af6d94d7ed8aa4 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:24:04.536940 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5973fa-1280-447e-b6c6-43b0be7c556c None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:04.537446 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5973fa-1280-447e-b6c6-43b0be7c556c None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:04.537949 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5973fa-1280-447e-b6c6-43b0be7c556c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:04.570169 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-8c5973fa-1280-447e-b6c6-43b0be7c556c None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:24:04.572015 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8c5973fa-1280-447e-b6c6-43b0be7c556c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:04.691736 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2033/4097] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:24:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:24:04.706271 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f7ac52-95e7-4365-918c-abeaf9c3b06e admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:04.708796 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-f6f7ac52-95e7-4365-918c-abeaf9c3b06e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:04.802918 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f7ac52-95e7-4365-918c-abeaf9c3b06e admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:04.807020 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb101c-de4d-412e-aeb0-d5ba0f30aa3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:04.809127 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb101c-de4d-412e-aeb0-d5ba0f30aa3c service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:04.809794 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb101c-de4d-412e-aeb0-d5ba0f30aa3c service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:04.810185 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb101c-de4d-412e-aeb0-d5ba0f30aa3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:04.822341 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eb101c-de4d-412e-aeb0-d5ba0f30aa3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:04.824493 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eb101c-de4d-412e-aeb0-d5ba0f30aa3c service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:04.842422 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2065/4098] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:24:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:24:05.510465 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5973fa-1280-447e-b6c6-43b0be7c556c None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:05.512348 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8c5973fa-1280-447e-b6c6-43b0be7c556c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:05.530040 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5973fa-1280-447e-b6c6-43b0be7c556c None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:05.535291 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8f195-140a-4467-b6f5-c8edb6c5b6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:05.536321 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8f195-140a-4467-b6f5-c8edb6c5b6a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:05.536703 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8f195-140a-4467-b6f5-c8edb6c5b6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:05.537077 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8f195-140a-4467-b6f5-c8edb6c5b6a2 admin admin] PATH_INFO: `/v3/projects/e42139e85af94363b5c5cc3f0b297b87` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:05.538920 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b8f195-140a-4467-b6f5-c8edb6c5b6a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e42139e85af94363b5c5cc3f0b297b87)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:05.542252 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b8f195-140a-4467-b6f5-c8edb6c5b6a2 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:05.679984 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-18b8f195-140a-4467-b6f5-c8edb6c5b6a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e42139e85af94363b5c5cc3f0b297b87', 'request_id': 'req-18b8f195-140a-4467-b6f5-c8edb6c5b6a2'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:05.687318 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-18b8f195-140a-4467-b6f5-c8edb6c5b6a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e42139e85af94363b5c5cc3f0b297b87', 'request_id': 'req-18b8f195-140a-4467-b6f5-c8edb6c5b6a2'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:05.695868 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-18b8f195-140a-4467-b6f5-c8edb6c5b6a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e42139e85af94363b5c5cc3f0b297b87', 'request_id': 'req-18b8f195-140a-4467-b6f5-c8edb6c5b6a2'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:05.869317 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-18b8f195-140a-4467-b6f5-c8edb6c5b6a2 admin admin] The token cache is being invalidate because project e42139e85af94363b5c5cc3f0b297b87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:24:05.869616 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-18b8f195-140a-4467-b6f5-c8edb6c5b6a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:05.870515 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-18b8f195-140a-4467-b6f5-c8edb6c5b6a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:05.873748 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2034/4099] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:24:05 2022] DELETE /identity/v3/projects/e42139e85af94363b5c5cc3f0b297b87 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:24:05.877901 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb101c-de4d-412e-aeb0-d5ba0f30aa3c service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:05.895830 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb101c-de4d-412e-aeb0-d5ba0f30aa3c service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:06.034041 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8f195-140a-4467-b6f5-c8edb6c5b6a2 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:06.036516 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-18b8f195-140a-4467-b6f5-c8edb6c5b6a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:06.041812 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c3ce5-3f49-4de2-9cc9-a634ab8d6cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:06.042837 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c3ce5-3f49-4de2-9cc9-a634ab8d6cc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:06.043394 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c3ce5-3f49-4de2-9cc9-a634ab8d6cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:06.043720 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c3ce5-3f49-4de2-9cc9-a634ab8d6cc1 admin admin] PATH_INFO: `/v3/users/94615a6b1610413d96cb13c46a19de68` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:06.045278 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041c3ce5-3f49-4de2-9cc9-a634ab8d6cc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94615a6b1610413d96cb13c46a19de68)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:06.049057 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041c3ce5-3f49-4de2-9cc9-a634ab8d6cc1 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:06.062440 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8f195-140a-4467-b6f5-c8edb6c5b6a2 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:06.076780 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e9031e-6908-42be-a251-948ecfd54cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:06.081544 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e9031e-6908-42be-a251-948ecfd54cd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:06.082361 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e9031e-6908-42be-a251-948ecfd54cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:06.083464 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e9031e-6908-42be-a251-948ecfd54cd6 admin admin] PATH_INFO: `/v3/projects/afb6c8f3d7414357bc178ffacaf9edf7` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:06.093681 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e9031e-6908-42be-a251-948ecfd54cd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afb6c8f3d7414357bc178ffacaf9edf7)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:06.093681 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e9031e-6908-42be-a251-948ecfd54cd6 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:06.397755 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-041c3ce5-3f49-4de2-9cc9-a634ab8d6cc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94615a6b1610413d96cb13c46a19de68'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:06.398037 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-43e9031e-6908-42be-a251-948ecfd54cd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afb6c8f3d7414357bc178ffacaf9edf7', 'request_id': 'req-43e9031e-6908-42be-a251-948ecfd54cd6'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:06.403739 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-43e9031e-6908-42be-a251-948ecfd54cd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afb6c8f3d7414357bc178ffacaf9edf7', 'request_id': 'req-43e9031e-6908-42be-a251-948ecfd54cd6'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:06.410170 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-43e9031e-6908-42be-a251-948ecfd54cd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afb6c8f3d7414357bc178ffacaf9edf7', 'request_id': 'req-43e9031e-6908-42be-a251-948ecfd54cd6'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:06.410340 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-041c3ce5-3f49-4de2-9cc9-a634ab8d6cc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94615a6b1610413d96cb13c46a19de68'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:06.422285 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-041c3ce5-3f49-4de2-9cc9-a634ab8d6cc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94615a6b1610413d96cb13c46a19de68'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:06.520007 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-43e9031e-6908-42be-a251-948ecfd54cd6 admin admin] The token cache is being invalidate because project afb6c8f3d7414357bc178ffacaf9edf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:24:06.522295 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-43e9031e-6908-42be-a251-948ecfd54cd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:06.523663 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-43e9031e-6908-42be-a251-948ecfd54cd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:06.525752 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2035/4100] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:24:06 2022] DELETE /identity/v3/projects/afb6c8f3d7414357bc178ffacaf9edf7 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:24:06.530693 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ce3ef-8034-48c9-8ba9-6b889fa093fe None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:06.531284 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ce3ef-8034-48c9-8ba9-6b889fa093fe None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:06.531590 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ce3ef-8034-48c9-8ba9-6b889fa093fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:06.554294 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-de2ce3ef-8034-48c9-8ba9-6b889fa093fe None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:24:06.556611 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-de2ce3ef-8034-48c9-8ba9-6b889fa093fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:06.594710 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-041c3ce5-3f49-4de2-9cc9-a634ab8d6cc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94615a6b1610413d96cb13c46a19de68'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:06.595354 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-041c3ce5-3f49-4de2-9cc9-a634ab8d6cc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94615a6b1610413d96cb13c46a19de68'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:06.602455 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2066/4101] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:24:05 2022] DELETE /identity/v3/users/94615a6b1610413d96cb13c46a19de68 => generated 0 bytes in 725 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:24:06.649191 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2036/4102] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:24:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:24:06.658214 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390af1e5-676d-4cb0-8d29-36f33a4f0548 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:06.658979 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390af1e5-676d-4cb0-8d29-36f33a4f0548 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:06.659436 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390af1e5-676d-4cb0-8d29-36f33a4f0548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:06.687518 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-390af1e5-676d-4cb0-8d29-36f33a4f0548 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:24:06.688857 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-390af1e5-676d-4cb0-8d29-36f33a4f0548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:06.787709 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2067/4103] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:24:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:24:06.790490 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2ce3ef-8034-48c9-8ba9-6b889fa093fe None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:06.810184 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2ce3ef-8034-48c9-8ba9-6b889fa093fe None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:06.816374 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffb47e6-8d8d-4667-b204-01124bc896a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:06.817132 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb47e6-8d8d-4667-b204-01124bc896a5 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:06.817477 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb47e6-8d8d-4667-b204-01124bc896a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:06.817847 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb47e6-8d8d-4667-b204-01124bc896a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:06.818640 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffb47e6-8d8d-4667-b204-01124bc896a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:24:06.819016 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffb47e6-8d8d-4667-b204-01124bc896a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:06.820772 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffb47e6-8d8d-4667-b204-01124bc896a5 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:06.842594 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2037/4104] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:24:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:24:06.843203 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390af1e5-676d-4cb0-8d29-36f33a4f0548 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:06.858916 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390af1e5-676d-4cb0-8d29-36f33a4f0548 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:06.868265 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e83a461-3713-490f-9109-76cc56fd8a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:06.868974 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e83a461-3713-490f-9109-76cc56fd8a13 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:06.869256 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e83a461-3713-490f-9109-76cc56fd8a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:06.869534 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e83a461-3713-490f-9109-76cc56fd8a13 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:06.870329 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e83a461-3713-490f-9109-76cc56fd8a13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:06.878609 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e83a461-3713-490f-9109-76cc56fd8a13 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:07.018549 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2068/4105] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:24:06 2022] POST /identity/v3/projects => generated 367 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:24:07.023022 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffb47e6-8d8d-4667-b204-01124bc896a5 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:07.037508 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffb47e6-8d8d-4667-b204-01124bc896a5 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:07.118172 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22635bd4-171b-4530-a13d-132ae39db7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:07.118839 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22635bd4-171b-4530-a13d-132ae39db7d3 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:07.119119 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22635bd4-171b-4530-a13d-132ae39db7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:07.119393 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22635bd4-171b-4530-a13d-132ae39db7d3 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:07.120119 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22635bd4-171b-4530-a13d-132ae39db7d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:07.122579 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22635bd4-171b-4530-a13d-132ae39db7d3 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:07.218451 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e83a461-3713-490f-9109-76cc56fd8a13 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:07.221182 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-5e83a461-3713-490f-9109-76cc56fd8a13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:07.243874 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e83a461-3713-490f-9109-76cc56fd8a13 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:07.251569 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2038/4106] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:24:07 2022] POST /identity/v3/users => generated 284 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:24:07.252664 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22635bd4-171b-4530-a13d-132ae39db7d3 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:07.265322 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ef0bac-de83-4a0d-8041-c3360436d40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:07.266694 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef0bac-de83-4a0d-8041-c3360436d40a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:07.266694 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef0bac-de83-4a0d-8041-c3360436d40a admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:07.266889 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef0bac-de83-4a0d-8041-c3360436d40a admin admin] PATH_INFO: `/v3/projects/d321999c320f481398fe018d92e09e6c` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:07.273176 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ef0bac-de83-4a0d-8041-c3360436d40a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d321999c320f481398fe018d92e09e6c)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:07.274809 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22635bd4-171b-4530-a13d-132ae39db7d3 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:07.276054 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ef0bac-de83-4a0d-8041-c3360436d40a admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:07.295205 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a5b165-6dcc-479a-b985-bfe554ba7698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:07.296112 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5b165-6dcc-479a-b985-bfe554ba7698 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:07.296361 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5b165-6dcc-479a-b985-bfe554ba7698 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:07.297051 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5b165-6dcc-479a-b985-bfe554ba7698 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:07.297922 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a5b165-6dcc-479a-b985-bfe554ba7698 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:07.301337 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a5b165-6dcc-479a-b985-bfe554ba7698 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:07.344633 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2039/4107] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:24:07 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:24:07.347189 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a5b165-6dcc-479a-b985-bfe554ba7698 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:07.361363 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a5b165-6dcc-479a-b985-bfe554ba7698 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:07.368351 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd16cdd-f7e3-452f-ac09-8cf3c7c655bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:07.369203 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd16cdd-f7e3-452f-ac09-8cf3c7c655bd admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:07.372475 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd16cdd-f7e3-452f-ac09-8cf3c7c655bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:07.372475 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd16cdd-f7e3-452f-ac09-8cf3c7c655bd admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:07.372475 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd16cdd-f7e3-452f-ac09-8cf3c7c655bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:07.374217 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd16cdd-f7e3-452f-ac09-8cf3c7c655bd admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:07.400937 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2040/4108] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:24:07 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:24:07.402394 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd16cdd-f7e3-452f-ac09-8cf3c7c655bd admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:07.422347 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd16cdd-f7e3-452f-ac09-8cf3c7c655bd admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:07.438603 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-77ef0bac-de83-4a0d-8041-c3360436d40a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd321999c320f481398fe018d92e09e6c', 'request_id': 'req-77ef0bac-de83-4a0d-8041-c3360436d40a'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:07.454105 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-77ef0bac-de83-4a0d-8041-c3360436d40a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd321999c320f481398fe018d92e09e6c', 'request_id': 'req-77ef0bac-de83-4a0d-8041-c3360436d40a'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:07.516819 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1532b59d-06de-47ae-9e02-de54de2f3c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:07.522223 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532b59d-06de-47ae-9e02-de54de2f3c07 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:07.522963 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532b59d-06de-47ae-9e02-de54de2f3c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:07.524211 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532b59d-06de-47ae-9e02-de54de2f3c07 admin admin] PATH_INFO: `/v3/projects/f2a1c19cad6047f09d1b74a2a607dd28/users/98b7bc6d0abe43a889cc29118685e8f4/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:07.550431 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1532b59d-06de-47ae-9e02-de54de2f3c07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2a1c19cad6047f09d1b74a2a607dd28, user_id=98b7bc6d0abe43a889cc29118685e8f4, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:07.554864 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1532b59d-06de-47ae-9e02-de54de2f3c07 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:07.565512 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-77ef0bac-de83-4a0d-8041-c3360436d40a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd321999c320f481398fe018d92e09e6c', 'request_id': 'req-77ef0bac-de83-4a0d-8041-c3360436d40a'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:07.582813 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-77ef0bac-de83-4a0d-8041-c3360436d40a admin admin] The token cache is being invalidate because project d321999c320f481398fe018d92e09e6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:24:07.583044 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-77ef0bac-de83-4a0d-8041-c3360436d40a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:07.584400 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-77ef0bac-de83-4a0d-8041-c3360436d40a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:07.590002 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2069/4109] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:24:07 2022] DELETE /identity/v3/projects/d321999c320f481398fe018d92e09e6c => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:24:07.592073 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d29f9-bb7f-4180-bba3-1360cb580786 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:07.592618 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d29f9-bb7f-4180-bba3-1360cb580786 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:07.592985 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d29f9-bb7f-4180-bba3-1360cb580786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:07.619328 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-109d29f9-bb7f-4180-bba3-1360cb580786 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:24:07.621406 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-109d29f9-bb7f-4180-bba3-1360cb580786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:07.633424 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2070/4110] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:24:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:24:07.642279 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b60c8c-bb8f-4b1d-931f-771e10f707c3 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:07.642638 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b60c8c-bb8f-4b1d-931f-771e10f707c3 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:07.642994 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b60c8c-bb8f-4b1d-931f-771e10f707c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:07.665615 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-47b60c8c-bb8f-4b1d-931f-771e10f707c3 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:24:07.667550 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-47b60c8c-bb8f-4b1d-931f-771e10f707c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:07.684558 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2071/4111] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:24:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:24:07.685442 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b60c8c-bb8f-4b1d-931f-771e10f707c3 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:07.699828 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2041/4112] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:24:07 2022] PUT /identity/v3/projects/f2a1c19cad6047f09d1b74a2a607dd28/users/98b7bc6d0abe43a889cc29118685e8f4/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:24:07.702203 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c7000-f99b-41bf-aaa4-5d3463f48a19 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:07.702403 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b60c8c-bb8f-4b1d-931f-771e10f707c3 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:07.704521 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c7000-f99b-41bf-aaa4-5d3463f48a19 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:07.706096 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c7000-f99b-41bf-aaa4-5d3463f48a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:07.752298 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-ec2c7000-f99b-41bf-aaa4-5d3463f48a19 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:24:07.759064 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-ec2c7000-f99b-41bf-aaa4-5d3463f48a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:07.794161 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaaed2a-37b8-482c-84e9-d7726fceaa63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:07.795958 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaaed2a-37b8-482c-84e9-d7726fceaa63 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:07.796512 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaaed2a-37b8-482c-84e9-d7726fceaa63 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:07.796949 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaaed2a-37b8-482c-84e9-d7726fceaa63 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:07.798257 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaaed2a-37b8-482c-84e9-d7726fceaa63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:24:07.801718 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaaed2a-37b8-482c-84e9-d7726fceaa63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:07.801718 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaaed2a-37b8-482c-84e9-d7726fceaa63 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:07.834614 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2072/4113] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:24:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:24:07.838924 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaaed2a-37b8-482c-84e9-d7726fceaa63 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:07.871622 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaaed2a-37b8-482c-84e9-d7726fceaa63 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:07.877505 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2042/4114] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:24:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:24:07.885178 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d3e258-9ff6-4326-b3be-39a86da36cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:07.887055 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3e258-9ff6-4326-b3be-39a86da36cde admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:07.888192 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3e258-9ff6-4326-b3be-39a86da36cde admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:07.888828 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3e258-9ff6-4326-b3be-39a86da36cde admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:07.900278 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d3e258-9ff6-4326-b3be-39a86da36cde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:07.904201 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c7000-f99b-41bf-aaa4-5d3463f48a19 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:07.906311 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-ec2c7000-f99b-41bf-aaa4-5d3463f48a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:07.908620 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d3e258-9ff6-4326-b3be-39a86da36cde admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:07.994089 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c7000-f99b-41bf-aaa4-5d3463f48a19 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:07.998801 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dc624c-810c-4b5c-88cf-c8fa23601e64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:08.000214 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc624c-810c-4b5c-88cf-c8fa23601e64 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:08.000684 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc624c-810c-4b5c-88cf-c8fa23601e64 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:08.001755 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc624c-810c-4b5c-88cf-c8fa23601e64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:08.016269 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dc624c-810c-4b5c-88cf-c8fa23601e64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:08.018087 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dc624c-810c-4b5c-88cf-c8fa23601e64 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:08.023057 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2073/4115] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:24:07 2022] POST /identity/v3/projects => generated 387 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:24:08.028326 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d3e258-9ff6-4326-b3be-39a86da36cde admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:08.042248 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2043/4116] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:24:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:24:08.105222 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d3e258-9ff6-4326-b3be-39a86da36cde admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:08.115449 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76b94b8-2a27-4b47-a82a-d4ec16b1157f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:08.116444 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b94b8-2a27-4b47-a82a-d4ec16b1157f admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:08.116891 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b94b8-2a27-4b47-a82a-d4ec16b1157f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:08.124660 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b94b8-2a27-4b47-a82a-d4ec16b1157f admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:08.124660 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76b94b8-2a27-4b47-a82a-d4ec16b1157f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:08.124660 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76b94b8-2a27-4b47-a82a-d4ec16b1157f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:08.209945 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2074/4117] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:24:08 2022] POST /identity/v3/users => generated 300 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:24:08.214618 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dc624c-810c-4b5c-88cf-c8fa23601e64 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:08.227298 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dc624c-810c-4b5c-88cf-c8fa23601e64 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:08.240319 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa86d0e-0183-48c0-b517-821a07762975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:08.241198 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa86d0e-0183-48c0-b517-821a07762975 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:08.241492 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa86d0e-0183-48c0-b517-821a07762975 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:08.241776 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa86d0e-0183-48c0-b517-821a07762975 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:08.243208 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa86d0e-0183-48c0-b517-821a07762975 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:08.246462 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa86d0e-0183-48c0-b517-821a07762975 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:08.265582 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76b94b8-2a27-4b47-a82a-d4ec16b1157f admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:08.266069 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2044/4118] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:24:08 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:24:08.277005 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76b94b8-2a27-4b47-a82a-d4ec16b1157f admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:08.284304 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc69befd-cbb2-4ecd-b20a-3866b314de46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:08.285465 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69befd-cbb2-4ecd-b20a-3866b314de46 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:08.286116 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69befd-cbb2-4ecd-b20a-3866b314de46 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:08.286289 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69befd-cbb2-4ecd-b20a-3866b314de46 admin admin] PATH_INFO: `/v3/projects/51d04918ea404cbcabc74350a7086926/users/ee158abd32574b76b3cfec15ea9ca671/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:08.306640 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc69befd-cbb2-4ecd-b20a-3866b314de46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51d04918ea404cbcabc74350a7086926, user_id=ee158abd32574b76b3cfec15ea9ca671, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:08.313816 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc69befd-cbb2-4ecd-b20a-3866b314de46 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:08.404820 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2075/4119] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:24:08 2022] PUT /identity/v3/projects/51d04918ea404cbcabc74350a7086926/users/ee158abd32574b76b3cfec15ea9ca671/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:24:08.410370 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa86d0e-0183-48c0-b517-821a07762975 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:08.422408 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa86d0e-0183-48c0-b517-821a07762975 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:08.566688 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ee782-599a-4db7-b4fd-50ffd45871b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:08.567395 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ee782-599a-4db7-b4fd-50ffd45871b5 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:08.569132 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ee782-599a-4db7-b4fd-50ffd45871b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:08.571731 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ee782-599a-4db7-b4fd-50ffd45871b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:08.573446 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0ee782-599a-4db7-b4fd-50ffd45871b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:08.578541 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0ee782-599a-4db7-b4fd-50ffd45871b5 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:08.600977 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2045/4120] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:24:08 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:24:08.606374 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc69befd-cbb2-4ecd-b20a-3866b314de46 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:08.621749 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc69befd-cbb2-4ecd-b20a-3866b314de46 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:08.629002 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f4f19c-398a-4776-8821-3028ece1ab1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:08.629924 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f4f19c-398a-4776-8821-3028ece1ab1e admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:08.630393 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f4f19c-398a-4776-8821-3028ece1ab1e admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:08.630784 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f4f19c-398a-4776-8821-3028ece1ab1e admin admin] PATH_INFO: `/v3/projects/51d04918ea404cbcabc74350a7086926/users/ee158abd32574b76b3cfec15ea9ca671/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:08.633535 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f4f19c-398a-4776-8821-3028ece1ab1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=51d04918ea404cbcabc74350a7086926, user_id=ee158abd32574b76b3cfec15ea9ca671, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:08.640625 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f4f19c-398a-4776-8821-3028ece1ab1e admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:08.668327 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2076/4121] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:24:08 2022] PUT /identity/v3/projects/51d04918ea404cbcabc74350a7086926/users/ee158abd32574b76b3cfec15ea9ca671/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:24:08.682295 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7fe72-39fa-4ef8-a42e-ee3be2799286 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:08.683164 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7fe72-39fa-4ef8-a42e-ee3be2799286 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:08.684017 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7fe72-39fa-4ef8-a42e-ee3be2799286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:08.729504 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-caa7fe72-39fa-4ef8-a42e-ee3be2799286 None None] MFA Rules not processed for user `ee158abd32574b76b3cfec15ea9ca671`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:24:08.731832 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-caa7fe72-39fa-4ef8-a42e-ee3be2799286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:08.847790 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2046/4122] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:24:08 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:24:08.852718 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f4f19c-398a-4776-8821-3028ece1ab1e admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:08.930250 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f4f19c-398a-4776-8821-3028ece1ab1e admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:08.940938 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4270b6-0fff-494f-8562-275f36c98d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:08.941994 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4270b6-0fff-494f-8562-275f36c98d31 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:08.942509 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4270b6-0fff-494f-8562-275f36c98d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:08.942999 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4270b6-0fff-494f-8562-275f36c98d31 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:08.944419 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4270b6-0fff-494f-8562-275f36c98d31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:08.946708 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4270b6-0fff-494f-8562-275f36c98d31 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:09.118726 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2077/4123] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:24:08 2022] POST /identity/v3/projects => generated 387 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:24:09.122781 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa7fe72-39fa-4ef8-a42e-ee3be2799286 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:09.139641 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa7fe72-39fa-4ef8-a42e-ee3be2799286 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:09.219298 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a122c3-1ddc-4303-9f82-f1a44a937500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:09.220271 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a122c3-1ddc-4303-9f82-f1a44a937500 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:09.221066 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a122c3-1ddc-4303-9f82-f1a44a937500 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:09.221506 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a122c3-1ddc-4303-9f82-f1a44a937500 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:09.222353 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a122c3-1ddc-4303-9f82-f1a44a937500 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:09.224839 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a122c3-1ddc-4303-9f82-f1a44a937500 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:09.395383 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2047/4124] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:24:09 2022] POST /identity/v3/users => generated 294 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:24:09.399594 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4270b6-0fff-494f-8562-275f36c98d31 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:09.416017 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4270b6-0fff-494f-8562-275f36c98d31 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:09.421008 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc60175d-db7a-4b13-be96-db8b798abe0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:09.422422 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc60175d-db7a-4b13-be96-db8b798abe0c admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:09.422422 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc60175d-db7a-4b13-be96-db8b798abe0c admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:09.422422 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc60175d-db7a-4b13-be96-db8b798abe0c admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:09.423211 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc60175d-db7a-4b13-be96-db8b798abe0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:09.424974 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc60175d-db7a-4b13-be96-db8b798abe0c admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:09.439014 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2078/4125] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:24:09 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:24:09.444702 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a122c3-1ddc-4303-9f82-f1a44a937500 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:09.456741 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a122c3-1ddc-4303-9f82-f1a44a937500 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:09.462819 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d180bd4a-157a-42e2-9707-af322df1253d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:09.463182 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d180bd4a-157a-42e2-9707-af322df1253d admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:09.463515 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d180bd4a-157a-42e2-9707-af322df1253d admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:09.466626 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d180bd4a-157a-42e2-9707-af322df1253d admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:09.466626 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d180bd4a-157a-42e2-9707-af322df1253d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:09.467134 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d180bd4a-157a-42e2-9707-af322df1253d admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:09.484269 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc60175d-db7a-4b13-be96-db8b798abe0c admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:09.487644 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2048/4126] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:24:09 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:24:09.496668 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc60175d-db7a-4b13-be96-db8b798abe0c admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:09.502034 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d548f-80b1-4628-9423-1f69e199eaea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:09.502930 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d548f-80b1-4628-9423-1f69e199eaea admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:09.503879 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d548f-80b1-4628-9423-1f69e199eaea admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:09.503879 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d548f-80b1-4628-9423-1f69e199eaea admin admin] PATH_INFO: `/v3/projects/a17aec51392c4459aec1d60b8bd99a66/users/d6fdc1d6454a48fbaa3f4e7d5520e9bf/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:09.522277 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859d548f-80b1-4628-9423-1f69e199eaea admin admin] RBAC: Authorizing `identity:create_grant(project_id=a17aec51392c4459aec1d60b8bd99a66, user_id=d6fdc1d6454a48fbaa3f4e7d5520e9bf, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:09.525115 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859d548f-80b1-4628-9423-1f69e199eaea admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:09.644718 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2079/4127] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:24:09 2022] PUT /identity/v3/projects/a17aec51392c4459aec1d60b8bd99a66/users/d6fdc1d6454a48fbaa3f4e7d5520e9bf/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:24:09.657447 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944fbd4-c6ec-4af0-8332-6716838b0d48 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:09.658322 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944fbd4-c6ec-4af0-8332-6716838b0d48 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:09.658607 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944fbd4-c6ec-4af0-8332-6716838b0d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:09.691158 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-6944fbd4-c6ec-4af0-8332-6716838b0d48 None None] MFA Rules not processed for user `d6fdc1d6454a48fbaa3f4e7d5520e9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:24:09.692832 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-6944fbd4-c6ec-4af0-8332-6716838b0d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:09.772510 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2049/4128] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:24:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:24:09.796344 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d548f-80b1-4628-9423-1f69e199eaea admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:09.797945 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-859d548f-80b1-4628-9423-1f69e199eaea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:09.925678 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d548f-80b1-4628-9423-1f69e199eaea admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:09.934327 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6321cf9-3617-41ee-9d33-9c0eb360e8e0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b5cb86f190f4fcfb06d66cb8f14643f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:09.935251 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6321cf9-3617-41ee-9d33-9c0eb360e8e0 service glance] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:09.938003 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6321cf9-3617-41ee-9d33-9c0eb360e8e0 service glance] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:09.938425 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6321cf9-3617-41ee-9d33-9c0eb360e8e0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:10.033100 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6321cf9-3617-41ee-9d33-9c0eb360e8e0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:10.034502 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6321cf9-3617-41ee-9d33-9c0eb360e8e0 service glance] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:10.057570 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2080/4129] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:24:09 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:24:11.991385 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6944fbd4-c6ec-4af0-8332-6716838b0d48 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:12.086484 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6944fbd4-c6ec-4af0-8332-6716838b0d48 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:12.092823 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7572f333-68f8-425d-8213-f2840fbc6757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:12.093934 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7572f333-68f8-425d-8213-f2840fbc6757 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:12.094319 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7572f333-68f8-425d-8213-f2840fbc6757 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:12.095137 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7572f333-68f8-425d-8213-f2840fbc6757 admin admin] PATH_INFO: `/v3/users/ee158abd32574b76b3cfec15ea9ca671` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:12.096496 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7572f333-68f8-425d-8213-f2840fbc6757 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee158abd32574b76b3cfec15ea9ca671)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:12.098567 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7572f333-68f8-425d-8213-f2840fbc6757 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:12.430983 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7572f333-68f8-425d-8213-f2840fbc6757 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee158abd32574b76b3cfec15ea9ca671'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:12.440225 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7572f333-68f8-425d-8213-f2840fbc6757 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee158abd32574b76b3cfec15ea9ca671'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:12.440964 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7572f333-68f8-425d-8213-f2840fbc6757 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee158abd32574b76b3cfec15ea9ca671'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:12.550690 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7572f333-68f8-425d-8213-f2840fbc6757 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee158abd32574b76b3cfec15ea9ca671'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:12.590940 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7572f333-68f8-425d-8213-f2840fbc6757 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee158abd32574b76b3cfec15ea9ca671'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:12.610692 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2050/4130] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:24:11 2022] DELETE /identity/v3/users/ee158abd32574b76b3cfec15ea9ca671 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:24:12.615333 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dffd62-21b9-472c-96f7-01b71f0e03ff None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:12.616162 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dffd62-21b9-472c-96f7-01b71f0e03ff None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:12.616289 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dffd62-21b9-472c-96f7-01b71f0e03ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:12.647411 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-c6dffd62-21b9-472c-96f7-01b71f0e03ff None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:24:12.648668 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c6dffd62-21b9-472c-96f7-01b71f0e03ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:12.746876 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2081/4131] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:24:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:24:12.791731 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7572f333-68f8-425d-8213-f2840fbc6757 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:12.803008 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-7572f333-68f8-425d-8213-f2840fbc6757 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:12.955859 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7572f333-68f8-425d-8213-f2840fbc6757 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:12.961634 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5c2823-6343-416a-8259-848e8cb28ff8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:12.962460 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c2823-6343-416a-8259-848e8cb28ff8 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:12.962745 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c2823-6343-416a-8259-848e8cb28ff8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:12.965068 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c2823-6343-416a-8259-848e8cb28ff8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:12.987656 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5c2823-6343-416a-8259-848e8cb28ff8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:12.992006 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5c2823-6343-416a-8259-848e8cb28ff8 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:13.023244 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2051/4132] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:24:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:24:15.226574 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dffd62-21b9-472c-96f7-01b71f0e03ff None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:15.227229 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c6dffd62-21b9-472c-96f7-01b71f0e03ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:15.250163 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dffd62-21b9-472c-96f7-01b71f0e03ff None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:15.272295 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf4e57e-57e1-490b-8629-5c7d9f2e7ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:15.280335 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4e57e-57e1-490b-8629-5c7d9f2e7ea5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:15.283888 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4e57e-57e1-490b-8629-5c7d9f2e7ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:15.283888 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4e57e-57e1-490b-8629-5c7d9f2e7ea5 admin admin] PATH_INFO: `/v3/projects/51d04918ea404cbcabc74350a7086926` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:15.283888 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf4e57e-57e1-490b-8629-5c7d9f2e7ea5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51d04918ea404cbcabc74350a7086926)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:15.285481 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf4e57e-57e1-490b-8629-5c7d9f2e7ea5 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:15.431378 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-eaf4e57e-57e1-490b-8629-5c7d9f2e7ea5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51d04918ea404cbcabc74350a7086926', 'request_id': 'req-eaf4e57e-57e1-490b-8629-5c7d9f2e7ea5'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:15.440439 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-eaf4e57e-57e1-490b-8629-5c7d9f2e7ea5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51d04918ea404cbcabc74350a7086926', 'request_id': 'req-eaf4e57e-57e1-490b-8629-5c7d9f2e7ea5'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:15.532667 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-eaf4e57e-57e1-490b-8629-5c7d9f2e7ea5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51d04918ea404cbcabc74350a7086926', 'request_id': 'req-eaf4e57e-57e1-490b-8629-5c7d9f2e7ea5'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:15.550553 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-eaf4e57e-57e1-490b-8629-5c7d9f2e7ea5 admin admin] The token cache is being invalidate because project 51d04918ea404cbcabc74350a7086926 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:24:15.551512 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-eaf4e57e-57e1-490b-8629-5c7d9f2e7ea5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:15.553735 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-eaf4e57e-57e1-490b-8629-5c7d9f2e7ea5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:15.563342 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2082/4133] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:24:15 2022] DELETE /identity/v3/projects/51d04918ea404cbcabc74350a7086926 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:24:15.564008 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5c2823-6343-416a-8259-848e8cb28ff8 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:15.574619 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5c2823-6343-416a-8259-848e8cb28ff8 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:15.711258 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65615646-edc1-48a3-8d14-96e38698bc4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:15.713966 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65615646-edc1-48a3-8d14-96e38698bc4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:15.714487 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65615646-edc1-48a3-8d14-96e38698bc4c admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:15.714962 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65615646-edc1-48a3-8d14-96e38698bc4c admin admin] PATH_INFO: `/v3/users/d6fdc1d6454a48fbaa3f4e7d5520e9bf` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:15.716981 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65615646-edc1-48a3-8d14-96e38698bc4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6fdc1d6454a48fbaa3f4e7d5520e9bf)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:15.719564 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65615646-edc1-48a3-8d14-96e38698bc4c admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:16.007884 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-65615646-edc1-48a3-8d14-96e38698bc4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6fdc1d6454a48fbaa3f4e7d5520e9bf'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:16.022793 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-65615646-edc1-48a3-8d14-96e38698bc4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6fdc1d6454a48fbaa3f4e7d5520e9bf'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:16.024436 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-65615646-edc1-48a3-8d14-96e38698bc4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6fdc1d6454a48fbaa3f4e7d5520e9bf'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:16.120143 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-65615646-edc1-48a3-8d14-96e38698bc4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6fdc1d6454a48fbaa3f4e7d5520e9bf'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:16.143504 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-65615646-edc1-48a3-8d14-96e38698bc4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6fdc1d6454a48fbaa3f4e7d5520e9bf'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:16.152315 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2052/4134] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:24:15 2022] DELETE /identity/v3/users/d6fdc1d6454a48fbaa3f4e7d5520e9bf => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:24:16.907129 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761fafcb-973e-4c71-81e7-2218c1e37463 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:16.908039 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761fafcb-973e-4c71-81e7-2218c1e37463 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:16.908720 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761fafcb-973e-4c71-81e7-2218c1e37463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:16.948380 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-761fafcb-973e-4c71-81e7-2218c1e37463 None None] MFA Rules not processed for user `98b7bc6d0abe43a889cc29118685e8f4`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:24:16.952900 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-761fafcb-973e-4c71-81e7-2218c1e37463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:17.100653 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2083/4135] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:24:16 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:24:17.353301 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65615646-edc1-48a3-8d14-96e38698bc4c admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:17.358211 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-65615646-edc1-48a3-8d14-96e38698bc4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:17.455621 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65615646-edc1-48a3-8d14-96e38698bc4c admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:17.461576 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa77a12-9b54-4d2c-8578-cc044e2108fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:17.462238 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa77a12-9b54-4d2c-8578-cc044e2108fa service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:17.462522 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa77a12-9b54-4d2c-8578-cc044e2108fa service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:17.462798 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa77a12-9b54-4d2c-8578-cc044e2108fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:17.472447 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa77a12-9b54-4d2c-8578-cc044e2108fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:17.474088 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa77a12-9b54-4d2c-8578-cc044e2108fa service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:17.484307 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2053/4136] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:24:17 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:24:17.602435 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761fafcb-973e-4c71-81e7-2218c1e37463 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:17.604613 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-761fafcb-973e-4c71-81e7-2218c1e37463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:17.695624 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761fafcb-973e-4c71-81e7-2218c1e37463 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:17.701049 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff790598-ba72-41d0-bc0f-0a34c5e6d792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:17.702222 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff790598-ba72-41d0-bc0f-0a34c5e6d792 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:17.702505 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff790598-ba72-41d0-bc0f-0a34c5e6d792 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:17.702852 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff790598-ba72-41d0-bc0f-0a34c5e6d792 admin admin] PATH_INFO: `/v3/projects/a17aec51392c4459aec1d60b8bd99a66` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:17.704175 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff790598-ba72-41d0-bc0f-0a34c5e6d792 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a17aec51392c4459aec1d60b8bd99a66)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:17.706135 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff790598-ba72-41d0-bc0f-0a34c5e6d792 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:17.912050 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ff790598-ba72-41d0-bc0f-0a34c5e6d792 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a17aec51392c4459aec1d60b8bd99a66', 'request_id': 'req-ff790598-ba72-41d0-bc0f-0a34c5e6d792'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:17.948066 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ff790598-ba72-41d0-bc0f-0a34c5e6d792 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a17aec51392c4459aec1d60b8bd99a66', 'request_id': 'req-ff790598-ba72-41d0-bc0f-0a34c5e6d792'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:18.006071 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ff790598-ba72-41d0-bc0f-0a34c5e6d792 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a17aec51392c4459aec1d60b8bd99a66', 'request_id': 'req-ff790598-ba72-41d0-bc0f-0a34c5e6d792'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:18.020715 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ff790598-ba72-41d0-bc0f-0a34c5e6d792 admin admin] The token cache is being invalidate because project a17aec51392c4459aec1d60b8bd99a66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:24:18.020715 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ff790598-ba72-41d0-bc0f-0a34c5e6d792 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:18.021369 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ff790598-ba72-41d0-bc0f-0a34c5e6d792 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:18.023988 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2084/4137] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:24:17 2022] DELETE /identity/v3/projects/a17aec51392c4459aec1d60b8bd99a66 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:24:18.029117 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ff629-3644-47c5-84f7-3e19680eb4eb None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:18.029844 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ff629-3644-47c5-84f7-3e19680eb4eb None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:18.030146 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ff629-3644-47c5-84f7-3e19680eb4eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:18.063127 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-296ff629-3644-47c5-84f7-3e19680eb4eb None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:24:18.068966 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-296ff629-3644-47c5-84f7-3e19680eb4eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:18.156926 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2054/4138] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:24:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:24:18.164891 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdce89b-be39-445a-bab2-1daa1a336ac4 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:18.165354 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdce89b-be39-445a-bab2-1daa1a336ac4 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:18.166588 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdce89b-be39-445a-bab2-1daa1a336ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:18.187996 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-4bdce89b-be39-445a-bab2-1daa1a336ac4 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:24:18.189377 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-4bdce89b-be39-445a-bab2-1daa1a336ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:18.197870 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2085/4139] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:24:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:24:18.203141 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ff629-3644-47c5-84f7-3e19680eb4eb None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:18.213499 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ff629-3644-47c5-84f7-3e19680eb4eb None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:18.218978 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f945cc-edff-4278-a6e8-eb5476cde065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:18.219744 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f945cc-edff-4278-a6e8-eb5476cde065 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:18.220035 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f945cc-edff-4278-a6e8-eb5476cde065 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:18.220313 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f945cc-edff-4278-a6e8-eb5476cde065 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:18.221165 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f945cc-edff-4278-a6e8-eb5476cde065 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:24:18.221420 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f945cc-edff-4278-a6e8-eb5476cde065 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:18.223044 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f945cc-edff-4278-a6e8-eb5476cde065 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:18.235612 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2055/4140] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:24:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:24:18.241057 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdce89b-be39-445a-bab2-1daa1a336ac4 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:18.254275 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdce89b-be39-445a-bab2-1daa1a336ac4 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:18.265373 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bead1c-2783-45c3-a662-7fb57ddeb2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:18.265499 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bead1c-2783-45c3-a662-7fb57ddeb2f8 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:18.265748 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bead1c-2783-45c3-a662-7fb57ddeb2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:18.266026 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bead1c-2783-45c3-a662-7fb57ddeb2f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:18.267378 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bead1c-2783-45c3-a662-7fb57ddeb2f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:18.269589 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bead1c-2783-45c3-a662-7fb57ddeb2f8 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:18.415123 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2086/4141] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:24:18 2022] POST /identity/v3/projects => generated 379 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:24:18.420065 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f945cc-edff-4278-a6e8-eb5476cde065 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:18.436070 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f945cc-edff-4278-a6e8-eb5476cde065 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:18.517848 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4fcb5d-0118-441e-8561-e4f619653a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:18.518841 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4fcb5d-0118-441e-8561-e4f619653a3b admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:18.519536 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4fcb5d-0118-441e-8561-e4f619653a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:18.520248 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4fcb5d-0118-441e-8561-e4f619653a3b admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:18.521225 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4fcb5d-0118-441e-8561-e4f619653a3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:18.524273 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4fcb5d-0118-441e-8561-e4f619653a3b admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:18.643270 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2056/4142] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:24:18 2022] POST /identity/v3/users => generated 296 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:24:18.647445 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bead1c-2783-45c3-a662-7fb57ddeb2f8 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:18.659031 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bead1c-2783-45c3-a662-7fb57ddeb2f8 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:18.664172 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb6f2cd-a413-4c8b-bd59-435351ada3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:18.664856 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6f2cd-a413-4c8b-bd59-435351ada3a1 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:18.665124 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6f2cd-a413-4c8b-bd59-435351ada3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:18.665404 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6f2cd-a413-4c8b-bd59-435351ada3a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:18.666127 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb6f2cd-a413-4c8b-bd59-435351ada3a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:18.668566 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb6f2cd-a413-4c8b-bd59-435351ada3a1 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:18.680220 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2087/4143] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:24:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:24:18.685075 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4fcb5d-0118-441e-8561-e4f619653a3b admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:18.698793 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4fcb5d-0118-441e-8561-e4f619653a3b admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:18.709050 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93c6f47-8062-4d9f-8c18-a449f00c5f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:18.711181 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c6f47-8062-4d9f-8c18-a449f00c5f45 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:18.715338 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c6f47-8062-4d9f-8c18-a449f00c5f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:18.715777 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c6f47-8062-4d9f-8c18-a449f00c5f45 admin admin] PATH_INFO: `/v3/projects/14c7e9544a414144abb20ebf550486f5/users/4577a265ca7642d7aab7107e0a813a29/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:18.738596 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93c6f47-8062-4d9f-8c18-a449f00c5f45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14c7e9544a414144abb20ebf550486f5, user_id=4577a265ca7642d7aab7107e0a813a29, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:18.741741 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93c6f47-8062-4d9f-8c18-a449f00c5f45 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:18.826922 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb6f2cd-a413-4c8b-bd59-435351ada3a1 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:18.827733 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2057/4144] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:24:18 2022] PUT /identity/v3/projects/14c7e9544a414144abb20ebf550486f5/users/4577a265ca7642d7aab7107e0a813a29/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:24:18.842874 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb6f2cd-a413-4c8b-bd59-435351ada3a1 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:18.931954 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d72325-6d45-4739-913a-8bbe91bf4223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:18.932458 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d72325-6d45-4739-913a-8bbe91bf4223 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:18.933133 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d72325-6d45-4739-913a-8bbe91bf4223 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:18.933764 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d72325-6d45-4739-913a-8bbe91bf4223 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:18.935528 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d72325-6d45-4739-913a-8bbe91bf4223 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:18.942720 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d72325-6d45-4739-913a-8bbe91bf4223 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:18.953573 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2088/4145] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:24:18 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:24:18.961077 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93c6f47-8062-4d9f-8c18-a449f00c5f45 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:18.976759 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93c6f47-8062-4d9f-8c18-a449f00c5f45 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:18.984562 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd141bc-ebeb-4c6a-9edc-6dadacc52b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:18.986041 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd141bc-ebeb-4c6a-9edc-6dadacc52b3f admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:18.986512 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd141bc-ebeb-4c6a-9edc-6dadacc52b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:18.986944 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd141bc-ebeb-4c6a-9edc-6dadacc52b3f admin admin] PATH_INFO: `/v3/projects/14c7e9544a414144abb20ebf550486f5/users/4577a265ca7642d7aab7107e0a813a29/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:18.991439 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd141bc-ebeb-4c6a-9edc-6dadacc52b3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=14c7e9544a414144abb20ebf550486f5, user_id=4577a265ca7642d7aab7107e0a813a29, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:18.996880 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd141bc-ebeb-4c6a-9edc-6dadacc52b3f admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:19.016429 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2058/4146] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:24:18 2022] PUT /identity/v3/projects/14c7e9544a414144abb20ebf550486f5/users/4577a265ca7642d7aab7107e0a813a29/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:24:19.027235 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7a12f-cbc0-4b03-b823-a6161662a03b None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:19.030553 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7a12f-cbc0-4b03-b823-a6161662a03b None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:19.030553 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7a12f-cbc0-4b03-b823-a6161662a03b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:19.068301 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-8fc7a12f-cbc0-4b03-b823-a6161662a03b None None] MFA Rules not processed for user `4577a265ca7642d7aab7107e0a813a29`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:24:19.070505 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-8fc7a12f-cbc0-4b03-b823-a6161662a03b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:19.178726 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2089/4147] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:24:19 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:24:19.179916 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd141bc-ebeb-4c6a-9edc-6dadacc52b3f admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:19.236795 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7a12f-cbc0-4b03-b823-a6161662a03b None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:19.242150 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-8fc7a12f-cbc0-4b03-b823-a6161662a03b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:19.305662 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd141bc-ebeb-4c6a-9edc-6dadacc52b3f admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:19.320066 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459cdf14-cbc5-43c8-89bf-b2c05fd48999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:19.320788 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459cdf14-cbc5-43c8-89bf-b2c05fd48999 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:19.321150 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459cdf14-cbc5-43c8-89bf-b2c05fd48999 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:19.321440 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459cdf14-cbc5-43c8-89bf-b2c05fd48999 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:19.322152 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459cdf14-cbc5-43c8-89bf-b2c05fd48999 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:19.324541 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459cdf14-cbc5-43c8-89bf-b2c05fd48999 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:19.350330 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7a12f-cbc0-4b03-b823-a6161662a03b None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:19.358688 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428555bf-7a4f-4169-a7ff-3573f296ea79 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:19.359492 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428555bf-7a4f-4169-a7ff-3573f296ea79 service placement] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:19.360308 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428555bf-7a4f-4169-a7ff-3573f296ea79 service placement] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:19.360308 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428555bf-7a4f-4169-a7ff-3573f296ea79 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:19.363354 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-428555bf-7a4f-4169-a7ff-3573f296ea79 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:19.379600 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428555bf-7a4f-4169-a7ff-3573f296ea79 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:19.381551 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428555bf-7a4f-4169-a7ff-3573f296ea79 service placement] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:19.407449 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2090/4148] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:24:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:24:19.452738 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2059/4149] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:24:19 2022] POST /identity/v3/projects => generated 381 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:24:19.454578 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428555bf-7a4f-4169-a7ff-3573f296ea79 service placement] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:19.469009 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428555bf-7a4f-4169-a7ff-3573f296ea79 service placement] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:19.553404 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f258fb-df0d-4a88-9cf9-24ec5dae7738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:19.555661 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f258fb-df0d-4a88-9cf9-24ec5dae7738 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:19.556064 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f258fb-df0d-4a88-9cf9-24ec5dae7738 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:19.557468 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f258fb-df0d-4a88-9cf9-24ec5dae7738 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:19.560153 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f258fb-df0d-4a88-9cf9-24ec5dae7738 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:19.564970 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f258fb-df0d-4a88-9cf9-24ec5dae7738 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:19.649360 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2091/4150] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:24:19 2022] POST /identity/v3/users => generated 291 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:24:19.653424 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459cdf14-cbc5-43c8-89bf-b2c05fd48999 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:19.669294 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459cdf14-cbc5-43c8-89bf-b2c05fd48999 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:19.680071 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf89165-69b8-440d-b8ad-e27d71159d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:19.681338 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf89165-69b8-440d-b8ad-e27d71159d9f admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:19.681975 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf89165-69b8-440d-b8ad-e27d71159d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:19.682492 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf89165-69b8-440d-b8ad-e27d71159d9f admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:19.684210 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf89165-69b8-440d-b8ad-e27d71159d9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:19.692652 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf89165-69b8-440d-b8ad-e27d71159d9f admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:19.722903 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f258fb-df0d-4a88-9cf9-24ec5dae7738 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:19.724114 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2060/4151] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:24:19 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:24:19.737068 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f258fb-df0d-4a88-9cf9-24ec5dae7738 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:19.749999 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc6daa8-0165-40e5-a7c6-7c9e4cd24ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:19.751212 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc6daa8-0165-40e5-a7c6-7c9e4cd24ce8 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:19.752408 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc6daa8-0165-40e5-a7c6-7c9e4cd24ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:19.753285 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc6daa8-0165-40e5-a7c6-7c9e4cd24ce8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:19.754347 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc6daa8-0165-40e5-a7c6-7c9e4cd24ce8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:19.756415 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc6daa8-0165-40e5-a7c6-7c9e4cd24ce8 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:19.778255 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2092/4152] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:24:19 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:24:19.781294 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf89165-69b8-440d-b8ad-e27d71159d9f admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:19.806615 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf89165-69b8-440d-b8ad-e27d71159d9f admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:19.810042 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b3585f-9ac9-4b75-83db-83ebe07ec40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:19.811885 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3585f-9ac9-4b75-83db-83ebe07ec40d admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:19.813377 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3585f-9ac9-4b75-83db-83ebe07ec40d admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:19.814045 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3585f-9ac9-4b75-83db-83ebe07ec40d admin admin] PATH_INFO: `/v3/projects/24e76d9bba7b43e8bc3ea4c049697e95/users/42ec84c9f058415c949e1c91a6e8c735/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:19.839471 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b3585f-9ac9-4b75-83db-83ebe07ec40d admin admin] RBAC: Authorizing `identity:create_grant(project_id=24e76d9bba7b43e8bc3ea4c049697e95, user_id=42ec84c9f058415c949e1c91a6e8c735, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:19.844606 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b3585f-9ac9-4b75-83db-83ebe07ec40d admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:19.945214 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2061/4153] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:24:19 2022] PUT /identity/v3/projects/24e76d9bba7b43e8bc3ea4c049697e95/users/42ec84c9f058415c949e1c91a6e8c735/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:24:19.958931 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574fcbe-846b-488a-bac4-0449ac17e586 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:19.960650 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574fcbe-846b-488a-bac4-0449ac17e586 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:19.961255 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574fcbe-846b-488a-bac4-0449ac17e586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:20.080634 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-b574fcbe-846b-488a-bac4-0449ac17e586 None None] MFA Rules not processed for user `42ec84c9f058415c949e1c91a6e8c735`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:24:20.085744 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b574fcbe-846b-488a-bac4-0449ac17e586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:20.272443 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2093/4154] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:24:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:24:20.280561 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b3585f-9ac9-4b75-83db-83ebe07ec40d admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:20.282323 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-a8b3585f-9ac9-4b75-83db-83ebe07ec40d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:20.407575 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b3585f-9ac9-4b75-83db-83ebe07ec40d admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:20.445473 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0072616-f610-4bae-89f5-d96489c85f6a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b5cb86f190f4fcfb06d66cb8f14643f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:20.446484 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0072616-f610-4bae-89f5-d96489c85f6a service glance] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:20.446834 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0072616-f610-4bae-89f5-d96489c85f6a service glance] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:20.447383 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0072616-f610-4bae-89f5-d96489c85f6a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:20.600057 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0072616-f610-4bae-89f5-d96489c85f6a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:20.602424 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0072616-f610-4bae-89f5-d96489c85f6a service glance] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:20.632349 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2062/4155] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:24:20 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:24:20.993733 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b93e64-af18-4829-b170-4c6e9214e4d8 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:20.994656 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b93e64-af18-4829-b170-4c6e9214e4d8 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:20.996436 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b93e64-af18-4829-b170-4c6e9214e4d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:21.049535 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-93b93e64-af18-4829-b170-4c6e9214e4d8 None None] MFA Rules not processed for user `87538f2309714545bd47f228b6505883`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:24:21.052847 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-93b93e64-af18-4829-b170-4c6e9214e4d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:21.233433 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2094/4156] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:24:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:24:22.191663 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0072616-f610-4bae-89f5-d96489c85f6a service glance] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:22.245733 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150b753-8cfd-487b-8e50-dd936345a5e0 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:22.246606 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150b753-8cfd-487b-8e50-dd936345a5e0 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:22.247048 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150b753-8cfd-487b-8e50-dd936345a5e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:22.286895 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-c150b753-8cfd-487b-8e50-dd936345a5e0 None None] MFA Rules not processed for user `98b7bc6d0abe43a889cc29118685e8f4`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:24:22.288792 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c150b753-8cfd-487b-8e50-dd936345a5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:22.314587 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0072616-f610-4bae-89f5-d96489c85f6a service glance] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:22.319919 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa67a66c-7927-42a0-a24c-32dd496dde33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:22.321100 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67a66c-7927-42a0-a24c-32dd496dde33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:22.321490 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67a66c-7927-42a0-a24c-32dd496dde33 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:22.321872 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67a66c-7927-42a0-a24c-32dd496dde33 admin admin] PATH_INFO: `/v3/users/4577a265ca7642d7aab7107e0a813a29` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:22.324123 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa67a66c-7927-42a0-a24c-32dd496dde33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4577a265ca7642d7aab7107e0a813a29)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:22.326403 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa67a66c-7927-42a0-a24c-32dd496dde33 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:22.419354 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2095/4157] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:24:22 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:24:22.590612 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-fa67a66c-7927-42a0-a24c-32dd496dde33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4577a265ca7642d7aab7107e0a813a29'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:22.643022 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-fa67a66c-7927-42a0-a24c-32dd496dde33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4577a265ca7642d7aab7107e0a813a29'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:22.647319 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-fa67a66c-7927-42a0-a24c-32dd496dde33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4577a265ca7642d7aab7107e0a813a29'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:22.748532 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-fa67a66c-7927-42a0-a24c-32dd496dde33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4577a265ca7642d7aab7107e0a813a29'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:22.785822 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-fa67a66c-7927-42a0-a24c-32dd496dde33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4577a265ca7642d7aab7107e0a813a29'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:22.809127 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2063/4158] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:24:22 2022] DELETE /identity/v3/users/4577a265ca7642d7aab7107e0a813a29 => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:24:22.809734 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b486c-128a-4c9d-b2fa-f9195f32b710 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:22.810218 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b486c-128a-4c9d-b2fa-f9195f32b710 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:22.810659 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b486c-128a-4c9d-b2fa-f9195f32b710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:22.844116 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-bd2b486c-128a-4c9d-b2fa-f9195f32b710 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:24:22.845865 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-bd2b486c-128a-4c9d-b2fa-f9195f32b710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:22.994635 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2096/4159] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:24:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:24:23.031360 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa67a66c-7927-42a0-a24c-32dd496dde33 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:23.034661 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-fa67a66c-7927-42a0-a24c-32dd496dde33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:23.168610 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa67a66c-7927-42a0-a24c-32dd496dde33 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:23.173484 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e9a95-85a3-4810-a094-b6cf7c3370f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:23.174970 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e9a95-85a3-4810-a094-b6cf7c3370f6 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:23.175257 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e9a95-85a3-4810-a094-b6cf7c3370f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:23.175710 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e9a95-85a3-4810-a094-b6cf7c3370f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:23.189814 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560e9a95-85a3-4810-a094-b6cf7c3370f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:23.193942 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560e9a95-85a3-4810-a094-b6cf7c3370f6 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:23.210035 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2064/4160] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:24:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:24:24.078000 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b486c-128a-4c9d-b2fa-f9195f32b710 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:24.081106 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-bd2b486c-128a-4c9d-b2fa-f9195f32b710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:24.111905 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b486c-128a-4c9d-b2fa-f9195f32b710 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:24.124097 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d834df09-b237-4b16-a0c4-ad1ea6c86cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:24.125349 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d834df09-b237-4b16-a0c4-ad1ea6c86cbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:24.125857 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d834df09-b237-4b16-a0c4-ad1ea6c86cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:24.128630 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d834df09-b237-4b16-a0c4-ad1ea6c86cbf admin admin] PATH_INFO: `/v3/projects/14c7e9544a414144abb20ebf550486f5` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:24.132475 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d834df09-b237-4b16-a0c4-ad1ea6c86cbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=14c7e9544a414144abb20ebf550486f5)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:24.152691 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d834df09-b237-4b16-a0c4-ad1ea6c86cbf admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:24.323367 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d834df09-b237-4b16-a0c4-ad1ea6c86cbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14c7e9544a414144abb20ebf550486f5', 'request_id': 'req-d834df09-b237-4b16-a0c4-ad1ea6c86cbf'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:24.330527 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d834df09-b237-4b16-a0c4-ad1ea6c86cbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14c7e9544a414144abb20ebf550486f5', 'request_id': 'req-d834df09-b237-4b16-a0c4-ad1ea6c86cbf'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:24.453366 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d834df09-b237-4b16-a0c4-ad1ea6c86cbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14c7e9544a414144abb20ebf550486f5', 'request_id': 'req-d834df09-b237-4b16-a0c4-ad1ea6c86cbf'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:24.471156 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d834df09-b237-4b16-a0c4-ad1ea6c86cbf admin admin] The token cache is being invalidate because project 14c7e9544a414144abb20ebf550486f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:24:24.471766 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d834df09-b237-4b16-a0c4-ad1ea6c86cbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:24.476664 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d834df09-b237-4b16-a0c4-ad1ea6c86cbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:24.478834 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2097/4161] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:24:24 2022] DELETE /identity/v3/projects/14c7e9544a414144abb20ebf550486f5 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:24:24.485193 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e9a95-85a3-4810-a094-b6cf7c3370f6 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:24.501010 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e9a95-85a3-4810-a094-b6cf7c3370f6 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:24.586302 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5068df9-dbff-4408-9fc2-e0023f7fe705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:24.588695 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5068df9-dbff-4408-9fc2-e0023f7fe705 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:24.589602 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5068df9-dbff-4408-9fc2-e0023f7fe705 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:24.590151 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5068df9-dbff-4408-9fc2-e0023f7fe705 admin admin] PATH_INFO: `/v3/users/42ec84c9f058415c949e1c91a6e8c735` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:24.591704 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5068df9-dbff-4408-9fc2-e0023f7fe705 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42ec84c9f058415c949e1c91a6e8c735)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:24.594890 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5068df9-dbff-4408-9fc2-e0023f7fe705 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:24.921219 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a5068df9-dbff-4408-9fc2-e0023f7fe705 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42ec84c9f058415c949e1c91a6e8c735'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:24.941980 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a5068df9-dbff-4408-9fc2-e0023f7fe705 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42ec84c9f058415c949e1c91a6e8c735'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:24.943742 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a5068df9-dbff-4408-9fc2-e0023f7fe705 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42ec84c9f058415c949e1c91a6e8c735'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:25.026986 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a5068df9-dbff-4408-9fc2-e0023f7fe705 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42ec84c9f058415c949e1c91a6e8c735'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:25.059775 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a5068df9-dbff-4408-9fc2-e0023f7fe705 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42ec84c9f058415c949e1c91a6e8c735'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:25.079335 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2065/4162] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:24:24 2022] DELETE /identity/v3/users/42ec84c9f058415c949e1c91a6e8c735 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:24:25.757099 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d834df09-b237-4b16-a0c4-ad1ea6c86cbf admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:25.758553 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d834df09-b237-4b16-a0c4-ad1ea6c86cbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:25.789231 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d834df09-b237-4b16-a0c4-ad1ea6c86cbf admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:25.878252 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392f7eb2-e373-4003-bcbc-3269c2b0c50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:25.879313 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f7eb2-e373-4003-bcbc-3269c2b0c50e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:25.879706 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f7eb2-e373-4003-bcbc-3269c2b0c50e admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:25.879984 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f7eb2-e373-4003-bcbc-3269c2b0c50e admin admin] PATH_INFO: `/v3/projects/24e76d9bba7b43e8bc3ea4c049697e95` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:25.881376 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392f7eb2-e373-4003-bcbc-3269c2b0c50e admin admin] RBAC: Authorizing `identity:delete_project(project_id=24e76d9bba7b43e8bc3ea4c049697e95)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:25.883305 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392f7eb2-e373-4003-bcbc-3269c2b0c50e admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:26.084419 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-392f7eb2-e373-4003-bcbc-3269c2b0c50e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24e76d9bba7b43e8bc3ea4c049697e95', 'request_id': 'req-392f7eb2-e373-4003-bcbc-3269c2b0c50e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:26.092668 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-392f7eb2-e373-4003-bcbc-3269c2b0c50e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24e76d9bba7b43e8bc3ea4c049697e95', 'request_id': 'req-392f7eb2-e373-4003-bcbc-3269c2b0c50e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:26.127208 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db19a152-a680-43dc-87a9-4b6ce8bceee7 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:26.128642 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db19a152-a680-43dc-87a9-4b6ce8bceee7 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:26.129093 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db19a152-a680-43dc-87a9-4b6ce8bceee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:26.153194 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-db19a152-a680-43dc-87a9-4b6ce8bceee7 None None] MFA Rules not processed for user `87538f2309714545bd47f228b6505883`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:24:26.154924 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-db19a152-a680-43dc-87a9-4b6ce8bceee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:26.159799 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-392f7eb2-e373-4003-bcbc-3269c2b0c50e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24e76d9bba7b43e8bc3ea4c049697e95', 'request_id': 'req-392f7eb2-e373-4003-bcbc-3269c2b0c50e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:26.183207 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-392f7eb2-e373-4003-bcbc-3269c2b0c50e admin admin] The token cache is being invalidate because project 24e76d9bba7b43e8bc3ea4c049697e95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:24:26.183207 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-392f7eb2-e373-4003-bcbc-3269c2b0c50e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:26.184112 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-392f7eb2-e373-4003-bcbc-3269c2b0c50e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:26.185922 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2098/4163] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:24:25 2022] DELETE /identity/v3/projects/24e76d9bba7b43e8bc3ea4c049697e95 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:24:26.192007 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b83238-5030-4ce1-b897-35e6653975c6 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:26.201054 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b83238-5030-4ce1-b897-35e6653975c6 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:26.201054 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b83238-5030-4ce1-b897-35e6653975c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:26.212111 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-65b83238-5030-4ce1-b897-35e6653975c6 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:24:26.213346 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-65b83238-5030-4ce1-b897-35e6653975c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:26.236716 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2066/4164] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:24:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:24:26.281596 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db19a152-a680-43dc-87a9-4b6ce8bceee7 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:26.282845 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-db19a152-a680-43dc-87a9-4b6ce8bceee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:26.315607 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2099/4165] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:24:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:24:26.317519 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7acb7f-8f14-433f-8860-975a9e711f0f None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:26.317860 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7acb7f-8f14-433f-8860-975a9e711f0f None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:26.318081 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7acb7f-8f14-433f-8860-975a9e711f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:26.381704 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-5f7acb7f-8f14-433f-8860-975a9e711f0f None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:24:26.381704 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-5f7acb7f-8f14-433f-8860-975a9e711f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:26.392294 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2100/4166] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:24:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:24:26.398596 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7acb7f-8f14-433f-8860-975a9e711f0f None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:26.419872 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7acb7f-8f14-433f-8860-975a9e711f0f None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:26.425636 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db19a152-a680-43dc-87a9-4b6ce8bceee7 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:26.429187 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d5abf0-c177-4959-bb4d-885cd73c0d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:26.429878 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d5abf0-c177-4959-bb4d-885cd73c0d8d admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:26.430272 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d5abf0-c177-4959-bb4d-885cd73c0d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:26.430718 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d5abf0-c177-4959-bb4d-885cd73c0d8d admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:26.431561 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d5abf0-c177-4959-bb4d-885cd73c0d8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:24:26.432980 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d5abf0-c177-4959-bb4d-885cd73c0d8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:26.434166 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4963aa2b-bcc5-4108-8501-1656a37135d8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:26.434362 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d5abf0-c177-4959-bb4d-885cd73c0d8d admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:26.435147 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4963aa2b-bcc5-4108-8501-1656a37135d8 service placement] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:26.435752 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4963aa2b-bcc5-4108-8501-1656a37135d8 service placement] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:26.436177 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4963aa2b-bcc5-4108-8501-1656a37135d8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:26.439530 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-4963aa2b-bcc5-4108-8501-1656a37135d8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:26.452565 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2101/4167] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:24:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:24:26.458192 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d5abf0-c177-4959-bb4d-885cd73c0d8d admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:26.459991 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4963aa2b-bcc5-4108-8501-1656a37135d8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:26.462153 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4963aa2b-bcc5-4108-8501-1656a37135d8 service placement] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:26.489618 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2067/4168] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:24:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:24:26.492219 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d5abf0-c177-4959-bb4d-885cd73c0d8d admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:26.499167 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae835af-e9c1-410a-ac94-4a5083e84f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:26.500422 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae835af-e9c1-410a-ac94-4a5083e84f23 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:26.501038 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae835af-e9c1-410a-ac94-4a5083e84f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:26.501622 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae835af-e9c1-410a-ac94-4a5083e84f23 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:26.512771 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae835af-e9c1-410a-ac94-4a5083e84f23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:26.515240 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae835af-e9c1-410a-ac94-4a5083e84f23 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:26.638535 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2102/4169] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:24:26 2022] POST /identity/v3/projects => generated 385 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:24:26.643754 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4963aa2b-bcc5-4108-8501-1656a37135d8 service placement] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:26.665937 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4963aa2b-bcc5-4108-8501-1656a37135d8 service placement] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:26.751243 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03f3fa1-af5b-4bd9-bf59-972a3fbcadc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:26.751750 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f3fa1-af5b-4bd9-bf59-972a3fbcadc0 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:26.752031 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f3fa1-af5b-4bd9-bf59-972a3fbcadc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:26.752309 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f3fa1-af5b-4bd9-bf59-972a3fbcadc0 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:26.752992 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03f3fa1-af5b-4bd9-bf59-972a3fbcadc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:26.754924 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03f3fa1-af5b-4bd9-bf59-972a3fbcadc0 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:26.875712 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2068/4170] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:24:26 2022] POST /identity/v3/users => generated 293 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:24:26.883211 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae835af-e9c1-410a-ac94-4a5083e84f23 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:26.900124 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae835af-e9c1-410a-ac94-4a5083e84f23 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:26.932146 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381a181e-a77d-421b-ab0e-df0cc576564e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:26.934116 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a181e-a77d-421b-ab0e-df0cc576564e admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:26.934473 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a181e-a77d-421b-ab0e-df0cc576564e admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:26.934820 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a181e-a77d-421b-ab0e-df0cc576564e admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:26.936656 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381a181e-a77d-421b-ab0e-df0cc576564e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:26.937946 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381a181e-a77d-421b-ab0e-df0cc576564e admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:26.993395 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2103/4171] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:24:26.996533 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03f3fa1-af5b-4bd9-bf59-972a3fbcadc0 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:27.010327 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03f3fa1-af5b-4bd9-bf59-972a3fbcadc0 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:27.023689 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f6622f-d978-4f28-8208-6b4889f39a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:27.024576 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f6622f-d978-4f28-8208-6b4889f39a6f admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:27.024935 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f6622f-d978-4f28-8208-6b4889f39a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:27.025286 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f6622f-d978-4f28-8208-6b4889f39a6f admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:27.028204 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f6622f-d978-4f28-8208-6b4889f39a6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:27.035654 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f6622f-d978-4f28-8208-6b4889f39a6f admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:27.057155 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2069/4172] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:24:27.067951 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381a181e-a77d-421b-ab0e-df0cc576564e admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:27.079837 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381a181e-a77d-421b-ab0e-df0cc576564e admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:27.089734 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90377321-982c-4622-83b2-4a1559b4898e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:27.092057 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90377321-982c-4622-83b2-4a1559b4898e admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:27.092730 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90377321-982c-4622-83b2-4a1559b4898e admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:27.093371 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90377321-982c-4622-83b2-4a1559b4898e admin admin] PATH_INFO: `/v3/projects/fd178d4c14994f26b3b475ddac4a05e7/users/0772d2b65486482db15e8be5aa6d1bf8/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:27.123561 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90377321-982c-4622-83b2-4a1559b4898e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd178d4c14994f26b3b475ddac4a05e7, user_id=0772d2b65486482db15e8be5aa6d1bf8, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:27.142505 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90377321-982c-4622-83b2-4a1559b4898e admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:27.249417 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2104/4173] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:24:27 2022] PUT /identity/v3/projects/fd178d4c14994f26b3b475ddac4a05e7/users/0772d2b65486482db15e8be5aa6d1bf8/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:24:27.259929 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79600a3-6724-426d-a12d-1dff0656efdb None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:27.260452 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79600a3-6724-426d-a12d-1dff0656efdb None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:27.260568 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79600a3-6724-426d-a12d-1dff0656efdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:27.303651 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-c79600a3-6724-426d-a12d-1dff0656efdb None None] MFA Rules not processed for user `0772d2b65486482db15e8be5aa6d1bf8`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:24:27.305410 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c79600a3-6724-426d-a12d-1dff0656efdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:27.433742 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2070/4174] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:24:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:24:27.438999 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90377321-982c-4622-83b2-4a1559b4898e admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:27.559230 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90377321-982c-4622-83b2-4a1559b4898e admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:27.565178 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd230efa-509a-4c64-8feb-70777ab57284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:27.566111 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd230efa-509a-4c64-8feb-70777ab57284 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:27.567635 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd230efa-509a-4c64-8feb-70777ab57284 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:27.567994 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd230efa-509a-4c64-8feb-70777ab57284 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:27.569129 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd230efa-509a-4c64-8feb-70777ab57284 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:27.572322 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd230efa-509a-4c64-8feb-70777ab57284 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:27.680028 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2105/4175] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:24:27 2022] POST /identity/v3/projects => generated 385 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:24:27.681817 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79600a3-6724-426d-a12d-1dff0656efdb None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:27.705815 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79600a3-6724-426d-a12d-1dff0656efdb None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:27.811919 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d887af4-e1ce-42ce-876a-5b42b35d0279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:27.814582 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d887af4-e1ce-42ce-876a-5b42b35d0279 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:27.814582 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d887af4-e1ce-42ce-876a-5b42b35d0279 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:27.814582 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d887af4-e1ce-42ce-876a-5b42b35d0279 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:27.814582 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d887af4-e1ce-42ce-876a-5b42b35d0279 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:27.816386 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d887af4-e1ce-42ce-876a-5b42b35d0279 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:27.935300 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2071/4176] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:24:27 2022] POST /identity/v3/users => generated 299 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:24:27.935711 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd230efa-509a-4c64-8feb-70777ab57284 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:27.948712 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd230efa-509a-4c64-8feb-70777ab57284 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:27.954704 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384e9945-dca6-410c-b964-bf82703491b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:27.955398 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e9945-dca6-410c-b964-bf82703491b1 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:27.955741 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e9945-dca6-410c-b964-bf82703491b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:27.956101 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e9945-dca6-410c-b964-bf82703491b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:27.956751 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384e9945-dca6-410c-b964-bf82703491b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:27.958656 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384e9945-dca6-410c-b964-bf82703491b1 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:27.974176 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2106/4177] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:24:27 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:24:27.978289 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d887af4-e1ce-42ce-876a-5b42b35d0279 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:27.997180 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d887af4-e1ce-42ce-876a-5b42b35d0279 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:28.014854 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca27010-8151-45f9-a967-906d47f8974e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:28.015869 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca27010-8151-45f9-a967-906d47f8974e admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:28.016149 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca27010-8151-45f9-a967-906d47f8974e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:28.016431 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca27010-8151-45f9-a967-906d47f8974e admin admin] PATH_INFO: `/v3/projects/c51d73d877bd4403b6ab1c8c694b3c90/users/221f4f1d6b764f6f95f77f7100963f0f/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:28.073366 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca27010-8151-45f9-a967-906d47f8974e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c51d73d877bd4403b6ab1c8c694b3c90, user_id=221f4f1d6b764f6f95f77f7100963f0f, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:28.076607 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca27010-8151-45f9-a967-906d47f8974e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:28.167058 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2072/4178] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:24:27 2022] PUT /identity/v3/projects/c51d73d877bd4403b6ab1c8c694b3c90/users/221f4f1d6b764f6f95f77f7100963f0f/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:24:28.168661 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384e9945-dca6-410c-b964-bf82703491b1 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:28.185292 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384e9945-dca6-410c-b964-bf82703491b1 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:28.277870 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca27010-8151-45f9-a967-906d47f8974e admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:28.282573 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-3ca27010-8151-45f9-a967-906d47f8974e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:28.315689 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93521f39-e90d-46f9-901c-515ca010e2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:28.317599 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93521f39-e90d-46f9-901c-515ca010e2c4 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:28.318683 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93521f39-e90d-46f9-901c-515ca010e2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:28.319935 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93521f39-e90d-46f9-901c-515ca010e2c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:28.321439 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93521f39-e90d-46f9-901c-515ca010e2c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:28.326161 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93521f39-e90d-46f9-901c-515ca010e2c4 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:28.356918 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2107/4179] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:24:28.365179 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93521f39-e90d-46f9-901c-515ca010e2c4 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:28.382747 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93521f39-e90d-46f9-901c-515ca010e2c4 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:28.392348 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd00e64-869c-49d5-adb8-3455454979c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:28.394501 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd00e64-869c-49d5-adb8-3455454979c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:28.395004 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd00e64-869c-49d5-adb8-3455454979c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:28.395523 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd00e64-869c-49d5-adb8-3455454979c2 admin admin] PATH_INFO: `/v3/projects/c51d73d877bd4403b6ab1c8c694b3c90/users/221f4f1d6b764f6f95f77f7100963f0f/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:28.399268 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd00e64-869c-49d5-adb8-3455454979c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c51d73d877bd4403b6ab1c8c694b3c90, user_id=221f4f1d6b764f6f95f77f7100963f0f, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:28.400181 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca27010-8151-45f9-a967-906d47f8974e admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:28.403353 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd00e64-869c-49d5-adb8-3455454979c2 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:28.409453 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90eedde-c3ef-4dcc-80ea-a38a43349863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:28.410898 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90eedde-c3ef-4dcc-80ea-a38a43349863 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:28.411510 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90eedde-c3ef-4dcc-80ea-a38a43349863 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:28.414383 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90eedde-c3ef-4dcc-80ea-a38a43349863 admin admin] PATH_INFO: `/v3/users/a7f2d4818aa7461da8f30ddfe7641d93` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:28.414383 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90eedde-c3ef-4dcc-80ea-a38a43349863 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7f2d4818aa7461da8f30ddfe7641d93)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:28.419358 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90eedde-c3ef-4dcc-80ea-a38a43349863 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:28.423540 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2108/4180] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:24:28 2022] PUT /identity/v3/projects/c51d73d877bd4403b6ab1c8c694b3c90/users/221f4f1d6b764f6f95f77f7100963f0f/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:24:28.434452 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0f50a-b565-4c7e-ab89-a376c4b767bc None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:28.436407 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0f50a-b565-4c7e-ab89-a376c4b767bc None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:28.438625 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0f50a-b565-4c7e-ab89-a376c4b767bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:28.511382 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-99f0f50a-b565-4c7e-ab89-a376c4b767bc None None] MFA Rules not processed for user `221f4f1d6b764f6f95f77f7100963f0f`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:24:28.512948 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-99f0f50a-b565-4c7e-ab89-a376c4b767bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:28.645685 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2109/4181] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:24:28 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:24:28.659591 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f0f50a-b565-4c7e-ab89-a376c4b767bc None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:28.661885 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d90eedde-c3ef-4dcc-80ea-a38a43349863 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7f2d4818aa7461da8f30ddfe7641d93'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:28.662761 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-99f0f50a-b565-4c7e-ab89-a376c4b767bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:28.672763 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d90eedde-c3ef-4dcc-80ea-a38a43349863 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7f2d4818aa7461da8f30ddfe7641d93'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:28.674283 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d90eedde-c3ef-4dcc-80ea-a38a43349863 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7f2d4818aa7461da8f30ddfe7641d93'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:28.755895 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f0f50a-b565-4c7e-ab89-a376c4b767bc None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:28.770354 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab76f6b6-2076-41d5-8d4a-cf84f8cc8675 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:28.771109 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76f6b6-2076-41d5-8d4a-cf84f8cc8675 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:28.771461 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76f6b6-2076-41d5-8d4a-cf84f8cc8675 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:28.771844 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76f6b6-2076-41d5-8d4a-cf84f8cc8675 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:28.794574 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d90eedde-c3ef-4dcc-80ea-a38a43349863 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7f2d4818aa7461da8f30ddfe7641d93'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:28.822076 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d90eedde-c3ef-4dcc-80ea-a38a43349863 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7f2d4818aa7461da8f30ddfe7641d93'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:28.833368 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2073/4182] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:24:28 2022] DELETE /identity/v3/users/a7f2d4818aa7461da8f30ddfe7641d93 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:24:28.899802 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab76f6b6-2076-41d5-8d4a-cf84f8cc8675 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:28.902836 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab76f6b6-2076-41d5-8d4a-cf84f8cc8675 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:28.920508 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2110/4183] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:24:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:24:29.205926 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90eedde-c3ef-4dcc-80ea-a38a43349863 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:29.207783 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-d90eedde-c3ef-4dcc-80ea-a38a43349863 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:29.319312 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90eedde-c3ef-4dcc-80ea-a38a43349863 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:29.326992 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d52802-e672-4777-9d87-eee5ca1b2759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:29.327926 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d52802-e672-4777-9d87-eee5ca1b2759 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:29.328211 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d52802-e672-4777-9d87-eee5ca1b2759 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:29.328485 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d52802-e672-4777-9d87-eee5ca1b2759 admin admin] PATH_INFO: `/v3/projects/155b6f457be24818bb00db2560ef96fe` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:29.329769 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d52802-e672-4777-9d87-eee5ca1b2759 admin admin] RBAC: Authorizing `identity:delete_project(project_id=155b6f457be24818bb00db2560ef96fe)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:29.331735 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d52802-e672-4777-9d87-eee5ca1b2759 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:29.450485 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-83d52802-e672-4777-9d87-eee5ca1b2759 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '155b6f457be24818bb00db2560ef96fe', 'request_id': 'req-83d52802-e672-4777-9d87-eee5ca1b2759'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:29.456555 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-83d52802-e672-4777-9d87-eee5ca1b2759 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '155b6f457be24818bb00db2560ef96fe', 'request_id': 'req-83d52802-e672-4777-9d87-eee5ca1b2759'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:29.464712 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-83d52802-e672-4777-9d87-eee5ca1b2759 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '155b6f457be24818bb00db2560ef96fe', 'request_id': 'req-83d52802-e672-4777-9d87-eee5ca1b2759'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:29.540411 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-83d52802-e672-4777-9d87-eee5ca1b2759 admin admin] The token cache is being invalidate because project 155b6f457be24818bb00db2560ef96fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:24:29.540891 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-83d52802-e672-4777-9d87-eee5ca1b2759 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:29.541977 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-83d52802-e672-4777-9d87-eee5ca1b2759 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:29.544594 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2074/4184] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:24:29 2022] DELETE /identity/v3/projects/155b6f457be24818bb00db2560ef96fe => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:24:29.550872 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da5ddbf-5792-48f5-91e3-cc16b9b1bd38 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:29.551395 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da5ddbf-5792-48f5-91e3-cc16b9b1bd38 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:29.551509 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da5ddbf-5792-48f5-91e3-cc16b9b1bd38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:29.587507 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-4da5ddbf-5792-48f5-91e3-cc16b9b1bd38 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:24:29.590849 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-4da5ddbf-5792-48f5-91e3-cc16b9b1bd38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:29.661550 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d52802-e672-4777-9d87-eee5ca1b2759 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:29.666252 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-83d52802-e672-4777-9d87-eee5ca1b2759 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:29.711173 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2111/4185] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:24:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:24:29.720611 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e514c9-1e6b-4c1f-8b79-052165d1e3e6 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:29.721138 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e514c9-1e6b-4c1f-8b79-052165d1e3e6 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:29.721442 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e514c9-1e6b-4c1f-8b79-052165d1e3e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:29.755455 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-33e514c9-1e6b-4c1f-8b79-052165d1e3e6 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:24:29.756453 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-33e514c9-1e6b-4c1f-8b79-052165d1e3e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:29.770839 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2112/4186] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:24:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:24:29.778207 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e514c9-1e6b-4c1f-8b79-052165d1e3e6 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:29.782933 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e514c9-1e6b-4c1f-8b79-052165d1e3e6 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:29.785085 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d52802-e672-4777-9d87-eee5ca1b2759 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:29.788837 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357198fb-2942-4a21-a7cb-ebf74df7598e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:29.789755 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357198fb-2942-4a21-a7cb-ebf74df7598e admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:29.790196 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357198fb-2942-4a21-a7cb-ebf74df7598e admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:29.790642 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357198fb-2942-4a21-a7cb-ebf74df7598e admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:29.791405 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f443bb15-789f-447f-b6e5-46c09e774b3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:29.792305 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357198fb-2942-4a21-a7cb-ebf74df7598e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:24:29.792802 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357198fb-2942-4a21-a7cb-ebf74df7598e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:29.792955 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443bb15-789f-447f-b6e5-46c09e774b3f service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:29.793397 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443bb15-789f-447f-b6e5-46c09e774b3f service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:29.794026 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443bb15-789f-447f-b6e5-46c09e774b3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:29.794521 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357198fb-2942-4a21-a7cb-ebf74df7598e admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:29.797337 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-f443bb15-789f-447f-b6e5-46c09e774b3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:29.812157 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2113/4187] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:24:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:24:29.813131 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357198fb-2942-4a21-a7cb-ebf74df7598e admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:29.824682 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357198fb-2942-4a21-a7cb-ebf74df7598e admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:29.829966 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc96c1e7-03b3-46df-abf8-27012fcb9583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:29.830685 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc96c1e7-03b3-46df-abf8-27012fcb9583 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:29.830978 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc96c1e7-03b3-46df-abf8-27012fcb9583 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:29.831261 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc96c1e7-03b3-46df-abf8-27012fcb9583 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:29.832807 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc96c1e7-03b3-46df-abf8-27012fcb9583 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:29.834330 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc96c1e7-03b3-46df-abf8-27012fcb9583 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:29.878619 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f443bb15-789f-447f-b6e5-46c09e774b3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:29.880158 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f443bb15-789f-447f-b6e5-46c09e774b3f service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:29.891214 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2075/4188] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:24:29 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:24:29.934752 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2114/4189] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:24:29 2022] POST /identity/v3/projects => generated 365 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:24:29.937359 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb4ac1-1961-41d1-b909-fc22d37aa78e None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:29.937916 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb4ac1-1961-41d1-b909-fc22d37aa78e None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:29.939065 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb4ac1-1961-41d1-b909-fc22d37aa78e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:29.940925 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc96c1e7-03b3-46df-abf8-27012fcb9583 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:29.977816 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-d0cb4ac1-1961-41d1-b909-fc22d37aa78e None None] MFA Rules not processed for user `87538f2309714545bd47f228b6505883`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:24:29.982014 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-d0cb4ac1-1961-41d1-b909-fc22d37aa78e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:30.039719 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc96c1e7-03b3-46df-abf8-27012fcb9583 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:30.045658 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76bbd93-1d31-4509-8fc3-dce9c5f458e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:30.046392 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76bbd93-1d31-4509-8fc3-dce9c5f458e0 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:30.046671 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76bbd93-1d31-4509-8fc3-dce9c5f458e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:30.046949 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76bbd93-1d31-4509-8fc3-dce9c5f458e0 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:30.048021 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76bbd93-1d31-4509-8fc3-dce9c5f458e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:30.049747 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76bbd93-1d31-4509-8fc3-dce9c5f458e0 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:30.078597 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2076/4190] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:24:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:24:30.157099 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2115/4191] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:24:29 2022] POST /identity/v3/users => generated 283 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:24:30.161839 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb4ac1-1961-41d1-b909-fc22d37aa78e None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:30.178069 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb4ac1-1961-41d1-b909-fc22d37aa78e None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:30.186709 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f6e85-e50c-4d6d-be48-9f3c05506167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:30.187988 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f6e85-e50c-4d6d-be48-9f3c05506167 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:30.188460 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f6e85-e50c-4d6d-be48-9f3c05506167 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:30.188924 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f6e85-e50c-4d6d-be48-9f3c05506167 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:30.189995 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018f6e85-e50c-4d6d-be48-9f3c05506167 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:30.191973 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018f6e85-e50c-4d6d-be48-9f3c05506167 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:30.205787 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2077/4192] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:24:30 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:24:30.209445 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76bbd93-1d31-4509-8fc3-dce9c5f458e0 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:30.222394 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76bbd93-1d31-4509-8fc3-dce9c5f458e0 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:30.228084 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c47a6e-f220-4d6e-a0d8-1f94964e916f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:30.228761 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c47a6e-f220-4d6e-a0d8-1f94964e916f admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:30.229127 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c47a6e-f220-4d6e-a0d8-1f94964e916f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:30.229493 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c47a6e-f220-4d6e-a0d8-1f94964e916f admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:30.230231 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c47a6e-f220-4d6e-a0d8-1f94964e916f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:30.231873 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c47a6e-f220-4d6e-a0d8-1f94964e916f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:30.249117 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2116/4193] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:24:30 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:24:30.252581 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f6e85-e50c-4d6d-be48-9f3c05506167 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:30.270226 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f6e85-e50c-4d6d-be48-9f3c05506167 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:30.278551 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc0731-2790-4d5b-9e50-1c7fd710fe98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:30.278551 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc0731-2790-4d5b-9e50-1c7fd710fe98 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:30.278551 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc0731-2790-4d5b-9e50-1c7fd710fe98 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:30.278551 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc0731-2790-4d5b-9e50-1c7fd710fe98 admin admin] PATH_INFO: `/v3/projects/c4fe0b96d43b41aaaa0e8e238888786a/users/ed0a76be93e44fa887cb813a8879e04d/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:30.296091 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcc0731-2790-4d5b-9e50-1c7fd710fe98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4fe0b96d43b41aaaa0e8e238888786a, user_id=ed0a76be93e44fa887cb813a8879e04d, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:30.299745 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcc0731-2790-4d5b-9e50-1c7fd710fe98 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:30.438147 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2078/4194] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:24:30 2022] PUT /identity/v3/projects/c4fe0b96d43b41aaaa0e8e238888786a/users/ed0a76be93e44fa887cb813a8879e04d/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:24:30.439674 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13615c35-bacd-4bbe-bc92-750e9210176a None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:30.439974 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13615c35-bacd-4bbe-bc92-750e9210176a None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:30.440258 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13615c35-bacd-4bbe-bc92-750e9210176a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:30.464243 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-13615c35-bacd-4bbe-bc92-750e9210176a None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:24:30.466779 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-13615c35-bacd-4bbe-bc92-750e9210176a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:30.578784 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2117/4195] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:24:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:24:30.587362 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc0731-2790-4d5b-9e50-1c7fd710fe98 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:30.665902 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc0731-2790-4d5b-9e50-1c7fd710fe98 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:30.672235 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f905dd-1fbc-43a8-bcfb-69160a929842 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:30.673627 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f905dd-1fbc-43a8-bcfb-69160a929842 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:30.673627 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f905dd-1fbc-43a8-bcfb-69160a929842 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:30.674282 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f905dd-1fbc-43a8-bcfb-69160a929842 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:30.685699 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f905dd-1fbc-43a8-bcfb-69160a929842 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:30.687722 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f905dd-1fbc-43a8-bcfb-69160a929842 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:30.708957 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2079/4196] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:24:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:24:30.927298 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb55534-3f6b-4917-8b12-8f624a4800b7 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:30.928284 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb55534-3f6b-4917-8b12-8f624a4800b7 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:30.928645 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb55534-3f6b-4917-8b12-8f624a4800b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:30.961393 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-ccb55534-3f6b-4917-8b12-8f624a4800b7 None None] MFA Rules not processed for user `87538f2309714545bd47f228b6505883`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:24:30.967862 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ccb55534-3f6b-4917-8b12-8f624a4800b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:31.032464 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a5c32-3e52-466d-afdc-f0369d3d2286 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:31.033059 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a5c32-3e52-466d-afdc-f0369d3d2286 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:31.033699 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a5c32-3e52-466d-afdc-f0369d3d2286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:31.056637 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2118/4197] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:24:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:24:31.115311 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-d63a5c32-3e52-466d-afdc-f0369d3d2286 None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:24:31.117212 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-d63a5c32-3e52-466d-afdc-f0369d3d2286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:31.208818 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2080/4198] 10.222.0.52 () {58 vars in 967 bytes} [Sat May 14 21:24:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:24:31.226330 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb55534-3f6b-4917-8b12-8f624a4800b7 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:31.226678 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ccb55534-3f6b-4917-8b12-8f624a4800b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:31.399584 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb55534-3f6b-4917-8b12-8f624a4800b7 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:31.410233 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dbfa36-21c2-4e3a-b7a9-8203fc7d7138 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:31.411292 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dbfa36-21c2-4e3a-b7a9-8203fc7d7138 service swift] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:31.411622 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dbfa36-21c2-4e3a-b7a9-8203fc7d7138 service swift] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:31.412325 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dbfa36-21c2-4e3a-b7a9-8203fc7d7138 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:31.424465 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dbfa36-21c2-4e3a-b7a9-8203fc7d7138 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:31.426496 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dbfa36-21c2-4e3a-b7a9-8203fc7d7138 service swift] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:31.450280 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2119/4199] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 21:24:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 21:24:32.446907 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb4bda-555e-4fc4-9d83-e05c7b7dc740 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:32.447504 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb4bda-555e-4fc4-9d83-e05c7b7dc740 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:32.447504 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb4bda-555e-4fc4-9d83-e05c7b7dc740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:32.466292 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-20fb4bda-555e-4fc4-9d83-e05c7b7dc740 None None] MFA Rules not processed for user `87538f2309714545bd47f228b6505883`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:24:32.467895 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-20fb4bda-555e-4fc4-9d83-e05c7b7dc740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:32.475904 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2081/4200] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:24:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:24:33.305542 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48378545-a497-47e2-90bd-6e9d4fe59fc8 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:33.306748 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48378545-a497-47e2-90bd-6e9d4fe59fc8 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:33.306885 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48378545-a497-47e2-90bd-6e9d4fe59fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:33.348049 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-48378545-a497-47e2-90bd-6e9d4fe59fc8 None None] MFA Rules not processed for user `ed0a76be93e44fa887cb813a8879e04d`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:24:33.349706 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-48378545-a497-47e2-90bd-6e9d4fe59fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:33.458925 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2120/4201] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:24:33 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:24:33.472307 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293fa4b5-35cd-4a18-8475-4c4fb7b753b8 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:33.474111 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293fa4b5-35cd-4a18-8475-4c4fb7b753b8 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:33.474911 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293fa4b5-35cd-4a18-8475-4c4fb7b753b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:33.499304 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-293fa4b5-35cd-4a18-8475-4c4fb7b753b8 None None] MFA Rules not processed for user `ed0a76be93e44fa887cb813a8879e04d`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:24:33.501374 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-293fa4b5-35cd-4a18-8475-4c4fb7b753b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:33.510044 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2082/4202] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:24:33 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:24:33.724609 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48378545-a497-47e2-90bd-6e9d4fe59fc8 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:33.726437 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-48378545-a497-47e2-90bd-6e9d4fe59fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:33.737460 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10436f-d428-4b25-9f36-939d36682fc9 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:33.737845 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10436f-d428-4b25-9f36-939d36682fc9 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:33.738206 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10436f-d428-4b25-9f36-939d36682fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:33.764730 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-7a10436f-d428-4b25-9f36-939d36682fc9 None None] MFA Rules not processed for user `87538f2309714545bd47f228b6505883`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:24:33.766754 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-7a10436f-d428-4b25-9f36-939d36682fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:33.783649 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2083/4203] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:24:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:24:33.873766 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48378545-a497-47e2-90bd-6e9d4fe59fc8 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:33.888284 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2323af36-c52b-4a87-8fb8-5196e4e6a80d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:33.889049 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323af36-c52b-4a87-8fb8-5196e4e6a80d service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:33.889333 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323af36-c52b-4a87-8fb8-5196e4e6a80d service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:33.889750 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323af36-c52b-4a87-8fb8-5196e4e6a80d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:33.899145 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2323af36-c52b-4a87-8fb8-5196e4e6a80d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:33.901394 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2323af36-c52b-4a87-8fb8-5196e4e6a80d service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:33.912922 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2121/4204] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:24:33 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:24:34.158686 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843f2bb-9f45-4d02-9f53-55d7811ef92c None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:34.159249 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843f2bb-9f45-4d02-9f53-55d7811ef92c None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:34.159571 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843f2bb-9f45-4d02-9f53-55d7811ef92c None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:34.161157 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2084/4205] 10.222.0.52 () {54 vars in 912 bytes} [Sat May 14 21:24:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:24:34.167055 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ffb43-1129-4d8d-bb68-8a687af2d7cc None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:34.167340 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ffb43-1129-4d8d-bb68-8a687af2d7cc None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:34.168241 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ffb43-1129-4d8d-bb68-8a687af2d7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:34.233081 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-e80ffb43-1129-4d8d-bb68-8a687af2d7cc None None] MFA Rules not processed for user `0812ae67e44d483baf2dbb1a5332a1d7`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:24:34.236821 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e80ffb43-1129-4d8d-bb68-8a687af2d7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:34.339368 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2122/4206] 10.222.0.52 () {58 vars in 1009 bytes} [Sat May 14 21:24:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:24:34.380031 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4843f2bb-9f45-4d02-9f53-55d7811ef92c None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:34.386496 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-4843f2bb-9f45-4d02-9f53-55d7811ef92c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:34.404156 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4843f2bb-9f45-4d02-9f53-55d7811ef92c None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:34.415069 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe30672c-806d-474d-8c64-09635179fa67 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:34.415069 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe30672c-806d-474d-8c64-09635179fa67 service placement] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:34.415069 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe30672c-806d-474d-8c64-09635179fa67 service placement] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:34.415069 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe30672c-806d-474d-8c64-09635179fa67 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:34.425138 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe30672c-806d-474d-8c64-09635179fa67 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:34.428764 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe30672c-806d-474d-8c64-09635179fa67 service placement] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:34.441000 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2085/4207] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:24:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:24:35.937760 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3892d60-72be-4af7-adde-ab7a27529405 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:35.938300 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3892d60-72be-4af7-adde-ab7a27529405 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:35.938505 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3892d60-72be-4af7-adde-ab7a27529405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:35.956835 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-c3892d60-72be-4af7-adde-ab7a27529405 None None] MFA Rules not processed for user `87538f2309714545bd47f228b6505883`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:24:35.958051 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c3892d60-72be-4af7-adde-ab7a27529405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:35.966018 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2123/4208] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:24:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:24:36.445232 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c84bd-c733-40e9-a768-a5422dabfffd None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:36.446705 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c84bd-c733-40e9-a768-a5422dabfffd None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:36.447191 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c84bd-c733-40e9-a768-a5422dabfffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:36.481506 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-351c84bd-c733-40e9-a768-a5422dabfffd None None] MFA Rules not processed for user `87538f2309714545bd47f228b6505883`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:24:36.484478 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-351c84bd-c733-40e9-a768-a5422dabfffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:36.507305 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2086/4209] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:24:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:24:37.070301 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2337aa01-7ecb-41bc-ab64-a39d166e6850 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:37.071304 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2337aa01-7ecb-41bc-ab64-a39d166e6850 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:37.071824 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2337aa01-7ecb-41bc-ab64-a39d166e6850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:37.094708 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-2337aa01-7ecb-41bc-ab64-a39d166e6850 None None] MFA Rules not processed for user `87538f2309714545bd47f228b6505883`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:24:37.096468 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-2337aa01-7ecb-41bc-ab64-a39d166e6850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:37.106144 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2124/4210] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:24:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:24:38.292700 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e44a9-1278-4bfe-ba29-1000c47c7801 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:38.293749 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e44a9-1278-4bfe-ba29-1000c47c7801 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:38.294300 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e44a9-1278-4bfe-ba29-1000c47c7801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:38.315499 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-334e44a9-1278-4bfe-ba29-1000c47c7801 None None] MFA Rules not processed for user `87538f2309714545bd47f228b6505883`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:24:38.317257 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-334e44a9-1278-4bfe-ba29-1000c47c7801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:38.327381 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2087/4211] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:24:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:24:43.819901 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2337aa01-7ecb-41bc-ab64-a39d166e6850 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:43.822082 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-2337aa01-7ecb-41bc-ab64-a39d166e6850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:43.841980 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2337aa01-7ecb-41bc-ab64-a39d166e6850 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:43.849528 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330b9d92-7095-4fa4-a480-72e5a22a4919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:43.850634 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b9d92-7095-4fa4-a480-72e5a22a4919 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:43.851073 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b9d92-7095-4fa4-a480-72e5a22a4919 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:43.851532 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b9d92-7095-4fa4-a480-72e5a22a4919 admin admin] PATH_INFO: `/v3/users/0772d2b65486482db15e8be5aa6d1bf8` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:43.852934 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330b9d92-7095-4fa4-a480-72e5a22a4919 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0772d2b65486482db15e8be5aa6d1bf8)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:43.857003 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330b9d92-7095-4fa4-a480-72e5a22a4919 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:44.079673 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-330b9d92-7095-4fa4-a480-72e5a22a4919 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0772d2b65486482db15e8be5aa6d1bf8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:44.101948 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-330b9d92-7095-4fa4-a480-72e5a22a4919 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0772d2b65486482db15e8be5aa6d1bf8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:44.111322 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-330b9d92-7095-4fa4-a480-72e5a22a4919 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0772d2b65486482db15e8be5aa6d1bf8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:44.177143 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-330b9d92-7095-4fa4-a480-72e5a22a4919 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0772d2b65486482db15e8be5aa6d1bf8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:44.177783 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-330b9d92-7095-4fa4-a480-72e5a22a4919 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0772d2b65486482db15e8be5aa6d1bf8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:44.182208 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be017d66-a4f9-4dcc-b4f0-24171fed06e0 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:44.182208 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be017d66-a4f9-4dcc-b4f0-24171fed06e0 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:44.182208 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be017d66-a4f9-4dcc-b4f0-24171fed06e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:44.188621 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2125/4212] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:24:43 2022] DELETE /identity/v3/users/0772d2b65486482db15e8be5aa6d1bf8 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:24:44.195255 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127eccd4-00ed-4f3a-ad71-d43c30ecb054 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:44.195652 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127eccd4-00ed-4f3a-ad71-d43c30ecb054 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:44.196023 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127eccd4-00ed-4f3a-ad71-d43c30ecb054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:44.206074 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-be017d66-a4f9-4dcc-b4f0-24171fed06e0 None None] MFA Rules not processed for user `87538f2309714545bd47f228b6505883`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:24:44.210593 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-be017d66-a4f9-4dcc-b4f0-24171fed06e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:44.236358 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-127eccd4-00ed-4f3a-ad71-d43c30ecb054 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:24:44.238157 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-127eccd4-00ed-4f3a-ad71-d43c30ecb054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:44.311339 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2088/4213] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:24:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:24:44.338451 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2126/4214] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:24:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:24:44.346824 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be017d66-a4f9-4dcc-b4f0-24171fed06e0 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:44.353022 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-be017d66-a4f9-4dcc-b4f0-24171fed06e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:44.434414 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be017d66-a4f9-4dcc-b4f0-24171fed06e0 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:44.439288 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725b0140-c414-4c70-a42d-53b6acbd2f69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:44.440726 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b0140-c414-4c70-a42d-53b6acbd2f69 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:44.441239 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b0140-c414-4c70-a42d-53b6acbd2f69 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:44.441700 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b0140-c414-4c70-a42d-53b6acbd2f69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:44.455185 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725b0140-c414-4c70-a42d-53b6acbd2f69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:44.457498 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725b0140-c414-4c70-a42d-53b6acbd2f69 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:44.479594 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2089/4215] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:24:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:24:44.856816 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6273efa-4bc0-4c8c-a309-a54afd982b6c None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:44.857355 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6273efa-4bc0-4c8c-a309-a54afd982b6c None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:44.857355 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6273efa-4bc0-4c8c-a309-a54afd982b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:44.880088 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-f6273efa-4bc0-4c8c-a309-a54afd982b6c None None] MFA Rules not processed for user `87538f2309714545bd47f228b6505883`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:24:44.881394 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-f6273efa-4bc0-4c8c-a309-a54afd982b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:44.901734 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725b0140-c414-4c70-a42d-53b6acbd2f69 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:44.903159 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2127/4216] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:24:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:24:44.903773 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-725b0140-c414-4c70-a42d-53b6acbd2f69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:44.930054 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725b0140-c414-4c70-a42d-53b6acbd2f69 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:44.950129 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb475a8-0aac-429a-8de6-58655fd7d16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:44.952464 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb475a8-0aac-429a-8de6-58655fd7d16d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:44.954560 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb475a8-0aac-429a-8de6-58655fd7d16d admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:44.955006 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb475a8-0aac-429a-8de6-58655fd7d16d admin admin] PATH_INFO: `/v3/projects/fd178d4c14994f26b3b475ddac4a05e7` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:44.957850 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb475a8-0aac-429a-8de6-58655fd7d16d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd178d4c14994f26b3b475ddac4a05e7)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:44.964418 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb475a8-0aac-429a-8de6-58655fd7d16d admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:45.220427 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-cfb475a8-0aac-429a-8de6-58655fd7d16d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd178d4c14994f26b3b475ddac4a05e7', 'request_id': 'req-cfb475a8-0aac-429a-8de6-58655fd7d16d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:45.220427 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-cfb475a8-0aac-429a-8de6-58655fd7d16d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd178d4c14994f26b3b475ddac4a05e7', 'request_id': 'req-cfb475a8-0aac-429a-8de6-58655fd7d16d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:45.235002 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-cfb475a8-0aac-429a-8de6-58655fd7d16d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd178d4c14994f26b3b475ddac4a05e7', 'request_id': 'req-cfb475a8-0aac-429a-8de6-58655fd7d16d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:45.326350 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-cfb475a8-0aac-429a-8de6-58655fd7d16d admin admin] The token cache is being invalidate because project fd178d4c14994f26b3b475ddac4a05e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:24:45.326934 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-cfb475a8-0aac-429a-8de6-58655fd7d16d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:45.327938 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-cfb475a8-0aac-429a-8de6-58655fd7d16d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:45.332236 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2090/4217] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:24:44 2022] DELETE /identity/v3/projects/fd178d4c14994f26b3b475ddac4a05e7 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:24:45.342553 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6273efa-4bc0-4c8c-a309-a54afd982b6c None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:45.358534 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6273efa-4bc0-4c8c-a309-a54afd982b6c None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:45.453868 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3311c45-37a7-4744-bd38-ad6995cdc5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:45.455517 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3311c45-37a7-4744-bd38-ad6995cdc5e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:45.456058 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3311c45-37a7-4744-bd38-ad6995cdc5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:45.456536 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3311c45-37a7-4744-bd38-ad6995cdc5e4 admin admin] PATH_INFO: `/v3/users/221f4f1d6b764f6f95f77f7100963f0f` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:45.458238 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3311c45-37a7-4744-bd38-ad6995cdc5e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=221f4f1d6b764f6f95f77f7100963f0f)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:45.460791 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3311c45-37a7-4744-bd38-ad6995cdc5e4 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:45.718385 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b3311c45-37a7-4744-bd38-ad6995cdc5e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '221f4f1d6b764f6f95f77f7100963f0f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:45.731740 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b3311c45-37a7-4744-bd38-ad6995cdc5e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '221f4f1d6b764f6f95f77f7100963f0f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:45.739316 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b3311c45-37a7-4744-bd38-ad6995cdc5e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '221f4f1d6b764f6f95f77f7100963f0f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:45.808310 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b3311c45-37a7-4744-bd38-ad6995cdc5e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '221f4f1d6b764f6f95f77f7100963f0f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:45.809147 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b3311c45-37a7-4744-bd38-ad6995cdc5e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '221f4f1d6b764f6f95f77f7100963f0f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:45.819748 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2128/4218] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:24:45 2022] DELETE /identity/v3/users/221f4f1d6b764f6f95f77f7100963f0f => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:24:46.259213 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb475a8-0aac-429a-8de6-58655fd7d16d admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:46.263015 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-cfb475a8-0aac-429a-8de6-58655fd7d16d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:46.289429 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb475a8-0aac-429a-8de6-58655fd7d16d admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:46.402424 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783ba921-6480-45d4-ac9b-46694065d9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:46.406306 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ba921-6480-45d4-ac9b-46694065d9e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:46.407077 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ba921-6480-45d4-ac9b-46694065d9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:46.407613 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ba921-6480-45d4-ac9b-46694065d9e6 admin admin] PATH_INFO: `/v3/projects/c51d73d877bd4403b6ab1c8c694b3c90` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:46.409225 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783ba921-6480-45d4-ac9b-46694065d9e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c51d73d877bd4403b6ab1c8c694b3c90)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:46.411366 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783ba921-6480-45d4-ac9b-46694065d9e6 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:46.591999 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-783ba921-6480-45d4-ac9b-46694065d9e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c51d73d877bd4403b6ab1c8c694b3c90', 'request_id': 'req-783ba921-6480-45d4-ac9b-46694065d9e6'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:46.602064 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-783ba921-6480-45d4-ac9b-46694065d9e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c51d73d877bd4403b6ab1c8c694b3c90', 'request_id': 'req-783ba921-6480-45d4-ac9b-46694065d9e6'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:46.610080 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-783ba921-6480-45d4-ac9b-46694065d9e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c51d73d877bd4403b6ab1c8c694b3c90', 'request_id': 'req-783ba921-6480-45d4-ac9b-46694065d9e6'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:46.697528 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-783ba921-6480-45d4-ac9b-46694065d9e6 admin admin] The token cache is being invalidate because project c51d73d877bd4403b6ab1c8c694b3c90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:24:46.697884 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-783ba921-6480-45d4-ac9b-46694065d9e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:46.698708 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-783ba921-6480-45d4-ac9b-46694065d9e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:46.700741 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2091/4219] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:24:46 2022] DELETE /identity/v3/projects/c51d73d877bd4403b6ab1c8c694b3c90 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:24:46.705854 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee9add-d89b-4208-a113-10eaf96ad1c2 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:46.706353 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee9add-d89b-4208-a113-10eaf96ad1c2 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:46.706450 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee9add-d89b-4208-a113-10eaf96ad1c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:46.730444 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-82ee9add-d89b-4208-a113-10eaf96ad1c2 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:24:46.732586 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-82ee9add-d89b-4208-a113-10eaf96ad1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:46.809626 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2129/4220] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:24:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:24:46.817419 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2400d5b-fb66-42dc-8cd2-f6c5c4ee5ef1 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:46.817712 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2400d5b-fb66-42dc-8cd2-f6c5c4ee5ef1 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:46.817993 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2400d5b-fb66-42dc-8cd2-f6c5c4ee5ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:46.848624 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-c2400d5b-fb66-42dc-8cd2-f6c5c4ee5ef1 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:24:46.849960 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c2400d5b-fb66-42dc-8cd2-f6c5c4ee5ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:46.863029 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2092/4221] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:24:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:24:46.868126 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ee9add-d89b-4208-a113-10eaf96ad1c2 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:46.895021 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ee9add-d89b-4208-a113-10eaf96ad1c2 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:46.902300 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca16c5-8411-4529-82c6-f1b884cd408c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:46.903301 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca16c5-8411-4529-82c6-f1b884cd408c admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:46.903668 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca16c5-8411-4529-82c6-f1b884cd408c admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:46.903955 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca16c5-8411-4529-82c6-f1b884cd408c admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:46.904886 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ca16c5-8411-4529-82c6-f1b884cd408c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:24:46.905202 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ca16c5-8411-4529-82c6-f1b884cd408c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:46.906868 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ca16c5-8411-4529-82c6-f1b884cd408c admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:46.920101 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2130/4222] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:24:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:24:46.926262 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2400d5b-fb66-42dc-8cd2-f6c5c4ee5ef1 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:46.938211 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2400d5b-fb66-42dc-8cd2-f6c5c4ee5ef1 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:46.943181 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06bdaa7-5d76-477a-8fb6-6be91c0c7fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:46.943884 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06bdaa7-5d76-477a-8fb6-6be91c0c7fbf admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:46.944169 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06bdaa7-5d76-477a-8fb6-6be91c0c7fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:46.944446 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06bdaa7-5d76-477a-8fb6-6be91c0c7fbf admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:46.945167 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06bdaa7-5d76-477a-8fb6-6be91c0c7fbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:46.947798 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06bdaa7-5d76-477a-8fb6-6be91c0c7fbf admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:47.128829 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2093/4223] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:24:46 2022] POST /identity/v3/projects => generated 367 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:24:47.131203 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca16c5-8411-4529-82c6-f1b884cd408c admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:47.142095 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca16c5-8411-4529-82c6-f1b884cd408c admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:47.202968 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60948de-0a42-4606-b4b0-5d9e75b3355a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:47.204031 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60948de-0a42-4606-b4b0-5d9e75b3355a admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:47.204323 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60948de-0a42-4606-b4b0-5d9e75b3355a admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:47.204603 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60948de-0a42-4606-b4b0-5d9e75b3355a admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:47.205457 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60948de-0a42-4606-b4b0-5d9e75b3355a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:47.207418 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60948de-0a42-4606-b4b0-5d9e75b3355a admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:47.291984 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2131/4224] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:24:47 2022] POST /identity/v3/users => generated 284 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:24:47.295894 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06bdaa7-5d76-477a-8fb6-6be91c0c7fbf admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:47.307034 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06bdaa7-5d76-477a-8fb6-6be91c0c7fbf admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:47.312655 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c4a6d-9bc4-4121-89a1-440537d828a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:47.313366 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c4a6d-9bc4-4121-89a1-440537d828a1 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:47.313692 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c4a6d-9bc4-4121-89a1-440537d828a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:47.317965 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c4a6d-9bc4-4121-89a1-440537d828a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:47.317965 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976c4a6d-9bc4-4121-89a1-440537d828a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:47.317965 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976c4a6d-9bc4-4121-89a1-440537d828a1 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:47.329755 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2094/4225] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:24:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:24:47.333542 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60948de-0a42-4606-b4b0-5d9e75b3355a admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:47.353518 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60948de-0a42-4606-b4b0-5d9e75b3355a admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:47.353518 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5189a3-84b1-4c60-bc8a-13e22a945a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:47.353945 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5189a3-84b1-4c60-bc8a-13e22a945a48 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:47.354236 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5189a3-84b1-4c60-bc8a-13e22a945a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:47.354512 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5189a3-84b1-4c60-bc8a-13e22a945a48 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:47.355238 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5189a3-84b1-4c60-bc8a-13e22a945a48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:47.357000 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5189a3-84b1-4c60-bc8a-13e22a945a48 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:47.368124 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2132/4226] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:24:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:24:47.372685 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c4a6d-9bc4-4121-89a1-440537d828a1 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:47.383516 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c4a6d-9bc4-4121-89a1-440537d828a1 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:47.389423 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c377e84-2203-4809-96f1-fc7e131ebf8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:47.390347 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c377e84-2203-4809-96f1-fc7e131ebf8e admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:47.390663 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c377e84-2203-4809-96f1-fc7e131ebf8e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:47.390946 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c377e84-2203-4809-96f1-fc7e131ebf8e admin admin] PATH_INFO: `/v3/projects/4ab567f7ad2e4635b2a6e93c69fae605/users/166d10b4eba34f9abd8140d75bc5b173/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:47.406873 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c377e84-2203-4809-96f1-fc7e131ebf8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ab567f7ad2e4635b2a6e93c69fae605, user_id=166d10b4eba34f9abd8140d75bc5b173, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:47.410104 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c377e84-2203-4809-96f1-fc7e131ebf8e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:47.481474 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2095/4227] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:24:47 2022] PUT /identity/v3/projects/4ab567f7ad2e4635b2a6e93c69fae605/users/166d10b4eba34f9abd8140d75bc5b173/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:24:47.492961 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a6fb69-9e7b-4425-9ba9-a99d5b948ab9 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:47.493443 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a6fb69-9e7b-4425-9ba9-a99d5b948ab9 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:47.493726 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a6fb69-9e7b-4425-9ba9-a99d5b948ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:47.524613 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-31a6fb69-9e7b-4425-9ba9-a99d5b948ab9 None None] MFA Rules not processed for user `166d10b4eba34f9abd8140d75bc5b173`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:24:47.526618 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-31a6fb69-9e7b-4425-9ba9-a99d5b948ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:47.595164 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2133/4228] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:24:47 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:24:47.599791 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c377e84-2203-4809-96f1-fc7e131ebf8e admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:47.660415 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c377e84-2203-4809-96f1-fc7e131ebf8e admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:47.665163 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbfc40c-75c2-4414-a509-05839b6b35dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:47.665872 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbfc40c-75c2-4414-a509-05839b6b35dd admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:47.679381 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbfc40c-75c2-4414-a509-05839b6b35dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:47.679381 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbfc40c-75c2-4414-a509-05839b6b35dd admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:47.679381 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbfc40c-75c2-4414-a509-05839b6b35dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:47.679381 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbfc40c-75c2-4414-a509-05839b6b35dd admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:47.818261 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2096/4229] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:24:47 2022] POST /identity/v3/projects => generated 367 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:24:47.822874 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a6fb69-9e7b-4425-9ba9-a99d5b948ab9 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:47.834948 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a6fb69-9e7b-4425-9ba9-a99d5b948ab9 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:47.896603 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8e7ceb-50cf-4ed8-bc61-c1d8d91ade30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:47.897198 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e7ceb-50cf-4ed8-bc61-c1d8d91ade30 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:47.897479 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e7ceb-50cf-4ed8-bc61-c1d8d91ade30 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:47.897756 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e7ceb-50cf-4ed8-bc61-c1d8d91ade30 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:47.898446 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8e7ceb-50cf-4ed8-bc61-c1d8d91ade30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:47.900546 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8e7ceb-50cf-4ed8-bc61-c1d8d91ade30 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:47.995575 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2134/4230] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:24:47 2022] POST /identity/v3/users => generated 290 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:24:47.999789 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbfc40c-75c2-4414-a509-05839b6b35dd admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:48.011551 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbfc40c-75c2-4414-a509-05839b6b35dd admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:48.016601 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572ff312-78b9-453f-af48-4f34f856dee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:48.017469 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ff312-78b9-453f-af48-4f34f856dee8 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:48.017752 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ff312-78b9-453f-af48-4f34f856dee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:48.018029 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ff312-78b9-453f-af48-4f34f856dee8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:48.018749 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572ff312-78b9-453f-af48-4f34f856dee8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:48.020386 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572ff312-78b9-453f-af48-4f34f856dee8 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:48.033368 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2097/4231] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:24:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:24:48.037693 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8e7ceb-50cf-4ed8-bc61-c1d8d91ade30 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:48.049194 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8e7ceb-50cf-4ed8-bc61-c1d8d91ade30 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:48.053825 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7871d1-d376-4779-ab68-23bfd06476b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:48.054817 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7871d1-d376-4779-ab68-23bfd06476b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:48.055133 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7871d1-d376-4779-ab68-23bfd06476b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:48.059098 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7871d1-d376-4779-ab68-23bfd06476b7 admin admin] PATH_INFO: `/v3/projects/4a017fe7c4734fc8be40fcfb1d2a643c/users/c9b6b0d133b24d9fb51440f61138a499/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:48.075740 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7871d1-d376-4779-ab68-23bfd06476b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a017fe7c4734fc8be40fcfb1d2a643c, user_id=c9b6b0d133b24d9fb51440f61138a499, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:48.078415 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7871d1-d376-4779-ab68-23bfd06476b7 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:48.363436 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2135/4232] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:24:48 2022] PUT /identity/v3/projects/4a017fe7c4734fc8be40fcfb1d2a643c/users/c9b6b0d133b24d9fb51440f61138a499/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:24:48.363651 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572ff312-78b9-453f-af48-4f34f856dee8 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:48.373558 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572ff312-78b9-453f-af48-4f34f856dee8 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:48.429773 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3133731d-fefd-4b45-81e5-dd8a84de9e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:48.430440 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3133731d-fefd-4b45-81e5-dd8a84de9e24 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:48.430735 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3133731d-fefd-4b45-81e5-dd8a84de9e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:48.431052 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3133731d-fefd-4b45-81e5-dd8a84de9e24 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:48.432346 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3133731d-fefd-4b45-81e5-dd8a84de9e24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:48.433928 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3133731d-fefd-4b45-81e5-dd8a84de9e24 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:48.443404 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2098/4233] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:24:48 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:24:48.448387 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7871d1-d376-4779-ab68-23bfd06476b7 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:48.458678 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7871d1-d376-4779-ab68-23bfd06476b7 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:48.463271 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5351dd-404c-46fd-b083-8de34e799c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:48.464118 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5351dd-404c-46fd-b083-8de34e799c10 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:48.464402 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5351dd-404c-46fd-b083-8de34e799c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:48.464681 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5351dd-404c-46fd-b083-8de34e799c10 admin admin] PATH_INFO: `/v3/projects/4a017fe7c4734fc8be40fcfb1d2a643c/users/c9b6b0d133b24d9fb51440f61138a499/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:48.466624 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5351dd-404c-46fd-b083-8de34e799c10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a017fe7c4734fc8be40fcfb1d2a643c, user_id=c9b6b0d133b24d9fb51440f61138a499, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:48.469308 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5351dd-404c-46fd-b083-8de34e799c10 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:48.479261 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2136/4234] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:24:48 2022] PUT /identity/v3/projects/4a017fe7c4734fc8be40fcfb1d2a643c/users/c9b6b0d133b24d9fb51440f61138a499/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:24:48.489434 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ca49b-34f1-4061-a090-ff2663f2d8b2 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:48.489760 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ca49b-34f1-4061-a090-ff2663f2d8b2 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:48.490042 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ca49b-34f1-4061-a090-ff2663f2d8b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:48.516607 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-f63ca49b-34f1-4061-a090-ff2663f2d8b2 None None] MFA Rules not processed for user `c9b6b0d133b24d9fb51440f61138a499`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:24:48.517892 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-f63ca49b-34f1-4061-a090-ff2663f2d8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:48.591626 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2099/4235] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:24:48 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:24:48.599081 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5351dd-404c-46fd-b083-8de34e799c10 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:48.601306 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-7f5351dd-404c-46fd-b083-8de34e799c10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:48.601764 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63ca49b-34f1-4061-a090-ff2663f2d8b2 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:48.603151 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-f63ca49b-34f1-4061-a090-ff2663f2d8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:48.663148 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5351dd-404c-46fd-b083-8de34e799c10 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:48.667750 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6149fcb0-8520-49bd-818a-97282fe4fcc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:48.668406 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149fcb0-8520-49bd-818a-97282fe4fcc4 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:48.668688 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149fcb0-8520-49bd-818a-97282fe4fcc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:48.669094 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149fcb0-8520-49bd-818a-97282fe4fcc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:48.672391 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63ca49b-34f1-4061-a090-ff2663f2d8b2 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:48.678610 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6149fcb0-8520-49bd-818a-97282fe4fcc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:48.678776 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55272ea5-dd61-4aec-a224-cbb2af4dd4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:48.679554 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55272ea5-dd61-4aec-a224-cbb2af4dd4b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:48.679901 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55272ea5-dd61-4aec-a224-cbb2af4dd4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:48.680085 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6149fcb0-8520-49bd-818a-97282fe4fcc4 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:48.680204 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55272ea5-dd61-4aec-a224-cbb2af4dd4b6 admin admin] PATH_INFO: `/v3/users/c4020cecd1174ff68101b6498780d00c` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:48.681331 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55272ea5-dd61-4aec-a224-cbb2af4dd4b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4020cecd1174ff68101b6498780d00c)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:48.683571 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55272ea5-dd61-4aec-a224-cbb2af4dd4b6 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:48.695326 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2137/4236] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:24:48 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:24:49.020623 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-55272ea5-dd61-4aec-a224-cbb2af4dd4b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4020cecd1174ff68101b6498780d00c'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:49.036859 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-55272ea5-dd61-4aec-a224-cbb2af4dd4b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4020cecd1174ff68101b6498780d00c'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:49.039191 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-55272ea5-dd61-4aec-a224-cbb2af4dd4b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4020cecd1174ff68101b6498780d00c'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:49.153551 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-55272ea5-dd61-4aec-a224-cbb2af4dd4b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4020cecd1174ff68101b6498780d00c'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:49.170951 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-55272ea5-dd61-4aec-a224-cbb2af4dd4b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4020cecd1174ff68101b6498780d00c'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:49.177740 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2100/4237] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:24:48 2022] DELETE /identity/v3/users/c4020cecd1174ff68101b6498780d00c => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:24:49.966907 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6149fcb0-8520-49bd-818a-97282fe4fcc4 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:49.980523 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6149fcb0-8520-49bd-818a-97282fe4fcc4 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:50.076122 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a6099-3a98-4d5c-ba27-390820e367ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:50.077027 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a6099-3a98-4d5c-ba27-390820e367ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:50.077309 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a6099-3a98-4d5c-ba27-390820e367ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:50.077635 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a6099-3a98-4d5c-ba27-390820e367ca admin admin] PATH_INFO: `/v3/projects/9b6232491b674705b2c339c302ac9000` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:50.079016 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261a6099-3a98-4d5c-ba27-390820e367ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b6232491b674705b2c339c302ac9000)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:50.081854 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261a6099-3a98-4d5c-ba27-390820e367ca admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:50.320257 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-261a6099-3a98-4d5c-ba27-390820e367ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b6232491b674705b2c339c302ac9000', 'request_id': 'req-261a6099-3a98-4d5c-ba27-390820e367ca'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:50.328860 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-261a6099-3a98-4d5c-ba27-390820e367ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b6232491b674705b2c339c302ac9000', 'request_id': 'req-261a6099-3a98-4d5c-ba27-390820e367ca'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:50.400532 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-261a6099-3a98-4d5c-ba27-390820e367ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b6232491b674705b2c339c302ac9000', 'request_id': 'req-261a6099-3a98-4d5c-ba27-390820e367ca'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:50.422052 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-261a6099-3a98-4d5c-ba27-390820e367ca admin admin] The token cache is being invalidate because project 9b6232491b674705b2c339c302ac9000 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:24:50.422692 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-261a6099-3a98-4d5c-ba27-390820e367ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:50.434301 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-261a6099-3a98-4d5c-ba27-390820e367ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:50.434405 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2138/4238] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:24:49 2022] DELETE /identity/v3/projects/9b6232491b674705b2c339c302ac9000 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:24:50.439375 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f552d-5840-4ed2-8bac-056939a73a9b None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:50.439903 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f552d-5840-4ed2-8bac-056939a73a9b None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:50.440003 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f552d-5840-4ed2-8bac-056939a73a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:50.462415 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-f29f552d-5840-4ed2-8bac-056939a73a9b None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:24:50.464578 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-f29f552d-5840-4ed2-8bac-056939a73a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:50.568941 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2101/4239] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:24:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:24:50.586079 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d83691-a705-4e8b-9ad7-c73dfddd3a5a None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:50.586079 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d83691-a705-4e8b-9ad7-c73dfddd3a5a None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:50.586079 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d83691-a705-4e8b-9ad7-c73dfddd3a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:50.609223 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-e9d83691-a705-4e8b-9ad7-c73dfddd3a5a None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:24:50.609336 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e9d83691-a705-4e8b-9ad7-c73dfddd3a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:50.631413 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2139/4240] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:24:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:24:50.635724 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f552d-5840-4ed2-8bac-056939a73a9b None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:50.648290 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f552d-5840-4ed2-8bac-056939a73a9b None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:50.654196 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d7a896-3efb-4029-a496-66386090065b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:50.656390 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d7a896-3efb-4029-a496-66386090065b admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:50.660688 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d7a896-3efb-4029-a496-66386090065b admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:50.660688 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d7a896-3efb-4029-a496-66386090065b admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:50.660688 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d7a896-3efb-4029-a496-66386090065b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:24:50.660688 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d7a896-3efb-4029-a496-66386090065b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:50.660688 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d7a896-3efb-4029-a496-66386090065b admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:50.674452 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2102/4241] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:24:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:24:50.679810 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d83691-a705-4e8b-9ad7-c73dfddd3a5a None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:50.705440 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d83691-a705-4e8b-9ad7-c73dfddd3a5a None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:50.711189 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aea2785-f958-478c-8f11-925526033e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:50.712344 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea2785-f958-478c-8f11-925526033e5a admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:50.715740 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea2785-f958-478c-8f11-925526033e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:50.715740 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea2785-f958-478c-8f11-925526033e5a admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:50.715740 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aea2785-f958-478c-8f11-925526033e5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:50.717021 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aea2785-f958-478c-8f11-925526033e5a admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:50.866396 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2140/4242] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:24:50 2022] POST /identity/v3/projects => generated 375 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:24:50.870518 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d7a896-3efb-4029-a496-66386090065b admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:50.888295 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d7a896-3efb-4029-a496-66386090065b admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:50.999676 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f10e10b-cf15-4d04-b421-71ee401c5fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:51.000343 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f10e10b-cf15-4d04-b421-71ee401c5fef admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:51.000644 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f10e10b-cf15-4d04-b421-71ee401c5fef admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:51.000918 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f10e10b-cf15-4d04-b421-71ee401c5fef admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:51.001611 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f10e10b-cf15-4d04-b421-71ee401c5fef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:51.005971 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f10e10b-cf15-4d04-b421-71ee401c5fef admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:51.080611 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2103/4243] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:24:50 2022] POST /identity/v3/users => generated 288 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:24:51.084956 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aea2785-f958-478c-8f11-925526033e5a admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:51.096230 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aea2785-f958-478c-8f11-925526033e5a admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:51.101764 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c63d7b-2c61-42d1-a444-010ab42b26aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:51.104093 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c63d7b-2c61-42d1-a444-010ab42b26aa admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:51.104093 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c63d7b-2c61-42d1-a444-010ab42b26aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:51.104093 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c63d7b-2c61-42d1-a444-010ab42b26aa admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:51.104546 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c63d7b-2c61-42d1-a444-010ab42b26aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:51.105928 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c63d7b-2c61-42d1-a444-010ab42b26aa admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:51.116449 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2141/4244] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:24:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:24:51.122538 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f10e10b-cf15-4d04-b421-71ee401c5fef admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:51.133904 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f10e10b-cf15-4d04-b421-71ee401c5fef admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:51.140552 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6904ae-e481-4d35-a440-2be0ca98f7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:51.141911 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6904ae-e481-4d35-a440-2be0ca98f7b2 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:51.142198 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6904ae-e481-4d35-a440-2be0ca98f7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:51.142470 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6904ae-e481-4d35-a440-2be0ca98f7b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:51.143234 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6904ae-e481-4d35-a440-2be0ca98f7b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:51.144831 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6904ae-e481-4d35-a440-2be0ca98f7b2 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:51.158312 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2104/4245] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:24:51 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:24:51.162112 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c63d7b-2c61-42d1-a444-010ab42b26aa admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:51.173727 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c63d7b-2c61-42d1-a444-010ab42b26aa admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:51.178505 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7730a58-07a8-424e-9a78-44aa9dcbe0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:51.179567 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7730a58-07a8-424e-9a78-44aa9dcbe0b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:51.179958 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7730a58-07a8-424e-9a78-44aa9dcbe0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:51.180297 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7730a58-07a8-424e-9a78-44aa9dcbe0b1 admin admin] PATH_INFO: `/v3/projects/69be921807044629a1b5f9e3adc7d5ef/users/ea1c919d55a34ef6b52e4ba211928f5b/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:51.197638 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7730a58-07a8-424e-9a78-44aa9dcbe0b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69be921807044629a1b5f9e3adc7d5ef, user_id=ea1c919d55a34ef6b52e4ba211928f5b, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:51.200646 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7730a58-07a8-424e-9a78-44aa9dcbe0b1 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:51.307997 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2142/4246] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:24:51 2022] PUT /identity/v3/projects/69be921807044629a1b5f9e3adc7d5ef/users/ea1c919d55a34ef6b52e4ba211928f5b/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:24:51.313123 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a22df-f1ae-4155-906f-317f11f45365 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:51.313413 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a22df-f1ae-4155-906f-317f11f45365 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:51.313691 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a22df-f1ae-4155-906f-317f11f45365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:51.335024 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-1c0a22df-f1ae-4155-906f-317f11f45365 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:24:51.336757 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-1c0a22df-f1ae-4155-906f-317f11f45365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:51.406169 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2105/4247] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:24:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:24:51.418500 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7730a58-07a8-424e-9a78-44aa9dcbe0b1 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:51.420375 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e7730a58-07a8-424e-9a78-44aa9dcbe0b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:51.488632 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a22df-f1ae-4155-906f-317f11f45365 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:51.490401 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-1c0a22df-f1ae-4155-906f-317f11f45365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:51.502279 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7730a58-07a8-424e-9a78-44aa9dcbe0b1 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:51.507086 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a22df-f1ae-4155-906f-317f11f45365 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:51.513684 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6348582-31b6-4d70-a243-c7625bd11b38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:51.514351 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6348582-31b6-4d70-a243-c7625bd11b38 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:51.514639 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6348582-31b6-4d70-a243-c7625bd11b38 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:51.514922 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6348582-31b6-4d70-a243-c7625bd11b38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:51.519931 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644db211-8be2-434e-a119-ea84c7e1a935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:51.520817 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644db211-8be2-434e-a119-ea84c7e1a935 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:51.521101 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644db211-8be2-434e-a119-ea84c7e1a935 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:51.521507 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644db211-8be2-434e-a119-ea84c7e1a935 admin admin] PATH_INFO: `/v3/users/166d10b4eba34f9abd8140d75bc5b173` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:51.523393 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644db211-8be2-434e-a119-ea84c7e1a935 admin admin] RBAC: Authorizing `identity:delete_user(user_id=166d10b4eba34f9abd8140d75bc5b173)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:51.529414 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644db211-8be2-434e-a119-ea84c7e1a935 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:51.551872 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6348582-31b6-4d70-a243-c7625bd11b38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:51.554701 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6348582-31b6-4d70-a243-c7625bd11b38 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:51.569119 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2143/4248] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:24:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:24:51.752629 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-644db211-8be2-434e-a119-ea84c7e1a935 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '166d10b4eba34f9abd8140d75bc5b173'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:51.761925 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-644db211-8be2-434e-a119-ea84c7e1a935 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '166d10b4eba34f9abd8140d75bc5b173'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:51.762951 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-644db211-8be2-434e-a119-ea84c7e1a935 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '166d10b4eba34f9abd8140d75bc5b173'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:51.885717 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-644db211-8be2-434e-a119-ea84c7e1a935 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '166d10b4eba34f9abd8140d75bc5b173'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:51.898725 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-644db211-8be2-434e-a119-ea84c7e1a935 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '166d10b4eba34f9abd8140d75bc5b173'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:51.905361 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2106/4249] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:24:51 2022] DELETE /identity/v3/users/166d10b4eba34f9abd8140d75bc5b173 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:24:51.909933 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca831b48-8c2f-4a02-9b11-e48b653eca0d None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:51.910228 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca831b48-8c2f-4a02-9b11-e48b653eca0d None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:51.910512 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca831b48-8c2f-4a02-9b11-e48b653eca0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:51.927909 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-ca831b48-8c2f-4a02-9b11-e48b653eca0d None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:24:51.929130 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ca831b48-8c2f-4a02-9b11-e48b653eca0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:51.998252 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2144/4250] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:24:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:24:52.015268 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644db211-8be2-434e-a119-ea84c7e1a935 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:52.019962 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-644db211-8be2-434e-a119-ea84c7e1a935 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:52.121140 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644db211-8be2-434e-a119-ea84c7e1a935 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:52.125619 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e94ec8-caa7-42db-be30-ca9ecdd7492f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:52.126270 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e94ec8-caa7-42db-be30-ca9ecdd7492f service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:52.126554 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e94ec8-caa7-42db-be30-ca9ecdd7492f service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:52.126829 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e94ec8-caa7-42db-be30-ca9ecdd7492f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:52.139381 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e94ec8-caa7-42db-be30-ca9ecdd7492f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:52.140999 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e94ec8-caa7-42db-be30-ca9ecdd7492f service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:52.153332 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2107/4251] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:24:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:24:52.844500 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca831b48-8c2f-4a02-9b11-e48b653eca0d None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:52.846947 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ca831b48-8c2f-4a02-9b11-e48b653eca0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:52.876813 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca831b48-8c2f-4a02-9b11-e48b653eca0d None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:52.882577 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c69217-cb86-470e-8975-72188c8dff02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:52.884525 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c69217-cb86-470e-8975-72188c8dff02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:52.885724 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c69217-cb86-470e-8975-72188c8dff02 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:52.885987 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c69217-cb86-470e-8975-72188c8dff02 admin admin] PATH_INFO: `/v3/projects/4ab567f7ad2e4635b2a6e93c69fae605` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:52.888086 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c69217-cb86-470e-8975-72188c8dff02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ab567f7ad2e4635b2a6e93c69fae605)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:52.892079 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c69217-cb86-470e-8975-72188c8dff02 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:53.029278 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-00c69217-cb86-470e-8975-72188c8dff02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ab567f7ad2e4635b2a6e93c69fae605', 'request_id': 'req-00c69217-cb86-470e-8975-72188c8dff02'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:53.034921 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-00c69217-cb86-470e-8975-72188c8dff02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ab567f7ad2e4635b2a6e93c69fae605', 'request_id': 'req-00c69217-cb86-470e-8975-72188c8dff02'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:53.110804 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-00c69217-cb86-470e-8975-72188c8dff02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ab567f7ad2e4635b2a6e93c69fae605', 'request_id': 'req-00c69217-cb86-470e-8975-72188c8dff02'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:53.121950 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-00c69217-cb86-470e-8975-72188c8dff02 admin admin] The token cache is being invalidate because project 4ab567f7ad2e4635b2a6e93c69fae605 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:24:53.122588 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-00c69217-cb86-470e-8975-72188c8dff02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:53.123359 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-00c69217-cb86-470e-8975-72188c8dff02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:53.125025 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2145/4252] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:24:52 2022] DELETE /identity/v3/projects/4ab567f7ad2e4635b2a6e93c69fae605 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:24:53.128980 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e94ec8-caa7-42db-be30-ca9ecdd7492f service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:53.139565 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e94ec8-caa7-42db-be30-ca9ecdd7492f service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:53.207280 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4dd77c-0e9f-4bf2-8c32-c9b9e6d31cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:53.208264 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4dd77c-0e9f-4bf2-8c32-c9b9e6d31cf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:53.208551 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4dd77c-0e9f-4bf2-8c32-c9b9e6d31cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:53.208839 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4dd77c-0e9f-4bf2-8c32-c9b9e6d31cf0 admin admin] PATH_INFO: `/v3/users/c9b6b0d133b24d9fb51440f61138a499` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:53.210185 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4dd77c-0e9f-4bf2-8c32-c9b9e6d31cf0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9b6b0d133b24d9fb51440f61138a499)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:53.212312 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4dd77c-0e9f-4bf2-8c32-c9b9e6d31cf0 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:53.221392 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba51e50-3f04-4fec-bcad-0cbf34e4e497 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:53.221677 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba51e50-3f04-4fec-bcad-0cbf34e4e497 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:53.221959 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba51e50-3f04-4fec-bcad-0cbf34e4e497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:53.269428 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-fba51e50-3f04-4fec-bcad-0cbf34e4e497 None None] MFA Rules not processed for user `ea1c919d55a34ef6b52e4ba211928f5b`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:24:53.270721 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-fba51e50-3f04-4fec-bcad-0cbf34e4e497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:53.370046 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2146/4253] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:24:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:24:53.472481 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba51e50-3f04-4fec-bcad-0cbf34e4e497 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:53.477122 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-fba51e50-3f04-4fec-bcad-0cbf34e4e497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:53.547115 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ca4dd77c-0e9f-4bf2-8c32-c9b9e6d31cf0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9b6b0d133b24d9fb51440f61138a499'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:53.560190 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ca4dd77c-0e9f-4bf2-8c32-c9b9e6d31cf0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9b6b0d133b24d9fb51440f61138a499'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:53.560503 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba51e50-3f04-4fec-bcad-0cbf34e4e497 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:53.561817 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ca4dd77c-0e9f-4bf2-8c32-c9b9e6d31cf0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9b6b0d133b24d9fb51440f61138a499'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:53.567323 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20cf287-1e8e-45b0-8ce3-1b154861f0ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:53.571547 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20cf287-1e8e-45b0-8ce3-1b154861f0ba service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:53.571547 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20cf287-1e8e-45b0-8ce3-1b154861f0ba service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:53.571547 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20cf287-1e8e-45b0-8ce3-1b154861f0ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:53.577820 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20cf287-1e8e-45b0-8ce3-1b154861f0ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:53.579578 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20cf287-1e8e-45b0-8ce3-1b154861f0ba service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:53.589053 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2147/4254] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:24:53 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:24:53.662368 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ca4dd77c-0e9f-4bf2-8c32-c9b9e6d31cf0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9b6b0d133b24d9fb51440f61138a499'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:53.676858 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ca4dd77c-0e9f-4bf2-8c32-c9b9e6d31cf0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9b6b0d133b24d9fb51440f61138a499'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:53.689751 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2108/4255] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:24:53 2022] DELETE /identity/v3/users/c9b6b0d133b24d9fb51440f61138a499 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:24:54.207948 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20cf287-1e8e-45b0-8ce3-1b154861f0ba service nova] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:54.211181 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c20cf287-1e8e-45b0-8ce3-1b154861f0ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:54.261380 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20cf287-1e8e-45b0-8ce3-1b154861f0ba service nova] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:54.324861 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6c8ba3-f78c-4e98-898a-f58134b65314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:54.326090 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c8ba3-f78c-4e98-898a-f58134b65314 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:54.326568 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c8ba3-f78c-4e98-898a-f58134b65314 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:54.327205 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c8ba3-f78c-4e98-898a-f58134b65314 admin admin] PATH_INFO: `/v3/projects/4a017fe7c4734fc8be40fcfb1d2a643c` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:54.328723 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6c8ba3-f78c-4e98-898a-f58134b65314 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a017fe7c4734fc8be40fcfb1d2a643c)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:54.330921 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6c8ba3-f78c-4e98-898a-f58134b65314 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:54.497540 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ca6c8ba3-f78c-4e98-898a-f58134b65314 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a017fe7c4734fc8be40fcfb1d2a643c', 'request_id': 'req-ca6c8ba3-f78c-4e98-898a-f58134b65314'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:54.503917 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ca6c8ba3-f78c-4e98-898a-f58134b65314 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a017fe7c4734fc8be40fcfb1d2a643c', 'request_id': 'req-ca6c8ba3-f78c-4e98-898a-f58134b65314'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:54.583193 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ca6c8ba3-f78c-4e98-898a-f58134b65314 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a017fe7c4734fc8be40fcfb1d2a643c', 'request_id': 'req-ca6c8ba3-f78c-4e98-898a-f58134b65314'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:54.597700 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ca6c8ba3-f78c-4e98-898a-f58134b65314 admin admin] The token cache is being invalidate because project 4a017fe7c4734fc8be40fcfb1d2a643c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:24:54.597993 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ca6c8ba3-f78c-4e98-898a-f58134b65314 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:54.598747 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ca6c8ba3-f78c-4e98-898a-f58134b65314 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:24:54.600368 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2148/4256] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:24:54 2022] DELETE /identity/v3/projects/4a017fe7c4734fc8be40fcfb1d2a643c => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:24:54.606596 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45c264-1146-4d48-9813-913a1f62759d None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:54.607454 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45c264-1146-4d48-9813-913a1f62759d None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:54.608185 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45c264-1146-4d48-9813-913a1f62759d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:54.631170 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-ac45c264-1146-4d48-9813-913a1f62759d None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:24:54.633069 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-ac45c264-1146-4d48-9813-913a1f62759d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:54.706303 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2109/4257] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:24:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:24:54.708625 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2c768-c217-4380-af60-cf358d3859bb None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:54.708914 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2c768-c217-4380-af60-cf358d3859bb None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:54.709188 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2c768-c217-4380-af60-cf358d3859bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:54.730671 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-72f2c768-c217-4380-af60-cf358d3859bb None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:24:54.732248 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-72f2c768-c217-4380-af60-cf358d3859bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:54.740420 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2149/4258] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:24:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:24:54.749636 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac45c264-1146-4d48-9813-913a1f62759d None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:54.758340 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac45c264-1146-4d48-9813-913a1f62759d None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:54.764116 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1115ef-a007-41b7-ac4b-76631b42b0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:54.765224 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1115ef-a007-41b7-ac4b-76631b42b0d0 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:54.765509 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1115ef-a007-41b7-ac4b-76631b42b0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:54.765780 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1115ef-a007-41b7-ac4b-76631b42b0d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:54.766705 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1115ef-a007-41b7-ac4b-76631b42b0d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:24:54.767647 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1115ef-a007-41b7-ac4b-76631b42b0d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:54.769606 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1115ef-a007-41b7-ac4b-76631b42b0d0 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:54.802933 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2110/4259] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:24:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:24:54.806438 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f2c768-c217-4380-af60-cf358d3859bb None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:54.817759 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f2c768-c217-4380-af60-cf358d3859bb None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:54.824984 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f269c471-9421-4742-b2ea-9370863dd85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:54.825877 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269c471-9421-4742-b2ea-9370863dd85e admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:54.827090 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269c471-9421-4742-b2ea-9370863dd85e admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:54.827090 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269c471-9421-4742-b2ea-9370863dd85e admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:54.827442 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f269c471-9421-4742-b2ea-9370863dd85e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:54.830295 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f269c471-9421-4742-b2ea-9370863dd85e admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:54.954612 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2150/4260] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:24:54 2022] POST /identity/v3/projects => generated 399 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:24:54.956632 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1115ef-a007-41b7-ac4b-76631b42b0d0 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:54.971621 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1115ef-a007-41b7-ac4b-76631b42b0d0 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:55.051747 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b3126a-c15a-4b9f-a21f-6c90a17ed420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:55.052973 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b3126a-c15a-4b9f-a21f-6c90a17ed420 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:55.053261 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b3126a-c15a-4b9f-a21f-6c90a17ed420 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:55.053525 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b3126a-c15a-4b9f-a21f-6c90a17ed420 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:55.054393 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b3126a-c15a-4b9f-a21f-6c90a17ed420 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:55.063090 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b3126a-c15a-4b9f-a21f-6c90a17ed420 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:55.194935 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2111/4261] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:24:54 2022] POST /identity/v3/users => generated 300 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:24:55.199103 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f269c471-9421-4742-b2ea-9370863dd85e admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:55.212920 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f269c471-9421-4742-b2ea-9370863dd85e admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:55.220026 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45722566-834d-42e7-9043-49b5f39050f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:55.220895 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45722566-834d-42e7-9043-49b5f39050f2 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:55.221341 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45722566-834d-42e7-9043-49b5f39050f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:55.222134 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45722566-834d-42e7-9043-49b5f39050f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:55.223244 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45722566-834d-42e7-9043-49b5f39050f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:55.225047 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45722566-834d-42e7-9043-49b5f39050f2 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:55.238293 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2151/4262] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:24:55 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:24:55.242650 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b3126a-c15a-4b9f-a21f-6c90a17ed420 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:55.259095 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b3126a-c15a-4b9f-a21f-6c90a17ed420 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:55.273444 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec87ffe-ce85-4ccc-8697-44e702302ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:55.281484 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec87ffe-ce85-4ccc-8697-44e702302ea8 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:55.281484 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec87ffe-ce85-4ccc-8697-44e702302ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:55.281484 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec87ffe-ce85-4ccc-8697-44e702302ea8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:55.281484 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec87ffe-ce85-4ccc-8697-44e702302ea8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:55.281484 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec87ffe-ce85-4ccc-8697-44e702302ea8 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:55.294184 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2112/4263] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:24:55 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:24:55.298594 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45722566-834d-42e7-9043-49b5f39050f2 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:55.310945 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45722566-834d-42e7-9043-49b5f39050f2 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:55.321144 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef97147-354a-4e89-bfc8-fc5c15b51bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:55.323197 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef97147-354a-4e89-bfc8-fc5c15b51bfb admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:55.323647 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef97147-354a-4e89-bfc8-fc5c15b51bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:55.324036 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef97147-354a-4e89-bfc8-fc5c15b51bfb admin admin] PATH_INFO: `/v3/projects/ef393d12cd9e4387985ada49dfba24d8/users/79ef4150f3ee4d7bad3c4cca099c7458/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:55.344880 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef97147-354a-4e89-bfc8-fc5c15b51bfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef393d12cd9e4387985ada49dfba24d8, user_id=79ef4150f3ee4d7bad3c4cca099c7458, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:55.349138 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef97147-354a-4e89-bfc8-fc5c15b51bfb admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:55.471868 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2152/4264] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:24:55 2022] PUT /identity/v3/projects/ef393d12cd9e4387985ada49dfba24d8/users/79ef4150f3ee4d7bad3c4cca099c7458/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:24:55.483131 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca0700-4aad-4e20-8598-d2d0da62d88a None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:55.483453 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca0700-4aad-4e20-8598-d2d0da62d88a None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:55.483988 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca0700-4aad-4e20-8598-d2d0da62d88a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:55.532286 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-2aca0700-4aad-4e20-8598-d2d0da62d88a None None] MFA Rules not processed for user `79ef4150f3ee4d7bad3c4cca099c7458`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:24:55.535183 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-2aca0700-4aad-4e20-8598-d2d0da62d88a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:55.635895 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2113/4265] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:24:55 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:24:55.640950 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef97147-354a-4e89-bfc8-fc5c15b51bfb admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:55.747216 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef97147-354a-4e89-bfc8-fc5c15b51bfb admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:55.752856 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c4e96-ff6d-4cb9-a88e-05fb369fafdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:55.753730 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c4e96-ff6d-4cb9-a88e-05fb369fafdc admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:55.754122 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c4e96-ff6d-4cb9-a88e-05fb369fafdc admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:55.754935 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c4e96-ff6d-4cb9-a88e-05fb369fafdc admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:55.756010 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048c4e96-ff6d-4cb9-a88e-05fb369fafdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:55.759151 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048c4e96-ff6d-4cb9-a88e-05fb369fafdc admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:55.885198 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2153/4266] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:24:55 2022] POST /identity/v3/projects => generated 397 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:24:55.886648 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca0700-4aad-4e20-8598-d2d0da62d88a None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:55.899339 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754577e7-1a60-4ef6-86d3-6e03c4a2fc6e None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:55.899912 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754577e7-1a60-4ef6-86d3-6e03c4a2fc6e None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:55.900802 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754577e7-1a60-4ef6-86d3-6e03c4a2fc6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:55.904987 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca0700-4aad-4e20-8598-d2d0da62d88a None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:55.926922 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-754577e7-1a60-4ef6-86d3-6e03c4a2fc6e None None] MFA Rules not processed for user `87538f2309714545bd47f228b6505883`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:24:55.926922 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-754577e7-1a60-4ef6-86d3-6e03c4a2fc6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:56.007277 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2154/4267] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:24:55 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:24:56.012512 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5093ad44-4767-4510-92d1-03cda57f4503 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:56.012512 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5093ad44-4767-4510-92d1-03cda57f4503 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:56.013161 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5093ad44-4767-4510-92d1-03cda57f4503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:56.050330 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c6a5c0-b268-40b8-a18e-5e3237c821ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:56.050330 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6a5c0-b268-40b8-a18e-5e3237c821ea admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:56.050330 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6a5c0-b268-40b8-a18e-5e3237c821ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:56.050330 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6a5c0-b268-40b8-a18e-5e3237c821ea admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:56.050742 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-5093ad44-4767-4510-92d1-03cda57f4503 None None] MFA Rules not processed for user `ea1c919d55a34ef6b52e4ba211928f5b`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:24:56.050836 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c6a5c0-b268-40b8-a18e-5e3237c821ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:56.050925 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-5093ad44-4767-4510-92d1-03cda57f4503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:56.051025 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c6a5c0-b268-40b8-a18e-5e3237c821ea admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:56.095544 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2155/4268] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:24:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:24:56.169775 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2114/4269] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:24:55 2022] POST /identity/v3/users => generated 305 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:24:56.171960 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5093ad44-4767-4510-92d1-03cda57f4503 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:56.183757 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5093ad44-4767-4510-92d1-03cda57f4503 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:56.190838 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99149a93-af67-40bf-b219-79042bc109f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:56.193919 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99149a93-af67-40bf-b219-79042bc109f8 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:56.193919 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99149a93-af67-40bf-b219-79042bc109f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:56.193919 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99149a93-af67-40bf-b219-79042bc109f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:56.193919 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99149a93-af67-40bf-b219-79042bc109f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:56.196681 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99149a93-af67-40bf-b219-79042bc109f8 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:56.209895 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2156/4270] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:24:56.217019 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c6a5c0-b268-40b8-a18e-5e3237c821ea admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:56.225667 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c6a5c0-b268-40b8-a18e-5e3237c821ea admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:56.231052 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6a06f4-cd11-47b2-a6e2-77a0c7d7b36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:56.232016 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a06f4-cd11-47b2-a6e2-77a0c7d7b36b admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:56.232475 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a06f4-cd11-47b2-a6e2-77a0c7d7b36b admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:56.232929 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a06f4-cd11-47b2-a6e2-77a0c7d7b36b admin admin] PATH_INFO: `/v3/projects/98f1087977ab4d7ea0b5c0dbe2ccb277/users/ead176a169a947e89b06acc4c7eafea1/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:56.256321 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6a06f4-cd11-47b2-a6e2-77a0c7d7b36b admin admin] RBAC: Authorizing `identity:create_grant(project_id=98f1087977ab4d7ea0b5c0dbe2ccb277, user_id=ead176a169a947e89b06acc4c7eafea1, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:56.263276 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6a06f4-cd11-47b2-a6e2-77a0c7d7b36b admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:56.355429 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2115/4271] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:24:56 2022] PUT /identity/v3/projects/98f1087977ab4d7ea0b5c0dbe2ccb277/users/ead176a169a947e89b06acc4c7eafea1/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:24:56.359174 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99149a93-af67-40bf-b219-79042bc109f8 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:56.369902 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99149a93-af67-40bf-b219-79042bc109f8 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:56.444047 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90477e2-aca0-4ee8-9ef4-0ce86452ec85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:56.444829 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90477e2-aca0-4ee8-9ef4-0ce86452ec85 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:56.445004 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90477e2-aca0-4ee8-9ef4-0ce86452ec85 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:56.445272 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90477e2-aca0-4ee8-9ef4-0ce86452ec85 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:56.445994 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90477e2-aca0-4ee8-9ef4-0ce86452ec85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:56.447835 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90477e2-aca0-4ee8-9ef4-0ce86452ec85 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:56.463094 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2157/4272] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:24:56.464616 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6a06f4-cd11-47b2-a6e2-77a0c7d7b36b admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:56.475998 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6a06f4-cd11-47b2-a6e2-77a0c7d7b36b admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:56.484172 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d59187f-6c31-4bdb-b3fb-a1e92e8a6b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:56.485215 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d59187f-6c31-4bdb-b3fb-a1e92e8a6b0b admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:56.485500 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d59187f-6c31-4bdb-b3fb-a1e92e8a6b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:56.485825 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d59187f-6c31-4bdb-b3fb-a1e92e8a6b0b admin admin] PATH_INFO: `/v3/projects/98f1087977ab4d7ea0b5c0dbe2ccb277/users/ead176a169a947e89b06acc4c7eafea1/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:56.491644 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d59187f-6c31-4bdb-b3fb-a1e92e8a6b0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=98f1087977ab4d7ea0b5c0dbe2ccb277, user_id=ead176a169a947e89b06acc4c7eafea1, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:56.492462 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d59187f-6c31-4bdb-b3fb-a1e92e8a6b0b admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:56.504129 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2116/4273] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:24:56 2022] PUT /identity/v3/projects/98f1087977ab4d7ea0b5c0dbe2ccb277/users/ead176a169a947e89b06acc4c7eafea1/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:24:56.521052 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8d644-45b7-4b89-a9b0-50efbcd56c67 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:56.521352 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8d644-45b7-4b89-a9b0-50efbcd56c67 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:56.521655 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8d644-45b7-4b89-a9b0-50efbcd56c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:56.559311 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-03c8d644-45b7-4b89-a9b0-50efbcd56c67 None None] MFA Rules not processed for user `ead176a169a947e89b06acc4c7eafea1`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:24:56.560836 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-03c8d644-45b7-4b89-a9b0-50efbcd56c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:56.636348 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2158/4274] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:24:56 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:24:56.646429 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d59187f-6c31-4bdb-b3fb-a1e92e8a6b0b admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:56.648743 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-0d59187f-6c31-4bdb-b3fb-a1e92e8a6b0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:56.719641 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d59187f-6c31-4bdb-b3fb-a1e92e8a6b0b admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:56.724083 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8494c9ca-9770-499b-be3b-73c41d5449fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:56.724889 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494c9ca-9770-499b-be3b-73c41d5449fd service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:56.725319 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494c9ca-9770-499b-be3b-73c41d5449fd service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:56.725599 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494c9ca-9770-499b-be3b-73c41d5449fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:56.808010 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8494c9ca-9770-499b-be3b-73c41d5449fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:56.809796 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8494c9ca-9770-499b-be3b-73c41d5449fd service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:56.821392 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2117/4275] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:24:56 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:24:57.711641 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c8d644-45b7-4b89-a9b0-50efbcd56c67 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:57.714601 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-03c8d644-45b7-4b89-a9b0-50efbcd56c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:57.742085 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8494c9ca-9770-499b-be3b-73c41d5449fd service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:57.746434 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8494c9ca-9770-499b-be3b-73c41d5449fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:57.758033 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8494c9ca-9770-499b-be3b-73c41d5449fd service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:57.764178 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b705d5d-e604-4038-923a-0663cd1cb331 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:57.769327 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b705d5d-e604-4038-923a-0663cd1cb331 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:57.769327 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b705d5d-e604-4038-923a-0663cd1cb331 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:57.769327 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b705d5d-e604-4038-923a-0663cd1cb331 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:57.769327 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-2b705d5d-e604-4038-923a-0663cd1cb331 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:57.810357 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c8d644-45b7-4b89-a9b0-50efbcd56c67 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:57.816782 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77525f34-57bc-45a8-8da5-a3aa5fed00c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:57.817724 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77525f34-57bc-45a8-8da5-a3aa5fed00c4 service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:57.818555 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77525f34-57bc-45a8-8da5-a3aa5fed00c4 service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:57.821377 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77525f34-57bc-45a8-8da5-a3aa5fed00c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:57.828543 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77525f34-57bc-45a8-8da5-a3aa5fed00c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:57.830152 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77525f34-57bc-45a8-8da5-a3aa5fed00c4 service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:57.840707 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2159/4276] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:24:57 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:24:57.842979 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b705d5d-e604-4038-923a-0663cd1cb331 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:57.844465 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b705d5d-e604-4038-923a-0663cd1cb331 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:57.855007 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2118/4277] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:24:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:24:58.210114 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeedf74-7ef7-474f-a91e-24813a251580 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:58.210463 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeedf74-7ef7-474f-a91e-24813a251580 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:58.210752 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeedf74-7ef7-474f-a91e-24813a251580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:58.230280 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-3eeedf74-7ef7-474f-a91e-24813a251580 None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:24:58.231602 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-3eeedf74-7ef7-474f-a91e-24813a251580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:58.294181 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2160/4278] 10.222.0.52 () {58 vars in 1009 bytes} [Sat May 14 21:24:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:24:58.324791 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b705d5d-e604-4038-923a-0663cd1cb331 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:24:58.326671 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-2b705d5d-e604-4038-923a-0663cd1cb331 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:24:58.432540 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b705d5d-e604-4038-923a-0663cd1cb331 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:24:58.441728 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03da84f-4176-47da-94fc-f4374bf8cb2b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:24:58.443403 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03da84f-4176-47da-94fc-f4374bf8cb2b service swift] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:24:58.443881 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03da84f-4176-47da-94fc-f4374bf8cb2b service swift] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:24:58.444346 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03da84f-4176-47da-94fc-f4374bf8cb2b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:24:58.459589 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03da84f-4176-47da-94fc-f4374bf8cb2b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:24:58.461596 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03da84f-4176-47da-94fc-f4374bf8cb2b service swift] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:24:58.473522 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2119/4279] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 21:24:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 21:25:04.893829 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeedf74-7ef7-474f-a91e-24813a251580 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:04.896026 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-3eeedf74-7ef7-474f-a91e-24813a251580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:04.968838 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeedf74-7ef7-474f-a91e-24813a251580 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:04.974878 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8893833a-2764-4020-9f08-4fc6940bdc15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:04.976007 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8893833a-2764-4020-9f08-4fc6940bdc15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:04.976440 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8893833a-2764-4020-9f08-4fc6940bdc15 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:04.977461 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8893833a-2764-4020-9f08-4fc6940bdc15 admin admin] PATH_INFO: `/v3/users/a42e0caa0878447f98544e74f767c7ca` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:04.984425 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8893833a-2764-4020-9f08-4fc6940bdc15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a42e0caa0878447f98544e74f767c7ca)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:04.986784 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8893833a-2764-4020-9f08-4fc6940bdc15 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:05.198535 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8893833a-2764-4020-9f08-4fc6940bdc15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a42e0caa0878447f98544e74f767c7ca'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:05.216051 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8893833a-2764-4020-9f08-4fc6940bdc15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a42e0caa0878447f98544e74f767c7ca'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:05.223859 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8893833a-2764-4020-9f08-4fc6940bdc15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a42e0caa0878447f98544e74f767c7ca'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:05.296827 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8893833a-2764-4020-9f08-4fc6940bdc15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a42e0caa0878447f98544e74f767c7ca'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:05.298005 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8893833a-2764-4020-9f08-4fc6940bdc15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a42e0caa0878447f98544e74f767c7ca'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:05.305671 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2161/4280] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:25:04 2022] DELETE /identity/v3/users/a42e0caa0878447f98544e74f767c7ca => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:25:05.571639 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03da84f-4176-47da-94fc-f4374bf8cb2b service swift] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:05.583734 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03da84f-4176-47da-94fc-f4374bf8cb2b service swift] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:05.705401 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3fcaba-65da-412d-9a80-b227127708b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:05.706187 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3fcaba-65da-412d-9a80-b227127708b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:05.706479 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3fcaba-65da-412d-9a80-b227127708b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:05.706765 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3fcaba-65da-412d-9a80-b227127708b1 admin admin] PATH_INFO: `/v3/projects/a924ca59a9ac44cf96e53be012a43af1` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:05.720332 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3fcaba-65da-412d-9a80-b227127708b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a924ca59a9ac44cf96e53be012a43af1)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:05.722449 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3fcaba-65da-412d-9a80-b227127708b1 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:05.894237 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ff3fcaba-65da-412d-9a80-b227127708b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a924ca59a9ac44cf96e53be012a43af1', 'request_id': 'req-ff3fcaba-65da-412d-9a80-b227127708b1'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:05.909966 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ff3fcaba-65da-412d-9a80-b227127708b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a924ca59a9ac44cf96e53be012a43af1', 'request_id': 'req-ff3fcaba-65da-412d-9a80-b227127708b1'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:05.929632 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ff3fcaba-65da-412d-9a80-b227127708b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a924ca59a9ac44cf96e53be012a43af1', 'request_id': 'req-ff3fcaba-65da-412d-9a80-b227127708b1'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:06.043334 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ff3fcaba-65da-412d-9a80-b227127708b1 admin admin] The token cache is being invalidate because project a924ca59a9ac44cf96e53be012a43af1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:25:06.044083 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ff3fcaba-65da-412d-9a80-b227127708b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:06.045959 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ff3fcaba-65da-412d-9a80-b227127708b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:06.048233 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2120/4281] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:25:05 2022] DELETE /identity/v3/projects/a924ca59a9ac44cf96e53be012a43af1 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:25:06.053372 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973d8b5-f86a-467f-b871-61b7036fd194 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:06.054509 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973d8b5-f86a-467f-b871-61b7036fd194 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:06.055850 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973d8b5-f86a-467f-b871-61b7036fd194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:06.090939 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-7973d8b5-f86a-467f-b871-61b7036fd194 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:25:06.097493 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-7973d8b5-f86a-467f-b871-61b7036fd194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:06.185442 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2162/4282] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:25:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:25:06.195584 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d59801-7dd5-4f43-833b-0967c38ad8ae None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:06.195951 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d59801-7dd5-4f43-833b-0967c38ad8ae None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:06.196236 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d59801-7dd5-4f43-833b-0967c38ad8ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:06.221513 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-23d59801-7dd5-4f43-833b-0967c38ad8ae None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:25:06.222718 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-23d59801-7dd5-4f43-833b-0967c38ad8ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:06.235714 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2121/4283] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:25:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:25:06.236864 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7973d8b5-f86a-467f-b871-61b7036fd194 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:06.248164 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7973d8b5-f86a-467f-b871-61b7036fd194 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:06.254719 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f508e97-ee48-4113-aa1d-cd9cd661b488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:06.255666 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f508e97-ee48-4113-aa1d-cd9cd661b488 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:06.256066 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f508e97-ee48-4113-aa1d-cd9cd661b488 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:06.256434 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f508e97-ee48-4113-aa1d-cd9cd661b488 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:06.257273 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f508e97-ee48-4113-aa1d-cd9cd661b488 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:25:06.257683 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f508e97-ee48-4113-aa1d-cd9cd661b488 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:06.259521 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f508e97-ee48-4113-aa1d-cd9cd661b488 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:06.280990 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d59801-7dd5-4f43-833b-0967c38ad8ae None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:06.287346 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2163/4284] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:25:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:25:06.294583 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d59801-7dd5-4f43-833b-0967c38ad8ae None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:06.300526 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508432b5-0a90-4130-88ff-f2dbe0ad0a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:06.301413 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508432b5-0a90-4130-88ff-f2dbe0ad0a6a admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:06.301783 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508432b5-0a90-4130-88ff-f2dbe0ad0a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:06.302169 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508432b5-0a90-4130-88ff-f2dbe0ad0a6a admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:06.302973 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508432b5-0a90-4130-88ff-f2dbe0ad0a6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:06.305322 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508432b5-0a90-4130-88ff-f2dbe0ad0a6a admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:06.417425 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f508e97-ee48-4113-aa1d-cd9cd661b488 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:06.418215 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2122/4285] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:25:06 2022] POST /identity/v3/projects => generated 395 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:25:06.429135 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f508e97-ee48-4113-aa1d-cd9cd661b488 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:06.502039 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83859d9-f96c-4b0f-b2e3-d3f2a8cc0b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:06.502833 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83859d9-f96c-4b0f-b2e3-d3f2a8cc0b93 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:06.503332 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83859d9-f96c-4b0f-b2e3-d3f2a8cc0b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:06.503724 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83859d9-f96c-4b0f-b2e3-d3f2a8cc0b93 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:06.504792 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83859d9-f96c-4b0f-b2e3-d3f2a8cc0b93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:06.507021 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83859d9-f96c-4b0f-b2e3-d3f2a8cc0b93 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:06.617351 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508432b5-0a90-4130-88ff-f2dbe0ad0a6a admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:06.624652 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2164/4286] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:25:06 2022] POST /identity/v3/users => generated 298 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:25:06.638947 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508432b5-0a90-4130-88ff-f2dbe0ad0a6a admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:06.652097 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb78a10-bb19-4e93-9f3c-611e8f330344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:06.652792 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb78a10-bb19-4e93-9f3c-611e8f330344 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:06.653077 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb78a10-bb19-4e93-9f3c-611e8f330344 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:06.653393 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb78a10-bb19-4e93-9f3c-611e8f330344 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:06.654136 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb78a10-bb19-4e93-9f3c-611e8f330344 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:06.655876 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb78a10-bb19-4e93-9f3c-611e8f330344 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:06.677505 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2123/4287] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:25:06 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:25:06.678659 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83859d9-f96c-4b0f-b2e3-d3f2a8cc0b93 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:06.692768 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83859d9-f96c-4b0f-b2e3-d3f2a8cc0b93 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:06.709027 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c5102-bb5b-4ebf-a6d7-8bddae3626eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:06.710060 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c5102-bb5b-4ebf-a6d7-8bddae3626eb admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:06.710635 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c5102-bb5b-4ebf-a6d7-8bddae3626eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:06.710919 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c5102-bb5b-4ebf-a6d7-8bddae3626eb admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:06.712127 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379c5102-bb5b-4ebf-a6d7-8bddae3626eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:06.714655 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379c5102-bb5b-4ebf-a6d7-8bddae3626eb admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:06.733193 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2165/4288] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:25:06 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:25:06.734699 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb78a10-bb19-4e93-9f3c-611e8f330344 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:06.748435 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb78a10-bb19-4e93-9f3c-611e8f330344 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:06.754155 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c5eb6d-416f-4117-8f1f-aac5a814ac52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:06.755204 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5eb6d-416f-4117-8f1f-aac5a814ac52 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:06.756137 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5eb6d-416f-4117-8f1f-aac5a814ac52 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:06.756834 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5eb6d-416f-4117-8f1f-aac5a814ac52 admin admin] PATH_INFO: `/v3/projects/7b8a604af2ec48059ef55244ec6a5363/users/6f0c6efc18184500875e0db8280d6bc3/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:06.783533 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c5eb6d-416f-4117-8f1f-aac5a814ac52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b8a604af2ec48059ef55244ec6a5363, user_id=6f0c6efc18184500875e0db8280d6bc3, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:06.787438 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c5eb6d-416f-4117-8f1f-aac5a814ac52 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:06.889241 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2124/4289] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:25:06 2022] PUT /identity/v3/projects/7b8a604af2ec48059ef55244ec6a5363/users/6f0c6efc18184500875e0db8280d6bc3/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:25:06.891355 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab9d41a-f896-49e5-b617-192b87ae0db6 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:06.892512 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab9d41a-f896-49e5-b617-192b87ae0db6 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:06.893038 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab9d41a-f896-49e5-b617-192b87ae0db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:06.933598 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-8ab9d41a-f896-49e5-b617-192b87ae0db6 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:25:06.936044 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-8ab9d41a-f896-49e5-b617-192b87ae0db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:07.033388 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2166/4290] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:25:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:25:07.043868 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c5eb6d-416f-4117-8f1f-aac5a814ac52 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:07.046711 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-67c5eb6d-416f-4117-8f1f-aac5a814ac52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:07.128126 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c5eb6d-416f-4117-8f1f-aac5a814ac52 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:07.133623 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7a4a86-34da-481c-baf8-a0a6f62cc9ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:07.135552 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a4a86-34da-481c-baf8-a0a6f62cc9ae service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:07.135919 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a4a86-34da-481c-baf8-a0a6f62cc9ae service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:07.136647 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a4a86-34da-481c-baf8-a0a6f62cc9ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:07.167465 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7a4a86-34da-481c-baf8-a0a6f62cc9ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:07.171502 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7a4a86-34da-481c-baf8-a0a6f62cc9ae service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:07.186335 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2125/4291] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:25:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:25:09.268326 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab9d41a-f896-49e5-b617-192b87ae0db6 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:09.269895 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-8ab9d41a-f896-49e5-b617-192b87ae0db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:09.288582 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab9d41a-f896-49e5-b617-192b87ae0db6 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:09.302260 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c7cdf5-6865-433c-9f0e-2086c83dd130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:09.303188 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7cdf5-6865-433c-9f0e-2086c83dd130 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:09.303494 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7cdf5-6865-433c-9f0e-2086c83dd130 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:09.303794 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7cdf5-6865-433c-9f0e-2086c83dd130 admin admin] PATH_INFO: `/v3/users/79ef4150f3ee4d7bad3c4cca099c7458` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:09.307357 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c7cdf5-6865-433c-9f0e-2086c83dd130 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79ef4150f3ee4d7bad3c4cca099c7458)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:09.321212 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c7cdf5-6865-433c-9f0e-2086c83dd130 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:09.367637 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0a8b0-dac2-4c25-8bc9-f1932afff476 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:09.368298 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0a8b0-dac2-4c25-8bc9-f1932afff476 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:09.368601 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0a8b0-dac2-4c25-8bc9-f1932afff476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:09.423816 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-24e0a8b0-dac2-4c25-8bc9-f1932afff476 None None] MFA Rules not processed for user `6f0c6efc18184500875e0db8280d6bc3`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:25:09.427945 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-24e0a8b0-dac2-4c25-8bc9-f1932afff476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:09.582792 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2126/4292] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:25:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:25:09.593300 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf0749-9e60-40dd-b1ed-8440990f7dce None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:09.594804 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf0749-9e60-40dd-b1ed-8440990f7dce None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:09.597524 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf0749-9e60-40dd-b1ed-8440990f7dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:09.611990 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d9c7cdf5-6865-433c-9f0e-2086c83dd130 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79ef4150f3ee4d7bad3c4cca099c7458'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:09.629295 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-41cf0749-9e60-40dd-b1ed-8440990f7dce None None] MFA Rules not processed for user `6f0c6efc18184500875e0db8280d6bc3`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:25:09.632140 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-41cf0749-9e60-40dd-b1ed-8440990f7dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:09.635146 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d9c7cdf5-6865-433c-9f0e-2086c83dd130 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79ef4150f3ee4d7bad3c4cca099c7458'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:09.646904 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2127/4293] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:25:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:25:09.654776 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d9c7cdf5-6865-433c-9f0e-2086c83dd130 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79ef4150f3ee4d7bad3c4cca099c7458'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:09.660045 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cf0749-9e60-40dd-b1ed-8440990f7dce None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:09.661792 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-41cf0749-9e60-40dd-b1ed-8440990f7dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:09.742112 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d9c7cdf5-6865-433c-9f0e-2086c83dd130 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79ef4150f3ee4d7bad3c4cca099c7458'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:09.742833 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d9c7cdf5-6865-433c-9f0e-2086c83dd130 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79ef4150f3ee4d7bad3c4cca099c7458'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:09.751404 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2167/4294] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:25:09 2022] DELETE /identity/v3/users/79ef4150f3ee4d7bad3c4cca099c7458 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:25:09.756352 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffbc455-cc53-4f87-bd32-c12c1adc2dc8 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:09.756352 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffbc455-cc53-4f87-bd32-c12c1adc2dc8 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:09.756633 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffbc455-cc53-4f87-bd32-c12c1adc2dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:09.773794 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cf0749-9e60-40dd-b1ed-8440990f7dce None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:09.778165 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-9ffbc455-cc53-4f87-bd32-c12c1adc2dc8 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:25:09.779671 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-9ffbc455-cc53-4f87-bd32-c12c1adc2dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:09.876248 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2168/4295] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:25:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:25:09.890828 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffbc455-cc53-4f87-bd32-c12c1adc2dc8 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:09.893178 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db22208c-9e60-4633-80fc-f7ee4da6dc8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:09.894242 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db22208c-9e60-4633-80fc-f7ee4da6dc8a service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:09.894722 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db22208c-9e60-4633-80fc-f7ee4da6dc8a service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:09.895177 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db22208c-9e60-4633-80fc-f7ee4da6dc8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:09.896331 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-9ffbc455-cc53-4f87-bd32-c12c1adc2dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:09.897427 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-db22208c-9e60-4633-80fc-f7ee4da6dc8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:09.983661 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffbc455-cc53-4f87-bd32-c12c1adc2dc8 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:10.000455 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1544d4-26e2-427c-81d0-da2b7727050b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:10.001191 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1544d4-26e2-427c-81d0-da2b7727050b service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:10.001412 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1544d4-26e2-427c-81d0-da2b7727050b service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:10.001959 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1544d4-26e2-427c-81d0-da2b7727050b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:10.017135 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1544d4-26e2-427c-81d0-da2b7727050b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:10.019658 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1544d4-26e2-427c-81d0-da2b7727050b service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:10.022156 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db22208c-9e60-4633-80fc-f7ee4da6dc8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:10.024870 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db22208c-9e60-4633-80fc-f7ee4da6dc8a service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:10.041580 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2128/4296] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:25:09 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:25:10.043232 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2169/4297] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:25:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:25:10.501963 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db22208c-9e60-4633-80fc-f7ee4da6dc8a service nova] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:10.503947 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-db22208c-9e60-4633-80fc-f7ee4da6dc8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:10.519749 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db22208c-9e60-4633-80fc-f7ee4da6dc8a service nova] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:10.525744 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735ca24e-3945-4c23-9d56-6cca387b952c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:10.526626 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ca24e-3945-4c23-9d56-6cca387b952c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:10.526908 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ca24e-3945-4c23-9d56-6cca387b952c admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:10.527191 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ca24e-3945-4c23-9d56-6cca387b952c admin admin] PATH_INFO: `/v3/projects/ef393d12cd9e4387985ada49dfba24d8` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:10.528411 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735ca24e-3945-4c23-9d56-6cca387b952c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef393d12cd9e4387985ada49dfba24d8)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:10.530336 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735ca24e-3945-4c23-9d56-6cca387b952c admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:10.662675 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-735ca24e-3945-4c23-9d56-6cca387b952c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef393d12cd9e4387985ada49dfba24d8', 'request_id': 'req-735ca24e-3945-4c23-9d56-6cca387b952c'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:10.669758 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-735ca24e-3945-4c23-9d56-6cca387b952c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef393d12cd9e4387985ada49dfba24d8', 'request_id': 'req-735ca24e-3945-4c23-9d56-6cca387b952c'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:10.678318 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-735ca24e-3945-4c23-9d56-6cca387b952c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef393d12cd9e4387985ada49dfba24d8', 'request_id': 'req-735ca24e-3945-4c23-9d56-6cca387b952c'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:10.777607 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-735ca24e-3945-4c23-9d56-6cca387b952c admin admin] The token cache is being invalidate because project ef393d12cd9e4387985ada49dfba24d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:25:10.778197 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-735ca24e-3945-4c23-9d56-6cca387b952c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:10.778925 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-735ca24e-3945-4c23-9d56-6cca387b952c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:10.783555 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2129/4298] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:25:10 2022] DELETE /identity/v3/projects/ef393d12cd9e4387985ada49dfba24d8 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:25:10.784759 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1544d4-26e2-427c-81d0-da2b7727050b service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:10.797845 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1544d4-26e2-427c-81d0-da2b7727050b service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:10.925475 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e257fbfc-4d99-4662-9a47-8369d6d77509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:10.927188 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257fbfc-4d99-4662-9a47-8369d6d77509 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:10.928687 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257fbfc-4d99-4662-9a47-8369d6d77509 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:10.928687 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257fbfc-4d99-4662-9a47-8369d6d77509 admin admin] PATH_INFO: `/v3/users/ead176a169a947e89b06acc4c7eafea1` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:10.937169 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e257fbfc-4d99-4662-9a47-8369d6d77509 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ead176a169a947e89b06acc4c7eafea1)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:10.943440 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e257fbfc-4d99-4662-9a47-8369d6d77509 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:11.199198 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e257fbfc-4d99-4662-9a47-8369d6d77509 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ead176a169a947e89b06acc4c7eafea1'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:11.229095 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e257fbfc-4d99-4662-9a47-8369d6d77509 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ead176a169a947e89b06acc4c7eafea1'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:11.240449 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e257fbfc-4d99-4662-9a47-8369d6d77509 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ead176a169a947e89b06acc4c7eafea1'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:11.354936 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e257fbfc-4d99-4662-9a47-8369d6d77509 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ead176a169a947e89b06acc4c7eafea1'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:11.356320 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e257fbfc-4d99-4662-9a47-8369d6d77509 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ead176a169a947e89b06acc4c7eafea1'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:11.364830 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2170/4299] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:25:10 2022] DELETE /identity/v3/users/ead176a169a947e89b06acc4c7eafea1 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:25:11.789504 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735ca24e-3945-4c23-9d56-6cca387b952c admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:11.792183 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-735ca24e-3945-4c23-9d56-6cca387b952c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:11.825620 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735ca24e-3945-4c23-9d56-6cca387b952c admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:11.911200 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d2b7e-57c6-441d-b0d4-d8b58b587d08 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:11.912140 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d2b7e-57c6-441d-b0d4-d8b58b587d08 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:11.912589 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d2b7e-57c6-441d-b0d4-d8b58b587d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:11.940309 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d0e4a1-ab0a-434e-9245-8f8d81ea62c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:11.940309 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d0e4a1-ab0a-434e-9245-8f8d81ea62c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:11.940309 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d0e4a1-ab0a-434e-9245-8f8d81ea62c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:11.940309 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d0e4a1-ab0a-434e-9245-8f8d81ea62c2 admin admin] PATH_INFO: `/v3/projects/98f1087977ab4d7ea0b5c0dbe2ccb277` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:11.940830 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d0e4a1-ab0a-434e-9245-8f8d81ea62c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98f1087977ab4d7ea0b5c0dbe2ccb277)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:11.942316 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d0e4a1-ab0a-434e-9245-8f8d81ea62c2 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:11.948148 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-d53d2b7e-57c6-441d-b0d4-d8b58b587d08 None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:25:11.949721 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d53d2b7e-57c6-441d-b0d4-d8b58b587d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:12.021645 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2171/4300] 10.222.0.52 () {58 vars in 1009 bytes} [Sat May 14 21:25:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:25:12.038381 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53d2b7e-57c6-441d-b0d4-d8b58b587d08 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:12.040041 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d53d2b7e-57c6-441d-b0d4-d8b58b587d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:12.089172 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-23d0e4a1-ab0a-434e-9245-8f8d81ea62c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98f1087977ab4d7ea0b5c0dbe2ccb277', 'request_id': 'req-23d0e4a1-ab0a-434e-9245-8f8d81ea62c2'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:12.089172 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-23d0e4a1-ab0a-434e-9245-8f8d81ea62c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98f1087977ab4d7ea0b5c0dbe2ccb277', 'request_id': 'req-23d0e4a1-ab0a-434e-9245-8f8d81ea62c2'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:12.096776 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-23d0e4a1-ab0a-434e-9245-8f8d81ea62c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98f1087977ab4d7ea0b5c0dbe2ccb277', 'request_id': 'req-23d0e4a1-ab0a-434e-9245-8f8d81ea62c2'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:12.129974 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53d2b7e-57c6-441d-b0d4-d8b58b587d08 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:12.199806 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78031000-9b2a-417b-b86d-836360f44fde service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:12.200510 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78031000-9b2a-417b-b86d-836360f44fde service swift] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:12.200798 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78031000-9b2a-417b-b86d-836360f44fde service swift] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:12.201082 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78031000-9b2a-417b-b86d-836360f44fde service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:12.260091 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78031000-9b2a-417b-b86d-836360f44fde service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:12.261717 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78031000-9b2a-417b-b86d-836360f44fde service swift] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:12.270233 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2172/4301] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 21:25:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 21:25:12.490676 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-23d0e4a1-ab0a-434e-9245-8f8d81ea62c2 admin admin] The token cache is being invalidate because project 98f1087977ab4d7ea0b5c0dbe2ccb277 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:25:12.490966 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-23d0e4a1-ab0a-434e-9245-8f8d81ea62c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:12.491675 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-23d0e4a1-ab0a-434e-9245-8f8d81ea62c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:12.493767 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2130/4302] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:25:11 2022] DELETE /identity/v3/projects/98f1087977ab4d7ea0b5c0dbe2ccb277 => generated 0 bytes in 705 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:25:12.498646 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a3550-81f3-44e5-ae05-1456f768e519 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:12.499074 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a3550-81f3-44e5-ae05-1456f768e519 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:12.499366 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a3550-81f3-44e5-ae05-1456f768e519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:12.518865 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-0a0a3550-81f3-44e5-ae05-1456f768e519 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:25:12.520106 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-0a0a3550-81f3-44e5-ae05-1456f768e519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:12.607436 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2173/4303] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:25:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:25:12.615180 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5212df-10cb-4cc8-8fc6-b9447b78ed50 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:12.615707 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5212df-10cb-4cc8-8fc6-b9447b78ed50 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:12.616003 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5212df-10cb-4cc8-8fc6-b9447b78ed50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:12.652212 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-3c5212df-10cb-4cc8-8fc6-b9447b78ed50 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:25:12.653853 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-3c5212df-10cb-4cc8-8fc6-b9447b78ed50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:12.697622 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2131/4304] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:25:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:25:12.703700 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0a3550-81f3-44e5-ae05-1456f768e519 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:12.722894 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0a3550-81f3-44e5-ae05-1456f768e519 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:12.735034 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8e4fbd-3467-4204-88e1-3d5b5b4ff17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:12.735658 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8e4fbd-3467-4204-88e1-3d5b5b4ff17a admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:12.735941 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8e4fbd-3467-4204-88e1-3d5b5b4ff17a admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:12.736216 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8e4fbd-3467-4204-88e1-3d5b5b4ff17a admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:12.736941 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8e4fbd-3467-4204-88e1-3d5b5b4ff17a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:25:12.737243 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8e4fbd-3467-4204-88e1-3d5b5b4ff17a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:12.739000 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8e4fbd-3467-4204-88e1-3d5b5b4ff17a admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:12.786163 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2174/4305] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:25:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:25:12.787313 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5212df-10cb-4cc8-8fc6-b9447b78ed50 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:12.813733 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5212df-10cb-4cc8-8fc6-b9447b78ed50 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:12.841024 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81365089-41c1-461f-a2cc-0385c8807112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:12.846636 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81365089-41c1-461f-a2cc-0385c8807112 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:12.846926 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81365089-41c1-461f-a2cc-0385c8807112 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:12.847227 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81365089-41c1-461f-a2cc-0385c8807112 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:12.847947 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81365089-41c1-461f-a2cc-0385c8807112 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:12.860777 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81365089-41c1-461f-a2cc-0385c8807112 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:13.021842 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2132/4306] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:25:12 2022] POST /identity/v3/projects => generated 391 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:25:13.026630 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8e4fbd-3467-4204-88e1-3d5b5b4ff17a admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:13.043993 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8e4fbd-3467-4204-88e1-3d5b5b4ff17a admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:13.160240 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c765482e-52cb-40bf-9bed-4a36444d517d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:13.160982 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c765482e-52cb-40bf-9bed-4a36444d517d admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:13.161270 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c765482e-52cb-40bf-9bed-4a36444d517d admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:13.161548 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c765482e-52cb-40bf-9bed-4a36444d517d admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:13.162304 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c765482e-52cb-40bf-9bed-4a36444d517d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:13.166027 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c765482e-52cb-40bf-9bed-4a36444d517d admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:13.265617 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2175/4307] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:25:13 2022] POST /identity/v3/users => generated 296 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:25:13.268474 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81365089-41c1-461f-a2cc-0385c8807112 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:13.285284 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81365089-41c1-461f-a2cc-0385c8807112 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:13.301463 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d015d1f2-2ed1-4473-a4a8-05d689e5522b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:13.302180 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d015d1f2-2ed1-4473-a4a8-05d689e5522b admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:13.302451 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d015d1f2-2ed1-4473-a4a8-05d689e5522b admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:13.302734 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d015d1f2-2ed1-4473-a4a8-05d689e5522b admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:13.303470 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d015d1f2-2ed1-4473-a4a8-05d689e5522b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:13.305715 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d015d1f2-2ed1-4473-a4a8-05d689e5522b admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:13.330538 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2133/4308] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:25:13 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:25:13.331858 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c765482e-52cb-40bf-9bed-4a36444d517d admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:13.346653 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c765482e-52cb-40bf-9bed-4a36444d517d admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:13.384192 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f3de67-b065-4557-85c2-167347187020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:13.385192 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3de67-b065-4557-85c2-167347187020 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:13.385192 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3de67-b065-4557-85c2-167347187020 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:13.385473 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3de67-b065-4557-85c2-167347187020 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:13.386250 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f3de67-b065-4557-85c2-167347187020 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:13.389585 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f3de67-b065-4557-85c2-167347187020 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:13.401615 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2176/4309] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:25:13 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:25:13.406448 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d015d1f2-2ed1-4473-a4a8-05d689e5522b admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:13.429714 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d015d1f2-2ed1-4473-a4a8-05d689e5522b admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:13.436462 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb0d002-d0c6-4052-9b7b-a3057fec94e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:13.437412 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0d002-d0c6-4052-9b7b-a3057fec94e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:13.437900 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0d002-d0c6-4052-9b7b-a3057fec94e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:13.438000 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0d002-d0c6-4052-9b7b-a3057fec94e2 admin admin] PATH_INFO: `/v3/projects/a5e52299769e4393a4d2300efc95dc1f/users/80d4a430aebb454cbff5294c40f2bcab/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:13.470416 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb0d002-d0c6-4052-9b7b-a3057fec94e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5e52299769e4393a4d2300efc95dc1f, user_id=80d4a430aebb454cbff5294c40f2bcab, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:13.473171 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb0d002-d0c6-4052-9b7b-a3057fec94e2 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:13.568650 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2134/4310] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:25:13 2022] PUT /identity/v3/projects/a5e52299769e4393a4d2300efc95dc1f/users/80d4a430aebb454cbff5294c40f2bcab/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:25:13.570556 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa812b-b1d5-49e5-92e3-b428dc72a898 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:13.570882 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa812b-b1d5-49e5-92e3-b428dc72a898 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:13.571837 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa812b-b1d5-49e5-92e3-b428dc72a898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:13.613784 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-e4fa812b-b1d5-49e5-92e3-b428dc72a898 None None] MFA Rules not processed for user `80d4a430aebb454cbff5294c40f2bcab`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:25:13.615082 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e4fa812b-b1d5-49e5-92e3-b428dc72a898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:13.719603 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2177/4311] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:25:13 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:25:13.732074 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb0d002-d0c6-4052-9b7b-a3057fec94e2 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:13.733353 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-6eb0d002-d0c6-4052-9b7b-a3057fec94e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:13.818413 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb0d002-d0c6-4052-9b7b-a3057fec94e2 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:13.822844 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ccaebd-baf6-454a-8b1d-088631bb382f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:13.823916 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ccaebd-baf6-454a-8b1d-088631bb382f service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:13.824205 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ccaebd-baf6-454a-8b1d-088631bb382f service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:13.824485 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ccaebd-baf6-454a-8b1d-088631bb382f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:13.835069 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ccaebd-baf6-454a-8b1d-088631bb382f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:13.837707 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ccaebd-baf6-454a-8b1d-088631bb382f service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:13.848498 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2135/4312] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:25:13 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:25:13.893512 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fa812b-b1d5-49e5-92e3-b428dc72a898 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:13.978489 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fa812b-b1d5-49e5-92e3-b428dc72a898 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:13.984146 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2cf5ad-50f5-4dae-be6b-00a9faa1cca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:13.985135 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2cf5ad-50f5-4dae-be6b-00a9faa1cca4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:13.985419 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2cf5ad-50f5-4dae-be6b-00a9faa1cca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:13.985700 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2cf5ad-50f5-4dae-be6b-00a9faa1cca4 admin admin] PATH_INFO: `/v3/users/80d4a430aebb454cbff5294c40f2bcab` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:13.986907 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2cf5ad-50f5-4dae-be6b-00a9faa1cca4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80d4a430aebb454cbff5294c40f2bcab)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:13.990430 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2cf5ad-50f5-4dae-be6b-00a9faa1cca4 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:14.107717 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b82b5-71e6-4701-851d-cb866fceab6f None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:14.108301 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b82b5-71e6-4701-851d-cb866fceab6f None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:14.108755 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b82b5-71e6-4701-851d-cb866fceab6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:14.128856 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-d92b82b5-71e6-4701-851d-cb866fceab6f None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:25:14.130468 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-d92b82b5-71e6-4701-851d-cb866fceab6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:14.279437 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2136/4313] 10.222.0.52 () {58 vars in 967 bytes} [Sat May 14 21:25:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:25:14.280567 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-de2cf5ad-50f5-4dae-be6b-00a9faa1cca4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80d4a430aebb454cbff5294c40f2bcab'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:14.338227 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-de2cf5ad-50f5-4dae-be6b-00a9faa1cca4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80d4a430aebb454cbff5294c40f2bcab'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:14.365017 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92b82b5-71e6-4701-851d-cb866fceab6f None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:14.366716 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-d92b82b5-71e6-4701-851d-cb866fceab6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:14.379329 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-de2cf5ad-50f5-4dae-be6b-00a9faa1cca4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80d4a430aebb454cbff5294c40f2bcab'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:14.504951 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92b82b5-71e6-4701-851d-cb866fceab6f None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:14.510919 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18907a22-ee81-4269-9ef8-e5ccc64bd81f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:14.511609 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18907a22-ee81-4269-9ef8-e5ccc64bd81f service swift] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:14.511897 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18907a22-ee81-4269-9ef8-e5ccc64bd81f service swift] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:14.512164 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18907a22-ee81-4269-9ef8-e5ccc64bd81f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:14.518982 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-de2cf5ad-50f5-4dae-be6b-00a9faa1cca4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80d4a430aebb454cbff5294c40f2bcab'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:14.523257 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-de2cf5ad-50f5-4dae-be6b-00a9faa1cca4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80d4a430aebb454cbff5294c40f2bcab'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:14.532641 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2178/4314] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:25:13 2022] DELETE /identity/v3/users/80d4a430aebb454cbff5294c40f2bcab => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:25:14.540739 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e9ff9-6dda-48aa-a083-464136a55210 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:14.547827 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e9ff9-6dda-48aa-a083-464136a55210 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:14.547827 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e9ff9-6dda-48aa-a083-464136a55210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:14.549111 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18907a22-ee81-4269-9ef8-e5ccc64bd81f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:14.554915 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18907a22-ee81-4269-9ef8-e5ccc64bd81f service swift] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:14.575376 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-479e9ff9-6dda-48aa-a083-464136a55210 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:25:14.576523 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2137/4315] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 21:25:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 14 21:25:14.576960 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-479e9ff9-6dda-48aa-a083-464136a55210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:14.695630 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2179/4316] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:25:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:25:14.702904 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18907a22-ee81-4269-9ef8-e5ccc64bd81f service swift] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:14.716973 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18907a22-ee81-4269-9ef8-e5ccc64bd81f service swift] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:14.798746 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2ce4d3-1da7-4262-a7a2-c6a6845c78b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:14.800045 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ce4d3-1da7-4262-a7a2-c6a6845c78b9 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:14.800551 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ce4d3-1da7-4262-a7a2-c6a6845c78b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:14.801031 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ce4d3-1da7-4262-a7a2-c6a6845c78b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:14.813307 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2ce4d3-1da7-4262-a7a2-c6a6845c78b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:14.814974 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2ce4d3-1da7-4262-a7a2-c6a6845c78b9 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:14.828897 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2138/4317] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:25:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:25:15.710884 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479e9ff9-6dda-48aa-a083-464136a55210 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:15.713189 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-479e9ff9-6dda-48aa-a083-464136a55210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:15.744571 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479e9ff9-6dda-48aa-a083-464136a55210 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:15.772840 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b1657c-a25d-4edf-81b1-9a2e0663bc3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:15.776325 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b1657c-a25d-4edf-81b1-9a2e0663bc3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:15.776931 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b1657c-a25d-4edf-81b1-9a2e0663bc3a admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:15.777631 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b1657c-a25d-4edf-81b1-9a2e0663bc3a admin admin] PATH_INFO: `/v3/projects/a5e52299769e4393a4d2300efc95dc1f` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:15.790792 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b1657c-a25d-4edf-81b1-9a2e0663bc3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5e52299769e4393a4d2300efc95dc1f)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:15.798772 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b1657c-a25d-4edf-81b1-9a2e0663bc3a admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:15.994113 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f9b1657c-a25d-4edf-81b1-9a2e0663bc3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5e52299769e4393a4d2300efc95dc1f', 'request_id': 'req-f9b1657c-a25d-4edf-81b1-9a2e0663bc3a'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:16.001420 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f9b1657c-a25d-4edf-81b1-9a2e0663bc3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5e52299769e4393a4d2300efc95dc1f', 'request_id': 'req-f9b1657c-a25d-4edf-81b1-9a2e0663bc3a'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:16.091250 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f9b1657c-a25d-4edf-81b1-9a2e0663bc3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5e52299769e4393a4d2300efc95dc1f', 'request_id': 'req-f9b1657c-a25d-4edf-81b1-9a2e0663bc3a'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:16.135785 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f9b1657c-a25d-4edf-81b1-9a2e0663bc3a admin admin] The token cache is being invalidate because project a5e52299769e4393a4d2300efc95dc1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:25:16.136128 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f9b1657c-a25d-4edf-81b1-9a2e0663bc3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:16.137914 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f9b1657c-a25d-4edf-81b1-9a2e0663bc3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:16.141048 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2180/4318] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:25:15 2022] DELETE /identity/v3/projects/a5e52299769e4393a4d2300efc95dc1f => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:25:16.146728 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda88e47-ceb1-4b0b-94dc-e1f4ae9ab062 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:16.147235 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda88e47-ceb1-4b0b-94dc-e1f4ae9ab062 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:16.170129 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda88e47-ceb1-4b0b-94dc-e1f4ae9ab062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:16.182026 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-cda88e47-ceb1-4b0b-94dc-e1f4ae9ab062 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:25:16.183668 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-cda88e47-ceb1-4b0b-94dc-e1f4ae9ab062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:16.299597 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2139/4319] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:25:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:25:16.308225 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7218a2-4446-40b0-b808-f30043df6534 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:16.308656 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7218a2-4446-40b0-b808-f30043df6534 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:16.309066 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7218a2-4446-40b0-b808-f30043df6534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:16.333275 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-ad7218a2-4446-40b0-b808-f30043df6534 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:25:16.335147 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ad7218a2-4446-40b0-b808-f30043df6534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:16.345630 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2181/4320] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:25:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:25:16.349738 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda88e47-ceb1-4b0b-94dc-e1f4ae9ab062 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:16.361108 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda88e47-ceb1-4b0b-94dc-e1f4ae9ab062 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:16.366695 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f159e-0e8b-4d73-96e2-97829d3e0996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:16.367941 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f159e-0e8b-4d73-96e2-97829d3e0996 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:16.368766 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f159e-0e8b-4d73-96e2-97829d3e0996 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:16.369299 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f159e-0e8b-4d73-96e2-97829d3e0996 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:16.370256 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0f159e-0e8b-4d73-96e2-97829d3e0996 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:25:16.370820 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0f159e-0e8b-4d73-96e2-97829d3e0996 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:16.372649 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0f159e-0e8b-4d73-96e2-97829d3e0996 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:16.388753 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2140/4321] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:25:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:25:16.392719 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7218a2-4446-40b0-b808-f30043df6534 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:16.404705 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7218a2-4446-40b0-b808-f30043df6534 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:16.415675 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd0278-8e5d-4f2a-ac73-9ed55f86211b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:16.416373 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd0278-8e5d-4f2a-ac73-9ed55f86211b admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:16.416659 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd0278-8e5d-4f2a-ac73-9ed55f86211b admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:16.416939 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd0278-8e5d-4f2a-ac73-9ed55f86211b admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:16.417650 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cd0278-8e5d-4f2a-ac73-9ed55f86211b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:16.419878 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cd0278-8e5d-4f2a-ac73-9ed55f86211b admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:16.452768 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba83e2-c7ed-4d86-81fb-776605d53e4d None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:16.453215 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba83e2-c7ed-4d86-81fb-776605d53e4d None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:16.453716 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba83e2-c7ed-4d86-81fb-776605d53e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:16.489867 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-edba83e2-c7ed-4d86-81fb-776605d53e4d None None] MFA Rules not processed for user `ed0a76be93e44fa887cb813a8879e04d`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:25:16.492372 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-edba83e2-c7ed-4d86-81fb-776605d53e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:16.559515 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2182/4322] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:25:16 2022] POST /identity/v3/projects => generated 391 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:25:16.559515 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd0278-8e5d-4f2a-ac73-9ed55f86211b admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:16.573103 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2141/4323] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:25:16 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:25:16.715985 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd0278-8e5d-4f2a-ac73-9ed55f86211b admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:16.721527 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1600a28b-3e90-4d2d-b5c1-4cc3c47d6e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:16.722162 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1600a28b-3e90-4d2d-b5c1-4cc3c47d6e47 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:16.722459 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1600a28b-3e90-4d2d-b5c1-4cc3c47d6e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:16.722724 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1600a28b-3e90-4d2d-b5c1-4cc3c47d6e47 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:16.723419 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1600a28b-3e90-4d2d-b5c1-4cc3c47d6e47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:16.725423 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1600a28b-3e90-4d2d-b5c1-4cc3c47d6e47 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:17.046078 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2183/4324] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:25:16 2022] POST /identity/v3/users => generated 296 bytes in 494 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:25:17.049703 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edba83e2-c7ed-4d86-81fb-776605d53e4d None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:17.062889 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edba83e2-c7ed-4d86-81fb-776605d53e4d None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:17.073923 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c02fc2-03d2-4e46-971d-0c36b81d7104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:17.074642 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c02fc2-03d2-4e46-971d-0c36b81d7104 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:17.075080 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c02fc2-03d2-4e46-971d-0c36b81d7104 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:17.075367 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c02fc2-03d2-4e46-971d-0c36b81d7104 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:17.076507 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c02fc2-03d2-4e46-971d-0c36b81d7104 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:17.078163 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c02fc2-03d2-4e46-971d-0c36b81d7104 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:17.113565 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2142/4325] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:25:17 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:25:17.114855 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1600a28b-3e90-4d2d-b5c1-4cc3c47d6e47 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:17.150618 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1600a28b-3e90-4d2d-b5c1-4cc3c47d6e47 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:17.166889 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14966cd5-4347-4bee-899b-42eea72ae42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:17.167587 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14966cd5-4347-4bee-899b-42eea72ae42c admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:17.167871 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14966cd5-4347-4bee-899b-42eea72ae42c admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:17.168148 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14966cd5-4347-4bee-899b-42eea72ae42c admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:17.174415 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14966cd5-4347-4bee-899b-42eea72ae42c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:17.176471 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14966cd5-4347-4bee-899b-42eea72ae42c admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:17.207347 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2184/4326] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:25:17 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:25:17.211580 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c02fc2-03d2-4e46-971d-0c36b81d7104 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:17.231202 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c02fc2-03d2-4e46-971d-0c36b81d7104 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:17.242169 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f42759-5cd2-4212-874d-288731decba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:17.243840 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f42759-5cd2-4212-874d-288731decba6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:17.244128 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f42759-5cd2-4212-874d-288731decba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:17.244588 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f42759-5cd2-4212-874d-288731decba6 admin admin] PATH_INFO: `/v3/projects/716f3eb835744dd5bc0290c8e34f808d/users/6d179177a9d34c7bac1b6a613c4f1426/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:17.281666 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f42759-5cd2-4212-874d-288731decba6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=716f3eb835744dd5bc0290c8e34f808d, user_id=6d179177a9d34c7bac1b6a613c4f1426, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:17.284743 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f42759-5cd2-4212-874d-288731decba6 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:17.387104 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2143/4327] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:25:17 2022] PUT /identity/v3/projects/716f3eb835744dd5bc0290c8e34f808d/users/6d179177a9d34c7bac1b6a613c4f1426/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:25:17.404290 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a38d3-30dc-4174-a64d-f1da92189231 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:17.404577 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a38d3-30dc-4174-a64d-f1da92189231 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:17.404856 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a38d3-30dc-4174-a64d-f1da92189231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:17.475941 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-924a38d3-30dc-4174-a64d-f1da92189231 None None] MFA Rules not processed for user `6d179177a9d34c7bac1b6a613c4f1426`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:25:17.478115 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-924a38d3-30dc-4174-a64d-f1da92189231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:17.611390 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2185/4328] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:25:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:25:17.622088 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f42759-5cd2-4212-874d-288731decba6 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:17.624933 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-30f42759-5cd2-4212-874d-288731decba6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:17.728080 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f42759-5cd2-4212-874d-288731decba6 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:17.737112 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f066154-e364-4d7f-8a80-79bd888c4b8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:17.737796 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f066154-e364-4d7f-8a80-79bd888c4b8b service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:17.739397 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f066154-e364-4d7f-8a80-79bd888c4b8b service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:17.739720 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f066154-e364-4d7f-8a80-79bd888c4b8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:17.754378 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f066154-e364-4d7f-8a80-79bd888c4b8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:17.756567 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f066154-e364-4d7f-8a80-79bd888c4b8b service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:17.768065 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2144/4329] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:25:17 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:25:21.329800 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a38d3-30dc-4174-a64d-f1da92189231 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:21.331375 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-924a38d3-30dc-4174-a64d-f1da92189231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:21.487534 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a38d3-30dc-4174-a64d-f1da92189231 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:21.493745 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e2d01-9955-4c28-a6a0-1c4d2d3300f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:21.495386 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e2d01-9955-4c28-a6a0-1c4d2d3300f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:21.495955 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e2d01-9955-4c28-a6a0-1c4d2d3300f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:21.496469 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e2d01-9955-4c28-a6a0-1c4d2d3300f6 admin admin] PATH_INFO: `/v3/users/ea1c919d55a34ef6b52e4ba211928f5b` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:21.497973 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998e2d01-9955-4c28-a6a0-1c4d2d3300f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea1c919d55a34ef6b52e4ba211928f5b)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:21.500333 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998e2d01-9955-4c28-a6a0-1c4d2d3300f6 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:21.712827 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-998e2d01-9955-4c28-a6a0-1c4d2d3300f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea1c919d55a34ef6b52e4ba211928f5b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:21.747156 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-998e2d01-9955-4c28-a6a0-1c4d2d3300f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea1c919d55a34ef6b52e4ba211928f5b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:21.761664 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-998e2d01-9955-4c28-a6a0-1c4d2d3300f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea1c919d55a34ef6b52e4ba211928f5b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:21.840595 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-998e2d01-9955-4c28-a6a0-1c4d2d3300f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea1c919d55a34ef6b52e4ba211928f5b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:21.842118 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-998e2d01-9955-4c28-a6a0-1c4d2d3300f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea1c919d55a34ef6b52e4ba211928f5b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:21.858849 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2186/4330] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:25:21 2022] DELETE /identity/v3/users/ea1c919d55a34ef6b52e4ba211928f5b => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:25:22.413555 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f066154-e364-4d7f-8a80-79bd888c4b8b service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:22.438174 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f066154-e364-4d7f-8a80-79bd888c4b8b service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:22.581944 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae629a2-960d-447f-af73-d383066a4aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:22.585518 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae629a2-960d-447f-af73-d383066a4aa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:22.585694 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae629a2-960d-447f-af73-d383066a4aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:22.586006 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae629a2-960d-447f-af73-d383066a4aa8 admin admin] PATH_INFO: `/v3/projects/69be921807044629a1b5f9e3adc7d5ef` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:22.587450 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae629a2-960d-447f-af73-d383066a4aa8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69be921807044629a1b5f9e3adc7d5ef)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:22.590066 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae629a2-960d-447f-af73-d383066a4aa8 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:22.758568 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9ae629a2-960d-447f-af73-d383066a4aa8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69be921807044629a1b5f9e3adc7d5ef', 'request_id': 'req-9ae629a2-960d-447f-af73-d383066a4aa8'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:22.777048 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9ae629a2-960d-447f-af73-d383066a4aa8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69be921807044629a1b5f9e3adc7d5ef', 'request_id': 'req-9ae629a2-960d-447f-af73-d383066a4aa8'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:22.791778 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9ae629a2-960d-447f-af73-d383066a4aa8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69be921807044629a1b5f9e3adc7d5ef', 'request_id': 'req-9ae629a2-960d-447f-af73-d383066a4aa8'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:22.876617 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9ae629a2-960d-447f-af73-d383066a4aa8 admin admin] The token cache is being invalidate because project 69be921807044629a1b5f9e3adc7d5ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:25:22.876617 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9ae629a2-960d-447f-af73-d383066a4aa8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:22.877059 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9ae629a2-960d-447f-af73-d383066a4aa8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:22.879305 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2145/4331] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:25:22 2022] DELETE /identity/v3/projects/69be921807044629a1b5f9e3adc7d5ef => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:25:22.886339 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed45e98-3526-402a-a435-16d48e329d38 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:22.887733 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed45e98-3526-402a-a435-16d48e329d38 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:22.888196 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed45e98-3526-402a-a435-16d48e329d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:22.948317 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-eed45e98-3526-402a-a435-16d48e329d38 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:25:22.949545 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-eed45e98-3526-402a-a435-16d48e329d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:23.145353 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2187/4332] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:25:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:25:23.154225 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c2585-8fe8-4b7b-8576-1a181162fe95 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:23.157217 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c2585-8fe8-4b7b-8576-1a181162fe95 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:23.157217 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c2585-8fe8-4b7b-8576-1a181162fe95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:23.208914 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-d41c2585-8fe8-4b7b-8576-1a181162fe95 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:25:23.210462 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-d41c2585-8fe8-4b7b-8576-1a181162fe95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:23.236353 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2146/4333] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:25:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:25:23.241231 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed45e98-3526-402a-a435-16d48e329d38 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:23.251803 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed45e98-3526-402a-a435-16d48e329d38 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:23.263283 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c7d59d-602f-4d5e-8e6c-5b7ae9708c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:23.264275 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c7d59d-602f-4d5e-8e6c-5b7ae9708c7a admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:23.264750 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c7d59d-602f-4d5e-8e6c-5b7ae9708c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:23.265175 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c7d59d-602f-4d5e-8e6c-5b7ae9708c7a admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:23.266157 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c7d59d-602f-4d5e-8e6c-5b7ae9708c7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:25:23.266635 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c7d59d-602f-4d5e-8e6c-5b7ae9708c7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:23.269708 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c7d59d-602f-4d5e-8e6c-5b7ae9708c7a admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:23.289065 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2188/4334] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:25:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:25:23.291615 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41c2585-8fe8-4b7b-8576-1a181162fe95 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:23.312827 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41c2585-8fe8-4b7b-8576-1a181162fe95 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:23.328426 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbb57c0-612b-4b96-9cee-cdf0a1a5db2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:23.329301 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb57c0-612b-4b96-9cee-cdf0a1a5db2e admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:23.329592 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb57c0-612b-4b96-9cee-cdf0a1a5db2e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:23.330696 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb57c0-612b-4b96-9cee-cdf0a1a5db2e admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:23.330696 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbb57c0-612b-4b96-9cee-cdf0a1a5db2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:23.336056 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbb57c0-612b-4b96-9cee-cdf0a1a5db2e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:23.479526 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2147/4335] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:25:23 2022] POST /identity/v3/projects => generated 373 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:25:23.482257 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c7d59d-602f-4d5e-8e6c-5b7ae9708c7a admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:23.495024 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c7d59d-602f-4d5e-8e6c-5b7ae9708c7a admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:23.628898 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92d8321-1bbc-4723-a34d-93dc8dc395ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:23.630160 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d8321-1bbc-4723-a34d-93dc8dc395ac admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:23.630557 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d8321-1bbc-4723-a34d-93dc8dc395ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:23.630925 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d8321-1bbc-4723-a34d-93dc8dc395ac admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:23.631776 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92d8321-1bbc-4723-a34d-93dc8dc395ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:23.635251 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92d8321-1bbc-4723-a34d-93dc8dc395ac admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:23.763985 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbb57c0-612b-4b96-9cee-cdf0a1a5db2e admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:23.767043 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2189/4336] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:25:23 2022] POST /identity/v3/users => generated 287 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:25:23.783433 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbb57c0-612b-4b96-9cee-cdf0a1a5db2e admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:23.792227 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584f9e10-7e6a-4627-aaa4-01ca218095d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:23.792923 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584f9e10-7e6a-4627-aaa4-01ca218095d8 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:23.793206 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584f9e10-7e6a-4627-aaa4-01ca218095d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:23.793480 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584f9e10-7e6a-4627-aaa4-01ca218095d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:23.794216 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584f9e10-7e6a-4627-aaa4-01ca218095d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:23.800514 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584f9e10-7e6a-4627-aaa4-01ca218095d8 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:23.836417 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92d8321-1bbc-4723-a34d-93dc8dc395ac admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:23.837949 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2148/4337] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:25:23 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:25:23.856812 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92d8321-1bbc-4723-a34d-93dc8dc395ac admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:23.872550 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d959050-41f3-4fcd-af96-5b51d27b1a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:23.875433 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d959050-41f3-4fcd-af96-5b51d27b1a6a admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:23.877421 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d959050-41f3-4fcd-af96-5b51d27b1a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:23.880751 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d959050-41f3-4fcd-af96-5b51d27b1a6a admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:23.882809 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d959050-41f3-4fcd-af96-5b51d27b1a6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:23.895337 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d959050-41f3-4fcd-af96-5b51d27b1a6a admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:23.948779 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2190/4338] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:25:23 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:25:23.952906 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584f9e10-7e6a-4627-aaa4-01ca218095d8 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:23.984450 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584f9e10-7e6a-4627-aaa4-01ca218095d8 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:24.006119 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb3644-ce36-40fc-bbd3-333216890d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:24.007347 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb3644-ce36-40fc-bbd3-333216890d01 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:24.007867 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb3644-ce36-40fc-bbd3-333216890d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:24.010423 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb3644-ce36-40fc-bbd3-333216890d01 admin admin] PATH_INFO: `/v3/projects/f81d13056f0041a4b01112cd3d502b78/users/fbbd79f0a4984166a48522eb5103f0c1/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:24.069413 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fb3644-ce36-40fc-bbd3-333216890d01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f81d13056f0041a4b01112cd3d502b78, user_id=fbbd79f0a4984166a48522eb5103f0c1, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:24.072835 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fb3644-ce36-40fc-bbd3-333216890d01 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:24.215205 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2149/4339] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:25:23 2022] PUT /identity/v3/projects/f81d13056f0041a4b01112cd3d502b78/users/fbbd79f0a4984166a48522eb5103f0c1/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:25:24.217097 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e2327-f5f3-4efc-a8f2-6eff86f3891d None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:24.218005 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e2327-f5f3-4efc-a8f2-6eff86f3891d None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:24.218619 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e2327-f5f3-4efc-a8f2-6eff86f3891d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:24.256089 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-900e2327-f5f3-4efc-a8f2-6eff86f3891d None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:25:24.260191 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-900e2327-f5f3-4efc-a8f2-6eff86f3891d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:24.338781 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2191/4340] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:25:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:25:24.351612 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb3644-ce36-40fc-bbd3-333216890d01 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:24.354793 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-f9fb3644-ce36-40fc-bbd3-333216890d01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:24.515953 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb3644-ce36-40fc-bbd3-333216890d01 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:24.520176 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a496dc2-52c7-4f50-af2d-d50065e7e044 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:24.525508 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a496dc2-52c7-4f50-af2d-d50065e7e044 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:24.525888 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a496dc2-52c7-4f50-af2d-d50065e7e044 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:24.526248 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a496dc2-52c7-4f50-af2d-d50065e7e044 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:24.569758 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a496dc2-52c7-4f50-af2d-d50065e7e044 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:24.572310 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a496dc2-52c7-4f50-af2d-d50065e7e044 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:24.595893 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2150/4341] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:25:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:25:27.962544 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55692baf-2833-41a2-958a-24a5a5d2ccfa None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:27.966628 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55692baf-2833-41a2-958a-24a5a5d2ccfa None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:27.966945 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55692baf-2833-41a2-958a-24a5a5d2ccfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:28.086845 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-55692baf-2833-41a2-958a-24a5a5d2ccfa None None] MFA Rules not processed for user `fbbd79f0a4984166a48522eb5103f0c1`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:25:28.093879 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-55692baf-2833-41a2-958a-24a5a5d2ccfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:28.312194 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2192/4342] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:25:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:25:28.325620 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f21a421-48fe-4f67-bb89-d4bc6a062ed2 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:28.330849 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f21a421-48fe-4f67-bb89-d4bc6a062ed2 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:28.330849 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f21a421-48fe-4f67-bb89-d4bc6a062ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:28.352862 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-5f21a421-48fe-4f67-bb89-d4bc6a062ed2 None None] MFA Rules not processed for user `fbbd79f0a4984166a48522eb5103f0c1`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:25:28.355016 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-5f21a421-48fe-4f67-bb89-d4bc6a062ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:28.367665 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2151/4343] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:25:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:25:28.379721 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55692baf-2833-41a2-958a-24a5a5d2ccfa None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:28.382137 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-55692baf-2833-41a2-958a-24a5a5d2ccfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:28.612330 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55692baf-2833-41a2-958a-24a5a5d2ccfa None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:28.620758 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0c0fdd-d9f5-481a-b5cb-df523708bb1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:28.621789 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c0fdd-d9f5-481a-b5cb-df523708bb1e service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:28.622217 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c0fdd-d9f5-481a-b5cb-df523708bb1e service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:28.622601 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c0fdd-d9f5-481a-b5cb-df523708bb1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:28.638321 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0c0fdd-d9f5-481a-b5cb-df523708bb1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:28.640177 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0c0fdd-d9f5-481a-b5cb-df523708bb1e service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:28.673396 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2193/4344] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:25:28 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:25:31.757294 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f21a421-48fe-4f67-bb89-d4bc6a062ed2 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:31.758894 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-5f21a421-48fe-4f67-bb89-d4bc6a062ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:31.791878 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f21a421-48fe-4f67-bb89-d4bc6a062ed2 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:31.803048 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d340b5af-444a-4000-9a90-b3eb826e438e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:31.803965 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d340b5af-444a-4000-9a90-b3eb826e438e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:31.804246 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d340b5af-444a-4000-9a90-b3eb826e438e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:31.804522 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d340b5af-444a-4000-9a90-b3eb826e438e admin admin] PATH_INFO: `/v3/users/6d179177a9d34c7bac1b6a613c4f1426` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:31.807788 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d340b5af-444a-4000-9a90-b3eb826e438e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d179177a9d34c7bac1b6a613c4f1426)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:31.809789 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d340b5af-444a-4000-9a90-b3eb826e438e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:32.030416 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d340b5af-444a-4000-9a90-b3eb826e438e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d179177a9d34c7bac1b6a613c4f1426'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:32.046959 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d340b5af-444a-4000-9a90-b3eb826e438e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d179177a9d34c7bac1b6a613c4f1426'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:32.047791 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d340b5af-444a-4000-9a90-b3eb826e438e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d179177a9d34c7bac1b6a613c4f1426'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:32.152913 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d340b5af-444a-4000-9a90-b3eb826e438e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d179177a9d34c7bac1b6a613c4f1426'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:32.172257 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d340b5af-444a-4000-9a90-b3eb826e438e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d179177a9d34c7bac1b6a613c4f1426'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:32.189883 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2152/4345] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:25:31 2022] DELETE /identity/v3/users/6d179177a9d34c7bac1b6a613c4f1426 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:25:32.194782 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af7ea7-5a6d-4f06-ab55-96b9e50911cb None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:32.195884 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af7ea7-5a6d-4f06-ab55-96b9e50911cb None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:32.196358 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af7ea7-5a6d-4f06-ab55-96b9e50911cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:32.216217 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-24af7ea7-5a6d-4f06-ab55-96b9e50911cb None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:25:32.217457 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-24af7ea7-5a6d-4f06-ab55-96b9e50911cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:32.288436 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2194/4346] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:25:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:25:32.301679 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d340b5af-444a-4000-9a90-b3eb826e438e admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:32.303258 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-d340b5af-444a-4000-9a90-b3eb826e438e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:32.389870 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d340b5af-444a-4000-9a90-b3eb826e438e admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:32.392999 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28021487-3b40-4f95-9000-f02589d7b0b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:32.393737 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28021487-3b40-4f95-9000-f02589d7b0b0 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:32.394019 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28021487-3b40-4f95-9000-f02589d7b0b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:32.394286 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28021487-3b40-4f95-9000-f02589d7b0b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:32.417684 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28021487-3b40-4f95-9000-f02589d7b0b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:32.419804 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28021487-3b40-4f95-9000-f02589d7b0b0 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:32.432988 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2153/4347] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:25:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:25:32.940775 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24af7ea7-5a6d-4f06-ab55-96b9e50911cb None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:32.942649 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-24af7ea7-5a6d-4f06-ab55-96b9e50911cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:32.963971 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24af7ea7-5a6d-4f06-ab55-96b9e50911cb None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:32.980364 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a74e02-9256-43fc-b82d-74493698d630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:32.982716 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a74e02-9256-43fc-b82d-74493698d630 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:32.983262 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a74e02-9256-43fc-b82d-74493698d630 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:32.983823 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a74e02-9256-43fc-b82d-74493698d630 admin admin] PATH_INFO: `/v3/projects/716f3eb835744dd5bc0290c8e34f808d` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:32.985974 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a74e02-9256-43fc-b82d-74493698d630 admin admin] RBAC: Authorizing `identity:delete_project(project_id=716f3eb835744dd5bc0290c8e34f808d)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:32.990257 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a74e02-9256-43fc-b82d-74493698d630 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:33.152495 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-03a74e02-9256-43fc-b82d-74493698d630 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '716f3eb835744dd5bc0290c8e34f808d', 'request_id': 'req-03a74e02-9256-43fc-b82d-74493698d630'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:33.161018 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-03a74e02-9256-43fc-b82d-74493698d630 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '716f3eb835744dd5bc0290c8e34f808d', 'request_id': 'req-03a74e02-9256-43fc-b82d-74493698d630'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:33.268227 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-03a74e02-9256-43fc-b82d-74493698d630 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '716f3eb835744dd5bc0290c8e34f808d', 'request_id': 'req-03a74e02-9256-43fc-b82d-74493698d630'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:33.303702 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-03a74e02-9256-43fc-b82d-74493698d630 admin admin] The token cache is being invalidate because project 716f3eb835744dd5bc0290c8e34f808d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:25:33.304074 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-03a74e02-9256-43fc-b82d-74493698d630 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:33.305468 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-03a74e02-9256-43fc-b82d-74493698d630 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:33.308238 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2195/4348] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:25:32 2022] DELETE /identity/v3/projects/716f3eb835744dd5bc0290c8e34f808d => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:25:33.312754 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec94252-ef3f-4a6c-8651-e3c40d681f7f None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:33.313663 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec94252-ef3f-4a6c-8651-e3c40d681f7f None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:33.314122 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec94252-ef3f-4a6c-8651-e3c40d681f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:33.336987 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-dec94252-ef3f-4a6c-8651-e3c40d681f7f None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:25:33.338645 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-dec94252-ef3f-4a6c-8651-e3c40d681f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:33.427642 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2154/4349] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:25:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:25:33.433077 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca60630-4991-44ae-8a82-4b7b2fa0082d None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:33.433371 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca60630-4991-44ae-8a82-4b7b2fa0082d None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:33.433643 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca60630-4991-44ae-8a82-4b7b2fa0082d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:33.453583 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-8ca60630-4991-44ae-8a82-4b7b2fa0082d None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:25:33.454819 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-8ca60630-4991-44ae-8a82-4b7b2fa0082d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:33.468362 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec94252-ef3f-4a6c-8651-e3c40d681f7f None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:33.468905 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2196/4350] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:25:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:25:33.478455 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec94252-ef3f-4a6c-8651-e3c40d681f7f None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:33.484090 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6dd13a-bcef-401b-8c50-ae0524ff37eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:33.484850 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6dd13a-bcef-401b-8c50-ae0524ff37eb admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:33.485083 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6dd13a-bcef-401b-8c50-ae0524ff37eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:33.485317 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6dd13a-bcef-401b-8c50-ae0524ff37eb admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:33.486048 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6dd13a-bcef-401b-8c50-ae0524ff37eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:25:33.486355 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6dd13a-bcef-401b-8c50-ae0524ff37eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:33.488058 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6dd13a-bcef-401b-8c50-ae0524ff37eb admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:33.501030 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2155/4351] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:25:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:25:33.505304 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca60630-4991-44ae-8a82-4b7b2fa0082d None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:33.523191 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca60630-4991-44ae-8a82-4b7b2fa0082d None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:33.530092 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f995adf0-b353-4b6c-967b-20f9a3475950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:33.530773 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995adf0-b353-4b6c-967b-20f9a3475950 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:33.534627 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995adf0-b353-4b6c-967b-20f9a3475950 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:33.534627 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995adf0-b353-4b6c-967b-20f9a3475950 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:33.534627 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f995adf0-b353-4b6c-967b-20f9a3475950 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:33.535562 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f995adf0-b353-4b6c-967b-20f9a3475950 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:33.671068 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2197/4352] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:25:33 2022] POST /identity/v3/projects => generated 387 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:25:33.675179 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6dd13a-bcef-401b-8c50-ae0524ff37eb admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:33.686064 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6dd13a-bcef-401b-8c50-ae0524ff37eb admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:33.761589 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b5d3b1-f084-426a-9241-dd42bb49ce57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:33.762275 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5d3b1-f084-426a-9241-dd42bb49ce57 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:33.763208 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5d3b1-f084-426a-9241-dd42bb49ce57 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:33.763208 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5d3b1-f084-426a-9241-dd42bb49ce57 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:33.763860 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b5d3b1-f084-426a-9241-dd42bb49ce57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:33.766448 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b5d3b1-f084-426a-9241-dd42bb49ce57 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:33.900386 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2156/4353] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:25:33 2022] POST /identity/v3/users => generated 294 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:25:33.901332 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f995adf0-b353-4b6c-967b-20f9a3475950 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:33.912517 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f995adf0-b353-4b6c-967b-20f9a3475950 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:33.922230 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2844d39a-4698-4020-a942-40ff3999790f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:33.922966 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2844d39a-4698-4020-a942-40ff3999790f admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:33.923254 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2844d39a-4698-4020-a942-40ff3999790f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:33.923770 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2844d39a-4698-4020-a942-40ff3999790f admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:33.924506 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2844d39a-4698-4020-a942-40ff3999790f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:33.926560 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2844d39a-4698-4020-a942-40ff3999790f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:33.941286 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2198/4354] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:25:33 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:25:33.945205 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b5d3b1-f084-426a-9241-dd42bb49ce57 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:33.957730 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b5d3b1-f084-426a-9241-dd42bb49ce57 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:33.964772 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f518a8-a57d-4b53-ac99-1f8241b70de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:33.965968 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f518a8-a57d-4b53-ac99-1f8241b70de7 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:33.966411 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f518a8-a57d-4b53-ac99-1f8241b70de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:33.966845 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f518a8-a57d-4b53-ac99-1f8241b70de7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:33.968004 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f518a8-a57d-4b53-ac99-1f8241b70de7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:33.970512 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f518a8-a57d-4b53-ac99-1f8241b70de7 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:33.983867 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2157/4355] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:25:33 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:25:33.988675 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2844d39a-4698-4020-a942-40ff3999790f admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:33.999644 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2844d39a-4698-4020-a942-40ff3999790f admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:34.006296 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd462d4-e75e-48dd-9aad-94f01ac37537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:34.007349 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd462d4-e75e-48dd-9aad-94f01ac37537 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:34.007948 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd462d4-e75e-48dd-9aad-94f01ac37537 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:34.008408 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd462d4-e75e-48dd-9aad-94f01ac37537 admin admin] PATH_INFO: `/v3/projects/07944a81a7734cdd9c0381a99e29c0a6/users/10ef9774b8b547f4a6ccf630d9ccc7ed/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:34.026473 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd462d4-e75e-48dd-9aad-94f01ac37537 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07944a81a7734cdd9c0381a99e29c0a6, user_id=10ef9774b8b547f4a6ccf630d9ccc7ed, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:34.029425 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd462d4-e75e-48dd-9aad-94f01ac37537 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:34.103201 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2199/4356] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:25:33 2022] PUT /identity/v3/projects/07944a81a7734cdd9c0381a99e29c0a6/users/10ef9774b8b547f4a6ccf630d9ccc7ed/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:25:34.115687 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c61391-c3f8-4bdd-a8fa-6d5a1e811e31 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:34.116039 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c61391-c3f8-4bdd-a8fa-6d5a1e811e31 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:34.116257 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c61391-c3f8-4bdd-a8fa-6d5a1e811e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:34.152674 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-89c61391-c3f8-4bdd-a8fa-6d5a1e811e31 None None] MFA Rules not processed for user `10ef9774b8b547f4a6ccf630d9ccc7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:25:34.153966 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-89c61391-c3f8-4bdd-a8fa-6d5a1e811e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:34.238071 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2158/4357] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:25:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:25:34.248763 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd462d4-e75e-48dd-9aad-94f01ac37537 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:34.250531 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-bbd462d4-e75e-48dd-9aad-94f01ac37537 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:34.316370 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd462d4-e75e-48dd-9aad-94f01ac37537 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:34.320938 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc820a9-12fa-40ad-ae01-89d2846c184d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:34.327026 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc820a9-12fa-40ad-ae01-89d2846c184d service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:34.327026 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc820a9-12fa-40ad-ae01-89d2846c184d service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:34.327026 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc820a9-12fa-40ad-ae01-89d2846c184d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:34.338189 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc820a9-12fa-40ad-ae01-89d2846c184d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:34.340231 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc820a9-12fa-40ad-ae01-89d2846c184d service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:34.352883 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2200/4358] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:25:34 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:25:35.414032 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c61391-c3f8-4bdd-a8fa-6d5a1e811e31 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:35.416658 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-89c61391-c3f8-4bdd-a8fa-6d5a1e811e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:35.535958 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c61391-c3f8-4bdd-a8fa-6d5a1e811e31 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:35.542261 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ab5d66-b438-4ac3-b5ad-87fc11bd2888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:35.543149 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab5d66-b438-4ac3-b5ad-87fc11bd2888 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:35.543427 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab5d66-b438-4ac3-b5ad-87fc11bd2888 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:35.543733 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab5d66-b438-4ac3-b5ad-87fc11bd2888 admin admin] PATH_INFO: `/v3/users/6f0c6efc18184500875e0db8280d6bc3` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:35.544949 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ab5d66-b438-4ac3-b5ad-87fc11bd2888 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f0c6efc18184500875e0db8280d6bc3)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:35.547903 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ab5d66-b438-4ac3-b5ad-87fc11bd2888 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:35.768157 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a6ab5d66-b438-4ac3-b5ad-87fc11bd2888 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f0c6efc18184500875e0db8280d6bc3'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:35.778416 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a6ab5d66-b438-4ac3-b5ad-87fc11bd2888 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f0c6efc18184500875e0db8280d6bc3'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:35.779338 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a6ab5d66-b438-4ac3-b5ad-87fc11bd2888 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f0c6efc18184500875e0db8280d6bc3'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:35.896147 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a6ab5d66-b438-4ac3-b5ad-87fc11bd2888 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f0c6efc18184500875e0db8280d6bc3'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:35.910524 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a6ab5d66-b438-4ac3-b5ad-87fc11bd2888 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f0c6efc18184500875e0db8280d6bc3'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:35.924064 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2159/4359] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:25:35 2022] DELETE /identity/v3/users/6f0c6efc18184500875e0db8280d6bc3 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:25:36.599062 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc820a9-12fa-40ad-ae01-89d2846c184d service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:36.638676 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc820a9-12fa-40ad-ae01-89d2846c184d service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:36.729089 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ab5d66-b438-4ac3-b5ad-87fc11bd2888 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:36.731266 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-a6ab5d66-b438-4ac3-b5ad-87fc11bd2888 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:36.743832 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1cb63a-c5b0-4ab6-87cf-6a70313c6195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:36.745146 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1cb63a-c5b0-4ab6-87cf-6a70313c6195 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:36.746055 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1cb63a-c5b0-4ab6-87cf-6a70313c6195 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:36.756939 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1cb63a-c5b0-4ab6-87cf-6a70313c6195 admin admin] PATH_INFO: `/v3/projects/7b8a604af2ec48059ef55244ec6a5363` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:36.756939 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1cb63a-c5b0-4ab6-87cf-6a70313c6195 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b8a604af2ec48059ef55244ec6a5363)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:36.756939 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1cb63a-c5b0-4ab6-87cf-6a70313c6195 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:36.857330 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ab5d66-b438-4ac3-b5ad-87fc11bd2888 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:36.862228 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9823f843-db94-44f9-a40b-0de96250ac6a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b5cb86f190f4fcfb06d66cb8f14643f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:36.863207 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9823f843-db94-44f9-a40b-0de96250ac6a service glance] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:36.863341 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9823f843-db94-44f9-a40b-0de96250ac6a service glance] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:36.863729 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9823f843-db94-44f9-a40b-0de96250ac6a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:36.866203 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-9823f843-db94-44f9-a40b-0de96250ac6a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:36.911835 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-df1cb63a-c5b0-4ab6-87cf-6a70313c6195 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b8a604af2ec48059ef55244ec6a5363', 'request_id': 'req-df1cb63a-c5b0-4ab6-87cf-6a70313c6195'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:36.930262 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-df1cb63a-c5b0-4ab6-87cf-6a70313c6195 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b8a604af2ec48059ef55244ec6a5363', 'request_id': 'req-df1cb63a-c5b0-4ab6-87cf-6a70313c6195'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:36.999238 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9823f843-db94-44f9-a40b-0de96250ac6a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:37.001149 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9823f843-db94-44f9-a40b-0de96250ac6a service glance] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:37.020967 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2160/4360] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:25:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:25:37.038969 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-df1cb63a-c5b0-4ab6-87cf-6a70313c6195 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b8a604af2ec48059ef55244ec6a5363', 'request_id': 'req-df1cb63a-c5b0-4ab6-87cf-6a70313c6195'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:37.063125 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-df1cb63a-c5b0-4ab6-87cf-6a70313c6195 admin admin] The token cache is being invalidate because project 7b8a604af2ec48059ef55244ec6a5363 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:25:37.063700 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-df1cb63a-c5b0-4ab6-87cf-6a70313c6195 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:37.064876 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-df1cb63a-c5b0-4ab6-87cf-6a70313c6195 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:37.070810 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2201/4361] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:25:36 2022] DELETE /identity/v3/projects/7b8a604af2ec48059ef55244ec6a5363 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:25:37.072534 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04008dd-251c-4077-b89c-3858e75ebcbe None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:37.072888 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04008dd-251c-4077-b89c-3858e75ebcbe None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:37.076168 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04008dd-251c-4077-b89c-3858e75ebcbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:37.096030 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-d04008dd-251c-4077-b89c-3858e75ebcbe None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:25:37.104902 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-d04008dd-251c-4077-b89c-3858e75ebcbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:37.207529 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2161/4362] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:25:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:25:37.215109 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e8484-0586-4ab9-bec4-618cc2ad05e4 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:37.219393 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e8484-0586-4ab9-bec4-618cc2ad05e4 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:37.219393 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e8484-0586-4ab9-bec4-618cc2ad05e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:37.236216 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04008dd-251c-4077-b89c-3858e75ebcbe None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:37.244588 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-d04008dd-251c-4077-b89c-3858e75ebcbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:37.273021 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-343e8484-0586-4ab9-bec4-618cc2ad05e4 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:25:37.275667 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04008dd-251c-4077-b89c-3858e75ebcbe None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:37.277342 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-343e8484-0586-4ab9-bec4-618cc2ad05e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:37.286040 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f46b43e-8f7e-48e4-9b44-78432156af76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:37.286931 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f46b43e-8f7e-48e4-9b44-78432156af76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:37.287219 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f46b43e-8f7e-48e4-9b44-78432156af76 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:37.287518 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f46b43e-8f7e-48e4-9b44-78432156af76 admin admin] PATH_INFO: `/v3/users/98b7bc6d0abe43a889cc29118685e8f4` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:37.290935 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f46b43e-8f7e-48e4-9b44-78432156af76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98b7bc6d0abe43a889cc29118685e8f4)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:37.293375 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f46b43e-8f7e-48e4-9b44-78432156af76 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:37.300259 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2202/4363] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:25:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:25:37.300259 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e8484-0586-4ab9-bec4-618cc2ad05e4 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:37.300593 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-343e8484-0586-4ab9-bec4-618cc2ad05e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:37.383953 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e8484-0586-4ab9-bec4-618cc2ad05e4 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:37.389425 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ca0bdc-148d-4802-96ef-a3e14a1a36e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:37.390342 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca0bdc-148d-4802-96ef-a3e14a1a36e9 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:37.390893 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca0bdc-148d-4802-96ef-a3e14a1a36e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:37.391648 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca0bdc-148d-4802-96ef-a3e14a1a36e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:37.394409 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-31ca0bdc-148d-4802-96ef-a3e14a1a36e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:37.408673 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ca0bdc-148d-4802-96ef-a3e14a1a36e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:37.410656 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ca0bdc-148d-4802-96ef-a3e14a1a36e9 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:37.421543 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2203/4364] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:25:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:25:37.423038 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ca0bdc-148d-4802-96ef-a3e14a1a36e9 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:37.443685 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ca0bdc-148d-4802-96ef-a3e14a1a36e9 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:37.453287 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b8f52-d21b-455c-8461-f9aaaf9e0778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:37.454677 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b8f52-d21b-455c-8461-f9aaaf9e0778 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:37.454677 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b8f52-d21b-455c-8461-f9aaaf9e0778 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:37.455280 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b8f52-d21b-455c-8461-f9aaaf9e0778 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:37.456874 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5b8f52-d21b-455c-8461-f9aaaf9e0778 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:25:37.457192 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5b8f52-d21b-455c-8461-f9aaaf9e0778 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:37.459036 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5b8f52-d21b-455c-8461-f9aaaf9e0778 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:37.475175 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2204/4365] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:25:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:25:37.479613 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b8f52-d21b-455c-8461-f9aaaf9e0778 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:37.508627 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b8f52-d21b-455c-8461-f9aaaf9e0778 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:37.517898 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75cdd60-be96-421f-ae29-3266097caf88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:37.518864 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75cdd60-be96-421f-ae29-3266097caf88 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:37.519305 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75cdd60-be96-421f-ae29-3266097caf88 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:37.519792 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75cdd60-be96-421f-ae29-3266097caf88 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:37.520784 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75cdd60-be96-421f-ae29-3266097caf88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:37.526762 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75cdd60-be96-421f-ae29-3266097caf88 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:37.563946 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9f46b43e-8f7e-48e4-9b44-78432156af76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98b7bc6d0abe43a889cc29118685e8f4'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:37.576885 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9f46b43e-8f7e-48e4-9b44-78432156af76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98b7bc6d0abe43a889cc29118685e8f4'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:37.581063 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9f46b43e-8f7e-48e4-9b44-78432156af76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98b7bc6d0abe43a889cc29118685e8f4'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:37.753040 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9f46b43e-8f7e-48e4-9b44-78432156af76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98b7bc6d0abe43a889cc29118685e8f4'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:37.774097 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2205/4366] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:25:37 2022] POST /identity/v3/projects => generated 381 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:25:37.774553 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75cdd60-be96-421f-ae29-3266097caf88 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:37.780511 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9f46b43e-8f7e-48e4-9b44-78432156af76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98b7bc6d0abe43a889cc29118685e8f4'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:37.791899 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2162/4367] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:25:37 2022] DELETE /identity/v3/users/98b7bc6d0abe43a889cc29118685e8f4 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:25:37.878347 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f46b43e-8f7e-48e4-9b44-78432156af76 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:37.881273 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-9f46b43e-8f7e-48e4-9b44-78432156af76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:37.907766 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75cdd60-be96-421f-ae29-3266097caf88 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:38.018053 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f46b43e-8f7e-48e4-9b44-78432156af76 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:38.028826 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dd7c07-6f21-496f-8e48-c9627d90dc66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:38.029497 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd7c07-6f21-496f-8e48-c9627d90dc66 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:38.029781 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd7c07-6f21-496f-8e48-c9627d90dc66 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:38.030060 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd7c07-6f21-496f-8e48-c9627d90dc66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:38.034233 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-41dd7c07-6f21-496f-8e48-c9627d90dc66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:38.072165 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbff1b6a-64ea-419a-ac7b-4d2bee56642f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:38.072877 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff1b6a-64ea-419a-ac7b-4d2bee56642f admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:38.073311 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff1b6a-64ea-419a-ac7b-4d2bee56642f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:38.073656 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff1b6a-64ea-419a-ac7b-4d2bee56642f admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:38.074414 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbff1b6a-64ea-419a-ac7b-4d2bee56642f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:38.078305 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbff1b6a-64ea-419a-ac7b-4d2bee56642f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:38.174010 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2206/4368] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:25:37 2022] POST /identity/v3/users => generated 291 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:25:38.179230 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbff1b6a-64ea-419a-ac7b-4d2bee56642f admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:38.193331 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-cbff1b6a-64ea-419a-ac7b-4d2bee56642f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:38.226270 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbff1b6a-64ea-419a-ac7b-4d2bee56642f admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:38.245614 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c3b723-8218-4280-b1a7-3a1b8af53a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:38.246520 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c3b723-8218-4280-b1a7-3a1b8af53a03 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:38.246919 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c3b723-8218-4280-b1a7-3a1b8af53a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:38.248013 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c3b723-8218-4280-b1a7-3a1b8af53a03 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:38.248013 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c3b723-8218-4280-b1a7-3a1b8af53a03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:38.249896 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c3b723-8218-4280-b1a7-3a1b8af53a03 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:38.253221 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dd7c07-6f21-496f-8e48-c9627d90dc66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:38.266791 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dd7c07-6f21-496f-8e48-c9627d90dc66 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:38.271131 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2207/4369] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:25:38.281638 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c3b723-8218-4280-b1a7-3a1b8af53a03 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:38.292542 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2163/4370] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:25:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:25:38.297355 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c3b723-8218-4280-b1a7-3a1b8af53a03 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:38.315868 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be0200c-b92c-4fc0-ac63-13439665d5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:38.316554 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be0200c-b92c-4fc0-ac63-13439665d5bf admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:38.316845 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be0200c-b92c-4fc0-ac63-13439665d5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:38.317125 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be0200c-b92c-4fc0-ac63-13439665d5bf admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:38.317860 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be0200c-b92c-4fc0-ac63-13439665d5bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:38.319532 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be0200c-b92c-4fc0-ac63-13439665d5bf admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:38.341345 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2208/4371] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:25:38.345835 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dd7c07-6f21-496f-8e48-c9627d90dc66 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:38.362213 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dd7c07-6f21-496f-8e48-c9627d90dc66 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:38.369919 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb3bb00-65f4-45e1-b3b9-67bfb895b452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:38.371128 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb3bb00-65f4-45e1-b3b9-67bfb895b452 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:38.371626 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb3bb00-65f4-45e1-b3b9-67bfb895b452 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:38.372100 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb3bb00-65f4-45e1-b3b9-67bfb895b452 admin admin] PATH_INFO: `/v3/projects/1bdcf091cf2140d9ae48f8fe5554a0bb/users/f40558cc65e44e90bd9462b4c848826d/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:38.397809 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb3bb00-65f4-45e1-b3b9-67bfb895b452 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bdcf091cf2140d9ae48f8fe5554a0bb, user_id=f40558cc65e44e90bd9462b4c848826d, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:38.402471 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb3bb00-65f4-45e1-b3b9-67bfb895b452 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:38.503836 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2164/4372] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:25:38 2022] PUT /identity/v3/projects/1bdcf091cf2140d9ae48f8fe5554a0bb/users/f40558cc65e44e90bd9462b4c848826d/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:25:38.508890 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd7cc4b-0ce5-41db-ae37-bb0fcf596e62 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:38.509371 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd7cc4b-0ce5-41db-ae37-bb0fcf596e62 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:38.509781 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd7cc4b-0ce5-41db-ae37-bb0fcf596e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:38.531344 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-ffd7cc4b-0ce5-41db-ae37-bb0fcf596e62 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:25:38.532734 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ffd7cc4b-0ce5-41db-ae37-bb0fcf596e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:38.654590 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2209/4373] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:25:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:25:38.686588 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb3bb00-65f4-45e1-b3b9-67bfb895b452 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:38.691161 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-cfb3bb00-65f4-45e1-b3b9-67bfb895b452 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:38.798843 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb3bb00-65f4-45e1-b3b9-67bfb895b452 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:38.803044 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da076b7-ee03-44bc-b0c8-4b56f31e3725 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:38.803745 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da076b7-ee03-44bc-b0c8-4b56f31e3725 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:38.804031 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da076b7-ee03-44bc-b0c8-4b56f31e3725 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:38.804312 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da076b7-ee03-44bc-b0c8-4b56f31e3725 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:38.827600 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da076b7-ee03-44bc-b0c8-4b56f31e3725 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:38.832364 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da076b7-ee03-44bc-b0c8-4b56f31e3725 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:38.860458 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2165/4374] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:25:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:25:39.217791 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd7cc4b-0ce5-41db-ae37-bb0fcf596e62 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:39.223520 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ffd7cc4b-0ce5-41db-ae37-bb0fcf596e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:39.252825 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd7cc4b-0ce5-41db-ae37-bb0fcf596e62 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:39.263453 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1d0b82-fb64-484f-ba4d-eabf86159334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:39.264627 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d0b82-fb64-484f-ba4d-eabf86159334 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:39.265062 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d0b82-fb64-484f-ba4d-eabf86159334 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:39.265645 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d0b82-fb64-484f-ba4d-eabf86159334 admin admin] PATH_INFO: `/v3/projects/f2a1c19cad6047f09d1b74a2a607dd28` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:39.267056 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1d0b82-fb64-484f-ba4d-eabf86159334 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2a1c19cad6047f09d1b74a2a607dd28)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:39.269782 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1d0b82-fb64-484f-ba4d-eabf86159334 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:39.415432 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-df1d0b82-fb64-484f-ba4d-eabf86159334 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2a1c19cad6047f09d1b74a2a607dd28', 'request_id': 'req-df1d0b82-fb64-484f-ba4d-eabf86159334'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:39.423016 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-df1d0b82-fb64-484f-ba4d-eabf86159334 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2a1c19cad6047f09d1b74a2a607dd28', 'request_id': 'req-df1d0b82-fb64-484f-ba4d-eabf86159334'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:39.518866 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-df1d0b82-fb64-484f-ba4d-eabf86159334 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2a1c19cad6047f09d1b74a2a607dd28', 'request_id': 'req-df1d0b82-fb64-484f-ba4d-eabf86159334'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:39.533097 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-df1d0b82-fb64-484f-ba4d-eabf86159334 admin admin] The token cache is being invalidate because project f2a1c19cad6047f09d1b74a2a607dd28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:25:39.533416 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-df1d0b82-fb64-484f-ba4d-eabf86159334 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:39.534233 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-df1d0b82-fb64-484f-ba4d-eabf86159334 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:39.539588 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2210/4375] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:25:39 2022] DELETE /identity/v3/projects/f2a1c19cad6047f09d1b74a2a607dd28 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:25:39.541773 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd239ba-1179-451e-923f-6de09296ee22 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:39.542063 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd239ba-1179-451e-923f-6de09296ee22 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:39.542337 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd239ba-1179-451e-923f-6de09296ee22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:39.560605 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-fcd239ba-1179-451e-923f-6de09296ee22 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:25:39.562042 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-fcd239ba-1179-451e-923f-6de09296ee22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:39.660762 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2166/4376] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:25:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:25:39.668221 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815bbca9-699f-4a30-a3c3-94ac64cfea64 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:39.668836 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815bbca9-699f-4a30-a3c3-94ac64cfea64 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:39.669160 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815bbca9-699f-4a30-a3c3-94ac64cfea64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:39.709558 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-815bbca9-699f-4a30-a3c3-94ac64cfea64 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:25:39.718011 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-815bbca9-699f-4a30-a3c3-94ac64cfea64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:39.728194 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2211/4377] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:25:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:25:39.729732 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd239ba-1179-451e-923f-6de09296ee22 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:39.744634 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd239ba-1179-451e-923f-6de09296ee22 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:39.751529 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d0a43c-e3f2-4a85-87d8-ae6f619ebb55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:39.751529 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d0a43c-e3f2-4a85-87d8-ae6f619ebb55 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:39.751790 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d0a43c-e3f2-4a85-87d8-ae6f619ebb55 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:39.751996 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d0a43c-e3f2-4a85-87d8-ae6f619ebb55 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:39.752649 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d0a43c-e3f2-4a85-87d8-ae6f619ebb55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:25:39.753094 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d0a43c-e3f2-4a85-87d8-ae6f619ebb55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:39.754769 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d0a43c-e3f2-4a85-87d8-ae6f619ebb55 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:39.787441 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2167/4378] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:25:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:25:39.788714 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815bbca9-699f-4a30-a3c3-94ac64cfea64 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:39.801020 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815bbca9-699f-4a30-a3c3-94ac64cfea64 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:39.808953 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011549a2-d3b9-4b4e-a8ad-dd283de3e37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:39.816496 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011549a2-d3b9-4b4e-a8ad-dd283de3e37b admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:39.816496 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011549a2-d3b9-4b4e-a8ad-dd283de3e37b admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:39.816496 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011549a2-d3b9-4b4e-a8ad-dd283de3e37b admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:39.816496 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011549a2-d3b9-4b4e-a8ad-dd283de3e37b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:39.816496 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011549a2-d3b9-4b4e-a8ad-dd283de3e37b admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:39.955565 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2212/4379] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:25:39 2022] POST /identity/v3/projects => generated 399 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:25:39.958442 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d0a43c-e3f2-4a85-87d8-ae6f619ebb55 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:39.990121 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d0a43c-e3f2-4a85-87d8-ae6f619ebb55 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:40.100995 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a2bd8d-dd79-49e8-9a3e-8b2e35c64acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:40.103220 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a2bd8d-dd79-49e8-9a3e-8b2e35c64acc admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:40.103220 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a2bd8d-dd79-49e8-9a3e-8b2e35c64acc admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:40.103220 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a2bd8d-dd79-49e8-9a3e-8b2e35c64acc admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:40.104177 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a2bd8d-dd79-49e8-9a3e-8b2e35c64acc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:40.110652 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a2bd8d-dd79-49e8-9a3e-8b2e35c64acc admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:40.267246 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2168/4380] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:25:39 2022] POST /identity/v3/users => generated 300 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:25:40.268778 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011549a2-d3b9-4b4e-a8ad-dd283de3e37b admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:40.282707 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011549a2-d3b9-4b4e-a8ad-dd283de3e37b admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:40.294030 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18032661-5d4e-4071-b159-ba7e4064fc5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:40.294030 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18032661-5d4e-4071-b159-ba7e4064fc5e admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:40.294030 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18032661-5d4e-4071-b159-ba7e4064fc5e admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:40.294030 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18032661-5d4e-4071-b159-ba7e4064fc5e admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:40.294512 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18032661-5d4e-4071-b159-ba7e4064fc5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:40.295899 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18032661-5d4e-4071-b159-ba7e4064fc5e admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:40.309345 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2213/4381] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:25:40.319221 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a2bd8d-dd79-49e8-9a3e-8b2e35c64acc admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:40.329373 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a2bd8d-dd79-49e8-9a3e-8b2e35c64acc admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:40.336607 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9e6575-5cac-4f1f-afba-147a57d1c3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:40.337315 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e6575-5cac-4f1f-afba-147a57d1c3ad admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:40.337598 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e6575-5cac-4f1f-afba-147a57d1c3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:40.337875 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e6575-5cac-4f1f-afba-147a57d1c3ad admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:40.338613 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9e6575-5cac-4f1f-afba-147a57d1c3ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:40.340546 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9e6575-5cac-4f1f-afba-147a57d1c3ad admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:40.356798 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2169/4382] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:25:40.360624 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18032661-5d4e-4071-b159-ba7e4064fc5e admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:40.374574 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18032661-5d4e-4071-b159-ba7e4064fc5e admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:40.381625 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a69b7dd-c062-43e2-ae22-dec95516c0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:40.383746 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a69b7dd-c062-43e2-ae22-dec95516c0fe admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:40.384290 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a69b7dd-c062-43e2-ae22-dec95516c0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:40.384784 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a69b7dd-c062-43e2-ae22-dec95516c0fe admin admin] PATH_INFO: `/v3/projects/689bc5cf419440f683a6ab4fd29dc06e/users/1b4361b4b12041edbd523eef23f82dae/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:40.406114 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a69b7dd-c062-43e2-ae22-dec95516c0fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=689bc5cf419440f683a6ab4fd29dc06e, user_id=1b4361b4b12041edbd523eef23f82dae, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:40.417492 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a69b7dd-c062-43e2-ae22-dec95516c0fe admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:40.499581 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2214/4383] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:25:40 2022] PUT /identity/v3/projects/689bc5cf419440f683a6ab4fd29dc06e/users/1b4361b4b12041edbd523eef23f82dae/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:25:40.502757 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81802e2-feb2-4afc-9773-b2f92b536d49 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:40.503270 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81802e2-feb2-4afc-9773-b2f92b536d49 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:40.503581 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81802e2-feb2-4afc-9773-b2f92b536d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:40.527909 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-b81802e2-feb2-4afc-9773-b2f92b536d49 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:25:40.529379 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b81802e2-feb2-4afc-9773-b2f92b536d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:40.620929 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2170/4384] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:25:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:25:40.648757 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a69b7dd-c062-43e2-ae22-dec95516c0fe admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:40.650621 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-6a69b7dd-c062-43e2-ae22-dec95516c0fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:40.733028 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a69b7dd-c062-43e2-ae22-dec95516c0fe admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:40.738148 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee7c8fc-d2b8-44db-a310-4888f4e5add1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:40.738983 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee7c8fc-d2b8-44db-a310-4888f4e5add1 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:40.739338 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee7c8fc-d2b8-44db-a310-4888f4e5add1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:40.739717 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee7c8fc-d2b8-44db-a310-4888f4e5add1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:40.752698 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee7c8fc-d2b8-44db-a310-4888f4e5add1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:40.754307 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee7c8fc-d2b8-44db-a310-4888f4e5add1 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:40.768844 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2215/4385] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:25:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:25:41.374171 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1433800-6eaf-4e0a-8aea-83c71cd59597 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:41.375042 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1433800-6eaf-4e0a-8aea-83c71cd59597 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:41.375508 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1433800-6eaf-4e0a-8aea-83c71cd59597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:41.410004 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-b1433800-6eaf-4e0a-8aea-83c71cd59597 None None] MFA Rules not processed for user `f40558cc65e44e90bd9462b4c848826d`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:25:41.411664 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b1433800-6eaf-4e0a-8aea-83c71cd59597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:41.510900 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2171/4386] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:25:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:25:41.594278 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee7c8fc-d2b8-44db-a310-4888f4e5add1 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:41.595790 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-7ee7c8fc-d2b8-44db-a310-4888f4e5add1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:41.709145 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee7c8fc-d2b8-44db-a310-4888f4e5add1 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:41.717324 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68245a39-dbfb-40f8-8142-0dc2b0d8732c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:41.741636 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68245a39-dbfb-40f8-8142-0dc2b0d8732c service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:41.741636 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68245a39-dbfb-40f8-8142-0dc2b0d8732c service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:41.741636 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68245a39-dbfb-40f8-8142-0dc2b0d8732c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:41.741636 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68245a39-dbfb-40f8-8142-0dc2b0d8732c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:41.741636 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68245a39-dbfb-40f8-8142-0dc2b0d8732c service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:41.744065 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2216/4387] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:25:41 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:25:43.085282 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca027f-3f0b-4e0c-a65a-4ec5a1b16d31 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:43.085913 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca027f-3f0b-4e0c-a65a-4ec5a1b16d31 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:43.085913 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca027f-3f0b-4e0c-a65a-4ec5a1b16d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:43.124163 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-20ca027f-3f0b-4e0c-a65a-4ec5a1b16d31 None None] MFA Rules not processed for user `1b4361b4b12041edbd523eef23f82dae`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:25:43.126174 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-20ca027f-3f0b-4e0c-a65a-4ec5a1b16d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:43.218569 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2172/4388] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:25:43 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:25:43.232068 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68245a39-dbfb-40f8-8142-0dc2b0d8732c service nova] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:43.234628 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c8d60-aa68-4ea7-a929-bf0d7f9d9e4c None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:43.234628 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c8d60-aa68-4ea7-a929-bf0d7f9d9e4c None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:43.234980 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c8d60-aa68-4ea7-a929-bf0d7f9d9e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:43.237075 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-68245a39-dbfb-40f8-8142-0dc2b0d8732c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:43.264989 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68245a39-dbfb-40f8-8142-0dc2b0d8732c service nova] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:43.269963 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-be4c8d60-aa68-4ea7-a929-bf0d7f9d9e4c None None] MFA Rules not processed for user `1b4361b4b12041edbd523eef23f82dae`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:25:43.270709 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031ff2c9-f2d7-40dc-a6ee-e382ae492791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:43.271812 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ff2c9-f2d7-40dc-a6ee-e382ae492791 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:43.272480 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ff2c9-f2d7-40dc-a6ee-e382ae492791 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:43.272921 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ff2c9-f2d7-40dc-a6ee-e382ae492791 admin admin] PATH_INFO: `/v3/users/f40558cc65e44e90bd9462b4c848826d` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:43.274587 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-be4c8d60-aa68-4ea7-a929-bf0d7f9d9e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:43.275068 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031ff2c9-f2d7-40dc-a6ee-e382ae492791 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f40558cc65e44e90bd9462b4c848826d)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:43.277793 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031ff2c9-f2d7-40dc-a6ee-e382ae492791 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:43.297309 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2173/4389] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:25:43 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:25:43.299026 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e833f-6344-4df9-8df9-6fb6f6a7b9ea None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:43.301766 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e833f-6344-4df9-8df9-6fb6f6a7b9ea None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:43.302300 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e833f-6344-4df9-8df9-6fb6f6a7b9ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:43.368733 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-db6e833f-6344-4df9-8df9-6fb6f6a7b9ea None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:25:43.371958 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-db6e833f-6344-4df9-8df9-6fb6f6a7b9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:43.465064 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2174/4390] 10.222.0.52 () {58 vars in 1009 bytes} [Sat May 14 21:25:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:25:43.466293 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6e833f-6344-4df9-8df9-6fb6f6a7b9ea None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:43.475174 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-db6e833f-6344-4df9-8df9-6fb6f6a7b9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:43.493919 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6e833f-6344-4df9-8df9-6fb6f6a7b9ea None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:43.500415 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c383f3a-efe9-45d3-bba4-7816aeec89e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:43.501316 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c383f3a-efe9-45d3-bba4-7816aeec89e2 service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:43.501316 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c383f3a-efe9-45d3-bba4-7816aeec89e2 service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:43.501655 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c383f3a-efe9-45d3-bba4-7816aeec89e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:43.513906 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c383f3a-efe9-45d3-bba4-7816aeec89e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:43.517729 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c383f3a-efe9-45d3-bba4-7816aeec89e2 service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:43.535821 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2175/4391] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:25:43 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:25:43.536786 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c383f3a-efe9-45d3-bba4-7816aeec89e2 service nova] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:43.543640 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-2c383f3a-efe9-45d3-bba4-7816aeec89e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:43.587339 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-031ff2c9-f2d7-40dc-a6ee-e382ae492791 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f40558cc65e44e90bd9462b4c848826d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:43.628389 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-031ff2c9-f2d7-40dc-a6ee-e382ae492791 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f40558cc65e44e90bd9462b4c848826d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:43.648895 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-031ff2c9-f2d7-40dc-a6ee-e382ae492791 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f40558cc65e44e90bd9462b4c848826d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:43.697332 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c383f3a-efe9-45d3-bba4-7816aeec89e2 service nova] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:43.704184 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92869276-4a21-401a-b016-fdce0718286e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:43.705065 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92869276-4a21-401a-b016-fdce0718286e service swift] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:43.705452 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92869276-4a21-401a-b016-fdce0718286e service swift] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:43.705820 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92869276-4a21-401a-b016-fdce0718286e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:43.716458 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92869276-4a21-401a-b016-fdce0718286e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:43.718189 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92869276-4a21-401a-b016-fdce0718286e service swift] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:43.724685 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-031ff2c9-f2d7-40dc-a6ee-e382ae492791 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f40558cc65e44e90bd9462b4c848826d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:43.725487 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-031ff2c9-f2d7-40dc-a6ee-e382ae492791 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f40558cc65e44e90bd9462b4c848826d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:43.729819 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2176/4392] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 21:25:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 21:25:43.736706 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2217/4393] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:25:43 2022] DELETE /identity/v3/users/f40558cc65e44e90bd9462b4c848826d => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:25:44.178116 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92869276-4a21-401a-b016-fdce0718286e service swift] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:44.192311 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92869276-4a21-401a-b016-fdce0718286e service swift] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:44.355553 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5f44d9-df97-42dc-9076-422befee925d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:44.359851 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f44d9-df97-42dc-9076-422befee925d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:44.360152 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f44d9-df97-42dc-9076-422befee925d admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:44.360437 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f44d9-df97-42dc-9076-422befee925d admin admin] PATH_INFO: `/v3/projects/1bdcf091cf2140d9ae48f8fe5554a0bb` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:44.362444 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5f44d9-df97-42dc-9076-422befee925d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bdcf091cf2140d9ae48f8fe5554a0bb)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:44.366039 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5f44d9-df97-42dc-9076-422befee925d admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:44.534040 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-cd5f44d9-df97-42dc-9076-422befee925d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bdcf091cf2140d9ae48f8fe5554a0bb', 'request_id': 'req-cd5f44d9-df97-42dc-9076-422befee925d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:44.544017 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-cd5f44d9-df97-42dc-9076-422befee925d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bdcf091cf2140d9ae48f8fe5554a0bb', 'request_id': 'req-cd5f44d9-df97-42dc-9076-422befee925d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:44.569406 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-cd5f44d9-df97-42dc-9076-422befee925d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bdcf091cf2140d9ae48f8fe5554a0bb', 'request_id': 'req-cd5f44d9-df97-42dc-9076-422befee925d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:44.694567 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-cd5f44d9-df97-42dc-9076-422befee925d admin admin] The token cache is being invalidate because project 1bdcf091cf2140d9ae48f8fe5554a0bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:25:44.696217 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-cd5f44d9-df97-42dc-9076-422befee925d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:44.697825 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-cd5f44d9-df97-42dc-9076-422befee925d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:44.701061 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2177/4394] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:25:44 2022] DELETE /identity/v3/projects/1bdcf091cf2140d9ae48f8fe5554a0bb => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:25:44.709179 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90344e-6e50-4c2e-9144-965f3a07168a None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:44.709662 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90344e-6e50-4c2e-9144-965f3a07168a None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:44.709772 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90344e-6e50-4c2e-9144-965f3a07168a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:44.734703 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-7a90344e-6e50-4c2e-9144-965f3a07168a None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:25:44.746937 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-7a90344e-6e50-4c2e-9144-965f3a07168a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:44.833422 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2218/4395] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:25:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:25:44.841503 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d724a3c-898d-48d1-8a97-68b7545d60a4 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:44.844993 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d724a3c-898d-48d1-8a97-68b7545d60a4 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:44.844993 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d724a3c-898d-48d1-8a97-68b7545d60a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:44.881904 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-6d724a3c-898d-48d1-8a97-68b7545d60a4 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:25:44.884139 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-6d724a3c-898d-48d1-8a97-68b7545d60a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:44.905164 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2178/4396] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:25:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:25:44.908174 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a90344e-6e50-4c2e-9144-965f3a07168a None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:44.923124 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a90344e-6e50-4c2e-9144-965f3a07168a None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:44.940883 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a53c56-1da7-4944-97c3-475ad4a5ab35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:44.941663 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a53c56-1da7-4944-97c3-475ad4a5ab35 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:44.942049 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a53c56-1da7-4944-97c3-475ad4a5ab35 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:44.942372 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a53c56-1da7-4944-97c3-475ad4a5ab35 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:44.943180 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a53c56-1da7-4944-97c3-475ad4a5ab35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:25:44.943607 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a53c56-1da7-4944-97c3-475ad4a5ab35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:44.946188 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a53c56-1da7-4944-97c3-475ad4a5ab35 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:44.985210 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d724a3c-898d-48d1-8a97-68b7545d60a4 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:44.995211 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2219/4397] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:25:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:25:44.997192 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d724a3c-898d-48d1-8a97-68b7545d60a4 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:45.002446 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16ab25b-fafe-4287-b59d-c81f95348c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:45.003195 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ab25b-fafe-4287-b59d-c81f95348c95 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:45.003590 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ab25b-fafe-4287-b59d-c81f95348c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:45.003939 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ab25b-fafe-4287-b59d-c81f95348c95 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:45.004711 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16ab25b-fafe-4287-b59d-c81f95348c95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:45.016855 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16ab25b-fafe-4287-b59d-c81f95348c95 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:45.187199 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2179/4398] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:25:44 2022] POST /identity/v3/projects => generated 385 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:25:45.191588 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a53c56-1da7-4944-97c3-475ad4a5ab35 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:45.204654 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a53c56-1da7-4944-97c3-475ad4a5ab35 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:45.366599 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3f49f5-e48c-4627-8b92-1a73daf8a7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:45.370173 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f49f5-e48c-4627-8b92-1a73daf8a7eb admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:45.370568 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f49f5-e48c-4627-8b92-1a73daf8a7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:45.370933 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f49f5-e48c-4627-8b92-1a73daf8a7eb admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:45.374986 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3f49f5-e48c-4627-8b92-1a73daf8a7eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:45.377168 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3f49f5-e48c-4627-8b92-1a73daf8a7eb admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:45.473615 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2220/4399] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:25:45 2022] POST /identity/v3/users => generated 293 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:25:45.478470 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16ab25b-fafe-4287-b59d-c81f95348c95 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:45.507589 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16ab25b-fafe-4287-b59d-c81f95348c95 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:45.518737 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c850a0cc-b087-4922-ad3d-db9273fb9440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:45.520198 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c850a0cc-b087-4922-ad3d-db9273fb9440 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:45.520688 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c850a0cc-b087-4922-ad3d-db9273fb9440 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:45.521298 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c850a0cc-b087-4922-ad3d-db9273fb9440 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:45.524440 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c850a0cc-b087-4922-ad3d-db9273fb9440 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:45.526554 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c850a0cc-b087-4922-ad3d-db9273fb9440 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:45.542952 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2180/4400] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:25:45 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:25:45.547303 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3f49f5-e48c-4627-8b92-1a73daf8a7eb admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:45.558770 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3f49f5-e48c-4627-8b92-1a73daf8a7eb admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:45.566751 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da2997-31f0-472f-8d2f-4496ed1e3742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:45.567059 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da2997-31f0-472f-8d2f-4496ed1e3742 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:45.567632 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da2997-31f0-472f-8d2f-4496ed1e3742 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:45.568120 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da2997-31f0-472f-8d2f-4496ed1e3742 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:45.569145 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71da2997-31f0-472f-8d2f-4496ed1e3742 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:45.571442 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71da2997-31f0-472f-8d2f-4496ed1e3742 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:45.592029 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2221/4401] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:25:45 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:25:45.596546 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c850a0cc-b087-4922-ad3d-db9273fb9440 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:45.619753 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c850a0cc-b087-4922-ad3d-db9273fb9440 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:45.635963 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63077c5c-c453-4759-ab2a-01d97e17dab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:45.636923 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63077c5c-c453-4759-ab2a-01d97e17dab1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:45.637212 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63077c5c-c453-4759-ab2a-01d97e17dab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:45.637493 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63077c5c-c453-4759-ab2a-01d97e17dab1 admin admin] PATH_INFO: `/v3/projects/8bd6f25048cd4798985e725f734f1845/users/1e3390c9579a4f598c46f9417b4dd046/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:45.680618 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63077c5c-c453-4759-ab2a-01d97e17dab1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bd6f25048cd4798985e725f734f1845, user_id=1e3390c9579a4f598c46f9417b4dd046, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:45.683369 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63077c5c-c453-4759-ab2a-01d97e17dab1 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:45.777886 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2181/4402] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:25:45 2022] PUT /identity/v3/projects/8bd6f25048cd4798985e725f734f1845/users/1e3390c9579a4f598c46f9417b4dd046/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:25:45.783507 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b63fb8-c729-4a93-8ef2-55c95ead72fc None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:45.783989 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b63fb8-c729-4a93-8ef2-55c95ead72fc None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:45.784370 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b63fb8-c729-4a93-8ef2-55c95ead72fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:45.816268 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-c5b63fb8-c729-4a93-8ef2-55c95ead72fc None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:25:45.826362 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c5b63fb8-c729-4a93-8ef2-55c95ead72fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:45.943393 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2222/4403] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:25:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:25:45.960333 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63077c5c-c453-4759-ab2a-01d97e17dab1 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:45.966840 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-63077c5c-c453-4759-ab2a-01d97e17dab1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:46.061816 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63077c5c-c453-4759-ab2a-01d97e17dab1 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:46.066024 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b43b7d8-4c83-44d9-8451-33edd9cc4b46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:46.067014 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b43b7d8-4c83-44d9-8451-33edd9cc4b46 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:46.067014 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b43b7d8-4c83-44d9-8451-33edd9cc4b46 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:46.067263 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b43b7d8-4c83-44d9-8451-33edd9cc4b46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:46.078407 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b43b7d8-4c83-44d9-8451-33edd9cc4b46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:46.079915 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b43b7d8-4c83-44d9-8451-33edd9cc4b46 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:46.110505 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2182/4404] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:25:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:25:57.525082 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b63fb8-c729-4a93-8ef2-55c95ead72fc None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:57.526833 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c5b63fb8-c729-4a93-8ef2-55c95ead72fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:57.562062 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b63fb8-c729-4a93-8ef2-55c95ead72fc None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:57.566863 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dedf2c4-1767-4203-a022-7cb2b4100807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:57.568016 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dedf2c4-1767-4203-a022-7cb2b4100807 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:57.571554 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dedf2c4-1767-4203-a022-7cb2b4100807 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:57.571554 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dedf2c4-1767-4203-a022-7cb2b4100807 admin admin] PATH_INFO: `/v3/users/10ef9774b8b547f4a6ccf630d9ccc7ed` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:57.571554 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dedf2c4-1767-4203-a022-7cb2b4100807 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10ef9774b8b547f4a6ccf630d9ccc7ed)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:57.572924 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dedf2c4-1767-4203-a022-7cb2b4100807 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:57.842455 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5dedf2c4-1767-4203-a022-7cb2b4100807 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10ef9774b8b547f4a6ccf630d9ccc7ed'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:57.843981 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b43b7d8-4c83-44d9-8451-33edd9cc4b46 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:57.846039 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-5b43b7d8-4c83-44d9-8451-33edd9cc4b46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:57.867560 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b43b7d8-4c83-44d9-8451-33edd9cc4b46 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:57.878862 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecbc2cf-8a26-4ad0-a2ff-67e287b05125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:57.879914 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5dedf2c4-1767-4203-a022-7cb2b4100807 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10ef9774b8b547f4a6ccf630d9ccc7ed'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:57.881031 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecbc2cf-8a26-4ad0-a2ff-67e287b05125 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:57.882983 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecbc2cf-8a26-4ad0-a2ff-67e287b05125 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:57.884728 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecbc2cf-8a26-4ad0-a2ff-67e287b05125 admin admin] PATH_INFO: `/v3/users/fbbd79f0a4984166a48522eb5103f0c1` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:57.889795 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5dedf2c4-1767-4203-a022-7cb2b4100807 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10ef9774b8b547f4a6ccf630d9ccc7ed'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:57.895723 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecbc2cf-8a26-4ad0-a2ff-67e287b05125 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbbd79f0a4984166a48522eb5103f0c1)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:57.895974 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecbc2cf-8a26-4ad0-a2ff-67e287b05125 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:58.001784 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5dedf2c4-1767-4203-a022-7cb2b4100807 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10ef9774b8b547f4a6ccf630d9ccc7ed'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:58.001784 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5dedf2c4-1767-4203-a022-7cb2b4100807 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10ef9774b8b547f4a6ccf630d9ccc7ed'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:58.013204 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2223/4405] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:25:57 2022] DELETE /identity/v3/users/10ef9774b8b547f4a6ccf630d9ccc7ed => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:25:58.017644 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff19a0f-101c-4c24-b811-b989da792007 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:58.018180 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff19a0f-101c-4c24-b811-b989da792007 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:58.018642 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff19a0f-101c-4c24-b811-b989da792007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:58.047182 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-bff19a0f-101c-4c24-b811-b989da792007 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:25:58.048757 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-bff19a0f-101c-4c24-b811-b989da792007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:58.144366 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2224/4406] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:25:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:25:58.144366 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff19a0f-101c-4c24-b811-b989da792007 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:58.144571 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-bff19a0f-101c-4c24-b811-b989da792007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:58.214471 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff19a0f-101c-4c24-b811-b989da792007 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:58.221774 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d374c1e-6f1e-44d4-b1e7-01c90cb4d9e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:58.222369 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-6ecbc2cf-8a26-4ad0-a2ff-67e287b05125 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbbd79f0a4984166a48522eb5103f0c1'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:58.225059 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d374c1e-6f1e-44d4-b1e7-01c90cb4d9e5 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:58.225059 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d374c1e-6f1e-44d4-b1e7-01c90cb4d9e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:58.225059 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d374c1e-6f1e-44d4-b1e7-01c90cb4d9e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:58.237083 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-6ecbc2cf-8a26-4ad0-a2ff-67e287b05125 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbbd79f0a4984166a48522eb5103f0c1'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:58.237806 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-6ecbc2cf-8a26-4ad0-a2ff-67e287b05125 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbbd79f0a4984166a48522eb5103f0c1'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:58.238824 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d374c1e-6f1e-44d4-b1e7-01c90cb4d9e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:58.240744 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d374c1e-6f1e-44d4-b1e7-01c90cb4d9e5 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:58.258878 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2225/4407] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:25:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:25:58.302631 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117afa1a-a0f4-4cf1-893a-be31d54e2892 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:58.303063 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117afa1a-a0f4-4cf1-893a-be31d54e2892 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:58.303430 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117afa1a-a0f4-4cf1-893a-be31d54e2892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:58.335400 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-6ecbc2cf-8a26-4ad0-a2ff-67e287b05125 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbbd79f0a4984166a48522eb5103f0c1'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:58.342401 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-117afa1a-a0f4-4cf1-893a-be31d54e2892 None None] MFA Rules not processed for user `1e3390c9579a4f598c46f9417b4dd046`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:25:58.343959 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-117afa1a-a0f4-4cf1-893a-be31d54e2892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:58.365865 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-6ecbc2cf-8a26-4ad0-a2ff-67e287b05125 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbbd79f0a4984166a48522eb5103f0c1'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:58.367973 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2183/4408] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:25:57 2022] DELETE /identity/v3/users/fbbd79f0a4984166a48522eb5103f0c1 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:25:58.484088 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2226/4409] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:25:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:25:58.487812 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecbc2cf-8a26-4ad0-a2ff-67e287b05125 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:58.489506 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-6ecbc2cf-8a26-4ad0-a2ff-67e287b05125 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:58.613419 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecbc2cf-8a26-4ad0-a2ff-67e287b05125 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:58.623067 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe12ed76-59aa-4f0f-8a05-0907469dd94c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:58.623688 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe12ed76-59aa-4f0f-8a05-0907469dd94c service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:58.624127 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe12ed76-59aa-4f0f-8a05-0907469dd94c service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:58.624409 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe12ed76-59aa-4f0f-8a05-0907469dd94c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:58.657316 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117afa1a-a0f4-4cf1-893a-be31d54e2892 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:58.659391 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-117afa1a-a0f4-4cf1-893a-be31d54e2892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:58.680341 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117afa1a-a0f4-4cf1-893a-be31d54e2892 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:58.702228 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe12ed76-59aa-4f0f-8a05-0907469dd94c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:58.703805 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe12ed76-59aa-4f0f-8a05-0907469dd94c service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:58.714213 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2184/4410] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:25:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:25:58.759298 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9725e691-e007-4e2a-8b34-05cf398bcebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:58.760208 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725e691-e007-4e2a-8b34-05cf398bcebe admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:58.760502 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725e691-e007-4e2a-8b34-05cf398bcebe admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:58.760780 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725e691-e007-4e2a-8b34-05cf398bcebe admin admin] PATH_INFO: `/v3/projects/07944a81a7734cdd9c0381a99e29c0a6` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:58.763459 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9725e691-e007-4e2a-8b34-05cf398bcebe admin admin] RBAC: Authorizing `identity:delete_project(project_id=07944a81a7734cdd9c0381a99e29c0a6)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:58.767629 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9725e691-e007-4e2a-8b34-05cf398bcebe admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:58.807735 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe12ed76-59aa-4f0f-8a05-0907469dd94c service nova] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:58.807981 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-fe12ed76-59aa-4f0f-8a05-0907469dd94c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:58.833342 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe12ed76-59aa-4f0f-8a05-0907469dd94c service nova] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:58.840235 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3001f30e-54eb-4317-a69d-b175e17115a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:58.840891 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001f30e-54eb-4317-a69d-b175e17115a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:58.841181 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001f30e-54eb-4317-a69d-b175e17115a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:58.841455 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001f30e-54eb-4317-a69d-b175e17115a4 admin admin] PATH_INFO: `/v3/projects/f81d13056f0041a4b01112cd3d502b78` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:58.842733 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3001f30e-54eb-4317-a69d-b175e17115a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f81d13056f0041a4b01112cd3d502b78)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:58.845053 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3001f30e-54eb-4317-a69d-b175e17115a4 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:58.947320 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9725e691-e007-4e2a-8b34-05cf398bcebe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07944a81a7734cdd9c0381a99e29c0a6', 'request_id': 'req-9725e691-e007-4e2a-8b34-05cf398bcebe'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:58.959140 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9725e691-e007-4e2a-8b34-05cf398bcebe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07944a81a7734cdd9c0381a99e29c0a6', 'request_id': 'req-9725e691-e007-4e2a-8b34-05cf398bcebe'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:58.969406 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3001f30e-54eb-4317-a69d-b175e17115a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f81d13056f0041a4b01112cd3d502b78', 'request_id': 'req-3001f30e-54eb-4317-a69d-b175e17115a4'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:58.976202 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3001f30e-54eb-4317-a69d-b175e17115a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f81d13056f0041a4b01112cd3d502b78', 'request_id': 'req-3001f30e-54eb-4317-a69d-b175e17115a4'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:58.983756 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3001f30e-54eb-4317-a69d-b175e17115a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f81d13056f0041a4b01112cd3d502b78', 'request_id': 'req-3001f30e-54eb-4317-a69d-b175e17115a4'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:59.021270 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9725e691-e007-4e2a-8b34-05cf398bcebe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07944a81a7734cdd9c0381a99e29c0a6', 'request_id': 'req-9725e691-e007-4e2a-8b34-05cf398bcebe'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:59.052454 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9725e691-e007-4e2a-8b34-05cf398bcebe admin admin] The token cache is being invalidate because project 07944a81a7734cdd9c0381a99e29c0a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:25:59.052785 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9725e691-e007-4e2a-8b34-05cf398bcebe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:59.059243 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9725e691-e007-4e2a-8b34-05cf398bcebe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:59.061247 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2227/4411] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:25:58 2022] DELETE /identity/v3/projects/07944a81a7734cdd9c0381a99e29c0a6 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:25:59.068413 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f48607e-eff5-4aa8-acfe-b4d1f73eaa3e None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:59.068731 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f48607e-eff5-4aa8-acfe-b4d1f73eaa3e None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:59.070199 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f48607e-eff5-4aa8-acfe-b4d1f73eaa3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:59.094938 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-5f48607e-eff5-4aa8-acfe-b4d1f73eaa3e None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:25:59.096234 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-5f48607e-eff5-4aa8-acfe-b4d1f73eaa3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:59.114308 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3001f30e-54eb-4317-a69d-b175e17115a4 admin admin] The token cache is being invalidate because project f81d13056f0041a4b01112cd3d502b78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:25:59.117922 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3001f30e-54eb-4317-a69d-b175e17115a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:59.117922 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3001f30e-54eb-4317-a69d-b175e17115a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:25:59.119003 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2185/4412] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:25:58 2022] DELETE /identity/v3/projects/f81d13056f0041a4b01112cd3d502b78 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:25:59.124454 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb78ce1b-6dad-4042-8700-e08025a93434 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:59.127085 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb78ce1b-6dad-4042-8700-e08025a93434 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:59.130114 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb78ce1b-6dad-4042-8700-e08025a93434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:59.168921 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-eb78ce1b-6dad-4042-8700-e08025a93434 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:25:59.171956 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-eb78ce1b-6dad-4042-8700-e08025a93434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:59.192319 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2228/4413] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:25:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:25:59.202405 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36d4b1-0a23-42a3-8654-4e386808140f None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:59.202703 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36d4b1-0a23-42a3-8654-4e386808140f None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:59.202992 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36d4b1-0a23-42a3-8654-4e386808140f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:59.225324 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-8c36d4b1-0a23-42a3-8654-4e386808140f None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:25:59.227573 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-8c36d4b1-0a23-42a3-8654-4e386808140f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:59.242609 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2229/4414] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:25:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:25:59.249446 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c36d4b1-0a23-42a3-8654-4e386808140f None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:59.259492 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c36d4b1-0a23-42a3-8654-4e386808140f None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:59.276995 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeed7e6-6452-4dc1-baba-a9ec808621fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:59.276995 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeed7e6-6452-4dc1-baba-a9ec808621fb admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:59.276995 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeed7e6-6452-4dc1-baba-a9ec808621fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:59.276995 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeed7e6-6452-4dc1-baba-a9ec808621fb admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:59.277520 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeed7e6-6452-4dc1-baba-a9ec808621fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:25:59.277838 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeed7e6-6452-4dc1-baba-a9ec808621fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:59.279505 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeed7e6-6452-4dc1-baba-a9ec808621fb admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:59.290875 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2186/4415] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:25:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:25:59.299684 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1719581-a5b0-418d-8b5b-f3af5cc93333 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:59.300213 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1719581-a5b0-418d-8b5b-f3af5cc93333 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:59.305479 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1719581-a5b0-418d-8b5b-f3af5cc93333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:59.311007 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2230/4416] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:25:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:25:59.315698 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeed7e6-6452-4dc1-baba-a9ec808621fb admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:59.337259 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeed7e6-6452-4dc1-baba-a9ec808621fb admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:59.340324 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-f1719581-a5b0-418d-8b5b-f3af5cc93333 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:25:59.341872 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-f1719581-a5b0-418d-8b5b-f3af5cc93333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:25:59.344142 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30fd620-c4b6-4aa4-ab17-9efe79397e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:59.345059 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30fd620-c4b6-4aa4-ab17-9efe79397e65 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:59.345271 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30fd620-c4b6-4aa4-ab17-9efe79397e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:59.345694 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30fd620-c4b6-4aa4-ab17-9efe79397e65 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:59.346400 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30fd620-c4b6-4aa4-ab17-9efe79397e65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:59.348869 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30fd620-c4b6-4aa4-ab17-9efe79397e65 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:59.365699 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2187/4417] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:25:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:25:59.370411 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1719581-a5b0-418d-8b5b-f3af5cc93333 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:59.385254 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1719581-a5b0-418d-8b5b-f3af5cc93333 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:59.393324 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b6fbed-debc-4b4d-ab21-7b0e1dbd3f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:59.393324 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6fbed-debc-4b4d-ab21-7b0e1dbd3f5f admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:59.393324 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6fbed-debc-4b4d-ab21-7b0e1dbd3f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:59.394214 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6fbed-debc-4b4d-ab21-7b0e1dbd3f5f admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:59.394952 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b6fbed-debc-4b4d-ab21-7b0e1dbd3f5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:25:59.395255 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b6fbed-debc-4b4d-ab21-7b0e1dbd3f5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:59.396956 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b6fbed-debc-4b4d-ab21-7b0e1dbd3f5f admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:59.419640 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2188/4418] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:25:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:25:59.421240 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b6fbed-debc-4b4d-ab21-7b0e1dbd3f5f admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:59.434481 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b6fbed-debc-4b4d-ab21-7b0e1dbd3f5f admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:59.440592 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d8fb23-d79b-46bd-8122-d1c2cf048dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:59.441498 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d8fb23-d79b-46bd-8122-d1c2cf048dad admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:59.441861 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d8fb23-d79b-46bd-8122-d1c2cf048dad admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:59.442619 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d8fb23-d79b-46bd-8122-d1c2cf048dad admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:59.443337 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d8fb23-d79b-46bd-8122-d1c2cf048dad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:59.446309 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d8fb23-d79b-46bd-8122-d1c2cf048dad admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:59.451021 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2231/4419] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:25:59 2022] POST /identity/v3/projects => generated 371 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:25:59.455218 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30fd620-c4b6-4aa4-ab17-9efe79397e65 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:59.528926 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2189/4420] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:25:59 2022] POST /identity/v3/projects => generated 365 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:25:59.528926 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d8fb23-d79b-46bd-8122-d1c2cf048dad admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:59.558726 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30fd620-c4b6-4aa4-ab17-9efe79397e65 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:59.618969 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d8fb23-d79b-46bd-8122-d1c2cf048dad admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:59.625197 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f631de82-f005-4da5-8c3e-79f799666bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:59.630323 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f631de82-f005-4da5-8c3e-79f799666bab admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:59.630323 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f631de82-f005-4da5-8c3e-79f799666bab admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:59.630323 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f631de82-f005-4da5-8c3e-79f799666bab admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:59.630323 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f631de82-f005-4da5-8c3e-79f799666bab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:59.630323 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f631de82-f005-4da5-8c3e-79f799666bab admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:59.655015 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67372925-8539-4741-8af1-1755141ef4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:59.655762 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67372925-8539-4741-8af1-1755141ef4b7 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:59.656149 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67372925-8539-4741-8af1-1755141ef4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:59.656598 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67372925-8539-4741-8af1-1755141ef4b7 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:59.657499 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67372925-8539-4741-8af1-1755141ef4b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:59.659649 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67372925-8539-4741-8af1-1755141ef4b7 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:59.818667 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2190/4421] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:25:59 2022] POST /identity/v3/users => generated 283 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:25:59.819010 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2232/4422] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:25:59 2022] POST /identity/v3/users => generated 286 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:25:59.820510 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f631de82-f005-4da5-8c3e-79f799666bab admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:59.823660 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67372925-8539-4741-8af1-1755141ef4b7 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:59.859777 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f631de82-f005-4da5-8c3e-79f799666bab admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:59.859777 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc925c94-650d-46fc-8310-2eaa0d3added admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:59.859777 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc925c94-650d-46fc-8310-2eaa0d3added admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:59.859777 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc925c94-650d-46fc-8310-2eaa0d3added admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:59.860508 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc925c94-650d-46fc-8310-2eaa0d3added admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:59.860508 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc925c94-650d-46fc-8310-2eaa0d3added admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:59.860683 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67372925-8539-4741-8af1-1755141ef4b7 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:59.860789 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc925c94-650d-46fc-8310-2eaa0d3added admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:59.867192 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2191/4423] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:25:59.871023 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc925c94-650d-46fc-8310-2eaa0d3added admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:59.874168 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71be42b0-5be0-4c60-9465-53098fc3e85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:59.875127 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be42b0-5be0-4c60-9465-53098fc3e85f admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:59.875804 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be42b0-5be0-4c60-9465-53098fc3e85f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:59.876262 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be42b0-5be0-4c60-9465-53098fc3e85f admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:59.877754 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71be42b0-5be0-4c60-9465-53098fc3e85f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:59.880402 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71be42b0-5be0-4c60-9465-53098fc3e85f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:59.883404 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc925c94-650d-46fc-8310-2eaa0d3added admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:59.888168 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b443d-f960-4010-8ab0-ce010c797d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:59.889013 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b443d-f960-4010-8ab0-ce010c797d49 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:59.889414 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b443d-f960-4010-8ab0-ce010c797d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:59.889795 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b443d-f960-4010-8ab0-ce010c797d49 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:59.890633 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b443d-f960-4010-8ab0-ce010c797d49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:59.892420 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b443d-f960-4010-8ab0-ce010c797d49 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:59.896930 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2233/4424] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:25:59.903258 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71be42b0-5be0-4c60-9465-53098fc3e85f admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:59.916967 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71be42b0-5be0-4c60-9465-53098fc3e85f admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:59.921364 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2192/4425] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:25:59.925288 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b443d-f960-4010-8ab0-ce010c797d49 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:59.928887 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db05b747-0654-4ac6-95f4-c7ab8337e7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:59.929870 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db05b747-0654-4ac6-95f4-c7ab8337e7b5 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:59.930220 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db05b747-0654-4ac6-95f4-c7ab8337e7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:59.930561 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db05b747-0654-4ac6-95f4-c7ab8337e7b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:59.931573 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db05b747-0654-4ac6-95f4-c7ab8337e7b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:59.934835 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db05b747-0654-4ac6-95f4-c7ab8337e7b5 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:59.941048 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b443d-f960-4010-8ab0-ce010c797d49 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:59.951588 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e519d23-0d4f-47e7-a459-9da424464f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:59.952723 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e519d23-0d4f-47e7-a459-9da424464f7b admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:59.953110 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e519d23-0d4f-47e7-a459-9da424464f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:59.954029 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e519d23-0d4f-47e7-a459-9da424464f7b admin admin] PATH_INFO: `/v3/projects/13273590af6f4adb8015396a79638c8e/users/b6eb995be9004e65ad8abaafe1bd63c3/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:59.954797 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2234/4426] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:25:59.956075 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db05b747-0654-4ac6-95f4-c7ab8337e7b5 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:25:59.968862 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db05b747-0654-4ac6-95f4-c7ab8337e7b5 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:25:59.974090 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43eacd2-be6e-47a8-b251-934deea35d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:25:59.975218 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43eacd2-be6e-47a8-b251-934deea35d8c admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:25:59.975622 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43eacd2-be6e-47a8-b251-934deea35d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:25:59.976006 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43eacd2-be6e-47a8-b251-934deea35d8c admin admin] PATH_INFO: `/v3/projects/91fceeecfb744810a52fd04cc03c72cf/users/b398969c37454956a73bf459e0d37e61/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:25:59.976474 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e519d23-0d4f-47e7-a459-9da424464f7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=13273590af6f4adb8015396a79638c8e, user_id=b6eb995be9004e65ad8abaafe1bd63c3, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:59.979603 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e519d23-0d4f-47e7-a459-9da424464f7b admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:25:59.993134 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43eacd2-be6e-47a8-b251-934deea35d8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=91fceeecfb744810a52fd04cc03c72cf, user_id=b398969c37454956a73bf459e0d37e61, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:25:59.996006 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43eacd2-be6e-47a8-b251-934deea35d8c admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:00.089425 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2193/4427] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:25:59 2022] PUT /identity/v3/projects/13273590af6f4adb8015396a79638c8e/users/b6eb995be9004e65ad8abaafe1bd63c3/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:26:00.104458 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2235/4428] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:25:59 2022] PUT /identity/v3/projects/91fceeecfb744810a52fd04cc03c72cf/users/b398969c37454956a73bf459e0d37e61/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:26:00.110036 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a2bb54-9d80-4c60-99ae-7e1d967776a6 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:00.110411 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a2bb54-9d80-4c60-99ae-7e1d967776a6 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:00.110700 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a2bb54-9d80-4c60-99ae-7e1d967776a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:00.131596 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-27a2bb54-9d80-4c60-99ae-7e1d967776a6 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:26:00.134026 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-27a2bb54-9d80-4c60-99ae-7e1d967776a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:26:00.189573 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea39cb-d64a-4d39-bc9c-d0ff971dae81 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:00.189981 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea39cb-d64a-4d39-bc9c-d0ff971dae81 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:00.190391 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea39cb-d64a-4d39-bc9c-d0ff971dae81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:00.207138 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2194/4429] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:26:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:26:00.217914 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a2bb54-9d80-4c60-99ae-7e1d967776a6 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:00.221092 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-27a2bb54-9d80-4c60-99ae-7e1d967776a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:26:00.236201 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-53ea39cb-d64a-4d39-bc9c-d0ff971dae81 None None] MFA Rules not processed for user `b6eb995be9004e65ad8abaafe1bd63c3`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:26:00.238892 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-53ea39cb-d64a-4d39-bc9c-d0ff971dae81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:26:00.296701 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a2bb54-9d80-4c60-99ae-7e1d967776a6 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:00.301295 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851b2436-242e-4fa9-9e27-f9610e7afe59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:00.302166 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b2436-242e-4fa9-9e27-f9610e7afe59 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:00.306054 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b2436-242e-4fa9-9e27-f9610e7afe59 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:00.306054 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b2436-242e-4fa9-9e27-f9610e7afe59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:00.313697 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851b2436-242e-4fa9-9e27-f9610e7afe59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:00.315147 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851b2436-242e-4fa9-9e27-f9610e7afe59 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:00.316666 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2236/4430] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:26:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:26:00.328348 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2195/4431] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:26:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:26:00.341215 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ea39cb-d64a-4d39-bc9c-d0ff971dae81 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:00.345457 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-53ea39cb-d64a-4d39-bc9c-d0ff971dae81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:26:00.363999 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ea39cb-d64a-4d39-bc9c-d0ff971dae81 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:00.368174 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbff515-ad60-4d93-8ae4-545bb8e86b9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:00.369015 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbff515-ad60-4d93-8ae4-545bb8e86b9e service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:00.369304 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbff515-ad60-4d93-8ae4-545bb8e86b9e service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:00.369608 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbff515-ad60-4d93-8ae4-545bb8e86b9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:00.378448 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbff515-ad60-4d93-8ae4-545bb8e86b9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:00.379926 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbff515-ad60-4d93-8ae4-545bb8e86b9e service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:00.390898 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2237/4432] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:26:00 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:26:01.973884 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282f8a2-dd81-47e6-b2e8-6e852cba98bd None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:01.975527 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282f8a2-dd81-47e6-b2e8-6e852cba98bd None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:01.975997 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282f8a2-dd81-47e6-b2e8-6e852cba98bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:02.013084 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-c282f8a2-dd81-47e6-b2e8-6e852cba98bd None None] MFA Rules not processed for user `b398969c37454956a73bf459e0d37e61`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:26:02.014810 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c282f8a2-dd81-47e6-b2e8-6e852cba98bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:26:02.106971 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2196/4433] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:26:01 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:26:02.119425 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6349bd85-28e2-421d-a2a1-dbf12e70b89e None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:02.119995 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6349bd85-28e2-421d-a2a1-dbf12e70b89e None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:02.119995 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6349bd85-28e2-421d-a2a1-dbf12e70b89e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:02.149243 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-6349bd85-28e2-421d-a2a1-dbf12e70b89e None None] MFA Rules not processed for user `b398969c37454956a73bf459e0d37e61`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:26:02.150597 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-6349bd85-28e2-421d-a2a1-dbf12e70b89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:26:02.165504 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2238/4434] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:26:02 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:26:02.173142 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c282f8a2-dd81-47e6-b2e8-6e852cba98bd None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:02.180814 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c282f8a2-dd81-47e6-b2e8-6e852cba98bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:26:02.301088 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c282f8a2-dd81-47e6-b2e8-6e852cba98bd None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:02.321818 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3512cd44-84cd-47b5-adaf-fd61b72ffc2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:02.322811 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3512cd44-84cd-47b5-adaf-fd61b72ffc2a service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:02.323305 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3512cd44-84cd-47b5-adaf-fd61b72ffc2a service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:02.324309 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3512cd44-84cd-47b5-adaf-fd61b72ffc2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:02.358915 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3512cd44-84cd-47b5-adaf-fd61b72ffc2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:02.360586 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3512cd44-84cd-47b5-adaf-fd61b72ffc2a service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:02.377698 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2197/4435] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:26:02 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:26:02.476498 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ae2f2-df02-4c23-9c68-3235f536691b None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:02.477174 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ae2f2-df02-4c23-9c68-3235f536691b None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:02.477952 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ae2f2-df02-4c23-9c68-3235f536691b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:02.506340 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-c97ae2f2-df02-4c23-9c68-3235f536691b None None] MFA Rules not processed for user `1e3390c9579a4f598c46f9417b4dd046`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:26:02.508295 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c97ae2f2-df02-4c23-9c68-3235f536691b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:26:02.622324 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2239/4436] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:26:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:26:08.150740 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ed256-7a61-43f2-b689-9a4ef5eb5562 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:08.154109 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ed256-7a61-43f2-b689-9a4ef5eb5562 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:08.154646 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ed256-7a61-43f2-b689-9a4ef5eb5562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:08.214474 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-3f0ed256-7a61-43f2-b689-9a4ef5eb5562 None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:26:08.216778 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-3f0ed256-7a61-43f2-b689-9a4ef5eb5562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:26:08.311796 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2198/4437] 10.222.0.52 () {58 vars in 1009 bytes} [Sat May 14 21:26:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:26:08.344795 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97ae2f2-df02-4c23-9c68-3235f536691b None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:08.349169 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c97ae2f2-df02-4c23-9c68-3235f536691b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:26:08.447905 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97ae2f2-df02-4c23-9c68-3235f536691b None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:08.454006 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3d15c6-7346-4eae-8925-7b7ad693cf7f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:08.454963 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d15c6-7346-4eae-8925-7b7ad693cf7f service swift] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:08.455425 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d15c6-7346-4eae-8925-7b7ad693cf7f service swift] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:08.455916 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d15c6-7346-4eae-8925-7b7ad693cf7f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:08.465834 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3d15c6-7346-4eae-8925-7b7ad693cf7f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:08.467686 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3d15c6-7346-4eae-8925-7b7ad693cf7f service swift] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:08.477619 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2240/4438] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 21:26:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 21:26:09.076811 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b3fa4-f463-4329-a2f2-a70a5fe50f47 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:09.077103 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b3fa4-f463-4329-a2f2-a70a5fe50f47 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:09.077379 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b3fa4-f463-4329-a2f2-a70a5fe50f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:09.125577 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-df6b3fa4-f463-4329-a2f2-a70a5fe50f47 None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:26:09.128835 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-df6b3fa4-f463-4329-a2f2-a70a5fe50f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:26:09.148937 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2199/4439] 10.222.0.52 () {58 vars in 967 bytes} [Sat May 14 21:26:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:26:09.169918 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3d15c6-7346-4eae-8925-7b7ad693cf7f service swift] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:09.187981 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3d15c6-7346-4eae-8925-7b7ad693cf7f service swift] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:09.204136 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d630173-1104-4f8b-bb0c-2bbf78d33827 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:09.204803 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d630173-1104-4f8b-bb0c-2bbf78d33827 service swift] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:09.205083 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d630173-1104-4f8b-bb0c-2bbf78d33827 service swift] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:09.205356 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d630173-1104-4f8b-bb0c-2bbf78d33827 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:09.226689 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d630173-1104-4f8b-bb0c-2bbf78d33827 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:09.235330 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d630173-1104-4f8b-bb0c-2bbf78d33827 service swift] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:09.273885 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2241/4440] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 21:26:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 21:26:17.067253 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6b3fa4-f463-4329-a2f2-a70a5fe50f47 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:17.068891 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-df6b3fa4-f463-4329-a2f2-a70a5fe50f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:26:17.092741 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6b3fa4-f463-4329-a2f2-a70a5fe50f47 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:17.137755 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217a0b4a-d6c8-4a5b-a2ef-2ca2838a1cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:17.139169 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217a0b4a-d6c8-4a5b-a2ef-2ca2838a1cdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:17.143246 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217a0b4a-d6c8-4a5b-a2ef-2ca2838a1cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:17.143803 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217a0b4a-d6c8-4a5b-a2ef-2ca2838a1cdd admin admin] PATH_INFO: `/v3/users/1b4361b4b12041edbd523eef23f82dae` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:17.151670 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217a0b4a-d6c8-4a5b-a2ef-2ca2838a1cdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b4361b4b12041edbd523eef23f82dae)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:17.155047 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217a0b4a-d6c8-4a5b-a2ef-2ca2838a1cdd admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:17.490094 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-217a0b4a-d6c8-4a5b-a2ef-2ca2838a1cdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b4361b4b12041edbd523eef23f82dae'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:26:17.500337 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-217a0b4a-d6c8-4a5b-a2ef-2ca2838a1cdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b4361b4b12041edbd523eef23f82dae'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:26:17.501374 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-217a0b4a-d6c8-4a5b-a2ef-2ca2838a1cdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b4361b4b12041edbd523eef23f82dae'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:26:17.622056 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-217a0b4a-d6c8-4a5b-a2ef-2ca2838a1cdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b4361b4b12041edbd523eef23f82dae'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:26:17.646660 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-217a0b4a-d6c8-4a5b-a2ef-2ca2838a1cdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b4361b4b12041edbd523eef23f82dae'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:26:17.663051 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2200/4441] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:26:17 2022] DELETE /identity/v3/users/1b4361b4b12041edbd523eef23f82dae => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:26:18.544256 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d630173-1104-4f8b-bb0c-2bbf78d33827 service swift] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:18.559148 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d630173-1104-4f8b-bb0c-2bbf78d33827 service swift] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:18.753637 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f1eae-959d-4740-aba3-f3f2920086a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:18.754805 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f1eae-959d-4740-aba3-f3f2920086a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:18.755309 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f1eae-959d-4740-aba3-f3f2920086a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:18.755849 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f1eae-959d-4740-aba3-f3f2920086a2 admin admin] PATH_INFO: `/v3/projects/689bc5cf419440f683a6ab4fd29dc06e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:18.766537 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519f1eae-959d-4740-aba3-f3f2920086a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=689bc5cf419440f683a6ab4fd29dc06e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:18.769396 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519f1eae-959d-4740-aba3-f3f2920086a2 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:18.987011 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-519f1eae-959d-4740-aba3-f3f2920086a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '689bc5cf419440f683a6ab4fd29dc06e', 'request_id': 'req-519f1eae-959d-4740-aba3-f3f2920086a2'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:26:19.002292 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-519f1eae-959d-4740-aba3-f3f2920086a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '689bc5cf419440f683a6ab4fd29dc06e', 'request_id': 'req-519f1eae-959d-4740-aba3-f3f2920086a2'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:26:19.089389 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-519f1eae-959d-4740-aba3-f3f2920086a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '689bc5cf419440f683a6ab4fd29dc06e', 'request_id': 'req-519f1eae-959d-4740-aba3-f3f2920086a2'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:26:19.111233 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-519f1eae-959d-4740-aba3-f3f2920086a2 admin admin] The token cache is being invalidate because project 689bc5cf419440f683a6ab4fd29dc06e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:26:19.112357 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-519f1eae-959d-4740-aba3-f3f2920086a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:26:19.114611 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-519f1eae-959d-4740-aba3-f3f2920086a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:26:19.124554 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2242/4442] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:26:18 2022] DELETE /identity/v3/projects/689bc5cf419440f683a6ab4fd29dc06e => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:26:19.130256 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baaa355-8ea6-435f-8bbf-3cb703798bd9 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:19.131516 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baaa355-8ea6-435f-8bbf-3cb703798bd9 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:19.132120 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baaa355-8ea6-435f-8bbf-3cb703798bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:19.177655 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-8baaa355-8ea6-435f-8bbf-3cb703798bd9 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:26:19.180981 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8baaa355-8ea6-435f-8bbf-3cb703798bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:26:19.359522 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2201/4443] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:26:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:26:19.445052 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c9b871-36ee-4acf-883c-b53aa2791fab None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:19.445508 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c9b871-36ee-4acf-883c-b53aa2791fab None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:19.445925 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c9b871-36ee-4acf-883c-b53aa2791fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:19.476800 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-68c9b871-36ee-4acf-883c-b53aa2791fab None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:26:19.480400 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-68c9b871-36ee-4acf-883c-b53aa2791fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:26:19.491470 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2243/4444] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:26:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:26:19.493355 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baaa355-8ea6-435f-8bbf-3cb703798bd9 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:19.507217 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baaa355-8ea6-435f-8bbf-3cb703798bd9 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:19.516401 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef07158-eaf7-4a58-b3ee-16cd1ff9a593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:19.517643 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef07158-eaf7-4a58-b3ee-16cd1ff9a593 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:19.518104 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef07158-eaf7-4a58-b3ee-16cd1ff9a593 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:19.519597 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef07158-eaf7-4a58-b3ee-16cd1ff9a593 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:19.521157 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef07158-eaf7-4a58-b3ee-16cd1ff9a593 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:26:19.523055 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef07158-eaf7-4a58-b3ee-16cd1ff9a593 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:19.525739 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef07158-eaf7-4a58-b3ee-16cd1ff9a593 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:19.564646 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2202/4445] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:26:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:26:19.565909 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c9b871-36ee-4acf-883c-b53aa2791fab None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:19.582002 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c9b871-36ee-4acf-883c-b53aa2791fab None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:19.596185 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d31bc0-9c8a-46f8-ad4f-7f94769c85e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:19.598330 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d31bc0-9c8a-46f8-ad4f-7f94769c85e3 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:19.598774 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d31bc0-9c8a-46f8-ad4f-7f94769c85e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:19.599120 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d31bc0-9c8a-46f8-ad4f-7f94769c85e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:19.603643 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d31bc0-9c8a-46f8-ad4f-7f94769c85e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:19.604589 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d31bc0-9c8a-46f8-ad4f-7f94769c85e3 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:19.801244 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2244/4446] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:26:19 2022] POST /identity/v3/projects => generated 381 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:26:19.805015 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef07158-eaf7-4a58-b3ee-16cd1ff9a593 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:19.822595 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef07158-eaf7-4a58-b3ee-16cd1ff9a593 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:20.008058 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f2f6a8-43e0-4428-b908-5b7ed17a604d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:20.008888 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f2f6a8-43e0-4428-b908-5b7ed17a604d admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:20.009276 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f2f6a8-43e0-4428-b908-5b7ed17a604d admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:20.009728 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f2f6a8-43e0-4428-b908-5b7ed17a604d admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:20.010520 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f2f6a8-43e0-4428-b908-5b7ed17a604d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:20.013414 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f2f6a8-43e0-4428-b908-5b7ed17a604d admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:20.153346 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2203/4447] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:26:19 2022] POST /identity/v3/users => generated 291 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:26:20.154003 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d31bc0-9c8a-46f8-ad4f-7f94769c85e3 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:20.169908 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d31bc0-9c8a-46f8-ad4f-7f94769c85e3 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:20.196628 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f72595e-80d0-42f7-ab6d-b8a11730e980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:20.197339 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72595e-80d0-42f7-ab6d-b8a11730e980 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:20.197627 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72595e-80d0-42f7-ab6d-b8a11730e980 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:20.197905 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72595e-80d0-42f7-ab6d-b8a11730e980 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:20.198651 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f72595e-80d0-42f7-ab6d-b8a11730e980 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:20.200320 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f72595e-80d0-42f7-ab6d-b8a11730e980 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:20.231380 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2245/4448] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:26:20 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:26:20.238808 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f2f6a8-43e0-4428-b908-5b7ed17a604d admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:20.265893 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f2f6a8-43e0-4428-b908-5b7ed17a604d admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:20.286223 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba8564-5e7b-4d01-a6c2-37a6b10a9f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:20.286223 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba8564-5e7b-4d01-a6c2-37a6b10a9f03 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:20.286223 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba8564-5e7b-4d01-a6c2-37a6b10a9f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:20.286223 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba8564-5e7b-4d01-a6c2-37a6b10a9f03 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:20.292256 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daba8564-5e7b-4d01-a6c2-37a6b10a9f03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:20.294170 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daba8564-5e7b-4d01-a6c2-37a6b10a9f03 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:20.310054 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2204/4449] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:26:20 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:26:20.314406 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f72595e-80d0-42f7-ab6d-b8a11730e980 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:20.329962 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f72595e-80d0-42f7-ab6d-b8a11730e980 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:20.341808 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b2b755-fd4e-4cbc-94f5-6f2206f4bc0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:20.342725 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2b755-fd4e-4cbc-94f5-6f2206f4bc0e admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:20.343011 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2b755-fd4e-4cbc-94f5-6f2206f4bc0e admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:20.343292 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2b755-fd4e-4cbc-94f5-6f2206f4bc0e admin admin] PATH_INFO: `/v3/projects/ec5b6c73e5f14deca3371f8735b60f5f/users/b487bf2669c946b9935d9afb5d8e266a/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:20.371394 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b2b755-fd4e-4cbc-94f5-6f2206f4bc0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec5b6c73e5f14deca3371f8735b60f5f, user_id=b487bf2669c946b9935d9afb5d8e266a, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:20.374663 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b2b755-fd4e-4cbc-94f5-6f2206f4bc0e admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:20.498423 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2246/4450] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:26:20 2022] PUT /identity/v3/projects/ec5b6c73e5f14deca3371f8735b60f5f/users/b487bf2669c946b9935d9afb5d8e266a/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:26:20.498537 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364746e7-9273-467f-9d4d-5886df7831f4 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:20.498537 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364746e7-9273-467f-9d4d-5886df7831f4 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:20.498537 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364746e7-9273-467f-9d4d-5886df7831f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:20.526616 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-364746e7-9273-467f-9d4d-5886df7831f4 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:26:20.527956 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-364746e7-9273-467f-9d4d-5886df7831f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:26:20.608977 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2205/4451] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:26:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:26:20.621777 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b2b755-fd4e-4cbc-94f5-6f2206f4bc0e admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:20.627732 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-47b2b755-fd4e-4cbc-94f5-6f2206f4bc0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:26:20.735737 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b2b755-fd4e-4cbc-94f5-6f2206f4bc0e admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:20.740236 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc9edb5-8ea5-4df5-8dc4-a0450e142c1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:20.742241 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9edb5-8ea5-4df5-8dc4-a0450e142c1c service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:20.743791 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9edb5-8ea5-4df5-8dc4-a0450e142c1c service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:20.745344 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9edb5-8ea5-4df5-8dc4-a0450e142c1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:20.762457 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc9edb5-8ea5-4df5-8dc4-a0450e142c1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:20.765299 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc9edb5-8ea5-4df5-8dc4-a0450e142c1c service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:20.796511 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2247/4452] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:26:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:26:23.325722 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6639db5-ed81-4310-8f78-4835bcb829c9 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:23.326699 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6639db5-ed81-4310-8f78-4835bcb829c9 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:23.327160 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6639db5-ed81-4310-8f78-4835bcb829c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:23.373512 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-a6639db5-ed81-4310-8f78-4835bcb829c9 None None] MFA Rules not processed for user `b398969c37454956a73bf459e0d37e61`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:26:23.374990 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-a6639db5-ed81-4310-8f78-4835bcb829c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:26:23.562252 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2206/4453] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:26:23 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:26:24.131275 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc9edb5-8ea5-4df5-8dc4-a0450e142c1c service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:24.132813 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-6fc9edb5-8ea5-4df5-8dc4-a0450e142c1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:26:24.158062 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc9edb5-8ea5-4df5-8dc4-a0450e142c1c service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:24.169456 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb80b8b-b838-49dc-8c71-a7d62383000f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:24.170691 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb80b8b-b838-49dc-8c71-a7d62383000f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:24.171067 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb80b8b-b838-49dc-8c71-a7d62383000f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:24.171442 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb80b8b-b838-49dc-8c71-a7d62383000f admin admin] PATH_INFO: `/v3/users/b6eb995be9004e65ad8abaafe1bd63c3` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:24.182452 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb80b8b-b838-49dc-8c71-a7d62383000f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6eb995be9004e65ad8abaafe1bd63c3)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:24.186357 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb80b8b-b838-49dc-8c71-a7d62383000f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:24.303544 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0886d2-5895-4482-ab2f-782b499ef275 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:24.304109 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0886d2-5895-4482-ab2f-782b499ef275 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:24.304615 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0886d2-5895-4482-ab2f-782b499ef275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:24.358095 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-8f0886d2-5895-4482-ab2f-782b499ef275 None None] MFA Rules not processed for user `b487bf2669c946b9935d9afb5d8e266a`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:26:24.359405 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8f0886d2-5895-4482-ab2f-782b499ef275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:26:24.465977 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2fb80b8b-b838-49dc-8c71-a7d62383000f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6eb995be9004e65ad8abaafe1bd63c3'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:26:24.501158 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2fb80b8b-b838-49dc-8c71-a7d62383000f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6eb995be9004e65ad8abaafe1bd63c3'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:26:24.514260 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2fb80b8b-b838-49dc-8c71-a7d62383000f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6eb995be9004e65ad8abaafe1bd63c3'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:26:24.521141 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2207/4454] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:26:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:26:24.532532 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf53755-0a35-4068-9d15-10cefdf49f72 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:24.533047 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf53755-0a35-4068-9d15-10cefdf49f72 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:24.533609 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf53755-0a35-4068-9d15-10cefdf49f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:24.554972 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-ebf53755-0a35-4068-9d15-10cefdf49f72 None None] MFA Rules not processed for user `b487bf2669c946b9935d9afb5d8e266a`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:26:24.556656 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-ebf53755-0a35-4068-9d15-10cefdf49f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:26:24.564281 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2208/4455] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:26:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:26:24.609441 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2fb80b8b-b838-49dc-8c71-a7d62383000f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6eb995be9004e65ad8abaafe1bd63c3'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:26:24.610280 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2fb80b8b-b838-49dc-8c71-a7d62383000f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6eb995be9004e65ad8abaafe1bd63c3'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:26:24.617806 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2248/4456] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:26:24 2022] DELETE /identity/v3/users/b6eb995be9004e65ad8abaafe1bd63c3 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:26:24.622006 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f2495-b6a5-4022-9bfb-c3e62e29bc39 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:24.622293 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f2495-b6a5-4022-9bfb-c3e62e29bc39 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:24.622563 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f2495-b6a5-4022-9bfb-c3e62e29bc39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:24.661952 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-da2f2495-b6a5-4022-9bfb-c3e62e29bc39 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:26:24.661952 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-da2f2495-b6a5-4022-9bfb-c3e62e29bc39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:26:24.672502 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb80b8b-b838-49dc-8c71-a7d62383000f admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:24.673933 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-2fb80b8b-b838-49dc-8c71-a7d62383000f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:26:24.815919 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2209/4457] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:26:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:26:24.828623 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2f2495-b6a5-4022-9bfb-c3e62e29bc39 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:24.830784 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-da2f2495-b6a5-4022-9bfb-c3e62e29bc39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:26:24.834681 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb80b8b-b838-49dc-8c71-a7d62383000f admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:24.842944 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b3ec26-8810-46ef-b878-6c83ba37fdbd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:24.843698 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b3ec26-8810-46ef-b878-6c83ba37fdbd service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:24.844036 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b3ec26-8810-46ef-b878-6c83ba37fdbd service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:24.844308 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b3ec26-8810-46ef-b878-6c83ba37fdbd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:24.846189 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-98b3ec26-8810-46ef-b878-6c83ba37fdbd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:26:24.977051 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b3ec26-8810-46ef-b878-6c83ba37fdbd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:24.980920 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2f2495-b6a5-4022-9bfb-c3e62e29bc39 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:24.985212 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e70f8-1c1c-4b7c-a2f5-75cd89929b5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:24.986003 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e70f8-1c1c-4b7c-a2f5-75cd89929b5f service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:24.986350 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e70f8-1c1c-4b7c-a2f5-75cd89929b5f service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:24.990040 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e70f8-1c1c-4b7c-a2f5-75cd89929b5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:24.990186 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b3ec26-8810-46ef-b878-6c83ba37fdbd service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:25.002858 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908e70f8-1c1c-4b7c-a2f5-75cd89929b5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:25.005209 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908e70f8-1c1c-4b7c-a2f5-75cd89929b5f service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:25.005967 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2249/4458] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:26:24 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:26:25.037110 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2210/4459] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:26:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:26:25.285094 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b3ec26-8810-46ef-b878-6c83ba37fdbd service nova] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:25.286677 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-98b3ec26-8810-46ef-b878-6c83ba37fdbd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:26:25.432455 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b3ec26-8810-46ef-b878-6c83ba37fdbd service nova] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:25.441992 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b266068a-a2ec-42b9-a354-b6c7d41ed7f5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:25.443143 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b266068a-a2ec-42b9-a354-b6c7d41ed7f5 service placement] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:25.444351 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b266068a-a2ec-42b9-a354-b6c7d41ed7f5 service placement] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:25.444885 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b266068a-a2ec-42b9-a354-b6c7d41ed7f5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:25.447085 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b266068a-a2ec-42b9-a354-b6c7d41ed7f5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:26:25.465041 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b266068a-a2ec-42b9-a354-b6c7d41ed7f5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:25.472063 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b266068a-a2ec-42b9-a354-b6c7d41ed7f5 service placement] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:25.532122 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2250/4460] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:26:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:26:25.822866 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e710942-b1a1-486d-8422-e1aecddd0e83 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:25.823380 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e710942-b1a1-486d-8422-e1aecddd0e83 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:25.823569 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e710942-b1a1-486d-8422-e1aecddd0e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:25.867315 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-2e710942-b1a1-486d-8422-e1aecddd0e83 None None] MFA Rules not processed for user `b398969c37454956a73bf459e0d37e61`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:26:25.868605 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-2e710942-b1a1-486d-8422-e1aecddd0e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:26:25.983017 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2211/4461] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:26:25 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:26:26.100930 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b266068a-a2ec-42b9-a354-b6c7d41ed7f5 service placement] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:26.102678 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b266068a-a2ec-42b9-a354-b6c7d41ed7f5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:26:26.125243 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b266068a-a2ec-42b9-a354-b6c7d41ed7f5 service placement] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:26.139736 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c086030-a336-411a-9c4f-7cb4aa7d36e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:26.140575 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c086030-a336-411a-9c4f-7cb4aa7d36e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:26.140794 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c086030-a336-411a-9c4f-7cb4aa7d36e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:26.141002 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c086030-a336-411a-9c4f-7cb4aa7d36e9 admin admin] PATH_INFO: `/v3/projects/13273590af6f4adb8015396a79638c8e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:26.142309 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c086030-a336-411a-9c4f-7cb4aa7d36e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13273590af6f4adb8015396a79638c8e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:26.150268 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c086030-a336-411a-9c4f-7cb4aa7d36e9 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:26.375207 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3c086030-a336-411a-9c4f-7cb4aa7d36e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13273590af6f4adb8015396a79638c8e', 'request_id': 'req-3c086030-a336-411a-9c4f-7cb4aa7d36e9'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:26:26.407245 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3c086030-a336-411a-9c4f-7cb4aa7d36e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13273590af6f4adb8015396a79638c8e', 'request_id': 'req-3c086030-a336-411a-9c4f-7cb4aa7d36e9'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:26:26.517782 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3c086030-a336-411a-9c4f-7cb4aa7d36e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13273590af6f4adb8015396a79638c8e', 'request_id': 'req-3c086030-a336-411a-9c4f-7cb4aa7d36e9'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:26:26.536898 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3c086030-a336-411a-9c4f-7cb4aa7d36e9 admin admin] The token cache is being invalidate because project 13273590af6f4adb8015396a79638c8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:26:26.537231 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3c086030-a336-411a-9c4f-7cb4aa7d36e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:26:26.538342 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3c086030-a336-411a-9c4f-7cb4aa7d36e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:26:26.546297 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2251/4462] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:26:26 2022] DELETE /identity/v3/projects/13273590af6f4adb8015396a79638c8e => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:26:26.547931 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80088a0e-f00e-4041-9064-8896f2c4ef7d None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:26.548237 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80088a0e-f00e-4041-9064-8896f2c4ef7d None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:26.548531 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80088a0e-f00e-4041-9064-8896f2c4ef7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:26.597156 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-80088a0e-f00e-4041-9064-8896f2c4ef7d None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:26:26.598236 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-80088a0e-f00e-4041-9064-8896f2c4ef7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:26:26.732856 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2212/4463] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:26:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:26:26.742106 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c05d1-db5f-40b9-9150-a0bf99b997dd None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:26.743448 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c05d1-db5f-40b9-9150-a0bf99b997dd None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:26.743987 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c05d1-db5f-40b9-9150-a0bf99b997dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:26.786510 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-8f1c05d1-db5f-40b9-9150-a0bf99b997dd None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:26:26.791262 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-8f1c05d1-db5f-40b9-9150-a0bf99b997dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:26:26.820545 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2252/4464] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:26:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:26:26.821277 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80088a0e-f00e-4041-9064-8896f2c4ef7d None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:26.839444 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80088a0e-f00e-4041-9064-8896f2c4ef7d None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:26.855451 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e7bf3d-8bfc-4c17-850f-7e87b79cd98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:26.856755 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7bf3d-8bfc-4c17-850f-7e87b79cd98b admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:26.857237 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7bf3d-8bfc-4c17-850f-7e87b79cd98b admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:26.858250 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7bf3d-8bfc-4c17-850f-7e87b79cd98b admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:26.871181 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e7bf3d-8bfc-4c17-850f-7e87b79cd98b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:26:26.871523 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e7bf3d-8bfc-4c17-850f-7e87b79cd98b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:26.873193 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e7bf3d-8bfc-4c17-850f-7e87b79cd98b admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:26.904427 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2213/4465] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:26:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:26:26.908926 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1c05d1-db5f-40b9-9150-a0bf99b997dd None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:26.941455 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1c05d1-db5f-40b9-9150-a0bf99b997dd None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:26.963793 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7571ed5-697a-400a-8c8c-41e12798731e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:26.964485 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7571ed5-697a-400a-8c8c-41e12798731e admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:26.964770 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7571ed5-697a-400a-8c8c-41e12798731e admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:26.965049 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7571ed5-697a-400a-8c8c-41e12798731e admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:26.965758 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7571ed5-697a-400a-8c8c-41e12798731e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:26.967794 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7571ed5-697a-400a-8c8c-41e12798731e admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:27.656130 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2253/4466] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:26:26 2022] POST /identity/v3/projects => generated 357 bytes in 748 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:26:27.661107 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e7bf3d-8bfc-4c17-850f-7e87b79cd98b admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:27.677409 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e7bf3d-8bfc-4c17-850f-7e87b79cd98b admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:27.816846 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53a5756-5ef6-4c52-91fb-2b6f5dfed6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:27.817528 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a5756-5ef6-4c52-91fb-2b6f5dfed6b9 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:27.817809 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a5756-5ef6-4c52-91fb-2b6f5dfed6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:27.818084 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a5756-5ef6-4c52-91fb-2b6f5dfed6b9 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:27.819396 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53a5756-5ef6-4c52-91fb-2b6f5dfed6b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:27.824627 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53a5756-5ef6-4c52-91fb-2b6f5dfed6b9 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:27.957293 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2214/4467] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:26:27 2022] POST /identity/v3/users => generated 279 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:26:27.962732 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7571ed5-697a-400a-8c8c-41e12798731e admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:27.980478 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7571ed5-697a-400a-8c8c-41e12798731e admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:28.004649 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40688f28-479c-440b-bccf-af7809d2dc77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:28.005536 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40688f28-479c-440b-bccf-af7809d2dc77 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:28.006099 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40688f28-479c-440b-bccf-af7809d2dc77 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:28.006546 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40688f28-479c-440b-bccf-af7809d2dc77 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:28.012666 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40688f28-479c-440b-bccf-af7809d2dc77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:28.014858 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40688f28-479c-440b-bccf-af7809d2dc77 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:28.065705 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2254/4468] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:26:28.066402 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53a5756-5ef6-4c52-91fb-2b6f5dfed6b9 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:28.076791 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53a5756-5ef6-4c52-91fb-2b6f5dfed6b9 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:28.101126 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fda3ad7-f8d4-4885-b9e8-86ce92ee2f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:28.102458 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda3ad7-f8d4-4885-b9e8-86ce92ee2f3b admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:28.102749 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda3ad7-f8d4-4885-b9e8-86ce92ee2f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:28.103028 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda3ad7-f8d4-4885-b9e8-86ce92ee2f3b admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:28.103839 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fda3ad7-f8d4-4885-b9e8-86ce92ee2f3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:28.105639 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fda3ad7-f8d4-4885-b9e8-86ce92ee2f3b admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:28.124373 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2215/4469] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:26:28 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:26:28.128572 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40688f28-479c-440b-bccf-af7809d2dc77 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:28.138409 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fda3ad7-f8d4-4885-b9e8-86ce92ee2f3b admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:28.145044 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-9fda3ad7-f8d4-4885-b9e8-86ce92ee2f3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:26:28.151883 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40688f28-479c-440b-bccf-af7809d2dc77 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:28.164602 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00735712-4391-4fad-9117-d7a1fac6be9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:28.165867 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00735712-4391-4fad-9117-d7a1fac6be9d admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:28.166380 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00735712-4391-4fad-9117-d7a1fac6be9d admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:28.166824 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00735712-4391-4fad-9117-d7a1fac6be9d admin admin] PATH_INFO: `/v3/projects/a55ae9f506474c828bc69fff78a389e0/users/e86200e4d1704c11b78acac21134f51f/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:28.208205 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00735712-4391-4fad-9117-d7a1fac6be9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a55ae9f506474c828bc69fff78a389e0, user_id=e86200e4d1704c11b78acac21134f51f, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:28.214181 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00735712-4391-4fad-9117-d7a1fac6be9d admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:28.285026 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fda3ad7-f8d4-4885-b9e8-86ce92ee2f3b admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:28.291806 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c755340b-8c26-4527-b525-e5c2211da27d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:28.293765 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c755340b-8c26-4527-b525-e5c2211da27d service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:28.293967 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c755340b-8c26-4527-b525-e5c2211da27d service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:28.294363 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c755340b-8c26-4527-b525-e5c2211da27d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:28.299758 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c755340b-8c26-4527-b525-e5c2211da27d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:26:28.322674 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2255/4470] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:26:28 2022] PUT /identity/v3/projects/a55ae9f506474c828bc69fff78a389e0/users/e86200e4d1704c11b78acac21134f51f/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:26:28.339797 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452e973e-c365-448b-8d8d-d6568e0d7b08 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:28.340136 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452e973e-c365-448b-8d8d-d6568e0d7b08 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:28.343930 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452e973e-c365-448b-8d8d-d6568e0d7b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:28.356063 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c755340b-8c26-4527-b525-e5c2211da27d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:28.357938 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c755340b-8c26-4527-b525-e5c2211da27d service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:28.383461 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2216/4471] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:26:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:26:28.472231 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-452e973e-c365-448b-8d8d-d6568e0d7b08 None None] MFA Rules not processed for user `e86200e4d1704c11b78acac21134f51f`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:26:28.473662 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-452e973e-c365-448b-8d8d-d6568e0d7b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:26:28.664429 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2256/4472] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:26:28 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:26:28.679389 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c755340b-8c26-4527-b525-e5c2211da27d service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:28.690964 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c755340b-8c26-4527-b525-e5c2211da27d service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:28.768410 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6181dcd-16ae-453a-b06f-556eb4210272 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:28.796411 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6181dcd-16ae-453a-b06f-556eb4210272 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:28.796411 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6181dcd-16ae-453a-b06f-556eb4210272 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:28.796411 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6181dcd-16ae-453a-b06f-556eb4210272 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:28.796411 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6181dcd-16ae-453a-b06f-556eb4210272 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:28.796411 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6181dcd-16ae-453a-b06f-556eb4210272 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:28.802668 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2217/4473] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:26:28 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:26:29.852804 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a30a4-8b65-473f-86d8-eb23c7a9236e None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:29.853334 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a30a4-8b65-473f-86d8-eb23c7a9236e None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:29.853334 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a30a4-8b65-473f-86d8-eb23c7a9236e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:29.875110 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-543a30a4-8b65-473f-86d8-eb23c7a9236e None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:26:29.878120 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-543a30a4-8b65-473f-86d8-eb23c7a9236e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:26:29.983591 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2257/4474] 10.222.0.52 () {58 vars in 967 bytes} [Sat May 14 21:26:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:26:29.996910 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6181dcd-16ae-453a-b06f-556eb4210272 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:29.998628 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c6181dcd-16ae-453a-b06f-556eb4210272 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:26:30.158980 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6181dcd-16ae-453a-b06f-556eb4210272 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:30.182661 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422b7965-55af-4300-8fdb-a56f49d8e2b0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:30.183336 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422b7965-55af-4300-8fdb-a56f49d8e2b0 service swift] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:30.183693 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422b7965-55af-4300-8fdb-a56f49d8e2b0 service swift] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:30.184145 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422b7965-55af-4300-8fdb-a56f49d8e2b0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:30.211421 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422b7965-55af-4300-8fdb-a56f49d8e2b0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:30.211421 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422b7965-55af-4300-8fdb-a56f49d8e2b0 service swift] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:30.223922 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2218/4475] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 21:26:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 21:26:31.916539 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6cc85-8409-4cbf-a7d0-945fb094b6ec None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:31.917087 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6cc85-8409-4cbf-a7d0-945fb094b6ec None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:31.917087 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6cc85-8409-4cbf-a7d0-945fb094b6ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:31.944380 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-6bc6cc85-8409-4cbf-a7d0-945fb094b6ec None None] MFA Rules not processed for user `ed0a76be93e44fa887cb813a8879e04d`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:26:31.945902 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-6bc6cc85-8409-4cbf-a7d0-945fb094b6ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:26:32.016777 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2258/4476] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:26:31 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:26:36.035997 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422b7965-55af-4300-8fdb-a56f49d8e2b0 service swift] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:36.037915 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-422b7965-55af-4300-8fdb-a56f49d8e2b0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:26:36.197210 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422b7965-55af-4300-8fdb-a56f49d8e2b0 service swift] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:36.202730 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffa4091-c2fc-463d-99be-17a54525fa86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:36.205249 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa4091-c2fc-463d-99be-17a54525fa86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:36.205537 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa4091-c2fc-463d-99be-17a54525fa86 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:36.205817 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa4091-c2fc-463d-99be-17a54525fa86 admin admin] PATH_INFO: `/v3/users/4e87a5a5713748b6a0d73984a279009b` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:36.207518 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffa4091-c2fc-463d-99be-17a54525fa86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e87a5a5713748b6a0d73984a279009b)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:36.210280 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffa4091-c2fc-463d-99be-17a54525fa86 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:36.477990 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-8ffa4091-c2fc-463d-99be-17a54525fa86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e87a5a5713748b6a0d73984a279009b'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:26:36.487509 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-8ffa4091-c2fc-463d-99be-17a54525fa86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e87a5a5713748b6a0d73984a279009b'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:26:36.488738 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-8ffa4091-c2fc-463d-99be-17a54525fa86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e87a5a5713748b6a0d73984a279009b'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:26:36.562260 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-8ffa4091-c2fc-463d-99be-17a54525fa86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e87a5a5713748b6a0d73984a279009b'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:26:36.579130 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-8ffa4091-c2fc-463d-99be-17a54525fa86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e87a5a5713748b6a0d73984a279009b'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:26:36.587381 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2219/4477] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:26:36 2022] DELETE /identity/v3/users/4e87a5a5713748b6a0d73984a279009b => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:26:37.106903 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc6cc85-8409-4cbf-a7d0-945fb094b6ec None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:37.107445 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffa4091-c2fc-463d-99be-17a54525fa86 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:37.109622 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8ffa4091-c2fc-463d-99be-17a54525fa86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:26:37.127805 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc6cc85-8409-4cbf-a7d0-945fb094b6ec None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:37.196728 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8407061-9f47-4f32-b579-d6678a559539 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:37.197630 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8407061-9f47-4f32-b579-d6678a559539 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:37.198103 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8407061-9f47-4f32-b579-d6678a559539 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:37.198720 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8407061-9f47-4f32-b579-d6678a559539 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:37.202983 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e8407061-9f47-4f32-b579-d6678a559539 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:26:37.301727 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8407061-9f47-4f32-b579-d6678a559539 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:37.304102 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8407061-9f47-4f32-b579-d6678a559539 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:37.321983 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2259/4478] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:26:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:26:37.385160 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffa4091-c2fc-463d-99be-17a54525fa86 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:37.391576 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bc05e2-e0e8-4f24-abcc-0ea38484ceda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:37.392993 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc05e2-e0e8-4f24-abcc-0ea38484ceda admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:37.393281 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc05e2-e0e8-4f24-abcc-0ea38484ceda admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:37.393559 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc05e2-e0e8-4f24-abcc-0ea38484ceda admin admin] PATH_INFO: `/v3/projects/ef1f3155d52e42bb9c54f43a8360a74e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:37.394813 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bc05e2-e0e8-4f24-abcc-0ea38484ceda admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef1f3155d52e42bb9c54f43a8360a74e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:37.398037 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bc05e2-e0e8-4f24-abcc-0ea38484ceda admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:37.558206 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-89bc05e2-e0e8-4f24-abcc-0ea38484ceda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef1f3155d52e42bb9c54f43a8360a74e', 'request_id': 'req-89bc05e2-e0e8-4f24-abcc-0ea38484ceda'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:26:37.584178 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-89bc05e2-e0e8-4f24-abcc-0ea38484ceda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef1f3155d52e42bb9c54f43a8360a74e', 'request_id': 'req-89bc05e2-e0e8-4f24-abcc-0ea38484ceda'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:26:37.594988 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-89bc05e2-e0e8-4f24-abcc-0ea38484ceda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef1f3155d52e42bb9c54f43a8360a74e', 'request_id': 'req-89bc05e2-e0e8-4f24-abcc-0ea38484ceda'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:26:37.660667 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-89bc05e2-e0e8-4f24-abcc-0ea38484ceda admin admin] The token cache is being invalidate because project ef1f3155d52e42bb9c54f43a8360a74e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:26:37.661876 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-89bc05e2-e0e8-4f24-abcc-0ea38484ceda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:26:37.663159 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-89bc05e2-e0e8-4f24-abcc-0ea38484ceda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:26:37.665750 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2220/4479] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:26:37 2022] DELETE /identity/v3/projects/ef1f3155d52e42bb9c54f43a8360a74e => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:26:37.670791 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8e2bc-787d-4c91-9630-286429ae3d69 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:37.671088 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8e2bc-787d-4c91-9630-286429ae3d69 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:37.671369 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8e2bc-787d-4c91-9630-286429ae3d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:37.693782 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-72d8e2bc-787d-4c91-9630-286429ae3d69 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:26:37.695058 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-72d8e2bc-787d-4c91-9630-286429ae3d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:26:37.816194 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2260/4480] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:26:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:26:37.823710 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e1b57-a2aa-4c00-9ed9-90a5b8650d85 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:37.824130 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e1b57-a2aa-4c00-9ed9-90a5b8650d85 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:37.824548 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e1b57-a2aa-4c00-9ed9-90a5b8650d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:37.844256 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-c28e1b57-a2aa-4c00-9ed9-90a5b8650d85 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:26:37.845529 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c28e1b57-a2aa-4c00-9ed9-90a5b8650d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:26:37.854114 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2221/4481] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:26:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:26:37.858300 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d8e2bc-787d-4c91-9630-286429ae3d69 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:37.869511 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d8e2bc-787d-4c91-9630-286429ae3d69 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:37.877396 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e93128e-fb7e-45f3-99e0-67077cdd3f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:37.877985 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e93128e-fb7e-45f3-99e0-67077cdd3f7c admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:37.878281 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e93128e-fb7e-45f3-99e0-67077cdd3f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:37.878550 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e93128e-fb7e-45f3-99e0-67077cdd3f7c admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:37.879283 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e93128e-fb7e-45f3-99e0-67077cdd3f7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:26:37.879634 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e93128e-fb7e-45f3-99e0-67077cdd3f7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:37.883157 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e93128e-fb7e-45f3-99e0-67077cdd3f7c admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:37.913314 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28e1b57-a2aa-4c00-9ed9-90a5b8650d85 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:37.917246 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2261/4482] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:26:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:26:37.939402 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28e1b57-a2aa-4c00-9ed9-90a5b8650d85 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:37.944953 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4835c3b7-bf10-4b27-8190-056cb502cc88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:37.945620 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4835c3b7-bf10-4b27-8190-056cb502cc88 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:37.945899 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4835c3b7-bf10-4b27-8190-056cb502cc88 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:37.946173 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4835c3b7-bf10-4b27-8190-056cb502cc88 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:37.946861 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4835c3b7-bf10-4b27-8190-056cb502cc88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:37.948884 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4835c3b7-bf10-4b27-8190-056cb502cc88 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:38.066107 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2222/4483] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:26:37 2022] POST /identity/v3/projects => generated 379 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:26:38.067526 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e93128e-fb7e-45f3-99e0-67077cdd3f7c admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:38.079278 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e93128e-fb7e-45f3-99e0-67077cdd3f7c admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:38.149417 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01e06b4-5646-41b6-836c-63584b8c8844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:38.150172 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e06b4-5646-41b6-836c-63584b8c8844 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:38.150455 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e06b4-5646-41b6-836c-63584b8c8844 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:38.150738 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e06b4-5646-41b6-836c-63584b8c8844 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:38.151684 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01e06b4-5646-41b6-836c-63584b8c8844 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:38.153668 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01e06b4-5646-41b6-836c-63584b8c8844 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:38.250303 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2262/4484] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:26:38 2022] POST /identity/v3/users => generated 290 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:26:38.254320 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4835c3b7-bf10-4b27-8190-056cb502cc88 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:38.266747 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4835c3b7-bf10-4b27-8190-056cb502cc88 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:38.272968 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c0914-56e4-4613-b0a7-3ec2938cddcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:38.273658 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c0914-56e4-4613-b0a7-3ec2938cddcf admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:38.274127 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c0914-56e4-4613-b0a7-3ec2938cddcf admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:38.274593 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c0914-56e4-4613-b0a7-3ec2938cddcf admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:38.275339 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7c0914-56e4-4613-b0a7-3ec2938cddcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:38.277019 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7c0914-56e4-4613-b0a7-3ec2938cddcf admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:38.298291 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2223/4485] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:26:38 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:26:38.302392 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01e06b4-5646-41b6-836c-63584b8c8844 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:38.317024 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01e06b4-5646-41b6-836c-63584b8c8844 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:38.322982 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04a5b8a-b737-4899-95f9-8d1891d251f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:38.323703 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a5b8a-b737-4899-95f9-8d1891d251f6 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:38.323993 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a5b8a-b737-4899-95f9-8d1891d251f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:38.324281 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a5b8a-b737-4899-95f9-8d1891d251f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:38.325019 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04a5b8a-b737-4899-95f9-8d1891d251f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:38.326643 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04a5b8a-b737-4899-95f9-8d1891d251f6 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:38.340846 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2263/4486] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:26:38 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:26:38.345141 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c0914-56e4-4613-b0a7-3ec2938cddcf admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:38.356492 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c0914-56e4-4613-b0a7-3ec2938cddcf admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:38.374416 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff891d-acf9-4cd4-bb20-2b762b38584f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:38.375108 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff891d-acf9-4cd4-bb20-2b762b38584f admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:38.375577 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff891d-acf9-4cd4-bb20-2b762b38584f admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:38.375867 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff891d-acf9-4cd4-bb20-2b762b38584f admin admin] PATH_INFO: `/v3/projects/1df1ae61bf82472dadc4830840421a63/users/22a06bece449427d91289ade79c94822/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:38.398153 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faff891d-acf9-4cd4-bb20-2b762b38584f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1df1ae61bf82472dadc4830840421a63, user_id=22a06bece449427d91289ade79c94822, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:38.401540 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faff891d-acf9-4cd4-bb20-2b762b38584f admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:38.497575 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db3190-870a-4ca7-a276-18a962b918b8 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:38.498967 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db3190-870a-4ca7-a276-18a962b918b8 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:38.499783 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db3190-870a-4ca7-a276-18a962b918b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:38.503110 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2224/4487] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:26:38 2022] PUT /identity/v3/projects/1df1ae61bf82472dadc4830840421a63/users/22a06bece449427d91289ade79c94822/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:26:38.526774 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-d1db3190-870a-4ca7-a276-18a962b918b8 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:26:38.528254 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d1db3190-870a-4ca7-a276-18a962b918b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:26:38.611246 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2264/4488] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:26:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:26:38.627871 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff891d-acf9-4cd4-bb20-2b762b38584f admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:38.629626 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-faff891d-acf9-4cd4-bb20-2b762b38584f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:26:38.721015 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff891d-acf9-4cd4-bb20-2b762b38584f admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:38.729744 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c845d66a-0c28-42f3-81a9-2bf4f6fa5db6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:38.729744 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c845d66a-0c28-42f3-81a9-2bf4f6fa5db6 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:38.729744 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c845d66a-0c28-42f3-81a9-2bf4f6fa5db6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:38.729744 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c845d66a-0c28-42f3-81a9-2bf4f6fa5db6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:38.737316 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c845d66a-0c28-42f3-81a9-2bf4f6fa5db6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:38.738882 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c845d66a-0c28-42f3-81a9-2bf4f6fa5db6 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:38.753473 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2225/4489] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:26:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:26:39.080240 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db3190-870a-4ca7-a276-18a962b918b8 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:39.082012 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d1db3190-870a-4ca7-a276-18a962b918b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:26:39.098416 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db3190-870a-4ca7-a276-18a962b918b8 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:39.103560 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca99cd-67fd-4229-b56e-996a5dede85b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:39.104271 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca99cd-67fd-4229-b56e-996a5dede85b service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:39.104555 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca99cd-67fd-4229-b56e-996a5dede85b service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:39.105068 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca99cd-67fd-4229-b56e-996a5dede85b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:39.106673 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-deca99cd-67fd-4229-b56e-996a5dede85b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:26:39.188307 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deca99cd-67fd-4229-b56e-996a5dede85b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:39.189851 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deca99cd-67fd-4229-b56e-996a5dede85b service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:39.203405 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2265/4490] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:26:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:26:47.730775 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c340f9-2ada-485a-abf5-6b770700edd4 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:47.731310 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c340f9-2ada-485a-abf5-6b770700edd4 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:47.731310 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c340f9-2ada-485a-abf5-6b770700edd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:47.820592 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-44c340f9-2ada-485a-abf5-6b770700edd4 None None] MFA Rules not processed for user `22a06bece449427d91289ade79c94822`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:26:47.825443 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-44c340f9-2ada-485a-abf5-6b770700edd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:26:48.017002 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2226/4491] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:26:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:26:48.019419 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca99cd-67fd-4229-b56e-996a5dede85b service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:48.039315 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca99cd-67fd-4229-b56e-996a5dede85b service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:48.045847 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db392c-0b4b-4e74-a4c0-d17e8378a854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:48.045847 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db392c-0b4b-4e74-a4c0-d17e8378a854 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:48.046323 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db392c-0b4b-4e74-a4c0-d17e8378a854 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:48.046822 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db392c-0b4b-4e74-a4c0-d17e8378a854 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:48.047864 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48db392c-0b4b-4e74-a4c0-d17e8378a854 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:48.056502 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48db392c-0b4b-4e74-a4c0-d17e8378a854 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:48.184458 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2266/4492] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:26:48 2022] POST /identity/v3/projects => generated 379 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:26:48.187928 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c340f9-2ada-485a-abf5-6b770700edd4 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:48.202368 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c340f9-2ada-485a-abf5-6b770700edd4 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:48.259542 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0cb6fb-0745-4155-ba15-579ccccd830f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:48.260226 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0cb6fb-0745-4155-ba15-579ccccd830f admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:48.260511 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0cb6fb-0745-4155-ba15-579ccccd830f admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:48.260790 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0cb6fb-0745-4155-ba15-579ccccd830f admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:48.261491 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0cb6fb-0745-4155-ba15-579ccccd830f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:48.263739 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0cb6fb-0745-4155-ba15-579ccccd830f admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:48.383907 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2227/4493] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:26:48 2022] POST /identity/v3/users => generated 296 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:26:48.388103 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db392c-0b4b-4e74-a4c0-d17e8378a854 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:48.403374 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db392c-0b4b-4e74-a4c0-d17e8378a854 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:48.418491 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8172800d-abce-49ce-9da3-77b52a378f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:48.418491 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8172800d-abce-49ce-9da3-77b52a378f30 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:48.418491 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8172800d-abce-49ce-9da3-77b52a378f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:48.418491 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8172800d-abce-49ce-9da3-77b52a378f30 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:48.419550 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8172800d-abce-49ce-9da3-77b52a378f30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:48.421423 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8172800d-abce-49ce-9da3-77b52a378f30 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:48.438084 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2267/4494] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:26:48.439287 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0cb6fb-0745-4155-ba15-579ccccd830f admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:48.455115 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0cb6fb-0745-4155-ba15-579ccccd830f admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:48.464588 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae864e-cae3-4e69-96cd-41ea728fb825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:48.465969 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae864e-cae3-4e69-96cd-41ea728fb825 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:48.466317 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae864e-cae3-4e69-96cd-41ea728fb825 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:48.466673 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae864e-cae3-4e69-96cd-41ea728fb825 admin admin] PATH_INFO: `/v3/projects/8898bc5dedb1443a9e4f09d9866360a4/users/21104d85a5cc470a8faf69a3fd83a2d1/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:48.510576 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ae864e-cae3-4e69-96cd-41ea728fb825 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8898bc5dedb1443a9e4f09d9866360a4, user_id=21104d85a5cc470a8faf69a3fd83a2d1, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:48.514281 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ae864e-cae3-4e69-96cd-41ea728fb825 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:48.597827 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2228/4495] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:26:48 2022] PUT /identity/v3/projects/8898bc5dedb1443a9e4f09d9866360a4/users/21104d85a5cc470a8faf69a3fd83a2d1/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:26:48.602306 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8172800d-abce-49ce-9da3-77b52a378f30 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:48.618593 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8172800d-abce-49ce-9da3-77b52a378f30 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:48.702370 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359ffa0a-02a4-4a79-8ebc-304710e6b1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:48.703322 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ffa0a-02a4-4a79-8ebc-304710e6b1a0 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:48.703884 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ffa0a-02a4-4a79-8ebc-304710e6b1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:48.704412 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ffa0a-02a4-4a79-8ebc-304710e6b1a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:48.705789 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359ffa0a-02a4-4a79-8ebc-304710e6b1a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:48.707724 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359ffa0a-02a4-4a79-8ebc-304710e6b1a0 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:48.728634 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae864e-cae3-4e69-96cd-41ea728fb825 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:48.741040 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2268/4496] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:26:48.742533 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae864e-cae3-4e69-96cd-41ea728fb825 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:48.757347 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7080ecc0-afcb-4257-a683-8c33a33af95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:48.758628 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080ecc0-afcb-4257-a683-8c33a33af95d admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:48.759118 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080ecc0-afcb-4257-a683-8c33a33af95d admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:48.759746 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080ecc0-afcb-4257-a683-8c33a33af95d admin admin] PATH_INFO: `/v3/projects/8898bc5dedb1443a9e4f09d9866360a4/users/21104d85a5cc470a8faf69a3fd83a2d1/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:48.762133 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7080ecc0-afcb-4257-a683-8c33a33af95d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8898bc5dedb1443a9e4f09d9866360a4, user_id=21104d85a5cc470a8faf69a3fd83a2d1, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:48.765498 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7080ecc0-afcb-4257-a683-8c33a33af95d admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:48.786982 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2229/4497] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:26:48 2022] PUT /identity/v3/projects/8898bc5dedb1443a9e4f09d9866360a4/users/21104d85a5cc470a8faf69a3fd83a2d1/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:26:48.851655 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359ffa0a-02a4-4a79-8ebc-304710e6b1a0 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:48.854009 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-359ffa0a-02a4-4a79-8ebc-304710e6b1a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:26:48.889406 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359ffa0a-02a4-4a79-8ebc-304710e6b1a0 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:48.985142 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d004b7c5-ff17-4fb1-8094-183ea2848eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:48.987398 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d004b7c5-ff17-4fb1-8094-183ea2848eee admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:48.987710 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d004b7c5-ff17-4fb1-8094-183ea2848eee admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:48.987987 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d004b7c5-ff17-4fb1-8094-183ea2848eee admin admin] PATH_INFO: `/v3/users/e86200e4d1704c11b78acac21134f51f` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:49.007417 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d004b7c5-ff17-4fb1-8094-183ea2848eee admin admin] RBAC: Authorizing `identity:delete_user(user_id=e86200e4d1704c11b78acac21134f51f)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:49.012161 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d004b7c5-ff17-4fb1-8094-183ea2848eee admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:49.305484 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d004b7c5-ff17-4fb1-8094-183ea2848eee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e86200e4d1704c11b78acac21134f51f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:26:49.324525 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d004b7c5-ff17-4fb1-8094-183ea2848eee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e86200e4d1704c11b78acac21134f51f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:26:49.332773 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d004b7c5-ff17-4fb1-8094-183ea2848eee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e86200e4d1704c11b78acac21134f51f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:26:49.409402 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d004b7c5-ff17-4fb1-8094-183ea2848eee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e86200e4d1704c11b78acac21134f51f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:26:49.413001 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d004b7c5-ff17-4fb1-8094-183ea2848eee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e86200e4d1704c11b78acac21134f51f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:26:49.422893 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2269/4498] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:26:48 2022] DELETE /identity/v3/users/e86200e4d1704c11b78acac21134f51f => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:26:49.427404 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aec3bf-a1c8-48ab-b797-c9ce41d3ce2d None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:49.427777 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aec3bf-a1c8-48ab-b797-c9ce41d3ce2d None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:49.428235 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aec3bf-a1c8-48ab-b797-c9ce41d3ce2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:49.455867 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-81aec3bf-a1c8-48ab-b797-c9ce41d3ce2d None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:26:49.455867 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-81aec3bf-a1c8-48ab-b797-c9ce41d3ce2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:26:49.570511 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2230/4499] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:26:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:26:49.585590 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d004b7c5-ff17-4fb1-8094-183ea2848eee admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:49.596619 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d004b7c5-ff17-4fb1-8094-183ea2848eee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:26:49.656418 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d004b7c5-ff17-4fb1-8094-183ea2848eee admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:49.663918 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad32dbe-2c19-490f-b975-63e2af827dee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:49.664755 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad32dbe-2c19-490f-b975-63e2af827dee service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:49.664879 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad32dbe-2c19-490f-b975-63e2af827dee service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:49.665178 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad32dbe-2c19-490f-b975-63e2af827dee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:49.678799 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad32dbe-2c19-490f-b975-63e2af827dee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:49.681582 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad32dbe-2c19-490f-b975-63e2af827dee service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:49.695678 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2270/4500] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:26:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:26:50.326634 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aec3bf-a1c8-48ab-b797-c9ce41d3ce2d None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:50.328566 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-81aec3bf-a1c8-48ab-b797-c9ce41d3ce2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:26:50.357154 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aec3bf-a1c8-48ab-b797-c9ce41d3ce2d None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:50.375667 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6344b2-38ac-4511-a3af-f108b25c8163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:50.377455 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6344b2-38ac-4511-a3af-f108b25c8163 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:50.377618 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6344b2-38ac-4511-a3af-f108b25c8163 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:50.379227 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6344b2-38ac-4511-a3af-f108b25c8163 admin admin] PATH_INFO: `/v3/projects/a55ae9f506474c828bc69fff78a389e0` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:50.382067 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6344b2-38ac-4511-a3af-f108b25c8163 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a55ae9f506474c828bc69fff78a389e0)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:50.384853 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6344b2-38ac-4511-a3af-f108b25c8163 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:50.664961 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-fe6344b2-38ac-4511-a3af-f108b25c8163 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a55ae9f506474c828bc69fff78a389e0', 'request_id': 'req-fe6344b2-38ac-4511-a3af-f108b25c8163'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:26:50.686016 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-fe6344b2-38ac-4511-a3af-f108b25c8163 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a55ae9f506474c828bc69fff78a389e0', 'request_id': 'req-fe6344b2-38ac-4511-a3af-f108b25c8163'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:26:50.708743 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-fe6344b2-38ac-4511-a3af-f108b25c8163 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a55ae9f506474c828bc69fff78a389e0', 'request_id': 'req-fe6344b2-38ac-4511-a3af-f108b25c8163'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:26:50.820344 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-fe6344b2-38ac-4511-a3af-f108b25c8163 admin admin] The token cache is being invalidate because project a55ae9f506474c828bc69fff78a389e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:26:50.821263 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-fe6344b2-38ac-4511-a3af-f108b25c8163 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:26:50.822599 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-fe6344b2-38ac-4511-a3af-f108b25c8163 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:26:50.825421 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2231/4501] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:26:50 2022] DELETE /identity/v3/projects/a55ae9f506474c828bc69fff78a389e0 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:26:50.834432 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc2f3c-565a-4358-b7a1-55fbe0b272fe None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:50.835055 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc2f3c-565a-4358-b7a1-55fbe0b272fe None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:50.835298 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc2f3c-565a-4358-b7a1-55fbe0b272fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:50.905915 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-36cc2f3c-565a-4358-b7a1-55fbe0b272fe None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:26:50.910668 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-36cc2f3c-565a-4358-b7a1-55fbe0b272fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:26:51.021778 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2271/4502] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:26:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:26:51.030132 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a165338-275b-4565-bb4c-b145751dff7e None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:51.030433 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a165338-275b-4565-bb4c-b145751dff7e None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:51.030720 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a165338-275b-4565-bb4c-b145751dff7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:51.069339 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-5a165338-275b-4565-bb4c-b145751dff7e None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:26:51.070915 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-5a165338-275b-4565-bb4c-b145751dff7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:26:51.091578 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc2f3c-565a-4358-b7a1-55fbe0b272fe None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:51.092492 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2232/4503] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:26:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:26:51.103462 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc2f3c-565a-4358-b7a1-55fbe0b272fe None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:51.110400 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38e696c-1dee-4d1c-a23a-105b29a991c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:51.115505 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e696c-1dee-4d1c-a23a-105b29a991c7 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:51.116017 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e696c-1dee-4d1c-a23a-105b29a991c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:51.116581 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e696c-1dee-4d1c-a23a-105b29a991c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:51.117736 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38e696c-1dee-4d1c-a23a-105b29a991c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:26:51.118643 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38e696c-1dee-4d1c-a23a-105b29a991c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:51.122433 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38e696c-1dee-4d1c-a23a-105b29a991c7 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:51.142862 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2272/4504] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:26:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:26:51.148490 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a165338-275b-4565-bb4c-b145751dff7e None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:51.162008 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a165338-275b-4565-bb4c-b145751dff7e None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:51.168893 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc14601-f0a8-49ee-ac52-aae447cd6c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:51.169876 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc14601-f0a8-49ee-ac52-aae447cd6c0e admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:51.170940 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc14601-f0a8-49ee-ac52-aae447cd6c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:51.171400 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc14601-f0a8-49ee-ac52-aae447cd6c0e admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:51.172338 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc14601-f0a8-49ee-ac52-aae447cd6c0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:51.182795 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc14601-f0a8-49ee-ac52-aae447cd6c0e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:51.295040 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38e696c-1dee-4d1c-a23a-105b29a991c7 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:51.307988 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2233/4505] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:26:51 2022] POST /identity/v3/projects => generated 373 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:26:51.313926 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38e696c-1dee-4d1c-a23a-105b29a991c7 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:51.455902 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b401d1-0acf-4771-b234-3a90cffb043c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:51.456739 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b401d1-0acf-4771-b234-3a90cffb043c admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:51.457087 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b401d1-0acf-4771-b234-3a90cffb043c admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:51.457428 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b401d1-0acf-4771-b234-3a90cffb043c admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:51.458884 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b401d1-0acf-4771-b234-3a90cffb043c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:51.461037 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b401d1-0acf-4771-b234-3a90cffb043c admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:51.616751 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2273/4506] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:26:51 2022] POST /identity/v3/users => generated 287 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:26:51.622039 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc14601-f0a8-49ee-ac52-aae447cd6c0e admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:51.637612 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc14601-f0a8-49ee-ac52-aae447cd6c0e admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:51.641718 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f99b5b-4fa7-4a5d-b383-409f7c222a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:51.642657 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f99b5b-4fa7-4a5d-b383-409f7c222a64 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:51.643123 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f99b5b-4fa7-4a5d-b383-409f7c222a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:51.643745 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f99b5b-4fa7-4a5d-b383-409f7c222a64 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:51.644677 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f99b5b-4fa7-4a5d-b383-409f7c222a64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:51.646418 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f99b5b-4fa7-4a5d-b383-409f7c222a64 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:51.710129 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2234/4507] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:26:51 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:26:51.714406 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b401d1-0acf-4771-b234-3a90cffb043c admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:51.731998 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b401d1-0acf-4771-b234-3a90cffb043c admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:51.748674 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef644e2-a418-4011-98f3-f81705785af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:51.750131 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef644e2-a418-4011-98f3-f81705785af1 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:51.758298 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef644e2-a418-4011-98f3-f81705785af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:51.758298 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef644e2-a418-4011-98f3-f81705785af1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:51.759927 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef644e2-a418-4011-98f3-f81705785af1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:51.764668 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef644e2-a418-4011-98f3-f81705785af1 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:51.796002 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2274/4508] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:26:51 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:26:51.800038 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f99b5b-4fa7-4a5d-b383-409f7c222a64 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:51.815946 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f99b5b-4fa7-4a5d-b383-409f7c222a64 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:51.832527 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af90465-a326-47fa-8a1a-7b042775997a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:51.833976 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af90465-a326-47fa-8a1a-7b042775997a admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:51.834442 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af90465-a326-47fa-8a1a-7b042775997a admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:51.834881 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af90465-a326-47fa-8a1a-7b042775997a admin admin] PATH_INFO: `/v3/projects/7cfa60d7e6a54f3e9b1cd09e4d9daa06/users/9588a09647234c10838c81ba39d48fa7/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:51.887439 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af90465-a326-47fa-8a1a-7b042775997a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cfa60d7e6a54f3e9b1cd09e4d9daa06, user_id=9588a09647234c10838c81ba39d48fa7, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:51.892465 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af90465-a326-47fa-8a1a-7b042775997a admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:51.990508 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce13a9-f63a-4378-98f4-cc217407c696 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:51.993614 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce13a9-f63a-4378-98f4-cc217407c696 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:51.993614 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce13a9-f63a-4378-98f4-cc217407c696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:51.994506 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2235/4509] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:26:51 2022] PUT /identity/v3/projects/7cfa60d7e6a54f3e9b1cd09e4d9daa06/users/9588a09647234c10838c81ba39d48fa7/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:26:52.039786 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-cbce13a9-f63a-4378-98f4-cc217407c696 None None] MFA Rules not processed for user `9588a09647234c10838c81ba39d48fa7`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:26:52.042321 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-cbce13a9-f63a-4378-98f4-cc217407c696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:26:52.165496 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2275/4510] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:26:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:26:52.181208 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af90465-a326-47fa-8a1a-7b042775997a admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:52.184156 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-4af90465-a326-47fa-8a1a-7b042775997a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:26:52.279651 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af90465-a326-47fa-8a1a-7b042775997a admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:52.284266 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c18b617-0adf-4de7-8f73-21508e640723 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198271d1c0d44cb58bace41a65f4b94c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:52.285259 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18b617-0adf-4de7-8f73-21508e640723 service cinder] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:52.285709 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18b617-0adf-4de7-8f73-21508e640723 service cinder] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:52.286733 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18b617-0adf-4de7-8f73-21508e640723 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:52.302908 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c18b617-0adf-4de7-8f73-21508e640723 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:52.307918 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c18b617-0adf-4de7-8f73-21508e640723 service cinder] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:52.335786 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2236/4511] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:26:52 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:26:52.359124 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce13a9-f63a-4378-98f4-cc217407c696 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:52.453739 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce13a9-f63a-4378-98f4-cc217407c696 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:52.460269 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c899deaa-b239-426c-a655-4d0d9902d3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:52.461592 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899deaa-b239-426c-a655-4d0d9902d3fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:52.462069 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899deaa-b239-426c-a655-4d0d9902d3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:52.462502 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899deaa-b239-426c-a655-4d0d9902d3fe admin admin] PATH_INFO: `/v3/users/9588a09647234c10838c81ba39d48fa7` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:52.463901 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c899deaa-b239-426c-a655-4d0d9902d3fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=9588a09647234c10838c81ba39d48fa7)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:52.467031 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c899deaa-b239-426c-a655-4d0d9902d3fe admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:52.794326 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c899deaa-b239-426c-a655-4d0d9902d3fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9588a09647234c10838c81ba39d48fa7'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:26:52.823097 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c899deaa-b239-426c-a655-4d0d9902d3fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9588a09647234c10838c81ba39d48fa7'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:26:52.865101 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c899deaa-b239-426c-a655-4d0d9902d3fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9588a09647234c10838c81ba39d48fa7'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:26:52.970167 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c899deaa-b239-426c-a655-4d0d9902d3fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9588a09647234c10838c81ba39d48fa7'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:26:52.970167 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c899deaa-b239-426c-a655-4d0d9902d3fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9588a09647234c10838c81ba39d48fa7'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:26:52.994271 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2276/4512] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:26:52 2022] DELETE /identity/v3/users/9588a09647234c10838c81ba39d48fa7 => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:26:52.996709 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2972f3c4-2f70-4201-917f-baa62a40b60a None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:52.997129 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2972f3c4-2f70-4201-917f-baa62a40b60a None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:52.997249 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2972f3c4-2f70-4201-917f-baa62a40b60a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:53.052309 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-2972f3c4-2f70-4201-917f-baa62a40b60a None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:26:53.052309 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-2972f3c4-2f70-4201-917f-baa62a40b60a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:26:53.125765 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2237/4513] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:26:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:26:53.137228 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c899deaa-b239-426c-a655-4d0d9902d3fe admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:53.139080 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c899deaa-b239-426c-a655-4d0d9902d3fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:26:53.217254 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c899deaa-b239-426c-a655-4d0d9902d3fe admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:53.222041 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778cdb4d-d38d-4cf8-9d75-d278023cb14d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:53.222975 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778cdb4d-d38d-4cf8-9d75-d278023cb14d service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:53.224594 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778cdb4d-d38d-4cf8-9d75-d278023cb14d service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:53.224594 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778cdb4d-d38d-4cf8-9d75-d278023cb14d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:53.234749 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778cdb4d-d38d-4cf8-9d75-d278023cb14d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:53.236342 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778cdb4d-d38d-4cf8-9d75-d278023cb14d service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:53.248274 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2277/4514] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:26:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:26:54.079056 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2972f3c4-2f70-4201-917f-baa62a40b60a None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:54.081080 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-2972f3c4-2f70-4201-917f-baa62a40b60a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:26:54.107593 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2972f3c4-2f70-4201-917f-baa62a40b60a None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:54.113476 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc224df-d471-4e4d-8679-f67ca9d7ff24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:54.115902 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc224df-d471-4e4d-8679-f67ca9d7ff24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:54.117775 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc224df-d471-4e4d-8679-f67ca9d7ff24 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:54.118286 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc224df-d471-4e4d-8679-f67ca9d7ff24 admin admin] PATH_INFO: `/v3/users/87538f2309714545bd47f228b6505883` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:54.119849 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc224df-d471-4e4d-8679-f67ca9d7ff24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87538f2309714545bd47f228b6505883)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:54.123822 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc224df-d471-4e4d-8679-f67ca9d7ff24 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:54.160860 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778cdb4d-d38d-4cf8-9d75-d278023cb14d service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:54.163932 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-778cdb4d-d38d-4cf8-9d75-d278023cb14d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:26:54.194634 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778cdb4d-d38d-4cf8-9d75-d278023cb14d service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:54.203209 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a906a6a2-44f5-4eef-b0b9-32510afa764b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:54.205259 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a906a6a2-44f5-4eef-b0b9-32510afa764b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:54.209413 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a906a6a2-44f5-4eef-b0b9-32510afa764b admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:54.209818 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a906a6a2-44f5-4eef-b0b9-32510afa764b admin admin] PATH_INFO: `/v3/projects/7cfa60d7e6a54f3e9b1cd09e4d9daa06` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:54.211438 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a906a6a2-44f5-4eef-b0b9-32510afa764b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cfa60d7e6a54f3e9b1cd09e4d9daa06)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:54.216171 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a906a6a2-44f5-4eef-b0b9-32510afa764b admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:54.401447 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dcc224df-d471-4e4d-8679-f67ca9d7ff24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87538f2309714545bd47f228b6505883'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:26:54.404350 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a906a6a2-44f5-4eef-b0b9-32510afa764b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cfa60d7e6a54f3e9b1cd09e4d9daa06', 'request_id': 'req-a906a6a2-44f5-4eef-b0b9-32510afa764b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:26:54.409907 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dcc224df-d471-4e4d-8679-f67ca9d7ff24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87538f2309714545bd47f228b6505883'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:26:54.410258 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a906a6a2-44f5-4eef-b0b9-32510afa764b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cfa60d7e6a54f3e9b1cd09e4d9daa06', 'request_id': 'req-a906a6a2-44f5-4eef-b0b9-32510afa764b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:26:54.410778 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dcc224df-d471-4e4d-8679-f67ca9d7ff24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87538f2309714545bd47f228b6505883'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:26:54.501003 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a906a6a2-44f5-4eef-b0b9-32510afa764b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cfa60d7e6a54f3e9b1cd09e4d9daa06', 'request_id': 'req-a906a6a2-44f5-4eef-b0b9-32510afa764b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:26:54.515160 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a906a6a2-44f5-4eef-b0b9-32510afa764b admin admin] The token cache is being invalidate because project 7cfa60d7e6a54f3e9b1cd09e4d9daa06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:26:54.515538 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a906a6a2-44f5-4eef-b0b9-32510afa764b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:26:54.516147 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a906a6a2-44f5-4eef-b0b9-32510afa764b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:26:54.518079 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2278/4515] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:26:54 2022] DELETE /identity/v3/projects/7cfa60d7e6a54f3e9b1cd09e4d9daa06 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:26:54.523391 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74de124-80fb-4bda-9e0c-01a3f65d3394 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:54.524149 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74de124-80fb-4bda-9e0c-01a3f65d3394 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:54.524451 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74de124-80fb-4bda-9e0c-01a3f65d3394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:54.554258 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-e74de124-80fb-4bda-9e0c-01a3f65d3394 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:26:54.555119 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e74de124-80fb-4bda-9e0c-01a3f65d3394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:26:54.585162 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dcc224df-d471-4e4d-8679-f67ca9d7ff24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87538f2309714545bd47f228b6505883'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:26:54.604704 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dcc224df-d471-4e4d-8679-f67ca9d7ff24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87538f2309714545bd47f228b6505883'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:26:54.618728 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2238/4516] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:26:54 2022] DELETE /identity/v3/users/87538f2309714545bd47f228b6505883 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:26:54.636342 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2279/4517] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:26:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:26:54.644984 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392dc77-eb55-4275-8398-f922cda7472e None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:54.648110 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392dc77-eb55-4275-8398-f922cda7472e None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:54.648110 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392dc77-eb55-4275-8398-f922cda7472e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:54.666438 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-5392dc77-eb55-4275-8398-f922cda7472e None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:26:54.669165 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-5392dc77-eb55-4275-8398-f922cda7472e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:26:54.751753 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2239/4518] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:26:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:26:54.752433 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74de124-80fb-4bda-9e0c-01a3f65d3394 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:54.764286 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74de124-80fb-4bda-9e0c-01a3f65d3394 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:54.769578 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e281b1ee-3853-48df-b6f6-03e72ee45735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:54.770576 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e281b1ee-3853-48df-b6f6-03e72ee45735 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:54.770827 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e281b1ee-3853-48df-b6f6-03e72ee45735 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:54.771110 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e281b1ee-3853-48df-b6f6-03e72ee45735 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:54.772263 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e281b1ee-3853-48df-b6f6-03e72ee45735 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:26:54.772650 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e281b1ee-3853-48df-b6f6-03e72ee45735 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:54.774433 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e281b1ee-3853-48df-b6f6-03e72ee45735 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:54.794163 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2280/4519] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:26:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:26:54.794740 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5392dc77-eb55-4275-8398-f922cda7472e None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:54.806665 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5392dc77-eb55-4275-8398-f922cda7472e None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:54.811814 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2b2d8c-2399-492e-a368-e1f23cba55fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:54.812476 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b2d8c-2399-492e-a368-e1f23cba55fb admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:54.812907 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b2d8c-2399-492e-a368-e1f23cba55fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:54.813064 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b2d8c-2399-492e-a368-e1f23cba55fb admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:54.813770 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2b2d8c-2399-492e-a368-e1f23cba55fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:54.815684 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2b2d8c-2399-492e-a368-e1f23cba55fb admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:54.915764 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2240/4520] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:26:54 2022] POST /identity/v3/projects => generated 385 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:26:54.919993 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e281b1ee-3853-48df-b6f6-03e72ee45735 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:54.933758 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e281b1ee-3853-48df-b6f6-03e72ee45735 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:54.996971 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ab86ec-c1aa-449f-98b3-6d2aa5a881a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:54.997665 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab86ec-c1aa-449f-98b3-6d2aa5a881a0 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:54.997956 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab86ec-c1aa-449f-98b3-6d2aa5a881a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:54.998244 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab86ec-c1aa-449f-98b3-6d2aa5a881a0 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:54.998934 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ab86ec-c1aa-449f-98b3-6d2aa5a881a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:55.000910 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ab86ec-c1aa-449f-98b3-6d2aa5a881a0 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:55.124428 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2281/4521] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:26:54 2022] POST /identity/v3/users => generated 293 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:26:55.128439 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2b2d8c-2399-492e-a368-e1f23cba55fb admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:55.140694 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2b2d8c-2399-492e-a368-e1f23cba55fb admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:55.146196 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579972b7-1480-4af8-b0f5-159e185ec310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:55.147260 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579972b7-1480-4af8-b0f5-159e185ec310 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:55.147260 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579972b7-1480-4af8-b0f5-159e185ec310 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:55.147529 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579972b7-1480-4af8-b0f5-159e185ec310 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:55.148291 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579972b7-1480-4af8-b0f5-159e185ec310 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:55.149951 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579972b7-1480-4af8-b0f5-159e185ec310 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:55.162227 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2241/4522] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:26:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:26:55.166445 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ab86ec-c1aa-449f-98b3-6d2aa5a881a0 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:55.178097 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ab86ec-c1aa-449f-98b3-6d2aa5a881a0 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:55.183898 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5959564-22ec-40c9-b065-1b72b89dc390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:55.184592 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5959564-22ec-40c9-b065-1b72b89dc390 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:55.184878 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5959564-22ec-40c9-b065-1b72b89dc390 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:55.185160 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5959564-22ec-40c9-b065-1b72b89dc390 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:55.185910 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5959564-22ec-40c9-b065-1b72b89dc390 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:55.187587 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5959564-22ec-40c9-b065-1b72b89dc390 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:55.200497 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2282/4523] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:26:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:26:55.204915 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579972b7-1480-4af8-b0f5-159e185ec310 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:55.222316 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579972b7-1480-4af8-b0f5-159e185ec310 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:55.229780 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c93972f-23a3-4550-8f54-112de449f98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:55.230851 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93972f-23a3-4550-8f54-112de449f98d admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:55.231170 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93972f-23a3-4550-8f54-112de449f98d admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:55.232154 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93972f-23a3-4550-8f54-112de449f98d admin admin] PATH_INFO: `/v3/projects/8bf1c9f99ca0403f9b22031eb90ffe8f/users/1382428c1e50441794230e9abc5f2d39/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:55.252924 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c93972f-23a3-4550-8f54-112de449f98d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bf1c9f99ca0403f9b22031eb90ffe8f, user_id=1382428c1e50441794230e9abc5f2d39, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:55.256629 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c93972f-23a3-4550-8f54-112de449f98d admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:55.309712 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2242/4524] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:26:55 2022] PUT /identity/v3/projects/8bf1c9f99ca0403f9b22031eb90ffe8f/users/1382428c1e50441794230e9abc5f2d39/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:26:55.321804 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e67d6-4558-463f-8a41-9947f7541af8 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:55.322344 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e67d6-4558-463f-8a41-9947f7541af8 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:55.322730 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e67d6-4558-463f-8a41-9947f7541af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:55.397333 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-2f1e67d6-4558-463f-8a41-9947f7541af8 None None] MFA Rules not processed for user `1382428c1e50441794230e9abc5f2d39`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:26:55.398465 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c93972f-23a3-4550-8f54-112de449f98d admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:55.398603 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-2f1e67d6-4558-463f-8a41-9947f7541af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:26:55.402404 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8c93972f-23a3-4550-8f54-112de449f98d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:26:55.477406 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2283/4525] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:26:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:26:55.482254 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1e67d6-4558-463f-8a41-9947f7541af8 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:55.500560 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c93972f-23a3-4550-8f54-112de449f98d admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:55.517510 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0caad8-fb02-4c13-be45-8f8582d0f0cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:55.522864 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0caad8-fb02-4c13-be45-8f8582d0f0cc service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:55.522864 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0caad8-fb02-4c13-be45-8f8582d0f0cc service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:55.522864 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0caad8-fb02-4c13-be45-8f8582d0f0cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:55.522864 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-ef0caad8-fb02-4c13-be45-8f8582d0f0cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:26:55.544363 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0caad8-fb02-4c13-be45-8f8582d0f0cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:55.546874 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0caad8-fb02-4c13-be45-8f8582d0f0cc service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:55.569649 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2243/4526] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:26:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:26:55.571655 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b7938-9bf5-49ce-9b3e-05753c503aeb None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:55.572168 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b7938-9bf5-49ce-9b3e-05753c503aeb None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:55.573189 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b7938-9bf5-49ce-9b3e-05753c503aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:55.602574 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-199b7938-9bf5-49ce-9b3e-05753c503aeb None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:26:55.605555 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-199b7938-9bf5-49ce-9b3e-05753c503aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:26:55.622533 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1e67d6-4558-463f-8a41-9947f7541af8 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:55.658037 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2fcbdf-009d-4448-9380-7c136cb60f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:55.660135 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2fcbdf-009d-4448-9380-7c136cb60f2d admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:55.660659 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2fcbdf-009d-4448-9380-7c136cb60f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:55.670382 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2fcbdf-009d-4448-9380-7c136cb60f2d admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:55.670382 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2fcbdf-009d-4448-9380-7c136cb60f2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:55.670382 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2fcbdf-009d-4448-9380-7c136cb60f2d admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:55.719632 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2244/4527] 10.222.0.52 () {58 vars in 1009 bytes} [Sat May 14 21:26:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:26:55.723770 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b7938-9bf5-49ce-9b3e-05753c503aeb None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:55.728672 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-199b7938-9bf5-49ce-9b3e-05753c503aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:26:55.748108 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b7938-9bf5-49ce-9b3e-05753c503aeb None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:55.753651 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68fe826-c0e9-44e4-bba9-b0594c7df38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:55.755271 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68fe826-c0e9-44e4-bba9-b0594c7df38c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:55.755772 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68fe826-c0e9-44e4-bba9-b0594c7df38c admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:55.756124 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68fe826-c0e9-44e4-bba9-b0594c7df38c admin admin] PATH_INFO: `/v3/projects/fe513cd0819f40d7866ce2aaa1b8ea8d` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:55.757760 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68fe826-c0e9-44e4-bba9-b0594c7df38c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe513cd0819f40d7866ce2aaa1b8ea8d)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:55.761897 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68fe826-c0e9-44e4-bba9-b0594c7df38c admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:55.804120 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2284/4528] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:26:55 2022] POST /identity/v3/projects => generated 383 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:26:55.804120 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2fcbdf-009d-4448-9380-7c136cb60f2d admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:55.806796 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ae2fcbdf-009d-4448-9380-7c136cb60f2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:26:55.921135 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2fcbdf-009d-4448-9380-7c136cb60f2d admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:55.936359 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e7f75-eb54-4f16-9d31-7e00ddd182d2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:55.937039 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e7f75-eb54-4f16-9d31-7e00ddd182d2 service swift] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:55.937326 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e7f75-eb54-4f16-9d31-7e00ddd182d2 service swift] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:55.937609 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e7f75-eb54-4f16-9d31-7e00ddd182d2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:55.969523 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c68fe826-c0e9-44e4-bba9-b0594c7df38c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'request_id': 'req-c68fe826-c0e9-44e4-bba9-b0594c7df38c'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:26:55.986961 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c68fe826-c0e9-44e4-bba9-b0594c7df38c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'request_id': 'req-c68fe826-c0e9-44e4-bba9-b0594c7df38c'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:26:56.001681 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c68fe826-c0e9-44e4-bba9-b0594c7df38c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'request_id': 'req-c68fe826-c0e9-44e4-bba9-b0594c7df38c'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:26:56.061286 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1e7f75-eb54-4f16-9d31-7e00ddd182d2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:56.063468 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1e7f75-eb54-4f16-9d31-7e00ddd182d2 service swift] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:56.085119 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2285/4529] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 21:26:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 21:26:56.088438 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e7f75-eb54-4f16-9d31-7e00ddd182d2 service swift] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:56.140093 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c68fe826-c0e9-44e4-bba9-b0594c7df38c admin admin] The token cache is being invalidate because project fe513cd0819f40d7866ce2aaa1b8ea8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:26:56.140637 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c68fe826-c0e9-44e4-bba9-b0594c7df38c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:26:56.141536 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c68fe826-c0e9-44e4-bba9-b0594c7df38c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:26:56.143358 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2245/4530] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:26:55 2022] DELETE /identity/v3/projects/fe513cd0819f40d7866ce2aaa1b8ea8d => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:26:56.149215 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39793f-2743-4f5d-8cdf-014a7652dc69 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:56.151383 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39793f-2743-4f5d-8cdf-014a7652dc69 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:56.151383 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39793f-2743-4f5d-8cdf-014a7652dc69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:56.190525 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-2f39793f-2743-4f5d-8cdf-014a7652dc69 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:26:56.194574 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-2f39793f-2743-4f5d-8cdf-014a7652dc69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:26:56.260108 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e7f75-eb54-4f16-9d31-7e00ddd182d2 service swift] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:56.398945 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab3e10-b40a-4bd7-8b35-58b569608b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:56.399892 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab3e10-b40a-4bd7-8b35-58b569608b67 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:56.400338 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab3e10-b40a-4bd7-8b35-58b569608b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:56.400845 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab3e10-b40a-4bd7-8b35-58b569608b67 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:56.401573 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ab3e10-b40a-4bd7-8b35-58b569608b67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:56.406049 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ab3e10-b40a-4bd7-8b35-58b569608b67 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:56.440427 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2246/4531] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:26:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:26:56.449379 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec94671-6fc9-41c8-9e0b-553e3d2e4015 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:56.449682 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec94671-6fc9-41c8-9e0b-553e3d2e4015 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:56.449957 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec94671-6fc9-41c8-9e0b-553e3d2e4015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:56.518608 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-dec94671-6fc9-41c8-9e0b-553e3d2e4015 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:26:56.521407 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2286/4532] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:26:56 2022] POST /identity/v3/users => generated 292 bytes in 434 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:26:56.522073 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-dec94671-6fc9-41c8-9e0b-553e3d2e4015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:26:56.528977 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab3e10-b40a-4bd7-8b35-58b569608b67 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:56.533427 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-30ab3e10-b40a-4bd7-8b35-58b569608b67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:26:56.541248 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2247/4533] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:26:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:26:56.545635 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec94671-6fc9-41c8-9e0b-553e3d2e4015 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:56.561834 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab3e10-b40a-4bd7-8b35-58b569608b67 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:56.565262 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec94671-6fc9-41c8-9e0b-553e3d2e4015 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:56.578840 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db55ae8-b352-45b1-b7b6-8347322d40f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:56.579444 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db55ae8-b352-45b1-b7b6-8347322d40f1 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:56.579760 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db55ae8-b352-45b1-b7b6-8347322d40f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:56.580039 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db55ae8-b352-45b1-b7b6-8347322d40f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:56.580664 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c0f14e-79b0-4718-b8a1-88cda107862b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:56.580861 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db55ae8-b352-45b1-b7b6-8347322d40f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:26:56.581065 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db55ae8-b352-45b1-b7b6-8347322d40f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:56.581332 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c0f14e-79b0-4718-b8a1-88cda107862b admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:56.581613 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c0f14e-79b0-4718-b8a1-88cda107862b admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:56.581888 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c0f14e-79b0-4718-b8a1-88cda107862b admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:56.582651 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c0f14e-79b0-4718-b8a1-88cda107862b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:56.583316 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db55ae8-b352-45b1-b7b6-8347322d40f1 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:56.586821 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c0f14e-79b0-4718-b8a1-88cda107862b admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:56.627890 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2287/4534] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:26:56 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:26:56.641972 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c0f14e-79b0-4718-b8a1-88cda107862b admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:56.646229 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2248/4535] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:26:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:26:56.650274 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db55ae8-b352-45b1-b7b6-8347322d40f1 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:56.656770 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c0f14e-79b0-4718-b8a1-88cda107862b admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:56.669685 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f086686a-88f9-4b0d-9a5e-040b2be74814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:56.670414 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086686a-88f9-4b0d-9a5e-040b2be74814 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:56.670695 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086686a-88f9-4b0d-9a5e-040b2be74814 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:56.671016 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086686a-88f9-4b0d-9a5e-040b2be74814 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:56.671776 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f086686a-88f9-4b0d-9a5e-040b2be74814 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:56.673398 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f086686a-88f9-4b0d-9a5e-040b2be74814 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:56.682824 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db55ae8-b352-45b1-b7b6-8347322d40f1 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:56.700912 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dddcd8-e7a6-4a33-b0ac-299fb6242036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:56.701667 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dddcd8-e7a6-4a33-b0ac-299fb6242036 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:56.701928 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dddcd8-e7a6-4a33-b0ac-299fb6242036 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:56.702204 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dddcd8-e7a6-4a33-b0ac-299fb6242036 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:56.705743 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dddcd8-e7a6-4a33-b0ac-299fb6242036 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:56.706180 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2288/4536] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:26:56 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:26:56.711090 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f086686a-88f9-4b0d-9a5e-040b2be74814 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:56.711585 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dddcd8-e7a6-4a33-b0ac-299fb6242036 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:56.741667 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f086686a-88f9-4b0d-9a5e-040b2be74814 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:56.755083 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a1a17e-4c4a-4f98-9b04-a24cbf539a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:56.757601 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a1a17e-4c4a-4f98-9b04-a24cbf539a85 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:56.757746 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a1a17e-4c4a-4f98-9b04-a24cbf539a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:56.762280 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a1a17e-4c4a-4f98-9b04-a24cbf539a85 admin admin] PATH_INFO: `/v3/projects/f9af314372304f59bb4feeed38d832c0/users/73221847bd2941a18e2759995375417f/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:56.783937 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a1a17e-4c4a-4f98-9b04-a24cbf539a85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9af314372304f59bb4feeed38d832c0, user_id=73221847bd2941a18e2759995375417f, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:56.789077 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a1a17e-4c4a-4f98-9b04-a24cbf539a85 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:56.857598 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2249/4537] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:26:56 2022] POST /identity/v3/projects => generated 365 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:26:56.862189 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dddcd8-e7a6-4a33-b0ac-299fb6242036 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:56.911741 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2289/4538] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:26:56 2022] PUT /identity/v3/projects/f9af314372304f59bb4feeed38d832c0/users/73221847bd2941a18e2759995375417f/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:26:56.922145 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72141b4-4a04-4f5d-9be6-80f26e06b676 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:56.922644 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72141b4-4a04-4f5d-9be6-80f26e06b676 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:56.922775 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72141b4-4a04-4f5d-9be6-80f26e06b676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:56.952685 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dddcd8-e7a6-4a33-b0ac-299fb6242036 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:57.054435 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-b72141b4-4a04-4f5d-9be6-80f26e06b676 None None] MFA Rules not processed for user `73221847bd2941a18e2759995375417f`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:26:57.057906 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d82df4-ebc3-4812-929f-16df455f8afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:57.058603 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d82df4-ebc3-4812-929f-16df455f8afe admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:57.058951 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d82df4-ebc3-4812-929f-16df455f8afe admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:57.059254 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d82df4-ebc3-4812-929f-16df455f8afe admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:57.060165 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d82df4-ebc3-4812-929f-16df455f8afe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:57.060710 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b72141b4-4a04-4f5d-9be6-80f26e06b676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:26:57.066090 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d82df4-ebc3-4812-929f-16df455f8afe admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:57.160374 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2250/4539] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:26:56 2022] POST /identity/v3/users => generated 283 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:26:57.164616 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d82df4-ebc3-4812-929f-16df455f8afe admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:57.180579 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d82df4-ebc3-4812-929f-16df455f8afe admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:57.199157 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db529452-0d1b-4b23-94d5-e67c6bb126a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:57.199357 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2290/4540] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:26:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:26:57.199463 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db529452-0d1b-4b23-94d5-e67c6bb126a2 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:57.199463 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db529452-0d1b-4b23-94d5-e67c6bb126a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:57.199463 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db529452-0d1b-4b23-94d5-e67c6bb126a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:57.199463 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db529452-0d1b-4b23-94d5-e67c6bb126a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:57.200845 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72141b4-4a04-4f5d-9be6-80f26e06b676 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:57.204804 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db529452-0d1b-4b23-94d5-e67c6bb126a2 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:57.217661 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72141b4-4a04-4f5d-9be6-80f26e06b676 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:57.225864 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2251/4541] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:26:57 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:26:57.226980 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db529452-0d1b-4b23-94d5-e67c6bb126a2 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:57.236854 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e525d-7b89-4308-af84-035d0b24747d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:57.237106 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e525d-7b89-4308-af84-035d0b24747d admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:57.237563 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e525d-7b89-4308-af84-035d0b24747d admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:57.237963 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e525d-7b89-4308-af84-035d0b24747d admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:57.238654 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db529452-0d1b-4b23-94d5-e67c6bb126a2 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:57.238812 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63e525d-7b89-4308-af84-035d0b24747d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:57.246630 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63e525d-7b89-4308-af84-035d0b24747d admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:57.252124 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d2572a-2a8a-476e-8546-d16d6fece0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:57.253982 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d2572a-2a8a-476e-8546-d16d6fece0d2 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:57.254281 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d2572a-2a8a-476e-8546-d16d6fece0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:57.254598 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d2572a-2a8a-476e-8546-d16d6fece0d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:57.257819 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d2572a-2a8a-476e-8546-d16d6fece0d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:57.263175 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d2572a-2a8a-476e-8546-d16d6fece0d2 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:57.289959 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2252/4542] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:26:57 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:26:57.290946 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d2572a-2a8a-476e-8546-d16d6fece0d2 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:57.303993 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d2572a-2a8a-476e-8546-d16d6fece0d2 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:57.314466 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df791c75-509a-4799-a9c0-77bb70a8cd83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:57.315874 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df791c75-509a-4799-a9c0-77bb70a8cd83 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:57.316207 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df791c75-509a-4799-a9c0-77bb70a8cd83 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:57.323055 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df791c75-509a-4799-a9c0-77bb70a8cd83 admin admin] PATH_INFO: `/v3/projects/2e178a6743a947c0810f64d90d260ebd/users/cd41bd6980b8449aae43239ff1ef8557/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:57.356971 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2291/4543] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:26:57 2022] POST /identity/v3/projects => generated 383 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:26:57.358541 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e525d-7b89-4308-af84-035d0b24747d admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:57.360240 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df791c75-509a-4799-a9c0-77bb70a8cd83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e178a6743a947c0810f64d90d260ebd, user_id=cd41bd6980b8449aae43239ff1ef8557, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:57.367528 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df791c75-509a-4799-a9c0-77bb70a8cd83 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:57.474971 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2253/4544] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:26:57 2022] PUT /identity/v3/projects/2e178a6743a947c0810f64d90d260ebd/users/cd41bd6980b8449aae43239ff1ef8557/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:26:57.476936 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d5fa9-1f94-4cac-bf73-f3000d91ecf1 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:57.477235 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d5fa9-1f94-4cac-bf73-f3000d91ecf1 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:57.477515 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d5fa9-1f94-4cac-bf73-f3000d91ecf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:57.486337 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e525d-7b89-4308-af84-035d0b24747d admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:57.545526 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-937d5fa9-1f94-4cac-bf73-f3000d91ecf1 None None] MFA Rules not processed for user `cd41bd6980b8449aae43239ff1ef8557`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:26:57.546353 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-937d5fa9-1f94-4cac-bf73-f3000d91ecf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:26:57.626031 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a79aa8-14d6-4086-a0ff-b4fcccd90d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:57.626727 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a79aa8-14d6-4086-a0ff-b4fcccd90d38 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:57.627014 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a79aa8-14d6-4086-a0ff-b4fcccd90d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:57.627413 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a79aa8-14d6-4086-a0ff-b4fcccd90d38 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:57.628191 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a79aa8-14d6-4086-a0ff-b4fcccd90d38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:57.634723 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a79aa8-14d6-4086-a0ff-b4fcccd90d38 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:57.705862 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2254/4545] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:26:57 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:26:57.731132 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937d5fa9-1f94-4cac-bf73-f3000d91ecf1 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:57.732688 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-937d5fa9-1f94-4cac-bf73-f3000d91ecf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:26:57.757916 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2292/4546] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:26:57 2022] POST /identity/v3/users => generated 298 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:26:57.764099 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a79aa8-14d6-4086-a0ff-b4fcccd90d38 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:57.820970 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a79aa8-14d6-4086-a0ff-b4fcccd90d38 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:57.828704 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18e875-5d12-46a7-bba0-ce40e9801a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:57.829813 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18e875-5d12-46a7-bba0-ce40e9801a98 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:57.830291 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18e875-5d12-46a7-bba0-ce40e9801a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:57.830741 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18e875-5d12-46a7-bba0-ce40e9801a98 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:57.831746 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf18e875-5d12-46a7-bba0-ce40e9801a98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:57.834609 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf18e875-5d12-46a7-bba0-ce40e9801a98 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:57.846405 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2293/4547] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:26:57 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:26:57.851758 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18e875-5d12-46a7-bba0-ce40e9801a98 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:57.862551 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18e875-5d12-46a7-bba0-ce40e9801a98 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:57.870734 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0049b0f2-9a92-4c96-aeb2-a6a90c2da9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:57.872095 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0049b0f2-9a92-4c96-aeb2-a6a90c2da9b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:57.872542 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0049b0f2-9a92-4c96-aeb2-a6a90c2da9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:57.873252 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0049b0f2-9a92-4c96-aeb2-a6a90c2da9b9 admin admin] PATH_INFO: `/v3/projects/402205919cca433186bd6c32bdbe970b/users/cbbc9ad2fa3545b6b8c6245afb39ad89/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:57.899498 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937d5fa9-1f94-4cac-bf73-f3000d91ecf1 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:57.902068 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0049b0f2-9a92-4c96-aeb2-a6a90c2da9b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=402205919cca433186bd6c32bdbe970b, user_id=cbbc9ad2fa3545b6b8c6245afb39ad89, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:57.906373 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0049b0f2-9a92-4c96-aeb2-a6a90c2da9b9 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:57.923795 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a66c3d-e93a-495c-85e9-65c583d2e3cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:57.932096 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a66c3d-e93a-495c-85e9-65c583d2e3cc service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:57.932516 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a66c3d-e93a-495c-85e9-65c583d2e3cc service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:57.938165 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a66c3d-e93a-495c-85e9-65c583d2e3cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:57.950966 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a66c3d-e93a-495c-85e9-65c583d2e3cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:57.952962 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a66c3d-e93a-495c-85e9-65c583d2e3cc service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:57.968425 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2255/4548] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:26:57 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:26:57.991099 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1adc392-ec78-4964-8dfe-aac673a7e04b None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:57.991450 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1adc392-ec78-4964-8dfe-aac673a7e04b None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:57.991705 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1adc392-ec78-4964-8dfe-aac673a7e04b None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:57.993505 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2256/4549] 10.222.0.52 () {54 vars in 912 bytes} [Sat May 14 21:26:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:26:58.001367 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1adc392-ec78-4964-8dfe-aac673a7e04b None None] Authenticating service token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 14 21:26:58.042546 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2294/4550] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:26:57 2022] PUT /identity/v3/projects/402205919cca433186bd6c32bdbe970b/users/cbbc9ad2fa3545b6b8c6245afb39ad89/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:26:58.046252 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0049b0f2-9a92-4c96-aeb2-a6a90c2da9b9 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:58.048154 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1adc392-ec78-4964-8dfe-aac673a7e04b None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:58.074460 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1adc392-ec78-4964-8dfe-aac673a7e04b None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:58.181849 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0049b0f2-9a92-4c96-aeb2-a6a90c2da9b9 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:58.186508 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40029415-5ef0-43c2-ad37-5a66950c3555 tempest-QuotasTestJSON-1472162625 tempest-QuotasTestJSON-1472162625-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd41bd6980b8449aae43239ff1ef8557', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e178a6743a947c0810f64d90d260ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:58.187109 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40029415-5ef0-43c2-ad37-5a66950c3555 tempest-QuotasTestJSON-1472162625 tempest-QuotasTestJSON-1472162625-project] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:58.187519 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40029415-5ef0-43c2-ad37-5a66950c3555 tempest-QuotasTestJSON-1472162625 tempest-QuotasTestJSON-1472162625-project] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:58.187891 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40029415-5ef0-43c2-ad37-5a66950c3555 tempest-QuotasTestJSON-1472162625 tempest-QuotasTestJSON-1472162625-project] PATH_INFO: `/v3/projects/2e178a6743a947c0810f64d90d260ebd` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:58.189310 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40029415-5ef0-43c2-ad37-5a66950c3555 tempest-QuotasTestJSON-1472162625 tempest-QuotasTestJSON-1472162625-project] RBAC: Authorizing `identity:get_project(project_id=2e178a6743a947c0810f64d90d260ebd)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:58.193167 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40029415-5ef0-43c2-ad37-5a66950c3555 tempest-QuotasTestJSON-1472162625 tempest-QuotasTestJSON-1472162625-project] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:58.196208 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2257/4551] 10.222.0.52 () {58 vars in 1443 bytes} [Sat May 14 21:26:58 2022] GET /identity/v3/projects/2e178a6743a947c0810f64d90d260ebd => generated 365 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:26:58.200456 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b3ebda-af2f-4f79-beba-dccca9ac3327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:58.201754 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3ebda-af2f-4f79-beba-dccca9ac3327 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:58.202212 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3ebda-af2f-4f79-beba-dccca9ac3327 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:58.202659 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3ebda-af2f-4f79-beba-dccca9ac3327 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:58.203833 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b3ebda-af2f-4f79-beba-dccca9ac3327 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:58.205945 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b3ebda-af2f-4f79-beba-dccca9ac3327 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:58.224143 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2295/4552] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:26:58 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:26:58.228394 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40029415-5ef0-43c2-ad37-5a66950c3555 tempest-QuotasTestJSON-1472162625 tempest-QuotasTestJSON-1472162625-project] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:58.241303 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa35cc9-45f9-422d-b478-cc313cf59e7b None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:58.244108 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa35cc9-45f9-422d-b478-cc313cf59e7b None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:58.244400 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa35cc9-45f9-422d-b478-cc313cf59e7b None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:58.246305 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40029415-5ef0-43c2-ad37-5a66950c3555 tempest-QuotasTestJSON-1472162625 tempest-QuotasTestJSON-1472162625-project] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:58.250837 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2296/4553] 10.222.0.52 () {54 vars in 912 bytes} [Sat May 14 21:26:58 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:26:58.257588 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa35cc9-45f9-422d-b478-cc313cf59e7b None None] Authenticating service token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 14 21:26:58.259884 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e697691-84a7-4156-9c5c-bec413f85d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:58.261163 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-8aa35cc9-45f9-422d-b478-cc313cf59e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:26:58.263725 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e697691-84a7-4156-9c5c-bec413f85d89 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:58.264580 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e697691-84a7-4156-9c5c-bec413f85d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:58.266529 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e697691-84a7-4156-9c5c-bec413f85d89 admin admin] PATH_INFO: `/v3/projects/402205919cca433186bd6c32bdbe970b/users/cbbc9ad2fa3545b6b8c6245afb39ad89/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:58.272212 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e697691-84a7-4156-9c5c-bec413f85d89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=402205919cca433186bd6c32bdbe970b, user_id=cbbc9ad2fa3545b6b8c6245afb39ad89, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:58.281161 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e697691-84a7-4156-9c5c-bec413f85d89 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:58.310643 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2258/4554] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:26:58 2022] PUT /identity/v3/projects/402205919cca433186bd6c32bdbe970b/users/cbbc9ad2fa3545b6b8c6245afb39ad89/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:26:58.321989 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ec1ce7-0b6a-45c4-aa9f-e77c815121d2 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:58.322602 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ec1ce7-0b6a-45c4-aa9f-e77c815121d2 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:58.323065 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ec1ce7-0b6a-45c4-aa9f-e77c815121d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:58.390566 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-06ec1ce7-0b6a-45c4-aa9f-e77c815121d2 None None] MFA Rules not processed for user `cbbc9ad2fa3545b6b8c6245afb39ad89`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:26:58.392165 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-06ec1ce7-0b6a-45c4-aa9f-e77c815121d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:26:58.436005 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa35cc9-45f9-422d-b478-cc313cf59e7b None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:58.449260 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa35cc9-45f9-422d-b478-cc313cf59e7b None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:58.506565 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2259/4555] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:26:58 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:26:58.521521 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ec1ce7-0b6a-45c4-aa9f-e77c815121d2 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:58.521753 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-06ec1ce7-0b6a-45c4-aa9f-e77c815121d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:26:58.540624 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10ba33f-5fb3-49ea-adf5-4c877bdaa063 tempest-QuotasTestJSON-1472162625 tempest-QuotasTestJSON-1472162625-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd41bd6980b8449aae43239ff1ef8557', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e178a6743a947c0810f64d90d260ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:58.543272 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ba33f-5fb3-49ea-adf5-4c877bdaa063 tempest-QuotasTestJSON-1472162625 tempest-QuotasTestJSON-1472162625-project] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:58.545763 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ba33f-5fb3-49ea-adf5-4c877bdaa063 tempest-QuotasTestJSON-1472162625 tempest-QuotasTestJSON-1472162625-project] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:58.559329 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ba33f-5fb3-49ea-adf5-4c877bdaa063 tempest-QuotasTestJSON-1472162625 tempest-QuotasTestJSON-1472162625-project] PATH_INFO: `/v3/projects/2e178a6743a947c0810f64d90d260ebd` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:58.559329 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10ba33f-5fb3-49ea-adf5-4c877bdaa063 tempest-QuotasTestJSON-1472162625 tempest-QuotasTestJSON-1472162625-project] RBAC: Authorizing `identity:get_project(project_id=2e178a6743a947c0810f64d90d260ebd)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:58.559329 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10ba33f-5fb3-49ea-adf5-4c877bdaa063 tempest-QuotasTestJSON-1472162625 tempest-QuotasTestJSON-1472162625-project] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:58.559329 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2297/4556] 10.222.0.52 () {58 vars in 1443 bytes} [Sat May 14 21:26:58 2022] GET /identity/v3/projects/2e178a6743a947c0810f64d90d260ebd => generated 365 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:26:58.618883 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21854d-c3e5-4fd9-85d4-e450bb3e659d None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:58.618883 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21854d-c3e5-4fd9-85d4-e450bb3e659d None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:58.618883 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21854d-c3e5-4fd9-85d4-e450bb3e659d None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:58.618883 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2298/4557] 10.222.0.52 () {54 vars in 912 bytes} [Sat May 14 21:26:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:26:58.636780 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc21854d-c3e5-4fd9-85d4-e450bb3e659d None None] Authenticating service token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 14 21:26:58.648503 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ec1ce7-0b6a-45c4-aa9f-e77c815121d2 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:58.658534 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c8f9ac-d5a1-4379-9360-1d841c0dce0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198271d1c0d44cb58bace41a65f4b94c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:58.662003 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c8f9ac-d5a1-4379-9360-1d841c0dce0b service cinder] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:58.662003 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c8f9ac-d5a1-4379-9360-1d841c0dce0b service cinder] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:58.662003 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c8f9ac-d5a1-4379-9360-1d841c0dce0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:58.670001 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b0c8f9ac-d5a1-4379-9360-1d841c0dce0b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:26:58.776299 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc21854d-c3e5-4fd9-85d4-e450bb3e659d None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:58.796355 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c8f9ac-d5a1-4379-9360-1d841c0dce0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:58.797546 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc21854d-c3e5-4fd9-85d4-e450bb3e659d None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:58.798820 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c8f9ac-d5a1-4379-9360-1d841c0dce0b service cinder] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:58.808759 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c061cf4-440b-4304-8008-2f409b399cb8 tempest-QuotasTestJSON-1472162625 tempest-QuotasTestJSON-1472162625-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd41bd6980b8449aae43239ff1ef8557', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e178a6743a947c0810f64d90d260ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:58.810975 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c061cf4-440b-4304-8008-2f409b399cb8 tempest-QuotasTestJSON-1472162625 tempest-QuotasTestJSON-1472162625-project] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:58.810975 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c061cf4-440b-4304-8008-2f409b399cb8 tempest-QuotasTestJSON-1472162625 tempest-QuotasTestJSON-1472162625-project] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:58.810975 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c061cf4-440b-4304-8008-2f409b399cb8 tempest-QuotasTestJSON-1472162625 tempest-QuotasTestJSON-1472162625-project] PATH_INFO: `/v3/projects/2e178a6743a947c0810f64d90d260ebd` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:58.812290 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c061cf4-440b-4304-8008-2f409b399cb8 tempest-QuotasTestJSON-1472162625 tempest-QuotasTestJSON-1472162625-project] RBAC: Authorizing `identity:get_project(project_id=2e178a6743a947c0810f64d90d260ebd)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:58.814258 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c061cf4-440b-4304-8008-2f409b399cb8 tempest-QuotasTestJSON-1472162625 tempest-QuotasTestJSON-1472162625-project] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:58.816876 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2299/4558] 10.222.0.52 () {58 vars in 1443 bytes} [Sat May 14 21:26:58 2022] GET /identity/v3/projects/2e178a6743a947c0810f64d90d260ebd => generated 365 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:26:58.834641 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2260/4559] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:26:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:26:58.862203 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d738fbbf-043b-4166-8702-e76801994afc None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:58.862493 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d738fbbf-043b-4166-8702-e76801994afc None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:58.862781 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d738fbbf-043b-4166-8702-e76801994afc None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:58.864799 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2300/4560] 10.222.0.52 () {54 vars in 912 bytes} [Sat May 14 21:26:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:26:58.870533 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c8f9ac-d5a1-4379-9360-1d841c0dce0b service cinder] Authenticating service token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 14 21:26:58.900156 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c8f9ac-d5a1-4379-9360-1d841c0dce0b service cinder] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:58.921287 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c8f9ac-d5a1-4379-9360-1d841c0dce0b service cinder] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:58.936013 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3384bd3-a1d5-4386-b7b6-eec8b2d18527 tempest-QuotasTestJSON-1472162625 tempest-QuotasTestJSON-1472162625-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd41bd6980b8449aae43239ff1ef8557', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e178a6743a947c0810f64d90d260ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:58.936605 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3384bd3-a1d5-4386-b7b6-eec8b2d18527 tempest-QuotasTestJSON-1472162625 tempest-QuotasTestJSON-1472162625-project] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:58.936893 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3384bd3-a1d5-4386-b7b6-eec8b2d18527 tempest-QuotasTestJSON-1472162625 tempest-QuotasTestJSON-1472162625-project] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:58.937173 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3384bd3-a1d5-4386-b7b6-eec8b2d18527 tempest-QuotasTestJSON-1472162625 tempest-QuotasTestJSON-1472162625-project] PATH_INFO: `/v3/projects/2e178a6743a947c0810f64d90d260ebd` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:58.940043 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3384bd3-a1d5-4386-b7b6-eec8b2d18527 tempest-QuotasTestJSON-1472162625 tempest-QuotasTestJSON-1472162625-project] RBAC: Authorizing `identity:get_project(project_id=2e178a6743a947c0810f64d90d260ebd)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:58.947824 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3384bd3-a1d5-4386-b7b6-eec8b2d18527 tempest-QuotasTestJSON-1472162625 tempest-QuotasTestJSON-1472162625-project] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:58.947824 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2261/4561] 10.222.0.52 () {58 vars in 1443 bytes} [Sat May 14 21:26:58 2022] GET /identity/v3/projects/2e178a6743a947c0810f64d90d260ebd => generated 365 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:26:59.005631 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947319a2-8bf0-444e-819b-4a768fc6f3b3 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:59.005929 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947319a2-8bf0-444e-819b-4a768fc6f3b3 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:59.006217 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947319a2-8bf0-444e-819b-4a768fc6f3b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:59.015747 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c763f0e-2c3e-43fc-ac09-968f1406c04b None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:59.016042 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c763f0e-2c3e-43fc-ac09-968f1406c04b None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:59.016440 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c763f0e-2c3e-43fc-ac09-968f1406c04b None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:59.017693 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2262/4562] 10.222.0.52 () {54 vars in 912 bytes} [Sat May 14 21:26:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 14 21:26:59.024036 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c763f0e-2c3e-43fc-ac09-968f1406c04b None None] Authenticating service token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 14 21:26:59.068817 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-947319a2-8bf0-444e-819b-4a768fc6f3b3 None None] MFA Rules not processed for user `b398969c37454956a73bf459e0d37e61`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:26:59.070563 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c763f0e-2c3e-43fc-ac09-968f1406c04b None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:59.074638 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-947319a2-8bf0-444e-819b-4a768fc6f3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:26:59.099124 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c763f0e-2c3e-43fc-ac09-968f1406c04b None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:59.116586 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a174cf-65b8-4f93-8847-3228cf2511b7 tempest-QuotasTestJSON-1472162625 tempest-QuotasTestJSON-1472162625-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd41bd6980b8449aae43239ff1ef8557', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e178a6743a947c0810f64d90d260ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:59.118504 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a174cf-65b8-4f93-8847-3228cf2511b7 tempest-QuotasTestJSON-1472162625 tempest-QuotasTestJSON-1472162625-project] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:59.118504 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a174cf-65b8-4f93-8847-3228cf2511b7 tempest-QuotasTestJSON-1472162625 tempest-QuotasTestJSON-1472162625-project] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:59.118504 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a174cf-65b8-4f93-8847-3228cf2511b7 tempest-QuotasTestJSON-1472162625 tempest-QuotasTestJSON-1472162625-project] PATH_INFO: `/v3/projects/2e178a6743a947c0810f64d90d260ebd` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:59.127598 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a174cf-65b8-4f93-8847-3228cf2511b7 tempest-QuotasTestJSON-1472162625 tempest-QuotasTestJSON-1472162625-project] RBAC: Authorizing `identity:get_project(project_id=2e178a6743a947c0810f64d90d260ebd)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:59.129993 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a174cf-65b8-4f93-8847-3228cf2511b7 tempest-QuotasTestJSON-1472162625 tempest-QuotasTestJSON-1472162625-project] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:59.139724 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2263/4563] 10.222.0.52 () {58 vars in 1443 bytes} [Sat May 14 21:26:59 2022] GET /identity/v3/projects/2e178a6743a947c0810f64d90d260ebd => generated 365 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:26:59.196610 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2301/4564] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:26:59 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:26:59.234569 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a174cf-65b8-4f93-8847-3228cf2511b7 tempest-QuotasTestJSON-1472162625 tempest-QuotasTestJSON-1472162625-project] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:59.404029 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a174cf-65b8-4f93-8847-3228cf2511b7 tempest-QuotasTestJSON-1472162625 tempest-QuotasTestJSON-1472162625-project] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:59.409934 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44680b9d-4c52-4202-82af-f1ce49545836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:59.411868 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44680b9d-4c52-4202-82af-f1ce49545836 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:59.412091 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44680b9d-4c52-4202-82af-f1ce49545836 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:59.412522 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44680b9d-4c52-4202-82af-f1ce49545836 admin admin] PATH_INFO: `/v3/users/cd41bd6980b8449aae43239ff1ef8557` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:59.415247 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44680b9d-4c52-4202-82af-f1ce49545836 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd41bd6980b8449aae43239ff1ef8557)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:59.416524 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44680b9d-4c52-4202-82af-f1ce49545836 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:59.506039 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947319a2-8bf0-444e-819b-4a768fc6f3b3 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:26:59.506509 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-947319a2-8bf0-444e-819b-4a768fc6f3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:26:59.532933 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947319a2-8bf0-444e-819b-4a768fc6f3b3 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:26:59.533827 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0319196b-1ef7-4358-9623-9f82746fbece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:26:59.534980 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0319196b-1ef7-4358-9623-9f82746fbece admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:59.535738 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0319196b-1ef7-4358-9623-9f82746fbece admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:59.537105 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0319196b-1ef7-4358-9623-9f82746fbece admin admin] PATH_INFO: `/v3/users/b487bf2669c946b9935d9afb5d8e266a` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:59.538683 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0319196b-1ef7-4358-9623-9f82746fbece admin admin] RBAC: Authorizing `identity:delete_user(user_id=b487bf2669c946b9935d9afb5d8e266a)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:26:59.544412 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0319196b-1ef7-4358-9623-9f82746fbece admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:26:59.668708 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-44680b9d-4c52-4202-82af-f1ce49545836 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd41bd6980b8449aae43239ff1ef8557'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:26:59.678156 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-44680b9d-4c52-4202-82af-f1ce49545836 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd41bd6980b8449aae43239ff1ef8557'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:26:59.678917 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-44680b9d-4c52-4202-82af-f1ce49545836 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd41bd6980b8449aae43239ff1ef8557'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:26:59.748948 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-44680b9d-4c52-4202-82af-f1ce49545836 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd41bd6980b8449aae43239ff1ef8557'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:26:59.779961 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-44680b9d-4c52-4202-82af-f1ce49545836 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd41bd6980b8449aae43239ff1ef8557'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:26:59.791556 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0319196b-1ef7-4358-9623-9f82746fbece admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b487bf2669c946b9935d9afb5d8e266a'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:26:59.834206 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2264/4565] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:26:59 2022] DELETE /identity/v3/users/cd41bd6980b8449aae43239ff1ef8557 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:26:59.838074 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0319196b-1ef7-4358-9623-9f82746fbece admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b487bf2669c946b9935d9afb5d8e266a'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:26:59.841647 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0289829-6644-40ca-a712-79b0cfd4c5f2 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:26:59.842203 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0289829-6644-40ca-a712-79b0cfd4c5f2 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:26:59.843340 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0289829-6644-40ca-a712-79b0cfd4c5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:26:59.854505 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0319196b-1ef7-4358-9623-9f82746fbece admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b487bf2669c946b9935d9afb5d8e266a'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:26:59.905746 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-d0289829-6644-40ca-a712-79b0cfd4c5f2 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:26:59.907578 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-d0289829-6644-40ca-a712-79b0cfd4c5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:26:59.968430 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0319196b-1ef7-4358-9623-9f82746fbece admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b487bf2669c946b9935d9afb5d8e266a'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:26:59.969348 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0319196b-1ef7-4358-9623-9f82746fbece admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b487bf2669c946b9935d9afb5d8e266a'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:26:59.988563 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2302/4566] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:26:59 2022] DELETE /identity/v3/users/b487bf2669c946b9935d9afb5d8e266a => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:27:00.067097 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2265/4567] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:26:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:27:00.107032 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0319196b-1ef7-4358-9623-9f82746fbece admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:27:00.109194 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-0319196b-1ef7-4358-9623-9f82746fbece admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:27:00.247065 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0319196b-1ef7-4358-9623-9f82746fbece admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:27:00.294325 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ed846f-1bcb-4003-9fca-a12df631a65a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:27:00.295263 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ed846f-1bcb-4003-9fca-a12df631a65a service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:00.295590 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ed846f-1bcb-4003-9fca-a12df631a65a service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:00.295923 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ed846f-1bcb-4003-9fca-a12df631a65a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:00.429143 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ed846f-1bcb-4003-9fca-a12df631a65a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:27:00.431565 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ed846f-1bcb-4003-9fca-a12df631a65a service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:27:00.448820 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2303/4568] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:27:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:27:00.494238 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0289829-6644-40ca-a712-79b0cfd4c5f2 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:27:00.497017 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-d0289829-6644-40ca-a712-79b0cfd4c5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:27:00.541440 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0289829-6644-40ca-a712-79b0cfd4c5f2 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:27:00.554556 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c191a1-14a6-467f-9f72-36a70304a29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:27:00.559465 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c191a1-14a6-467f-9f72-36a70304a29f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:00.560042 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c191a1-14a6-467f-9f72-36a70304a29f admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:00.560589 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c191a1-14a6-467f-9f72-36a70304a29f admin admin] PATH_INFO: `/v3/projects/ec5b6c73e5f14deca3371f8735b60f5f` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:00.563004 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c191a1-14a6-467f-9f72-36a70304a29f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec5b6c73e5f14deca3371f8735b60f5f)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:27:00.566175 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c191a1-14a6-467f-9f72-36a70304a29f admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:27:00.722814 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-91c191a1-14a6-467f-9f72-36a70304a29f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec5b6c73e5f14deca3371f8735b60f5f', 'request_id': 'req-91c191a1-14a6-467f-9f72-36a70304a29f'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:27:00.732750 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-91c191a1-14a6-467f-9f72-36a70304a29f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec5b6c73e5f14deca3371f8735b60f5f', 'request_id': 'req-91c191a1-14a6-467f-9f72-36a70304a29f'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:27:00.742540 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-91c191a1-14a6-467f-9f72-36a70304a29f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec5b6c73e5f14deca3371f8735b60f5f', 'request_id': 'req-91c191a1-14a6-467f-9f72-36a70304a29f'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:27:00.795244 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c227584-b634-4f96-835c-8aafc037a59e None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:00.800033 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c227584-b634-4f96-835c-8aafc037a59e None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:00.800379 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c227584-b634-4f96-835c-8aafc037a59e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:00.874683 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-91c191a1-14a6-467f-9f72-36a70304a29f admin admin] The token cache is being invalidate because project ec5b6c73e5f14deca3371f8735b60f5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:27:00.874977 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-91c191a1-14a6-467f-9f72-36a70304a29f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:27:00.878129 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-91c191a1-14a6-467f-9f72-36a70304a29f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:27:00.880373 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2266/4569] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:27:00 2022] DELETE /identity/v3/projects/ec5b6c73e5f14deca3371f8735b60f5f => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:27:00.885410 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a1ad7-64a1-4d60-b851-80c02e138c24 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:00.885701 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a1ad7-64a1-4d60-b851-80c02e138c24 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:00.885994 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a1ad7-64a1-4d60-b851-80c02e138c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:00.911458 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-5c227584-b634-4f96-835c-8aafc037a59e None None] MFA Rules not processed for user `21104d85a5cc470a8faf69a3fd83a2d1`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:27:00.912740 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-5c227584-b634-4f96-835c-8aafc037a59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:27:00.924445 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-ea8a1ad7-64a1-4d60-b851-80c02e138c24 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:27:00.928765 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-ea8a1ad7-64a1-4d60-b851-80c02e138c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:27:01.121867 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2304/4570] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:27:00 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:27:01.149543 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c227584-b634-4f96-835c-8aafc037a59e None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:27:01.151040 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-5c227584-b634-4f96-835c-8aafc037a59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:27:01.220037 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2267/4571] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:27:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:27:01.227194 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933f6a7-391d-4523-8e24-0322115f9c56 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:01.227504 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933f6a7-391d-4523-8e24-0322115f9c56 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:01.228713 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933f6a7-391d-4523-8e24-0322115f9c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:01.277493 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c227584-b634-4f96-835c-8aafc037a59e None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:27:01.283573 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a014f1-d1fd-4fc8-a8d5-260549e15638 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198271d1c0d44cb58bace41a65f4b94c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:27:01.284502 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a014f1-d1fd-4fc8-a8d5-260549e15638 service cinder] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:01.285039 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a014f1-d1fd-4fc8-a8d5-260549e15638 service cinder] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:01.285481 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a014f1-d1fd-4fc8-a8d5-260549e15638 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:01.289177 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c1a014f1-d1fd-4fc8-a8d5-260549e15638 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:27:01.298539 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-6933f6a7-391d-4523-8e24-0322115f9c56 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:27:01.299885 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-6933f6a7-391d-4523-8e24-0322115f9c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:27:01.324513 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2268/4572] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:27:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:27:01.334991 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6933f6a7-391d-4523-8e24-0322115f9c56 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:27:01.359091 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6933f6a7-391d-4523-8e24-0322115f9c56 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:27:01.371655 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ef096b-2be3-40e8-a949-6111d79112b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:27:01.372791 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef096b-2be3-40e8-a949-6111d79112b0 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:01.374476 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef096b-2be3-40e8-a949-6111d79112b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:01.374982 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef096b-2be3-40e8-a949-6111d79112b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:01.376869 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ef096b-2be3-40e8-a949-6111d79112b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:27:01.378809 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ef096b-2be3-40e8-a949-6111d79112b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:27:01.383046 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ef096b-2be3-40e8-a949-6111d79112b0 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:27:01.386640 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a014f1-d1fd-4fc8-a8d5-260549e15638 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:27:01.392546 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a014f1-d1fd-4fc8-a8d5-260549e15638 service cinder] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:27:01.398665 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2269/4573] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:27:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:27:01.402503 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2305/4574] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:27:01 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:27:01.403583 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ef096b-2be3-40e8-a949-6111d79112b0 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:27:01.415800 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ef096b-2be3-40e8-a949-6111d79112b0 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:27:01.433291 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c16e0-607e-4eba-8bfb-47031a6da180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:27:01.434894 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c16e0-607e-4eba-8bfb-47031a6da180 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:01.434894 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c16e0-607e-4eba-8bfb-47031a6da180 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:01.435622 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c16e0-607e-4eba-8bfb-47031a6da180 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:01.436421 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415c16e0-607e-4eba-8bfb-47031a6da180 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:27:01.438708 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415c16e0-607e-4eba-8bfb-47031a6da180 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:27:01.650913 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a014f1-d1fd-4fc8-a8d5-260549e15638 service cinder] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:27:01.652728 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c1a014f1-d1fd-4fc8-a8d5-260549e15638 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:27:01.662015 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2270/4575] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:27:01 2022] POST /identity/v3/projects => generated 395 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:27:01.663026 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c16e0-607e-4eba-8bfb-47031a6da180 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:27:01.684531 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a014f1-d1fd-4fc8-a8d5-260549e15638 service cinder] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:27:01.836034 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c16e0-607e-4eba-8bfb-47031a6da180 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:27:01.841303 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32708599-632b-414d-97c9-584bb08325ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:27:01.842325 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32708599-632b-414d-97c9-584bb08325ea admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:01.842682 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32708599-632b-414d-97c9-584bb08325ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:01.843359 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32708599-632b-414d-97c9-584bb08325ea admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:01.844179 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32708599-632b-414d-97c9-584bb08325ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:27:01.846292 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32708599-632b-414d-97c9-584bb08325ea admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:27:01.923395 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c492bfba-ec53-45dd-8287-4fba311696d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:27:01.924357 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492bfba-ec53-45dd-8287-4fba311696d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:01.924641 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492bfba-ec53-45dd-8287-4fba311696d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:01.924909 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492bfba-ec53-45dd-8287-4fba311696d8 admin admin] PATH_INFO: `/v3/projects/2e178a6743a947c0810f64d90d260ebd` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:01.927315 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c492bfba-ec53-45dd-8287-4fba311696d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e178a6743a947c0810f64d90d260ebd)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:27:01.929709 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c492bfba-ec53-45dd-8287-4fba311696d8 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:27:01.973743 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2271/4576] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:27:01 2022] POST /identity/v3/users => generated 298 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:27:01.979020 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32708599-632b-414d-97c9-584bb08325ea admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:27:01.998703 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32708599-632b-414d-97c9-584bb08325ea admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:27:02.005964 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bce375-84b1-464d-a942-e4fa23360ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:27:02.007199 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bce375-84b1-464d-a942-e4fa23360ce2 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:02.007813 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bce375-84b1-464d-a942-e4fa23360ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:02.012046 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bce375-84b1-464d-a942-e4fa23360ce2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:02.012046 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bce375-84b1-464d-a942-e4fa23360ce2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:27:02.013076 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bce375-84b1-464d-a942-e4fa23360ce2 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:27:02.058642 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2272/4577] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:27:01 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:27:02.059024 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bce375-84b1-464d-a942-e4fa23360ce2 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:27:02.083929 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bce375-84b1-464d-a942-e4fa23360ce2 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:27:02.105666 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289ddf95-a814-4b2a-9b96-fd668fe664cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:27:02.107019 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ddf95-a814-4b2a-9b96-fd668fe664cf admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:02.107314 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ddf95-a814-4b2a-9b96-fd668fe664cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:02.107626 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ddf95-a814-4b2a-9b96-fd668fe664cf admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:02.109965 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289ddf95-a814-4b2a-9b96-fd668fe664cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:27:02.114112 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289ddf95-a814-4b2a-9b96-fd668fe664cf admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:27:02.151860 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2273/4578] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:27:02 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:27:02.156277 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289ddf95-a814-4b2a-9b96-fd668fe664cf admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:27:02.198096 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289ddf95-a814-4b2a-9b96-fd668fe664cf admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:27:02.228438 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c492bfba-ec53-45dd-8287-4fba311696d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e178a6743a947c0810f64d90d260ebd', 'request_id': 'req-c492bfba-ec53-45dd-8287-4fba311696d8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:27:02.258373 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c492bfba-ec53-45dd-8287-4fba311696d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e178a6743a947c0810f64d90d260ebd', 'request_id': 'req-c492bfba-ec53-45dd-8287-4fba311696d8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:27:02.345760 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c492bfba-ec53-45dd-8287-4fba311696d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e178a6743a947c0810f64d90d260ebd', 'request_id': 'req-c492bfba-ec53-45dd-8287-4fba311696d8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:27:02.372968 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c492bfba-ec53-45dd-8287-4fba311696d8 admin admin] The token cache is being invalidate because project 2e178a6743a947c0810f64d90d260ebd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:27:02.373647 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c492bfba-ec53-45dd-8287-4fba311696d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:27:02.374912 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c492bfba-ec53-45dd-8287-4fba311696d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:27:02.377556 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2306/4579] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:27:01 2022] DELETE /identity/v3/projects/2e178a6743a947c0810f64d90d260ebd => generated 0 bytes in 727 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:27:02.386322 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a8acd-5646-403a-a2d0-c114268e037c None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:02.386482 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1008f9-047d-433f-b15d-3d3a11a748e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:27:02.387707 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1008f9-047d-433f-b15d-3d3a11a748e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:02.388004 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1008f9-047d-433f-b15d-3d3a11a748e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:02.388288 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1008f9-047d-433f-b15d-3d3a11a748e6 admin admin] PATH_INFO: `/v3/projects/c39236c4fcb74ea2838acddd315e00ff/users/1a51643a51af4175b40a61a726eac80a/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:02.389000 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a8acd-5646-403a-a2d0-c114268e037c None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:02.390680 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a8acd-5646-403a-a2d0-c114268e037c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:02.441778 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1008f9-047d-433f-b15d-3d3a11a748e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c39236c4fcb74ea2838acddd315e00ff, user_id=1a51643a51af4175b40a61a726eac80a, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:27:02.444874 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-0d3a8acd-5646-403a-a2d0-c114268e037c None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:27:02.446500 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-0d3a8acd-5646-403a-a2d0-c114268e037c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:27:02.447342 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1008f9-047d-433f-b15d-3d3a11a748e6 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:27:02.469435 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2307/4580] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:27:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:27:02.507940 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c769c-8f24-4db8-baf7-7d839503591d None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:02.508260 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c769c-8f24-4db8-baf7-7d839503591d None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:02.508811 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c769c-8f24-4db8-baf7-7d839503591d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:02.528709 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2274/4581] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:27:02 2022] PUT /identity/v3/projects/c39236c4fcb74ea2838acddd315e00ff/users/1a51643a51af4175b40a61a726eac80a/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:27:02.534026 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e053bd8a-c6fc-49e0-be49-96afd6277948 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:02.534320 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e053bd8a-c6fc-49e0-be49-96afd6277948 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:02.534609 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e053bd8a-c6fc-49e0-be49-96afd6277948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:02.594333 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-e053bd8a-c6fc-49e0-be49-96afd6277948 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:27:02.597152 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e053bd8a-c6fc-49e0-be49-96afd6277948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:27:02.613319 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-1e0c769c-8f24-4db8-baf7-7d839503591d None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:27:02.613319 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-1e0c769c-8f24-4db8-baf7-7d839503591d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:27:02.716611 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2308/4582] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:27:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:27:02.720734 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c769c-8f24-4db8-baf7-7d839503591d None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:27:02.750380 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c769c-8f24-4db8-baf7-7d839503591d None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:27:02.765511 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf222a7-443b-42fc-aa1e-2069f0fc52ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:27:02.766521 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf222a7-443b-42fc-aa1e-2069f0fc52ec admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:02.766868 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf222a7-443b-42fc-aa1e-2069f0fc52ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:02.767220 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf222a7-443b-42fc-aa1e-2069f0fc52ec admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:02.768074 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf222a7-443b-42fc-aa1e-2069f0fc52ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:27:02.768461 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf222a7-443b-42fc-aa1e-2069f0fc52ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:27:02.772925 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf222a7-443b-42fc-aa1e-2069f0fc52ec admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:27:02.802747 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2309/4583] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:27:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:27:02.803621 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf222a7-443b-42fc-aa1e-2069f0fc52ec admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:27:02.808558 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-bdf222a7-443b-42fc-aa1e-2069f0fc52ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:27:02.852965 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2275/4584] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:27:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:27:02.854061 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e053bd8a-c6fc-49e0-be49-96afd6277948 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:27:02.868955 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e053bd8a-c6fc-49e0-be49-96afd6277948 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:27:02.874629 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de5bc5-c57e-432f-9a86-145bbfcf0a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:27:02.875414 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de5bc5-c57e-432f-9a86-145bbfcf0a02 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:02.875938 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de5bc5-c57e-432f-9a86-145bbfcf0a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:02.876212 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de5bc5-c57e-432f-9a86-145bbfcf0a02 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:02.877117 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2de5bc5-c57e-432f-9a86-145bbfcf0a02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:27:02.879170 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2de5bc5-c57e-432f-9a86-145bbfcf0a02 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:27:02.912042 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf222a7-443b-42fc-aa1e-2069f0fc52ec admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:27:02.917908 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69ef3cc-b58b-4667-93b6-c3a411b2daba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198271d1c0d44cb58bace41a65f4b94c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:27:02.918713 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ef3cc-b58b-4667-93b6-c3a411b2daba service cinder] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:02.919072 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ef3cc-b58b-4667-93b6-c3a411b2daba service cinder] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:02.919511 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ef3cc-b58b-4667-93b6-c3a411b2daba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:02.924012 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b69ef3cc-b58b-4667-93b6-c3a411b2daba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:27:02.990044 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69ef3cc-b58b-4667-93b6-c3a411b2daba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:27:02.991759 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69ef3cc-b58b-4667-93b6-c3a411b2daba service cinder] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:27:03.001513 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2310/4585] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:27:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:27:03.002346 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69ef3cc-b58b-4667-93b6-c3a411b2daba service cinder] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:27:03.003983 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b69ef3cc-b58b-4667-93b6-c3a411b2daba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:27:03.089810 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69ef3cc-b58b-4667-93b6-c3a411b2daba service cinder] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:27:03.096496 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef59cc5-08ea-4e57-bf89-9947241d7772 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:27:03.097255 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef59cc5-08ea-4e57-bf89-9947241d7772 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:03.097663 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef59cc5-08ea-4e57-bf89-9947241d7772 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:03.098084 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef59cc5-08ea-4e57-bf89-9947241d7772 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:03.112017 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef59cc5-08ea-4e57-bf89-9947241d7772 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:27:03.113611 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef59cc5-08ea-4e57-bf89-9947241d7772 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:27:03.137081 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2311/4586] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:27:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:27:03.150055 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2276/4587] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:27:02 2022] POST /identity/v3/projects => generated 387 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:27:03.154952 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef59cc5-08ea-4e57-bf89-9947241d7772 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:27:03.173910 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef59cc5-08ea-4e57-bf89-9947241d7772 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:27:03.243520 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83769bac-e499-4c9f-bd63-33c4ea03a847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:27:03.244361 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83769bac-e499-4c9f-bd63-33c4ea03a847 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:03.244742 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83769bac-e499-4c9f-bd63-33c4ea03a847 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:03.245118 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83769bac-e499-4c9f-bd63-33c4ea03a847 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:03.245868 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83769bac-e499-4c9f-bd63-33c4ea03a847 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:27:03.247973 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83769bac-e499-4c9f-bd63-33c4ea03a847 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:27:03.403406 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2312/4588] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:27:03 2022] POST /identity/v3/users => generated 294 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:27:03.408049 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de5bc5-c57e-432f-9a86-145bbfcf0a02 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:27:03.445014 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de5bc5-c57e-432f-9a86-145bbfcf0a02 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:27:03.471363 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20748d9-0474-4514-bd6c-8b5c70dcfa63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:27:03.474743 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20748d9-0474-4514-bd6c-8b5c70dcfa63 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:03.475656 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20748d9-0474-4514-bd6c-8b5c70dcfa63 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:03.477910 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20748d9-0474-4514-bd6c-8b5c70dcfa63 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:03.480589 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20748d9-0474-4514-bd6c-8b5c70dcfa63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:27:03.491715 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20748d9-0474-4514-bd6c-8b5c70dcfa63 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:27:03.540505 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2277/4589] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:27:03 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:27:03.543193 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83769bac-e499-4c9f-bd63-33c4ea03a847 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:27:03.554983 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83769bac-e499-4c9f-bd63-33c4ea03a847 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:27:03.577597 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23712b40-d45e-4717-a68d-805e1f386593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:27:03.578281 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23712b40-d45e-4717-a68d-805e1f386593 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:03.578569 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23712b40-d45e-4717-a68d-805e1f386593 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:03.579167 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23712b40-d45e-4717-a68d-805e1f386593 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:03.584046 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23712b40-d45e-4717-a68d-805e1f386593 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:27:03.586087 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23712b40-d45e-4717-a68d-805e1f386593 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:27:03.610099 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2313/4590] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:27:03 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:27:03.611049 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20748d9-0474-4514-bd6c-8b5c70dcfa63 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:27:03.627200 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20748d9-0474-4514-bd6c-8b5c70dcfa63 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:27:03.643190 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5e6bce-b7f3-46c0-aa33-2e68e6e5dfbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:27:03.644228 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e6bce-b7f3-46c0-aa33-2e68e6e5dfbe admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:03.644628 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e6bce-b7f3-46c0-aa33-2e68e6e5dfbe admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:03.645863 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e6bce-b7f3-46c0-aa33-2e68e6e5dfbe admin admin] PATH_INFO: `/v3/projects/4989c480608c4b86bd1cd7615fba4d20/users/04e48304473d40ebb8c0c5386c4c3592/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:03.690630 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5e6bce-b7f3-46c0-aa33-2e68e6e5dfbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=4989c480608c4b86bd1cd7615fba4d20, user_id=04e48304473d40ebb8c0c5386c4c3592, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:27:03.698254 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5e6bce-b7f3-46c0-aa33-2e68e6e5dfbe admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:27:03.771564 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23712b40-d45e-4717-a68d-805e1f386593 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:27:03.773553 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-23712b40-d45e-4717-a68d-805e1f386593 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:27:03.799608 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2278/4591] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:27:03 2022] PUT /identity/v3/projects/4989c480608c4b86bd1cd7615fba4d20/users/04e48304473d40ebb8c0c5386c4c3592/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:27:03.805449 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f09ad5-cdec-4ced-8220-672495589297 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:03.807756 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f09ad5-cdec-4ced-8220-672495589297 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:03.807998 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f09ad5-cdec-4ced-8220-672495589297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:03.864266 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-28f09ad5-cdec-4ced-8220-672495589297 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:27:03.865967 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-28f09ad5-cdec-4ced-8220-672495589297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:27:03.930557 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23712b40-d45e-4717-a68d-805e1f386593 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:27:04.070015 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a306e4b2-b7d1-44c9-9ccb-812a2950eea1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:27:04.071143 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306e4b2-b7d1-44c9-9ccb-812a2950eea1 service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:04.071734 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306e4b2-b7d1-44c9-9ccb-812a2950eea1 service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:04.072431 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306e4b2-b7d1-44c9-9ccb-812a2950eea1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:04.075336 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2279/4592] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:27:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:27:04.077156 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-a306e4b2-b7d1-44c9-9ccb-812a2950eea1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:27:04.087787 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f09ad5-cdec-4ced-8220-672495589297 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:27:04.089404 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-28f09ad5-cdec-4ced-8220-672495589297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:27:04.264398 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f09ad5-cdec-4ced-8220-672495589297 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:27:04.269111 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a306e4b2-b7d1-44c9-9ccb-812a2950eea1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:27:04.270807 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a306e4b2-b7d1-44c9-9ccb-812a2950eea1 service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:27:04.292074 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ad324e-7d85-44df-9c88-314be9902d68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:27:04.293939 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad324e-7d85-44df-9c88-314be9902d68 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:04.294798 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad324e-7d85-44df-9c88-314be9902d68 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:04.295231 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad324e-7d85-44df-9c88-314be9902d68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:04.319107 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2314/4593] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:27:03 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:27:04.349858 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ad324e-7d85-44df-9c88-314be9902d68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:27:04.357923 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ad324e-7d85-44df-9c88-314be9902d68 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:27:04.393069 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2280/4594] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:27:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:27:05.405007 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d559fd-7fa5-4937-ae80-2daf157a7b4d None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:05.405845 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d559fd-7fa5-4937-ae80-2daf157a7b4d None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:05.406286 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d559fd-7fa5-4937-ae80-2daf157a7b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:05.502139 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-43d559fd-7fa5-4937-ae80-2daf157a7b4d None None] MFA Rules not processed for user `1a51643a51af4175b40a61a726eac80a`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:27:05.507522 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-43d559fd-7fa5-4937-ae80-2daf157a7b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:27:05.719594 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2315/4595] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:27:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:27:05.721403 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a0f01f-ddb6-4b92-b8d5-9da574a9c9d8 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:05.721872 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a0f01f-ddb6-4b92-b8d5-9da574a9c9d8 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:05.722008 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a0f01f-ddb6-4b92-b8d5-9da574a9c9d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:05.763019 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-b8a0f01f-ddb6-4b92-b8d5-9da574a9c9d8 None None] MFA Rules not processed for user `1a51643a51af4175b40a61a726eac80a`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:27:05.764861 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b8a0f01f-ddb6-4b92-b8d5-9da574a9c9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:27:05.791393 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2281/4596] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:27:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:27:05.801361 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d559fd-7fa5-4937-ae80-2daf157a7b4d None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:27:05.806342 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-43d559fd-7fa5-4937-ae80-2daf157a7b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:27:05.830614 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d559fd-7fa5-4937-ae80-2daf157a7b4d None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:27:05.842477 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07de7d38-93ef-4eb5-aae4-3eac6a464179 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:27:05.846511 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de7d38-93ef-4eb5-aae4-3eac6a464179 service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:05.846511 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de7d38-93ef-4eb5-aae4-3eac6a464179 service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:05.846511 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de7d38-93ef-4eb5-aae4-3eac6a464179 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:05.857602 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07de7d38-93ef-4eb5-aae4-3eac6a464179 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:27:05.859723 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07de7d38-93ef-4eb5-aae4-3eac6a464179 service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:27:05.886232 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2316/4597] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:27:05 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:27:09.053932 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a0f01f-ddb6-4b92-b8d5-9da574a9c9d8 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:27:09.056506 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b8a0f01f-ddb6-4b92-b8d5-9da574a9c9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:27:09.197384 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a0f01f-ddb6-4b92-b8d5-9da574a9c9d8 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:27:09.207092 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6851b9-af7a-4dbc-9249-d92f81bdce0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198271d1c0d44cb58bace41a65f4b94c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:27:09.208434 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6851b9-af7a-4dbc-9249-d92f81bdce0a service cinder] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:09.208927 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6851b9-af7a-4dbc-9249-d92f81bdce0a service cinder] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:09.209436 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6851b9-af7a-4dbc-9249-d92f81bdce0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:09.213661 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-bd6851b9-af7a-4dbc-9249-d92f81bdce0a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:27:09.355324 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6851b9-af7a-4dbc-9249-d92f81bdce0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:27:09.357642 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6851b9-af7a-4dbc-9249-d92f81bdce0a service cinder] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:27:09.371025 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2282/4598] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:27:09 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:27:15.920820 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda622a2-8db1-4a56-a06e-bed23ceadf4c None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:15.921396 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda622a2-8db1-4a56-a06e-bed23ceadf4c None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:15.921396 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda622a2-8db1-4a56-a06e-bed23ceadf4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:16.062807 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-eda622a2-8db1-4a56-a06e-bed23ceadf4c None None] MFA Rules not processed for user `04e48304473d40ebb8c0c5386c4c3592`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:27:16.064122 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-eda622a2-8db1-4a56-a06e-bed23ceadf4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:27:16.237568 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2317/4599] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:27:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:27:16.558310 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6851b9-af7a-4dbc-9249-d92f81bdce0a service cinder] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:27:16.581348 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6851b9-af7a-4dbc-9249-d92f81bdce0a service cinder] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:27:16.606390 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107c9555-3977-4448-b486-403f9d16a5b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:27:16.607110 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c9555-3977-4448-b486-403f9d16a5b5 service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:16.607403 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c9555-3977-4448-b486-403f9d16a5b5 service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:16.607730 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c9555-3977-4448-b486-403f9d16a5b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:16.642606 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107c9555-3977-4448-b486-403f9d16a5b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:27:16.645141 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107c9555-3977-4448-b486-403f9d16a5b5 service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:27:16.669715 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2283/4600] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:27:16 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:27:18.266223 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e9252-ee1e-4e31-83fb-a05aa87ca30b None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:18.266784 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e9252-ee1e-4e31-83fb-a05aa87ca30b None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:18.266784 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e9252-ee1e-4e31-83fb-a05aa87ca30b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:18.303199 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-468e9252-ee1e-4e31-83fb-a05aa87ca30b None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:27:18.305515 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-468e9252-ee1e-4e31-83fb-a05aa87ca30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:27:18.429971 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2318/4601] 10.222.0.52 () {58 vars in 967 bytes} [Sat May 14 21:27:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:27:18.440559 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107c9555-3977-4448-b486-403f9d16a5b5 service nova] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:27:18.443174 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-107c9555-3977-4448-b486-403f9d16a5b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:27:18.536699 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107c9555-3977-4448-b486-403f9d16a5b5 service nova] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:27:18.542910 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b72cab-8aaa-45fd-9594-bd337b583f32 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:27:18.543687 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b72cab-8aaa-45fd-9594-bd337b583f32 service swift] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:18.543965 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b72cab-8aaa-45fd-9594-bd337b583f32 service swift] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:18.544443 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b72cab-8aaa-45fd-9594-bd337b583f32 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:18.555075 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b72cab-8aaa-45fd-9594-bd337b583f32 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:27:18.557017 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b72cab-8aaa-45fd-9594-bd337b583f32 service swift] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:27:18.566164 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2284/4602] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 21:27:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 21:27:19.213395 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e9252-ee1e-4e31-83fb-a05aa87ca30b None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:27:19.226807 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e9252-ee1e-4e31-83fb-a05aa87ca30b None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:27:19.240398 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b05b7-a487-4d69-afe2-d74e72efea38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:27:19.241250 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b05b7-a487-4d69-afe2-d74e72efea38 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:19.241852 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b05b7-a487-4d69-afe2-d74e72efea38 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:19.242310 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b05b7-a487-4d69-afe2-d74e72efea38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:19.247067 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-788b05b7-a487-4d69-afe2-d74e72efea38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:27:19.282640 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788b05b7-a487-4d69-afe2-d74e72efea38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:27:19.285784 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788b05b7-a487-4d69-afe2-d74e72efea38 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:27:19.312294 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2319/4603] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:27:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:27:20.673527 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c213f-ae68-42d7-a310-fa8366e7a531 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:20.674408 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c213f-ae68-42d7-a310-fa8366e7a531 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:20.675411 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c213f-ae68-42d7-a310-fa8366e7a531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:20.721937 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-653c213f-ae68-42d7-a310-fa8366e7a531 None None] MFA Rules not processed for user `ed0a76be93e44fa887cb813a8879e04d`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:27:20.723699 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-653c213f-ae68-42d7-a310-fa8366e7a531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:27:20.851253 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2285/4604] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:27:20 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:27:21.268825 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8872679-1213-4fc1-88e4-54b61068b1e7 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:21.269479 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8872679-1213-4fc1-88e4-54b61068b1e7 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:21.269479 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8872679-1213-4fc1-88e4-54b61068b1e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:21.288916 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-e8872679-1213-4fc1-88e4-54b61068b1e7 None None] MFA Rules not processed for user `04e48304473d40ebb8c0c5386c4c3592`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:27:21.290161 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e8872679-1213-4fc1-88e4-54b61068b1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:27:21.298907 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2320/4605] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:27:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:27:22.334608 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d86250-2315-44a2-a7ec-0add92f01d06 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:22.335576 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d86250-2315-44a2-a7ec-0add92f01d06 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:22.336017 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d86250-2315-44a2-a7ec-0add92f01d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:22.385952 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-38d86250-2315-44a2-a7ec-0add92f01d06 None None] MFA Rules not processed for user `1e3390c9579a4f598c46f9417b4dd046`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:27:22.387253 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-38d86250-2315-44a2-a7ec-0add92f01d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:27:22.475684 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2286/4606] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:27:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:27:22.495856 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8872679-1213-4fc1-88e4-54b61068b1e7 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:27:22.497366 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e8872679-1213-4fc1-88e4-54b61068b1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:27:22.576964 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8872679-1213-4fc1-88e4-54b61068b1e7 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:27:22.583549 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a95f3-1877-4f77-a765-72cca0636709 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:27:22.584253 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a95f3-1877-4f77-a765-72cca0636709 service placement] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:22.584749 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a95f3-1877-4f77-a765-72cca0636709 service placement] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:22.585097 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a95f3-1877-4f77-a765-72cca0636709 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:22.587355 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-621a95f3-1877-4f77-a765-72cca0636709 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:27:22.603057 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621a95f3-1877-4f77-a765-72cca0636709 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:27:22.605230 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621a95f3-1877-4f77-a765-72cca0636709 service placement] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:27:22.636876 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2321/4607] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:27:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:27:25.048769 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d86250-2315-44a2-a7ec-0add92f01d06 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:27:25.059776 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d86250-2315-44a2-a7ec-0add92f01d06 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:27:25.071083 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb75f2a2-f0e6-4dc5-91c4-a4f82fcdbdbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:27:25.071083 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb75f2a2-f0e6-4dc5-91c4-a4f82fcdbdbe service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:25.071083 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb75f2a2-f0e6-4dc5-91c4-a4f82fcdbdbe service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:25.071083 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb75f2a2-f0e6-4dc5-91c4-a4f82fcdbdbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:25.071652 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-fb75f2a2-f0e6-4dc5-91c4-a4f82fcdbdbe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:27:25.085102 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb75f2a2-f0e6-4dc5-91c4-a4f82fcdbdbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:27:25.087159 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb75f2a2-f0e6-4dc5-91c4-a4f82fcdbdbe service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:27:25.099354 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2287/4608] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:27:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:27:26.897561 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b1b5fd-ee0c-4e1b-b730-039cc6cfd4f4 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:26.898082 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b1b5fd-ee0c-4e1b-b730-039cc6cfd4f4 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:26.898174 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b1b5fd-ee0c-4e1b-b730-039cc6cfd4f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:26.942875 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-c5b1b5fd-ee0c-4e1b-b730-039cc6cfd4f4 None None] MFA Rules not processed for user `b398969c37454956a73bf459e0d37e61`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:27:26.944169 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c5b1b5fd-ee0c-4e1b-b730-039cc6cfd4f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:27:27.090946 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2322/4609] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:27:26 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:27:27.491671 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb1dafe-a365-4c83-bd99-1b8a42135d14 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:27.492322 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb1dafe-a365-4c83-bd99-1b8a42135d14 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:27.492322 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb1dafe-a365-4c83-bd99-1b8a42135d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:27.521326 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-3bb1dafe-a365-4c83-bd99-1b8a42135d14 None None] MFA Rules not processed for user `1a51643a51af4175b40a61a726eac80a`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:27:27.523071 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-3bb1dafe-a365-4c83-bd99-1b8a42135d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:27:27.539230 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2288/4610] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:27:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:27:27.616668 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111ecbfc-ef38-4fc4-87cc-2c084563c61b None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:27.618007 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111ecbfc-ef38-4fc4-87cc-2c084563c61b None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:27.618557 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111ecbfc-ef38-4fc4-87cc-2c084563c61b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:27.673287 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-111ecbfc-ef38-4fc4-87cc-2c084563c61b None None] MFA Rules not processed for user `1a51643a51af4175b40a61a726eac80a`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:27:27.673489 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-111ecbfc-ef38-4fc4-87cc-2c084563c61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:27:27.689564 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2323/4611] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:27:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:27:27.873825 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea61e20-403b-43d8-8fe1-2f54e1ee1d07 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:27.873825 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea61e20-403b-43d8-8fe1-2f54e1ee1d07 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:27.873825 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea61e20-403b-43d8-8fe1-2f54e1ee1d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:27.938244 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-1ea61e20-403b-43d8-8fe1-2f54e1ee1d07 None None] MFA Rules not processed for user `1a51643a51af4175b40a61a726eac80a`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:27:27.940536 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-1ea61e20-403b-43d8-8fe1-2f54e1ee1d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:27:27.966916 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2289/4612] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:27:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:27:28.328443 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856c70c-3a40-4106-b1ba-efc237cbb31b None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:28.330123 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856c70c-3a40-4106-b1ba-efc237cbb31b None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:28.330594 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856c70c-3a40-4106-b1ba-efc237cbb31b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:28.363059 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-3856c70c-3a40-4106-b1ba-efc237cbb31b None None] MFA Rules not processed for user `1a51643a51af4175b40a61a726eac80a`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:27:28.364667 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-3856c70c-3a40-4106-b1ba-efc237cbb31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:27:28.389483 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2324/4613] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:27:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:27:28.547277 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f9a31d-d3c4-4dc9-acf1-37bca0cff9c0 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:28.547810 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f9a31d-d3c4-4dc9-acf1-37bca0cff9c0 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:28.560248 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f9a31d-d3c4-4dc9-acf1-37bca0cff9c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:28.570052 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-94f9a31d-d3c4-4dc9-acf1-37bca0cff9c0 None None] MFA Rules not processed for user `1a51643a51af4175b40a61a726eac80a`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:27:28.571898 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-94f9a31d-d3c4-4dc9-acf1-37bca0cff9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:27:28.582297 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2290/4614] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:27:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:27:33.396313 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3856c70c-3a40-4106-b1ba-efc237cbb31b None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:27:33.398267 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-3856c70c-3a40-4106-b1ba-efc237cbb31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:27:33.459853 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3856c70c-3a40-4106-b1ba-efc237cbb31b None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:27:33.465665 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa96eb25-e741-4d0c-a4da-548b1a73173c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:27:33.466799 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96eb25-e741-4d0c-a4da-548b1a73173c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:33.467318 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96eb25-e741-4d0c-a4da-548b1a73173c admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:33.467834 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96eb25-e741-4d0c-a4da-548b1a73173c admin admin] PATH_INFO: `/v3/users/1382428c1e50441794230e9abc5f2d39` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:33.469262 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa96eb25-e741-4d0c-a4da-548b1a73173c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1382428c1e50441794230e9abc5f2d39)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:27:33.471221 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa96eb25-e741-4d0c-a4da-548b1a73173c admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:27:33.685867 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-aa96eb25-e741-4d0c-a4da-548b1a73173c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1382428c1e50441794230e9abc5f2d39'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:27:33.700883 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-aa96eb25-e741-4d0c-a4da-548b1a73173c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1382428c1e50441794230e9abc5f2d39'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:27:33.708198 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde041ae-313a-4d07-adb9-6973514dc448 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:33.709551 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde041ae-313a-4d07-adb9-6973514dc448 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:33.709748 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-aa96eb25-e741-4d0c-a4da-548b1a73173c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1382428c1e50441794230e9abc5f2d39'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:27:33.709901 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde041ae-313a-4d07-adb9-6973514dc448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:33.730422 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-fde041ae-313a-4d07-adb9-6973514dc448 None None] MFA Rules not processed for user `22a06bece449427d91289ade79c94822`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:27:33.731989 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-fde041ae-313a-4d07-adb9-6973514dc448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:27:33.791158 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-aa96eb25-e741-4d0c-a4da-548b1a73173c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1382428c1e50441794230e9abc5f2d39'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:27:33.793337 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-aa96eb25-e741-4d0c-a4da-548b1a73173c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1382428c1e50441794230e9abc5f2d39'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:27:33.802249 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2325/4615] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:27:33 2022] DELETE /identity/v3/users/1382428c1e50441794230e9abc5f2d39 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:27:33.806892 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca88ea3-8c8e-455b-b3f7-d30973fd1ca5 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:33.807438 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca88ea3-8c8e-455b-b3f7-d30973fd1ca5 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:33.808076 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca88ea3-8c8e-455b-b3f7-d30973fd1ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:33.839125 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2291/4616] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:27:33 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:27:33.848959 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a57118b-3599-4303-9140-29af2291876f None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:33.849384 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a57118b-3599-4303-9140-29af2291876f None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:33.849786 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a57118b-3599-4303-9140-29af2291876f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:33.854429 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-9ca88ea3-8c8e-455b-b3f7-d30973fd1ca5 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:27:33.858496 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-9ca88ea3-8c8e-455b-b3f7-d30973fd1ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:27:33.890800 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-3a57118b-3599-4303-9140-29af2291876f None None] MFA Rules not processed for user `22a06bece449427d91289ade79c94822`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:27:33.898562 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-3a57118b-3599-4303-9140-29af2291876f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:27:34.026992 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2326/4617] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:27:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:27:34.042139 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca88ea3-8c8e-455b-b3f7-d30973fd1ca5 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:27:34.042139 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-9ca88ea3-8c8e-455b-b3f7-d30973fd1ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:27:34.043364 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2292/4618] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:27:33 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:27:34.126135 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca88ea3-8c8e-455b-b3f7-d30973fd1ca5 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:27:34.135335 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2829456d-e925-43d9-b016-17cdfc5507fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:27:34.136094 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2829456d-e925-43d9-b016-17cdfc5507fa service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:34.136382 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2829456d-e925-43d9-b016-17cdfc5507fa service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:34.136722 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2829456d-e925-43d9-b016-17cdfc5507fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:34.172785 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2829456d-e925-43d9-b016-17cdfc5507fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:27:34.174899 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2829456d-e925-43d9-b016-17cdfc5507fa service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:27:34.187251 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2327/4619] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:27:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:27:34.894790 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a57118b-3599-4303-9140-29af2291876f None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:27:34.896767 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-3a57118b-3599-4303-9140-29af2291876f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:27:34.929754 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a57118b-3599-4303-9140-29af2291876f None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:27:34.951263 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5607df28-d444-40a3-886a-1832b9e016fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:27:34.952186 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5607df28-d444-40a3-886a-1832b9e016fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:34.952701 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5607df28-d444-40a3-886a-1832b9e016fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:34.962876 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5607df28-d444-40a3-886a-1832b9e016fe admin admin] PATH_INFO: `/v3/projects/8bf1c9f99ca0403f9b22031eb90ffe8f` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:34.962876 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5607df28-d444-40a3-886a-1832b9e016fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bf1c9f99ca0403f9b22031eb90ffe8f)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:27:34.962876 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5607df28-d444-40a3-886a-1832b9e016fe admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:27:35.103855 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-5607df28-d444-40a3-886a-1832b9e016fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bf1c9f99ca0403f9b22031eb90ffe8f', 'request_id': 'req-5607df28-d444-40a3-886a-1832b9e016fe'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:27:35.110163 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-5607df28-d444-40a3-886a-1832b9e016fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bf1c9f99ca0403f9b22031eb90ffe8f', 'request_id': 'req-5607df28-d444-40a3-886a-1832b9e016fe'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:27:35.119676 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-5607df28-d444-40a3-886a-1832b9e016fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bf1c9f99ca0403f9b22031eb90ffe8f', 'request_id': 'req-5607df28-d444-40a3-886a-1832b9e016fe'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:27:35.186105 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-5607df28-d444-40a3-886a-1832b9e016fe admin admin] The token cache is being invalidate because project 8bf1c9f99ca0403f9b22031eb90ffe8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:27:35.187692 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-5607df28-d444-40a3-886a-1832b9e016fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:27:35.188585 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-5607df28-d444-40a3-886a-1832b9e016fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:27:35.191819 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2293/4620] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:27:34 2022] DELETE /identity/v3/projects/8bf1c9f99ca0403f9b22031eb90ffe8f => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:27:35.199966 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2829456d-e925-43d9-b016-17cdfc5507fa service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:27:35.214107 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2829456d-e925-43d9-b016-17cdfc5507fa service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:27:35.286914 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9161c7-a319-4714-bbc2-bd5553fdf69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:27:35.288048 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9161c7-a319-4714-bbc2-bd5553fdf69d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:35.288435 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9161c7-a319-4714-bbc2-bd5553fdf69d admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:35.288816 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9161c7-a319-4714-bbc2-bd5553fdf69d admin admin] PATH_INFO: `/v3/users/73221847bd2941a18e2759995375417f` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:35.290547 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9161c7-a319-4714-bbc2-bd5553fdf69d admin admin] RBAC: Authorizing `identity:delete_user(user_id=73221847bd2941a18e2759995375417f)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:27:35.292673 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9161c7-a319-4714-bbc2-bd5553fdf69d admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:27:35.548068 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5f9161c7-a319-4714-bbc2-bd5553fdf69d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73221847bd2941a18e2759995375417f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:27:35.570922 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5f9161c7-a319-4714-bbc2-bd5553fdf69d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73221847bd2941a18e2759995375417f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:27:35.580126 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5f9161c7-a319-4714-bbc2-bd5553fdf69d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73221847bd2941a18e2759995375417f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:27:35.680765 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5607df28-d444-40a3-886a-1832b9e016fe admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:27:35.682097 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-5607df28-d444-40a3-886a-1832b9e016fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:27:35.688154 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5f9161c7-a319-4714-bbc2-bd5553fdf69d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73221847bd2941a18e2759995375417f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:27:35.688844 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5f9161c7-a319-4714-bbc2-bd5553fdf69d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73221847bd2941a18e2759995375417f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:27:35.701538 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2328/4621] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:27:35 2022] DELETE /identity/v3/users/73221847bd2941a18e2759995375417f => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:27:35.708571 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5607df28-d444-40a3-886a-1832b9e016fe admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:27:35.778040 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26c3f6d-de73-41d8-b524-553e3cfe058e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:27:35.779031 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c3f6d-de73-41d8-b524-553e3cfe058e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:35.779590 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c3f6d-de73-41d8-b524-553e3cfe058e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:35.780018 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c3f6d-de73-41d8-b524-553e3cfe058e admin admin] PATH_INFO: `/v3/users/1a51643a51af4175b40a61a726eac80a` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:35.792796 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26c3f6d-de73-41d8-b524-553e3cfe058e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a51643a51af4175b40a61a726eac80a)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:27:35.792796 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26c3f6d-de73-41d8-b524-553e3cfe058e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:27:36.155468 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b26c3f6d-de73-41d8-b524-553e3cfe058e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a51643a51af4175b40a61a726eac80a'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:27:36.166069 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b26c3f6d-de73-41d8-b524-553e3cfe058e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a51643a51af4175b40a61a726eac80a'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:27:36.167501 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b26c3f6d-de73-41d8-b524-553e3cfe058e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a51643a51af4175b40a61a726eac80a'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:27:36.237057 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b26c3f6d-de73-41d8-b524-553e3cfe058e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a51643a51af4175b40a61a726eac80a'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:27:36.262362 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b26c3f6d-de73-41d8-b524-553e3cfe058e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a51643a51af4175b40a61a726eac80a'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:27:36.277800 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2294/4622] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:27:35 2022] DELETE /identity/v3/users/1a51643a51af4175b40a61a726eac80a => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:27:36.442489 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9161c7-a319-4714-bbc2-bd5553fdf69d admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:27:36.444005 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-5f9161c7-a319-4714-bbc2-bd5553fdf69d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:27:36.461070 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9161c7-a319-4714-bbc2-bd5553fdf69d admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:27:36.557785 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c91c36-9729-4831-a04c-74dda846847e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:27:36.558940 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c91c36-9729-4831-a04c-74dda846847e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:36.559444 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c91c36-9729-4831-a04c-74dda846847e admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:36.560045 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c91c36-9729-4831-a04c-74dda846847e admin admin] PATH_INFO: `/v3/projects/f9af314372304f59bb4feeed38d832c0` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:36.561650 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c91c36-9729-4831-a04c-74dda846847e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9af314372304f59bb4feeed38d832c0)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:27:36.564865 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c91c36-9729-4831-a04c-74dda846847e admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:27:36.670940 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a5c91c36-9729-4831-a04c-74dda846847e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9af314372304f59bb4feeed38d832c0', 'request_id': 'req-a5c91c36-9729-4831-a04c-74dda846847e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:27:36.677517 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a5c91c36-9729-4831-a04c-74dda846847e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9af314372304f59bb4feeed38d832c0', 'request_id': 'req-a5c91c36-9729-4831-a04c-74dda846847e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:27:36.687069 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26c3f6d-de73-41d8-b524-553e3cfe058e admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:27:36.688594 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b26c3f6d-de73-41d8-b524-553e3cfe058e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:27:36.708203 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26c3f6d-de73-41d8-b524-553e3cfe058e admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:27:36.756747 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a5c91c36-9729-4831-a04c-74dda846847e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9af314372304f59bb4feeed38d832c0', 'request_id': 'req-a5c91c36-9729-4831-a04c-74dda846847e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:27:36.773942 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a5c91c36-9729-4831-a04c-74dda846847e admin admin] The token cache is being invalidate because project f9af314372304f59bb4feeed38d832c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:27:36.774252 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a5c91c36-9729-4831-a04c-74dda846847e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:27:36.777158 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a5c91c36-9729-4831-a04c-74dda846847e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:27:36.781723 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2329/4623] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:27:36 2022] DELETE /identity/v3/projects/f9af314372304f59bb4feeed38d832c0 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:27:36.786395 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c91c36-9729-4831-a04c-74dda846847e admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:27:36.790392 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-a5c91c36-9729-4831-a04c-74dda846847e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:27:36.821956 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3184cf57-320d-49e4-8d99-36d979584ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:27:36.823020 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3184cf57-320d-49e4-8d99-36d979584ff5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:36.823932 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3184cf57-320d-49e4-8d99-36d979584ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:36.824309 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3184cf57-320d-49e4-8d99-36d979584ff5 admin admin] PATH_INFO: `/v3/projects/c39236c4fcb74ea2838acddd315e00ff` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:36.826557 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3184cf57-320d-49e4-8d99-36d979584ff5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c39236c4fcb74ea2838acddd315e00ff)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:27:36.829630 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3184cf57-320d-49e4-8d99-36d979584ff5 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:27:36.895095 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c91c36-9729-4831-a04c-74dda846847e admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:27:36.899793 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcafd29d-18ed-4896-ab9b-5970c990e6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:27:36.900664 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcafd29d-18ed-4896-ab9b-5970c990e6cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:36.900942 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcafd29d-18ed-4896-ab9b-5970c990e6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:36.901212 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcafd29d-18ed-4896-ab9b-5970c990e6cd admin admin] PATH_INFO: `/v3/users/cbbc9ad2fa3545b6b8c6245afb39ad89` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:36.902406 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcafd29d-18ed-4896-ab9b-5970c990e6cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbbc9ad2fa3545b6b8c6245afb39ad89)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:27:36.904395 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcafd29d-18ed-4896-ab9b-5970c990e6cd admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:27:37.053124 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3184cf57-320d-49e4-8d99-36d979584ff5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c39236c4fcb74ea2838acddd315e00ff', 'request_id': 'req-3184cf57-320d-49e4-8d99-36d979584ff5'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:27:37.059245 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3184cf57-320d-49e4-8d99-36d979584ff5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c39236c4fcb74ea2838acddd315e00ff', 'request_id': 'req-3184cf57-320d-49e4-8d99-36d979584ff5'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:27:37.069380 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3184cf57-320d-49e4-8d99-36d979584ff5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c39236c4fcb74ea2838acddd315e00ff', 'request_id': 'req-3184cf57-320d-49e4-8d99-36d979584ff5'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:27:37.199210 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-bcafd29d-18ed-4896-ab9b-5970c990e6cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbbc9ad2fa3545b6b8c6245afb39ad89'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:27:37.215959 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3184cf57-320d-49e4-8d99-36d979584ff5 admin admin] The token cache is being invalidate because project c39236c4fcb74ea2838acddd315e00ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:27:37.218209 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3184cf57-320d-49e4-8d99-36d979584ff5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:27:37.218940 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3184cf57-320d-49e4-8d99-36d979584ff5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:27:37.223147 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2295/4624] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:27:36 2022] DELETE /identity/v3/projects/c39236c4fcb74ea2838acddd315e00ff => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:27:37.229798 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-bcafd29d-18ed-4896-ab9b-5970c990e6cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbbc9ad2fa3545b6b8c6245afb39ad89'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:27:37.230895 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c21c4-765d-4925-a6cc-b8ccb501f7ef None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:37.232393 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c21c4-765d-4925-a6cc-b8ccb501f7ef None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:37.232816 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c21c4-765d-4925-a6cc-b8ccb501f7ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:37.238181 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-bcafd29d-18ed-4896-ab9b-5970c990e6cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbbc9ad2fa3545b6b8c6245afb39ad89'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:27:37.262454 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-d29c21c4-765d-4925-a6cc-b8ccb501f7ef None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:27:37.264654 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-d29c21c4-765d-4925-a6cc-b8ccb501f7ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:27:37.313242 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-bcafd29d-18ed-4896-ab9b-5970c990e6cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbbc9ad2fa3545b6b8c6245afb39ad89'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:27:37.313990 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-bcafd29d-18ed-4896-ab9b-5970c990e6cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbbc9ad2fa3545b6b8c6245afb39ad89'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:27:37.326142 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2330/4625] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:27:36 2022] DELETE /identity/v3/users/cbbc9ad2fa3545b6b8c6245afb39ad89 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:27:37.361549 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2296/4626] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:27:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:27:37.377523 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ecb1c-d760-4a63-8ca0-cc703766cc86 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:37.377885 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ecb1c-d760-4a63-8ca0-cc703766cc86 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:37.380845 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ecb1c-d760-4a63-8ca0-cc703766cc86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:37.415601 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-9e1ecb1c-d760-4a63-8ca0-cc703766cc86 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:27:37.416984 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-9e1ecb1c-d760-4a63-8ca0-cc703766cc86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:27:37.494772 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2331/4627] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:27:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:27:37.498776 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29c21c4-765d-4925-a6cc-b8ccb501f7ef None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:27:37.509125 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29c21c4-765d-4925-a6cc-b8ccb501f7ef None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:27:37.514218 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eed915-b940-42f8-be9b-fffca6d9a164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:27:37.514880 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eed915-b940-42f8-be9b-fffca6d9a164 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:37.515163 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eed915-b940-42f8-be9b-fffca6d9a164 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:37.515443 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eed915-b940-42f8-be9b-fffca6d9a164 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:37.516205 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eed915-b940-42f8-be9b-fffca6d9a164 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:27:37.516536 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eed915-b940-42f8-be9b-fffca6d9a164 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:27:37.518111 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eed915-b940-42f8-be9b-fffca6d9a164 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:27:37.530821 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2297/4628] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:27:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:27:37.542225 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1ecb1c-d760-4a63-8ca0-cc703766cc86 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:27:37.553887 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1ecb1c-d760-4a63-8ca0-cc703766cc86 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:27:37.573706 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73003b4-7733-49d1-bc64-66d22a9ed5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:27:37.573706 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73003b4-7733-49d1-bc64-66d22a9ed5f0 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:37.573706 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73003b4-7733-49d1-bc64-66d22a9ed5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:37.573706 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73003b4-7733-49d1-bc64-66d22a9ed5f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:37.574575 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73003b4-7733-49d1-bc64-66d22a9ed5f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:27:37.574575 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73003b4-7733-49d1-bc64-66d22a9ed5f0 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:27:37.698155 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2332/4629] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:27:37 2022] POST /identity/v3/projects => generated 385 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:27:37.698312 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eed915-b940-42f8-be9b-fffca6d9a164 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:27:37.716416 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eed915-b940-42f8-be9b-fffca6d9a164 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:27:37.816970 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed2df0-02a9-4a17-99f5-4e4a7f75a788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:27:37.817841 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed2df0-02a9-4a17-99f5-4e4a7f75a788 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:37.822749 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed2df0-02a9-4a17-99f5-4e4a7f75a788 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:37.822749 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed2df0-02a9-4a17-99f5-4e4a7f75a788 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:37.822749 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ed2df0-02a9-4a17-99f5-4e4a7f75a788 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:27:37.822749 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ed2df0-02a9-4a17-99f5-4e4a7f75a788 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:27:37.923384 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2298/4630] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:27:37 2022] POST /identity/v3/users => generated 293 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:27:37.929343 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73003b4-7733-49d1-bc64-66d22a9ed5f0 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:27:37.943221 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73003b4-7733-49d1-bc64-66d22a9ed5f0 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:27:37.949228 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee136915-fb64-4909-aff9-8e49d937b13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:27:37.949980 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee136915-fb64-4909-aff9-8e49d937b13d admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:37.950699 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee136915-fb64-4909-aff9-8e49d937b13d admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:37.950979 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee136915-fb64-4909-aff9-8e49d937b13d admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:37.951907 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee136915-fb64-4909-aff9-8e49d937b13d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:27:37.956660 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee136915-fb64-4909-aff9-8e49d937b13d admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:27:37.975029 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2333/4631] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:27:37 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:27:37.976367 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed2df0-02a9-4a17-99f5-4e4a7f75a788 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:27:37.986855 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed2df0-02a9-4a17-99f5-4e4a7f75a788 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:27:37.991795 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c787a6-4a6d-48a5-bc91-73910328cb9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:27:37.992473 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c787a6-4a6d-48a5-bc91-73910328cb9e admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:37.992749 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c787a6-4a6d-48a5-bc91-73910328cb9e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:37.993023 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c787a6-4a6d-48a5-bc91-73910328cb9e admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:37.993748 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c787a6-4a6d-48a5-bc91-73910328cb9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:27:37.995361 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c787a6-4a6d-48a5-bc91-73910328cb9e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:27:38.005868 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2299/4632] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:27:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:27:38.010150 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee136915-fb64-4909-aff9-8e49d937b13d admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:27:38.022048 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee136915-fb64-4909-aff9-8e49d937b13d admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:27:38.028569 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7c06a5-13e6-43eb-a268-5522f97392a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:27:38.029779 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c06a5-13e6-43eb-a268-5522f97392a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:38.030162 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c06a5-13e6-43eb-a268-5522f97392a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:38.030498 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c06a5-13e6-43eb-a268-5522f97392a3 admin admin] PATH_INFO: `/v3/projects/4f45ca24e9b741df963be459976108ea/users/ff045ac8f496497286701d2fcdc5d7e7/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:38.052867 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c787a6-4a6d-48a5-bc91-73910328cb9e admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:27:38.055667 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-77c787a6-4a6d-48a5-bc91-73910328cb9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:27:38.077491 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7c06a5-13e6-43eb-a268-5522f97392a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f45ca24e9b741df963be459976108ea, user_id=ff045ac8f496497286701d2fcdc5d7e7, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:27:38.086041 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7c06a5-13e6-43eb-a268-5522f97392a3 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:27:38.094644 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c787a6-4a6d-48a5-bc91-73910328cb9e admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:27:38.104909 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae72f4ba-4a59-4363-9174-880087e980d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:27:38.105805 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72f4ba-4a59-4363-9174-880087e980d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:38.106251 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72f4ba-4a59-4363-9174-880087e980d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:38.106534 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72f4ba-4a59-4363-9174-880087e980d6 admin admin] PATH_INFO: `/v3/projects/402205919cca433186bd6c32bdbe970b` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:38.108105 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae72f4ba-4a59-4363-9174-880087e980d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=402205919cca433186bd6c32bdbe970b)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:27:38.110622 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae72f4ba-4a59-4363-9174-880087e980d6 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:27:38.180682 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2334/4633] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:27:38 2022] PUT /identity/v3/projects/4f45ca24e9b741df963be459976108ea/users/ff045ac8f496497286701d2fcdc5d7e7/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:27:38.181590 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7c06a5-13e6-43eb-a268-5522f97392a3 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:27:38.183171 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-5c7c06a5-13e6-43eb-a268-5522f97392a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:27:38.262966 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7c06a5-13e6-43eb-a268-5522f97392a3 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:27:38.267805 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ae72f4ba-4a59-4363-9174-880087e980d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '402205919cca433186bd6c32bdbe970b', 'request_id': 'req-ae72f4ba-4a59-4363-9174-880087e980d6'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:27:38.276302 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ae72f4ba-4a59-4363-9174-880087e980d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '402205919cca433186bd6c32bdbe970b', 'request_id': 'req-ae72f4ba-4a59-4363-9174-880087e980d6'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:27:38.286534 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ae72f4ba-4a59-4363-9174-880087e980d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '402205919cca433186bd6c32bdbe970b', 'request_id': 'req-ae72f4ba-4a59-4363-9174-880087e980d6'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:27:38.363797 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e858c1-ba51-4ade-9a65-365a6e4ef1fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:27:38.364642 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e858c1-ba51-4ade-9a65-365a6e4ef1fb service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:38.364925 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e858c1-ba51-4ade-9a65-365a6e4ef1fb service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:38.365269 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e858c1-ba51-4ade-9a65-365a6e4ef1fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:38.367165 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-78e858c1-ba51-4ade-9a65-365a6e4ef1fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:27:38.378350 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ae72f4ba-4a59-4363-9174-880087e980d6 admin admin] The token cache is being invalidate because project 402205919cca433186bd6c32bdbe970b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:27:38.378638 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ae72f4ba-4a59-4363-9174-880087e980d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:27:38.379306 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ae72f4ba-4a59-4363-9174-880087e980d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:27:38.384819 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2300/4634] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:27:38 2022] DELETE /identity/v3/projects/402205919cca433186bd6c32bdbe970b => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:27:38.386099 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d342a7e-3ff3-4764-8752-0ff80a6bd5d4 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:38.386382 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d342a7e-3ff3-4764-8752-0ff80a6bd5d4 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:38.386654 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d342a7e-3ff3-4764-8752-0ff80a6bd5d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:38.397946 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e858c1-ba51-4ade-9a65-365a6e4ef1fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:27:38.399620 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e858c1-ba51-4ade-9a65-365a6e4ef1fb service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:27:38.418750 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-3d342a7e-3ff3-4764-8752-0ff80a6bd5d4 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:27:38.420003 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-3d342a7e-3ff3-4764-8752-0ff80a6bd5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:27:38.420582 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2335/4635] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:27:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:27:38.422154 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a8b451-de41-4a0d-963d-81410261dbdf None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:38.422456 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a8b451-de41-4a0d-963d-81410261dbdf None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:38.422729 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a8b451-de41-4a0d-963d-81410261dbdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:38.443465 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-05a8b451-de41-4a0d-963d-81410261dbdf None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:27:38.444715 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-05a8b451-de41-4a0d-963d-81410261dbdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:27:38.517156 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2301/4636] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:27:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:27:38.527816 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d342a7e-3ff3-4764-8752-0ff80a6bd5d4 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:27:38.529604 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-3d342a7e-3ff3-4764-8752-0ff80a6bd5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:27:38.547937 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2336/4637] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:27:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:27:38.551385 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d885a5c-830d-4d0c-8065-25b45407a9d4 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:38.552391 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d885a5c-830d-4d0c-8065-25b45407a9d4 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:38.552897 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d885a5c-830d-4d0c-8065-25b45407a9d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:38.574369 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-6d885a5c-830d-4d0c-8065-25b45407a9d4 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:27:38.576717 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-6d885a5c-830d-4d0c-8065-25b45407a9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:27:38.599070 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2337/4638] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:27:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:27:38.601202 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d885a5c-830d-4d0c-8065-25b45407a9d4 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:27:38.614168 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d885a5c-830d-4d0c-8065-25b45407a9d4 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:27:38.614530 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d342a7e-3ff3-4764-8752-0ff80a6bd5d4 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:27:38.619245 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a830e7c3-40fa-434e-8e44-29ce16e30c25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:27:38.619933 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830e7c3-40fa-434e-8e44-29ce16e30c25 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:38.620218 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830e7c3-40fa-434e-8e44-29ce16e30c25 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:38.620495 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830e7c3-40fa-434e-8e44-29ce16e30c25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:38.626077 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684622a2-013c-4e6e-87de-95f9db8b90c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:27:38.626763 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684622a2-013c-4e6e-87de-95f9db8b90c3 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:38.627240 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684622a2-013c-4e6e-87de-95f9db8b90c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:38.627755 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684622a2-013c-4e6e-87de-95f9db8b90c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:38.629954 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684622a2-013c-4e6e-87de-95f9db8b90c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:27:38.630449 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684622a2-013c-4e6e-87de-95f9db8b90c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:27:38.640069 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a830e7c3-40fa-434e-8e44-29ce16e30c25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:27:38.640525 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684622a2-013c-4e6e-87de-95f9db8b90c3 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:27:38.640687 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a830e7c3-40fa-434e-8e44-29ce16e30c25 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:27:38.646685 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2302/4639] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:27:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:27:38.654900 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2338/4640] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:27:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:27:38.656770 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a830e7c3-40fa-434e-8e44-29ce16e30c25 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:27:38.672510 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a830e7c3-40fa-434e-8e44-29ce16e30c25 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:27:38.682327 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af36a9e-78a6-4069-8764-565027412a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:27:38.683292 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af36a9e-78a6-4069-8764-565027412a64 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:38.683804 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af36a9e-78a6-4069-8764-565027412a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:38.684761 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af36a9e-78a6-4069-8764-565027412a64 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:38.685810 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af36a9e-78a6-4069-8764-565027412a64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:27:38.689522 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af36a9e-78a6-4069-8764-565027412a64 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:27:38.875899 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2303/4641] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:27:38 2022] POST /identity/v3/projects => generated 367 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:27:38.876934 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684622a2-013c-4e6e-87de-95f9db8b90c3 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:27:38.892524 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684622a2-013c-4e6e-87de-95f9db8b90c3 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:27:38.980675 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157f79ec-c1d7-4b37-84d6-2af495c047c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:27:38.981357 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f79ec-c1d7-4b37-84d6-2af495c047c9 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:38.981758 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f79ec-c1d7-4b37-84d6-2af495c047c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:38.982067 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f79ec-c1d7-4b37-84d6-2af495c047c9 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:38.983031 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157f79ec-c1d7-4b37-84d6-2af495c047c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:27:38.985202 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157f79ec-c1d7-4b37-84d6-2af495c047c9 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:27:39.133431 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af36a9e-78a6-4069-8764-565027412a64 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:27:39.138532 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2339/4642] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:27:38 2022] POST /identity/v3/users => generated 284 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:27:39.155527 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af36a9e-78a6-4069-8764-565027412a64 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:27:39.161159 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ac9dd-42d5-4edf-b79c-bb95feca6e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:27:39.161450 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ac9dd-42d5-4edf-b79c-bb95feca6e08 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:39.161743 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ac9dd-42d5-4edf-b79c-bb95feca6e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:39.162099 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ac9dd-42d5-4edf-b79c-bb95feca6e08 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:39.162820 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398ac9dd-42d5-4edf-b79c-bb95feca6e08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:27:39.164446 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398ac9dd-42d5-4edf-b79c-bb95feca6e08 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:27:39.180639 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2304/4643] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:27:39 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:27:39.182166 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157f79ec-c1d7-4b37-84d6-2af495c047c9 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:27:39.194874 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157f79ec-c1d7-4b37-84d6-2af495c047c9 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:27:39.201408 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a5d60a-7ce1-4bf7-8009-7ada5b449cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:27:39.202077 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a5d60a-7ce1-4bf7-8009-7ada5b449cb9 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:39.202358 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a5d60a-7ce1-4bf7-8009-7ada5b449cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:39.202631 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a5d60a-7ce1-4bf7-8009-7ada5b449cb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:39.203353 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a5d60a-7ce1-4bf7-8009-7ada5b449cb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:27:39.204988 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a5d60a-7ce1-4bf7-8009-7ada5b449cb9 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:27:39.216233 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2340/4644] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:27:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:27:39.220541 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ac9dd-42d5-4edf-b79c-bb95feca6e08 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:27:39.231709 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ac9dd-42d5-4edf-b79c-bb95feca6e08 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:27:39.236760 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b864da-0faf-4c21-a9e9-42464ab0a86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:27:39.238733 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b864da-0faf-4c21-a9e9-42464ab0a86e admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:39.239094 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b864da-0faf-4c21-a9e9-42464ab0a86e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:39.239383 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b864da-0faf-4c21-a9e9-42464ab0a86e admin admin] PATH_INFO: `/v3/projects/51bdb907e2014a05815af94bc5cff92d/users/d698e25b4c5d409c8f14c353218baac2/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:39.256938 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b864da-0faf-4c21-a9e9-42464ab0a86e admin admin] RBAC: Authorizing `identity:create_grant(project_id=51bdb907e2014a05815af94bc5cff92d, user_id=d698e25b4c5d409c8f14c353218baac2, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:27:39.259818 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b864da-0faf-4c21-a9e9-42464ab0a86e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:27:39.335948 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2305/4645] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:27:39 2022] PUT /identity/v3/projects/51bdb907e2014a05815af94bc5cff92d/users/d698e25b4c5d409c8f14c353218baac2/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:27:39.346653 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d789460-53dc-4a89-af79-66bccd6ae7df None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:39.347687 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d789460-53dc-4a89-af79-66bccd6ae7df None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:39.348478 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d789460-53dc-4a89-af79-66bccd6ae7df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:39.377187 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-5d789460-53dc-4a89-af79-66bccd6ae7df None None] MFA Rules not processed for user `d698e25b4c5d409c8f14c353218baac2`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:27:39.378946 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-5d789460-53dc-4a89-af79-66bccd6ae7df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:27:39.454285 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2341/4646] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:27:39 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:27:39.466378 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b864da-0faf-4c21-a9e9-42464ab0a86e admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:27:39.469010 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-41b864da-0faf-4c21-a9e9-42464ab0a86e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:27:39.528180 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b864da-0faf-4c21-a9e9-42464ab0a86e admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:27:39.531906 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce3fbd-b07e-4f88-baa3-82968029b998 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b5cb86f190f4fcfb06d66cb8f14643f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:27:39.532550 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce3fbd-b07e-4f88-baa3-82968029b998 service glance] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:39.532836 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce3fbd-b07e-4f88-baa3-82968029b998 service glance] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:39.533114 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce3fbd-b07e-4f88-baa3-82968029b998 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:39.542432 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afce3fbd-b07e-4f88-baa3-82968029b998 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:27:39.544027 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afce3fbd-b07e-4f88-baa3-82968029b998 service glance] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:27:39.553617 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2306/4647] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:27:39 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:27:40.613518 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b0cfae-6401-4fc6-95b8-c5792c890a7a None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:40.613963 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b0cfae-6401-4fc6-95b8-c5792c890a7a None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:40.614308 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b0cfae-6401-4fc6-95b8-c5792c890a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:40.683547 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-c8b0cfae-6401-4fc6-95b8-c5792c890a7a None None] MFA Rules not processed for user `ff045ac8f496497286701d2fcdc5d7e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:27:40.685680 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c8b0cfae-6401-4fc6-95b8-c5792c890a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:27:40.787637 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2342/4648] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:27:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:27:42.020894 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce3fbd-b07e-4f88-baa3-82968029b998 service glance] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:27:42.022408 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-afce3fbd-b07e-4f88-baa3-82968029b998 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:27:42.140207 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce3fbd-b07e-4f88-baa3-82968029b998 service glance] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:27:42.148842 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0199b6d1-9d14-4ff4-9533-c9a18019fc49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:27:42.149732 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0199b6d1-9d14-4ff4-9533-c9a18019fc49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:42.150019 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0199b6d1-9d14-4ff4-9533-c9a18019fc49 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:42.150295 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0199b6d1-9d14-4ff4-9533-c9a18019fc49 admin admin] PATH_INFO: `/v3/users/ff045ac8f496497286701d2fcdc5d7e7` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:42.151526 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0199b6d1-9d14-4ff4-9533-c9a18019fc49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff045ac8f496497286701d2fcdc5d7e7)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:27:42.156793 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0199b6d1-9d14-4ff4-9533-c9a18019fc49 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:27:42.291642 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0199b6d1-9d14-4ff4-9533-c9a18019fc49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff045ac8f496497286701d2fcdc5d7e7'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:27:42.301839 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0199b6d1-9d14-4ff4-9533-c9a18019fc49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff045ac8f496497286701d2fcdc5d7e7'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:27:42.301839 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0199b6d1-9d14-4ff4-9533-c9a18019fc49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff045ac8f496497286701d2fcdc5d7e7'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:27:42.356736 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0199b6d1-9d14-4ff4-9533-c9a18019fc49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff045ac8f496497286701d2fcdc5d7e7'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:27:42.371639 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0199b6d1-9d14-4ff4-9533-c9a18019fc49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff045ac8f496497286701d2fcdc5d7e7'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:27:42.383397 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2307/4649] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:27:42 2022] DELETE /identity/v3/users/ff045ac8f496497286701d2fcdc5d7e7 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:27:42.701362 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b0cfae-6401-4fc6-95b8-c5792c890a7a None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:27:42.717315 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b0cfae-6401-4fc6-95b8-c5792c890a7a None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:27:42.795875 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e673be4d-10b8-44d5-80be-8887b16fa329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:27:42.796938 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e673be4d-10b8-44d5-80be-8887b16fa329 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:42.797224 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e673be4d-10b8-44d5-80be-8887b16fa329 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:42.797656 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e673be4d-10b8-44d5-80be-8887b16fa329 admin admin] PATH_INFO: `/v3/projects/4f45ca24e9b741df963be459976108ea` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:42.799188 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e673be4d-10b8-44d5-80be-8887b16fa329 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f45ca24e9b741df963be459976108ea)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:27:42.805013 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e673be4d-10b8-44d5-80be-8887b16fa329 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:27:42.954667 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e673be4d-10b8-44d5-80be-8887b16fa329 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f45ca24e9b741df963be459976108ea', 'request_id': 'req-e673be4d-10b8-44d5-80be-8887b16fa329'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:27:42.961070 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e673be4d-10b8-44d5-80be-8887b16fa329 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f45ca24e9b741df963be459976108ea', 'request_id': 'req-e673be4d-10b8-44d5-80be-8887b16fa329'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:27:43.031145 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e673be4d-10b8-44d5-80be-8887b16fa329 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f45ca24e9b741df963be459976108ea', 'request_id': 'req-e673be4d-10b8-44d5-80be-8887b16fa329'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:27:43.051451 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e673be4d-10b8-44d5-80be-8887b16fa329 admin admin] The token cache is being invalidate because project 4f45ca24e9b741df963be459976108ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:27:43.052455 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e673be4d-10b8-44d5-80be-8887b16fa329 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:27:43.053806 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e673be4d-10b8-44d5-80be-8887b16fa329 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:27:43.055534 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2343/4650] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:27:42 2022] DELETE /identity/v3/projects/4f45ca24e9b741df963be459976108ea => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:27:43.061209 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf341e2-860b-4231-830e-69e6b1729fae None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:43.061702 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf341e2-860b-4231-830e-69e6b1729fae None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:43.061808 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf341e2-860b-4231-830e-69e6b1729fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:43.086983 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-aaf341e2-860b-4231-830e-69e6b1729fae None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:27:43.088570 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-aaf341e2-860b-4231-830e-69e6b1729fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:27:43.162646 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2308/4651] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:27:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:27:43.171937 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d3fca7-61a4-410d-84df-deece200edc5 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:43.172261 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d3fca7-61a4-410d-84df-deece200edc5 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:43.172486 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d3fca7-61a4-410d-84df-deece200edc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:43.197756 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-40d3fca7-61a4-410d-84df-deece200edc5 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:27:43.199559 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-40d3fca7-61a4-410d-84df-deece200edc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:27:43.215734 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2344/4652] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:27:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:27:43.220237 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf341e2-860b-4231-830e-69e6b1729fae None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:27:43.233154 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf341e2-860b-4231-830e-69e6b1729fae None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:27:43.239393 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1e2292-8f1b-429d-b3e8-90f6c50fa57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:27:43.240146 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e2292-8f1b-429d-b3e8-90f6c50fa57d admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:43.240437 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e2292-8f1b-429d-b3e8-90f6c50fa57d admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:43.240822 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e2292-8f1b-429d-b3e8-90f6c50fa57d admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:43.241743 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1e2292-8f1b-429d-b3e8-90f6c50fa57d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:27:43.242130 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1e2292-8f1b-429d-b3e8-90f6c50fa57d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:27:43.243943 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1e2292-8f1b-429d-b3e8-90f6c50fa57d admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:27:43.269874 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2309/4653] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:27:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:27:43.277300 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d3fca7-61a4-410d-84df-deece200edc5 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:27:43.288166 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d3fca7-61a4-410d-84df-deece200edc5 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:27:43.294338 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69131ca-106a-4a2d-997c-24a10d348b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:27:43.295623 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69131ca-106a-4a2d-997c-24a10d348b75 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:43.295623 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69131ca-106a-4a2d-997c-24a10d348b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:43.296014 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69131ca-106a-4a2d-997c-24a10d348b75 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:43.296807 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69131ca-106a-4a2d-997c-24a10d348b75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:27:43.299525 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69131ca-106a-4a2d-997c-24a10d348b75 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:27:43.374736 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2345/4654] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:27:43 2022] POST /identity/v3/projects => generated 377 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:27:43.375949 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1e2292-8f1b-429d-b3e8-90f6c50fa57d admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:27:43.387262 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1e2292-8f1b-429d-b3e8-90f6c50fa57d admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:27:43.446208 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f91cdcf-302f-47d7-a3b4-0f46169ead92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:27:43.446885 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91cdcf-302f-47d7-a3b4-0f46169ead92 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:43.447170 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91cdcf-302f-47d7-a3b4-0f46169ead92 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:43.447448 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91cdcf-302f-47d7-a3b4-0f46169ead92 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:43.448170 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f91cdcf-302f-47d7-a3b4-0f46169ead92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:27:43.450090 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f91cdcf-302f-47d7-a3b4-0f46169ead92 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:27:43.569182 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2310/4655] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:27:43 2022] POST /identity/v3/users => generated 289 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:27:43.573664 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69131ca-106a-4a2d-997c-24a10d348b75 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:27:43.585823 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69131ca-106a-4a2d-997c-24a10d348b75 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:27:43.591102 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6120ff61-902f-459e-b131-6ac54b468b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:27:43.591814 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120ff61-902f-459e-b131-6ac54b468b82 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:43.592164 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120ff61-902f-459e-b131-6ac54b468b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:43.592514 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120ff61-902f-459e-b131-6ac54b468b82 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:43.593335 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6120ff61-902f-459e-b131-6ac54b468b82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:27:43.595120 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6120ff61-902f-459e-b131-6ac54b468b82 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:27:43.609034 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2346/4656] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:27:43 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:27:43.613242 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f91cdcf-302f-47d7-a3b4-0f46169ead92 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:27:43.624294 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f91cdcf-302f-47d7-a3b4-0f46169ead92 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:27:43.630571 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8127cfac-a292-45a9-9d4a-46c9e3bd399d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:27:43.631343 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127cfac-a292-45a9-9d4a-46c9e3bd399d admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:43.631722 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127cfac-a292-45a9-9d4a-46c9e3bd399d admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:43.632084 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127cfac-a292-45a9-9d4a-46c9e3bd399d admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:43.632879 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8127cfac-a292-45a9-9d4a-46c9e3bd399d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:27:43.634568 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8127cfac-a292-45a9-9d4a-46c9e3bd399d admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:27:43.650681 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2311/4657] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:27:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:27:43.652287 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6120ff61-902f-459e-b131-6ac54b468b82 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:27:43.665096 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6120ff61-902f-459e-b131-6ac54b468b82 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:27:43.670775 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5ad341-5a18-49d6-bb18-c91d168e52ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:27:43.675611 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ad341-5a18-49d6-bb18-c91d168e52ea admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:43.675611 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ad341-5a18-49d6-bb18-c91d168e52ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:43.675611 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ad341-5a18-49d6-bb18-c91d168e52ea admin admin] PATH_INFO: `/v3/projects/6641b342c1d440aea451919f391bc5db/users/5586a3a946a0490498c42cb71f39ce1e/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:43.691368 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5ad341-5a18-49d6-bb18-c91d168e52ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=6641b342c1d440aea451919f391bc5db, user_id=5586a3a946a0490498c42cb71f39ce1e, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:27:43.694772 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5ad341-5a18-49d6-bb18-c91d168e52ea admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:27:43.781382 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2347/4658] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:27:43 2022] PUT /identity/v3/projects/6641b342c1d440aea451919f391bc5db/users/5586a3a946a0490498c42cb71f39ce1e/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:27:43.787850 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3a87d7-4807-4c77-8c7d-079eeb46612e None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:43.788672 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3a87d7-4807-4c77-8c7d-079eeb46612e None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:43.789204 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3a87d7-4807-4c77-8c7d-079eeb46612e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:43.823243 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-7d3a87d7-4807-4c77-8c7d-079eeb46612e None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:27:43.825933 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-7d3a87d7-4807-4c77-8c7d-079eeb46612e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:27:43.906734 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2312/4659] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:27:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:27:43.931624 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5ad341-5a18-49d6-bb18-c91d168e52ea admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:27:43.933867 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-1e5ad341-5a18-49d6-bb18-c91d168e52ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:27:44.003853 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5ad341-5a18-49d6-bb18-c91d168e52ea admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:27:44.008478 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e3cec1-30dd-420f-8bcf-e60ebadc26aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:27:44.009608 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e3cec1-30dd-420f-8bcf-e60ebadc26aa service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:44.010138 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e3cec1-30dd-420f-8bcf-e60ebadc26aa service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:44.010582 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e3cec1-30dd-420f-8bcf-e60ebadc26aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:44.027231 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e3cec1-30dd-420f-8bcf-e60ebadc26aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:27:44.029336 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e3cec1-30dd-420f-8bcf-e60ebadc26aa service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:27:44.041779 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2348/4660] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:27:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:27:48.250421 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1425a52-8923-4d2e-8047-3b4601ffe3ad None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:48.250985 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1425a52-8923-4d2e-8047-3b4601ffe3ad None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:48.251077 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1425a52-8923-4d2e-8047-3b4601ffe3ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:48.287808 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-b1425a52-8923-4d2e-8047-3b4601ffe3ad None None] MFA Rules not processed for user `b398969c37454956a73bf459e0d37e61`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:27:48.290261 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b1425a52-8923-4d2e-8047-3b4601ffe3ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:27:48.416375 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2313/4661] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:27:48 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:27:53.019151 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e3cec1-30dd-420f-8bcf-e60ebadc26aa service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:27:53.022596 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-a3e3cec1-30dd-420f-8bcf-e60ebadc26aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:27:53.045194 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e3cec1-30dd-420f-8bcf-e60ebadc26aa service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:27:53.056162 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b80bdc-8030-4053-a3fb-74d8756da0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:27:53.057601 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b80bdc-8030-4053-a3fb-74d8756da0a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:53.058139 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b80bdc-8030-4053-a3fb-74d8756da0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:53.059007 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b80bdc-8030-4053-a3fb-74d8756da0a7 admin admin] PATH_INFO: `/v3/users/ed0a76be93e44fa887cb813a8879e04d` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:53.061169 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b80bdc-8030-4053-a3fb-74d8756da0a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed0a76be93e44fa887cb813a8879e04d)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:27:53.064216 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b80bdc-8030-4053-a3fb-74d8756da0a7 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:27:53.372061 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-79b80bdc-8030-4053-a3fb-74d8756da0a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed0a76be93e44fa887cb813a8879e04d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:27:53.392956 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-79b80bdc-8030-4053-a3fb-74d8756da0a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed0a76be93e44fa887cb813a8879e04d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:27:53.403644 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-79b80bdc-8030-4053-a3fb-74d8756da0a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed0a76be93e44fa887cb813a8879e04d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:27:53.465303 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-79b80bdc-8030-4053-a3fb-74d8756da0a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed0a76be93e44fa887cb813a8879e04d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:27:53.466061 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-79b80bdc-8030-4053-a3fb-74d8756da0a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed0a76be93e44fa887cb813a8879e04d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:27:53.478307 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2349/4662] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:27:53 2022] DELETE /identity/v3/users/ed0a76be93e44fa887cb813a8879e04d => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:27:53.834362 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1425a52-8923-4d2e-8047-3b4601ffe3ad None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:27:53.851372 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1425a52-8923-4d2e-8047-3b4601ffe3ad None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:27:53.942492 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5e9cf8-00b5-4e18-8566-b2f6b41241ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:27:53.943467 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e9cf8-00b5-4e18-8566-b2f6b41241ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:53.943891 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e9cf8-00b5-4e18-8566-b2f6b41241ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:53.944303 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e9cf8-00b5-4e18-8566-b2f6b41241ad admin admin] PATH_INFO: `/v3/projects/c4fe0b96d43b41aaaa0e8e238888786a` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:53.946061 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5e9cf8-00b5-4e18-8566-b2f6b41241ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4fe0b96d43b41aaaa0e8e238888786a)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:27:53.948335 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5e9cf8-00b5-4e18-8566-b2f6b41241ad admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:27:54.082017 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-8d5e9cf8-00b5-4e18-8566-b2f6b41241ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4fe0b96d43b41aaaa0e8e238888786a', 'request_id': 'req-8d5e9cf8-00b5-4e18-8566-b2f6b41241ad'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:27:54.089394 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-8d5e9cf8-00b5-4e18-8566-b2f6b41241ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4fe0b96d43b41aaaa0e8e238888786a', 'request_id': 'req-8d5e9cf8-00b5-4e18-8566-b2f6b41241ad'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:27:54.102487 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-8d5e9cf8-00b5-4e18-8566-b2f6b41241ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4fe0b96d43b41aaaa0e8e238888786a', 'request_id': 'req-8d5e9cf8-00b5-4e18-8566-b2f6b41241ad'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:27:54.184642 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-8d5e9cf8-00b5-4e18-8566-b2f6b41241ad admin admin] The token cache is being invalidate because project c4fe0b96d43b41aaaa0e8e238888786a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:27:54.185743 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-8d5e9cf8-00b5-4e18-8566-b2f6b41241ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:27:54.186684 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-8d5e9cf8-00b5-4e18-8566-b2f6b41241ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:27:54.189550 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2314/4663] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:27:53 2022] DELETE /identity/v3/projects/c4fe0b96d43b41aaaa0e8e238888786a => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:27:54.194962 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b83b2-63b4-43d7-893b-6de13fbfacb5 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:54.195423 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b83b2-63b4-43d7-893b-6de13fbfacb5 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:54.195637 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b83b2-63b4-43d7-893b-6de13fbfacb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:54.217558 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-db8b83b2-63b4-43d7-893b-6de13fbfacb5 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:27:54.219183 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-db8b83b2-63b4-43d7-893b-6de13fbfacb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:27:54.294404 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2350/4664] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:27:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:27:54.301895 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105490e3-953e-4dc9-bdba-7f984a3c0747 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:54.302253 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105490e3-953e-4dc9-bdba-7f984a3c0747 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:54.302494 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105490e3-953e-4dc9-bdba-7f984a3c0747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:54.332905 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-105490e3-953e-4dc9-bdba-7f984a3c0747 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:27:54.334246 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-105490e3-953e-4dc9-bdba-7f984a3c0747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:27:54.344804 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2315/4665] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:27:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:27:54.349272 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b83b2-63b4-43d7-893b-6de13fbfacb5 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:27:54.365432 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b83b2-63b4-43d7-893b-6de13fbfacb5 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:27:54.372889 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0610ea7-587c-46d4-8621-fc0c81f508fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:27:54.373581 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0610ea7-587c-46d4-8621-fc0c81f508fe admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:54.373897 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0610ea7-587c-46d4-8621-fc0c81f508fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:54.374183 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0610ea7-587c-46d4-8621-fc0c81f508fe admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:54.374929 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0610ea7-587c-46d4-8621-fc0c81f508fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:27:54.375234 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0610ea7-587c-46d4-8621-fc0c81f508fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:27:54.379387 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0610ea7-587c-46d4-8621-fc0c81f508fe admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:27:54.406776 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2351/4666] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:27:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:27:54.411389 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105490e3-953e-4dc9-bdba-7f984a3c0747 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:27:54.431156 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105490e3-953e-4dc9-bdba-7f984a3c0747 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:27:54.453381 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb87523-e461-4c62-8418-350be37dcfed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:27:54.454087 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb87523-e461-4c62-8418-350be37dcfed admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:54.454556 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb87523-e461-4c62-8418-350be37dcfed admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:54.454672 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb87523-e461-4c62-8418-350be37dcfed admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:54.455666 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb87523-e461-4c62-8418-350be37dcfed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:27:54.458197 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb87523-e461-4c62-8418-350be37dcfed admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:27:54.524939 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2316/4667] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:27:54 2022] POST /identity/v3/projects => generated 399 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:27:54.529222 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0610ea7-587c-46d4-8621-fc0c81f508fe admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:27:54.542285 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0610ea7-587c-46d4-8621-fc0c81f508fe admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:27:54.612399 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cee6e35-4f0e-4838-ae32-a5c9f62768ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:27:54.613496 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee6e35-4f0e-4838-ae32-a5c9f62768ec admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:54.613973 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee6e35-4f0e-4838-ae32-a5c9f62768ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:54.620500 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee6e35-4f0e-4838-ae32-a5c9f62768ec admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:54.620500 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cee6e35-4f0e-4838-ae32-a5c9f62768ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:27:54.620500 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cee6e35-4f0e-4838-ae32-a5c9f62768ec admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:27:54.707570 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2352/4668] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:27:54 2022] POST /identity/v3/users => generated 300 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:27:54.711631 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb87523-e461-4c62-8418-350be37dcfed admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:27:54.725436 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb87523-e461-4c62-8418-350be37dcfed admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:27:54.732358 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a740c-0465-4267-bdae-dca07ff6e935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:27:54.733208 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a740c-0465-4267-bdae-dca07ff6e935 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:54.733590 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a740c-0465-4267-bdae-dca07ff6e935 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:54.734089 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a740c-0465-4267-bdae-dca07ff6e935 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:54.735529 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041a740c-0465-4267-bdae-dca07ff6e935 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:27:54.738433 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041a740c-0465-4267-bdae-dca07ff6e935 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:27:54.759939 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2317/4669] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:27:54 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:27:54.761187 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cee6e35-4f0e-4838-ae32-a5c9f62768ec admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:27:54.785161 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cee6e35-4f0e-4838-ae32-a5c9f62768ec admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:27:54.790596 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea8991b-e6b5-45a1-b260-e5cde36005ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:27:54.791731 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8991b-e6b5-45a1-b260-e5cde36005ed admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:54.792153 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8991b-e6b5-45a1-b260-e5cde36005ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:54.792527 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8991b-e6b5-45a1-b260-e5cde36005ed admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:54.793349 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea8991b-e6b5-45a1-b260-e5cde36005ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:27:54.795159 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea8991b-e6b5-45a1-b260-e5cde36005ed admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:27:54.808085 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2353/4670] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:27:54 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:27:54.824121 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a740c-0465-4267-bdae-dca07ff6e935 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:27:54.849038 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a740c-0465-4267-bdae-dca07ff6e935 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:27:54.849038 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ceffa-03a1-4b34-8efa-5472ed7a6033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:27:54.849038 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ceffa-03a1-4b34-8efa-5472ed7a6033 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:54.849038 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ceffa-03a1-4b34-8efa-5472ed7a6033 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:54.850137 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ceffa-03a1-4b34-8efa-5472ed7a6033 admin admin] PATH_INFO: `/v3/projects/bbb13e5ea4a949d18e6c5c4bf679fde2/users/1d73e16649b845319b5184937056b233/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:54.863663 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2ceffa-03a1-4b34-8efa-5472ed7a6033 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbb13e5ea4a949d18e6c5c4bf679fde2, user_id=1d73e16649b845319b5184937056b233, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:27:54.866412 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2ceffa-03a1-4b34-8efa-5472ed7a6033 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:27:54.942012 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2318/4671] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:27:54 2022] PUT /identity/v3/projects/bbb13e5ea4a949d18e6c5c4bf679fde2/users/1d73e16649b845319b5184937056b233/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:27:54.947134 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d0224-360f-47d9-89a4-b65f43e86d96 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:54.947432 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d0224-360f-47d9-89a4-b65f43e86d96 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:54.947821 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d0224-360f-47d9-89a4-b65f43e86d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:54.974706 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-ae2d0224-360f-47d9-89a4-b65f43e86d96 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:27:54.975974 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ae2d0224-360f-47d9-89a4-b65f43e86d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:27:55.071258 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2354/4672] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:27:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:27:55.088372 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ceffa-03a1-4b34-8efa-5472ed7a6033 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:27:55.090963 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-1d2ceffa-03a1-4b34-8efa-5472ed7a6033 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:27:55.178280 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ceffa-03a1-4b34-8efa-5472ed7a6033 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:27:55.185293 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c13d35-c748-4b3d-8a3e-4148003eea09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:27:55.186443 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c13d35-c748-4b3d-8a3e-4148003eea09 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:55.186897 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c13d35-c748-4b3d-8a3e-4148003eea09 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:55.187328 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c13d35-c748-4b3d-8a3e-4148003eea09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:55.217013 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c13d35-c748-4b3d-8a3e-4148003eea09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:27:55.219077 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c13d35-c748-4b3d-8a3e-4148003eea09 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:27:55.251116 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2319/4673] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:27:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:27:57.047169 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6fcf26-bfa9-4772-9406-05e67a689ad1 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:57.047169 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6fcf26-bfa9-4772-9406-05e67a689ad1 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:57.047169 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6fcf26-bfa9-4772-9406-05e67a689ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:57.081289 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-6e6fcf26-bfa9-4772-9406-05e67a689ad1 None None] MFA Rules not processed for user `1d73e16649b845319b5184937056b233`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:27:57.081289 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-6e6fcf26-bfa9-4772-9406-05e67a689ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:27:57.216053 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e24d2-2c55-4b80-b404-f4ecc38093c1 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:57.216717 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e24d2-2c55-4b80-b404-f4ecc38093c1 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:57.216717 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e24d2-2c55-4b80-b404-f4ecc38093c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:57.219533 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2355/4674] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:27:57 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:27:57.237978 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-b97e24d2-2c55-4b80-b404-f4ecc38093c1 None None] MFA Rules not processed for user `1d73e16649b845319b5184937056b233`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:27:57.239224 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b97e24d2-2c55-4b80-b404-f4ecc38093c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:27:57.251624 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2320/4675] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:27:57 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:27:57.263723 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6fcf26-bfa9-4772-9406-05e67a689ad1 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:27:57.265619 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-6e6fcf26-bfa9-4772-9406-05e67a689ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:27:57.418196 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6fcf26-bfa9-4772-9406-05e67a689ad1 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:27:57.423980 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7cc713-fe6f-413f-a07a-079dba453e49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:27:57.425333 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7cc713-fe6f-413f-a07a-079dba453e49 service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:57.425662 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7cc713-fe6f-413f-a07a-079dba453e49 service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:57.426014 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7cc713-fe6f-413f-a07a-079dba453e49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:57.443807 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7cc713-fe6f-413f-a07a-079dba453e49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:27:57.445435 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7cc713-fe6f-413f-a07a-079dba453e49 service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:27:57.457635 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2356/4676] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:27:57 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:27:57.816347 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00f19b-cb46-4fb8-9016-8cbaf02241b3 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:57.816627 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00f19b-cb46-4fb8-9016-8cbaf02241b3 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:57.817206 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00f19b-cb46-4fb8-9016-8cbaf02241b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:57.860754 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-dc00f19b-cb46-4fb8-9016-8cbaf02241b3 None None] MFA Rules not processed for user `5586a3a946a0490498c42cb71f39ce1e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:27:57.862604 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-dc00f19b-cb46-4fb8-9016-8cbaf02241b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:27:58.020138 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2321/4677] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:27:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:27:58.041315 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7cc713-fe6f-413f-a07a-079dba453e49 service nova] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:27:58.044393 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-2d7cc713-fe6f-413f-a07a-079dba453e49 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:27:58.096294 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7cc713-fe6f-413f-a07a-079dba453e49 service nova] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:27:58.125277 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b2efa3-0fff-47ba-bb90-5a5c6114af5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:27:58.125277 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2efa3-0fff-47ba-bb90-5a5c6114af5a service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:27:58.125277 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2efa3-0fff-47ba-bb90-5a5c6114af5a service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:27:58.125277 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2efa3-0fff-47ba-bb90-5a5c6114af5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:27:58.136686 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b2efa3-0fff-47ba-bb90-5a5c6114af5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:27:58.138383 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b2efa3-0fff-47ba-bb90-5a5c6114af5a service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:27:58.158455 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2357/4678] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:27:58 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:28:01.757341 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1634583e-2444-49fc-b5a8-b3873b40bc55 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:28:01.757341 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1634583e-2444-49fc-b5a8-b3873b40bc55 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:28:01.757341 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1634583e-2444-49fc-b5a8-b3873b40bc55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:28:01.779407 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-1634583e-2444-49fc-b5a8-b3873b40bc55 None None] MFA Rules not processed for user `5586a3a946a0490498c42cb71f39ce1e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:28:01.780705 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-1634583e-2444-49fc-b5a8-b3873b40bc55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:28:01.789320 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2322/4679] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:28:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:28:16.994685 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9599d1e-248e-403e-8185-133c0dbff3ce None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:28:16.995233 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9599d1e-248e-403e-8185-133c0dbff3ce None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:28:16.996304 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9599d1e-248e-403e-8185-133c0dbff3ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:28:17.016669 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-f9599d1e-248e-403e-8185-133c0dbff3ce None None] MFA Rules not processed for user `b398969c37454956a73bf459e0d37e61`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:28:17.018190 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-f9599d1e-248e-403e-8185-133c0dbff3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:28:17.099593 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2358/4680] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:28:16 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:28:24.396823 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1634583e-2444-49fc-b5a8-b3873b40bc55 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:28:24.412835 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1634583e-2444-49fc-b5a8-b3873b40bc55 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:28:24.420143 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70af1ac1-76b8-472a-96e4-08bd202e400a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:28:24.420896 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af1ac1-76b8-472a-96e4-08bd202e400a service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:28:24.421405 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af1ac1-76b8-472a-96e4-08bd202e400a service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:28:24.421885 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af1ac1-76b8-472a-96e4-08bd202e400a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:28:24.424368 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-70af1ac1-76b8-472a-96e4-08bd202e400a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:28:24.437952 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70af1ac1-76b8-472a-96e4-08bd202e400a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:28:24.439770 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70af1ac1-76b8-472a-96e4-08bd202e400a service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:28:24.451561 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2323/4681] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:28:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:28:32.198712 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f74fd-7df7-4110-889f-d28ce960604f None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:28:32.199274 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f74fd-7df7-4110-889f-d28ce960604f None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:28:32.199274 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f74fd-7df7-4110-889f-d28ce960604f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:28:32.217063 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-e29f74fd-7df7-4110-889f-d28ce960604f None None] MFA Rules not processed for user `1d73e16649b845319b5184937056b233`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:28:32.219954 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e29f74fd-7df7-4110-889f-d28ce960604f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:28:32.225236 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2359/4682] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:28:32 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:28:32.480458 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70af1ac1-76b8-472a-96e4-08bd202e400a service nova] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:28:32.481875 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-70af1ac1-76b8-472a-96e4-08bd202e400a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:28:32.494776 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70af1ac1-76b8-472a-96e4-08bd202e400a service nova] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:28:32.500674 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f472e1-cbf1-4b79-a345-6e358a8f1aa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:28:32.500674 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f472e1-cbf1-4b79-a345-6e358a8f1aa0 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:28:32.500674 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f472e1-cbf1-4b79-a345-6e358a8f1aa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:28:32.500674 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f472e1-cbf1-4b79-a345-6e358a8f1aa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:28:32.502217 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-f8f472e1-cbf1-4b79-a345-6e358a8f1aa0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:28:32.512252 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f472e1-cbf1-4b79-a345-6e358a8f1aa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:28:32.513672 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f472e1-cbf1-4b79-a345-6e358a8f1aa0 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:28:32.523047 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2324/4683] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:28:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:28:43.793541 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb1725-5527-414d-8d76-ea8b7340849c None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:28:43.799732 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb1725-5527-414d-8d76-ea8b7340849c None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:28:43.799732 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb1725-5527-414d-8d76-ea8b7340849c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:28:43.818058 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-e8eb1725-5527-414d-8d76-ea8b7340849c None None] MFA Rules not processed for user `1e3390c9579a4f598c46f9417b4dd046`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:28:43.822604 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e8eb1725-5527-414d-8d76-ea8b7340849c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:28:43.881294 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2360/4684] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:28:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:28:46.472643 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67564fe4-7c89-48ab-8a1d-2ee8d027d4a8 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:28:46.473593 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67564fe4-7c89-48ab-8a1d-2ee8d027d4a8 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:28:46.473878 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67564fe4-7c89-48ab-8a1d-2ee8d027d4a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:28:46.496415 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-67564fe4-7c89-48ab-8a1d-2ee8d027d4a8 None None] MFA Rules not processed for user `b398969c37454956a73bf459e0d37e61`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:28:46.497627 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-67564fe4-7c89-48ab-8a1d-2ee8d027d4a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:28:46.505102 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2325/4685] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:28:46 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:28:49.352884 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9415984-5573-48d6-8ce9-e4f159c05768 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:28:49.353790 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9415984-5573-48d6-8ce9-e4f159c05768 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:28:49.357556 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9415984-5573-48d6-8ce9-e4f159c05768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:28:49.380348 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-c9415984-5573-48d6-8ce9-e4f159c05768 None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:28:49.381112 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c9415984-5573-48d6-8ce9-e4f159c05768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:28:49.471649 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2361/4686] 10.222.0.52 () {58 vars in 1009 bytes} [Sat May 14 21:28:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:28:49.691442 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67564fe4-7c89-48ab-8a1d-2ee8d027d4a8 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:28:49.694201 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-67564fe4-7c89-48ab-8a1d-2ee8d027d4a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:28:49.845977 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67564fe4-7c89-48ab-8a1d-2ee8d027d4a8 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:28:49.851789 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03151041-9842-43ea-b5ac-9281bcb9a161 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:28:49.852801 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03151041-9842-43ea-b5ac-9281bcb9a161 service swift] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:28:49.853316 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03151041-9842-43ea-b5ac-9281bcb9a161 service swift] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:28:49.853818 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03151041-9842-43ea-b5ac-9281bcb9a161 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:28:49.864558 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03151041-9842-43ea-b5ac-9281bcb9a161 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:28:49.867420 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03151041-9842-43ea-b5ac-9281bcb9a161 service swift] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:28:49.880529 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2326/4687] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 21:28:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 14 21:28:51.947205 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9415984-5573-48d6-8ce9-e4f159c05768 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:28:51.948776 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c9415984-5573-48d6-8ce9-e4f159c05768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:28:51.971735 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9415984-5573-48d6-8ce9-e4f159c05768 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:28:51.977365 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e1db62-591c-419d-b246-e2331906c7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:28:51.978494 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e1db62-591c-419d-b246-e2331906c7b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:28:51.978974 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e1db62-591c-419d-b246-e2331906c7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:28:51.979534 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e1db62-591c-419d-b246-e2331906c7b5 admin admin] PATH_INFO: `/v3/users/d698e25b4c5d409c8f14c353218baac2` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:28:51.980997 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e1db62-591c-419d-b246-e2331906c7b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d698e25b4c5d409c8f14c353218baac2)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:28:51.983432 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e1db62-591c-419d-b246-e2331906c7b5 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:28:52.190650 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c5e1db62-591c-419d-b246-e2331906c7b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd698e25b4c5d409c8f14c353218baac2'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:28:52.212635 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c5e1db62-591c-419d-b246-e2331906c7b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd698e25b4c5d409c8f14c353218baac2'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:28:52.223570 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c5e1db62-591c-419d-b246-e2331906c7b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd698e25b4c5d409c8f14c353218baac2'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:28:52.350037 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c5e1db62-591c-419d-b246-e2331906c7b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd698e25b4c5d409c8f14c353218baac2'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:28:52.350895 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c5e1db62-591c-419d-b246-e2331906c7b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd698e25b4c5d409c8f14c353218baac2'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:28:52.358817 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2362/4688] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:28:51 2022] DELETE /identity/v3/users/d698e25b4c5d409c8f14c353218baac2 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:28:52.364331 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d33af-81b8-49b4-b594-ba1f72de8ec0 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:28:52.364871 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d33af-81b8-49b4-b594-ba1f72de8ec0 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:28:52.364999 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d33af-81b8-49b4-b594-ba1f72de8ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:28:52.391119 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-835d33af-81b8-49b4-b594-ba1f72de8ec0 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:28:52.392579 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-835d33af-81b8-49b4-b594-ba1f72de8ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:28:52.497157 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2327/4689] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:28:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:28:52.511838 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e1db62-591c-419d-b246-e2331906c7b5 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:28:52.513293 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c5e1db62-591c-419d-b246-e2331906c7b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:28:52.602849 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e1db62-591c-419d-b246-e2331906c7b5 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:28:52.618806 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4081aa05-085c-478d-93c2-5bef30f0305a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:28:52.619550 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4081aa05-085c-478d-93c2-5bef30f0305a service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:28:52.619788 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4081aa05-085c-478d-93c2-5bef30f0305a service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:28:52.620065 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4081aa05-085c-478d-93c2-5bef30f0305a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:28:52.630010 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4081aa05-085c-478d-93c2-5bef30f0305a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:28:52.631809 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4081aa05-085c-478d-93c2-5bef30f0305a service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:28:52.643738 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2363/4690] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:28:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:28:53.271629 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d33af-81b8-49b4-b594-ba1f72de8ec0 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:28:53.273164 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-835d33af-81b8-49b4-b594-ba1f72de8ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:28:53.316391 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d33af-81b8-49b4-b594-ba1f72de8ec0 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:28:53.327129 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f950093e-3b73-4052-8e57-51c4eac60ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:28:53.328357 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f950093e-3b73-4052-8e57-51c4eac60ad5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:28:53.328804 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f950093e-3b73-4052-8e57-51c4eac60ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:28:53.329243 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f950093e-3b73-4052-8e57-51c4eac60ad5 admin admin] PATH_INFO: `/v3/projects/51bdb907e2014a05815af94bc5cff92d` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:28:53.330744 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f950093e-3b73-4052-8e57-51c4eac60ad5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51bdb907e2014a05815af94bc5cff92d)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:28:53.341030 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f950093e-3b73-4052-8e57-51c4eac60ad5 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:28:53.497960 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f950093e-3b73-4052-8e57-51c4eac60ad5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51bdb907e2014a05815af94bc5cff92d', 'request_id': 'req-f950093e-3b73-4052-8e57-51c4eac60ad5'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:28:53.512013 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f950093e-3b73-4052-8e57-51c4eac60ad5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51bdb907e2014a05815af94bc5cff92d', 'request_id': 'req-f950093e-3b73-4052-8e57-51c4eac60ad5'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:28:53.523343 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f950093e-3b73-4052-8e57-51c4eac60ad5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51bdb907e2014a05815af94bc5cff92d', 'request_id': 'req-f950093e-3b73-4052-8e57-51c4eac60ad5'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:28:53.698711 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f950093e-3b73-4052-8e57-51c4eac60ad5 admin admin] The token cache is being invalidate because project 51bdb907e2014a05815af94bc5cff92d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:28:53.699044 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f950093e-3b73-4052-8e57-51c4eac60ad5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:28:53.700131 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f950093e-3b73-4052-8e57-51c4eac60ad5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:28:53.706822 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2328/4691] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:28:53 2022] DELETE /identity/v3/projects/51bdb907e2014a05815af94bc5cff92d => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:28:53.711882 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e348f-cf08-4fc7-9426-fff6a700bd4a None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:28:53.712450 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e348f-cf08-4fc7-9426-fff6a700bd4a None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:28:53.712450 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e348f-cf08-4fc7-9426-fff6a700bd4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:28:53.758573 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-262e348f-cf08-4fc7-9426-fff6a700bd4a None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:28:53.761159 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-262e348f-cf08-4fc7-9426-fff6a700bd4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:28:53.887558 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2364/4692] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:28:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:28:53.903263 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2232e491-4c50-45bb-94af-c0b18b8ef3a5 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:28:53.903850 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2232e491-4c50-45bb-94af-c0b18b8ef3a5 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:28:53.904322 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2232e491-4c50-45bb-94af-c0b18b8ef3a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:28:53.943451 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-2232e491-4c50-45bb-94af-c0b18b8ef3a5 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:28:53.945148 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-2232e491-4c50-45bb-94af-c0b18b8ef3a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:28:53.971013 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2329/4693] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:28:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:28:53.976967 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e348f-cf08-4fc7-9426-fff6a700bd4a None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:28:53.997821 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e348f-cf08-4fc7-9426-fff6a700bd4a None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:28:54.004249 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a8219d-cca5-4f9e-a0d5-5c715023491d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:28:54.005348 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8219d-cca5-4f9e-a0d5-5c715023491d admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:28:54.005641 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8219d-cca5-4f9e-a0d5-5c715023491d admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:28:54.006036 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8219d-cca5-4f9e-a0d5-5c715023491d admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:28:54.006771 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a8219d-cca5-4f9e-a0d5-5c715023491d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:28:54.007077 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a8219d-cca5-4f9e-a0d5-5c715023491d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:28:54.012756 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a8219d-cca5-4f9e-a0d5-5c715023491d admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:28:54.034050 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2365/4694] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:28:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:28:54.034629 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2232e491-4c50-45bb-94af-c0b18b8ef3a5 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:28:54.045914 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2232e491-4c50-45bb-94af-c0b18b8ef3a5 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:28:54.059915 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d13c984-56c7-4556-a703-06605e49dbbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:28:54.060610 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d13c984-56c7-4556-a703-06605e49dbbc admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:28:54.060896 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d13c984-56c7-4556-a703-06605e49dbbc admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:28:54.061173 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d13c984-56c7-4556-a703-06605e49dbbc admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:28:54.061892 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d13c984-56c7-4556-a703-06605e49dbbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:28:54.063858 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d13c984-56c7-4556-a703-06605e49dbbc admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:28:54.291561 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2330/4695] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:28:54 2022] POST /identity/v3/projects => generated 373 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:28:54.294098 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a8219d-cca5-4f9e-a0d5-5c715023491d admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:28:54.304670 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a8219d-cca5-4f9e-a0d5-5c715023491d admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:28:54.408779 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4de2db-3bc4-47bc-a1d7-3a7f8583e218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:28:54.408779 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4de2db-3bc4-47bc-a1d7-3a7f8583e218 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:28:54.408779 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4de2db-3bc4-47bc-a1d7-3a7f8583e218 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:28:54.411121 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4de2db-3bc4-47bc-a1d7-3a7f8583e218 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:28:54.412692 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4de2db-3bc4-47bc-a1d7-3a7f8583e218 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:28:54.414617 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4de2db-3bc4-47bc-a1d7-3a7f8583e218 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:28:54.574606 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2366/4696] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:28:54 2022] POST /identity/v3/users => generated 287 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:28:54.578574 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d13c984-56c7-4556-a703-06605e49dbbc admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:28:54.590357 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d13c984-56c7-4556-a703-06605e49dbbc admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:28:54.596493 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76f069e-c049-4366-ba05-c9e45cab8ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:28:54.597451 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f069e-c049-4366-ba05-c9e45cab8ec2 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:28:54.597917 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f069e-c049-4366-ba05-c9e45cab8ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:28:54.598193 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f069e-c049-4366-ba05-c9e45cab8ec2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:28:54.599105 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76f069e-c049-4366-ba05-c9e45cab8ec2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:28:54.600993 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76f069e-c049-4366-ba05-c9e45cab8ec2 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:28:54.616529 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2331/4697] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:28:54 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:28:54.617642 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4de2db-3bc4-47bc-a1d7-3a7f8583e218 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:28:54.632820 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4de2db-3bc4-47bc-a1d7-3a7f8583e218 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:28:54.648758 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e998556f-5c8d-4464-b02b-f522ea90baa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:28:54.649548 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e998556f-5c8d-4464-b02b-f522ea90baa3 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:28:54.649912 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e998556f-5c8d-4464-b02b-f522ea90baa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:28:54.650257 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e998556f-5c8d-4464-b02b-f522ea90baa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:28:54.651523 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e998556f-5c8d-4464-b02b-f522ea90baa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:28:54.656218 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e998556f-5c8d-4464-b02b-f522ea90baa3 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:28:54.676636 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2367/4698] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:28:54 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:28:54.680779 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76f069e-c049-4366-ba05-c9e45cab8ec2 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:28:54.691934 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76f069e-c049-4366-ba05-c9e45cab8ec2 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:28:54.697138 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c802ed69-8a4b-4ad5-8357-0b20d9c1b7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:28:54.698029 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c802ed69-8a4b-4ad5-8357-0b20d9c1b7e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:28:54.698490 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c802ed69-8a4b-4ad5-8357-0b20d9c1b7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:28:54.705035 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c802ed69-8a4b-4ad5-8357-0b20d9c1b7e1 admin admin] PATH_INFO: `/v3/projects/939c7de6596640f1b2b8081775020666/users/cf3c57181efa47658e72ebc678ad3035/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:28:54.724203 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c802ed69-8a4b-4ad5-8357-0b20d9c1b7e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=939c7de6596640f1b2b8081775020666, user_id=cf3c57181efa47658e72ebc678ad3035, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:28:54.727186 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c802ed69-8a4b-4ad5-8357-0b20d9c1b7e1 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:28:54.838441 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2332/4699] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:28:54 2022] PUT /identity/v3/projects/939c7de6596640f1b2b8081775020666/users/cf3c57181efa47658e72ebc678ad3035/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:28:54.849434 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131bc7af-9d46-4de4-9ae1-fba0986f179f None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:28:54.849985 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131bc7af-9d46-4de4-9ae1-fba0986f179f None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:28:54.849985 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131bc7af-9d46-4de4-9ae1-fba0986f179f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:28:54.883379 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-131bc7af-9d46-4de4-9ae1-fba0986f179f None None] MFA Rules not processed for user `cf3c57181efa47658e72ebc678ad3035`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:28:54.884727 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-131bc7af-9d46-4de4-9ae1-fba0986f179f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:28:54.982589 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2368/4700] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:28:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:28:54.991660 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c802ed69-8a4b-4ad5-8357-0b20d9c1b7e1 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:28:54.993626 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c802ed69-8a4b-4ad5-8357-0b20d9c1b7e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:28:55.109959 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c802ed69-8a4b-4ad5-8357-0b20d9c1b7e1 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:28:55.114931 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d1b680-55db-4c29-8bea-6a3a567e9600 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198271d1c0d44cb58bace41a65f4b94c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:28:55.115973 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d1b680-55db-4c29-8bea-6a3a567e9600 service cinder] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:28:55.116259 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d1b680-55db-4c29-8bea-6a3a567e9600 service cinder] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:28:55.116542 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d1b680-55db-4c29-8bea-6a3a567e9600 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:28:55.136484 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d1b680-55db-4c29-8bea-6a3a567e9600 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:28:55.138089 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d1b680-55db-4c29-8bea-6a3a567e9600 service cinder] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:28:55.152656 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2333/4701] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:28:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:29:00.990825 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d82b3f-4efb-4a39-b8bd-65b0629e0f14 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:00.991368 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d82b3f-4efb-4a39-b8bd-65b0629e0f14 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:00.991368 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d82b3f-4efb-4a39-b8bd-65b0629e0f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:01.028135 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-44d82b3f-4efb-4a39-b8bd-65b0629e0f14 None None] MFA Rules not processed for user `1d73e16649b845319b5184937056b233`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:29:01.032392 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-44d82b3f-4efb-4a39-b8bd-65b0629e0f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:29:01.158089 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2369/4702] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:29:00 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:29:01.424341 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d1b680-55db-4c29-8bea-6a3a567e9600 service cinder] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:01.426389 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-a1d1b680-55db-4c29-8bea-6a3a567e9600 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:29:01.488248 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d1b680-55db-4c29-8bea-6a3a567e9600 service cinder] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:01.492183 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4480c0-14da-4ff3-85f9-13dc80348570 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:01.493264 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4480c0-14da-4ff3-85f9-13dc80348570 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:01.493771 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4480c0-14da-4ff3-85f9-13dc80348570 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:01.494068 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4480c0-14da-4ff3-85f9-13dc80348570 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:01.496564 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-ac4480c0-14da-4ff3-85f9-13dc80348570 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:29:01.508237 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4480c0-14da-4ff3-85f9-13dc80348570 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:01.509707 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4480c0-14da-4ff3-85f9-13dc80348570 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:01.519600 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2334/4703] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:29:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:29:10.196562 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d82b3f-4efb-4a39-b8bd-65b0629e0f14 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:10.198124 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-44d82b3f-4efb-4a39-b8bd-65b0629e0f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:29:10.269105 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d82b3f-4efb-4a39-b8bd-65b0629e0f14 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:10.272687 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7635e27a-ec78-41e8-b87c-6bdf6b1c533a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b5cb86f190f4fcfb06d66cb8f14643f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:10.273328 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7635e27a-ec78-41e8-b87c-6bdf6b1c533a service glance] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:10.273611 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7635e27a-ec78-41e8-b87c-6bdf6b1c533a service glance] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:10.273884 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7635e27a-ec78-41e8-b87c-6bdf6b1c533a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:10.275671 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-7635e27a-ec78-41e8-b87c-6bdf6b1c533a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:29:10.347762 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7635e27a-ec78-41e8-b87c-6bdf6b1c533a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:10.349265 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7635e27a-ec78-41e8-b87c-6bdf6b1c533a service glance] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:10.360608 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2370/4704] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:29:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:29:10.606618 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4480c0-14da-4ff3-85f9-13dc80348570 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:10.608084 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-ac4480c0-14da-4ff3-85f9-13dc80348570 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:29:10.619468 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4480c0-14da-4ff3-85f9-13dc80348570 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:10.623134 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35917a0-42c1-4a15-8cf0-91c7e838a8af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:10.623814 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35917a0-42c1-4a15-8cf0-91c7e838a8af service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:10.624096 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35917a0-42c1-4a15-8cf0-91c7e838a8af service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:10.624372 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35917a0-42c1-4a15-8cf0-91c7e838a8af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:10.626880 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e35917a0-42c1-4a15-8cf0-91c7e838a8af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:29:10.636600 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35917a0-42c1-4a15-8cf0-91c7e838a8af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:10.638017 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35917a0-42c1-4a15-8cf0-91c7e838a8af service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:10.647469 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2335/4705] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:29:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:29:10.731803 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7635e27a-ec78-41e8-b87c-6bdf6b1c533a service glance] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:10.741801 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7635e27a-ec78-41e8-b87c-6bdf6b1c533a service glance] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:10.745494 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3bf8bf-f553-41b4-a78b-0102a59b13cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:10.746143 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3bf8bf-f553-41b4-a78b-0102a59b13cd service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:10.746429 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3bf8bf-f553-41b4-a78b-0102a59b13cd service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:10.746701 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3bf8bf-f553-41b4-a78b-0102a59b13cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:10.748583 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-4f3bf8bf-f553-41b4-a78b-0102a59b13cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:29:10.762875 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3bf8bf-f553-41b4-a78b-0102a59b13cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:10.764415 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3bf8bf-f553-41b4-a78b-0102a59b13cd service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:10.778110 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2371/4706] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:29:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:29:14.696008 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc4433f-44cd-436e-a242-bf4c6aa5eed4 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:14.701918 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc4433f-44cd-436e-a242-bf4c6aa5eed4 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:14.701918 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc4433f-44cd-436e-a242-bf4c6aa5eed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:14.714140 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-adc4433f-44cd-436e-a242-bf4c6aa5eed4 None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:29:14.715249 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-adc4433f-44cd-436e-a242-bf4c6aa5eed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:29:14.769523 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2336/4707] 10.222.0.52 () {58 vars in 1009 bytes} [Sat May 14 21:29:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:29:14.781683 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3bf8bf-f553-41b4-a78b-0102a59b13cd service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:14.783970 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-4f3bf8bf-f553-41b4-a78b-0102a59b13cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:29:14.943912 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3bf8bf-f553-41b4-a78b-0102a59b13cd service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:14.948887 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd782aca-b7ce-4bd1-abf2-c049719fe1e3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:14.949526 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd782aca-b7ce-4bd1-abf2-c049719fe1e3 service swift] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:14.949831 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd782aca-b7ce-4bd1-abf2-c049719fe1e3 service swift] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:14.950132 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd782aca-b7ce-4bd1-abf2-c049719fe1e3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:14.958046 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd782aca-b7ce-4bd1-abf2-c049719fe1e3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:14.959702 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd782aca-b7ce-4bd1-abf2-c049719fe1e3 service swift] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:14.969648 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2372/4708] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 21:29:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 21:29:30.789305 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc4433f-44cd-436e-a242-bf4c6aa5eed4 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:30.790954 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-adc4433f-44cd-436e-a242-bf4c6aa5eed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:29:30.869487 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc4433f-44cd-436e-a242-bf4c6aa5eed4 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:30.874924 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d30717-d17c-4941-ba5a-ab0bb22da26e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:30.875677 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d30717-d17c-4941-ba5a-ab0bb22da26e service placement] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:30.876135 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d30717-d17c-4941-ba5a-ab0bb22da26e service placement] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:30.876489 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d30717-d17c-4941-ba5a-ab0bb22da26e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:30.878294 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-d4d30717-d17c-4941-ba5a-ab0bb22da26e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:29:30.891014 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d30717-d17c-4941-ba5a-ab0bb22da26e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:30.893549 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d30717-d17c-4941-ba5a-ab0bb22da26e service placement] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:30.905204 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2337/4709] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:29:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:29:34.092002 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd782aca-b7ce-4bd1-abf2-c049719fe1e3 service swift] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:34.093501 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-dd782aca-b7ce-4bd1-abf2-c049719fe1e3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:29:34.159136 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd782aca-b7ce-4bd1-abf2-c049719fe1e3 service swift] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:34.163623 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf84f8d-b5b9-451d-86a9-1c7b00aab302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:34.164527 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf84f8d-b5b9-451d-86a9-1c7b00aab302 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:34.164808 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf84f8d-b5b9-451d-86a9-1c7b00aab302 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:34.165080 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf84f8d-b5b9-451d-86a9-1c7b00aab302 admin admin] PATH_INFO: `/v3/users/1d73e16649b845319b5184937056b233` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:34.166353 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf84f8d-b5b9-451d-86a9-1c7b00aab302 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d73e16649b845319b5184937056b233)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:34.168305 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf84f8d-b5b9-451d-86a9-1c7b00aab302 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:34.349944 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8cf84f8d-b5b9-451d-86a9-1c7b00aab302 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d73e16649b845319b5184937056b233'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:34.374114 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8cf84f8d-b5b9-451d-86a9-1c7b00aab302 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d73e16649b845319b5184937056b233'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:34.385711 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8cf84f8d-b5b9-451d-86a9-1c7b00aab302 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d73e16649b845319b5184937056b233'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:34.408669 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d30717-d17c-4941-ba5a-ab0bb22da26e service placement] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:34.420864 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d30717-d17c-4941-ba5a-ab0bb22da26e service placement] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:34.429492 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1511f971-788f-46a4-b547-208f73096768 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:34.430155 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1511f971-788f-46a4-b547-208f73096768 service placement] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:34.430741 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1511f971-788f-46a4-b547-208f73096768 service placement] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:34.431030 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1511f971-788f-46a4-b547-208f73096768 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:34.432935 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-1511f971-788f-46a4-b547-208f73096768 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:29:34.446673 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8cf84f8d-b5b9-451d-86a9-1c7b00aab302 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d73e16649b845319b5184937056b233'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:34.447063 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1511f971-788f-46a4-b547-208f73096768 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:34.447351 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8cf84f8d-b5b9-451d-86a9-1c7b00aab302 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d73e16649b845319b5184937056b233'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:34.449206 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1511f971-788f-46a4-b547-208f73096768 service placement] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:34.457509 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2373/4710] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:29:34 2022] DELETE /identity/v3/users/1d73e16649b845319b5184937056b233 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:29:34.465774 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2338/4711] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:29:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:29:34.761326 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf84f8d-b5b9-451d-86a9-1c7b00aab302 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:34.771568 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-8cf84f8d-b5b9-451d-86a9-1c7b00aab302 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:29:34.837805 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf84f8d-b5b9-451d-86a9-1c7b00aab302 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:34.849498 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eb2e1a-93af-4811-ac6a-43a6790583a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:34.850428 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb2e1a-93af-4811-ac6a-43a6790583a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:34.850725 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb2e1a-93af-4811-ac6a-43a6790583a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:34.851002 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb2e1a-93af-4811-ac6a-43a6790583a1 admin admin] PATH_INFO: `/v3/projects/bbb13e5ea4a949d18e6c5c4bf679fde2` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:34.852266 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eb2e1a-93af-4811-ac6a-43a6790583a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbb13e5ea4a949d18e6c5c4bf679fde2)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:34.854185 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eb2e1a-93af-4811-ac6a-43a6790583a1 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:35.025449 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-65eb2e1a-93af-4811-ac6a-43a6790583a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbb13e5ea4a949d18e6c5c4bf679fde2', 'request_id': 'req-65eb2e1a-93af-4811-ac6a-43a6790583a1'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:35.030972 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-65eb2e1a-93af-4811-ac6a-43a6790583a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbb13e5ea4a949d18e6c5c4bf679fde2', 'request_id': 'req-65eb2e1a-93af-4811-ac6a-43a6790583a1'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:35.149369 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-65eb2e1a-93af-4811-ac6a-43a6790583a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbb13e5ea4a949d18e6c5c4bf679fde2', 'request_id': 'req-65eb2e1a-93af-4811-ac6a-43a6790583a1'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:35.166359 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-65eb2e1a-93af-4811-ac6a-43a6790583a1 admin admin] The token cache is being invalidate because project bbb13e5ea4a949d18e6c5c4bf679fde2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:29:35.166870 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-65eb2e1a-93af-4811-ac6a-43a6790583a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:35.167775 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-65eb2e1a-93af-4811-ac6a-43a6790583a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:35.170060 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2374/4712] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:29:34 2022] DELETE /identity/v3/projects/bbb13e5ea4a949d18e6c5c4bf679fde2 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:29:35.175118 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e66a0-c1f0-470e-8113-1b976e5ac214 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:35.175901 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e66a0-c1f0-470e-8113-1b976e5ac214 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:35.176752 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e66a0-c1f0-470e-8113-1b976e5ac214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:35.201655 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-e81e66a0-c1f0-470e-8113-1b976e5ac214 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:29:35.202992 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e81e66a0-c1f0-470e-8113-1b976e5ac214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:29:35.280689 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2339/4713] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:29:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:29:35.282426 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1472db4-c9f0-46bc-a280-e7bab0ea8862 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:35.282716 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1472db4-c9f0-46bc-a280-e7bab0ea8862 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:35.283001 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1472db4-c9f0-46bc-a280-e7bab0ea8862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:35.301839 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-e1472db4-c9f0-46bc-a280-e7bab0ea8862 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:29:35.303054 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e1472db4-c9f0-46bc-a280-e7bab0ea8862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:29:35.311070 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2375/4714] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:29:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:29:35.315869 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e66a0-c1f0-470e-8113-1b976e5ac214 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:35.325859 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e66a0-c1f0-470e-8113-1b976e5ac214 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:35.331606 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bcbd13-6c2f-480f-9216-43215c3cc811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:35.332290 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bcbd13-6c2f-480f-9216-43215c3cc811 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:35.332586 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bcbd13-6c2f-480f-9216-43215c3cc811 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:35.332853 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bcbd13-6c2f-480f-9216-43215c3cc811 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:35.333589 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bcbd13-6c2f-480f-9216-43215c3cc811 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:29:35.333892 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bcbd13-6c2f-480f-9216-43215c3cc811 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:35.335538 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bcbd13-6c2f-480f-9216-43215c3cc811 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:35.350061 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2340/4715] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:29:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:29:35.354329 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1472db4-c9f0-46bc-a280-e7bab0ea8862 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:35.364681 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1472db4-c9f0-46bc-a280-e7bab0ea8862 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:35.369420 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887b7af1-c9e1-41f4-a607-a2841e52a836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:35.370079 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b7af1-c9e1-41f4-a607-a2841e52a836 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:35.370367 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b7af1-c9e1-41f4-a607-a2841e52a836 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:35.370647 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b7af1-c9e1-41f4-a607-a2841e52a836 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:35.371343 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887b7af1-c9e1-41f4-a607-a2841e52a836 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:35.373283 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887b7af1-c9e1-41f4-a607-a2841e52a836 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:35.475570 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2376/4716] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:29:35 2022] POST /identity/v3/projects => generated 373 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:29:35.479637 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bcbd13-6c2f-480f-9216-43215c3cc811 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:35.490780 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bcbd13-6c2f-480f-9216-43215c3cc811 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:35.565943 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e57111-d19d-46b8-973e-e2b1af900630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:35.566772 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e57111-d19d-46b8-973e-e2b1af900630 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:35.567156 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e57111-d19d-46b8-973e-e2b1af900630 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:35.567575 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e57111-d19d-46b8-973e-e2b1af900630 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:35.568283 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e57111-d19d-46b8-973e-e2b1af900630 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:35.570452 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e57111-d19d-46b8-973e-e2b1af900630 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:35.711289 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2341/4717] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:29:35 2022] POST /identity/v3/users => generated 287 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:29:35.715534 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887b7af1-c9e1-41f4-a607-a2841e52a836 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:35.727029 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887b7af1-c9e1-41f4-a607-a2841e52a836 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:35.731780 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f41363b-32e1-4030-ae97-c1534f61a361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:35.732464 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41363b-32e1-4030-ae97-c1534f61a361 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:35.732746 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41363b-32e1-4030-ae97-c1534f61a361 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:35.733020 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41363b-32e1-4030-ae97-c1534f61a361 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:35.733737 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f41363b-32e1-4030-ae97-c1534f61a361 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:35.741360 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f41363b-32e1-4030-ae97-c1534f61a361 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:35.752169 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2377/4718] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:29:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:29:35.757123 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e57111-d19d-46b8-973e-e2b1af900630 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:35.763396 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e57111-d19d-46b8-973e-e2b1af900630 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:35.769420 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb990e-46bc-4c11-a853-2277c434b15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:35.770224 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb990e-46bc-4c11-a853-2277c434b15d admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:35.770512 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb990e-46bc-4c11-a853-2277c434b15d admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:35.770794 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb990e-46bc-4c11-a853-2277c434b15d admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:35.771584 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cb990e-46bc-4c11-a853-2277c434b15d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:35.773192 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cb990e-46bc-4c11-a853-2277c434b15d admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:35.795896 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2342/4719] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:29:35 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:29:35.796967 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f41363b-32e1-4030-ae97-c1534f61a361 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:35.808591 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f41363b-32e1-4030-ae97-c1534f61a361 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:35.814260 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9657dfd1-c0ad-40d1-9c2b-2d5ad0abc022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:35.821077 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657dfd1-c0ad-40d1-9c2b-2d5ad0abc022 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:35.821077 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657dfd1-c0ad-40d1-9c2b-2d5ad0abc022 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:35.821077 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657dfd1-c0ad-40d1-9c2b-2d5ad0abc022 admin admin] PATH_INFO: `/v3/projects/f43cf27f7a634cb4adb7865a7e8b7838/users/b75ffa8886d946e3ae228f737b193198/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:35.837800 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9657dfd1-c0ad-40d1-9c2b-2d5ad0abc022 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f43cf27f7a634cb4adb7865a7e8b7838, user_id=b75ffa8886d946e3ae228f737b193198, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:35.840386 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9657dfd1-c0ad-40d1-9c2b-2d5ad0abc022 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:35.977346 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2378/4720] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:29:35 2022] PUT /identity/v3/projects/f43cf27f7a634cb4adb7865a7e8b7838/users/b75ffa8886d946e3ae228f737b193198/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:29:35.977489 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd2c884-7be5-4bb1-a1f4-be81acc1d9ba None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:35.977489 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd2c884-7be5-4bb1-a1f4-be81acc1d9ba None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:35.977489 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd2c884-7be5-4bb1-a1f4-be81acc1d9ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:36.022031 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-3cd2c884-7be5-4bb1-a1f4-be81acc1d9ba None None] MFA Rules not processed for user `b75ffa8886d946e3ae228f737b193198`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:29:36.024231 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-3cd2c884-7be5-4bb1-a1f4-be81acc1d9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:29:36.108693 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2343/4721] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:29:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:29:36.113672 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb9ac06-fa4e-43fa-9b1e-71ad93ad22e2 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:36.113958 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb9ac06-fa4e-43fa-9b1e-71ad93ad22e2 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:36.114233 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb9ac06-fa4e-43fa-9b1e-71ad93ad22e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:36.133791 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-fdb9ac06-fa4e-43fa-9b1e-71ad93ad22e2 None None] MFA Rules not processed for user `b75ffa8886d946e3ae228f737b193198`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:29:36.135006 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-fdb9ac06-fa4e-43fa-9b1e-71ad93ad22e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:29:36.142780 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2379/4722] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:29:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:29:36.153387 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd2c884-7be5-4bb1-a1f4-be81acc1d9ba None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:36.154863 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-3cd2c884-7be5-4bb1-a1f4-be81acc1d9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:29:36.235200 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd2c884-7be5-4bb1-a1f4-be81acc1d9ba None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:36.240808 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9318577-7f9a-4fa2-b2ae-7f953eca0e02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:36.241459 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9318577-7f9a-4fa2-b2ae-7f953eca0e02 service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:36.241742 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9318577-7f9a-4fa2-b2ae-7f953eca0e02 service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:36.242017 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9318577-7f9a-4fa2-b2ae-7f953eca0e02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:36.249910 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9318577-7f9a-4fa2-b2ae-7f953eca0e02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:36.251587 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9318577-7f9a-4fa2-b2ae-7f953eca0e02 service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:36.261082 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2344/4723] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:29:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:29:36.583679 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c5834b-e0aa-4db4-9c02-248018893ed5 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:36.584175 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c5834b-e0aa-4db4-9c02-248018893ed5 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:36.584284 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c5834b-e0aa-4db4-9c02-248018893ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:36.602790 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-26c5834b-e0aa-4db4-9c02-248018893ed5 None None] MFA Rules not processed for user `b75ffa8886d946e3ae228f737b193198`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:29:36.604019 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-26c5834b-e0aa-4db4-9c02-248018893ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:29:36.612506 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2380/4724] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:29:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:29:37.516150 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207b8f5-71c6-49f0-ae4f-28cceb6b642f None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:37.516691 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207b8f5-71c6-49f0-ae4f-28cceb6b642f None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:37.516829 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207b8f5-71c6-49f0-ae4f-28cceb6b642f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:37.536112 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-8207b8f5-71c6-49f0-ae4f-28cceb6b642f None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:29:37.537783 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8207b8f5-71c6-49f0-ae4f-28cceb6b642f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:29:37.616520 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2345/4725] 10.222.0.52 () {58 vars in 967 bytes} [Sat May 14 21:29:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:29:37.634461 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c5834b-e0aa-4db4-9c02-248018893ed5 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:37.635989 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-26c5834b-e0aa-4db4-9c02-248018893ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:29:37.717538 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c5834b-e0aa-4db4-9c02-248018893ed5 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:37.723349 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c19d1f-1679-4bff-96b2-d401e1411899 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:37.724039 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c19d1f-1679-4bff-96b2-d401e1411899 service swift] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:37.724327 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c19d1f-1679-4bff-96b2-d401e1411899 service swift] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:37.724605 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c19d1f-1679-4bff-96b2-d401e1411899 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:37.733347 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c19d1f-1679-4bff-96b2-d401e1411899 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:37.735796 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c19d1f-1679-4bff-96b2-d401e1411899 service swift] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:37.744281 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2381/4726] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 21:29:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 21:29:41.249928 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8207b8f5-71c6-49f0-ae4f-28cceb6b642f None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:41.252065 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8207b8f5-71c6-49f0-ae4f-28cceb6b642f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:29:41.317695 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8207b8f5-71c6-49f0-ae4f-28cceb6b642f None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:41.322895 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42a9665-fcc9-4c96-950d-2cc738249e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:41.323285 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a9665-fcc9-4c96-950d-2cc738249e2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:41.323603 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a9665-fcc9-4c96-950d-2cc738249e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:41.323887 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a9665-fcc9-4c96-950d-2cc738249e2f admin admin] PATH_INFO: `/v3/users/cf3c57181efa47658e72ebc678ad3035` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:41.325196 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42a9665-fcc9-4c96-950d-2cc738249e2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf3c57181efa47658e72ebc678ad3035)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:41.327256 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42a9665-fcc9-4c96-950d-2cc738249e2f admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:41.591522 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a42a9665-fcc9-4c96-950d-2cc738249e2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf3c57181efa47658e72ebc678ad3035'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:41.598689 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a42a9665-fcc9-4c96-950d-2cc738249e2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf3c57181efa47658e72ebc678ad3035'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:41.603252 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a42a9665-fcc9-4c96-950d-2cc738249e2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf3c57181efa47658e72ebc678ad3035'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:41.714837 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a42a9665-fcc9-4c96-950d-2cc738249e2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf3c57181efa47658e72ebc678ad3035'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:41.728062 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a42a9665-fcc9-4c96-950d-2cc738249e2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf3c57181efa47658e72ebc678ad3035'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:41.736110 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2346/4727] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:29:41 2022] DELETE /identity/v3/users/cf3c57181efa47658e72ebc678ad3035 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:29:41.740437 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c19d1f-1679-4bff-96b2-d401e1411899 service swift] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:41.740979 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc81114-f930-40eb-b5de-2785ee3d405c None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:41.740979 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc81114-f930-40eb-b5de-2785ee3d405c None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:41.741155 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc81114-f930-40eb-b5de-2785ee3d405c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:41.741859 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b9c19d1f-1679-4bff-96b2-d401e1411899 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:29:41.757156 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c19d1f-1679-4bff-96b2-d401e1411899 service swift] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:41.760250 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-0bc81114-f930-40eb-b5de-2785ee3d405c None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:29:41.761621 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-0bc81114-f930-40eb-b5de-2785ee3d405c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:29:41.823344 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1115c266-3bd1-4d81-ae13-725db218703c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:41.824697 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1115c266-3bd1-4d81-ae13-725db218703c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:41.825146 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1115c266-3bd1-4d81-ae13-725db218703c admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:41.825616 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1115c266-3bd1-4d81-ae13-725db218703c admin admin] PATH_INFO: `/v3/users/b398969c37454956a73bf459e0d37e61` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:41.827160 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1115c266-3bd1-4d81-ae13-725db218703c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b398969c37454956a73bf459e0d37e61)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:41.829591 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1115c266-3bd1-4d81-ae13-725db218703c admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:41.829933 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2347/4728] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:29:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:29:41.841483 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc81114-f930-40eb-b5de-2785ee3d405c None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:41.843040 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-0bc81114-f930-40eb-b5de-2785ee3d405c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:29:41.909199 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc81114-f930-40eb-b5de-2785ee3d405c None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:41.912824 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be633d6-d292-4835-9a4d-1e34b9c115bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:41.913479 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be633d6-d292-4835-9a4d-1e34b9c115bb service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:41.913735 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be633d6-d292-4835-9a4d-1e34b9c115bb service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:41.914006 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be633d6-d292-4835-9a4d-1e34b9c115bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:41.925139 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be633d6-d292-4835-9a4d-1e34b9c115bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:41.926598 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be633d6-d292-4835-9a4d-1e34b9c115bb service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:41.936729 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2348/4729] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:29:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:29:42.008365 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-1115c266-3bd1-4d81-ae13-725db218703c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b398969c37454956a73bf459e0d37e61'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:42.020900 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-1115c266-3bd1-4d81-ae13-725db218703c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b398969c37454956a73bf459e0d37e61'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:42.027937 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-1115c266-3bd1-4d81-ae13-725db218703c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b398969c37454956a73bf459e0d37e61'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:42.127422 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-1115c266-3bd1-4d81-ae13-725db218703c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b398969c37454956a73bf459e0d37e61'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:42.128268 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-1115c266-3bd1-4d81-ae13-725db218703c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b398969c37454956a73bf459e0d37e61'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:42.135646 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2382/4730] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:29:41 2022] DELETE /identity/v3/users/b398969c37454956a73bf459e0d37e61 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:29:42.345660 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be633d6-d292-4835-9a4d-1e34b9c115bb service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:42.347101 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-3be633d6-d292-4835-9a4d-1e34b9c115bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:29:42.368913 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1115c266-3bd1-4d81-ae13-725db218703c admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:42.369092 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be633d6-d292-4835-9a4d-1e34b9c115bb service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:42.370995 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-1115c266-3bd1-4d81-ae13-725db218703c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:29:42.435692 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94446a55-607b-4330-9010-f4d3af37e806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:42.436550 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94446a55-607b-4330-9010-f4d3af37e806 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:42.437470 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94446a55-607b-4330-9010-f4d3af37e806 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:42.437470 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94446a55-607b-4330-9010-f4d3af37e806 admin admin] PATH_INFO: `/v3/projects/939c7de6596640f1b2b8081775020666` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:42.438729 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94446a55-607b-4330-9010-f4d3af37e806 admin admin] RBAC: Authorizing `identity:delete_project(project_id=939c7de6596640f1b2b8081775020666)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:42.440698 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94446a55-607b-4330-9010-f4d3af37e806 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:42.443726 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1115c266-3bd1-4d81-ae13-725db218703c admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:42.448357 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8af27-4ce3-4356-8de1-a9397d3c07fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:42.449213 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8af27-4ce3-4356-8de1-a9397d3c07fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:42.449546 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8af27-4ce3-4356-8de1-a9397d3c07fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:42.449831 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8af27-4ce3-4356-8de1-a9397d3c07fc admin admin] PATH_INFO: `/v3/projects/91fceeecfb744810a52fd04cc03c72cf` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:42.450994 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b8af27-4ce3-4356-8de1-a9397d3c07fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=91fceeecfb744810a52fd04cc03c72cf)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:42.452920 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b8af27-4ce3-4356-8de1-a9397d3c07fc admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:42.576851 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-94446a55-607b-4330-9010-f4d3af37e806 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '939c7de6596640f1b2b8081775020666', 'request_id': 'req-94446a55-607b-4330-9010-f4d3af37e806'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:42.588603 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-94446a55-607b-4330-9010-f4d3af37e806 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '939c7de6596640f1b2b8081775020666', 'request_id': 'req-94446a55-607b-4330-9010-f4d3af37e806'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:42.596040 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-94446a55-607b-4330-9010-f4d3af37e806 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '939c7de6596640f1b2b8081775020666', 'request_id': 'req-94446a55-607b-4330-9010-f4d3af37e806'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:42.598283 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a4b8af27-4ce3-4356-8de1-a9397d3c07fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91fceeecfb744810a52fd04cc03c72cf', 'request_id': 'req-a4b8af27-4ce3-4356-8de1-a9397d3c07fc'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:42.614174 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a4b8af27-4ce3-4356-8de1-a9397d3c07fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91fceeecfb744810a52fd04cc03c72cf', 'request_id': 'req-a4b8af27-4ce3-4356-8de1-a9397d3c07fc'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:42.699836 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-94446a55-607b-4330-9010-f4d3af37e806 admin admin] The token cache is being invalidate because project 939c7de6596640f1b2b8081775020666 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:29:42.699836 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-94446a55-607b-4330-9010-f4d3af37e806 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:42.699836 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-94446a55-607b-4330-9010-f4d3af37e806 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:42.699836 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2349/4731] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:29:42 2022] DELETE /identity/v3/projects/939c7de6596640f1b2b8081775020666 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:29:42.700570 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e1d30-a2b3-4971-aa35-73e843e69c3b None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:42.701040 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e1d30-a2b3-4971-aa35-73e843e69c3b None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:42.701316 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e1d30-a2b3-4971-aa35-73e843e69c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:42.720190 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-708e1d30-a2b3-4971-aa35-73e843e69c3b None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:29:42.721397 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-708e1d30-a2b3-4971-aa35-73e843e69c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:29:42.748704 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a4b8af27-4ce3-4356-8de1-a9397d3c07fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91fceeecfb744810a52fd04cc03c72cf', 'request_id': 'req-a4b8af27-4ce3-4356-8de1-a9397d3c07fc'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:42.761759 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a4b8af27-4ce3-4356-8de1-a9397d3c07fc admin admin] The token cache is being invalidate because project 91fceeecfb744810a52fd04cc03c72cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:29:42.762286 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a4b8af27-4ce3-4356-8de1-a9397d3c07fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:42.762976 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a4b8af27-4ce3-4356-8de1-a9397d3c07fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:42.764658 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2383/4732] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:29:42 2022] DELETE /identity/v3/projects/91fceeecfb744810a52fd04cc03c72cf => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:29:42.770366 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c0988-5605-4802-ae0f-87478482cc0b None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:42.774420 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c0988-5605-4802-ae0f-87478482cc0b None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:42.774420 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c0988-5605-4802-ae0f-87478482cc0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:42.781186 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2350/4733] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:29:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:29:42.789366 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e056c-31fe-4793-8933-66afaa317119 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:42.789649 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e056c-31fe-4793-8933-66afaa317119 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:42.789922 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e056c-31fe-4793-8933-66afaa317119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:42.791272 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-5b4c0988-5605-4802-ae0f-87478482cc0b None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:29:42.792507 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-5b4c0988-5605-4802-ae0f-87478482cc0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:29:42.801610 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2384/4734] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:29:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:29:42.808889 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-5d9e056c-31fe-4793-8933-66afaa317119 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:29:42.809061 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91628641-bc3c-4659-b84d-6debc887ac23 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:42.809306 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91628641-bc3c-4659-b84d-6debc887ac23 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:42.809587 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91628641-bc3c-4659-b84d-6debc887ac23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:42.810096 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-5d9e056c-31fe-4793-8933-66afaa317119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:29:42.818490 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2351/4735] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:29:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:29:42.823158 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9e056c-31fe-4793-8933-66afaa317119 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:42.827709 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-91628641-bc3c-4659-b84d-6debc887ac23 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:29:42.828940 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-91628641-bc3c-4659-b84d-6debc887ac23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:29:42.832564 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9e056c-31fe-4793-8933-66afaa317119 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:42.836916 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2385/4736] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:29:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:29:42.838559 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c9c9f-b9d6-4cf8-83ef-50efd0e41102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:42.843460 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c9c9f-b9d6-4cf8-83ef-50efd0e41102 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:42.843460 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c9c9f-b9d6-4cf8-83ef-50efd0e41102 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:42.843460 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c9c9f-b9d6-4cf8-83ef-50efd0e41102 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:42.843460 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1c9c9f-b9d6-4cf8-83ef-50efd0e41102 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:29:42.843460 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1c9c9f-b9d6-4cf8-83ef-50efd0e41102 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:42.843460 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1c9c9f-b9d6-4cf8-83ef-50efd0e41102 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:42.846780 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91628641-bc3c-4659-b84d-6debc887ac23 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:42.854720 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2352/4737] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:29:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:29:42.855825 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91628641-bc3c-4659-b84d-6debc887ac23 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:42.859155 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c9c9f-b9d6-4cf8-83ef-50efd0e41102 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:42.863213 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a1304d-d023-4622-af96-14983a819579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:42.874185 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1304d-d023-4622-af96-14983a819579 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:42.874185 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1304d-d023-4622-af96-14983a819579 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:42.874185 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1304d-d023-4622-af96-14983a819579 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:42.874185 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a1304d-d023-4622-af96-14983a819579 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:29:42.874185 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a1304d-d023-4622-af96-14983a819579 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:42.874185 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a1304d-d023-4622-af96-14983a819579 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:42.874794 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c9c9f-b9d6-4cf8-83ef-50efd0e41102 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:42.875180 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18ef3ad-db36-43be-88f7-645742e05719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:42.875874 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ef3ad-db36-43be-88f7-645742e05719 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:42.876241 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ef3ad-db36-43be-88f7-645742e05719 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:42.876525 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ef3ad-db36-43be-88f7-645742e05719 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:42.877217 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18ef3ad-db36-43be-88f7-645742e05719 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:42.879193 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18ef3ad-db36-43be-88f7-645742e05719 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:42.882255 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2386/4738] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:29:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:29:42.886401 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a1304d-d023-4622-af96-14983a819579 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:42.897841 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a1304d-d023-4622-af96-14983a819579 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:42.902559 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f75d0-c973-4022-800d-a451af059b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:42.903218 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f75d0-c973-4022-800d-a451af059b29 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:42.903534 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f75d0-c973-4022-800d-a451af059b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:42.903862 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f75d0-c973-4022-800d-a451af059b29 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:42.904641 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7f75d0-c973-4022-800d-a451af059b29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:42.907414 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7f75d0-c973-4022-800d-a451af059b29 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:42.995583 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2387/4739] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:29:42 2022] POST /identity/v3/projects => generated 365 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:29:42.998726 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2353/4740] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:29:42 2022] POST /identity/v3/projects => generated 383 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:29:42.999550 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f75d0-c973-4022-800d-a451af059b29 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:42.999750 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18ef3ad-db36-43be-88f7-645742e05719 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:43.061487 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f75d0-c973-4022-800d-a451af059b29 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:43.067681 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96246f8f-745a-4906-a94e-749305455f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:43.068485 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96246f8f-745a-4906-a94e-749305455f95 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:43.068894 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96246f8f-745a-4906-a94e-749305455f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:43.069062 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18ef3ad-db36-43be-88f7-645742e05719 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:43.069280 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96246f8f-745a-4906-a94e-749305455f95 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:43.070031 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96246f8f-745a-4906-a94e-749305455f95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:43.072068 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96246f8f-745a-4906-a94e-749305455f95 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:43.074271 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebe1b60-7077-4eb5-8e4d-e3e7611a5d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:43.081293 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe1b60-7077-4eb5-8e4d-e3e7611a5d13 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:43.081293 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe1b60-7077-4eb5-8e4d-e3e7611a5d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:43.081293 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe1b60-7077-4eb5-8e4d-e3e7611a5d13 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:43.081293 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebe1b60-7077-4eb5-8e4d-e3e7611a5d13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:43.081293 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebe1b60-7077-4eb5-8e4d-e3e7611a5d13 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:43.149971 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2388/4741] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:29:42 2022] POST /identity/v3/users => generated 283 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:29:43.150297 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2354/4742] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:29:42 2022] POST /identity/v3/users => generated 292 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:29:43.154034 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96246f8f-745a-4906-a94e-749305455f95 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:43.155042 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebe1b60-7077-4eb5-8e4d-e3e7611a5d13 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:43.165637 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96246f8f-745a-4906-a94e-749305455f95 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:43.166105 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebe1b60-7077-4eb5-8e4d-e3e7611a5d13 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:43.170452 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0904c58d-f2b6-4f49-9fbc-8d1a0e7a3a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:43.171112 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904c58d-f2b6-4f49-9fbc-8d1a0e7a3a12 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:43.172858 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b623671-4537-46f8-8e38-90eec2fa8bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:43.172997 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904c58d-f2b6-4f49-9fbc-8d1a0e7a3a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:43.172997 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904c58d-f2b6-4f49-9fbc-8d1a0e7a3a12 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:43.173189 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b623671-4537-46f8-8e38-90eec2fa8bdb admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:43.173279 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0904c58d-f2b6-4f49-9fbc-8d1a0e7a3a12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:43.173404 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b623671-4537-46f8-8e38-90eec2fa8bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:43.173404 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b623671-4537-46f8-8e38-90eec2fa8bdb admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:43.174341 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b623671-4537-46f8-8e38-90eec2fa8bdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:43.174575 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0904c58d-f2b6-4f49-9fbc-8d1a0e7a3a12 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:43.176018 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b623671-4537-46f8-8e38-90eec2fa8bdb admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:43.190225 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2389/4743] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:29:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:29:43.191354 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0904c58d-f2b6-4f49-9fbc-8d1a0e7a3a12 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:43.203336 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2355/4744] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:29:43 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:29:43.207539 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0904c58d-f2b6-4f49-9fbc-8d1a0e7a3a12 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:43.208143 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b623671-4537-46f8-8e38-90eec2fa8bdb admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:43.212635 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c0b293-f0bd-49b2-b1e3-1f92b244701b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:43.213411 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c0b293-f0bd-49b2-b1e3-1f92b244701b admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:43.213702 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c0b293-f0bd-49b2-b1e3-1f92b244701b admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:43.213981 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c0b293-f0bd-49b2-b1e3-1f92b244701b admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:43.214699 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c0b293-f0bd-49b2-b1e3-1f92b244701b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:43.216412 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c0b293-f0bd-49b2-b1e3-1f92b244701b admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:43.220551 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b623671-4537-46f8-8e38-90eec2fa8bdb admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:43.226921 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e51360-5479-445c-ae75-25012563b90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:43.227616 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e51360-5479-445c-ae75-25012563b90c admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:43.228931 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e51360-5479-445c-ae75-25012563b90c admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:43.228931 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e51360-5479-445c-ae75-25012563b90c admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:43.229143 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2390/4745] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:29:43 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:29:43.229251 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e51360-5479-445c-ae75-25012563b90c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:43.230643 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e51360-5479-445c-ae75-25012563b90c admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:43.232597 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c0b293-f0bd-49b2-b1e3-1f92b244701b admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:43.243046 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c0b293-f0bd-49b2-b1e3-1f92b244701b admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:43.244613 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2356/4746] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:29:43 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:29:43.247914 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1f30d1-6212-471b-b89f-95e2dcc92d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:43.248782 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e51360-5479-445c-ae75-25012563b90c admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:43.256915 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f30d1-6212-471b-b89f-95e2dcc92d82 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:43.256915 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f30d1-6212-471b-b89f-95e2dcc92d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:43.256915 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f30d1-6212-471b-b89f-95e2dcc92d82 admin admin] PATH_INFO: `/v3/projects/162610ac2697486d8a05f41713cc5ba2/users/a8e967d05266477dbc5748ed77b8c69e/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:43.259923 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e51360-5479-445c-ae75-25012563b90c admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:43.265226 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef026bf-c62e-4567-ad11-a7043c8c2e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:43.266691 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef026bf-c62e-4567-ad11-a7043c8c2e17 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:43.267171 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef026bf-c62e-4567-ad11-a7043c8c2e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:43.267299 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef026bf-c62e-4567-ad11-a7043c8c2e17 admin admin] PATH_INFO: `/v3/projects/a72e2038e5724d5ab59a47dab93612c8/users/500a32aaf082446e9ad0875baa1b7b90/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:43.279654 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1f30d1-6212-471b-b89f-95e2dcc92d82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=162610ac2697486d8a05f41713cc5ba2, user_id=a8e967d05266477dbc5748ed77b8c69e, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:43.282428 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1f30d1-6212-471b-b89f-95e2dcc92d82 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:43.287453 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef026bf-c62e-4567-ad11-a7043c8c2e17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a72e2038e5724d5ab59a47dab93612c8, user_id=500a32aaf082446e9ad0875baa1b7b90, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:43.290371 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef026bf-c62e-4567-ad11-a7043c8c2e17 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:43.352267 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2357/4747] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:29:43 2022] PUT /identity/v3/projects/a72e2038e5724d5ab59a47dab93612c8/users/500a32aaf082446e9ad0875baa1b7b90/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:29:43.353368 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2391/4748] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:29:43 2022] PUT /identity/v3/projects/162610ac2697486d8a05f41713cc5ba2/users/a8e967d05266477dbc5748ed77b8c69e/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:29:43.364257 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be4f64-a619-421a-b275-364a4878e6d3 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:43.364257 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be4f64-a619-421a-b275-364a4878e6d3 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:43.364257 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be4f64-a619-421a-b275-364a4878e6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:43.366491 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be004f3-4282-4354-ab96-b9c4bf21863d None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:43.366985 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be004f3-4282-4354-ab96-b9c4bf21863d None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:43.367267 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be004f3-4282-4354-ab96-b9c4bf21863d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:43.389109 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-9be004f3-4282-4354-ab96-b9c4bf21863d None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:29:43.390680 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-9be004f3-4282-4354-ab96-b9c4bf21863d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:29:43.396804 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-89be4f64-a619-421a-b275-364a4878e6d3 None None] MFA Rules not processed for user `500a32aaf082446e9ad0875baa1b7b90`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:29:43.398191 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-89be4f64-a619-421a-b275-364a4878e6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:29:43.462676 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2358/4749] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:29:43 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:29:43.469825 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2392/4750] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:29:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:29:43.474925 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89be4f64-a619-421a-b275-364a4878e6d3 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:43.476419 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-89be4f64-a619-421a-b275-364a4878e6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:29:43.479176 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be004f3-4282-4354-ab96-b9c4bf21863d None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:43.480542 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-9be004f3-4282-4354-ab96-b9c4bf21863d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:29:43.539540 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be004f3-4282-4354-ab96-b9c4bf21863d None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:43.543698 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9df066-4618-4ba7-b7f6-4a8a78c41478 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:43.544434 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9df066-4618-4ba7-b7f6-4a8a78c41478 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:43.544829 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9df066-4618-4ba7-b7f6-4a8a78c41478 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:43.545188 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9df066-4618-4ba7-b7f6-4a8a78c41478 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:43.550976 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89be4f64-a619-421a-b275-364a4878e6d3 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:43.554928 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9df066-4618-4ba7-b7f6-4a8a78c41478 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:43.556469 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9df066-4618-4ba7-b7f6-4a8a78c41478 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:43.556713 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930d227e-3565-42c0-b2ee-586dab0358d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:43.557363 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d227e-3565-42c0-b2ee-586dab0358d1 service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:43.557648 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d227e-3565-42c0-b2ee-586dab0358d1 service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:43.557989 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d227e-3565-42c0-b2ee-586dab0358d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:43.567418 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2393/4751] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:29:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:29:43.568208 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930d227e-3565-42c0-b2ee-586dab0358d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:43.570562 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930d227e-3565-42c0-b2ee-586dab0358d1 service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:43.581823 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2359/4752] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:29:43 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:29:43.622473 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9df066-4618-4ba7-b7f6-4a8a78c41478 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:43.633136 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9df066-4618-4ba7-b7f6-4a8a78c41478 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:43.637901 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fc101c-b491-40f4-9055-9a5037210222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:43.638753 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc101c-b491-40f4-9055-9a5037210222 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:43.639035 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc101c-b491-40f4-9055-9a5037210222 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:43.639563 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc101c-b491-40f4-9055-9a5037210222 admin admin] PATH_INFO: `/v3/users/500a32aaf082446e9ad0875baa1b7b90` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:43.641223 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fc101c-b491-40f4-9055-9a5037210222 admin admin] RBAC: Authorizing `identity:delete_user(user_id=500a32aaf082446e9ad0875baa1b7b90)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:43.643781 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fc101c-b491-40f4-9055-9a5037210222 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:43.958493 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-74fc101c-b491-40f4-9055-9a5037210222 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '500a32aaf082446e9ad0875baa1b7b90'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:43.979261 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-74fc101c-b491-40f4-9055-9a5037210222 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '500a32aaf082446e9ad0875baa1b7b90'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:43.987820 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-74fc101c-b491-40f4-9055-9a5037210222 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '500a32aaf082446e9ad0875baa1b7b90'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:44.069376 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-74fc101c-b491-40f4-9055-9a5037210222 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '500a32aaf082446e9ad0875baa1b7b90'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:44.070280 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-74fc101c-b491-40f4-9055-9a5037210222 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '500a32aaf082446e9ad0875baa1b7b90'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:44.077337 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2394/4753] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:29:43 2022] DELETE /identity/v3/users/500a32aaf082446e9ad0875baa1b7b90 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:29:44.082313 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a3b3b-985d-4f61-9fff-b8400abe0d4d None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:44.082603 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a3b3b-985d-4f61-9fff-b8400abe0d4d None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:44.082930 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a3b3b-985d-4f61-9fff-b8400abe0d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:44.104118 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-e66a3b3b-985d-4f61-9fff-b8400abe0d4d None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:29:44.105394 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e66a3b3b-985d-4f61-9fff-b8400abe0d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:29:44.201409 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2360/4754] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:29:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:29:44.211225 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fc101c-b491-40f4-9055-9a5037210222 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:44.212770 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-74fc101c-b491-40f4-9055-9a5037210222 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:29:44.309481 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fc101c-b491-40f4-9055-9a5037210222 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:44.314680 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b882e222-bd0f-4e1c-81d3-2b46e8492545 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:44.315786 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882e222-bd0f-4e1c-81d3-2b46e8492545 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:44.315958 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882e222-bd0f-4e1c-81d3-2b46e8492545 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:44.316244 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882e222-bd0f-4e1c-81d3-2b46e8492545 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:44.331747 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b882e222-bd0f-4e1c-81d3-2b46e8492545 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:44.341508 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b882e222-bd0f-4e1c-81d3-2b46e8492545 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:44.354271 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2395/4755] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:29:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:29:44.930727 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66a3b3b-985d-4f61-9fff-b8400abe0d4d None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:44.932906 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e66a3b3b-985d-4f61-9fff-b8400abe0d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:29:44.951032 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66a3b3b-985d-4f61-9fff-b8400abe0d4d None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:44.959675 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967076e7-c841-4a60-869d-fa89fa6fcbfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:44.961074 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967076e7-c841-4a60-869d-fa89fa6fcbfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:44.961588 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967076e7-c841-4a60-869d-fa89fa6fcbfd admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:44.962047 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967076e7-c841-4a60-869d-fa89fa6fcbfd admin admin] PATH_INFO: `/v3/projects/a72e2038e5724d5ab59a47dab93612c8` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:44.965197 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967076e7-c841-4a60-869d-fa89fa6fcbfd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a72e2038e5724d5ab59a47dab93612c8)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:44.968320 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967076e7-c841-4a60-869d-fa89fa6fcbfd admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:45.122378 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-967076e7-c841-4a60-869d-fa89fa6fcbfd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a72e2038e5724d5ab59a47dab93612c8', 'request_id': 'req-967076e7-c841-4a60-869d-fa89fa6fcbfd'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:45.128615 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-967076e7-c841-4a60-869d-fa89fa6fcbfd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a72e2038e5724d5ab59a47dab93612c8', 'request_id': 'req-967076e7-c841-4a60-869d-fa89fa6fcbfd'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:45.135203 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-967076e7-c841-4a60-869d-fa89fa6fcbfd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a72e2038e5724d5ab59a47dab93612c8', 'request_id': 'req-967076e7-c841-4a60-869d-fa89fa6fcbfd'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:45.206136 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-967076e7-c841-4a60-869d-fa89fa6fcbfd admin admin] The token cache is being invalidate because project a72e2038e5724d5ab59a47dab93612c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:29:45.206487 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-967076e7-c841-4a60-869d-fa89fa6fcbfd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:45.207137 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-967076e7-c841-4a60-869d-fa89fa6fcbfd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:45.208738 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2361/4756] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:29:44 2022] DELETE /identity/v3/projects/a72e2038e5724d5ab59a47dab93612c8 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:29:45.217140 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15351bd5-0437-4cb9-ad57-f61bd0bdfc38 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:45.217708 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15351bd5-0437-4cb9-ad57-f61bd0bdfc38 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:45.217708 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15351bd5-0437-4cb9-ad57-f61bd0bdfc38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:45.235527 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-15351bd5-0437-4cb9-ad57-f61bd0bdfc38 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:29:45.236758 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-15351bd5-0437-4cb9-ad57-f61bd0bdfc38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:29:45.300738 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2396/4757] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:29:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:29:45.309469 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbff9a7-7420-4d7f-a557-3b6ee5935a4c None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:45.309793 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbff9a7-7420-4d7f-a557-3b6ee5935a4c None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:45.310094 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbff9a7-7420-4d7f-a557-3b6ee5935a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:45.329727 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-9fbff9a7-7420-4d7f-a557-3b6ee5935a4c None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:29:45.331178 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-9fbff9a7-7420-4d7f-a557-3b6ee5935a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:29:45.339677 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2362/4758] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:29:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:29:45.343849 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15351bd5-0437-4cb9-ad57-f61bd0bdfc38 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:45.354259 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15351bd5-0437-4cb9-ad57-f61bd0bdfc38 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:45.359039 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9046429c-352d-4346-91b7-eed46ec49464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:45.360410 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046429c-352d-4346-91b7-eed46ec49464 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:45.360854 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046429c-352d-4346-91b7-eed46ec49464 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:45.361100 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046429c-352d-4346-91b7-eed46ec49464 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:45.361826 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9046429c-352d-4346-91b7-eed46ec49464 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:29:45.362135 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9046429c-352d-4346-91b7-eed46ec49464 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:45.363848 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9046429c-352d-4346-91b7-eed46ec49464 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:45.377054 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2397/4759] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:29:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:29:45.384052 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbff9a7-7420-4d7f-a557-3b6ee5935a4c None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:45.395854 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbff9a7-7420-4d7f-a557-3b6ee5935a4c None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:45.400981 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9277523-9cc6-4458-bba0-e8ffea4328b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:45.401652 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9277523-9cc6-4458-bba0-e8ffea4328b4 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:45.401938 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9277523-9cc6-4458-bba0-e8ffea4328b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:45.402217 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9277523-9cc6-4458-bba0-e8ffea4328b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:45.403027 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9277523-9cc6-4458-bba0-e8ffea4328b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:45.405001 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9277523-9cc6-4458-bba0-e8ffea4328b4 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:45.475604 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76def932-7278-4718-a2c0-d05b4c3617b0 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:45.475904 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76def932-7278-4718-a2c0-d05b4c3617b0 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:45.476193 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76def932-7278-4718-a2c0-d05b4c3617b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:45.497293 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2363/4760] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:29:45 2022] POST /identity/v3/projects => generated 377 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:29:45.502778 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9277523-9cc6-4458-bba0-e8ffea4328b4 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:45.512341 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-76def932-7278-4718-a2c0-d05b4c3617b0 None None] MFA Rules not processed for user `a8e967d05266477dbc5748ed77b8c69e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:29:45.513744 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-76def932-7278-4718-a2c0-d05b4c3617b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:29:45.580806 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9277523-9cc6-4458-bba0-e8ffea4328b4 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:45.585644 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae49e11-391e-4a8b-a28a-3e970ae92b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:45.586398 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae49e11-391e-4a8b-a28a-3e970ae92b54 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:45.586757 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae49e11-391e-4a8b-a28a-3e970ae92b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:45.587106 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae49e11-391e-4a8b-a28a-3e970ae92b54 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:45.587920 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae49e11-391e-4a8b-a28a-3e970ae92b54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:45.590090 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae49e11-391e-4a8b-a28a-3e970ae92b54 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:45.595266 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2398/4761] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:29:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:29:45.607803 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76def932-7278-4718-a2c0-d05b4c3617b0 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:45.610038 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-76def932-7278-4718-a2c0-d05b4c3617b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:29:45.674753 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76def932-7278-4718-a2c0-d05b4c3617b0 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:45.678454 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdfe9c7-1087-4c6d-97e4-7d9f968a31d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198271d1c0d44cb58bace41a65f4b94c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:45.679166 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdfe9c7-1087-4c6d-97e4-7d9f968a31d4 service cinder] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:45.683458 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdfe9c7-1087-4c6d-97e4-7d9f968a31d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:45.683458 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdfe9c7-1087-4c6d-97e4-7d9f968a31d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:45.688302 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdfe9c7-1087-4c6d-97e4-7d9f968a31d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:45.689826 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdfe9c7-1087-4c6d-97e4-7d9f968a31d4 service cinder] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:45.698651 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2399/4762] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:29:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:29:45.743767 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2364/4763] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:29:45 2022] POST /identity/v3/users => generated 289 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:29:45.747897 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdfe9c7-1087-4c6d-97e4-7d9f968a31d4 service cinder] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:45.758744 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdfe9c7-1087-4c6d-97e4-7d9f968a31d4 service cinder] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:45.763870 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d31fd42-92a9-4f88-94ec-814099a0c453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:45.764564 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d31fd42-92a9-4f88-94ec-814099a0c453 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:45.765128 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d31fd42-92a9-4f88-94ec-814099a0c453 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:45.765391 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d31fd42-92a9-4f88-94ec-814099a0c453 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:45.766112 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d31fd42-92a9-4f88-94ec-814099a0c453 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:45.767822 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d31fd42-92a9-4f88-94ec-814099a0c453 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:45.777922 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2400/4764] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:29:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:29:45.782773 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae49e11-391e-4a8b-a28a-3e970ae92b54 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:45.792726 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae49e11-391e-4a8b-a28a-3e970ae92b54 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:45.798016 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d8e258-042f-41bf-9cd9-e5938b849bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:45.799409 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8e258-042f-41bf-9cd9-e5938b849bc3 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:45.799740 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8e258-042f-41bf-9cd9-e5938b849bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:45.800404 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8e258-042f-41bf-9cd9-e5938b849bc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:45.800723 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d8e258-042f-41bf-9cd9-e5938b849bc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:45.802345 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d8e258-042f-41bf-9cd9-e5938b849bc3 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:45.813269 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2365/4765] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:29:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:29:45.817597 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d31fd42-92a9-4f88-94ec-814099a0c453 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:45.832556 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d31fd42-92a9-4f88-94ec-814099a0c453 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:45.839874 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e57cf-e35c-4ed6-bd5e-54311191c3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:45.841036 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e57cf-e35c-4ed6-bd5e-54311191c3f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:45.841519 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e57cf-e35c-4ed6-bd5e-54311191c3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:45.841967 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e57cf-e35c-4ed6-bd5e-54311191c3f5 admin admin] PATH_INFO: `/v3/projects/1b26638e3c7540ed935f64031b52db96/users/0314b915239e432a90b112c8cb9a9321/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:45.861650 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7e57cf-e35c-4ed6-bd5e-54311191c3f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b26638e3c7540ed935f64031b52db96, user_id=0314b915239e432a90b112c8cb9a9321, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:45.864343 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7e57cf-e35c-4ed6-bd5e-54311191c3f5 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:45.956437 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2401/4766] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:29:45 2022] PUT /identity/v3/projects/1b26638e3c7540ed935f64031b52db96/users/0314b915239e432a90b112c8cb9a9321/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:29:45.966590 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b7f09c-a4fe-4370-af31-f33818a2ee14 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:45.967086 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b7f09c-a4fe-4370-af31-f33818a2ee14 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:45.967230 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b7f09c-a4fe-4370-af31-f33818a2ee14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:46.003286 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-b8b7f09c-a4fe-4370-af31-f33818a2ee14 None None] MFA Rules not processed for user `0314b915239e432a90b112c8cb9a9321`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:29:46.003286 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b8b7f09c-a4fe-4370-af31-f33818a2ee14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:29:46.071219 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2366/4767] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:29:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:29:46.076108 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e57cf-e35c-4ed6-bd5e-54311191c3f5 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:46.141894 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e57cf-e35c-4ed6-bd5e-54311191c3f5 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:46.146415 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66587f8a-9b72-4b13-974c-283c13800b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:46.147088 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66587f8a-9b72-4b13-974c-283c13800b9d admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:46.147373 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66587f8a-9b72-4b13-974c-283c13800b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:46.147677 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66587f8a-9b72-4b13-974c-283c13800b9d admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:46.148366 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66587f8a-9b72-4b13-974c-283c13800b9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:46.150259 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66587f8a-9b72-4b13-974c-283c13800b9d admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:46.264619 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2402/4768] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:29:46 2022] POST /identity/v3/projects => generated 377 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:29:46.269001 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b7f09c-a4fe-4370-af31-f33818a2ee14 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:46.279533 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b7f09c-a4fe-4370-af31-f33818a2ee14 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:46.342553 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb7ff86-e31f-4312-90c7-10d971f5aa3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:46.343358 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7ff86-e31f-4312-90c7-10d971f5aa3e admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:46.344320 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7ff86-e31f-4312-90c7-10d971f5aa3e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:46.344695 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7ff86-e31f-4312-90c7-10d971f5aa3e admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:46.345517 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb7ff86-e31f-4312-90c7-10d971f5aa3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:46.348073 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb7ff86-e31f-4312-90c7-10d971f5aa3e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:46.434958 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2367/4769] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:29:46 2022] POST /identity/v3/users => generated 295 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:29:46.439128 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66587f8a-9b72-4b13-974c-283c13800b9d admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:46.449306 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66587f8a-9b72-4b13-974c-283c13800b9d admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:46.453927 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e2851-e6b5-4eb7-accb-c92425b168da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:46.454579 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e2851-e6b5-4eb7-accb-c92425b168da admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:46.454857 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e2851-e6b5-4eb7-accb-c92425b168da admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:46.455130 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e2851-e6b5-4eb7-accb-c92425b168da admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:46.455911 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48e2851-e6b5-4eb7-accb-c92425b168da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:46.461753 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48e2851-e6b5-4eb7-accb-c92425b168da admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:46.469128 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2403/4770] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:29:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:29:46.473405 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb7ff86-e31f-4312-90c7-10d971f5aa3e admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:46.484174 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb7ff86-e31f-4312-90c7-10d971f5aa3e admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:46.489644 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca2a10-81c2-4065-bf64-ae813794946a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:46.490620 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca2a10-81c2-4065-bf64-ae813794946a admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:46.490904 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca2a10-81c2-4065-bf64-ae813794946a admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:46.491181 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca2a10-81c2-4065-bf64-ae813794946a admin admin] PATH_INFO: `/v3/projects/40cd8c9e94e9480ebfb04eae85f6be60/users/d592be499fb8433498c4afd66c88ee35/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:46.506211 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeca2a10-81c2-4065-bf64-ae813794946a admin admin] RBAC: Authorizing `identity:create_grant(project_id=40cd8c9e94e9480ebfb04eae85f6be60, user_id=d592be499fb8433498c4afd66c88ee35, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:46.508969 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeca2a10-81c2-4065-bf64-ae813794946a admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:46.618171 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2368/4771] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:29:46 2022] PUT /identity/v3/projects/40cd8c9e94e9480ebfb04eae85f6be60/users/d592be499fb8433498c4afd66c88ee35/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:29:46.622109 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e2851-e6b5-4eb7-accb-c92425b168da admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:46.633105 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e2851-e6b5-4eb7-accb-c92425b168da admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:46.692929 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1623a80-1631-454d-85aa-e71d908714fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:46.693849 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1623a80-1631-454d-85aa-e71d908714fd admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:46.694307 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1623a80-1631-454d-85aa-e71d908714fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:46.694686 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1623a80-1631-454d-85aa-e71d908714fd admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:46.695609 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1623a80-1631-454d-85aa-e71d908714fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:46.697329 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1623a80-1631-454d-85aa-e71d908714fd admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:46.708340 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2404/4772] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:29:46 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:29:46.712245 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca2a10-81c2-4065-bf64-ae813794946a admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:46.722850 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca2a10-81c2-4065-bf64-ae813794946a admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:46.727604 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534a5726-9479-46be-b912-24a1d9c00f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:46.728485 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534a5726-9479-46be-b912-24a1d9c00f7d admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:46.730716 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534a5726-9479-46be-b912-24a1d9c00f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:46.730716 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534a5726-9479-46be-b912-24a1d9c00f7d admin admin] PATH_INFO: `/v3/projects/40cd8c9e94e9480ebfb04eae85f6be60/users/d592be499fb8433498c4afd66c88ee35/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:46.731041 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534a5726-9479-46be-b912-24a1d9c00f7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=40cd8c9e94e9480ebfb04eae85f6be60, user_id=d592be499fb8433498c4afd66c88ee35, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:46.733733 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534a5726-9479-46be-b912-24a1d9c00f7d admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:46.744580 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2369/4773] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:29:46 2022] PUT /identity/v3/projects/40cd8c9e94e9480ebfb04eae85f6be60/users/d592be499fb8433498c4afd66c88ee35/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:29:46.756079 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2de632-8137-47ac-bdf6-4521788a5786 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:46.756367 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2de632-8137-47ac-bdf6-4521788a5786 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:46.756645 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2de632-8137-47ac-bdf6-4521788a5786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:46.785892 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-2f2de632-8137-47ac-bdf6-4521788a5786 None None] MFA Rules not processed for user `d592be499fb8433498c4afd66c88ee35`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:29:46.787103 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-2f2de632-8137-47ac-bdf6-4521788a5786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:29:46.855222 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2405/4774] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:29:46 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:29:46.860147 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534a5726-9479-46be-b912-24a1d9c00f7d admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:46.870833 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534a5726-9479-46be-b912-24a1d9c00f7d admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:46.875396 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61716813-cf13-4c91-98ce-cbeebde11dbf tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd592be499fb8433498c4afd66c88ee35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd8c9e94e9480ebfb04eae85f6be60', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:46.876057 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61716813-cf13-4c91-98ce-cbeebde11dbf tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:46.876342 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61716813-cf13-4c91-98ce-cbeebde11dbf tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:46.876623 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61716813-cf13-4c91-98ce-cbeebde11dbf tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:46.877370 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61716813-cf13-4c91-98ce-cbeebde11dbf tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:46.878385 ncdv-master-1 devstack@keystone.service[91107]: WARNING py.warnings [None req-61716813-cf13-4c91-98ce-cbeebde11dbf tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:29:46.878385 ncdv-master-1 devstack@keystone.service[91107]: warnings.warn(msg) May 14 21:29:46.878385 ncdv-master-1 devstack@keystone.service[91107]: May 14 21:29:46.879265 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61716813-cf13-4c91-98ce-cbeebde11dbf tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:46.994722 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2370/4775] 10.222.0.52 () {60 vars in 1184 bytes} [Sat May 14 21:29:46 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:29:46.998853 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2de632-8137-47ac-bdf6-4521788a5786 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:47.009086 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2de632-8137-47ac-bdf6-4521788a5786 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:47.014466 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b92be5-8a7d-493a-80f4-b8289bbea82d tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd592be499fb8433498c4afd66c88ee35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd8c9e94e9480ebfb04eae85f6be60', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:47.015644 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b92be5-8a7d-493a-80f4-b8289bbea82d tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:47.016988 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b92be5-8a7d-493a-80f4-b8289bbea82d tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:47.017276 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b92be5-8a7d-493a-80f4-b8289bbea82d tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/85cb88b9681a4da5a36783711cd17c04` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:47.017929 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b92be5-8a7d-493a-80f4-b8289bbea82d tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=85cb88b9681a4da5a36783711cd17c04)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:47.018927 ncdv-master-1 devstack@keystone.service[91106]: WARNING py.warnings [None req-60b92be5-8a7d-493a-80f4-b8289bbea82d tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:29:47.018927 ncdv-master-1 devstack@keystone.service[91106]: warnings.warn(msg) May 14 21:29:47.018927 ncdv-master-1 devstack@keystone.service[91106]: May 14 21:29:47.019893 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b92be5-8a7d-493a-80f4-b8289bbea82d tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:47.026648 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2406/4776] 10.222.0.52 () {58 vars in 1262 bytes} [Sat May 14 21:29:46 2022] GET /identity/v3/OS-OAUTH1/consumers/85cb88b9681a4da5a36783711cd17c04 => generated 220 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:29:47.030786 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61716813-cf13-4c91-98ce-cbeebde11dbf tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:47.041011 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61716813-cf13-4c91-98ce-cbeebde11dbf tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:47.045881 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6511af8-2370-475b-beb7-4f7c409bd715 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd592be499fb8433498c4afd66c88ee35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd8c9e94e9480ebfb04eae85f6be60', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:47.046728 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6511af8-2370-475b-beb7-4f7c409bd715 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:47.047099 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6511af8-2370-475b-beb7-4f7c409bd715 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:47.047387 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6511af8-2370-475b-beb7-4f7c409bd715 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/85cb88b9681a4da5a36783711cd17c04` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:47.048175 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6511af8-2370-475b-beb7-4f7c409bd715 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=85cb88b9681a4da5a36783711cd17c04)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:47.049146 ncdv-master-1 devstack@keystone.service[91107]: WARNING py.warnings [None req-d6511af8-2370-475b-beb7-4f7c409bd715 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:29:47.049146 ncdv-master-1 devstack@keystone.service[91107]: warnings.warn(msg) May 14 21:29:47.049146 ncdv-master-1 devstack@keystone.service[91107]: May 14 21:29:47.050076 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6511af8-2370-475b-beb7-4f7c409bd715 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:47.050349 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d6511af8-2370-475b-beb7-4f7c409bd715 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] Invalidating token cache because consumer 85cb88b9681a4da5a36783711cd17c04 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:29:47.050632 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d6511af8-2370-475b-beb7-4f7c409bd715 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:47.051346 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d6511af8-2370-475b-beb7-4f7c409bd715 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:47.114303 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d6511af8-2370-475b-beb7-4f7c409bd715 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '85cb88b9681a4da5a36783711cd17c04', 'request_id': 'req-d6511af8-2370-475b-beb7-4f7c409bd715'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:47.183753 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2371/4777] 10.222.0.52 () {58 vars in 1265 bytes} [Sat May 14 21:29:47 2022] DELETE /identity/v3/OS-OAUTH1/consumers/85cb88b9681a4da5a36783711cd17c04 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:29:47.191311 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b92be5-8a7d-493a-80f4-b8289bbea82d tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:47.191311 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-60b92be5-8a7d-493a-80f4-b8289bbea82d tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:29:47.205530 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b92be5-8a7d-493a-80f4-b8289bbea82d tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:47.210446 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d505dcb4-5f8e-49a3-aa2e-0453b6f56812 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd592be499fb8433498c4afd66c88ee35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd8c9e94e9480ebfb04eae85f6be60', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:47.211090 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505dcb4-5f8e-49a3-aa2e-0453b6f56812 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:47.211373 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505dcb4-5f8e-49a3-aa2e-0453b6f56812 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:47.211682 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505dcb4-5f8e-49a3-aa2e-0453b6f56812 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:47.212404 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d505dcb4-5f8e-49a3-aa2e-0453b6f56812 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:47.213406 ncdv-master-1 devstack@keystone.service[91106]: WARNING py.warnings [None req-d505dcb4-5f8e-49a3-aa2e-0453b6f56812 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:29:47.213406 ncdv-master-1 devstack@keystone.service[91106]: warnings.warn(msg) May 14 21:29:47.213406 ncdv-master-1 devstack@keystone.service[91106]: May 14 21:29:47.214292 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d505dcb4-5f8e-49a3-aa2e-0453b6f56812 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:47.320608 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2407/4778] 10.222.0.52 () {60 vars in 1184 bytes} [Sat May 14 21:29:47 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:29:47.321839 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6511af8-2370-475b-beb7-4f7c409bd715 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:47.331981 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6511af8-2370-475b-beb7-4f7c409bd715 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:47.336606 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037809ef-f1ab-4a42-a3ef-5b1ad117feca tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd592be499fb8433498c4afd66c88ee35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd8c9e94e9480ebfb04eae85f6be60', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:47.337450 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037809ef-f1ab-4a42-a3ef-5b1ad117feca tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:47.337763 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037809ef-f1ab-4a42-a3ef-5b1ad117feca tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:47.338039 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037809ef-f1ab-4a42-a3ef-5b1ad117feca tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/fa1df3654eae42cc931b9de1cd85e89d` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:47.338678 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037809ef-f1ab-4a42-a3ef-5b1ad117feca tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=fa1df3654eae42cc931b9de1cd85e89d)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:47.339705 ncdv-master-1 devstack@keystone.service[91107]: WARNING py.warnings [None req-037809ef-f1ab-4a42-a3ef-5b1ad117feca tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:29:47.339705 ncdv-master-1 devstack@keystone.service[91107]: warnings.warn(msg) May 14 21:29:47.339705 ncdv-master-1 devstack@keystone.service[91107]: May 14 21:29:47.340590 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037809ef-f1ab-4a42-a3ef-5b1ad117feca tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:47.345898 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2372/4779] 10.222.0.52 () {58 vars in 1262 bytes} [Sat May 14 21:29:47 2022] GET /identity/v3/OS-OAUTH1/consumers/fa1df3654eae42cc931b9de1cd85e89d => generated 221 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:29:47.350497 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d505dcb4-5f8e-49a3-aa2e-0453b6f56812 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:47.362121 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d505dcb4-5f8e-49a3-aa2e-0453b6f56812 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:47.366888 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd60b9-1375-4bb9-bd4e-1462dc1af573 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd592be499fb8433498c4afd66c88ee35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd8c9e94e9480ebfb04eae85f6be60', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:47.370628 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd60b9-1375-4bb9-bd4e-1462dc1af573 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:47.370628 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd60b9-1375-4bb9-bd4e-1462dc1af573 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:47.370628 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd60b9-1375-4bb9-bd4e-1462dc1af573 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/fa1df3654eae42cc931b9de1cd85e89d` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:47.370628 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bd60b9-1375-4bb9-bd4e-1462dc1af573 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=fa1df3654eae42cc931b9de1cd85e89d)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:47.370981 ncdv-master-1 devstack@keystone.service[91106]: WARNING py.warnings [None req-a8bd60b9-1375-4bb9-bd4e-1462dc1af573 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:29:47.370981 ncdv-master-1 devstack@keystone.service[91106]: warnings.warn(msg) May 14 21:29:47.370981 ncdv-master-1 devstack@keystone.service[91106]: May 14 21:29:47.370981 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bd60b9-1375-4bb9-bd4e-1462dc1af573 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:47.371331 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a8bd60b9-1375-4bb9-bd4e-1462dc1af573 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] Invalidating token cache because consumer fa1df3654eae42cc931b9de1cd85e89d has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:29:47.371435 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a8bd60b9-1375-4bb9-bd4e-1462dc1af573 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:47.372119 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a8bd60b9-1375-4bb9-bd4e-1462dc1af573 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:47.434013 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a8bd60b9-1375-4bb9-bd4e-1462dc1af573 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'fa1df3654eae42cc931b9de1cd85e89d', 'request_id': 'req-a8bd60b9-1375-4bb9-bd4e-1462dc1af573'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:47.495050 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2408/4780] 10.222.0.52 () {58 vars in 1265 bytes} [Sat May 14 21:29:47 2022] DELETE /identity/v3/OS-OAUTH1/consumers/fa1df3654eae42cc931b9de1cd85e89d => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:29:47.499206 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037809ef-f1ab-4a42-a3ef-5b1ad117feca tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:47.504960 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-037809ef-f1ab-4a42-a3ef-5b1ad117feca tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:29:47.519192 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037809ef-f1ab-4a42-a3ef-5b1ad117feca tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:47.524469 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a8e56-1da5-47dc-b6ab-b1a5bb364e07 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd592be499fb8433498c4afd66c88ee35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd8c9e94e9480ebfb04eae85f6be60', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:47.525302 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a8e56-1da5-47dc-b6ab-b1a5bb364e07 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:47.525587 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a8e56-1da5-47dc-b6ab-b1a5bb364e07 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:47.525866 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a8e56-1da5-47dc-b6ab-b1a5bb364e07 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/fa1df3654eae42cc931b9de1cd85e89d` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:47.526527 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1a8e56-1da5-47dc-b6ab-b1a5bb364e07 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=fa1df3654eae42cc931b9de1cd85e89d)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:47.528238 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1a8e56-1da5-47dc-b6ab-b1a5bb364e07 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:47.571866 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-3f1a8e56-1da5-47dc-b6ab-b1a5bb364e07 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found May 14 21:29:47.571866 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:29:47.571866 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 21:29:47.571866 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 21:29:47.571866 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 21:29:47.571866 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 21:29:47.571866 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 21:29:47.571866 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 21:29:47.571866 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 21:29:47.571866 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 21:29:47.571866 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 21:29:47.571866 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 21:29:47.571866 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 100, in get May 14 21:29:47.571866 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_consumer(consumer_id) May 14 21:29:47.571866 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 95, in _get_consumer May 14 21:29:47.573311 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.oauth_api.get_consumer(consumer_id)) May 14 21:29:47.573311 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 101, in get_consumer May 14 21:29:47.573311 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application self.get_consumer_with_secret(consumer_id)) May 14 21:29:47.573311 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 96, in get_consumer_with_secret May 14 21:29:47.573311 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) May 14 21:29:47.573311 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer May 14 21:29:47.573311 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) May 14 21:29:47.573311 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found May 14 21:29:47.573311 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:29:47.574533 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2373/4781] 10.222.0.52 () {58 vars in 1262 bytes} [Sat May 14 21:29:47 2022] GET /identity/v3/OS-OAUTH1/consumers/fa1df3654eae42cc931b9de1cd85e89d => generated 74 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 21:29:47.577419 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd60b9-1375-4bb9-bd4e-1462dc1af573 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:47.592112 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd60b9-1375-4bb9-bd4e-1462dc1af573 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:47.597055 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3484cc45-26cf-4455-9f40-62495b49beb7 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd592be499fb8433498c4afd66c88ee35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd8c9e94e9480ebfb04eae85f6be60', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:47.597887 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3484cc45-26cf-4455-9f40-62495b49beb7 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:47.598177 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3484cc45-26cf-4455-9f40-62495b49beb7 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:47.598457 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3484cc45-26cf-4455-9f40-62495b49beb7 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/fa1df3654eae42cc931b9de1cd85e89d` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:47.599139 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3484cc45-26cf-4455-9f40-62495b49beb7 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=fa1df3654eae42cc931b9de1cd85e89d)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:47.600799 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3484cc45-26cf-4455-9f40-62495b49beb7 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:47.601069 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3484cc45-26cf-4455-9f40-62495b49beb7 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] Invalidating token cache because consumer fa1df3654eae42cc931b9de1cd85e89d has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:29:47.601366 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3484cc45-26cf-4455-9f40-62495b49beb7 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:47.602024 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3484cc45-26cf-4455-9f40-62495b49beb7 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:47.628337 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-3484cc45-26cf-4455-9f40-62495b49beb7 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found May 14 21:29:47.628337 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:29:47.628337 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 21:29:47.628337 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 21:29:47.628337 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 21:29:47.628337 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 21:29:47.628337 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 21:29:47.628337 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 21:29:47.628337 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 21:29:47.628337 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 21:29:47.628337 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 21:29:47.628337 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 21:29:47.628337 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 123, in delete May 14 21:29:47.628337 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application PROVIDERS.oauth_api.delete_consumer( May 14 21:29:47.628337 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 21:29:47.629809 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 21:29:47.629809 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/core.py", line 139, in delete_consumer May 14 21:29:47.629809 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ret = self.driver.delete_consumer(consumer_id) May 14 21:29:47.629809 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 133, in delete_consumer May 14 21:29:47.629809 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application self._delete_consumer(session, consumer_id) May 14 21:29:47.629809 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 110, in _delete_consumer May 14 21:29:47.629809 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) May 14 21:29:47.629809 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer May 14 21:29:47.629809 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) May 14 21:29:47.629809 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found May 14 21:29:47.629809 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:29:47.629809 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2409/4782] 10.222.0.52 () {58 vars in 1265 bytes} [Sat May 14 21:29:47 2022] DELETE /identity/v3/OS-OAUTH1/consumers/fa1df3654eae42cc931b9de1cd85e89d => generated 74 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 21:29:47.636187 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a8e56-1da5-47dc-b6ab-b1a5bb364e07 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:47.638007 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-3f1a8e56-1da5-47dc-b6ab-b1a5bb364e07 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:29:47.651737 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a8e56-1da5-47dc-b6ab-b1a5bb364e07 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:47.657080 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb01f47c-0945-4406-87c9-f769a985279d tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd592be499fb8433498c4afd66c88ee35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd8c9e94e9480ebfb04eae85f6be60', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:47.657764 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb01f47c-0945-4406-87c9-f769a985279d tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:47.658010 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb01f47c-0945-4406-87c9-f769a985279d tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:47.658291 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb01f47c-0945-4406-87c9-f769a985279d tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:47.659032 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb01f47c-0945-4406-87c9-f769a985279d tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:47.660685 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb01f47c-0945-4406-87c9-f769a985279d tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:47.742991 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2374/4783] 10.222.0.52 () {60 vars in 1184 bytes} [Sat May 14 21:29:47 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:29:47.747037 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3484cc45-26cf-4455-9f40-62495b49beb7 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:47.757434 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3484cc45-26cf-4455-9f40-62495b49beb7 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:47.762280 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab8ac0-a0f1-49f6-9072-408a3e09e570 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd592be499fb8433498c4afd66c88ee35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd8c9e94e9480ebfb04eae85f6be60', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:47.762945 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab8ac0-a0f1-49f6-9072-408a3e09e570 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:47.763930 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab8ac0-a0f1-49f6-9072-408a3e09e570 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:47.763930 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab8ac0-a0f1-49f6-9072-408a3e09e570 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:47.764318 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cab8ac0-a0f1-49f6-9072-408a3e09e570 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:47.766219 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cab8ac0-a0f1-49f6-9072-408a3e09e570 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:47.835675 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2410/4784] 10.222.0.52 () {60 vars in 1184 bytes} [Sat May 14 21:29:47 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 265 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:29:47.839682 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb01f47c-0945-4406-87c9-f769a985279d tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:47.851819 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb01f47c-0945-4406-87c9-f769a985279d tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:47.856649 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a992a1-baeb-4f3a-8676-1913eee3c8f0 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd592be499fb8433498c4afd66c88ee35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd8c9e94e9480ebfb04eae85f6be60', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:47.857279 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a992a1-baeb-4f3a-8676-1913eee3c8f0 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:47.857561 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a992a1-baeb-4f3a-8676-1913eee3c8f0 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:47.857836 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a992a1-baeb-4f3a-8676-1913eee3c8f0 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:47.858461 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a992a1-baeb-4f3a-8676-1913eee3c8f0 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] RBAC: Authorizing `identity:list_consumers()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:47.860720 ncdv-master-1 devstack@keystone.service[91107]: WARNING py.warnings [None req-41a992a1-baeb-4f3a-8676-1913eee3c8f0 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_consumers": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:29:47.860720 ncdv-master-1 devstack@keystone.service[91107]: warnings.warn(msg) May 14 21:29:47.860720 ncdv-master-1 devstack@keystone.service[91107]: May 14 21:29:47.861760 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a992a1-baeb-4f3a-8676-1913eee3c8f0 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:47.867349 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2375/4785] 10.222.0.52 () {58 vars in 1163 bytes} [Sat May 14 21:29:47 2022] GET /identity/v3/OS-OAUTH1/consumers => generated 535 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:29:47.871736 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab8ac0-a0f1-49f6-9072-408a3e09e570 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:47.882412 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab8ac0-a0f1-49f6-9072-408a3e09e570 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:47.887153 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab8535-c6ad-4da0-ab40-09f4bb0e87f7 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd592be499fb8433498c4afd66c88ee35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd8c9e94e9480ebfb04eae85f6be60', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:47.893876 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab8535-c6ad-4da0-ab40-09f4bb0e87f7 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:47.893876 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab8535-c6ad-4da0-ab40-09f4bb0e87f7 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:47.893876 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab8535-c6ad-4da0-ab40-09f4bb0e87f7 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/9309ae4c1c9d4a60810ca21ac7976ce5` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:47.893876 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ab8535-c6ad-4da0-ab40-09f4bb0e87f7 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=9309ae4c1c9d4a60810ca21ac7976ce5)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:47.894306 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ab8535-c6ad-4da0-ab40-09f4bb0e87f7 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:47.894306 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d2ab8535-c6ad-4da0-ab40-09f4bb0e87f7 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] Invalidating token cache because consumer 9309ae4c1c9d4a60810ca21ac7976ce5 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:29:47.894306 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d2ab8535-c6ad-4da0-ab40-09f4bb0e87f7 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:47.894306 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d2ab8535-c6ad-4da0-ab40-09f4bb0e87f7 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:47.970465 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d2ab8535-c6ad-4da0-ab40-09f4bb0e87f7 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '9309ae4c1c9d4a60810ca21ac7976ce5', 'request_id': 'req-d2ab8535-c6ad-4da0-ab40-09f4bb0e87f7'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:48.069748 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2411/4786] 10.222.0.52 () {58 vars in 1265 bytes} [Sat May 14 21:29:47 2022] DELETE /identity/v3/OS-OAUTH1/consumers/9309ae4c1c9d4a60810ca21ac7976ce5 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:29:48.074022 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a992a1-baeb-4f3a-8676-1913eee3c8f0 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:48.075803 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-41a992a1-baeb-4f3a-8676-1913eee3c8f0 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:29:48.092701 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a992a1-baeb-4f3a-8676-1913eee3c8f0 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:48.094971 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83370deb-259a-4d1b-a93a-3bc3799235f7 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd592be499fb8433498c4afd66c88ee35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd8c9e94e9480ebfb04eae85f6be60', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:48.095834 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83370deb-259a-4d1b-a93a-3bc3799235f7 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:48.096118 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83370deb-259a-4d1b-a93a-3bc3799235f7 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:48.096405 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83370deb-259a-4d1b-a93a-3bc3799235f7 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/5b841611006c459ea34da6aee85594cc` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:48.097046 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83370deb-259a-4d1b-a93a-3bc3799235f7 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=5b841611006c459ea34da6aee85594cc)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:48.098636 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83370deb-259a-4d1b-a93a-3bc3799235f7 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:48.098907 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-83370deb-259a-4d1b-a93a-3bc3799235f7 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] Invalidating token cache because consumer 5b841611006c459ea34da6aee85594cc has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:29:48.099187 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-83370deb-259a-4d1b-a93a-3bc3799235f7 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:48.099860 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-83370deb-259a-4d1b-a93a-3bc3799235f7 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:48.192435 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-83370deb-259a-4d1b-a93a-3bc3799235f7 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '5b841611006c459ea34da6aee85594cc', 'request_id': 'req-83370deb-259a-4d1b-a93a-3bc3799235f7'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:48.248461 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2376/4787] 10.222.0.52 () {58 vars in 1265 bytes} [Sat May 14 21:29:48 2022] DELETE /identity/v3/OS-OAUTH1/consumers/5b841611006c459ea34da6aee85594cc => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:29:48.253965 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab8535-c6ad-4da0-ab40-09f4bb0e87f7 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:48.264684 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab8535-c6ad-4da0-ab40-09f4bb0e87f7 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:48.270560 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da10e5f3-cb8c-430b-a7ea-10ea4c08d6ee tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd592be499fb8433498c4afd66c88ee35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd8c9e94e9480ebfb04eae85f6be60', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:48.271206 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da10e5f3-cb8c-430b-a7ea-10ea4c08d6ee tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:48.271524 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da10e5f3-cb8c-430b-a7ea-10ea4c08d6ee tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:48.271813 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da10e5f3-cb8c-430b-a7ea-10ea4c08d6ee tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:48.272525 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da10e5f3-cb8c-430b-a7ea-10ea4c08d6ee tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:48.274218 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da10e5f3-cb8c-430b-a7ea-10ea4c08d6ee tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:48.387263 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2412/4788] 10.222.0.52 () {60 vars in 1184 bytes} [Sat May 14 21:29:48 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:29:48.388500 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83370deb-259a-4d1b-a93a-3bc3799235f7 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:48.390177 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-83370deb-259a-4d1b-a93a-3bc3799235f7 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:29:48.412523 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83370deb-259a-4d1b-a93a-3bc3799235f7 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:48.413339 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e23db9-70fb-4313-b758-14934de8bc05 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd592be499fb8433498c4afd66c88ee35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd8c9e94e9480ebfb04eae85f6be60', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:48.414330 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e23db9-70fb-4313-b758-14934de8bc05 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:48.414683 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e23db9-70fb-4313-b758-14934de8bc05 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:48.415077 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e23db9-70fb-4313-b758-14934de8bc05 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/d5e50198c215486197af000a8d2dab96` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:48.416006 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e23db9-70fb-4313-b758-14934de8bc05 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] RBAC: Authorizing `identity:update_consumer(consumer_id=d5e50198c215486197af000a8d2dab96)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:48.417398 ncdv-master-1 devstack@keystone.service[91107]: WARNING py.warnings [None req-12e23db9-70fb-4313-b758-14934de8bc05 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:29:48.417398 ncdv-master-1 devstack@keystone.service[91107]: warnings.warn(msg) May 14 21:29:48.417398 ncdv-master-1 devstack@keystone.service[91107]: May 14 21:29:48.418737 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e23db9-70fb-4313-b758-14934de8bc05 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:48.526446 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2377/4789] 10.222.0.52 () {60 vars in 1284 bytes} [Sat May 14 21:29:48 2022] PATCH /identity/v3/OS-OAUTH1/consumers/d5e50198c215486197af000a8d2dab96 => generated 221 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:29:48.530933 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da10e5f3-cb8c-430b-a7ea-10ea4c08d6ee tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:48.544545 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da10e5f3-cb8c-430b-a7ea-10ea4c08d6ee tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:48.551579 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9babbf5-a1e3-456b-b271-4f82533285da tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd592be499fb8433498c4afd66c88ee35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd8c9e94e9480ebfb04eae85f6be60', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:48.552857 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9babbf5-a1e3-456b-b271-4f82533285da tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:48.553147 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9babbf5-a1e3-456b-b271-4f82533285da tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:48.553423 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9babbf5-a1e3-456b-b271-4f82533285da tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/d5e50198c215486197af000a8d2dab96` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:48.554108 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9babbf5-a1e3-456b-b271-4f82533285da tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=d5e50198c215486197af000a8d2dab96)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:48.555724 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9babbf5-a1e3-456b-b271-4f82533285da tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:48.561127 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2413/4790] 10.222.0.52 () {58 vars in 1262 bytes} [Sat May 14 21:29:48 2022] GET /identity/v3/OS-OAUTH1/consumers/d5e50198c215486197af000a8d2dab96 => generated 221 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:29:48.569000 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e23db9-70fb-4313-b758-14934de8bc05 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:48.588236 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e23db9-70fb-4313-b758-14934de8bc05 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:48.593038 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69c6beb-6c34-4d05-8159-c88b3887bf82 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd592be499fb8433498c4afd66c88ee35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd8c9e94e9480ebfb04eae85f6be60', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:48.594474 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c6beb-6c34-4d05-8159-c88b3887bf82 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:48.594898 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c6beb-6c34-4d05-8159-c88b3887bf82 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:48.595385 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c6beb-6c34-4d05-8159-c88b3887bf82 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/d5e50198c215486197af000a8d2dab96` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:48.596335 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69c6beb-6c34-4d05-8159-c88b3887bf82 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=d5e50198c215486197af000a8d2dab96)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:48.598087 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69c6beb-6c34-4d05-8159-c88b3887bf82 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:48.598361 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f69c6beb-6c34-4d05-8159-c88b3887bf82 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] Invalidating token cache because consumer d5e50198c215486197af000a8d2dab96 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:29:48.598756 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f69c6beb-6c34-4d05-8159-c88b3887bf82 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:48.599741 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f69c6beb-6c34-4d05-8159-c88b3887bf82 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:48.703270 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f69c6beb-6c34-4d05-8159-c88b3887bf82 tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'd5e50198c215486197af000a8d2dab96', 'request_id': 'req-f69c6beb-6c34-4d05-8159-c88b3887bf82'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:48.808075 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2378/4791] 10.222.0.52 () {58 vars in 1265 bytes} [Sat May 14 21:29:48 2022] DELETE /identity/v3/OS-OAUTH1/consumers/d5e50198c215486197af000a8d2dab96 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:29:48.815420 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9babbf5-a1e3-456b-b271-4f82533285da tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:48.817382 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-a9babbf5-a1e3-456b-b271-4f82533285da tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:29:48.906846 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9babbf5-a1e3-456b-b271-4f82533285da tempest-OAUTHConsumersV3Test-1986371354 tempest-OAUTHConsumersV3Test-1986371354-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:48.915932 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da51757e-7704-4577-b16d-bd67d916165c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:48.916814 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51757e-7704-4577-b16d-bd67d916165c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:48.917090 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51757e-7704-4577-b16d-bd67d916165c admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:48.922796 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51757e-7704-4577-b16d-bd67d916165c admin admin] PATH_INFO: `/v3/users/0314b915239e432a90b112c8cb9a9321` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:48.922796 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da51757e-7704-4577-b16d-bd67d916165c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0314b915239e432a90b112c8cb9a9321)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:48.922796 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da51757e-7704-4577-b16d-bd67d916165c admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:49.146544 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-da51757e-7704-4577-b16d-bd67d916165c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0314b915239e432a90b112c8cb9a9321'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:49.159555 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-da51757e-7704-4577-b16d-bd67d916165c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0314b915239e432a90b112c8cb9a9321'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:49.166490 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-da51757e-7704-4577-b16d-bd67d916165c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0314b915239e432a90b112c8cb9a9321'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:49.235796 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-da51757e-7704-4577-b16d-bd67d916165c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0314b915239e432a90b112c8cb9a9321'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:49.236443 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-da51757e-7704-4577-b16d-bd67d916165c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0314b915239e432a90b112c8cb9a9321'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:49.244373 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2414/4792] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:29:48 2022] DELETE /identity/v3/users/0314b915239e432a90b112c8cb9a9321 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:29:49.248947 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a571c-7d96-4bad-8f3c-baa10c0562a8 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:49.249453 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a571c-7d96-4bad-8f3c-baa10c0562a8 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:49.249574 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a571c-7d96-4bad-8f3c-baa10c0562a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:49.270664 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-8f0a571c-7d96-4bad-8f3c-baa10c0562a8 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:29:49.271937 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8f0a571c-7d96-4bad-8f3c-baa10c0562a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:29:49.331588 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2379/4793] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:29:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:29:49.341215 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da51757e-7704-4577-b16d-bd67d916165c admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:49.342624 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-da51757e-7704-4577-b16d-bd67d916165c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:29:49.405222 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da51757e-7704-4577-b16d-bd67d916165c admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:49.408849 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61fc96b-b0fa-430a-8c4f-622faab9faa4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:49.409491 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61fc96b-b0fa-430a-8c4f-622faab9faa4 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:49.409770 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61fc96b-b0fa-430a-8c4f-622faab9faa4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:49.410044 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61fc96b-b0fa-430a-8c4f-622faab9faa4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:49.419001 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61fc96b-b0fa-430a-8c4f-622faab9faa4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:49.420448 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61fc96b-b0fa-430a-8c4f-622faab9faa4 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:49.431611 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2415/4794] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:29:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:29:49.889236 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a571c-7d96-4bad-8f3c-baa10c0562a8 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:49.892215 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8f0a571c-7d96-4bad-8f3c-baa10c0562a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:29:49.929532 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a571c-7d96-4bad-8f3c-baa10c0562a8 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:49.942042 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52e9c62-c8f6-4d5f-a6f5-07ecdc0f4e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:49.943235 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e9c62-c8f6-4d5f-a6f5-07ecdc0f4e19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:49.943545 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e9c62-c8f6-4d5f-a6f5-07ecdc0f4e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:49.943823 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e9c62-c8f6-4d5f-a6f5-07ecdc0f4e19 admin admin] PATH_INFO: `/v3/projects/1b26638e3c7540ed935f64031b52db96` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:49.945451 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52e9c62-c8f6-4d5f-a6f5-07ecdc0f4e19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b26638e3c7540ed935f64031b52db96)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:49.947594 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52e9c62-c8f6-4d5f-a6f5-07ecdc0f4e19 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:50.066231 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f52e9c62-c8f6-4d5f-a6f5-07ecdc0f4e19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b26638e3c7540ed935f64031b52db96', 'request_id': 'req-f52e9c62-c8f6-4d5f-a6f5-07ecdc0f4e19'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:50.071765 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f52e9c62-c8f6-4d5f-a6f5-07ecdc0f4e19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b26638e3c7540ed935f64031b52db96', 'request_id': 'req-f52e9c62-c8f6-4d5f-a6f5-07ecdc0f4e19'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:50.080615 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f52e9c62-c8f6-4d5f-a6f5-07ecdc0f4e19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b26638e3c7540ed935f64031b52db96', 'request_id': 'req-f52e9c62-c8f6-4d5f-a6f5-07ecdc0f4e19'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:50.256939 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f52e9c62-c8f6-4d5f-a6f5-07ecdc0f4e19 admin admin] The token cache is being invalidate because project 1b26638e3c7540ed935f64031b52db96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:29:50.257691 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f52e9c62-c8f6-4d5f-a6f5-07ecdc0f4e19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:50.257969 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f52e9c62-c8f6-4d5f-a6f5-07ecdc0f4e19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:50.259542 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2380/4795] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:29:49 2022] DELETE /identity/v3/projects/1b26638e3c7540ed935f64031b52db96 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:29:50.263499 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61fc96b-b0fa-430a-8c4f-622faab9faa4 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:50.274922 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61fc96b-b0fa-430a-8c4f-622faab9faa4 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:50.329557 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca99185-1356-4bae-93ec-a62e0668056a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:50.330492 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca99185-1356-4bae-93ec-a62e0668056a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:50.330800 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca99185-1356-4bae-93ec-a62e0668056a admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:50.331078 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca99185-1356-4bae-93ec-a62e0668056a admin admin] PATH_INFO: `/v3/users/d592be499fb8433498c4afd66c88ee35` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:50.332305 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca99185-1356-4bae-93ec-a62e0668056a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d592be499fb8433498c4afd66c88ee35)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:50.334288 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca99185-1356-4bae-93ec-a62e0668056a admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:50.517722 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-fca99185-1356-4bae-93ec-a62e0668056a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd592be499fb8433498c4afd66c88ee35'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:50.529012 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-fca99185-1356-4bae-93ec-a62e0668056a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd592be499fb8433498c4afd66c88ee35'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:50.535975 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-fca99185-1356-4bae-93ec-a62e0668056a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd592be499fb8433498c4afd66c88ee35'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:50.594822 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-fca99185-1356-4bae-93ec-a62e0668056a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd592be499fb8433498c4afd66c88ee35'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:50.595469 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-fca99185-1356-4bae-93ec-a62e0668056a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd592be499fb8433498c4afd66c88ee35'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:50.602033 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2416/4796] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:29:50 2022] DELETE /identity/v3/users/d592be499fb8433498c4afd66c88ee35 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:29:51.042223 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52e9c62-c8f6-4d5f-a6f5-07ecdc0f4e19 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:51.046162 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-f52e9c62-c8f6-4d5f-a6f5-07ecdc0f4e19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:29:51.061570 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52e9c62-c8f6-4d5f-a6f5-07ecdc0f4e19 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:51.140157 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67189216-e25c-4bfe-850a-7a0157889dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:51.141600 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67189216-e25c-4bfe-850a-7a0157889dee admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:51.141879 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67189216-e25c-4bfe-850a-7a0157889dee admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:51.142151 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67189216-e25c-4bfe-850a-7a0157889dee admin admin] PATH_INFO: `/v3/projects/40cd8c9e94e9480ebfb04eae85f6be60` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:51.143329 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67189216-e25c-4bfe-850a-7a0157889dee admin admin] RBAC: Authorizing `identity:delete_project(project_id=40cd8c9e94e9480ebfb04eae85f6be60)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:51.145283 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67189216-e25c-4bfe-850a-7a0157889dee admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:51.308324 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-67189216-e25c-4bfe-850a-7a0157889dee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40cd8c9e94e9480ebfb04eae85f6be60', 'request_id': 'req-67189216-e25c-4bfe-850a-7a0157889dee'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:51.313602 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-67189216-e25c-4bfe-850a-7a0157889dee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40cd8c9e94e9480ebfb04eae85f6be60', 'request_id': 'req-67189216-e25c-4bfe-850a-7a0157889dee'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:51.319721 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-67189216-e25c-4bfe-850a-7a0157889dee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40cd8c9e94e9480ebfb04eae85f6be60', 'request_id': 'req-67189216-e25c-4bfe-850a-7a0157889dee'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:51.382448 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-67189216-e25c-4bfe-850a-7a0157889dee admin admin] The token cache is being invalidate because project 40cd8c9e94e9480ebfb04eae85f6be60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:29:51.382812 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-67189216-e25c-4bfe-850a-7a0157889dee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:51.383454 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-67189216-e25c-4bfe-850a-7a0157889dee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:51.385029 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2381/4797] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:29:51 2022] DELETE /identity/v3/projects/40cd8c9e94e9480ebfb04eae85f6be60 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:29:51.390954 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab2236-4e9f-413b-9c52-a6ea7c609f82 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:51.391249 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab2236-4e9f-413b-9c52-a6ea7c609f82 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:51.391567 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab2236-4e9f-413b-9c52-a6ea7c609f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:51.411294 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-29ab2236-4e9f-413b-9c52-a6ea7c609f82 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:29:51.412598 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-29ab2236-4e9f-413b-9c52-a6ea7c609f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:29:51.473460 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2417/4798] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:29:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:29:51.546726 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f9b72-28d9-4b4c-a533-5086e24e95b6 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:51.547138 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f9b72-28d9-4b4c-a533-5086e24e95b6 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:51.547517 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f9b72-28d9-4b4c-a533-5086e24e95b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:51.569651 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-be2f9b72-28d9-4b4c-a533-5086e24e95b6 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:29:51.569651 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-be2f9b72-28d9-4b4c-a533-5086e24e95b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:29:51.576968 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2382/4799] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:29:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:29:51.582035 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ab2236-4e9f-413b-9c52-a6ea7c609f82 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:51.592077 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ab2236-4e9f-413b-9c52-a6ea7c609f82 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:51.598445 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828662e5-0665-49b0-88bd-159f9356ac67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:51.598445 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828662e5-0665-49b0-88bd-159f9356ac67 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:51.598445 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828662e5-0665-49b0-88bd-159f9356ac67 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:51.598764 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828662e5-0665-49b0-88bd-159f9356ac67 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:51.599206 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828662e5-0665-49b0-88bd-159f9356ac67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:29:51.599586 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828662e5-0665-49b0-88bd-159f9356ac67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:51.601874 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828662e5-0665-49b0-88bd-159f9356ac67 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:51.613848 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2418/4800] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:29:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:29:51.618242 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2f9b72-28d9-4b4c-a533-5086e24e95b6 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:51.628180 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2f9b72-28d9-4b4c-a533-5086e24e95b6 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:51.633066 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd50a62-e3a4-4df4-9441-6ed6d7e04ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:51.633716 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd50a62-e3a4-4df4-9441-6ed6d7e04ddd admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:51.634003 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd50a62-e3a4-4df4-9441-6ed6d7e04ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:51.634282 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd50a62-e3a4-4df4-9441-6ed6d7e04ddd admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:51.634997 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd50a62-e3a4-4df4-9441-6ed6d7e04ddd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:51.636961 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd50a62-e3a4-4df4-9441-6ed6d7e04ddd admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:51.727654 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2383/4801] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:29:51 2022] POST /identity/v3/projects => generated 369 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:29:51.732304 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828662e5-0665-49b0-88bd-159f9356ac67 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:51.742796 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828662e5-0665-49b0-88bd-159f9356ac67 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:51.799149 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04335bb0-d837-434e-8dee-3244f4475aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:51.799846 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04335bb0-d837-434e-8dee-3244f4475aa8 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:51.800141 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04335bb0-d837-434e-8dee-3244f4475aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:51.800423 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04335bb0-d837-434e-8dee-3244f4475aa8 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:51.801105 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04335bb0-d837-434e-8dee-3244f4475aa8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:51.803065 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04335bb0-d837-434e-8dee-3244f4475aa8 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:51.863493 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2419/4802] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:29:51 2022] POST /identity/v3/users => generated 285 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:29:51.867558 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd50a62-e3a4-4df4-9441-6ed6d7e04ddd admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:51.878644 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd50a62-e3a4-4df4-9441-6ed6d7e04ddd admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:51.883636 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a826f2-7f23-4a2f-9c17-1df458f797bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:51.884327 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a826f2-7f23-4a2f-9c17-1df458f797bc admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:51.884613 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a826f2-7f23-4a2f-9c17-1df458f797bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:51.884892 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a826f2-7f23-4a2f-9c17-1df458f797bc admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:51.885656 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a826f2-7f23-4a2f-9c17-1df458f797bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:51.887276 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a826f2-7f23-4a2f-9c17-1df458f797bc admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:51.898137 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2384/4803] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:29:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:29:51.902122 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04335bb0-d837-434e-8dee-3244f4475aa8 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:51.912280 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04335bb0-d837-434e-8dee-3244f4475aa8 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:51.917188 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8629b1e-f928-45fc-80e8-0ca834aed4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:51.917848 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8629b1e-f928-45fc-80e8-0ca834aed4ff admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:51.918137 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8629b1e-f928-45fc-80e8-0ca834aed4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:51.918419 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8629b1e-f928-45fc-80e8-0ca834aed4ff admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:51.919141 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8629b1e-f928-45fc-80e8-0ca834aed4ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:51.920791 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8629b1e-f928-45fc-80e8-0ca834aed4ff admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:51.932562 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2420/4804] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:29:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:29:51.936783 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a826f2-7f23-4a2f-9c17-1df458f797bc admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:51.947609 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a826f2-7f23-4a2f-9c17-1df458f797bc admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:51.952362 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa9fdd8-833b-488e-97c4-b21d51789e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:51.953267 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9fdd8-833b-488e-97c4-b21d51789e8e admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:51.953550 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9fdd8-833b-488e-97c4-b21d51789e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:51.953824 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9fdd8-833b-488e-97c4-b21d51789e8e admin admin] PATH_INFO: `/v3/projects/bd8d784d8f854be4b5ba531c38b6aaf2/users/34734045c67c43ad83059b9534b2be1d/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:51.969353 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa9fdd8-833b-488e-97c4-b21d51789e8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd8d784d8f854be4b5ba531c38b6aaf2, user_id=34734045c67c43ad83059b9534b2be1d, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:51.972094 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa9fdd8-833b-488e-97c4-b21d51789e8e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:52.069519 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2385/4805] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:29:51 2022] PUT /identity/v3/projects/bd8d784d8f854be4b5ba531c38b6aaf2/users/34734045c67c43ad83059b9534b2be1d/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:29:52.079460 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea1a80c-bad3-4106-8f22-dda6e74135c0 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:52.079776 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea1a80c-bad3-4106-8f22-dda6e74135c0 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:52.080054 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea1a80c-bad3-4106-8f22-dda6e74135c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:52.107523 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-9ea1a80c-bad3-4106-8f22-dda6e74135c0 None None] MFA Rules not processed for user `34734045c67c43ad83059b9534b2be1d`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:29:52.108608 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-9ea1a80c-bad3-4106-8f22-dda6e74135c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:29:52.175143 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2421/4806] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:29:52 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:29:52.179599 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa9fdd8-833b-488e-97c4-b21d51789e8e admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:52.239748 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa9fdd8-833b-488e-97c4-b21d51789e8e admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:52.244512 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b00c96-c353-4af7-8980-d38a520aa5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:52.245158 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b00c96-c353-4af7-8980-d38a520aa5e1 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:52.245459 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b00c96-c353-4af7-8980-d38a520aa5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:52.245735 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b00c96-c353-4af7-8980-d38a520aa5e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:52.246426 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b00c96-c353-4af7-8980-d38a520aa5e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:52.248350 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b00c96-c353-4af7-8980-d38a520aa5e1 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:52.321439 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2386/4807] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:29:52 2022] POST /identity/v3/projects => generated 367 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:29:52.325721 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea1a80c-bad3-4106-8f22-dda6e74135c0 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:52.337728 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea1a80c-bad3-4106-8f22-dda6e74135c0 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:52.395082 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2d1b27-578a-496d-9a79-cbab5d0a4206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:52.395781 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d1b27-578a-496d-9a79-cbab5d0a4206 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:52.396071 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d1b27-578a-496d-9a79-cbab5d0a4206 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:52.396347 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d1b27-578a-496d-9a79-cbab5d0a4206 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:52.397057 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2d1b27-578a-496d-9a79-cbab5d0a4206 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:52.399055 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2d1b27-578a-496d-9a79-cbab5d0a4206 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:52.475359 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2422/4808] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:29:52 2022] POST /identity/v3/users => generated 290 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:29:52.479366 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b00c96-c353-4af7-8980-d38a520aa5e1 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:52.490774 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b00c96-c353-4af7-8980-d38a520aa5e1 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:52.495750 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f30bb1-e943-43b5-9bc1-f9f419fd7dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:52.496451 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f30bb1-e943-43b5-9bc1-f9f419fd7dd8 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:52.496736 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f30bb1-e943-43b5-9bc1-f9f419fd7dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:52.497012 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f30bb1-e943-43b5-9bc1-f9f419fd7dd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:52.497792 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f30bb1-e943-43b5-9bc1-f9f419fd7dd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:52.499395 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f30bb1-e943-43b5-9bc1-f9f419fd7dd8 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:52.510647 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2387/4809] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:29:52.515142 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2d1b27-578a-496d-9a79-cbab5d0a4206 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:52.525902 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2d1b27-578a-496d-9a79-cbab5d0a4206 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:52.532173 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4b2a3c-131f-4d8e-9c66-3639d589f470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:52.532173 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b2a3c-131f-4d8e-9c66-3639d589f470 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:52.532173 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b2a3c-131f-4d8e-9c66-3639d589f470 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:52.532173 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b2a3c-131f-4d8e-9c66-3639d589f470 admin admin] PATH_INFO: `/v3/projects/1997fca61bf6406d83c93f3f98a79a84/users/16df42e793ed46c8b39b78b4a4821bb9/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:52.546642 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4b2a3c-131f-4d8e-9c66-3639d589f470 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1997fca61bf6406d83c93f3f98a79a84, user_id=16df42e793ed46c8b39b78b4a4821bb9, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:52.549365 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4b2a3c-131f-4d8e-9c66-3639d589f470 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:52.635439 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2423/4810] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:29:52 2022] PUT /identity/v3/projects/1997fca61bf6406d83c93f3f98a79a84/users/16df42e793ed46c8b39b78b4a4821bb9/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:29:52.639254 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f30bb1-e943-43b5-9bc1-f9f419fd7dd8 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:52.649757 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f30bb1-e943-43b5-9bc1-f9f419fd7dd8 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:52.709150 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7d76db-3cc1-44c3-aad8-6c105a2f697b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:52.709963 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d76db-3cc1-44c3-aad8-6c105a2f697b admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:52.710252 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d76db-3cc1-44c3-aad8-6c105a2f697b admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:52.710532 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d76db-3cc1-44c3-aad8-6c105a2f697b admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:52.711255 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7d76db-3cc1-44c3-aad8-6c105a2f697b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:52.712952 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7d76db-3cc1-44c3-aad8-6c105a2f697b admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:52.723865 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2388/4811] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:29:52.727850 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4b2a3c-131f-4d8e-9c66-3639d589f470 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:52.738993 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4b2a3c-131f-4d8e-9c66-3639d589f470 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:52.743744 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a37acd2-7a9f-4bab-ba48-e3edc4d6bfa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:52.744636 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37acd2-7a9f-4bab-ba48-e3edc4d6bfa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:52.744917 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37acd2-7a9f-4bab-ba48-e3edc4d6bfa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:52.745193 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37acd2-7a9f-4bab-ba48-e3edc4d6bfa3 admin admin] PATH_INFO: `/v3/projects/1997fca61bf6406d83c93f3f98a79a84/users/16df42e793ed46c8b39b78b4a4821bb9/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:52.747296 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a37acd2-7a9f-4bab-ba48-e3edc4d6bfa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1997fca61bf6406d83c93f3f98a79a84, user_id=16df42e793ed46c8b39b78b4a4821bb9, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:52.750678 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a37acd2-7a9f-4bab-ba48-e3edc4d6bfa3 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:52.761772 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2424/4812] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:29:52 2022] PUT /identity/v3/projects/1997fca61bf6406d83c93f3f98a79a84/users/16df42e793ed46c8b39b78b4a4821bb9/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:29:52.772329 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5102ed-7840-40e7-affe-0770621c55c7 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:52.776543 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5102ed-7840-40e7-affe-0770621c55c7 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:52.776543 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5102ed-7840-40e7-affe-0770621c55c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:52.804955 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-eb5102ed-7840-40e7-affe-0770621c55c7 None None] MFA Rules not processed for user `16df42e793ed46c8b39b78b4a4821bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:29:52.806213 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-eb5102ed-7840-40e7-affe-0770621c55c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:29:52.874391 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2389/4813] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:29:52 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:29:52.880325 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a37acd2-7a9f-4bab-ba48-e3edc4d6bfa3 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:52.891161 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a37acd2-7a9f-4bab-ba48-e3edc4d6bfa3 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:52.895760 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6797685-257a-4702-9ad6-cb30369615a3 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16df42e793ed46c8b39b78b4a4821bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1997fca61bf6406d83c93f3f98a79a84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:52.896400 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6797685-257a-4702-9ad6-cb30369615a3 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:52.896699 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6797685-257a-4702-9ad6-cb30369615a3 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:52.896986 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6797685-257a-4702-9ad6-cb30369615a3 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:52.897664 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6797685-257a-4702-9ad6-cb30369615a3 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:52.899547 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6797685-257a-4702-9ad6-cb30369615a3 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:53.064670 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2425/4814] 10.222.0.52 () {60 vars in 1151 bytes} [Sat May 14 21:29:52 2022] POST /identity/v3/projects => generated 329 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:29:53.068978 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5102ed-7840-40e7-affe-0770621c55c7 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:53.078149 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5102ed-7840-40e7-affe-0770621c55c7 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:53.157236 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb47ce0-e733-419a-8c0c-a26f64d42024 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16df42e793ed46c8b39b78b4a4821bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1997fca61bf6406d83c93f3f98a79a84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:53.157965 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb47ce0-e733-419a-8c0c-a26f64d42024 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:53.158329 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb47ce0-e733-419a-8c0c-a26f64d42024 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:53.158672 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb47ce0-e733-419a-8c0c-a26f64d42024 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:53.159875 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb47ce0-e733-419a-8c0c-a26f64d42024 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:53.162137 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb47ce0-e733-419a-8c0c-a26f64d42024 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:53.230323 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2390/4815] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:29:53 2022] POST /identity/v3/users => generated 413 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:29:53.235171 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6797685-257a-4702-9ad6-cb30369615a3 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:53.245506 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6797685-257a-4702-9ad6-cb30369615a3 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:53.261712 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4fb1be-1198-42e3-b136-031f2d34d171 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16df42e793ed46c8b39b78b4a4821bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1997fca61bf6406d83c93f3f98a79a84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:53.262388 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4fb1be-1198-42e3-b136-031f2d34d171 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:53.262675 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4fb1be-1198-42e3-b136-031f2d34d171 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:53.262958 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4fb1be-1198-42e3-b136-031f2d34d171 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:53.263820 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4fb1be-1198-42e3-b136-031f2d34d171 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:53.265700 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4fb1be-1198-42e3-b136-031f2d34d171 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:53.338604 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2426/4816] 10.222.0.52 () {60 vars in 1142 bytes} [Sat May 14 21:29:53 2022] POST /identity/v3/roles => generated 244 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:29:53.342593 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb47ce0-e733-419a-8c0c-a26f64d42024 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:53.353532 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb47ce0-e733-419a-8c0c-a26f64d42024 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:53.358561 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3012dd7e-52bf-465d-8c0e-d9c96f60715a tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16df42e793ed46c8b39b78b4a4821bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1997fca61bf6406d83c93f3f98a79a84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:53.360007 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012dd7e-52bf-465d-8c0e-d9c96f60715a tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:53.360296 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012dd7e-52bf-465d-8c0e-d9c96f60715a tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:53.360575 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012dd7e-52bf-465d-8c0e-d9c96f60715a tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:53.361380 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3012dd7e-52bf-465d-8c0e-d9c96f60715a tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:53.362991 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3012dd7e-52bf-465d-8c0e-d9c96f60715a tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:53.472337 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2391/4817] 10.222.0.52 () {60 vars in 1142 bytes} [Sat May 14 21:29:53 2022] POST /identity/v3/roles => generated 246 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:29:53.476570 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4fb1be-1198-42e3-b136-031f2d34d171 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:53.487512 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4fb1be-1198-42e3-b136-031f2d34d171 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:53.492699 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8dcfa5-086c-44c5-8e2b-66be52e06006 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16df42e793ed46c8b39b78b4a4821bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1997fca61bf6406d83c93f3f98a79a84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:53.493579 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8dcfa5-086c-44c5-8e2b-66be52e06006 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:53.493861 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8dcfa5-086c-44c5-8e2b-66be52e06006 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:53.494140 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8dcfa5-086c-44c5-8e2b-66be52e06006 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] PATH_INFO: `/v3/projects/a47f17158cd545cdb6e31597eb340376/users/ba1f19ca0cac4f6ab2a432aa4d54324f/roles/385203b88a214af29b77386656c016b8` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:53.509554 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8dcfa5-086c-44c5-8e2b-66be52e06006 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorizing `identity:create_grant(project_id=a47f17158cd545cdb6e31597eb340376, user_id=ba1f19ca0cac4f6ab2a432aa4d54324f, role_id=385203b88a214af29b77386656c016b8)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:53.512248 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8dcfa5-086c-44c5-8e2b-66be52e06006 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:53.629802 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2427/4818] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:29:53 2022] PUT /identity/v3/projects/a47f17158cd545cdb6e31597eb340376/users/ba1f19ca0cac4f6ab2a432aa4d54324f/roles/385203b88a214af29b77386656c016b8 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:29:53.634006 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3012dd7e-52bf-465d-8c0e-d9c96f60715a tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:53.645073 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3012dd7e-52bf-465d-8c0e-d9c96f60715a tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:53.705337 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e63ea7-5232-4fa0-933d-8ffc8eb34a1a tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16df42e793ed46c8b39b78b4a4821bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1997fca61bf6406d83c93f3f98a79a84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:53.706215 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e63ea7-5232-4fa0-933d-8ffc8eb34a1a tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:53.706506 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e63ea7-5232-4fa0-933d-8ffc8eb34a1a tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:53.706781 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e63ea7-5232-4fa0-933d-8ffc8eb34a1a tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] PATH_INFO: `/v3/projects/a47f17158cd545cdb6e31597eb340376/users/ba1f19ca0cac4f6ab2a432aa4d54324f/roles/bc2ecb828d7d4a9db287d2019816effa` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:53.709252 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e63ea7-5232-4fa0-933d-8ffc8eb34a1a tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorizing `identity:create_grant(project_id=a47f17158cd545cdb6e31597eb340376, user_id=ba1f19ca0cac4f6ab2a432aa4d54324f, role_id=bc2ecb828d7d4a9db287d2019816effa)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:53.712069 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e63ea7-5232-4fa0-933d-8ffc8eb34a1a tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:53.790093 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2392/4819] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:29:53 2022] PUT /identity/v3/projects/a47f17158cd545cdb6e31597eb340376/users/ba1f19ca0cac4f6ab2a432aa4d54324f/roles/bc2ecb828d7d4a9db287d2019816effa => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:29:53.798428 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8dcfa5-086c-44c5-8e2b-66be52e06006 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:53.816227 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8dcfa5-086c-44c5-8e2b-66be52e06006 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:53.894839 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c84033e-6c83-4160-abf4-1c16371a8570 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16df42e793ed46c8b39b78b4a4821bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1997fca61bf6406d83c93f3f98a79a84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:53.894839 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84033e-6c83-4160-abf4-1c16371a8570 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:53.894839 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84033e-6c83-4160-abf4-1c16371a8570 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:53.895340 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84033e-6c83-4160-abf4-1c16371a8570 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:53.895876 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c84033e-6c83-4160-abf4-1c16371a8570 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:53.897482 ncdv-master-1 devstack@keystone.service[91106]: WARNING py.warnings [None req-9c84033e-6c83-4160-abf4-1c16371a8570 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 14 21:29:53.897482 ncdv-master-1 devstack@keystone.service[91106]: warnings.warn(msg) May 14 21:29:53.897482 ncdv-master-1 devstack@keystone.service[91106]: May 14 21:29:53.898910 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c84033e-6c83-4160-abf4-1c16371a8570 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:53.962615 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2428/4820] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:29:53 2022] GET /identity/v3/users => generated 8633 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:29:53.967657 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e7d758-c01f-41da-9289-0d67efb3daad None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:53.967951 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e7d758-c01f-41da-9289-0d67efb3daad None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:53.968230 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e7d758-c01f-41da-9289-0d67efb3daad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:54.010823 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-58e7d758-c01f-41da-9289-0d67efb3daad None None] MFA Rules not processed for user `ba1f19ca0cac4f6ab2a432aa4d54324f`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:29:54.012289 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-58e7d758-c01f-41da-9289-0d67efb3daad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:29:54.080480 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2393/4821] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:29:53 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:29:54.092309 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50037a41-969b-4fda-ae7a-5ae17c2e9b4d None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:54.092658 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50037a41-969b-4fda-ae7a-5ae17c2e9b4d None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:54.092881 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50037a41-969b-4fda-ae7a-5ae17c2e9b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:54.113035 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-50037a41-969b-4fda-ae7a-5ae17c2e9b4d None None] MFA Rules not processed for user `ba1f19ca0cac4f6ab2a432aa4d54324f`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:29:54.114320 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-50037a41-969b-4fda-ae7a-5ae17c2e9b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:29:54.123204 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2429/4822] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:29:54 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:29:54.127637 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e7d758-c01f-41da-9289-0d67efb3daad None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:54.139735 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e7d758-c01f-41da-9289-0d67efb3daad None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:54.146001 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0db7705-9b01-4917-8a03-0d92947c0501 tempest-TrustsV3TestJSON-1764129193 tempest-user-101448440] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1f19ca0cac4f6ab2a432aa4d54324f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a47f17158cd545cdb6e31597eb340376', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1281990992', 'tempest-NotDelegatedRole-548587787'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:54.146738 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db7705-9b01-4917-8a03-0d92947c0501 tempest-TrustsV3TestJSON-1764129193 tempest-user-101448440] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:54.147681 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db7705-9b01-4917-8a03-0d92947c0501 tempest-TrustsV3TestJSON-1764129193 tempest-user-101448440] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:54.147966 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db7705-9b01-4917-8a03-0d92947c0501 tempest-TrustsV3TestJSON-1764129193 tempest-user-101448440] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:54.148828 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0db7705-9b01-4917-8a03-0d92947c0501 tempest-TrustsV3TestJSON-1764129193 tempest-user-101448440] RBAC: Authorizing `identity:create_trust()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:54.150336 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0db7705-9b01-4917-8a03-0d92947c0501 tempest-TrustsV3TestJSON-1764129193 tempest-user-101448440] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:54.360341 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2394/4823] 10.222.0.52 () {60 vars in 1173 bytes} [Sat May 14 21:29:54 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:29:54.364645 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50037a41-969b-4fda-ae7a-5ae17c2e9b4d None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:54.384317 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50037a41-969b-4fda-ae7a-5ae17c2e9b4d None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:54.404707 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137c132-e8d4-47ad-b14f-b58fe113272b tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16df42e793ed46c8b39b78b4a4821bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1997fca61bf6406d83c93f3f98a79a84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:54.405488 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137c132-e8d4-47ad-b14f-b58fe113272b tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:54.405488 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137c132-e8d4-47ad-b14f-b58fe113272b tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:54.405795 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137c132-e8d4-47ad-b14f-b58fe113272b tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:54.406879 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8137c132-e8d4-47ad-b14f-b58fe113272b tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorizing `identity:list_trusts()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:54.408557 ncdv-master-1 devstack@keystone.service[91106]: WARNING py.warnings [None req-8137c132-e8d4-47ad-b14f-b58fe113272b tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_trusts": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:29:54.408557 ncdv-master-1 devstack@keystone.service[91106]: warnings.warn(msg) May 14 21:29:54.408557 ncdv-master-1 devstack@keystone.service[91106]: May 14 21:29:54.409068 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8137c132-e8d4-47ad-b14f-b58fe113272b tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:54.426657 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2430/4824] 10.222.0.52 () {58 vars in 1154 bytes} [Sat May 14 21:29:54 2022] GET /identity/v3/OS-TRUST/trusts/ => generated 562 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:29:54.432875 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0db7705-9b01-4917-8a03-0d92947c0501 tempest-TrustsV3TestJSON-1764129193 tempest-user-101448440] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:54.446203 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0db7705-9b01-4917-8a03-0d92947c0501 tempest-TrustsV3TestJSON-1764129193 tempest-user-101448440] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:54.451559 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c52c80-15dc-4afc-9c20-4d4406889d7c tempest-TrustsV3TestJSON-1764129193 tempest-user-101448440] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1f19ca0cac4f6ab2a432aa4d54324f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a47f17158cd545cdb6e31597eb340376', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1281990992', 'tempest-NotDelegatedRole-548587787'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:54.453688 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c52c80-15dc-4afc-9c20-4d4406889d7c tempest-TrustsV3TestJSON-1764129193 tempest-user-101448440] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:54.454098 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c52c80-15dc-4afc-9c20-4d4406889d7c tempest-TrustsV3TestJSON-1764129193 tempest-user-101448440] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:54.455528 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c52c80-15dc-4afc-9c20-4d4406889d7c tempest-TrustsV3TestJSON-1764129193 tempest-user-101448440] PATH_INFO: `/v3/OS-TRUST/trusts/16b30e112dbe44cf86fda632ba63806c` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:54.467442 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c52c80-15dc-4afc-9c20-4d4406889d7c tempest-TrustsV3TestJSON-1764129193 tempest-user-101448440] RBAC: Authorizing `identity:delete_trust(trust_id=16b30e112dbe44cf86fda632ba63806c)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:54.470026 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c52c80-15dc-4afc-9c20-4d4406889d7c tempest-TrustsV3TestJSON-1764129193 tempest-user-101448440] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:54.537484 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-10c52c80-15dc-4afc-9c20-4d4406889d7c tempest-TrustsV3TestJSON-1764129193 tempest-user-101448440] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '16b30e112dbe44cf86fda632ba63806c', 'request_id': 'req-10c52c80-15dc-4afc-9c20-4d4406889d7c'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:54.538383 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-10c52c80-15dc-4afc-9c20-4d4406889d7c tempest-TrustsV3TestJSON-1764129193 tempest-user-101448440] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '16b30e112dbe44cf86fda632ba63806c', 'request_id': 'req-10c52c80-15dc-4afc-9c20-4d4406889d7c'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:54.538951 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-10c52c80-15dc-4afc-9c20-4d4406889d7c tempest-TrustsV3TestJSON-1764129193 tempest-user-101448440] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '16b30e112dbe44cf86fda632ba63806c', 'request_id': 'req-10c52c80-15dc-4afc-9c20-4d4406889d7c'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:54.607250 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2395/4825] 10.222.0.52 () {58 vars in 1253 bytes} [Sat May 14 21:29:54 2022] DELETE /identity/v3/OS-TRUST/trusts/16b30e112dbe44cf86fda632ba63806c => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:29:54.611731 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137c132-e8d4-47ad-b14f-b58fe113272b tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:54.613500 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-8137c132-e8d4-47ad-b14f-b58fe113272b tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:29:54.628540 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137c132-e8d4-47ad-b14f-b58fe113272b tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:54.632639 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081206db-bb73-4492-97a1-33f311233ac7 tempest-TrustsV3TestJSON-1764129193 tempest-user-101448440] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1f19ca0cac4f6ab2a432aa4d54324f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a47f17158cd545cdb6e31597eb340376', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1281990992', 'tempest-NotDelegatedRole-548587787'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:54.633592 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081206db-bb73-4492-97a1-33f311233ac7 tempest-TrustsV3TestJSON-1764129193 tempest-user-101448440] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:54.633875 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081206db-bb73-4492-97a1-33f311233ac7 tempest-TrustsV3TestJSON-1764129193 tempest-user-101448440] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:54.634157 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081206db-bb73-4492-97a1-33f311233ac7 tempest-TrustsV3TestJSON-1764129193 tempest-user-101448440] PATH_INFO: `/v3/OS-TRUST/trusts/16b30e112dbe44cf86fda632ba63806c` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:54.697670 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-081206db-bb73-4492-97a1-33f311233ac7 tempest-TrustsV3TestJSON-1764129193 tempest-user-101448440] Could not find trust: 16b30e112dbe44cf86fda632ba63806c.: keystone.exception.TrustNotFound: Could not find trust: 16b30e112dbe44cf86fda632ba63806c. May 14 21:29:54.697670 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:29:54.697670 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 21:29:54.697670 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 21:29:54.697670 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 21:29:54.697670 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 21:29:54.697670 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 21:29:54.697670 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 21:29:54.697670 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 21:29:54.697670 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 21:29:54.697670 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 21:29:54.697670 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 21:29:54.697670 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get May 14 21:29:54.697670 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) May 14 21:29:54.697670 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust May 14 21:29:54.699117 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', May 14 21:29:54.699117 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call May 14 21:29:54.699117 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() May 14 21:29:54.699117 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement May 14 21:29:54.699117 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( May 14 21:29:54.699117 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 21:29:54.699117 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 21:29:54.699117 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust May 14 21:29:54.699117 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) May 14 21:29:54.699117 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust May 14 21:29:54.699117 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) May 14 21:29:54.699117 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 16b30e112dbe44cf86fda632ba63806c. May 14 21:29:54.699117 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:29:54.700458 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2431/4826] 10.222.0.52 () {58 vars in 1250 bytes} [Sat May 14 21:29:54 2022] GET /identity/v3/OS-TRUST/trusts/16b30e112dbe44cf86fda632ba63806c => generated 111 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 14 21:29:54.704227 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c52c80-15dc-4afc-9c20-4d4406889d7c tempest-TrustsV3TestJSON-1764129193 tempest-user-101448440] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:54.705674 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-10c52c80-15dc-4afc-9c20-4d4406889d7c tempest-TrustsV3TestJSON-1764129193 tempest-user-101448440] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:29:54.720898 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c52c80-15dc-4afc-9c20-4d4406889d7c tempest-TrustsV3TestJSON-1764129193 tempest-user-101448440] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:54.725467 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c52e43-f34d-4763-a51b-fc83cd05f832 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16df42e793ed46c8b39b78b4a4821bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1997fca61bf6406d83c93f3f98a79a84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:54.726416 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c52e43-f34d-4763-a51b-fc83cd05f832 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:54.728125 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c52e43-f34d-4763-a51b-fc83cd05f832 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:54.728125 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c52e43-f34d-4763-a51b-fc83cd05f832 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] PATH_INFO: `/v3/roles/bc2ecb828d7d4a9db287d2019816effa` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:54.728396 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c52e43-f34d-4763-a51b-fc83cd05f832 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorizing `identity:delete_role(role_id=bc2ecb828d7d4a9db287d2019816effa)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:54.729994 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c52e43-f34d-4763-a51b-fc83cd05f832 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:54.927290 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c8c52e43-f34d-4763-a51b-fc83cd05f832 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invalidating the token cache because role bc2ecb828d7d4a9db287d2019816effa has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:29:54.929427 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c8c52e43-f34d-4763-a51b-fc83cd05f832 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:54.929752 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c8c52e43-f34d-4763-a51b-fc83cd05f832 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:54.936062 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2396/4827] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:29:54 2022] DELETE /identity/v3/roles/bc2ecb828d7d4a9db287d2019816effa => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:29:54.938838 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081206db-bb73-4492-97a1-33f311233ac7 tempest-TrustsV3TestJSON-1764129193 tempest-user-101448440] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:54.940832 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-081206db-bb73-4492-97a1-33f311233ac7 tempest-TrustsV3TestJSON-1764129193 tempest-user-101448440] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:29:54.963895 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081206db-bb73-4492-97a1-33f311233ac7 tempest-TrustsV3TestJSON-1764129193 tempest-user-101448440] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:55.026291 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f59ee-e7aa-46df-ad28-de8b9fb678cf tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16df42e793ed46c8b39b78b4a4821bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1997fca61bf6406d83c93f3f98a79a84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:55.027208 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f59ee-e7aa-46df-ad28-de8b9fb678cf tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:55.027516 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f59ee-e7aa-46df-ad28-de8b9fb678cf tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:55.027856 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f59ee-e7aa-46df-ad28-de8b9fb678cf tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] PATH_INFO: `/v3/roles/385203b88a214af29b77386656c016b8` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:55.029358 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8f59ee-e7aa-46df-ad28-de8b9fb678cf tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorizing `identity:delete_role(role_id=385203b88a214af29b77386656c016b8)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:55.031066 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8f59ee-e7aa-46df-ad28-de8b9fb678cf tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:55.173879 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8e8f59ee-e7aa-46df-ad28-de8b9fb678cf tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invalidating the token cache because role 385203b88a214af29b77386656c016b8 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:29:55.174149 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8e8f59ee-e7aa-46df-ad28-de8b9fb678cf tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:55.176064 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8e8f59ee-e7aa-46df-ad28-de8b9fb678cf tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:55.182324 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2432/4828] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:29:54 2022] DELETE /identity/v3/roles/385203b88a214af29b77386656c016b8 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:29:55.186330 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c52e43-f34d-4763-a51b-fc83cd05f832 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:55.201495 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c52e43-f34d-4763-a51b-fc83cd05f832 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:55.267191 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4e94a0-e6cc-4931-8919-47eff37909c7 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16df42e793ed46c8b39b78b4a4821bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1997fca61bf6406d83c93f3f98a79a84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:55.268025 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e94a0-e6cc-4931-8919-47eff37909c7 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:55.268310 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e94a0-e6cc-4931-8919-47eff37909c7 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:55.268616 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e94a0-e6cc-4931-8919-47eff37909c7 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] PATH_INFO: `/v3/users/ba1f19ca0cac4f6ab2a432aa4d54324f` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:55.269830 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4e94a0-e6cc-4931-8919-47eff37909c7 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorizing `identity:delete_user(user_id=ba1f19ca0cac4f6ab2a432aa4d54324f)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:55.271818 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4e94a0-e6cc-4931-8919-47eff37909c7 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:55.623908 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0f4e94a0-e6cc-4931-8919-47eff37909c7 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba1f19ca0cac4f6ab2a432aa4d54324f'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:55.631206 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0f4e94a0-e6cc-4931-8919-47eff37909c7 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba1f19ca0cac4f6ab2a432aa4d54324f'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:55.631921 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0f4e94a0-e6cc-4931-8919-47eff37909c7 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba1f19ca0cac4f6ab2a432aa4d54324f'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:55.748706 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0f4e94a0-e6cc-4931-8919-47eff37909c7 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba1f19ca0cac4f6ab2a432aa4d54324f'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:55.761477 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0f4e94a0-e6cc-4931-8919-47eff37909c7 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba1f19ca0cac4f6ab2a432aa4d54324f'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:55.768231 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2397/4829] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:29:55 2022] DELETE /identity/v3/users/ba1f19ca0cac4f6ab2a432aa4d54324f => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:29:55.772610 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f59ee-e7aa-46df-ad28-de8b9fb678cf tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:55.776730 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-8e8f59ee-e7aa-46df-ad28-de8b9fb678cf tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:29:55.788211 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f59ee-e7aa-46df-ad28-de8b9fb678cf tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:55.847683 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c48c21b-b25b-4b26-bf3f-3f705b343654 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16df42e793ed46c8b39b78b4a4821bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1997fca61bf6406d83c93f3f98a79a84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:55.848559 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48c21b-b25b-4b26-bf3f-3f705b343654 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:55.848840 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48c21b-b25b-4b26-bf3f-3f705b343654 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:55.849119 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48c21b-b25b-4b26-bf3f-3f705b343654 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] PATH_INFO: `/v3/projects/a47f17158cd545cdb6e31597eb340376` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:55.850379 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c48c21b-b25b-4b26-bf3f-3f705b343654 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a47f17158cd545cdb6e31597eb340376)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:55.852818 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c48c21b-b25b-4b26-bf3f-3f705b343654 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:56.016090 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-4c48c21b-b25b-4b26-bf3f-3f705b343654 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a47f17158cd545cdb6e31597eb340376', 'request_id': 'req-4c48c21b-b25b-4b26-bf3f-3f705b343654'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:56.022071 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-4c48c21b-b25b-4b26-bf3f-3f705b343654 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a47f17158cd545cdb6e31597eb340376', 'request_id': 'req-4c48c21b-b25b-4b26-bf3f-3f705b343654'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:56.097565 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-4c48c21b-b25b-4b26-bf3f-3f705b343654 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a47f17158cd545cdb6e31597eb340376', 'request_id': 'req-4c48c21b-b25b-4b26-bf3f-3f705b343654'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:56.110759 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-4c48c21b-b25b-4b26-bf3f-3f705b343654 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] The token cache is being invalidate because project a47f17158cd545cdb6e31597eb340376 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:29:56.115268 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-4c48c21b-b25b-4b26-bf3f-3f705b343654 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:56.115268 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-4c48c21b-b25b-4b26-bf3f-3f705b343654 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:56.115268 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2433/4830] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:29:55 2022] DELETE /identity/v3/projects/a47f17158cd545cdb6e31597eb340376 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:29:56.119464 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4e94a0-e6cc-4931-8919-47eff37909c7 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:56.120930 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-0f4e94a0-e6cc-4931-8919-47eff37909c7 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:29:56.134058 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4e94a0-e6cc-4931-8919-47eff37909c7 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:56.192745 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d53b9-834d-4f1d-93ac-24ab31167c0c tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16df42e793ed46c8b39b78b4a4821bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1997fca61bf6406d83c93f3f98a79a84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:56.193454 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d53b9-834d-4f1d-93ac-24ab31167c0c tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:56.193746 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d53b9-834d-4f1d-93ac-24ab31167c0c tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:56.194026 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d53b9-834d-4f1d-93ac-24ab31167c0c tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:56.194726 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0d53b9-834d-4f1d-93ac-24ab31167c0c tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:56.196713 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0d53b9-834d-4f1d-93ac-24ab31167c0c tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:56.294996 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2398/4831] 10.222.0.52 () {60 vars in 1151 bytes} [Sat May 14 21:29:56 2022] POST /identity/v3/projects => generated 329 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:29:56.298084 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c48c21b-b25b-4b26-bf3f-3f705b343654 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:56.299855 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-4c48c21b-b25b-4b26-bf3f-3f705b343654 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:29:56.314373 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c48c21b-b25b-4b26-bf3f-3f705b343654 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:56.382309 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b61411-2788-45be-8f6e-d498d1722314 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16df42e793ed46c8b39b78b4a4821bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1997fca61bf6406d83c93f3f98a79a84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:56.382983 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b61411-2788-45be-8f6e-d498d1722314 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:56.383274 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b61411-2788-45be-8f6e-d498d1722314 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:56.383600 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b61411-2788-45be-8f6e-d498d1722314 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:56.384305 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b61411-2788-45be-8f6e-d498d1722314 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:56.386230 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b61411-2788-45be-8f6e-d498d1722314 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:56.501826 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2434/4832] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:29:56 2022] POST /identity/v3/users => generated 416 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:29:56.503382 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d53b9-834d-4f1d-93ac-24ab31167c0c tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:56.513947 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d53b9-834d-4f1d-93ac-24ab31167c0c tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:56.519246 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb984c3-8a6a-4b72-8fd6-f6e85799ed2d tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16df42e793ed46c8b39b78b4a4821bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1997fca61bf6406d83c93f3f98a79a84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:56.520102 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb984c3-8a6a-4b72-8fd6-f6e85799ed2d tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:56.524118 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb984c3-8a6a-4b72-8fd6-f6e85799ed2d tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:56.524118 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb984c3-8a6a-4b72-8fd6-f6e85799ed2d tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:56.524118 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb984c3-8a6a-4b72-8fd6-f6e85799ed2d tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:56.524118 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb984c3-8a6a-4b72-8fd6-f6e85799ed2d tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:56.632610 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2399/4833] 10.222.0.52 () {60 vars in 1142 bytes} [Sat May 14 21:29:56 2022] POST /identity/v3/roles => generated 244 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:29:56.633894 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b61411-2788-45be-8f6e-d498d1722314 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:56.648804 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b61411-2788-45be-8f6e-d498d1722314 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:56.654807 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91d7250-0164-4f62-a49c-42f2f866b936 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16df42e793ed46c8b39b78b4a4821bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1997fca61bf6406d83c93f3f98a79a84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:56.655580 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d7250-0164-4f62-a49c-42f2f866b936 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:56.656040 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d7250-0164-4f62-a49c-42f2f866b936 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:56.656246 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d7250-0164-4f62-a49c-42f2f866b936 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:56.657097 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91d7250-0164-4f62-a49c-42f2f866b936 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:56.659316 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91d7250-0164-4f62-a49c-42f2f866b936 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:56.746370 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2435/4834] 10.222.0.52 () {60 vars in 1142 bytes} [Sat May 14 21:29:56 2022] POST /identity/v3/roles => generated 247 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:29:56.750918 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb984c3-8a6a-4b72-8fd6-f6e85799ed2d tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:56.764334 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb984c3-8a6a-4b72-8fd6-f6e85799ed2d tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:56.770665 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca173d2-77ec-42aa-a679-e24bdaa0d082 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16df42e793ed46c8b39b78b4a4821bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1997fca61bf6406d83c93f3f98a79a84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:56.771681 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca173d2-77ec-42aa-a679-e24bdaa0d082 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:56.772053 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca173d2-77ec-42aa-a679-e24bdaa0d082 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:56.772572 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca173d2-77ec-42aa-a679-e24bdaa0d082 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] PATH_INFO: `/v3/projects/80c01d4ffb254e45b58936c9b002a7d5/users/5b7ee74f11a34a3781b570a9a203763f/roles/55406fc00ab040eda966e105e453ad99` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:56.788844 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca173d2-77ec-42aa-a679-e24bdaa0d082 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorizing `identity:create_grant(project_id=80c01d4ffb254e45b58936c9b002a7d5, user_id=5b7ee74f11a34a3781b570a9a203763f, role_id=55406fc00ab040eda966e105e453ad99)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:56.791870 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca173d2-77ec-42aa-a679-e24bdaa0d082 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:56.910618 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2400/4835] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:29:56 2022] PUT /identity/v3/projects/80c01d4ffb254e45b58936c9b002a7d5/users/5b7ee74f11a34a3781b570a9a203763f/roles/55406fc00ab040eda966e105e453ad99 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:29:56.914750 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91d7250-0164-4f62-a49c-42f2f866b936 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:56.925498 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91d7250-0164-4f62-a49c-42f2f866b936 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:56.989298 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b07230-c171-4633-b662-c9add2557d65 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16df42e793ed46c8b39b78b4a4821bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1997fca61bf6406d83c93f3f98a79a84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:56.990155 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b07230-c171-4633-b662-c9add2557d65 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:56.990440 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b07230-c171-4633-b662-c9add2557d65 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:56.990714 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b07230-c171-4633-b662-c9add2557d65 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] PATH_INFO: `/v3/projects/80c01d4ffb254e45b58936c9b002a7d5/users/5b7ee74f11a34a3781b570a9a203763f/roles/68b216fd5e984a91bba9485105c38edf` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:56.992974 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b07230-c171-4633-b662-c9add2557d65 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorizing `identity:create_grant(project_id=80c01d4ffb254e45b58936c9b002a7d5, user_id=5b7ee74f11a34a3781b570a9a203763f, role_id=68b216fd5e984a91bba9485105c38edf)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:56.995927 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b07230-c171-4633-b662-c9add2557d65 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:57.103711 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2436/4836] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:29:56 2022] PUT /identity/v3/projects/80c01d4ffb254e45b58936c9b002a7d5/users/5b7ee74f11a34a3781b570a9a203763f/roles/68b216fd5e984a91bba9485105c38edf => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:29:57.107858 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca173d2-77ec-42aa-a679-e24bdaa0d082 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:57.124577 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca173d2-77ec-42aa-a679-e24bdaa0d082 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:57.185768 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1714fdd3-13fc-4e20-90c1-48f815475b6d tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16df42e793ed46c8b39b78b4a4821bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1997fca61bf6406d83c93f3f98a79a84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:57.186442 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714fdd3-13fc-4e20-90c1-48f815475b6d tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:57.186725 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714fdd3-13fc-4e20-90c1-48f815475b6d tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:57.187012 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714fdd3-13fc-4e20-90c1-48f815475b6d tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:57.188295 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1714fdd3-13fc-4e20-90c1-48f815475b6d tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:57.193484 ncdv-master-1 devstack@keystone.service[91107]: WARNING py.warnings [None req-1714fdd3-13fc-4e20-90c1-48f815475b6d tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 14 21:29:57.193484 ncdv-master-1 devstack@keystone.service[91107]: warnings.warn(msg) May 14 21:29:57.193484 ncdv-master-1 devstack@keystone.service[91107]: May 14 21:29:57.193484 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1714fdd3-13fc-4e20-90c1-48f815475b6d tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:57.233358 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2401/4837] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:29:57 2022] GET /identity/v3/users => generated 8636 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:29:57.239185 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd9f27-809d-4b7e-8a37-dc98935e0483 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:57.239486 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd9f27-809d-4b7e-8a37-dc98935e0483 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:57.239789 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd9f27-809d-4b7e-8a37-dc98935e0483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:57.286240 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-5dfd9f27-809d-4b7e-8a37-dc98935e0483 None None] MFA Rules not processed for user `5b7ee74f11a34a3781b570a9a203763f`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:29:57.287454 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-5dfd9f27-809d-4b7e-8a37-dc98935e0483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:29:57.352335 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2437/4838] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:29:57 2022] POST /identity/v3/auth/tokens => generated 3271 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:29:57.362496 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781b24bd-9b3d-4f1e-8866-afb4567512d9 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:57.362812 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781b24bd-9b3d-4f1e-8866-afb4567512d9 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:57.363058 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781b24bd-9b3d-4f1e-8866-afb4567512d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:57.381533 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-781b24bd-9b3d-4f1e-8866-afb4567512d9 None None] MFA Rules not processed for user `5b7ee74f11a34a3781b570a9a203763f`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:29:57.381753 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-781b24bd-9b3d-4f1e-8866-afb4567512d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:29:57.389308 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2402/4839] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:29:57 2022] POST /identity/v3/auth/tokens => generated 3271 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:29:57.394507 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfd9f27-809d-4b7e-8a37-dc98935e0483 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:57.403562 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfd9f27-809d-4b7e-8a37-dc98935e0483 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:57.408889 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87930b4c-caa9-4025-906f-6af0240f7e8f tempest-TrustsV3TestJSON-1547543641 tempest-user-1099558776] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7ee74f11a34a3781b570a9a203763f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80c01d4ffb254e45b58936c9b002a7d5', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1757246767', 'tempest-NotDelegatedRole-1118920818'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:57.409545 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87930b4c-caa9-4025-906f-6af0240f7e8f tempest-TrustsV3TestJSON-1547543641 tempest-user-1099558776] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:57.409825 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87930b4c-caa9-4025-906f-6af0240f7e8f tempest-TrustsV3TestJSON-1547543641 tempest-user-1099558776] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:57.410157 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87930b4c-caa9-4025-906f-6af0240f7e8f tempest-TrustsV3TestJSON-1547543641 tempest-user-1099558776] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:57.410847 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87930b4c-caa9-4025-906f-6af0240f7e8f tempest-TrustsV3TestJSON-1547543641 tempest-user-1099558776] RBAC: Authorizing `identity:create_trust()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:57.412057 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87930b4c-caa9-4025-906f-6af0240f7e8f tempest-TrustsV3TestJSON-1547543641 tempest-user-1099558776] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:57.550058 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2438/4840] 10.222.0.52 () {60 vars in 1173 bytes} [Sat May 14 21:29:57 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:29:57.555149 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781b24bd-9b3d-4f1e-8866-afb4567512d9 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:57.563767 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781b24bd-9b3d-4f1e-8866-afb4567512d9 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:57.568206 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92badf7f-56d0-4ee7-9a2b-55fe148fcf93 tempest-TrustsV3TestJSON-1547543641 tempest-user-1099558776] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7ee74f11a34a3781b570a9a203763f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80c01d4ffb254e45b58936c9b002a7d5', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1757246767', 'tempest-NotDelegatedRole-1118920818'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:57.572709 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92badf7f-56d0-4ee7-9a2b-55fe148fcf93 tempest-TrustsV3TestJSON-1547543641 tempest-user-1099558776] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:57.572709 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92badf7f-56d0-4ee7-9a2b-55fe148fcf93 tempest-TrustsV3TestJSON-1547543641 tempest-user-1099558776] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:57.572709 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92badf7f-56d0-4ee7-9a2b-55fe148fcf93 tempest-TrustsV3TestJSON-1547543641 tempest-user-1099558776] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:57.572709 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92badf7f-56d0-4ee7-9a2b-55fe148fcf93 tempest-TrustsV3TestJSON-1547543641 tempest-user-1099558776] RBAC: Authorizing `identity:list_trusts_for_trustor()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:57.572709 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92badf7f-56d0-4ee7-9a2b-55fe148fcf93 tempest-TrustsV3TestJSON-1547543641 tempest-user-1099558776] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:57.576918 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2403/4841] 10.222.0.52 () {58 vars in 1251 bytes} [Sat May 14 21:29:57 2022] GET /identity/v3/OS-TRUST/trusts/?trustor_user_id=5b7ee74f11a34a3781b570a9a203763f => generated 611 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:29:57.581554 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87930b4c-caa9-4025-906f-6af0240f7e8f tempest-TrustsV3TestJSON-1547543641 tempest-user-1099558776] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:57.591019 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87930b4c-caa9-4025-906f-6af0240f7e8f tempest-TrustsV3TestJSON-1547543641 tempest-user-1099558776] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:57.596303 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de63c289-ceff-4085-ae09-c1af9c5dc02d tempest-TrustsV3TestJSON-1547543641 tempest-user-1099558776] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7ee74f11a34a3781b570a9a203763f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80c01d4ffb254e45b58936c9b002a7d5', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1757246767', 'tempest-NotDelegatedRole-1118920818'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:57.598643 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de63c289-ceff-4085-ae09-c1af9c5dc02d tempest-TrustsV3TestJSON-1547543641 tempest-user-1099558776] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:57.598643 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de63c289-ceff-4085-ae09-c1af9c5dc02d tempest-TrustsV3TestJSON-1547543641 tempest-user-1099558776] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:57.598643 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de63c289-ceff-4085-ae09-c1af9c5dc02d tempest-TrustsV3TestJSON-1547543641 tempest-user-1099558776] PATH_INFO: `/v3/OS-TRUST/trusts/e14b2596fc864b5190b17e7fa9cf0a3c` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:57.608642 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de63c289-ceff-4085-ae09-c1af9c5dc02d tempest-TrustsV3TestJSON-1547543641 tempest-user-1099558776] RBAC: Authorizing `identity:delete_trust(trust_id=e14b2596fc864b5190b17e7fa9cf0a3c)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:57.610842 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de63c289-ceff-4085-ae09-c1af9c5dc02d tempest-TrustsV3TestJSON-1547543641 tempest-user-1099558776] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:57.727034 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-de63c289-ceff-4085-ae09-c1af9c5dc02d tempest-TrustsV3TestJSON-1547543641 tempest-user-1099558776] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'e14b2596fc864b5190b17e7fa9cf0a3c', 'request_id': 'req-de63c289-ceff-4085-ae09-c1af9c5dc02d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:57.730657 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-de63c289-ceff-4085-ae09-c1af9c5dc02d tempest-TrustsV3TestJSON-1547543641 tempest-user-1099558776] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'e14b2596fc864b5190b17e7fa9cf0a3c', 'request_id': 'req-de63c289-ceff-4085-ae09-c1af9c5dc02d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:57.783119 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-de63c289-ceff-4085-ae09-c1af9c5dc02d tempest-TrustsV3TestJSON-1547543641 tempest-user-1099558776] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'e14b2596fc864b5190b17e7fa9cf0a3c', 'request_id': 'req-de63c289-ceff-4085-ae09-c1af9c5dc02d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:57.791063 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2439/4842] 10.222.0.52 () {58 vars in 1253 bytes} [Sat May 14 21:29:57 2022] DELETE /identity/v3/OS-TRUST/trusts/e14b2596fc864b5190b17e7fa9cf0a3c => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:29:57.795952 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92badf7f-56d0-4ee7-9a2b-55fe148fcf93 tempest-TrustsV3TestJSON-1547543641 tempest-user-1099558776] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:57.804577 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-92badf7f-56d0-4ee7-9a2b-55fe148fcf93 tempest-TrustsV3TestJSON-1547543641 tempest-user-1099558776] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:29:57.817674 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92badf7f-56d0-4ee7-9a2b-55fe148fcf93 tempest-TrustsV3TestJSON-1547543641 tempest-user-1099558776] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:57.822129 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7584fa-8798-4e32-8851-1f4a42aa0371 tempest-TrustsV3TestJSON-1547543641 tempest-user-1099558776] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7ee74f11a34a3781b570a9a203763f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80c01d4ffb254e45b58936c9b002a7d5', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1757246767', 'tempest-NotDelegatedRole-1118920818'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:57.822953 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7584fa-8798-4e32-8851-1f4a42aa0371 tempest-TrustsV3TestJSON-1547543641 tempest-user-1099558776] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:57.823232 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7584fa-8798-4e32-8851-1f4a42aa0371 tempest-TrustsV3TestJSON-1547543641 tempest-user-1099558776] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:57.823534 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7584fa-8798-4e32-8851-1f4a42aa0371 tempest-TrustsV3TestJSON-1547543641 tempest-user-1099558776] PATH_INFO: `/v3/OS-TRUST/trusts/e14b2596fc864b5190b17e7fa9cf0a3c` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:57.837464 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-6d7584fa-8798-4e32-8851-1f4a42aa0371 tempest-TrustsV3TestJSON-1547543641 tempest-user-1099558776] Could not find trust: e14b2596fc864b5190b17e7fa9cf0a3c.: keystone.exception.TrustNotFound: Could not find trust: e14b2596fc864b5190b17e7fa9cf0a3c. May 14 21:29:57.837464 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:29:57.837464 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 21:29:57.837464 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 21:29:57.837464 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 21:29:57.837464 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 21:29:57.837464 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 21:29:57.837464 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 21:29:57.837464 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 21:29:57.837464 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 21:29:57.837464 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 21:29:57.837464 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 21:29:57.837464 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get May 14 21:29:57.837464 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) May 14 21:29:57.837464 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust May 14 21:29:57.838744 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', May 14 21:29:57.838744 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call May 14 21:29:57.838744 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() May 14 21:29:57.838744 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement May 14 21:29:57.838744 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( May 14 21:29:57.838744 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 21:29:57.838744 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 21:29:57.838744 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust May 14 21:29:57.838744 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) May 14 21:29:57.838744 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust May 14 21:29:57.838744 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) May 14 21:29:57.838744 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: e14b2596fc864b5190b17e7fa9cf0a3c. May 14 21:29:57.838744 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:29:57.840713 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2404/4843] 10.222.0.52 () {58 vars in 1250 bytes} [Sat May 14 21:29:57 2022] GET /identity/v3/OS-TRUST/trusts/e14b2596fc864b5190b17e7fa9cf0a3c => generated 111 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 14 21:29:57.845443 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de63c289-ceff-4085-ae09-c1af9c5dc02d tempest-TrustsV3TestJSON-1547543641 tempest-user-1099558776] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:57.848688 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-de63c289-ceff-4085-ae09-c1af9c5dc02d tempest-TrustsV3TestJSON-1547543641 tempest-user-1099558776] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:29:57.865174 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de63c289-ceff-4085-ae09-c1af9c5dc02d tempest-TrustsV3TestJSON-1547543641 tempest-user-1099558776] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:57.870583 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80fe38e-53ef-48e7-af7e-13aef1a95721 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16df42e793ed46c8b39b78b4a4821bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1997fca61bf6406d83c93f3f98a79a84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:57.871675 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80fe38e-53ef-48e7-af7e-13aef1a95721 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:57.872308 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80fe38e-53ef-48e7-af7e-13aef1a95721 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:57.872679 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80fe38e-53ef-48e7-af7e-13aef1a95721 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] PATH_INFO: `/v3/roles/68b216fd5e984a91bba9485105c38edf` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:57.874393 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80fe38e-53ef-48e7-af7e-13aef1a95721 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorizing `identity:delete_role(role_id=68b216fd5e984a91bba9485105c38edf)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:57.876492 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80fe38e-53ef-48e7-af7e-13aef1a95721 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:58.107701 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f80fe38e-53ef-48e7-af7e-13aef1a95721 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invalidating the token cache because role 68b216fd5e984a91bba9485105c38edf has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:29:58.107701 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f80fe38e-53ef-48e7-af7e-13aef1a95721 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:58.107701 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f80fe38e-53ef-48e7-af7e-13aef1a95721 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:58.107701 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2440/4844] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:29:57 2022] DELETE /identity/v3/roles/68b216fd5e984a91bba9485105c38edf => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:29:58.110097 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7584fa-8798-4e32-8851-1f4a42aa0371 tempest-TrustsV3TestJSON-1547543641 tempest-user-1099558776] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:58.111900 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-6d7584fa-8798-4e32-8851-1f4a42aa0371 tempest-TrustsV3TestJSON-1547543641 tempest-user-1099558776] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:29:58.127113 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7584fa-8798-4e32-8851-1f4a42aa0371 tempest-TrustsV3TestJSON-1547543641 tempest-user-1099558776] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:58.201162 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f83950-55a7-42e2-bd6c-f5ef651f6ae6 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16df42e793ed46c8b39b78b4a4821bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1997fca61bf6406d83c93f3f98a79a84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:58.205115 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f83950-55a7-42e2-bd6c-f5ef651f6ae6 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:58.205115 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f83950-55a7-42e2-bd6c-f5ef651f6ae6 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:58.205115 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f83950-55a7-42e2-bd6c-f5ef651f6ae6 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] PATH_INFO: `/v3/roles/55406fc00ab040eda966e105e453ad99` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:58.205756 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f83950-55a7-42e2-bd6c-f5ef651f6ae6 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorizing `identity:delete_role(role_id=55406fc00ab040eda966e105e453ad99)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:58.207777 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f83950-55a7-42e2-bd6c-f5ef651f6ae6 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:58.424590 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-24f83950-55a7-42e2-bd6c-f5ef651f6ae6 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invalidating the token cache because role 55406fc00ab040eda966e105e453ad99 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:29:58.425086 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-24f83950-55a7-42e2-bd6c-f5ef651f6ae6 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:58.425614 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-24f83950-55a7-42e2-bd6c-f5ef651f6ae6 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:58.427512 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2405/4845] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:29:58 2022] DELETE /identity/v3/roles/55406fc00ab040eda966e105e453ad99 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:29:58.431466 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80fe38e-53ef-48e7-af7e-13aef1a95721 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:58.442517 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80fe38e-53ef-48e7-af7e-13aef1a95721 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:58.507067 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4244d934-6123-4036-90e6-15aceb85e5fc tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16df42e793ed46c8b39b78b4a4821bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1997fca61bf6406d83c93f3f98a79a84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:58.508489 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4244d934-6123-4036-90e6-15aceb85e5fc tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:58.508850 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4244d934-6123-4036-90e6-15aceb85e5fc tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:58.509413 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4244d934-6123-4036-90e6-15aceb85e5fc tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] PATH_INFO: `/v3/users/5b7ee74f11a34a3781b570a9a203763f` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:58.511282 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4244d934-6123-4036-90e6-15aceb85e5fc tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorizing `identity:delete_user(user_id=5b7ee74f11a34a3781b570a9a203763f)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:58.514826 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4244d934-6123-4036-90e6-15aceb85e5fc tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:58.685371 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-4244d934-6123-4036-90e6-15aceb85e5fc tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b7ee74f11a34a3781b570a9a203763f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:58.697879 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-4244d934-6123-4036-90e6-15aceb85e5fc tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b7ee74f11a34a3781b570a9a203763f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:58.705663 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-4244d934-6123-4036-90e6-15aceb85e5fc tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b7ee74f11a34a3781b570a9a203763f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:58.768128 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-4244d934-6123-4036-90e6-15aceb85e5fc tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b7ee74f11a34a3781b570a9a203763f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:58.770895 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-4244d934-6123-4036-90e6-15aceb85e5fc tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b7ee74f11a34a3781b570a9a203763f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:58.779019 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2441/4846] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:29:58 2022] DELETE /identity/v3/users/5b7ee74f11a34a3781b570a9a203763f => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:29:58.783734 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f83950-55a7-42e2-bd6c-f5ef651f6ae6 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:58.785433 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-24f83950-55a7-42e2-bd6c-f5ef651f6ae6 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:29:58.800975 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f83950-55a7-42e2-bd6c-f5ef651f6ae6 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:59.009005 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9460ee70-bcf8-4286-a591-f53efa1e9459 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16df42e793ed46c8b39b78b4a4821bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1997fca61bf6406d83c93f3f98a79a84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:59.010147 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9460ee70-bcf8-4286-a591-f53efa1e9459 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:59.010469 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9460ee70-bcf8-4286-a591-f53efa1e9459 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:59.010823 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9460ee70-bcf8-4286-a591-f53efa1e9459 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] PATH_INFO: `/v3/projects/80c01d4ffb254e45b58936c9b002a7d5` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:59.012129 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9460ee70-bcf8-4286-a591-f53efa1e9459 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorizing `identity:delete_project(project_id=80c01d4ffb254e45b58936c9b002a7d5)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:59.014036 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9460ee70-bcf8-4286-a591-f53efa1e9459 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:59.203901 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9460ee70-bcf8-4286-a591-f53efa1e9459 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80c01d4ffb254e45b58936c9b002a7d5', 'request_id': 'req-9460ee70-bcf8-4286-a591-f53efa1e9459'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:59.209371 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9460ee70-bcf8-4286-a591-f53efa1e9459 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80c01d4ffb254e45b58936c9b002a7d5', 'request_id': 'req-9460ee70-bcf8-4286-a591-f53efa1e9459'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:59.215525 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9460ee70-bcf8-4286-a591-f53efa1e9459 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80c01d4ffb254e45b58936c9b002a7d5', 'request_id': 'req-9460ee70-bcf8-4286-a591-f53efa1e9459'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:59.297614 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9460ee70-bcf8-4286-a591-f53efa1e9459 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] The token cache is being invalidate because project 80c01d4ffb254e45b58936c9b002a7d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:29:59.297868 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9460ee70-bcf8-4286-a591-f53efa1e9459 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:59.298617 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9460ee70-bcf8-4286-a591-f53efa1e9459 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:29:59.300293 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2406/4847] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:29:58 2022] DELETE /identity/v3/projects/80c01d4ffb254e45b58936c9b002a7d5 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:29:59.305851 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4244d934-6123-4036-90e6-15aceb85e5fc tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:59.307341 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-4244d934-6123-4036-90e6-15aceb85e5fc tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:29:59.321232 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4244d934-6123-4036-90e6-15aceb85e5fc tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:59.382260 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167c83ab-e7f0-4109-965c-2051ffec5a75 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16df42e793ed46c8b39b78b4a4821bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1997fca61bf6406d83c93f3f98a79a84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:59.382939 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c83ab-e7f0-4109-965c-2051ffec5a75 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:59.383230 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c83ab-e7f0-4109-965c-2051ffec5a75 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:59.386776 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c83ab-e7f0-4109-965c-2051ffec5a75 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:59.386776 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167c83ab-e7f0-4109-965c-2051ffec5a75 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:59.386776 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167c83ab-e7f0-4109-965c-2051ffec5a75 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:59.482833 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2442/4848] 10.222.0.52 () {60 vars in 1151 bytes} [Sat May 14 21:29:59 2022] POST /identity/v3/projects => generated 328 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:29:59.487895 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9460ee70-bcf8-4286-a591-f53efa1e9459 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:59.489340 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-9460ee70-bcf8-4286-a591-f53efa1e9459 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:29:59.503399 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9460ee70-bcf8-4286-a591-f53efa1e9459 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:59.572314 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd2e78c-c193-44d6-975b-8b6effe3415b tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16df42e793ed46c8b39b78b4a4821bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1997fca61bf6406d83c93f3f98a79a84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:59.573072 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2e78c-c193-44d6-975b-8b6effe3415b tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:59.573422 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2e78c-c193-44d6-975b-8b6effe3415b tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:59.573765 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2e78c-c193-44d6-975b-8b6effe3415b tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:59.574555 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd2e78c-c193-44d6-975b-8b6effe3415b tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:59.576606 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd2e78c-c193-44d6-975b-8b6effe3415b tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:59.700979 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2407/4849] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:29:59 2022] POST /identity/v3/users => generated 410 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:29:59.704464 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167c83ab-e7f0-4109-965c-2051ffec5a75 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:59.716390 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167c83ab-e7f0-4109-965c-2051ffec5a75 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:59.725818 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9fe1b1-6675-4c16-9d85-da6c3be8adce tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16df42e793ed46c8b39b78b4a4821bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1997fca61bf6406d83c93f3f98a79a84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:59.727500 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9fe1b1-6675-4c16-9d85-da6c3be8adce tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:59.728059 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9fe1b1-6675-4c16-9d85-da6c3be8adce tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:59.728581 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9fe1b1-6675-4c16-9d85-da6c3be8adce tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:59.729652 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9fe1b1-6675-4c16-9d85-da6c3be8adce tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:59.732858 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9fe1b1-6675-4c16-9d85-da6c3be8adce tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:59.835309 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2443/4850] 10.222.0.52 () {60 vars in 1142 bytes} [Sat May 14 21:29:59 2022] POST /identity/v3/roles => generated 244 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:29:59.839791 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd2e78c-c193-44d6-975b-8b6effe3415b tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:59.855435 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a1819-4da7-4a69-aab5-4e80755c511f None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:59.855818 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a1819-4da7-4a69-aab5-4e80755c511f None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:59.856172 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a1819-4da7-4a69-aab5-4e80755c511f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:59.866885 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd2e78c-c193-44d6-975b-8b6effe3415b tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:59.872254 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07efb15-ae84-46d0-81e5-2be04b3b242c tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16df42e793ed46c8b39b78b4a4821bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1997fca61bf6406d83c93f3f98a79a84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:59.874409 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07efb15-ae84-46d0-81e5-2be04b3b242c tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:59.874409 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07efb15-ae84-46d0-81e5-2be04b3b242c tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:59.874409 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07efb15-ae84-46d0-81e5-2be04b3b242c tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:29:59.874769 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07efb15-ae84-46d0-81e5-2be04b3b242c tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:29:59.876616 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07efb15-ae84-46d0-81e5-2be04b3b242c tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:29:59.876950 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-f09a1819-4da7-4a69-aab5-4e80755c511f None None] MFA Rules not processed for user `1e3390c9579a4f598c46f9417b4dd046`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:29:59.878185 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-f09a1819-4da7-4a69-aab5-4e80755c511f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:29:59.942964 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2444/4851] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:29:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:29:59.954733 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2408/4852] 10.222.0.52 () {60 vars in 1142 bytes} [Sat May 14 21:29:59 2022] POST /identity/v3/roles => generated 245 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:29:59.957522 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09a1819-4da7-4a69-aab5-4e80755c511f None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:29:59.975241 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09a1819-4da7-4a69-aab5-4e80755c511f None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:29:59.987618 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1f5555-c5c6-46b3-8897-95c91208b7a4 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16df42e793ed46c8b39b78b4a4821bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1997fca61bf6406d83c93f3f98a79a84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:29:59.988726 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f5555-c5c6-46b3-8897-95c91208b7a4 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:29:59.989200 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f5555-c5c6-46b3-8897-95c91208b7a4 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:29:59.989977 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f5555-c5c6-46b3-8897-95c91208b7a4 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] PATH_INFO: `/v3/projects/05a0dd8d74c448db8e45ce198e118e02/users/41fdf40a05c4441681ca824209914e0b/roles/b07629aeab274a89b8a27bcda7f4ae32` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:00.163422 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1f5555-c5c6-46b3-8897-95c91208b7a4 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorizing `identity:create_grant(project_id=05a0dd8d74c448db8e45ce198e118e02, user_id=41fdf40a05c4441681ca824209914e0b, role_id=b07629aeab274a89b8a27bcda7f4ae32)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:00.166288 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1f5555-c5c6-46b3-8897-95c91208b7a4 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:00.225136 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2445/4853] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:29:59 2022] PUT /identity/v3/projects/05a0dd8d74c448db8e45ce198e118e02/users/41fdf40a05c4441681ca824209914e0b/roles/b07629aeab274a89b8a27bcda7f4ae32 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:30:00.229368 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07efb15-ae84-46d0-81e5-2be04b3b242c tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:00.248112 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07efb15-ae84-46d0-81e5-2be04b3b242c tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:00.313664 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ed3ea-0fbf-4906-8c81-171776e1f14c tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16df42e793ed46c8b39b78b4a4821bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1997fca61bf6406d83c93f3f98a79a84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:00.315737 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ed3ea-0fbf-4906-8c81-171776e1f14c tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:00.315737 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ed3ea-0fbf-4906-8c81-171776e1f14c tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:00.315737 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ed3ea-0fbf-4906-8c81-171776e1f14c tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] PATH_INFO: `/v3/projects/05a0dd8d74c448db8e45ce198e118e02/users/41fdf40a05c4441681ca824209914e0b/roles/f28c39b5f863479087ebdc9da190b678` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:00.317846 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298ed3ea-0fbf-4906-8c81-171776e1f14c tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorizing `identity:create_grant(project_id=05a0dd8d74c448db8e45ce198e118e02, user_id=41fdf40a05c4441681ca824209914e0b, role_id=f28c39b5f863479087ebdc9da190b678)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:00.320605 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298ed3ea-0fbf-4906-8c81-171776e1f14c tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:00.384487 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2409/4854] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:30:00 2022] PUT /identity/v3/projects/05a0dd8d74c448db8e45ce198e118e02/users/41fdf40a05c4441681ca824209914e0b/roles/f28c39b5f863479087ebdc9da190b678 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:30:00.388422 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1f5555-c5c6-46b3-8897-95c91208b7a4 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:00.406627 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1f5555-c5c6-46b3-8897-95c91208b7a4 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:00.465920 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8acc494-9688-4d2d-bd70-4773f72f76a4 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16df42e793ed46c8b39b78b4a4821bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1997fca61bf6406d83c93f3f98a79a84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:00.466606 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8acc494-9688-4d2d-bd70-4773f72f76a4 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:00.466895 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8acc494-9688-4d2d-bd70-4773f72f76a4 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:00.467194 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8acc494-9688-4d2d-bd70-4773f72f76a4 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:00.468005 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8acc494-9688-4d2d-bd70-4773f72f76a4 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:00.471751 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8acc494-9688-4d2d-bd70-4773f72f76a4 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:00.506900 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2446/4855] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:30:00 2022] GET /identity/v3/users => generated 8630 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:30:00.511690 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a5d05-d500-4169-b401-11fea7fd465b None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:00.511983 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a5d05-d500-4169-b401-11fea7fd465b None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:00.512260 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a5d05-d500-4169-b401-11fea7fd465b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:00.552139 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-225a5d05-d500-4169-b401-11fea7fd465b None None] MFA Rules not processed for user `41fdf40a05c4441681ca824209914e0b`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:30:00.553341 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-225a5d05-d500-4169-b401-11fea7fd465b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:00.618022 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2410/4856] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:30:00 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:30:00.627955 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf7c82f-6557-40ed-931a-905ed28452b9 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:00.628244 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf7c82f-6557-40ed-931a-905ed28452b9 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:00.628518 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf7c82f-6557-40ed-931a-905ed28452b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:00.647273 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-ddf7c82f-6557-40ed-931a-905ed28452b9 None None] MFA Rules not processed for user `41fdf40a05c4441681ca824209914e0b`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:30:00.648509 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ddf7c82f-6557-40ed-931a-905ed28452b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:00.656734 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2447/4857] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:30:00 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:30:00.661031 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225a5d05-d500-4169-b401-11fea7fd465b None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:00.670407 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225a5d05-d500-4169-b401-11fea7fd465b None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:00.675923 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed86f58d-d274-447f-9784-58a4e3d85344 tempest-TrustsV3TestJSON-568895197 tempest-user-57504750] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41fdf40a05c4441681ca824209914e0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a0dd8d74c448db8e45ce198e118e02', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-90573857', 'tempest-DelegatedRole-1082240457'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:00.676591 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86f58d-d274-447f-9784-58a4e3d85344 tempest-TrustsV3TestJSON-568895197 tempest-user-57504750] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:00.676897 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86f58d-d274-447f-9784-58a4e3d85344 tempest-TrustsV3TestJSON-568895197 tempest-user-57504750] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:00.677169 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86f58d-d274-447f-9784-58a4e3d85344 tempest-TrustsV3TestJSON-568895197 tempest-user-57504750] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:00.677907 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed86f58d-d274-447f-9784-58a4e3d85344 tempest-TrustsV3TestJSON-568895197 tempest-user-57504750] RBAC: Authorizing `identity:create_trust()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:00.679055 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed86f58d-d274-447f-9784-58a4e3d85344 tempest-TrustsV3TestJSON-568895197 tempest-user-57504750] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:00.832976 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2411/4858] 10.222.0.52 () {60 vars in 1173 bytes} [Sat May 14 21:30:00 2022] POST /identity/v3/OS-TRUST/trusts => generated 859 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:30:00.841567 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf7c82f-6557-40ed-931a-905ed28452b9 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:00.852275 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf7c82f-6557-40ed-931a-905ed28452b9 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:00.856643 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e88257-54ce-4b98-83c1-35f7b665d20f tempest-TrustsV3TestJSON-568895197 tempest-user-57504750] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41fdf40a05c4441681ca824209914e0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a0dd8d74c448db8e45ce198e118e02', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-90573857', 'tempest-DelegatedRole-1082240457'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:00.857574 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e88257-54ce-4b98-83c1-35f7b665d20f tempest-TrustsV3TestJSON-568895197 tempest-user-57504750] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:00.857924 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e88257-54ce-4b98-83c1-35f7b665d20f tempest-TrustsV3TestJSON-568895197 tempest-user-57504750] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:00.858199 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e88257-54ce-4b98-83c1-35f7b665d20f tempest-TrustsV3TestJSON-568895197 tempest-user-57504750] PATH_INFO: `/v3/OS-TRUST/trusts/8dfb78864b21411685cd3dcb8a6d917a` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:00.867740 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e88257-54ce-4b98-83c1-35f7b665d20f tempest-TrustsV3TestJSON-568895197 tempest-user-57504750] RBAC: Authorizing `identity:get_trust(trust_id=8dfb78864b21411685cd3dcb8a6d917a)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:00.869616 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e88257-54ce-4b98-83c1-35f7b665d20f tempest-TrustsV3TestJSON-568895197 tempest-user-57504750] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:00.880238 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2448/4859] 10.222.0.52 () {58 vars in 1250 bytes} [Sat May 14 21:30:00 2022] GET /identity/v3/OS-TRUST/trusts/8dfb78864b21411685cd3dcb8a6d917a => generated 859 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:30:00.884384 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed86f58d-d274-447f-9784-58a4e3d85344 tempest-TrustsV3TestJSON-568895197 tempest-user-57504750] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:00.894503 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed86f58d-d274-447f-9784-58a4e3d85344 tempest-TrustsV3TestJSON-568895197 tempest-user-57504750] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:00.899860 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3535498-eded-484b-9ba4-01ccfda5694f tempest-TrustsV3TestJSON-568895197 tempest-user-57504750] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41fdf40a05c4441681ca824209914e0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a0dd8d74c448db8e45ce198e118e02', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-90573857', 'tempest-DelegatedRole-1082240457'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:00.901530 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3535498-eded-484b-9ba4-01ccfda5694f tempest-TrustsV3TestJSON-568895197 tempest-user-57504750] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:00.902092 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3535498-eded-484b-9ba4-01ccfda5694f tempest-TrustsV3TestJSON-568895197 tempest-user-57504750] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:00.902360 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3535498-eded-484b-9ba4-01ccfda5694f tempest-TrustsV3TestJSON-568895197 tempest-user-57504750] PATH_INFO: `/v3/OS-TRUST/trusts/8dfb78864b21411685cd3dcb8a6d917a/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:00.908999 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3535498-eded-484b-9ba4-01ccfda5694f tempest-TrustsV3TestJSON-568895197 tempest-user-57504750] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=8dfb78864b21411685cd3dcb8a6d917a)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:00.910481 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3535498-eded-484b-9ba4-01ccfda5694f tempest-TrustsV3TestJSON-568895197 tempest-user-57504750] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:00.919123 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2412/4860] 10.222.0.52 () {58 vars in 1268 bytes} [Sat May 14 21:30:00 2022] GET /identity/v3/OS-TRUST/trusts/8dfb78864b21411685cd3dcb8a6d917a/roles => generated 371 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:30:00.924426 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e88257-54ce-4b98-83c1-35f7b665d20f tempest-TrustsV3TestJSON-568895197 tempest-user-57504750] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:00.939375 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e88257-54ce-4b98-83c1-35f7b665d20f tempest-TrustsV3TestJSON-568895197 tempest-user-57504750] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:00.949421 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b560bdac-42b8-4991-b47a-063844676b13 tempest-TrustsV3TestJSON-568895197 tempest-user-57504750] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41fdf40a05c4441681ca824209914e0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a0dd8d74c448db8e45ce198e118e02', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-90573857', 'tempest-DelegatedRole-1082240457'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:00.950267 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b560bdac-42b8-4991-b47a-063844676b13 tempest-TrustsV3TestJSON-568895197 tempest-user-57504750] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:00.950555 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b560bdac-42b8-4991-b47a-063844676b13 tempest-TrustsV3TestJSON-568895197 tempest-user-57504750] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:00.950835 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b560bdac-42b8-4991-b47a-063844676b13 tempest-TrustsV3TestJSON-568895197 tempest-user-57504750] PATH_INFO: `/v3/OS-TRUST/trusts/8dfb78864b21411685cd3dcb8a6d917a/roles/b07629aeab274a89b8a27bcda7f4ae32` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:00.957938 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b560bdac-42b8-4991-b47a-063844676b13 tempest-TrustsV3TestJSON-568895197 tempest-user-57504750] RBAC: Authorizing `identity:get_role_for_trust(trust_id=8dfb78864b21411685cd3dcb8a6d917a, role_id=b07629aeab274a89b8a27bcda7f4ae32)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:00.960026 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b560bdac-42b8-4991-b47a-063844676b13 tempest-TrustsV3TestJSON-568895197 tempest-user-57504750] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:00.968950 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2449/4861] 10.222.0.52 () {58 vars in 1367 bytes} [Sat May 14 21:30:00 2022] GET /identity/v3/OS-TRUST/trusts/8dfb78864b21411685cd3dcb8a6d917a/roles/b07629aeab274a89b8a27bcda7f4ae32 => generated 244 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:30:00.973152 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3535498-eded-484b-9ba4-01ccfda5694f tempest-TrustsV3TestJSON-568895197 tempest-user-57504750] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:00.984495 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3535498-eded-484b-9ba4-01ccfda5694f tempest-TrustsV3TestJSON-568895197 tempest-user-57504750] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:00.989168 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ea4854-9762-4f0e-b481-8c42fad14835 tempest-TrustsV3TestJSON-568895197 tempest-user-57504750] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41fdf40a05c4441681ca824209914e0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a0dd8d74c448db8e45ce198e118e02', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-90573857', 'tempest-DelegatedRole-1082240457'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:00.990047 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ea4854-9762-4f0e-b481-8c42fad14835 tempest-TrustsV3TestJSON-568895197 tempest-user-57504750] REQUEST_METHOD: `HEAD` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:00.990331 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ea4854-9762-4f0e-b481-8c42fad14835 tempest-TrustsV3TestJSON-568895197 tempest-user-57504750] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:00.990605 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ea4854-9762-4f0e-b481-8c42fad14835 tempest-TrustsV3TestJSON-568895197 tempest-user-57504750] PATH_INFO: `/v3/OS-TRUST/trusts/8dfb78864b21411685cd3dcb8a6d917a/roles/b07629aeab274a89b8a27bcda7f4ae32` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:00.997167 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ea4854-9762-4f0e-b481-8c42fad14835 tempest-TrustsV3TestJSON-568895197 tempest-user-57504750] RBAC: Authorizing `identity:get_role_for_trust(trust_id=8dfb78864b21411685cd3dcb8a6d917a, role_id=b07629aeab274a89b8a27bcda7f4ae32)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:00.998608 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ea4854-9762-4f0e-b481-8c42fad14835 tempest-TrustsV3TestJSON-568895197 tempest-user-57504750] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:01.007108 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2413/4862] 10.222.0.52 () {58 vars in 1368 bytes} [Sat May 14 21:30:00 2022] HEAD /identity/v3/OS-TRUST/trusts/8dfb78864b21411685cd3dcb8a6d917a/roles/b07629aeab274a89b8a27bcda7f4ae32 => generated 0 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) May 14 21:30:01.011208 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b560bdac-42b8-4991-b47a-063844676b13 tempest-TrustsV3TestJSON-568895197 tempest-user-57504750] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:01.021784 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b560bdac-42b8-4991-b47a-063844676b13 tempest-TrustsV3TestJSON-568895197 tempest-user-57504750] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:01.028469 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f83eec-3ef1-4818-ad36-048993ef0184 tempest-TrustsV3TestJSON-568895197 tempest-user-57504750] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41fdf40a05c4441681ca824209914e0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a0dd8d74c448db8e45ce198e118e02', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-90573857', 'tempest-DelegatedRole-1082240457'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:01.028469 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f83eec-3ef1-4818-ad36-048993ef0184 tempest-TrustsV3TestJSON-568895197 tempest-user-57504750] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:01.028469 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f83eec-3ef1-4818-ad36-048993ef0184 tempest-TrustsV3TestJSON-568895197 tempest-user-57504750] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:01.028862 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f83eec-3ef1-4818-ad36-048993ef0184 tempest-TrustsV3TestJSON-568895197 tempest-user-57504750] PATH_INFO: `/v3/OS-TRUST/trusts/8dfb78864b21411685cd3dcb8a6d917a/roles/f28c39b5f863479087ebdc9da190b678` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:01.035609 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f83eec-3ef1-4818-ad36-048993ef0184 tempest-TrustsV3TestJSON-568895197 tempest-user-57504750] RBAC: Authorizing `identity:get_role_for_trust(trust_id=8dfb78864b21411685cd3dcb8a6d917a, role_id=f28c39b5f863479087ebdc9da190b678)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:01.037229 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f83eec-3ef1-4818-ad36-048993ef0184 tempest-TrustsV3TestJSON-568895197 tempest-user-57504750] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:01.053073 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-92f83eec-3ef1-4818-ad36-048993ef0184 tempest-TrustsV3TestJSON-568895197 tempest-user-57504750] Could not find role: f28c39b5f863479087ebdc9da190b678.: keystone.exception.RoleNotFound: Could not find role: f28c39b5f863479087ebdc9da190b678. May 14 21:30:01.053073 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:30:01.053073 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 21:30:01.053073 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 21:30:01.053073 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 21:30:01.053073 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 21:30:01.053073 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 21:30:01.053073 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 21:30:01.053073 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 21:30:01.053073 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 21:30:01.053073 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 21:30:01.053073 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 21:30:01.053073 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get May 14 21:30:01.053073 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 21:30:01.058466 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: f28c39b5f863479087ebdc9da190b678. May 14 21:30:01.058466 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:30:01.058466 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2450/4863] 10.222.0.52 () {58 vars in 1367 bytes} [Sat May 14 21:30:01 2022] GET /identity/v3/OS-TRUST/trusts/8dfb78864b21411685cd3dcb8a6d917a/roles/f28c39b5f863479087ebdc9da190b678 => generated 110 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 14 21:30:01.060487 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ea4854-9762-4f0e-b481-8c42fad14835 tempest-TrustsV3TestJSON-568895197 tempest-user-57504750] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:01.071028 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ea4854-9762-4f0e-b481-8c42fad14835 tempest-TrustsV3TestJSON-568895197 tempest-user-57504750] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:01.075549 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2471cc-e23e-499d-b284-5f10ceeecf15 tempest-TrustsV3TestJSON-568895197 tempest-user-57504750] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41fdf40a05c4441681ca824209914e0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a0dd8d74c448db8e45ce198e118e02', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-90573857', 'tempest-DelegatedRole-1082240457'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:01.077283 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2471cc-e23e-499d-b284-5f10ceeecf15 tempest-TrustsV3TestJSON-568895197 tempest-user-57504750] REQUEST_METHOD: `HEAD` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:01.077283 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2471cc-e23e-499d-b284-5f10ceeecf15 tempest-TrustsV3TestJSON-568895197 tempest-user-57504750] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:01.077283 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2471cc-e23e-499d-b284-5f10ceeecf15 tempest-TrustsV3TestJSON-568895197 tempest-user-57504750] PATH_INFO: `/v3/OS-TRUST/trusts/8dfb78864b21411685cd3dcb8a6d917a/roles/f28c39b5f863479087ebdc9da190b678` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:01.083588 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2471cc-e23e-499d-b284-5f10ceeecf15 tempest-TrustsV3TestJSON-568895197 tempest-user-57504750] RBAC: Authorizing `identity:get_role_for_trust(trust_id=8dfb78864b21411685cd3dcb8a6d917a, role_id=f28c39b5f863479087ebdc9da190b678)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:01.085044 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2471cc-e23e-499d-b284-5f10ceeecf15 tempest-TrustsV3TestJSON-568895197 tempest-user-57504750] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:01.099139 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-2f2471cc-e23e-499d-b284-5f10ceeecf15 tempest-TrustsV3TestJSON-568895197 tempest-user-57504750] Could not find role: f28c39b5f863479087ebdc9da190b678.: keystone.exception.RoleNotFound: Could not find role: f28c39b5f863479087ebdc9da190b678. May 14 21:30:01.099139 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:30:01.099139 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 21:30:01.099139 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 21:30:01.099139 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 21:30:01.099139 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 21:30:01.099139 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 21:30:01.099139 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 21:30:01.099139 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 21:30:01.099139 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 21:30:01.099139 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 21:30:01.099139 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 21:30:01.099139 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get May 14 21:30:01.099139 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 21:30:01.100728 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: f28c39b5f863479087ebdc9da190b678. May 14 21:30:01.100728 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:30:01.100728 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2414/4864] 10.222.0.52 () {58 vars in 1368 bytes} [Sat May 14 21:30:01 2022] HEAD /identity/v3/OS-TRUST/trusts/8dfb78864b21411685cd3dcb8a6d917a/roles/f28c39b5f863479087ebdc9da190b678 => generated 0 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) May 14 21:30:01.104602 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f83eec-3ef1-4818-ad36-048993ef0184 tempest-TrustsV3TestJSON-568895197 tempest-user-57504750] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:01.115418 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f83eec-3ef1-4818-ad36-048993ef0184 tempest-TrustsV3TestJSON-568895197 tempest-user-57504750] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:01.119604 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b43b73-cea3-4dbc-aa8d-1e5def747c32 tempest-TrustsV3TestJSON-568895197 tempest-user-57504750] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41fdf40a05c4441681ca824209914e0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a0dd8d74c448db8e45ce198e118e02', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-90573857', 'tempest-DelegatedRole-1082240457'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:01.120406 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b43b73-cea3-4dbc-aa8d-1e5def747c32 tempest-TrustsV3TestJSON-568895197 tempest-user-57504750] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:01.120684 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b43b73-cea3-4dbc-aa8d-1e5def747c32 tempest-TrustsV3TestJSON-568895197 tempest-user-57504750] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:01.120957 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b43b73-cea3-4dbc-aa8d-1e5def747c32 tempest-TrustsV3TestJSON-568895197 tempest-user-57504750] PATH_INFO: `/v3/OS-TRUST/trusts/8dfb78864b21411685cd3dcb8a6d917a` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:01.127992 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b43b73-cea3-4dbc-aa8d-1e5def747c32 tempest-TrustsV3TestJSON-568895197 tempest-user-57504750] RBAC: Authorizing `identity:delete_trust(trust_id=8dfb78864b21411685cd3dcb8a6d917a)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:01.129446 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b43b73-cea3-4dbc-aa8d-1e5def747c32 tempest-TrustsV3TestJSON-568895197 tempest-user-57504750] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:01.262181 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-94b43b73-cea3-4dbc-aa8d-1e5def747c32 tempest-TrustsV3TestJSON-568895197 tempest-user-57504750] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '8dfb78864b21411685cd3dcb8a6d917a', 'request_id': 'req-94b43b73-cea3-4dbc-aa8d-1e5def747c32'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:01.263187 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-94b43b73-cea3-4dbc-aa8d-1e5def747c32 tempest-TrustsV3TestJSON-568895197 tempest-user-57504750] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '8dfb78864b21411685cd3dcb8a6d917a', 'request_id': 'req-94b43b73-cea3-4dbc-aa8d-1e5def747c32'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:01.400593 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-94b43b73-cea3-4dbc-aa8d-1e5def747c32 tempest-TrustsV3TestJSON-568895197 tempest-user-57504750] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '8dfb78864b21411685cd3dcb8a6d917a', 'request_id': 'req-94b43b73-cea3-4dbc-aa8d-1e5def747c32'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:01.408271 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2451/4865] 10.222.0.52 () {58 vars in 1253 bytes} [Sat May 14 21:30:01 2022] DELETE /identity/v3/OS-TRUST/trusts/8dfb78864b21411685cd3dcb8a6d917a => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:30:01.412432 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2471cc-e23e-499d-b284-5f10ceeecf15 tempest-TrustsV3TestJSON-568895197 tempest-user-57504750] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:01.414143 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-2f2471cc-e23e-499d-b284-5f10ceeecf15 tempest-TrustsV3TestJSON-568895197 tempest-user-57504750] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:01.431364 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2471cc-e23e-499d-b284-5f10ceeecf15 tempest-TrustsV3TestJSON-568895197 tempest-user-57504750] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:01.435618 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d26b90-447b-4df7-9ca2-2f92504f6649 tempest-TrustsV3TestJSON-568895197 tempest-user-57504750] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41fdf40a05c4441681ca824209914e0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a0dd8d74c448db8e45ce198e118e02', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-90573857', 'tempest-DelegatedRole-1082240457'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:01.436437 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d26b90-447b-4df7-9ca2-2f92504f6649 tempest-TrustsV3TestJSON-568895197 tempest-user-57504750] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:01.436718 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d26b90-447b-4df7-9ca2-2f92504f6649 tempest-TrustsV3TestJSON-568895197 tempest-user-57504750] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:01.437062 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d26b90-447b-4df7-9ca2-2f92504f6649 tempest-TrustsV3TestJSON-568895197 tempest-user-57504750] PATH_INFO: `/v3/OS-TRUST/trusts/8dfb78864b21411685cd3dcb8a6d917a` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:01.450214 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-14d26b90-447b-4df7-9ca2-2f92504f6649 tempest-TrustsV3TestJSON-568895197 tempest-user-57504750] Could not find trust: 8dfb78864b21411685cd3dcb8a6d917a.: keystone.exception.TrustNotFound: Could not find trust: 8dfb78864b21411685cd3dcb8a6d917a. May 14 21:30:01.450214 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:30:01.450214 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 21:30:01.450214 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 21:30:01.450214 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 21:30:01.450214 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 21:30:01.450214 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 21:30:01.450214 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 21:30:01.450214 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 21:30:01.450214 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 21:30:01.450214 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 21:30:01.450214 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 21:30:01.450214 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get May 14 21:30:01.450214 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) May 14 21:30:01.450214 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust May 14 21:30:01.451697 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', May 14 21:30:01.451697 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call May 14 21:30:01.451697 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() May 14 21:30:01.451697 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement May 14 21:30:01.451697 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( May 14 21:30:01.451697 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 21:30:01.451697 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 21:30:01.451697 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust May 14 21:30:01.451697 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) May 14 21:30:01.451697 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust May 14 21:30:01.451697 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) May 14 21:30:01.451697 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 8dfb78864b21411685cd3dcb8a6d917a. May 14 21:30:01.451697 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:30:01.453333 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2415/4866] 10.222.0.52 () {58 vars in 1250 bytes} [Sat May 14 21:30:01 2022] GET /identity/v3/OS-TRUST/trusts/8dfb78864b21411685cd3dcb8a6d917a => generated 111 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 14 21:30:01.457456 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b43b73-cea3-4dbc-aa8d-1e5def747c32 tempest-TrustsV3TestJSON-568895197 tempest-user-57504750] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:01.460121 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-94b43b73-cea3-4dbc-aa8d-1e5def747c32 tempest-TrustsV3TestJSON-568895197 tempest-user-57504750] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:01.478121 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b43b73-cea3-4dbc-aa8d-1e5def747c32 tempest-TrustsV3TestJSON-568895197 tempest-user-57504750] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:01.482895 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fe9206-cabf-447e-8a3f-2f1e41fb8268 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16df42e793ed46c8b39b78b4a4821bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1997fca61bf6406d83c93f3f98a79a84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:01.484563 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe9206-cabf-447e-8a3f-2f1e41fb8268 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:01.485082 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe9206-cabf-447e-8a3f-2f1e41fb8268 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:01.485543 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe9206-cabf-447e-8a3f-2f1e41fb8268 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] PATH_INFO: `/v3/roles/f28c39b5f863479087ebdc9da190b678` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:01.488326 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fe9206-cabf-447e-8a3f-2f1e41fb8268 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorizing `identity:delete_role(role_id=f28c39b5f863479087ebdc9da190b678)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:01.495947 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fe9206-cabf-447e-8a3f-2f1e41fb8268 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:01.667910 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-95fe9206-cabf-447e-8a3f-2f1e41fb8268 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invalidating the token cache because role f28c39b5f863479087ebdc9da190b678 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:30:01.668156 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-95fe9206-cabf-447e-8a3f-2f1e41fb8268 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:01.668881 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-95fe9206-cabf-447e-8a3f-2f1e41fb8268 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:01.670961 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2452/4867] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:30:01 2022] DELETE /identity/v3/roles/f28c39b5f863479087ebdc9da190b678 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:30:01.675097 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d26b90-447b-4df7-9ca2-2f92504f6649 tempest-TrustsV3TestJSON-568895197 tempest-user-57504750] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:01.676872 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-14d26b90-447b-4df7-9ca2-2f92504f6649 tempest-TrustsV3TestJSON-568895197 tempest-user-57504750] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:01.692535 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d26b90-447b-4df7-9ca2-2f92504f6649 tempest-TrustsV3TestJSON-568895197 tempest-user-57504750] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:01.756510 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d256d-ac89-4ca4-bc02-c2aa1c782825 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16df42e793ed46c8b39b78b4a4821bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1997fca61bf6406d83c93f3f98a79a84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:01.757555 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d256d-ac89-4ca4-bc02-c2aa1c782825 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:01.757992 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d256d-ac89-4ca4-bc02-c2aa1c782825 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:01.758357 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d256d-ac89-4ca4-bc02-c2aa1c782825 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] PATH_INFO: `/v3/roles/b07629aeab274a89b8a27bcda7f4ae32` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:01.765873 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922d256d-ac89-4ca4-bc02-c2aa1c782825 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorizing `identity:delete_role(role_id=b07629aeab274a89b8a27bcda7f4ae32)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:01.765873 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922d256d-ac89-4ca4-bc02-c2aa1c782825 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:01.949516 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-922d256d-ac89-4ca4-bc02-c2aa1c782825 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invalidating the token cache because role b07629aeab274a89b8a27bcda7f4ae32 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:30:01.950226 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-922d256d-ac89-4ca4-bc02-c2aa1c782825 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:01.950512 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-922d256d-ac89-4ca4-bc02-c2aa1c782825 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:01.952443 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2416/4868] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:30:01 2022] DELETE /identity/v3/roles/b07629aeab274a89b8a27bcda7f4ae32 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:30:01.956869 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fe9206-cabf-447e-8a3f-2f1e41fb8268 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:01.968581 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fe9206-cabf-447e-8a3f-2f1e41fb8268 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:02.027568 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c07ee1f-2ad4-4328-b676-7cbdb5376789 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16df42e793ed46c8b39b78b4a4821bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1997fca61bf6406d83c93f3f98a79a84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:02.028424 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07ee1f-2ad4-4328-b676-7cbdb5376789 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:02.028692 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07ee1f-2ad4-4328-b676-7cbdb5376789 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:02.028970 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07ee1f-2ad4-4328-b676-7cbdb5376789 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] PATH_INFO: `/v3/users/41fdf40a05c4441681ca824209914e0b` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:02.030168 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c07ee1f-2ad4-4328-b676-7cbdb5376789 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorizing `identity:delete_user(user_id=41fdf40a05c4441681ca824209914e0b)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:02.032744 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c07ee1f-2ad4-4328-b676-7cbdb5376789 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:02.165377 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8c07ee1f-2ad4-4328-b676-7cbdb5376789 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41fdf40a05c4441681ca824209914e0b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:02.178766 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8c07ee1f-2ad4-4328-b676-7cbdb5376789 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41fdf40a05c4441681ca824209914e0b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:02.186071 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8c07ee1f-2ad4-4328-b676-7cbdb5376789 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41fdf40a05c4441681ca824209914e0b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:02.307263 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8c07ee1f-2ad4-4328-b676-7cbdb5376789 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41fdf40a05c4441681ca824209914e0b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:02.308164 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8c07ee1f-2ad4-4328-b676-7cbdb5376789 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41fdf40a05c4441681ca824209914e0b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:02.315669 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2453/4869] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:30:01 2022] DELETE /identity/v3/users/41fdf40a05c4441681ca824209914e0b => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:30:02.322754 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d256d-ac89-4ca4-bc02-c2aa1c782825 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:02.322754 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-922d256d-ac89-4ca4-bc02-c2aa1c782825 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:02.337146 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d256d-ac89-4ca4-bc02-c2aa1c782825 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:02.406877 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf045a-9612-4e3f-a73e-b5d029d06c59 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16df42e793ed46c8b39b78b4a4821bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1997fca61bf6406d83c93f3f98a79a84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:02.408402 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf045a-9612-4e3f-a73e-b5d029d06c59 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:02.408876 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf045a-9612-4e3f-a73e-b5d029d06c59 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:02.409365 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf045a-9612-4e3f-a73e-b5d029d06c59 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] PATH_INFO: `/v3/projects/05a0dd8d74c448db8e45ce198e118e02` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:02.411303 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edf045a-9612-4e3f-a73e-b5d029d06c59 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorizing `identity:delete_project(project_id=05a0dd8d74c448db8e45ce198e118e02)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:02.414292 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edf045a-9612-4e3f-a73e-b5d029d06c59 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:02.707292 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7edf045a-9612-4e3f-a73e-b5d029d06c59 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05a0dd8d74c448db8e45ce198e118e02', 'request_id': 'req-7edf045a-9612-4e3f-a73e-b5d029d06c59'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:02.712968 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7edf045a-9612-4e3f-a73e-b5d029d06c59 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05a0dd8d74c448db8e45ce198e118e02', 'request_id': 'req-7edf045a-9612-4e3f-a73e-b5d029d06c59'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:02.719872 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7edf045a-9612-4e3f-a73e-b5d029d06c59 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05a0dd8d74c448db8e45ce198e118e02', 'request_id': 'req-7edf045a-9612-4e3f-a73e-b5d029d06c59'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:02.777029 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7edf045a-9612-4e3f-a73e-b5d029d06c59 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] The token cache is being invalidate because project 05a0dd8d74c448db8e45ce198e118e02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:30:02.777545 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7edf045a-9612-4e3f-a73e-b5d029d06c59 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:02.778327 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7edf045a-9612-4e3f-a73e-b5d029d06c59 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:02.785330 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2417/4870] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:30:02 2022] DELETE /identity/v3/projects/05a0dd8d74c448db8e45ce198e118e02 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:30:02.787801 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c07ee1f-2ad4-4328-b676-7cbdb5376789 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:02.789833 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-8c07ee1f-2ad4-4328-b676-7cbdb5376789 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:02.805987 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c07ee1f-2ad4-4328-b676-7cbdb5376789 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:02.864017 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74730afd-6b84-4544-bdca-bad58e4dcadf tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16df42e793ed46c8b39b78b4a4821bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1997fca61bf6406d83c93f3f98a79a84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:02.864696 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74730afd-6b84-4544-bdca-bad58e4dcadf tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:02.864985 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74730afd-6b84-4544-bdca-bad58e4dcadf tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:02.865264 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74730afd-6b84-4544-bdca-bad58e4dcadf tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:02.865960 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74730afd-6b84-4544-bdca-bad58e4dcadf tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:02.867952 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74730afd-6b84-4544-bdca-bad58e4dcadf tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:03.014170 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2454/4871] 10.222.0.52 () {60 vars in 1151 bytes} [Sat May 14 21:30:02 2022] POST /identity/v3/projects => generated 329 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:30:03.018913 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf045a-9612-4e3f-a73e-b5d029d06c59 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:03.020526 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-7edf045a-9612-4e3f-a73e-b5d029d06c59 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:03.037163 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf045a-9612-4e3f-a73e-b5d029d06c59 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:03.100848 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fad73f6-0d9f-49c0-a31f-ae1944acf921 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16df42e793ed46c8b39b78b4a4821bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1997fca61bf6406d83c93f3f98a79a84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:03.101532 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad73f6-0d9f-49c0-a31f-ae1944acf921 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:03.101819 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad73f6-0d9f-49c0-a31f-ae1944acf921 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:03.102097 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad73f6-0d9f-49c0-a31f-ae1944acf921 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:03.102808 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fad73f6-0d9f-49c0-a31f-ae1944acf921 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:03.104836 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fad73f6-0d9f-49c0-a31f-ae1944acf921 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:03.185196 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2418/4872] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:30:03 2022] POST /identity/v3/users => generated 413 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:30:03.189709 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74730afd-6b84-4544-bdca-bad58e4dcadf tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:03.215416 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74730afd-6b84-4544-bdca-bad58e4dcadf tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:03.221787 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdc3138-e678-4b42-8183-3768b1646f16 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16df42e793ed46c8b39b78b4a4821bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1997fca61bf6406d83c93f3f98a79a84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:03.224861 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc3138-e678-4b42-8183-3768b1646f16 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:03.224861 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc3138-e678-4b42-8183-3768b1646f16 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:03.224861 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc3138-e678-4b42-8183-3768b1646f16 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:03.224861 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdc3138-e678-4b42-8183-3768b1646f16 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:03.225806 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdc3138-e678-4b42-8183-3768b1646f16 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:03.293377 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2455/4873] 10.222.0.52 () {60 vars in 1142 bytes} [Sat May 14 21:30:03 2022] POST /identity/v3/roles => generated 243 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:30:03.297356 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fad73f6-0d9f-49c0-a31f-ae1944acf921 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:03.310891 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fad73f6-0d9f-49c0-a31f-ae1944acf921 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:03.318846 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629e23e7-b844-4c8e-bb5b-56989688b93f tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16df42e793ed46c8b39b78b4a4821bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1997fca61bf6406d83c93f3f98a79a84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:03.319595 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e23e7-b844-4c8e-bb5b-56989688b93f tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:03.322367 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e23e7-b844-4c8e-bb5b-56989688b93f tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:03.322367 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e23e7-b844-4c8e-bb5b-56989688b93f tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:03.322367 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629e23e7-b844-4c8e-bb5b-56989688b93f tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:03.322679 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629e23e7-b844-4c8e-bb5b-56989688b93f tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:03.448894 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2419/4874] 10.222.0.52 () {60 vars in 1142 bytes} [Sat May 14 21:30:03 2022] POST /identity/v3/roles => generated 246 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:30:03.453297 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdc3138-e678-4b42-8183-3768b1646f16 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:03.464819 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdc3138-e678-4b42-8183-3768b1646f16 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:03.471533 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c129e50c-c50d-4499-a5cf-cda7e9ceada0 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16df42e793ed46c8b39b78b4a4821bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1997fca61bf6406d83c93f3f98a79a84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:03.473322 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c129e50c-c50d-4499-a5cf-cda7e9ceada0 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:03.473728 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c129e50c-c50d-4499-a5cf-cda7e9ceada0 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:03.474121 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c129e50c-c50d-4499-a5cf-cda7e9ceada0 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] PATH_INFO: `/v3/projects/8a0df7b801be4c13aea579d307f8b883/users/b9116af4e5fc4ad6bd52938038d39837/roles/96d7841394ae4be899dec07c22c2d06d` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:03.492413 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c129e50c-c50d-4499-a5cf-cda7e9ceada0 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorizing `identity:create_grant(project_id=8a0df7b801be4c13aea579d307f8b883, user_id=b9116af4e5fc4ad6bd52938038d39837, role_id=96d7841394ae4be899dec07c22c2d06d)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:03.496167 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c129e50c-c50d-4499-a5cf-cda7e9ceada0 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:03.577833 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2456/4875] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:30:03 2022] PUT /identity/v3/projects/8a0df7b801be4c13aea579d307f8b883/users/b9116af4e5fc4ad6bd52938038d39837/roles/96d7841394ae4be899dec07c22c2d06d => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:30:03.582349 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629e23e7-b844-4c8e-bb5b-56989688b93f tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:03.592871 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629e23e7-b844-4c8e-bb5b-56989688b93f tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:03.652139 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b61f1f-4146-4e1d-9ed3-8e7654bdf6a1 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16df42e793ed46c8b39b78b4a4821bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1997fca61bf6406d83c93f3f98a79a84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:03.653167 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b61f1f-4146-4e1d-9ed3-8e7654bdf6a1 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:03.653578 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b61f1f-4146-4e1d-9ed3-8e7654bdf6a1 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:03.653866 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b61f1f-4146-4e1d-9ed3-8e7654bdf6a1 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] PATH_INFO: `/v3/projects/8a0df7b801be4c13aea579d307f8b883/users/b9116af4e5fc4ad6bd52938038d39837/roles/ac4669f41fba42b3be17ef946bb79626` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:03.656798 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b61f1f-4146-4e1d-9ed3-8e7654bdf6a1 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorizing `identity:create_grant(project_id=8a0df7b801be4c13aea579d307f8b883, user_id=b9116af4e5fc4ad6bd52938038d39837, role_id=ac4669f41fba42b3be17ef946bb79626)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:03.659706 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b61f1f-4146-4e1d-9ed3-8e7654bdf6a1 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:03.721663 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2420/4876] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:30:03 2022] PUT /identity/v3/projects/8a0df7b801be4c13aea579d307f8b883/users/b9116af4e5fc4ad6bd52938038d39837/roles/ac4669f41fba42b3be17ef946bb79626 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:30:03.725823 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c129e50c-c50d-4499-a5cf-cda7e9ceada0 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:03.739715 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c129e50c-c50d-4499-a5cf-cda7e9ceada0 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:03.810956 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb812080-2fdc-4a16-824a-d9a24df49039 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16df42e793ed46c8b39b78b4a4821bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1997fca61bf6406d83c93f3f98a79a84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:03.812494 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb812080-2fdc-4a16-824a-d9a24df49039 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:03.812494 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb812080-2fdc-4a16-824a-d9a24df49039 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:03.812494 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb812080-2fdc-4a16-824a-d9a24df49039 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:03.813134 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb812080-2fdc-4a16-824a-d9a24df49039 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:03.814982 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb812080-2fdc-4a16-824a-d9a24df49039 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:03.848731 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2457/4877] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:30:03 2022] GET /identity/v3/users => generated 8633 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:30:03.854150 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fda238-3d34-43b2-84e0-aa8fce37d777 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:03.854526 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fda238-3d34-43b2-84e0-aa8fce37d777 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:03.854872 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fda238-3d34-43b2-84e0-aa8fce37d777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:03.895996 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-79fda238-3d34-43b2-84e0-aa8fce37d777 None None] MFA Rules not processed for user `b9116af4e5fc4ad6bd52938038d39837`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:30:03.897269 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-79fda238-3d34-43b2-84e0-aa8fce37d777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:03.980751 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2421/4878] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:30:03 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:30:03.991131 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc2676e-4f66-4398-8dc2-68791db46938 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:03.991425 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc2676e-4f66-4398-8dc2-68791db46938 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:03.991792 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc2676e-4f66-4398-8dc2-68791db46938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:04.010147 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-2cc2676e-4f66-4398-8dc2-68791db46938 None None] MFA Rules not processed for user `b9116af4e5fc4ad6bd52938038d39837`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:30:04.011574 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-2cc2676e-4f66-4398-8dc2-68791db46938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:04.021994 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2458/4879] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:30:03 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:30:04.026428 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fda238-3d34-43b2-84e0-aa8fce37d777 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:04.038018 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fda238-3d34-43b2-84e0-aa8fce37d777 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:04.043630 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bb25d2-520e-41b2-a57c-3e03707c878a tempest-TrustsV3TestJSON-1674208260 tempest-user-676591534] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9116af4e5fc4ad6bd52938038d39837', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0df7b801be4c13aea579d307f8b883', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-952137911', 'tempest-NotDelegatedRole-918688660'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:04.044296 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb25d2-520e-41b2-a57c-3e03707c878a tempest-TrustsV3TestJSON-1674208260 tempest-user-676591534] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:04.044734 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb25d2-520e-41b2-a57c-3e03707c878a tempest-TrustsV3TestJSON-1674208260 tempest-user-676591534] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:04.045021 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb25d2-520e-41b2-a57c-3e03707c878a tempest-TrustsV3TestJSON-1674208260 tempest-user-676591534] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:04.046072 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bb25d2-520e-41b2-a57c-3e03707c878a tempest-TrustsV3TestJSON-1674208260 tempest-user-676591534] RBAC: Authorizing `identity:create_trust()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:04.047288 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bb25d2-520e-41b2-a57c-3e03707c878a tempest-TrustsV3TestJSON-1674208260 tempest-user-676591534] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:04.128409 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-91bb25d2-520e-41b2-a57c-3e03707c878a tempest-TrustsV3TestJSON-1674208260 tempest-user-676591534] Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. May 14 21:30:04.128409 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:30:04.128409 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 67, in parse_isotime May 14 21:30:04.128409 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return iso8601.parse_date(timestr) May 14 21:30:04.128409 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/iso8601/iso8601.py", line 127, in parse_date May 14 21:30:04.128409 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise ParseError(f"Unable to parse date string {datestring!r}") May 14 21:30:04.128409 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application iso8601.iso8601.ParseError: Unable to parse date string 'bad.123Z' May 14 21:30:04.128409 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:30:04.128409 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 21:30:04.128409 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:30:04.128409 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:30:04.128409 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 346, in parse_expiration_date May 14 21:30:04.128409 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application expiration_time = timeutils.parse_isotime(expiration_date) May 14 21:30:04.128409 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 69, in parse_isotime May 14 21:30:04.129684 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise ValueError(str(e)) May 14 21:30:04.129684 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ValueError: Unable to parse date string 'bad.123Z' May 14 21:30:04.129684 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:30:04.129684 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 21:30:04.129684 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:30:04.129684 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:30:04.129684 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 21:30:04.129684 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 21:30:04.129684 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 21:30:04.129684 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 21:30:04.129684 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 21:30:04.129684 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 21:30:04.129684 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 21:30:04.129684 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 21:30:04.129684 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 21:30:04.129684 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 21:30:04.129684 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 296, in post May 14 21:30:04.129684 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application trust['expires_at'] = self._parse_expiration_date( May 14 21:30:04.131024 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 127, in _parse_expiration_date May 14 21:30:04.131024 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return utils.parse_expiration_date(expiration_date) May 14 21:30:04.131024 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 348, in parse_expiration_date May 14 21:30:04.131024 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.ValidationTimeStampError() May 14 21:30:04.131024 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. May 14 21:30:04.131024 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:30:04.131024 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2422/4880] 10.222.0.52 () {60 vars in 1173 bytes} [Sat May 14 21:30:04 2022] POST /identity/v3/OS-TRUST/trusts => generated 227 bytes in 104 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) May 14 21:30:04.134316 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc2676e-4f66-4398-8dc2-68791db46938 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:04.148667 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc2676e-4f66-4398-8dc2-68791db46938 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:04.159959 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c300f4b2-1b3e-4ad8-8cc3-0bef889b1ab6 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16df42e793ed46c8b39b78b4a4821bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1997fca61bf6406d83c93f3f98a79a84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:04.159959 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300f4b2-1b3e-4ad8-8cc3-0bef889b1ab6 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:04.159959 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300f4b2-1b3e-4ad8-8cc3-0bef889b1ab6 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:04.160314 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300f4b2-1b3e-4ad8-8cc3-0bef889b1ab6 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] PATH_INFO: `/v3/roles/ac4669f41fba42b3be17ef946bb79626` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:04.160314 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c300f4b2-1b3e-4ad8-8cc3-0bef889b1ab6 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorizing `identity:delete_role(role_id=ac4669f41fba42b3be17ef946bb79626)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:04.160314 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c300f4b2-1b3e-4ad8-8cc3-0bef889b1ab6 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:04.336861 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c300f4b2-1b3e-4ad8-8cc3-0bef889b1ab6 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invalidating the token cache because role ac4669f41fba42b3be17ef946bb79626 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:30:04.337124 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c300f4b2-1b3e-4ad8-8cc3-0bef889b1ab6 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:04.337795 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c300f4b2-1b3e-4ad8-8cc3-0bef889b1ab6 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:04.340268 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2459/4881] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:30:04 2022] DELETE /identity/v3/roles/ac4669f41fba42b3be17ef946bb79626 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:30:04.345218 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bb25d2-520e-41b2-a57c-3e03707c878a tempest-TrustsV3TestJSON-1674208260 tempest-user-676591534] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:04.346888 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-91bb25d2-520e-41b2-a57c-3e03707c878a tempest-TrustsV3TestJSON-1674208260 tempest-user-676591534] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:04.362306 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bb25d2-520e-41b2-a57c-3e03707c878a tempest-TrustsV3TestJSON-1674208260 tempest-user-676591534] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:04.419359 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc4e5c-b506-4a52-9b0b-aeb283a2fddd tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16df42e793ed46c8b39b78b4a4821bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1997fca61bf6406d83c93f3f98a79a84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:04.420281 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc4e5c-b506-4a52-9b0b-aeb283a2fddd tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:04.420580 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc4e5c-b506-4a52-9b0b-aeb283a2fddd tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:04.420849 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc4e5c-b506-4a52-9b0b-aeb283a2fddd tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] PATH_INFO: `/v3/roles/96d7841394ae4be899dec07c22c2d06d` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:04.422451 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadc4e5c-b506-4a52-9b0b-aeb283a2fddd tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorizing `identity:delete_role(role_id=96d7841394ae4be899dec07c22c2d06d)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:04.424128 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadc4e5c-b506-4a52-9b0b-aeb283a2fddd tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:04.617352 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-aadc4e5c-b506-4a52-9b0b-aeb283a2fddd tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invalidating the token cache because role 96d7841394ae4be899dec07c22c2d06d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:30:04.617648 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-aadc4e5c-b506-4a52-9b0b-aeb283a2fddd tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:04.618323 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-aadc4e5c-b506-4a52-9b0b-aeb283a2fddd tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:04.620646 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2423/4882] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:30:04 2022] DELETE /identity/v3/roles/96d7841394ae4be899dec07c22c2d06d => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:30:04.624755 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c300f4b2-1b3e-4ad8-8cc3-0bef889b1ab6 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:04.636358 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c300f4b2-1b3e-4ad8-8cc3-0bef889b1ab6 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:04.726223 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5974a1-adc8-481c-9ba2-aff7c550419f tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16df42e793ed46c8b39b78b4a4821bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1997fca61bf6406d83c93f3f98a79a84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:04.727149 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5974a1-adc8-481c-9ba2-aff7c550419f tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:04.727425 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5974a1-adc8-481c-9ba2-aff7c550419f tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:04.727729 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5974a1-adc8-481c-9ba2-aff7c550419f tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] PATH_INFO: `/v3/users/b9116af4e5fc4ad6bd52938038d39837` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:04.728976 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5974a1-adc8-481c-9ba2-aff7c550419f tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b9116af4e5fc4ad6bd52938038d39837)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:04.731040 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5974a1-adc8-481c-9ba2-aff7c550419f tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:04.843669 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0d5974a1-adc8-481c-9ba2-aff7c550419f tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9116af4e5fc4ad6bd52938038d39837'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:04.859982 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0d5974a1-adc8-481c-9ba2-aff7c550419f tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9116af4e5fc4ad6bd52938038d39837'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:04.867846 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0d5974a1-adc8-481c-9ba2-aff7c550419f tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9116af4e5fc4ad6bd52938038d39837'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:04.931505 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0d5974a1-adc8-481c-9ba2-aff7c550419f tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9116af4e5fc4ad6bd52938038d39837'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:04.932149 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0d5974a1-adc8-481c-9ba2-aff7c550419f tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9116af4e5fc4ad6bd52938038d39837'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:04.938667 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2460/4883] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:30:04 2022] DELETE /identity/v3/users/b9116af4e5fc4ad6bd52938038d39837 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:30:04.944858 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc4e5c-b506-4a52-9b0b-aeb283a2fddd tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:04.944858 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-aadc4e5c-b506-4a52-9b0b-aeb283a2fddd tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:04.962187 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc4e5c-b506-4a52-9b0b-aeb283a2fddd tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:05.050113 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b876e968-db39-4208-a91d-9674a222148f tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16df42e793ed46c8b39b78b4a4821bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1997fca61bf6406d83c93f3f98a79a84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:05.050914 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876e968-db39-4208-a91d-9674a222148f tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:05.051204 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876e968-db39-4208-a91d-9674a222148f tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:05.051501 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876e968-db39-4208-a91d-9674a222148f tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] PATH_INFO: `/v3/projects/8a0df7b801be4c13aea579d307f8b883` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:05.052739 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b876e968-db39-4208-a91d-9674a222148f tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8a0df7b801be4c13aea579d307f8b883)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:05.054687 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b876e968-db39-4208-a91d-9674a222148f tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:05.205550 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b876e968-db39-4208-a91d-9674a222148f tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a0df7b801be4c13aea579d307f8b883', 'request_id': 'req-b876e968-db39-4208-a91d-9674a222148f'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:05.219688 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b876e968-db39-4208-a91d-9674a222148f tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a0df7b801be4c13aea579d307f8b883', 'request_id': 'req-b876e968-db39-4208-a91d-9674a222148f'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:05.225969 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b876e968-db39-4208-a91d-9674a222148f tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a0df7b801be4c13aea579d307f8b883', 'request_id': 'req-b876e968-db39-4208-a91d-9674a222148f'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:05.291197 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b876e968-db39-4208-a91d-9674a222148f tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] The token cache is being invalidate because project 8a0df7b801be4c13aea579d307f8b883 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:30:05.291551 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b876e968-db39-4208-a91d-9674a222148f tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:05.292250 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b876e968-db39-4208-a91d-9674a222148f tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:05.294070 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2424/4884] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:30:04 2022] DELETE /identity/v3/projects/8a0df7b801be4c13aea579d307f8b883 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:30:05.299964 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5974a1-adc8-481c-9ba2-aff7c550419f tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:05.301567 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-0d5974a1-adc8-481c-9ba2-aff7c550419f tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:05.317141 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5974a1-adc8-481c-9ba2-aff7c550419f tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:05.387623 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd973ef-a48e-487e-9753-3462f6db82fc tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16df42e793ed46c8b39b78b4a4821bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1997fca61bf6406d83c93f3f98a79a84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:05.388601 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd973ef-a48e-487e-9753-3462f6db82fc tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:05.389068 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd973ef-a48e-487e-9753-3462f6db82fc tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:05.389533 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd973ef-a48e-487e-9753-3462f6db82fc tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:05.390651 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd973ef-a48e-487e-9753-3462f6db82fc tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:05.393121 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd973ef-a48e-487e-9753-3462f6db82fc tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:05.560833 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2461/4885] 10.222.0.52 () {60 vars in 1151 bytes} [Sat May 14 21:30:05 2022] POST /identity/v3/projects => generated 329 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:30:05.565773 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b876e968-db39-4208-a91d-9674a222148f tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:05.567189 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b876e968-db39-4208-a91d-9674a222148f tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:05.580254 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b876e968-db39-4208-a91d-9674a222148f tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:05.642665 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d60ad3-6273-434b-8899-9bc81701afc5 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16df42e793ed46c8b39b78b4a4821bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1997fca61bf6406d83c93f3f98a79a84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:05.642918 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d60ad3-6273-434b-8899-9bc81701afc5 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:05.643190 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d60ad3-6273-434b-8899-9bc81701afc5 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:05.643462 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d60ad3-6273-434b-8899-9bc81701afc5 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:05.644206 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d60ad3-6273-434b-8899-9bc81701afc5 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:05.646137 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d60ad3-6273-434b-8899-9bc81701afc5 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:05.750994 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2425/4886] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:30:05 2022] POST /identity/v3/users => generated 416 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:30:05.758958 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd973ef-a48e-487e-9753-3462f6db82fc tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:05.776560 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd973ef-a48e-487e-9753-3462f6db82fc tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:05.783031 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e137abc-38be-4554-aff3-9728b6e6b293 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16df42e793ed46c8b39b78b4a4821bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1997fca61bf6406d83c93f3f98a79a84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:05.783990 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e137abc-38be-4554-aff3-9728b6e6b293 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:05.784491 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e137abc-38be-4554-aff3-9728b6e6b293 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:05.785004 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e137abc-38be-4554-aff3-9728b6e6b293 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:05.785749 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e137abc-38be-4554-aff3-9728b6e6b293 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:05.787344 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e137abc-38be-4554-aff3-9728b6e6b293 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:05.887622 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2462/4887] 10.222.0.52 () {60 vars in 1142 bytes} [Sat May 14 21:30:05 2022] POST /identity/v3/roles => generated 243 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:30:05.892518 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d60ad3-6273-434b-8899-9bc81701afc5 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:05.903260 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d60ad3-6273-434b-8899-9bc81701afc5 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:05.909259 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6ee828-2a4e-4a63-a09e-0b610eed7948 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16df42e793ed46c8b39b78b4a4821bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1997fca61bf6406d83c93f3f98a79a84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:05.913073 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ee828-2a4e-4a63-a09e-0b610eed7948 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:05.913073 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ee828-2a4e-4a63-a09e-0b610eed7948 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:05.913073 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ee828-2a4e-4a63-a09e-0b610eed7948 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:05.913073 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6ee828-2a4e-4a63-a09e-0b610eed7948 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:05.913073 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6ee828-2a4e-4a63-a09e-0b610eed7948 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:06.040920 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2426/4888] 10.222.0.52 () {60 vars in 1142 bytes} [Sat May 14 21:30:05 2022] POST /identity/v3/roles => generated 246 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:30:06.045296 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e137abc-38be-4554-aff3-9728b6e6b293 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:06.056681 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e137abc-38be-4554-aff3-9728b6e6b293 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:06.061415 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd41e2-0f8e-4178-9b2f-92fa3a2fa41b tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16df42e793ed46c8b39b78b4a4821bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1997fca61bf6406d83c93f3f98a79a84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:06.062282 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd41e2-0f8e-4178-9b2f-92fa3a2fa41b tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:06.062654 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd41e2-0f8e-4178-9b2f-92fa3a2fa41b tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:06.063737 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd41e2-0f8e-4178-9b2f-92fa3a2fa41b tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] PATH_INFO: `/v3/projects/de9c8498d45a4d84b618f02fa4c3c594/users/2ebf973246eb41618e8931d41cebed41/roles/c94643021b8248089a9688e1a6c56d40` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:06.080302 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbd41e2-0f8e-4178-9b2f-92fa3a2fa41b tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorizing `identity:create_grant(project_id=de9c8498d45a4d84b618f02fa4c3c594, user_id=2ebf973246eb41618e8931d41cebed41, role_id=c94643021b8248089a9688e1a6c56d40)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:06.083381 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbd41e2-0f8e-4178-9b2f-92fa3a2fa41b tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:06.151525 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2463/4889] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:30:06 2022] PUT /identity/v3/projects/de9c8498d45a4d84b618f02fa4c3c594/users/2ebf973246eb41618e8931d41cebed41/roles/c94643021b8248089a9688e1a6c56d40 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:30:06.155994 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6ee828-2a4e-4a63-a09e-0b610eed7948 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:06.167701 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6ee828-2a4e-4a63-a09e-0b610eed7948 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:06.235380 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7940c303-d128-493a-8f85-0b0a1f730b0e tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16df42e793ed46c8b39b78b4a4821bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1997fca61bf6406d83c93f3f98a79a84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:06.236343 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940c303-d128-493a-8f85-0b0a1f730b0e tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:06.236626 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940c303-d128-493a-8f85-0b0a1f730b0e tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:06.237073 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940c303-d128-493a-8f85-0b0a1f730b0e tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] PATH_INFO: `/v3/projects/de9c8498d45a4d84b618f02fa4c3c594/users/2ebf973246eb41618e8931d41cebed41/roles/a50729297e9f46138a1dea6cd55e3df9` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:06.239601 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7940c303-d128-493a-8f85-0b0a1f730b0e tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorizing `identity:create_grant(project_id=de9c8498d45a4d84b618f02fa4c3c594, user_id=2ebf973246eb41618e8931d41cebed41, role_id=a50729297e9f46138a1dea6cd55e3df9)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:06.242405 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7940c303-d128-493a-8f85-0b0a1f730b0e tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:06.393894 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2427/4890] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:30:06 2022] PUT /identity/v3/projects/de9c8498d45a4d84b618f02fa4c3c594/users/2ebf973246eb41618e8931d41cebed41/roles/a50729297e9f46138a1dea6cd55e3df9 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:30:06.397885 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd41e2-0f8e-4178-9b2f-92fa3a2fa41b tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:06.409231 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd41e2-0f8e-4178-9b2f-92fa3a2fa41b tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:06.464589 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b148df73-57e5-4c4b-94a0-c6027d89a549 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16df42e793ed46c8b39b78b4a4821bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1997fca61bf6406d83c93f3f98a79a84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:06.472232 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b148df73-57e5-4c4b-94a0-c6027d89a549 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:06.472232 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b148df73-57e5-4c4b-94a0-c6027d89a549 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:06.472232 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b148df73-57e5-4c4b-94a0-c6027d89a549 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:06.472232 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b148df73-57e5-4c4b-94a0-c6027d89a549 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:06.472232 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b148df73-57e5-4c4b-94a0-c6027d89a549 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:06.512257 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2464/4891] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:30:06 2022] GET /identity/v3/users => generated 8636 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:30:06.519197 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a84d0-15e9-4e3c-93f1-f31219c414b8 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:06.520985 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a84d0-15e9-4e3c-93f1-f31219c414b8 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:06.521265 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a84d0-15e9-4e3c-93f1-f31219c414b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:06.567076 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-6d0a84d0-15e9-4e3c-93f1-f31219c414b8 None None] MFA Rules not processed for user `2ebf973246eb41618e8931d41cebed41`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:30:06.568404 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-6d0a84d0-15e9-4e3c-93f1-f31219c414b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:06.634382 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2428/4892] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:30:06 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:30:06.644937 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ff54a-3d7d-4022-af11-81ffb02031b7 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:06.645228 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ff54a-3d7d-4022-af11-81ffb02031b7 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:06.645503 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ff54a-3d7d-4022-af11-81ffb02031b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:06.669214 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-211ff54a-3d7d-4022-af11-81ffb02031b7 None None] MFA Rules not processed for user `2ebf973246eb41618e8931d41cebed41`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:30:06.669214 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-211ff54a-3d7d-4022-af11-81ffb02031b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:06.671943 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2465/4893] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:30:06 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:30:06.676097 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0a84d0-15e9-4e3c-93f1-f31219c414b8 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:06.685094 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0a84d0-15e9-4e3c-93f1-f31219c414b8 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:06.689762 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e180257-0aaf-4d28-97d0-5ea68e4e9637 tempest-TrustsV3TestJSON-1245397357 tempest-user-1239671094] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ebf973246eb41618e8931d41cebed41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de9c8498d45a4d84b618f02fa4c3c594', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-205444946', 'tempest-NotDelegatedRole-182216320'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:06.692293 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e180257-0aaf-4d28-97d0-5ea68e4e9637 tempest-TrustsV3TestJSON-1245397357 tempest-user-1239671094] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:06.692293 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e180257-0aaf-4d28-97d0-5ea68e4e9637 tempest-TrustsV3TestJSON-1245397357 tempest-user-1239671094] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:06.692293 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e180257-0aaf-4d28-97d0-5ea68e4e9637 tempest-TrustsV3TestJSON-1245397357 tempest-user-1239671094] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:06.692293 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e180257-0aaf-4d28-97d0-5ea68e4e9637 tempest-TrustsV3TestJSON-1245397357 tempest-user-1239671094] RBAC: Authorizing `identity:create_trust()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:06.692863 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e180257-0aaf-4d28-97d0-5ea68e4e9637 tempest-TrustsV3TestJSON-1245397357 tempest-user-1239671094] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:06.856443 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2429/4894] 10.222.0.52 () {60 vars in 1173 bytes} [Sat May 14 21:30:06 2022] POST /identity/v3/OS-TRUST/trusts => generated 833 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:30:06.858248 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211ff54a-3d7d-4022-af11-81ffb02031b7 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:06.866470 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211ff54a-3d7d-4022-af11-81ffb02031b7 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:06.870761 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c468e9b5-0469-434f-af1e-c69c3d2fb02d tempest-TrustsV3TestJSON-1245397357 tempest-user-1239671094] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ebf973246eb41618e8931d41cebed41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de9c8498d45a4d84b618f02fa4c3c594', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-205444946', 'tempest-NotDelegatedRole-182216320'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:06.871612 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c468e9b5-0469-434f-af1e-c69c3d2fb02d tempest-TrustsV3TestJSON-1245397357 tempest-user-1239671094] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:06.871915 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c468e9b5-0469-434f-af1e-c69c3d2fb02d tempest-TrustsV3TestJSON-1245397357 tempest-user-1239671094] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:06.872189 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c468e9b5-0469-434f-af1e-c69c3d2fb02d tempest-TrustsV3TestJSON-1245397357 tempest-user-1239671094] PATH_INFO: `/v3/OS-TRUST/trusts/d5b2c361cf4d45809669c6f958e433b3` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:06.879265 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c468e9b5-0469-434f-af1e-c69c3d2fb02d tempest-TrustsV3TestJSON-1245397357 tempest-user-1239671094] RBAC: Authorizing `identity:get_trust(trust_id=d5b2c361cf4d45809669c6f958e433b3)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:06.880833 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c468e9b5-0469-434f-af1e-c69c3d2fb02d tempest-TrustsV3TestJSON-1245397357 tempest-user-1239671094] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:06.888348 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2466/4895] 10.222.0.52 () {58 vars in 1250 bytes} [Sat May 14 21:30:06 2022] GET /identity/v3/OS-TRUST/trusts/d5b2c361cf4d45809669c6f958e433b3 => generated 833 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:30:06.897826 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e180257-0aaf-4d28-97d0-5ea68e4e9637 tempest-TrustsV3TestJSON-1245397357 tempest-user-1239671094] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:06.908323 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e180257-0aaf-4d28-97d0-5ea68e4e9637 tempest-TrustsV3TestJSON-1245397357 tempest-user-1239671094] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:06.912656 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e40931-aca5-4e60-8754-ff08b6c3c13f tempest-TrustsV3TestJSON-1245397357 tempest-user-1239671094] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ebf973246eb41618e8931d41cebed41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de9c8498d45a4d84b618f02fa4c3c594', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-205444946', 'tempest-NotDelegatedRole-182216320'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:06.913431 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e40931-aca5-4e60-8754-ff08b6c3c13f tempest-TrustsV3TestJSON-1245397357 tempest-user-1239671094] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:06.913741 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e40931-aca5-4e60-8754-ff08b6c3c13f tempest-TrustsV3TestJSON-1245397357 tempest-user-1239671094] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:06.914342 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e40931-aca5-4e60-8754-ff08b6c3c13f tempest-TrustsV3TestJSON-1245397357 tempest-user-1239671094] PATH_INFO: `/v3/OS-TRUST/trusts/d5b2c361cf4d45809669c6f958e433b3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:06.921018 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e40931-aca5-4e60-8754-ff08b6c3c13f tempest-TrustsV3TestJSON-1245397357 tempest-user-1239671094] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=d5b2c361cf4d45809669c6f958e433b3)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:06.922814 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e40931-aca5-4e60-8754-ff08b6c3c13f tempest-TrustsV3TestJSON-1245397357 tempest-user-1239671094] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:06.930632 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2430/4896] 10.222.0.52 () {58 vars in 1268 bytes} [Sat May 14 21:30:06 2022] GET /identity/v3/OS-TRUST/trusts/d5b2c361cf4d45809669c6f958e433b3/roles => generated 370 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:30:06.934772 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c468e9b5-0469-434f-af1e-c69c3d2fb02d tempest-TrustsV3TestJSON-1245397357 tempest-user-1239671094] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:06.945080 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c468e9b5-0469-434f-af1e-c69c3d2fb02d tempest-TrustsV3TestJSON-1245397357 tempest-user-1239671094] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:06.949352 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0026474c-daa1-4250-9608-e02d13e7e9ef tempest-TrustsV3TestJSON-1245397357 tempest-user-1239671094] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ebf973246eb41618e8931d41cebed41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de9c8498d45a4d84b618f02fa4c3c594', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-205444946', 'tempest-NotDelegatedRole-182216320'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:06.950167 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0026474c-daa1-4250-9608-e02d13e7e9ef tempest-TrustsV3TestJSON-1245397357 tempest-user-1239671094] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:06.950449 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0026474c-daa1-4250-9608-e02d13e7e9ef tempest-TrustsV3TestJSON-1245397357 tempest-user-1239671094] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:06.950727 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0026474c-daa1-4250-9608-e02d13e7e9ef tempest-TrustsV3TestJSON-1245397357 tempest-user-1239671094] PATH_INFO: `/v3/OS-TRUST/trusts/d5b2c361cf4d45809669c6f958e433b3/roles/c94643021b8248089a9688e1a6c56d40` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:06.957022 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0026474c-daa1-4250-9608-e02d13e7e9ef tempest-TrustsV3TestJSON-1245397357 tempest-user-1239671094] RBAC: Authorizing `identity:get_role_for_trust(trust_id=d5b2c361cf4d45809669c6f958e433b3, role_id=c94643021b8248089a9688e1a6c56d40)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:06.958452 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0026474c-daa1-4250-9608-e02d13e7e9ef tempest-TrustsV3TestJSON-1245397357 tempest-user-1239671094] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:06.965803 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2467/4897] 10.222.0.52 () {58 vars in 1367 bytes} [Sat May 14 21:30:06 2022] GET /identity/v3/OS-TRUST/trusts/d5b2c361cf4d45809669c6f958e433b3/roles/c94643021b8248089a9688e1a6c56d40 => generated 243 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:30:06.970721 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e40931-aca5-4e60-8754-ff08b6c3c13f tempest-TrustsV3TestJSON-1245397357 tempest-user-1239671094] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:06.982647 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e40931-aca5-4e60-8754-ff08b6c3c13f tempest-TrustsV3TestJSON-1245397357 tempest-user-1239671094] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:06.987098 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baefa693-3b0d-40a0-b7bb-8ab8077d7912 tempest-TrustsV3TestJSON-1245397357 tempest-user-1239671094] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ebf973246eb41618e8931d41cebed41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de9c8498d45a4d84b618f02fa4c3c594', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-205444946', 'tempest-NotDelegatedRole-182216320'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:06.987966 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baefa693-3b0d-40a0-b7bb-8ab8077d7912 tempest-TrustsV3TestJSON-1245397357 tempest-user-1239671094] REQUEST_METHOD: `HEAD` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:06.988251 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baefa693-3b0d-40a0-b7bb-8ab8077d7912 tempest-TrustsV3TestJSON-1245397357 tempest-user-1239671094] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:06.988526 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baefa693-3b0d-40a0-b7bb-8ab8077d7912 tempest-TrustsV3TestJSON-1245397357 tempest-user-1239671094] PATH_INFO: `/v3/OS-TRUST/trusts/d5b2c361cf4d45809669c6f958e433b3/roles/c94643021b8248089a9688e1a6c56d40` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:06.994603 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baefa693-3b0d-40a0-b7bb-8ab8077d7912 tempest-TrustsV3TestJSON-1245397357 tempest-user-1239671094] RBAC: Authorizing `identity:get_role_for_trust(trust_id=d5b2c361cf4d45809669c6f958e433b3, role_id=c94643021b8248089a9688e1a6c56d40)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:06.996069 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baefa693-3b0d-40a0-b7bb-8ab8077d7912 tempest-TrustsV3TestJSON-1245397357 tempest-user-1239671094] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:07.003992 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2431/4898] 10.222.0.52 () {58 vars in 1368 bytes} [Sat May 14 21:30:06 2022] HEAD /identity/v3/OS-TRUST/trusts/d5b2c361cf4d45809669c6f958e433b3/roles/c94643021b8248089a9688e1a6c56d40 => generated 0 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) May 14 21:30:07.007673 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0026474c-daa1-4250-9608-e02d13e7e9ef tempest-TrustsV3TestJSON-1245397357 tempest-user-1239671094] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:07.017983 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0026474c-daa1-4250-9608-e02d13e7e9ef tempest-TrustsV3TestJSON-1245397357 tempest-user-1239671094] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:07.022178 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b333440-998d-4d10-97fb-732c77a06688 tempest-TrustsV3TestJSON-1245397357 tempest-user-1239671094] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ebf973246eb41618e8931d41cebed41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de9c8498d45a4d84b618f02fa4c3c594', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-205444946', 'tempest-NotDelegatedRole-182216320'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:07.022983 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b333440-998d-4d10-97fb-732c77a06688 tempest-TrustsV3TestJSON-1245397357 tempest-user-1239671094] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:07.023261 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b333440-998d-4d10-97fb-732c77a06688 tempest-TrustsV3TestJSON-1245397357 tempest-user-1239671094] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:07.023570 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b333440-998d-4d10-97fb-732c77a06688 tempest-TrustsV3TestJSON-1245397357 tempest-user-1239671094] PATH_INFO: `/v3/OS-TRUST/trusts/d5b2c361cf4d45809669c6f958e433b3/roles/a50729297e9f46138a1dea6cd55e3df9` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:07.029561 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b333440-998d-4d10-97fb-732c77a06688 tempest-TrustsV3TestJSON-1245397357 tempest-user-1239671094] RBAC: Authorizing `identity:get_role_for_trust(trust_id=d5b2c361cf4d45809669c6f958e433b3, role_id=a50729297e9f46138a1dea6cd55e3df9)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:07.031030 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b333440-998d-4d10-97fb-732c77a06688 tempest-TrustsV3TestJSON-1245397357 tempest-user-1239671094] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:07.045561 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-9b333440-998d-4d10-97fb-732c77a06688 tempest-TrustsV3TestJSON-1245397357 tempest-user-1239671094] Could not find role: a50729297e9f46138a1dea6cd55e3df9.: keystone.exception.RoleNotFound: Could not find role: a50729297e9f46138a1dea6cd55e3df9. May 14 21:30:07.045561 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:30:07.045561 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 21:30:07.045561 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 21:30:07.045561 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 21:30:07.045561 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 21:30:07.045561 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 21:30:07.045561 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 21:30:07.045561 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 21:30:07.045561 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 21:30:07.045561 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 21:30:07.045561 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 21:30:07.045561 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get May 14 21:30:07.045561 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 21:30:07.046967 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: a50729297e9f46138a1dea6cd55e3df9. May 14 21:30:07.046967 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:30:07.047360 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2468/4899] 10.222.0.52 () {58 vars in 1367 bytes} [Sat May 14 21:30:07 2022] GET /identity/v3/OS-TRUST/trusts/d5b2c361cf4d45809669c6f958e433b3/roles/a50729297e9f46138a1dea6cd55e3df9 => generated 110 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) May 14 21:30:07.050968 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baefa693-3b0d-40a0-b7bb-8ab8077d7912 tempest-TrustsV3TestJSON-1245397357 tempest-user-1239671094] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:07.060247 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baefa693-3b0d-40a0-b7bb-8ab8077d7912 tempest-TrustsV3TestJSON-1245397357 tempest-user-1239671094] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:07.065253 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6dc86e-ec3c-4402-8cb5-70c6fdd13b14 tempest-TrustsV3TestJSON-1245397357 tempest-user-1239671094] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ebf973246eb41618e8931d41cebed41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de9c8498d45a4d84b618f02fa4c3c594', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-205444946', 'tempest-NotDelegatedRole-182216320'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:07.066069 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6dc86e-ec3c-4402-8cb5-70c6fdd13b14 tempest-TrustsV3TestJSON-1245397357 tempest-user-1239671094] REQUEST_METHOD: `HEAD` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:07.066385 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6dc86e-ec3c-4402-8cb5-70c6fdd13b14 tempest-TrustsV3TestJSON-1245397357 tempest-user-1239671094] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:07.066628 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6dc86e-ec3c-4402-8cb5-70c6fdd13b14 tempest-TrustsV3TestJSON-1245397357 tempest-user-1239671094] PATH_INFO: `/v3/OS-TRUST/trusts/d5b2c361cf4d45809669c6f958e433b3/roles/a50729297e9f46138a1dea6cd55e3df9` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:07.072548 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6dc86e-ec3c-4402-8cb5-70c6fdd13b14 tempest-TrustsV3TestJSON-1245397357 tempest-user-1239671094] RBAC: Authorizing `identity:get_role_for_trust(trust_id=d5b2c361cf4d45809669c6f958e433b3, role_id=a50729297e9f46138a1dea6cd55e3df9)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:07.073991 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6dc86e-ec3c-4402-8cb5-70c6fdd13b14 tempest-TrustsV3TestJSON-1245397357 tempest-user-1239671094] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:07.088132 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-cb6dc86e-ec3c-4402-8cb5-70c6fdd13b14 tempest-TrustsV3TestJSON-1245397357 tempest-user-1239671094] Could not find role: a50729297e9f46138a1dea6cd55e3df9.: keystone.exception.RoleNotFound: Could not find role: a50729297e9f46138a1dea6cd55e3df9. May 14 21:30:07.088132 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:30:07.088132 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 21:30:07.088132 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 21:30:07.088132 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 21:30:07.088132 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 21:30:07.088132 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 21:30:07.088132 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 21:30:07.088132 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 21:30:07.088132 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 21:30:07.088132 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 21:30:07.088132 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 21:30:07.088132 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get May 14 21:30:07.088132 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 21:30:07.089392 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: a50729297e9f46138a1dea6cd55e3df9. May 14 21:30:07.089392 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:30:07.089559 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2432/4900] 10.222.0.52 () {58 vars in 1368 bytes} [Sat May 14 21:30:07 2022] HEAD /identity/v3/OS-TRUST/trusts/d5b2c361cf4d45809669c6f958e433b3/roles/a50729297e9f46138a1dea6cd55e3df9 => generated 0 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) May 14 21:30:07.093457 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b333440-998d-4d10-97fb-732c77a06688 tempest-TrustsV3TestJSON-1245397357 tempest-user-1239671094] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:07.103373 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b333440-998d-4d10-97fb-732c77a06688 tempest-TrustsV3TestJSON-1245397357 tempest-user-1239671094] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:07.107548 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38888dae-ed41-4d5c-bb8c-d272dd1cdd95 tempest-TrustsV3TestJSON-1245397357 tempest-user-1239671094] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ebf973246eb41618e8931d41cebed41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de9c8498d45a4d84b618f02fa4c3c594', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-205444946', 'tempest-NotDelegatedRole-182216320'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:07.108356 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38888dae-ed41-4d5c-bb8c-d272dd1cdd95 tempest-TrustsV3TestJSON-1245397357 tempest-user-1239671094] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:07.108639 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38888dae-ed41-4d5c-bb8c-d272dd1cdd95 tempest-TrustsV3TestJSON-1245397357 tempest-user-1239671094] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:07.108930 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38888dae-ed41-4d5c-bb8c-d272dd1cdd95 tempest-TrustsV3TestJSON-1245397357 tempest-user-1239671094] PATH_INFO: `/v3/OS-TRUST/trusts/d5b2c361cf4d45809669c6f958e433b3` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:07.115301 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38888dae-ed41-4d5c-bb8c-d272dd1cdd95 tempest-TrustsV3TestJSON-1245397357 tempest-user-1239671094] RBAC: Authorizing `identity:delete_trust(trust_id=d5b2c361cf4d45809669c6f958e433b3)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:07.116906 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38888dae-ed41-4d5c-bb8c-d272dd1cdd95 tempest-TrustsV3TestJSON-1245397357 tempest-user-1239671094] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:07.188446 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-38888dae-ed41-4d5c-bb8c-d272dd1cdd95 tempest-TrustsV3TestJSON-1245397357 tempest-user-1239671094] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'd5b2c361cf4d45809669c6f958e433b3', 'request_id': 'req-38888dae-ed41-4d5c-bb8c-d272dd1cdd95'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:07.189192 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-38888dae-ed41-4d5c-bb8c-d272dd1cdd95 tempest-TrustsV3TestJSON-1245397357 tempest-user-1239671094] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'd5b2c361cf4d45809669c6f958e433b3', 'request_id': 'req-38888dae-ed41-4d5c-bb8c-d272dd1cdd95'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:07.274508 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-38888dae-ed41-4d5c-bb8c-d272dd1cdd95 tempest-TrustsV3TestJSON-1245397357 tempest-user-1239671094] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'd5b2c361cf4d45809669c6f958e433b3', 'request_id': 'req-38888dae-ed41-4d5c-bb8c-d272dd1cdd95'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:07.286409 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2469/4901] 10.222.0.52 () {58 vars in 1253 bytes} [Sat May 14 21:30:07 2022] DELETE /identity/v3/OS-TRUST/trusts/d5b2c361cf4d45809669c6f958e433b3 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:30:07.287626 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6dc86e-ec3c-4402-8cb5-70c6fdd13b14 tempest-TrustsV3TestJSON-1245397357 tempest-user-1239671094] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:07.294173 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-cb6dc86e-ec3c-4402-8cb5-70c6fdd13b14 tempest-TrustsV3TestJSON-1245397357 tempest-user-1239671094] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:07.310940 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6dc86e-ec3c-4402-8cb5-70c6fdd13b14 tempest-TrustsV3TestJSON-1245397357 tempest-user-1239671094] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:07.315718 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb8401c-6ef3-4c13-a477-6e822473aca1 tempest-TrustsV3TestJSON-1245397357 tempest-user-1239671094] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ebf973246eb41618e8931d41cebed41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de9c8498d45a4d84b618f02fa4c3c594', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-205444946', 'tempest-NotDelegatedRole-182216320'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:07.316573 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8401c-6ef3-4c13-a477-6e822473aca1 tempest-TrustsV3TestJSON-1245397357 tempest-user-1239671094] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:07.316895 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8401c-6ef3-4c13-a477-6e822473aca1 tempest-TrustsV3TestJSON-1245397357 tempest-user-1239671094] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:07.317154 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8401c-6ef3-4c13-a477-6e822473aca1 tempest-TrustsV3TestJSON-1245397357 tempest-user-1239671094] PATH_INFO: `/v3/OS-TRUST/trusts/d5b2c361cf4d45809669c6f958e433b3` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:07.331791 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-3cb8401c-6ef3-4c13-a477-6e822473aca1 tempest-TrustsV3TestJSON-1245397357 tempest-user-1239671094] Could not find trust: d5b2c361cf4d45809669c6f958e433b3.: keystone.exception.TrustNotFound: Could not find trust: d5b2c361cf4d45809669c6f958e433b3. May 14 21:30:07.331791 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:30:07.331791 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 21:30:07.331791 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 21:30:07.331791 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 21:30:07.331791 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 21:30:07.331791 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 21:30:07.331791 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 21:30:07.331791 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 21:30:07.331791 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 21:30:07.331791 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 21:30:07.331791 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 21:30:07.331791 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get May 14 21:30:07.331791 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) May 14 21:30:07.331791 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust May 14 21:30:07.333217 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', May 14 21:30:07.333217 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call May 14 21:30:07.333217 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() May 14 21:30:07.333217 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement May 14 21:30:07.333217 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( May 14 21:30:07.333217 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 21:30:07.333217 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 21:30:07.333217 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust May 14 21:30:07.333217 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) May 14 21:30:07.333217 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust May 14 21:30:07.333217 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) May 14 21:30:07.333217 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: d5b2c361cf4d45809669c6f958e433b3. May 14 21:30:07.333217 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:30:07.333217 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2433/4902] 10.222.0.52 () {58 vars in 1250 bytes} [Sat May 14 21:30:07 2022] GET /identity/v3/OS-TRUST/trusts/d5b2c361cf4d45809669c6f958e433b3 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 14 21:30:07.337757 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38888dae-ed41-4d5c-bb8c-d272dd1cdd95 tempest-TrustsV3TestJSON-1245397357 tempest-user-1239671094] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:07.339453 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-38888dae-ed41-4d5c-bb8c-d272dd1cdd95 tempest-TrustsV3TestJSON-1245397357 tempest-user-1239671094] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:07.356946 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38888dae-ed41-4d5c-bb8c-d272dd1cdd95 tempest-TrustsV3TestJSON-1245397357 tempest-user-1239671094] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:07.362517 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfff194-e472-4e1a-b95a-070f84b8d24b tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16df42e793ed46c8b39b78b4a4821bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1997fca61bf6406d83c93f3f98a79a84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:07.365448 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfff194-e472-4e1a-b95a-070f84b8d24b tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:07.365448 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfff194-e472-4e1a-b95a-070f84b8d24b tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:07.365448 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfff194-e472-4e1a-b95a-070f84b8d24b tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] PATH_INFO: `/v3/roles/a50729297e9f46138a1dea6cd55e3df9` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:07.365790 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfff194-e472-4e1a-b95a-070f84b8d24b tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorizing `identity:delete_role(role_id=a50729297e9f46138a1dea6cd55e3df9)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:07.367203 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfff194-e472-4e1a-b95a-070f84b8d24b tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:07.535597 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2dfff194-e472-4e1a-b95a-070f84b8d24b tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invalidating the token cache because role a50729297e9f46138a1dea6cd55e3df9 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:30:07.535865 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2dfff194-e472-4e1a-b95a-070f84b8d24b tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:07.536493 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2dfff194-e472-4e1a-b95a-070f84b8d24b tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:07.538493 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2470/4903] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:30:07 2022] DELETE /identity/v3/roles/a50729297e9f46138a1dea6cd55e3df9 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:30:07.542723 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb8401c-6ef3-4c13-a477-6e822473aca1 tempest-TrustsV3TestJSON-1245397357 tempest-user-1239671094] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:07.544543 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-3cb8401c-6ef3-4c13-a477-6e822473aca1 tempest-TrustsV3TestJSON-1245397357 tempest-user-1239671094] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:07.559942 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb8401c-6ef3-4c13-a477-6e822473aca1 tempest-TrustsV3TestJSON-1245397357 tempest-user-1239671094] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:07.619267 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1c7e4d-3f93-4c01-8694-c093128b64d1 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16df42e793ed46c8b39b78b4a4821bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1997fca61bf6406d83c93f3f98a79a84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:07.620247 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c7e4d-3f93-4c01-8694-c093128b64d1 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:07.620598 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c7e4d-3f93-4c01-8694-c093128b64d1 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:07.621096 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c7e4d-3f93-4c01-8694-c093128b64d1 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] PATH_INFO: `/v3/roles/c94643021b8248089a9688e1a6c56d40` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:07.622610 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1c7e4d-3f93-4c01-8694-c093128b64d1 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorizing `identity:delete_role(role_id=c94643021b8248089a9688e1a6c56d40)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:07.624335 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1c7e4d-3f93-4c01-8694-c093128b64d1 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:07.830001 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7a1c7e4d-3f93-4c01-8694-c093128b64d1 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invalidating the token cache because role c94643021b8248089a9688e1a6c56d40 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:30:07.831081 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7a1c7e4d-3f93-4c01-8694-c093128b64d1 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:07.831081 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7a1c7e4d-3f93-4c01-8694-c093128b64d1 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:07.832946 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2434/4904] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:30:07 2022] DELETE /identity/v3/roles/c94643021b8248089a9688e1a6c56d40 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:30:07.836906 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfff194-e472-4e1a-b95a-070f84b8d24b tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:07.847835 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfff194-e472-4e1a-b95a-070f84b8d24b tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:07.903741 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69421a47-a068-4763-bece-ee08f1c0e88b tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16df42e793ed46c8b39b78b4a4821bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1997fca61bf6406d83c93f3f98a79a84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:07.904630 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69421a47-a068-4763-bece-ee08f1c0e88b tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:07.904899 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69421a47-a068-4763-bece-ee08f1c0e88b tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:07.905210 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69421a47-a068-4763-bece-ee08f1c0e88b tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] PATH_INFO: `/v3/users/2ebf973246eb41618e8931d41cebed41` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:07.906478 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69421a47-a068-4763-bece-ee08f1c0e88b tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorizing `identity:delete_user(user_id=2ebf973246eb41618e8931d41cebed41)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:07.908565 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69421a47-a068-4763-bece-ee08f1c0e88b tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:08.044040 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-69421a47-a068-4763-bece-ee08f1c0e88b tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ebf973246eb41618e8931d41cebed41'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:08.056785 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-69421a47-a068-4763-bece-ee08f1c0e88b tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ebf973246eb41618e8931d41cebed41'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:08.064626 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-69421a47-a068-4763-bece-ee08f1c0e88b tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ebf973246eb41618e8931d41cebed41'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:08.176562 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-69421a47-a068-4763-bece-ee08f1c0e88b tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ebf973246eb41618e8931d41cebed41'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:08.177270 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-69421a47-a068-4763-bece-ee08f1c0e88b tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ebf973246eb41618e8931d41cebed41'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:08.184748 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2471/4905] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:30:07 2022] DELETE /identity/v3/users/2ebf973246eb41618e8931d41cebed41 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:30:08.189572 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1c7e4d-3f93-4c01-8694-c093128b64d1 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:08.191126 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-7a1c7e4d-3f93-4c01-8694-c093128b64d1 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:08.211329 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1c7e4d-3f93-4c01-8694-c093128b64d1 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:08.277103 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad3d87b-8812-4445-a06e-bb46eaa3a7ca tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16df42e793ed46c8b39b78b4a4821bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1997fca61bf6406d83c93f3f98a79a84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:08.280437 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad3d87b-8812-4445-a06e-bb46eaa3a7ca tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:08.280437 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad3d87b-8812-4445-a06e-bb46eaa3a7ca tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:08.280437 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad3d87b-8812-4445-a06e-bb46eaa3a7ca tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] PATH_INFO: `/v3/projects/de9c8498d45a4d84b618f02fa4c3c594` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:08.280437 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad3d87b-8812-4445-a06e-bb46eaa3a7ca tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorizing `identity:delete_project(project_id=de9c8498d45a4d84b618f02fa4c3c594)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:08.282235 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad3d87b-8812-4445-a06e-bb46eaa3a7ca tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:08.472699 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4ad3d87b-8812-4445-a06e-bb46eaa3a7ca tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de9c8498d45a4d84b618f02fa4c3c594', 'request_id': 'req-4ad3d87b-8812-4445-a06e-bb46eaa3a7ca'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:08.478353 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4ad3d87b-8812-4445-a06e-bb46eaa3a7ca tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de9c8498d45a4d84b618f02fa4c3c594', 'request_id': 'req-4ad3d87b-8812-4445-a06e-bb46eaa3a7ca'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:08.490302 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4ad3d87b-8812-4445-a06e-bb46eaa3a7ca tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de9c8498d45a4d84b618f02fa4c3c594', 'request_id': 'req-4ad3d87b-8812-4445-a06e-bb46eaa3a7ca'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:08.566498 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4ad3d87b-8812-4445-a06e-bb46eaa3a7ca tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] The token cache is being invalidate because project de9c8498d45a4d84b618f02fa4c3c594 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:30:08.566806 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4ad3d87b-8812-4445-a06e-bb46eaa3a7ca tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:08.567457 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4ad3d87b-8812-4445-a06e-bb46eaa3a7ca tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:08.569081 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2435/4906] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:30:08 2022] DELETE /identity/v3/projects/de9c8498d45a4d84b618f02fa4c3c594 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:30:08.574741 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69421a47-a068-4763-bece-ee08f1c0e88b tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:08.576276 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-69421a47-a068-4763-bece-ee08f1c0e88b tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:08.590213 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69421a47-a068-4763-bece-ee08f1c0e88b tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:08.645744 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dab090-0d95-4d6d-8109-8bcc2f5d4f2e tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16df42e793ed46c8b39b78b4a4821bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1997fca61bf6406d83c93f3f98a79a84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:08.646394 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dab090-0d95-4d6d-8109-8bcc2f5d4f2e tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:08.646675 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dab090-0d95-4d6d-8109-8bcc2f5d4f2e tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:08.646949 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dab090-0d95-4d6d-8109-8bcc2f5d4f2e tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:08.647664 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dab090-0d95-4d6d-8109-8bcc2f5d4f2e tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:08.649587 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dab090-0d95-4d6d-8109-8bcc2f5d4f2e tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:08.780619 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2472/4907] 10.222.0.52 () {60 vars in 1151 bytes} [Sat May 14 21:30:08 2022] POST /identity/v3/projects => generated 329 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:30:08.784814 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad3d87b-8812-4445-a06e-bb46eaa3a7ca tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:08.786617 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-4ad3d87b-8812-4445-a06e-bb46eaa3a7ca tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:08.802449 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad3d87b-8812-4445-a06e-bb46eaa3a7ca tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:08.868066 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d143d51b-a36c-4018-9b99-1f5928dfcea7 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16df42e793ed46c8b39b78b4a4821bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1997fca61bf6406d83c93f3f98a79a84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:08.868754 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d143d51b-a36c-4018-9b99-1f5928dfcea7 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:08.873516 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d143d51b-a36c-4018-9b99-1f5928dfcea7 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:08.873516 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d143d51b-a36c-4018-9b99-1f5928dfcea7 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:08.873516 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d143d51b-a36c-4018-9b99-1f5928dfcea7 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:08.873516 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d143d51b-a36c-4018-9b99-1f5928dfcea7 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:08.975520 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2436/4908] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:30:08 2022] POST /identity/v3/users => generated 416 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:30:08.977584 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dab090-0d95-4d6d-8109-8bcc2f5d4f2e tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:08.997585 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dab090-0d95-4d6d-8109-8bcc2f5d4f2e tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:09.005024 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c84202-520f-4609-9d06-2499f7de4d0f tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16df42e793ed46c8b39b78b4a4821bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1997fca61bf6406d83c93f3f98a79a84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:09.006045 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c84202-520f-4609-9d06-2499f7de4d0f tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:09.006328 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c84202-520f-4609-9d06-2499f7de4d0f tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:09.006669 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c84202-520f-4609-9d06-2499f7de4d0f tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:09.007681 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c84202-520f-4609-9d06-2499f7de4d0f tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:09.009424 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c84202-520f-4609-9d06-2499f7de4d0f tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:09.088104 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2473/4909] 10.222.0.52 () {60 vars in 1142 bytes} [Sat May 14 21:30:08 2022] POST /identity/v3/roles => generated 244 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:30:09.091961 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d143d51b-a36c-4018-9b99-1f5928dfcea7 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:09.104274 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d143d51b-a36c-4018-9b99-1f5928dfcea7 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:09.117914 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b805e6-30e3-4b51-9bb2-c438eb05b837 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16df42e793ed46c8b39b78b4a4821bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1997fca61bf6406d83c93f3f98a79a84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:09.118718 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b805e6-30e3-4b51-9bb2-c438eb05b837 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:09.119308 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b805e6-30e3-4b51-9bb2-c438eb05b837 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:09.119699 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b805e6-30e3-4b51-9bb2-c438eb05b837 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:09.120699 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b805e6-30e3-4b51-9bb2-c438eb05b837 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:09.122613 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b805e6-30e3-4b51-9bb2-c438eb05b837 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:09.206929 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2437/4910] 10.222.0.52 () {60 vars in 1142 bytes} [Sat May 14 21:30:09 2022] POST /identity/v3/roles => generated 247 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:30:09.211523 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c84202-520f-4609-9d06-2499f7de4d0f tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:09.223027 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c84202-520f-4609-9d06-2499f7de4d0f tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:09.227662 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f65339a-2f78-4825-ac1a-a7e84a5e4aee tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16df42e793ed46c8b39b78b4a4821bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1997fca61bf6406d83c93f3f98a79a84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:09.228535 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f65339a-2f78-4825-ac1a-a7e84a5e4aee tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:09.228831 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f65339a-2f78-4825-ac1a-a7e84a5e4aee tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:09.229106 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f65339a-2f78-4825-ac1a-a7e84a5e4aee tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] PATH_INFO: `/v3/projects/4fb7419948a142dcb390312d301aa116/users/7499f59e4acf4bdc806507795d883486/roles/f19b0621ad3840d8a83770a94adfa8bc` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:09.244414 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f65339a-2f78-4825-ac1a-a7e84a5e4aee tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorizing `identity:create_grant(project_id=4fb7419948a142dcb390312d301aa116, user_id=7499f59e4acf4bdc806507795d883486, role_id=f19b0621ad3840d8a83770a94adfa8bc)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:09.247169 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f65339a-2f78-4825-ac1a-a7e84a5e4aee tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:09.350085 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2474/4911] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:30:09 2022] PUT /identity/v3/projects/4fb7419948a142dcb390312d301aa116/users/7499f59e4acf4bdc806507795d883486/roles/f19b0621ad3840d8a83770a94adfa8bc => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:30:09.354327 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b805e6-30e3-4b51-9bb2-c438eb05b837 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:09.365979 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b805e6-30e3-4b51-9bb2-c438eb05b837 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:09.428927 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a22fe9a-0627-4feb-ac34-23d66d19326b tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16df42e793ed46c8b39b78b4a4821bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1997fca61bf6406d83c93f3f98a79a84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:09.429829 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a22fe9a-0627-4feb-ac34-23d66d19326b tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:09.430118 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a22fe9a-0627-4feb-ac34-23d66d19326b tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:09.430398 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a22fe9a-0627-4feb-ac34-23d66d19326b tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] PATH_INFO: `/v3/projects/4fb7419948a142dcb390312d301aa116/users/7499f59e4acf4bdc806507795d883486/roles/4e560790295640d680c553a224e04b76` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:09.432810 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a22fe9a-0627-4feb-ac34-23d66d19326b tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorizing `identity:create_grant(project_id=4fb7419948a142dcb390312d301aa116, user_id=7499f59e4acf4bdc806507795d883486, role_id=4e560790295640d680c553a224e04b76)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:09.435498 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a22fe9a-0627-4feb-ac34-23d66d19326b tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:09.526268 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2438/4912] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:30:09 2022] PUT /identity/v3/projects/4fb7419948a142dcb390312d301aa116/users/7499f59e4acf4bdc806507795d883486/roles/4e560790295640d680c553a224e04b76 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:30:09.530248 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f65339a-2f78-4825-ac1a-a7e84a5e4aee tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:09.541114 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f65339a-2f78-4825-ac1a-a7e84a5e4aee tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:09.600105 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40c7b50-7ad5-43ba-928b-5fa9680fd968 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16df42e793ed46c8b39b78b4a4821bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1997fca61bf6406d83c93f3f98a79a84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:09.600793 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c7b50-7ad5-43ba-928b-5fa9680fd968 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:09.601080 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c7b50-7ad5-43ba-928b-5fa9680fd968 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:09.601368 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c7b50-7ad5-43ba-928b-5fa9680fd968 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:09.602127 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40c7b50-7ad5-43ba-928b-5fa9680fd968 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:09.604159 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40c7b50-7ad5-43ba-928b-5fa9680fd968 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:09.634271 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2475/4913] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:30:09 2022] GET /identity/v3/users => generated 8636 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:30:09.639251 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f22bc-87a3-4212-9a6a-191a50174732 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:09.639568 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f22bc-87a3-4212-9a6a-191a50174732 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:09.639880 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f22bc-87a3-4212-9a6a-191a50174732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:09.682915 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-8c8f22bc-87a3-4212-9a6a-191a50174732 None None] MFA Rules not processed for user `7499f59e4acf4bdc806507795d883486`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:30:09.684170 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8c8f22bc-87a3-4212-9a6a-191a50174732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:09.755590 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2439/4914] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:30:09 2022] POST /identity/v3/auth/tokens => generated 3271 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:30:09.765397 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1569c31-ed77-4831-8418-4e355a5ec5d0 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:09.765724 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1569c31-ed77-4831-8418-4e355a5ec5d0 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:09.766801 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1569c31-ed77-4831-8418-4e355a5ec5d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:09.785249 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-e1569c31-ed77-4831-8418-4e355a5ec5d0 None None] MFA Rules not processed for user `7499f59e4acf4bdc806507795d883486`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:30:09.786607 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e1569c31-ed77-4831-8418-4e355a5ec5d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:09.794605 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2476/4915] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:30:09 2022] POST /identity/v3/auth/tokens => generated 3271 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:30:09.800352 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8f22bc-87a3-4212-9a6a-191a50174732 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:09.810853 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8f22bc-87a3-4212-9a6a-191a50174732 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:09.826894 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f402d319-135c-423e-b2aa-9869e59ec1fb tempest-TrustsV3TestJSON-1537474145 tempest-user-1354960774] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7499f59e4acf4bdc806507795d883486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb7419948a142dcb390312d301aa116', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1439569376', 'tempest-DelegatedRole-1245746473'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:09.832276 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402d319-135c-423e-b2aa-9869e59ec1fb tempest-TrustsV3TestJSON-1537474145 tempest-user-1354960774] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:09.832276 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402d319-135c-423e-b2aa-9869e59ec1fb tempest-TrustsV3TestJSON-1537474145 tempest-user-1354960774] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:09.832276 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402d319-135c-423e-b2aa-9869e59ec1fb tempest-TrustsV3TestJSON-1537474145 tempest-user-1354960774] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:09.832276 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f402d319-135c-423e-b2aa-9869e59ec1fb tempest-TrustsV3TestJSON-1537474145 tempest-user-1354960774] RBAC: Authorizing `identity:create_trust()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:09.832276 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f402d319-135c-423e-b2aa-9869e59ec1fb tempest-TrustsV3TestJSON-1537474145 tempest-user-1354960774] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:09.984438 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2440/4916] 10.222.0.52 () {60 vars in 1173 bytes} [Sat May 14 21:30:09 2022] POST /identity/v3/OS-TRUST/trusts => generated 835 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:30:09.989787 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1569c31-ed77-4831-8418-4e355a5ec5d0 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:09.998945 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1569c31-ed77-4831-8418-4e355a5ec5d0 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:10.003179 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876b447e-9d16-4015-9093-a281312a8909 tempest-TrustsV3TestJSON-1537474145 tempest-user-1354960774] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7499f59e4acf4bdc806507795d883486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb7419948a142dcb390312d301aa116', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1439569376', 'tempest-DelegatedRole-1245746473'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:10.004077 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b447e-9d16-4015-9093-a281312a8909 tempest-TrustsV3TestJSON-1537474145 tempest-user-1354960774] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:10.004603 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b447e-9d16-4015-9093-a281312a8909 tempest-TrustsV3TestJSON-1537474145 tempest-user-1354960774] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:10.005336 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b447e-9d16-4015-9093-a281312a8909 tempest-TrustsV3TestJSON-1537474145 tempest-user-1354960774] PATH_INFO: `/v3/OS-TRUST/trusts/a1f9370d51e341d29e9d5bb328cee6fe` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:10.012189 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876b447e-9d16-4015-9093-a281312a8909 tempest-TrustsV3TestJSON-1537474145 tempest-user-1354960774] RBAC: Authorizing `identity:get_trust(trust_id=a1f9370d51e341d29e9d5bb328cee6fe)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:10.013716 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876b447e-9d16-4015-9093-a281312a8909 tempest-TrustsV3TestJSON-1537474145 tempest-user-1354960774] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:10.022756 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2477/4917] 10.222.0.52 () {58 vars in 1250 bytes} [Sat May 14 21:30:09 2022] GET /identity/v3/OS-TRUST/trusts/a1f9370d51e341d29e9d5bb328cee6fe => generated 835 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:30:10.027253 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f402d319-135c-423e-b2aa-9869e59ec1fb tempest-TrustsV3TestJSON-1537474145 tempest-user-1354960774] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:10.039074 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f402d319-135c-423e-b2aa-9869e59ec1fb tempest-TrustsV3TestJSON-1537474145 tempest-user-1354960774] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:10.045725 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8462f788-19cb-47ec-bb9d-9e8dddf7dbee tempest-TrustsV3TestJSON-1537474145 tempest-user-1354960774] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7499f59e4acf4bdc806507795d883486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb7419948a142dcb390312d301aa116', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1439569376', 'tempest-DelegatedRole-1245746473'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:10.046547 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8462f788-19cb-47ec-bb9d-9e8dddf7dbee tempest-TrustsV3TestJSON-1537474145 tempest-user-1354960774] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:10.047537 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8462f788-19cb-47ec-bb9d-9e8dddf7dbee tempest-TrustsV3TestJSON-1537474145 tempest-user-1354960774] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:10.047884 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8462f788-19cb-47ec-bb9d-9e8dddf7dbee tempest-TrustsV3TestJSON-1537474145 tempest-user-1354960774] PATH_INFO: `/v3/OS-TRUST/trusts/a1f9370d51e341d29e9d5bb328cee6fe/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:10.055530 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8462f788-19cb-47ec-bb9d-9e8dddf7dbee tempest-TrustsV3TestJSON-1537474145 tempest-user-1354960774] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=a1f9370d51e341d29e9d5bb328cee6fe)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:10.059020 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8462f788-19cb-47ec-bb9d-9e8dddf7dbee tempest-TrustsV3TestJSON-1537474145 tempest-user-1354960774] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:10.073408 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2441/4918] 10.222.0.52 () {58 vars in 1268 bytes} [Sat May 14 21:30:10 2022] GET /identity/v3/OS-TRUST/trusts/a1f9370d51e341d29e9d5bb328cee6fe/roles => generated 371 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:30:10.074706 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876b447e-9d16-4015-9093-a281312a8909 tempest-TrustsV3TestJSON-1537474145 tempest-user-1354960774] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:10.089826 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876b447e-9d16-4015-9093-a281312a8909 tempest-TrustsV3TestJSON-1537474145 tempest-user-1354960774] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:10.094666 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5026dd8-6c69-4e30-9800-5f48e7a52ca1 tempest-TrustsV3TestJSON-1537474145 tempest-user-1354960774] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7499f59e4acf4bdc806507795d883486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb7419948a142dcb390312d301aa116', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1439569376', 'tempest-DelegatedRole-1245746473'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:10.095508 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5026dd8-6c69-4e30-9800-5f48e7a52ca1 tempest-TrustsV3TestJSON-1537474145 tempest-user-1354960774] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:10.095802 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5026dd8-6c69-4e30-9800-5f48e7a52ca1 tempest-TrustsV3TestJSON-1537474145 tempest-user-1354960774] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:10.096080 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5026dd8-6c69-4e30-9800-5f48e7a52ca1 tempest-TrustsV3TestJSON-1537474145 tempest-user-1354960774] PATH_INFO: `/v3/OS-TRUST/trusts/a1f9370d51e341d29e9d5bb328cee6fe/roles/f19b0621ad3840d8a83770a94adfa8bc` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:10.107089 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5026dd8-6c69-4e30-9800-5f48e7a52ca1 tempest-TrustsV3TestJSON-1537474145 tempest-user-1354960774] RBAC: Authorizing `identity:get_role_for_trust(trust_id=a1f9370d51e341d29e9d5bb328cee6fe, role_id=f19b0621ad3840d8a83770a94adfa8bc)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:10.113563 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5026dd8-6c69-4e30-9800-5f48e7a52ca1 tempest-TrustsV3TestJSON-1537474145 tempest-user-1354960774] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:10.119525 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2478/4919] 10.222.0.52 () {58 vars in 1367 bytes} [Sat May 14 21:30:10 2022] GET /identity/v3/OS-TRUST/trusts/a1f9370d51e341d29e9d5bb328cee6fe/roles/f19b0621ad3840d8a83770a94adfa8bc => generated 244 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:30:10.122871 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8462f788-19cb-47ec-bb9d-9e8dddf7dbee tempest-TrustsV3TestJSON-1537474145 tempest-user-1354960774] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:10.134687 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8462f788-19cb-47ec-bb9d-9e8dddf7dbee tempest-TrustsV3TestJSON-1537474145 tempest-user-1354960774] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:10.141773 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5dd5e7-fbd7-49c1-ae29-a6889d916c73 tempest-TrustsV3TestJSON-1537474145 tempest-user-1354960774] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7499f59e4acf4bdc806507795d883486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb7419948a142dcb390312d301aa116', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1439569376', 'tempest-DelegatedRole-1245746473'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:10.143008 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5dd5e7-fbd7-49c1-ae29-a6889d916c73 tempest-TrustsV3TestJSON-1537474145 tempest-user-1354960774] REQUEST_METHOD: `HEAD` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:10.143403 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5dd5e7-fbd7-49c1-ae29-a6889d916c73 tempest-TrustsV3TestJSON-1537474145 tempest-user-1354960774] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:10.143826 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5dd5e7-fbd7-49c1-ae29-a6889d916c73 tempest-TrustsV3TestJSON-1537474145 tempest-user-1354960774] PATH_INFO: `/v3/OS-TRUST/trusts/a1f9370d51e341d29e9d5bb328cee6fe/roles/f19b0621ad3840d8a83770a94adfa8bc` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:10.154321 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5dd5e7-fbd7-49c1-ae29-a6889d916c73 tempest-TrustsV3TestJSON-1537474145 tempest-user-1354960774] RBAC: Authorizing `identity:get_role_for_trust(trust_id=a1f9370d51e341d29e9d5bb328cee6fe, role_id=f19b0621ad3840d8a83770a94adfa8bc)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:10.157120 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5dd5e7-fbd7-49c1-ae29-a6889d916c73 tempest-TrustsV3TestJSON-1537474145 tempest-user-1354960774] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:10.165720 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2442/4920] 10.222.0.52 () {58 vars in 1368 bytes} [Sat May 14 21:30:10 2022] HEAD /identity/v3/OS-TRUST/trusts/a1f9370d51e341d29e9d5bb328cee6fe/roles/f19b0621ad3840d8a83770a94adfa8bc => generated 0 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) May 14 21:30:10.170015 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5026dd8-6c69-4e30-9800-5f48e7a52ca1 tempest-TrustsV3TestJSON-1537474145 tempest-user-1354960774] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:10.181373 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5026dd8-6c69-4e30-9800-5f48e7a52ca1 tempest-TrustsV3TestJSON-1537474145 tempest-user-1354960774] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:10.186204 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c426fca0-fe40-4ff1-a31b-ef25754ef7c0 tempest-TrustsV3TestJSON-1537474145 tempest-user-1354960774] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7499f59e4acf4bdc806507795d883486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb7419948a142dcb390312d301aa116', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1439569376', 'tempest-DelegatedRole-1245746473'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:10.188117 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c426fca0-fe40-4ff1-a31b-ef25754ef7c0 tempest-TrustsV3TestJSON-1537474145 tempest-user-1354960774] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:10.188117 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c426fca0-fe40-4ff1-a31b-ef25754ef7c0 tempest-TrustsV3TestJSON-1537474145 tempest-user-1354960774] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:10.188117 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c426fca0-fe40-4ff1-a31b-ef25754ef7c0 tempest-TrustsV3TestJSON-1537474145 tempest-user-1354960774] PATH_INFO: `/v3/OS-TRUST/trusts/a1f9370d51e341d29e9d5bb328cee6fe/roles/4e560790295640d680c553a224e04b76` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:10.195892 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c426fca0-fe40-4ff1-a31b-ef25754ef7c0 tempest-TrustsV3TestJSON-1537474145 tempest-user-1354960774] RBAC: Authorizing `identity:get_role_for_trust(trust_id=a1f9370d51e341d29e9d5bb328cee6fe, role_id=4e560790295640d680c553a224e04b76)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:10.197478 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c426fca0-fe40-4ff1-a31b-ef25754ef7c0 tempest-TrustsV3TestJSON-1537474145 tempest-user-1354960774] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:10.224458 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-c426fca0-fe40-4ff1-a31b-ef25754ef7c0 tempest-TrustsV3TestJSON-1537474145 tempest-user-1354960774] Could not find role: 4e560790295640d680c553a224e04b76.: keystone.exception.RoleNotFound: Could not find role: 4e560790295640d680c553a224e04b76. May 14 21:30:10.224458 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:30:10.224458 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 21:30:10.224458 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 21:30:10.224458 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 21:30:10.224458 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 21:30:10.224458 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 21:30:10.224458 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 21:30:10.224458 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 21:30:10.224458 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 21:30:10.224458 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 21:30:10.224458 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 21:30:10.224458 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get May 14 21:30:10.224458 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 21:30:10.225794 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 4e560790295640d680c553a224e04b76. May 14 21:30:10.225794 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:30:10.227150 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2479/4921] 10.222.0.52 () {58 vars in 1367 bytes} [Sat May 14 21:30:10 2022] GET /identity/v3/OS-TRUST/trusts/a1f9370d51e341d29e9d5bb328cee6fe/roles/4e560790295640d680c553a224e04b76 => generated 110 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 14 21:30:10.231328 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5dd5e7-fbd7-49c1-ae29-a6889d916c73 tempest-TrustsV3TestJSON-1537474145 tempest-user-1354960774] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:10.242599 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5dd5e7-fbd7-49c1-ae29-a6889d916c73 tempest-TrustsV3TestJSON-1537474145 tempest-user-1354960774] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:10.247283 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a86d43-10bd-401b-9732-626c7ccc1a7c tempest-TrustsV3TestJSON-1537474145 tempest-user-1354960774] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7499f59e4acf4bdc806507795d883486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb7419948a142dcb390312d301aa116', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1439569376', 'tempest-DelegatedRole-1245746473'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:10.248984 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a86d43-10bd-401b-9732-626c7ccc1a7c tempest-TrustsV3TestJSON-1537474145 tempest-user-1354960774] REQUEST_METHOD: `HEAD` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:10.248984 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a86d43-10bd-401b-9732-626c7ccc1a7c tempest-TrustsV3TestJSON-1537474145 tempest-user-1354960774] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:10.248984 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a86d43-10bd-401b-9732-626c7ccc1a7c tempest-TrustsV3TestJSON-1537474145 tempest-user-1354960774] PATH_INFO: `/v3/OS-TRUST/trusts/a1f9370d51e341d29e9d5bb328cee6fe/roles/4e560790295640d680c553a224e04b76` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:10.257711 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a86d43-10bd-401b-9732-626c7ccc1a7c tempest-TrustsV3TestJSON-1537474145 tempest-user-1354960774] RBAC: Authorizing `identity:get_role_for_trust(trust_id=a1f9370d51e341d29e9d5bb328cee6fe, role_id=4e560790295640d680c553a224e04b76)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:10.258775 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a86d43-10bd-401b-9732-626c7ccc1a7c tempest-TrustsV3TestJSON-1537474145 tempest-user-1354960774] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:10.275350 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-88a86d43-10bd-401b-9732-626c7ccc1a7c tempest-TrustsV3TestJSON-1537474145 tempest-user-1354960774] Could not find role: 4e560790295640d680c553a224e04b76.: keystone.exception.RoleNotFound: Could not find role: 4e560790295640d680c553a224e04b76. May 14 21:30:10.275350 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:30:10.275350 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 21:30:10.275350 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 21:30:10.275350 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 21:30:10.275350 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 21:30:10.275350 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 21:30:10.275350 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 21:30:10.275350 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 21:30:10.275350 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 21:30:10.275350 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 21:30:10.275350 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 21:30:10.275350 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get May 14 21:30:10.275350 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 21:30:10.278238 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 4e560790295640d680c553a224e04b76. May 14 21:30:10.278238 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:30:10.278238 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2443/4922] 10.222.0.52 () {58 vars in 1368 bytes} [Sat May 14 21:30:10 2022] HEAD /identity/v3/OS-TRUST/trusts/a1f9370d51e341d29e9d5bb328cee6fe/roles/4e560790295640d680c553a224e04b76 => generated 0 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) May 14 21:30:10.281417 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c426fca0-fe40-4ff1-a31b-ef25754ef7c0 tempest-TrustsV3TestJSON-1537474145 tempest-user-1354960774] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:10.291663 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c426fca0-fe40-4ff1-a31b-ef25754ef7c0 tempest-TrustsV3TestJSON-1537474145 tempest-user-1354960774] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:10.301667 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4d40b9-d9f3-48da-9cb2-313d05479fab tempest-TrustsV3TestJSON-1537474145 tempest-user-1354960774] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7499f59e4acf4bdc806507795d883486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb7419948a142dcb390312d301aa116', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1439569376', 'tempest-DelegatedRole-1245746473'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:10.302560 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d40b9-d9f3-48da-9cb2-313d05479fab tempest-TrustsV3TestJSON-1537474145 tempest-user-1354960774] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:10.302804 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d40b9-d9f3-48da-9cb2-313d05479fab tempest-TrustsV3TestJSON-1537474145 tempest-user-1354960774] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:10.304672 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d40b9-d9f3-48da-9cb2-313d05479fab tempest-TrustsV3TestJSON-1537474145 tempest-user-1354960774] PATH_INFO: `/v3/OS-TRUST/trusts/a1f9370d51e341d29e9d5bb328cee6fe` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:10.320706 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4d40b9-d9f3-48da-9cb2-313d05479fab tempest-TrustsV3TestJSON-1537474145 tempest-user-1354960774] RBAC: Authorizing `identity:delete_trust(trust_id=a1f9370d51e341d29e9d5bb328cee6fe)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:10.320706 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4d40b9-d9f3-48da-9cb2-313d05479fab tempest-TrustsV3TestJSON-1537474145 tempest-user-1354960774] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:10.422432 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6b4d40b9-d9f3-48da-9cb2-313d05479fab tempest-TrustsV3TestJSON-1537474145 tempest-user-1354960774] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'a1f9370d51e341d29e9d5bb328cee6fe', 'request_id': 'req-6b4d40b9-d9f3-48da-9cb2-313d05479fab'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:10.423243 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6b4d40b9-d9f3-48da-9cb2-313d05479fab tempest-TrustsV3TestJSON-1537474145 tempest-user-1354960774] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'a1f9370d51e341d29e9d5bb328cee6fe', 'request_id': 'req-6b4d40b9-d9f3-48da-9cb2-313d05479fab'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:10.525685 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6b4d40b9-d9f3-48da-9cb2-313d05479fab tempest-TrustsV3TestJSON-1537474145 tempest-user-1354960774] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'a1f9370d51e341d29e9d5bb328cee6fe', 'request_id': 'req-6b4d40b9-d9f3-48da-9cb2-313d05479fab'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:10.532870 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2480/4923] 10.222.0.52 () {58 vars in 1253 bytes} [Sat May 14 21:30:10 2022] DELETE /identity/v3/OS-TRUST/trusts/a1f9370d51e341d29e9d5bb328cee6fe => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:30:10.536811 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a86d43-10bd-401b-9732-626c7ccc1a7c tempest-TrustsV3TestJSON-1537474145 tempest-user-1354960774] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:10.538591 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-88a86d43-10bd-401b-9732-626c7ccc1a7c tempest-TrustsV3TestJSON-1537474145 tempest-user-1354960774] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:10.551598 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a86d43-10bd-401b-9732-626c7ccc1a7c tempest-TrustsV3TestJSON-1537474145 tempest-user-1354960774] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:10.555662 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20392d5d-8f41-40fe-a5d0-8170404da1a5 tempest-TrustsV3TestJSON-1537474145 tempest-user-1354960774] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7499f59e4acf4bdc806507795d883486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb7419948a142dcb390312d301aa116', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1439569376', 'tempest-DelegatedRole-1245746473'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:10.556487 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20392d5d-8f41-40fe-a5d0-8170404da1a5 tempest-TrustsV3TestJSON-1537474145 tempest-user-1354960774] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:10.556768 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20392d5d-8f41-40fe-a5d0-8170404da1a5 tempest-TrustsV3TestJSON-1537474145 tempest-user-1354960774] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:10.557042 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20392d5d-8f41-40fe-a5d0-8170404da1a5 tempest-TrustsV3TestJSON-1537474145 tempest-user-1354960774] PATH_INFO: `/v3/OS-TRUST/trusts/a1f9370d51e341d29e9d5bb328cee6fe` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:10.571951 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-20392d5d-8f41-40fe-a5d0-8170404da1a5 tempest-TrustsV3TestJSON-1537474145 tempest-user-1354960774] Could not find trust: a1f9370d51e341d29e9d5bb328cee6fe.: keystone.exception.TrustNotFound: Could not find trust: a1f9370d51e341d29e9d5bb328cee6fe. May 14 21:30:10.571951 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:30:10.571951 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 21:30:10.571951 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 21:30:10.571951 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 21:30:10.571951 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 21:30:10.571951 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 21:30:10.571951 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 21:30:10.571951 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 21:30:10.571951 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 21:30:10.571951 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 21:30:10.571951 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 21:30:10.571951 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get May 14 21:30:10.571951 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) May 14 21:30:10.571951 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust May 14 21:30:10.574826 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', May 14 21:30:10.574826 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call May 14 21:30:10.574826 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() May 14 21:30:10.574826 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement May 14 21:30:10.574826 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( May 14 21:30:10.574826 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 21:30:10.574826 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 21:30:10.574826 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust May 14 21:30:10.574826 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) May 14 21:30:10.574826 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust May 14 21:30:10.574826 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) May 14 21:30:10.574826 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: a1f9370d51e341d29e9d5bb328cee6fe. May 14 21:30:10.574826 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:30:10.574826 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2444/4924] 10.222.0.52 () {58 vars in 1250 bytes} [Sat May 14 21:30:10 2022] GET /identity/v3/OS-TRUST/trusts/a1f9370d51e341d29e9d5bb328cee6fe => generated 111 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 14 21:30:10.577637 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4d40b9-d9f3-48da-9cb2-313d05479fab tempest-TrustsV3TestJSON-1537474145 tempest-user-1354960774] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:10.579303 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-6b4d40b9-d9f3-48da-9cb2-313d05479fab tempest-TrustsV3TestJSON-1537474145 tempest-user-1354960774] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:10.596114 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4d40b9-d9f3-48da-9cb2-313d05479fab tempest-TrustsV3TestJSON-1537474145 tempest-user-1354960774] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:10.601167 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152b0a88-c1ff-4b1b-b07a-c34752a329da tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16df42e793ed46c8b39b78b4a4821bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1997fca61bf6406d83c93f3f98a79a84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:10.606240 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b0a88-c1ff-4b1b-b07a-c34752a329da tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:10.606240 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b0a88-c1ff-4b1b-b07a-c34752a329da tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:10.606240 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b0a88-c1ff-4b1b-b07a-c34752a329da tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] PATH_INFO: `/v3/roles/4e560790295640d680c553a224e04b76` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:10.606240 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152b0a88-c1ff-4b1b-b07a-c34752a329da tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorizing `identity:delete_role(role_id=4e560790295640d680c553a224e04b76)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:10.606240 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152b0a88-c1ff-4b1b-b07a-c34752a329da tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:10.754214 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-152b0a88-c1ff-4b1b-b07a-c34752a329da tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invalidating the token cache because role 4e560790295640d680c553a224e04b76 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:30:10.754499 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-152b0a88-c1ff-4b1b-b07a-c34752a329da tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:10.755172 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-152b0a88-c1ff-4b1b-b07a-c34752a329da tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:10.757073 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2481/4925] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:30:10 2022] DELETE /identity/v3/roles/4e560790295640d680c553a224e04b76 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:30:10.761162 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20392d5d-8f41-40fe-a5d0-8170404da1a5 tempest-TrustsV3TestJSON-1537474145 tempest-user-1354960774] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:10.763042 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-20392d5d-8f41-40fe-a5d0-8170404da1a5 tempest-TrustsV3TestJSON-1537474145 tempest-user-1354960774] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:10.780033 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20392d5d-8f41-40fe-a5d0-8170404da1a5 tempest-TrustsV3TestJSON-1537474145 tempest-user-1354960774] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:10.837275 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58db39d0-1489-43c9-bb28-4ca516a65b3d tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16df42e793ed46c8b39b78b4a4821bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1997fca61bf6406d83c93f3f98a79a84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:10.838043 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db39d0-1489-43c9-bb28-4ca516a65b3d tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:10.838353 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db39d0-1489-43c9-bb28-4ca516a65b3d tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:10.838843 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db39d0-1489-43c9-bb28-4ca516a65b3d tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] PATH_INFO: `/v3/roles/f19b0621ad3840d8a83770a94adfa8bc` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:10.840367 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58db39d0-1489-43c9-bb28-4ca516a65b3d tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorizing `identity:delete_role(role_id=f19b0621ad3840d8a83770a94adfa8bc)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:10.842082 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58db39d0-1489-43c9-bb28-4ca516a65b3d tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:11.096844 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-58db39d0-1489-43c9-bb28-4ca516a65b3d tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invalidating the token cache because role f19b0621ad3840d8a83770a94adfa8bc has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:30:11.097045 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-58db39d0-1489-43c9-bb28-4ca516a65b3d tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:11.097815 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-58db39d0-1489-43c9-bb28-4ca516a65b3d tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:11.099641 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2445/4926] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:30:10 2022] DELETE /identity/v3/roles/f19b0621ad3840d8a83770a94adfa8bc => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:30:11.105589 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152b0a88-c1ff-4b1b-b07a-c34752a329da tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:11.117576 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152b0a88-c1ff-4b1b-b07a-c34752a329da tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:11.180322 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109f273d-c7fb-4897-b632-6025f8092601 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16df42e793ed46c8b39b78b4a4821bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1997fca61bf6406d83c93f3f98a79a84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:11.181203 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f273d-c7fb-4897-b632-6025f8092601 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:11.181491 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f273d-c7fb-4897-b632-6025f8092601 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:11.181773 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f273d-c7fb-4897-b632-6025f8092601 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] PATH_INFO: `/v3/users/7499f59e4acf4bdc806507795d883486` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:11.183003 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109f273d-c7fb-4897-b632-6025f8092601 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorizing `identity:delete_user(user_id=7499f59e4acf4bdc806507795d883486)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:11.184974 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109f273d-c7fb-4897-b632-6025f8092601 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:11.321625 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-109f273d-c7fb-4897-b632-6025f8092601 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7499f59e4acf4bdc806507795d883486'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:11.338921 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-109f273d-c7fb-4897-b632-6025f8092601 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7499f59e4acf4bdc806507795d883486'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:11.348103 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-109f273d-c7fb-4897-b632-6025f8092601 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7499f59e4acf4bdc806507795d883486'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:11.442360 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-109f273d-c7fb-4897-b632-6025f8092601 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7499f59e4acf4bdc806507795d883486'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:11.443169 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-109f273d-c7fb-4897-b632-6025f8092601 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7499f59e4acf4bdc806507795d883486'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:11.456355 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2482/4927] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:30:11 2022] DELETE /identity/v3/users/7499f59e4acf4bdc806507795d883486 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:30:11.460107 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58db39d0-1489-43c9-bb28-4ca516a65b3d tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:11.461652 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-58db39d0-1489-43c9-bb28-4ca516a65b3d tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:11.476421 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58db39d0-1489-43c9-bb28-4ca516a65b3d tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:11.536833 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19539ebe-358c-4d61-89c9-a423cd4fb422 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16df42e793ed46c8b39b78b4a4821bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1997fca61bf6406d83c93f3f98a79a84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:11.537689 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19539ebe-358c-4d61-89c9-a423cd4fb422 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:11.537974 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19539ebe-358c-4d61-89c9-a423cd4fb422 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:11.538258 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19539ebe-358c-4d61-89c9-a423cd4fb422 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] PATH_INFO: `/v3/projects/4fb7419948a142dcb390312d301aa116` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:11.539423 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19539ebe-358c-4d61-89c9-a423cd4fb422 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4fb7419948a142dcb390312d301aa116)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:11.541376 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19539ebe-358c-4d61-89c9-a423cd4fb422 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:11.781877 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-19539ebe-358c-4d61-89c9-a423cd4fb422 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fb7419948a142dcb390312d301aa116', 'request_id': 'req-19539ebe-358c-4d61-89c9-a423cd4fb422'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:11.787693 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-19539ebe-358c-4d61-89c9-a423cd4fb422 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fb7419948a142dcb390312d301aa116', 'request_id': 'req-19539ebe-358c-4d61-89c9-a423cd4fb422'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:11.794129 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-19539ebe-358c-4d61-89c9-a423cd4fb422 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fb7419948a142dcb390312d301aa116', 'request_id': 'req-19539ebe-358c-4d61-89c9-a423cd4fb422'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:11.887968 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-19539ebe-358c-4d61-89c9-a423cd4fb422 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] The token cache is being invalidate because project 4fb7419948a142dcb390312d301aa116 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:30:11.888584 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-19539ebe-358c-4d61-89c9-a423cd4fb422 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:11.889243 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-19539ebe-358c-4d61-89c9-a423cd4fb422 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:11.892368 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2446/4928] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:30:11 2022] DELETE /identity/v3/projects/4fb7419948a142dcb390312d301aa116 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:30:11.896934 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109f273d-c7fb-4897-b632-6025f8092601 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:11.898486 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-109f273d-c7fb-4897-b632-6025f8092601 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:11.974374 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109f273d-c7fb-4897-b632-6025f8092601 tempest-TrustsV3TestJSON-930009949 tempest-TrustsV3TestJSON-930009949-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:12.033225 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f2e5d1-80ff-4bab-9546-60c5532bc589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:12.034089 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2e5d1-80ff-4bab-9546-60c5532bc589 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:12.034400 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2e5d1-80ff-4bab-9546-60c5532bc589 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:12.034672 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2e5d1-80ff-4bab-9546-60c5532bc589 admin admin] PATH_INFO: `/v3/users/34734045c67c43ad83059b9534b2be1d` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:12.035916 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f2e5d1-80ff-4bab-9546-60c5532bc589 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34734045c67c43ad83059b9534b2be1d)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:12.037883 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f2e5d1-80ff-4bab-9546-60c5532bc589 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:12.237388 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-68f2e5d1-80ff-4bab-9546-60c5532bc589 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34734045c67c43ad83059b9534b2be1d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:12.249215 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-68f2e5d1-80ff-4bab-9546-60c5532bc589 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34734045c67c43ad83059b9534b2be1d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:12.256070 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-68f2e5d1-80ff-4bab-9546-60c5532bc589 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34734045c67c43ad83059b9534b2be1d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:12.357873 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-68f2e5d1-80ff-4bab-9546-60c5532bc589 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34734045c67c43ad83059b9534b2be1d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:12.357873 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-68f2e5d1-80ff-4bab-9546-60c5532bc589 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34734045c67c43ad83059b9534b2be1d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:12.362159 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2483/4929] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:30:11 2022] DELETE /identity/v3/users/34734045c67c43ad83059b9534b2be1d => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:30:12.366854 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa8d8f1-bd54-4faf-b6dc-902348c2c21e None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:12.367207 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa8d8f1-bd54-4faf-b6dc-902348c2c21e None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:12.367584 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa8d8f1-bd54-4faf-b6dc-902348c2c21e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:12.386056 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-efa8d8f1-bd54-4faf-b6dc-902348c2c21e None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:30:12.387309 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-efa8d8f1-bd54-4faf-b6dc-902348c2c21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:12.448253 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2447/4930] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:30:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:30:12.458457 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f2e5d1-80ff-4bab-9546-60c5532bc589 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:12.461628 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-68f2e5d1-80ff-4bab-9546-60c5532bc589 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:12.531523 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f2e5d1-80ff-4bab-9546-60c5532bc589 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:12.536275 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e0aea1-a3c3-418c-9de4-8e02e67ec60f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:12.542045 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e0aea1-a3c3-418c-9de4-8e02e67ec60f service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:12.542045 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e0aea1-a3c3-418c-9de4-8e02e67ec60f service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:12.542045 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e0aea1-a3c3-418c-9de4-8e02e67ec60f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:12.549326 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e0aea1-a3c3-418c-9de4-8e02e67ec60f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:12.550915 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e0aea1-a3c3-418c-9de4-8e02e67ec60f service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:12.564945 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2484/4931] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:30:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:30:13.121647 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa8d8f1-bd54-4faf-b6dc-902348c2c21e None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:13.128717 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-efa8d8f1-bd54-4faf-b6dc-902348c2c21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:13.157549 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa8d8f1-bd54-4faf-b6dc-902348c2c21e None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:13.177658 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b807d395-03e1-48db-86f9-dca43d8012b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:13.178599 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807d395-03e1-48db-86f9-dca43d8012b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:13.178887 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807d395-03e1-48db-86f9-dca43d8012b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:13.179290 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807d395-03e1-48db-86f9-dca43d8012b3 admin admin] PATH_INFO: `/v3/projects/bd8d784d8f854be4b5ba531c38b6aaf2` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:13.180627 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b807d395-03e1-48db-86f9-dca43d8012b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd8d784d8f854be4b5ba531c38b6aaf2)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:13.189562 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b807d395-03e1-48db-86f9-dca43d8012b3 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:13.355103 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b807d395-03e1-48db-86f9-dca43d8012b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd8d784d8f854be4b5ba531c38b6aaf2', 'request_id': 'req-b807d395-03e1-48db-86f9-dca43d8012b3'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:13.361546 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b807d395-03e1-48db-86f9-dca43d8012b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd8d784d8f854be4b5ba531c38b6aaf2', 'request_id': 'req-b807d395-03e1-48db-86f9-dca43d8012b3'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:13.368540 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b807d395-03e1-48db-86f9-dca43d8012b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd8d784d8f854be4b5ba531c38b6aaf2', 'request_id': 'req-b807d395-03e1-48db-86f9-dca43d8012b3'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:13.435501 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b807d395-03e1-48db-86f9-dca43d8012b3 admin admin] The token cache is being invalidate because project bd8d784d8f854be4b5ba531c38b6aaf2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:30:13.436248 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b807d395-03e1-48db-86f9-dca43d8012b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:13.436479 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b807d395-03e1-48db-86f9-dca43d8012b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:13.438109 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2448/4932] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:30:13 2022] DELETE /identity/v3/projects/bd8d784d8f854be4b5ba531c38b6aaf2 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:30:13.442247 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e0aea1-a3c3-418c-9de4-8e02e67ec60f service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:13.452709 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e0aea1-a3c3-418c-9de4-8e02e67ec60f service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:13.514863 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595f75a2-94e5-4e44-866b-df64f856de37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:13.516780 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f75a2-94e5-4e44-866b-df64f856de37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:13.517074 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f75a2-94e5-4e44-866b-df64f856de37 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:13.517351 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f75a2-94e5-4e44-866b-df64f856de37 admin admin] PATH_INFO: `/v3/users/16df42e793ed46c8b39b78b4a4821bb9` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:13.518669 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595f75a2-94e5-4e44-866b-df64f856de37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16df42e793ed46c8b39b78b4a4821bb9)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:13.520661 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595f75a2-94e5-4e44-866b-df64f856de37 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:13.753121 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-595f75a2-94e5-4e44-866b-df64f856de37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16df42e793ed46c8b39b78b4a4821bb9'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:13.765472 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-595f75a2-94e5-4e44-866b-df64f856de37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16df42e793ed46c8b39b78b4a4821bb9'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:13.773780 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-595f75a2-94e5-4e44-866b-df64f856de37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16df42e793ed46c8b39b78b4a4821bb9'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:13.879354 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-595f75a2-94e5-4e44-866b-df64f856de37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16df42e793ed46c8b39b78b4a4821bb9'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:13.880025 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-595f75a2-94e5-4e44-866b-df64f856de37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16df42e793ed46c8b39b78b4a4821bb9'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:13.886831 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2485/4933] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:30:13 2022] DELETE /identity/v3/users/16df42e793ed46c8b39b78b4a4821bb9 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:30:14.429499 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b807d395-03e1-48db-86f9-dca43d8012b3 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:14.435344 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b807d395-03e1-48db-86f9-dca43d8012b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:14.455839 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b807d395-03e1-48db-86f9-dca43d8012b3 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:14.520226 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52e51ca-8e66-48d8-a06c-73657a3976b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:14.521415 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e51ca-8e66-48d8-a06c-73657a3976b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:14.521696 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e51ca-8e66-48d8-a06c-73657a3976b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:14.521972 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e51ca-8e66-48d8-a06c-73657a3976b3 admin admin] PATH_INFO: `/v3/projects/1997fca61bf6406d83c93f3f98a79a84` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:14.523192 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52e51ca-8e66-48d8-a06c-73657a3976b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1997fca61bf6406d83c93f3f98a79a84)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:14.525241 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52e51ca-8e66-48d8-a06c-73657a3976b3 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:14.649031 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e52e51ca-8e66-48d8-a06c-73657a3976b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1997fca61bf6406d83c93f3f98a79a84', 'request_id': 'req-e52e51ca-8e66-48d8-a06c-73657a3976b3'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:14.655390 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e52e51ca-8e66-48d8-a06c-73657a3976b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1997fca61bf6406d83c93f3f98a79a84', 'request_id': 'req-e52e51ca-8e66-48d8-a06c-73657a3976b3'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:14.663146 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e52e51ca-8e66-48d8-a06c-73657a3976b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1997fca61bf6406d83c93f3f98a79a84', 'request_id': 'req-e52e51ca-8e66-48d8-a06c-73657a3976b3'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:14.731958 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e52e51ca-8e66-48d8-a06c-73657a3976b3 admin admin] The token cache is being invalidate because project 1997fca61bf6406d83c93f3f98a79a84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:30:14.732278 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e52e51ca-8e66-48d8-a06c-73657a3976b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:14.732970 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e52e51ca-8e66-48d8-a06c-73657a3976b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:14.742657 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2449/4934] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:30:14 2022] DELETE /identity/v3/projects/1997fca61bf6406d83c93f3f98a79a84 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:30:14.752251 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074d958-49ec-4abe-a6bd-dcba7607da2a None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:14.752251 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074d958-49ec-4abe-a6bd-dcba7607da2a None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:14.752251 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074d958-49ec-4abe-a6bd-dcba7607da2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:14.767989 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-2074d958-49ec-4abe-a6bd-dcba7607da2a None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:30:14.769456 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-2074d958-49ec-4abe-a6bd-dcba7607da2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:14.841804 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2486/4935] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:30:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:30:14.850379 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f723677-f874-45dc-a608-eba9f264f7db None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:14.850671 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f723677-f874-45dc-a608-eba9f264f7db None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:14.850955 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f723677-f874-45dc-a608-eba9f264f7db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:14.879966 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-5f723677-f874-45dc-a608-eba9f264f7db None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:30:14.881226 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-5f723677-f874-45dc-a608-eba9f264f7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:14.892776 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2450/4936] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:30:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:30:14.897881 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2074d958-49ec-4abe-a6bd-dcba7607da2a None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:14.908788 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2074d958-49ec-4abe-a6bd-dcba7607da2a None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:14.913826 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bceaae-11c6-4766-b6da-31d266b7085e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:14.914576 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bceaae-11c6-4766-b6da-31d266b7085e admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:14.914866 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bceaae-11c6-4766-b6da-31d266b7085e admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:14.915102 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bceaae-11c6-4766-b6da-31d266b7085e admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:14.915872 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bceaae-11c6-4766-b6da-31d266b7085e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:30:14.916179 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bceaae-11c6-4766-b6da-31d266b7085e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:14.917788 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bceaae-11c6-4766-b6da-31d266b7085e admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:14.934021 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2487/4937] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:30:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:30:14.939316 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f723677-f874-45dc-a608-eba9f264f7db None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:14.952732 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f723677-f874-45dc-a608-eba9f264f7db None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:14.957876 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61aabbb-858b-4c48-a3fe-37c91b1bfff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:14.958561 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61aabbb-858b-4c48-a3fe-37c91b1bfff7 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:14.960304 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61aabbb-858b-4c48-a3fe-37c91b1bfff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:14.960304 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61aabbb-858b-4c48-a3fe-37c91b1bfff7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:14.960304 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61aabbb-858b-4c48-a3fe-37c91b1bfff7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:14.962158 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61aabbb-858b-4c48-a3fe-37c91b1bfff7 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:15.075859 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2451/4938] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:30:14 2022] POST /identity/v3/projects => generated 371 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:30:15.081018 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bceaae-11c6-4766-b6da-31d266b7085e admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:15.090784 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bceaae-11c6-4766-b6da-31d266b7085e admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:15.156382 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcaef5b-facb-42aa-882d-92219f9ad944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:15.157583 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcaef5b-facb-42aa-882d-92219f9ad944 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:15.157939 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcaef5b-facb-42aa-882d-92219f9ad944 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:15.158220 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcaef5b-facb-42aa-882d-92219f9ad944 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:15.158928 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcaef5b-facb-42aa-882d-92219f9ad944 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:15.169183 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcaef5b-facb-42aa-882d-92219f9ad944 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:15.264124 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2488/4939] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:30:15 2022] POST /identity/v3/users => generated 286 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:30:15.274796 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61aabbb-858b-4c48-a3fe-37c91b1bfff7 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:15.285909 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61aabbb-858b-4c48-a3fe-37c91b1bfff7 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:15.291203 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291dfe8d-693d-417e-831b-dd875786e369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:15.291988 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291dfe8d-693d-417e-831b-dd875786e369 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:15.292372 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291dfe8d-693d-417e-831b-dd875786e369 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:15.292722 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291dfe8d-693d-417e-831b-dd875786e369 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:15.293556 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291dfe8d-693d-417e-831b-dd875786e369 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:15.295437 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291dfe8d-693d-417e-831b-dd875786e369 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:15.313370 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2452/4940] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:30:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:30:15.317403 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcaef5b-facb-42aa-882d-92219f9ad944 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:15.329615 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcaef5b-facb-42aa-882d-92219f9ad944 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:15.336485 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e07a4a-c84c-42a0-b4da-c1911dd3e913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:15.337159 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e07a4a-c84c-42a0-b4da-c1911dd3e913 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:15.337437 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e07a4a-c84c-42a0-b4da-c1911dd3e913 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:15.337849 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e07a4a-c84c-42a0-b4da-c1911dd3e913 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:15.338437 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e07a4a-c84c-42a0-b4da-c1911dd3e913 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:15.340486 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e07a4a-c84c-42a0-b4da-c1911dd3e913 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:15.355850 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2489/4941] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:30:15 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:30:15.360805 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291dfe8d-693d-417e-831b-dd875786e369 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:15.381029 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291dfe8d-693d-417e-831b-dd875786e369 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:15.386776 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069cb2f3-e7ca-4d13-a2c5-f3579259f494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:15.387584 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069cb2f3-e7ca-4d13-a2c5-f3579259f494 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:15.387875 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069cb2f3-e7ca-4d13-a2c5-f3579259f494 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:15.388141 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069cb2f3-e7ca-4d13-a2c5-f3579259f494 admin admin] PATH_INFO: `/v3/projects/e27046a7e03743feb36a5e793f293754/users/5a0d3653a7424971845d48068f378808/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:15.411932 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069cb2f3-e7ca-4d13-a2c5-f3579259f494 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e27046a7e03743feb36a5e793f293754, user_id=5a0d3653a7424971845d48068f378808, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:15.415206 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069cb2f3-e7ca-4d13-a2c5-f3579259f494 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:15.494619 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2453/4942] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:30:15 2022] PUT /identity/v3/projects/e27046a7e03743feb36a5e793f293754/users/5a0d3653a7424971845d48068f378808/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:30:15.504879 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73907276-9e31-42f4-aaa8-5665415587b4 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:15.505206 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73907276-9e31-42f4-aaa8-5665415587b4 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:15.505493 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73907276-9e31-42f4-aaa8-5665415587b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:15.534991 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-73907276-9e31-42f4-aaa8-5665415587b4 None None] MFA Rules not processed for user `5a0d3653a7424971845d48068f378808`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:30:15.536378 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-73907276-9e31-42f4-aaa8-5665415587b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:15.605931 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2490/4943] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:30:15 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:30:15.611384 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069cb2f3-e7ca-4d13-a2c5-f3579259f494 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:15.621483 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069cb2f3-e7ca-4d13-a2c5-f3579259f494 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:15.626233 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce6170-2536-45f6-881a-8545315d3563 tempest-AccessRulesV3Test-1705547817 tempest-AccessRulesV3Test-1705547817-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0d3653a7424971845d48068f378808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e27046a7e03743feb36a5e793f293754', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:15.627082 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce6170-2536-45f6-881a-8545315d3563 tempest-AccessRulesV3Test-1705547817 tempest-AccessRulesV3Test-1705547817-project] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:15.627425 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce6170-2536-45f6-881a-8545315d3563 tempest-AccessRulesV3Test-1705547817 tempest-AccessRulesV3Test-1705547817-project] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:15.627720 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce6170-2536-45f6-881a-8545315d3563 tempest-AccessRulesV3Test-1705547817 tempest-AccessRulesV3Test-1705547817-project] PATH_INFO: `/v3/users/5a0d3653a7424971845d48068f378808/application_credentials` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:15.629047 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ce6170-2536-45f6-881a-8545315d3563 tempest-AccessRulesV3Test-1705547817 tempest-AccessRulesV3Test-1705547817-project] RBAC: Authorizing `identity:create_application_credential(user_id=5a0d3653a7424971845d48068f378808)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:15.630197 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ce6170-2536-45f6-881a-8545315d3563 tempest-AccessRulesV3Test-1705547817 tempest-AccessRulesV3Test-1705547817-project] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:15.857191 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2454/4944] 10.222.0.52 () {60 vars in 1314 bytes} [Sat May 14 21:30:15 2022] POST /identity/v3/users/5a0d3653a7424971845d48068f378808/application_credentials => generated 919 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:30:15.861773 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73907276-9e31-42f4-aaa8-5665415587b4 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:15.871069 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73907276-9e31-42f4-aaa8-5665415587b4 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:15.875904 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3248b4da-f1dd-4f94-88dc-6b70470ab12e tempest-AccessRulesV3Test-1705547817 tempest-AccessRulesV3Test-1705547817-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0d3653a7424971845d48068f378808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e27046a7e03743feb36a5e793f293754', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:15.876837 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248b4da-f1dd-4f94-88dc-6b70470ab12e tempest-AccessRulesV3Test-1705547817 tempest-AccessRulesV3Test-1705547817-project] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:15.878139 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248b4da-f1dd-4f94-88dc-6b70470ab12e tempest-AccessRulesV3Test-1705547817 tempest-AccessRulesV3Test-1705547817-project] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:15.878427 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248b4da-f1dd-4f94-88dc-6b70470ab12e tempest-AccessRulesV3Test-1705547817 tempest-AccessRulesV3Test-1705547817-project] PATH_INFO: `/v3/users/5a0d3653a7424971845d48068f378808/access_rules/cd3bb5c65caa45698950032bb31b1159` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:15.879677 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3248b4da-f1dd-4f94-88dc-6b70470ab12e tempest-AccessRulesV3Test-1705547817 tempest-AccessRulesV3Test-1705547817-project] RBAC: Authorizing `identity:delete_access_rule(user_id=5a0d3653a7424971845d48068f378808, access_rule_id=cd3bb5c65caa45698950032bb31b1159)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:15.881031 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3248b4da-f1dd-4f94-88dc-6b70470ab12e tempest-AccessRulesV3Test-1705547817 tempest-AccessRulesV3Test-1705547817-project] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:15.935132 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-3248b4da-f1dd-4f94-88dc-6b70470ab12e tempest-AccessRulesV3Test-1705547817 tempest-AccessRulesV3Test-1705547817-project] May not delete access rule in use: keystone.exception.ForbiddenNotSecurity: May not delete access rule in use May 14 21:30:15.935132 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:30:15.935132 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 256, in delete_access_rule May 14 21:30:15.935132 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application session.delete(ref) May 14 21:30:15.935132 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 14 21:30:15.935132 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application next(self.gen) May 14 21:30:15.935132 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 14 21:30:15.935132 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application yield resource May 14 21:30:15.935132 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 14 21:30:15.935132 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application next(self.gen) May 14 21:30:15.935132 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 14 21:30:15.935132 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application self.session.rollback() May 14 21:30:15.935132 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 14 21:30:15.935132 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application self.force_reraise() May 14 21:30:15.935132 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 14 21:30:15.935132 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise self.value May 14 21:30:15.936685 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 14 21:30:15.936685 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 14 21:30:15.936685 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 14 21:30:15.936685 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application session.commit() May 14 21:30:15.936685 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 14 21:30:15.936685 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 14 21:30:15.936685 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 14 21:30:15.936685 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application self._prepare_impl() May 14 21:30:15.936685 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 14 21:30:15.936685 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application self.session.flush() May 14 21:30:15.936685 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 14 21:30:15.936685 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application self._flush(objects) May 14 21:30:15.936685 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 14 21:30:15.936685 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 14 21:30:15.936685 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 14 21:30:15.936685 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application compat.raise_( May 14 21:30:15.938725 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 14 21:30:15.938725 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception May 14 21:30:15.938725 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 14 21:30:15.938725 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application flush_context.execute() May 14 21:30:15.938725 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 14 21:30:15.938725 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rec.execute(self) May 14 21:30:15.938725 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 577, in execute May 14 21:30:15.938725 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application self.dependency_processor.process_deletes(uow, states) May 14 21:30:15.938725 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 552, in process_deletes May 14 21:30:15.938725 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application self._synchronize( May 14 21:30:15.938725 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 610, in _synchronize May 14 21:30:15.938725 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application sync.clear(dest, self.mapper, self.prop.synchronize_pairs) May 14 21:30:15.938725 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/sync.py", line 86, in clear May 14 21:30:15.938725 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise AssertionError( May 14 21:30:15.938725 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application AssertionError: Dependency rule tried to blank-out primary key column 'application_credential_access_rule.access_rule_id' on instance '' May 14 21:30:15.938725 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:30:15.940048 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 21:30:15.940048 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:30:15.940048 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:30:15.940048 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 21:30:15.940048 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 21:30:15.940048 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 21:30:15.940048 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 21:30:15.940048 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 21:30:15.940048 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 21:30:15.940048 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 21:30:15.940048 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 21:30:15.940048 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 21:30:15.940048 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 21:30:15.940048 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 763, in delete May 14 21:30:15.940048 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application PROVIDERS.application_credential_api.delete_access_rule( May 14 21:30:15.940048 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 21:30:15.940048 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 21:30:15.941531 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/core.py", line 252, in delete_access_rule May 14 21:30:15.941531 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application self.driver.delete_access_rule(access_rule_id) May 14 21:30:15.941531 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 258, in delete_access_rule May 14 21:30:15.941531 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( May 14 21:30:15.941531 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: May not delete access rule in use May 14 21:30:15.941531 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:30:15.941531 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2491/4945] 10.222.0.52 () {58 vars in 1361 bytes} [Sat May 14 21:30:15 2022] DELETE /identity/v3/users/5a0d3653a7424971845d48068f378808/access_rules/cd3bb5c65caa45698950032bb31b1159 => generated 89 bytes in 75 msecs (HTTP/1.1 403) 5 headers in 183 bytes (1 switches on core 0) May 14 21:30:15.943454 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce6170-2536-45f6-881a-8545315d3563 tempest-AccessRulesV3Test-1705547817 tempest-AccessRulesV3Test-1705547817-project] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:15.954128 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce6170-2536-45f6-881a-8545315d3563 tempest-AccessRulesV3Test-1705547817 tempest-AccessRulesV3Test-1705547817-project] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:15.958417 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9085cb62-0b1f-4e71-b12d-3e46ff405df6 tempest-AccessRulesV3Test-1705547817 tempest-AccessRulesV3Test-1705547817-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0d3653a7424971845d48068f378808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e27046a7e03743feb36a5e793f293754', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:15.959349 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085cb62-0b1f-4e71-b12d-3e46ff405df6 tempest-AccessRulesV3Test-1705547817 tempest-AccessRulesV3Test-1705547817-project] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:15.959696 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085cb62-0b1f-4e71-b12d-3e46ff405df6 tempest-AccessRulesV3Test-1705547817 tempest-AccessRulesV3Test-1705547817-project] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:15.959971 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085cb62-0b1f-4e71-b12d-3e46ff405df6 tempest-AccessRulesV3Test-1705547817 tempest-AccessRulesV3Test-1705547817-project] PATH_INFO: `/v3/users/5a0d3653a7424971845d48068f378808/application_credentials/14d293fcf0ec4ca087bc0b422b32fa00` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:15.975576 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9085cb62-0b1f-4e71-b12d-3e46ff405df6 tempest-AccessRulesV3Test-1705547817 tempest-AccessRulesV3Test-1705547817-project] RBAC: Authorizing `identity:delete_application_credential(user_id=5a0d3653a7424971845d48068f378808, application_credential_id=14d293fcf0ec4ca087bc0b422b32fa00)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:15.977023 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9085cb62-0b1f-4e71-b12d-3e46ff405df6 tempest-AccessRulesV3Test-1705547817 tempest-AccessRulesV3Test-1705547817-project] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:16.126970 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2455/4946] 10.222.0.52 () {58 vars in 1394 bytes} [Sat May 14 21:30:15 2022] DELETE /identity/v3/users/5a0d3653a7424971845d48068f378808/application_credentials/14d293fcf0ec4ca087bc0b422b32fa00 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:30:16.130895 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3248b4da-f1dd-4f94-88dc-6b70470ab12e tempest-AccessRulesV3Test-1705547817 tempest-AccessRulesV3Test-1705547817-project] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:16.146417 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3248b4da-f1dd-4f94-88dc-6b70470ab12e tempest-AccessRulesV3Test-1705547817 tempest-AccessRulesV3Test-1705547817-project] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:16.151008 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d9e8bc-966c-48e5-92e4-4d40d28b29d5 tempest-AccessRulesV3Test-1705547817 tempest-AccessRulesV3Test-1705547817-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0d3653a7424971845d48068f378808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e27046a7e03743feb36a5e793f293754', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:16.151919 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d9e8bc-966c-48e5-92e4-4d40d28b29d5 tempest-AccessRulesV3Test-1705547817 tempest-AccessRulesV3Test-1705547817-project] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:16.152206 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d9e8bc-966c-48e5-92e4-4d40d28b29d5 tempest-AccessRulesV3Test-1705547817 tempest-AccessRulesV3Test-1705547817-project] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:16.152536 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d9e8bc-966c-48e5-92e4-4d40d28b29d5 tempest-AccessRulesV3Test-1705547817 tempest-AccessRulesV3Test-1705547817-project] PATH_INFO: `/v3/users/5a0d3653a7424971845d48068f378808/access_rules` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:16.153778 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d9e8bc-966c-48e5-92e4-4d40d28b29d5 tempest-AccessRulesV3Test-1705547817 tempest-AccessRulesV3Test-1705547817-project] RBAC: Authorizing `identity:list_access_rules(user_id=5a0d3653a7424971845d48068f378808)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:16.155307 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d9e8bc-966c-48e5-92e4-4d40d28b29d5 tempest-AccessRulesV3Test-1705547817 tempest-AccessRulesV3Test-1705547817-project] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:16.162392 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2492/4947] 10.222.0.52 () {58 vars in 1259 bytes} [Sat May 14 21:30:16 2022] GET /identity/v3/users/5a0d3653a7424971845d48068f378808/access_rules => generated 369 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:30:16.166779 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9085cb62-0b1f-4e71-b12d-3e46ff405df6 tempest-AccessRulesV3Test-1705547817 tempest-AccessRulesV3Test-1705547817-project] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:16.181453 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9085cb62-0b1f-4e71-b12d-3e46ff405df6 tempest-AccessRulesV3Test-1705547817 tempest-AccessRulesV3Test-1705547817-project] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:16.185807 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb88bd64-db0d-409e-a38a-34ca3a5a852d tempest-AccessRulesV3Test-1705547817 tempest-AccessRulesV3Test-1705547817-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0d3653a7424971845d48068f378808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e27046a7e03743feb36a5e793f293754', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:16.187398 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb88bd64-db0d-409e-a38a-34ca3a5a852d tempest-AccessRulesV3Test-1705547817 tempest-AccessRulesV3Test-1705547817-project] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:16.187398 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb88bd64-db0d-409e-a38a-34ca3a5a852d tempest-AccessRulesV3Test-1705547817 tempest-AccessRulesV3Test-1705547817-project] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:16.187398 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb88bd64-db0d-409e-a38a-34ca3a5a852d tempest-AccessRulesV3Test-1705547817 tempest-AccessRulesV3Test-1705547817-project] PATH_INFO: `/v3/users/5a0d3653a7424971845d48068f378808/access_rules/cd3bb5c65caa45698950032bb31b1159` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:16.188511 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb88bd64-db0d-409e-a38a-34ca3a5a852d tempest-AccessRulesV3Test-1705547817 tempest-AccessRulesV3Test-1705547817-project] RBAC: Authorizing `identity:delete_access_rule(user_id=5a0d3653a7424971845d48068f378808, access_rule_id=cd3bb5c65caa45698950032bb31b1159)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:16.189872 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb88bd64-db0d-409e-a38a-34ca3a5a852d tempest-AccessRulesV3Test-1705547817 tempest-AccessRulesV3Test-1705547817-project] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:16.269150 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2456/4948] 10.222.0.52 () {58 vars in 1361 bytes} [Sat May 14 21:30:16 2022] DELETE /identity/v3/users/5a0d3653a7424971845d48068f378808/access_rules/cd3bb5c65caa45698950032bb31b1159 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:30:16.273061 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d9e8bc-966c-48e5-92e4-4d40d28b29d5 tempest-AccessRulesV3Test-1705547817 tempest-AccessRulesV3Test-1705547817-project] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:16.288145 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d9e8bc-966c-48e5-92e4-4d40d28b29d5 tempest-AccessRulesV3Test-1705547817 tempest-AccessRulesV3Test-1705547817-project] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:16.293365 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea86bbc-5066-4d6e-8e71-111c0ef1c929 tempest-AccessRulesV3Test-1705547817 tempest-AccessRulesV3Test-1705547817-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0d3653a7424971845d48068f378808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e27046a7e03743feb36a5e793f293754', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:16.294226 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea86bbc-5066-4d6e-8e71-111c0ef1c929 tempest-AccessRulesV3Test-1705547817 tempest-AccessRulesV3Test-1705547817-project] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:16.294509 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea86bbc-5066-4d6e-8e71-111c0ef1c929 tempest-AccessRulesV3Test-1705547817 tempest-AccessRulesV3Test-1705547817-project] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:16.294785 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea86bbc-5066-4d6e-8e71-111c0ef1c929 tempest-AccessRulesV3Test-1705547817 tempest-AccessRulesV3Test-1705547817-project] PATH_INFO: `/v3/users/5a0d3653a7424971845d48068f378808/access_rules` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:16.296097 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea86bbc-5066-4d6e-8e71-111c0ef1c929 tempest-AccessRulesV3Test-1705547817 tempest-AccessRulesV3Test-1705547817-project] RBAC: Authorizing `identity:list_access_rules(user_id=5a0d3653a7424971845d48068f378808)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:16.298118 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea86bbc-5066-4d6e-8e71-111c0ef1c929 tempest-AccessRulesV3Test-1705547817 tempest-AccessRulesV3Test-1705547817-project] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:16.303002 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2493/4949] 10.222.0.52 () {58 vars in 1259 bytes} [Sat May 14 21:30:16 2022] GET /identity/v3/users/5a0d3653a7424971845d48068f378808/access_rules => generated 158 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:30:16.308488 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb88bd64-db0d-409e-a38a-34ca3a5a852d tempest-AccessRulesV3Test-1705547817 tempest-AccessRulesV3Test-1705547817-project] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:16.318961 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb88bd64-db0d-409e-a38a-34ca3a5a852d tempest-AccessRulesV3Test-1705547817 tempest-AccessRulesV3Test-1705547817-project] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:16.323173 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fbb9f8-57d0-4641-81f6-a1cce05df6f6 tempest-AccessRulesV3Test-1705547817 tempest-AccessRulesV3Test-1705547817-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0d3653a7424971845d48068f378808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e27046a7e03743feb36a5e793f293754', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:16.324117 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fbb9f8-57d0-4641-81f6-a1cce05df6f6 tempest-AccessRulesV3Test-1705547817 tempest-AccessRulesV3Test-1705547817-project] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:16.324401 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fbb9f8-57d0-4641-81f6-a1cce05df6f6 tempest-AccessRulesV3Test-1705547817 tempest-AccessRulesV3Test-1705547817-project] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:16.324679 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fbb9f8-57d0-4641-81f6-a1cce05df6f6 tempest-AccessRulesV3Test-1705547817 tempest-AccessRulesV3Test-1705547817-project] PATH_INFO: `/v3/users/5a0d3653a7424971845d48068f378808/application_credentials` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:16.325410 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fbb9f8-57d0-4641-81f6-a1cce05df6f6 tempest-AccessRulesV3Test-1705547817 tempest-AccessRulesV3Test-1705547817-project] RBAC: Authorizing `identity:create_application_credential(user_id=5a0d3653a7424971845d48068f378808)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:16.326590 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fbb9f8-57d0-4641-81f6-a1cce05df6f6 tempest-AccessRulesV3Test-1705547817 tempest-AccessRulesV3Test-1705547817-project] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:16.452662 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2457/4950] 10.222.0.52 () {60 vars in 1314 bytes} [Sat May 14 21:30:16 2022] POST /identity/v3/users/5a0d3653a7424971845d48068f378808/application_credentials => generated 921 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:30:16.457405 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea86bbc-5066-4d6e-8e71-111c0ef1c929 tempest-AccessRulesV3Test-1705547817 tempest-AccessRulesV3Test-1705547817-project] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:16.470794 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea86bbc-5066-4d6e-8e71-111c0ef1c929 tempest-AccessRulesV3Test-1705547817 tempest-AccessRulesV3Test-1705547817-project] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:16.475458 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b0126-23bd-4695-844d-85044129b05a tempest-AccessRulesV3Test-1705547817 tempest-AccessRulesV3Test-1705547817-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0d3653a7424971845d48068f378808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e27046a7e03743feb36a5e793f293754', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:16.476476 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b0126-23bd-4695-844d-85044129b05a tempest-AccessRulesV3Test-1705547817 tempest-AccessRulesV3Test-1705547817-project] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:16.477008 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b0126-23bd-4695-844d-85044129b05a tempest-AccessRulesV3Test-1705547817 tempest-AccessRulesV3Test-1705547817-project] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:16.477298 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b0126-23bd-4695-844d-85044129b05a tempest-AccessRulesV3Test-1705547817 tempest-AccessRulesV3Test-1705547817-project] PATH_INFO: `/v3/users/5a0d3653a7424971845d48068f378808/access_rules` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:16.478648 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33b0126-23bd-4695-844d-85044129b05a tempest-AccessRulesV3Test-1705547817 tempest-AccessRulesV3Test-1705547817-project] RBAC: Authorizing `identity:list_access_rules(user_id=5a0d3653a7424971845d48068f378808)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:16.480175 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33b0126-23bd-4695-844d-85044129b05a tempest-AccessRulesV3Test-1705547817 tempest-AccessRulesV3Test-1705547817-project] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:16.485791 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2494/4951] 10.222.0.52 () {58 vars in 1259 bytes} [Sat May 14 21:30:16 2022] GET /identity/v3/users/5a0d3653a7424971845d48068f378808/access_rules => generated 369 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:30:16.490805 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fbb9f8-57d0-4641-81f6-a1cce05df6f6 tempest-AccessRulesV3Test-1705547817 tempest-AccessRulesV3Test-1705547817-project] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:16.500882 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fbb9f8-57d0-4641-81f6-a1cce05df6f6 tempest-AccessRulesV3Test-1705547817 tempest-AccessRulesV3Test-1705547817-project] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:16.505059 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d121b5f-a593-4765-a29f-2586ff138e64 tempest-AccessRulesV3Test-1705547817 tempest-AccessRulesV3Test-1705547817-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0d3653a7424971845d48068f378808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e27046a7e03743feb36a5e793f293754', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:16.505984 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d121b5f-a593-4765-a29f-2586ff138e64 tempest-AccessRulesV3Test-1705547817 tempest-AccessRulesV3Test-1705547817-project] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:16.506272 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d121b5f-a593-4765-a29f-2586ff138e64 tempest-AccessRulesV3Test-1705547817 tempest-AccessRulesV3Test-1705547817-project] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:16.506551 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d121b5f-a593-4765-a29f-2586ff138e64 tempest-AccessRulesV3Test-1705547817 tempest-AccessRulesV3Test-1705547817-project] PATH_INFO: `/v3/users/5a0d3653a7424971845d48068f378808/application_credentials` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:16.507284 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d121b5f-a593-4765-a29f-2586ff138e64 tempest-AccessRulesV3Test-1705547817 tempest-AccessRulesV3Test-1705547817-project] RBAC: Authorizing `identity:create_application_credential(user_id=5a0d3653a7424971845d48068f378808)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:16.508508 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d121b5f-a593-4765-a29f-2586ff138e64 tempest-AccessRulesV3Test-1705547817 tempest-AccessRulesV3Test-1705547817-project] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:16.670011 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2458/4952] 10.222.0.52 () {60 vars in 1314 bytes} [Sat May 14 21:30:16 2022] POST /identity/v3/users/5a0d3653a7424971845d48068f378808/application_credentials => generated 920 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:30:16.685301 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b0126-23bd-4695-844d-85044129b05a tempest-AccessRulesV3Test-1705547817 tempest-AccessRulesV3Test-1705547817-project] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:16.698144 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b0126-23bd-4695-844d-85044129b05a tempest-AccessRulesV3Test-1705547817 tempest-AccessRulesV3Test-1705547817-project] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:16.702311 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084586bf-5b8b-4ccc-ab42-19f27459d7a6 tempest-AccessRulesV3Test-1705547817 tempest-AccessRulesV3Test-1705547817-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0d3653a7424971845d48068f378808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e27046a7e03743feb36a5e793f293754', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:16.704102 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084586bf-5b8b-4ccc-ab42-19f27459d7a6 tempest-AccessRulesV3Test-1705547817 tempest-AccessRulesV3Test-1705547817-project] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:16.704570 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084586bf-5b8b-4ccc-ab42-19f27459d7a6 tempest-AccessRulesV3Test-1705547817 tempest-AccessRulesV3Test-1705547817-project] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:16.704850 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084586bf-5b8b-4ccc-ab42-19f27459d7a6 tempest-AccessRulesV3Test-1705547817 tempest-AccessRulesV3Test-1705547817-project] PATH_INFO: `/v3/users/5a0d3653a7424971845d48068f378808/access_rules/d55b240b8b7b4cc9a0b926b5a436a13f` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:16.706083 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084586bf-5b8b-4ccc-ab42-19f27459d7a6 tempest-AccessRulesV3Test-1705547817 tempest-AccessRulesV3Test-1705547817-project] RBAC: Authorizing `identity:get_access_rule(user_id=5a0d3653a7424971845d48068f378808, access_rule_id=d55b240b8b7b4cc9a0b926b5a436a13f)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:16.707962 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084586bf-5b8b-4ccc-ab42-19f27459d7a6 tempest-AccessRulesV3Test-1705547817 tempest-AccessRulesV3Test-1705547817-project] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:16.717544 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2495/4953] 10.222.0.52 () {58 vars in 1358 bytes} [Sat May 14 21:30:16 2022] GET /identity/v3/users/5a0d3653a7424971845d48068f378808/access_rules/d55b240b8b7b4cc9a0b926b5a436a13f => generated 229 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:30:16.722473 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d121b5f-a593-4765-a29f-2586ff138e64 tempest-AccessRulesV3Test-1705547817 tempest-AccessRulesV3Test-1705547817-project] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:16.797355 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d121b5f-a593-4765-a29f-2586ff138e64 tempest-AccessRulesV3Test-1705547817 tempest-AccessRulesV3Test-1705547817-project] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:16.802040 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f8560a-a00a-42ac-a12a-09e3a500070f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:16.802971 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8560a-a00a-42ac-a12a-09e3a500070f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:16.803211 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8560a-a00a-42ac-a12a-09e3a500070f admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:16.803517 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8560a-a00a-42ac-a12a-09e3a500070f admin admin] PATH_INFO: `/v3/users/5a0d3653a7424971845d48068f378808` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:16.805507 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f8560a-a00a-42ac-a12a-09e3a500070f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a0d3653a7424971845d48068f378808)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:16.811632 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f8560a-a00a-42ac-a12a-09e3a500070f admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:17.057347 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-13f8560a-a00a-42ac-a12a-09e3a500070f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a0d3653a7424971845d48068f378808'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:17.064143 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-13f8560a-a00a-42ac-a12a-09e3a500070f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a0d3653a7424971845d48068f378808'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:17.064860 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-13f8560a-a00a-42ac-a12a-09e3a500070f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a0d3653a7424971845d48068f378808'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:17.143067 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-13f8560a-a00a-42ac-a12a-09e3a500070f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a0d3653a7424971845d48068f378808'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:17.364013 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-13f8560a-a00a-42ac-a12a-09e3a500070f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a0d3653a7424971845d48068f378808'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:17.376219 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2459/4954] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:30:16 2022] DELETE /identity/v3/users/5a0d3653a7424971845d48068f378808 => generated 0 bytes in 651 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:30:17.377944 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca5f8ac-e6ca-482c-8656-29fedb0446c4 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:17.378408 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca5f8ac-e6ca-482c-8656-29fedb0446c4 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:17.378503 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca5f8ac-e6ca-482c-8656-29fedb0446c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:17.410182 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-2ca5f8ac-e6ca-482c-8656-29fedb0446c4 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:30:17.411627 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-2ca5f8ac-e6ca-482c-8656-29fedb0446c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:17.534445 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2496/4955] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:30:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:30:17.559672 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f8560a-a00a-42ac-a12a-09e3a500070f admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:17.563641 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-13f8560a-a00a-42ac-a12a-09e3a500070f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:17.637735 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f8560a-a00a-42ac-a12a-09e3a500070f admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:17.642429 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cbdf02-8137-4b76-9019-322a8227afa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:17.643083 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cbdf02-8137-4b76-9019-322a8227afa6 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:17.643372 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cbdf02-8137-4b76-9019-322a8227afa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:17.643689 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cbdf02-8137-4b76-9019-322a8227afa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:17.660867 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cbdf02-8137-4b76-9019-322a8227afa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:17.662339 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cbdf02-8137-4b76-9019-322a8227afa6 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:17.675016 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2460/4956] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:30:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:30:18.095194 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca5f8ac-e6ca-482c-8656-29fedb0446c4 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:18.096973 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-2ca5f8ac-e6ca-482c-8656-29fedb0446c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:18.111626 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca5f8ac-e6ca-482c-8656-29fedb0446c4 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:18.123048 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bbaec6-bfd1-443e-bf4d-82276598aa9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:18.127287 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bbaec6-bfd1-443e-bf4d-82276598aa9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:18.130081 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bbaec6-bfd1-443e-bf4d-82276598aa9f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:18.130917 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bbaec6-bfd1-443e-bf4d-82276598aa9f admin admin] PATH_INFO: `/v3/projects/e27046a7e03743feb36a5e793f293754` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:18.132455 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bbaec6-bfd1-443e-bf4d-82276598aa9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e27046a7e03743feb36a5e793f293754)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:18.134900 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bbaec6-bfd1-443e-bf4d-82276598aa9f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:18.289144 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-86bbaec6-bfd1-443e-bf4d-82276598aa9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e27046a7e03743feb36a5e793f293754', 'request_id': 'req-86bbaec6-bfd1-443e-bf4d-82276598aa9f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:18.303686 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-86bbaec6-bfd1-443e-bf4d-82276598aa9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e27046a7e03743feb36a5e793f293754', 'request_id': 'req-86bbaec6-bfd1-443e-bf4d-82276598aa9f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:18.411744 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-86bbaec6-bfd1-443e-bf4d-82276598aa9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e27046a7e03743feb36a5e793f293754', 'request_id': 'req-86bbaec6-bfd1-443e-bf4d-82276598aa9f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:18.426453 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-86bbaec6-bfd1-443e-bf4d-82276598aa9f admin admin] The token cache is being invalidate because project e27046a7e03743feb36a5e793f293754 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:30:18.427371 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-86bbaec6-bfd1-443e-bf4d-82276598aa9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:18.428188 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-86bbaec6-bfd1-443e-bf4d-82276598aa9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:18.431849 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2497/4957] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:30:18 2022] DELETE /identity/v3/projects/e27046a7e03743feb36a5e793f293754 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:30:18.436358 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db89882-8b11-439b-953b-e3ed2bb38338 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:18.436645 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db89882-8b11-439b-953b-e3ed2bb38338 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:18.436920 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db89882-8b11-439b-953b-e3ed2bb38338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:18.460242 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-8db89882-8b11-439b-953b-e3ed2bb38338 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:30:18.464270 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8db89882-8b11-439b-953b-e3ed2bb38338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:18.586744 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2461/4958] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:30:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:30:18.596431 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c7d68-fe45-4004-96e3-8d53e83b1b88 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:18.596722 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c7d68-fe45-4004-96e3-8d53e83b1b88 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:18.597202 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c7d68-fe45-4004-96e3-8d53e83b1b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:18.643673 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-df3c7d68-fe45-4004-96e3-8d53e83b1b88 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:30:18.646796 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-df3c7d68-fe45-4004-96e3-8d53e83b1b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:18.663438 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2498/4959] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:30:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:30:18.667707 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db89882-8b11-439b-953b-e3ed2bb38338 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:18.682474 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db89882-8b11-439b-953b-e3ed2bb38338 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:18.687250 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147b84d9-3f70-468d-beab-feb16b67f7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:18.688917 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b84d9-3f70-468d-beab-feb16b67f7cc admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:18.689209 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b84d9-3f70-468d-beab-feb16b67f7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:18.689498 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b84d9-3f70-468d-beab-feb16b67f7cc admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:18.690555 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147b84d9-3f70-468d-beab-feb16b67f7cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:30:18.691035 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147b84d9-3f70-468d-beab-feb16b67f7cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:18.692832 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147b84d9-3f70-468d-beab-feb16b67f7cc admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:18.712982 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2462/4960] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:30:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:30:18.719091 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3c7d68-fe45-4004-96e3-8d53e83b1b88 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:18.733025 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3c7d68-fe45-4004-96e3-8d53e83b1b88 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:18.742913 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b3018-f6e3-4b1c-ae59-94ae9080e6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:18.743600 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b3018-f6e3-4b1c-ae59-94ae9080e6aa admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:18.743884 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b3018-f6e3-4b1c-ae59-94ae9080e6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:18.744267 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b3018-f6e3-4b1c-ae59-94ae9080e6aa admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:18.744856 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6b3018-f6e3-4b1c-ae59-94ae9080e6aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:18.746761 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6b3018-f6e3-4b1c-ae59-94ae9080e6aa admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:18.889039 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147b84d9-3f70-468d-beab-feb16b67f7cc admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:18.892119 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2499/4961] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:30:18 2022] POST /identity/v3/projects => generated 359 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:30:18.907496 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147b84d9-3f70-468d-beab-feb16b67f7cc admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:18.999258 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0392d0d7-92f6-412b-9c36-2d97e0154929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:19.002069 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392d0d7-92f6-412b-9c36-2d97e0154929 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:19.004564 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392d0d7-92f6-412b-9c36-2d97e0154929 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:19.004564 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392d0d7-92f6-412b-9c36-2d97e0154929 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:19.004564 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0392d0d7-92f6-412b-9c36-2d97e0154929 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:19.007859 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0392d0d7-92f6-412b-9c36-2d97e0154929 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:19.100809 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2463/4962] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:30:18 2022] POST /identity/v3/users => generated 280 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:30:19.105016 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b3018-f6e3-4b1c-ae59-94ae9080e6aa admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:19.115431 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b3018-f6e3-4b1c-ae59-94ae9080e6aa admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:19.120059 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0088f3-be6d-4b2e-ae4b-ab3a32596c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:19.120723 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0088f3-be6d-4b2e-ae4b-ab3a32596c67 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:19.121010 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0088f3-be6d-4b2e-ae4b-ab3a32596c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:19.121289 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0088f3-be6d-4b2e-ae4b-ab3a32596c67 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:19.122008 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0088f3-be6d-4b2e-ae4b-ab3a32596c67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:19.123635 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0088f3-be6d-4b2e-ae4b-ab3a32596c67 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:19.134190 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2500/4963] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:30:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:30:19.138261 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0392d0d7-92f6-412b-9c36-2d97e0154929 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:19.159287 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0392d0d7-92f6-412b-9c36-2d97e0154929 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:19.164204 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57cb774-e744-4d33-b241-6d95b49fc099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:19.164888 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57cb774-e744-4d33-b241-6d95b49fc099 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:19.165172 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57cb774-e744-4d33-b241-6d95b49fc099 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:19.165471 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57cb774-e744-4d33-b241-6d95b49fc099 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:19.166194 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57cb774-e744-4d33-b241-6d95b49fc099 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:19.167842 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57cb774-e744-4d33-b241-6d95b49fc099 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:19.178233 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2464/4964] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:30:19 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:30:19.182677 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0088f3-be6d-4b2e-ae4b-ab3a32596c67 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:19.196881 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0088f3-be6d-4b2e-ae4b-ab3a32596c67 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:19.199267 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599549d1-d943-46ea-86a2-c518e129c3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:19.200174 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599549d1-d943-46ea-86a2-c518e129c3d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:19.200457 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599549d1-d943-46ea-86a2-c518e129c3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:19.200730 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599549d1-d943-46ea-86a2-c518e129c3d1 admin admin] PATH_INFO: `/v3/projects/9763cae7eb54480fa9749df7976e6870/users/182c909987aa4e5cb1d2e3f06df4cd92/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:19.215366 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599549d1-d943-46ea-86a2-c518e129c3d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9763cae7eb54480fa9749df7976e6870, user_id=182c909987aa4e5cb1d2e3f06df4cd92, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:19.218130 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599549d1-d943-46ea-86a2-c518e129c3d1 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:19.286327 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2501/4965] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:30:19 2022] PUT /identity/v3/projects/9763cae7eb54480fa9749df7976e6870/users/182c909987aa4e5cb1d2e3f06df4cd92/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:30:19.304785 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4438463-03a6-41f3-8e1a-915ff4e4cfb8 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:19.305075 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4438463-03a6-41f3-8e1a-915ff4e4cfb8 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:19.305354 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4438463-03a6-41f3-8e1a-915ff4e4cfb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:19.333549 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-d4438463-03a6-41f3-8e1a-915ff4e4cfb8 None None] MFA Rules not processed for user `182c909987aa4e5cb1d2e3f06df4cd92`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:30:19.334762 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-d4438463-03a6-41f3-8e1a-915ff4e4cfb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:19.439210 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2465/4966] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:30:19 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:30:19.444850 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f21ea-c1ef-4c09-92cd-79dddfb091a8 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:19.445416 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f21ea-c1ef-4c09-92cd-79dddfb091a8 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:19.445574 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f21ea-c1ef-4c09-92cd-79dddfb091a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:19.475665 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-270f21ea-c1ef-4c09-92cd-79dddfb091a8 None None] MFA Rules not processed for user `182c909987aa4e5cb1d2e3f06df4cd92`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:30:19.475665 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-270f21ea-c1ef-4c09-92cd-79dddfb091a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:19.475665 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2502/4967] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:30:19 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 25 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 21:30:19.478297 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f6daa-b57c-4e76-8d0a-8d303604f003 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:19.478688 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f6daa-b57c-4e76-8d0a-8d303604f003 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:19.479034 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f6daa-b57c-4e76-8d0a-8d303604f003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:19.505893 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-f82f6daa-b57c-4e76-8d0a-8d303604f003 None None] MFA Rules not processed for user `182c909987aa4e5cb1d2e3f06df4cd92`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:30:19.507522 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-f82f6daa-b57c-4e76-8d0a-8d303604f003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:19.511137 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2466/4968] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:30:19 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 21:30:19.515838 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f21ea-c1ef-4c09-92cd-79dddfb091a8 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:19.528960 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f21ea-c1ef-4c09-92cd-79dddfb091a8 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:19.535019 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf1a8f-1e92-45e4-8bb3-95e356ddb151 tempest-TokensV3Test-913246078 tempest-TokensV3Test-913246078-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '182c909987aa4e5cb1d2e3f06df4cd92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9763cae7eb54480fa9749df7976e6870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:19.536783 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf1a8f-1e92-45e4-8bb3-95e356ddb151 tempest-TokensV3Test-913246078 tempest-TokensV3Test-913246078-project] REQUEST_METHOD: `HEAD` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:19.537307 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf1a8f-1e92-45e4-8bb3-95e356ddb151 tempest-TokensV3Test-913246078 tempest-TokensV3Test-913246078-project] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:19.537798 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf1a8f-1e92-45e4-8bb3-95e356ddb151 tempest-TokensV3Test-913246078 tempest-TokensV3Test-913246078-project] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:19.550107 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdf1a8f-1e92-45e4-8bb3-95e356ddb151 tempest-TokensV3Test-913246078 tempest-TokensV3Test-913246078-project] RBAC: Authorizing `identity:check_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:19.552410 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdf1a8f-1e92-45e4-8bb3-95e356ddb151 tempest-TokensV3Test-913246078 tempest-TokensV3Test-913246078-project] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:19.568107 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82f6daa-b57c-4e76-8d0a-8d303604f003 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:19.568970 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2503/4969] 10.222.0.52 () {56 vars in 1263 bytes} [Sat May 14 21:30:19 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 358 bytes (0 switches on core 0) May 14 21:30:19.582348 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82f6daa-b57c-4e76-8d0a-8d303604f003 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:19.593222 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e768287b-b3b2-4457-a83c-29dcf40b89d0 tempest-TokensV3Test-913246078 tempest-TokensV3Test-913246078-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '182c909987aa4e5cb1d2e3f06df4cd92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9763cae7eb54480fa9749df7976e6870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:19.595908 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768287b-b3b2-4457-a83c-29dcf40b89d0 tempest-TokensV3Test-913246078 tempest-TokensV3Test-913246078-project] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:19.596883 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768287b-b3b2-4457-a83c-29dcf40b89d0 tempest-TokensV3Test-913246078 tempest-TokensV3Test-913246078-project] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:19.597391 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768287b-b3b2-4457-a83c-29dcf40b89d0 tempest-TokensV3Test-913246078 tempest-TokensV3Test-913246078-project] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:19.619359 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e768287b-b3b2-4457-a83c-29dcf40b89d0 tempest-TokensV3Test-913246078 tempest-TokensV3Test-913246078-project] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:19.626366 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e768287b-b3b2-4457-a83c-29dcf40b89d0 tempest-TokensV3Test-913246078 tempest-TokensV3Test-913246078-project] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:19.631535 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2467/4970] 10.222.0.52 () {56 vars in 1262 bytes} [Sat May 14 21:30:19 2022] GET /identity/v3/auth/tokens => generated 345 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 14 21:30:19.649764 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf1a8f-1e92-45e4-8bb3-95e356ddb151 tempest-TokensV3Test-913246078 tempest-TokensV3Test-913246078-project] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:19.669555 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf1a8f-1e92-45e4-8bb3-95e356ddb151 tempest-TokensV3Test-913246078 tempest-TokensV3Test-913246078-project] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:19.676802 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a209743-6981-4fb5-86f5-193326594bbf tempest-TokensV3Test-913246078 tempest-TokensV3Test-913246078-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '182c909987aa4e5cb1d2e3f06df4cd92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9763cae7eb54480fa9749df7976e6870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:19.677900 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a209743-6981-4fb5-86f5-193326594bbf tempest-TokensV3Test-913246078 tempest-TokensV3Test-913246078-project] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:19.678293 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a209743-6981-4fb5-86f5-193326594bbf tempest-TokensV3Test-913246078 tempest-TokensV3Test-913246078-project] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:19.678578 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a209743-6981-4fb5-86f5-193326594bbf tempest-TokensV3Test-913246078 tempest-TokensV3Test-913246078-project] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:19.686643 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a209743-6981-4fb5-86f5-193326594bbf tempest-TokensV3Test-913246078 tempest-TokensV3Test-913246078-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:19.690111 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a209743-6981-4fb5-86f5-193326594bbf tempest-TokensV3Test-913246078 tempest-TokensV3Test-913246078-project] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:19.793156 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2504/4971] 10.222.0.52 () {56 vars in 1265 bytes} [Sat May 14 21:30:19 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:30:19.798308 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e768287b-b3b2-4457-a83c-29dcf40b89d0 tempest-TokensV3Test-913246078 tempest-TokensV3Test-913246078-project] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:19.815700 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e768287b-b3b2-4457-a83c-29dcf40b89d0 tempest-TokensV3Test-913246078 tempest-TokensV3Test-913246078-project] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:19.824137 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8bc426-5565-46e3-80c5-073b550708d3 tempest-TokensV3Test-913246078 tempest-TokensV3Test-913246078-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '182c909987aa4e5cb1d2e3f06df4cd92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9763cae7eb54480fa9749df7976e6870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:19.825080 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8bc426-5565-46e3-80c5-073b550708d3 tempest-TokensV3Test-913246078 tempest-TokensV3Test-913246078-project] REQUEST_METHOD: `HEAD` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:19.825592 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8bc426-5565-46e3-80c5-073b550708d3 tempest-TokensV3Test-913246078 tempest-TokensV3Test-913246078-project] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:19.826099 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8bc426-5565-46e3-80c5-073b550708d3 tempest-TokensV3Test-913246078 tempest-TokensV3Test-913246078-project] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:19.828717 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-ce8bc426-5565-46e3-80c5-073b550708d3 tempest-TokensV3Test-913246078 tempest-TokensV3Test-913246078-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:19.873617 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-ce8bc426-5565-46e3-80c5-073b550708d3 tempest-TokensV3Test-913246078 tempest-TokensV3Test-913246078-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token May 14 21:30:19.873617 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:30:19.873617 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 21:30:19.873617 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 21:30:19.873617 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 21:30:19.873617 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 21:30:19.873617 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 21:30:19.873617 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 21:30:19.873617 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 21:30:19.873617 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 21:30:19.873617 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 21:30:19.873617 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 21:30:19.873617 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 283, in get May 14 21:30:19.873617 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:check_token') May 14 21:30:19.873617 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call May 14 21:30:19.875114 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() May 14 21:30:19.875114 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data May 14 21:30:19.875114 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( May 14 21:30:19.875114 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 21:30:19.875114 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 21:30:19.875114 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token May 14 21:30:19.875114 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) May 14 21:30:19.875114 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token May 14 21:30:19.875114 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application self.check_revocation(token) May 14 21:30:19.875114 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 21:30:19.875114 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 21:30:19.875114 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation May 14 21:30:19.875114 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) May 14 21:30:19.875114 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 21:30:19.875114 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 21:30:19.875114 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 May 14 21:30:19.875114 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) May 14 21:30:19.876808 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 21:30:19.876808 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 21:30:19.876808 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token May 14 21:30:19.876808 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) May 14 21:30:19.876808 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token May 14 21:30:19.876808 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:30:19.876808 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2468/4972] 10.222.0.52 () {56 vars in 1263 bytes} [Sat May 14 21:30:19 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (0 switches on core 0) May 14 21:30:19.880802 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec31a08-8740-45c7-9003-cae62ce29d7f None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:19.881331 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec31a08-8740-45c7-9003-cae62ce29d7f None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:19.881689 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec31a08-8740-45c7-9003-cae62ce29d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:19.902596 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-fec31a08-8740-45c7-9003-cae62ce29d7f None None] MFA Rules not processed for user `182c909987aa4e5cb1d2e3f06df4cd92`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:30:19.905182 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-fec31a08-8740-45c7-9003-cae62ce29d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:19.911063 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2505/4973] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:30:19 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 21:30:19.915567 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8bc426-5565-46e3-80c5-073b550708d3 tempest-TokensV3Test-913246078 tempest-TokensV3Test-913246078-project] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:19.926716 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8bc426-5565-46e3-80c5-073b550708d3 tempest-TokensV3Test-913246078 tempest-TokensV3Test-913246078-project] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:19.931415 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161348ca-f081-48af-8382-ad83022a258a tempest-TokensV3Test-913246078 tempest-TokensV3Test-913246078-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '182c909987aa4e5cb1d2e3f06df4cd92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9763cae7eb54480fa9749df7976e6870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:19.932253 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161348ca-f081-48af-8382-ad83022a258a tempest-TokensV3Test-913246078 tempest-TokensV3Test-913246078-project] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:19.932550 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161348ca-f081-48af-8382-ad83022a258a tempest-TokensV3Test-913246078 tempest-TokensV3Test-913246078-project] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:19.932834 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161348ca-f081-48af-8382-ad83022a258a tempest-TokensV3Test-913246078 tempest-TokensV3Test-913246078-project] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:19.940505 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161348ca-f081-48af-8382-ad83022a258a tempest-TokensV3Test-913246078 tempest-TokensV3Test-913246078-project] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:19.942456 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161348ca-f081-48af-8382-ad83022a258a tempest-TokensV3Test-913246078 tempest-TokensV3Test-913246078-project] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:19.954862 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2469/4974] 10.222.0.52 () {56 vars in 1262 bytes} [Sat May 14 21:30:19 2022] GET /identity/v3/auth/tokens => generated 345 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 14 21:30:19.959052 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec31a08-8740-45c7-9003-cae62ce29d7f None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:19.971044 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec31a08-8740-45c7-9003-cae62ce29d7f None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:19.977152 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6c3e0d-187d-45a2-8e9e-ef96d0803565 tempest-TokensV3Test-913246078 tempest-TokensV3Test-913246078-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '182c909987aa4e5cb1d2e3f06df4cd92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9763cae7eb54480fa9749df7976e6870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:19.982307 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c3e0d-187d-45a2-8e9e-ef96d0803565 tempest-TokensV3Test-913246078 tempest-TokensV3Test-913246078-project] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:19.982307 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c3e0d-187d-45a2-8e9e-ef96d0803565 tempest-TokensV3Test-913246078 tempest-TokensV3Test-913246078-project] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:19.982307 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c3e0d-187d-45a2-8e9e-ef96d0803565 tempest-TokensV3Test-913246078 tempest-TokensV3Test-913246078-project] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:19.986941 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6c3e0d-187d-45a2-8e9e-ef96d0803565 tempest-TokensV3Test-913246078 tempest-TokensV3Test-913246078-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:19.988699 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6c3e0d-187d-45a2-8e9e-ef96d0803565 tempest-TokensV3Test-913246078 tempest-TokensV3Test-913246078-project] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:20.121455 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2506/4975] 10.222.0.52 () {56 vars in 1265 bytes} [Sat May 14 21:30:19 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:30:20.125708 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161348ca-f081-48af-8382-ad83022a258a tempest-TokensV3Test-913246078 tempest-TokensV3Test-913246078-project] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:20.136667 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161348ca-f081-48af-8382-ad83022a258a tempest-TokensV3Test-913246078 tempest-TokensV3Test-913246078-project] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:20.142759 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a8408f-cf72-47bb-b3cc-843ef6aeb975 tempest-TokensV3Test-913246078 tempest-TokensV3Test-913246078-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '182c909987aa4e5cb1d2e3f06df4cd92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9763cae7eb54480fa9749df7976e6870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:20.145900 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8408f-cf72-47bb-b3cc-843ef6aeb975 tempest-TokensV3Test-913246078 tempest-TokensV3Test-913246078-project] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:20.145900 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8408f-cf72-47bb-b3cc-843ef6aeb975 tempest-TokensV3Test-913246078 tempest-TokensV3Test-913246078-project] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:20.145900 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8408f-cf72-47bb-b3cc-843ef6aeb975 tempest-TokensV3Test-913246078 tempest-TokensV3Test-913246078-project] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:20.146310 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-54a8408f-cf72-47bb-b3cc-843ef6aeb975 tempest-TokensV3Test-913246078 tempest-TokensV3Test-913246078-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:20.158963 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-54a8408f-cf72-47bb-b3cc-843ef6aeb975 tempest-TokensV3Test-913246078 tempest-TokensV3Test-913246078-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token May 14 21:30:20.158963 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:30:20.158963 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 21:30:20.158963 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 21:30:20.158963 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 21:30:20.158963 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 21:30:20.158963 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 21:30:20.158963 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 21:30:20.158963 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 21:30:20.158963 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 21:30:20.158963 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 21:30:20.158963 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 21:30:20.158963 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get May 14 21:30:20.158963 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') May 14 21:30:20.158963 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call May 14 21:30:20.160308 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() May 14 21:30:20.160308 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data May 14 21:30:20.160308 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( May 14 21:30:20.160308 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 21:30:20.160308 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 21:30:20.160308 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token May 14 21:30:20.160308 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) May 14 21:30:20.160308 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token May 14 21:30:20.160308 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application self.check_revocation(token) May 14 21:30:20.160308 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 21:30:20.160308 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 21:30:20.160308 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation May 14 21:30:20.160308 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) May 14 21:30:20.160308 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 21:30:20.160308 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 21:30:20.160308 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 May 14 21:30:20.160308 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) May 14 21:30:20.161893 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 21:30:20.161893 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 21:30:20.161893 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token May 14 21:30:20.161893 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) May 14 21:30:20.161893 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token May 14 21:30:20.161893 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:30:20.161893 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2470/4976] 10.222.0.52 () {56 vars in 1262 bytes} [Sat May 14 21:30:20 2022] GET /identity/v3/auth/tokens => generated 80 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 21:30:20.165300 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6c3e0d-187d-45a2-8e9e-ef96d0803565 tempest-TokensV3Test-913246078 tempest-TokensV3Test-913246078-project] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:20.231414 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6c3e0d-187d-45a2-8e9e-ef96d0803565 tempest-TokensV3Test-913246078 tempest-TokensV3Test-913246078-project] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:20.238044 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61317bd9-11ff-4d2a-8430-46b960ac67cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:20.238311 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61317bd9-11ff-4d2a-8430-46b960ac67cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:20.238590 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61317bd9-11ff-4d2a-8430-46b960ac67cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:20.238867 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61317bd9-11ff-4d2a-8430-46b960ac67cc admin admin] PATH_INFO: `/v3/users/182c909987aa4e5cb1d2e3f06df4cd92` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:20.240081 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61317bd9-11ff-4d2a-8430-46b960ac67cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=182c909987aa4e5cb1d2e3f06df4cd92)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:20.241989 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61317bd9-11ff-4d2a-8430-46b960ac67cc admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:20.488345 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-61317bd9-11ff-4d2a-8430-46b960ac67cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '182c909987aa4e5cb1d2e3f06df4cd92'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:20.499995 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-61317bd9-11ff-4d2a-8430-46b960ac67cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '182c909987aa4e5cb1d2e3f06df4cd92'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:20.506836 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-61317bd9-11ff-4d2a-8430-46b960ac67cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '182c909987aa4e5cb1d2e3f06df4cd92'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:20.616849 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-61317bd9-11ff-4d2a-8430-46b960ac67cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '182c909987aa4e5cb1d2e3f06df4cd92'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:20.617560 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-61317bd9-11ff-4d2a-8430-46b960ac67cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '182c909987aa4e5cb1d2e3f06df4cd92'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:20.624075 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2507/4977] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:30:20 2022] DELETE /identity/v3/users/182c909987aa4e5cb1d2e3f06df4cd92 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:30:20.628602 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2aa741-ccc7-4cf6-9f15-b44888ad195b None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:20.629137 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2aa741-ccc7-4cf6-9f15-b44888ad195b None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:20.629137 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2aa741-ccc7-4cf6-9f15-b44888ad195b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:20.647302 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-4c2aa741-ccc7-4cf6-9f15-b44888ad195b None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:30:20.648561 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-4c2aa741-ccc7-4cf6-9f15-b44888ad195b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:20.722465 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2471/4978] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:30:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:30:20.736400 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61317bd9-11ff-4d2a-8430-46b960ac67cc admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:20.737840 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-61317bd9-11ff-4d2a-8430-46b960ac67cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:20.799606 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61317bd9-11ff-4d2a-8430-46b960ac67cc admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:20.803542 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671e061d-af29-4709-a386-cea91f630d88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:20.805685 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e061d-af29-4709-a386-cea91f630d88 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:20.806014 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e061d-af29-4709-a386-cea91f630d88 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:20.806295 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e061d-af29-4709-a386-cea91f630d88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:20.817157 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671e061d-af29-4709-a386-cea91f630d88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:20.818710 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671e061d-af29-4709-a386-cea91f630d88 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:20.828768 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2508/4979] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:30:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:30:21.402173 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2aa741-ccc7-4cf6-9f15-b44888ad195b None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:21.405506 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-4c2aa741-ccc7-4cf6-9f15-b44888ad195b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:21.437638 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2aa741-ccc7-4cf6-9f15-b44888ad195b None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:21.443225 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555b98df-cb47-4e81-a1c0-a0c278f7d9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:21.444207 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b98df-cb47-4e81-a1c0-a0c278f7d9ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:21.444571 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b98df-cb47-4e81-a1c0-a0c278f7d9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:21.444925 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b98df-cb47-4e81-a1c0-a0c278f7d9ea admin admin] PATH_INFO: `/v3/projects/9763cae7eb54480fa9749df7976e6870` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:21.446190 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555b98df-cb47-4e81-a1c0-a0c278f7d9ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=9763cae7eb54480fa9749df7976e6870)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:21.448371 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555b98df-cb47-4e81-a1c0-a0c278f7d9ea admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:21.632500 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-555b98df-cb47-4e81-a1c0-a0c278f7d9ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9763cae7eb54480fa9749df7976e6870', 'request_id': 'req-555b98df-cb47-4e81-a1c0-a0c278f7d9ea'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:21.644306 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-555b98df-cb47-4e81-a1c0-a0c278f7d9ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9763cae7eb54480fa9749df7976e6870', 'request_id': 'req-555b98df-cb47-4e81-a1c0-a0c278f7d9ea'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:21.653847 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-555b98df-cb47-4e81-a1c0-a0c278f7d9ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9763cae7eb54480fa9749df7976e6870', 'request_id': 'req-555b98df-cb47-4e81-a1c0-a0c278f7d9ea'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:21.715044 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-555b98df-cb47-4e81-a1c0-a0c278f7d9ea admin admin] The token cache is being invalidate because project 9763cae7eb54480fa9749df7976e6870 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:30:21.715375 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-555b98df-cb47-4e81-a1c0-a0c278f7d9ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:21.716273 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-555b98df-cb47-4e81-a1c0-a0c278f7d9ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:21.717821 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2472/4980] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:30:21 2022] DELETE /identity/v3/projects/9763cae7eb54480fa9749df7976e6870 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:30:21.723237 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b5fb1d-aafd-408e-89cf-880bf1fdc649 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:21.723824 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b5fb1d-aafd-408e-89cf-880bf1fdc649 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:21.724943 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b5fb1d-aafd-408e-89cf-880bf1fdc649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:21.747381 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-09b5fb1d-aafd-408e-89cf-880bf1fdc649 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:30:21.748599 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-09b5fb1d-aafd-408e-89cf-880bf1fdc649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:21.821754 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2509/4981] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:30:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:30:21.830934 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2047b0-efce-4255-b58b-f7ce8dbf0cf8 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:21.831928 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2047b0-efce-4255-b58b-f7ce8dbf0cf8 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:21.831928 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2047b0-efce-4255-b58b-f7ce8dbf0cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:21.855129 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-ef2047b0-efce-4255-b58b-f7ce8dbf0cf8 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:30:21.858515 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-ef2047b0-efce-4255-b58b-f7ce8dbf0cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:21.871101 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2473/4982] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:30:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:30:21.876226 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b5fb1d-aafd-408e-89cf-880bf1fdc649 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:21.899027 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b5fb1d-aafd-408e-89cf-880bf1fdc649 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:21.908672 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07930e69-c176-4d77-9fea-a7e348a310e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:21.909346 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07930e69-c176-4d77-9fea-a7e348a310e8 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:21.909694 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07930e69-c176-4d77-9fea-a7e348a310e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:21.920898 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07930e69-c176-4d77-9fea-a7e348a310e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:21.922711 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07930e69-c176-4d77-9fea-a7e348a310e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:30:21.923105 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07930e69-c176-4d77-9fea-a7e348a310e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:21.929116 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07930e69-c176-4d77-9fea-a7e348a310e8 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:21.937813 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2510/4983] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:30:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:30:21.942095 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2047b0-efce-4255-b58b-f7ce8dbf0cf8 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:21.955800 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2047b0-efce-4255-b58b-f7ce8dbf0cf8 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:21.960721 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea3d990-2b56-4fde-9d36-001fe884da76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:21.961406 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3d990-2b56-4fde-9d36-001fe884da76 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:21.961697 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3d990-2b56-4fde-9d36-001fe884da76 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:21.961974 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3d990-2b56-4fde-9d36-001fe884da76 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:21.962663 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea3d990-2b56-4fde-9d36-001fe884da76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:21.964909 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea3d990-2b56-4fde-9d36-001fe884da76 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:22.127674 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2474/4984] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:30:21 2022] POST /identity/v3/projects => generated 393 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:30:22.131849 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07930e69-c176-4d77-9fea-a7e348a310e8 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:22.144175 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07930e69-c176-4d77-9fea-a7e348a310e8 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:22.204719 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5236aa7d-0d6b-4e6b-a045-6cb0da1bda42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:22.205708 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236aa7d-0d6b-4e6b-a045-6cb0da1bda42 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:22.205996 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236aa7d-0d6b-4e6b-a045-6cb0da1bda42 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:22.206275 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236aa7d-0d6b-4e6b-a045-6cb0da1bda42 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:22.206967 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5236aa7d-0d6b-4e6b-a045-6cb0da1bda42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:22.209259 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5236aa7d-0d6b-4e6b-a045-6cb0da1bda42 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:22.337391 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2511/4985] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:30:22 2022] POST /identity/v3/users => generated 303 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:30:22.341492 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea3d990-2b56-4fde-9d36-001fe884da76 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:22.352006 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea3d990-2b56-4fde-9d36-001fe884da76 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:22.356522 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a6b9fb-7fc3-45c9-9698-fb43d84290c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:22.357178 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a6b9fb-7fc3-45c9-9698-fb43d84290c4 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:22.357464 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a6b9fb-7fc3-45c9-9698-fb43d84290c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:22.357744 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a6b9fb-7fc3-45c9-9698-fb43d84290c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:22.358521 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a6b9fb-7fc3-45c9-9698-fb43d84290c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:22.360864 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a6b9fb-7fc3-45c9-9698-fb43d84290c4 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:22.372271 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2475/4986] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:30:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:30:22.377166 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5236aa7d-0d6b-4e6b-a045-6cb0da1bda42 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:22.391274 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5236aa7d-0d6b-4e6b-a045-6cb0da1bda42 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:22.396038 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70429910-19a5-4489-9c60-571f6a769800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:22.397073 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70429910-19a5-4489-9c60-571f6a769800 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:22.397367 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70429910-19a5-4489-9c60-571f6a769800 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:22.397645 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70429910-19a5-4489-9c60-571f6a769800 admin admin] PATH_INFO: `/v3/projects/461ea13a51314446a3124ebffb3053cd/users/687e564c8042450fbde936333ede270b/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:22.414923 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70429910-19a5-4489-9c60-571f6a769800 admin admin] RBAC: Authorizing `identity:create_grant(project_id=461ea13a51314446a3124ebffb3053cd, user_id=687e564c8042450fbde936333ede270b, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:22.417566 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70429910-19a5-4489-9c60-571f6a769800 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:22.476305 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2512/4987] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:30:22 2022] PUT /identity/v3/projects/461ea13a51314446a3124ebffb3053cd/users/687e564c8042450fbde936333ede270b/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:30:22.480277 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a6b9fb-7fc3-45c9-9698-fb43d84290c4 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:22.491323 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a6b9fb-7fc3-45c9-9698-fb43d84290c4 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:22.549317 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55dd3f3-1083-4c3d-80a7-19a3004c8118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:22.550032 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55dd3f3-1083-4c3d-80a7-19a3004c8118 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:22.550322 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55dd3f3-1083-4c3d-80a7-19a3004c8118 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:22.550600 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55dd3f3-1083-4c3d-80a7-19a3004c8118 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:22.551320 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55dd3f3-1083-4c3d-80a7-19a3004c8118 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:22.553066 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55dd3f3-1083-4c3d-80a7-19a3004c8118 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:22.567186 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2476/4988] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:30:22 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:30:22.568466 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70429910-19a5-4489-9c60-571f6a769800 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:22.580351 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70429910-19a5-4489-9c60-571f6a769800 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:22.585034 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ca8ba4-de44-434b-9872-9af8f5652279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:22.585915 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca8ba4-de44-434b-9872-9af8f5652279 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:22.586204 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca8ba4-de44-434b-9872-9af8f5652279 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:22.586492 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca8ba4-de44-434b-9872-9af8f5652279 admin admin] PATH_INFO: `/v3/projects/461ea13a51314446a3124ebffb3053cd/users/687e564c8042450fbde936333ede270b/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:22.588524 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ca8ba4-de44-434b-9872-9af8f5652279 admin admin] RBAC: Authorizing `identity:create_grant(project_id=461ea13a51314446a3124ebffb3053cd, user_id=687e564c8042450fbde936333ede270b, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:22.591162 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ca8ba4-de44-434b-9872-9af8f5652279 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:22.603530 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2513/4989] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:30:22 2022] PUT /identity/v3/projects/461ea13a51314446a3124ebffb3053cd/users/687e564c8042450fbde936333ede270b/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:30:22.613181 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c4e27-e58d-4eca-9d7e-571acd418cba None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:22.613474 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c4e27-e58d-4eca-9d7e-571acd418cba None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:22.613761 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c4e27-e58d-4eca-9d7e-571acd418cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:22.648909 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-d70c4e27-e58d-4eca-9d7e-571acd418cba None None] MFA Rules not processed for user `687e564c8042450fbde936333ede270b`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:30:22.650300 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-d70c4e27-e58d-4eca-9d7e-571acd418cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:22.721802 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2477/4990] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:30:22 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:30:22.731035 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ca8ba4-de44-434b-9872-9af8f5652279 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:22.794087 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ca8ba4-de44-434b-9872-9af8f5652279 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:22.798865 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8103d541-2037-4326-a605-1bcd128bc382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:22.799541 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8103d541-2037-4326-a605-1bcd128bc382 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:22.799823 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8103d541-2037-4326-a605-1bcd128bc382 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:22.800100 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8103d541-2037-4326-a605-1bcd128bc382 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:22.800789 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8103d541-2037-4326-a605-1bcd128bc382 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:22.802678 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8103d541-2037-4326-a605-1bcd128bc382 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:22.908514 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2514/4991] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:30:22 2022] POST /identity/v3/projects => generated 393 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:30:22.912368 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70c4e27-e58d-4eca-9d7e-571acd418cba None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:22.926226 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70c4e27-e58d-4eca-9d7e-571acd418cba None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:22.991284 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a07a95-98c4-4fad-9459-033ace184645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:22.992766 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a07a95-98c4-4fad-9459-033ace184645 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:22.993253 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a07a95-98c4-4fad-9459-033ace184645 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:22.994157 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a07a95-98c4-4fad-9459-033ace184645 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:22.995011 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a07a95-98c4-4fad-9459-033ace184645 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:22.996984 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a07a95-98c4-4fad-9459-033ace184645 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:23.100992 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2478/4992] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:30:22 2022] POST /identity/v3/users => generated 297 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:30:23.102253 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8103d541-2037-4326-a605-1bcd128bc382 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:23.114142 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8103d541-2037-4326-a605-1bcd128bc382 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:23.126181 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabca226-2b01-4e3c-99c9-354e82969d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:23.126625 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabca226-2b01-4e3c-99c9-354e82969d11 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:23.126912 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabca226-2b01-4e3c-99c9-354e82969d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:23.127192 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabca226-2b01-4e3c-99c9-354e82969d11 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:23.127961 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabca226-2b01-4e3c-99c9-354e82969d11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:23.129631 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabca226-2b01-4e3c-99c9-354e82969d11 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:23.140041 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2515/4993] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:30:23.146194 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a07a95-98c4-4fad-9459-033ace184645 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:23.161026 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a07a95-98c4-4fad-9459-033ace184645 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:23.166644 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01695d58-f89e-437b-bac5-60f71a69ee3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:23.167461 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01695d58-f89e-437b-bac5-60f71a69ee3f admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:23.173707 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01695d58-f89e-437b-bac5-60f71a69ee3f admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:23.173707 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01695d58-f89e-437b-bac5-60f71a69ee3f admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:23.173707 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01695d58-f89e-437b-bac5-60f71a69ee3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:23.173707 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01695d58-f89e-437b-bac5-60f71a69ee3f admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:23.185443 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2479/4994] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:30:23.190552 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabca226-2b01-4e3c-99c9-354e82969d11 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:23.204564 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabca226-2b01-4e3c-99c9-354e82969d11 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:23.219994 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd5b79e-ab54-4738-8a3b-2aec8448ead7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:23.221040 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd5b79e-ab54-4738-8a3b-2aec8448ead7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:23.221399 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd5b79e-ab54-4738-8a3b-2aec8448ead7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:23.221755 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd5b79e-ab54-4738-8a3b-2aec8448ead7 admin admin] PATH_INFO: `/v3/projects/48e4cf1e1be647a1a97b51d143926a25/users/155eed4128e242eab6cb40a5424ec9f0/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:23.241664 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd5b79e-ab54-4738-8a3b-2aec8448ead7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48e4cf1e1be647a1a97b51d143926a25, user_id=155eed4128e242eab6cb40a5424ec9f0, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:23.244661 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd5b79e-ab54-4738-8a3b-2aec8448ead7 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:23.317518 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2516/4995] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:30:23 2022] PUT /identity/v3/projects/48e4cf1e1be647a1a97b51d143926a25/users/155eed4128e242eab6cb40a5424ec9f0/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:30:23.328476 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa91e80c-6ac1-443d-85ec-c7f7eb0a8be7 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:23.328781 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa91e80c-6ac1-443d-85ec-c7f7eb0a8be7 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:23.331280 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa91e80c-6ac1-443d-85ec-c7f7eb0a8be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:23.385331 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-fa91e80c-6ac1-443d-85ec-c7f7eb0a8be7 None None] MFA Rules not processed for user `155eed4128e242eab6cb40a5424ec9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:30:23.386580 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-fa91e80c-6ac1-443d-85ec-c7f7eb0a8be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:23.471230 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2480/4996] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:30:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:30:23.479129 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd5b79e-ab54-4738-8a3b-2aec8448ead7 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:23.480880 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-bfd5b79e-ab54-4738-8a3b-2aec8448ead7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:23.568537 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd5b79e-ab54-4738-8a3b-2aec8448ead7 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:23.578501 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73263732-4998-495e-b67a-2659a7d6ec7d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b5cb86f190f4fcfb06d66cb8f14643f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:23.580573 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73263732-4998-495e-b67a-2659a7d6ec7d service glance] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:23.583827 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73263732-4998-495e-b67a-2659a7d6ec7d service glance] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:23.585682 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73263732-4998-495e-b67a-2659a7d6ec7d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:23.685294 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73263732-4998-495e-b67a-2659a7d6ec7d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:23.686477 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73263732-4998-495e-b67a-2659a7d6ec7d service glance] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:23.699664 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2517/4997] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:30:23 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:30:24.777256 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdfa6b4-5034-4b52-aa5b-6086a87fbd27 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:24.777793 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdfa6b4-5034-4b52-aa5b-6086a87fbd27 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:24.777793 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdfa6b4-5034-4b52-aa5b-6086a87fbd27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:24.807606 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-acdfa6b4-5034-4b52-aa5b-6086a87fbd27 None None] MFA Rules not processed for user `04e48304473d40ebb8c0c5386c4c3592`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:30:24.810961 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-acdfa6b4-5034-4b52-aa5b-6086a87fbd27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:24.907156 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2481/4998] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:30:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:30:25.598947 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73263732-4998-495e-b67a-2659a7d6ec7d service glance] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:25.706578 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73263732-4998-495e-b67a-2659a7d6ec7d service glance] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:25.711663 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f952c69-6767-456a-9d59-ea61af0d33b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:25.712811 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f952c69-6767-456a-9d59-ea61af0d33b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:25.713157 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f952c69-6767-456a-9d59-ea61af0d33b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:25.713505 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f952c69-6767-456a-9d59-ea61af0d33b5 admin admin] PATH_INFO: `/v3/users/687e564c8042450fbde936333ede270b` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:25.714832 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f952c69-6767-456a-9d59-ea61af0d33b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=687e564c8042450fbde936333ede270b)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:25.716902 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f952c69-6767-456a-9d59-ea61af0d33b5 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:25.958544 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0f952c69-6767-456a-9d59-ea61af0d33b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '687e564c8042450fbde936333ede270b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:25.973768 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0f952c69-6767-456a-9d59-ea61af0d33b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '687e564c8042450fbde936333ede270b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:25.986471 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0f952c69-6767-456a-9d59-ea61af0d33b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '687e564c8042450fbde936333ede270b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:26.097635 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0f952c69-6767-456a-9d59-ea61af0d33b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '687e564c8042450fbde936333ede270b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:26.098399 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0f952c69-6767-456a-9d59-ea61af0d33b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '687e564c8042450fbde936333ede270b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:26.106814 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2518/4999] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:30:25 2022] DELETE /identity/v3/users/687e564c8042450fbde936333ede270b => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:30:26.112339 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d0030-fba2-420f-a114-b2e4650bc475 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:26.114321 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d0030-fba2-420f-a114-b2e4650bc475 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:26.114321 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d0030-fba2-420f-a114-b2e4650bc475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:26.131250 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-cc6d0030-fba2-420f-a114-b2e4650bc475 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:30:26.132646 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-cc6d0030-fba2-420f-a114-b2e4650bc475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:26.210306 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2482/5000] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:30:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:30:26.220822 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f952c69-6767-456a-9d59-ea61af0d33b5 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:26.222356 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-0f952c69-6767-456a-9d59-ea61af0d33b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:26.292602 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f952c69-6767-456a-9d59-ea61af0d33b5 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:26.300993 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204180e7-35d7-4309-b7fd-31daf02a616d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:26.301660 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204180e7-35d7-4309-b7fd-31daf02a616d service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:26.301945 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204180e7-35d7-4309-b7fd-31daf02a616d service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:26.302226 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204180e7-35d7-4309-b7fd-31daf02a616d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:26.312225 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204180e7-35d7-4309-b7fd-31daf02a616d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:26.316304 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204180e7-35d7-4309-b7fd-31daf02a616d service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:26.323397 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2519/5001] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:30:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:30:27.625469 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6d0030-fba2-420f-a114-b2e4650bc475 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:27.625469 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-cc6d0030-fba2-420f-a114-b2e4650bc475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:27.625469 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6d0030-fba2-420f-a114-b2e4650bc475 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:27.628814 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c59b9f-d059-4bd7-9b01-8182962311f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:27.628814 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c59b9f-d059-4bd7-9b01-8182962311f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:27.628814 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c59b9f-d059-4bd7-9b01-8182962311f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:27.628814 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c59b9f-d059-4bd7-9b01-8182962311f0 admin admin] PATH_INFO: `/v3/projects/461ea13a51314446a3124ebffb3053cd` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:27.629881 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c59b9f-d059-4bd7-9b01-8182962311f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=461ea13a51314446a3124ebffb3053cd)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:27.629881 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c59b9f-d059-4bd7-9b01-8182962311f0 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:27.836798 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-04c59b9f-d059-4bd7-9b01-8182962311f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '461ea13a51314446a3124ebffb3053cd', 'request_id': 'req-04c59b9f-d059-4bd7-9b01-8182962311f0'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:27.848368 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-04c59b9f-d059-4bd7-9b01-8182962311f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '461ea13a51314446a3124ebffb3053cd', 'request_id': 'req-04c59b9f-d059-4bd7-9b01-8182962311f0'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:27.864085 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-04c59b9f-d059-4bd7-9b01-8182962311f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '461ea13a51314446a3124ebffb3053cd', 'request_id': 'req-04c59b9f-d059-4bd7-9b01-8182962311f0'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:27.949346 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-04c59b9f-d059-4bd7-9b01-8182962311f0 admin admin] The token cache is being invalidate because project 461ea13a51314446a3124ebffb3053cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:30:27.955594 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-04c59b9f-d059-4bd7-9b01-8182962311f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:27.955594 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-04c59b9f-d059-4bd7-9b01-8182962311f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:27.955594 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2483/5002] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:30:27 2022] DELETE /identity/v3/projects/461ea13a51314446a3124ebffb3053cd => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:30:27.957179 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204180e7-35d7-4309-b7fd-31daf02a616d service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:27.968976 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204180e7-35d7-4309-b7fd-31daf02a616d service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:28.040080 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c8457d-6291-48a8-b327-95d931ade776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:28.042921 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8457d-6291-48a8-b327-95d931ade776 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:28.042921 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8457d-6291-48a8-b327-95d931ade776 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:28.042921 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8457d-6291-48a8-b327-95d931ade776 admin admin] PATH_INFO: `/v3/users/155eed4128e242eab6cb40a5424ec9f0` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:28.044690 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c8457d-6291-48a8-b327-95d931ade776 admin admin] RBAC: Authorizing `identity:delete_user(user_id=155eed4128e242eab6cb40a5424ec9f0)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:28.049441 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c8457d-6291-48a8-b327-95d931ade776 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:28.257091 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-48c8457d-6291-48a8-b327-95d931ade776 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '155eed4128e242eab6cb40a5424ec9f0'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:28.291842 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-48c8457d-6291-48a8-b327-95d931ade776 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '155eed4128e242eab6cb40a5424ec9f0'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:28.306633 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-48c8457d-6291-48a8-b327-95d931ade776 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '155eed4128e242eab6cb40a5424ec9f0'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:28.429304 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-48c8457d-6291-48a8-b327-95d931ade776 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '155eed4128e242eab6cb40a5424ec9f0'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:28.430036 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-48c8457d-6291-48a8-b327-95d931ade776 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '155eed4128e242eab6cb40a5424ec9f0'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:28.438277 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2520/5003] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:30:27 2022] DELETE /identity/v3/users/155eed4128e242eab6cb40a5424ec9f0 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:30:29.295887 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c59b9f-d059-4bd7-9b01-8182962311f0 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:29.295887 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-04c59b9f-d059-4bd7-9b01-8182962311f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:29.295887 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c59b9f-d059-4bd7-9b01-8182962311f0 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:29.301105 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c8457d-6291-48a8-b327-95d931ade776 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:29.301105 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-48c8457d-6291-48a8-b327-95d931ade776 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:29.303447 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936ecf6e-df59-44e2-8b05-1c6aa17f79bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:29.303447 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ecf6e-df59-44e2-8b05-1c6aa17f79bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:29.303447 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ecf6e-df59-44e2-8b05-1c6aa17f79bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:29.303447 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ecf6e-df59-44e2-8b05-1c6aa17f79bc admin admin] PATH_INFO: `/v3/projects/48e4cf1e1be647a1a97b51d143926a25` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:29.304306 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936ecf6e-df59-44e2-8b05-1c6aa17f79bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=48e4cf1e1be647a1a97b51d143926a25)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:29.304306 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936ecf6e-df59-44e2-8b05-1c6aa17f79bc admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:29.333944 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c8457d-6291-48a8-b327-95d931ade776 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:29.339035 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a25b3c-4fba-4221-97ef-a977a85108c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:29.339943 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a25b3c-4fba-4221-97ef-a977a85108c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:29.340233 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a25b3c-4fba-4221-97ef-a977a85108c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:29.340504 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a25b3c-4fba-4221-97ef-a977a85108c9 admin admin] PATH_INFO: `/v3/users/b75ffa8886d946e3ae228f737b193198` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:29.341683 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a25b3c-4fba-4221-97ef-a977a85108c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b75ffa8886d946e3ae228f737b193198)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:29.344212 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a25b3c-4fba-4221-97ef-a977a85108c9 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:29.460114 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-936ecf6e-df59-44e2-8b05-1c6aa17f79bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48e4cf1e1be647a1a97b51d143926a25', 'request_id': 'req-936ecf6e-df59-44e2-8b05-1c6aa17f79bc'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:29.466076 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-936ecf6e-df59-44e2-8b05-1c6aa17f79bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48e4cf1e1be647a1a97b51d143926a25', 'request_id': 'req-936ecf6e-df59-44e2-8b05-1c6aa17f79bc'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:29.473552 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-936ecf6e-df59-44e2-8b05-1c6aa17f79bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48e4cf1e1be647a1a97b51d143926a25', 'request_id': 'req-936ecf6e-df59-44e2-8b05-1c6aa17f79bc'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:29.553264 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-936ecf6e-df59-44e2-8b05-1c6aa17f79bc admin admin] The token cache is being invalidate because project 48e4cf1e1be647a1a97b51d143926a25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:30:29.553462 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-936ecf6e-df59-44e2-8b05-1c6aa17f79bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:29.554141 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-936ecf6e-df59-44e2-8b05-1c6aa17f79bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:29.555752 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2484/5004] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:30:29 2022] DELETE /identity/v3/projects/48e4cf1e1be647a1a97b51d143926a25 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:30:29.563204 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1cc8a3-ed15-412e-adb2-46fb12369944 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:29.563543 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1cc8a3-ed15-412e-adb2-46fb12369944 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:29.563812 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1cc8a3-ed15-412e-adb2-46fb12369944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:29.582246 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-aa1cc8a3-ed15-412e-adb2-46fb12369944 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:30:29.583471 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-aa1cc8a3-ed15-412e-adb2-46fb12369944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:29.647523 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2485/5005] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:30:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:30:29.655192 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f4df3a-d260-4ad1-9ab3-068901e73715 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:29.657551 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f4df3a-d260-4ad1-9ab3-068901e73715 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:29.657965 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f4df3a-d260-4ad1-9ab3-068901e73715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:29.662322 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-09a25b3c-4fba-4221-97ef-a977a85108c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b75ffa8886d946e3ae228f737b193198'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:29.678962 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-09a25b3c-4fba-4221-97ef-a977a85108c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b75ffa8886d946e3ae228f737b193198'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:29.695544 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-44f4df3a-d260-4ad1-9ab3-068901e73715 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:30:29.695641 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-09a25b3c-4fba-4221-97ef-a977a85108c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b75ffa8886d946e3ae228f737b193198'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:29.695721 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-44f4df3a-d260-4ad1-9ab3-068901e73715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:29.696622 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2486/5006] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:30:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:30:29.700692 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f4df3a-d260-4ad1-9ab3-068901e73715 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:29.711131 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f4df3a-d260-4ad1-9ab3-068901e73715 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:29.715859 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0962f640-daa0-4d24-b8ba-1693ee570522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:29.716516 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962f640-daa0-4d24-b8ba-1693ee570522 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:29.716799 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962f640-daa0-4d24-b8ba-1693ee570522 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:29.717073 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962f640-daa0-4d24-b8ba-1693ee570522 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:29.717787 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0962f640-daa0-4d24-b8ba-1693ee570522 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:30:29.718326 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0962f640-daa0-4d24-b8ba-1693ee570522 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:29.719984 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0962f640-daa0-4d24-b8ba-1693ee570522 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:29.731437 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2487/5007] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:30:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:30:29.736498 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0962f640-daa0-4d24-b8ba-1693ee570522 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:29.748884 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0962f640-daa0-4d24-b8ba-1693ee570522 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:29.754473 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c979e27-c7ac-47f4-b9c0-6b3d1bec30ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:29.755193 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c979e27-c7ac-47f4-b9c0-6b3d1bec30ea admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:29.755537 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c979e27-c7ac-47f4-b9c0-6b3d1bec30ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:29.755890 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c979e27-c7ac-47f4-b9c0-6b3d1bec30ea admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:29.756574 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c979e27-c7ac-47f4-b9c0-6b3d1bec30ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:29.758541 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c979e27-c7ac-47f4-b9c0-6b3d1bec30ea admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:29.828532 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-09a25b3c-4fba-4221-97ef-a977a85108c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b75ffa8886d946e3ae228f737b193198'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:29.829757 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-09a25b3c-4fba-4221-97ef-a977a85108c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b75ffa8886d946e3ae228f737b193198'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:29.845925 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2488/5009] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:30:29 2022] POST /identity/v3/projects => generated 371 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:30:29.847451 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c979e27-c7ac-47f4-b9c0-6b3d1bec30ea admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:29.847773 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2521/5009] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:30:29 2022] DELETE /identity/v3/users/b75ffa8886d946e3ae228f737b193198 => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:30:29.853150 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-9c979e27-c7ac-47f4-b9c0-6b3d1bec30ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:29.862918 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0744c8b7-29be-4849-aace-5c340533f828 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:29.862918 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0744c8b7-29be-4849-aace-5c340533f828 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:29.862918 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0744c8b7-29be-4849-aace-5c340533f828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:29.882580 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-0744c8b7-29be-4849-aace-5c340533f828 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:30:29.885798 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-0744c8b7-29be-4849-aace-5c340533f828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:29.998407 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2522/5010] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:30:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:30:30.009300 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c979e27-c7ac-47f4-b9c0-6b3d1bec30ea admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:30.014187 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee0a63-e4e9-4fc1-8105-09820077bedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:30.014963 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee0a63-e4e9-4fc1-8105-09820077bedf admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:30.016474 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee0a63-e4e9-4fc1-8105-09820077bedf admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:30.016761 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee0a63-e4e9-4fc1-8105-09820077bedf admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:30.017463 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ee0a63-e4e9-4fc1-8105-09820077bedf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:30.019459 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ee0a63-e4e9-4fc1-8105-09820077bedf admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:30.020814 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0744c8b7-29be-4849-aace-5c340533f828 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:30.040102 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-0744c8b7-29be-4849-aace-5c340533f828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:30.126756 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0744c8b7-29be-4849-aace-5c340533f828 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:30.131412 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd7364-aa6d-4c82-a6ea-8576fa73ef46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:30.132291 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd7364-aa6d-4c82-a6ea-8576fa73ef46 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:30.136062 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd7364-aa6d-4c82-a6ea-8576fa73ef46 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:30.136062 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd7364-aa6d-4c82-a6ea-8576fa73ef46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:30.139911 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2489/5011] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:30:29 2022] POST /identity/v3/users => generated 286 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:30:30.144779 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee0a63-e4e9-4fc1-8105-09820077bedf admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:30.146277 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cd7364-aa6d-4c82-a6ea-8576fa73ef46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:30.152924 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cd7364-aa6d-4c82-a6ea-8576fa73ef46 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:30.160364 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee0a63-e4e9-4fc1-8105-09820077bedf admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:30.165912 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2523/5012] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:30:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:30:30.167661 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303fde70-b5ea-45d4-93c1-ca564068c3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:30.168587 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303fde70-b5ea-45d4-93c1-ca564068c3ef admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:30.168879 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303fde70-b5ea-45d4-93c1-ca564068c3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:30.169432 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303fde70-b5ea-45d4-93c1-ca564068c3ef admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:30.170168 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303fde70-b5ea-45d4-93c1-ca564068c3ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:30.172097 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303fde70-b5ea-45d4-93c1-ca564068c3ef admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:30.184352 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2490/5013] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:30:30 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:30:30.190377 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd7364-aa6d-4c82-a6ea-8576fa73ef46 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:30.201591 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd7364-aa6d-4c82-a6ea-8576fa73ef46 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:30.207735 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33396a4d-0902-4774-bfb2-69171e334682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:30.208430 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33396a4d-0902-4774-bfb2-69171e334682 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:30.208714 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33396a4d-0902-4774-bfb2-69171e334682 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:30.208992 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33396a4d-0902-4774-bfb2-69171e334682 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:30.209741 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33396a4d-0902-4774-bfb2-69171e334682 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:30.211340 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33396a4d-0902-4774-bfb2-69171e334682 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:30.223515 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2524/5014] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:30:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:30:30.227262 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303fde70-b5ea-45d4-93c1-ca564068c3ef admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:30.237622 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303fde70-b5ea-45d4-93c1-ca564068c3ef admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:30.242892 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfd4db0-b557-45c0-b575-0fc49828a326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:30.243885 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd4db0-b557-45c0-b575-0fc49828a326 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:30.244172 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd4db0-b557-45c0-b575-0fc49828a326 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:30.244581 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd4db0-b557-45c0-b575-0fc49828a326 admin admin] PATH_INFO: `/v3/projects/362e6afe25d44ad3ac33b3af9a83e584/users/79c80e27f1f24e5895dd313e399bda39/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:30.260889 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfd4db0-b557-45c0-b575-0fc49828a326 admin admin] RBAC: Authorizing `identity:create_grant(project_id=362e6afe25d44ad3ac33b3af9a83e584, user_id=79c80e27f1f24e5895dd313e399bda39, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:30.263705 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfd4db0-b557-45c0-b575-0fc49828a326 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:30.371908 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2491/5015] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:30:30 2022] PUT /identity/v3/projects/362e6afe25d44ad3ac33b3af9a83e584/users/79c80e27f1f24e5895dd313e399bda39/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:30:30.383215 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c25dcd7-a787-442b-9c68-5dadd357f41c None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:30.383720 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c25dcd7-a787-442b-9c68-5dadd357f41c None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:30.383865 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c25dcd7-a787-442b-9c68-5dadd357f41c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:30.414560 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-5c25dcd7-a787-442b-9c68-5dadd357f41c None None] MFA Rules not processed for user `79c80e27f1f24e5895dd313e399bda39`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:30:30.415949 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-5c25dcd7-a787-442b-9c68-5dadd357f41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:30.495605 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2525/5016] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:30:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:30:30.506958 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfd4db0-b557-45c0-b575-0fc49828a326 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:30.508697 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-7cfd4db0-b557-45c0-b575-0fc49828a326 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:30.576837 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfd4db0-b557-45c0-b575-0fc49828a326 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:30.582091 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09815a49-f570-462c-833b-1205a7b39728 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b5cb86f190f4fcfb06d66cb8f14643f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:30.582762 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09815a49-f570-462c-833b-1205a7b39728 service glance] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:30.583070 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09815a49-f570-462c-833b-1205a7b39728 service glance] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:30.583586 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09815a49-f570-462c-833b-1205a7b39728 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:30.596284 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09815a49-f570-462c-833b-1205a7b39728 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:30.597933 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09815a49-f570-462c-833b-1205a7b39728 service glance] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:30.608053 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2492/5017] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:30:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:30:30.725918 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c25dcd7-a787-442b-9c68-5dadd357f41c None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:30.800397 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c25dcd7-a787-442b-9c68-5dadd357f41c None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:30.805285 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bade6d66-d924-4f30-83fa-48cfa4862886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:30.806168 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade6d66-d924-4f30-83fa-48cfa4862886 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:30.806440 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade6d66-d924-4f30-83fa-48cfa4862886 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:30.807124 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade6d66-d924-4f30-83fa-48cfa4862886 admin admin] PATH_INFO: `/v3/users/79c80e27f1f24e5895dd313e399bda39` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:30.808545 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bade6d66-d924-4f30-83fa-48cfa4862886 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79c80e27f1f24e5895dd313e399bda39)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:30.810465 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bade6d66-d924-4f30-83fa-48cfa4862886 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:30.923703 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09815a49-f570-462c-833b-1205a7b39728 service glance] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:30.934192 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-09815a49-f570-462c-833b-1205a7b39728 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:30.955673 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09815a49-f570-462c-833b-1205a7b39728 service glance] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:30.963147 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a1a1d-6899-4265-b7ca-2c21040a1cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:30.964214 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a1a1d-6899-4265-b7ca-2c21040a1cbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:30.964584 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a1a1d-6899-4265-b7ca-2c21040a1cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:30.965066 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a1a1d-6899-4265-b7ca-2c21040a1cbc admin admin] PATH_INFO: `/v3/projects/f43cf27f7a634cb4adb7865a7e8b7838` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:30.967049 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86a1a1d-6899-4265-b7ca-2c21040a1cbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=f43cf27f7a634cb4adb7865a7e8b7838)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:30.970136 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86a1a1d-6899-4265-b7ca-2c21040a1cbc admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:31.105648 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-bade6d66-d924-4f30-83fa-48cfa4862886 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79c80e27f1f24e5895dd313e399bda39'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:31.119245 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-bade6d66-d924-4f30-83fa-48cfa4862886 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79c80e27f1f24e5895dd313e399bda39'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:31.127668 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-bade6d66-d924-4f30-83fa-48cfa4862886 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79c80e27f1f24e5895dd313e399bda39'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:31.202897 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d86a1a1d-6899-4265-b7ca-2c21040a1cbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f43cf27f7a634cb4adb7865a7e8b7838', 'request_id': 'req-d86a1a1d-6899-4265-b7ca-2c21040a1cbc'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:31.211164 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d86a1a1d-6899-4265-b7ca-2c21040a1cbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f43cf27f7a634cb4adb7865a7e8b7838', 'request_id': 'req-d86a1a1d-6899-4265-b7ca-2c21040a1cbc'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:31.224636 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d86a1a1d-6899-4265-b7ca-2c21040a1cbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f43cf27f7a634cb4adb7865a7e8b7838', 'request_id': 'req-d86a1a1d-6899-4265-b7ca-2c21040a1cbc'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:31.226275 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-bade6d66-d924-4f30-83fa-48cfa4862886 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79c80e27f1f24e5895dd313e399bda39'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:31.227327 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-bade6d66-d924-4f30-83fa-48cfa4862886 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79c80e27f1f24e5895dd313e399bda39'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:31.238981 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2526/5018] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:30:30 2022] DELETE /identity/v3/users/79c80e27f1f24e5895dd313e399bda39 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:30:31.245094 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e29e2b-4817-484e-b133-b95e8efd2dd9 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:31.245385 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e29e2b-4817-484e-b133-b95e8efd2dd9 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:31.245665 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e29e2b-4817-484e-b133-b95e8efd2dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:31.268100 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-54e29e2b-4817-484e-b133-b95e8efd2dd9 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:30:31.269555 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-54e29e2b-4817-484e-b133-b95e8efd2dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:31.359376 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d86a1a1d-6899-4265-b7ca-2c21040a1cbc admin admin] The token cache is being invalidate because project f43cf27f7a634cb4adb7865a7e8b7838 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:30:31.359942 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d86a1a1d-6899-4265-b7ca-2c21040a1cbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:31.360598 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d86a1a1d-6899-4265-b7ca-2c21040a1cbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:31.362296 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2493/5019] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:30:30 2022] DELETE /identity/v3/projects/f43cf27f7a634cb4adb7865a7e8b7838 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:30:31.365757 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2527/5020] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:30:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:30:31.367823 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04297c58-7a00-4803-b293-95131268b205 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:31.368134 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04297c58-7a00-4803-b293-95131268b205 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:31.368406 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04297c58-7a00-4803-b293-95131268b205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:31.375577 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e29e2b-4817-484e-b133-b95e8efd2dd9 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:31.377172 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-54e29e2b-4817-484e-b133-b95e8efd2dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:31.387034 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-04297c58-7a00-4803-b293-95131268b205 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:30:31.388801 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-04297c58-7a00-4803-b293-95131268b205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:31.407267 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2494/5021] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:30:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:30:31.414696 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb2d10-ba91-4b9e-bb69-b9b79da32c5e None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:31.415761 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb2d10-ba91-4b9e-bb69-b9b79da32c5e None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:31.416142 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb2d10-ba91-4b9e-bb69-b9b79da32c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:31.440853 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-57eb2d10-ba91-4b9e-bb69-b9b79da32c5e None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:30:31.442289 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-57eb2d10-ba91-4b9e-bb69-b9b79da32c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:31.464949 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2495/5022] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:30:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:30:31.471517 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eb2d10-ba91-4b9e-bb69-b9b79da32c5e None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:31.475827 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e29e2b-4817-484e-b133-b95e8efd2dd9 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:31.480621 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d704e-06ba-4091-aec6-4ab499396fa1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:31.481518 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d704e-06ba-4091-aec6-4ab499396fa1 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:31.482065 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d704e-06ba-4091-aec6-4ab499396fa1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:31.483034 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d704e-06ba-4091-aec6-4ab499396fa1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:31.493563 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eb2d10-ba91-4b9e-bb69-b9b79da32c5e None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:31.499084 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dd29f9-17ce-4ef7-b111-292c051819c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:31.500634 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd29f9-17ce-4ef7-b111-292c051819c0 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:31.501398 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd29f9-17ce-4ef7-b111-292c051819c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:31.501834 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd29f9-17ce-4ef7-b111-292c051819c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:31.502978 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dd29f9-17ce-4ef7-b111-292c051819c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:30:31.503660 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dd29f9-17ce-4ef7-b111-292c051819c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:31.505530 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dd29f9-17ce-4ef7-b111-292c051819c0 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:31.517050 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83d704e-06ba-4091-aec6-4ab499396fa1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:31.519010 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83d704e-06ba-4091-aec6-4ab499396fa1 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:31.524060 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2496/5023] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:30:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:30:31.528378 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dd29f9-17ce-4ef7-b111-292c051819c0 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:31.542982 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dd29f9-17ce-4ef7-b111-292c051819c0 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:31.545465 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2528/5024] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:30:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:30:31.551126 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b1606-77db-45df-927d-904d41b5e3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:31.552107 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b1606-77db-45df-927d-904d41b5e3e9 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:31.552704 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b1606-77db-45df-927d-904d41b5e3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:31.553126 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b1606-77db-45df-927d-904d41b5e3e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:31.554163 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9b1606-77db-45df-927d-904d41b5e3e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:31.560250 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9b1606-77db-45df-927d-904d41b5e3e9 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:31.662341 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2497/5025] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:30:31 2022] POST /identity/v3/projects => generated 371 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:30:31.668133 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d704e-06ba-4091-aec6-4ab499396fa1 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:31.681551 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d704e-06ba-4091-aec6-4ab499396fa1 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:31.790448 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba684d5-3817-4687-863c-5427b42c0c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:31.791213 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba684d5-3817-4687-863c-5427b42c0c60 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:31.791601 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba684d5-3817-4687-863c-5427b42c0c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:31.795438 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba684d5-3817-4687-863c-5427b42c0c60 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:31.798024 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba684d5-3817-4687-863c-5427b42c0c60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:31.802373 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba684d5-3817-4687-863c-5427b42c0c60 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:31.975892 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2529/5026] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:30:31 2022] POST /identity/v3/users => generated 286 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:30:31.980525 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b1606-77db-45df-927d-904d41b5e3e9 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:32.000588 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b1606-77db-45df-927d-904d41b5e3e9 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:32.007728 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5ce3be-a90b-4418-9b6f-576445f66540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:32.008944 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ce3be-a90b-4418-9b6f-576445f66540 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:32.009598 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ce3be-a90b-4418-9b6f-576445f66540 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:32.012256 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ce3be-a90b-4418-9b6f-576445f66540 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:32.013374 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5ce3be-a90b-4418-9b6f-576445f66540 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:32.016407 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5ce3be-a90b-4418-9b6f-576445f66540 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:32.045185 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2498/5027] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:30:31 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:30:32.050519 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba684d5-3817-4687-863c-5427b42c0c60 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:32.067070 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba684d5-3817-4687-863c-5427b42c0c60 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:32.072544 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314eee34-ceeb-492a-b35c-40e032412a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:32.073944 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314eee34-ceeb-492a-b35c-40e032412a3f admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:32.074918 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314eee34-ceeb-492a-b35c-40e032412a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:32.075340 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314eee34-ceeb-492a-b35c-40e032412a3f admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:32.076275 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314eee34-ceeb-492a-b35c-40e032412a3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:32.079703 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314eee34-ceeb-492a-b35c-40e032412a3f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:32.099155 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2530/5028] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:30:32 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:30:32.103106 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5ce3be-a90b-4418-9b6f-576445f66540 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:32.117177 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5ce3be-a90b-4418-9b6f-576445f66540 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:32.124038 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd54c9fd-d81f-4a1a-a2b3-0525b9f3d0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:32.125988 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54c9fd-d81f-4a1a-a2b3-0525b9f3d0e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:32.126441 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54c9fd-d81f-4a1a-a2b3-0525b9f3d0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:32.126873 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54c9fd-d81f-4a1a-a2b3-0525b9f3d0e2 admin admin] PATH_INFO: `/v3/projects/ae5e9ab5390a49d0ad1896e52248340d/users/7133ca2c209048149a095b778ac1424e/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:32.145050 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd54c9fd-d81f-4a1a-a2b3-0525b9f3d0e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae5e9ab5390a49d0ad1896e52248340d, user_id=7133ca2c209048149a095b778ac1424e, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:32.155720 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd54c9fd-d81f-4a1a-a2b3-0525b9f3d0e2 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:32.240394 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2499/5029] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:30:32 2022] PUT /identity/v3/projects/ae5e9ab5390a49d0ad1896e52248340d/users/7133ca2c209048149a095b778ac1424e/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:30:32.259435 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e5557a-359e-4871-9c95-e71a8f4d99b9 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:32.259751 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e5557a-359e-4871-9c95-e71a8f4d99b9 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:32.260189 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e5557a-359e-4871-9c95-e71a8f4d99b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:32.298275 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-61e5557a-359e-4871-9c95-e71a8f4d99b9 None None] MFA Rules not processed for user `7133ca2c209048149a095b778ac1424e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:30:32.299866 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-61e5557a-359e-4871-9c95-e71a8f4d99b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:32.362918 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd54c9fd-d81f-4a1a-a2b3-0525b9f3d0e2 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:32.365993 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-bd54c9fd-d81f-4a1a-a2b3-0525b9f3d0e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:32.456380 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2531/5030] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:30:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:30:32.469863 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782a712-6129-4b60-8b47-62f1755b4b3e None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:32.473756 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782a712-6129-4b60-8b47-62f1755b4b3e None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:32.473756 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782a712-6129-4b60-8b47-62f1755b4b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:32.521284 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-1782a712-6129-4b60-8b47-62f1755b4b3e None None] MFA Rules not processed for user `7133ca2c209048149a095b778ac1424e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:30:32.523340 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-1782a712-6129-4b60-8b47-62f1755b4b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:32.524312 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd54c9fd-d81f-4a1a-a2b3-0525b9f3d0e2 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:32.535544 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2532/5031] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:30:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:30:32.536511 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96b7aaf-f9fc-4bea-9967-efc1c05b1ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:32.537591 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b7aaf-f9fc-4bea-9967-efc1c05b1ed3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:32.541466 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b7aaf-f9fc-4bea-9967-efc1c05b1ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:32.541466 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b7aaf-f9fc-4bea-9967-efc1c05b1ed3 admin admin] PATH_INFO: `/v3/projects/362e6afe25d44ad3ac33b3af9a83e584` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:32.541466 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96b7aaf-f9fc-4bea-9967-efc1c05b1ed3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=362e6afe25d44ad3ac33b3af9a83e584)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:32.542347 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96b7aaf-f9fc-4bea-9967-efc1c05b1ed3 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:32.553931 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1782a712-6129-4b60-8b47-62f1755b4b3e None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:32.556461 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-1782a712-6129-4b60-8b47-62f1755b4b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:32.643619 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1782a712-6129-4b60-8b47-62f1755b4b3e None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:32.649631 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d363e04e-751c-4dc7-b508-596279ab9ef7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:32.650369 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d363e04e-751c-4dc7-b508-596279ab9ef7 service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:32.650721 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d363e04e-751c-4dc7-b508-596279ab9ef7 service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:32.651079 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d363e04e-751c-4dc7-b508-596279ab9ef7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:32.664863 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d363e04e-751c-4dc7-b508-596279ab9ef7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:32.664863 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d363e04e-751c-4dc7-b508-596279ab9ef7 service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:32.670414 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2533/5032] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:30:32 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:30:32.703236 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a96b7aaf-f9fc-4bea-9967-efc1c05b1ed3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '362e6afe25d44ad3ac33b3af9a83e584', 'request_id': 'req-a96b7aaf-f9fc-4bea-9967-efc1c05b1ed3'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:32.709022 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a96b7aaf-f9fc-4bea-9967-efc1c05b1ed3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '362e6afe25d44ad3ac33b3af9a83e584', 'request_id': 'req-a96b7aaf-f9fc-4bea-9967-efc1c05b1ed3'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:32.715709 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a96b7aaf-f9fc-4bea-9967-efc1c05b1ed3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '362e6afe25d44ad3ac33b3af9a83e584', 'request_id': 'req-a96b7aaf-f9fc-4bea-9967-efc1c05b1ed3'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:32.829647 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a96b7aaf-f9fc-4bea-9967-efc1c05b1ed3 admin admin] The token cache is being invalidate because project 362e6afe25d44ad3ac33b3af9a83e584 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:30:32.830858 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a96b7aaf-f9fc-4bea-9967-efc1c05b1ed3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:32.833786 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a96b7aaf-f9fc-4bea-9967-efc1c05b1ed3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:32.839826 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2500/5033] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:30:32 2022] DELETE /identity/v3/projects/362e6afe25d44ad3ac33b3af9a83e584 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:30:32.845760 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd7f43-d48d-4758-af90-5c09aa2a37da None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:32.848146 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd7f43-d48d-4758-af90-5c09aa2a37da None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:32.849321 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd7f43-d48d-4758-af90-5c09aa2a37da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:32.901552 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-c1fd7f43-d48d-4758-af90-5c09aa2a37da None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:30:32.902873 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c1fd7f43-d48d-4758-af90-5c09aa2a37da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:33.083283 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26890d56-77c7-4669-b7d0-2a3eeaad21e4 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:33.084045 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26890d56-77c7-4669-b7d0-2a3eeaad21e4 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:33.088375 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2534/5034] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:30:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:30:33.089837 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26890d56-77c7-4669-b7d0-2a3eeaad21e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:33.145775 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-26890d56-77c7-4669-b7d0-2a3eeaad21e4 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:30:33.147021 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-26890d56-77c7-4669-b7d0-2a3eeaad21e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:33.174799 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2501/5035] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:30:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:30:33.179298 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fd7f43-d48d-4758-af90-5c09aa2a37da None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:33.208050 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fd7f43-d48d-4758-af90-5c09aa2a37da None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:33.216723 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0339ac5d-d8d8-432a-a56f-6d8d5a390f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:33.232182 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0339ac5d-d8d8-432a-a56f-6d8d5a390f85 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:33.233196 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0339ac5d-d8d8-432a-a56f-6d8d5a390f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:33.233196 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0339ac5d-d8d8-432a-a56f-6d8d5a390f85 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:33.233590 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0339ac5d-d8d8-432a-a56f-6d8d5a390f85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:30:33.239956 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0339ac5d-d8d8-432a-a56f-6d8d5a390f85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:33.242204 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0339ac5d-d8d8-432a-a56f-6d8d5a390f85 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:33.261001 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2535/5036] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:30:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:30:33.266293 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26890d56-77c7-4669-b7d0-2a3eeaad21e4 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:33.281137 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26890d56-77c7-4669-b7d0-2a3eeaad21e4 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:33.293603 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb17a43d-9414-41f8-8ef0-8979e9b686a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:33.300983 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb17a43d-9414-41f8-8ef0-8979e9b686a7 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:33.301281 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb17a43d-9414-41f8-8ef0-8979e9b686a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:33.301641 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb17a43d-9414-41f8-8ef0-8979e9b686a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:33.302474 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb17a43d-9414-41f8-8ef0-8979e9b686a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:33.304708 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb17a43d-9414-41f8-8ef0-8979e9b686a7 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:33.816440 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2502/5037] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:30:33 2022] POST /identity/v3/projects => generated 361 bytes in 551 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:30:33.817216 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0339ac5d-d8d8-432a-a56f-6d8d5a390f85 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:33.834576 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0339ac5d-d8d8-432a-a56f-6d8d5a390f85 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:33.963261 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a355d329-5c2f-4cd0-98df-05144c4f8920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:33.964261 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a355d329-5c2f-4cd0-98df-05144c4f8920 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:33.964752 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a355d329-5c2f-4cd0-98df-05144c4f8920 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:33.965080 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a355d329-5c2f-4cd0-98df-05144c4f8920 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:33.965924 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a355d329-5c2f-4cd0-98df-05144c4f8920 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:33.968822 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a355d329-5c2f-4cd0-98df-05144c4f8920 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:34.099009 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2536/5038] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:30:33 2022] POST /identity/v3/users => generated 281 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:30:34.103137 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb17a43d-9414-41f8-8ef0-8979e9b686a7 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:34.119648 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb17a43d-9414-41f8-8ef0-8979e9b686a7 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:34.150578 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5efc2cc-aea6-47ec-bc25-bd36e06fc922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:34.154935 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5efc2cc-aea6-47ec-bc25-bd36e06fc922 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:34.155095 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5efc2cc-aea6-47ec-bc25-bd36e06fc922 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:34.156320 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5efc2cc-aea6-47ec-bc25-bd36e06fc922 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:34.159080 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5efc2cc-aea6-47ec-bc25-bd36e06fc922 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:34.165171 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5efc2cc-aea6-47ec-bc25-bd36e06fc922 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:34.183783 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2503/5039] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:30:34 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:30:34.195236 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a355d329-5c2f-4cd0-98df-05144c4f8920 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:34.210891 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a355d329-5c2f-4cd0-98df-05144c4f8920 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:34.216838 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d57920-8389-48b3-9e49-42765e0bbc06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:34.218864 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d57920-8389-48b3-9e49-42765e0bbc06 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:34.219870 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d57920-8389-48b3-9e49-42765e0bbc06 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:34.220350 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d57920-8389-48b3-9e49-42765e0bbc06 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:34.221661 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d57920-8389-48b3-9e49-42765e0bbc06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:34.224570 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d57920-8389-48b3-9e49-42765e0bbc06 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:34.239876 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2537/5040] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:30:34 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:30:34.244240 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5efc2cc-aea6-47ec-bc25-bd36e06fc922 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:34.257248 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5efc2cc-aea6-47ec-bc25-bd36e06fc922 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:34.261981 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc20d79-b5b9-4e9d-904c-52804c112af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:34.262862 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc20d79-b5b9-4e9d-904c-52804c112af4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:34.263147 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc20d79-b5b9-4e9d-904c-52804c112af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:34.263435 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc20d79-b5b9-4e9d-904c-52804c112af4 admin admin] PATH_INFO: `/v3/projects/9df304d1a023497092679210709317fb/users/40faad7de4a3455599c9ff6869ce8cbb/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:34.281874 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc20d79-b5b9-4e9d-904c-52804c112af4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9df304d1a023497092679210709317fb, user_id=40faad7de4a3455599c9ff6869ce8cbb, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:34.284835 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc20d79-b5b9-4e9d-904c-52804c112af4 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:34.404100 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2504/5041] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:30:34 2022] PUT /identity/v3/projects/9df304d1a023497092679210709317fb/users/40faad7de4a3455599c9ff6869ce8cbb/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:30:34.416974 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d90a100-e28f-4925-8bb9-26127b3e2693 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:34.420028 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d90a100-e28f-4925-8bb9-26127b3e2693 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:34.420526 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d90a100-e28f-4925-8bb9-26127b3e2693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:34.462333 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-9d90a100-e28f-4925-8bb9-26127b3e2693 None None] MFA Rules not processed for user `40faad7de4a3455599c9ff6869ce8cbb`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:30:34.464916 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-9d90a100-e28f-4925-8bb9-26127b3e2693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:34.556426 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2538/5042] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:30:34 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:30:34.580653 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc20d79-b5b9-4e9d-904c-52804c112af4 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:34.675468 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc20d79-b5b9-4e9d-904c-52804c112af4 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:34.682878 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713081c3-2ef4-4a59-b30d-47b73886f097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:34.684296 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713081c3-2ef4-4a59-b30d-47b73886f097 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:34.696055 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713081c3-2ef4-4a59-b30d-47b73886f097 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:34.696055 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713081c3-2ef4-4a59-b30d-47b73886f097 admin admin] PATH_INFO: `/v3/users/40faad7de4a3455599c9ff6869ce8cbb` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:34.696055 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713081c3-2ef4-4a59-b30d-47b73886f097 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40faad7de4a3455599c9ff6869ce8cbb)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:34.696055 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713081c3-2ef4-4a59-b30d-47b73886f097 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:35.010172 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-713081c3-2ef4-4a59-b30d-47b73886f097 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40faad7de4a3455599c9ff6869ce8cbb'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:35.021006 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-713081c3-2ef4-4a59-b30d-47b73886f097 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40faad7de4a3455599c9ff6869ce8cbb'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:35.021777 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-713081c3-2ef4-4a59-b30d-47b73886f097 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40faad7de4a3455599c9ff6869ce8cbb'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:35.122250 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-713081c3-2ef4-4a59-b30d-47b73886f097 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40faad7de4a3455599c9ff6869ce8cbb'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:35.136343 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-713081c3-2ef4-4a59-b30d-47b73886f097 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40faad7de4a3455599c9ff6869ce8cbb'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:35.144799 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2505/5043] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:30:34 2022] DELETE /identity/v3/users/40faad7de4a3455599c9ff6869ce8cbb => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:30:35.149584 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c4c851-defb-415d-ba02-bfd8dee965f4 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:35.153444 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c4c851-defb-415d-ba02-bfd8dee965f4 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:35.153444 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c4c851-defb-415d-ba02-bfd8dee965f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:35.172020 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-b6c4c851-defb-415d-ba02-bfd8dee965f4 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:30:35.172989 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b6c4c851-defb-415d-ba02-bfd8dee965f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:35.253110 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2539/5044] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:30:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:30:35.264490 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713081c3-2ef4-4a59-b30d-47b73886f097 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:35.266829 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-713081c3-2ef4-4a59-b30d-47b73886f097 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:35.360299 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713081c3-2ef4-4a59-b30d-47b73886f097 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:35.365188 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39dfc22-a1e4-4e0a-8581-f06c9b326885 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:35.370691 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39dfc22-a1e4-4e0a-8581-f06c9b326885 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:35.370691 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39dfc22-a1e4-4e0a-8581-f06c9b326885 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:35.370691 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39dfc22-a1e4-4e0a-8581-f06c9b326885 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:35.382710 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39dfc22-a1e4-4e0a-8581-f06c9b326885 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:35.384484 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39dfc22-a1e4-4e0a-8581-f06c9b326885 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:35.398250 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2506/5045] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:30:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:30:36.245765 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c4c851-defb-415d-ba02-bfd8dee965f4 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:36.247978 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b6c4c851-defb-415d-ba02-bfd8dee965f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:36.264355 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c4c851-defb-415d-ba02-bfd8dee965f4 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:36.272368 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07816650-006d-4e23-8683-ade16b7985b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:36.273721 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07816650-006d-4e23-8683-ade16b7985b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:36.274195 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07816650-006d-4e23-8683-ade16b7985b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:36.274544 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07816650-006d-4e23-8683-ade16b7985b4 admin admin] PATH_INFO: `/v3/projects/9df304d1a023497092679210709317fb` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:36.276028 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07816650-006d-4e23-8683-ade16b7985b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9df304d1a023497092679210709317fb)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:36.279264 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07816650-006d-4e23-8683-ade16b7985b4 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:36.387971 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-07816650-006d-4e23-8683-ade16b7985b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9df304d1a023497092679210709317fb', 'request_id': 'req-07816650-006d-4e23-8683-ade16b7985b4'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:36.394729 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-07816650-006d-4e23-8683-ade16b7985b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9df304d1a023497092679210709317fb', 'request_id': 'req-07816650-006d-4e23-8683-ade16b7985b4'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:36.473761 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-07816650-006d-4e23-8683-ade16b7985b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9df304d1a023497092679210709317fb', 'request_id': 'req-07816650-006d-4e23-8683-ade16b7985b4'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:36.491223 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-07816650-006d-4e23-8683-ade16b7985b4 admin admin] The token cache is being invalidate because project 9df304d1a023497092679210709317fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:30:36.492522 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-07816650-006d-4e23-8683-ade16b7985b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:36.493602 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-07816650-006d-4e23-8683-ade16b7985b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:30:36.500387 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2540/5046] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:30:36 2022] DELETE /identity/v3/projects/9df304d1a023497092679210709317fb => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:30:36.501340 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3a198-f399-4e52-b2a7-78dc9c84c6d0 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:36.501768 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3a198-f399-4e52-b2a7-78dc9c84c6d0 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:36.501899 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3a198-f399-4e52-b2a7-78dc9c84c6d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:36.540745 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-4ed3a198-f399-4e52-b2a7-78dc9c84c6d0 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:30:36.542263 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-4ed3a198-f399-4e52-b2a7-78dc9c84c6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:36.637693 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2507/5047] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:30:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:30:36.646699 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab66cb9-5647-4374-92f1-8fe9d7a2b892 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:36.649768 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab66cb9-5647-4374-92f1-8fe9d7a2b892 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:36.649768 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab66cb9-5647-4374-92f1-8fe9d7a2b892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:36.686235 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-0ab66cb9-5647-4374-92f1-8fe9d7a2b892 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:30:36.691633 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-0ab66cb9-5647-4374-92f1-8fe9d7a2b892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:36.705426 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2541/5048] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:30:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:30:36.707024 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed3a198-f399-4e52-b2a7-78dc9c84c6d0 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:36.719057 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed3a198-f399-4e52-b2a7-78dc9c84c6d0 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:36.730664 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6639e93d-b1c5-496a-b275-d80651cbafd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:36.731418 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6639e93d-b1c5-496a-b275-d80651cbafd6 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:36.731770 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6639e93d-b1c5-496a-b275-d80651cbafd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:36.732039 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6639e93d-b1c5-496a-b275-d80651cbafd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:36.732780 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6639e93d-b1c5-496a-b275-d80651cbafd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:30:36.733092 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6639e93d-b1c5-496a-b275-d80651cbafd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:36.735913 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6639e93d-b1c5-496a-b275-d80651cbafd6 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:36.754502 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2508/5049] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:30:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:30:36.760315 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab66cb9-5647-4374-92f1-8fe9d7a2b892 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:36.772938 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab66cb9-5647-4374-92f1-8fe9d7a2b892 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:36.779014 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7aa18c-c608-47b7-b4e5-60a461ed6438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:36.780264 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7aa18c-c608-47b7-b4e5-60a461ed6438 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:36.780264 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7aa18c-c608-47b7-b4e5-60a461ed6438 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:36.780453 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7aa18c-c608-47b7-b4e5-60a461ed6438 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:36.781173 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7aa18c-c608-47b7-b4e5-60a461ed6438 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:36.784424 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7aa18c-c608-47b7-b4e5-60a461ed6438 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:36.910844 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2542/5050] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:30:36 2022] POST /identity/v3/projects => generated 383 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:30:36.913999 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6639e93d-b1c5-496a-b275-d80651cbafd6 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:36.936087 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6639e93d-b1c5-496a-b275-d80651cbafd6 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:37.050877 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bfbb54-c823-42c3-8b4e-a914a9ab1e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:37.051634 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bfbb54-c823-42c3-8b4e-a914a9ab1e0f admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:37.052076 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bfbb54-c823-42c3-8b4e-a914a9ab1e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:37.052364 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bfbb54-c823-42c3-8b4e-a914a9ab1e0f admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:37.053545 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bfbb54-c823-42c3-8b4e-a914a9ab1e0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:37.056317 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bfbb54-c823-42c3-8b4e-a914a9ab1e0f admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:37.167938 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2509/5051] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:30:36 2022] POST /identity/v3/users => generated 292 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:30:37.172398 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7aa18c-c608-47b7-b4e5-60a461ed6438 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:37.185292 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7aa18c-c608-47b7-b4e5-60a461ed6438 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:37.197242 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9601f248-34a5-4b7c-b276-c863dc39556f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:37.197943 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9601f248-34a5-4b7c-b276-c863dc39556f admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:37.198234 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9601f248-34a5-4b7c-b276-c863dc39556f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:37.198552 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9601f248-34a5-4b7c-b276-c863dc39556f admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:37.199763 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9601f248-34a5-4b7c-b276-c863dc39556f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:37.201322 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9601f248-34a5-4b7c-b276-c863dc39556f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:37.215411 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2543/5052] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:30:37 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:30:37.219859 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bfbb54-c823-42c3-8b4e-a914a9ab1e0f admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:37.232141 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bfbb54-c823-42c3-8b4e-a914a9ab1e0f admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:37.256630 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c547c9-a8dd-4271-8a24-919c31748c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:37.257803 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c547c9-a8dd-4271-8a24-919c31748c19 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:37.257943 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c547c9-a8dd-4271-8a24-919c31748c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:37.258139 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c547c9-a8dd-4271-8a24-919c31748c19 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:37.258914 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c547c9-a8dd-4271-8a24-919c31748c19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:37.260787 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c547c9-a8dd-4271-8a24-919c31748c19 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:37.282102 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2510/5053] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:30:37 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:30:37.284423 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9601f248-34a5-4b7c-b276-c863dc39556f admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:37.298211 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9601f248-34a5-4b7c-b276-c863dc39556f admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:37.308720 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0816ede1-0a47-416b-8d09-eb7a6900090e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:37.308720 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0816ede1-0a47-416b-8d09-eb7a6900090e admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:37.308720 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0816ede1-0a47-416b-8d09-eb7a6900090e admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:37.308720 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0816ede1-0a47-416b-8d09-eb7a6900090e admin admin] PATH_INFO: `/v3/projects/fed8d19b77e14adb88ac679316fd3e9a/users/4d73e918a65b4d78bd7d5cdbcad00cf7/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:37.328606 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0816ede1-0a47-416b-8d09-eb7a6900090e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fed8d19b77e14adb88ac679316fd3e9a, user_id=4d73e918a65b4d78bd7d5cdbcad00cf7, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:37.332405 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0816ede1-0a47-416b-8d09-eb7a6900090e admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:37.438299 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2544/5054] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:30:37 2022] PUT /identity/v3/projects/fed8d19b77e14adb88ac679316fd3e9a/users/4d73e918a65b4d78bd7d5cdbcad00cf7/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:30:37.451160 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f5c3c-1626-4ed8-9047-ef74b633364e None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:37.453206 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f5c3c-1626-4ed8-9047-ef74b633364e None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:37.453712 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f5c3c-1626-4ed8-9047-ef74b633364e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:37.491568 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-187f5c3c-1626-4ed8-9047-ef74b633364e None None] MFA Rules not processed for user `4d73e918a65b4d78bd7d5cdbcad00cf7`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:30:37.494332 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-187f5c3c-1626-4ed8-9047-ef74b633364e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:37.591517 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2511/5055] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:30:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:30:37.595307 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0816ede1-0a47-416b-8d09-eb7a6900090e admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:37.727757 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0816ede1-0a47-416b-8d09-eb7a6900090e admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:37.734759 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d549b7c5-64ab-4abf-ac23-279c1471ff57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:37.735507 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d549b7c5-64ab-4abf-ac23-279c1471ff57 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:37.738115 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d549b7c5-64ab-4abf-ac23-279c1471ff57 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:37.738115 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d549b7c5-64ab-4abf-ac23-279c1471ff57 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:37.738115 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d549b7c5-64ab-4abf-ac23-279c1471ff57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:37.739245 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d549b7c5-64ab-4abf-ac23-279c1471ff57 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:37.842222 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2545/5056] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:30:37 2022] POST /identity/v3/projects => generated 381 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:30:37.846391 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187f5c3c-1626-4ed8-9047-ef74b633364e None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:37.888470 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187f5c3c-1626-4ed8-9047-ef74b633364e None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:38.001038 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b569b14-cd4a-4ebf-8ad7-2b94d29cb270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:38.002632 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b569b14-cd4a-4ebf-8ad7-2b94d29cb270 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:38.002931 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b569b14-cd4a-4ebf-8ad7-2b94d29cb270 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:38.003255 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b569b14-cd4a-4ebf-8ad7-2b94d29cb270 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:38.004361 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b569b14-cd4a-4ebf-8ad7-2b94d29cb270 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:38.006581 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b569b14-cd4a-4ebf-8ad7-2b94d29cb270 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:38.116426 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2512/5057] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:30:37 2022] POST /identity/v3/users => generated 291 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:30:38.116752 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d549b7c5-64ab-4abf-ac23-279c1471ff57 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:38.131662 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d549b7c5-64ab-4abf-ac23-279c1471ff57 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:38.136896 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e29eecf-b002-476b-8ec0-97d6626e439f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:38.137723 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e29eecf-b002-476b-8ec0-97d6626e439f admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:38.138015 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e29eecf-b002-476b-8ec0-97d6626e439f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:38.138635 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e29eecf-b002-476b-8ec0-97d6626e439f admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:38.139385 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e29eecf-b002-476b-8ec0-97d6626e439f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:38.142368 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e29eecf-b002-476b-8ec0-97d6626e439f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:38.158975 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2546/5058] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:30:38 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:30:38.163195 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b569b14-cd4a-4ebf-8ad7-2b94d29cb270 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:38.183091 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b569b14-cd4a-4ebf-8ad7-2b94d29cb270 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:38.203345 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450f3204-996e-45ac-ae02-49170727870e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:38.203345 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f3204-996e-45ac-ae02-49170727870e admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:38.203345 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f3204-996e-45ac-ae02-49170727870e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:38.203809 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f3204-996e-45ac-ae02-49170727870e admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:38.204245 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450f3204-996e-45ac-ae02-49170727870e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:38.206044 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450f3204-996e-45ac-ae02-49170727870e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:38.228995 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2513/5059] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:30:38 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:30:38.233935 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e29eecf-b002-476b-8ec0-97d6626e439f admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:38.252424 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e29eecf-b002-476b-8ec0-97d6626e439f admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:38.261879 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829fb298-e8c0-482e-aeb2-931fda23abbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:38.262785 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829fb298-e8c0-482e-aeb2-931fda23abbf admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:38.263068 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829fb298-e8c0-482e-aeb2-931fda23abbf admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:38.263342 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829fb298-e8c0-482e-aeb2-931fda23abbf admin admin] PATH_INFO: `/v3/projects/84d821feb0e74ddba364b1123574d5e1/users/024b4b5b14764db6be4cae4b2d04cebf/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:38.305853 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829fb298-e8c0-482e-aeb2-931fda23abbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=84d821feb0e74ddba364b1123574d5e1, user_id=024b4b5b14764db6be4cae4b2d04cebf, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:38.310220 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829fb298-e8c0-482e-aeb2-931fda23abbf admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:38.509152 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2547/5060] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:30:38 2022] PUT /identity/v3/projects/84d821feb0e74ddba364b1123574d5e1/users/024b4b5b14764db6be4cae4b2d04cebf/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:30:38.519605 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aaac89-721b-4ccb-8632-fb3427ddb6c7 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:38.519912 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aaac89-721b-4ccb-8632-fb3427ddb6c7 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:38.520191 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aaac89-721b-4ccb-8632-fb3427ddb6c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:38.571071 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-88aaac89-721b-4ccb-8632-fb3427ddb6c7 None None] MFA Rules not processed for user `024b4b5b14764db6be4cae4b2d04cebf`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:30:38.572558 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-88aaac89-721b-4ccb-8632-fb3427ddb6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:38.746129 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2514/5061] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:30:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:30:38.750713 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829fb298-e8c0-482e-aeb2-931fda23abbf admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:38.945530 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829fb298-e8c0-482e-aeb2-931fda23abbf admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:38.953497 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e55529c-84a3-42cb-ace1-68ad61605ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:38.954137 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e55529c-84a3-42cb-ace1-68ad61605ed3 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:38.954425 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e55529c-84a3-42cb-ace1-68ad61605ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:38.954709 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e55529c-84a3-42cb-ace1-68ad61605ed3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:38.955423 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e55529c-84a3-42cb-ace1-68ad61605ed3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:38.957415 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e55529c-84a3-42cb-ace1-68ad61605ed3 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:39.074365 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2548/5062] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:30:38 2022] POST /identity/v3/projects => generated 383 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:30:39.078513 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aaac89-721b-4ccb-8632-fb3427ddb6c7 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:39.095462 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aaac89-721b-4ccb-8632-fb3427ddb6c7 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:39.196896 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c41f23-ab1d-4ecf-8788-fcd7270a5187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:39.198395 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c41f23-ab1d-4ecf-8788-fcd7270a5187 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:39.206274 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c41f23-ab1d-4ecf-8788-fcd7270a5187 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:39.206796 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c41f23-ab1d-4ecf-8788-fcd7270a5187 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:39.207679 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c41f23-ab1d-4ecf-8788-fcd7270a5187 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:39.212771 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c41f23-ab1d-4ecf-8788-fcd7270a5187 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:39.373124 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2515/5063] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:30:39 2022] POST /identity/v3/users => generated 298 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:30:39.376872 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e55529c-84a3-42cb-ace1-68ad61605ed3 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:39.391463 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e55529c-84a3-42cb-ace1-68ad61605ed3 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:39.401052 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021029bf-696a-484f-9989-4ebffbe80ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:39.402221 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021029bf-696a-484f-9989-4ebffbe80ff5 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:39.402715 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021029bf-696a-484f-9989-4ebffbe80ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:39.403157 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021029bf-696a-484f-9989-4ebffbe80ff5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:39.404497 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021029bf-696a-484f-9989-4ebffbe80ff5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:39.406642 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021029bf-696a-484f-9989-4ebffbe80ff5 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:39.421292 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2549/5064] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:30:39 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:30:39.425184 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c41f23-ab1d-4ecf-8788-fcd7270a5187 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:39.449465 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c41f23-ab1d-4ecf-8788-fcd7270a5187 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:39.457364 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3493704a-b667-4c25-a75c-092f252b6941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:39.458974 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493704a-b667-4c25-a75c-092f252b6941 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:39.459577 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493704a-b667-4c25-a75c-092f252b6941 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:39.460001 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493704a-b667-4c25-a75c-092f252b6941 admin admin] PATH_INFO: `/v3/projects/75557e8946ec483f9fc404fa45a7ccfa/users/d8bea758a2ea4a7580cf7d9c4b6d62a6/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:39.478207 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3493704a-b667-4c25-a75c-092f252b6941 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75557e8946ec483f9fc404fa45a7ccfa, user_id=d8bea758a2ea4a7580cf7d9c4b6d62a6, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:39.483150 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3493704a-b667-4c25-a75c-092f252b6941 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:39.570907 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2516/5065] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:30:39 2022] PUT /identity/v3/projects/75557e8946ec483f9fc404fa45a7ccfa/users/d8bea758a2ea4a7580cf7d9c4b6d62a6/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:30:39.579935 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021029bf-696a-484f-9989-4ebffbe80ff5 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:39.611673 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021029bf-696a-484f-9989-4ebffbe80ff5 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:39.769431 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635c223b-2390-4892-8f36-4dd8e9434558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:39.769431 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c223b-2390-4892-8f36-4dd8e9434558 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:39.769431 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c223b-2390-4892-8f36-4dd8e9434558 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:39.769431 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c223b-2390-4892-8f36-4dd8e9434558 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:39.769794 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635c223b-2390-4892-8f36-4dd8e9434558 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:39.771768 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635c223b-2390-4892-8f36-4dd8e9434558 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:39.794979 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2550/5066] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:30:39 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:30:39.801648 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3493704a-b667-4c25-a75c-092f252b6941 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:39.840557 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3493704a-b667-4c25-a75c-092f252b6941 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:39.850682 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b6c1f5-b001-4aa1-b42d-22374ed7e9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:39.852183 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b6c1f5-b001-4aa1-b42d-22374ed7e9b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:39.852183 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b6c1f5-b001-4aa1-b42d-22374ed7e9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:39.852470 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b6c1f5-b001-4aa1-b42d-22374ed7e9b1 admin admin] PATH_INFO: `/v3/projects/75557e8946ec483f9fc404fa45a7ccfa/users/d8bea758a2ea4a7580cf7d9c4b6d62a6/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:39.855899 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b6c1f5-b001-4aa1-b42d-22374ed7e9b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75557e8946ec483f9fc404fa45a7ccfa, user_id=d8bea758a2ea4a7580cf7d9c4b6d62a6, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:39.862628 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b6c1f5-b001-4aa1-b42d-22374ed7e9b1 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:39.892070 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2517/5067] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:30:39 2022] PUT /identity/v3/projects/75557e8946ec483f9fc404fa45a7ccfa/users/d8bea758a2ea4a7580cf7d9c4b6d62a6/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:30:39.905993 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80440a25-c795-4c2c-b675-07796bd6cf95 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:39.905993 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80440a25-c795-4c2c-b675-07796bd6cf95 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:39.905993 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80440a25-c795-4c2c-b675-07796bd6cf95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:39.950671 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-80440a25-c795-4c2c-b675-07796bd6cf95 None None] MFA Rules not processed for user `d8bea758a2ea4a7580cf7d9c4b6d62a6`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:30:39.951830 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-80440a25-c795-4c2c-b675-07796bd6cf95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:40.126863 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2551/5068] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:30:39 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:30:40.148370 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b6c1f5-b001-4aa1-b42d-22374ed7e9b1 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:40.150154 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-05b6c1f5-b001-4aa1-b42d-22374ed7e9b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:40.291745 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b6c1f5-b001-4aa1-b42d-22374ed7e9b1 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:40.299412 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7288b7-4f6c-4974-a200-d49e52996256 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:40.301687 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7288b7-4f6c-4974-a200-d49e52996256 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:40.302949 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7288b7-4f6c-4974-a200-d49e52996256 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:40.302949 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7288b7-4f6c-4974-a200-d49e52996256 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:40.446611 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7288b7-4f6c-4974-a200-d49e52996256 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:40.449410 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7288b7-4f6c-4974-a200-d49e52996256 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:40.463923 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2518/5069] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:30:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:30:51.880824 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80440a25-c795-4c2c-b675-07796bd6cf95 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:51.893312 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80440a25-c795-4c2c-b675-07796bd6cf95 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:51.902113 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b232d97-0138-4302-a101-73a9d3350672 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:51.902886 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b232d97-0138-4302-a101-73a9d3350672 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:51.903210 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b232d97-0138-4302-a101-73a9d3350672 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:51.903696 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b232d97-0138-4302-a101-73a9d3350672 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:51.916745 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b232d97-0138-4302-a101-73a9d3350672 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:51.918770 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b232d97-0138-4302-a101-73a9d3350672 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:51.936893 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2552/5070] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:30:51 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:30:56.078433 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e9493-7b7b-424e-9503-faa88445d662 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:56.078937 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e9493-7b7b-424e-9503-faa88445d662 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:56.079171 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e9493-7b7b-424e-9503-faa88445d662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:56.100190 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-0c7e9493-7b7b-424e-9503-faa88445d662 None None] MFA Rules not processed for user `5586a3a946a0490498c42cb71f39ce1e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:30:56.102954 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-0c7e9493-7b7b-424e-9503-faa88445d662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:56.176715 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2519/5071] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:30:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:30:57.234870 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b232d97-0138-4302-a101-73a9d3350672 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:57.245843 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b232d97-0138-4302-a101-73a9d3350672 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:57.250102 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6cfcad-3bce-49d6-92d9-ae7f8ed67eb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:57.250760 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6cfcad-3bce-49d6-92d9-ae7f8ed67eb2 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:57.251559 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6cfcad-3bce-49d6-92d9-ae7f8ed67eb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:57.251559 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6cfcad-3bce-49d6-92d9-ae7f8ed67eb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:57.312456 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6cfcad-3bce-49d6-92d9-ae7f8ed67eb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:57.313890 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6cfcad-3bce-49d6-92d9-ae7f8ed67eb2 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:57.323152 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2553/5072] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:30:57 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:30:59.424895 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7e9493-7b7b-424e-9503-faa88445d662 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:30:59.426412 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-0c7e9493-7b7b-424e-9503-faa88445d662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:59.519428 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7e9493-7b7b-424e-9503-faa88445d662 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:30:59.523665 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0fb2f-5a47-41ed-a8a3-b6071141d49e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198271d1c0d44cb58bace41a65f4b94c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:30:59.524428 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0fb2f-5a47-41ed-a8a3-b6071141d49e service cinder] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:30:59.524918 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0fb2f-5a47-41ed-a8a3-b6071141d49e service cinder] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:30:59.525562 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0fb2f-5a47-41ed-a8a3-b6071141d49e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:30:59.527454 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b6d0fb2f-5a47-41ed-a8a3-b6071141d49e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:30:59.605262 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d0fb2f-5a47-41ed-a8a3-b6071141d49e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:30:59.607000 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d0fb2f-5a47-41ed-a8a3-b6071141d49e service cinder] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:30:59.617782 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2520/5073] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:30:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:31:06.313734 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6cfcad-3bce-49d6-92d9-ae7f8ed67eb2 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:06.385738 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6cfcad-3bce-49d6-92d9-ae7f8ed67eb2 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:06.391868 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98384b09-2770-4e4b-95a0-759823b15e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:06.392889 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98384b09-2770-4e4b-95a0-759823b15e05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:06.393181 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98384b09-2770-4e4b-95a0-759823b15e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:06.393460 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98384b09-2770-4e4b-95a0-759823b15e05 admin admin] PATH_INFO: `/v3/users/4d73e918a65b4d78bd7d5cdbcad00cf7` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:06.394671 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98384b09-2770-4e4b-95a0-759823b15e05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d73e918a65b4d78bd7d5cdbcad00cf7)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:06.396642 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98384b09-2770-4e4b-95a0-759823b15e05 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:06.696610 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-98384b09-2770-4e4b-95a0-759823b15e05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d73e918a65b4d78bd7d5cdbcad00cf7'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:06.711540 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-98384b09-2770-4e4b-95a0-759823b15e05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d73e918a65b4d78bd7d5cdbcad00cf7'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:06.722369 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-98384b09-2770-4e4b-95a0-759823b15e05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d73e918a65b4d78bd7d5cdbcad00cf7'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:06.796616 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-98384b09-2770-4e4b-95a0-759823b15e05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d73e918a65b4d78bd7d5cdbcad00cf7'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:06.798117 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-98384b09-2770-4e4b-95a0-759823b15e05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d73e918a65b4d78bd7d5cdbcad00cf7'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:06.809134 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2554/5074] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:31:06 2022] DELETE /identity/v3/users/4d73e918a65b4d78bd7d5cdbcad00cf7 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:31:06.813766 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f522ed6-dc73-49e6-bc73-6b48217486ad None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:06.814327 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f522ed6-dc73-49e6-bc73-6b48217486ad None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:06.814327 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f522ed6-dc73-49e6-bc73-6b48217486ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:06.837579 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-0f522ed6-dc73-49e6-bc73-6b48217486ad None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:31:06.839116 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-0f522ed6-dc73-49e6-bc73-6b48217486ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:06.942719 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2521/5075] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:31:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:31:06.950033 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98384b09-2770-4e4b-95a0-759823b15e05 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:06.951796 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-98384b09-2770-4e4b-95a0-759823b15e05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:07.053115 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98384b09-2770-4e4b-95a0-759823b15e05 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:07.057844 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500b870e-d7d9-43df-b760-5d89e087d142 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:07.058651 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b870e-d7d9-43df-b760-5d89e087d142 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:07.059034 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b870e-d7d9-43df-b760-5d89e087d142 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:07.059416 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b870e-d7d9-43df-b760-5d89e087d142 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:07.071081 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500b870e-d7d9-43df-b760-5d89e087d142 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:07.074779 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500b870e-d7d9-43df-b760-5d89e087d142 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:07.085610 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2555/5076] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:31:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:31:07.390466 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f522ed6-dc73-49e6-bc73-6b48217486ad None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:07.392861 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-0f522ed6-dc73-49e6-bc73-6b48217486ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:07.412020 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f522ed6-dc73-49e6-bc73-6b48217486ad None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:07.419086 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763b0128-16a7-4db9-bb53-54a9dc6d8929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:07.424607 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b0128-16a7-4db9-bb53-54a9dc6d8929 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:07.425693 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b0128-16a7-4db9-bb53-54a9dc6d8929 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:07.426122 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b0128-16a7-4db9-bb53-54a9dc6d8929 admin admin] PATH_INFO: `/v3/projects/fed8d19b77e14adb88ac679316fd3e9a` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:07.427462 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763b0128-16a7-4db9-bb53-54a9dc6d8929 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fed8d19b77e14adb88ac679316fd3e9a)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:07.429795 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763b0128-16a7-4db9-bb53-54a9dc6d8929 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:07.572970 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-763b0128-16a7-4db9-bb53-54a9dc6d8929 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fed8d19b77e14adb88ac679316fd3e9a', 'request_id': 'req-763b0128-16a7-4db9-bb53-54a9dc6d8929'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:07.582430 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-763b0128-16a7-4db9-bb53-54a9dc6d8929 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fed8d19b77e14adb88ac679316fd3e9a', 'request_id': 'req-763b0128-16a7-4db9-bb53-54a9dc6d8929'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:07.590288 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-763b0128-16a7-4db9-bb53-54a9dc6d8929 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fed8d19b77e14adb88ac679316fd3e9a', 'request_id': 'req-763b0128-16a7-4db9-bb53-54a9dc6d8929'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:07.683691 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-763b0128-16a7-4db9-bb53-54a9dc6d8929 admin admin] The token cache is being invalidate because project fed8d19b77e14adb88ac679316fd3e9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:31:07.684272 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-763b0128-16a7-4db9-bb53-54a9dc6d8929 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:07.685927 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-763b0128-16a7-4db9-bb53-54a9dc6d8929 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:07.688904 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2522/5077] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:31:07 2022] DELETE /identity/v3/projects/fed8d19b77e14adb88ac679316fd3e9a => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:31:07.692922 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500b870e-d7d9-43df-b760-5d89e087d142 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:07.714047 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500b870e-d7d9-43df-b760-5d89e087d142 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:07.799282 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c5766e-6664-4382-87ce-d7da608a8c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:07.800203 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c5766e-6664-4382-87ce-d7da608a8c7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:07.800484 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c5766e-6664-4382-87ce-d7da608a8c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:07.800832 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c5766e-6664-4382-87ce-d7da608a8c7c admin admin] PATH_INFO: `/v3/users/024b4b5b14764db6be4cae4b2d04cebf` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:07.802032 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c5766e-6664-4382-87ce-d7da608a8c7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=024b4b5b14764db6be4cae4b2d04cebf)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:07.803980 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c5766e-6664-4382-87ce-d7da608a8c7c admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:08.034817 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c4c5766e-6664-4382-87ce-d7da608a8c7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '024b4b5b14764db6be4cae4b2d04cebf'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:08.055032 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c4c5766e-6664-4382-87ce-d7da608a8c7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '024b4b5b14764db6be4cae4b2d04cebf'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:08.073910 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c4c5766e-6664-4382-87ce-d7da608a8c7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '024b4b5b14764db6be4cae4b2d04cebf'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:08.204756 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c4c5766e-6664-4382-87ce-d7da608a8c7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '024b4b5b14764db6be4cae4b2d04cebf'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:08.205402 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c4c5766e-6664-4382-87ce-d7da608a8c7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '024b4b5b14764db6be4cae4b2d04cebf'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:08.211711 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2556/5078] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:31:07 2022] DELETE /identity/v3/users/024b4b5b14764db6be4cae4b2d04cebf => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:31:08.705018 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763b0128-16a7-4db9-bb53-54a9dc6d8929 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:08.706597 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-763b0128-16a7-4db9-bb53-54a9dc6d8929 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:08.723001 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763b0128-16a7-4db9-bb53-54a9dc6d8929 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:08.793014 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50488b0-19d5-4241-bdea-9f71e17f6c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:08.793014 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50488b0-19d5-4241-bdea-9f71e17f6c1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:08.793014 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50488b0-19d5-4241-bdea-9f71e17f6c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:08.793014 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50488b0-19d5-4241-bdea-9f71e17f6c1d admin admin] PATH_INFO: `/v3/projects/84d821feb0e74ddba364b1123574d5e1` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:08.793593 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50488b0-19d5-4241-bdea-9f71e17f6c1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=84d821feb0e74ddba364b1123574d5e1)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:08.796262 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50488b0-19d5-4241-bdea-9f71e17f6c1d admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:08.926626 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e50488b0-19d5-4241-bdea-9f71e17f6c1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84d821feb0e74ddba364b1123574d5e1', 'request_id': 'req-e50488b0-19d5-4241-bdea-9f71e17f6c1d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:08.935186 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e50488b0-19d5-4241-bdea-9f71e17f6c1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84d821feb0e74ddba364b1123574d5e1', 'request_id': 'req-e50488b0-19d5-4241-bdea-9f71e17f6c1d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:08.942559 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e50488b0-19d5-4241-bdea-9f71e17f6c1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84d821feb0e74ddba364b1123574d5e1', 'request_id': 'req-e50488b0-19d5-4241-bdea-9f71e17f6c1d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:09.064268 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e50488b0-19d5-4241-bdea-9f71e17f6c1d admin admin] The token cache is being invalidate because project 84d821feb0e74ddba364b1123574d5e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:31:09.064660 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e50488b0-19d5-4241-bdea-9f71e17f6c1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:09.065394 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e50488b0-19d5-4241-bdea-9f71e17f6c1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:09.067465 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2523/5079] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:31:08 2022] DELETE /identity/v3/projects/84d821feb0e74ddba364b1123574d5e1 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:31:09.071670 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c5766e-6664-4382-87ce-d7da608a8c7c admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:09.073719 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c4c5766e-6664-4382-87ce-d7da608a8c7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:09.088231 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c5766e-6664-4382-87ce-d7da608a8c7c admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:09.165921 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7370c417-0054-4046-9cbd-8beb04cd4862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:09.166908 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7370c417-0054-4046-9cbd-8beb04cd4862 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:09.167625 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7370c417-0054-4046-9cbd-8beb04cd4862 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:09.168237 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7370c417-0054-4046-9cbd-8beb04cd4862 admin admin] PATH_INFO: `/v3/users/d8bea758a2ea4a7580cf7d9c4b6d62a6` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:09.169919 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7370c417-0054-4046-9cbd-8beb04cd4862 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8bea758a2ea4a7580cf7d9c4b6d62a6)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:09.172981 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7370c417-0054-4046-9cbd-8beb04cd4862 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:09.434945 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-7370c417-0054-4046-9cbd-8beb04cd4862 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8bea758a2ea4a7580cf7d9c4b6d62a6'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:09.446854 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-7370c417-0054-4046-9cbd-8beb04cd4862 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8bea758a2ea4a7580cf7d9c4b6d62a6'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:09.454536 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-7370c417-0054-4046-9cbd-8beb04cd4862 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8bea758a2ea4a7580cf7d9c4b6d62a6'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:09.594765 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-7370c417-0054-4046-9cbd-8beb04cd4862 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8bea758a2ea4a7580cf7d9c4b6d62a6'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:09.596366 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-7370c417-0054-4046-9cbd-8beb04cd4862 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8bea758a2ea4a7580cf7d9c4b6d62a6'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:09.609099 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2557/5080] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:31:09 2022] DELETE /identity/v3/users/d8bea758a2ea4a7580cf7d9c4b6d62a6 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:31:10.131491 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50488b0-19d5-4241-bdea-9f71e17f6c1d admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:10.133385 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e50488b0-19d5-4241-bdea-9f71e17f6c1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:10.148579 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50488b0-19d5-4241-bdea-9f71e17f6c1d admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:10.214978 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd15fc4-dbb9-4146-9eb3-47bcfb7c30f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:10.216306 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd15fc4-dbb9-4146-9eb3-47bcfb7c30f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:10.217395 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd15fc4-dbb9-4146-9eb3-47bcfb7c30f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:10.217855 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd15fc4-dbb9-4146-9eb3-47bcfb7c30f7 admin admin] PATH_INFO: `/v3/projects/75557e8946ec483f9fc404fa45a7ccfa` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:10.219491 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd15fc4-dbb9-4146-9eb3-47bcfb7c30f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75557e8946ec483f9fc404fa45a7ccfa)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:10.221898 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd15fc4-dbb9-4146-9eb3-47bcfb7c30f7 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:10.457184 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9cd15fc4-dbb9-4146-9eb3-47bcfb7c30f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75557e8946ec483f9fc404fa45a7ccfa', 'request_id': 'req-9cd15fc4-dbb9-4146-9eb3-47bcfb7c30f7'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:10.464271 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9cd15fc4-dbb9-4146-9eb3-47bcfb7c30f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75557e8946ec483f9fc404fa45a7ccfa', 'request_id': 'req-9cd15fc4-dbb9-4146-9eb3-47bcfb7c30f7'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:10.472843 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9cd15fc4-dbb9-4146-9eb3-47bcfb7c30f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75557e8946ec483f9fc404fa45a7ccfa', 'request_id': 'req-9cd15fc4-dbb9-4146-9eb3-47bcfb7c30f7'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:10.537022 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9cd15fc4-dbb9-4146-9eb3-47bcfb7c30f7 admin admin] The token cache is being invalidate because project 75557e8946ec483f9fc404fa45a7ccfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:31:10.537312 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9cd15fc4-dbb9-4146-9eb3-47bcfb7c30f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:10.537951 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9cd15fc4-dbb9-4146-9eb3-47bcfb7c30f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:10.542218 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2524/5081] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:31:10 2022] DELETE /identity/v3/projects/75557e8946ec483f9fc404fa45a7ccfa => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:31:10.546704 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df4d3ab-437f-4b1d-917a-6a3854c62ec0 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:10.547208 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df4d3ab-437f-4b1d-917a-6a3854c62ec0 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:10.547393 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df4d3ab-437f-4b1d-917a-6a3854c62ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:10.569748 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-1df4d3ab-437f-4b1d-917a-6a3854c62ec0 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:31:10.569748 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-1df4d3ab-437f-4b1d-917a-6a3854c62ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:10.638137 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2558/5082] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:31:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:31:10.651232 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb26bcfa-3014-4258-a990-823d563d564e None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:10.651232 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb26bcfa-3014-4258-a990-823d563d564e None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:10.651232 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb26bcfa-3014-4258-a990-823d563d564e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:10.677978 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-fb26bcfa-3014-4258-a990-823d563d564e None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:31:10.679197 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-fb26bcfa-3014-4258-a990-823d563d564e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:10.688239 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2525/5083] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:31:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:31:10.692586 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df4d3ab-437f-4b1d-917a-6a3854c62ec0 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:10.703195 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df4d3ab-437f-4b1d-917a-6a3854c62ec0 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:10.708573 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f3e7bf-7f4e-4113-8019-a62bbfe304d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:10.708810 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f3e7bf-7f4e-4113-8019-a62bbfe304d2 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:10.709099 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f3e7bf-7f4e-4113-8019-a62bbfe304d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:10.709438 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f3e7bf-7f4e-4113-8019-a62bbfe304d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:10.710195 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f3e7bf-7f4e-4113-8019-a62bbfe304d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:31:10.710512 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f3e7bf-7f4e-4113-8019-a62bbfe304d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:10.712155 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f3e7bf-7f4e-4113-8019-a62bbfe304d2 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:10.726559 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2559/5084] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:31:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:31:10.729901 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb26bcfa-3014-4258-a990-823d563d564e None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:10.740718 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb26bcfa-3014-4258-a990-823d563d564e None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:10.745961 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79cf7f7-1a56-4750-82f1-cb93d48fa166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:10.746555 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79cf7f7-1a56-4750-82f1-cb93d48fa166 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:10.746853 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79cf7f7-1a56-4750-82f1-cb93d48fa166 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:10.747134 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79cf7f7-1a56-4750-82f1-cb93d48fa166 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:10.748676 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79cf7f7-1a56-4750-82f1-cb93d48fa166 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:10.751040 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79cf7f7-1a56-4750-82f1-cb93d48fa166 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:10.851976 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2526/5085] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:31:10 2022] POST /identity/v3/projects => generated 373 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:31:10.856372 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f3e7bf-7f4e-4113-8019-a62bbfe304d2 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:10.867064 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f3e7bf-7f4e-4113-8019-a62bbfe304d2 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:10.929550 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c326c6-f65b-435d-a006-dc3285dc38e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:10.930234 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c326c6-f65b-435d-a006-dc3285dc38e9 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:10.930665 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c326c6-f65b-435d-a006-dc3285dc38e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:10.930952 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c326c6-f65b-435d-a006-dc3285dc38e9 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:10.931904 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c326c6-f65b-435d-a006-dc3285dc38e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:10.933874 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c326c6-f65b-435d-a006-dc3285dc38e9 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:11.071358 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2560/5086] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:31:10 2022] POST /identity/v3/users => generated 287 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:31:11.072807 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79cf7f7-1a56-4750-82f1-cb93d48fa166 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:11.084364 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79cf7f7-1a56-4750-82f1-cb93d48fa166 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:11.089398 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4abd4a-8eaa-409b-a86b-267d4b930e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:11.090101 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4abd4a-8eaa-409b-a86b-267d4b930e08 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:11.090387 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4abd4a-8eaa-409b-a86b-267d4b930e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:11.090666 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4abd4a-8eaa-409b-a86b-267d4b930e08 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:11.092057 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4abd4a-8eaa-409b-a86b-267d4b930e08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:11.093677 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4abd4a-8eaa-409b-a86b-267d4b930e08 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:11.108506 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2527/5087] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:31:11.111210 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c326c6-f65b-435d-a006-dc3285dc38e9 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:11.121508 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c326c6-f65b-435d-a006-dc3285dc38e9 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:11.126174 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3302a3fa-191c-4345-bd39-1e53bf4206a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:11.126828 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302a3fa-191c-4345-bd39-1e53bf4206a0 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:11.127161 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302a3fa-191c-4345-bd39-1e53bf4206a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:11.127438 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302a3fa-191c-4345-bd39-1e53bf4206a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:11.128193 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3302a3fa-191c-4345-bd39-1e53bf4206a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:11.129771 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3302a3fa-191c-4345-bd39-1e53bf4206a0 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:11.140204 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2561/5088] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:31:11.144603 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4abd4a-8eaa-409b-a86b-267d4b930e08 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:11.156280 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4abd4a-8eaa-409b-a86b-267d4b930e08 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:11.161036 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7091b-1138-4405-b9a5-fe61a7b2f13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:11.161910 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7091b-1138-4405-b9a5-fe61a7b2f13b admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:11.162195 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7091b-1138-4405-b9a5-fe61a7b2f13b admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:11.162468 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7091b-1138-4405-b9a5-fe61a7b2f13b admin admin] PATH_INFO: `/v3/projects/2b5b79c70aea4de5b8ff47bd4276b487/users/9daebfa530c14a3bbc22a62f5e550e74/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:11.178418 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb7091b-1138-4405-b9a5-fe61a7b2f13b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b5b79c70aea4de5b8ff47bd4276b487, user_id=9daebfa530c14a3bbc22a62f5e550e74, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:11.181265 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb7091b-1138-4405-b9a5-fe61a7b2f13b admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:11.245659 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2528/5089] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:31:11 2022] PUT /identity/v3/projects/2b5b79c70aea4de5b8ff47bd4276b487/users/9daebfa530c14a3bbc22a62f5e550e74/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:31:11.256821 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe79106-9154-48fc-9471-7937b4a3d592 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:11.257153 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe79106-9154-48fc-9471-7937b4a3d592 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:11.257433 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe79106-9154-48fc-9471-7937b4a3d592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:11.283341 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-3fe79106-9154-48fc-9471-7937b4a3d592 None None] MFA Rules not processed for user `9daebfa530c14a3bbc22a62f5e550e74`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:31:11.284602 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-3fe79106-9154-48fc-9471-7937b4a3d592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:11.346902 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2562/5090] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:31:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:31:11.351319 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7091b-1138-4405-b9a5-fe61a7b2f13b admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:11.411949 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7091b-1138-4405-b9a5-fe61a7b2f13b admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:11.417142 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f44ac11-95eb-4a0e-8968-b5b505a2929e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:11.423561 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f44ac11-95eb-4a0e-8968-b5b505a2929e admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:11.423561 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f44ac11-95eb-4a0e-8968-b5b505a2929e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:11.423561 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f44ac11-95eb-4a0e-8968-b5b505a2929e admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:11.423561 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f44ac11-95eb-4a0e-8968-b5b505a2929e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:11.423561 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f44ac11-95eb-4a0e-8968-b5b505a2929e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:11.503771 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2529/5091] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:31:11 2022] POST /identity/v3/projects => generated 373 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:31:11.507654 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe79106-9154-48fc-9471-7937b4a3d592 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:11.519016 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe79106-9154-48fc-9471-7937b4a3d592 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:11.573521 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d297598-99dd-4dc4-849a-75692417da03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:11.574184 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d297598-99dd-4dc4-849a-75692417da03 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:11.574452 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d297598-99dd-4dc4-849a-75692417da03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:11.574728 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d297598-99dd-4dc4-849a-75692417da03 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:11.575410 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d297598-99dd-4dc4-849a-75692417da03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:11.577438 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d297598-99dd-4dc4-849a-75692417da03 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:11.697758 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2563/5092] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:31:11 2022] POST /identity/v3/users => generated 293 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:31:11.702367 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f44ac11-95eb-4a0e-8968-b5b505a2929e admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:11.713467 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f44ac11-95eb-4a0e-8968-b5b505a2929e admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:11.719882 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec94d50-4fd9-467e-81ab-c366c1d5fd10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:11.720801 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec94d50-4fd9-467e-81ab-c366c1d5fd10 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:11.721286 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec94d50-4fd9-467e-81ab-c366c1d5fd10 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:11.721755 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec94d50-4fd9-467e-81ab-c366c1d5fd10 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:11.722837 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec94d50-4fd9-467e-81ab-c366c1d5fd10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:11.725248 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec94d50-4fd9-467e-81ab-c366c1d5fd10 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:11.739639 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2530/5093] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:31:11.743863 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d297598-99dd-4dc4-849a-75692417da03 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:11.768271 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d297598-99dd-4dc4-849a-75692417da03 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:11.774112 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac1ae2f-f2d0-4a20-92e9-9992411bdf68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:11.776743 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1ae2f-f2d0-4a20-92e9-9992411bdf68 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:11.781048 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1ae2f-f2d0-4a20-92e9-9992411bdf68 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:11.781048 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1ae2f-f2d0-4a20-92e9-9992411bdf68 admin admin] PATH_INFO: `/v3/projects/ceb5bccfdfcf477089282d978d39c3fa/users/16f97de2de9c4303b9190bbb8bef3d99/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:11.795716 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac1ae2f-f2d0-4a20-92e9-9992411bdf68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ceb5bccfdfcf477089282d978d39c3fa, user_id=16f97de2de9c4303b9190bbb8bef3d99, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:11.798522 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac1ae2f-f2d0-4a20-92e9-9992411bdf68 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:11.902898 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2564/5094] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:31:11 2022] PUT /identity/v3/projects/ceb5bccfdfcf477089282d978d39c3fa/users/16f97de2de9c4303b9190bbb8bef3d99/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:31:11.916325 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec94d50-4fd9-467e-81ab-c366c1d5fd10 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:11.949500 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec94d50-4fd9-467e-81ab-c366c1d5fd10 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:12.026261 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8109fc4-443d-42fa-8acd-db4951930f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:12.027347 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8109fc4-443d-42fa-8acd-db4951930f08 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:12.028151 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8109fc4-443d-42fa-8acd-db4951930f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:12.028505 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8109fc4-443d-42fa-8acd-db4951930f08 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:12.030006 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8109fc4-443d-42fa-8acd-db4951930f08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:12.031785 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8109fc4-443d-42fa-8acd-db4951930f08 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:12.042689 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2531/5095] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:31:12.047752 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac1ae2f-f2d0-4a20-92e9-9992411bdf68 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:12.061075 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac1ae2f-f2d0-4a20-92e9-9992411bdf68 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:12.065924 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e559dff5-642a-4e1e-bc25-99056b04c1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:12.066810 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559dff5-642a-4e1e-bc25-99056b04c1da admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:12.069725 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559dff5-642a-4e1e-bc25-99056b04c1da admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:12.069725 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559dff5-642a-4e1e-bc25-99056b04c1da admin admin] PATH_INFO: `/v3/projects/ceb5bccfdfcf477089282d978d39c3fa/users/16f97de2de9c4303b9190bbb8bef3d99/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:12.069725 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e559dff5-642a-4e1e-bc25-99056b04c1da admin admin] RBAC: Authorizing `identity:create_grant(project_id=ceb5bccfdfcf477089282d978d39c3fa, user_id=16f97de2de9c4303b9190bbb8bef3d99, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:12.072514 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e559dff5-642a-4e1e-bc25-99056b04c1da admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:12.084185 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2565/5096] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:31:12 2022] PUT /identity/v3/projects/ceb5bccfdfcf477089282d978d39c3fa/users/16f97de2de9c4303b9190bbb8bef3d99/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:31:12.096416 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676e591-6071-41c4-8c19-008c8539bbc6 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:12.097250 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676e591-6071-41c4-8c19-008c8539bbc6 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:12.097682 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676e591-6071-41c4-8c19-008c8539bbc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:12.125439 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-1676e591-6071-41c4-8c19-008c8539bbc6 None None] MFA Rules not processed for user `16f97de2de9c4303b9190bbb8bef3d99`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:31:12.126642 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-1676e591-6071-41c4-8c19-008c8539bbc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:12.204331 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2532/5097] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:31:12 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:31:12.209386 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e559dff5-642a-4e1e-bc25-99056b04c1da admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:12.221448 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e559dff5-642a-4e1e-bc25-99056b04c1da admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:12.226202 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e25ed3-f91a-4471-ac66-11ae1105c66a tempest-QuotasNegativeTest-1123382617 tempest-QuotasNegativeTest-1123382617-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16f97de2de9c4303b9190bbb8bef3d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ceb5bccfdfcf477089282d978d39c3fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:12.226854 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e25ed3-f91a-4471-ac66-11ae1105c66a tempest-QuotasNegativeTest-1123382617 tempest-QuotasNegativeTest-1123382617-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:12.227158 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e25ed3-f91a-4471-ac66-11ae1105c66a tempest-QuotasNegativeTest-1123382617 tempest-QuotasNegativeTest-1123382617-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:12.227437 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e25ed3-f91a-4471-ac66-11ae1105c66a tempest-QuotasNegativeTest-1123382617 tempest-QuotasNegativeTest-1123382617-project-admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:12.228182 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e25ed3-f91a-4471-ac66-11ae1105c66a tempest-QuotasNegativeTest-1123382617 tempest-QuotasNegativeTest-1123382617-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:31:12.228487 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e25ed3-f91a-4471-ac66-11ae1105c66a tempest-QuotasNegativeTest-1123382617 tempest-QuotasNegativeTest-1123382617-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:12.230130 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e25ed3-f91a-4471-ac66-11ae1105c66a tempest-QuotasNegativeTest-1123382617 tempest-QuotasNegativeTest-1123382617-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:12.247884 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2566/5098] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:31:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:31:12.256719 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1676e591-6071-41c4-8c19-008c8539bbc6 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:12.267892 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1676e591-6071-41c4-8c19-008c8539bbc6 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:12.272873 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c659b8-a908-4844-92e5-8524ad9a2240 tempest-QuotasNegativeTest-1123382617 tempest-QuotasNegativeTest-1123382617-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16f97de2de9c4303b9190bbb8bef3d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ceb5bccfdfcf477089282d978d39c3fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:12.273540 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c659b8-a908-4844-92e5-8524ad9a2240 tempest-QuotasNegativeTest-1123382617 tempest-QuotasNegativeTest-1123382617-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:12.273824 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c659b8-a908-4844-92e5-8524ad9a2240 tempest-QuotasNegativeTest-1123382617 tempest-QuotasNegativeTest-1123382617-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:12.274100 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c659b8-a908-4844-92e5-8524ad9a2240 tempest-QuotasNegativeTest-1123382617 tempest-QuotasNegativeTest-1123382617-project-admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:12.274786 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c659b8-a908-4844-92e5-8524ad9a2240 tempest-QuotasNegativeTest-1123382617 tempest-QuotasNegativeTest-1123382617-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:12.276836 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c659b8-a908-4844-92e5-8524ad9a2240 tempest-QuotasNegativeTest-1123382617 tempest-QuotasNegativeTest-1123382617-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:12.403520 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2533/5099] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:31:12 2022] POST /identity/v3/projects => generated 347 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:31:12.407559 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e25ed3-f91a-4471-ac66-11ae1105c66a tempest-QuotasNegativeTest-1123382617 tempest-QuotasNegativeTest-1123382617-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:12.418117 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e25ed3-f91a-4471-ac66-11ae1105c66a tempest-QuotasNegativeTest-1123382617 tempest-QuotasNegativeTest-1123382617-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:12.478361 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e558ad41-2f4b-4aad-9964-508636741a13 tempest-QuotasNegativeTest-1123382617 tempest-QuotasNegativeTest-1123382617-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16f97de2de9c4303b9190bbb8bef3d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ceb5bccfdfcf477089282d978d39c3fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:12.479013 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e558ad41-2f4b-4aad-9964-508636741a13 tempest-QuotasNegativeTest-1123382617 tempest-QuotasNegativeTest-1123382617-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:12.479329 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e558ad41-2f4b-4aad-9964-508636741a13 tempest-QuotasNegativeTest-1123382617 tempest-QuotasNegativeTest-1123382617-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:12.479650 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e558ad41-2f4b-4aad-9964-508636741a13 tempest-QuotasNegativeTest-1123382617 tempest-QuotasNegativeTest-1123382617-project-admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:12.480387 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e558ad41-2f4b-4aad-9964-508636741a13 tempest-QuotasNegativeTest-1123382617 tempest-QuotasNegativeTest-1123382617-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:31:12.480694 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e558ad41-2f4b-4aad-9964-508636741a13 tempest-QuotasNegativeTest-1123382617 tempest-QuotasNegativeTest-1123382617-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:12.482326 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e558ad41-2f4b-4aad-9964-508636741a13 tempest-QuotasNegativeTest-1123382617 tempest-QuotasNegativeTest-1123382617-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:12.493536 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2567/5100] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:31:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:31:12.506713 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c659b8-a908-4844-92e5-8524ad9a2240 tempest-QuotasNegativeTest-1123382617 tempest-QuotasNegativeTest-1123382617-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:12.507630 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-00c659b8-a908-4844-92e5-8524ad9a2240 tempest-QuotasNegativeTest-1123382617 tempest-QuotasNegativeTest-1123382617-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:12.570384 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c659b8-a908-4844-92e5-8524ad9a2240 tempest-QuotasNegativeTest-1123382617 tempest-QuotasNegativeTest-1123382617-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:12.573990 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d0b70b-b02c-4a2a-8cad-70d6d5b416c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:12.574678 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d0b70b-b02c-4a2a-8cad-70d6d5b416c3 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:12.574960 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d0b70b-b02c-4a2a-8cad-70d6d5b416c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:12.575407 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d0b70b-b02c-4a2a-8cad-70d6d5b416c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:12.585557 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d0b70b-b02c-4a2a-8cad-70d6d5b416c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:12.587036 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d0b70b-b02c-4a2a-8cad-70d6d5b416c3 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:12.597491 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2534/5101] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:31:12 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:31:15.310823 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e558ad41-2f4b-4aad-9964-508636741a13 tempest-QuotasNegativeTest-1123382617 tempest-QuotasNegativeTest-1123382617-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:15.331529 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e558ad41-2f4b-4aad-9964-508636741a13 tempest-QuotasNegativeTest-1123382617 tempest-QuotasNegativeTest-1123382617-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:15.346572 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68a8b20-a940-4ee0-bb8d-ee6ceebd819e tempest-QuotasNegativeTest-1123382617 tempest-QuotasNegativeTest-1123382617-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16f97de2de9c4303b9190bbb8bef3d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ceb5bccfdfcf477089282d978d39c3fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:15.347621 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a8b20-a940-4ee0-bb8d-ee6ceebd819e tempest-QuotasNegativeTest-1123382617 tempest-QuotasNegativeTest-1123382617-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:15.347987 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a8b20-a940-4ee0-bb8d-ee6ceebd819e tempest-QuotasNegativeTest-1123382617 tempest-QuotasNegativeTest-1123382617-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:15.352648 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a8b20-a940-4ee0-bb8d-ee6ceebd819e tempest-QuotasNegativeTest-1123382617 tempest-QuotasNegativeTest-1123382617-project-admin] PATH_INFO: `/v3/projects/4da83ff6a7ea4c3aa549edc056d2c660` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:15.352648 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68a8b20-a940-4ee0-bb8d-ee6ceebd819e tempest-QuotasNegativeTest-1123382617 tempest-QuotasNegativeTest-1123382617-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4da83ff6a7ea4c3aa549edc056d2c660)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:15.352648 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68a8b20-a940-4ee0-bb8d-ee6ceebd819e tempest-QuotasNegativeTest-1123382617 tempest-QuotasNegativeTest-1123382617-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:15.507343 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e68a8b20-a940-4ee0-bb8d-ee6ceebd819e tempest-QuotasNegativeTest-1123382617 tempest-QuotasNegativeTest-1123382617-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4da83ff6a7ea4c3aa549edc056d2c660', 'request_id': 'req-e68a8b20-a940-4ee0-bb8d-ee6ceebd819e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:15.513810 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e68a8b20-a940-4ee0-bb8d-ee6ceebd819e tempest-QuotasNegativeTest-1123382617 tempest-QuotasNegativeTest-1123382617-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4da83ff6a7ea4c3aa549edc056d2c660', 'request_id': 'req-e68a8b20-a940-4ee0-bb8d-ee6ceebd819e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:15.610774 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e68a8b20-a940-4ee0-bb8d-ee6ceebd819e tempest-QuotasNegativeTest-1123382617 tempest-QuotasNegativeTest-1123382617-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4da83ff6a7ea4c3aa549edc056d2c660', 'request_id': 'req-e68a8b20-a940-4ee0-bb8d-ee6ceebd819e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:15.624442 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e68a8b20-a940-4ee0-bb8d-ee6ceebd819e tempest-QuotasNegativeTest-1123382617 tempest-QuotasNegativeTest-1123382617-project-admin] The token cache is being invalidate because project 4da83ff6a7ea4c3aa549edc056d2c660 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:31:15.624739 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e68a8b20-a940-4ee0-bb8d-ee6ceebd819e tempest-QuotasNegativeTest-1123382617 tempest-QuotasNegativeTest-1123382617-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:15.625486 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e68a8b20-a940-4ee0-bb8d-ee6ceebd819e tempest-QuotasNegativeTest-1123382617 tempest-QuotasNegativeTest-1123382617-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:15.627193 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2568/5102] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:31:15 2022] DELETE /identity/v3/projects/4da83ff6a7ea4c3aa549edc056d2c660 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:31:15.632373 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d0b70b-b02c-4a2a-8cad-70d6d5b416c3 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:15.701609 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d0b70b-b02c-4a2a-8cad-70d6d5b416c3 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:15.759613 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc5f98a-370f-4673-80cb-019e06c58959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:15.760517 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc5f98a-370f-4673-80cb-019e06c58959 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:15.760797 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc5f98a-370f-4673-80cb-019e06c58959 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:15.761071 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc5f98a-370f-4673-80cb-019e06c58959 admin admin] PATH_INFO: `/v3/users/9daebfa530c14a3bbc22a62f5e550e74` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:15.762258 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc5f98a-370f-4673-80cb-019e06c58959 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9daebfa530c14a3bbc22a62f5e550e74)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:15.765160 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc5f98a-370f-4673-80cb-019e06c58959 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:15.990945 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7bc5f98a-370f-4673-80cb-019e06c58959 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9daebfa530c14a3bbc22a62f5e550e74'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:15.998265 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7bc5f98a-370f-4673-80cb-019e06c58959 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9daebfa530c14a3bbc22a62f5e550e74'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:15.998856 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7bc5f98a-370f-4673-80cb-019e06c58959 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9daebfa530c14a3bbc22a62f5e550e74'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:16.097812 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7bc5f98a-370f-4673-80cb-019e06c58959 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9daebfa530c14a3bbc22a62f5e550e74'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:16.110617 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7bc5f98a-370f-4673-80cb-019e06c58959 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9daebfa530c14a3bbc22a62f5e550e74'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:16.116829 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2535/5103] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:31:15 2022] DELETE /identity/v3/users/9daebfa530c14a3bbc22a62f5e550e74 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:31:16.121394 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950564bb-137d-44d8-b22d-a12fa3ed849c None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:16.121682 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950564bb-137d-44d8-b22d-a12fa3ed849c None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:16.122879 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950564bb-137d-44d8-b22d-a12fa3ed849c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:16.145386 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-950564bb-137d-44d8-b22d-a12fa3ed849c None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:31:16.145386 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-950564bb-137d-44d8-b22d-a12fa3ed849c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:16.199687 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2569/5104] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:31:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:31:16.209379 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc5f98a-370f-4673-80cb-019e06c58959 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:16.210795 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-7bc5f98a-370f-4673-80cb-019e06c58959 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:16.270374 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc5f98a-370f-4673-80cb-019e06c58959 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:16.273936 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b838840-db3e-4d1a-9e5d-625cd8f75bbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:16.274581 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b838840-db3e-4d1a-9e5d-625cd8f75bbc service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:16.274867 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b838840-db3e-4d1a-9e5d-625cd8f75bbc service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:16.275168 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b838840-db3e-4d1a-9e5d-625cd8f75bbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:16.293639 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b838840-db3e-4d1a-9e5d-625cd8f75bbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:16.293639 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b838840-db3e-4d1a-9e5d-625cd8f75bbc service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:16.298342 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2536/5105] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:31:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:31:16.760778 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950564bb-137d-44d8-b22d-a12fa3ed849c None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:16.762395 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-950564bb-137d-44d8-b22d-a12fa3ed849c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:16.777244 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950564bb-137d-44d8-b22d-a12fa3ed849c None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:16.784031 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f71160b-ea01-4a18-8e13-1cd96dd42254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:16.784900 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f71160b-ea01-4a18-8e13-1cd96dd42254 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:16.785179 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f71160b-ea01-4a18-8e13-1cd96dd42254 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:16.785447 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f71160b-ea01-4a18-8e13-1cd96dd42254 admin admin] PATH_INFO: `/v3/projects/2b5b79c70aea4de5b8ff47bd4276b487` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:16.786696 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f71160b-ea01-4a18-8e13-1cd96dd42254 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b5b79c70aea4de5b8ff47bd4276b487)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:16.788730 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f71160b-ea01-4a18-8e13-1cd96dd42254 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:16.930526 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3f71160b-ea01-4a18-8e13-1cd96dd42254 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b5b79c70aea4de5b8ff47bd4276b487', 'request_id': 'req-3f71160b-ea01-4a18-8e13-1cd96dd42254'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:16.936938 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3f71160b-ea01-4a18-8e13-1cd96dd42254 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b5b79c70aea4de5b8ff47bd4276b487', 'request_id': 'req-3f71160b-ea01-4a18-8e13-1cd96dd42254'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:17.027632 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3f71160b-ea01-4a18-8e13-1cd96dd42254 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b5b79c70aea4de5b8ff47bd4276b487', 'request_id': 'req-3f71160b-ea01-4a18-8e13-1cd96dd42254'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:17.041299 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3f71160b-ea01-4a18-8e13-1cd96dd42254 admin admin] The token cache is being invalidate because project 2b5b79c70aea4de5b8ff47bd4276b487 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:31:17.041574 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3f71160b-ea01-4a18-8e13-1cd96dd42254 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:17.042513 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3f71160b-ea01-4a18-8e13-1cd96dd42254 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:17.044104 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2570/5106] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:31:16 2022] DELETE /identity/v3/projects/2b5b79c70aea4de5b8ff47bd4276b487 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:31:17.048372 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b838840-db3e-4d1a-9e5d-625cd8f75bbc service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:17.063882 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b838840-db3e-4d1a-9e5d-625cd8f75bbc service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:17.116512 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129df8b6-dc46-4a0d-b2be-d96827b2c471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:17.117393 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129df8b6-dc46-4a0d-b2be-d96827b2c471 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:17.117723 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129df8b6-dc46-4a0d-b2be-d96827b2c471 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:17.118016 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129df8b6-dc46-4a0d-b2be-d96827b2c471 admin admin] PATH_INFO: `/v3/users/16f97de2de9c4303b9190bbb8bef3d99` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:17.119202 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129df8b6-dc46-4a0d-b2be-d96827b2c471 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16f97de2de9c4303b9190bbb8bef3d99)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:17.121172 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129df8b6-dc46-4a0d-b2be-d96827b2c471 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:17.358418 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-129df8b6-dc46-4a0d-b2be-d96827b2c471 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16f97de2de9c4303b9190bbb8bef3d99'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:17.365670 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-129df8b6-dc46-4a0d-b2be-d96827b2c471 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16f97de2de9c4303b9190bbb8bef3d99'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:17.366399 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-129df8b6-dc46-4a0d-b2be-d96827b2c471 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16f97de2de9c4303b9190bbb8bef3d99'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:17.468203 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-129df8b6-dc46-4a0d-b2be-d96827b2c471 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16f97de2de9c4303b9190bbb8bef3d99'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:17.481008 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-129df8b6-dc46-4a0d-b2be-d96827b2c471 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16f97de2de9c4303b9190bbb8bef3d99'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:17.487693 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2537/5107] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:31:17 2022] DELETE /identity/v3/users/16f97de2de9c4303b9190bbb8bef3d99 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:31:17.550440 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f71160b-ea01-4a18-8e13-1cd96dd42254 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:17.552144 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-3f71160b-ea01-4a18-8e13-1cd96dd42254 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:17.565589 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f71160b-ea01-4a18-8e13-1cd96dd42254 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:17.625162 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69424807-459e-4bf6-97ff-78858df6cab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:17.626024 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69424807-459e-4bf6-97ff-78858df6cab0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:17.626239 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69424807-459e-4bf6-97ff-78858df6cab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:17.626508 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69424807-459e-4bf6-97ff-78858df6cab0 admin admin] PATH_INFO: `/v3/users/7133ca2c209048149a095b778ac1424e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:17.627734 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69424807-459e-4bf6-97ff-78858df6cab0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7133ca2c209048149a095b778ac1424e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:17.629689 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69424807-459e-4bf6-97ff-78858df6cab0 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:17.878975 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-69424807-459e-4bf6-97ff-78858df6cab0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7133ca2c209048149a095b778ac1424e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:17.893447 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-69424807-459e-4bf6-97ff-78858df6cab0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7133ca2c209048149a095b778ac1424e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:17.900587 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-69424807-459e-4bf6-97ff-78858df6cab0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7133ca2c209048149a095b778ac1424e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:17.977913 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129df8b6-dc46-4a0d-b2be-d96827b2c471 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:17.979404 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-129df8b6-dc46-4a0d-b2be-d96827b2c471 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:17.995863 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-69424807-459e-4bf6-97ff-78858df6cab0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7133ca2c209048149a095b778ac1424e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:17.995998 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129df8b6-dc46-4a0d-b2be-d96827b2c471 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:17.996075 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-69424807-459e-4bf6-97ff-78858df6cab0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7133ca2c209048149a095b778ac1424e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:18.003098 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb5b793-8d07-4335-a80d-5f147abbe51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:18.004133 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5b793-8d07-4335-a80d-5f147abbe51a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:18.004272 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5b793-8d07-4335-a80d-5f147abbe51a admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:18.004356 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2571/5108] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:31:17 2022] DELETE /identity/v3/users/7133ca2c209048149a095b778ac1424e => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:31:18.004548 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5b793-8d07-4335-a80d-5f147abbe51a admin admin] PATH_INFO: `/v3/projects/ceb5bccfdfcf477089282d978d39c3fa` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:18.006167 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb5b793-8d07-4335-a80d-5f147abbe51a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ceb5bccfdfcf477089282d978d39c3fa)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:18.008142 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb5b793-8d07-4335-a80d-5f147abbe51a admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:18.010434 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903dcfea-3215-472d-a1e3-cfc0388775a5 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:18.011683 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903dcfea-3215-472d-a1e3-cfc0388775a5 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:18.012514 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903dcfea-3215-472d-a1e3-cfc0388775a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:18.048637 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-903dcfea-3215-472d-a1e3-cfc0388775a5 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:31:18.058770 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-903dcfea-3215-472d-a1e3-cfc0388775a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:18.114641 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2572/5109] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:31:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:31:18.125335 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903dcfea-3215-472d-a1e3-cfc0388775a5 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:18.126440 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-903dcfea-3215-472d-a1e3-cfc0388775a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:18.160016 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dcb5b793-8d07-4335-a80d-5f147abbe51a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ceb5bccfdfcf477089282d978d39c3fa', 'request_id': 'req-dcb5b793-8d07-4335-a80d-5f147abbe51a'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:18.165443 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dcb5b793-8d07-4335-a80d-5f147abbe51a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ceb5bccfdfcf477089282d978d39c3fa', 'request_id': 'req-dcb5b793-8d07-4335-a80d-5f147abbe51a'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:18.172048 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dcb5b793-8d07-4335-a80d-5f147abbe51a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ceb5bccfdfcf477089282d978d39c3fa', 'request_id': 'req-dcb5b793-8d07-4335-a80d-5f147abbe51a'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:18.184129 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903dcfea-3215-472d-a1e3-cfc0388775a5 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:18.231688 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18f5f88-b379-40cd-ac49-b12058ccaaae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:18.232348 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f5f88-b379-40cd-ac49-b12058ccaaae service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:18.232635 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f5f88-b379-40cd-ac49-b12058ccaaae service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:18.232911 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f5f88-b379-40cd-ac49-b12058ccaaae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:18.284669 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dcb5b793-8d07-4335-a80d-5f147abbe51a admin admin] The token cache is being invalidate because project ceb5bccfdfcf477089282d978d39c3fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:31:18.284961 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dcb5b793-8d07-4335-a80d-5f147abbe51a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:18.285584 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dcb5b793-8d07-4335-a80d-5f147abbe51a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:18.287116 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2538/5110] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:31:17 2022] DELETE /identity/v3/projects/ceb5bccfdfcf477089282d978d39c3fa => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:31:18.291767 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb4ea1-3797-4d7c-9ddf-146625a9dd73 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:18.292134 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb4ea1-3797-4d7c-9ddf-146625a9dd73 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:18.292489 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb4ea1-3797-4d7c-9ddf-146625a9dd73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:18.297115 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18f5f88-b379-40cd-ac49-b12058ccaaae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:18.298569 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18f5f88-b379-40cd-ac49-b12058ccaaae service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:18.308895 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2573/5111] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:31:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:31:18.312224 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-a4eb4ea1-3797-4d7c-9ddf-146625a9dd73 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:31:18.313547 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-a4eb4ea1-3797-4d7c-9ddf-146625a9dd73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:18.322800 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2539/5112] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:31:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:31:18.331339 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54111739-8a49-4179-8de2-4e32baa3b24e None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:18.331665 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54111739-8a49-4179-8de2-4e32baa3b24e None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:18.333548 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54111739-8a49-4179-8de2-4e32baa3b24e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:18.362307 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-54111739-8a49-4179-8de2-4e32baa3b24e None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:31:18.363743 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-54111739-8a49-4179-8de2-4e32baa3b24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:18.374930 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2574/5113] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:31:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:31:18.378216 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb4ea1-3797-4d7c-9ddf-146625a9dd73 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:18.387858 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb4ea1-3797-4d7c-9ddf-146625a9dd73 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:18.393589 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e25e2f9-fb72-4669-aef1-61e21d50876e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:18.394249 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e25e2f9-fb72-4669-aef1-61e21d50876e admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:18.398187 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e25e2f9-fb72-4669-aef1-61e21d50876e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:18.398187 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e25e2f9-fb72-4669-aef1-61e21d50876e admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:18.398187 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e25e2f9-fb72-4669-aef1-61e21d50876e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:31:18.398187 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e25e2f9-fb72-4669-aef1-61e21d50876e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:18.398187 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e25e2f9-fb72-4669-aef1-61e21d50876e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:18.409540 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2540/5114] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:31:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:31:18.413887 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54111739-8a49-4179-8de2-4e32baa3b24e None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:18.423107 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54111739-8a49-4179-8de2-4e32baa3b24e None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:18.427808 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9efa2f-c2a3-4456-b6b4-10d875eb739d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:18.428457 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9efa2f-c2a3-4456-b6b4-10d875eb739d admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:18.428735 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9efa2f-c2a3-4456-b6b4-10d875eb739d admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:18.429009 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9efa2f-c2a3-4456-b6b4-10d875eb739d admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:18.429687 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9efa2f-c2a3-4456-b6b4-10d875eb739d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:18.431595 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9efa2f-c2a3-4456-b6b4-10d875eb739d admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:18.560636 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2575/5115] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:31:18 2022] POST /identity/v3/projects => generated 387 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:31:18.562318 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e25e2f9-fb72-4669-aef1-61e21d50876e admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:18.572568 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e25e2f9-fb72-4669-aef1-61e21d50876e admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:18.633461 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4177a150-8a2b-44bc-b07f-ed3a6d5b5ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:18.634137 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4177a150-8a2b-44bc-b07f-ed3a6d5b5ac2 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:18.634425 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4177a150-8a2b-44bc-b07f-ed3a6d5b5ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:18.634707 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4177a150-8a2b-44bc-b07f-ed3a6d5b5ac2 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:18.635400 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4177a150-8a2b-44bc-b07f-ed3a6d5b5ac2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:18.637470 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4177a150-8a2b-44bc-b07f-ed3a6d5b5ac2 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:18.763944 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2541/5116] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:31:18 2022] POST /identity/v3/users => generated 294 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:31:18.768039 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9efa2f-c2a3-4456-b6b4-10d875eb739d admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:18.778106 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9efa2f-c2a3-4456-b6b4-10d875eb739d admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:18.783374 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220df7a2-5499-426d-9a8e-7b67a4aaba6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:18.784043 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220df7a2-5499-426d-9a8e-7b67a4aaba6f admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:18.784321 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220df7a2-5499-426d-9a8e-7b67a4aaba6f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:18.784593 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220df7a2-5499-426d-9a8e-7b67a4aaba6f admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:18.785305 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220df7a2-5499-426d-9a8e-7b67a4aaba6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:18.786889 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220df7a2-5499-426d-9a8e-7b67a4aaba6f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:18.797720 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2576/5117] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:31:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:31:18.801918 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220df7a2-5499-426d-9a8e-7b67a4aaba6f admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:18.807021 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4177a150-8a2b-44bc-b07f-ed3a6d5b5ac2 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:18.807147 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-220df7a2-5499-426d-9a8e-7b67a4aaba6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:18.813331 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4177a150-8a2b-44bc-b07f-ed3a6d5b5ac2 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:18.817272 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220df7a2-5499-426d-9a8e-7b67a4aaba6f admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:18.821153 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a28b2c-854c-4348-bece-75f55ba9e98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:18.821849 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a28b2c-854c-4348-bece-75f55ba9e98f admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:18.822135 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a28b2c-854c-4348-bece-75f55ba9e98f admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:18.822413 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a28b2c-854c-4348-bece-75f55ba9e98f admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:18.823142 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a28b2c-854c-4348-bece-75f55ba9e98f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:18.825300 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa31717-ec3c-4721-83ab-807d0ac99689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:18.825499 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a28b2c-854c-4348-bece-75f55ba9e98f admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:18.826100 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa31717-ec3c-4721-83ab-807d0ac99689 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:18.826365 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa31717-ec3c-4721-83ab-807d0ac99689 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:18.826954 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa31717-ec3c-4721-83ab-807d0ac99689 admin admin] PATH_INFO: `/v3/projects/ae5e9ab5390a49d0ad1896e52248340d` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:18.828422 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa31717-ec3c-4721-83ab-807d0ac99689 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae5e9ab5390a49d0ad1896e52248340d)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:18.830785 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa31717-ec3c-4721-83ab-807d0ac99689 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:18.840055 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2542/5118] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:31:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:31:18.842005 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a28b2c-854c-4348-bece-75f55ba9e98f admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:18.853111 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a28b2c-854c-4348-bece-75f55ba9e98f admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:18.863749 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944334b7-a512-4f7c-92a7-ccc42a70435a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:18.864677 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944334b7-a512-4f7c-92a7-ccc42a70435a admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:18.864955 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944334b7-a512-4f7c-92a7-ccc42a70435a admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:18.865228 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944334b7-a512-4f7c-92a7-ccc42a70435a admin admin] PATH_INFO: `/v3/projects/ef27c8367a764fe683997e99d6fbab91/users/dab6695daa0047d3b6acc7fa368f4eec/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:18.880578 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944334b7-a512-4f7c-92a7-ccc42a70435a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef27c8367a764fe683997e99d6fbab91, user_id=dab6695daa0047d3b6acc7fa368f4eec, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:18.883256 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944334b7-a512-4f7c-92a7-ccc42a70435a admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:18.959786 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2543/5119] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:31:18 2022] PUT /identity/v3/projects/ef27c8367a764fe683997e99d6fbab91/users/dab6695daa0047d3b6acc7fa368f4eec/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:31:18.968380 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9fa31717-ec3c-4721-83ab-807d0ac99689 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae5e9ab5390a49d0ad1896e52248340d', 'request_id': 'req-9fa31717-ec3c-4721-83ab-807d0ac99689'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:18.971402 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32810d23-5119-48a1-be5a-65cbc6cc75b6 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:18.971709 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32810d23-5119-48a1-be5a-65cbc6cc75b6 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:18.971989 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32810d23-5119-48a1-be5a-65cbc6cc75b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:18.974017 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9fa31717-ec3c-4721-83ab-807d0ac99689 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae5e9ab5390a49d0ad1896e52248340d', 'request_id': 'req-9fa31717-ec3c-4721-83ab-807d0ac99689'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:18.999697 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-32810d23-5119-48a1-be5a-65cbc6cc75b6 None None] MFA Rules not processed for user `dab6695daa0047d3b6acc7fa368f4eec`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:31:19.000951 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-32810d23-5119-48a1-be5a-65cbc6cc75b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:19.045283 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9fa31717-ec3c-4721-83ab-807d0ac99689 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae5e9ab5390a49d0ad1896e52248340d', 'request_id': 'req-9fa31717-ec3c-4721-83ab-807d0ac99689'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:19.057150 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9fa31717-ec3c-4721-83ab-807d0ac99689 admin admin] The token cache is being invalidate because project ae5e9ab5390a49d0ad1896e52248340d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:31:19.057616 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9fa31717-ec3c-4721-83ab-807d0ac99689 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:19.061472 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9fa31717-ec3c-4721-83ab-807d0ac99689 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:19.061472 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2577/5120] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:31:18 2022] DELETE /identity/v3/projects/ae5e9ab5390a49d0ad1896e52248340d => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:31:19.066448 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e53f49-8546-4280-9674-1b85d0ca9042 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:19.066737 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e53f49-8546-4280-9674-1b85d0ca9042 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:19.067019 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e53f49-8546-4280-9674-1b85d0ca9042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:19.075466 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2544/5121] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:31:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:31:19.085837 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32810d23-5119-48a1-be5a-65cbc6cc75b6 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:19.090799 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-32810d23-5119-48a1-be5a-65cbc6cc75b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:19.092516 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-b9e53f49-8546-4280-9674-1b85d0ca9042 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:31:19.093778 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b9e53f49-8546-4280-9674-1b85d0ca9042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:19.158780 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2578/5122] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:31:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:31:19.161555 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32810d23-5119-48a1-be5a-65cbc6cc75b6 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:19.166449 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b03fa-dfa3-4c6f-8d01-c3562c15e5e3 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:19.166744 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b03fa-dfa3-4c6f-8d01-c3562c15e5e3 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:19.167024 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b03fa-dfa3-4c6f-8d01-c3562c15e5e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:19.167676 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d72499-2417-461f-b519-98e84e03c377 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:19.168227 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d72499-2417-461f-b519-98e84e03c377 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:19.168511 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d72499-2417-461f-b519-98e84e03c377 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:19.169094 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d72499-2417-461f-b519-98e84e03c377 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:19.171368 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-12d72499-2417-461f-b519-98e84e03c377 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:19.182895 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d72499-2417-461f-b519-98e84e03c377 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:19.184366 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d72499-2417-461f-b519-98e84e03c377 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:19.186097 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-040b03fa-dfa3-4c6f-8d01-c3562c15e5e3 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:31:19.187415 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-040b03fa-dfa3-4c6f-8d01-c3562c15e5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:19.195000 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2545/5123] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:31:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:31:19.203973 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2579/5124] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:31:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:31:19.208405 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d72499-2417-461f-b519-98e84e03c377 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:19.219020 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d72499-2417-461f-b519-98e84e03c377 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:19.223640 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdb710f-0aa8-49b0-a5ed-b9ab6e6d7c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:19.224290 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdb710f-0aa8-49b0-a5ed-b9ab6e6d7c29 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:19.224570 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdb710f-0aa8-49b0-a5ed-b9ab6e6d7c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:19.224844 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdb710f-0aa8-49b0-a5ed-b9ab6e6d7c29 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:19.225553 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdb710f-0aa8-49b0-a5ed-b9ab6e6d7c29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:31:19.225845 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdb710f-0aa8-49b0-a5ed-b9ab6e6d7c29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:19.227443 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdb710f-0aa8-49b0-a5ed-b9ab6e6d7c29 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:19.239697 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2546/5125] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:31:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:31:19.244214 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b03fa-dfa3-4c6f-8d01-c3562c15e5e3 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:19.254220 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b03fa-dfa3-4c6f-8d01-c3562c15e5e3 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:19.259264 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b013b5-4fdd-4b6a-8506-91742824dfef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:19.260145 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b013b5-4fdd-4b6a-8506-91742824dfef admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:19.260486 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b013b5-4fdd-4b6a-8506-91742824dfef admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:19.260825 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b013b5-4fdd-4b6a-8506-91742824dfef admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:19.261679 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b013b5-4fdd-4b6a-8506-91742824dfef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:19.263881 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b013b5-4fdd-4b6a-8506-91742824dfef admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:19.405582 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2580/5126] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:31:19 2022] POST /identity/v3/projects => generated 397 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:31:19.409700 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdb710f-0aa8-49b0-a5ed-b9ab6e6d7c29 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:19.420165 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdb710f-0aa8-49b0-a5ed-b9ab6e6d7c29 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:19.480641 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e64ea32-ba6e-4696-ad9c-df4ee5f4243c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:19.482191 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e64ea32-ba6e-4696-ad9c-df4ee5f4243c admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:19.482677 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e64ea32-ba6e-4696-ad9c-df4ee5f4243c admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:19.483229 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e64ea32-ba6e-4696-ad9c-df4ee5f4243c admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:19.484118 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e64ea32-ba6e-4696-ad9c-df4ee5f4243c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:19.485916 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e64ea32-ba6e-4696-ad9c-df4ee5f4243c admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:19.612664 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2547/5127] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:31:19 2022] POST /identity/v3/users => generated 299 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:31:19.616874 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b013b5-4fdd-4b6a-8506-91742824dfef admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:19.627070 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b013b5-4fdd-4b6a-8506-91742824dfef admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:19.631655 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f560478-8f36-45c5-aa99-a556837b004f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:19.639369 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f560478-8f36-45c5-aa99-a556837b004f admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:19.639369 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f560478-8f36-45c5-aa99-a556837b004f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:19.639369 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f560478-8f36-45c5-aa99-a556837b004f admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:19.639369 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f560478-8f36-45c5-aa99-a556837b004f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:19.639369 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f560478-8f36-45c5-aa99-a556837b004f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:19.646822 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2581/5128] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:31:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:31:19.650946 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e64ea32-ba6e-4696-ad9c-df4ee5f4243c admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:19.661868 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e64ea32-ba6e-4696-ad9c-df4ee5f4243c admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:19.668128 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24ee0bd-00dc-4a08-85c8-47544ba9b166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:19.668128 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ee0bd-00dc-4a08-85c8-47544ba9b166 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:19.668128 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ee0bd-00dc-4a08-85c8-47544ba9b166 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:19.668413 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ee0bd-00dc-4a08-85c8-47544ba9b166 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:19.669818 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24ee0bd-00dc-4a08-85c8-47544ba9b166 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:19.671635 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24ee0bd-00dc-4a08-85c8-47544ba9b166 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:19.681926 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2548/5129] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:31:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:31:19.686871 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f560478-8f36-45c5-aa99-a556837b004f admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:19.699302 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f560478-8f36-45c5-aa99-a556837b004f admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:19.704252 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5704e33f-99b2-440f-aba7-c6bafd5e9cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:19.705169 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5704e33f-99b2-440f-aba7-c6bafd5e9cc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:19.705485 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5704e33f-99b2-440f-aba7-c6bafd5e9cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:19.705790 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5704e33f-99b2-440f-aba7-c6bafd5e9cc3 admin admin] PATH_INFO: `/v3/projects/0ff7dc73b3ad4f36846e334931f80a28/users/012410e55bbb4061a79604dd6a196fb6/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:19.721784 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5704e33f-99b2-440f-aba7-c6bafd5e9cc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ff7dc73b3ad4f36846e334931f80a28, user_id=012410e55bbb4061a79604dd6a196fb6, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:19.725298 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5704e33f-99b2-440f-aba7-c6bafd5e9cc3 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:19.866780 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2582/5130] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:31:19 2022] PUT /identity/v3/projects/0ff7dc73b3ad4f36846e334931f80a28/users/012410e55bbb4061a79604dd6a196fb6/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:31:19.878421 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3dcef-6411-462d-867d-912f9a68a30c None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:19.878421 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3dcef-6411-462d-867d-912f9a68a30c None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:19.878609 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3dcef-6411-462d-867d-912f9a68a30c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:19.911757 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-59f3dcef-6411-462d-867d-912f9a68a30c None None] MFA Rules not processed for user `012410e55bbb4061a79604dd6a196fb6`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:31:19.912997 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-59f3dcef-6411-462d-867d-912f9a68a30c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:19.977934 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2549/5131] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:31:19 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:31:19.983264 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5704e33f-99b2-440f-aba7-c6bafd5e9cc3 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:20.056826 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5704e33f-99b2-440f-aba7-c6bafd5e9cc3 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:20.067207 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43edfac-594e-4394-85bd-8c7df77173aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:20.068145 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43edfac-594e-4394-85bd-8c7df77173aa admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:20.068573 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43edfac-594e-4394-85bd-8c7df77173aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:20.069026 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43edfac-594e-4394-85bd-8c7df77173aa admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:20.069727 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43edfac-594e-4394-85bd-8c7df77173aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:20.071692 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43edfac-594e-4394-85bd-8c7df77173aa admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:20.168833 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2583/5132] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:31:19 2022] POST /identity/v3/projects => generated 395 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:31:20.173215 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f3dcef-6411-462d-867d-912f9a68a30c None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:20.184955 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f3dcef-6411-462d-867d-912f9a68a30c None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:20.250338 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17d30b0-9fd7-42ce-a092-ca32450150a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:20.251012 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d30b0-9fd7-42ce-a092-ca32450150a2 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:20.251299 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d30b0-9fd7-42ce-a092-ca32450150a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:20.251617 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d30b0-9fd7-42ce-a092-ca32450150a2 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:20.252304 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17d30b0-9fd7-42ce-a092-ca32450150a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:20.254230 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17d30b0-9fd7-42ce-a092-ca32450150a2 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:20.353364 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2550/5133] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:31:20 2022] POST /identity/v3/users => generated 304 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:31:20.357658 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43edfac-594e-4394-85bd-8c7df77173aa admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:20.368423 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43edfac-594e-4394-85bd-8c7df77173aa admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:20.373573 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a48c1-0634-4409-94db-07b3bdc15d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:20.374267 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a48c1-0634-4409-94db-07b3bdc15d99 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:20.374549 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a48c1-0634-4409-94db-07b3bdc15d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:20.374821 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a48c1-0634-4409-94db-07b3bdc15d99 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:20.375556 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44a48c1-0634-4409-94db-07b3bdc15d99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:20.377140 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44a48c1-0634-4409-94db-07b3bdc15d99 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:20.388790 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2584/5134] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:31:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:31:20.393311 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17d30b0-9fd7-42ce-a092-ca32450150a2 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:20.403955 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17d30b0-9fd7-42ce-a092-ca32450150a2 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:20.409429 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0545e033-6c65-41bf-a77d-3b9ec3f6d948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:20.410368 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545e033-6c65-41bf-a77d-3b9ec3f6d948 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:20.410659 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545e033-6c65-41bf-a77d-3b9ec3f6d948 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:20.410939 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545e033-6c65-41bf-a77d-3b9ec3f6d948 admin admin] PATH_INFO: `/v3/projects/6e26e654bb9443b39a95c8a4c1ab1735/users/7f3d423ee7ea4c90845160747546007b/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:20.425886 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0545e033-6c65-41bf-a77d-3b9ec3f6d948 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e26e654bb9443b39a95c8a4c1ab1735, user_id=7f3d423ee7ea4c90845160747546007b, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:20.428596 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0545e033-6c65-41bf-a77d-3b9ec3f6d948 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:20.622967 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2551/5135] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:31:20 2022] PUT /identity/v3/projects/6e26e654bb9443b39a95c8a4c1ab1735/users/7f3d423ee7ea4c90845160747546007b/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:31:20.628213 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a48c1-0634-4409-94db-07b3bdc15d99 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:20.638731 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a48c1-0634-4409-94db-07b3bdc15d99 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:20.730240 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f8d5ca-f204-4012-9a10-761fd002e95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:20.730927 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f8d5ca-f204-4012-9a10-761fd002e95d admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:20.736400 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f8d5ca-f204-4012-9a10-761fd002e95d admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:20.736400 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f8d5ca-f204-4012-9a10-761fd002e95d admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:20.736400 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f8d5ca-f204-4012-9a10-761fd002e95d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:20.736400 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f8d5ca-f204-4012-9a10-761fd002e95d admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:20.745585 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2585/5136] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:31:20 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:31:20.750176 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0545e033-6c65-41bf-a77d-3b9ec3f6d948 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:20.767294 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0545e033-6c65-41bf-a77d-3b9ec3f6d948 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:20.777245 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15eccba-3a5f-459e-bae7-8fb211405091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:20.778223 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15eccba-3a5f-459e-bae7-8fb211405091 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:20.778691 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15eccba-3a5f-459e-bae7-8fb211405091 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:20.779108 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15eccba-3a5f-459e-bae7-8fb211405091 admin admin] PATH_INFO: `/v3/projects/6e26e654bb9443b39a95c8a4c1ab1735/users/7f3d423ee7ea4c90845160747546007b/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:20.781825 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15eccba-3a5f-459e-bae7-8fb211405091 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e26e654bb9443b39a95c8a4c1ab1735, user_id=7f3d423ee7ea4c90845160747546007b, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:20.787977 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15eccba-3a5f-459e-bae7-8fb211405091 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:20.798972 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2552/5137] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:31:20 2022] PUT /identity/v3/projects/6e26e654bb9443b39a95c8a4c1ab1735/users/7f3d423ee7ea4c90845160747546007b/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:31:20.808822 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdae57f-ed29-4caa-9315-393fce908a9b None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:20.809113 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdae57f-ed29-4caa-9315-393fce908a9b None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:20.809401 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdae57f-ed29-4caa-9315-393fce908a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:20.851609 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-4fdae57f-ed29-4caa-9315-393fce908a9b None None] MFA Rules not processed for user `7f3d423ee7ea4c90845160747546007b`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:31:20.852854 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-4fdae57f-ed29-4caa-9315-393fce908a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:20.945936 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2586/5138] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:31:20 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:31:20.952306 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15eccba-3a5f-459e-bae7-8fb211405091 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:21.021157 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15eccba-3a5f-459e-bae7-8fb211405091 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:21.027728 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b225194d-6dea-4239-bcd2-ff729ecab873 tempest-ProjectsNegativeStaticTestJSON-1062068859 tempest-ProjectsNegativeStaticTestJSON-1062068859-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '012410e55bbb4061a79604dd6a196fb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff7dc73b3ad4f36846e334931f80a28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:21.029143 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225194d-6dea-4239-bcd2-ff729ecab873 tempest-ProjectsNegativeStaticTestJSON-1062068859 tempest-ProjectsNegativeStaticTestJSON-1062068859-project] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:21.029872 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225194d-6dea-4239-bcd2-ff729ecab873 tempest-ProjectsNegativeStaticTestJSON-1062068859 tempest-ProjectsNegativeStaticTestJSON-1062068859-project] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:21.030288 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225194d-6dea-4239-bcd2-ff729ecab873 tempest-ProjectsNegativeStaticTestJSON-1062068859 tempest-ProjectsNegativeStaticTestJSON-1062068859-project] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:21.030952 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b225194d-6dea-4239-bcd2-ff729ecab873 tempest-ProjectsNegativeStaticTestJSON-1062068859 tempest-ProjectsNegativeStaticTestJSON-1062068859-project] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:21.037306 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-b225194d-6dea-4239-bcd2-ff729ecab873 tempest-ProjectsNegativeStaticTestJSON-1062068859 tempest-ProjectsNegativeStaticTestJSON-1062068859-project] You are not authorized to perform the requested action: identity:create_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. May 14 21:31:21.037306 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:31:21.037306 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 21:31:21.037306 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 21:31:21.037306 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 21:31:21.037306 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 21:31:21.037306 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 21:31:21.037306 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 21:31:21.037306 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 21:31:21.037306 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 21:31:21.037306 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 21:31:21.037306 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 21:31:21.037306 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 162, in post May 14 21:31:21.037306 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ENFORCER.enforce_call( May 14 21:31:21.038354 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call May 14 21:31:21.038354 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application enforcer_obj._enforce( May 14 21:31:21.038354 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce May 14 21:31:21.038354 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application result = self._enforcer.enforce( May 14 21:31:21.038354 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 14 21:31:21.038354 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) May 14 21:31:21.038354 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. May 14 21:31:21.038354 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:31:21.044072 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2553/5139] 10.222.0.52 () {60 vars in 1151 bytes} [Sat May 14 21:31:20 2022] POST /identity/v3/projects => generated 136 bytes in 88 msecs (HTTP/1.1 403) 5 headers in 184 bytes (2 switches on core 0) May 14 21:31:21.044167 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdae57f-ed29-4caa-9315-393fce908a9b None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:21.061202 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdae57f-ed29-4caa-9315-393fce908a9b None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:21.067377 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2669df6-6540-4c21-acb1-93334bccc824 tempest-ProjectsNegativeStaticTestJSON-405772921 tempest-ProjectsNegativeStaticTestJSON-405772921-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f3d423ee7ea4c90845160747546007b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e26e654bb9443b39a95c8a4c1ab1735', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:21.068762 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2669df6-6540-4c21-acb1-93334bccc824 tempest-ProjectsNegativeStaticTestJSON-405772921 tempest-ProjectsNegativeStaticTestJSON-405772921-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:21.068762 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2669df6-6540-4c21-acb1-93334bccc824 tempest-ProjectsNegativeStaticTestJSON-405772921 tempest-ProjectsNegativeStaticTestJSON-405772921-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:21.068946 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2669df6-6540-4c21-acb1-93334bccc824 tempest-ProjectsNegativeStaticTestJSON-405772921 tempest-ProjectsNegativeStaticTestJSON-405772921-project-admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:21.069590 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2669df6-6540-4c21-acb1-93334bccc824 tempest-ProjectsNegativeStaticTestJSON-405772921 tempest-ProjectsNegativeStaticTestJSON-405772921-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:21.071329 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2669df6-6540-4c21-acb1-93334bccc824 tempest-ProjectsNegativeStaticTestJSON-405772921 tempest-ProjectsNegativeStaticTestJSON-405772921-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:21.092475 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-f2669df6-6540-4c21-acb1-93334bccc824 tempest-ProjectsNegativeStaticTestJSON-405772921 tempest-ProjectsNegativeStaticTestJSON-405772921-project-admin] Invalid input for field 'name': '' is too short May 14 21:31:21.092475 ncdv-master-1 devstack@keystone.service[91106]: Failed validating 'minLength' in schema['properties']['name']: May 14 21:31:21.092475 ncdv-master-1 devstack@keystone.service[91106]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} May 14 21:31:21.092475 ncdv-master-1 devstack@keystone.service[91106]: On instance['name']: May 14 21:31:21.092475 ncdv-master-1 devstack@keystone.service[91106]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short May 14 21:31:21.092475 ncdv-master-1 devstack@keystone.service[91106]: Failed validating 'minLength' in schema['properties']['name']: May 14 21:31:21.092475 ncdv-master-1 devstack@keystone.service[91106]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} May 14 21:31:21.092475 ncdv-master-1 devstack@keystone.service[91106]: On instance['name']: May 14 21:31:21.092475 ncdv-master-1 devstack@keystone.service[91106]: '' May 14 21:31:21.092475 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:31:21.092475 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate May 14 21:31:21.092475 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) May 14 21:31:21.092475 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 14 21:31:21.092475 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise error May 14 21:31:21.092475 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short May 14 21:31:21.092475 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:31:21.092475 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: May 14 21:31:21.092475 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} May 14 21:31:21.092475 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:31:21.092475 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application On instance['name']: May 14 21:31:21.092475 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application '' May 14 21:31:21.092475 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:31:21.092475 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 21:31:21.094015 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:31:21.094015 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:31:21.094015 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 21:31:21.094015 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 21:31:21.094015 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 21:31:21.094015 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 21:31:21.094015 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 21:31:21.094015 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 21:31:21.094015 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 21:31:21.094015 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 21:31:21.094015 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 21:31:21.094015 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 21:31:21.094015 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post May 14 21:31:21.094015 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) May 14 21:31:21.094015 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate May 14 21:31:21.094015 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) May 14 21:31:21.094015 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate May 14 21:31:21.095028 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) May 14 21:31:21.095028 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short May 14 21:31:21.095028 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:31:21.095028 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: May 14 21:31:21.095028 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} May 14 21:31:21.095028 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:31:21.095028 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application On instance['name']: May 14 21:31:21.095028 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application '' May 14 21:31:21.095028 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:31:21.095028 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2587/5140] 10.222.0.52 () {60 vars in 1151 bytes} [Sat May 14 21:31:21 2022] POST /identity/v3/projects => generated 283 bytes in 51 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) May 14 21:31:21.100342 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b225194d-6dea-4239-bcd2-ff729ecab873 tempest-ProjectsNegativeStaticTestJSON-1062068859 tempest-ProjectsNegativeStaticTestJSON-1062068859-project] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:21.111728 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b225194d-6dea-4239-bcd2-ff729ecab873 tempest-ProjectsNegativeStaticTestJSON-1062068859 tempest-ProjectsNegativeStaticTestJSON-1062068859-project] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:21.116296 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65145c32-c7eb-4408-8e8b-481479b4780e tempest-ProjectsNegativeStaticTestJSON-405772921 tempest-ProjectsNegativeStaticTestJSON-405772921-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f3d423ee7ea4c90845160747546007b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e26e654bb9443b39a95c8a4c1ab1735', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:21.116952 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65145c32-c7eb-4408-8e8b-481479b4780e tempest-ProjectsNegativeStaticTestJSON-405772921 tempest-ProjectsNegativeStaticTestJSON-405772921-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:21.117260 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65145c32-c7eb-4408-8e8b-481479b4780e tempest-ProjectsNegativeStaticTestJSON-405772921 tempest-ProjectsNegativeStaticTestJSON-405772921-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:21.117538 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65145c32-c7eb-4408-8e8b-481479b4780e tempest-ProjectsNegativeStaticTestJSON-405772921 tempest-ProjectsNegativeStaticTestJSON-405772921-project-admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:21.118206 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65145c32-c7eb-4408-8e8b-481479b4780e tempest-ProjectsNegativeStaticTestJSON-405772921 tempest-ProjectsNegativeStaticTestJSON-405772921-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:21.120089 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65145c32-c7eb-4408-8e8b-481479b4780e tempest-ProjectsNegativeStaticTestJSON-405772921 tempest-ProjectsNegativeStaticTestJSON-405772921-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:21.127406 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-65145c32-c7eb-4408-8e8b-481479b4780e tempest-ProjectsNegativeStaticTestJSON-405772921 tempest-ProjectsNegativeStaticTestJSON-405772921-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 14 21:31:21.127406 ncdv-master-1 devstack@keystone.service[91107]: Failed validating 'maxLength' in schema['properties']['name']: May 14 21:31:21.127406 ncdv-master-1 devstack@keystone.service[91107]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} May 14 21:31:21.127406 ncdv-master-1 devstack@keystone.service[91107]: On instance['name']: May 14 21:31:21.127406 ncdv-master-1 devstack@keystone.service[91107]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 14 21:31:21.127406 ncdv-master-1 devstack@keystone.service[91107]: Failed validating 'maxLength' in schema['properties']['name']: May 14 21:31:21.127406 ncdv-master-1 devstack@keystone.service[91107]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} May 14 21:31:21.127406 ncdv-master-1 devstack@keystone.service[91107]: On instance['name']: May 14 21:31:21.127406 ncdv-master-1 devstack@keystone.service[91107]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' May 14 21:31:21.127406 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:31:21.127406 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate May 14 21:31:21.127406 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) May 14 21:31:21.127406 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 14 21:31:21.127406 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise error May 14 21:31:21.127406 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 14 21:31:21.127406 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:31:21.127406 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: May 14 21:31:21.127406 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} May 14 21:31:21.128739 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:31:21.128739 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application On instance['name']: May 14 21:31:21.128739 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' May 14 21:31:21.128739 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:31:21.128739 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 21:31:21.128739 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:31:21.128739 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:31:21.128739 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 21:31:21.128739 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 21:31:21.128739 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 21:31:21.128739 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 21:31:21.128739 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 21:31:21.128739 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 21:31:21.128739 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 21:31:21.128739 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 21:31:21.128739 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 21:31:21.128739 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 21:31:21.128739 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post May 14 21:31:21.129928 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) May 14 21:31:21.129928 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate May 14 21:31:21.129928 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) May 14 21:31:21.129928 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate May 14 21:31:21.129928 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) May 14 21:31:21.129928 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 14 21:31:21.129928 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:31:21.129928 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: May 14 21:31:21.129928 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} May 14 21:31:21.129928 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:31:21.129928 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application On instance['name']: May 14 21:31:21.129928 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' May 14 21:31:21.129928 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:31:21.129928 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2554/5141] 10.222.0.52 () {60 vars in 1151 bytes} [Sat May 14 21:31:21 2022] POST /identity/v3/projects => generated 412 bytes in 29 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) May 14 21:31:21.135910 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2669df6-6540-4c21-acb1-93334bccc824 tempest-ProjectsNegativeStaticTestJSON-405772921 tempest-ProjectsNegativeStaticTestJSON-405772921-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:21.147690 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2669df6-6540-4c21-acb1-93334bccc824 tempest-ProjectsNegativeStaticTestJSON-405772921 tempest-ProjectsNegativeStaticTestJSON-405772921-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:21.152443 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e11e55-d5c6-4e4b-a846-96d111665194 tempest-ProjectsNegativeStaticTestJSON-405772921 tempest-ProjectsNegativeStaticTestJSON-405772921-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f3d423ee7ea4c90845160747546007b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e26e654bb9443b39a95c8a4c1ab1735', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:21.153277 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e11e55-d5c6-4e4b-a846-96d111665194 tempest-ProjectsNegativeStaticTestJSON-405772921 tempest-ProjectsNegativeStaticTestJSON-405772921-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:21.153624 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e11e55-d5c6-4e4b-a846-96d111665194 tempest-ProjectsNegativeStaticTestJSON-405772921 tempest-ProjectsNegativeStaticTestJSON-405772921-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:21.154204 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e11e55-d5c6-4e4b-a846-96d111665194 tempest-ProjectsNegativeStaticTestJSON-405772921 tempest-ProjectsNegativeStaticTestJSON-405772921-project-admin] PATH_INFO: `/v3/projects/c079513539b74e4b9a350adfdafd0fbb` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:21.162109 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e11e55-d5c6-4e4b-a846-96d111665194 tempest-ProjectsNegativeStaticTestJSON-405772921 tempest-ProjectsNegativeStaticTestJSON-405772921-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c079513539b74e4b9a350adfdafd0fbb)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:21.164109 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e11e55-d5c6-4e4b-a846-96d111665194 tempest-ProjectsNegativeStaticTestJSON-405772921 tempest-ProjectsNegativeStaticTestJSON-405772921-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:21.197246 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-d7e11e55-d5c6-4e4b-a846-96d111665194 tempest-ProjectsNegativeStaticTestJSON-405772921 tempest-ProjectsNegativeStaticTestJSON-405772921-project-admin] Could not find project: c079513539b74e4b9a350adfdafd0fbb.: keystone.exception.ProjectNotFound: Could not find project: c079513539b74e4b9a350adfdafd0fbb. May 14 21:31:21.197246 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:31:21.197246 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 21:31:21.197246 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 21:31:21.197246 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 21:31:21.197246 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 21:31:21.197246 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 21:31:21.197246 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 21:31:21.197246 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 21:31:21.197246 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 21:31:21.197246 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 21:31:21.197246 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 21:31:21.197246 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete May 14 21:31:21.197246 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( May 14 21:31:21.198596 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 21:31:21.198596 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 21:31:21.198596 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project May 14 21:31:21.198596 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) May 14 21:31:21.198596 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 21:31:21.198596 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 21:31:21.198596 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 21:31:21.198596 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 21:31:21.198596 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: c079513539b74e4b9a350adfdafd0fbb. May 14 21:31:21.198596 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:31:21.212521 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2588/5142] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:31:21 2022] DELETE /identity/v3/projects/c079513539b74e4b9a350adfdafd0fbb => generated 113 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 14 21:31:21.214303 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65145c32-c7eb-4408-8e8b-481479b4780e tempest-ProjectsNegativeStaticTestJSON-405772921 tempest-ProjectsNegativeStaticTestJSON-405772921-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:21.244080 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65145c32-c7eb-4408-8e8b-481479b4780e tempest-ProjectsNegativeStaticTestJSON-405772921 tempest-ProjectsNegativeStaticTestJSON-405772921-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:21.258446 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d0e05-6142-43c6-8b8f-0cf4a8ab254a tempest-ProjectsNegativeStaticTestJSON-1062068859 tempest-ProjectsNegativeStaticTestJSON-1062068859-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '012410e55bbb4061a79604dd6a196fb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff7dc73b3ad4f36846e334931f80a28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:21.259397 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d0e05-6142-43c6-8b8f-0cf4a8ab254a tempest-ProjectsNegativeStaticTestJSON-1062068859 tempest-ProjectsNegativeStaticTestJSON-1062068859-project] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:21.260141 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d0e05-6142-43c6-8b8f-0cf4a8ab254a tempest-ProjectsNegativeStaticTestJSON-1062068859 tempest-ProjectsNegativeStaticTestJSON-1062068859-project] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:21.260431 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d0e05-6142-43c6-8b8f-0cf4a8ab254a tempest-ProjectsNegativeStaticTestJSON-1062068859 tempest-ProjectsNegativeStaticTestJSON-1062068859-project] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:21.261178 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563d0e05-6142-43c6-8b8f-0cf4a8ab254a tempest-ProjectsNegativeStaticTestJSON-1062068859 tempest-ProjectsNegativeStaticTestJSON-1062068859-project] RBAC: Authorizing `identity:list_projects()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:21.262200 ncdv-master-1 devstack@keystone.service[91107]: WARNING py.warnings [None req-563d0e05-6142-43c6-8b8f-0cf4a8ab254a tempest-ProjectsNegativeStaticTestJSON-1062068859 tempest-ProjectsNegativeStaticTestJSON-1062068859-project] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 14 21:31:21.262200 ncdv-master-1 devstack@keystone.service[91107]: warnings.warn(msg) May 14 21:31:21.262200 ncdv-master-1 devstack@keystone.service[91107]: May 14 21:31:21.268910 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-563d0e05-6142-43c6-8b8f-0cf4a8ab254a tempest-ProjectsNegativeStaticTestJSON-1062068859 tempest-ProjectsNegativeStaticTestJSON-1062068859-project] You are not authorized to perform the requested action: identity:list_projects.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. May 14 21:31:21.268910 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:31:21.268910 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 21:31:21.268910 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 21:31:21.268910 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 21:31:21.268910 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 21:31:21.268910 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 21:31:21.268910 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 21:31:21.268910 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 21:31:21.268910 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 21:31:21.268910 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 21:31:21.268910 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 21:31:21.268910 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 153, in get May 14 21:31:21.268910 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._list_projects() May 14 21:31:21.269866 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 120, in _list_projects May 14 21:31:21.269866 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:list_projects', May 14 21:31:21.269866 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call May 14 21:31:21.269866 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application enforcer_obj._enforce( May 14 21:31:21.269866 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce May 14 21:31:21.269866 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application result = self._enforcer.enforce( May 14 21:31:21.269866 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 14 21:31:21.269866 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) May 14 21:31:21.269866 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. May 14 21:31:21.269866 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:31:21.275947 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e11e55-d5c6-4e4b-a846-96d111665194 tempest-ProjectsNegativeStaticTestJSON-405772921 tempest-ProjectsNegativeStaticTestJSON-405772921-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:21.282760 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2555/5143] 10.222.0.52 () {58 vars in 1130 bytes} [Sat May 14 21:31:21 2022] GET /identity/v3/projects => generated 135 bytes in 69 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) May 14 21:31:21.296949 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e11e55-d5c6-4e4b-a846-96d111665194 tempest-ProjectsNegativeStaticTestJSON-405772921 tempest-ProjectsNegativeStaticTestJSON-405772921-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:21.303382 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db17e55-eacc-4c9b-af28-292da6b1a79e tempest-ProjectsNegativeStaticTestJSON-405772921 tempest-ProjectsNegativeStaticTestJSON-405772921-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f3d423ee7ea4c90845160747546007b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e26e654bb9443b39a95c8a4c1ab1735', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:21.304132 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db17e55-eacc-4c9b-af28-292da6b1a79e tempest-ProjectsNegativeStaticTestJSON-405772921 tempest-ProjectsNegativeStaticTestJSON-405772921-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:21.304418 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db17e55-eacc-4c9b-af28-292da6b1a79e tempest-ProjectsNegativeStaticTestJSON-405772921 tempest-ProjectsNegativeStaticTestJSON-405772921-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:21.304701 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db17e55-eacc-4c9b-af28-292da6b1a79e tempest-ProjectsNegativeStaticTestJSON-405772921 tempest-ProjectsNegativeStaticTestJSON-405772921-project-admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:21.305380 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db17e55-eacc-4c9b-af28-292da6b1a79e tempest-ProjectsNegativeStaticTestJSON-405772921 tempest-ProjectsNegativeStaticTestJSON-405772921-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:21.307243 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db17e55-eacc-4c9b-af28-292da6b1a79e tempest-ProjectsNegativeStaticTestJSON-405772921 tempest-ProjectsNegativeStaticTestJSON-405772921-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:21.431695 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2589/5144] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:31:21 2022] POST /identity/v3/projects => generated 358 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:31:21.433183 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d0e05-6142-43c6-8b8f-0cf4a8ab254a tempest-ProjectsNegativeStaticTestJSON-1062068859 tempest-ProjectsNegativeStaticTestJSON-1062068859-project] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:21.444828 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d0e05-6142-43c6-8b8f-0cf4a8ab254a tempest-ProjectsNegativeStaticTestJSON-1062068859 tempest-ProjectsNegativeStaticTestJSON-1062068859-project] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:21.509129 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cb1ca1-78a1-40c0-91e5-b72eaa565da1 tempest-ProjectsNegativeStaticTestJSON-405772921 tempest-ProjectsNegativeStaticTestJSON-405772921-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f3d423ee7ea4c90845160747546007b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e26e654bb9443b39a95c8a4c1ab1735', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:21.509794 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb1ca1-78a1-40c0-91e5-b72eaa565da1 tempest-ProjectsNegativeStaticTestJSON-405772921 tempest-ProjectsNegativeStaticTestJSON-405772921-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:21.510076 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb1ca1-78a1-40c0-91e5-b72eaa565da1 tempest-ProjectsNegativeStaticTestJSON-405772921 tempest-ProjectsNegativeStaticTestJSON-405772921-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:21.510356 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb1ca1-78a1-40c0-91e5-b72eaa565da1 tempest-ProjectsNegativeStaticTestJSON-405772921 tempest-ProjectsNegativeStaticTestJSON-405772921-project-admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:21.511030 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cb1ca1-78a1-40c0-91e5-b72eaa565da1 tempest-ProjectsNegativeStaticTestJSON-405772921 tempest-ProjectsNegativeStaticTestJSON-405772921-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:21.513643 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cb1ca1-78a1-40c0-91e5-b72eaa565da1 tempest-ProjectsNegativeStaticTestJSON-405772921 tempest-ProjectsNegativeStaticTestJSON-405772921-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:21.622108 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.sql.core [None req-10cb1ca1-78a1-40c0-91e5-b72eaa565da1 tempest-ProjectsNegativeStaticTestJSON-405772921 tempest-ProjectsNegativeStaticTestJSON-405772921-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-1517450408' for key 'project.ixu_project_name_domain_id'") May 14 21:31:21.622108 ncdv-master-1 devstack@keystone.service[91107]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 14 21:31:21.622108 ncdv-master-1 devstack@keystone.service[91107]: [parameters: {'id': '145642f0471c476f83dc10991e654b42', 'name': 'tempest-project-dup-1517450408', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 14 21:31:21.622108 ncdv-master-1 devstack@keystone.service[91107]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91107) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 14 21:31:21.650041 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-10cb1ca1-78a1-40c0-91e5-b72eaa565da1 tempest-ProjectsNegativeStaticTestJSON-405772921 tempest-ProjectsNegativeStaticTestJSON-405772921-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-1517450408, project id 145642f0471c476f83dc10991e654b42.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-1517450408, project id 145642f0471c476f83dc10991e654b42. May 14 21:31:21.650041 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:31:21.650041 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 14 21:31:21.650041 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application self.dialect.do_execute( May 14 21:31:21.650041 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 14 21:31:21.650041 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 14 21:31:21.650041 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 14 21:31:21.650041 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application result = self._query(query) May 14 21:31:21.650041 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 14 21:31:21.650041 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application conn.query(q) May 14 21:31:21.650041 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 14 21:31:21.650041 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 14 21:31:21.650978 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 14 21:31:21.650978 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application result.read() May 14 21:31:21.650978 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 14 21:31:21.650978 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 14 21:31:21.650978 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 14 21:31:21.650978 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application packet.raise_for_error() May 14 21:31:21.650978 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 14 21:31:21.650978 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 14 21:31:21.650978 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 14 21:31:21.650978 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 14 21:31:21.650978 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-tempest-project-dup-1517450408' for key 'project.ixu_project_name_domain_id'") May 14 21:31:21.650978 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:31:21.650978 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 14 21:31:21.650978 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:31:21.650978 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:31:21.650978 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 14 21:31:21.650978 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 14 21:31:21.652140 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 14 21:31:21.652140 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return project_ref.to_dict() May 14 21:31:21.652140 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 14 21:31:21.652140 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application next(self.gen) May 14 21:31:21.652140 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 14 21:31:21.652140 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application yield resource May 14 21:31:21.652140 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 14 21:31:21.652140 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application next(self.gen) May 14 21:31:21.652140 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 14 21:31:21.652140 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application self.session.rollback() May 14 21:31:21.652140 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 14 21:31:21.652140 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application self.force_reraise() May 14 21:31:21.652140 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 14 21:31:21.652140 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise self.value May 14 21:31:21.652140 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 14 21:31:21.652140 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 14 21:31:21.652140 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 14 21:31:21.652140 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application session.commit() May 14 21:31:21.653295 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 14 21:31:21.653295 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 14 21:31:21.653295 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 14 21:31:21.653295 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application self._prepare_impl() May 14 21:31:21.653295 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 14 21:31:21.653295 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application self.session.flush() May 14 21:31:21.653295 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 14 21:31:21.653295 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application self._flush(objects) May 14 21:31:21.653295 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 14 21:31:21.653295 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 14 21:31:21.653295 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 14 21:31:21.653295 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application compat.raise_( May 14 21:31:21.653295 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 14 21:31:21.653295 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception May 14 21:31:21.653295 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 14 21:31:21.653295 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application flush_context.execute() May 14 21:31:21.653295 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 14 21:31:21.655811 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rec.execute(self) May 14 21:31:21.655811 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 14 21:31:21.655811 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 14 21:31:21.655811 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 14 21:31:21.655811 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application _emit_insert_statements( May 14 21:31:21.655811 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 14 21:31:21.655811 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application c = connection._execute_20( May 14 21:31:21.655811 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 14 21:31:21.655811 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 14 21:31:21.655811 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 14 21:31:21.655811 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 14 21:31:21.655811 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 14 21:31:21.655811 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ret = self._execute_context( May 14 21:31:21.655811 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 14 21:31:21.655811 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 14 21:31:21.655811 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 14 21:31:21.657223 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 14 21:31:21.657223 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 14 21:31:21.657223 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception May 14 21:31:21.657223 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 14 21:31:21.657223 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application self.dialect.do_execute( May 14 21:31:21.657223 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 14 21:31:21.657223 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 14 21:31:21.657223 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 14 21:31:21.657223 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application result = self._query(query) May 14 21:31:21.657223 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 14 21:31:21.657223 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application conn.query(q) May 14 21:31:21.657223 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 14 21:31:21.657223 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 14 21:31:21.657223 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 14 21:31:21.657223 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application result.read() May 14 21:31:21.657223 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 14 21:31:21.657223 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 14 21:31:21.658455 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 14 21:31:21.658455 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application packet.raise_for_error() May 14 21:31:21.658455 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 14 21:31:21.658455 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 14 21:31:21.658455 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 14 21:31:21.658455 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 14 21:31:21.658455 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-1517450408' for key 'project.ixu_project_name_domain_id'") May 14 21:31:21.658455 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 14 21:31:21.658455 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [parameters: {'id': '145642f0471c476f83dc10991e654b42', 'name': 'tempest-project-dup-1517450408', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 14 21:31:21.658455 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 14 21:31:21.658455 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:31:21.658455 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 21:31:21.658455 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:31:21.658455 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:31:21.658455 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 14 21:31:21.659312 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 14 21:31:21.659312 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 14 21:31:21.659312 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 14 21:31:21.659312 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-project-dup-1517450408 at domain ID default. May 14 21:31:21.659312 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:31:21.659312 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 21:31:21.659312 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:31:21.659312 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:31:21.659312 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 21:31:21.659312 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 21:31:21.659312 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 21:31:21.659312 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 21:31:21.659312 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 21:31:21.659312 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 21:31:21.659312 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 21:31:21.659312 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 21:31:21.659312 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 21:31:21.660437 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 21:31:21.660437 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 14 21:31:21.660437 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 14 21:31:21.660437 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 21:31:21.660437 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 21:31:21.660437 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 14 21:31:21.660437 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.Conflict( May 14 21:31:21.660437 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-1517450408, project id 145642f0471c476f83dc10991e654b42. May 14 21:31:21.660437 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:31:21.660437 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2556/5145] 10.222.0.52 () {60 vars in 1151 bytes} [Sat May 14 21:31:21 2022] POST /identity/v3/projects => generated 285 bytes in 219 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 14 21:31:21.661170 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db17e55-eacc-4c9b-af28-292da6b1a79e tempest-ProjectsNegativeStaticTestJSON-405772921 tempest-ProjectsNegativeStaticTestJSON-405772921-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:21.671191 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db17e55-eacc-4c9b-af28-292da6b1a79e tempest-ProjectsNegativeStaticTestJSON-405772921 tempest-ProjectsNegativeStaticTestJSON-405772921-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:21.676249 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf308d2-6d99-48cd-b152-f8bdae74dda4 tempest-ProjectsNegativeStaticTestJSON-405772921 tempest-ProjectsNegativeStaticTestJSON-405772921-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f3d423ee7ea4c90845160747546007b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e26e654bb9443b39a95c8a4c1ab1735', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:21.677377 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf308d2-6d99-48cd-b152-f8bdae74dda4 tempest-ProjectsNegativeStaticTestJSON-405772921 tempest-ProjectsNegativeStaticTestJSON-405772921-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:21.677764 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf308d2-6d99-48cd-b152-f8bdae74dda4 tempest-ProjectsNegativeStaticTestJSON-405772921 tempest-ProjectsNegativeStaticTestJSON-405772921-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:21.678175 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf308d2-6d99-48cd-b152-f8bdae74dda4 tempest-ProjectsNegativeStaticTestJSON-405772921 tempest-ProjectsNegativeStaticTestJSON-405772921-project-admin] PATH_INFO: `/v3/projects/b1d15995e27f4bc1aa8aa3e0ab873006` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:21.679656 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf308d2-6d99-48cd-b152-f8bdae74dda4 tempest-ProjectsNegativeStaticTestJSON-405772921 tempest-ProjectsNegativeStaticTestJSON-405772921-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b1d15995e27f4bc1aa8aa3e0ab873006)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:21.681869 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf308d2-6d99-48cd-b152-f8bdae74dda4 tempest-ProjectsNegativeStaticTestJSON-405772921 tempest-ProjectsNegativeStaticTestJSON-405772921-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:21.856606 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-dbf308d2-6d99-48cd-b152-f8bdae74dda4 tempest-ProjectsNegativeStaticTestJSON-405772921 tempest-ProjectsNegativeStaticTestJSON-405772921-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1d15995e27f4bc1aa8aa3e0ab873006', 'request_id': 'req-dbf308d2-6d99-48cd-b152-f8bdae74dda4'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:21.862333 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-dbf308d2-6d99-48cd-b152-f8bdae74dda4 tempest-ProjectsNegativeStaticTestJSON-405772921 tempest-ProjectsNegativeStaticTestJSON-405772921-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1d15995e27f4bc1aa8aa3e0ab873006', 'request_id': 'req-dbf308d2-6d99-48cd-b152-f8bdae74dda4'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:21.981056 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-dbf308d2-6d99-48cd-b152-f8bdae74dda4 tempest-ProjectsNegativeStaticTestJSON-405772921 tempest-ProjectsNegativeStaticTestJSON-405772921-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1d15995e27f4bc1aa8aa3e0ab873006', 'request_id': 'req-dbf308d2-6d99-48cd-b152-f8bdae74dda4'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:21.987156 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-dbf308d2-6d99-48cd-b152-f8bdae74dda4 tempest-ProjectsNegativeStaticTestJSON-405772921 tempest-ProjectsNegativeStaticTestJSON-405772921-project-admin] The token cache is being invalidate because project b1d15995e27f4bc1aa8aa3e0ab873006 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:31:21.987625 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-dbf308d2-6d99-48cd-b152-f8bdae74dda4 tempest-ProjectsNegativeStaticTestJSON-405772921 tempest-ProjectsNegativeStaticTestJSON-405772921-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:21.988369 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-dbf308d2-6d99-48cd-b152-f8bdae74dda4 tempest-ProjectsNegativeStaticTestJSON-405772921 tempest-ProjectsNegativeStaticTestJSON-405772921-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:21.989982 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2590/5146] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:31:21 2022] DELETE /identity/v3/projects/b1d15995e27f4bc1aa8aa3e0ab873006 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:31:21.995325 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cb1ca1-78a1-40c0-91e5-b72eaa565da1 tempest-ProjectsNegativeStaticTestJSON-405772921 tempest-ProjectsNegativeStaticTestJSON-405772921-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:21.998591 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-10cb1ca1-78a1-40c0-91e5-b72eaa565da1 tempest-ProjectsNegativeStaticTestJSON-405772921 tempest-ProjectsNegativeStaticTestJSON-405772921-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:22.074139 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cb1ca1-78a1-40c0-91e5-b72eaa565da1 tempest-ProjectsNegativeStaticTestJSON-405772921 tempest-ProjectsNegativeStaticTestJSON-405772921-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:22.135411 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2a2056-fdc9-4838-910d-1ca180917b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:22.136771 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a2056-fdc9-4838-910d-1ca180917b9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:22.137246 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a2056-fdc9-4838-910d-1ca180917b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:22.137695 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a2056-fdc9-4838-910d-1ca180917b9b admin admin] PATH_INFO: `/v3/users/012410e55bbb4061a79604dd6a196fb6` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:22.139389 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2a2056-fdc9-4838-910d-1ca180917b9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=012410e55bbb4061a79604dd6a196fb6)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:22.142064 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2a2056-fdc9-4838-910d-1ca180917b9b admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:22.413015 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-aa2a2056-fdc9-4838-910d-1ca180917b9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '012410e55bbb4061a79604dd6a196fb6'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:22.431888 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-aa2a2056-fdc9-4838-910d-1ca180917b9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '012410e55bbb4061a79604dd6a196fb6'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:22.433860 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-aa2a2056-fdc9-4838-910d-1ca180917b9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '012410e55bbb4061a79604dd6a196fb6'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:22.610820 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-aa2a2056-fdc9-4838-910d-1ca180917b9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '012410e55bbb4061a79604dd6a196fb6'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:22.636921 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-aa2a2056-fdc9-4838-910d-1ca180917b9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '012410e55bbb4061a79604dd6a196fb6'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:22.660640 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2557/5147] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:31:21 2022] DELETE /identity/v3/users/012410e55bbb4061a79604dd6a196fb6 => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:31:22.665561 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2abc50-f791-4675-8d89-69efe8a0d013 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:22.666115 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2abc50-f791-4675-8d89-69efe8a0d013 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:22.666115 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2abc50-f791-4675-8d89-69efe8a0d013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:22.691327 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-fe2abc50-f791-4675-8d89-69efe8a0d013 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:31:22.691327 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-fe2abc50-f791-4675-8d89-69efe8a0d013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:22.762108 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2591/5148] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:31:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:31:22.774039 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2a2056-fdc9-4838-910d-1ca180917b9b admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:22.776830 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-aa2a2056-fdc9-4838-910d-1ca180917b9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:22.866915 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2a2056-fdc9-4838-910d-1ca180917b9b admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:22.871251 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d018ad21-45f9-40e2-a8c2-ef6512ae6419 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:22.879061 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d018ad21-45f9-40e2-a8c2-ef6512ae6419 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:22.879061 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d018ad21-45f9-40e2-a8c2-ef6512ae6419 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:22.879061 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d018ad21-45f9-40e2-a8c2-ef6512ae6419 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:22.885427 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d018ad21-45f9-40e2-a8c2-ef6512ae6419 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:22.887278 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d018ad21-45f9-40e2-a8c2-ef6512ae6419 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:22.902814 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2558/5149] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:31:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:31:23.651670 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2abc50-f791-4675-8d89-69efe8a0d013 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:23.653179 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-fe2abc50-f791-4675-8d89-69efe8a0d013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:23.665486 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2abc50-f791-4675-8d89-69efe8a0d013 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:23.671834 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48ad6ad-f67a-46c1-809f-37d72e86e965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:23.672945 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ad6ad-f67a-46c1-809f-37d72e86e965 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:23.673400 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ad6ad-f67a-46c1-809f-37d72e86e965 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:23.673822 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ad6ad-f67a-46c1-809f-37d72e86e965 admin admin] PATH_INFO: `/v3/projects/0ff7dc73b3ad4f36846e334931f80a28` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:23.679998 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48ad6ad-f67a-46c1-809f-37d72e86e965 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ff7dc73b3ad4f36846e334931f80a28)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:23.681991 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48ad6ad-f67a-46c1-809f-37d72e86e965 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:23.813833 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d48ad6ad-f67a-46c1-809f-37d72e86e965 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ff7dc73b3ad4f36846e334931f80a28', 'request_id': 'req-d48ad6ad-f67a-46c1-809f-37d72e86e965'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:23.828329 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d48ad6ad-f67a-46c1-809f-37d72e86e965 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ff7dc73b3ad4f36846e334931f80a28', 'request_id': 'req-d48ad6ad-f67a-46c1-809f-37d72e86e965'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:23.987312 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d48ad6ad-f67a-46c1-809f-37d72e86e965 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ff7dc73b3ad4f36846e334931f80a28', 'request_id': 'req-d48ad6ad-f67a-46c1-809f-37d72e86e965'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:24.001878 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d48ad6ad-f67a-46c1-809f-37d72e86e965 admin admin] The token cache is being invalidate because project 0ff7dc73b3ad4f36846e334931f80a28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:31:24.002106 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d48ad6ad-f67a-46c1-809f-37d72e86e965 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:24.002765 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d48ad6ad-f67a-46c1-809f-37d72e86e965 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:24.005026 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2592/5150] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:31:23 2022] DELETE /identity/v3/projects/0ff7dc73b3ad4f36846e334931f80a28 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:31:24.016083 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d018ad21-45f9-40e2-a8c2-ef6512ae6419 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:24.031754 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d018ad21-45f9-40e2-a8c2-ef6512ae6419 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:24.112378 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4825f757-3a07-4494-9ea6-c59bce0b4c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:24.113265 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4825f757-3a07-4494-9ea6-c59bce0b4c28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:24.113545 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4825f757-3a07-4494-9ea6-c59bce0b4c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:24.113816 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4825f757-3a07-4494-9ea6-c59bce0b4c28 admin admin] PATH_INFO: `/v3/users/7f3d423ee7ea4c90845160747546007b` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:24.115121 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4825f757-3a07-4494-9ea6-c59bce0b4c28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f3d423ee7ea4c90845160747546007b)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:24.117128 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4825f757-3a07-4494-9ea6-c59bce0b4c28 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:24.331806 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4825f757-3a07-4494-9ea6-c59bce0b4c28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f3d423ee7ea4c90845160747546007b'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:24.343657 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4825f757-3a07-4494-9ea6-c59bce0b4c28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f3d423ee7ea4c90845160747546007b'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:24.344408 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4825f757-3a07-4494-9ea6-c59bce0b4c28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f3d423ee7ea4c90845160747546007b'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:24.417113 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4825f757-3a07-4494-9ea6-c59bce0b4c28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f3d423ee7ea4c90845160747546007b'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:24.436851 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4825f757-3a07-4494-9ea6-c59bce0b4c28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f3d423ee7ea4c90845160747546007b'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:24.454153 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2559/5151] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:31:24 2022] DELETE /identity/v3/users/7f3d423ee7ea4c90845160747546007b => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:31:24.990607 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48ad6ad-f67a-46c1-809f-37d72e86e965 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:24.992588 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d48ad6ad-f67a-46c1-809f-37d72e86e965 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:25.018738 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48ad6ad-f67a-46c1-809f-37d72e86e965 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:25.104304 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ef679f-b349-46e7-a58a-3df59c94e3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:25.105735 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef679f-b349-46e7-a58a-3df59c94e3ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:25.107142 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef679f-b349-46e7-a58a-3df59c94e3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:25.107626 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef679f-b349-46e7-a58a-3df59c94e3ca admin admin] PATH_INFO: `/v3/projects/6e26e654bb9443b39a95c8a4c1ab1735` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:25.111429 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ef679f-b349-46e7-a58a-3df59c94e3ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e26e654bb9443b39a95c8a4c1ab1735)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:25.111828 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ef679f-b349-46e7-a58a-3df59c94e3ca admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:25.276473 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d5ef679f-b349-46e7-a58a-3df59c94e3ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e26e654bb9443b39a95c8a4c1ab1735', 'request_id': 'req-d5ef679f-b349-46e7-a58a-3df59c94e3ca'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:25.283128 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d5ef679f-b349-46e7-a58a-3df59c94e3ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e26e654bb9443b39a95c8a4c1ab1735', 'request_id': 'req-d5ef679f-b349-46e7-a58a-3df59c94e3ca'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:25.417194 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d5ef679f-b349-46e7-a58a-3df59c94e3ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e26e654bb9443b39a95c8a4c1ab1735', 'request_id': 'req-d5ef679f-b349-46e7-a58a-3df59c94e3ca'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:25.430575 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d5ef679f-b349-46e7-a58a-3df59c94e3ca admin admin] The token cache is being invalidate because project 6e26e654bb9443b39a95c8a4c1ab1735 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:31:25.430575 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d5ef679f-b349-46e7-a58a-3df59c94e3ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:25.430997 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d5ef679f-b349-46e7-a58a-3df59c94e3ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:25.433469 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2593/5152] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:31:24 2022] DELETE /identity/v3/projects/6e26e654bb9443b39a95c8a4c1ab1735 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:31:25.441551 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23be977-671b-44c3-b433-ebe39e0c3195 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:25.442053 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23be977-671b-44c3-b433-ebe39e0c3195 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:25.442142 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23be977-671b-44c3-b433-ebe39e0c3195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:25.462083 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-c23be977-671b-44c3-b433-ebe39e0c3195 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:31:25.463640 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c23be977-671b-44c3-b433-ebe39e0c3195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:25.561301 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2560/5153] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:31:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:31:25.569322 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84831d68-5548-48b2-ba01-1141fa087365 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:25.569622 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84831d68-5548-48b2-ba01-1141fa087365 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:25.569968 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84831d68-5548-48b2-ba01-1141fa087365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:25.592475 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-84831d68-5548-48b2-ba01-1141fa087365 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:31:25.594126 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-84831d68-5548-48b2-ba01-1141fa087365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:25.609335 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2594/5154] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:31:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:31:25.620365 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23be977-671b-44c3-b433-ebe39e0c3195 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:25.634817 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23be977-671b-44c3-b433-ebe39e0c3195 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:25.640277 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c393dc-8f25-46e5-9f81-104fa47c7692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:25.641232 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c393dc-8f25-46e5-9f81-104fa47c7692 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:25.641522 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c393dc-8f25-46e5-9f81-104fa47c7692 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:25.641797 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c393dc-8f25-46e5-9f81-104fa47c7692 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:25.642808 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c393dc-8f25-46e5-9f81-104fa47c7692 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:31:25.643290 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c393dc-8f25-46e5-9f81-104fa47c7692 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:25.645588 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c393dc-8f25-46e5-9f81-104fa47c7692 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:25.665947 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2561/5155] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:31:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:31:25.667341 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84831d68-5548-48b2-ba01-1141fa087365 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:25.683375 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84831d68-5548-48b2-ba01-1141fa087365 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:25.688623 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3f29a9-7e25-4cac-a2f8-cbe3d5e4000a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:25.689681 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f29a9-7e25-4cac-a2f8-cbe3d5e4000a admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:25.690052 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f29a9-7e25-4cac-a2f8-cbe3d5e4000a admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:25.690402 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f29a9-7e25-4cac-a2f8-cbe3d5e4000a admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:25.691177 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3f29a9-7e25-4cac-a2f8-cbe3d5e4000a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:25.693269 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3f29a9-7e25-4cac-a2f8-cbe3d5e4000a admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:25.805788 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2595/5156] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:31:25 2022] POST /identity/v3/projects => generated 377 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:31:25.806540 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c393dc-8f25-46e5-9f81-104fa47c7692 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:25.821871 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c393dc-8f25-46e5-9f81-104fa47c7692 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:25.908209 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb676807-97d1-45ca-870f-d50018c77675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:25.908897 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb676807-97d1-45ca-870f-d50018c77675 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:25.909188 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb676807-97d1-45ca-870f-d50018c77675 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:25.909468 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb676807-97d1-45ca-870f-d50018c77675 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:25.910219 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb676807-97d1-45ca-870f-d50018c77675 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:25.912234 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb676807-97d1-45ca-870f-d50018c77675 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:26.086553 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2562/5157] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:31:25 2022] POST /identity/v3/users => generated 289 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:31:26.095182 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3f29a9-7e25-4cac-a2f8-cbe3d5e4000a admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:26.115469 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3f29a9-7e25-4cac-a2f8-cbe3d5e4000a admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:26.120312 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e16e08a-46ad-43c2-bdd3-4fbbc0856d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:26.121002 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e16e08a-46ad-43c2-bdd3-4fbbc0856d7b admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:26.121290 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e16e08a-46ad-43c2-bdd3-4fbbc0856d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:26.121570 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e16e08a-46ad-43c2-bdd3-4fbbc0856d7b admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:26.123125 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e16e08a-46ad-43c2-bdd3-4fbbc0856d7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:26.124803 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e16e08a-46ad-43c2-bdd3-4fbbc0856d7b admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:26.140943 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb676807-97d1-45ca-870f-d50018c77675 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:26.142020 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2596/5158] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:31:26 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:31:26.152080 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb676807-97d1-45ca-870f-d50018c77675 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:26.166268 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f138d-4d42-44bc-87e1-aadb1ab98b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:26.166978 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f138d-4d42-44bc-87e1-aadb1ab98b80 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:26.170097 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f138d-4d42-44bc-87e1-aadb1ab98b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:26.170097 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f138d-4d42-44bc-87e1-aadb1ab98b80 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:26.170097 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08f138d-4d42-44bc-87e1-aadb1ab98b80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:26.172709 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08f138d-4d42-44bc-87e1-aadb1ab98b80 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:26.190820 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e16e08a-46ad-43c2-bdd3-4fbbc0856d7b admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:26.197253 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2563/5159] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:31:26 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:31:26.203773 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e16e08a-46ad-43c2-bdd3-4fbbc0856d7b admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:26.211054 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1908cc-f271-4659-8afd-943770dc058d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:26.212012 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1908cc-f271-4659-8afd-943770dc058d admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:26.212299 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1908cc-f271-4659-8afd-943770dc058d admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:26.212580 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1908cc-f271-4659-8afd-943770dc058d admin admin] PATH_INFO: `/v3/projects/8923623b6ce14d9fbe524f52b841ee75/users/ff63cac5395c4f94aba84797b83d4dd7/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:26.230460 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1908cc-f271-4659-8afd-943770dc058d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8923623b6ce14d9fbe524f52b841ee75, user_id=ff63cac5395c4f94aba84797b83d4dd7, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:26.234287 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1908cc-f271-4659-8afd-943770dc058d admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:26.303942 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2597/5160] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:31:26 2022] PUT /identity/v3/projects/8923623b6ce14d9fbe524f52b841ee75/users/ff63cac5395c4f94aba84797b83d4dd7/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:31:26.390349 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd932b3-e75e-4943-adc8-a6be7459e263 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:26.390949 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd932b3-e75e-4943-adc8-a6be7459e263 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:26.391238 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd932b3-e75e-4943-adc8-a6be7459e263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:26.428942 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-9bd932b3-e75e-4943-adc8-a6be7459e263 None None] MFA Rules not processed for user `ff63cac5395c4f94aba84797b83d4dd7`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:31:26.430990 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-9bd932b3-e75e-4943-adc8-a6be7459e263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:26.498917 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2564/5161] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:31:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:31:26.503665 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1908cc-f271-4659-8afd-943770dc058d admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:26.566000 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1908cc-f271-4659-8afd-943770dc058d admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:26.570925 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086fe344-235c-48f7-b92b-341a034ccae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:26.571456 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086fe344-235c-48f7-b92b-341a034ccae3 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:26.571767 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086fe344-235c-48f7-b92b-341a034ccae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:26.572042 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086fe344-235c-48f7-b92b-341a034ccae3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:26.572723 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086fe344-235c-48f7-b92b-341a034ccae3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:26.574616 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086fe344-235c-48f7-b92b-341a034ccae3 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:26.652606 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2598/5162] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:31:26 2022] POST /identity/v3/projects => generated 377 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:31:26.657198 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd932b3-e75e-4943-adc8-a6be7459e263 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:26.672662 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd932b3-e75e-4943-adc8-a6be7459e263 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:26.744970 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bf35ab-9703-4a56-b547-c7c8a9d959d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:26.745679 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf35ab-9703-4a56-b547-c7c8a9d959d0 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:26.745966 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf35ab-9703-4a56-b547-c7c8a9d959d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:26.746242 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf35ab-9703-4a56-b547-c7c8a9d959d0 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:26.746945 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bf35ab-9703-4a56-b547-c7c8a9d959d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:26.749675 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bf35ab-9703-4a56-b547-c7c8a9d959d0 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:26.876077 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2565/5163] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:31:26 2022] POST /identity/v3/users => generated 289 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:31:26.876853 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086fe344-235c-48f7-b92b-341a034ccae3 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:26.895082 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086fe344-235c-48f7-b92b-341a034ccae3 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:26.899783 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cea66a0-da0a-4abc-bca6-c2fefdaa8e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:26.900459 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea66a0-da0a-4abc-bca6-c2fefdaa8e45 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:26.900744 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea66a0-da0a-4abc-bca6-c2fefdaa8e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:26.901022 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea66a0-da0a-4abc-bca6-c2fefdaa8e45 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:26.901884 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cea66a0-da0a-4abc-bca6-c2fefdaa8e45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:26.903386 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cea66a0-da0a-4abc-bca6-c2fefdaa8e45 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:26.920669 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2599/5164] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:31:26 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:31:26.920811 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bf35ab-9703-4a56-b547-c7c8a9d959d0 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:26.934260 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bf35ab-9703-4a56-b547-c7c8a9d959d0 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:26.940009 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11351e53-d71c-4d65-8eee-39f016605c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:26.940694 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11351e53-d71c-4d65-8eee-39f016605c1f admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:26.940978 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11351e53-d71c-4d65-8eee-39f016605c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:26.941255 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11351e53-d71c-4d65-8eee-39f016605c1f admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:26.941981 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11351e53-d71c-4d65-8eee-39f016605c1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:26.943704 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11351e53-d71c-4d65-8eee-39f016605c1f admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:26.954555 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2566/5165] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:31:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:31:26.959603 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cea66a0-da0a-4abc-bca6-c2fefdaa8e45 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:26.969583 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cea66a0-da0a-4abc-bca6-c2fefdaa8e45 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:26.974226 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9048ba1a-2889-42d5-b848-52b9c741168c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:26.975107 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9048ba1a-2889-42d5-b848-52b9c741168c admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:26.975388 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9048ba1a-2889-42d5-b848-52b9c741168c admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:26.975705 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9048ba1a-2889-42d5-b848-52b9c741168c admin admin] PATH_INFO: `/v3/projects/2bc4f85699f04b77888f33bebd9d0ab6/users/e16bc7890d92423091b5e2e8058a3859/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:26.991946 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9048ba1a-2889-42d5-b848-52b9c741168c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bc4f85699f04b77888f33bebd9d0ab6, user_id=e16bc7890d92423091b5e2e8058a3859, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:26.994768 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9048ba1a-2889-42d5-b848-52b9c741168c admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:27.123936 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2600/5166] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:31:26 2022] PUT /identity/v3/projects/2bc4f85699f04b77888f33bebd9d0ab6/users/e16bc7890d92423091b5e2e8058a3859/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:31:27.134076 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0bb535-15ef-4e0a-b186-e68b98a20e94 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:27.134395 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0bb535-15ef-4e0a-b186-e68b98a20e94 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:27.139150 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0bb535-15ef-4e0a-b186-e68b98a20e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:27.164704 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-9d0bb535-15ef-4e0a-b186-e68b98a20e94 None None] MFA Rules not processed for user `e16bc7890d92423091b5e2e8058a3859`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:31:27.165903 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-9d0bb535-15ef-4e0a-b186-e68b98a20e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:27.231054 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2567/5167] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:31:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:31:27.246675 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9048ba1a-2889-42d5-b848-52b9c741168c admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:27.249884 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-9048ba1a-2889-42d5-b848-52b9c741168c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:27.310824 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9048ba1a-2889-42d5-b848-52b9c741168c admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:27.314605 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed29f329-60e6-48b7-8d24-4fd077321890 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b5cb86f190f4fcfb06d66cb8f14643f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:27.315282 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29f329-60e6-48b7-8d24-4fd077321890 service glance] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:27.315592 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29f329-60e6-48b7-8d24-4fd077321890 service glance] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:27.315873 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29f329-60e6-48b7-8d24-4fd077321890 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:27.377730 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed29f329-60e6-48b7-8d24-4fd077321890 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:27.379240 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed29f329-60e6-48b7-8d24-4fd077321890 service glance] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:27.391415 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2601/5168] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:31:27 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:31:27.695961 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d00a4c-bd4b-47df-9567-ef71ab3f8c6d None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:27.696465 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d00a4c-bd4b-47df-9567-ef71ab3f8c6d None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:27.696576 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d00a4c-bd4b-47df-9567-ef71ab3f8c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:27.716380 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-e3d00a4c-bd4b-47df-9567-ef71ab3f8c6d None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:31:27.727971 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e3d00a4c-bd4b-47df-9567-ef71ab3f8c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:27.786839 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2568/5169] 10.222.0.52 () {58 vars in 1009 bytes} [Sat May 14 21:31:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:31:27.975690 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed29f329-60e6-48b7-8d24-4fd077321890 service glance] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:27.977778 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ed29f329-60e6-48b7-8d24-4fd077321890 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:28.054589 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed29f329-60e6-48b7-8d24-4fd077321890 service glance] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:28.060560 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a93d89-5dcf-4ffe-8b0d-4e09d74463bd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:28.060960 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a93d89-5dcf-4ffe-8b0d-4e09d74463bd service swift] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:28.061249 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a93d89-5dcf-4ffe-8b0d-4e09d74463bd service swift] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:28.065360 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a93d89-5dcf-4ffe-8b0d-4e09d74463bd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:28.070237 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a93d89-5dcf-4ffe-8b0d-4e09d74463bd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:28.071912 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a93d89-5dcf-4ffe-8b0d-4e09d74463bd service swift] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:28.084449 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2602/5170] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 21:31:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 21:31:28.663571 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d00a4c-bd4b-47df-9567-ef71ab3f8c6d None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:28.670861 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e3d00a4c-bd4b-47df-9567-ef71ab3f8c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:28.678627 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d00a4c-bd4b-47df-9567-ef71ab3f8c6d None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:28.682672 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327366e3-c900-470c-846b-d952d6188455 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b5cb86f190f4fcfb06d66cb8f14643f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:28.683597 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327366e3-c900-470c-846b-d952d6188455 service glance] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:28.684104 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327366e3-c900-470c-846b-d952d6188455 service glance] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:28.684453 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327366e3-c900-470c-846b-d952d6188455 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:28.703776 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327366e3-c900-470c-846b-d952d6188455 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:28.705308 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327366e3-c900-470c-846b-d952d6188455 service glance] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:28.716117 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2569/5171] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:31:28 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:31:28.803071 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcbe344-1226-4832-86b8-cecd85ffdf18 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:28.803551 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcbe344-1226-4832-86b8-cecd85ffdf18 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:28.803776 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcbe344-1226-4832-86b8-cecd85ffdf18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:28.823924 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-4fcbe344-1226-4832-86b8-cecd85ffdf18 None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:31:28.825209 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-4fcbe344-1226-4832-86b8-cecd85ffdf18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:28.833392 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2603/5172] 10.222.0.52 () {58 vars in 967 bytes} [Sat May 14 21:31:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:31:28.845749 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327366e3-c900-470c-846b-d952d6188455 service glance] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:28.859800 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327366e3-c900-470c-846b-d952d6188455 service glance] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:28.864905 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310ab17-6939-4ef1-afe8-bdc4e691c560 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:28.865623 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310ab17-6939-4ef1-afe8-bdc4e691c560 service swift] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:28.865912 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310ab17-6939-4ef1-afe8-bdc4e691c560 service swift] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:28.866193 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310ab17-6939-4ef1-afe8-bdc4e691c560 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:28.875743 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3310ab17-6939-4ef1-afe8-bdc4e691c560 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:28.877317 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3310ab17-6939-4ef1-afe8-bdc4e691c560 service swift] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:28.885364 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2570/5173] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 21:31:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 21:31:29.408514 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcbe344-1226-4832-86b8-cecd85ffdf18 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:29.473112 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcbe344-1226-4832-86b8-cecd85ffdf18 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:29.477763 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479041c1-9f61-455f-81f6-00b1c798586e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:29.478632 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479041c1-9f61-455f-81f6-00b1c798586e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:29.479035 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479041c1-9f61-455f-81f6-00b1c798586e admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:29.479455 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479041c1-9f61-455f-81f6-00b1c798586e admin admin] PATH_INFO: `/v3/users/ff63cac5395c4f94aba84797b83d4dd7` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:29.480708 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479041c1-9f61-455f-81f6-00b1c798586e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff63cac5395c4f94aba84797b83d4dd7)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:29.483804 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479041c1-9f61-455f-81f6-00b1c798586e admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:29.688503 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-479041c1-9f61-455f-81f6-00b1c798586e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff63cac5395c4f94aba84797b83d4dd7'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:29.701256 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-479041c1-9f61-455f-81f6-00b1c798586e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff63cac5395c4f94aba84797b83d4dd7'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:29.709514 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-479041c1-9f61-455f-81f6-00b1c798586e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff63cac5395c4f94aba84797b83d4dd7'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:29.816451 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-479041c1-9f61-455f-81f6-00b1c798586e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff63cac5395c4f94aba84797b83d4dd7'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:29.817216 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-479041c1-9f61-455f-81f6-00b1c798586e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff63cac5395c4f94aba84797b83d4dd7'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:29.824147 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2604/5174] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:31:29 2022] DELETE /identity/v3/users/ff63cac5395c4f94aba84797b83d4dd7 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:31:29.829519 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df9db8-6073-4943-9950-5360ffbe6468 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:29.830018 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df9db8-6073-4943-9950-5360ffbe6468 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:29.830107 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df9db8-6073-4943-9950-5360ffbe6468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:29.850086 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-51df9db8-6073-4943-9950-5360ffbe6468 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:31:29.851320 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-51df9db8-6073-4943-9950-5360ffbe6468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:29.934878 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2571/5175] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:31:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:31:29.948226 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479041c1-9f61-455f-81f6-00b1c798586e admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:29.949851 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-479041c1-9f61-455f-81f6-00b1c798586e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:30.012216 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479041c1-9f61-455f-81f6-00b1c798586e admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:30.017189 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd99142-8a82-4e6f-8aa4-21579e4eb515 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:30.017841 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd99142-8a82-4e6f-8aa4-21579e4eb515 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:30.018500 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd99142-8a82-4e6f-8aa4-21579e4eb515 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:30.018500 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd99142-8a82-4e6f-8aa4-21579e4eb515 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:30.028198 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd99142-8a82-4e6f-8aa4-21579e4eb515 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:30.030912 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd99142-8a82-4e6f-8aa4-21579e4eb515 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:30.040769 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2605/5176] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:31:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:31:30.647802 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51df9db8-6073-4943-9950-5360ffbe6468 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:30.650021 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-51df9db8-6073-4943-9950-5360ffbe6468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:30.663986 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51df9db8-6073-4943-9950-5360ffbe6468 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:30.668689 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7448541-8543-45fe-9ff9-3ec46cd2d429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:30.670324 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7448541-8543-45fe-9ff9-3ec46cd2d429 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:30.670610 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7448541-8543-45fe-9ff9-3ec46cd2d429 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:30.670886 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7448541-8543-45fe-9ff9-3ec46cd2d429 admin admin] PATH_INFO: `/v3/projects/8923623b6ce14d9fbe524f52b841ee75` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:30.672225 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7448541-8543-45fe-9ff9-3ec46cd2d429 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8923623b6ce14d9fbe524f52b841ee75)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:30.674285 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7448541-8543-45fe-9ff9-3ec46cd2d429 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:30.835368 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e7448541-8543-45fe-9ff9-3ec46cd2d429 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8923623b6ce14d9fbe524f52b841ee75', 'request_id': 'req-e7448541-8543-45fe-9ff9-3ec46cd2d429'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:30.843634 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e7448541-8543-45fe-9ff9-3ec46cd2d429 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8923623b6ce14d9fbe524f52b841ee75', 'request_id': 'req-e7448541-8543-45fe-9ff9-3ec46cd2d429'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:30.854236 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e7448541-8543-45fe-9ff9-3ec46cd2d429 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8923623b6ce14d9fbe524f52b841ee75', 'request_id': 'req-e7448541-8543-45fe-9ff9-3ec46cd2d429'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:30.953405 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e7448541-8543-45fe-9ff9-3ec46cd2d429 admin admin] The token cache is being invalidate because project 8923623b6ce14d9fbe524f52b841ee75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:31:30.953694 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e7448541-8543-45fe-9ff9-3ec46cd2d429 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:30.954328 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e7448541-8543-45fe-9ff9-3ec46cd2d429 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:30.956161 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2572/5177] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:31:30 2022] DELETE /identity/v3/projects/8923623b6ce14d9fbe524f52b841ee75 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:31:30.960143 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd99142-8a82-4e6f-8aa4-21579e4eb515 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:30.981498 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd99142-8a82-4e6f-8aa4-21579e4eb515 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:31.049230 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beab9f23-23b7-4cc7-b679-ff2e261c59ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:31.050103 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab9f23-23b7-4cc7-b679-ff2e261c59ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:31.050384 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab9f23-23b7-4cc7-b679-ff2e261c59ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:31.050658 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab9f23-23b7-4cc7-b679-ff2e261c59ac admin admin] PATH_INFO: `/v3/users/e16bc7890d92423091b5e2e8058a3859` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:31.051972 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beab9f23-23b7-4cc7-b679-ff2e261c59ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=e16bc7890d92423091b5e2e8058a3859)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:31.053902 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beab9f23-23b7-4cc7-b679-ff2e261c59ac admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:31.262576 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-beab9f23-23b7-4cc7-b679-ff2e261c59ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e16bc7890d92423091b5e2e8058a3859'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:31.276627 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-beab9f23-23b7-4cc7-b679-ff2e261c59ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e16bc7890d92423091b5e2e8058a3859'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:31.285241 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-beab9f23-23b7-4cc7-b679-ff2e261c59ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e16bc7890d92423091b5e2e8058a3859'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:31.347618 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-beab9f23-23b7-4cc7-b679-ff2e261c59ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e16bc7890d92423091b5e2e8058a3859'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:31.348239 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-beab9f23-23b7-4cc7-b679-ff2e261c59ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e16bc7890d92423091b5e2e8058a3859'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:31.354670 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2606/5178] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:31:30 2022] DELETE /identity/v3/users/e16bc7890d92423091b5e2e8058a3859 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:31:31.949187 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7448541-8543-45fe-9ff9-3ec46cd2d429 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:31.951497 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e7448541-8543-45fe-9ff9-3ec46cd2d429 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:31.973292 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7448541-8543-45fe-9ff9-3ec46cd2d429 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:32.038946 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a63b0c-bbfb-4faa-977c-393e9cb5d47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:32.039966 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a63b0c-bbfb-4faa-977c-393e9cb5d47a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:32.040395 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a63b0c-bbfb-4faa-977c-393e9cb5d47a admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:32.040799 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a63b0c-bbfb-4faa-977c-393e9cb5d47a admin admin] PATH_INFO: `/v3/projects/2bc4f85699f04b77888f33bebd9d0ab6` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:32.042143 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a63b0c-bbfb-4faa-977c-393e9cb5d47a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bc4f85699f04b77888f33bebd9d0ab6)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:32.046356 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a63b0c-bbfb-4faa-977c-393e9cb5d47a admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:32.166684 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b5a63b0c-bbfb-4faa-977c-393e9cb5d47a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bc4f85699f04b77888f33bebd9d0ab6', 'request_id': 'req-b5a63b0c-bbfb-4faa-977c-393e9cb5d47a'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:32.174055 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b5a63b0c-bbfb-4faa-977c-393e9cb5d47a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bc4f85699f04b77888f33bebd9d0ab6', 'request_id': 'req-b5a63b0c-bbfb-4faa-977c-393e9cb5d47a'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:32.180884 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b5a63b0c-bbfb-4faa-977c-393e9cb5d47a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bc4f85699f04b77888f33bebd9d0ab6', 'request_id': 'req-b5a63b0c-bbfb-4faa-977c-393e9cb5d47a'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:32.272097 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b5a63b0c-bbfb-4faa-977c-393e9cb5d47a admin admin] The token cache is being invalidate because project 2bc4f85699f04b77888f33bebd9d0ab6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:31:32.272618 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b5a63b0c-bbfb-4faa-977c-393e9cb5d47a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:32.273344 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b5a63b0c-bbfb-4faa-977c-393e9cb5d47a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:32.275040 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2573/5179] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:31:31 2022] DELETE /identity/v3/projects/2bc4f85699f04b77888f33bebd9d0ab6 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:31:32.282093 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26754519-633a-489c-8652-2ffcb8785526 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:32.282679 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26754519-633a-489c-8652-2ffcb8785526 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:32.282679 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26754519-633a-489c-8652-2ffcb8785526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:32.300663 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-26754519-633a-489c-8652-2ffcb8785526 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:31:32.301843 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-26754519-633a-489c-8652-2ffcb8785526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:32.365194 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2607/5180] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:31:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:31:32.374201 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b01ba-92c8-486d-a1af-7f7318000155 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:32.374494 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b01ba-92c8-486d-a1af-7f7318000155 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:32.374945 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b01ba-92c8-486d-a1af-7f7318000155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:32.394292 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-a06b01ba-92c8-486d-a1af-7f7318000155 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:31:32.395544 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-a06b01ba-92c8-486d-a1af-7f7318000155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:32.404388 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2574/5181] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:31:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:31:32.408602 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26754519-633a-489c-8652-2ffcb8785526 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:32.418944 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26754519-633a-489c-8652-2ffcb8785526 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:32.424448 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ac1813-8846-4bc1-b9aa-266eb40ac4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:32.425977 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac1813-8846-4bc1-b9aa-266eb40ac4f7 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:32.425977 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac1813-8846-4bc1-b9aa-266eb40ac4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:32.425977 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac1813-8846-4bc1-b9aa-266eb40ac4f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:32.427612 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ac1813-8846-4bc1-b9aa-266eb40ac4f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:31:32.427612 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ac1813-8846-4bc1-b9aa-266eb40ac4f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:32.429311 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ac1813-8846-4bc1-b9aa-266eb40ac4f7 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:32.447593 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2608/5182] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:31:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:31:32.450291 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06b01ba-92c8-486d-a1af-7f7318000155 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:32.458771 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06b01ba-92c8-486d-a1af-7f7318000155 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:32.468706 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fea0c29-c932-4d0b-a799-ae709cf168bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:32.469379 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fea0c29-c932-4d0b-a799-ae709cf168bf admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:32.469657 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fea0c29-c932-4d0b-a799-ae709cf168bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:32.469934 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fea0c29-c932-4d0b-a799-ae709cf168bf admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:32.470615 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fea0c29-c932-4d0b-a799-ae709cf168bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:32.472716 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fea0c29-c932-4d0b-a799-ae709cf168bf admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:32.579112 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2575/5183] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:31:32 2022] POST /identity/v3/projects => generated 371 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:31:32.583699 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ac1813-8846-4bc1-b9aa-266eb40ac4f7 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:32.597052 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ac1813-8846-4bc1-b9aa-266eb40ac4f7 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:32.677724 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa58328d-3f15-4a13-ac7e-c7bc2609fbc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:32.679399 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa58328d-3f15-4a13-ac7e-c7bc2609fbc3 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:32.679715 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa58328d-3f15-4a13-ac7e-c7bc2609fbc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:32.679991 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa58328d-3f15-4a13-ac7e-c7bc2609fbc3 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:32.680689 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa58328d-3f15-4a13-ac7e-c7bc2609fbc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:32.682649 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa58328d-3f15-4a13-ac7e-c7bc2609fbc3 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:32.819105 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2609/5184] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:31:32 2022] POST /identity/v3/users => generated 286 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:31:32.824351 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fea0c29-c932-4d0b-a799-ae709cf168bf admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:32.837058 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fea0c29-c932-4d0b-a799-ae709cf168bf admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:32.843850 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e9335c-b1ea-4c61-b931-374f63246c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:32.844010 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e9335c-b1ea-4c61-b931-374f63246c58 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:32.844363 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e9335c-b1ea-4c61-b931-374f63246c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:32.844672 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e9335c-b1ea-4c61-b931-374f63246c58 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:32.845399 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e9335c-b1ea-4c61-b931-374f63246c58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:32.847012 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e9335c-b1ea-4c61-b931-374f63246c58 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:32.873058 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2576/5185] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:31:32 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:31:32.878172 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa58328d-3f15-4a13-ac7e-c7bc2609fbc3 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:32.893562 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa58328d-3f15-4a13-ac7e-c7bc2609fbc3 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:32.900534 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984d0152-d3fb-4fb2-8f7b-97b8769d9651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:32.901626 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d0152-d3fb-4fb2-8f7b-97b8769d9651 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:32.902107 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d0152-d3fb-4fb2-8f7b-97b8769d9651 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:32.902572 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d0152-d3fb-4fb2-8f7b-97b8769d9651 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:32.904482 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984d0152-d3fb-4fb2-8f7b-97b8769d9651 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:32.907604 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984d0152-d3fb-4fb2-8f7b-97b8769d9651 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:32.927062 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2610/5186] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:31:32 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:31:32.932614 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e9335c-b1ea-4c61-b931-374f63246c58 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:32.949485 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e9335c-b1ea-4c61-b931-374f63246c58 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:32.958490 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839dd02f-304b-449c-9d53-69e082c0f131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:32.959666 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839dd02f-304b-449c-9d53-69e082c0f131 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:32.962615 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839dd02f-304b-449c-9d53-69e082c0f131 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:32.962615 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839dd02f-304b-449c-9d53-69e082c0f131 admin admin] PATH_INFO: `/v3/projects/7b8dacf58289444eb351814a7708b42d/users/5cf98665048c492faabc9f64c27cab40/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:32.995647 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839dd02f-304b-449c-9d53-69e082c0f131 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b8dacf58289444eb351814a7708b42d, user_id=5cf98665048c492faabc9f64c27cab40, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:32.995943 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839dd02f-304b-449c-9d53-69e082c0f131 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:33.109097 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2577/5187] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:31:32 2022] PUT /identity/v3/projects/7b8dacf58289444eb351814a7708b42d/users/5cf98665048c492faabc9f64c27cab40/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:31:33.116462 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a88d0-93ef-474d-a3ac-a79fad3314d5 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:33.116829 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a88d0-93ef-474d-a3ac-a79fad3314d5 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:33.117143 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a88d0-93ef-474d-a3ac-a79fad3314d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:33.154957 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-bb6a88d0-93ef-474d-a3ac-a79fad3314d5 None None] MFA Rules not processed for user `5cf98665048c492faabc9f64c27cab40`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:31:33.156925 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-bb6a88d0-93ef-474d-a3ac-a79fad3314d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:33.247756 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2611/5188] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:31:33 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:31:33.280889 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839dd02f-304b-449c-9d53-69e082c0f131 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:33.285144 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-839dd02f-304b-449c-9d53-69e082c0f131 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:33.358909 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839dd02f-304b-449c-9d53-69e082c0f131 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:33.362666 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ab6c64-2181-4415-a9a1-1218b0fe0a86 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b5cb86f190f4fcfb06d66cb8f14643f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:33.363320 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab6c64-2181-4415-a9a1-1218b0fe0a86 service glance] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:33.363772 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab6c64-2181-4415-a9a1-1218b0fe0a86 service glance] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:33.364055 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab6c64-2181-4415-a9a1-1218b0fe0a86 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:33.374302 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ab6c64-2181-4415-a9a1-1218b0fe0a86 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:33.375985 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ab6c64-2181-4415-a9a1-1218b0fe0a86 service glance] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:33.386317 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2578/5189] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:31:33 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:31:33.837196 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6e7ec-a4b4-4162-97d2-6a7bde900358 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:33.837657 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6e7ec-a4b4-4162-97d2-6a7bde900358 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:33.837770 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6e7ec-a4b4-4162-97d2-6a7bde900358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:33.857834 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-74e6e7ec-a4b4-4162-97d2-6a7bde900358 None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:31:33.859043 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-74e6e7ec-a4b4-4162-97d2-6a7bde900358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:33.916782 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2612/5190] 10.222.0.52 () {58 vars in 1009 bytes} [Sat May 14 21:31:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:31:33.928767 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ab6c64-2181-4415-a9a1-1218b0fe0a86 service glance] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:33.930253 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-26ab6c64-2181-4415-a9a1-1218b0fe0a86 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:34.004952 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ab6c64-2181-4415-a9a1-1218b0fe0a86 service glance] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:34.013515 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7903cda3-7399-433d-ba96-615eee0767b6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:34.014379 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7903cda3-7399-433d-ba96-615eee0767b6 service swift] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:34.016611 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7903cda3-7399-433d-ba96-615eee0767b6 service swift] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:34.016611 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7903cda3-7399-433d-ba96-615eee0767b6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:34.024445 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7903cda3-7399-433d-ba96-615eee0767b6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:34.026023 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7903cda3-7399-433d-ba96-615eee0767b6 service swift] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:34.027539 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e6e7ec-a4b4-4162-97d2-6a7bde900358 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:34.030926 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-74e6e7ec-a4b4-4162-97d2-6a7bde900358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:34.038739 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2579/5191] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 21:31:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 14 21:31:34.114644 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e6e7ec-a4b4-4162-97d2-6a7bde900358 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:34.122029 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2955d0c-3987-453b-968c-7c0008fef58d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:34.123220 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2955d0c-3987-453b-968c-7c0008fef58d service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:34.123610 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2955d0c-3987-453b-968c-7c0008fef58d service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:34.124131 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2955d0c-3987-453b-968c-7c0008fef58d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:34.126312 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e2955d0c-3987-453b-968c-7c0008fef58d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:34.261828 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2955d0c-3987-453b-968c-7c0008fef58d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:34.263991 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2955d0c-3987-453b-968c-7c0008fef58d service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:34.279510 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2613/5192] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:31:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:31:34.988910 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31694db-f0e1-4960-be51-fdb9fa7bc839 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:34.989790 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31694db-f0e1-4960-be51-fdb9fa7bc839 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:34.989926 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31694db-f0e1-4960-be51-fdb9fa7bc839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:35.001073 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2955d0c-3987-453b-968c-7c0008fef58d service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:35.002930 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e2955d0c-3987-453b-968c-7c0008fef58d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:35.027861 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-e31694db-f0e1-4960-be51-fdb9fa7bc839 None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:31:35.028899 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e31694db-f0e1-4960-be51-fdb9fa7bc839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:35.057055 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2955d0c-3987-453b-968c-7c0008fef58d service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:35.057540 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2580/5193] 10.222.0.52 () {58 vars in 1009 bytes} [Sat May 14 21:31:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:31:35.062775 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1837505d-560a-446b-8f27-057c79b0634d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:35.063828 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1837505d-560a-446b-8f27-057c79b0634d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:35.064190 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1837505d-560a-446b-8f27-057c79b0634d admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:35.064541 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1837505d-560a-446b-8f27-057c79b0634d admin admin] PATH_INFO: `/v3/users/dab6695daa0047d3b6acc7fa368f4eec` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:35.065875 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1837505d-560a-446b-8f27-057c79b0634d admin admin] RBAC: Authorizing `identity:delete_user(user_id=dab6695daa0047d3b6acc7fa368f4eec)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:35.068093 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1837505d-560a-446b-8f27-057c79b0634d admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:35.075770 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31694db-f0e1-4960-be51-fdb9fa7bc839 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:35.096675 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31694db-f0e1-4960-be51-fdb9fa7bc839 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:35.103146 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ddf4b9-8d8f-4290-bd6f-444261e7e151 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:35.103634 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ddf4b9-8d8f-4290-bd6f-444261e7e151 service swift] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:35.103925 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ddf4b9-8d8f-4290-bd6f-444261e7e151 service swift] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:35.104214 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ddf4b9-8d8f-4290-bd6f-444261e7e151 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:35.113780 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ddf4b9-8d8f-4290-bd6f-444261e7e151 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:35.115261 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ddf4b9-8d8f-4290-bd6f-444261e7e151 service swift] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:35.124554 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2581/5194] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 21:31:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 21:31:35.269317 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-1837505d-560a-446b-8f27-057c79b0634d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dab6695daa0047d3b6acc7fa368f4eec'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:35.288029 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-1837505d-560a-446b-8f27-057c79b0634d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dab6695daa0047d3b6acc7fa368f4eec'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:35.295169 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-1837505d-560a-446b-8f27-057c79b0634d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dab6695daa0047d3b6acc7fa368f4eec'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:35.358857 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-1837505d-560a-446b-8f27-057c79b0634d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dab6695daa0047d3b6acc7fa368f4eec'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:35.360150 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-1837505d-560a-446b-8f27-057c79b0634d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dab6695daa0047d3b6acc7fa368f4eec'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:35.367386 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2614/5195] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:31:34 2022] DELETE /identity/v3/users/dab6695daa0047d3b6acc7fa368f4eec => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:31:35.372196 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d87af-4ddf-4594-9e1d-f60f1ca9088d None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:35.373125 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d87af-4ddf-4594-9e1d-f60f1ca9088d None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:35.373667 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d87af-4ddf-4594-9e1d-f60f1ca9088d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:35.421026 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-5a5d87af-4ddf-4594-9e1d-f60f1ca9088d None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:31:35.422341 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-5a5d87af-4ddf-4594-9e1d-f60f1ca9088d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:35.486434 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2582/5196] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:31:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:31:35.496185 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1837505d-560a-446b-8f27-057c79b0634d admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:35.497817 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-1837505d-560a-446b-8f27-057c79b0634d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:35.568736 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1837505d-560a-446b-8f27-057c79b0634d admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:35.575290 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02a4fc7-bd43-4622-bf7f-9a91c86d7736 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:35.575290 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a4fc7-bd43-4622-bf7f-9a91c86d7736 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:35.575290 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a4fc7-bd43-4622-bf7f-9a91c86d7736 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:35.575290 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a4fc7-bd43-4622-bf7f-9a91c86d7736 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:35.600596 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02a4fc7-bd43-4622-bf7f-9a91c86d7736 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:35.602243 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02a4fc7-bd43-4622-bf7f-9a91c86d7736 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:35.619046 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2615/5197] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:31:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:31:35.939199 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5d87af-4ddf-4594-9e1d-f60f1ca9088d None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:35.941174 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-5a5d87af-4ddf-4594-9e1d-f60f1ca9088d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:35.976147 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5d87af-4ddf-4594-9e1d-f60f1ca9088d None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:35.982564 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4af56c-7b7f-47c6-94a6-bacdf09f32a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:35.983753 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4af56c-7b7f-47c6-94a6-bacdf09f32a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:35.984005 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4af56c-7b7f-47c6-94a6-bacdf09f32a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:35.984467 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4af56c-7b7f-47c6-94a6-bacdf09f32a3 admin admin] PATH_INFO: `/v3/projects/ef27c8367a764fe683997e99d6fbab91` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:35.985899 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4af56c-7b7f-47c6-94a6-bacdf09f32a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef27c8367a764fe683997e99d6fbab91)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:35.987851 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4af56c-7b7f-47c6-94a6-bacdf09f32a3 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:36.134746 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-aa4af56c-7b7f-47c6-94a6-bacdf09f32a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef27c8367a764fe683997e99d6fbab91', 'request_id': 'req-aa4af56c-7b7f-47c6-94a6-bacdf09f32a3'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:36.142765 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-aa4af56c-7b7f-47c6-94a6-bacdf09f32a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef27c8367a764fe683997e99d6fbab91', 'request_id': 'req-aa4af56c-7b7f-47c6-94a6-bacdf09f32a3'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:36.149571 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-aa4af56c-7b7f-47c6-94a6-bacdf09f32a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef27c8367a764fe683997e99d6fbab91', 'request_id': 'req-aa4af56c-7b7f-47c6-94a6-bacdf09f32a3'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:36.179748 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e743ee65-d420-4852-bca4-4631ea312335 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:36.180207 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e743ee65-d420-4852-bca4-4631ea312335 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:36.180319 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e743ee65-d420-4852-bca4-4631ea312335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:36.209764 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-e743ee65-d420-4852-bca4-4631ea312335 None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:31:36.209764 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e743ee65-d420-4852-bca4-4631ea312335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:36.263393 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-aa4af56c-7b7f-47c6-94a6-bacdf09f32a3 admin admin] The token cache is being invalidate because project ef27c8367a764fe683997e99d6fbab91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:31:36.264253 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-aa4af56c-7b7f-47c6-94a6-bacdf09f32a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:36.265293 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-aa4af56c-7b7f-47c6-94a6-bacdf09f32a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:36.271109 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2583/5198] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:31:35 2022] DELETE /identity/v3/projects/ef27c8367a764fe683997e99d6fbab91 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:31:36.273049 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf407b-2a88-426f-bcce-50d249d82c4d None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:36.273344 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf407b-2a88-426f-bcce-50d249d82c4d None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:36.273625 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf407b-2a88-426f-bcce-50d249d82c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:36.283538 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2616/5199] 10.222.0.52 () {58 vars in 1009 bytes} [Sat May 14 21:31:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:31:36.298145 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-14cf407b-2a88-426f-bcce-50d249d82c4d None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:31:36.298300 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e743ee65-d420-4852-bca4-4631ea312335 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:36.299385 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-14cf407b-2a88-426f-bcce-50d249d82c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:36.300012 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e743ee65-d420-4852-bca4-4631ea312335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:36.402974 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2584/5200] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:31:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:31:36.409606 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89476b63-6f73-4f14-be38-358881d92eb2 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:36.410290 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89476b63-6f73-4f14-be38-358881d92eb2 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:36.411155 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89476b63-6f73-4f14-be38-358881d92eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:36.439004 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e743ee65-d420-4852-bca4-4631ea312335 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:36.440342 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-89476b63-6f73-4f14-be38-358881d92eb2 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:31:36.441862 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-89476b63-6f73-4f14-be38-358881d92eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:36.448173 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8034c343-cdf7-4f42-908d-99e31d640efd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:36.449335 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034c343-cdf7-4f42-908d-99e31d640efd service swift] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:36.449773 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034c343-cdf7-4f42-908d-99e31d640efd service swift] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:36.451131 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034c343-cdf7-4f42-908d-99e31d640efd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:36.455852 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2585/5201] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:31:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:31:36.466863 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8034c343-cdf7-4f42-908d-99e31d640efd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:36.468950 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8034c343-cdf7-4f42-908d-99e31d640efd service swift] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:36.472410 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89476b63-6f73-4f14-be38-358881d92eb2 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:36.483069 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2617/5202] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 21:31:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 14 21:31:36.505239 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89476b63-6f73-4f14-be38-358881d92eb2 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:36.515407 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b746ac45-32a0-4f91-990b-4aa3d77ff547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:36.518276 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746ac45-32a0-4f91-990b-4aa3d77ff547 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:36.518685 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746ac45-32a0-4f91-990b-4aa3d77ff547 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:36.519718 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746ac45-32a0-4f91-990b-4aa3d77ff547 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:36.523074 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b746ac45-32a0-4f91-990b-4aa3d77ff547 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:31:36.523506 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b746ac45-32a0-4f91-990b-4aa3d77ff547 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:36.525329 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b746ac45-32a0-4f91-990b-4aa3d77ff547 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:36.547535 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2586/5203] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:31:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:31:36.549367 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8034c343-cdf7-4f42-908d-99e31d640efd service swift] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:36.561479 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8034c343-cdf7-4f42-908d-99e31d640efd service swift] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:36.566447 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4c4cf3-0a58-4562-9c0e-cc50a69f11fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:36.567300 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c4cf3-0a58-4562-9c0e-cc50a69f11fb admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:36.567692 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c4cf3-0a58-4562-9c0e-cc50a69f11fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:36.568045 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c4cf3-0a58-4562-9c0e-cc50a69f11fb admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:36.568842 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4c4cf3-0a58-4562-9c0e-cc50a69f11fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:36.570782 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4c4cf3-0a58-4562-9c0e-cc50a69f11fb admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:36.722985 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2618/5204] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:31:36 2022] POST /identity/v3/projects => generated 373 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:31:36.726950 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b746ac45-32a0-4f91-990b-4aa3d77ff547 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:36.740922 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b746ac45-32a0-4f91-990b-4aa3d77ff547 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:36.838481 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a01232-8d89-45fc-a6ca-81b5c2432794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:36.839606 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a01232-8d89-45fc-a6ca-81b5c2432794 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:36.840220 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a01232-8d89-45fc-a6ca-81b5c2432794 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:36.848142 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a01232-8d89-45fc-a6ca-81b5c2432794 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:36.848142 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a01232-8d89-45fc-a6ca-81b5c2432794 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:36.848142 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a01232-8d89-45fc-a6ca-81b5c2432794 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:36.992792 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2587/5205] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:31:36 2022] POST /identity/v3/users => generated 287 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:31:36.996621 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4c4cf3-0a58-4562-9c0e-cc50a69f11fb admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:37.007377 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4c4cf3-0a58-4562-9c0e-cc50a69f11fb admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:37.012697 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c85f5c1-ac08-4f9a-b749-ecbf0a95276f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:37.013471 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85f5c1-ac08-4f9a-b749-ecbf0a95276f admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:37.014000 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85f5c1-ac08-4f9a-b749-ecbf0a95276f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:37.014377 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85f5c1-ac08-4f9a-b749-ecbf0a95276f admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:37.015205 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c85f5c1-ac08-4f9a-b749-ecbf0a95276f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:37.017207 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c85f5c1-ac08-4f9a-b749-ecbf0a95276f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:37.031304 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2619/5206] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:31:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:31:37.035387 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a01232-8d89-45fc-a6ca-81b5c2432794 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:37.047448 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a01232-8d89-45fc-a6ca-81b5c2432794 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:37.057901 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245ceed6-58f1-4031-9bbf-74227ee8603e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:37.058830 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ceed6-58f1-4031-9bbf-74227ee8603e admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:37.059334 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ceed6-58f1-4031-9bbf-74227ee8603e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:37.059943 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ceed6-58f1-4031-9bbf-74227ee8603e admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:37.065280 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245ceed6-58f1-4031-9bbf-74227ee8603e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:37.065280 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245ceed6-58f1-4031-9bbf-74227ee8603e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:37.080642 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2588/5207] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:31:37 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:31:37.084850 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c85f5c1-ac08-4f9a-b749-ecbf0a95276f admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:37.097292 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c85f5c1-ac08-4f9a-b749-ecbf0a95276f admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:37.103284 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88327f68-efa6-48df-bba3-9561e3a13c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:37.104251 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88327f68-efa6-48df-bba3-9561e3a13c71 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:37.104534 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88327f68-efa6-48df-bba3-9561e3a13c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:37.104808 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88327f68-efa6-48df-bba3-9561e3a13c71 admin admin] PATH_INFO: `/v3/projects/cbfc67c5870e4d3a898d2ad91d63364a/users/6d24edac2e0f4948b6ede060e2bb2df9/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:37.127599 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88327f68-efa6-48df-bba3-9561e3a13c71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbfc67c5870e4d3a898d2ad91d63364a, user_id=6d24edac2e0f4948b6ede060e2bb2df9, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:37.130343 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88327f68-efa6-48df-bba3-9561e3a13c71 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:37.241899 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2620/5208] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:31:37 2022] PUT /identity/v3/projects/cbfc67c5870e4d3a898d2ad91d63364a/users/6d24edac2e0f4948b6ede060e2bb2df9/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:31:37.252504 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171744d3-b8c2-40db-a869-d07d9aad765d None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:37.252975 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171744d3-b8c2-40db-a869-d07d9aad765d None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:37.253051 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171744d3-b8c2-40db-a869-d07d9aad765d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:37.287059 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-171744d3-b8c2-40db-a869-d07d9aad765d None None] MFA Rules not processed for user `6d24edac2e0f4948b6ede060e2bb2df9`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:31:37.288335 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-171744d3-b8c2-40db-a869-d07d9aad765d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:37.354850 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2589/5209] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:31:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:31:37.371735 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88327f68-efa6-48df-bba3-9561e3a13c71 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:37.377087 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-88327f68-efa6-48df-bba3-9561e3a13c71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:37.505488 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88327f68-efa6-48df-bba3-9561e3a13c71 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:37.509440 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b5943e-3046-4a2d-96d8-8ae093400184 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:37.510186 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5943e-3046-4a2d-96d8-8ae093400184 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:37.510468 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5943e-3046-4a2d-96d8-8ae093400184 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:37.510743 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5943e-3046-4a2d-96d8-8ae093400184 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:37.522368 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b5943e-3046-4a2d-96d8-8ae093400184 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:37.524003 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b5943e-3046-4a2d-96d8-8ae093400184 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:37.540087 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2621/5210] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:31:37 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:31:37.595405 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdd89d0-0a15-41a2-89f0-14b7a736f52b None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:37.595718 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdd89d0-0a15-41a2-89f0-14b7a736f52b None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:37.596167 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdd89d0-0a15-41a2-89f0-14b7a736f52b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:37.617650 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-1bdd89d0-0a15-41a2-89f0-14b7a736f52b None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:31:37.619347 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-1bdd89d0-0a15-41a2-89f0-14b7a736f52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:37.708249 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2590/5211] 10.222.0.52 () {58 vars in 1009 bytes} [Sat May 14 21:31:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:31:37.723794 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b5943e-3046-4a2d-96d8-8ae093400184 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:37.822963 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b5943e-3046-4a2d-96d8-8ae093400184 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:37.829323 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83c53a6-5379-4209-b309-ecc9eb409521 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:37.833486 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c53a6-5379-4209-b309-ecc9eb409521 service swift] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:37.833752 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c53a6-5379-4209-b309-ecc9eb409521 service swift] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:37.834030 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c53a6-5379-4209-b309-ecc9eb409521 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:37.858829 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83c53a6-5379-4209-b309-ecc9eb409521 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:37.860599 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83c53a6-5379-4209-b309-ecc9eb409521 service swift] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:37.878123 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2622/5212] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 21:31:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 21:31:38.144072 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdd89d0-0a15-41a2-89f0-14b7a736f52b None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:38.146399 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-1bdd89d0-0a15-41a2-89f0-14b7a736f52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:38.177513 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdd89d0-0a15-41a2-89f0-14b7a736f52b None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:38.186975 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce21fb-5e08-4853-8518-0832219cd8c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:38.188094 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce21fb-5e08-4853-8518-0832219cd8c3 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:38.188895 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce21fb-5e08-4853-8518-0832219cd8c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:38.188895 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce21fb-5e08-4853-8518-0832219cd8c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:38.202361 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c3ce21fb-5e08-4853-8518-0832219cd8c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:38.380217 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ce21fb-5e08-4853-8518-0832219cd8c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:38.381759 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ce21fb-5e08-4853-8518-0832219cd8c3 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:38.417399 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2591/5213] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:31:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:31:38.434364 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24daf4ac-ebab-4987-a19e-30b9530b5d0f None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:38.435955 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24daf4ac-ebab-4987-a19e-30b9530b5d0f None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:38.435955 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24daf4ac-ebab-4987-a19e-30b9530b5d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:38.466232 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-24daf4ac-ebab-4987-a19e-30b9530b5d0f None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:31:38.467721 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-24daf4ac-ebab-4987-a19e-30b9530b5d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:38.490828 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2623/5214] 10.222.0.52 () {58 vars in 1009 bytes} [Sat May 14 21:31:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:31:38.509002 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24daf4ac-ebab-4987-a19e-30b9530b5d0f None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:38.509469 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce21fb-5e08-4853-8518-0832219cd8c3 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:38.531643 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce21fb-5e08-4853-8518-0832219cd8c3 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:38.544940 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bfa58d-cb31-441e-a640-36601ef5bdf9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:38.546353 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bfa58d-cb31-441e-a640-36601ef5bdf9 service swift] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:38.546794 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bfa58d-cb31-441e-a640-36601ef5bdf9 service swift] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:38.547267 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bfa58d-cb31-441e-a640-36601ef5bdf9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:38.564828 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bfa58d-cb31-441e-a640-36601ef5bdf9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:38.567462 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bfa58d-cb31-441e-a640-36601ef5bdf9 service swift] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:38.581610 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2592/5215] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 21:31:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 21:31:38.629838 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24daf4ac-ebab-4987-a19e-30b9530b5d0f None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:38.636209 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2740599f-dee0-45fa-a1c9-e56446595d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:38.637258 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740599f-dee0-45fa-a1c9-e56446595d84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:38.637630 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740599f-dee0-45fa-a1c9-e56446595d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:38.638862 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740599f-dee0-45fa-a1c9-e56446595d84 admin admin] PATH_INFO: `/v3/users/6d24edac2e0f4948b6ede060e2bb2df9` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:38.640651 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2740599f-dee0-45fa-a1c9-e56446595d84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d24edac2e0f4948b6ede060e2bb2df9)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:38.642882 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2740599f-dee0-45fa-a1c9-e56446595d84 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:38.956876 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2740599f-dee0-45fa-a1c9-e56446595d84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d24edac2e0f4948b6ede060e2bb2df9'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:38.997133 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2740599f-dee0-45fa-a1c9-e56446595d84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d24edac2e0f4948b6ede060e2bb2df9'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:39.012033 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2740599f-dee0-45fa-a1c9-e56446595d84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d24edac2e0f4948b6ede060e2bb2df9'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:39.031648 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258615a-33b6-427b-a376-37a592db1ae2 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:39.033279 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258615a-33b6-427b-a376-37a592db1ae2 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:39.033782 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258615a-33b6-427b-a376-37a592db1ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:39.060024 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-f258615a-33b6-427b-a376-37a592db1ae2 None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:31:39.063774 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-f258615a-33b6-427b-a376-37a592db1ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:39.086058 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2593/5216] 10.222.0.52 () {58 vars in 1009 bytes} [Sat May 14 21:31:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:31:39.107014 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f258615a-33b6-427b-a376-37a592db1ae2 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:39.128312 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f258615a-33b6-427b-a376-37a592db1ae2 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:39.136072 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3821f4d2-00ac-4060-8058-d195de7e2ecc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:39.136686 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3821f4d2-00ac-4060-8058-d195de7e2ecc service swift] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:39.137168 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3821f4d2-00ac-4060-8058-d195de7e2ecc service swift] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:39.138292 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3821f4d2-00ac-4060-8058-d195de7e2ecc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:39.150746 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3821f4d2-00ac-4060-8058-d195de7e2ecc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:39.153625 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3821f4d2-00ac-4060-8058-d195de7e2ecc service swift] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:39.165097 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2740599f-dee0-45fa-a1c9-e56446595d84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d24edac2e0f4948b6ede060e2bb2df9'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:39.167347 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2594/5217] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 21:31:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 14 21:31:39.168037 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2740599f-dee0-45fa-a1c9-e56446595d84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d24edac2e0f4948b6ede060e2bb2df9'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:39.179927 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2624/5218] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:31:38 2022] DELETE /identity/v3/users/6d24edac2e0f4948b6ede060e2bb2df9 => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:31:39.184311 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d602600-7f65-47bf-b35f-8df3b97a03b0 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:39.185506 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d602600-7f65-47bf-b35f-8df3b97a03b0 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:39.186316 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d602600-7f65-47bf-b35f-8df3b97a03b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:39.249014 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-1d602600-7f65-47bf-b35f-8df3b97a03b0 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:31:39.250456 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-1d602600-7f65-47bf-b35f-8df3b97a03b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:39.369966 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2595/5219] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:31:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:31:39.384782 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2740599f-dee0-45fa-a1c9-e56446595d84 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:39.386449 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-2740599f-dee0-45fa-a1c9-e56446595d84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:39.651070 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2740599f-dee0-45fa-a1c9-e56446595d84 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:39.651070 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b059f1-76aa-4557-b5a6-9f6fe379908b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:39.651070 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b059f1-76aa-4557-b5a6-9f6fe379908b service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:39.651070 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b059f1-76aa-4557-b5a6-9f6fe379908b service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:39.653435 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b059f1-76aa-4557-b5a6-9f6fe379908b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:39.653435 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b059f1-76aa-4557-b5a6-9f6fe379908b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:39.653435 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b059f1-76aa-4557-b5a6-9f6fe379908b service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:39.653435 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2625/5220] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:31:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:31:40.498967 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d602600-7f65-47bf-b35f-8df3b97a03b0 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:40.501045 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-1d602600-7f65-47bf-b35f-8df3b97a03b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:40.522149 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d602600-7f65-47bf-b35f-8df3b97a03b0 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:40.527287 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbefbc0-3042-419c-8aa2-fc9462745d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:40.530223 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbefbc0-3042-419c-8aa2-fc9462745d3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:40.530223 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbefbc0-3042-419c-8aa2-fc9462745d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:40.530223 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbefbc0-3042-419c-8aa2-fc9462745d3e admin admin] PATH_INFO: `/v3/projects/cbfc67c5870e4d3a898d2ad91d63364a` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:40.531366 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbefbc0-3042-419c-8aa2-fc9462745d3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbfc67c5870e4d3a898d2ad91d63364a)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:40.533640 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbefbc0-3042-419c-8aa2-fc9462745d3e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:40.747363 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3dbefbc0-3042-419c-8aa2-fc9462745d3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbfc67c5870e4d3a898d2ad91d63364a', 'request_id': 'req-3dbefbc0-3042-419c-8aa2-fc9462745d3e'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:40.760355 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3dbefbc0-3042-419c-8aa2-fc9462745d3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbfc67c5870e4d3a898d2ad91d63364a', 'request_id': 'req-3dbefbc0-3042-419c-8aa2-fc9462745d3e'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:40.775258 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3dbefbc0-3042-419c-8aa2-fc9462745d3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbfc67c5870e4d3a898d2ad91d63364a', 'request_id': 'req-3dbefbc0-3042-419c-8aa2-fc9462745d3e'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:40.823924 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cfa160-dff4-45c4-8594-667b2e08a90c None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:40.824539 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cfa160-dff4-45c4-8594-667b2e08a90c None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:40.824730 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cfa160-dff4-45c4-8594-667b2e08a90c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:40.851075 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-68cfa160-dff4-45c4-8594-667b2e08a90c None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:31:40.852949 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-68cfa160-dff4-45c4-8594-667b2e08a90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:40.875998 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3dbefbc0-3042-419c-8aa2-fc9462745d3e admin admin] The token cache is being invalidate because project cbfc67c5870e4d3a898d2ad91d63364a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:31:40.876579 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3dbefbc0-3042-419c-8aa2-fc9462745d3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:40.877541 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3dbefbc0-3042-419c-8aa2-fc9462745d3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:40.884432 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2596/5221] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:31:40 2022] DELETE /identity/v3/projects/cbfc67c5870e4d3a898d2ad91d63364a => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:31:40.886021 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ecb66-91db-42ae-a7ac-7f8c4ad1feed None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:40.888259 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ecb66-91db-42ae-a7ac-7f8c4ad1feed None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:40.891843 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ecb66-91db-42ae-a7ac-7f8c4ad1feed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:40.979462 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2626/5222] 10.222.0.52 () {58 vars in 1009 bytes} [Sat May 14 21:31:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:31:41.014234 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-8b2ecb66-91db-42ae-a7ac-7f8c4ad1feed None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:31:41.016432 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8b2ecb66-91db-42ae-a7ac-7f8c4ad1feed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:41.024761 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cfa160-dff4-45c4-8594-667b2e08a90c None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:41.026713 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-68cfa160-dff4-45c4-8594-667b2e08a90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:41.130853 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cfa160-dff4-45c4-8594-667b2e08a90c None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:41.141837 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2597/5223] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:31:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:31:41.148918 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b3db63-355d-493e-b38a-8f85a24461c1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:41.150018 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b3db63-355d-493e-b38a-8f85a24461c1 service swift] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:41.150409 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b3db63-355d-493e-b38a-8f85a24461c1 service swift] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:41.151054 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b3db63-355d-493e-b38a-8f85a24461c1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:41.182143 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b3db63-355d-493e-b38a-8f85a24461c1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:41.187355 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b3db63-355d-493e-b38a-8f85a24461c1 service swift] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:41.197862 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2627/5224] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 21:31:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 21:31:41.283143 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97784d69-6396-407e-9d35-691cd3b28735 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:41.283143 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97784d69-6396-407e-9d35-691cd3b28735 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:41.283143 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97784d69-6396-407e-9d35-691cd3b28735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:41.283143 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-97784d69-6396-407e-9d35-691cd3b28735 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:31:41.283143 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-97784d69-6396-407e-9d35-691cd3b28735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:41.304449 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2598/5225] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:31:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:31:41.305623 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b3db63-355d-493e-b38a-8f85a24461c1 service swift] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:41.328948 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b3db63-355d-493e-b38a-8f85a24461c1 service swift] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:41.334757 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7912b82d-8028-41f5-bbff-502ed9f22bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:41.335795 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7912b82d-8028-41f5-bbff-502ed9f22bea admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:41.336316 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7912b82d-8028-41f5-bbff-502ed9f22bea admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:41.336714 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7912b82d-8028-41f5-bbff-502ed9f22bea admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:41.337560 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7912b82d-8028-41f5-bbff-502ed9f22bea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:31:41.337978 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7912b82d-8028-41f5-bbff-502ed9f22bea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:41.339743 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7912b82d-8028-41f5-bbff-502ed9f22bea admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:41.358567 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97784d69-6396-407e-9d35-691cd3b28735 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:41.367719 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2628/5226] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:31:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:31:41.375413 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97784d69-6396-407e-9d35-691cd3b28735 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:41.384491 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354ce4b5-2992-479e-970d-6e16fd906b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:41.386217 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ce4b5-2992-479e-970d-6e16fd906b2f admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:41.386578 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ce4b5-2992-479e-970d-6e16fd906b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:41.387207 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ce4b5-2992-479e-970d-6e16fd906b2f admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:41.388604 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354ce4b5-2992-479e-970d-6e16fd906b2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:41.391188 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354ce4b5-2992-479e-970d-6e16fd906b2f admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:41.487614 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7912b82d-8028-41f5-bbff-502ed9f22bea admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:41.506293 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-7912b82d-8028-41f5-bbff-502ed9f22bea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:41.527908 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2599/5227] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:31:41 2022] POST /identity/v3/projects => generated 369 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:31:41.532733 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354ce4b5-2992-479e-970d-6e16fd906b2f admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:41.655255 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7912b82d-8028-41f5-bbff-502ed9f22bea admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:41.733163 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354ce4b5-2992-479e-970d-6e16fd906b2f admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:41.735546 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0965f2f5-ec34-4980-b9fa-84abf1a750c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:41.736493 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0965f2f5-ec34-4980-b9fa-84abf1a750c1 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:41.736949 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0965f2f5-ec34-4980-b9fa-84abf1a750c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:41.739711 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95958e5-bded-4a60-b9f7-8244d5dc12ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:41.740215 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0965f2f5-ec34-4980-b9fa-84abf1a750c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:41.740593 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95958e5-bded-4a60-b9f7-8244d5dc12ee admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:41.740967 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95958e5-bded-4a60-b9f7-8244d5dc12ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:41.741219 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95958e5-bded-4a60-b9f7-8244d5dc12ee admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:41.742350 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95958e5-bded-4a60-b9f7-8244d5dc12ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:41.744506 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95958e5-bded-4a60-b9f7-8244d5dc12ee admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:41.750931 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-0965f2f5-ec34-4980-b9fa-84abf1a750c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:41.866019 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2600/5228] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:31:41 2022] POST /identity/v3/users => generated 285 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:31:41.870524 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95958e5-bded-4a60-b9f7-8244d5dc12ee admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:41.912596 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95958e5-bded-4a60-b9f7-8244d5dc12ee admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:41.915204 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0965f2f5-ec34-4980-b9fa-84abf1a750c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:41.923221 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c74d6-4c9e-4cb5-b5c0-db65e9c5defa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:41.930029 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0965f2f5-ec34-4980-b9fa-84abf1a750c1 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:41.930913 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c74d6-4c9e-4cb5-b5c0-db65e9c5defa admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:41.930913 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c74d6-4c9e-4cb5-b5c0-db65e9c5defa admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:41.930913 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c74d6-4c9e-4cb5-b5c0-db65e9c5defa admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:41.930913 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2c74d6-4c9e-4cb5-b5c0-db65e9c5defa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:41.930913 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2c74d6-4c9e-4cb5-b5c0-db65e9c5defa admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:41.946766 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2601/5229] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:31:41 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:31:41.947775 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c74d6-4c9e-4cb5-b5c0-db65e9c5defa admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:41.962043 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c74d6-4c9e-4cb5-b5c0-db65e9c5defa admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:41.968325 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2629/5230] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:31:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:31:41.969256 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2b8ac7-987f-4b38-a6da-8697aeded0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:41.969576 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2b8ac7-987f-4b38-a6da-8697aeded0a2 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:41.969987 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2b8ac7-987f-4b38-a6da-8697aeded0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:41.970334 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2b8ac7-987f-4b38-a6da-8697aeded0a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:41.971144 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2b8ac7-987f-4b38-a6da-8697aeded0a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:41.973039 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2b8ac7-987f-4b38-a6da-8697aeded0a2 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:41.990737 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2602/5231] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:31:41 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:31:41.995050 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0965f2f5-ec34-4980-b9fa-84abf1a750c1 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:42.018756 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0965f2f5-ec34-4980-b9fa-84abf1a750c1 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:42.039468 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992e7053-2b29-4e44-941c-e34054c1852f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:42.040511 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e7053-2b29-4e44-941c-e34054c1852f admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:42.040691 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e7053-2b29-4e44-941c-e34054c1852f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:42.040969 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e7053-2b29-4e44-941c-e34054c1852f admin admin] PATH_INFO: `/v3/projects/01ee6268a3564343aa30b49035a0e4fe/users/32f31413db6a48f0b18b6698626bef76/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:42.117345 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992e7053-2b29-4e44-941c-e34054c1852f admin admin] RBAC: Authorizing `identity:create_grant(project_id=01ee6268a3564343aa30b49035a0e4fe, user_id=32f31413db6a48f0b18b6698626bef76, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:42.130858 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992e7053-2b29-4e44-941c-e34054c1852f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:42.236699 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093497f1-615b-46ed-874a-c9fa21bcbd99 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:42.237030 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093497f1-615b-46ed-874a-c9fa21bcbd99 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:42.237268 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093497f1-615b-46ed-874a-c9fa21bcbd99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:42.239692 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2630/5232] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:31:41 2022] PUT /identity/v3/projects/01ee6268a3564343aa30b49035a0e4fe/users/32f31413db6a48f0b18b6698626bef76/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:31:42.297739 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-093497f1-615b-46ed-874a-c9fa21bcbd99 None None] MFA Rules not processed for user `32f31413db6a48f0b18b6698626bef76`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:31:42.299217 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-093497f1-615b-46ed-874a-c9fa21bcbd99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:42.413093 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2603/5233] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:31:42 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:31:42.427971 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992e7053-2b29-4e44-941c-e34054c1852f admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:42.431727 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-992e7053-2b29-4e44-941c-e34054c1852f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:42.546400 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992e7053-2b29-4e44-941c-e34054c1852f admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:42.550559 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57da456-5e57-4b97-90c5-5d81d43806d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:42.551511 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57da456-5e57-4b97-90c5-5d81d43806d8 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:42.552007 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57da456-5e57-4b97-90c5-5d81d43806d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:42.552485 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57da456-5e57-4b97-90c5-5d81d43806d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:42.586159 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57da456-5e57-4b97-90c5-5d81d43806d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:42.587994 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57da456-5e57-4b97-90c5-5d81d43806d8 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:42.598020 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2631/5234] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:31:42 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:31:43.380535 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920420b6-1865-4ebd-9192-2e4a72e52a69 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:43.381334 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920420b6-1865-4ebd-9192-2e4a72e52a69 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:43.382058 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920420b6-1865-4ebd-9192-2e4a72e52a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:43.420261 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-920420b6-1865-4ebd-9192-2e4a72e52a69 None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:31:43.421823 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-920420b6-1865-4ebd-9192-2e4a72e52a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:43.499819 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2604/5235] 10.222.0.52 () {58 vars in 967 bytes} [Sat May 14 21:31:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:31:43.523803 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57da456-5e57-4b97-90c5-5d81d43806d8 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:43.712689 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57da456-5e57-4b97-90c5-5d81d43806d8 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:43.720238 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6cf3c3-6ee6-491b-b6a5-fd30ea4f5b27 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:43.721310 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6cf3c3-6ee6-491b-b6a5-fd30ea4f5b27 service swift] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:43.721772 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6cf3c3-6ee6-491b-b6a5-fd30ea4f5b27 service swift] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:43.722219 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6cf3c3-6ee6-491b-b6a5-fd30ea4f5b27 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:43.734203 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6cf3c3-6ee6-491b-b6a5-fd30ea4f5b27 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:43.736294 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6cf3c3-6ee6-491b-b6a5-fd30ea4f5b27 service swift] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:43.748283 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2632/5236] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 21:31:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 14 21:31:44.387579 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0fd70e-3d56-41ff-acc8-406af6cd26d4 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:44.392740 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0fd70e-3d56-41ff-acc8-406af6cd26d4 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:44.392740 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0fd70e-3d56-41ff-acc8-406af6cd26d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:44.412179 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-ad0fd70e-3d56-41ff-acc8-406af6cd26d4 None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:31:44.413378 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-ad0fd70e-3d56-41ff-acc8-406af6cd26d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:44.423814 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2605/5237] 10.222.0.52 () {58 vars in 967 bytes} [Sat May 14 21:31:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:31:44.446725 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6cf3c3-6ee6-491b-b6a5-fd30ea4f5b27 service swift] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:44.468451 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6cf3c3-6ee6-491b-b6a5-fd30ea4f5b27 service swift] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:44.483938 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591170be-73c6-4e83-a845-b4811c65d291 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:44.485151 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591170be-73c6-4e83-a845-b4811c65d291 service swift] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:44.485596 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591170be-73c6-4e83-a845-b4811c65d291 service swift] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:44.486037 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591170be-73c6-4e83-a845-b4811c65d291 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:44.516496 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591170be-73c6-4e83-a845-b4811c65d291 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:44.518195 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591170be-73c6-4e83-a845-b4811c65d291 service swift] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:44.547935 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2633/5238] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 21:31:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 21:31:45.262471 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195928dd-47df-4062-bf65-016f6d06bdbc None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:45.263208 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195928dd-47df-4062-bf65-016f6d06bdbc None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:45.263679 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195928dd-47df-4062-bf65-016f6d06bdbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:45.313316 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-195928dd-47df-4062-bf65-016f6d06bdbc None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:31:45.314408 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-195928dd-47df-4062-bf65-016f6d06bdbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:45.330421 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2606/5239] 10.222.0.52 () {58 vars in 967 bytes} [Sat May 14 21:31:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:31:45.344799 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591170be-73c6-4e83-a845-b4811c65d291 service swift] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:45.364419 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591170be-73c6-4e83-a845-b4811c65d291 service swift] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:45.380738 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a04637-f9ce-4db7-ab6f-6dc8451a7f41 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:45.385124 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a04637-f9ce-4db7-ab6f-6dc8451a7f41 service swift] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:45.385124 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a04637-f9ce-4db7-ab6f-6dc8451a7f41 service swift] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:45.385124 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a04637-f9ce-4db7-ab6f-6dc8451a7f41 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:45.393982 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a04637-f9ce-4db7-ab6f-6dc8451a7f41 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:45.396227 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a04637-f9ce-4db7-ab6f-6dc8451a7f41 service swift] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:45.408493 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2634/5240] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 21:31:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 21:31:46.071762 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c18df17-cdff-495f-a106-23597d8088d5 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:46.072774 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c18df17-cdff-495f-a106-23597d8088d5 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:46.073297 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c18df17-cdff-495f-a106-23597d8088d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:46.144628 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-3c18df17-cdff-495f-a106-23597d8088d5 None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:31:46.152541 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-3c18df17-cdff-495f-a106-23597d8088d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:46.182073 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2607/5241] 10.222.0.52 () {58 vars in 967 bytes} [Sat May 14 21:31:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:31:46.196879 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a04637-f9ce-4db7-ab6f-6dc8451a7f41 service swift] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:46.226216 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a04637-f9ce-4db7-ab6f-6dc8451a7f41 service swift] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:46.233842 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18c6cdc-50bb-4d72-8e43-5f1201b08cf6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:46.235236 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c6cdc-50bb-4d72-8e43-5f1201b08cf6 service swift] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:46.235938 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c6cdc-50bb-4d72-8e43-5f1201b08cf6 service swift] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:46.236649 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c6cdc-50bb-4d72-8e43-5f1201b08cf6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:46.249893 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18c6cdc-50bb-4d72-8e43-5f1201b08cf6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:46.252553 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18c6cdc-50bb-4d72-8e43-5f1201b08cf6 service swift] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:46.264397 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2635/5242] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 21:31:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 21:31:47.089679 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c18df17-cdff-495f-a106-23597d8088d5 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:47.100593 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-3c18df17-cdff-495f-a106-23597d8088d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:47.288421 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c18df17-cdff-495f-a106-23597d8088d5 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:47.288421 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dabe0e-0ccc-45b5-9e56-b301b5da3989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:47.288421 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dabe0e-0ccc-45b5-9e56-b301b5da3989 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:47.288421 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dabe0e-0ccc-45b5-9e56-b301b5da3989 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:47.289208 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dabe0e-0ccc-45b5-9e56-b301b5da3989 admin admin] PATH_INFO: `/v3/users/2d0ac47523ba4f288bcd89f8228ef910` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:47.289208 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dabe0e-0ccc-45b5-9e56-b301b5da3989 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d0ac47523ba4f288bcd89f8228ef910)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:47.289208 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dabe0e-0ccc-45b5-9e56-b301b5da3989 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:47.476225 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a9b1d-aaba-47d7-b2e0-c7049335f0af None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:47.476790 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a9b1d-aaba-47d7-b2e0-c7049335f0af None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:47.476891 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a9b1d-aaba-47d7-b2e0-c7049335f0af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:47.495334 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-1b2a9b1d-aaba-47d7-b2e0-c7049335f0af None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:31:47.500856 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-1b2a9b1d-aaba-47d7-b2e0-c7049335f0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:47.505078 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2636/5243] 10.222.0.52 () {58 vars in 967 bytes} [Sat May 14 21:31:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:31:47.518438 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2a9b1d-aaba-47d7-b2e0-c7049335f0af None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:47.533369 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2a9b1d-aaba-47d7-b2e0-c7049335f0af None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:47.536655 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a7dabe0e-0ccc-45b5-9e56-b301b5da3989 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d0ac47523ba4f288bcd89f8228ef910'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:47.538398 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c77614a-e188-4944-99d9-6abde774b703 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:47.539112 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77614a-e188-4944-99d9-6abde774b703 service swift] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:47.539332 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77614a-e188-4944-99d9-6abde774b703 service swift] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:47.539638 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77614a-e188-4944-99d9-6abde774b703 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:47.544131 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a7dabe0e-0ccc-45b5-9e56-b301b5da3989 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d0ac47523ba4f288bcd89f8228ef910'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:47.544815 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a7dabe0e-0ccc-45b5-9e56-b301b5da3989 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d0ac47523ba4f288bcd89f8228ef910'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:47.553312 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c77614a-e188-4944-99d9-6abde774b703 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:47.553959 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c77614a-e188-4944-99d9-6abde774b703 service swift] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:47.563544 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2637/5244] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 21:31:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 14 21:31:47.679616 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a7dabe0e-0ccc-45b5-9e56-b301b5da3989 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d0ac47523ba4f288bcd89f8228ef910'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:47.695464 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a7dabe0e-0ccc-45b5-9e56-b301b5da3989 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d0ac47523ba4f288bcd89f8228ef910'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:47.705347 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2608/5245] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:31:47 2022] DELETE /identity/v3/users/2d0ac47523ba4f288bcd89f8228ef910 => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:31:48.183443 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c77614a-e188-4944-99d9-6abde774b703 service swift] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:48.202671 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c77614a-e188-4944-99d9-6abde774b703 service swift] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:48.277438 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad065311-9b03-46cc-af15-1668ac5e402b None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:48.278337 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad065311-9b03-46cc-af15-1668ac5e402b None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:48.278802 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad065311-9b03-46cc-af15-1668ac5e402b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:48.300044 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-ad065311-9b03-46cc-af15-1668ac5e402b None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:31:48.301566 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-ad065311-9b03-46cc-af15-1668ac5e402b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:48.407025 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606db461-b02a-4c6f-af20-1109d64f0155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:48.407947 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606db461-b02a-4c6f-af20-1109d64f0155 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:48.408229 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606db461-b02a-4c6f-af20-1109d64f0155 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:48.409556 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606db461-b02a-4c6f-af20-1109d64f0155 admin admin] PATH_INFO: `/v3/projects/c8d3f937d0cc40e6b1cd90e72b6fb07e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:48.463592 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2609/5246] 10.222.0.52 () {58 vars in 967 bytes} [Sat May 14 21:31:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:31:48.482782 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606db461-b02a-4c6f-af20-1109d64f0155 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8d3f937d0cc40e6b1cd90e72b6fb07e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:48.486323 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad065311-9b03-46cc-af15-1668ac5e402b None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:48.489993 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-ad065311-9b03-46cc-af15-1668ac5e402b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:48.490924 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606db461-b02a-4c6f-af20-1109d64f0155 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:48.642567 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad065311-9b03-46cc-af15-1668ac5e402b None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:48.670333 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-606db461-b02a-4c6f-af20-1109d64f0155 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'request_id': 'req-606db461-b02a-4c6f-af20-1109d64f0155'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:48.677121 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-606db461-b02a-4c6f-af20-1109d64f0155 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'request_id': 'req-606db461-b02a-4c6f-af20-1109d64f0155'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:48.742257 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c086ad-ec8d-484f-bb22-33d159538b13 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:48.743393 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c086ad-ec8d-484f-bb22-33d159538b13 service swift] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:48.743711 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c086ad-ec8d-484f-bb22-33d159538b13 service swift] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:48.744457 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c086ad-ec8d-484f-bb22-33d159538b13 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:48.757504 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-606db461-b02a-4c6f-af20-1109d64f0155 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'request_id': 'req-606db461-b02a-4c6f-af20-1109d64f0155'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:48.775748 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-606db461-b02a-4c6f-af20-1109d64f0155 admin admin] The token cache is being invalidate because project c8d3f937d0cc40e6b1cd90e72b6fb07e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:31:48.776792 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-606db461-b02a-4c6f-af20-1109d64f0155 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:48.777644 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-606db461-b02a-4c6f-af20-1109d64f0155 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:48.780630 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2638/5247] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:31:48 2022] DELETE /identity/v3/projects/c8d3f937d0cc40e6b1cd90e72b6fb07e => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:31:48.784695 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606db461-b02a-4c6f-af20-1109d64f0155 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:48.789185 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-606db461-b02a-4c6f-af20-1109d64f0155 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:48.822506 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c086ad-ec8d-484f-bb22-33d159538b13 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:48.825675 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c086ad-ec8d-484f-bb22-33d159538b13 service swift] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:48.842733 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2610/5248] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 21:31:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 14 21:31:48.882099 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606db461-b02a-4c6f-af20-1109d64f0155 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:48.886874 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2218d027-0130-4a25-afae-d2408373c7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:48.888535 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2218d027-0130-4a25-afae-d2408373c7ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:48.888824 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2218d027-0130-4a25-afae-d2408373c7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:48.889106 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2218d027-0130-4a25-afae-d2408373c7ed admin admin] PATH_INFO: `/v3/users/eab74b8b11144ce5ae668614ded520fe` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:48.927184 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2218d027-0130-4a25-afae-d2408373c7ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=eab74b8b11144ce5ae668614ded520fe)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:48.927184 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2218d027-0130-4a25-afae-d2408373c7ed admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:49.192277 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2218d027-0130-4a25-afae-d2408373c7ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eab74b8b11144ce5ae668614ded520fe'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:49.207261 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2218d027-0130-4a25-afae-d2408373c7ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eab74b8b11144ce5ae668614ded520fe'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:49.217253 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2218d027-0130-4a25-afae-d2408373c7ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eab74b8b11144ce5ae668614ded520fe'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:49.376061 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2218d027-0130-4a25-afae-d2408373c7ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eab74b8b11144ce5ae668614ded520fe'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:49.376743 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2218d027-0130-4a25-afae-d2408373c7ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eab74b8b11144ce5ae668614ded520fe'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:49.384828 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2639/5249] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:31:48 2022] DELETE /identity/v3/users/eab74b8b11144ce5ae668614ded520fe => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:31:49.674133 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c086ad-ec8d-484f-bb22-33d159538b13 service swift] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:49.676873 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b6c086ad-ec8d-484f-bb22-33d159538b13 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:49.693438 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c086ad-ec8d-484f-bb22-33d159538b13 service swift] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:49.816193 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97582d1c-3122-40fb-8290-ba7bac4fad02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:49.817914 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97582d1c-3122-40fb-8290-ba7bac4fad02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:49.818950 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97582d1c-3122-40fb-8290-ba7bac4fad02 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:49.819243 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97582d1c-3122-40fb-8290-ba7bac4fad02 admin admin] PATH_INFO: `/v3/users/5cf98665048c492faabc9f64c27cab40` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:49.820995 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97582d1c-3122-40fb-8290-ba7bac4fad02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cf98665048c492faabc9f64c27cab40)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:49.824153 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97582d1c-3122-40fb-8290-ba7bac4fad02 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:49.830192 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2218d027-0130-4a25-afae-d2408373c7ed admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:49.831781 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-2218d027-0130-4a25-afae-d2408373c7ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:49.864548 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2218d027-0130-4a25-afae-d2408373c7ed admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:49.871113 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df1e4ab-1bf6-482c-a853-4ebfe32f1f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:49.872652 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1e4ab-1bf6-482c-a853-4ebfe32f1f75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:49.881578 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1e4ab-1bf6-482c-a853-4ebfe32f1f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:49.881939 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1e4ab-1bf6-482c-a853-4ebfe32f1f75 admin admin] PATH_INFO: `/v3/projects/c5f5d25903a54e73ac56fef5225279c8` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:49.897409 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df1e4ab-1bf6-482c-a853-4ebfe32f1f75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5f5d25903a54e73ac56fef5225279c8)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:49.899784 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df1e4ab-1bf6-482c-a853-4ebfe32f1f75 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:50.045827 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-97582d1c-3122-40fb-8290-ba7bac4fad02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cf98665048c492faabc9f64c27cab40'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:50.056509 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-97582d1c-3122-40fb-8290-ba7bac4fad02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cf98665048c492faabc9f64c27cab40'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:50.057801 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-97582d1c-3122-40fb-8290-ba7bac4fad02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cf98665048c492faabc9f64c27cab40'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:50.096487 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2df1e4ab-1bf6-482c-a853-4ebfe32f1f75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5f5d25903a54e73ac56fef5225279c8', 'request_id': 'req-2df1e4ab-1bf6-482c-a853-4ebfe32f1f75'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:50.114102 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2df1e4ab-1bf6-482c-a853-4ebfe32f1f75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5f5d25903a54e73ac56fef5225279c8', 'request_id': 'req-2df1e4ab-1bf6-482c-a853-4ebfe32f1f75'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:50.142309 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-97582d1c-3122-40fb-8290-ba7bac4fad02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cf98665048c492faabc9f64c27cab40'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:50.161891 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-97582d1c-3122-40fb-8290-ba7bac4fad02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cf98665048c492faabc9f64c27cab40'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:50.170416 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2611/5250] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:31:49 2022] DELETE /identity/v3/users/5cf98665048c492faabc9f64c27cab40 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:31:50.177520 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502c44b-17a3-49d5-9b24-7dc0d086b024 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:50.177821 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502c44b-17a3-49d5-9b24-7dc0d086b024 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:50.178102 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502c44b-17a3-49d5-9b24-7dc0d086b024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:50.207244 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-9502c44b-17a3-49d5-9b24-7dc0d086b024 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:31:50.209063 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-9502c44b-17a3-49d5-9b24-7dc0d086b024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:50.239815 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2df1e4ab-1bf6-482c-a853-4ebfe32f1f75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5f5d25903a54e73ac56fef5225279c8', 'request_id': 'req-2df1e4ab-1bf6-482c-a853-4ebfe32f1f75'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:50.294565 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2df1e4ab-1bf6-482c-a853-4ebfe32f1f75 admin admin] The token cache is being invalidate because project c5f5d25903a54e73ac56fef5225279c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:31:50.295104 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2df1e4ab-1bf6-482c-a853-4ebfe32f1f75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:50.298959 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2df1e4ab-1bf6-482c-a853-4ebfe32f1f75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:50.305853 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2640/5251] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:31:49 2022] DELETE /identity/v3/projects/c5f5d25903a54e73ac56fef5225279c8 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:31:50.313827 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a431b-398c-4a1a-826a-5555ec5276fc None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:50.314140 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a431b-398c-4a1a-826a-5555ec5276fc None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:50.315081 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a431b-398c-4a1a-826a-5555ec5276fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:50.343202 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-6e1a431b-398c-4a1a-826a-5555ec5276fc None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:31:50.345099 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-6e1a431b-398c-4a1a-826a-5555ec5276fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:50.347092 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2612/5252] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:31:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:31:50.361068 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9502c44b-17a3-49d5-9b24-7dc0d086b024 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:50.363884 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2641/5253] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:31:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:31:50.366308 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-9502c44b-17a3-49d5-9b24-7dc0d086b024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:50.372309 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2552d4-6c64-43d7-9a98-03f8baa24bd0 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:50.373723 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2552d4-6c64-43d7-9a98-03f8baa24bd0 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:50.374250 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2552d4-6c64-43d7-9a98-03f8baa24bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:50.425518 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-ea2552d4-6c64-43d7-9a98-03f8baa24bd0 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:31:50.428948 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ea2552d4-6c64-43d7-9a98-03f8baa24bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:50.455896 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2642/5254] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:31:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:31:50.457767 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2552d4-6c64-43d7-9a98-03f8baa24bd0 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:50.480047 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2552d4-6c64-43d7-9a98-03f8baa24bd0 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:50.488240 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9502c44b-17a3-49d5-9b24-7dc0d086b024 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:50.493461 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd9cf83-e4ae-47a4-a291-ba757ec8aa58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:50.497408 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd9cf83-e4ae-47a4-a291-ba757ec8aa58 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:50.497990 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd9cf83-e4ae-47a4-a291-ba757ec8aa58 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:50.498342 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd9cf83-e4ae-47a4-a291-ba757ec8aa58 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:50.499547 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd9cf83-e4ae-47a4-a291-ba757ec8aa58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:31:50.502607 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faac8cec-7a23-465e-815c-2bc927606bef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:50.503163 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd9cf83-e4ae-47a4-a291-ba757ec8aa58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:50.503903 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac8cec-7a23-465e-815c-2bc927606bef service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:50.505706 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac8cec-7a23-465e-815c-2bc927606bef service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:50.505999 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac8cec-7a23-465e-815c-2bc927606bef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:50.507185 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd9cf83-e4ae-47a4-a291-ba757ec8aa58 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:50.527247 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2643/5255] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:31:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:31:50.527449 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faac8cec-7a23-465e-815c-2bc927606bef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:50.527449 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faac8cec-7a23-465e-815c-2bc927606bef service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:50.530699 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd9cf83-e4ae-47a4-a291-ba757ec8aa58 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:50.546972 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd9cf83-e4ae-47a4-a291-ba757ec8aa58 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:50.547198 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2613/5256] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:31:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:31:50.560462 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b125ad7f-626c-4522-94fc-ba85e53b4c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:50.561205 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125ad7f-626c-4522-94fc-ba85e53b4c68 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:50.562109 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125ad7f-626c-4522-94fc-ba85e53b4c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:50.562109 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125ad7f-626c-4522-94fc-ba85e53b4c68 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:50.562438 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b125ad7f-626c-4522-94fc-ba85e53b4c68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:50.565062 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b125ad7f-626c-4522-94fc-ba85e53b4c68 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:50.718190 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2644/5257] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:31:50 2022] POST /identity/v3/projects => generated 391 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:31:50.729394 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faac8cec-7a23-465e-815c-2bc927606bef service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:50.752663 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faac8cec-7a23-465e-815c-2bc927606bef service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:50.852078 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457301b2-341b-49c1-9479-0d152f9aed75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:50.853034 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457301b2-341b-49c1-9479-0d152f9aed75 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:50.853951 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457301b2-341b-49c1-9479-0d152f9aed75 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:50.854654 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457301b2-341b-49c1-9479-0d152f9aed75 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:50.855578 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457301b2-341b-49c1-9479-0d152f9aed75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:50.858958 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457301b2-341b-49c1-9479-0d152f9aed75 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:50.978965 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2614/5258] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:31:50 2022] POST /identity/v3/users => generated 296 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:31:50.980233 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b125ad7f-626c-4522-94fc-ba85e53b4c68 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:50.994805 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b125ad7f-626c-4522-94fc-ba85e53b4c68 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:51.005031 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f969414c-6a18-4bf6-8cb6-5f2265c017ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:51.005031 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969414c-6a18-4bf6-8cb6-5f2265c017ed admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:51.005031 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969414c-6a18-4bf6-8cb6-5f2265c017ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:51.005031 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969414c-6a18-4bf6-8cb6-5f2265c017ed admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:51.005443 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f969414c-6a18-4bf6-8cb6-5f2265c017ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:51.007830 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f969414c-6a18-4bf6-8cb6-5f2265c017ed admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:51.044901 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2645/5259] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:31:50 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:31:51.048584 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457301b2-341b-49c1-9479-0d152f9aed75 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:51.065492 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457301b2-341b-49c1-9479-0d152f9aed75 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:51.088962 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a4a781-0313-4580-b8e1-169b11414d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:51.089868 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4a781-0313-4580-b8e1-169b11414d59 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:51.090907 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4a781-0313-4580-b8e1-169b11414d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:51.091368 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4a781-0313-4580-b8e1-169b11414d59 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:51.092313 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a4a781-0313-4580-b8e1-169b11414d59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:51.097101 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a4a781-0313-4580-b8e1-169b11414d59 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:51.111672 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2615/5260] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:31:51 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:31:51.115287 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f969414c-6a18-4bf6-8cb6-5f2265c017ed admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:51.129519 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f969414c-6a18-4bf6-8cb6-5f2265c017ed admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:51.143590 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a594582-02af-471e-b733-3120c44c475a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:51.144497 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a594582-02af-471e-b733-3120c44c475a admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:51.146066 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a594582-02af-471e-b733-3120c44c475a admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:51.146066 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a594582-02af-471e-b733-3120c44c475a admin admin] PATH_INFO: `/v3/projects/5241cdff4cf3483c9b0dbdf7bf4e0ceb/users/4ad81cc85a4146199c0d1a8c17f8aa21/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:51.199197 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a594582-02af-471e-b733-3120c44c475a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5241cdff4cf3483c9b0dbdf7bf4e0ceb, user_id=4ad81cc85a4146199c0d1a8c17f8aa21, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:51.204057 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a594582-02af-471e-b733-3120c44c475a admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:51.334053 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2646/5261] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:31:51 2022] PUT /identity/v3/projects/5241cdff4cf3483c9b0dbdf7bf4e0ceb/users/4ad81cc85a4146199c0d1a8c17f8aa21/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:31:51.341662 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce31713-4cdd-4e5c-b201-4bbecbc2815b None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:51.341955 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce31713-4cdd-4e5c-b201-4bbecbc2815b None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:51.342236 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce31713-4cdd-4e5c-b201-4bbecbc2815b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:51.379609 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-fce31713-4cdd-4e5c-b201-4bbecbc2815b None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:31:51.381325 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-fce31713-4cdd-4e5c-b201-4bbecbc2815b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:51.471243 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2616/5262] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:31:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:31:51.481678 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a594582-02af-471e-b733-3120c44c475a admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:51.549778 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a594582-02af-471e-b733-3120c44c475a admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:51.553699 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdafb2f8-ff1a-4463-b8e9-f1fdc3e7a229 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:51.554388 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdafb2f8-ff1a-4463-b8e9-f1fdc3e7a229 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:51.554675 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdafb2f8-ff1a-4463-b8e9-f1fdc3e7a229 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:51.554949 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdafb2f8-ff1a-4463-b8e9-f1fdc3e7a229 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:51.564887 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdafb2f8-ff1a-4463-b8e9-f1fdc3e7a229 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:51.566340 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdafb2f8-ff1a-4463-b8e9-f1fdc3e7a229 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:51.578232 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2647/5263] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:31:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:31:51.796094 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce31713-4cdd-4e5c-b201-4bbecbc2815b None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:51.800273 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-fce31713-4cdd-4e5c-b201-4bbecbc2815b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:51.816466 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce31713-4cdd-4e5c-b201-4bbecbc2815b None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:51.829074 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6873a1e0-a032-4e96-9a2c-fcd566575c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:51.830000 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873a1e0-a032-4e96-9a2c-fcd566575c99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:51.830252 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873a1e0-a032-4e96-9a2c-fcd566575c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:51.830579 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873a1e0-a032-4e96-9a2c-fcd566575c99 admin admin] PATH_INFO: `/v3/projects/7b8dacf58289444eb351814a7708b42d` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:51.832018 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6873a1e0-a032-4e96-9a2c-fcd566575c99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b8dacf58289444eb351814a7708b42d)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:51.833946 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6873a1e0-a032-4e96-9a2c-fcd566575c99 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:52.041483 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-6873a1e0-a032-4e96-9a2c-fcd566575c99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b8dacf58289444eb351814a7708b42d', 'request_id': 'req-6873a1e0-a032-4e96-9a2c-fcd566575c99'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:52.048264 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-6873a1e0-a032-4e96-9a2c-fcd566575c99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b8dacf58289444eb351814a7708b42d', 'request_id': 'req-6873a1e0-a032-4e96-9a2c-fcd566575c99'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:52.060620 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-6873a1e0-a032-4e96-9a2c-fcd566575c99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b8dacf58289444eb351814a7708b42d', 'request_id': 'req-6873a1e0-a032-4e96-9a2c-fcd566575c99'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:52.307220 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-6873a1e0-a032-4e96-9a2c-fcd566575c99 admin admin] The token cache is being invalidate because project 7b8dacf58289444eb351814a7708b42d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:31:52.307538 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-6873a1e0-a032-4e96-9a2c-fcd566575c99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:52.309903 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-6873a1e0-a032-4e96-9a2c-fcd566575c99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:31:52.316890 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2617/5264] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:31:51 2022] DELETE /identity/v3/projects/7b8dacf58289444eb351814a7708b42d => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:31:52.321542 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281b7bc-c959-4780-a17d-4bda0edef7e3 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:52.322452 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281b7bc-c959-4780-a17d-4bda0edef7e3 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:52.322872 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281b7bc-c959-4780-a17d-4bda0edef7e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:52.370469 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-6281b7bc-c959-4780-a17d-4bda0edef7e3 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:31:52.372804 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-6281b7bc-c959-4780-a17d-4bda0edef7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:52.519963 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2648/5265] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:31:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:31:52.528799 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35831844-9923-448d-83de-7c78fb7d00dd None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:52.529436 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35831844-9923-448d-83de-7c78fb7d00dd None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:52.529870 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35831844-9923-448d-83de-7c78fb7d00dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:52.565998 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-35831844-9923-448d-83de-7c78fb7d00dd None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:31:52.567922 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-35831844-9923-448d-83de-7c78fb7d00dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:52.581325 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2618/5266] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:31:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:31:52.586117 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6281b7bc-c959-4780-a17d-4bda0edef7e3 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:52.600149 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6281b7bc-c959-4780-a17d-4bda0edef7e3 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:52.606051 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc8c188-a133-4e88-a598-057f9f84f774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:52.608182 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc8c188-a133-4e88-a598-057f9f84f774 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:52.608658 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc8c188-a133-4e88-a598-057f9f84f774 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:52.609691 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc8c188-a133-4e88-a598-057f9f84f774 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:52.610624 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc8c188-a133-4e88-a598-057f9f84f774 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:31:52.611148 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc8c188-a133-4e88-a598-057f9f84f774 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:52.613909 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc8c188-a133-4e88-a598-057f9f84f774 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:52.637917 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2649/5267] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:31:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:31:52.642179 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35831844-9923-448d-83de-7c78fb7d00dd None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:52.664966 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35831844-9923-448d-83de-7c78fb7d00dd None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:52.671234 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3c6e68-52fb-4cd2-b153-ea110be5b3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:52.671953 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c6e68-52fb-4cd2-b153-ea110be5b3d1 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:52.672237 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c6e68-52fb-4cd2-b153-ea110be5b3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:52.672643 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c6e68-52fb-4cd2-b153-ea110be5b3d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:52.675194 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3c6e68-52fb-4cd2-b153-ea110be5b3d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:52.677477 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3c6e68-52fb-4cd2-b153-ea110be5b3d1 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:52.837726 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2619/5268] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:31:52 2022] POST /identity/v3/projects => generated 389 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:31:52.842882 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc8c188-a133-4e88-a598-057f9f84f774 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:52.858106 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc8c188-a133-4e88-a598-057f9f84f774 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:53.028377 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba874e4-96a8-4720-bc0d-2a7d9c14e9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:53.032417 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba874e4-96a8-4720-bc0d-2a7d9c14e9cf admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:53.039266 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba874e4-96a8-4720-bc0d-2a7d9c14e9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:53.039266 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba874e4-96a8-4720-bc0d-2a7d9c14e9cf admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:53.039266 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba874e4-96a8-4720-bc0d-2a7d9c14e9cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:53.041125 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba874e4-96a8-4720-bc0d-2a7d9c14e9cf admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:53.234817 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2650/5269] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:31:52 2022] POST /identity/v3/users => generated 295 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:31:53.239542 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3c6e68-52fb-4cd2-b153-ea110be5b3d1 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:53.255525 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3c6e68-52fb-4cd2-b153-ea110be5b3d1 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:53.261565 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f4f66-0398-4b82-aa2a-a3031bf3a3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:53.262483 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f4f66-0398-4b82-aa2a-a3031bf3a3ea admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:53.262902 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f4f66-0398-4b82-aa2a-a3031bf3a3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:53.263250 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f4f66-0398-4b82-aa2a-a3031bf3a3ea admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:53.264387 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1f4f66-0398-4b82-aa2a-a3031bf3a3ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:53.266766 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1f4f66-0398-4b82-aa2a-a3031bf3a3ea admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:53.282372 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2620/5270] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:31:53 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:31:53.286051 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba874e4-96a8-4720-bc0d-2a7d9c14e9cf admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:53.304449 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba874e4-96a8-4720-bc0d-2a7d9c14e9cf admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:53.311119 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788fae44-f610-4b35-a9e5-f7194379c6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:53.312261 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788fae44-f610-4b35-a9e5-f7194379c6e0 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:53.312572 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788fae44-f610-4b35-a9e5-f7194379c6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:53.312885 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788fae44-f610-4b35-a9e5-f7194379c6e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:53.313927 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788fae44-f610-4b35-a9e5-f7194379c6e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:53.315806 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788fae44-f610-4b35-a9e5-f7194379c6e0 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:53.328387 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2651/5271] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:31:53 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:31:53.334139 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f4f66-0398-4b82-aa2a-a3031bf3a3ea admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:53.354337 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f4f66-0398-4b82-aa2a-a3031bf3a3ea admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:53.358511 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a445df3c-28ff-48d9-ba7e-53f4418e0245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:53.360171 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a445df3c-28ff-48d9-ba7e-53f4418e0245 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:53.360816 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a445df3c-28ff-48d9-ba7e-53f4418e0245 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:53.361304 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a445df3c-28ff-48d9-ba7e-53f4418e0245 admin admin] PATH_INFO: `/v3/projects/4d79f7e4d0ac4ea98550cf3b65fe66af/users/5761ab8432a24fc4a329e487b27cf397/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:53.379074 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a445df3c-28ff-48d9-ba7e-53f4418e0245 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d79f7e4d0ac4ea98550cf3b65fe66af, user_id=5761ab8432a24fc4a329e487b27cf397, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:53.381977 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a445df3c-28ff-48d9-ba7e-53f4418e0245 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:53.511453 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2621/5272] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:31:53 2022] PUT /identity/v3/projects/4d79f7e4d0ac4ea98550cf3b65fe66af/users/5761ab8432a24fc4a329e487b27cf397/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:31:53.512470 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e4b0b-923b-4eb8-88a5-f8c4fa30d1e7 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:53.512878 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e4b0b-923b-4eb8-88a5-f8c4fa30d1e7 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:53.513273 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e4b0b-923b-4eb8-88a5-f8c4fa30d1e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:53.596852 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-1d4e4b0b-923b-4eb8-88a5-f8c4fa30d1e7 None None] MFA Rules not processed for user `5761ab8432a24fc4a329e487b27cf397`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:31:53.598547 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-1d4e4b0b-923b-4eb8-88a5-f8c4fa30d1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:53.666188 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344d79a-1112-4acb-8efe-f7e811fd9ce2 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:53.666698 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344d79a-1112-4acb-8efe-f7e811fd9ce2 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:53.667606 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344d79a-1112-4acb-8efe-f7e811fd9ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:53.730559 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-e344d79a-1112-4acb-8efe-f7e811fd9ce2 None None] MFA Rules not processed for user `4ad81cc85a4146199c0d1a8c17f8aa21`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:31:53.736717 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e344d79a-1112-4acb-8efe-f7e811fd9ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:53.849827 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2652/5273] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:31:53 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:31:53.855156 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4e4b0b-923b-4eb8-88a5-f8c4fa30d1e7 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:53.868680 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2622/5274] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:31:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:31:53.888239 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf65587f-b70d-4c7e-9d9f-4f8de6bf9c0e None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:53.888533 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf65587f-b70d-4c7e-9d9f-4f8de6bf9c0e None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:53.888817 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf65587f-b70d-4c7e-9d9f-4f8de6bf9c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:53.913471 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-bf65587f-b70d-4c7e-9d9f-4f8de6bf9c0e None None] MFA Rules not processed for user `4ad81cc85a4146199c0d1a8c17f8aa21`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:31:53.923394 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-bf65587f-b70d-4c7e-9d9f-4f8de6bf9c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:53.951532 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2623/5275] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:31:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:31:53.964010 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf65587f-b70d-4c7e-9d9f-4f8de6bf9c0e None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:53.970342 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-bf65587f-b70d-4c7e-9d9f-4f8de6bf9c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:53.975857 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4e4b0b-923b-4eb8-88a5-f8c4fa30d1e7 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:53.985292 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39234c02-ea91-4859-a36d-208008c98eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:53.986754 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39234c02-ea91-4859-a36d-208008c98eac admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:53.987198 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39234c02-ea91-4859-a36d-208008c98eac admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:53.987666 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39234c02-ea91-4859-a36d-208008c98eac admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:53.988525 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39234c02-ea91-4859-a36d-208008c98eac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:53.991755 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39234c02-ea91-4859-a36d-208008c98eac admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:54.113378 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2653/5276] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:31:53 2022] POST /identity/v3/projects => generated 391 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:31:54.117424 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39234c02-ea91-4859-a36d-208008c98eac admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:54.120534 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf65587f-b70d-4c7e-9d9f-4f8de6bf9c0e None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:54.251955 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f28556-e011-4daa-b306-cb930bdff6ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:54.252875 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f28556-e011-4daa-b306-cb930bdff6ea service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:54.255745 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f28556-e011-4daa-b306-cb930bdff6ea service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:54.256482 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f28556-e011-4daa-b306-cb930bdff6ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:54.269582 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39234c02-ea91-4859-a36d-208008c98eac admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:54.274842 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dc3b35-c0fd-4a47-b682-52cb5713d508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:54.275544 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc3b35-c0fd-4a47-b682-52cb5713d508 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:54.275833 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc3b35-c0fd-4a47-b682-52cb5713d508 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:54.277231 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc3b35-c0fd-4a47-b682-52cb5713d508 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:54.278143 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dc3b35-c0fd-4a47-b682-52cb5713d508 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:54.280979 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dc3b35-c0fd-4a47-b682-52cb5713d508 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:54.357978 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f28556-e011-4daa-b306-cb930bdff6ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:54.359681 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f28556-e011-4daa-b306-cb930bdff6ea service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:54.371894 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2624/5277] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:31:53 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:31:54.406505 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2654/5278] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:31:54 2022] POST /identity/v3/users => generated 302 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:31:54.416975 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f28556-e011-4daa-b306-cb930bdff6ea service nova] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:54.436771 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f28556-e011-4daa-b306-cb930bdff6ea service nova] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:54.442107 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13269edc-d781-4048-913b-044cc36ba52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:54.443012 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13269edc-d781-4048-913b-044cc36ba52f admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:54.443470 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13269edc-d781-4048-913b-044cc36ba52f admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:54.443946 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13269edc-d781-4048-913b-044cc36ba52f admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:54.445008 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13269edc-d781-4048-913b-044cc36ba52f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:54.447967 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13269edc-d781-4048-913b-044cc36ba52f admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:54.461432 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2625/5279] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:31:54 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:31:54.466227 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dc3b35-c0fd-4a47-b682-52cb5713d508 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:54.477221 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dc3b35-c0fd-4a47-b682-52cb5713d508 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:54.484132 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dc43a6-2c9f-40ad-bf40-a75b0a9a1eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:54.484993 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc43a6-2c9f-40ad-bf40-a75b0a9a1eaf admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:54.485284 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc43a6-2c9f-40ad-bf40-a75b0a9a1eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:54.485564 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc43a6-2c9f-40ad-bf40-a75b0a9a1eaf admin admin] PATH_INFO: `/v3/projects/0497902906ea4c059ecd90e7bb6d18f1/users/8fd5f5cef0da413b992f674c7765cbcd/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:54.504275 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dc43a6-2c9f-40ad-bf40-a75b0a9a1eaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=0497902906ea4c059ecd90e7bb6d18f1, user_id=8fd5f5cef0da413b992f674c7765cbcd, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:54.507550 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dc43a6-2c9f-40ad-bf40-a75b0a9a1eaf admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:54.625467 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2655/5280] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:31:54 2022] PUT /identity/v3/projects/0497902906ea4c059ecd90e7bb6d18f1/users/8fd5f5cef0da413b992f674c7765cbcd/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:31:54.629121 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13269edc-d781-4048-913b-044cc36ba52f admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:54.644911 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13269edc-d781-4048-913b-044cc36ba52f admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:54.790590 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177e14e7-98a6-4d58-bdaf-aad059491262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:54.791327 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e14e7-98a6-4d58-bdaf-aad059491262 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:54.792096 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e14e7-98a6-4d58-bdaf-aad059491262 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:54.792096 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e14e7-98a6-4d58-bdaf-aad059491262 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:54.792785 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177e14e7-98a6-4d58-bdaf-aad059491262 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:54.795239 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177e14e7-98a6-4d58-bdaf-aad059491262 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:54.812416 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2626/5281] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:31:54 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:31:54.813706 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dc43a6-2c9f-40ad-bf40-a75b0a9a1eaf admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:54.855139 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dc43a6-2c9f-40ad-bf40-a75b0a9a1eaf admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:54.862597 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d411ff-f2cb-49fb-a4ee-694a51e354f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:54.863876 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d411ff-f2cb-49fb-a4ee-694a51e354f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:54.864332 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d411ff-f2cb-49fb-a4ee-694a51e354f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:54.864613 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d411ff-f2cb-49fb-a4ee-694a51e354f6 admin admin] PATH_INFO: `/v3/projects/0497902906ea4c059ecd90e7bb6d18f1/users/8fd5f5cef0da413b992f674c7765cbcd/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:54.868768 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d411ff-f2cb-49fb-a4ee-694a51e354f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0497902906ea4c059ecd90e7bb6d18f1, user_id=8fd5f5cef0da413b992f674c7765cbcd, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:54.874678 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d411ff-f2cb-49fb-a4ee-694a51e354f6 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:54.906465 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2656/5282] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:31:54 2022] PUT /identity/v3/projects/0497902906ea4c059ecd90e7bb6d18f1/users/8fd5f5cef0da413b992f674c7765cbcd/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:31:54.908669 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b8d74a-087a-494a-8c41-01d15ea5fbce None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:54.909129 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b8d74a-087a-494a-8c41-01d15ea5fbce None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:54.909258 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b8d74a-087a-494a-8c41-01d15ea5fbce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:54.959139 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-43b8d74a-087a-494a-8c41-01d15ea5fbce None None] MFA Rules not processed for user `8fd5f5cef0da413b992f674c7765cbcd`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:31:54.959995 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-43b8d74a-087a-494a-8c41-01d15ea5fbce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:55.113614 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2627/5283] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:31:54 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:31:55.131864 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d411ff-f2cb-49fb-a4ee-694a51e354f6 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:55.133639 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c4d411ff-f2cb-49fb-a4ee-694a51e354f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:55.254173 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d411ff-f2cb-49fb-a4ee-694a51e354f6 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:55.259343 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94718162-67b2-4333-b780-6b23a7e078c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:55.260231 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94718162-67b2-4333-b780-6b23a7e078c6 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:55.260579 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94718162-67b2-4333-b780-6b23a7e078c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:55.260940 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94718162-67b2-4333-b780-6b23a7e078c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:55.357823 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94718162-67b2-4333-b780-6b23a7e078c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:55.359382 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94718162-67b2-4333-b780-6b23a7e078c6 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:55.372125 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2657/5284] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:31:55 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:31:55.965482 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b8d74a-087a-494a-8c41-01d15ea5fbce None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:31:55.967951 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-43b8d74a-087a-494a-8c41-01d15ea5fbce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:55.985856 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b8d74a-087a-494a-8c41-01d15ea5fbce None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:31:55.989942 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8554fd3b-278c-4c1b-8016-8ea00586d57f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:31:55.991282 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8554fd3b-278c-4c1b-8016-8ea00586d57f service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:31:55.996886 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8554fd3b-278c-4c1b-8016-8ea00586d57f service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:31:55.996886 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8554fd3b-278c-4c1b-8016-8ea00586d57f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:31:55.996886 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8554fd3b-278c-4c1b-8016-8ea00586d57f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:31:56.080851 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8554fd3b-278c-4c1b-8016-8ea00586d57f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:31:56.082339 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8554fd3b-278c-4c1b-8016-8ea00586d57f service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:31:56.097490 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2628/5285] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:31:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:32:01.131528 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94718162-67b2-4333-b780-6b23a7e078c6 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:01.153598 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94718162-67b2-4333-b780-6b23a7e078c6 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:01.171216 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abece4e0-45ce-49ca-9a01-f2d0056e5dd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:01.173590 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abece4e0-45ce-49ca-9a01-f2d0056e5dd2 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:01.176421 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abece4e0-45ce-49ca-9a01-f2d0056e5dd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:01.194251 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abece4e0-45ce-49ca-9a01-f2d0056e5dd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:01.209383 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abece4e0-45ce-49ca-9a01-f2d0056e5dd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:01.212532 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abece4e0-45ce-49ca-9a01-f2d0056e5dd2 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:01.260327 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2658/5286] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:32:01 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:32:04.822321 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8554fd3b-278c-4c1b-8016-8ea00586d57f service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:04.922282 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8554fd3b-278c-4c1b-8016-8ea00586d57f service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:04.940327 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b4ee93-f7c8-45b7-9ee5-33100ff89b16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:04.941273 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b4ee93-f7c8-45b7-9ee5-33100ff89b16 service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:04.941585 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b4ee93-f7c8-45b7-9ee5-33100ff89b16 service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:04.941712 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b4ee93-f7c8-45b7-9ee5-33100ff89b16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:04.944733 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-08b4ee93-f7c8-45b7-9ee5-33100ff89b16 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:05.003321 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b4ee93-f7c8-45b7-9ee5-33100ff89b16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:05.005099 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b4ee93-f7c8-45b7-9ee5-33100ff89b16 service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:05.065835 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2629/5287] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:32:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:32:05.895525 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abece4e0-45ce-49ca-9a01-f2d0056e5dd2 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:05.897699 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-abece4e0-45ce-49ca-9a01-f2d0056e5dd2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:05.939230 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abece4e0-45ce-49ca-9a01-f2d0056e5dd2 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:05.955937 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c3b06d-268a-4507-ad3d-726e652f73fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:05.957169 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c3b06d-268a-4507-ad3d-726e652f73fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:05.957654 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c3b06d-268a-4507-ad3d-726e652f73fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:05.958125 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c3b06d-268a-4507-ad3d-726e652f73fa admin admin] PATH_INFO: `/v3/users/1e3390c9579a4f598c46f9417b4dd046` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:05.959872 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c3b06d-268a-4507-ad3d-726e652f73fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e3390c9579a4f598c46f9417b4dd046)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:05.965425 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c3b06d-268a-4507-ad3d-726e652f73fa admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:06.196075 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-63c3b06d-268a-4507-ad3d-726e652f73fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e3390c9579a4f598c46f9417b4dd046'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:06.213874 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-63c3b06d-268a-4507-ad3d-726e652f73fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e3390c9579a4f598c46f9417b4dd046'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:06.230348 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-63c3b06d-268a-4507-ad3d-726e652f73fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e3390c9579a4f598c46f9417b4dd046'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:06.313314 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-63c3b06d-268a-4507-ad3d-726e652f73fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e3390c9579a4f598c46f9417b4dd046'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:06.314241 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-63c3b06d-268a-4507-ad3d-726e652f73fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e3390c9579a4f598c46f9417b4dd046'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:06.321897 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2659/5288] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:32:05 2022] DELETE /identity/v3/users/1e3390c9579a4f598c46f9417b4dd046 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:32:06.727328 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b4ee93-f7c8-45b7-9ee5-33100ff89b16 service nova] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:06.756687 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b4ee93-f7c8-45b7-9ee5-33100ff89b16 service nova] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:06.906382 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b053db-e3d4-4319-8f56-e5a24f5a8135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:06.908394 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b053db-e3d4-4319-8f56-e5a24f5a8135 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:06.908846 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b053db-e3d4-4319-8f56-e5a24f5a8135 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:06.909341 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b053db-e3d4-4319-8f56-e5a24f5a8135 admin admin] PATH_INFO: `/v3/projects/8bd6f25048cd4798985e725f734f1845` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:06.911761 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b053db-e3d4-4319-8f56-e5a24f5a8135 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bd6f25048cd4798985e725f734f1845)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:06.914961 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b053db-e3d4-4319-8f56-e5a24f5a8135 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:07.121417 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-75b053db-e3d4-4319-8f56-e5a24f5a8135 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bd6f25048cd4798985e725f734f1845', 'request_id': 'req-75b053db-e3d4-4319-8f56-e5a24f5a8135'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:07.132481 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-75b053db-e3d4-4319-8f56-e5a24f5a8135 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bd6f25048cd4798985e725f734f1845', 'request_id': 'req-75b053db-e3d4-4319-8f56-e5a24f5a8135'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:07.167550 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-75b053db-e3d4-4319-8f56-e5a24f5a8135 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bd6f25048cd4798985e725f734f1845', 'request_id': 'req-75b053db-e3d4-4319-8f56-e5a24f5a8135'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:07.282741 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-75b053db-e3d4-4319-8f56-e5a24f5a8135 admin admin] The token cache is being invalidate because project 8bd6f25048cd4798985e725f734f1845 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:32:07.283181 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-75b053db-e3d4-4319-8f56-e5a24f5a8135 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:07.291935 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-75b053db-e3d4-4319-8f56-e5a24f5a8135 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:07.294923 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2630/5289] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:32:06 2022] DELETE /identity/v3/projects/8bd6f25048cd4798985e725f734f1845 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:32:07.301090 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4d667-b387-4f55-a783-12554190c6f0 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:07.301708 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4d667-b387-4f55-a783-12554190c6f0 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:07.301708 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4d667-b387-4f55-a783-12554190c6f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:07.329993 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-c9a4d667-b387-4f55-a783-12554190c6f0 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:32:07.333224 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c9a4d667-b387-4f55-a783-12554190c6f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:07.427561 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2660/5290] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:32:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:32:07.434533 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bcc375-1bc6-4e4c-8997-5378287326a8 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:07.435285 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bcc375-1bc6-4e4c-8997-5378287326a8 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:07.435971 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bcc375-1bc6-4e4c-8997-5378287326a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:07.479407 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-62bcc375-1bc6-4e4c-8997-5378287326a8 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:32:07.481621 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-62bcc375-1bc6-4e4c-8997-5378287326a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:07.500177 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a4d667-b387-4f55-a783-12554190c6f0 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:07.500969 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2631/5291] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:32:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:32:07.510055 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a4d667-b387-4f55-a783-12554190c6f0 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:07.531423 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa90621e-37f9-406b-bc5a-b1a74406a7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:07.532219 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa90621e-37f9-406b-bc5a-b1a74406a7dd admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:07.532508 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa90621e-37f9-406b-bc5a-b1a74406a7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:07.532788 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa90621e-37f9-406b-bc5a-b1a74406a7dd admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:07.533531 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa90621e-37f9-406b-bc5a-b1a74406a7dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:32:07.534019 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa90621e-37f9-406b-bc5a-b1a74406a7dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:07.535807 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa90621e-37f9-406b-bc5a-b1a74406a7dd admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:07.550672 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2661/5292] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:32:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:32:07.554789 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bcc375-1bc6-4e4c-8997-5378287326a8 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:07.565586 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bcc375-1bc6-4e4c-8997-5378287326a8 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:07.570633 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd68e4-6a74-419f-9423-ff00e718025d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:07.571336 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd68e4-6a74-419f-9423-ff00e718025d admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:07.571660 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd68e4-6a74-419f-9423-ff00e718025d admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:07.571939 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd68e4-6a74-419f-9423-ff00e718025d admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:07.572622 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfd68e4-6a74-419f-9423-ff00e718025d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:07.575196 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfd68e4-6a74-419f-9423-ff00e718025d admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:07.649131 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa90621e-37f9-406b-bc5a-b1a74406a7dd admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:07.653053 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-aa90621e-37f9-406b-bc5a-b1a74406a7dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:07.662859 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2632/5293] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:32:07 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:32:07.666558 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd68e4-6a74-419f-9423-ff00e718025d admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:07.674903 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa90621e-37f9-406b-bc5a-b1a74406a7dd admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:07.741726 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd68e4-6a74-419f-9423-ff00e718025d admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:07.742297 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d1829-aedf-4776-8f2c-fa3f2233a1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:07.742843 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d1829-aedf-4776-8f2c-fa3f2233a1a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:07.743207 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d1829-aedf-4776-8f2c-fa3f2233a1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:07.743590 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d1829-aedf-4776-8f2c-fa3f2233a1a9 admin admin] PATH_INFO: `/v3/users/5761ab8432a24fc4a329e487b27cf397` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:07.745003 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d1829-aedf-4776-8f2c-fa3f2233a1a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5761ab8432a24fc4a329e487b27cf397)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:07.747160 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d1829-aedf-4776-8f2c-fa3f2233a1a9 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:07.747345 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9930215f-6163-4d10-8731-7113f8896fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:07.749142 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9930215f-6163-4d10-8731-7113f8896fe0 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:07.749446 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9930215f-6163-4d10-8731-7113f8896fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:07.750142 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9930215f-6163-4d10-8731-7113f8896fe0 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:07.751121 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9930215f-6163-4d10-8731-7113f8896fe0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:07.754766 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9930215f-6163-4d10-8731-7113f8896fe0 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:07.819695 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2633/5294] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:32:07 2022] POST /identity/v3/users => generated 293 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:32:07.820932 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9930215f-6163-4d10-8731-7113f8896fe0 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:07.831408 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9930215f-6163-4d10-8731-7113f8896fe0 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:07.836740 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff3939a-ddbc-4f35-be3f-b40f2b7f6a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:07.837489 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff3939a-ddbc-4f35-be3f-b40f2b7f6a68 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:07.838100 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff3939a-ddbc-4f35-be3f-b40f2b7f6a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:07.838100 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff3939a-ddbc-4f35-be3f-b40f2b7f6a68 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:07.838764 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff3939a-ddbc-4f35-be3f-b40f2b7f6a68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:07.841231 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff3939a-ddbc-4f35-be3f-b40f2b7f6a68 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:07.854821 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2634/5295] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:32:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:32:07.857178 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff3939a-ddbc-4f35-be3f-b40f2b7f6a68 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:07.868515 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff3939a-ddbc-4f35-be3f-b40f2b7f6a68 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:07.874055 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065285cd-f8ce-4fed-957a-a92f5e4be352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:07.874744 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065285cd-f8ce-4fed-957a-a92f5e4be352 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:07.875030 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065285cd-f8ce-4fed-957a-a92f5e4be352 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:07.875310 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065285cd-f8ce-4fed-957a-a92f5e4be352 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:07.876087 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065285cd-f8ce-4fed-957a-a92f5e4be352 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:07.877787 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065285cd-f8ce-4fed-957a-a92f5e4be352 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:07.893250 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2635/5296] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:32:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:32:07.894755 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065285cd-f8ce-4fed-957a-a92f5e4be352 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:07.906456 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065285cd-f8ce-4fed-957a-a92f5e4be352 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:07.910667 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-705d1829-aedf-4776-8f2c-fa3f2233a1a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5761ab8432a24fc4a329e487b27cf397'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:07.911541 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f32f41-1726-4ae9-afb7-5cd250cbfacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:07.912549 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f32f41-1726-4ae9-afb7-5cd250cbfacf admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:07.912895 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f32f41-1726-4ae9-afb7-5cd250cbfacf admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:07.913236 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f32f41-1726-4ae9-afb7-5cd250cbfacf admin admin] PATH_INFO: `/v3/projects/2a1393fd6fd94533b439ca5f156d94ee/users/0e40446fedca416883f7321a3de390bf/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:07.926733 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-705d1829-aedf-4776-8f2c-fa3f2233a1a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5761ab8432a24fc4a329e487b27cf397'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:07.932056 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f32f41-1726-4ae9-afb7-5cd250cbfacf admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a1393fd6fd94533b439ca5f156d94ee, user_id=0e40446fedca416883f7321a3de390bf, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:07.934951 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f32f41-1726-4ae9-afb7-5cd250cbfacf admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:07.936403 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-705d1829-aedf-4776-8f2c-fa3f2233a1a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5761ab8432a24fc4a329e487b27cf397'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:08.043774 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2636/5297] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:32:07 2022] PUT /identity/v3/projects/2a1393fd6fd94533b439ca5f156d94ee/users/0e40446fedca416883f7321a3de390bf/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:32:08.054476 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea699aef-49b7-4f65-b549-f9916046cdaf None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:08.054767 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea699aef-49b7-4f65-b549-f9916046cdaf None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:08.055046 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea699aef-49b7-4f65-b549-f9916046cdaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:08.062356 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-705d1829-aedf-4776-8f2c-fa3f2233a1a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5761ab8432a24fc4a329e487b27cf397'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:08.063527 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-705d1829-aedf-4776-8f2c-fa3f2233a1a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5761ab8432a24fc4a329e487b27cf397'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:08.074095 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2662/5298] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:32:07 2022] DELETE /identity/v3/users/5761ab8432a24fc4a329e487b27cf397 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:32:08.078647 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f21ac-b58e-4009-a225-a62e7aba290b None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:08.079211 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f21ac-b58e-4009-a225-a62e7aba290b None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:08.079853 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f21ac-b58e-4009-a225-a62e7aba290b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:08.092696 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-ea699aef-49b7-4f65-b549-f9916046cdaf None None] MFA Rules not processed for user `0e40446fedca416883f7321a3de390bf`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:32:08.094239 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-ea699aef-49b7-4f65-b549-f9916046cdaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:08.151514 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-d01f21ac-b58e-4009-a225-a62e7aba290b None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:32:08.155861 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d01f21ac-b58e-4009-a225-a62e7aba290b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:08.203544 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2637/5299] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:32:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:32:08.213151 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea699aef-49b7-4f65-b549-f9916046cdaf None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:08.214755 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-ea699aef-49b7-4f65-b549-f9916046cdaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:08.265008 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2663/5300] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:32:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:32:08.274849 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01f21ac-b58e-4009-a225-a62e7aba290b None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:08.276442 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d01f21ac-b58e-4009-a225-a62e7aba290b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:08.318411 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea699aef-49b7-4f65-b549-f9916046cdaf None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:08.325642 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e95de-dda5-44de-bc7b-8b2ef630f2ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:08.326485 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e95de-dda5-44de-bc7b-8b2ef630f2ef service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:08.327169 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e95de-dda5-44de-bc7b-8b2ef630f2ef service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:08.327437 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e95de-dda5-44de-bc7b-8b2ef630f2ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:08.338406 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028e95de-dda5-44de-bc7b-8b2ef630f2ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:08.340347 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028e95de-dda5-44de-bc7b-8b2ef630f2ef service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:08.345545 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01f21ac-b58e-4009-a225-a62e7aba290b None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:08.350338 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b0e8e-36d8-45a4-bea6-31b696137083 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:08.351050 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b0e8e-36d8-45a4-bea6-31b696137083 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:08.354685 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2638/5301] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:32:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:32:08.354796 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b0e8e-36d8-45a4-bea6-31b696137083 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:08.354796 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b0e8e-36d8-45a4-bea6-31b696137083 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:08.363627 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78b0e8e-36d8-45a4-bea6-31b696137083 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:08.365127 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78b0e8e-36d8-45a4-bea6-31b696137083 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:08.381888 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2664/5302] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:32:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:32:08.734152 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e95de-dda5-44de-bc7b-8b2ef630f2ef service nova] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:08.735873 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-028e95de-dda5-44de-bc7b-8b2ef630f2ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:08.752647 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e95de-dda5-44de-bc7b-8b2ef630f2ef service nova] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:08.771261 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac27a8-55b3-4b79-b460-543347e9a719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:08.772237 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac27a8-55b3-4b79-b460-543347e9a719 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:08.772524 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac27a8-55b3-4b79-b460-543347e9a719 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:08.773281 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac27a8-55b3-4b79-b460-543347e9a719 admin admin] PATH_INFO: `/v3/projects/4d79f7e4d0ac4ea98550cf3b65fe66af` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:08.774499 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fac27a8-55b3-4b79-b460-543347e9a719 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d79f7e4d0ac4ea98550cf3b65fe66af)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:08.784428 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fac27a8-55b3-4b79-b460-543347e9a719 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:08.900202 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebabb113-6867-4a04-ab39-b1c80aac8601 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:08.900419 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebabb113-6867-4a04-ab39-b1c80aac8601 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:08.900979 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebabb113-6867-4a04-ab39-b1c80aac8601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:08.922587 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-ebabb113-6867-4a04-ab39-b1c80aac8601 None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:32:08.923851 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ebabb113-6867-4a04-ab39-b1c80aac8601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:08.972732 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3fac27a8-55b3-4b79-b460-543347e9a719 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d79f7e4d0ac4ea98550cf3b65fe66af', 'request_id': 'req-3fac27a8-55b3-4b79-b460-543347e9a719'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:08.979929 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3fac27a8-55b3-4b79-b460-543347e9a719 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d79f7e4d0ac4ea98550cf3b65fe66af', 'request_id': 'req-3fac27a8-55b3-4b79-b460-543347e9a719'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:08.989239 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3fac27a8-55b3-4b79-b460-543347e9a719 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d79f7e4d0ac4ea98550cf3b65fe66af', 'request_id': 'req-3fac27a8-55b3-4b79-b460-543347e9a719'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:09.002796 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2665/5303] 10.222.0.52 () {58 vars in 1009 bytes} [Sat May 14 21:32:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:32:09.024113 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebabb113-6867-4a04-ab39-b1c80aac8601 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:09.025790 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ebabb113-6867-4a04-ab39-b1c80aac8601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:09.115191 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebabb113-6867-4a04-ab39-b1c80aac8601 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:09.124195 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3fac27a8-55b3-4b79-b460-543347e9a719 admin admin] The token cache is being invalidate because project 4d79f7e4d0ac4ea98550cf3b65fe66af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:32:09.124508 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3fac27a8-55b3-4b79-b460-543347e9a719 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:09.126765 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3fac27a8-55b3-4b79-b460-543347e9a719 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:09.129235 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2639/5304] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:32:08 2022] DELETE /identity/v3/projects/4d79f7e4d0ac4ea98550cf3b65fe66af => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:32:09.135422 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac27a8-55b3-4b79-b460-543347e9a719 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:09.138337 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-3fac27a8-55b3-4b79-b460-543347e9a719 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:09.231386 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dc45df-ee83-424a-aa42-3dc817b71f5d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:09.232291 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc45df-ee83-424a-aa42-3dc817b71f5d service swift] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:09.232721 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc45df-ee83-424a-aa42-3dc817b71f5d service swift] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:09.233208 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc45df-ee83-424a-aa42-3dc817b71f5d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:09.235288 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-14dc45df-ee83-424a-aa42-3dc817b71f5d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:09.298773 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac27a8-55b3-4b79-b460-543347e9a719 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:09.304470 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e265c682-2c67-417b-81b0-4bf8c05518ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:09.306318 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e265c682-2c67-417b-81b0-4bf8c05518ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:09.306318 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e265c682-2c67-417b-81b0-4bf8c05518ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:09.306482 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dc45df-ee83-424a-aa42-3dc817b71f5d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:09.306560 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e265c682-2c67-417b-81b0-4bf8c05518ff admin admin] PATH_INFO: `/v3/users/8fd5f5cef0da413b992f674c7765cbcd` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:09.307660 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e265c682-2c67-417b-81b0-4bf8c05518ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fd5f5cef0da413b992f674c7765cbcd)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:09.307867 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dc45df-ee83-424a-aa42-3dc817b71f5d service swift] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:09.310324 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e265c682-2c67-417b-81b0-4bf8c05518ff admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:09.325754 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2666/5305] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 21:32:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 14 21:32:09.591548 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e265c682-2c67-417b-81b0-4bf8c05518ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fd5f5cef0da413b992f674c7765cbcd'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:09.601644 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e265c682-2c67-417b-81b0-4bf8c05518ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fd5f5cef0da413b992f674c7765cbcd'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:09.602475 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e265c682-2c67-417b-81b0-4bf8c05518ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fd5f5cef0da413b992f674c7765cbcd'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:09.707567 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e265c682-2c67-417b-81b0-4bf8c05518ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fd5f5cef0da413b992f674c7765cbcd'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:09.741665 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e265c682-2c67-417b-81b0-4bf8c05518ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fd5f5cef0da413b992f674c7765cbcd'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:09.758045 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2640/5306] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:32:09 2022] DELETE /identity/v3/users/8fd5f5cef0da413b992f674c7765cbcd => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:32:10.648415 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b1095-a3f2-4b65-9681-21ad8ff76734 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:10.648981 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b1095-a3f2-4b65-9681-21ad8ff76734 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:10.649060 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b1095-a3f2-4b65-9681-21ad8ff76734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:10.678429 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-8e4b1095-a3f2-4b65-9681-21ad8ff76734 None None] MFA Rules not processed for user `a8e967d05266477dbc5748ed77b8c69e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:32:10.680114 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-8e4b1095-a3f2-4b65-9681-21ad8ff76734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:10.703564 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e265c682-2c67-417b-81b0-4bf8c05518ff admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:10.706133 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e265c682-2c67-417b-81b0-4bf8c05518ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:10.852863 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e265c682-2c67-417b-81b0-4bf8c05518ff admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:10.857372 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2667/5307] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:32:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:32:10.867914 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec90a5e5-24e1-4eb2-9768-e2b5327e0cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:10.869018 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec90a5e5-24e1-4eb2-9768-e2b5327e0cc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:10.869637 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec90a5e5-24e1-4eb2-9768-e2b5327e0cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:10.869928 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec90a5e5-24e1-4eb2-9768-e2b5327e0cc3 admin admin] PATH_INFO: `/v3/projects/0497902906ea4c059ecd90e7bb6d18f1` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:10.872151 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec90a5e5-24e1-4eb2-9768-e2b5327e0cc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0497902906ea4c059ecd90e7bb6d18f1)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:10.875232 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec90a5e5-24e1-4eb2-9768-e2b5327e0cc3 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:11.073268 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ec90a5e5-24e1-4eb2-9768-e2b5327e0cc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0497902906ea4c059ecd90e7bb6d18f1', 'request_id': 'req-ec90a5e5-24e1-4eb2-9768-e2b5327e0cc3'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:11.084025 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ec90a5e5-24e1-4eb2-9768-e2b5327e0cc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0497902906ea4c059ecd90e7bb6d18f1', 'request_id': 'req-ec90a5e5-24e1-4eb2-9768-e2b5327e0cc3'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:11.098018 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ec90a5e5-24e1-4eb2-9768-e2b5327e0cc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0497902906ea4c059ecd90e7bb6d18f1', 'request_id': 'req-ec90a5e5-24e1-4eb2-9768-e2b5327e0cc3'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:11.255151 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ec90a5e5-24e1-4eb2-9768-e2b5327e0cc3 admin admin] The token cache is being invalidate because project 0497902906ea4c059ecd90e7bb6d18f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:32:11.255806 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ec90a5e5-24e1-4eb2-9768-e2b5327e0cc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:11.260095 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ec90a5e5-24e1-4eb2-9768-e2b5327e0cc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:11.270686 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2641/5308] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:32:10 2022] DELETE /identity/v3/projects/0497902906ea4c059ecd90e7bb6d18f1 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:32:11.271718 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760ca21-f623-4dfe-bcac-609f96011b21 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:11.272382 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760ca21-f623-4dfe-bcac-609f96011b21 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:11.272848 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760ca21-f623-4dfe-bcac-609f96011b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:11.329543 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-a760ca21-f623-4dfe-bcac-609f96011b21 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:32:11.331327 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-a760ca21-f623-4dfe-bcac-609f96011b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:11.490921 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce3d85-0c85-4f60-8deb-9c892b8d3f2e None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:11.491846 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce3d85-0c85-4f60-8deb-9c892b8d3f2e None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:11.492385 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce3d85-0c85-4f60-8deb-9c892b8d3f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:11.494365 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2668/5309] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:32:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:32:11.516697 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-82ce3d85-0c85-4f60-8deb-9c892b8d3f2e None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:32:11.518188 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-82ce3d85-0c85-4f60-8deb-9c892b8d3f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:11.529948 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2642/5310] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:32:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:32:11.535751 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a760ca21-f623-4dfe-bcac-609f96011b21 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:11.586952 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a760ca21-f623-4dfe-bcac-609f96011b21 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:11.597258 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d901f567-abf6-4f28-af8f-3d3aed1af7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:11.598363 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d901f567-abf6-4f28-af8f-3d3aed1af7d6 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:11.598913 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d901f567-abf6-4f28-af8f-3d3aed1af7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:11.600714 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d901f567-abf6-4f28-af8f-3d3aed1af7d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:11.601604 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d901f567-abf6-4f28-af8f-3d3aed1af7d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:32:11.604509 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d901f567-abf6-4f28-af8f-3d3aed1af7d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:11.623609 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d901f567-abf6-4f28-af8f-3d3aed1af7d6 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:11.664927 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2669/5311] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:32:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:32:11.669438 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ce3d85-0c85-4f60-8deb-9c892b8d3f2e None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:11.679740 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ce3d85-0c85-4f60-8deb-9c892b8d3f2e None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:11.688149 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3949708-97dc-4166-b483-a3dc22c1f4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:11.689407 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3949708-97dc-4166-b483-a3dc22c1f4f3 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:11.690040 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3949708-97dc-4166-b483-a3dc22c1f4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:11.694818 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3949708-97dc-4166-b483-a3dc22c1f4f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:11.696454 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3949708-97dc-4166-b483-a3dc22c1f4f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:11.700453 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3949708-97dc-4166-b483-a3dc22c1f4f3 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:11.841472 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2643/5312] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:32:11 2022] POST /identity/v3/projects => generated 405 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:32:11.845761 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d901f567-abf6-4f28-af8f-3d3aed1af7d6 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:11.864125 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d901f567-abf6-4f28-af8f-3d3aed1af7d6 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:11.979137 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1635f2ce-5083-47e5-b26b-6831b0e5a318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:11.979869 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635f2ce-5083-47e5-b26b-6831b0e5a318 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:11.980891 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635f2ce-5083-47e5-b26b-6831b0e5a318 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:11.981239 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635f2ce-5083-47e5-b26b-6831b0e5a318 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:11.981840 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1635f2ce-5083-47e5-b26b-6831b0e5a318 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:11.984184 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1635f2ce-5083-47e5-b26b-6831b0e5a318 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:12.124927 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2670/5313] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:32:11 2022] POST /identity/v3/users => generated 303 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:32:12.126010 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3949708-97dc-4166-b483-a3dc22c1f4f3 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:12.150100 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3949708-97dc-4166-b483-a3dc22c1f4f3 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:12.162336 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c3ba93-972f-4a04-b594-016094674acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:12.163786 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c3ba93-972f-4a04-b594-016094674acd admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:12.164275 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c3ba93-972f-4a04-b594-016094674acd admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:12.164658 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c3ba93-972f-4a04-b594-016094674acd admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:12.165504 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c3ba93-972f-4a04-b594-016094674acd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:12.167280 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c3ba93-972f-4a04-b594-016094674acd admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:12.195535 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2644/5314] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:32:12 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:32:12.208697 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1635f2ce-5083-47e5-b26b-6831b0e5a318 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:12.222974 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1635f2ce-5083-47e5-b26b-6831b0e5a318 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:12.229578 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0517b80a-9a18-4769-a127-34aaa63afcf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:12.230284 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517b80a-9a18-4769-a127-34aaa63afcf6 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:12.230573 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517b80a-9a18-4769-a127-34aaa63afcf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:12.231122 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517b80a-9a18-4769-a127-34aaa63afcf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:12.232008 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0517b80a-9a18-4769-a127-34aaa63afcf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:12.234394 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0517b80a-9a18-4769-a127-34aaa63afcf6 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:12.256654 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2671/5315] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:32:12 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:32:12.257887 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c3ba93-972f-4a04-b594-016094674acd admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:12.278700 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c3ba93-972f-4a04-b594-016094674acd admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:12.287689 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aed4632-f225-4fc8-ab05-4ef027470b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:12.288781 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aed4632-f225-4fc8-ab05-4ef027470b8a admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:12.289048 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aed4632-f225-4fc8-ab05-4ef027470b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:12.289349 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aed4632-f225-4fc8-ab05-4ef027470b8a admin admin] PATH_INFO: `/v3/projects/574107fbfe6248259dcdf198e50cc290/users/cb4f4488c7ae4627b85e119ffaaf757f/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:12.309410 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aed4632-f225-4fc8-ab05-4ef027470b8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=574107fbfe6248259dcdf198e50cc290, user_id=cb4f4488c7ae4627b85e119ffaaf757f, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:12.312846 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aed4632-f225-4fc8-ab05-4ef027470b8a admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:12.399630 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2645/5316] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:32:12 2022] PUT /identity/v3/projects/574107fbfe6248259dcdf198e50cc290/users/cb4f4488c7ae4627b85e119ffaaf757f/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:32:12.404061 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93659153-45b8-4c16-b442-cac4fc445401 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:12.404395 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93659153-45b8-4c16-b442-cac4fc445401 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:12.404682 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93659153-45b8-4c16-b442-cac4fc445401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:12.481395 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-93659153-45b8-4c16-b442-cac4fc445401 None None] MFA Rules not processed for user `cb4f4488c7ae4627b85e119ffaaf757f`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:32:12.483725 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-93659153-45b8-4c16-b442-cac4fc445401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:12.619302 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2672/5317] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:32:12 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:32:12.623991 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aed4632-f225-4fc8-ab05-4ef027470b8a admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:12.863538 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aed4632-f225-4fc8-ab05-4ef027470b8a admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:12.889565 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e68c73-c43c-4eba-bed5-6a43d883589d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:12.890667 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e68c73-c43c-4eba-bed5-6a43d883589d admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:12.891362 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e68c73-c43c-4eba-bed5-6a43d883589d admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:12.891940 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e68c73-c43c-4eba-bed5-6a43d883589d admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:12.892847 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e68c73-c43c-4eba-bed5-6a43d883589d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:12.895011 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e68c73-c43c-4eba-bed5-6a43d883589d admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:13.067899 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2646/5318] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:32:12 2022] POST /identity/v3/projects => generated 407 bytes in 444 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:32:13.071879 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93659153-45b8-4c16-b442-cac4fc445401 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:13.098009 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93659153-45b8-4c16-b442-cac4fc445401 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:13.222125 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee650a10-3c33-4253-aae6-c7e202e2de34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:13.226066 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee650a10-3c33-4253-aae6-c7e202e2de34 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:13.226934 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee650a10-3c33-4253-aae6-c7e202e2de34 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:13.228217 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee650a10-3c33-4253-aae6-c7e202e2de34 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:13.229385 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee650a10-3c33-4253-aae6-c7e202e2de34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:13.232724 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee650a10-3c33-4253-aae6-c7e202e2de34 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:13.361478 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2673/5319] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:32:13 2022] POST /identity/v3/users => generated 310 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:32:13.365550 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e68c73-c43c-4eba-bed5-6a43d883589d admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:13.383032 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e68c73-c43c-4eba-bed5-6a43d883589d admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:13.390264 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ab8697-9327-4bf6-93be-f319b823c21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:13.391359 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab8697-9327-4bf6-93be-f319b823c21f admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:13.392422 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab8697-9327-4bf6-93be-f319b823c21f admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:13.392722 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab8697-9327-4bf6-93be-f319b823c21f admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:13.393469 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ab8697-9327-4bf6-93be-f319b823c21f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:13.395119 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ab8697-9327-4bf6-93be-f319b823c21f admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:13.411220 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2647/5320] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:32:13 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:32:13.415126 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee650a10-3c33-4253-aae6-c7e202e2de34 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:13.430580 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee650a10-3c33-4253-aae6-c7e202e2de34 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:13.437050 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54fdd11-5ffe-4048-9e50-e279462b497f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:13.438578 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54fdd11-5ffe-4048-9e50-e279462b497f admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:13.439706 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54fdd11-5ffe-4048-9e50-e279462b497f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:13.440217 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54fdd11-5ffe-4048-9e50-e279462b497f admin admin] PATH_INFO: `/v3/projects/6dc7b08c0f7749cf9834cc2d878c26af/users/7b77765f89814ef099ba857616969d97/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:13.464348 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54fdd11-5ffe-4048-9e50-e279462b497f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dc7b08c0f7749cf9834cc2d878c26af, user_id=7b77765f89814ef099ba857616969d97, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:13.473927 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54fdd11-5ffe-4048-9e50-e279462b497f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:13.568692 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2674/5321] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:32:13 2022] PUT /identity/v3/projects/6dc7b08c0f7749cf9834cc2d878c26af/users/7b77765f89814ef099ba857616969d97/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:32:13.572498 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ab8697-9327-4bf6-93be-f319b823c21f admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:13.600998 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ab8697-9327-4bf6-93be-f319b823c21f admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:13.737527 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d67d69-07e7-4166-86f2-704b8a44cd6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:13.738287 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d67d69-07e7-4166-86f2-704b8a44cd6b admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:13.738576 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d67d69-07e7-4166-86f2-704b8a44cd6b admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:13.738859 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d67d69-07e7-4166-86f2-704b8a44cd6b admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:13.749745 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d67d69-07e7-4166-86f2-704b8a44cd6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:13.751669 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d67d69-07e7-4166-86f2-704b8a44cd6b admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:13.766835 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2648/5322] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:32:13 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:32:13.771582 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54fdd11-5ffe-4048-9e50-e279462b497f admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:13.784517 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54fdd11-5ffe-4048-9e50-e279462b497f admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:13.791701 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85b1e64-0f38-4195-bc29-1e624b106093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:13.794461 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b1e64-0f38-4195-bc29-1e624b106093 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:13.795434 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b1e64-0f38-4195-bc29-1e624b106093 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:13.795956 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b1e64-0f38-4195-bc29-1e624b106093 admin admin] PATH_INFO: `/v3/projects/6dc7b08c0f7749cf9834cc2d878c26af/users/7b77765f89814ef099ba857616969d97/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:13.799115 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85b1e64-0f38-4195-bc29-1e624b106093 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dc7b08c0f7749cf9834cc2d878c26af, user_id=7b77765f89814ef099ba857616969d97, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:13.802664 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85b1e64-0f38-4195-bc29-1e624b106093 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:13.819729 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2675/5323] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:32:13 2022] PUT /identity/v3/projects/6dc7b08c0f7749cf9834cc2d878c26af/users/7b77765f89814ef099ba857616969d97/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:32:13.827544 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b510e0d-37b0-42ee-bcec-48744a2eb518 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:13.827835 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b510e0d-37b0-42ee-bcec-48744a2eb518 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:13.828113 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b510e0d-37b0-42ee-bcec-48744a2eb518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:13.859655 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-5b510e0d-37b0-42ee-bcec-48744a2eb518 None None] MFA Rules not processed for user `7b77765f89814ef099ba857616969d97`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:32:13.861234 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-5b510e0d-37b0-42ee-bcec-48744a2eb518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:13.977644 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2649/5324] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:32:13 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:32:13.985198 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85b1e64-0f38-4195-bc29-1e624b106093 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:13.988960 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e85b1e64-0f38-4195-bc29-1e624b106093 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:14.072167 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85b1e64-0f38-4195-bc29-1e624b106093 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:14.076626 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe5786a-08b2-461e-aa5c-8c745e909545 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:14.077345 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5786a-08b2-461e-aa5c-8c745e909545 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:14.077627 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5786a-08b2-461e-aa5c-8c745e909545 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:14.078292 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5786a-08b2-461e-aa5c-8c745e909545 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:14.194904 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe5786a-08b2-461e-aa5c-8c745e909545 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:14.197351 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe5786a-08b2-461e-aa5c-8c745e909545 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:14.211962 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2676/5325] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:32:13 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:32:15.388989 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b510e0d-37b0-42ee-bcec-48744a2eb518 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:15.390496 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-5b510e0d-37b0-42ee-bcec-48744a2eb518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:15.491579 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b510e0d-37b0-42ee-bcec-48744a2eb518 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:15.498459 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0400324a-5e57-4a2b-9fee-3e694aec5c5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:15.499183 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0400324a-5e57-4a2b-9fee-3e694aec5c5a service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:15.499545 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0400324a-5e57-4a2b-9fee-3e694aec5c5a service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:15.499859 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0400324a-5e57-4a2b-9fee-3e694aec5c5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:15.509809 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0400324a-5e57-4a2b-9fee-3e694aec5c5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:15.512332 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0400324a-5e57-4a2b-9fee-3e694aec5c5a service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:15.525995 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2650/5326] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:32:15 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:32:17.226912 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe5786a-08b2-461e-aa5c-8c745e909545 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:17.228512 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-8fe5786a-08b2-461e-aa5c-8c745e909545 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:17.282981 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe5786a-08b2-461e-aa5c-8c745e909545 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:17.300571 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cd5ee8-e6c3-4911-ba6c-d6cb80ad7086 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:17.301299 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cd5ee8-e6c3-4911-ba6c-d6cb80ad7086 service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:17.301591 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cd5ee8-e6c3-4911-ba6c-d6cb80ad7086 service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:17.302344 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cd5ee8-e6c3-4911-ba6c-d6cb80ad7086 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:17.309634 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d6cd5ee8-e6c3-4911-ba6c-d6cb80ad7086 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:17.496987 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cd5ee8-e6c3-4911-ba6c-d6cb80ad7086 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:17.498610 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cd5ee8-e6c3-4911-ba6c-d6cb80ad7086 service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:17.532981 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2677/5327] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:32:17 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:32:20.094947 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0400324a-5e57-4a2b-9fee-3e694aec5c5a service nova] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:20.117412 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0400324a-5e57-4a2b-9fee-3e694aec5c5a service nova] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:20.137328 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c436f117-6b2c-4711-bade-80e4a2fa4921 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:20.138360 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c436f117-6b2c-4711-bade-80e4a2fa4921 service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:20.138360 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c436f117-6b2c-4711-bade-80e4a2fa4921 service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:20.138672 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c436f117-6b2c-4711-bade-80e4a2fa4921 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:20.141390 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c436f117-6b2c-4711-bade-80e4a2fa4921 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:20.335683 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c436f117-6b2c-4711-bade-80e4a2fa4921 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:20.337902 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c436f117-6b2c-4711-bade-80e4a2fa4921 service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:20.378354 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2651/5328] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:32:20 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:32:21.894737 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cd5ee8-e6c3-4911-ba6c-d6cb80ad7086 service nova] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:21.894737 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d6cd5ee8-e6c3-4911-ba6c-d6cb80ad7086 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:22.098793 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cd5ee8-e6c3-4911-ba6c-d6cb80ad7086 service nova] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:22.104558 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7226682-9354-458b-8903-788e5c726859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:22.141514 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7226682-9354-458b-8903-788e5c726859 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:22.142059 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7226682-9354-458b-8903-788e5c726859 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:22.143536 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7226682-9354-458b-8903-788e5c726859 admin admin] PATH_INFO: `/v3/users/4ad81cc85a4146199c0d1a8c17f8aa21` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:22.146895 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7226682-9354-458b-8903-788e5c726859 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ad81cc85a4146199c0d1a8c17f8aa21)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:22.153711 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7226682-9354-458b-8903-788e5c726859 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:22.480602 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b7226682-9354-458b-8903-788e5c726859 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ad81cc85a4146199c0d1a8c17f8aa21'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:22.480602 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b7226682-9354-458b-8903-788e5c726859 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ad81cc85a4146199c0d1a8c17f8aa21'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:22.480602 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b7226682-9354-458b-8903-788e5c726859 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ad81cc85a4146199c0d1a8c17f8aa21'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:22.918906 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b7226682-9354-458b-8903-788e5c726859 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ad81cc85a4146199c0d1a8c17f8aa21'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:22.921271 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b7226682-9354-458b-8903-788e5c726859 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ad81cc85a4146199c0d1a8c17f8aa21'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:22.936236 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2678/5329] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:32:21 2022] DELETE /identity/v3/users/4ad81cc85a4146199c0d1a8c17f8aa21 => generated 0 bytes in 1044 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:32:23.762324 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c436f117-6b2c-4711-bade-80e4a2fa4921 service nova] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:23.783039 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c436f117-6b2c-4711-bade-80e4a2fa4921 service nova] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:23.870658 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20951ea-826a-447d-8c4e-d922c85eea85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:23.871739 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20951ea-826a-447d-8c4e-d922c85eea85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:23.872030 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20951ea-826a-447d-8c4e-d922c85eea85 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:23.872316 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20951ea-826a-447d-8c4e-d922c85eea85 admin admin] PATH_INFO: `/v3/projects/5241cdff4cf3483c9b0dbdf7bf4e0ceb` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:23.876993 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20951ea-826a-447d-8c4e-d922c85eea85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5241cdff4cf3483c9b0dbdf7bf4e0ceb)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:23.878951 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20951ea-826a-447d-8c4e-d922c85eea85 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:24.096608 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b20951ea-826a-447d-8c4e-d922c85eea85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5241cdff4cf3483c9b0dbdf7bf4e0ceb', 'request_id': 'req-b20951ea-826a-447d-8c4e-d922c85eea85'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:24.104135 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b20951ea-826a-447d-8c4e-d922c85eea85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5241cdff4cf3483c9b0dbdf7bf4e0ceb', 'request_id': 'req-b20951ea-826a-447d-8c4e-d922c85eea85'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:24.114838 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b20951ea-826a-447d-8c4e-d922c85eea85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5241cdff4cf3483c9b0dbdf7bf4e0ceb', 'request_id': 'req-b20951ea-826a-447d-8c4e-d922c85eea85'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:24.211145 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b20951ea-826a-447d-8c4e-d922c85eea85 admin admin] The token cache is being invalidate because project 5241cdff4cf3483c9b0dbdf7bf4e0ceb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:32:24.211571 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b20951ea-826a-447d-8c4e-d922c85eea85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:24.215613 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b20951ea-826a-447d-8c4e-d922c85eea85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:24.224301 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2652/5330] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:32:23 2022] DELETE /identity/v3/projects/5241cdff4cf3483c9b0dbdf7bf4e0ceb => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:32:24.225428 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c54bf4c-0713-47b8-abfb-a9501a178d9d None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:24.226504 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c54bf4c-0713-47b8-abfb-a9501a178d9d None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:24.226748 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c54bf4c-0713-47b8-abfb-a9501a178d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:24.289693 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-0c54bf4c-0713-47b8-abfb-a9501a178d9d None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:32:24.294629 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-0c54bf4c-0713-47b8-abfb-a9501a178d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:24.445441 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2679/5331] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:32:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:32:24.454689 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e38968-9720-42bb-86ee-af763a90152c None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:24.454986 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e38968-9720-42bb-86ee-af763a90152c None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:24.455270 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e38968-9720-42bb-86ee-af763a90152c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:24.493419 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-d1e38968-9720-42bb-86ee-af763a90152c None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:32:24.494973 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-d1e38968-9720-42bb-86ee-af763a90152c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:24.507197 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2653/5332] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:32:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:32:24.508112 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c54bf4c-0713-47b8-abfb-a9501a178d9d None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:24.521963 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c54bf4c-0713-47b8-abfb-a9501a178d9d None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:24.536716 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c626eef0-78c7-40f4-a79e-c9277d155a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:24.536716 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c626eef0-78c7-40f4-a79e-c9277d155a6e admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:24.536716 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c626eef0-78c7-40f4-a79e-c9277d155a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:24.536716 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c626eef0-78c7-40f4-a79e-c9277d155a6e admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:24.537266 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c626eef0-78c7-40f4-a79e-c9277d155a6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:32:24.537266 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c626eef0-78c7-40f4-a79e-c9277d155a6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:24.537266 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c626eef0-78c7-40f4-a79e-c9277d155a6e admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:24.552508 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2680/5333] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:32:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:32:24.556730 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e38968-9720-42bb-86ee-af763a90152c None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:24.571539 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e38968-9720-42bb-86ee-af763a90152c None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:24.580698 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b5e91e-93ba-47d9-a782-0cbdc3675a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:24.582684 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5e91e-93ba-47d9-a782-0cbdc3675a01 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:24.582684 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5e91e-93ba-47d9-a782-0cbdc3675a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:24.582684 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5e91e-93ba-47d9-a782-0cbdc3675a01 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:24.583745 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b5e91e-93ba-47d9-a782-0cbdc3675a01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:24.586234 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b5e91e-93ba-47d9-a782-0cbdc3675a01 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:24.781209 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2654/5334] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:32:24 2022] POST /identity/v3/projects => generated 391 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:32:24.785350 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c626eef0-78c7-40f4-a79e-c9277d155a6e admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:24.802485 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c626eef0-78c7-40f4-a79e-c9277d155a6e admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:24.935705 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca7b402-b25e-48de-84ea-1b510c67e36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:24.936416 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca7b402-b25e-48de-84ea-1b510c67e36e admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:24.936702 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca7b402-b25e-48de-84ea-1b510c67e36e admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:24.937823 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca7b402-b25e-48de-84ea-1b510c67e36e admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:24.937823 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca7b402-b25e-48de-84ea-1b510c67e36e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:24.939854 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca7b402-b25e-48de-84ea-1b510c67e36e admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:25.091981 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2681/5335] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:32:24 2022] POST /identity/v3/users => generated 296 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:32:25.096675 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b5e91e-93ba-47d9-a782-0cbdc3675a01 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:25.123452 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca7b402-b25e-48de-84ea-1b510c67e36e admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:25.125096 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b5e91e-93ba-47d9-a782-0cbdc3675a01 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:25.125614 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-aca7b402-b25e-48de-84ea-1b510c67e36e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:25.130728 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d6bb37-1bfd-4c28-84cc-bb296182d05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:25.140579 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6bb37-1bfd-4c28-84cc-bb296182d05f admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:25.140579 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6bb37-1bfd-4c28-84cc-bb296182d05f admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:25.140579 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6bb37-1bfd-4c28-84cc-bb296182d05f admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:25.140579 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d6bb37-1bfd-4c28-84cc-bb296182d05f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:25.140579 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d6bb37-1bfd-4c28-84cc-bb296182d05f admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:25.152962 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2655/5336] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:32:25 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:32:25.157140 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d6bb37-1bfd-4c28-84cc-bb296182d05f admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:25.167905 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d6bb37-1bfd-4c28-84cc-bb296182d05f admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:25.176163 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9688812b-1cda-491e-8198-463aac7619b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:25.177469 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9688812b-1cda-491e-8198-463aac7619b1 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:25.178420 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9688812b-1cda-491e-8198-463aac7619b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:25.178944 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9688812b-1cda-491e-8198-463aac7619b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:25.180408 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9688812b-1cda-491e-8198-463aac7619b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:25.185215 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9688812b-1cda-491e-8198-463aac7619b1 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:25.201298 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2656/5337] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:32:25 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:32:25.205376 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9688812b-1cda-491e-8198-463aac7619b1 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:25.220492 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9688812b-1cda-491e-8198-463aac7619b1 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:25.229277 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca7b402-b25e-48de-84ea-1b510c67e36e admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:25.238705 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b161f9-8281-4ba5-a26b-c6cfb4365cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:25.238705 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b161f9-8281-4ba5-a26b-c6cfb4365cb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:25.238705 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b161f9-8281-4ba5-a26b-c6cfb4365cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:25.238705 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b161f9-8281-4ba5-a26b-c6cfb4365cb4 admin admin] PATH_INFO: `/v3/projects/59c0f4df562340e5bb096ef2eed9239e/users/cbb8c5cf2d144e3791171eb3d6f83eca/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:25.239147 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c86e0d-b0ee-4dbd-b789-07b61763f023 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:25.239147 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c86e0d-b0ee-4dbd-b789-07b61763f023 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:25.239147 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c86e0d-b0ee-4dbd-b789-07b61763f023 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:25.239147 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c86e0d-b0ee-4dbd-b789-07b61763f023 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:25.241688 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e4c86e0d-b0ee-4dbd-b789-07b61763f023 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:25.257321 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c86e0d-b0ee-4dbd-b789-07b61763f023 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:25.259077 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c86e0d-b0ee-4dbd-b789-07b61763f023 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:25.272663 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b161f9-8281-4ba5-a26b-c6cfb4365cb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59c0f4df562340e5bb096ef2eed9239e, user_id=cbb8c5cf2d144e3791171eb3d6f83eca, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:25.274161 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2682/5338] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:32:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:32:25.294775 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b161f9-8281-4ba5-a26b-c6cfb4365cb4 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:25.388737 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2657/5339] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:32:25 2022] PUT /identity/v3/projects/59c0f4df562340e5bb096ef2eed9239e/users/cbb8c5cf2d144e3791171eb3d6f83eca/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:32:25.389388 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26fb8e-4773-43a6-8346-8d00b27808c7 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:25.389701 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26fb8e-4773-43a6-8346-8d00b27808c7 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:25.389975 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26fb8e-4773-43a6-8346-8d00b27808c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:25.415680 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-1e26fb8e-4773-43a6-8346-8d00b27808c7 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:32:25.431624 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-1e26fb8e-4773-43a6-8346-8d00b27808c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:25.538421 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2683/5340] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:32:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:32:25.551053 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b161f9-8281-4ba5-a26b-c6cfb4365cb4 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:25.553709 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b9b161f9-8281-4ba5-a26b-c6cfb4365cb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:25.648592 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b161f9-8281-4ba5-a26b-c6cfb4365cb4 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:25.658265 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643b4b39-0368-4a33-88b8-927bd55c0d9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:25.659054 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b4b39-0368-4a33-88b8-927bd55c0d9f service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:25.659417 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b4b39-0368-4a33-88b8-927bd55c0d9f service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:25.659796 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b4b39-0368-4a33-88b8-927bd55c0d9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:25.672048 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643b4b39-0368-4a33-88b8-927bd55c0d9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:25.673855 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643b4b39-0368-4a33-88b8-927bd55c0d9f service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:25.700544 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2658/5341] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:32:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:32:31.394024 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b315ccea-950f-49d7-948d-04cee62a5a99 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:31.394896 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b315ccea-950f-49d7-948d-04cee62a5a99 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:31.395183 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b315ccea-950f-49d7-948d-04cee62a5a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:31.427947 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-b315ccea-950f-49d7-948d-04cee62a5a99 None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:32:31.429776 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b315ccea-950f-49d7-948d-04cee62a5a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:31.504624 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2684/5342] 10.222.0.52 () {58 vars in 967 bytes} [Sat May 14 21:32:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:32:31.532312 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643b4b39-0368-4a33-88b8-927bd55c0d9f service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:31.533983 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-643b4b39-0368-4a33-88b8-927bd55c0d9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:31.660075 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643b4b39-0368-4a33-88b8-927bd55c0d9f service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:31.673713 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852d4853-77be-492f-8e39-0cfca9fd4ad6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:31.674392 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d4853-77be-492f-8e39-0cfca9fd4ad6 service swift] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:31.674674 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d4853-77be-492f-8e39-0cfca9fd4ad6 service swift] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:31.674973 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d4853-77be-492f-8e39-0cfca9fd4ad6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:31.685854 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852d4853-77be-492f-8e39-0cfca9fd4ad6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:31.687452 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852d4853-77be-492f-8e39-0cfca9fd4ad6 service swift] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:31.697175 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2659/5343] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 21:32:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 21:32:31.726940 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b315ccea-950f-49d7-948d-04cee62a5a99 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:31.728536 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b315ccea-950f-49d7-948d-04cee62a5a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:31.743854 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b315ccea-950f-49d7-948d-04cee62a5a99 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:31.750065 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583457d9-c1af-4d81-9326-50369771e7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:31.750973 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583457d9-c1af-4d81-9326-50369771e7ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:31.751264 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583457d9-c1af-4d81-9326-50369771e7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:31.751683 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583457d9-c1af-4d81-9326-50369771e7ec admin admin] PATH_INFO: `/v3/users/cb4f4488c7ae4627b85e119ffaaf757f` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:31.756720 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583457d9-c1af-4d81-9326-50369771e7ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb4f4488c7ae4627b85e119ffaaf757f)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:31.758671 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583457d9-c1af-4d81-9326-50369771e7ec admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:32.149958 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-583457d9-c1af-4d81-9326-50369771e7ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb4f4488c7ae4627b85e119ffaaf757f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:32.171108 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-583457d9-c1af-4d81-9326-50369771e7ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb4f4488c7ae4627b85e119ffaaf757f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:32.184353 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-583457d9-c1af-4d81-9326-50369771e7ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb4f4488c7ae4627b85e119ffaaf757f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:32.335950 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-583457d9-c1af-4d81-9326-50369771e7ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb4f4488c7ae4627b85e119ffaaf757f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:32.337465 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-583457d9-c1af-4d81-9326-50369771e7ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb4f4488c7ae4627b85e119ffaaf757f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:32.347853 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2685/5344] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:32:31 2022] DELETE /identity/v3/users/cb4f4488c7ae4627b85e119ffaaf757f => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:32:32.352184 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69663374-40e6-4f53-bf3c-3682a0ab380c None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:32.352679 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69663374-40e6-4f53-bf3c-3682a0ab380c None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:32.352970 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69663374-40e6-4f53-bf3c-3682a0ab380c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:32.381579 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-69663374-40e6-4f53-bf3c-3682a0ab380c None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:32:32.382993 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-69663374-40e6-4f53-bf3c-3682a0ab380c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:32.475744 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2660/5345] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:32:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:32:32.486885 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583457d9-c1af-4d81-9326-50369771e7ec admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:32.489032 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-583457d9-c1af-4d81-9326-50369771e7ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:32.567436 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583457d9-c1af-4d81-9326-50369771e7ec admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:32.572664 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4133033-09d5-4ec5-8243-6a005c0775f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:32.573879 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4133033-09d5-4ec5-8243-6a005c0775f4 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:32.574168 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4133033-09d5-4ec5-8243-6a005c0775f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:32.574454 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4133033-09d5-4ec5-8243-6a005c0775f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:32.587886 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4133033-09d5-4ec5-8243-6a005c0775f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:32.589984 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4133033-09d5-4ec5-8243-6a005c0775f4 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:32.611761 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2686/5346] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:32:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:32:33.089964 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69663374-40e6-4f53-bf3c-3682a0ab380c None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:33.093533 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-69663374-40e6-4f53-bf3c-3682a0ab380c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:33.115107 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69663374-40e6-4f53-bf3c-3682a0ab380c None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:33.120953 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd08def-961a-4de2-a2de-8df729a91762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:33.122123 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd08def-961a-4de2-a2de-8df729a91762 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:33.122706 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd08def-961a-4de2-a2de-8df729a91762 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:33.123149 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd08def-961a-4de2-a2de-8df729a91762 admin admin] PATH_INFO: `/v3/projects/574107fbfe6248259dcdf198e50cc290` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:33.125745 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd08def-961a-4de2-a2de-8df729a91762 admin admin] RBAC: Authorizing `identity:delete_project(project_id=574107fbfe6248259dcdf198e50cc290)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:33.127961 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd08def-961a-4de2-a2de-8df729a91762 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:33.281623 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0fd08def-961a-4de2-a2de-8df729a91762 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '574107fbfe6248259dcdf198e50cc290', 'request_id': 'req-0fd08def-961a-4de2-a2de-8df729a91762'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:33.287510 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0fd08def-961a-4de2-a2de-8df729a91762 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '574107fbfe6248259dcdf198e50cc290', 'request_id': 'req-0fd08def-961a-4de2-a2de-8df729a91762'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:33.297936 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0fd08def-961a-4de2-a2de-8df729a91762 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '574107fbfe6248259dcdf198e50cc290', 'request_id': 'req-0fd08def-961a-4de2-a2de-8df729a91762'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:33.411295 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0fd08def-961a-4de2-a2de-8df729a91762 admin admin] The token cache is being invalidate because project 574107fbfe6248259dcdf198e50cc290 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:32:33.425197 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0fd08def-961a-4de2-a2de-8df729a91762 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:33.430664 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0fd08def-961a-4de2-a2de-8df729a91762 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:33.439704 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2661/5347] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:32:33 2022] DELETE /identity/v3/projects/574107fbfe6248259dcdf198e50cc290 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:32:33.444060 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4133033-09d5-4ec5-8243-6a005c0775f4 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:33.461685 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4133033-09d5-4ec5-8243-6a005c0775f4 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:33.549798 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee8c695-737b-4a4a-b617-de231679cf91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:33.551015 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee8c695-737b-4a4a-b617-de231679cf91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:33.551325 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee8c695-737b-4a4a-b617-de231679cf91 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:33.551643 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee8c695-737b-4a4a-b617-de231679cf91 admin admin] PATH_INFO: `/v3/users/7b77765f89814ef099ba857616969d97` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:33.554085 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee8c695-737b-4a4a-b617-de231679cf91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b77765f89814ef099ba857616969d97)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:33.556294 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee8c695-737b-4a4a-b617-de231679cf91 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:33.943236 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3ee8c695-737b-4a4a-b617-de231679cf91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b77765f89814ef099ba857616969d97'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:33.964220 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3ee8c695-737b-4a4a-b617-de231679cf91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b77765f89814ef099ba857616969d97'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:33.975666 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3ee8c695-737b-4a4a-b617-de231679cf91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b77765f89814ef099ba857616969d97'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:34.099134 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3ee8c695-737b-4a4a-b617-de231679cf91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b77765f89814ef099ba857616969d97'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:34.099810 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3ee8c695-737b-4a4a-b617-de231679cf91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b77765f89814ef099ba857616969d97'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:34.110103 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2687/5348] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:32:33 2022] DELETE /identity/v3/users/7b77765f89814ef099ba857616969d97 => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:32:35.015527 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd08def-961a-4de2-a2de-8df729a91762 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:35.017932 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-0fd08def-961a-4de2-a2de-8df729a91762 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:35.047356 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd08def-961a-4de2-a2de-8df729a91762 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:35.197544 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5cdcd2-9033-48a7-8f3b-cf9be2b31c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:35.198497 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5cdcd2-9033-48a7-8f3b-cf9be2b31c49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:35.198785 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5cdcd2-9033-48a7-8f3b-cf9be2b31c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:35.199073 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5cdcd2-9033-48a7-8f3b-cf9be2b31c49 admin admin] PATH_INFO: `/v3/projects/6dc7b08c0f7749cf9834cc2d878c26af` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:35.200880 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5cdcd2-9033-48a7-8f3b-cf9be2b31c49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dc7b08c0f7749cf9834cc2d878c26af)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:35.203069 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5cdcd2-9033-48a7-8f3b-cf9be2b31c49 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:35.477573 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3d5cdcd2-9033-48a7-8f3b-cf9be2b31c49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dc7b08c0f7749cf9834cc2d878c26af', 'request_id': 'req-3d5cdcd2-9033-48a7-8f3b-cf9be2b31c49'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:35.503989 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3d5cdcd2-9033-48a7-8f3b-cf9be2b31c49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dc7b08c0f7749cf9834cc2d878c26af', 'request_id': 'req-3d5cdcd2-9033-48a7-8f3b-cf9be2b31c49'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:35.522608 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3d5cdcd2-9033-48a7-8f3b-cf9be2b31c49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dc7b08c0f7749cf9834cc2d878c26af', 'request_id': 'req-3d5cdcd2-9033-48a7-8f3b-cf9be2b31c49'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:35.652024 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3d5cdcd2-9033-48a7-8f3b-cf9be2b31c49 admin admin] The token cache is being invalidate because project 6dc7b08c0f7749cf9834cc2d878c26af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:32:35.652357 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3d5cdcd2-9033-48a7-8f3b-cf9be2b31c49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:35.656339 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3d5cdcd2-9033-48a7-8f3b-cf9be2b31c49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:35.658428 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2662/5349] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:32:35 2022] DELETE /identity/v3/projects/6dc7b08c0f7749cf9834cc2d878c26af => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:32:35.663908 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba615ff-483c-4c46-8a85-de0bd9f70059 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:35.664409 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba615ff-483c-4c46-8a85-de0bd9f70059 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:35.664488 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba615ff-483c-4c46-8a85-de0bd9f70059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:35.746755 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-1ba615ff-483c-4c46-8a85-de0bd9f70059 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:32:35.751843 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-1ba615ff-483c-4c46-8a85-de0bd9f70059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:35.898454 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2688/5350] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:32:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:32:35.906768 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6343e05-27b9-45bb-b349-77b7875587e2 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:35.911349 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6343e05-27b9-45bb-b349-77b7875587e2 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:35.911349 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6343e05-27b9-45bb-b349-77b7875587e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:35.957394 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-a6343e05-27b9-45bb-b349-77b7875587e2 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:32:35.957515 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-a6343e05-27b9-45bb-b349-77b7875587e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:36.002760 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70aa4e1-3d9c-4156-8495-2102157ffd37 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:36.002760 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70aa4e1-3d9c-4156-8495-2102157ffd37 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:36.002760 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70aa4e1-3d9c-4156-8495-2102157ffd37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:36.008696 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2663/5351] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:32:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:32:36.014229 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6343e05-27b9-45bb-b349-77b7875587e2 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:36.030151 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6343e05-27b9-45bb-b349-77b7875587e2 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:36.049630 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22cd854-6853-41e4-b8a4-72e22915441e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:36.050327 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22cd854-6853-41e4-b8a4-72e22915441e admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:36.050612 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22cd854-6853-41e4-b8a4-72e22915441e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:36.050856 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-b70aa4e1-3d9c-4156-8495-2102157ffd37 None None] MFA Rules not processed for user `cbb8c5cf2d144e3791171eb3d6f83eca`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:32:36.051245 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22cd854-6853-41e4-b8a4-72e22915441e admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:36.052439 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b70aa4e1-3d9c-4156-8495-2102157ffd37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:36.053443 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22cd854-6853-41e4-b8a4-72e22915441e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:32:36.054021 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22cd854-6853-41e4-b8a4-72e22915441e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:36.056300 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22cd854-6853-41e4-b8a4-72e22915441e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:36.076362 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2664/5352] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:32:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:32:36.080959 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22cd854-6853-41e4-b8a4-72e22915441e admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:36.110030 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22cd854-6853-41e4-b8a4-72e22915441e admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:36.121521 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2b322b-6343-47d3-811e-d1527bf4b69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:36.137656 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b322b-6343-47d3-811e-d1527bf4b69e admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:36.137947 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b322b-6343-47d3-811e-d1527bf4b69e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:36.138226 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b322b-6343-47d3-811e-d1527bf4b69e admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:36.138933 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2b322b-6343-47d3-811e-d1527bf4b69e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:36.144891 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2b322b-6343-47d3-811e-d1527bf4b69e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:36.217706 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2689/5353] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:32:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:32:36.231768 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b01acc-2ca2-406e-9d95-13709773a750 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:36.232063 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b01acc-2ca2-406e-9d95-13709773a750 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:36.232346 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b01acc-2ca2-406e-9d95-13709773a750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:36.278002 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2665/5354] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:32:36 2022] POST /identity/v3/projects => generated 355 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:32:36.278754 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-b8b01acc-2ca2-406e-9d95-13709773a750 None None] MFA Rules not processed for user `cbb8c5cf2d144e3791171eb3d6f83eca`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:32:36.280709 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b8b01acc-2ca2-406e-9d95-13709773a750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:36.281866 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2b322b-6343-47d3-811e-d1527bf4b69e admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:36.373580 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2b322b-6343-47d3-811e-d1527bf4b69e admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:36.381971 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2690/5355] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:32:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:32:36.387987 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f66d3-c830-43e8-af03-c48a96c34a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:36.388923 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f66d3-c830-43e8-af03-c48a96c34a66 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:36.389352 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f66d3-c830-43e8-af03-c48a96c34a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:36.389788 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f66d3-c830-43e8-af03-c48a96c34a66 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:36.390623 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5f66d3-c830-43e8-af03-c48a96c34a66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:36.393196 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b01acc-2ca2-406e-9d95-13709773a750 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:36.393597 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5f66d3-c830-43e8-af03-c48a96c34a66 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:36.394971 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b8b01acc-2ca2-406e-9d95-13709773a750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:36.486612 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2666/5356] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:32:36 2022] POST /identity/v3/users => generated 278 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:32:36.487046 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f66d3-c830-43e8-af03-c48a96c34a66 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:36.503785 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f66d3-c830-43e8-af03-c48a96c34a66 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:36.516663 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc027a18-5a3b-4d34-804e-2833f3fa0121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:36.517502 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc027a18-5a3b-4d34-804e-2833f3fa0121 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:36.517640 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc027a18-5a3b-4d34-804e-2833f3fa0121 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:36.517946 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc027a18-5a3b-4d34-804e-2833f3fa0121 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:36.519680 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc027a18-5a3b-4d34-804e-2833f3fa0121 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:36.521227 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc027a18-5a3b-4d34-804e-2833f3fa0121 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:36.548569 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2667/5357] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:32:36 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:32:36.552218 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc027a18-5a3b-4d34-804e-2833f3fa0121 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:36.561692 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b01acc-2ca2-406e-9d95-13709773a750 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:36.570061 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc027a18-5a3b-4d34-804e-2833f3fa0121 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:36.580931 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ca962-8a05-456c-8c97-3860aadcbeee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:36.580931 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ca962-8a05-456c-8c97-3860aadcbeee service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:36.580931 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ca962-8a05-456c-8c97-3860aadcbeee service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:36.580931 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ca962-8a05-456c-8c97-3860aadcbeee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:36.586786 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca00c4-0f39-4ea3-9071-fc0cb70fea50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:36.587468 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca00c4-0f39-4ea3-9071-fc0cb70fea50 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:36.587801 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca00c4-0f39-4ea3-9071-fc0cb70fea50 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:36.588291 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca00c4-0f39-4ea3-9071-fc0cb70fea50 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:36.589136 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ca00c4-0f39-4ea3-9071-fc0cb70fea50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:36.590774 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ca00c4-0f39-4ea3-9071-fc0cb70fea50 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:36.599915 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9ca962-8a05-456c-8c97-3860aadcbeee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:36.599915 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9ca962-8a05-456c-8c97-3860aadcbeee service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:36.611957 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2668/5358] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:32:36 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:32:36.612765 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca00c4-0f39-4ea3-9071-fc0cb70fea50 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:36.621924 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2691/5359] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:32:36 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:32:36.628029 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca00c4-0f39-4ea3-9071-fc0cb70fea50 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:36.634559 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f91dbcc-5635-4984-8cce-58b6a2027715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:36.636549 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91dbcc-5635-4984-8cce-58b6a2027715 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:36.636922 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91dbcc-5635-4984-8cce-58b6a2027715 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:36.639685 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91dbcc-5635-4984-8cce-58b6a2027715 admin admin] PATH_INFO: `/v3/projects/0c087509b6aa40b0b220f34beebf3501/users/cd265066b1264798b70f2ecd940188d1/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:36.660409 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f91dbcc-5635-4984-8cce-58b6a2027715 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c087509b6aa40b0b220f34beebf3501, user_id=cd265066b1264798b70f2ecd940188d1, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:36.664908 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f91dbcc-5635-4984-8cce-58b6a2027715 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:36.811668 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2669/5360] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:32:36 2022] PUT /identity/v3/projects/0c087509b6aa40b0b220f34beebf3501/users/cd265066b1264798b70f2ecd940188d1/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:32:36.814240 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4375485-f295-489b-9f4a-71abcfc04044 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:36.814735 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4375485-f295-489b-9f4a-71abcfc04044 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:36.815078 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4375485-f295-489b-9f4a-71abcfc04044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:36.850860 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-e4375485-f295-489b-9f4a-71abcfc04044 None None] MFA Rules not processed for user `cd265066b1264798b70f2ecd940188d1`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:32:36.854406 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e4375485-f295-489b-9f4a-71abcfc04044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:36.953188 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2692/5361] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:32:36 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:32:36.958079 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f91dbcc-5635-4984-8cce-58b6a2027715 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:37.032102 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f91dbcc-5635-4984-8cce-58b6a2027715 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:37.038160 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addb51f0-627f-47b0-8f07-bb75115ee881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:37.039141 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb51f0-627f-47b0-8f07-bb75115ee881 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:37.039571 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb51f0-627f-47b0-8f07-bb75115ee881 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:37.039901 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb51f0-627f-47b0-8f07-bb75115ee881 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:37.040765 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addb51f0-627f-47b0-8f07-bb75115ee881 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:37.043560 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addb51f0-627f-47b0-8f07-bb75115ee881 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:37.194821 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2670/5362] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:32:36 2022] POST /identity/v3/projects => generated 357 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:32:37.196232 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4375485-f295-489b-9f4a-71abcfc04044 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:37.210075 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4375485-f295-489b-9f4a-71abcfc04044 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:37.241806 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addb51f0-627f-47b0-8f07-bb75115ee881 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:37.246407 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-addb51f0-627f-47b0-8f07-bb75115ee881 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:37.288021 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40326cc-4749-4638-854d-833d978a9a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:37.288714 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40326cc-4749-4638-854d-833d978a9a8e admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:37.292221 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40326cc-4749-4638-854d-833d978a9a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:37.292221 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40326cc-4749-4638-854d-833d978a9a8e admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:37.292221 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40326cc-4749-4638-854d-833d978a9a8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:37.292657 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40326cc-4749-4638-854d-833d978a9a8e admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:37.369745 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2693/5363] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:32:37 2022] POST /identity/v3/users => generated 285 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:32:37.370737 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40326cc-4749-4638-854d-833d978a9a8e admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:37.384381 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addb51f0-627f-47b0-8f07-bb75115ee881 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:37.392070 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145ff915-085f-4c6b-a020-abb5d71c86d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:37.392618 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40326cc-4749-4638-854d-833d978a9a8e admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:37.393336 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ff915-085f-4c6b-a020-abb5d71c86d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:37.393772 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ff915-085f-4c6b-a020-abb5d71c86d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:37.394195 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ff915-085f-4c6b-a020-abb5d71c86d2 admin admin] PATH_INFO: `/v3/users/0e40446fedca416883f7321a3de390bf` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:37.396338 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145ff915-085f-4c6b-a020-abb5d71c86d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e40446fedca416883f7321a3de390bf)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:37.398925 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145ff915-085f-4c6b-a020-abb5d71c86d2 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:37.405061 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d3cc6-84c7-42b3-91de-8df544592b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:37.406000 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d3cc6-84c7-42b3-91de-8df544592b7e admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:37.406282 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d3cc6-84c7-42b3-91de-8df544592b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:37.406560 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d3cc6-84c7-42b3-91de-8df544592b7e admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:37.407295 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15d3cc6-84c7-42b3-91de-8df544592b7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:37.420825 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15d3cc6-84c7-42b3-91de-8df544592b7e admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:37.450468 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2694/5364] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:32:37 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:32:37.451774 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d3cc6-84c7-42b3-91de-8df544592b7e admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:37.466343 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d3cc6-84c7-42b3-91de-8df544592b7e admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:37.473544 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c0704-e3ea-419a-84e5-41f603d1858d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:37.474694 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c0704-e3ea-419a-84e5-41f603d1858d admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:37.476476 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c0704-e3ea-419a-84e5-41f603d1858d admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:37.476476 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c0704-e3ea-419a-84e5-41f603d1858d admin admin] PATH_INFO: `/v3/projects/7ed63d34601b465898ecacd22cd3e558/users/c5cb11bcfe5243e7b460464a41343980/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:37.513418 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887c0704-e3ea-419a-84e5-41f603d1858d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ed63d34601b465898ecacd22cd3e558, user_id=c5cb11bcfe5243e7b460464a41343980, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:37.518640 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887c0704-e3ea-419a-84e5-41f603d1858d admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:37.634652 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2695/5365] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:32:37 2022] PUT /identity/v3/projects/7ed63d34601b465898ecacd22cd3e558/users/c5cb11bcfe5243e7b460464a41343980/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:32:37.639712 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c0704-e3ea-419a-84e5-41f603d1858d admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:37.713085 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-145ff915-085f-4c6b-a020-abb5d71c86d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e40446fedca416883f7321a3de390bf'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:37.738046 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-145ff915-085f-4c6b-a020-abb5d71c86d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e40446fedca416883f7321a3de390bf'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:37.741500 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-145ff915-085f-4c6b-a020-abb5d71c86d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e40446fedca416883f7321a3de390bf'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:37.848574 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-145ff915-085f-4c6b-a020-abb5d71c86d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e40446fedca416883f7321a3de390bf'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:37.853754 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c0704-e3ea-419a-84e5-41f603d1858d admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:37.861512 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44527d41-dac3-436f-a570-ed6ccc521f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:37.862721 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44527d41-dac3-436f-a570-ed6ccc521f9d admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:37.863110 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44527d41-dac3-436f-a570-ed6ccc521f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:37.863826 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44527d41-dac3-436f-a570-ed6ccc521f9d admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:37.864315 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44527d41-dac3-436f-a570-ed6ccc521f9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:37.866429 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44527d41-dac3-436f-a570-ed6ccc521f9d admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:37.884551 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-145ff915-085f-4c6b-a020-abb5d71c86d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e40446fedca416883f7321a3de390bf'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:37.899581 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2696/5366] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:32:37 2022] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:32:37.904449 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2671/5367] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:32:37 2022] DELETE /identity/v3/users/0e40446fedca416883f7321a3de390bf => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:32:37.907911 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbecce2-3fdd-427c-9516-2edd986b4107 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:37.908052 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44527d41-dac3-436f-a570-ed6ccc521f9d admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:37.908259 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbecce2-3fdd-427c-9516-2edd986b4107 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:37.908487 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbecce2-3fdd-427c-9516-2edd986b4107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:37.911811 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-44527d41-dac3-436f-a570-ed6ccc521f9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:37.950305 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44527d41-dac3-436f-a570-ed6ccc521f9d admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:37.954154 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-1dbecce2-3fdd-427c-9516-2edd986b4107 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:32:37.955582 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-1dbecce2-3fdd-427c-9516-2edd986b4107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:38.052292 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f80ea0-8d76-414a-bc67-6498f22b6f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:38.053276 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f80ea0-8d76-414a-bc67-6498f22b6f4a admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:38.054545 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f80ea0-8d76-414a-bc67-6498f22b6f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:38.054888 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f80ea0-8d76-414a-bc67-6498f22b6f4a admin admin] PATH_INFO: `/v3/projects/7ed63d34601b465898ecacd22cd3e558/users/c5cb11bcfe5243e7b460464a41343980/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:38.055949 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2672/5368] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:32:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:32:38.060105 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f80ea0-8d76-414a-bc67-6498f22b6f4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ed63d34601b465898ecacd22cd3e558, user_id=c5cb11bcfe5243e7b460464a41343980, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:38.062699 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f80ea0-8d76-414a-bc67-6498f22b6f4a admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:38.070934 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbecce2-3fdd-427c-9516-2edd986b4107 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:38.079929 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-1dbecce2-3fdd-427c-9516-2edd986b4107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:38.084098 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2697/5369] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:32:37 2022] PUT /identity/v3/projects/7ed63d34601b465898ecacd22cd3e558/users/c5cb11bcfe5243e7b460464a41343980/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:32:38.086536 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3840794-f41c-4aed-8c44-feda42223f30 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:38.086832 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3840794-f41c-4aed-8c44-feda42223f30 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:38.087114 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3840794-f41c-4aed-8c44-feda42223f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:38.127950 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-d3840794-f41c-4aed-8c44-feda42223f30 None None] MFA Rules not processed for user `c5cb11bcfe5243e7b460464a41343980`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:32:38.127950 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d3840794-f41c-4aed-8c44-feda42223f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:38.235299 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbecce2-3fdd-427c-9516-2edd986b4107 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:38.337951 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2698/5370] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:32:38 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:32:38.348175 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3840794-f41c-4aed-8c44-feda42223f30 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:38.354089 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d3840794-f41c-4aed-8c44-feda42223f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:38.388584 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa74090d-d6e1-43b4-9c3a-c3abf5c51a54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:38.391205 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa74090d-d6e1-43b4-9c3a-c3abf5c51a54 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:38.392629 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa74090d-d6e1-43b4-9c3a-c3abf5c51a54 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:38.393844 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa74090d-d6e1-43b4-9c3a-c3abf5c51a54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:38.549839 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa74090d-d6e1-43b4-9c3a-c3abf5c51a54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:38.551428 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa74090d-d6e1-43b4-9c3a-c3abf5c51a54 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:38.570912 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2673/5371] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:32:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:32:38.573506 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3840794-f41c-4aed-8c44-feda42223f30 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:38.578824 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba41fca-e32c-4694-a8c7-b6c06ed81ced None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:38.578824 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba41fca-e32c-4694-a8c7-b6c06ed81ced None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:38.578824 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba41fca-e32c-4694-a8c7-b6c06ed81ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:38.581944 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c02e1c-83be-4964-aa24-ca14f465cbb7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:38.582756 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c02e1c-83be-4964-aa24-ca14f465cbb7 service placement] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:38.583199 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c02e1c-83be-4964-aa24-ca14f465cbb7 service placement] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:38.583519 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c02e1c-83be-4964-aa24-ca14f465cbb7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:38.585910 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d4c02e1c-83be-4964-aa24-ca14f465cbb7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:38.603505 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c02e1c-83be-4964-aa24-ca14f465cbb7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:38.609551 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-5ba41fca-e32c-4694-a8c7-b6c06ed81ced None None] MFA Rules not processed for user `cbb8c5cf2d144e3791171eb3d6f83eca`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:32:38.609759 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c02e1c-83be-4964-aa24-ca14f465cbb7 service placement] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:38.609873 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-5ba41fca-e32c-4694-a8c7-b6c06ed81ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:38.622028 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2699/5372] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:32:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:32:38.623188 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c02e1c-83be-4964-aa24-ca14f465cbb7 service placement] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:38.636198 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c02e1c-83be-4964-aa24-ca14f465cbb7 service placement] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:38.644263 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f3f924-b716-47d6-9d63-60447a3aff0b tempest-QuotasTest-1133392860 tempest-QuotasTest-1133392860-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5cb11bcfe5243e7b460464a41343980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed63d34601b465898ecacd22cd3e558', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:38.645536 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f3f924-b716-47d6-9d63-60447a3aff0b tempest-QuotasTest-1133392860 tempest-QuotasTest-1133392860-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:38.645857 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f3f924-b716-47d6-9d63-60447a3aff0b tempest-QuotasTest-1133392860 tempest-QuotasTest-1133392860-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:38.646132 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f3f924-b716-47d6-9d63-60447a3aff0b tempest-QuotasTest-1133392860 tempest-QuotasTest-1133392860-project-admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:38.646995 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f3f924-b716-47d6-9d63-60447a3aff0b tempest-QuotasTest-1133392860 tempest-QuotasTest-1133392860-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:32:38.647364 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f3f924-b716-47d6-9d63-60447a3aff0b tempest-QuotasTest-1133392860 tempest-QuotasTest-1133392860-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:38.650006 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f3f924-b716-47d6-9d63-60447a3aff0b tempest-QuotasTest-1133392860 tempest-QuotasTest-1133392860-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:38.666430 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2700/5373] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:32:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:32:38.678525 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f3f924-b716-47d6-9d63-60447a3aff0b tempest-QuotasTest-1133392860 tempest-QuotasTest-1133392860-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:38.689170 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f3f924-b716-47d6-9d63-60447a3aff0b tempest-QuotasTest-1133392860 tempest-QuotasTest-1133392860-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:38.694986 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2674/5374] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:32:38 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:32:38.707451 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d5758e-e214-4fc3-b856-09fa4a248314 tempest-QuotasTest-1133392860 tempest-QuotasTest-1133392860-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5cb11bcfe5243e7b460464a41343980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed63d34601b465898ecacd22cd3e558', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:38.708980 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5758e-e214-4fc3-b856-09fa4a248314 tempest-QuotasTest-1133392860 tempest-QuotasTest-1133392860-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:38.712805 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5758e-e214-4fc3-b856-09fa4a248314 tempest-QuotasTest-1133392860 tempest-QuotasTest-1133392860-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:38.712805 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5758e-e214-4fc3-b856-09fa4a248314 tempest-QuotasTest-1133392860 tempest-QuotasTest-1133392860-project-admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:38.712805 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d5758e-e214-4fc3-b856-09fa4a248314 tempest-QuotasTest-1133392860 tempest-QuotasTest-1133392860-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:38.713061 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d5758e-e214-4fc3-b856-09fa4a248314 tempest-QuotasTest-1133392860 tempest-QuotasTest-1133392860-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:38.859543 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2701/5375] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:32:38 2022] POST /identity/v3/projects => generated 348 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:32:38.860901 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba41fca-e32c-4694-a8c7-b6c06ed81ced None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:38.878394 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba41fca-e32c-4694-a8c7-b6c06ed81ced None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:39.143011 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8f742d-801a-4801-b460-1f49bd178930 tempest-QuotasTest-1133392860 tempest-QuotasTest-1133392860-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5cb11bcfe5243e7b460464a41343980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed63d34601b465898ecacd22cd3e558', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:39.147041 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f742d-801a-4801-b460-1f49bd178930 tempest-QuotasTest-1133392860 tempest-QuotasTest-1133392860-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:39.150477 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f742d-801a-4801-b460-1f49bd178930 tempest-QuotasTest-1133392860 tempest-QuotasTest-1133392860-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:39.151701 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f742d-801a-4801-b460-1f49bd178930 tempest-QuotasTest-1133392860 tempest-QuotasTest-1133392860-project-admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:39.153443 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8f742d-801a-4801-b460-1f49bd178930 tempest-QuotasTest-1133392860 tempest-QuotasTest-1133392860-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:32:39.157019 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8f742d-801a-4801-b460-1f49bd178930 tempest-QuotasTest-1133392860 tempest-QuotasTest-1133392860-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:39.160577 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8f742d-801a-4801-b460-1f49bd178930 tempest-QuotasTest-1133392860 tempest-QuotasTest-1133392860-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:39.204319 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2675/5376] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:32:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:32:39.255612 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d5758e-e214-4fc3-b856-09fa4a248314 tempest-QuotasTest-1133392860 tempest-QuotasTest-1133392860-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:39.418718 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d5758e-e214-4fc3-b856-09fa4a248314 tempest-QuotasTest-1133392860 tempest-QuotasTest-1133392860-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:39.423629 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e372ee-852f-415c-b5d2-5141c8d39a50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:39.424448 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e372ee-852f-415c-b5d2-5141c8d39a50 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:39.424732 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e372ee-852f-415c-b5d2-5141c8d39a50 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:39.425060 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e372ee-852f-415c-b5d2-5141c8d39a50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:39.437827 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e372ee-852f-415c-b5d2-5141c8d39a50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:39.445054 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e372ee-852f-415c-b5d2-5141c8d39a50 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:39.456925 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2702/5377] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:32:39 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:32:40.367841 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8f742d-801a-4801-b460-1f49bd178930 tempest-QuotasTest-1133392860 tempest-QuotasTest-1133392860-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:40.401590 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8f742d-801a-4801-b460-1f49bd178930 tempest-QuotasTest-1133392860 tempest-QuotasTest-1133392860-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:40.411395 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d5fb6-89ae-492a-b5c9-723d07b269f3 tempest-QuotasTest-1133392860 tempest-QuotasTest-1133392860-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5cb11bcfe5243e7b460464a41343980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed63d34601b465898ecacd22cd3e558', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:40.415150 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d5fb6-89ae-492a-b5c9-723d07b269f3 tempest-QuotasTest-1133392860 tempest-QuotasTest-1133392860-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:40.415820 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d5fb6-89ae-492a-b5c9-723d07b269f3 tempest-QuotasTest-1133392860 tempest-QuotasTest-1133392860-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:40.416258 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d5fb6-89ae-492a-b5c9-723d07b269f3 tempest-QuotasTest-1133392860 tempest-QuotasTest-1133392860-project-admin] PATH_INFO: `/v3/projects/55d6be0220554977943c9d64a2e4bd76` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:40.418575 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6d5fb6-89ae-492a-b5c9-723d07b269f3 tempest-QuotasTest-1133392860 tempest-QuotasTest-1133392860-project-admin] RBAC: Authorizing `identity:delete_project(project_id=55d6be0220554977943c9d64a2e4bd76)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:40.421395 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6d5fb6-89ae-492a-b5c9-723d07b269f3 tempest-QuotasTest-1133392860 tempest-QuotasTest-1133392860-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:40.514788 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e372ee-852f-415c-b5d2-5141c8d39a50 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:40.517163 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-38e372ee-852f-415c-b5d2-5141c8d39a50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:40.608781 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-6f6d5fb6-89ae-492a-b5c9-723d07b269f3 tempest-QuotasTest-1133392860 tempest-QuotasTest-1133392860-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55d6be0220554977943c9d64a2e4bd76', 'request_id': 'req-6f6d5fb6-89ae-492a-b5c9-723d07b269f3'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:40.637308 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-6f6d5fb6-89ae-492a-b5c9-723d07b269f3 tempest-QuotasTest-1133392860 tempest-QuotasTest-1133392860-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55d6be0220554977943c9d64a2e4bd76', 'request_id': 'req-6f6d5fb6-89ae-492a-b5c9-723d07b269f3'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:40.667550 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-6f6d5fb6-89ae-492a-b5c9-723d07b269f3 tempest-QuotasTest-1133392860 tempest-QuotasTest-1133392860-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55d6be0220554977943c9d64a2e4bd76', 'request_id': 'req-6f6d5fb6-89ae-492a-b5c9-723d07b269f3'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:40.704122 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e372ee-852f-415c-b5d2-5141c8d39a50 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:40.753119 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-6f6d5fb6-89ae-492a-b5c9-723d07b269f3 tempest-QuotasTest-1133392860 tempest-QuotasTest-1133392860-project-admin] The token cache is being invalidate because project 55d6be0220554977943c9d64a2e4bd76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:32:40.753578 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-6f6d5fb6-89ae-492a-b5c9-723d07b269f3 tempest-QuotasTest-1133392860 tempest-QuotasTest-1133392860-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:40.758068 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-6f6d5fb6-89ae-492a-b5c9-723d07b269f3 tempest-QuotasTest-1133392860 tempest-QuotasTest-1133392860-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:40.764204 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2676/5378] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:32:40 2022] DELETE /identity/v3/projects/55d6be0220554977943c9d64a2e4bd76 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:32:40.792825 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e7ce3-f4fa-4f73-aa21-f125c9554e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:40.792825 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e7ce3-f4fa-4f73-aa21-f125c9554e82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:40.792825 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e7ce3-f4fa-4f73-aa21-f125c9554e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:40.792825 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e7ce3-f4fa-4f73-aa21-f125c9554e82 admin admin] PATH_INFO: `/v3/projects/2a1393fd6fd94533b439ca5f156d94ee` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:40.793870 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8e7ce3-f4fa-4f73-aa21-f125c9554e82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a1393fd6fd94533b439ca5f156d94ee)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:40.795920 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8e7ce3-f4fa-4f73-aa21-f125c9554e82 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:41.028170 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3a8e7ce3-f4fa-4f73-aa21-f125c9554e82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a1393fd6fd94533b439ca5f156d94ee', 'request_id': 'req-3a8e7ce3-f4fa-4f73-aa21-f125c9554e82'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:41.042614 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3a8e7ce3-f4fa-4f73-aa21-f125c9554e82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a1393fd6fd94533b439ca5f156d94ee', 'request_id': 'req-3a8e7ce3-f4fa-4f73-aa21-f125c9554e82'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:41.051256 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d5fb6-89ae-492a-b5c9-723d07b269f3 tempest-QuotasTest-1133392860 tempest-QuotasTest-1133392860-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:41.056924 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-6f6d5fb6-89ae-492a-b5c9-723d07b269f3 tempest-QuotasTest-1133392860 tempest-QuotasTest-1133392860-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:41.075410 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d5fb6-89ae-492a-b5c9-723d07b269f3 tempest-QuotasTest-1133392860 tempest-QuotasTest-1133392860-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:41.158241 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3a8e7ce3-f4fa-4f73-aa21-f125c9554e82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a1393fd6fd94533b439ca5f156d94ee', 'request_id': 'req-3a8e7ce3-f4fa-4f73-aa21-f125c9554e82'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:41.174980 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3a8e7ce3-f4fa-4f73-aa21-f125c9554e82 admin admin] The token cache is being invalidate because project 2a1393fd6fd94533b439ca5f156d94ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:32:41.175617 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3a8e7ce3-f4fa-4f73-aa21-f125c9554e82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:41.176353 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3a8e7ce3-f4fa-4f73-aa21-f125c9554e82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:41.191055 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2703/5379] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:32:40 2022] DELETE /identity/v3/projects/2a1393fd6fd94533b439ca5f156d94ee => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:32:41.192876 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ff43a-f5b3-434d-a548-bf396c6eab33 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:41.193170 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ff43a-f5b3-434d-a548-bf396c6eab33 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:41.193605 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ff43a-f5b3-434d-a548-bf396c6eab33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:41.200842 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a37b91a-56c3-4d0c-b071-bb1e15542d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:41.202071 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a37b91a-56c3-4d0c-b071-bb1e15542d0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:41.202748 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a37b91a-56c3-4d0c-b071-bb1e15542d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:41.203186 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a37b91a-56c3-4d0c-b071-bb1e15542d0e admin admin] PATH_INFO: `/v3/users/cd265066b1264798b70f2ecd940188d1` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:41.205675 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a37b91a-56c3-4d0c-b071-bb1e15542d0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd265066b1264798b70f2ecd940188d1)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:41.208003 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a37b91a-56c3-4d0c-b071-bb1e15542d0e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:41.221883 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-bd4ff43a-f5b3-434d-a548-bf396c6eab33 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:32:41.223419 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-bd4ff43a-f5b3-434d-a548-bf396c6eab33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:41.234597 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2704/5380] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:32:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:32:41.245188 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c7398-93f3-419e-a1ed-dcd87e00348c None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:41.246982 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c7398-93f3-419e-a1ed-dcd87e00348c None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:41.247491 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c7398-93f3-419e-a1ed-dcd87e00348c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:41.273304 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-db5c7398-93f3-419e-a1ed-dcd87e00348c None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:32:41.274523 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-db5c7398-93f3-419e-a1ed-dcd87e00348c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:41.286869 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2705/5381] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:32:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:32:41.287900 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c7398-93f3-419e-a1ed-dcd87e00348c None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:41.298424 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c7398-93f3-419e-a1ed-dcd87e00348c None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:41.329055 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17005849-8aa4-4db9-9bd5-6581342b642a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:41.329977 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17005849-8aa4-4db9-9bd5-6581342b642a admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:41.330100 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17005849-8aa4-4db9-9bd5-6581342b642a admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:41.330501 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17005849-8aa4-4db9-9bd5-6581342b642a admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:41.331866 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17005849-8aa4-4db9-9bd5-6581342b642a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:32:41.331866 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17005849-8aa4-4db9-9bd5-6581342b642a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:41.334119 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17005849-8aa4-4db9-9bd5-6581342b642a admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:41.353348 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2706/5382] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:32:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:32:41.355965 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17005849-8aa4-4db9-9bd5-6581342b642a admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:41.366663 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17005849-8aa4-4db9-9bd5-6581342b642a admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:41.373780 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd92a6f-72b2-4c47-a059-30bc48239870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:41.374668 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd92a6f-72b2-4c47-a059-30bc48239870 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:41.375113 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd92a6f-72b2-4c47-a059-30bc48239870 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:41.375609 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd92a6f-72b2-4c47-a059-30bc48239870 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:41.376461 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd92a6f-72b2-4c47-a059-30bc48239870 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:41.378925 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd92a6f-72b2-4c47-a059-30bc48239870 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:41.454229 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4a37b91a-56c3-4d0c-b071-bb1e15542d0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd265066b1264798b70f2ecd940188d1'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:41.465627 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4a37b91a-56c3-4d0c-b071-bb1e15542d0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd265066b1264798b70f2ecd940188d1'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:41.466741 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4a37b91a-56c3-4d0c-b071-bb1e15542d0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd265066b1264798b70f2ecd940188d1'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:41.507888 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2707/5383] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:32:41 2022] POST /identity/v3/projects => generated 375 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:32:41.511177 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd92a6f-72b2-4c47-a059-30bc48239870 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:41.568210 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4a37b91a-56c3-4d0c-b071-bb1e15542d0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd265066b1264798b70f2ecd940188d1'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:41.595585 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4a37b91a-56c3-4d0c-b071-bb1e15542d0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd265066b1264798b70f2ecd940188d1'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:41.609690 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2677/5384] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:32:41 2022] DELETE /identity/v3/users/cd265066b1264798b70f2ecd940188d1 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:32:41.615303 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c04486-4dd1-478f-a496-024938fd0aeb None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:41.616271 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c04486-4dd1-478f-a496-024938fd0aeb None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:41.617019 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c04486-4dd1-478f-a496-024938fd0aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:41.645929 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd92a6f-72b2-4c47-a059-30bc48239870 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:41.655356 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-20c04486-4dd1-478f-a496-024938fd0aeb None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:32:41.656627 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-20c04486-4dd1-478f-a496-024938fd0aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:41.741896 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2678/5385] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:32:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:32:41.752928 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd50f6aa-de1b-44c0-9fb3-16c5906f7bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:41.753660 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd50f6aa-de1b-44c0-9fb3-16c5906f7bcb admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:41.753915 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd50f6aa-de1b-44c0-9fb3-16c5906f7bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:41.754199 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd50f6aa-de1b-44c0-9fb3-16c5906f7bcb admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:41.754894 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd50f6aa-de1b-44c0-9fb3-16c5906f7bcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:41.756884 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd50f6aa-de1b-44c0-9fb3-16c5906f7bcb admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:41.834679 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c04486-4dd1-478f-a496-024938fd0aeb None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:41.837315 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-20c04486-4dd1-478f-a496-024938fd0aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:41.882722 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2708/5386] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:32:41 2022] POST /identity/v3/users => generated 288 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:32:41.889153 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd50f6aa-de1b-44c0-9fb3-16c5906f7bcb admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:41.893504 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-dd50f6aa-de1b-44c0-9fb3-16c5906f7bcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:41.934182 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd50f6aa-de1b-44c0-9fb3-16c5906f7bcb admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:41.936112 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c04486-4dd1-478f-a496-024938fd0aeb None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:41.949030 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b0ee7b-268c-4932-b7a5-b384eb10f91d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:41.949713 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b0ee7b-268c-4932-b7a5-b384eb10f91d service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:41.949996 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b0ee7b-268c-4932-b7a5-b384eb10f91d service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:41.950924 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b0ee7b-268c-4932-b7a5-b384eb10f91d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:41.951550 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57cf52b-f92a-4341-aaf5-9bde3a849e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:41.952227 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57cf52b-f92a-4341-aaf5-9bde3a849e0d admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:41.952512 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57cf52b-f92a-4341-aaf5-9bde3a849e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:41.953370 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57cf52b-f92a-4341-aaf5-9bde3a849e0d admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:41.953515 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57cf52b-f92a-4341-aaf5-9bde3a849e0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:41.957245 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57cf52b-f92a-4341-aaf5-9bde3a849e0d admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:41.974997 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2709/5387] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:32:41.981693 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57cf52b-f92a-4341-aaf5-9bde3a849e0d admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:41.991106 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b0ee7b-268c-4932-b7a5-b384eb10f91d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:41.998780 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57cf52b-f92a-4341-aaf5-9bde3a849e0d admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:41.999660 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b0ee7b-268c-4932-b7a5-b384eb10f91d service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:42.014546 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21f6454-73c7-43d7-993c-5daccce6568d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:42.015256 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f6454-73c7-43d7-993c-5daccce6568d admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:42.015668 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f6454-73c7-43d7-993c-5daccce6568d admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:42.016024 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f6454-73c7-43d7-993c-5daccce6568d admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:42.016945 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21f6454-73c7-43d7-993c-5daccce6568d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:42.018629 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21f6454-73c7-43d7-993c-5daccce6568d admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:42.022106 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2679/5388] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:32:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:32:42.040586 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2710/5389] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:32:42.042085 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b0ee7b-268c-4932-b7a5-b384eb10f91d service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:42.054535 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b0ee7b-268c-4932-b7a5-b384eb10f91d service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:42.060522 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9474b269-d1f6-43e7-83a2-1a375303b986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:42.061430 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474b269-d1f6-43e7-83a2-1a375303b986 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:42.061714 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474b269-d1f6-43e7-83a2-1a375303b986 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:42.061993 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474b269-d1f6-43e7-83a2-1a375303b986 admin admin] PATH_INFO: `/v3/projects/01d43a90ddfb4d95909b88ddec426a3d/users/0154df4d09de4928b87558f4783beacb/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:42.086471 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9474b269-d1f6-43e7-83a2-1a375303b986 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01d43a90ddfb4d95909b88ddec426a3d, user_id=0154df4d09de4928b87558f4783beacb, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:42.090418 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9474b269-d1f6-43e7-83a2-1a375303b986 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:42.216651 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2680/5390] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:32:42 2022] PUT /identity/v3/projects/01d43a90ddfb4d95909b88ddec426a3d/users/0154df4d09de4928b87558f4783beacb/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:32:42.226498 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeee9e2-f6f7-40a8-af24-86c77db5ef8f None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:42.226957 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeee9e2-f6f7-40a8-af24-86c77db5ef8f None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:42.227241 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeee9e2-f6f7-40a8-af24-86c77db5ef8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:42.258975 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-4aeee9e2-f6f7-40a8-af24-86c77db5ef8f None None] MFA Rules not processed for user `0154df4d09de4928b87558f4783beacb`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:32:42.260834 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-4aeee9e2-f6f7-40a8-af24-86c77db5ef8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:42.423594 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2711/5391] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:32:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:32:42.424959 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9474b269-d1f6-43e7-83a2-1a375303b986 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:42.541995 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9474b269-d1f6-43e7-83a2-1a375303b986 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:42.558897 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a074c048-3b37-469e-bde6-62efe4b4f184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:42.559889 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074c048-3b37-469e-bde6-62efe4b4f184 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:42.560325 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074c048-3b37-469e-bde6-62efe4b4f184 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:42.560767 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074c048-3b37-469e-bde6-62efe4b4f184 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:42.561805 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a074c048-3b37-469e-bde6-62efe4b4f184 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:42.564480 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a074c048-3b37-469e-bde6-62efe4b4f184 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:42.703946 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2681/5392] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:32:42 2022] POST /identity/v3/projects => generated 377 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:32:42.705135 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeee9e2-f6f7-40a8-af24-86c77db5ef8f None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:42.723309 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeee9e2-f6f7-40a8-af24-86c77db5ef8f None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:42.846670 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa29c73f-3fc4-4896-8de2-6925bc095212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:42.847375 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa29c73f-3fc4-4896-8de2-6925bc095212 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:42.847690 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa29c73f-3fc4-4896-8de2-6925bc095212 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:42.847970 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa29c73f-3fc4-4896-8de2-6925bc095212 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:42.848673 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa29c73f-3fc4-4896-8de2-6925bc095212 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:42.851141 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa29c73f-3fc4-4896-8de2-6925bc095212 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:43.042632 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2712/5393] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:32:42 2022] POST /identity/v3/users => generated 295 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:32:43.046698 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a074c048-3b37-469e-bde6-62efe4b4f184 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:43.058759 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a074c048-3b37-469e-bde6-62efe4b4f184 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:43.063403 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fb83ed-aa23-4d07-b16b-fe6a824ef480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:43.064288 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb83ed-aa23-4d07-b16b-fe6a824ef480 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:43.064578 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb83ed-aa23-4d07-b16b-fe6a824ef480 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:43.064859 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb83ed-aa23-4d07-b16b-fe6a824ef480 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:43.065584 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fb83ed-aa23-4d07-b16b-fe6a824ef480 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:43.067192 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fb83ed-aa23-4d07-b16b-fe6a824ef480 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:43.078632 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2682/5394] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:32:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:32:43.086966 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa29c73f-3fc4-4896-8de2-6925bc095212 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:43.095874 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa29c73f-3fc4-4896-8de2-6925bc095212 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:43.101229 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89522682-5758-4c73-8bcd-021a5fa1b557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:43.102423 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89522682-5758-4c73-8bcd-021a5fa1b557 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:43.102917 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89522682-5758-4c73-8bcd-021a5fa1b557 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:43.103697 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89522682-5758-4c73-8bcd-021a5fa1b557 admin admin] PATH_INFO: `/v3/projects/518df7d85bbf4702b3a30647ead34c0c/users/dbadb11ec9d1442b8349bbc8447f55f6/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:43.142316 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89522682-5758-4c73-8bcd-021a5fa1b557 admin admin] RBAC: Authorizing `identity:create_grant(project_id=518df7d85bbf4702b3a30647ead34c0c, user_id=dbadb11ec9d1442b8349bbc8447f55f6, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:43.159343 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89522682-5758-4c73-8bcd-021a5fa1b557 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:43.198331 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fb83ed-aa23-4d07-b16b-fe6a824ef480 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:43.200908 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-72fb83ed-aa23-4d07-b16b-fe6a824ef480 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:43.232210 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fb83ed-aa23-4d07-b16b-fe6a824ef480 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:43.262856 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94e98ed-8dfe-4c0d-b75c-f60d37c56559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:43.263857 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e98ed-8dfe-4c0d-b75c-f60d37c56559 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:43.264352 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e98ed-8dfe-4c0d-b75c-f60d37c56559 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:43.264684 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e98ed-8dfe-4c0d-b75c-f60d37c56559 admin admin] PATH_INFO: `/v3/projects/0c087509b6aa40b0b220f34beebf3501` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:43.266622 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94e98ed-8dfe-4c0d-b75c-f60d37c56559 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c087509b6aa40b0b220f34beebf3501)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:43.268640 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94e98ed-8dfe-4c0d-b75c-f60d37c56559 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:43.304605 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2713/5395] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:32:43 2022] PUT /identity/v3/projects/518df7d85bbf4702b3a30647ead34c0c/users/dbadb11ec9d1442b8349bbc8447f55f6/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:32:43.312688 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89522682-5758-4c73-8bcd-021a5fa1b557 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:43.445425 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89522682-5758-4c73-8bcd-021a5fa1b557 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:43.460947 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c94e98ed-8dfe-4c0d-b75c-f60d37c56559 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c087509b6aa40b0b220f34beebf3501', 'request_id': 'req-c94e98ed-8dfe-4c0d-b75c-f60d37c56559'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:43.473365 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c94e98ed-8dfe-4c0d-b75c-f60d37c56559 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c087509b6aa40b0b220f34beebf3501', 'request_id': 'req-c94e98ed-8dfe-4c0d-b75c-f60d37c56559'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:43.483930 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c94e98ed-8dfe-4c0d-b75c-f60d37c56559 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c087509b6aa40b0b220f34beebf3501', 'request_id': 'req-c94e98ed-8dfe-4c0d-b75c-f60d37c56559'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:43.529813 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3b970f-ed23-4478-bd17-5d06f5c76249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:43.530485 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b970f-ed23-4478-bd17-5d06f5c76249 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:43.530762 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b970f-ed23-4478-bd17-5d06f5c76249 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:43.531111 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b970f-ed23-4478-bd17-5d06f5c76249 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:43.532023 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3b970f-ed23-4478-bd17-5d06f5c76249 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:43.533633 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3b970f-ed23-4478-bd17-5d06f5c76249 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:43.545616 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2714/5396] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:32:43 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:32:43.549640 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3b970f-ed23-4478-bd17-5d06f5c76249 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:43.560120 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3b970f-ed23-4478-bd17-5d06f5c76249 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:43.565505 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133341b6-61f5-4657-8039-5f16bd2a76ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:43.566400 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133341b6-61f5-4657-8039-5f16bd2a76ae admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:43.566687 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133341b6-61f5-4657-8039-5f16bd2a76ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:43.571401 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133341b6-61f5-4657-8039-5f16bd2a76ae admin admin] PATH_INFO: `/v3/projects/518df7d85bbf4702b3a30647ead34c0c/users/dbadb11ec9d1442b8349bbc8447f55f6/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:43.571401 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133341b6-61f5-4657-8039-5f16bd2a76ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=518df7d85bbf4702b3a30647ead34c0c, user_id=dbadb11ec9d1442b8349bbc8447f55f6, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:43.572118 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133341b6-61f5-4657-8039-5f16bd2a76ae admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:43.583194 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2715/5397] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:32:43 2022] PUT /identity/v3/projects/518df7d85bbf4702b3a30647ead34c0c/users/dbadb11ec9d1442b8349bbc8447f55f6/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:32:43.595016 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250bb296-1042-4e8e-af42-424250cf5aa7 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:43.600199 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250bb296-1042-4e8e-af42-424250cf5aa7 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:43.600199 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250bb296-1042-4e8e-af42-424250cf5aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:43.600396 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c94e98ed-8dfe-4c0d-b75c-f60d37c56559 admin admin] The token cache is being invalidate because project 0c087509b6aa40b0b220f34beebf3501 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:32:43.600396 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c94e98ed-8dfe-4c0d-b75c-f60d37c56559 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:43.600396 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c94e98ed-8dfe-4c0d-b75c-f60d37c56559 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:43.600396 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2683/5398] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:32:43 2022] DELETE /identity/v3/projects/0c087509b6aa40b0b220f34beebf3501 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:32:43.605017 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94e98ed-8dfe-4c0d-b75c-f60d37c56559 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:43.607218 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c94e98ed-8dfe-4c0d-b75c-f60d37c56559 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:43.626371 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-250bb296-1042-4e8e-af42-424250cf5aa7 None None] MFA Rules not processed for user `dbadb11ec9d1442b8349bbc8447f55f6`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:32:43.627792 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-250bb296-1042-4e8e-af42-424250cf5aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:43.643101 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94e98ed-8dfe-4c0d-b75c-f60d37c56559 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:43.739858 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2716/5399] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:32:43 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:32:43.752389 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250bb296-1042-4e8e-af42-424250cf5aa7 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:43.757340 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e06d09-5f3b-42a3-a783-efdbe5e6fab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:43.758279 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e06d09-5f3b-42a3-a783-efdbe5e6fab2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:43.759348 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e06d09-5f3b-42a3-a783-efdbe5e6fab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:43.759721 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e06d09-5f3b-42a3-a783-efdbe5e6fab2 admin admin] PATH_INFO: `/v3/users/c5cb11bcfe5243e7b460464a41343980` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:43.761303 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e06d09-5f3b-42a3-a783-efdbe5e6fab2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5cb11bcfe5243e7b460464a41343980)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:43.763516 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e06d09-5f3b-42a3-a783-efdbe5e6fab2 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:43.763630 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250bb296-1042-4e8e-af42-424250cf5aa7 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:43.770688 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc893a6d-d2a2-4579-a299-85368721888c tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbadb11ec9d1442b8349bbc8447f55f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518df7d85bbf4702b3a30647ead34c0c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:43.771342 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc893a6d-d2a2-4579-a299-85368721888c tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:43.771669 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc893a6d-d2a2-4579-a299-85368721888c tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:43.771949 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc893a6d-d2a2-4579-a299-85368721888c tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:43.772962 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc893a6d-d2a2-4579-a299-85368721888c tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:43.774288 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc893a6d-d2a2-4579-a299-85368721888c tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:43.904406 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2717/5400] 10.222.0.52 () {60 vars in 1148 bytes} [Sat May 14 21:32:43 2022] POST /identity/v3/domains => generated 245 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:32:43.908423 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc893a6d-d2a2-4579-a299-85368721888c tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:43.998443 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc893a6d-d2a2-4579-a299-85368721888c tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:44.005302 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276a4b1b-5fd0-4c3a-bbd9-67b756771439 tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbadb11ec9d1442b8349bbc8447f55f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518df7d85bbf4702b3a30647ead34c0c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:44.007832 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a4b1b-5fd0-4c3a-bbd9-67b756771439 tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:44.007832 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a4b1b-5fd0-4c3a-bbd9-67b756771439 tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:44.008061 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a4b1b-5fd0-4c3a-bbd9-67b756771439 tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:44.009012 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276a4b1b-5fd0-4c3a-bbd9-67b756771439 tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:44.012191 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276a4b1b-5fd0-4c3a-bbd9-67b756771439 tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:44.110541 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a9e06d09-5f3b-42a3-a783-efdbe5e6fab2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5cb11bcfe5243e7b460464a41343980'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:44.120947 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a9e06d09-5f3b-42a3-a783-efdbe5e6fab2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5cb11bcfe5243e7b460464a41343980'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:44.122065 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a9e06d09-5f3b-42a3-a783-efdbe5e6fab2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5cb11bcfe5243e7b460464a41343980'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:44.215279 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2718/5401] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:32:43 2022] POST /identity/v3/projects => generated 409 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:32:44.220324 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276a4b1b-5fd0-4c3a-bbd9-67b756771439 tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:44.256758 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a9e06d09-5f3b-42a3-a783-efdbe5e6fab2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5cb11bcfe5243e7b460464a41343980'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:44.287533 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a9e06d09-5f3b-42a3-a783-efdbe5e6fab2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5cb11bcfe5243e7b460464a41343980'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:44.294730 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2684/5402] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:32:43 2022] DELETE /identity/v3/users/c5cb11bcfe5243e7b460464a41343980 => generated 0 bytes in 691 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:32:44.306905 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276a4b1b-5fd0-4c3a-bbd9-67b756771439 tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:44.379447 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c3f29-addc-4215-9ab2-9d1a7ccf001c tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbadb11ec9d1442b8349bbc8447f55f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518df7d85bbf4702b3a30647ead34c0c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:44.380530 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c3f29-addc-4215-9ab2-9d1a7ccf001c tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:44.380976 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c3f29-addc-4215-9ab2-9d1a7ccf001c tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:44.381427 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c3f29-addc-4215-9ab2-9d1a7ccf001c tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:44.382281 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19c3f29-addc-4215-9ab2-9d1a7ccf001c tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:44.385071 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19c3f29-addc-4215-9ab2-9d1a7ccf001c tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:44.456740 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e06d09-5f3b-42a3-a783-efdbe5e6fab2 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:44.458921 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-a9e06d09-5f3b-42a3-a783-efdbe5e6fab2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:44.500455 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2719/5403] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:32:44 2022] POST /identity/v3/users => generated 347 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:32:44.504361 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c3f29-addc-4215-9ab2-9d1a7ccf001c tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:44.506892 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c19c3f29-addc-4215-9ab2-9d1a7ccf001c tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:44.547403 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c3f29-addc-4215-9ab2-9d1a7ccf001c tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:44.562306 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fb7f8c-de74-4e09-89ca-e30d8cd3876d tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbadb11ec9d1442b8349bbc8447f55f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518df7d85bbf4702b3a30647ead34c0c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:44.563196 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb7f8c-de74-4e09-89ca-e30d8cd3876d tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:44.563196 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb7f8c-de74-4e09-89ca-e30d8cd3876d tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:44.563375 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb7f8c-de74-4e09-89ca-e30d8cd3876d tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:44.564321 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fb7f8c-de74-4e09-89ca-e30d8cd3876d tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:44.572317 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fb7f8c-de74-4e09-89ca-e30d8cd3876d tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:44.592127 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2720/5404] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:32:44.596017 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fb7f8c-de74-4e09-89ca-e30d8cd3876d tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:44.599224 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e06d09-5f3b-42a3-a783-efdbe5e6fab2 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:44.606210 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c28a161-f95e-46ea-b154-cc67424a69eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:44.607976 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28a161-f95e-46ea-b154-cc67424a69eb service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:44.623057 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28a161-f95e-46ea-b154-cc67424a69eb service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:44.629389 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28a161-f95e-46ea-b154-cc67424a69eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:44.630031 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fb7f8c-de74-4e09-89ca-e30d8cd3876d tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:44.630811 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-4c28a161-f95e-46ea-b154-cc67424a69eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:44.639930 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df18842d-41e6-4bfa-ba1d-442601bb7501 tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbadb11ec9d1442b8349bbc8447f55f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518df7d85bbf4702b3a30647ead34c0c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:44.640835 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df18842d-41e6-4bfa-ba1d-442601bb7501 tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:44.641189 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df18842d-41e6-4bfa-ba1d-442601bb7501 tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:44.641652 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df18842d-41e6-4bfa-ba1d-442601bb7501 tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] PATH_INFO: `/v3/projects/0b9febed568345ee9a54a502329a18ac/users/92573bd241604ab4a094e54c6fac2a39/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:44.646717 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c28a161-f95e-46ea-b154-cc67424a69eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:44.649331 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c28a161-f95e-46ea-b154-cc67424a69eb service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:44.665556 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2685/5405] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:32:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:32:44.678453 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df18842d-41e6-4bfa-ba1d-442601bb7501 tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] RBAC: Authorizing `identity:create_grant(project_id=0b9febed568345ee9a54a502329a18ac, user_id=92573bd241604ab4a094e54c6fac2a39, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:44.683292 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df18842d-41e6-4bfa-ba1d-442601bb7501 tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:44.781429 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2721/5406] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:32:44 2022] PUT /identity/v3/projects/0b9febed568345ee9a54a502329a18ac/users/92573bd241604ab4a094e54c6fac2a39/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:32:44.785827 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06201d0-ecb9-43d6-84be-068dd43ae8db None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:44.786119 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06201d0-ecb9-43d6-84be-068dd43ae8db None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:44.786404 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06201d0-ecb9-43d6-84be-068dd43ae8db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:44.923421 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-f06201d0-ecb9-43d6-84be-068dd43ae8db None None] MFA Rules not processed for user `92573bd241604ab4a094e54c6fac2a39`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:32:44.925477 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-f06201d0-ecb9-43d6-84be-068dd43ae8db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:44.927154 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df18842d-41e6-4bfa-ba1d-442601bb7501 tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:44.928936 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-df18842d-41e6-4bfa-ba1d-442601bb7501 tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:44.961423 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2686/5407] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:32:44 2022] POST /identity/v3/auth/tokens => generated 3350 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:32:44.974038 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa4eb9-0632-478e-8432-5563607f4fc1 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:44.974560 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa4eb9-0632-478e-8432-5563607f4fc1 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:44.975048 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa4eb9-0632-478e-8432-5563607f4fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:45.005494 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-61fa4eb9-0632-478e-8432-5563607f4fc1 None None] MFA Rules not processed for user `92573bd241604ab4a094e54c6fac2a39`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:32:45.007148 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-61fa4eb9-0632-478e-8432-5563607f4fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:45.019280 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2687/5408] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:32:44 2022] POST /identity/v3/auth/tokens => generated 3350 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:32:45.024436 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fa4eb9-0632-478e-8432-5563607f4fc1 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:45.035192 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fa4eb9-0632-478e-8432-5563607f4fc1 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:45.040767 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d460c2b-e392-44a6-a1d4-da29ddb16093 tempest-test_project-1324157339 tempest-user-443263332] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92573bd241604ab4a094e54c6fac2a39', 'user_domain_id': '90b3fe5732b649698b256ed93bbc4db7', 'system_scope': None, 'project_id': '0b9febed568345ee9a54a502329a18ac', 'project_domain_id': '90b3fe5732b649698b256ed93bbc4db7', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:45.042322 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d460c2b-e392-44a6-a1d4-da29ddb16093 tempest-test_project-1324157339 tempest-user-443263332] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:45.042486 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d460c2b-e392-44a6-a1d4-da29ddb16093 tempest-test_project-1324157339 tempest-user-443263332] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:45.043103 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d460c2b-e392-44a6-a1d4-da29ddb16093 tempest-test_project-1324157339 tempest-user-443263332] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:45.049744 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df18842d-41e6-4bfa-ba1d-442601bb7501 tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:45.051518 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d460c2b-e392-44a6-a1d4-da29ddb16093 tempest-test_project-1324157339 tempest-user-443263332] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:45.053255 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d460c2b-e392-44a6-a1d4-da29ddb16093 tempest-test_project-1324157339 tempest-user-443263332] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:45.061259 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbab67e-b95c-4407-996f-ef14873046c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:45.063068 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbab67e-b95c-4407-996f-ef14873046c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:45.063068 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbab67e-b95c-4407-996f-ef14873046c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:45.064175 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbab67e-b95c-4407-996f-ef14873046c1 admin admin] PATH_INFO: `/v3/projects/7ed63d34601b465898ecacd22cd3e558` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:45.065238 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2688/5409] 10.222.0.52 () {56 vars in 1283 bytes} [Sat May 14 21:32:45 2022] GET /identity/v3/auth/tokens => generated 3350 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:32:45.066371 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbab67e-b95c-4407-996f-ef14873046c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ed63d34601b465898ecacd22cd3e558)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:45.068658 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbab67e-b95c-4407-996f-ef14873046c1 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:45.069690 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d460c2b-e392-44a6-a1d4-da29ddb16093 tempest-test_project-1324157339 tempest-user-443263332] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:45.146132 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d460c2b-e392-44a6-a1d4-da29ddb16093 tempest-test_project-1324157339 tempest-user-443263332] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:45.152711 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea7b6d-bf25-472e-b5fe-735a08fe0d57 tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbadb11ec9d1442b8349bbc8447f55f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518df7d85bbf4702b3a30647ead34c0c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:45.153693 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea7b6d-bf25-472e-b5fe-735a08fe0d57 tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:45.154077 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea7b6d-bf25-472e-b5fe-735a08fe0d57 tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:45.154423 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea7b6d-bf25-472e-b5fe-735a08fe0d57 tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] PATH_INFO: `/v3/users/92573bd241604ab4a094e54c6fac2a39` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:45.155725 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ea7b6d-bf25-472e-b5fe-735a08fe0d57 tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] RBAC: Authorizing `identity:delete_user(user_id=92573bd241604ab4a094e54c6fac2a39)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:45.157811 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ea7b6d-bf25-472e-b5fe-735a08fe0d57 tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:45.194447 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6fbab67e-b95c-4407-996f-ef14873046c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ed63d34601b465898ecacd22cd3e558', 'request_id': 'req-6fbab67e-b95c-4407-996f-ef14873046c1'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:45.202984 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6fbab67e-b95c-4407-996f-ef14873046c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ed63d34601b465898ecacd22cd3e558', 'request_id': 'req-6fbab67e-b95c-4407-996f-ef14873046c1'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:45.296080 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6fbab67e-b95c-4407-996f-ef14873046c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ed63d34601b465898ecacd22cd3e558', 'request_id': 'req-6fbab67e-b95c-4407-996f-ef14873046c1'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:45.309554 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6fbab67e-b95c-4407-996f-ef14873046c1 admin admin] The token cache is being invalidate because project 7ed63d34601b465898ecacd22cd3e558 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:32:45.309834 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6fbab67e-b95c-4407-996f-ef14873046c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:45.310501 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6fbab67e-b95c-4407-996f-ef14873046c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:45.317645 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2722/5410] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:32:44 2022] DELETE /identity/v3/projects/7ed63d34601b465898ecacd22cd3e558 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:32:45.319045 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3467a945-1733-496e-88f6-85c2b5bce2d1 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:45.319333 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3467a945-1733-496e-88f6-85c2b5bce2d1 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:45.319639 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3467a945-1733-496e-88f6-85c2b5bce2d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:45.344021 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-3467a945-1733-496e-88f6-85c2b5bce2d1 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:32:45.345267 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-3467a945-1733-496e-88f6-85c2b5bce2d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:45.348034 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-96ea7b6d-bf25-472e-b5fe-735a08fe0d57 tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92573bd241604ab4a094e54c6fac2a39'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:45.359768 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-96ea7b6d-bf25-472e-b5fe-735a08fe0d57 tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92573bd241604ab4a094e54c6fac2a39'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:45.362334 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-96ea7b6d-bf25-472e-b5fe-735a08fe0d57 tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92573bd241604ab4a094e54c6fac2a39'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:45.414751 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2723/5411] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:32:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:32:45.423816 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b24940c-f06d-4006-b9c7-f4b738d3415d None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:45.424156 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b24940c-f06d-4006-b9c7-f4b738d3415d None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:45.424438 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b24940c-f06d-4006-b9c7-f4b738d3415d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:45.443732 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-3b24940c-f06d-4006-b9c7-f4b738d3415d None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:32:45.445014 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-3b24940c-f06d-4006-b9c7-f4b738d3415d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:45.459741 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2724/5412] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:32:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:32:45.461701 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b24940c-f06d-4006-b9c7-f4b738d3415d None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:45.476203 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b24940c-f06d-4006-b9c7-f4b738d3415d None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:45.482054 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0dbfdf-c87b-40f3-a0c4-84b163fb54a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:45.482801 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0dbfdf-c87b-40f3-a0c4-84b163fb54a9 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:45.483159 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0dbfdf-c87b-40f3-a0c4-84b163fb54a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:45.483538 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0dbfdf-c87b-40f3-a0c4-84b163fb54a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:45.484341 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0dbfdf-c87b-40f3-a0c4-84b163fb54a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:32:45.484728 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0dbfdf-c87b-40f3-a0c4-84b163fb54a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:45.486701 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0dbfdf-c87b-40f3-a0c4-84b163fb54a9 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:45.500408 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2725/5413] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:32:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:32:45.504645 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0dbfdf-c87b-40f3-a0c4-84b163fb54a9 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:45.517504 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0dbfdf-c87b-40f3-a0c4-84b163fb54a9 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:45.523539 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b5f911-f087-4098-bc40-ca3cf0ed20c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:45.524454 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5f911-f087-4098-bc40-ca3cf0ed20c1 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:45.524849 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5f911-f087-4098-bc40-ca3cf0ed20c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:45.525246 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5f911-f087-4098-bc40-ca3cf0ed20c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:45.526164 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b5f911-f087-4098-bc40-ca3cf0ed20c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:45.528729 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b5f911-f087-4098-bc40-ca3cf0ed20c1 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:45.597925 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-96ea7b6d-bf25-472e-b5fe-735a08fe0d57 tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92573bd241604ab4a094e54c6fac2a39'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:45.611612 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-96ea7b6d-bf25-472e-b5fe-735a08fe0d57 tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92573bd241604ab4a094e54c6fac2a39'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:45.622019 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2689/5414] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:32:45 2022] DELETE /identity/v3/users/92573bd241604ab4a094e54c6fac2a39 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:32:45.623004 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea7b6d-bf25-472e-b5fe-735a08fe0d57 tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:45.624490 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-96ea7b6d-bf25-472e-b5fe-735a08fe0d57 tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:45.691919 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea7b6d-bf25-472e-b5fe-735a08fe0d57 tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:45.697351 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c504e-10e0-4bc9-9fef-fc4523f86f67 tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbadb11ec9d1442b8349bbc8447f55f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518df7d85bbf4702b3a30647ead34c0c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:45.698080 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c504e-10e0-4bc9-9fef-fc4523f86f67 tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:45.698404 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c504e-10e0-4bc9-9fef-fc4523f86f67 tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:45.698685 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c504e-10e0-4bc9-9fef-fc4523f86f67 tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] PATH_INFO: `/v3/projects/0b9febed568345ee9a54a502329a18ac` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:45.699899 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4c504e-10e0-4bc9-9fef-fc4523f86f67 tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0b9febed568345ee9a54a502329a18ac)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:45.704652 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2726/5415] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:32:45 2022] POST /identity/v3/projects => generated 375 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:32:45.704796 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4c504e-10e0-4bc9-9fef-fc4523f86f67 tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:45.706210 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b5f911-f087-4098-bc40-ca3cf0ed20c1 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:45.708106 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-39b5f911-f087-4098-bc40-ca3cf0ed20c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:45.784891 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b5f911-f087-4098-bc40-ca3cf0ed20c1 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:45.790073 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c2176c-1c59-4f06-81d4-e2bf71bd437c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:45.790749 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c2176c-1c59-4f06-81d4-e2bf71bd437c admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:45.791200 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c2176c-1c59-4f06-81d4-e2bf71bd437c admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:45.791666 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c2176c-1c59-4f06-81d4-e2bf71bd437c admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:45.792361 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c2176c-1c59-4f06-81d4-e2bf71bd437c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:45.794466 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c2176c-1c59-4f06-81d4-e2bf71bd437c admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:45.867800 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-fa4c504e-10e0-4bc9-9fef-fc4523f86f67 tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b9febed568345ee9a54a502329a18ac', 'request_id': 'req-fa4c504e-10e0-4bc9-9fef-fc4523f86f67'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:45.876635 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-fa4c504e-10e0-4bc9-9fef-fc4523f86f67 tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b9febed568345ee9a54a502329a18ac', 'request_id': 'req-fa4c504e-10e0-4bc9-9fef-fc4523f86f67'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:45.884837 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-fa4c504e-10e0-4bc9-9fef-fc4523f86f67 tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b9febed568345ee9a54a502329a18ac', 'request_id': 'req-fa4c504e-10e0-4bc9-9fef-fc4523f86f67'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:45.944694 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2727/5416] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:32:45 2022] POST /identity/v3/users => generated 288 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:32:45.945863 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c2176c-1c59-4f06-81d4-e2bf71bd437c admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:45.957601 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c2176c-1c59-4f06-81d4-e2bf71bd437c admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:46.003268 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-fa4c504e-10e0-4bc9-9fef-fc4523f86f67 tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] The token cache is being invalidate because project 0b9febed568345ee9a54a502329a18ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:32:46.003584 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-fa4c504e-10e0-4bc9-9fef-fc4523f86f67 tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:46.006561 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-fa4c504e-10e0-4bc9-9fef-fc4523f86f67 tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:46.012640 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2690/5417] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:32:45 2022] DELETE /identity/v3/projects/0b9febed568345ee9a54a502329a18ac => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:32:46.019641 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c504e-10e0-4bc9-9fef-fc4523f86f67 tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:46.022166 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-fa4c504e-10e0-4bc9-9fef-fc4523f86f67 tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:46.046248 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bde7d1-c780-40b1-af9e-7c93597cbc9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:46.047348 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bde7d1-c780-40b1-af9e-7c93597cbc9e admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:46.047662 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bde7d1-c780-40b1-af9e-7c93597cbc9e admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:46.047943 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bde7d1-c780-40b1-af9e-7c93597cbc9e admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:46.049793 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bde7d1-c780-40b1-af9e-7c93597cbc9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:46.052075 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bde7d1-c780-40b1-af9e-7c93597cbc9e admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:46.068260 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2728/5418] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:32:46.072752 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bde7d1-c780-40b1-af9e-7c93597cbc9e admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:46.074601 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-10bde7d1-c780-40b1-af9e-7c93597cbc9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:46.112823 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bde7d1-c780-40b1-af9e-7c93597cbc9e admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:46.118435 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad3efb1-c4bf-418d-9b33-4f42b141b939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:46.119150 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad3efb1-c4bf-418d-9b33-4f42b141b939 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:46.120631 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad3efb1-c4bf-418d-9b33-4f42b141b939 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:46.121022 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad3efb1-c4bf-418d-9b33-4f42b141b939 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:46.121762 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad3efb1-c4bf-418d-9b33-4f42b141b939 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:46.123596 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad3efb1-c4bf-418d-9b33-4f42b141b939 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:46.140961 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2729/5419] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:32:46 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:32:46.140961 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad3efb1-c4bf-418d-9b33-4f42b141b939 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:46.177671 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad3efb1-c4bf-418d-9b33-4f42b141b939 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:46.190768 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611a4607-2226-4b90-a12d-58b040eb6676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:46.191706 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a4607-2226-4b90-a12d-58b040eb6676 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:46.191992 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a4607-2226-4b90-a12d-58b040eb6676 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:46.192267 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a4607-2226-4b90-a12d-58b040eb6676 admin admin] PATH_INFO: `/v3/projects/42f767810e984404be0dc9a736a84765/users/7ac035423b7e4250987fa75efd7893cb/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:46.195625 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c504e-10e0-4bc9-9fef-fc4523f86f67 tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:46.202626 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb65b203-82df-43c7-aa8d-834b29c1817b tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbadb11ec9d1442b8349bbc8447f55f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518df7d85bbf4702b3a30647ead34c0c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:46.204237 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb65b203-82df-43c7-aa8d-834b29c1817b tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:46.204810 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb65b203-82df-43c7-aa8d-834b29c1817b tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:46.205150 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb65b203-82df-43c7-aa8d-834b29c1817b tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] PATH_INFO: `/v3/domains/90b3fe5732b649698b256ed93bbc4db7` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:46.206689 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb65b203-82df-43c7-aa8d-834b29c1817b tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=90b3fe5732b649698b256ed93bbc4db7)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:46.209744 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb65b203-82df-43c7-aa8d-834b29c1817b tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:46.223121 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611a4607-2226-4b90-a12d-58b040eb6676 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42f767810e984404be0dc9a736a84765, user_id=7ac035423b7e4250987fa75efd7893cb, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:46.227449 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611a4607-2226-4b90-a12d-58b040eb6676 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:46.238634 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-fb65b203-82df-43c7-aa8d-834b29c1817b tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '90b3fe5732b649698b256ed93bbc4db7'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:46.239649 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-fb65b203-82df-43c7-aa8d-834b29c1817b tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '90b3fe5732b649698b256ed93bbc4db7'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:46.330198 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2730/5420] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:32:46 2022] PUT /identity/v3/projects/42f767810e984404be0dc9a736a84765/users/7ac035423b7e4250987fa75efd7893cb/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:32:46.342996 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce487f-2a3a-4c2e-9f33-eab047c84f7b None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:46.343395 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce487f-2a3a-4c2e-9f33-eab047c84f7b None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:46.343766 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce487f-2a3a-4c2e-9f33-eab047c84f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:46.370382 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-fb65b203-82df-43c7-aa8d-834b29c1817b tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '90b3fe5732b649698b256ed93bbc4db7'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:46.373397 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-fb65b203-82df-43c7-aa8d-834b29c1817b tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '90b3fe5732b649698b256ed93bbc4db7'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:46.376131 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2691/5421] 10.222.0.52 () {60 vars in 1248 bytes} [Sat May 14 21:32:46 2022] PATCH /identity/v3/domains/90b3fe5732b649698b256ed93bbc4db7 => generated 246 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:32:46.380195 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb65b203-82df-43c7-aa8d-834b29c1817b tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:46.386251 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-fb65b203-82df-43c7-aa8d-834b29c1817b tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:46.430869 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-afce487f-2a3a-4c2e-9f33-eab047c84f7b None None] MFA Rules not processed for user `7ac035423b7e4250987fa75efd7893cb`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:32:46.434710 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-afce487f-2a3a-4c2e-9f33-eab047c84f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:46.537904 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb65b203-82df-43c7-aa8d-834b29c1817b tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:46.593452 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2731/5422] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:32:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:32:46.598475 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce487f-2a3a-4c2e-9f33-eab047c84f7b None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:46.600931 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-afce487f-2a3a-4c2e-9f33-eab047c84f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:46.690399 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5e6b84-9e7b-4478-ac12-61a8eff491c3 tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbadb11ec9d1442b8349bbc8447f55f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518df7d85bbf4702b3a30647ead34c0c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:46.696444 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e6b84-9e7b-4478-ac12-61a8eff491c3 tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:46.699346 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e6b84-9e7b-4478-ac12-61a8eff491c3 tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:46.699828 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e6b84-9e7b-4478-ac12-61a8eff491c3 tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] PATH_INFO: `/v3/domains/90b3fe5732b649698b256ed93bbc4db7` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:46.723498 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce487f-2a3a-4c2e-9f33-eab047c84f7b None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:46.731920 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4dcf3b-af6d-42bc-946a-f7aa7d3610ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:46.733322 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4dcf3b-af6d-42bc-946a-f7aa7d3610ac admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:46.733754 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4dcf3b-af6d-42bc-946a-f7aa7d3610ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:46.734338 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4dcf3b-af6d-42bc-946a-f7aa7d3610ac admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:46.735413 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4dcf3b-af6d-42bc-946a-f7aa7d3610ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:46.737681 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4dcf3b-af6d-42bc-946a-f7aa7d3610ac admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:46.740844 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5e6b84-9e7b-4478-ac12-61a8eff491c3 tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=90b3fe5732b649698b256ed93bbc4db7)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:46.747863 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5e6b84-9e7b-4478-ac12-61a8eff491c3 tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:46.814761 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ba5e6b84-9e7b-4478-ac12-61a8eff491c3 tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '90b3fe5732b649698b256ed93bbc4db7'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:46.852260 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ba5e6b84-9e7b-4478-ac12-61a8eff491c3 tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '90b3fe5732b649698b256ed93bbc4db7'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:46.857903 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2732/5423] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:32:46 2022] POST /identity/v3/projects => generated 377 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:32:46.858996 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4dcf3b-af6d-42bc-946a-f7aa7d3610ac admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:46.984771 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4dcf3b-af6d-42bc-946a-f7aa7d3610ac admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:46.990171 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d91a11-80c0-4f56-848b-dc570e4b3fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:46.990916 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d91a11-80c0-4f56-848b-dc570e4b3fde admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:46.991250 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d91a11-80c0-4f56-848b-dc570e4b3fde admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:46.991575 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d91a11-80c0-4f56-848b-dc570e4b3fde admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:46.992941 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d91a11-80c0-4f56-848b-dc570e4b3fde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:46.995512 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d91a11-80c0-4f56-848b-dc570e4b3fde admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:47.027231 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ba5e6b84-9e7b-4478-ac12-61a8eff491c3 tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90b3fe5732b649698b256ed93bbc4db7', 'request_id': 'req-ba5e6b84-9e7b-4478-ac12-61a8eff491c3'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:47.034226 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ba5e6b84-9e7b-4478-ac12-61a8eff491c3 tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90b3fe5732b649698b256ed93bbc4db7', 'request_id': 'req-ba5e6b84-9e7b-4478-ac12-61a8eff491c3'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:47.043417 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ba5e6b84-9e7b-4478-ac12-61a8eff491c3 tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90b3fe5732b649698b256ed93bbc4db7', 'request_id': 'req-ba5e6b84-9e7b-4478-ac12-61a8eff491c3'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:47.112300 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2733/5424] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:32:46 2022] POST /identity/v3/users => generated 295 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:32:47.115213 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d91a11-80c0-4f56-848b-dc570e4b3fde admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:47.133086 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d91a11-80c0-4f56-848b-dc570e4b3fde admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:47.136063 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ba5e6b84-9e7b-4478-ac12-61a8eff491c3 tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] The token cache is being invalidate because project 90b3fe5732b649698b256ed93bbc4db7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:32:47.143113 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ba5e6b84-9e7b-4478-ac12-61a8eff491c3 tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:47.143113 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ba5e6b84-9e7b-4478-ac12-61a8eff491c3 tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:47.147426 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ba5e6b84-9e7b-4478-ac12-61a8eff491c3 tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '90b3fe5732b649698b256ed93bbc4db7', 'request_id': 'req-ba5e6b84-9e7b-4478-ac12-61a8eff491c3'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:47.148527 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ba5e6b84-9e7b-4478-ac12-61a8eff491c3 tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '90b3fe5732b649698b256ed93bbc4db7', 'request_id': 'req-ba5e6b84-9e7b-4478-ac12-61a8eff491c3'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:47.152840 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ba5e6b84-9e7b-4478-ac12-61a8eff491c3 tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '90b3fe5732b649698b256ed93bbc4db7', 'request_id': 'req-ba5e6b84-9e7b-4478-ac12-61a8eff491c3'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:47.161426 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2692/5425] 10.222.0.52 () {58 vars in 1229 bytes} [Sat May 14 21:32:46 2022] DELETE /identity/v3/domains/90b3fe5732b649698b256ed93bbc4db7 => generated 0 bytes in 782 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:32:47.167009 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5e6b84-9e7b-4478-ac12-61a8eff491c3 tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:47.168765 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-ba5e6b84-9e7b-4478-ac12-61a8eff491c3 tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:47.271741 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb531004-b622-4710-9a15-21861e82d070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:47.271741 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb531004-b622-4710-9a15-21861e82d070 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:47.271741 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb531004-b622-4710-9a15-21861e82d070 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:47.271741 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb531004-b622-4710-9a15-21861e82d070 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:47.272178 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb531004-b622-4710-9a15-21861e82d070 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:47.279178 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb531004-b622-4710-9a15-21861e82d070 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:47.318183 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2734/5426] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:32:47 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:32:47.321861 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb531004-b622-4710-9a15-21861e82d070 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:47.326726 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-fb531004-b622-4710-9a15-21861e82d070 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:47.344621 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5e6b84-9e7b-4478-ac12-61a8eff491c3 tempest-TestDefaultProjectId-1048289884 tempest-TestDefaultProjectId-1048289884-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:47.357061 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b8b53-66b2-4fd7-98f4-2a64412d92a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:47.358102 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b8b53-66b2-4fd7-98f4-2a64412d92a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:47.359223 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb531004-b622-4710-9a15-21861e82d070 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:47.359640 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b8b53-66b2-4fd7-98f4-2a64412d92a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:47.360966 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b8b53-66b2-4fd7-98f4-2a64412d92a6 admin admin] PATH_INFO: `/v3/users/0154df4d09de4928b87558f4783beacb` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:47.362918 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83b8b53-66b2-4fd7-98f4-2a64412d92a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0154df4d09de4928b87558f4783beacb)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:47.365831 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83b8b53-66b2-4fd7-98f4-2a64412d92a6 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:47.372549 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aa36ca-fea8-41a7-a51d-bbd3ce9baae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:47.374377 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa36ca-fea8-41a7-a51d-bbd3ce9baae4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:47.375101 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa36ca-fea8-41a7-a51d-bbd3ce9baae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:47.376381 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa36ca-fea8-41a7-a51d-bbd3ce9baae4 admin admin] PATH_INFO: `/v3/projects/032ba616dcc14854aeef541cdedda6df/users/32dfb4a72bb343059307d695af4db2da/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:47.410967 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aa36ca-fea8-41a7-a51d-bbd3ce9baae4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=032ba616dcc14854aeef541cdedda6df, user_id=32dfb4a72bb343059307d695af4db2da, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:47.421066 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aa36ca-fea8-41a7-a51d-bbd3ce9baae4 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:47.604010 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2735/5427] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:32:47 2022] PUT /identity/v3/projects/032ba616dcc14854aeef541cdedda6df/users/32dfb4a72bb343059307d695af4db2da/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:32:47.606476 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aa36ca-fea8-41a7-a51d-bbd3ce9baae4 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:47.692027 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a83b8b53-66b2-4fd7-98f4-2a64412d92a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0154df4d09de4928b87558f4783beacb'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:47.707931 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a83b8b53-66b2-4fd7-98f4-2a64412d92a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0154df4d09de4928b87558f4783beacb'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:47.712110 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a83b8b53-66b2-4fd7-98f4-2a64412d92a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0154df4d09de4928b87558f4783beacb'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:47.724366 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aa36ca-fea8-41a7-a51d-bbd3ce9baae4 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:47.743631 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58908f11-1e26-4e4d-b1b4-d7f3afeadaca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:47.744525 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58908f11-1e26-4e4d-b1b4-d7f3afeadaca admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:47.747654 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58908f11-1e26-4e4d-b1b4-d7f3afeadaca admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:47.748877 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58908f11-1e26-4e4d-b1b4-d7f3afeadaca admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:47.751679 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58908f11-1e26-4e4d-b1b4-d7f3afeadaca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:47.753579 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58908f11-1e26-4e4d-b1b4-d7f3afeadaca admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:47.778191 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2736/5428] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:32:47 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:32:47.785539 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58908f11-1e26-4e4d-b1b4-d7f3afeadaca admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:47.792826 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a83b8b53-66b2-4fd7-98f4-2a64412d92a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0154df4d09de4928b87558f4783beacb'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:47.804688 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58908f11-1e26-4e4d-b1b4-d7f3afeadaca admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:47.812100 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38201a9-46aa-42b0-91b5-1f70fc854b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:47.813165 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38201a9-46aa-42b0-91b5-1f70fc854b37 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:47.813606 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38201a9-46aa-42b0-91b5-1f70fc854b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:47.813895 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38201a9-46aa-42b0-91b5-1f70fc854b37 admin admin] PATH_INFO: `/v3/projects/032ba616dcc14854aeef541cdedda6df/users/32dfb4a72bb343059307d695af4db2da/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:47.817050 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38201a9-46aa-42b0-91b5-1f70fc854b37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=032ba616dcc14854aeef541cdedda6df, user_id=32dfb4a72bb343059307d695af4db2da, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:47.819835 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38201a9-46aa-42b0-91b5-1f70fc854b37 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:47.825153 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a83b8b53-66b2-4fd7-98f4-2a64412d92a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0154df4d09de4928b87558f4783beacb'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:47.835503 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2693/5429] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:32:47 2022] DELETE /identity/v3/users/0154df4d09de4928b87558f4783beacb => generated 0 bytes in 667 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:32:47.837485 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130797be-2f77-4637-9fd0-e0772ea97ac3 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:47.843275 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130797be-2f77-4637-9fd0-e0772ea97ac3 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:47.843408 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2737/5430] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:32:47 2022] PUT /identity/v3/projects/032ba616dcc14854aeef541cdedda6df/users/32dfb4a72bb343059307d695af4db2da/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:32:47.843613 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130797be-2f77-4637-9fd0-e0772ea97ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:47.848501 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d4eba-d8d6-41aa-b534-b23b7c8c58f5 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:47.849131 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d4eba-d8d6-41aa-b534-b23b7c8c58f5 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:47.849565 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d4eba-d8d6-41aa-b534-b23b7c8c58f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:47.857513 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-130797be-2f77-4637-9fd0-e0772ea97ac3 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:32:47.858845 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-130797be-2f77-4637-9fd0-e0772ea97ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:47.892512 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-f62d4eba-d8d6-41aa-b534-b23b7c8c58f5 None None] MFA Rules not processed for user `32dfb4a72bb343059307d695af4db2da`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:32:47.893793 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-f62d4eba-d8d6-41aa-b534-b23b7c8c58f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:47.982119 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2694/5431] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:32:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:32:47.998482 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130797be-2f77-4637-9fd0-e0772ea97ac3 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:48.000341 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-130797be-2f77-4637-9fd0-e0772ea97ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:48.029628 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2738/5432] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:32:47 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:32:48.066172 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62d4eba-d8d6-41aa-b534-b23b7c8c58f5 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:48.070154 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-f62d4eba-d8d6-41aa-b534-b23b7c8c58f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:48.117488 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130797be-2f77-4637-9fd0-e0772ea97ac3 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:48.124374 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbd2ae9-dc95-4ac0-8ed2-2406c12eea02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:48.126965 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd2ae9-dc95-4ac0-8ed2-2406c12eea02 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:48.127900 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd2ae9-dc95-4ac0-8ed2-2406c12eea02 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:48.127900 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd2ae9-dc95-4ac0-8ed2-2406c12eea02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:48.143807 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbd2ae9-dc95-4ac0-8ed2-2406c12eea02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:48.145575 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbd2ae9-dc95-4ac0-8ed2-2406c12eea02 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:48.160689 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2695/5433] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:32:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:32:48.208459 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62d4eba-d8d6-41aa-b534-b23b7c8c58f5 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:48.217813 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685a8c16-0e1a-4207-b340-0d7ff25fd3c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:48.218600 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a8c16-0e1a-4207-b340-0d7ff25fd3c9 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:48.219173 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a8c16-0e1a-4207-b340-0d7ff25fd3c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:48.219600 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a8c16-0e1a-4207-b340-0d7ff25fd3c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:48.232422 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685a8c16-0e1a-4207-b340-0d7ff25fd3c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:48.235591 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685a8c16-0e1a-4207-b340-0d7ff25fd3c9 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:48.262687 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2739/5434] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:32:48 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:32:49.130526 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbd2ae9-dc95-4ac0-8ed2-2406c12eea02 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:49.132154 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-cdbd2ae9-dc95-4ac0-8ed2-2406c12eea02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:49.157997 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbd2ae9-dc95-4ac0-8ed2-2406c12eea02 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:49.179251 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f729192-8212-4dcd-909e-10adc631beac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:49.180416 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f729192-8212-4dcd-909e-10adc631beac admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:49.180889 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f729192-8212-4dcd-909e-10adc631beac admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:49.181355 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f729192-8212-4dcd-909e-10adc631beac admin admin] PATH_INFO: `/v3/projects/01d43a90ddfb4d95909b88ddec426a3d` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:49.184563 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f729192-8212-4dcd-909e-10adc631beac admin admin] RBAC: Authorizing `identity:delete_project(project_id=01d43a90ddfb4d95909b88ddec426a3d)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:49.190664 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f729192-8212-4dcd-909e-10adc631beac admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:49.378323 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-6f729192-8212-4dcd-909e-10adc631beac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01d43a90ddfb4d95909b88ddec426a3d', 'request_id': 'req-6f729192-8212-4dcd-909e-10adc631beac'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:49.385243 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-6f729192-8212-4dcd-909e-10adc631beac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01d43a90ddfb4d95909b88ddec426a3d', 'request_id': 'req-6f729192-8212-4dcd-909e-10adc631beac'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:49.392883 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-6f729192-8212-4dcd-909e-10adc631beac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01d43a90ddfb4d95909b88ddec426a3d', 'request_id': 'req-6f729192-8212-4dcd-909e-10adc631beac'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:49.486914 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-6f729192-8212-4dcd-909e-10adc631beac admin admin] The token cache is being invalidate because project 01d43a90ddfb4d95909b88ddec426a3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:32:49.486914 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-6f729192-8212-4dcd-909e-10adc631beac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:49.486914 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-6f729192-8212-4dcd-909e-10adc631beac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:49.486914 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2696/5435] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:32:49 2022] DELETE /identity/v3/projects/01d43a90ddfb4d95909b88ddec426a3d => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:32:49.488613 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685a8c16-0e1a-4207-b340-0d7ff25fd3c9 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:49.502431 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685a8c16-0e1a-4207-b340-0d7ff25fd3c9 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:49.579203 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d72088-6c67-4b0e-bfd1-790cf1c1ebd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:49.580689 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d72088-6c67-4b0e-bfd1-790cf1c1ebd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:49.581134 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d72088-6c67-4b0e-bfd1-790cf1c1ebd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:49.581592 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d72088-6c67-4b0e-bfd1-790cf1c1ebd0 admin admin] PATH_INFO: `/v3/users/dbadb11ec9d1442b8349bbc8447f55f6` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:49.583076 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d72088-6c67-4b0e-bfd1-790cf1c1ebd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbadb11ec9d1442b8349bbc8447f55f6)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:49.585459 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d72088-6c67-4b0e-bfd1-790cf1c1ebd0 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:49.820182 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-93d72088-6c67-4b0e-bfd1-790cf1c1ebd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbadb11ec9d1442b8349bbc8447f55f6'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:49.838862 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-93d72088-6c67-4b0e-bfd1-790cf1c1ebd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbadb11ec9d1442b8349bbc8447f55f6'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:49.858247 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-93d72088-6c67-4b0e-bfd1-790cf1c1ebd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbadb11ec9d1442b8349bbc8447f55f6'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:49.974218 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-93d72088-6c67-4b0e-bfd1-790cf1c1ebd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbadb11ec9d1442b8349bbc8447f55f6'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:49.974218 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-93d72088-6c67-4b0e-bfd1-790cf1c1ebd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbadb11ec9d1442b8349bbc8447f55f6'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:49.977913 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2740/5436] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:32:49 2022] DELETE /identity/v3/users/dbadb11ec9d1442b8349bbc8447f55f6 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:32:51.023549 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f729192-8212-4dcd-909e-10adc631beac admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:51.027519 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-6f729192-8212-4dcd-909e-10adc631beac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:51.046728 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f729192-8212-4dcd-909e-10adc631beac admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:51.114380 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe741e2-1a32-4bf2-8ceb-933af5886641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:51.115247 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe741e2-1a32-4bf2-8ceb-933af5886641 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:51.115701 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe741e2-1a32-4bf2-8ceb-933af5886641 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:51.115931 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe741e2-1a32-4bf2-8ceb-933af5886641 admin admin] PATH_INFO: `/v3/projects/518df7d85bbf4702b3a30647ead34c0c` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:51.117267 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe741e2-1a32-4bf2-8ceb-933af5886641 admin admin] RBAC: Authorizing `identity:delete_project(project_id=518df7d85bbf4702b3a30647ead34c0c)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:51.120401 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe741e2-1a32-4bf2-8ceb-933af5886641 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:51.240676 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dfe741e2-1a32-4bf2-8ceb-933af5886641 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '518df7d85bbf4702b3a30647ead34c0c', 'request_id': 'req-dfe741e2-1a32-4bf2-8ceb-933af5886641'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:51.248333 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dfe741e2-1a32-4bf2-8ceb-933af5886641 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '518df7d85bbf4702b3a30647ead34c0c', 'request_id': 'req-dfe741e2-1a32-4bf2-8ceb-933af5886641'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:51.259073 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dfe741e2-1a32-4bf2-8ceb-933af5886641 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '518df7d85bbf4702b3a30647ead34c0c', 'request_id': 'req-dfe741e2-1a32-4bf2-8ceb-933af5886641'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:51.344504 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dfe741e2-1a32-4bf2-8ceb-933af5886641 admin admin] The token cache is being invalidate because project 518df7d85bbf4702b3a30647ead34c0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:32:51.345029 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dfe741e2-1a32-4bf2-8ceb-933af5886641 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:51.346335 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dfe741e2-1a32-4bf2-8ceb-933af5886641 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:51.355637 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2697/5437] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:32:51 2022] DELETE /identity/v3/projects/518df7d85bbf4702b3a30647ead34c0c => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:32:51.356261 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeacc62-1952-41f0-bc12-a5726b04be96 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:51.357054 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeacc62-1952-41f0-bc12-a5726b04be96 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:51.357339 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeacc62-1952-41f0-bc12-a5726b04be96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:51.388223 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-0aeacc62-1952-41f0-bc12-a5726b04be96 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:32:51.389756 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-0aeacc62-1952-41f0-bc12-a5726b04be96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:51.479640 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2741/5438] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:32:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:32:51.487972 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132ae19-01ad-48d0-9ce5-a309d8d97004 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:51.488615 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132ae19-01ad-48d0-9ce5-a309d8d97004 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:51.489099 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132ae19-01ad-48d0-9ce5-a309d8d97004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:51.509880 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-6132ae19-01ad-48d0-9ce5-a309d8d97004 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:32:51.511101 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-6132ae19-01ad-48d0-9ce5-a309d8d97004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:51.523097 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2698/5439] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:32:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:32:51.524725 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeacc62-1952-41f0-bc12-a5726b04be96 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:51.535014 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeacc62-1952-41f0-bc12-a5726b04be96 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:51.541784 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e97b538-97f4-4cb2-94f9-f711914db233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:51.542990 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e97b538-97f4-4cb2-94f9-f711914db233 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:51.543126 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e97b538-97f4-4cb2-94f9-f711914db233 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:51.543617 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e97b538-97f4-4cb2-94f9-f711914db233 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:51.544537 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e97b538-97f4-4cb2-94f9-f711914db233 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:32:51.545801 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e97b538-97f4-4cb2-94f9-f711914db233 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:51.547400 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e97b538-97f4-4cb2-94f9-f711914db233 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:51.562217 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2742/5440] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:32:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:32:51.568611 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6132ae19-01ad-48d0-9ce5-a309d8d97004 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:51.578743 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6132ae19-01ad-48d0-9ce5-a309d8d97004 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:51.583830 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5860f4-135f-4dc2-a526-4a8d50022cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:51.584570 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5860f4-135f-4dc2-a526-4a8d50022cfc admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:51.584950 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5860f4-135f-4dc2-a526-4a8d50022cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:51.585519 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5860f4-135f-4dc2-a526-4a8d50022cfc admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:51.586273 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5860f4-135f-4dc2-a526-4a8d50022cfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:51.588515 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5860f4-135f-4dc2-a526-4a8d50022cfc admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:51.755813 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2699/5441] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:32:51 2022] POST /identity/v3/projects => generated 373 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:32:51.759370 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e97b538-97f4-4cb2-94f9-f711914db233 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:51.770067 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e97b538-97f4-4cb2-94f9-f711914db233 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:51.848617 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5487965-7e37-43e2-a670-f59006f612f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:51.849627 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5487965-7e37-43e2-a670-f59006f612f5 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:51.850121 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5487965-7e37-43e2-a670-f59006f612f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:51.850610 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5487965-7e37-43e2-a670-f59006f612f5 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:51.851540 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5487965-7e37-43e2-a670-f59006f612f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:51.854833 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5487965-7e37-43e2-a670-f59006f612f5 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:51.968468 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2743/5442] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:32:51 2022] POST /identity/v3/users => generated 287 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:32:51.973472 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5860f4-135f-4dc2-a526-4a8d50022cfc admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:51.997351 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5860f4-135f-4dc2-a526-4a8d50022cfc admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:52.002775 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a3ba6-96c4-4589-90f8-dfa45a4b1ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:52.003458 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a3ba6-96c4-4589-90f8-dfa45a4b1ee2 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:52.004056 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a3ba6-96c4-4589-90f8-dfa45a4b1ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:52.004343 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a3ba6-96c4-4589-90f8-dfa45a4b1ee2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:52.005354 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7a3ba6-96c4-4589-90f8-dfa45a4b1ee2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:52.007340 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7a3ba6-96c4-4589-90f8-dfa45a4b1ee2 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:52.019768 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2700/5443] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:32:51 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:32:52.023339 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5487965-7e37-43e2-a670-f59006f612f5 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:52.035283 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5487965-7e37-43e2-a670-f59006f612f5 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:52.044525 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0f94ba-7e53-4fbd-8553-73da07707743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:52.047712 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0f94ba-7e53-4fbd-8553-73da07707743 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:52.047712 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0f94ba-7e53-4fbd-8553-73da07707743 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:52.047712 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0f94ba-7e53-4fbd-8553-73da07707743 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:52.047712 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0f94ba-7e53-4fbd-8553-73da07707743 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:52.048277 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0f94ba-7e53-4fbd-8553-73da07707743 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:52.059101 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2744/5444] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:32:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:32:52.063214 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a3ba6-96c4-4589-90f8-dfa45a4b1ee2 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:52.076269 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a3ba6-96c4-4589-90f8-dfa45a4b1ee2 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:52.083601 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa6ca08-6eda-4aac-a11c-7483950f92c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:52.084616 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa6ca08-6eda-4aac-a11c-7483950f92c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:52.084973 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa6ca08-6eda-4aac-a11c-7483950f92c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:52.085601 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa6ca08-6eda-4aac-a11c-7483950f92c0 admin admin] PATH_INFO: `/v3/projects/5208d64e0a41427eab0d8c69aa9a4e09/users/dcf5a756a55e46a3a836b7052728db39/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:52.102467 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa6ca08-6eda-4aac-a11c-7483950f92c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5208d64e0a41427eab0d8c69aa9a4e09, user_id=dcf5a756a55e46a3a836b7052728db39, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:52.105702 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa6ca08-6eda-4aac-a11c-7483950f92c0 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:52.174315 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2701/5445] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:32:52 2022] PUT /identity/v3/projects/5208d64e0a41427eab0d8c69aa9a4e09/users/dcf5a756a55e46a3a836b7052728db39/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:32:52.183121 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d0b28-cefe-4073-83b7-4e7cf9a2d823 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:52.183423 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d0b28-cefe-4073-83b7-4e7cf9a2d823 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:52.183803 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d0b28-cefe-4073-83b7-4e7cf9a2d823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:52.225542 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-616d0b28-cefe-4073-83b7-4e7cf9a2d823 None None] MFA Rules not processed for user `dcf5a756a55e46a3a836b7052728db39`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:32:52.227883 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-616d0b28-cefe-4073-83b7-4e7cf9a2d823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:52.319516 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2745/5446] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:32:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:32:52.323839 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa6ca08-6eda-4aac-a11c-7483950f92c0 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:52.419030 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa6ca08-6eda-4aac-a11c-7483950f92c0 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:52.426526 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465f5753-9d7d-499f-9246-674428cf07bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:52.427440 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f5753-9d7d-499f-9246-674428cf07bc admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:52.428196 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f5753-9d7d-499f-9246-674428cf07bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:52.428937 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f5753-9d7d-499f-9246-674428cf07bc admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:52.430740 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465f5753-9d7d-499f-9246-674428cf07bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:52.434989 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465f5753-9d7d-499f-9246-674428cf07bc admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:52.525325 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2702/5447] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:32:52 2022] POST /identity/v3/projects => generated 373 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:32:52.530155 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d0b28-cefe-4073-83b7-4e7cf9a2d823 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:52.544921 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d0b28-cefe-4073-83b7-4e7cf9a2d823 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:52.617779 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b0ae3c-d6ee-4163-aa27-364d22b2534e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:52.617779 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b0ae3c-d6ee-4163-aa27-364d22b2534e admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:52.617779 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b0ae3c-d6ee-4163-aa27-364d22b2534e admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:52.617779 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b0ae3c-d6ee-4163-aa27-364d22b2534e admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:52.618276 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b0ae3c-d6ee-4163-aa27-364d22b2534e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:52.619999 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b0ae3c-d6ee-4163-aa27-364d22b2534e admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:52.714449 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2746/5448] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:32:52 2022] POST /identity/v3/users => generated 293 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:32:52.719735 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465f5753-9d7d-499f-9246-674428cf07bc admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:52.743902 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465f5753-9d7d-499f-9246-674428cf07bc admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:52.749665 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166e958e-6ba6-4a4c-999b-3d56dbc60f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:52.750347 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166e958e-6ba6-4a4c-999b-3d56dbc60f8e admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:52.750635 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166e958e-6ba6-4a4c-999b-3d56dbc60f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:52.751734 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166e958e-6ba6-4a4c-999b-3d56dbc60f8e admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:52.751850 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166e958e-6ba6-4a4c-999b-3d56dbc60f8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:52.753460 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166e958e-6ba6-4a4c-999b-3d56dbc60f8e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:52.779821 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2703/5449] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:32:52 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:32:52.780318 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b0ae3c-d6ee-4163-aa27-364d22b2534e admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:52.794489 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b0ae3c-d6ee-4163-aa27-364d22b2534e admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:52.804861 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17f8fa5-9e30-464a-b5b3-0e0d65418232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:52.816622 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f8fa5-9e30-464a-b5b3-0e0d65418232 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:52.816622 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f8fa5-9e30-464a-b5b3-0e0d65418232 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:52.816622 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f8fa5-9e30-464a-b5b3-0e0d65418232 admin admin] PATH_INFO: `/v3/projects/8789066f62374508a750836dbf4f4a2e/users/124d0390f8794ee3871d98bc0bbbb486/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:52.834520 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17f8fa5-9e30-464a-b5b3-0e0d65418232 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8789066f62374508a750836dbf4f4a2e, user_id=124d0390f8794ee3871d98bc0bbbb486, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:52.837431 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17f8fa5-9e30-464a-b5b3-0e0d65418232 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:53.031901 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2747/5450] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:32:52 2022] PUT /identity/v3/projects/8789066f62374508a750836dbf4f4a2e/users/124d0390f8794ee3871d98bc0bbbb486/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:32:53.035805 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166e958e-6ba6-4a4c-999b-3d56dbc60f8e admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:53.046143 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166e958e-6ba6-4a4c-999b-3d56dbc60f8e admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:53.124400 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dea97ac-dbcb-4810-a47c-76177fe02ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:53.127976 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea97ac-dbcb-4810-a47c-76177fe02ed5 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:53.127976 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea97ac-dbcb-4810-a47c-76177fe02ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:53.127976 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea97ac-dbcb-4810-a47c-76177fe02ed5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:53.127976 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dea97ac-dbcb-4810-a47c-76177fe02ed5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:53.128464 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dea97ac-dbcb-4810-a47c-76177fe02ed5 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:53.143276 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2704/5451] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:32:53 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:32:53.144438 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17f8fa5-9e30-464a-b5b3-0e0d65418232 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:53.155915 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17f8fa5-9e30-464a-b5b3-0e0d65418232 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:53.160978 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063da314-5254-4e2f-93a9-99484223eb33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:53.161967 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063da314-5254-4e2f-93a9-99484223eb33 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:53.162314 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063da314-5254-4e2f-93a9-99484223eb33 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:53.162661 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063da314-5254-4e2f-93a9-99484223eb33 admin admin] PATH_INFO: `/v3/projects/8789066f62374508a750836dbf4f4a2e/users/124d0390f8794ee3871d98bc0bbbb486/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:53.165007 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063da314-5254-4e2f-93a9-99484223eb33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8789066f62374508a750836dbf4f4a2e, user_id=124d0390f8794ee3871d98bc0bbbb486, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:53.168164 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063da314-5254-4e2f-93a9-99484223eb33 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:53.179680 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2748/5452] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:32:53 2022] PUT /identity/v3/projects/8789066f62374508a750836dbf4f4a2e/users/124d0390f8794ee3871d98bc0bbbb486/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:32:53.191376 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc5760-21e6-4ddb-bd85-92c48dac30ba None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:53.191984 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc5760-21e6-4ddb-bd85-92c48dac30ba None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:53.192611 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc5760-21e6-4ddb-bd85-92c48dac30ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:53.225324 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-b2bc5760-21e6-4ddb-bd85-92c48dac30ba None None] MFA Rules not processed for user `124d0390f8794ee3871d98bc0bbbb486`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:32:53.226642 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b2bc5760-21e6-4ddb-bd85-92c48dac30ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:53.354768 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2705/5453] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:32:53 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:32:53.359120 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063da314-5254-4e2f-93a9-99484223eb33 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:53.372276 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063da314-5254-4e2f-93a9-99484223eb33 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:53.457556 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d3a678-14e1-48f0-9ac1-8a30b419e743 tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124d0390f8794ee3871d98bc0bbbb486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8789066f62374508a750836dbf4f4a2e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:53.457556 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d3a678-14e1-48f0-9ac1-8a30b419e743 tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:53.457556 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d3a678-14e1-48f0-9ac1-8a30b419e743 tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:53.457872 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d3a678-14e1-48f0-9ac1-8a30b419e743 tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] PATH_INFO: `/v3/services` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:53.457872 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d3a678-14e1-48f0-9ac1-8a30b419e743 tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:53.457872 ncdv-master-1 devstack@keystone.service[91106]: WARNING py.warnings [None req-15d3a678-14e1-48f0-9ac1-8a30b419e743 tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:32:53.457872 ncdv-master-1 devstack@keystone.service[91106]: warnings.warn(msg) May 14 21:32:53.457872 ncdv-master-1 devstack@keystone.service[91106]: May 14 21:32:53.457872 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d3a678-14e1-48f0-9ac1-8a30b419e743 tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:53.500037 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bc5760-21e6-4ddb-bd85-92c48dac30ba None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:53.501460 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b2bc5760-21e6-4ddb-bd85-92c48dac30ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:53.581057 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bc5760-21e6-4ddb-bd85-92c48dac30ba None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:53.586588 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578d1d4e-b169-4632-a447-f78b5bf362f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:53.587236 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d1d4e-b169-4632-a447-f78b5bf362f4 service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:53.587556 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d1d4e-b169-4632-a447-f78b5bf362f4 service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:53.587885 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d1d4e-b169-4632-a447-f78b5bf362f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:53.589816 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-578d1d4e-b169-4632-a447-f78b5bf362f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:53.603872 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578d1d4e-b169-4632-a447-f78b5bf362f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:53.605523 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578d1d4e-b169-4632-a447-f78b5bf362f4 service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:53.617788 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2706/5454] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:32:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:32:53.817194 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2749/5455] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:32:53 2022] POST /identity/v3/services => generated 290 bytes in 458 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:32:53.821117 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578d1d4e-b169-4632-a447-f78b5bf362f4 service nova] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:53.836574 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578d1d4e-b169-4632-a447-f78b5bf362f4 service nova] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:53.863027 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732795cf-c81d-4cf0-8631-35eea40332bb tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124d0390f8794ee3871d98bc0bbbb486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8789066f62374508a750836dbf4f4a2e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:53.864679 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732795cf-c81d-4cf0-8631-35eea40332bb tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:53.865099 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732795cf-c81d-4cf0-8631-35eea40332bb tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:53.865620 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732795cf-c81d-4cf0-8631-35eea40332bb tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:53.867771 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732795cf-c81d-4cf0-8631-35eea40332bb tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:53.870971 ncdv-master-1 devstack@keystone.service[91107]: WARNING py.warnings [None req-732795cf-c81d-4cf0-8631-35eea40332bb tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:32:53.870971 ncdv-master-1 devstack@keystone.service[91107]: warnings.warn(msg) May 14 21:32:53.870971 ncdv-master-1 devstack@keystone.service[91107]: May 14 21:32:53.872295 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732795cf-c81d-4cf0-8631-35eea40332bb tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:54.000999 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2707/5456] 10.222.0.52 () {60 vars in 1212 bytes} [Sat May 14 21:32:53 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 331 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:32:54.004813 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d3a678-14e1-48f0-9ac1-8a30b419e743 tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:54.031503 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d3a678-14e1-48f0-9ac1-8a30b419e743 tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:54.044663 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f3d1d9-9853-4170-9c4e-6591c877377b tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124d0390f8794ee3871d98bc0bbbb486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8789066f62374508a750836dbf4f4a2e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:54.045083 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f3d1d9-9853-4170-9c4e-6591c877377b tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:54.045374 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f3d1d9-9853-4170-9c4e-6591c877377b tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:54.049467 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f3d1d9-9853-4170-9c4e-6591c877377b tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] PATH_INFO: `/v3/services` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:54.051247 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f3d1d9-9853-4170-9c4e-6591c877377b tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:54.053395 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f3d1d9-9853-4170-9c4e-6591c877377b tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:54.201539 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2750/5457] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:32:54 2022] POST /identity/v3/services => generated 288 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:32:54.205276 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732795cf-c81d-4cf0-8631-35eea40332bb tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:54.219654 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732795cf-c81d-4cf0-8631-35eea40332bb tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:54.249432 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa3f8d0-03ee-45da-9da8-300341784204 tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124d0390f8794ee3871d98bc0bbbb486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8789066f62374508a750836dbf4f4a2e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:54.250310 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa3f8d0-03ee-45da-9da8-300341784204 tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:54.251786 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa3f8d0-03ee-45da-9da8-300341784204 tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:54.252266 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa3f8d0-03ee-45da-9da8-300341784204 tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:54.253167 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa3f8d0-03ee-45da-9da8-300341784204 tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:54.255227 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa3f8d0-03ee-45da-9da8-300341784204 tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:54.316002 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2708/5458] 10.222.0.52 () {60 vars in 1212 bytes} [Sat May 14 21:32:54 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 333 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:32:54.319653 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f3d1d9-9853-4170-9c4e-6591c877377b tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:54.333336 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f3d1d9-9853-4170-9c4e-6591c877377b tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:54.341002 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ed053-766b-4f31-9407-9631c8d050bb tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124d0390f8794ee3871d98bc0bbbb486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8789066f62374508a750836dbf4f4a2e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:54.341747 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ed053-766b-4f31-9407-9631c8d050bb tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:54.342314 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ed053-766b-4f31-9407-9631c8d050bb tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:54.342604 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ed053-766b-4f31-9407-9631c8d050bb tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:54.343539 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6ed053-766b-4f31-9407-9631c8d050bb tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:54.344603 ncdv-master-1 devstack@keystone.service[91106]: WARNING py.warnings [None req-5b6ed053-766b-4f31-9407-9631c8d050bb tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoint_groups": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:32:54.344603 ncdv-master-1 devstack@keystone.service[91106]: warnings.warn(msg) May 14 21:32:54.344603 ncdv-master-1 devstack@keystone.service[91106]: May 14 21:32:54.345713 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6ed053-766b-4f31-9407-9631c8d050bb tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:54.353843 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2751/5459] 10.222.0.52 () {58 vars in 1190 bytes} [Sat May 14 21:32:54 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 762 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:32:54.358187 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa3f8d0-03ee-45da-9da8-300341784204 tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:54.372829 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa3f8d0-03ee-45da-9da8-300341784204 tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:54.379723 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270dd627-fd11-4578-baf1-d0452e3cec0e tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124d0390f8794ee3871d98bc0bbbb486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8789066f62374508a750836dbf4f4a2e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:54.380776 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270dd627-fd11-4578-baf1-d0452e3cec0e tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:54.381065 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270dd627-fd11-4578-baf1-d0452e3cec0e tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:54.381348 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270dd627-fd11-4578-baf1-d0452e3cec0e tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/1f79b9031ad5490f86235e5bd4844e18` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:54.382026 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270dd627-fd11-4578-baf1-d0452e3cec0e tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=1f79b9031ad5490f86235e5bd4844e18)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:54.383032 ncdv-master-1 devstack@keystone.service[91107]: WARNING py.warnings [None req-270dd627-fd11-4578-baf1-d0452e3cec0e tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:32:54.383032 ncdv-master-1 devstack@keystone.service[91107]: warnings.warn(msg) May 14 21:32:54.383032 ncdv-master-1 devstack@keystone.service[91107]: May 14 21:32:54.384308 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270dd627-fd11-4578-baf1-d0452e3cec0e tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:54.409021 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2709/5460] 10.222.0.52 () {58 vars in 1289 bytes} [Sat May 14 21:32:54 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups/1f79b9031ad5490f86235e5bd4844e18 => generated 333 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:32:54.413152 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ed053-766b-4f31-9407-9631c8d050bb tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:54.431318 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ed053-766b-4f31-9407-9631c8d050bb tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:54.444627 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c6c33f-1b30-45d4-b215-f8d19eaf1fd9 tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124d0390f8794ee3871d98bc0bbbb486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8789066f62374508a750836dbf4f4a2e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:54.445810 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6c33f-1b30-45d4-b215-f8d19eaf1fd9 tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:54.446261 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6c33f-1b30-45d4-b215-f8d19eaf1fd9 tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:54.446725 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6c33f-1b30-45d4-b215-f8d19eaf1fd9 tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/1f79b9031ad5490f86235e5bd4844e18` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:54.448807 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c6c33f-1b30-45d4-b215-f8d19eaf1fd9 tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=1f79b9031ad5490f86235e5bd4844e18)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:54.450853 ncdv-master-1 devstack@keystone.service[91106]: WARNING py.warnings [None req-39c6c33f-1b30-45d4-b215-f8d19eaf1fd9 tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:32:54.450853 ncdv-master-1 devstack@keystone.service[91106]: warnings.warn(msg) May 14 21:32:54.450853 ncdv-master-1 devstack@keystone.service[91106]: May 14 21:32:54.453068 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c6c33f-1b30-45d4-b215-f8d19eaf1fd9 tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:54.460439 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2752/5461] 10.222.0.52 () {58 vars in 1290 bytes} [Sat May 14 21:32:54 2022] HEAD /identity/v3/OS-EP-FILTER/endpoint_groups/1f79b9031ad5490f86235e5bd4844e18 => generated 0 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) May 14 21:32:54.464831 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270dd627-fd11-4578-baf1-d0452e3cec0e tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:54.475883 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270dd627-fd11-4578-baf1-d0452e3cec0e tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:54.481721 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ff1aa6-d312-4049-8ca8-c4593eb080da tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124d0390f8794ee3871d98bc0bbbb486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8789066f62374508a750836dbf4f4a2e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:54.482897 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff1aa6-d312-4049-8ca8-c4593eb080da tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:54.488737 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff1aa6-d312-4049-8ca8-c4593eb080da tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:54.488737 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff1aa6-d312-4049-8ca8-c4593eb080da tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/1f79b9031ad5490f86235e5bd4844e18` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:54.488737 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ff1aa6-d312-4049-8ca8-c4593eb080da tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=1f79b9031ad5490f86235e5bd4844e18)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:54.488737 ncdv-master-1 devstack@keystone.service[91107]: WARNING py.warnings [None req-65ff1aa6-d312-4049-8ca8-c4593eb080da tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:32:54.488737 ncdv-master-1 devstack@keystone.service[91107]: warnings.warn(msg) May 14 21:32:54.488737 ncdv-master-1 devstack@keystone.service[91107]: May 14 21:32:54.489307 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ff1aa6-d312-4049-8ca8-c4593eb080da tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:54.607990 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2710/5462] 10.222.0.52 () {58 vars in 1292 bytes} [Sat May 14 21:32:54 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/1f79b9031ad5490f86235e5bd4844e18 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:32:54.612007 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c6c33f-1b30-45d4-b215-f8d19eaf1fd9 tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:54.623128 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c6c33f-1b30-45d4-b215-f8d19eaf1fd9 tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:54.628092 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986525a8-c8a1-4fdf-8cd8-16b15ae74205 tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124d0390f8794ee3871d98bc0bbbb486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8789066f62374508a750836dbf4f4a2e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:54.628808 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986525a8-c8a1-4fdf-8cd8-16b15ae74205 tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:54.629237 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986525a8-c8a1-4fdf-8cd8-16b15ae74205 tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:54.629518 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986525a8-c8a1-4fdf-8cd8-16b15ae74205 tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:54.630342 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986525a8-c8a1-4fdf-8cd8-16b15ae74205 tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:54.632009 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986525a8-c8a1-4fdf-8cd8-16b15ae74205 tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:54.654195 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2753/5463] 10.222.0.52 () {58 vars in 1190 bytes} [Sat May 14 21:32:54 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 448 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:32:54.658596 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ff1aa6-d312-4049-8ca8-c4593eb080da tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:54.671923 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ff1aa6-d312-4049-8ca8-c4593eb080da tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:54.685837 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426062b5-157e-4985-90b7-29b666c6afbe tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124d0390f8794ee3871d98bc0bbbb486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8789066f62374508a750836dbf4f4a2e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:54.687045 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426062b5-157e-4985-90b7-29b666c6afbe tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:54.687326 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426062b5-157e-4985-90b7-29b666c6afbe tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:54.687815 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426062b5-157e-4985-90b7-29b666c6afbe tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/1f79b9031ad5490f86235e5bd4844e18` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:54.688646 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426062b5-157e-4985-90b7-29b666c6afbe tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=1f79b9031ad5490f86235e5bd4844e18)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:54.690274 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426062b5-157e-4985-90b7-29b666c6afbe tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:54.720745 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-426062b5-157e-4985-90b7-29b666c6afbe tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] Could not find Endpoint Group: 1f79b9031ad5490f86235e5bd4844e18.: keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: 1f79b9031ad5490f86235e5bd4844e18. May 14 21:32:54.720745 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:32:54.720745 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 21:32:54.720745 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 21:32:54.720745 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 21:32:54.720745 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 21:32:54.720745 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 21:32:54.720745 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 21:32:54.720745 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 21:32:54.720745 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 21:32:54.720745 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 21:32:54.720745 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 21:32:54.720745 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_ep_filter.py", line 107, in delete May 14 21:32:54.720745 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return (PROVIDERS.catalog_api.delete_endpoint_group(endpoint_group_id), May 14 21:32:54.721767 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 519, in delete_endpoint_group May 14 21:32:54.721767 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application endpoint_group_ref = self._get_endpoint_group(session, May 14 21:32:54.721767 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 495, in _get_endpoint_group May 14 21:32:54.721767 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.EndpointGroupNotFound( May 14 21:32:54.721767 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: 1f79b9031ad5490f86235e5bd4844e18. May 14 21:32:54.721767 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:32:54.723120 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2711/5464] 10.222.0.52 () {58 vars in 1292 bytes} [Sat May 14 21:32:54 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/1f79b9031ad5490f86235e5bd4844e18 => generated 120 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 14 21:32:54.728056 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986525a8-c8a1-4fdf-8cd8-16b15ae74205 tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:54.745207 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986525a8-c8a1-4fdf-8cd8-16b15ae74205 tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:54.752595 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7600560-23ed-44fa-857c-a019c03c9211 tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124d0390f8794ee3871d98bc0bbbb486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8789066f62374508a750836dbf4f4a2e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:54.754646 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7600560-23ed-44fa-857c-a019c03c9211 tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:54.754937 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7600560-23ed-44fa-857c-a019c03c9211 tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:54.764042 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7600560-23ed-44fa-857c-a019c03c9211 tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] PATH_INFO: `/v3/services/060a8dc725074b48a5ac1e5f02b0ed65` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:54.766359 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7600560-23ed-44fa-857c-a019c03c9211 tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] RBAC: Authorizing `identity:delete_service(service_id=060a8dc725074b48a5ac1e5f02b0ed65)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:54.767713 ncdv-master-1 devstack@keystone.service[91106]: WARNING py.warnings [None req-b7600560-23ed-44fa-857c-a019c03c9211 tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:32:54.767713 ncdv-master-1 devstack@keystone.service[91106]: warnings.warn(msg) May 14 21:32:54.767713 ncdv-master-1 devstack@keystone.service[91106]: May 14 21:32:54.778481 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7600560-23ed-44fa-857c-a019c03c9211 tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:54.920460 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2754/5465] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:32:54 2022] DELETE /identity/v3/services/060a8dc725074b48a5ac1e5f02b0ed65 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:32:54.932348 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426062b5-157e-4985-90b7-29b666c6afbe tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:54.943940 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426062b5-157e-4985-90b7-29b666c6afbe tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:54.965682 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27511b4c-ded0-45d8-b9b8-32fe859b1dd6 tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124d0390f8794ee3871d98bc0bbbb486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8789066f62374508a750836dbf4f4a2e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:54.966678 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27511b4c-ded0-45d8-b9b8-32fe859b1dd6 tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:54.966966 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27511b4c-ded0-45d8-b9b8-32fe859b1dd6 tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:54.967245 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27511b4c-ded0-45d8-b9b8-32fe859b1dd6 tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] PATH_INFO: `/v3/services` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:54.968911 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27511b4c-ded0-45d8-b9b8-32fe859b1dd6 tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:54.970577 ncdv-master-1 devstack@keystone.service[91107]: WARNING py.warnings [None req-27511b4c-ded0-45d8-b9b8-32fe859b1dd6 tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:32:54.970577 ncdv-master-1 devstack@keystone.service[91107]: warnings.warn(msg) May 14 21:32:54.970577 ncdv-master-1 devstack@keystone.service[91107]: May 14 21:32:54.971816 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27511b4c-ded0-45d8-b9b8-32fe859b1dd6 tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:55.089835 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2712/5466] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:32:54 2022] POST /identity/v3/services => generated 289 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:32:55.091419 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7600560-23ed-44fa-857c-a019c03c9211 tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:55.103046 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7600560-23ed-44fa-857c-a019c03c9211 tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:55.122990 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68daf13-db02-4e36-a0f7-33a38fa5278e tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124d0390f8794ee3871d98bc0bbbb486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8789066f62374508a750836dbf4f4a2e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:55.123685 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68daf13-db02-4e36-a0f7-33a38fa5278e tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:55.123975 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68daf13-db02-4e36-a0f7-33a38fa5278e tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:55.124258 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68daf13-db02-4e36-a0f7-33a38fa5278e tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:55.124992 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68daf13-db02-4e36-a0f7-33a38fa5278e tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:55.126060 ncdv-master-1 devstack@keystone.service[91106]: WARNING py.warnings [None req-b68daf13-db02-4e36-a0f7-33a38fa5278e tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:32:55.126060 ncdv-master-1 devstack@keystone.service[91106]: warnings.warn(msg) May 14 21:32:55.126060 ncdv-master-1 devstack@keystone.service[91106]: May 14 21:32:55.126967 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68daf13-db02-4e36-a0f7-33a38fa5278e tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:55.215141 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2755/5467] 10.222.0.52 () {60 vars in 1212 bytes} [Sat May 14 21:32:55 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 334 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:32:55.219597 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27511b4c-ded0-45d8-b9b8-32fe859b1dd6 tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:55.234273 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27511b4c-ded0-45d8-b9b8-32fe859b1dd6 tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:55.241612 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f174d85-08ea-4163-a6a4-329d1c279c10 tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124d0390f8794ee3871d98bc0bbbb486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8789066f62374508a750836dbf4f4a2e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:55.243365 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f174d85-08ea-4163-a6a4-329d1c279c10 tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:55.243884 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f174d85-08ea-4163-a6a4-329d1c279c10 tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:55.248721 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f174d85-08ea-4163-a6a4-329d1c279c10 tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] PATH_INFO: `/v3/services` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:55.249642 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f174d85-08ea-4163-a6a4-329d1c279c10 tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:55.251715 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f174d85-08ea-4163-a6a4-329d1c279c10 tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:55.454626 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2713/5468] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:32:55 2022] POST /identity/v3/services => generated 288 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:32:55.458483 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68daf13-db02-4e36-a0f7-33a38fa5278e tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:55.470180 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68daf13-db02-4e36-a0f7-33a38fa5278e tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:55.492903 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec375401-99b6-4c7e-b2d3-e75f38648a6f tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124d0390f8794ee3871d98bc0bbbb486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8789066f62374508a750836dbf4f4a2e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:55.493885 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec375401-99b6-4c7e-b2d3-e75f38648a6f tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:55.494490 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec375401-99b6-4c7e-b2d3-e75f38648a6f tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:55.494868 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec375401-99b6-4c7e-b2d3-e75f38648a6f tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/8998030a4a4c4568bc47fb0834429bdb` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:55.495765 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec375401-99b6-4c7e-b2d3-e75f38648a6f tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] RBAC: Authorizing `identity:update_endpoint_group(endpoint_group_id=8998030a4a4c4568bc47fb0834429bdb)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:55.496913 ncdv-master-1 devstack@keystone.service[91106]: WARNING py.warnings [None req-ec375401-99b6-4c7e-b2d3-e75f38648a6f tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:32:55.496913 ncdv-master-1 devstack@keystone.service[91106]: warnings.warn(msg) May 14 21:32:55.496913 ncdv-master-1 devstack@keystone.service[91106]: May 14 21:32:55.498047 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec375401-99b6-4c7e-b2d3-e75f38648a6f tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:55.573024 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2756/5469] 10.222.0.52 () {60 vars in 1312 bytes} [Sat May 14 21:32:55 2022] PATCH /identity/v3/OS-EP-FILTER/endpoint_groups/8998030a4a4c4568bc47fb0834429bdb => generated 336 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:32:55.574270 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f174d85-08ea-4163-a6a4-329d1c279c10 tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:55.589011 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f174d85-08ea-4163-a6a4-329d1c279c10 tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:55.597906 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116add0d-c459-43a8-9922-b2ece061acca tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124d0390f8794ee3871d98bc0bbbb486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8789066f62374508a750836dbf4f4a2e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:55.599186 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116add0d-c459-43a8-9922-b2ece061acca tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:55.599730 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116add0d-c459-43a8-9922-b2ece061acca tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:55.600185 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116add0d-c459-43a8-9922-b2ece061acca tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] PATH_INFO: `/v3/services/e965cc00fdeb426d8a0af50acacd8598` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:55.601011 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116add0d-c459-43a8-9922-b2ece061acca tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] RBAC: Authorizing `identity:delete_service(service_id=e965cc00fdeb426d8a0af50acacd8598)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:55.602308 ncdv-master-1 devstack@keystone.service[91107]: WARNING py.warnings [None req-116add0d-c459-43a8-9922-b2ece061acca tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:32:55.602308 ncdv-master-1 devstack@keystone.service[91107]: warnings.warn(msg) May 14 21:32:55.602308 ncdv-master-1 devstack@keystone.service[91107]: May 14 21:32:55.603628 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116add0d-c459-43a8-9922-b2ece061acca tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:55.698946 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2714/5470] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:32:55 2022] DELETE /identity/v3/services/e965cc00fdeb426d8a0af50acacd8598 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:32:55.703366 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec375401-99b6-4c7e-b2d3-e75f38648a6f tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:55.723260 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec375401-99b6-4c7e-b2d3-e75f38648a6f tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:55.749440 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d84f54-2b63-421b-97b0-be96674913d1 tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124d0390f8794ee3871d98bc0bbbb486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8789066f62374508a750836dbf4f4a2e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:55.750497 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d84f54-2b63-421b-97b0-be96674913d1 tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:55.750793 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d84f54-2b63-421b-97b0-be96674913d1 tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:55.751068 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d84f54-2b63-421b-97b0-be96674913d1 tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/8998030a4a4c4568bc47fb0834429bdb` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:55.751757 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d84f54-2b63-421b-97b0-be96674913d1 tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=8998030a4a4c4568bc47fb0834429bdb)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:55.752800 ncdv-master-1 devstack@keystone.service[91106]: WARNING py.warnings [None req-f6d84f54-2b63-421b-97b0-be96674913d1 tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:32:55.752800 ncdv-master-1 devstack@keystone.service[91106]: warnings.warn(msg) May 14 21:32:55.752800 ncdv-master-1 devstack@keystone.service[91106]: May 14 21:32:55.753893 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d84f54-2b63-421b-97b0-be96674913d1 tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:55.833563 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2757/5471] 10.222.0.52 () {58 vars in 1292 bytes} [Sat May 14 21:32:55 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/8998030a4a4c4568bc47fb0834429bdb => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:32:55.843961 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116add0d-c459-43a8-9922-b2ece061acca tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:55.856971 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116add0d-c459-43a8-9922-b2ece061acca tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:55.863710 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487136a6-6a57-473a-b932-cee74d55f7d5 tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124d0390f8794ee3871d98bc0bbbb486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8789066f62374508a750836dbf4f4a2e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:55.865623 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487136a6-6a57-473a-b932-cee74d55f7d5 tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:55.866272 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487136a6-6a57-473a-b932-cee74d55f7d5 tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:55.866805 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487136a6-6a57-473a-b932-cee74d55f7d5 tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] PATH_INFO: `/v3/services/0610b304bee844c4b70668ac21e2c261` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:55.868398 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487136a6-6a57-473a-b932-cee74d55f7d5 tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] RBAC: Authorizing `identity:delete_service(service_id=0610b304bee844c4b70668ac21e2c261)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:55.872847 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487136a6-6a57-473a-b932-cee74d55f7d5 tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:55.976900 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2715/5472] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:32:55 2022] DELETE /identity/v3/services/0610b304bee844c4b70668ac21e2c261 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:32:55.982807 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d84f54-2b63-421b-97b0-be96674913d1 tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:55.993650 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d84f54-2b63-421b-97b0-be96674913d1 tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:56.012124 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45673d51-4d3f-484c-9cd6-e6b3deee182b tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124d0390f8794ee3871d98bc0bbbb486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8789066f62374508a750836dbf4f4a2e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:56.013688 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45673d51-4d3f-484c-9cd6-e6b3deee182b tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:56.013984 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45673d51-4d3f-484c-9cd6-e6b3deee182b tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:56.014342 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45673d51-4d3f-484c-9cd6-e6b3deee182b tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/bfd406e1c71f4a8eb977a139560b6e05` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:56.015691 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45673d51-4d3f-484c-9cd6-e6b3deee182b tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=bfd406e1c71f4a8eb977a139560b6e05)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:56.020062 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45673d51-4d3f-484c-9cd6-e6b3deee182b tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:56.099801 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2758/5473] 10.222.0.52 () {58 vars in 1292 bytes} [Sat May 14 21:32:55 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/bfd406e1c71f4a8eb977a139560b6e05 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:32:56.106967 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487136a6-6a57-473a-b932-cee74d55f7d5 tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:56.122814 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487136a6-6a57-473a-b932-cee74d55f7d5 tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:56.130746 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888cda1f-b741-459d-a053-c8a40f7dc25d tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124d0390f8794ee3871d98bc0bbbb486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8789066f62374508a750836dbf4f4a2e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:56.132603 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888cda1f-b741-459d-a053-c8a40f7dc25d tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:56.132963 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888cda1f-b741-459d-a053-c8a40f7dc25d tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:56.133355 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888cda1f-b741-459d-a053-c8a40f7dc25d tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] PATH_INFO: `/v3/services/59d7cc438a2d4520a5beb1d9a18ede15` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:56.134124 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888cda1f-b741-459d-a053-c8a40f7dc25d tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] RBAC: Authorizing `identity:delete_service(service_id=59d7cc438a2d4520a5beb1d9a18ede15)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:56.135924 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888cda1f-b741-459d-a053-c8a40f7dc25d tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:56.284865 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2716/5474] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:32:56 2022] DELETE /identity/v3/services/59d7cc438a2d4520a5beb1d9a18ede15 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:32:56.290164 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45673d51-4d3f-484c-9cd6-e6b3deee182b tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:56.399613 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45673d51-4d3f-484c-9cd6-e6b3deee182b tempest-EndPointGroupsTest-1558698457 tempest-EndPointGroupsTest-1558698457-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:56.432339 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a6c6d5-57a3-4e16-aa28-c6bb043dc4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:56.435101 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a6c6d5-57a3-4e16-aa28-c6bb043dc4ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:56.435612 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a6c6d5-57a3-4e16-aa28-c6bb043dc4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:56.436323 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a6c6d5-57a3-4e16-aa28-c6bb043dc4ca admin admin] PATH_INFO: `/v3/users/dcf5a756a55e46a3a836b7052728db39` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:56.438173 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a6c6d5-57a3-4e16-aa28-c6bb043dc4ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcf5a756a55e46a3a836b7052728db39)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:56.442789 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a6c6d5-57a3-4e16-aa28-c6bb043dc4ca admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:56.686156 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-92a6c6d5-57a3-4e16-aa28-c6bb043dc4ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcf5a756a55e46a3a836b7052728db39'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:56.719462 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-92a6c6d5-57a3-4e16-aa28-c6bb043dc4ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcf5a756a55e46a3a836b7052728db39'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:56.730156 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-92a6c6d5-57a3-4e16-aa28-c6bb043dc4ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcf5a756a55e46a3a836b7052728db39'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:56.811768 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-92a6c6d5-57a3-4e16-aa28-c6bb043dc4ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcf5a756a55e46a3a836b7052728db39'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:56.816724 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-92a6c6d5-57a3-4e16-aa28-c6bb043dc4ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcf5a756a55e46a3a836b7052728db39'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:56.819721 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2759/5475] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:32:56 2022] DELETE /identity/v3/users/dcf5a756a55e46a3a836b7052728db39 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:32:56.825574 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c72e07-9c54-428b-b9c2-89c69e80b3ca None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:56.825975 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c72e07-9c54-428b-b9c2-89c69e80b3ca None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:56.826388 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c72e07-9c54-428b-b9c2-89c69e80b3ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:56.857814 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-d2c72e07-9c54-428b-b9c2-89c69e80b3ca None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:32:56.859308 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-d2c72e07-9c54-428b-b9c2-89c69e80b3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:57.033235 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2717/5476] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:32:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:32:57.046893 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a6c6d5-57a3-4e16-aa28-c6bb043dc4ca admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:57.048622 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-92a6c6d5-57a3-4e16-aa28-c6bb043dc4ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:57.220769 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a6c6d5-57a3-4e16-aa28-c6bb043dc4ca admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:57.224927 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ceaae-2c5a-4908-abe0-3c37d81fd3af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:57.232327 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ceaae-2c5a-4908-abe0-3c37d81fd3af service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:57.232327 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ceaae-2c5a-4908-abe0-3c37d81fd3af service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:57.232327 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ceaae-2c5a-4908-abe0-3c37d81fd3af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:57.238128 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92ceaae-2c5a-4908-abe0-3c37d81fd3af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:57.239839 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92ceaae-2c5a-4908-abe0-3c37d81fd3af service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:57.254730 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2760/5477] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:32:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:32:58.112446 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c72e07-9c54-428b-b9c2-89c69e80b3ca None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:58.112446 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-d2c72e07-9c54-428b-b9c2-89c69e80b3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:58.126612 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c72e07-9c54-428b-b9c2-89c69e80b3ca None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:58.131880 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e2e04-4d21-48a2-89fc-39f250ad9e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:58.136363 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e2e04-4d21-48a2-89fc-39f250ad9e75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:58.136363 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e2e04-4d21-48a2-89fc-39f250ad9e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:58.136363 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e2e04-4d21-48a2-89fc-39f250ad9e75 admin admin] PATH_INFO: `/v3/projects/5208d64e0a41427eab0d8c69aa9a4e09` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:58.138813 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55e2e04-4d21-48a2-89fc-39f250ad9e75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5208d64e0a41427eab0d8c69aa9a4e09)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:58.140965 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55e2e04-4d21-48a2-89fc-39f250ad9e75 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:58.359817 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b55e2e04-4d21-48a2-89fc-39f250ad9e75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5208d64e0a41427eab0d8c69aa9a4e09', 'request_id': 'req-b55e2e04-4d21-48a2-89fc-39f250ad9e75'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:58.366536 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b55e2e04-4d21-48a2-89fc-39f250ad9e75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5208d64e0a41427eab0d8c69aa9a4e09', 'request_id': 'req-b55e2e04-4d21-48a2-89fc-39f250ad9e75'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:58.373734 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b55e2e04-4d21-48a2-89fc-39f250ad9e75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5208d64e0a41427eab0d8c69aa9a4e09', 'request_id': 'req-b55e2e04-4d21-48a2-89fc-39f250ad9e75'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:58.451601 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b55e2e04-4d21-48a2-89fc-39f250ad9e75 admin admin] The token cache is being invalidate because project 5208d64e0a41427eab0d8c69aa9a4e09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:32:58.452169 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b55e2e04-4d21-48a2-89fc-39f250ad9e75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:58.455980 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b55e2e04-4d21-48a2-89fc-39f250ad9e75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:58.458491 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2718/5478] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:32:58 2022] DELETE /identity/v3/projects/5208d64e0a41427eab0d8c69aa9a4e09 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:32:58.462406 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ceaae-2c5a-4908-abe0-3c37d81fd3af service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:58.473076 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ceaae-2c5a-4908-abe0-3c37d81fd3af service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:58.557673 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58fa210-046f-400e-a5a7-9b5c25533a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:58.558824 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58fa210-046f-400e-a5a7-9b5c25533a3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:58.559173 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58fa210-046f-400e-a5a7-9b5c25533a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:58.559688 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58fa210-046f-400e-a5a7-9b5c25533a3d admin admin] PATH_INFO: `/v3/users/124d0390f8794ee3871d98bc0bbbb486` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:58.561168 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58fa210-046f-400e-a5a7-9b5c25533a3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=124d0390f8794ee3871d98bc0bbbb486)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:58.563594 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58fa210-046f-400e-a5a7-9b5c25533a3d admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:58.647665 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e2e04-4d21-48a2-89fc-39f250ad9e75 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:58.649340 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b55e2e04-4d21-48a2-89fc-39f250ad9e75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:58.806342 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b58fa210-046f-400e-a5a7-9b5c25533a3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '124d0390f8794ee3871d98bc0bbbb486'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:58.849840 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b58fa210-046f-400e-a5a7-9b5c25533a3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '124d0390f8794ee3871d98bc0bbbb486'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:58.882077 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b58fa210-046f-400e-a5a7-9b5c25533a3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '124d0390f8794ee3871d98bc0bbbb486'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:58.886158 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e2e04-4d21-48a2-89fc-39f250ad9e75 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:58.901481 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc835039-ff0f-4040-864b-fce24a8c1102 tempest-RoutersIpV6AdminTest-1967192725 tempest-RoutersIpV6AdminTest-1967192725-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32dfb4a72bb343059307d695af4db2da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '032ba616dcc14854aeef541cdedda6df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:58.903877 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc835039-ff0f-4040-864b-fce24a8c1102 tempest-RoutersIpV6AdminTest-1967192725 tempest-RoutersIpV6AdminTest-1967192725-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:58.904946 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc835039-ff0f-4040-864b-fce24a8c1102 tempest-RoutersIpV6AdminTest-1967192725 tempest-RoutersIpV6AdminTest-1967192725-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:58.907589 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc835039-ff0f-4040-864b-fce24a8c1102 tempest-RoutersIpV6AdminTest-1967192725 tempest-RoutersIpV6AdminTest-1967192725-project-admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:58.908643 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc835039-ff0f-4040-864b-fce24a8c1102 tempest-RoutersIpV6AdminTest-1967192725 tempest-RoutersIpV6AdminTest-1967192725-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:32:58.909224 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc835039-ff0f-4040-864b-fce24a8c1102 tempest-RoutersIpV6AdminTest-1967192725 tempest-RoutersIpV6AdminTest-1967192725-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:58.913618 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc835039-ff0f-4040-864b-fce24a8c1102 tempest-RoutersIpV6AdminTest-1967192725 tempest-RoutersIpV6AdminTest-1967192725-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:58.943620 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2719/5479] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:32:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:32:58.949919 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc835039-ff0f-4040-864b-fce24a8c1102 tempest-RoutersIpV6AdminTest-1967192725 tempest-RoutersIpV6AdminTest-1967192725-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:58.974167 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc835039-ff0f-4040-864b-fce24a8c1102 tempest-RoutersIpV6AdminTest-1967192725 tempest-RoutersIpV6AdminTest-1967192725-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:58.984245 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b4ae90-4a25-4c16-9499-267810e95d56 tempest-RoutersIpV6AdminTest-1967192725 tempest-RoutersIpV6AdminTest-1967192725-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32dfb4a72bb343059307d695af4db2da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '032ba616dcc14854aeef541cdedda6df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:58.990262 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b4ae90-4a25-4c16-9499-267810e95d56 tempest-RoutersIpV6AdminTest-1967192725 tempest-RoutersIpV6AdminTest-1967192725-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:58.990262 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b4ae90-4a25-4c16-9499-267810e95d56 tempest-RoutersIpV6AdminTest-1967192725 tempest-RoutersIpV6AdminTest-1967192725-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:58.990262 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b4ae90-4a25-4c16-9499-267810e95d56 tempest-RoutersIpV6AdminTest-1967192725 tempest-RoutersIpV6AdminTest-1967192725-project-admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:58.990262 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b4ae90-4a25-4c16-9499-267810e95d56 tempest-RoutersIpV6AdminTest-1967192725 tempest-RoutersIpV6AdminTest-1967192725-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:58.994339 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b4ae90-4a25-4c16-9499-267810e95d56 tempest-RoutersIpV6AdminTest-1967192725 tempest-RoutersIpV6AdminTest-1967192725-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:59.010056 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b58fa210-046f-400e-a5a7-9b5c25533a3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '124d0390f8794ee3871d98bc0bbbb486'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:59.011662 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b58fa210-046f-400e-a5a7-9b5c25533a3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '124d0390f8794ee3871d98bc0bbbb486'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:32:59.023339 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2761/5480] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:32:58 2022] DELETE /identity/v3/users/124d0390f8794ee3871d98bc0bbbb486 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:32:59.154508 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2720/5481] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:32:58 2022] POST /identity/v3/projects => generated 347 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:32:59.158419 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58fa210-046f-400e-a5a7-9b5c25533a3d admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:59.159976 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b58fa210-046f-400e-a5a7-9b5c25533a3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:59.261669 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b4ae90-4a25-4c16-9499-267810e95d56 tempest-RoutersIpV6AdminTest-1967192725 tempest-RoutersIpV6AdminTest-1967192725-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:59.264131 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-39b4ae90-4a25-4c16-9499-267810e95d56 tempest-RoutersIpV6AdminTest-1967192725 tempest-RoutersIpV6AdminTest-1967192725-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:59.316505 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58fa210-046f-400e-a5a7-9b5c25533a3d admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:59.393647 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef41854-8f79-4942-9a35-eb192596b1d1 tempest-RoutersIpV6AdminTest-1967192725 tempest-RoutersIpV6AdminTest-1967192725-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32dfb4a72bb343059307d695af4db2da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '032ba616dcc14854aeef541cdedda6df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:59.394912 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef41854-8f79-4942-9a35-eb192596b1d1 tempest-RoutersIpV6AdminTest-1967192725 tempest-RoutersIpV6AdminTest-1967192725-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:59.394912 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef41854-8f79-4942-9a35-eb192596b1d1 tempest-RoutersIpV6AdminTest-1967192725 tempest-RoutersIpV6AdminTest-1967192725-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:59.411986 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef41854-8f79-4942-9a35-eb192596b1d1 tempest-RoutersIpV6AdminTest-1967192725 tempest-RoutersIpV6AdminTest-1967192725-project-admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:59.411986 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef41854-8f79-4942-9a35-eb192596b1d1 tempest-RoutersIpV6AdminTest-1967192725 tempest-RoutersIpV6AdminTest-1967192725-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:32:59.411986 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef41854-8f79-4942-9a35-eb192596b1d1 tempest-RoutersIpV6AdminTest-1967192725 tempest-RoutersIpV6AdminTest-1967192725-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:59.411986 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef41854-8f79-4942-9a35-eb192596b1d1 tempest-RoutersIpV6AdminTest-1967192725 tempest-RoutersIpV6AdminTest-1967192725-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:59.414508 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b4ae90-4a25-4c16-9499-267810e95d56 tempest-RoutersIpV6AdminTest-1967192725 tempest-RoutersIpV6AdminTest-1967192725-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:59.424502 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2762/5482] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:32:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:32:59.426686 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c8351f-24aa-484d-ac75-dd0d2b3a6038 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198271d1c0d44cb58bace41a65f4b94c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:59.427504 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c8351f-24aa-484d-ac75-dd0d2b3a6038 service cinder] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:59.427811 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c8351f-24aa-484d-ac75-dd0d2b3a6038 service cinder] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:59.428089 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c8351f-24aa-484d-ac75-dd0d2b3a6038 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:59.430121 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-78c8351f-24aa-484d-ac75-dd0d2b3a6038 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:59.597981 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c8351f-24aa-484d-ac75-dd0d2b3a6038 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:59.600151 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c8351f-24aa-484d-ac75-dd0d2b3a6038 service cinder] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:32:59.668042 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2721/5483] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:32:59 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:32:59.880086 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef41854-8f79-4942-9a35-eb192596b1d1 tempest-RoutersIpV6AdminTest-1967192725 tempest-RoutersIpV6AdminTest-1967192725-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:32:59.882236 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-fef41854-8f79-4942-9a35-eb192596b1d1 tempest-RoutersIpV6AdminTest-1967192725 tempest-RoutersIpV6AdminTest-1967192725-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:32:59.965189 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef41854-8f79-4942-9a35-eb192596b1d1 tempest-RoutersIpV6AdminTest-1967192725 tempest-RoutersIpV6AdminTest-1967192725-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:32:59.970022 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a49ba3a-65b3-4f81-9360-0df288b70c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:32:59.970898 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a49ba3a-65b3-4f81-9360-0df288b70c3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:32:59.971182 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a49ba3a-65b3-4f81-9360-0df288b70c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:32:59.971462 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a49ba3a-65b3-4f81-9360-0df288b70c3f admin admin] PATH_INFO: `/v3/projects/8789066f62374508a750836dbf4f4a2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:32:59.974820 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a49ba3a-65b3-4f81-9360-0df288b70c3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8789066f62374508a750836dbf4f4a2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:32:59.976700 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a49ba3a-65b3-4f81-9360-0df288b70c3f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:00.116169 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2a49ba3a-65b3-4f81-9360-0df288b70c3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8789066f62374508a750836dbf4f4a2e', 'request_id': 'req-2a49ba3a-65b3-4f81-9360-0df288b70c3f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:00.124768 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2a49ba3a-65b3-4f81-9360-0df288b70c3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8789066f62374508a750836dbf4f4a2e', 'request_id': 'req-2a49ba3a-65b3-4f81-9360-0df288b70c3f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:00.261250 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2a49ba3a-65b3-4f81-9360-0df288b70c3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8789066f62374508a750836dbf4f4a2e', 'request_id': 'req-2a49ba3a-65b3-4f81-9360-0df288b70c3f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:00.289953 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2a49ba3a-65b3-4f81-9360-0df288b70c3f admin admin] The token cache is being invalidate because project 8789066f62374508a750836dbf4f4a2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:33:00.290297 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2a49ba3a-65b3-4f81-9360-0df288b70c3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:00.295411 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2a49ba3a-65b3-4f81-9360-0df288b70c3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:00.300117 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2763/5484] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:32:59 2022] DELETE /identity/v3/projects/8789066f62374508a750836dbf4f4a2e => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:00.305539 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf592756-6e9b-490d-ac6e-7c6f99a7d4ee None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:00.306021 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf592756-6e9b-490d-ac6e-7c6f99a7d4ee None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:00.306142 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf592756-6e9b-490d-ac6e-7c6f99a7d4ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:00.352780 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-cf592756-6e9b-490d-ac6e-7c6f99a7d4ee None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:33:00.354117 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-cf592756-6e9b-490d-ac6e-7c6f99a7d4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:00.508341 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2722/5485] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:33:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:33:00.532179 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adeea56-0197-49ad-8d1e-55f5d23aa1c2 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:00.532179 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adeea56-0197-49ad-8d1e-55f5d23aa1c2 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:00.532179 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adeea56-0197-49ad-8d1e-55f5d23aa1c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:00.548949 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-6adeea56-0197-49ad-8d1e-55f5d23aa1c2 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:33:00.553963 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-6adeea56-0197-49ad-8d1e-55f5d23aa1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:00.566822 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2764/5486] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:33:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:33:00.571434 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf592756-6e9b-490d-ac6e-7c6f99a7d4ee None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:00.584061 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf592756-6e9b-490d-ac6e-7c6f99a7d4ee None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:00.590063 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1d5e8e-62ca-4f17-94e2-4e3236622835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:00.590741 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d5e8e-62ca-4f17-94e2-4e3236622835 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:00.594369 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d5e8e-62ca-4f17-94e2-4e3236622835 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:00.594369 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d5e8e-62ca-4f17-94e2-4e3236622835 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:00.594369 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1d5e8e-62ca-4f17-94e2-4e3236622835 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:33:00.594369 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1d5e8e-62ca-4f17-94e2-4e3236622835 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:00.594670 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1d5e8e-62ca-4f17-94e2-4e3236622835 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:00.611867 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2723/5487] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:33:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:33:00.613215 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adeea56-0197-49ad-8d1e-55f5d23aa1c2 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:00.622661 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adeea56-0197-49ad-8d1e-55f5d23aa1c2 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:00.627517 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4321828e-88ee-41fb-ac1b-0671be2f6242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:00.628173 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4321828e-88ee-41fb-ac1b-0671be2f6242 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:00.628454 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4321828e-88ee-41fb-ac1b-0671be2f6242 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:00.628744 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4321828e-88ee-41fb-ac1b-0671be2f6242 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:00.629536 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4321828e-88ee-41fb-ac1b-0671be2f6242 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:00.631535 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4321828e-88ee-41fb-ac1b-0671be2f6242 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:00.656276 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1d5e8e-62ca-4f17-94e2-4e3236622835 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:00.658114 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-0d1d5e8e-62ca-4f17-94e2-4e3236622835 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:00.741403 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1d5e8e-62ca-4f17-94e2-4e3236622835 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:00.748684 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02563b9b-26b0-4a28-9239-0af9397ddb67 tempest-RoutersIpV6AdminTest-1967192725 tempest-RoutersIpV6AdminTest-1967192725-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32dfb4a72bb343059307d695af4db2da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '032ba616dcc14854aeef541cdedda6df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:00.748684 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02563b9b-26b0-4a28-9239-0af9397ddb67 tempest-RoutersIpV6AdminTest-1967192725 tempest-RoutersIpV6AdminTest-1967192725-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:00.748684 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02563b9b-26b0-4a28-9239-0af9397ddb67 tempest-RoutersIpV6AdminTest-1967192725 tempest-RoutersIpV6AdminTest-1967192725-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:00.748944 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02563b9b-26b0-4a28-9239-0af9397ddb67 tempest-RoutersIpV6AdminTest-1967192725 tempest-RoutersIpV6AdminTest-1967192725-project-admin] PATH_INFO: `/v3/projects/adba66d333d04beda076fac69586aeef` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:00.750223 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02563b9b-26b0-4a28-9239-0af9397ddb67 tempest-RoutersIpV6AdminTest-1967192725 tempest-RoutersIpV6AdminTest-1967192725-project-admin] RBAC: Authorizing `identity:delete_project(project_id=adba66d333d04beda076fac69586aeef)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:00.752550 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02563b9b-26b0-4a28-9239-0af9397ddb67 tempest-RoutersIpV6AdminTest-1967192725 tempest-RoutersIpV6AdminTest-1967192725-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:00.772128 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2765/5488] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:33:00 2022] POST /identity/v3/projects => generated 373 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:33:00.776825 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4321828e-88ee-41fb-ac1b-0671be2f6242 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:00.857876 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4321828e-88ee-41fb-ac1b-0671be2f6242 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:00.862684 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da7df23-fc4d-446b-83cb-febe066dc10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:00.863353 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7df23-fc4d-446b-83cb-febe066dc10a admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:00.863674 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7df23-fc4d-446b-83cb-febe066dc10a admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:00.863956 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7df23-fc4d-446b-83cb-febe066dc10a admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:00.864900 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da7df23-fc4d-446b-83cb-febe066dc10a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:00.866833 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da7df23-fc4d-446b-83cb-febe066dc10a admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:00.902137 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-02563b9b-26b0-4a28-9239-0af9397ddb67 tempest-RoutersIpV6AdminTest-1967192725 tempest-RoutersIpV6AdminTest-1967192725-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adba66d333d04beda076fac69586aeef', 'request_id': 'req-02563b9b-26b0-4a28-9239-0af9397ddb67'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:00.908269 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-02563b9b-26b0-4a28-9239-0af9397ddb67 tempest-RoutersIpV6AdminTest-1967192725 tempest-RoutersIpV6AdminTest-1967192725-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adba66d333d04beda076fac69586aeef', 'request_id': 'req-02563b9b-26b0-4a28-9239-0af9397ddb67'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:00.914577 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-02563b9b-26b0-4a28-9239-0af9397ddb67 tempest-RoutersIpV6AdminTest-1967192725 tempest-RoutersIpV6AdminTest-1967192725-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adba66d333d04beda076fac69586aeef', 'request_id': 'req-02563b9b-26b0-4a28-9239-0af9397ddb67'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:00.982420 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2766/5489] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:33:00 2022] POST /identity/v3/users => generated 287 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:33:00.982420 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da7df23-fc4d-446b-83cb-febe066dc10a admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:00.982420 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-7da7df23-fc4d-446b-83cb-febe066dc10a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:01.003657 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-02563b9b-26b0-4a28-9239-0af9397ddb67 tempest-RoutersIpV6AdminTest-1967192725 tempest-RoutersIpV6AdminTest-1967192725-project-admin] The token cache is being invalidate because project adba66d333d04beda076fac69586aeef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:33:01.004498 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-02563b9b-26b0-4a28-9239-0af9397ddb67 tempest-RoutersIpV6AdminTest-1967192725 tempest-RoutersIpV6AdminTest-1967192725-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:01.005237 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-02563b9b-26b0-4a28-9239-0af9397ddb67 tempest-RoutersIpV6AdminTest-1967192725 tempest-RoutersIpV6AdminTest-1967192725-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:01.007883 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2724/5490] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:33:00 2022] DELETE /identity/v3/projects/adba66d333d04beda076fac69586aeef => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:01.008776 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02563b9b-26b0-4a28-9239-0af9397ddb67 tempest-RoutersIpV6AdminTest-1967192725 tempest-RoutersIpV6AdminTest-1967192725-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:01.010612 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-02563b9b-26b0-4a28-9239-0af9397ddb67 tempest-RoutersIpV6AdminTest-1967192725 tempest-RoutersIpV6AdminTest-1967192725-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:01.047810 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da7df23-fc4d-446b-83cb-febe066dc10a admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:01.084564 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02563b9b-26b0-4a28-9239-0af9397ddb67 tempest-RoutersIpV6AdminTest-1967192725 tempest-RoutersIpV6AdminTest-1967192725-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:01.090103 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e4bd9-be41-48b9-89ec-47153b6da43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:01.090782 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e4bd9-be41-48b9-89ec-47153b6da43e admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:01.091068 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e4bd9-be41-48b9-89ec-47153b6da43e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:01.091343 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e4bd9-be41-48b9-89ec-47153b6da43e admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:01.092415 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06e4bd9-be41-48b9-89ec-47153b6da43e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:01.093850 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06e4bd9-be41-48b9-89ec-47153b6da43e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:01.101601 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf87c803-4b8c-47b7-ab42-c64f49e033c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:01.102529 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87c803-4b8c-47b7-ab42-c64f49e033c5 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:01.102888 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87c803-4b8c-47b7-ab42-c64f49e033c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:01.103326 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87c803-4b8c-47b7-ab42-c64f49e033c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:01.104444 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2725/5491] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:33:01 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:33:01.105224 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e4bd9-be41-48b9-89ec-47153b6da43e admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:01.106857 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c06e4bd9-be41-48b9-89ec-47153b6da43e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:01.108228 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-cf87c803-4b8c-47b7-ab42-c64f49e033c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:01.122511 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf87c803-4b8c-47b7-ab42-c64f49e033c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:01.123983 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf87c803-4b8c-47b7-ab42-c64f49e033c5 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:01.125321 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e4bd9-be41-48b9-89ec-47153b6da43e admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:01.130260 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919fbf93-8555-41c7-852a-3140d884470a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:01.130987 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919fbf93-8555-41c7-852a-3140d884470a service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:01.131636 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919fbf93-8555-41c7-852a-3140d884470a service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:01.131990 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919fbf93-8555-41c7-852a-3140d884470a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:01.135326 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-919fbf93-8555-41c7-852a-3140d884470a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:01.136607 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2767/5492] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:33:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:33:01.140444 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf87c803-4b8c-47b7-ab42-c64f49e033c5 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:01.152976 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf87c803-4b8c-47b7-ab42-c64f49e033c5 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:01.158708 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe7081-ac92-4c57-a48d-a554831526fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:01.160375 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe7081-ac92-4c57-a48d-a554831526fc admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:01.160918 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe7081-ac92-4c57-a48d-a554831526fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:01.161476 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe7081-ac92-4c57-a48d-a554831526fc admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:01.162515 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbe7081-ac92-4c57-a48d-a554831526fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:01.164901 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbe7081-ac92-4c57-a48d-a554831526fc admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:01.177736 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2768/5493] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:33:01 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:33:01.183668 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe7081-ac92-4c57-a48d-a554831526fc admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:01.203860 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe7081-ac92-4c57-a48d-a554831526fc admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:01.209784 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e702e5d-4861-4b59-ad8d-b9341ec3bf92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:01.210983 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e702e5d-4861-4b59-ad8d-b9341ec3bf92 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:01.211373 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e702e5d-4861-4b59-ad8d-b9341ec3bf92 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:01.212100 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e702e5d-4861-4b59-ad8d-b9341ec3bf92 admin admin] PATH_INFO: `/v3/projects/2ab705ce1456448785c121ba9cf6e5c2/users/7b03cccf523b43a49748977c3739010f/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:01.225920 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919fbf93-8555-41c7-852a-3140d884470a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:01.227648 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919fbf93-8555-41c7-852a-3140d884470a service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:01.237323 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e702e5d-4861-4b59-ad8d-b9341ec3bf92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ab705ce1456448785c121ba9cf6e5c2, user_id=7b03cccf523b43a49748977c3739010f, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:01.243112 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e702e5d-4861-4b59-ad8d-b9341ec3bf92 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:01.250875 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2726/5494] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:33:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:33:01.342117 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2769/5495] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:33:01 2022] PUT /identity/v3/projects/2ab705ce1456448785c121ba9cf6e5c2/users/7b03cccf523b43a49748977c3739010f/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:33:01.427378 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a45a387-a528-4d09-aca6-95d83c68d63e None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:01.427901 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a45a387-a528-4d09-aca6-95d83c68d63e None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:01.427996 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a45a387-a528-4d09-aca6-95d83c68d63e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:01.458878 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-9a45a387-a528-4d09-aca6-95d83c68d63e None None] MFA Rules not processed for user `7b03cccf523b43a49748977c3739010f`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:33:01.460565 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-9a45a387-a528-4d09-aca6-95d83c68d63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:01.539981 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2727/5496] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:33:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:33:01.545553 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e702e5d-4861-4b59-ad8d-b9341ec3bf92 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:01.613668 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e702e5d-4861-4b59-ad8d-b9341ec3bf92 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:01.618576 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32416b0-fabc-4753-a7d3-368c8f7a6c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:01.619979 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32416b0-fabc-4753-a7d3-368c8f7a6c04 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:01.620335 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32416b0-fabc-4753-a7d3-368c8f7a6c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:01.620681 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32416b0-fabc-4753-a7d3-368c8f7a6c04 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:01.621470 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32416b0-fabc-4753-a7d3-368c8f7a6c04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:01.623599 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32416b0-fabc-4753-a7d3-368c8f7a6c04 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:01.736487 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2770/5497] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:33:01 2022] POST /identity/v3/projects => generated 373 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:33:01.737652 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a45a387-a528-4d09-aca6-95d83c68d63e None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:01.755013 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a45a387-a528-4d09-aca6-95d83c68d63e None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:01.846413 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6248210-d20b-4650-b98c-57ed424c47ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:01.853151 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6248210-d20b-4650-b98c-57ed424c47ad admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:01.853151 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6248210-d20b-4650-b98c-57ed424c47ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:01.853151 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6248210-d20b-4650-b98c-57ed424c47ad admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:01.853151 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6248210-d20b-4650-b98c-57ed424c47ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:01.853151 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6248210-d20b-4650-b98c-57ed424c47ad admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:01.939184 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2728/5498] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:33:01 2022] POST /identity/v3/users => generated 293 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:33:01.943172 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32416b0-fabc-4753-a7d3-368c8f7a6c04 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:01.955061 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32416b0-fabc-4753-a7d3-368c8f7a6c04 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:01.960048 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a97cb-b29d-4e85-93a7-2078d605a365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:01.961778 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a97cb-b29d-4e85-93a7-2078d605a365 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:01.962163 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a97cb-b29d-4e85-93a7-2078d605a365 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:01.962565 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a97cb-b29d-4e85-93a7-2078d605a365 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:01.965923 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419a97cb-b29d-4e85-93a7-2078d605a365 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:01.965923 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419a97cb-b29d-4e85-93a7-2078d605a365 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:01.981764 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2771/5499] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:33:01 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:33:01.985614 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6248210-d20b-4650-b98c-57ed424c47ad admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:02.000890 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6248210-d20b-4650-b98c-57ed424c47ad admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:02.007741 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb982f5-841d-46b5-a89c-b37d7a271bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:02.009117 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb982f5-841d-46b5-a89c-b37d7a271bf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:02.009540 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb982f5-841d-46b5-a89c-b37d7a271bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:02.010152 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb982f5-841d-46b5-a89c-b37d7a271bf8 admin admin] PATH_INFO: `/v3/projects/7c389ec6b454405aad0012fe235deac5/users/9dccef27a56140498698b4161fdc9569/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:02.031912 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb982f5-841d-46b5-a89c-b37d7a271bf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c389ec6b454405aad0012fe235deac5, user_id=9dccef27a56140498698b4161fdc9569, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:02.035385 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb982f5-841d-46b5-a89c-b37d7a271bf8 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:02.147667 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2729/5500] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:33:01 2022] PUT /identity/v3/projects/7c389ec6b454405aad0012fe235deac5/users/9dccef27a56140498698b4161fdc9569/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:02.152010 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a97cb-b29d-4e85-93a7-2078d605a365 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:02.166988 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a97cb-b29d-4e85-93a7-2078d605a365 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:02.252598 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d730d122-0fa4-4ae6-a6be-4c89d0042242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:02.253536 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730d122-0fa4-4ae6-a6be-4c89d0042242 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:02.253861 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730d122-0fa4-4ae6-a6be-4c89d0042242 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:02.254199 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730d122-0fa4-4ae6-a6be-4c89d0042242 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:02.255043 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d730d122-0fa4-4ae6-a6be-4c89d0042242 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:02.257074 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d730d122-0fa4-4ae6-a6be-4c89d0042242 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:02.268678 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2772/5501] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:33:02 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:33:02.272769 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb982f5-841d-46b5-a89c-b37d7a271bf8 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:02.283778 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb982f5-841d-46b5-a89c-b37d7a271bf8 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:02.292924 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aca8465-7d73-405f-9af5-8f4b5eed4d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:02.293794 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca8465-7d73-405f-9af5-8f4b5eed4d87 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:02.294074 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca8465-7d73-405f-9af5-8f4b5eed4d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:02.294349 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca8465-7d73-405f-9af5-8f4b5eed4d87 admin admin] PATH_INFO: `/v3/projects/7c389ec6b454405aad0012fe235deac5/users/9dccef27a56140498698b4161fdc9569/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:02.296337 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aca8465-7d73-405f-9af5-8f4b5eed4d87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c389ec6b454405aad0012fe235deac5, user_id=9dccef27a56140498698b4161fdc9569, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:02.299229 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aca8465-7d73-405f-9af5-8f4b5eed4d87 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:02.318706 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2730/5502] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:33:02 2022] PUT /identity/v3/projects/7c389ec6b454405aad0012fe235deac5/users/9dccef27a56140498698b4161fdc9569/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:02.322964 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d268b8-2ed5-4289-b62e-c7cb95eaca73 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:02.323264 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d268b8-2ed5-4289-b62e-c7cb95eaca73 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:02.323587 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d268b8-2ed5-4289-b62e-c7cb95eaca73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:02.356241 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-87d268b8-2ed5-4289-b62e-c7cb95eaca73 None None] MFA Rules not processed for user `9dccef27a56140498698b4161fdc9569`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:33:02.357527 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-87d268b8-2ed5-4289-b62e-c7cb95eaca73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:02.448367 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2773/5503] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:33:02 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:33:02.452681 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aca8465-7d73-405f-9af5-8f4b5eed4d87 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:02.467102 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aca8465-7d73-405f-9af5-8f4b5eed4d87 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:02.473218 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3280ec5d-d5b5-4de2-8ec4-7de63d389f5d tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dccef27a56140498698b4161fdc9569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c389ec6b454405aad0012fe235deac5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:02.473961 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280ec5d-d5b5-4de2-8ec4-7de63d389f5d tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:02.474430 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280ec5d-d5b5-4de2-8ec4-7de63d389f5d tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:02.474990 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280ec5d-d5b5-4de2-8ec4-7de63d389f5d tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:02.476021 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3280ec5d-d5b5-4de2-8ec4-7de63d389f5d tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:02.477813 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3280ec5d-d5b5-4de2-8ec4-7de63d389f5d tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:02.543410 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2731/5504] 10.222.0.52 () {60 vars in 1148 bytes} [Sat May 14 21:33:02 2022] POST /identity/v3/domains => generated 275 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:33:02.548093 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d268b8-2ed5-4289-b62e-c7cb95eaca73 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:02.558184 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d268b8-2ed5-4289-b62e-c7cb95eaca73 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:02.625830 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e7da51-afb8-49dc-9764-77ab3f208ff8 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dccef27a56140498698b4161fdc9569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c389ec6b454405aad0012fe235deac5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:02.626537 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e7da51-afb8-49dc-9764-77ab3f208ff8 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:02.626971 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e7da51-afb8-49dc-9764-77ab3f208ff8 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:02.627284 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e7da51-afb8-49dc-9764-77ab3f208ff8 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:02.628243 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e7da51-afb8-49dc-9764-77ab3f208ff8 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:02.631378 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e7da51-afb8-49dc-9764-77ab3f208ff8 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:02.760177 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2774/5505] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:33:02 2022] POST /identity/v3/projects => generated 403 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:33:02.763933 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3280ec5d-d5b5-4de2-8ec4-7de63d389f5d tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:02.774381 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3280ec5d-d5b5-4de2-8ec4-7de63d389f5d tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:02.834708 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170795ab-1820-4cae-8a86-e061698eeb3e tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dccef27a56140498698b4161fdc9569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c389ec6b454405aad0012fe235deac5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:02.835451 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170795ab-1820-4cae-8a86-e061698eeb3e tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:02.836072 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170795ab-1820-4cae-8a86-e061698eeb3e tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:02.836619 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170795ab-1820-4cae-8a86-e061698eeb3e tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] PATH_INFO: `/v3/groups` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:02.837801 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170795ab-1820-4cae-8a86-e061698eeb3e tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:02.839428 ncdv-master-1 devstack@keystone.service[91107]: WARNING py.warnings [None req-170795ab-1820-4cae-8a86-e061698eeb3e tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 14 21:33:02.839428 ncdv-master-1 devstack@keystone.service[91107]: warnings.warn(msg) May 14 21:33:02.839428 ncdv-master-1 devstack@keystone.service[91107]: May 14 21:33:02.840918 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170795ab-1820-4cae-8a86-e061698eeb3e tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:02.935900 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2732/5506] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:33:02 2022] POST /identity/v3/groups => generated 302 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:33:02.940649 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e7da51-afb8-49dc-9764-77ab3f208ff8 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:02.954950 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e7da51-afb8-49dc-9764-77ab3f208ff8 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:02.960068 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121eaaf9-d38d-4659-b50b-7ac36381a7fe tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dccef27a56140498698b4161fdc9569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c389ec6b454405aad0012fe235deac5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:02.960940 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121eaaf9-d38d-4659-b50b-7ac36381a7fe tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:02.961677 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121eaaf9-d38d-4659-b50b-7ac36381a7fe tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:02.962108 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121eaaf9-d38d-4659-b50b-7ac36381a7fe tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:02.963864 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121eaaf9-d38d-4659-b50b-7ac36381a7fe tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:02.965961 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121eaaf9-d38d-4659-b50b-7ac36381a7fe tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:03.068834 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2775/5507] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:33:02 2022] POST /identity/v3/users => generated 442 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:33:03.073778 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170795ab-1820-4cae-8a86-e061698eeb3e tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:03.084467 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170795ab-1820-4cae-8a86-e061698eeb3e tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:03.089788 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c1c32-eb5f-4be7-b5ce-5105b5beaac4 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dccef27a56140498698b4161fdc9569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c389ec6b454405aad0012fe235deac5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:03.090467 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c1c32-eb5f-4be7-b5ce-5105b5beaac4 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:03.090756 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c1c32-eb5f-4be7-b5ce-5105b5beaac4 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:03.091104 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c1c32-eb5f-4be7-b5ce-5105b5beaac4 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:03.091875 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4c1c32-eb5f-4be7-b5ce-5105b5beaac4 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:03.093601 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4c1c32-eb5f-4be7-b5ce-5105b5beaac4 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:03.179844 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2733/5508] 10.222.0.52 () {60 vars in 1142 bytes} [Sat May 14 21:33:03 2022] POST /identity/v3/roles => generated 239 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:33:03.184253 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121eaaf9-d38d-4659-b50b-7ac36381a7fe tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:03.194653 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121eaaf9-d38d-4659-b50b-7ac36381a7fe tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:03.199581 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5186ab-791a-42d2-bd03-fdde46fbecc9 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dccef27a56140498698b4161fdc9569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c389ec6b454405aad0012fe235deac5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:03.200403 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5186ab-791a-42d2-bd03-fdde46fbecc9 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:03.200686 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5186ab-791a-42d2-bd03-fdde46fbecc9 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:03.200962 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5186ab-791a-42d2-bd03-fdde46fbecc9 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/cd9a1471bb814b39bef2a604db5ac07c/groups/8990544af252475f881b07ca08bca5f8/roles/4119df83c40c4ded97ce0b807c03ef16/inherited_to_projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:03.207363 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5186ab-791a-42d2-bd03-fdde46fbecc9 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorizing `identity:create_grant(project_id=cd9a1471bb814b39bef2a604db5ac07c, group_id=8990544af252475f881b07ca08bca5f8, role_id=4119df83c40c4ded97ce0b807c03ef16)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:03.210095 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5186ab-791a-42d2-bd03-fdde46fbecc9 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:03.298361 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2776/5509] 10.222.0.52 () {60 vars in 1584 bytes} [Sat May 14 21:33:03 2022] PUT /identity/v3/OS-INHERIT/projects/cd9a1471bb814b39bef2a604db5ac07c/groups/8990544af252475f881b07ca08bca5f8/roles/4119df83c40c4ded97ce0b807c03ef16/inherited_to_projects => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:33:03.302500 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c1c32-eb5f-4be7-b5ce-5105b5beaac4 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:03.314864 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c1c32-eb5f-4be7-b5ce-5105b5beaac4 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:03.428979 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e634ec90-05cd-4c86-9e34-a14a40e242a5 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dccef27a56140498698b4161fdc9569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c389ec6b454405aad0012fe235deac5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:03.430428 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634ec90-05cd-4c86-9e34-a14a40e242a5 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:03.430428 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634ec90-05cd-4c86-9e34-a14a40e242a5 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:03.431058 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634ec90-05cd-4c86-9e34-a14a40e242a5 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/cd9a1471bb814b39bef2a604db5ac07c/groups/8990544af252475f881b07ca08bca5f8/roles/4119df83c40c4ded97ce0b807c03ef16/inherited_to_projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:03.434315 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e634ec90-05cd-4c86-9e34-a14a40e242a5 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorizing `identity:check_grant(project_id=cd9a1471bb814b39bef2a604db5ac07c, group_id=8990544af252475f881b07ca08bca5f8, role_id=4119df83c40c4ded97ce0b807c03ef16)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:03.438442 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e634ec90-05cd-4c86-9e34-a14a40e242a5 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:03.447879 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2734/5510] 10.222.0.52 () {58 vars in 1566 bytes} [Sat May 14 21:33:03 2022] HEAD /identity/v3/OS-INHERIT/projects/cd9a1471bb814b39bef2a604db5ac07c/groups/8990544af252475f881b07ca08bca5f8/roles/4119df83c40c4ded97ce0b807c03ef16/inherited_to_projects => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:03.455772 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5186ab-791a-42d2-bd03-fdde46fbecc9 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:03.470074 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5186ab-791a-42d2-bd03-fdde46fbecc9 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:03.474971 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fd64f2-b7fe-493e-a43c-d84b953da5c5 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dccef27a56140498698b4161fdc9569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c389ec6b454405aad0012fe235deac5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:03.476279 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd64f2-b7fe-493e-a43c-d84b953da5c5 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:03.476766 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd64f2-b7fe-493e-a43c-d84b953da5c5 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:03.477136 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd64f2-b7fe-493e-a43c-d84b953da5c5 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/cd9a1471bb814b39bef2a604db5ac07c/groups/8990544af252475f881b07ca08bca5f8/roles/4119df83c40c4ded97ce0b807c03ef16/inherited_to_projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:03.481140 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fd64f2-b7fe-493e-a43c-d84b953da5c5 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=cd9a1471bb814b39bef2a604db5ac07c, group_id=8990544af252475f881b07ca08bca5f8, role_id=4119df83c40c4ded97ce0b807c03ef16)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:03.484578 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fd64f2-b7fe-493e-a43c-d84b953da5c5 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:03.507549 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-68fd64f2-b7fe-493e-a43c-d84b953da5c5 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Invalidating the token cache because role 4119df83c40c4ded97ce0b807c03ef16 was removed from group 8990544af252475f881b07ca08bca5f8 on project cd9a1471bb814b39bef2a604db5ac07c. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:33:03.507849 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-68fd64f2-b7fe-493e-a43c-d84b953da5c5 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:03.508760 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-68fd64f2-b7fe-493e-a43c-d84b953da5c5 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:03.593502 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2777/5511] 10.222.0.52 () {58 vars in 1568 bytes} [Sat May 14 21:33:03 2022] DELETE /identity/v3/OS-INHERIT/projects/cd9a1471bb814b39bef2a604db5ac07c/groups/8990544af252475f881b07ca08bca5f8/roles/4119df83c40c4ded97ce0b807c03ef16/inherited_to_projects => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:03.594683 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e634ec90-05cd-4c86-9e34-a14a40e242a5 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:03.598028 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e634ec90-05cd-4c86-9e34-a14a40e242a5 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:03.621994 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e634ec90-05cd-4c86-9e34-a14a40e242a5 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:03.808081 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a800d3-3e2f-4f4c-bb4f-49f59bd9ce4a tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dccef27a56140498698b4161fdc9569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c389ec6b454405aad0012fe235deac5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:03.809004 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a800d3-3e2f-4f4c-bb4f-49f59bd9ce4a tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:03.809291 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a800d3-3e2f-4f4c-bb4f-49f59bd9ce4a tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:03.809569 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a800d3-3e2f-4f4c-bb4f-49f59bd9ce4a tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] PATH_INFO: `/v3/roles/4119df83c40c4ded97ce0b807c03ef16` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:03.812654 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a800d3-3e2f-4f4c-bb4f-49f59bd9ce4a tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorizing `identity:delete_role(role_id=4119df83c40c4ded97ce0b807c03ef16)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:03.814545 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a800d3-3e2f-4f4c-bb4f-49f59bd9ce4a tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:03.953133 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-49a800d3-3e2f-4f4c-bb4f-49f59bd9ce4a tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Invalidating the token cache because role 4119df83c40c4ded97ce0b807c03ef16 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:33:03.953825 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-49a800d3-3e2f-4f4c-bb4f-49f59bd9ce4a tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:03.954973 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-49a800d3-3e2f-4f4c-bb4f-49f59bd9ce4a tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:03.958142 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2735/5512] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:33:03 2022] DELETE /identity/v3/roles/4119df83c40c4ded97ce0b807c03ef16 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:03.963717 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fd64f2-b7fe-493e-a43c-d84b953da5c5 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:03.974393 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fd64f2-b7fe-493e-a43c-d84b953da5c5 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:04.054700 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf6c478-393e-44e3-8284-71fb89af6f2e tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dccef27a56140498698b4161fdc9569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c389ec6b454405aad0012fe235deac5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:04.055786 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6c478-393e-44e3-8284-71fb89af6f2e tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:04.056719 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6c478-393e-44e3-8284-71fb89af6f2e tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:04.057243 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6c478-393e-44e3-8284-71fb89af6f2e tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:04.058248 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf6c478-393e-44e3-8284-71fb89af6f2e tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:04.060369 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf6c478-393e-44e3-8284-71fb89af6f2e tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:04.160929 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a800d3-3e2f-4f4c-bb4f-49f59bd9ce4a tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:04.164333 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-49a800d3-3e2f-4f4c-bb4f-49f59bd9ce4a tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:04.167227 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2778/5513] 10.222.0.52 () {60 vars in 1142 bytes} [Sat May 14 21:33:03 2022] POST /identity/v3/roles => generated 240 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:33:04.178576 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a800d3-3e2f-4f4c-bb4f-49f59bd9ce4a tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:04.184805 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f8d1c4-e11f-4db6-85c5-5da2c5a4d476 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dccef27a56140498698b4161fdc9569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c389ec6b454405aad0012fe235deac5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:04.186100 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f8d1c4-e11f-4db6-85c5-5da2c5a4d476 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:04.186876 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f8d1c4-e11f-4db6-85c5-5da2c5a4d476 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:04.187160 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f8d1c4-e11f-4db6-85c5-5da2c5a4d476 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/cd9a1471bb814b39bef2a604db5ac07c/users/755b4ba0a6554e459937a3c3eda09ad3/roles/ebb1650691324182b251bd1b1c09ce33/inherited_to_projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:04.221731 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f8d1c4-e11f-4db6-85c5-5da2c5a4d476 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorizing `identity:create_grant(project_id=cd9a1471bb814b39bef2a604db5ac07c, user_id=755b4ba0a6554e459937a3c3eda09ad3, role_id=ebb1650691324182b251bd1b1c09ce33)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:04.225761 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f8d1c4-e11f-4db6-85c5-5da2c5a4d476 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:04.317331 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2736/5514] 10.222.0.52 () {60 vars in 1581 bytes} [Sat May 14 21:33:04 2022] PUT /identity/v3/OS-INHERIT/projects/cd9a1471bb814b39bef2a604db5ac07c/users/755b4ba0a6554e459937a3c3eda09ad3/roles/ebb1650691324182b251bd1b1c09ce33/inherited_to_projects => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:04.322356 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf6c478-393e-44e3-8284-71fb89af6f2e tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:04.343355 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf6c478-393e-44e3-8284-71fb89af6f2e tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:04.455083 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48592356-e18f-494b-9533-5744dc8c7c4b tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dccef27a56140498698b4161fdc9569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c389ec6b454405aad0012fe235deac5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:04.456031 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48592356-e18f-494b-9533-5744dc8c7c4b tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:04.456316 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48592356-e18f-494b-9533-5744dc8c7c4b tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:04.456619 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48592356-e18f-494b-9533-5744dc8c7c4b tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/cd9a1471bb814b39bef2a604db5ac07c/users/755b4ba0a6554e459937a3c3eda09ad3/roles/ebb1650691324182b251bd1b1c09ce33/inherited_to_projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:04.459234 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48592356-e18f-494b-9533-5744dc8c7c4b tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorizing `identity:check_grant(project_id=cd9a1471bb814b39bef2a604db5ac07c, user_id=755b4ba0a6554e459937a3c3eda09ad3, role_id=ebb1650691324182b251bd1b1c09ce33)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:04.462011 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48592356-e18f-494b-9533-5744dc8c7c4b tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:04.469102 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2779/5515] 10.222.0.52 () {58 vars in 1563 bytes} [Sat May 14 21:33:04 2022] HEAD /identity/v3/OS-INHERIT/projects/cd9a1471bb814b39bef2a604db5ac07c/users/755b4ba0a6554e459937a3c3eda09ad3/roles/ebb1650691324182b251bd1b1c09ce33/inherited_to_projects => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:04.473473 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f8d1c4-e11f-4db6-85c5-5da2c5a4d476 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:04.484912 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f8d1c4-e11f-4db6-85c5-5da2c5a4d476 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:04.489950 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f7cf0c-0634-4d6b-9ca2-cc5980d3c625 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dccef27a56140498698b4161fdc9569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c389ec6b454405aad0012fe235deac5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:04.490892 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f7cf0c-0634-4d6b-9ca2-cc5980d3c625 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:04.491250 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f7cf0c-0634-4d6b-9ca2-cc5980d3c625 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:04.491788 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f7cf0c-0634-4d6b-9ca2-cc5980d3c625 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/cd9a1471bb814b39bef2a604db5ac07c/users/755b4ba0a6554e459937a3c3eda09ad3/roles/ebb1650691324182b251bd1b1c09ce33/inherited_to_projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:04.495036 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f7cf0c-0634-4d6b-9ca2-cc5980d3c625 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=cd9a1471bb814b39bef2a604db5ac07c, user_id=755b4ba0a6554e459937a3c3eda09ad3, role_id=ebb1650691324182b251bd1b1c09ce33)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:04.498055 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f7cf0c-0634-4d6b-9ca2-cc5980d3c625 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:04.503704 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a4f7cf0c-0634-4d6b-9ca2-cc5980d3c625 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Invalidating the token cache because role ebb1650691324182b251bd1b1c09ce33 was removed from user 755b4ba0a6554e459937a3c3eda09ad3 on project cd9a1471bb814b39bef2a604db5ac07c. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:33:04.503991 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a4f7cf0c-0634-4d6b-9ca2-cc5980d3c625 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:04.504702 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a4f7cf0c-0634-4d6b-9ca2-cc5980d3c625 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:04.582727 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2737/5516] 10.222.0.52 () {58 vars in 1565 bytes} [Sat May 14 21:33:04 2022] DELETE /identity/v3/OS-INHERIT/projects/cd9a1471bb814b39bef2a604db5ac07c/users/755b4ba0a6554e459937a3c3eda09ad3/roles/ebb1650691324182b251bd1b1c09ce33/inherited_to_projects => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:04.588273 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48592356-e18f-494b-9533-5744dc8c7c4b tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:04.590463 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-48592356-e18f-494b-9533-5744dc8c7c4b tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:04.609935 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48592356-e18f-494b-9533-5744dc8c7c4b tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:04.684681 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd7b86-8063-4dfc-9b39-9d6ecafe099c tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dccef27a56140498698b4161fdc9569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c389ec6b454405aad0012fe235deac5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:04.685927 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd7b86-8063-4dfc-9b39-9d6ecafe099c tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:04.686375 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd7b86-8063-4dfc-9b39-9d6ecafe099c tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:04.687324 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd7b86-8063-4dfc-9b39-9d6ecafe099c tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] PATH_INFO: `/v3/roles/ebb1650691324182b251bd1b1c09ce33` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:04.688662 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbd7b86-8063-4dfc-9b39-9d6ecafe099c tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorizing `identity:delete_role(role_id=ebb1650691324182b251bd1b1c09ce33)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:04.690492 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbd7b86-8063-4dfc-9b39-9d6ecafe099c tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:04.791709 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0dbd7b86-8063-4dfc-9b39-9d6ecafe099c tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Invalidating the token cache because role ebb1650691324182b251bd1b1c09ce33 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:33:04.792389 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0dbd7b86-8063-4dfc-9b39-9d6ecafe099c tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:04.793220 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0dbd7b86-8063-4dfc-9b39-9d6ecafe099c tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:04.797518 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2780/5517] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:33:04 2022] DELETE /identity/v3/roles/ebb1650691324182b251bd1b1c09ce33 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:04.803694 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f7cf0c-0634-4d6b-9ca2-cc5980d3c625 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:04.815453 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f7cf0c-0634-4d6b-9ca2-cc5980d3c625 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:04.882361 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a5aa5-b7e3-47ca-a700-68c9765fcc6b tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dccef27a56140498698b4161fdc9569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c389ec6b454405aad0012fe235deac5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:04.884454 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a5aa5-b7e3-47ca-a700-68c9765fcc6b tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:04.886051 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a5aa5-b7e3-47ca-a700-68c9765fcc6b tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:04.886199 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a5aa5-b7e3-47ca-a700-68c9765fcc6b tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:04.887995 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0a5aa5-b7e3-47ca-a700-68c9765fcc6b tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:04.890682 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0a5aa5-b7e3-47ca-a700-68c9765fcc6b tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:04.965958 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2738/5518] 10.222.0.52 () {60 vars in 1142 bytes} [Sat May 14 21:33:04 2022] POST /identity/v3/roles => generated 239 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:33:04.969996 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd7b86-8063-4dfc-9b39-9d6ecafe099c tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:04.971951 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-0dbd7b86-8063-4dfc-9b39-9d6ecafe099c tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:04.995752 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd7b86-8063-4dfc-9b39-9d6ecafe099c tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:05.012095 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af2f2b-f5aa-44e7-9b9d-02e1c5a7a9aa tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dccef27a56140498698b4161fdc9569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c389ec6b454405aad0012fe235deac5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:05.013713 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af2f2b-f5aa-44e7-9b9d-02e1c5a7a9aa tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:05.013945 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af2f2b-f5aa-44e7-9b9d-02e1c5a7a9aa tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:05.016160 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af2f2b-f5aa-44e7-9b9d-02e1c5a7a9aa tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/449aebffff714e5687e4270cd0a01fb2/groups/8990544af252475f881b07ca08bca5f8/roles/56ce8aeaac994a219be766ba29fa795e/inherited_to_projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:05.024113 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96af2f2b-f5aa-44e7-9b9d-02e1c5a7a9aa tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=449aebffff714e5687e4270cd0a01fb2, group_id=8990544af252475f881b07ca08bca5f8, role_id=56ce8aeaac994a219be766ba29fa795e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:05.027814 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96af2f2b-f5aa-44e7-9b9d-02e1c5a7a9aa tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:05.132894 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2781/5519] 10.222.0.52 () {60 vars in 1581 bytes} [Sat May 14 21:33:04 2022] PUT /identity/v3/OS-INHERIT/domains/449aebffff714e5687e4270cd0a01fb2/groups/8990544af252475f881b07ca08bca5f8/roles/56ce8aeaac994a219be766ba29fa795e/inherited_to_projects => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:05.137674 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a5aa5-b7e3-47ca-a700-68c9765fcc6b tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:05.157159 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a5aa5-b7e3-47ca-a700-68c9765fcc6b tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:05.266119 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b113b-fa37-49ac-99d2-5d50f61cadf4 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dccef27a56140498698b4161fdc9569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c389ec6b454405aad0012fe235deac5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:05.267389 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b113b-fa37-49ac-99d2-5d50f61cadf4 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:05.267714 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b113b-fa37-49ac-99d2-5d50f61cadf4 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:05.268000 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b113b-fa37-49ac-99d2-5d50f61cadf4 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/449aebffff714e5687e4270cd0a01fb2/groups/8990544af252475f881b07ca08bca5f8/roles/inherited_to_projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:05.270269 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b113b-fa37-49ac-99d2-5d50f61cadf4 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=449aebffff714e5687e4270cd0a01fb2, group_id=8990544af252475f881b07ca08bca5f8)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:05.271902 ncdv-master-1 devstack@keystone.service[91107]: WARNING py.warnings [None req-ed4b113b-fa37-49ac-99d2-5d50f61cadf4 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 14 21:33:05.271902 ncdv-master-1 devstack@keystone.service[91107]: warnings.warn(msg) May 14 21:33:05.271902 ncdv-master-1 devstack@keystone.service[91107]: May 14 21:33:05.275439 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b113b-fa37-49ac-99d2-5d50f61cadf4 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:05.299416 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2739/5520] 10.222.0.52 () {58 vars in 1463 bytes} [Sat May 14 21:33:05 2022] GET /identity/v3/OS-INHERIT/domains/449aebffff714e5687e4270cd0a01fb2/groups/8990544af252475f881b07ca08bca5f8/roles/inherited_to_projects => generated 447 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:33:05.301251 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af2f2b-f5aa-44e7-9b9d-02e1c5a7a9aa tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:05.341071 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af2f2b-f5aa-44e7-9b9d-02e1c5a7a9aa tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:05.356145 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ea37a-9a70-4499-ad99-69d8417b481e tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dccef27a56140498698b4161fdc9569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c389ec6b454405aad0012fe235deac5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:05.357173 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ea37a-9a70-4499-ad99-69d8417b481e tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:05.357700 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ea37a-9a70-4499-ad99-69d8417b481e tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:05.358365 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ea37a-9a70-4499-ad99-69d8417b481e tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/449aebffff714e5687e4270cd0a01fb2/groups/8990544af252475f881b07ca08bca5f8/roles/56ce8aeaac994a219be766ba29fa795e/inherited_to_projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:05.361320 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3ea37a-9a70-4499-ad99-69d8417b481e tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=449aebffff714e5687e4270cd0a01fb2, group_id=8990544af252475f881b07ca08bca5f8, role_id=56ce8aeaac994a219be766ba29fa795e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:05.369302 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3ea37a-9a70-4499-ad99-69d8417b481e tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:05.379614 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2782/5521] 10.222.0.52 () {58 vars in 1563 bytes} [Sat May 14 21:33:05 2022] HEAD /identity/v3/OS-INHERIT/domains/449aebffff714e5687e4270cd0a01fb2/groups/8990544af252475f881b07ca08bca5f8/roles/56ce8aeaac994a219be766ba29fa795e/inherited_to_projects => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:05.383600 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b113b-fa37-49ac-99d2-5d50f61cadf4 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:05.398802 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b113b-fa37-49ac-99d2-5d50f61cadf4 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:05.405921 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40019f0-5420-4957-90c3-cf9a780e6fc2 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dccef27a56140498698b4161fdc9569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c389ec6b454405aad0012fe235deac5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:05.407078 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40019f0-5420-4957-90c3-cf9a780e6fc2 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:05.407206 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40019f0-5420-4957-90c3-cf9a780e6fc2 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:05.407390 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40019f0-5420-4957-90c3-cf9a780e6fc2 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/449aebffff714e5687e4270cd0a01fb2/groups/8990544af252475f881b07ca08bca5f8/roles/56ce8aeaac994a219be766ba29fa795e/inherited_to_projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:05.410095 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40019f0-5420-4957-90c3-cf9a780e6fc2 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=449aebffff714e5687e4270cd0a01fb2, group_id=8990544af252475f881b07ca08bca5f8, role_id=56ce8aeaac994a219be766ba29fa795e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:05.414945 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40019f0-5420-4957-90c3-cf9a780e6fc2 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:05.422873 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b40019f0-5420-4957-90c3-cf9a780e6fc2 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Invalidating the token cache because role 56ce8aeaac994a219be766ba29fa795e was removed from group 8990544af252475f881b07ca08bca5f8 on domain 449aebffff714e5687e4270cd0a01fb2. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:33:05.423723 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b40019f0-5420-4957-90c3-cf9a780e6fc2 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:05.424025 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b40019f0-5420-4957-90c3-cf9a780e6fc2 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:05.603438 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2740/5522] 10.222.0.52 () {58 vars in 1565 bytes} [Sat May 14 21:33:05 2022] DELETE /identity/v3/OS-INHERIT/domains/449aebffff714e5687e4270cd0a01fb2/groups/8990544af252475f881b07ca08bca5f8/roles/56ce8aeaac994a219be766ba29fa795e/inherited_to_projects => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:05.607529 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ea37a-9a70-4499-ad99-69d8417b481e tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:05.609559 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-0a3ea37a-9a70-4499-ad99-69d8417b481e tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:05.626402 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ea37a-9a70-4499-ad99-69d8417b481e tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:05.704534 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d0b883-1454-4404-802b-09ac8c0ab048 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dccef27a56140498698b4161fdc9569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c389ec6b454405aad0012fe235deac5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:05.705698 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0b883-1454-4404-802b-09ac8c0ab048 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:05.706108 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0b883-1454-4404-802b-09ac8c0ab048 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:05.706454 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0b883-1454-4404-802b-09ac8c0ab048 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] PATH_INFO: `/v3/roles/56ce8aeaac994a219be766ba29fa795e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:05.709930 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d0b883-1454-4404-802b-09ac8c0ab048 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorizing `identity:delete_role(role_id=56ce8aeaac994a219be766ba29fa795e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:05.713493 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d0b883-1454-4404-802b-09ac8c0ab048 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:05.849488 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-92d0b883-1454-4404-802b-09ac8c0ab048 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Invalidating the token cache because role 56ce8aeaac994a219be766ba29fa795e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:33:05.849789 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-92d0b883-1454-4404-802b-09ac8c0ab048 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:05.855947 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-92d0b883-1454-4404-802b-09ac8c0ab048 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:05.863931 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2783/5523] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:33:05 2022] DELETE /identity/v3/roles/56ce8aeaac994a219be766ba29fa795e => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:05.868711 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40019f0-5420-4957-90c3-cf9a780e6fc2 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:05.883049 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40019f0-5420-4957-90c3-cf9a780e6fc2 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:05.983953 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120275cf-7183-4b56-97f0-17059e686d5d tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dccef27a56140498698b4161fdc9569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c389ec6b454405aad0012fe235deac5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:05.984863 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120275cf-7183-4b56-97f0-17059e686d5d tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:05.985155 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120275cf-7183-4b56-97f0-17059e686d5d tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:05.985431 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120275cf-7183-4b56-97f0-17059e686d5d tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:05.986510 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120275cf-7183-4b56-97f0-17059e686d5d tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:05.988940 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120275cf-7183-4b56-97f0-17059e686d5d tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:06.108534 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2741/5524] 10.222.0.52 () {60 vars in 1142 bytes} [Sat May 14 21:33:05 2022] POST /identity/v3/roles => generated 240 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:33:06.112578 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d0b883-1454-4404-802b-09ac8c0ab048 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:06.114680 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-92d0b883-1454-4404-802b-09ac8c0ab048 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:06.139163 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d0b883-1454-4404-802b-09ac8c0ab048 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:06.144814 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97c6089-b99f-4f0e-87f9-57f9c340dc5d tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dccef27a56140498698b4161fdc9569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c389ec6b454405aad0012fe235deac5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:06.146278 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c6089-b99f-4f0e-87f9-57f9c340dc5d tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:06.146724 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c6089-b99f-4f0e-87f9-57f9c340dc5d tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:06.147343 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c6089-b99f-4f0e-87f9-57f9c340dc5d tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/449aebffff714e5687e4270cd0a01fb2/users/755b4ba0a6554e459937a3c3eda09ad3/roles/0194994c5cda4fc59a6aa6f7e8d3ef82/inherited_to_projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:06.153804 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97c6089-b99f-4f0e-87f9-57f9c340dc5d tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=449aebffff714e5687e4270cd0a01fb2, user_id=755b4ba0a6554e459937a3c3eda09ad3, role_id=0194994c5cda4fc59a6aa6f7e8d3ef82)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:06.159342 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97c6089-b99f-4f0e-87f9-57f9c340dc5d tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:06.258309 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2784/5525] 10.222.0.52 () {60 vars in 1578 bytes} [Sat May 14 21:33:06 2022] PUT /identity/v3/OS-INHERIT/domains/449aebffff714e5687e4270cd0a01fb2/users/755b4ba0a6554e459937a3c3eda09ad3/roles/0194994c5cda4fc59a6aa6f7e8d3ef82/inherited_to_projects => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:06.262975 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120275cf-7183-4b56-97f0-17059e686d5d tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:06.283186 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120275cf-7183-4b56-97f0-17059e686d5d tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:06.403934 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ed89a-7fa2-47e8-9257-7c0178d5f779 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dccef27a56140498698b4161fdc9569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c389ec6b454405aad0012fe235deac5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:06.405291 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ed89a-7fa2-47e8-9257-7c0178d5f779 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:06.411764 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ed89a-7fa2-47e8-9257-7c0178d5f779 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:06.411764 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ed89a-7fa2-47e8-9257-7c0178d5f779 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/449aebffff714e5687e4270cd0a01fb2/users/755b4ba0a6554e459937a3c3eda09ad3/roles/inherited_to_projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:06.411764 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691ed89a-7fa2-47e8-9257-7c0178d5f779 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=449aebffff714e5687e4270cd0a01fb2, user_id=755b4ba0a6554e459937a3c3eda09ad3)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:06.413632 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691ed89a-7fa2-47e8-9257-7c0178d5f779 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:06.443586 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2742/5526] 10.222.0.52 () {58 vars in 1460 bytes} [Sat May 14 21:33:06 2022] GET /identity/v3/OS-INHERIT/domains/449aebffff714e5687e4270cd0a01fb2/users/755b4ba0a6554e459937a3c3eda09ad3/roles/inherited_to_projects => generated 447 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:33:06.451403 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97c6089-b99f-4f0e-87f9-57f9c340dc5d tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:06.471277 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97c6089-b99f-4f0e-87f9-57f9c340dc5d tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:06.497112 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a407d332-988f-4f0e-99cc-cb3ea8e47338 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dccef27a56140498698b4161fdc9569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c389ec6b454405aad0012fe235deac5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:06.499187 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a407d332-988f-4f0e-99cc-cb3ea8e47338 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:06.500907 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a407d332-988f-4f0e-99cc-cb3ea8e47338 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:06.506393 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a407d332-988f-4f0e-99cc-cb3ea8e47338 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/449aebffff714e5687e4270cd0a01fb2/users/755b4ba0a6554e459937a3c3eda09ad3/roles/0194994c5cda4fc59a6aa6f7e8d3ef82/inherited_to_projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:06.508391 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a407d332-988f-4f0e-99cc-cb3ea8e47338 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=449aebffff714e5687e4270cd0a01fb2, user_id=755b4ba0a6554e459937a3c3eda09ad3, role_id=0194994c5cda4fc59a6aa6f7e8d3ef82)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:06.512149 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a407d332-988f-4f0e-99cc-cb3ea8e47338 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:06.522210 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2785/5527] 10.222.0.52 () {58 vars in 1560 bytes} [Sat May 14 21:33:06 2022] HEAD /identity/v3/OS-INHERIT/domains/449aebffff714e5687e4270cd0a01fb2/users/755b4ba0a6554e459937a3c3eda09ad3/roles/0194994c5cda4fc59a6aa6f7e8d3ef82/inherited_to_projects => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:06.526671 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ed89a-7fa2-47e8-9257-7c0178d5f779 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:06.546578 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ed89a-7fa2-47e8-9257-7c0178d5f779 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:06.582197 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664e2492-c8e8-4cb6-8879-ccb0904f5763 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dccef27a56140498698b4161fdc9569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c389ec6b454405aad0012fe235deac5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:06.583077 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e2492-c8e8-4cb6-8879-ccb0904f5763 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:06.583362 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e2492-c8e8-4cb6-8879-ccb0904f5763 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:06.583693 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e2492-c8e8-4cb6-8879-ccb0904f5763 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/449aebffff714e5687e4270cd0a01fb2/users/755b4ba0a6554e459937a3c3eda09ad3/roles/0194994c5cda4fc59a6aa6f7e8d3ef82/inherited_to_projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:06.586385 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664e2492-c8e8-4cb6-8879-ccb0904f5763 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=449aebffff714e5687e4270cd0a01fb2, user_id=755b4ba0a6554e459937a3c3eda09ad3, role_id=0194994c5cda4fc59a6aa6f7e8d3ef82)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:06.589561 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664e2492-c8e8-4cb6-8879-ccb0904f5763 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:06.595299 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-664e2492-c8e8-4cb6-8879-ccb0904f5763 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Invalidating the token cache because role 0194994c5cda4fc59a6aa6f7e8d3ef82 was removed from user 755b4ba0a6554e459937a3c3eda09ad3 on domain 449aebffff714e5687e4270cd0a01fb2. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:33:06.595848 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-664e2492-c8e8-4cb6-8879-ccb0904f5763 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:06.597026 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-664e2492-c8e8-4cb6-8879-ccb0904f5763 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:06.671534 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2743/5528] 10.222.0.52 () {58 vars in 1562 bytes} [Sat May 14 21:33:06 2022] DELETE /identity/v3/OS-INHERIT/domains/449aebffff714e5687e4270cd0a01fb2/users/755b4ba0a6554e459937a3c3eda09ad3/roles/0194994c5cda4fc59a6aa6f7e8d3ef82/inherited_to_projects => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:06.675653 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a407d332-988f-4f0e-99cc-cb3ea8e47338 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:06.679573 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-a407d332-988f-4f0e-99cc-cb3ea8e47338 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:06.699064 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a407d332-988f-4f0e-99cc-cb3ea8e47338 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:06.785139 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4632adde-e7f3-4723-9aea-6e8383c6585f tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dccef27a56140498698b4161fdc9569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c389ec6b454405aad0012fe235deac5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:06.786748 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4632adde-e7f3-4723-9aea-6e8383c6585f tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:06.787247 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4632adde-e7f3-4723-9aea-6e8383c6585f tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:06.788412 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4632adde-e7f3-4723-9aea-6e8383c6585f tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] PATH_INFO: `/v3/roles/0194994c5cda4fc59a6aa6f7e8d3ef82` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:06.792526 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4632adde-e7f3-4723-9aea-6e8383c6585f tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorizing `identity:delete_role(role_id=0194994c5cda4fc59a6aa6f7e8d3ef82)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:06.795010 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4632adde-e7f3-4723-9aea-6e8383c6585f tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:06.902389 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-4632adde-e7f3-4723-9aea-6e8383c6585f tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Invalidating the token cache because role 0194994c5cda4fc59a6aa6f7e8d3ef82 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:33:06.902788 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-4632adde-e7f3-4723-9aea-6e8383c6585f tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:06.903558 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-4632adde-e7f3-4723-9aea-6e8383c6585f tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:06.906028 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2786/5529] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:33:06 2022] DELETE /identity/v3/roles/0194994c5cda4fc59a6aa6f7e8d3ef82 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:06.916448 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664e2492-c8e8-4cb6-8879-ccb0904f5763 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:06.934166 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664e2492-c8e8-4cb6-8879-ccb0904f5763 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:07.071469 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e11ce62-40c3-4116-b0ef-788698da07f6 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dccef27a56140498698b4161fdc9569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c389ec6b454405aad0012fe235deac5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:07.071469 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e11ce62-40c3-4116-b0ef-788698da07f6 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:07.071469 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e11ce62-40c3-4116-b0ef-788698da07f6 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:07.072633 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e11ce62-40c3-4116-b0ef-788698da07f6 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:07.072857 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e11ce62-40c3-4116-b0ef-788698da07f6 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:07.075766 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e11ce62-40c3-4116-b0ef-788698da07f6 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:07.169867 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2744/5530] 10.222.0.52 () {60 vars in 1142 bytes} [Sat May 14 21:33:06 2022] POST /identity/v3/roles => generated 240 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:33:07.173609 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4632adde-e7f3-4723-9aea-6e8383c6585f tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:07.175038 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-4632adde-e7f3-4723-9aea-6e8383c6585f tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:07.191666 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4632adde-e7f3-4723-9aea-6e8383c6585f tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:07.198823 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f71ed33-69a3-4234-890d-6608caeb3606 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dccef27a56140498698b4161fdc9569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c389ec6b454405aad0012fe235deac5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:07.199269 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f71ed33-69a3-4234-890d-6608caeb3606 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:07.199577 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f71ed33-69a3-4234-890d-6608caeb3606 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:07.199858 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f71ed33-69a3-4234-890d-6608caeb3606 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:07.201759 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f71ed33-69a3-4234-890d-6608caeb3606 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:07.205147 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f71ed33-69a3-4234-890d-6608caeb3606 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:07.354408 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2787/5531] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:33:07 2022] POST /identity/v3/projects => generated 408 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:33:07.359183 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e11ce62-40c3-4116-b0ef-788698da07f6 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:07.392075 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e11ce62-40c3-4116-b0ef-788698da07f6 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:07.502292 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38860d57-9890-4638-92ee-f1dd2d6b1f41 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dccef27a56140498698b4161fdc9569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c389ec6b454405aad0012fe235deac5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:07.503255 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38860d57-9890-4638-92ee-f1dd2d6b1f41 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:07.503788 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38860d57-9890-4638-92ee-f1dd2d6b1f41 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:07.504275 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38860d57-9890-4638-92ee-f1dd2d6b1f41 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/449aebffff714e5687e4270cd0a01fb2/users/755b4ba0a6554e459937a3c3eda09ad3/roles/a8410b7df46c4a8e8e910ad1edec4359/inherited_to_projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:07.507282 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38860d57-9890-4638-92ee-f1dd2d6b1f41 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=449aebffff714e5687e4270cd0a01fb2, user_id=755b4ba0a6554e459937a3c3eda09ad3, role_id=a8410b7df46c4a8e8e910ad1edec4359)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:07.510977 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38860d57-9890-4638-92ee-f1dd2d6b1f41 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:07.616054 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2745/5532] 10.222.0.52 () {60 vars in 1578 bytes} [Sat May 14 21:33:07 2022] PUT /identity/v3/OS-INHERIT/domains/449aebffff714e5687e4270cd0a01fb2/users/755b4ba0a6554e459937a3c3eda09ad3/roles/a8410b7df46c4a8e8e910ad1edec4359/inherited_to_projects => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:07.621242 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f71ed33-69a3-4234-890d-6608caeb3606 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:07.648799 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f71ed33-69a3-4234-890d-6608caeb3606 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:07.765985 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eab41d8-a4c5-4b6b-8ea3-15b9b90298c6 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dccef27a56140498698b4161fdc9569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c389ec6b454405aad0012fe235deac5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:07.767299 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab41d8-a4c5-4b6b-8ea3-15b9b90298c6 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:07.767945 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab41d8-a4c5-4b6b-8ea3-15b9b90298c6 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:07.768383 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab41d8-a4c5-4b6b-8ea3-15b9b90298c6 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:07.769401 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eab41d8-a4c5-4b6b-8ea3-15b9b90298c6 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Adding query filter params (scope.project.id=cd9a1471bb814b39bef2a604db5ac07c, user.id=755b4ba0a6554e459937a3c3eda09ad3) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:33:07.769875 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eab41d8-a4c5-4b6b-8ea3-15b9b90298c6 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:07.772324 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eab41d8-a4c5-4b6b-8ea3-15b9b90298c6 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:07.883359 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2788/5533] 10.222.0.52 () {58 vars in 1355 bytes} [Sat May 14 21:33:07 2022] GET /identity/v3/role_assignments?scope.project.id=cd9a1471bb814b39bef2a604db5ac07c&user.id=755b4ba0a6554e459937a3c3eda09ad3&effective => generated 648 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:33:07.888742 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38860d57-9890-4638-92ee-f1dd2d6b1f41 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:07.938767 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38860d57-9890-4638-92ee-f1dd2d6b1f41 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:07.958812 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a0f254-d488-49c0-af7c-c1e8e318125a tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dccef27a56140498698b4161fdc9569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c389ec6b454405aad0012fe235deac5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:07.958812 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0f254-d488-49c0-af7c-c1e8e318125a tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:07.958812 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0f254-d488-49c0-af7c-c1e8e318125a tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:07.959125 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0f254-d488-49c0-af7c-c1e8e318125a tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:07.959125 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a0f254-d488-49c0-af7c-c1e8e318125a tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Adding query filter params (scope.project.id=1ce229525a91401da07dd5a83fe273b9, user.id=755b4ba0a6554e459937a3c3eda09ad3) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:33:07.959125 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a0f254-d488-49c0-af7c-c1e8e318125a tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:07.959125 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a0f254-d488-49c0-af7c-c1e8e318125a tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:08.059210 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2746/5534] 10.222.0.52 () {58 vars in 1355 bytes} [Sat May 14 21:33:07 2022] GET /identity/v3/role_assignments?scope.project.id=1ce229525a91401da07dd5a83fe273b9&user.id=755b4ba0a6554e459937a3c3eda09ad3&effective => generated 648 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:33:08.062976 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eab41d8-a4c5-4b6b-8ea3-15b9b90298c6 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:08.073841 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eab41d8-a4c5-4b6b-8ea3-15b9b90298c6 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:08.089660 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437fb239-3e97-4c48-b56e-4c8ab2de3cb2 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dccef27a56140498698b4161fdc9569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c389ec6b454405aad0012fe235deac5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:08.093292 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fb239-3e97-4c48-b56e-4c8ab2de3cb2 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:08.093292 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fb239-3e97-4c48-b56e-4c8ab2de3cb2 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:08.093292 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fb239-3e97-4c48-b56e-4c8ab2de3cb2 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/449aebffff714e5687e4270cd0a01fb2/users/755b4ba0a6554e459937a3c3eda09ad3/roles/a8410b7df46c4a8e8e910ad1edec4359/inherited_to_projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:08.096434 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437fb239-3e97-4c48-b56e-4c8ab2de3cb2 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=449aebffff714e5687e4270cd0a01fb2, user_id=755b4ba0a6554e459937a3c3eda09ad3, role_id=a8410b7df46c4a8e8e910ad1edec4359)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:08.101768 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437fb239-3e97-4c48-b56e-4c8ab2de3cb2 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:08.113403 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-437fb239-3e97-4c48-b56e-4c8ab2de3cb2 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Invalidating the token cache because role a8410b7df46c4a8e8e910ad1edec4359 was removed from user 755b4ba0a6554e459937a3c3eda09ad3 on domain 449aebffff714e5687e4270cd0a01fb2. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:33:08.114007 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-437fb239-3e97-4c48-b56e-4c8ab2de3cb2 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:08.116882 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-437fb239-3e97-4c48-b56e-4c8ab2de3cb2 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:08.252430 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2789/5535] 10.222.0.52 () {58 vars in 1562 bytes} [Sat May 14 21:33:08 2022] DELETE /identity/v3/OS-INHERIT/domains/449aebffff714e5687e4270cd0a01fb2/users/755b4ba0a6554e459937a3c3eda09ad3/roles/a8410b7df46c4a8e8e910ad1edec4359/inherited_to_projects => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:08.256843 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a0f254-d488-49c0-af7c-c1e8e318125a tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:08.258858 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-08a0f254-d488-49c0-af7c-c1e8e318125a tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:08.274595 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a0f254-d488-49c0-af7c-c1e8e318125a tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:08.373836 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f352c76-07d0-4ac8-a60c-e59a6b62833e tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dccef27a56140498698b4161fdc9569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c389ec6b454405aad0012fe235deac5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:08.374713 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f352c76-07d0-4ac8-a60c-e59a6b62833e tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:08.375006 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f352c76-07d0-4ac8-a60c-e59a6b62833e tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:08.375286 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f352c76-07d0-4ac8-a60c-e59a6b62833e tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:08.376392 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f352c76-07d0-4ac8-a60c-e59a6b62833e tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Adding query filter params (scope.project.id=cd9a1471bb814b39bef2a604db5ac07c, user.id=755b4ba0a6554e459937a3c3eda09ad3) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:33:08.376961 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f352c76-07d0-4ac8-a60c-e59a6b62833e tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:08.379669 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f352c76-07d0-4ac8-a60c-e59a6b62833e tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:08.445470 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2747/5536] 10.222.0.52 () {58 vars in 1355 bytes} [Sat May 14 21:33:08 2022] GET /identity/v3/role_assignments?scope.project.id=cd9a1471bb814b39bef2a604db5ac07c&user.id=755b4ba0a6554e459937a3c3eda09ad3&effective => generated 228 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:33:08.449590 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437fb239-3e97-4c48-b56e-4c8ab2de3cb2 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:08.464026 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437fb239-3e97-4c48-b56e-4c8ab2de3cb2 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:08.477682 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd43a453-c38a-4810-88da-62f9ddec1e3d tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dccef27a56140498698b4161fdc9569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c389ec6b454405aad0012fe235deac5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:08.480129 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43a453-c38a-4810-88da-62f9ddec1e3d tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:08.480129 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43a453-c38a-4810-88da-62f9ddec1e3d tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:08.480129 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43a453-c38a-4810-88da-62f9ddec1e3d tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:08.480129 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd43a453-c38a-4810-88da-62f9ddec1e3d tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Adding query filter params (scope.project.id=1ce229525a91401da07dd5a83fe273b9, user.id=755b4ba0a6554e459937a3c3eda09ad3) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:33:08.480476 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd43a453-c38a-4810-88da-62f9ddec1e3d tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:08.482437 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd43a453-c38a-4810-88da-62f9ddec1e3d tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:08.555314 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2790/5537] 10.222.0.52 () {58 vars in 1355 bytes} [Sat May 14 21:33:08 2022] GET /identity/v3/role_assignments?scope.project.id=1ce229525a91401da07dd5a83fe273b9&user.id=755b4ba0a6554e459937a3c3eda09ad3&effective => generated 228 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:33:08.560190 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f352c76-07d0-4ac8-a60c-e59a6b62833e tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:08.570739 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f352c76-07d0-4ac8-a60c-e59a6b62833e tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:08.576006 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938351d7-0c23-4b7c-b703-4102b75e26db tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dccef27a56140498698b4161fdc9569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c389ec6b454405aad0012fe235deac5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:08.577028 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938351d7-0c23-4b7c-b703-4102b75e26db tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:08.577459 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938351d7-0c23-4b7c-b703-4102b75e26db tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:08.577743 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938351d7-0c23-4b7c-b703-4102b75e26db tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] PATH_INFO: `/v3/projects/1ce229525a91401da07dd5a83fe273b9` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:08.579680 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938351d7-0c23-4b7c-b703-4102b75e26db tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1ce229525a91401da07dd5a83fe273b9)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:08.581678 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938351d7-0c23-4b7c-b703-4102b75e26db tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:08.656560 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd43a453-c38a-4810-88da-62f9ddec1e3d tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:08.658947 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-cd43a453-c38a-4810-88da-62f9ddec1e3d tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:08.753519 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-938351d7-0c23-4b7c-b703-4102b75e26db tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ce229525a91401da07dd5a83fe273b9', 'request_id': 'req-938351d7-0c23-4b7c-b703-4102b75e26db'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:08.763438 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-938351d7-0c23-4b7c-b703-4102b75e26db tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ce229525a91401da07dd5a83fe273b9', 'request_id': 'req-938351d7-0c23-4b7c-b703-4102b75e26db'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:08.765865 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd43a453-c38a-4810-88da-62f9ddec1e3d tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:08.773543 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-938351d7-0c23-4b7c-b703-4102b75e26db tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ce229525a91401da07dd5a83fe273b9', 'request_id': 'req-938351d7-0c23-4b7c-b703-4102b75e26db'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:08.845616 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a01abb5-d3c3-4559-9270-1825e747385f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:08.846693 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01abb5-d3c3-4559-9270-1825e747385f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:08.847080 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01abb5-d3c3-4559-9270-1825e747385f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:08.847650 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01abb5-d3c3-4559-9270-1825e747385f admin admin] PATH_INFO: `/v3/users/5586a3a946a0490498c42cb71f39ce1e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:08.850900 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a01abb5-d3c3-4559-9270-1825e747385f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5586a3a946a0490498c42cb71f39ce1e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:08.857656 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a01abb5-d3c3-4559-9270-1825e747385f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:08.892573 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-938351d7-0c23-4b7c-b703-4102b75e26db tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] The token cache is being invalidate because project 1ce229525a91401da07dd5a83fe273b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:33:08.893109 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-938351d7-0c23-4b7c-b703-4102b75e26db tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:08.893958 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-938351d7-0c23-4b7c-b703-4102b75e26db tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:08.901921 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2748/5538] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:33:08 2022] DELETE /identity/v3/projects/1ce229525a91401da07dd5a83fe273b9 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:08.902829 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938351d7-0c23-4b7c-b703-4102b75e26db tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:08.920399 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-938351d7-0c23-4b7c-b703-4102b75e26db tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:09.018302 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938351d7-0c23-4b7c-b703-4102b75e26db tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:09.023558 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1895e1e5-2261-4e22-abdd-7806076a31af tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dccef27a56140498698b4161fdc9569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c389ec6b454405aad0012fe235deac5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:09.024433 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895e1e5-2261-4e22-abdd-7806076a31af tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:09.025100 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895e1e5-2261-4e22-abdd-7806076a31af tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:09.025623 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895e1e5-2261-4e22-abdd-7806076a31af tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] PATH_INFO: `/v3/roles/a8410b7df46c4a8e8e910ad1edec4359` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:09.027316 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1895e1e5-2261-4e22-abdd-7806076a31af tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorizing `identity:delete_role(role_id=a8410b7df46c4a8e8e910ad1edec4359)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:09.028993 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1895e1e5-2261-4e22-abdd-7806076a31af tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:09.076834 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0a01abb5-d3c3-4559-9270-1825e747385f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5586a3a946a0490498c42cb71f39ce1e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:09.090468 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0a01abb5-d3c3-4559-9270-1825e747385f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5586a3a946a0490498c42cb71f39ce1e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:09.097368 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0a01abb5-d3c3-4559-9270-1825e747385f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5586a3a946a0490498c42cb71f39ce1e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:09.177502 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0a01abb5-d3c3-4559-9270-1825e747385f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5586a3a946a0490498c42cb71f39ce1e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:09.178632 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0a01abb5-d3c3-4559-9270-1825e747385f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5586a3a946a0490498c42cb71f39ce1e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:09.181994 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-1895e1e5-2261-4e22-abdd-7806076a31af tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Invalidating the token cache because role a8410b7df46c4a8e8e910ad1edec4359 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:33:09.182549 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-1895e1e5-2261-4e22-abdd-7806076a31af tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:09.183423 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-1895e1e5-2261-4e22-abdd-7806076a31af tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:09.193408 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2791/5540] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:33:08 2022] DELETE /identity/v3/users/5586a3a946a0490498c42cb71f39ce1e => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:33:09.194349 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2749/5540] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:33:08 2022] DELETE /identity/v3/roles/a8410b7df46c4a8e8e910ad1edec4359 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:09.195248 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a01abb5-d3c3-4559-9270-1825e747385f admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:09.196848 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-0a01abb5-d3c3-4559-9270-1825e747385f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:09.285142 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a01abb5-d3c3-4559-9270-1825e747385f admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:09.293037 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3c7e3e-0f06-4a25-9feb-87258b9ea9bf tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dccef27a56140498698b4161fdc9569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c389ec6b454405aad0012fe235deac5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:09.294111 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3c7e3e-0f06-4a25-9feb-87258b9ea9bf tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:09.294558 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3c7e3e-0f06-4a25-9feb-87258b9ea9bf tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:09.295003 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3c7e3e-0f06-4a25-9feb-87258b9ea9bf tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:09.296020 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3c7e3e-0f06-4a25-9feb-87258b9ea9bf tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:09.298028 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3c7e3e-0f06-4a25-9feb-87258b9ea9bf tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:09.378830 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2792/5541] 10.222.0.52 () {60 vars in 1142 bytes} [Sat May 14 21:33:09 2022] POST /identity/v3/roles => generated 239 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:33:09.381056 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1895e1e5-2261-4e22-abdd-7806076a31af tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:09.382798 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-1895e1e5-2261-4e22-abdd-7806076a31af tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:09.468383 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1895e1e5-2261-4e22-abdd-7806076a31af tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:09.474673 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2cc358-642a-40bd-ab43-640c6e19a559 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dccef27a56140498698b4161fdc9569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c389ec6b454405aad0012fe235deac5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:09.475415 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2cc358-642a-40bd-ab43-640c6e19a559 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:09.475730 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2cc358-642a-40bd-ab43-640c6e19a559 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:09.476006 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2cc358-642a-40bd-ab43-640c6e19a559 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:09.477287 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2cc358-642a-40bd-ab43-640c6e19a559 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:09.479972 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2cc358-642a-40bd-ab43-640c6e19a559 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:09.605736 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2750/5542] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:33:09 2022] POST /identity/v3/projects => generated 409 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:33:09.610349 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3c7e3e-0f06-4a25-9feb-87258b9ea9bf tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:09.615609 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2cc358-642a-40bd-ab43-640c6e19a559 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:09.617795 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-6b2cc358-642a-40bd-ab43-640c6e19a559 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:09.624493 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3c7e3e-0f06-4a25-9feb-87258b9ea9bf tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:09.761828 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303b5130-cdb6-48ea-b94d-d055652af30e tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dccef27a56140498698b4161fdc9569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c389ec6b454405aad0012fe235deac5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:09.762698 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b5130-cdb6-48ea-b94d-d055652af30e tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:09.764049 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b5130-cdb6-48ea-b94d-d055652af30e tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:09.764346 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b5130-cdb6-48ea-b94d-d055652af30e tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/cd9a1471bb814b39bef2a604db5ac07c/users/755b4ba0a6554e459937a3c3eda09ad3/roles/3828db65642f4a52861d6fe0b17cef38/inherited_to_projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:09.774490 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303b5130-cdb6-48ea-b94d-d055652af30e tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorizing `identity:create_grant(project_id=cd9a1471bb814b39bef2a604db5ac07c, user_id=755b4ba0a6554e459937a3c3eda09ad3, role_id=3828db65642f4a52861d6fe0b17cef38)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:09.779578 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303b5130-cdb6-48ea-b94d-d055652af30e tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:09.788280 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2cc358-642a-40bd-ab43-640c6e19a559 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:09.795464 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252647d2-df6c-4f7a-937b-d458f8b95b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:09.796538 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252647d2-df6c-4f7a-937b-d458f8b95b2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:09.796827 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252647d2-df6c-4f7a-937b-d458f8b95b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:09.797100 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252647d2-df6c-4f7a-937b-d458f8b95b2f admin admin] PATH_INFO: `/v3/projects/6641b342c1d440aea451919f391bc5db` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:09.798379 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252647d2-df6c-4f7a-937b-d458f8b95b2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6641b342c1d440aea451919f391bc5db)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:09.800445 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252647d2-df6c-4f7a-937b-d458f8b95b2f admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:09.866125 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2793/5543] 10.222.0.52 () {60 vars in 1581 bytes} [Sat May 14 21:33:09 2022] PUT /identity/v3/OS-INHERIT/projects/cd9a1471bb814b39bef2a604db5ac07c/users/755b4ba0a6554e459937a3c3eda09ad3/roles/3828db65642f4a52861d6fe0b17cef38/inherited_to_projects => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:09.872037 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303b5130-cdb6-48ea-b94d-d055652af30e tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:09.981635 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-252647d2-df6c-4f7a-937b-d458f8b95b2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6641b342c1d440aea451919f391bc5db', 'request_id': 'req-252647d2-df6c-4f7a-937b-d458f8b95b2f'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:09.998911 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-252647d2-df6c-4f7a-937b-d458f8b95b2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6641b342c1d440aea451919f391bc5db', 'request_id': 'req-252647d2-df6c-4f7a-937b-d458f8b95b2f'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:10.011721 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-252647d2-df6c-4f7a-937b-d458f8b95b2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6641b342c1d440aea451919f391bc5db', 'request_id': 'req-252647d2-df6c-4f7a-937b-d458f8b95b2f'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:10.021993 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303b5130-cdb6-48ea-b94d-d055652af30e tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:10.102898 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b1b2d0-5487-4259-b58e-d9a763e889f4 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dccef27a56140498698b4161fdc9569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c389ec6b454405aad0012fe235deac5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:10.102898 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b1b2d0-5487-4259-b58e-d9a763e889f4 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:10.102898 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b1b2d0-5487-4259-b58e-d9a763e889f4 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:10.103279 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b1b2d0-5487-4259-b58e-d9a763e889f4 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:10.103279 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b1b2d0-5487-4259-b58e-d9a763e889f4 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Adding query filter params (scope.project.id=df65700ff02940fcad2414851ee06da3, user.id=755b4ba0a6554e459937a3c3eda09ad3) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:33:10.103279 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b1b2d0-5487-4259-b58e-d9a763e889f4 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:10.103279 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b1b2d0-5487-4259-b58e-d9a763e889f4 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:10.143399 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-252647d2-df6c-4f7a-937b-d458f8b95b2f admin admin] The token cache is being invalidate because project 6641b342c1d440aea451919f391bc5db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:33:10.143399 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-252647d2-df6c-4f7a-937b-d458f8b95b2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:10.144156 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-252647d2-df6c-4f7a-937b-d458f8b95b2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:10.152672 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2751/5544] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:33:09 2022] DELETE /identity/v3/projects/6641b342c1d440aea451919f391bc5db => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:10.154241 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dada5b-f3d6-4577-bee4-e7642a0b03e6 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:10.154532 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dada5b-f3d6-4577-bee4-e7642a0b03e6 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:10.154814 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dada5b-f3d6-4577-bee4-e7642a0b03e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:10.198562 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-f1dada5b-f3d6-4577-bee4-e7642a0b03e6 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:33:10.201280 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-f1dada5b-f3d6-4577-bee4-e7642a0b03e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:10.211465 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2794/5545] 10.222.0.52 () {58 vars in 1355 bytes} [Sat May 14 21:33:09 2022] GET /identity/v3/role_assignments?scope.project.id=df65700ff02940fcad2414851ee06da3&user.id=755b4ba0a6554e459937a3c3eda09ad3&effective => generated 649 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:33:10.214902 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b1b2d0-5487-4259-b58e-d9a763e889f4 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:10.221408 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-08b1b2d0-5487-4259-b58e-d9a763e889f4 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:10.242004 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b1b2d0-5487-4259-b58e-d9a763e889f4 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:10.253985 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd0c12d-4d33-48c6-864c-dd9be3acdc71 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dccef27a56140498698b4161fdc9569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c389ec6b454405aad0012fe235deac5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:10.256870 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0c12d-4d33-48c6-864c-dd9be3acdc71 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:10.257246 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0c12d-4d33-48c6-864c-dd9be3acdc71 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:10.257606 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0c12d-4d33-48c6-864c-dd9be3acdc71 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/cd9a1471bb814b39bef2a604db5ac07c/users/755b4ba0a6554e459937a3c3eda09ad3/roles/3828db65642f4a52861d6fe0b17cef38/inherited_to_projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:10.261927 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd0c12d-4d33-48c6-864c-dd9be3acdc71 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=cd9a1471bb814b39bef2a604db5ac07c, user_id=755b4ba0a6554e459937a3c3eda09ad3, role_id=3828db65642f4a52861d6fe0b17cef38)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:10.285175 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd0c12d-4d33-48c6-864c-dd9be3acdc71 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:10.299192 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-cdd0c12d-4d33-48c6-864c-dd9be3acdc71 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Invalidating the token cache because role 3828db65642f4a52861d6fe0b17cef38 was removed from user 755b4ba0a6554e459937a3c3eda09ad3 on project cd9a1471bb814b39bef2a604db5ac07c. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:33:10.300476 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-cdd0c12d-4d33-48c6-864c-dd9be3acdc71 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:10.303561 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-cdd0c12d-4d33-48c6-864c-dd9be3acdc71 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:10.353552 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2752/5546] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:33:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:33:10.366596 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3cf83-7353-42f0-a6ce-9b1be716b61d None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:10.367173 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3cf83-7353-42f0-a6ce-9b1be716b61d None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:10.367680 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3cf83-7353-42f0-a6ce-9b1be716b61d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:10.409765 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-11c3cf83-7353-42f0-a6ce-9b1be716b61d None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:33:10.411359 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-11c3cf83-7353-42f0-a6ce-9b1be716b61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:10.425540 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2753/5547] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:33:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:33:10.426873 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c3cf83-7353-42f0-a6ce-9b1be716b61d None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:10.439572 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c3cf83-7353-42f0-a6ce-9b1be716b61d None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:10.444565 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef53d208-86c0-4b84-a2f6-76202f05d517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:10.445095 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef53d208-86c0-4b84-a2f6-76202f05d517 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:10.445476 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef53d208-86c0-4b84-a2f6-76202f05d517 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:10.446247 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef53d208-86c0-4b84-a2f6-76202f05d517 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:10.447794 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef53d208-86c0-4b84-a2f6-76202f05d517 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:33:10.448178 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef53d208-86c0-4b84-a2f6-76202f05d517 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:10.449989 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef53d208-86c0-4b84-a2f6-76202f05d517 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:10.463992 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2754/5548] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:33:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:33:10.468383 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2795/5549] 10.222.0.52 () {58 vars in 1565 bytes} [Sat May 14 21:33:10 2022] DELETE /identity/v3/OS-INHERIT/projects/cd9a1471bb814b39bef2a604db5ac07c/users/755b4ba0a6554e459937a3c3eda09ad3/roles/3828db65642f4a52861d6fe0b17cef38/inherited_to_projects => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:10.471497 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef53d208-86c0-4b84-a2f6-76202f05d517 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:10.472714 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd0c12d-4d33-48c6-864c-dd9be3acdc71 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:10.476408 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-cdd0c12d-4d33-48c6-864c-dd9be3acdc71 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:10.488569 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef53d208-86c0-4b84-a2f6-76202f05d517 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:10.602060 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f679cd-fb3a-40c7-ab2e-d84b8ef3290d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:10.604251 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f679cd-fb3a-40c7-ab2e-d84b8ef3290d admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:10.604806 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f679cd-fb3a-40c7-ab2e-d84b8ef3290d admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:10.605304 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f679cd-fb3a-40c7-ab2e-d84b8ef3290d admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:10.607005 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f679cd-fb3a-40c7-ab2e-d84b8ef3290d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:10.612196 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f679cd-fb3a-40c7-ab2e-d84b8ef3290d admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:10.627718 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd0c12d-4d33-48c6-864c-dd9be3acdc71 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:10.633794 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04a0fa6-557e-445a-8d6f-4413cb1bf0a0 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dccef27a56140498698b4161fdc9569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c389ec6b454405aad0012fe235deac5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:10.635091 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a0fa6-557e-445a-8d6f-4413cb1bf0a0 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:10.635457 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a0fa6-557e-445a-8d6f-4413cb1bf0a0 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:10.635834 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a0fa6-557e-445a-8d6f-4413cb1bf0a0 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:10.637031 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04a0fa6-557e-445a-8d6f-4413cb1bf0a0 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Adding query filter params (scope.project.id=df65700ff02940fcad2414851ee06da3, user.id=755b4ba0a6554e459937a3c3eda09ad3) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:33:10.637432 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04a0fa6-557e-445a-8d6f-4413cb1bf0a0 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:10.642174 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04a0fa6-557e-445a-8d6f-4413cb1bf0a0 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:10.715234 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2796/5550] 10.222.0.52 () {58 vars in 1355 bytes} [Sat May 14 21:33:10 2022] GET /identity/v3/role_assignments?scope.project.id=df65700ff02940fcad2414851ee06da3&user.id=755b4ba0a6554e459937a3c3eda09ad3&effective => generated 228 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:33:10.721958 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04a0fa6-557e-445a-8d6f-4413cb1bf0a0 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:10.734437 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2755/5551] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:33:10 2022] POST /identity/v3/projects => generated 373 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:33:10.735241 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f679cd-fb3a-40c7-ab2e-d84b8ef3290d admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:10.736351 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04a0fa6-557e-445a-8d6f-4413cb1bf0a0 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:10.835529 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec42fa0-7c27-4359-a5a5-78a0d721f68d tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dccef27a56140498698b4161fdc9569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c389ec6b454405aad0012fe235deac5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:10.872494 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec42fa0-7c27-4359-a5a5-78a0d721f68d tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:10.872494 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec42fa0-7c27-4359-a5a5-78a0d721f68d tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:10.872494 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec42fa0-7c27-4359-a5a5-78a0d721f68d tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] PATH_INFO: `/v3/projects/df65700ff02940fcad2414851ee06da3` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:10.872494 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec42fa0-7c27-4359-a5a5-78a0d721f68d tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorizing `identity:delete_project(project_id=df65700ff02940fcad2414851ee06da3)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:10.873541 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec42fa0-7c27-4359-a5a5-78a0d721f68d tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:10.898062 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f679cd-fb3a-40c7-ab2e-d84b8ef3290d admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:10.911319 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322bf0c3-2956-45a8-a8b0-1f022b76806e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:10.912293 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322bf0c3-2956-45a8-a8b0-1f022b76806e admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:10.913473 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322bf0c3-2956-45a8-a8b0-1f022b76806e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:10.913861 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322bf0c3-2956-45a8-a8b0-1f022b76806e admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:10.929977 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322bf0c3-2956-45a8-a8b0-1f022b76806e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:10.937226 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322bf0c3-2956-45a8-a8b0-1f022b76806e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:11.078447 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2756/5552] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:33:10 2022] POST /identity/v3/users => generated 287 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:33:11.083072 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322bf0c3-2956-45a8-a8b0-1f022b76806e admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:11.099559 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322bf0c3-2956-45a8-a8b0-1f022b76806e admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:11.128064 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3ec42fa0-7c27-4359-a5a5-78a0d721f68d tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df65700ff02940fcad2414851ee06da3', 'request_id': 'req-3ec42fa0-7c27-4359-a5a5-78a0d721f68d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:11.150732 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3ec42fa0-7c27-4359-a5a5-78a0d721f68d tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df65700ff02940fcad2414851ee06da3', 'request_id': 'req-3ec42fa0-7c27-4359-a5a5-78a0d721f68d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:11.252606 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3daa14-1886-425c-9eeb-20de2061eeea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:11.254004 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3daa14-1886-425c-9eeb-20de2061eeea admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:11.254004 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3daa14-1886-425c-9eeb-20de2061eeea admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:11.254209 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3daa14-1886-425c-9eeb-20de2061eeea admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:11.254821 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3daa14-1886-425c-9eeb-20de2061eeea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:11.257063 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3daa14-1886-425c-9eeb-20de2061eeea admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:11.278498 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2757/5553] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:33:11 2022] GET /identity/v3/roles => generated 1650 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:33:11.284728 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3ec42fa0-7c27-4359-a5a5-78a0d721f68d tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df65700ff02940fcad2414851ee06da3', 'request_id': 'req-3ec42fa0-7c27-4359-a5a5-78a0d721f68d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:11.294605 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3daa14-1886-425c-9eeb-20de2061eeea admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:11.337910 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3ec42fa0-7c27-4359-a5a5-78a0d721f68d tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] The token cache is being invalidate because project df65700ff02940fcad2414851ee06da3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:33:11.340215 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3daa14-1886-425c-9eeb-20de2061eeea admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:11.341593 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3ec42fa0-7c27-4359-a5a5-78a0d721f68d tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:11.345776 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3ec42fa0-7c27-4359-a5a5-78a0d721f68d tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:11.347136 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f0dc2-3e01-415b-af13-a29d0591a447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:11.348081 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f0dc2-3e01-415b-af13-a29d0591a447 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:11.348731 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f0dc2-3e01-415b-af13-a29d0591a447 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:11.349344 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f0dc2-3e01-415b-af13-a29d0591a447 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:11.350629 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172f0dc2-3e01-415b-af13-a29d0591a447 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:11.351824 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2797/5554] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:33:10 2022] DELETE /identity/v3/projects/df65700ff02940fcad2414851ee06da3 => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:11.353938 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172f0dc2-3e01-415b-af13-a29d0591a447 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:11.356471 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec42fa0-7c27-4359-a5a5-78a0d721f68d tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:11.360955 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-3ec42fa0-7c27-4359-a5a5-78a0d721f68d tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:11.369587 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2758/5555] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:33:11 2022] GET /identity/v3/roles => generated 1650 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:33:11.377865 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f0dc2-3e01-415b-af13-a29d0591a447 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:11.381623 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-172f0dc2-3e01-415b-af13-a29d0591a447 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:11.410112 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f0dc2-3e01-415b-af13-a29d0591a447 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:11.420601 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa27b44d-0d41-4e03-a865-57e683300e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:11.422147 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa27b44d-0d41-4e03-a865-57e683300e78 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:11.422288 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa27b44d-0d41-4e03-a865-57e683300e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:11.422735 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa27b44d-0d41-4e03-a865-57e683300e78 admin admin] PATH_INFO: `/v3/projects/1e47a259ad71441e8aa863bfef62ff84/users/5025051634604827b245491e9d9907bf/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:11.444595 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa27b44d-0d41-4e03-a865-57e683300e78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e47a259ad71441e8aa863bfef62ff84, user_id=5025051634604827b245491e9d9907bf, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:11.452394 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa27b44d-0d41-4e03-a865-57e683300e78 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:11.499909 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec42fa0-7c27-4359-a5a5-78a0d721f68d tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:11.510281 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e67f8-9bab-4a90-9f9b-26044af2e65b tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dccef27a56140498698b4161fdc9569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c389ec6b454405aad0012fe235deac5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:11.512057 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e67f8-9bab-4a90-9f9b-26044af2e65b tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:11.515576 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e67f8-9bab-4a90-9f9b-26044af2e65b tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:11.515576 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e67f8-9bab-4a90-9f9b-26044af2e65b tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] PATH_INFO: `/v3/roles/3828db65642f4a52861d6fe0b17cef38` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:11.515576 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759e67f8-9bab-4a90-9f9b-26044af2e65b tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorizing `identity:delete_role(role_id=3828db65642f4a52861d6fe0b17cef38)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:11.516958 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759e67f8-9bab-4a90-9f9b-26044af2e65b tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:11.548343 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2759/5556] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:33:11 2022] PUT /identity/v3/projects/1e47a259ad71441e8aa863bfef62ff84/users/5025051634604827b245491e9d9907bf/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:11.559094 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a12dca-4d89-4011-929e-0f39b57ba4d8 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:11.559386 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a12dca-4d89-4011-929e-0f39b57ba4d8 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:11.559688 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a12dca-4d89-4011-929e-0f39b57ba4d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:11.592475 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-f4a12dca-4d89-4011-929e-0f39b57ba4d8 None None] MFA Rules not processed for user `5025051634604827b245491e9d9907bf`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:33:11.593877 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-f4a12dca-4d89-4011-929e-0f39b57ba4d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:11.707651 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2760/5557] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:33:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:33:11.716904 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-759e67f8-9bab-4a90-9f9b-26044af2e65b tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Invalidating the token cache because role 3828db65642f4a52861d6fe0b17cef38 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:33:11.717371 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-759e67f8-9bab-4a90-9f9b-26044af2e65b tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:11.718156 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-759e67f8-9bab-4a90-9f9b-26044af2e65b tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:11.720368 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a12dca-4d89-4011-929e-0f39b57ba4d8 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:11.726243 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2798/5558] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:33:11 2022] DELETE /identity/v3/roles/3828db65642f4a52861d6fe0b17cef38 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:11.736374 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e67f8-9bab-4a90-9f9b-26044af2e65b tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:11.738210 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-759e67f8-9bab-4a90-9f9b-26044af2e65b tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:11.856567 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a12dca-4d89-4011-929e-0f39b57ba4d8 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:11.886775 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e67f8-9bab-4a90-9f9b-26044af2e65b tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:11.899243 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba01f1-c7c8-4612-a0d8-f55f6a1087f7 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dccef27a56140498698b4161fdc9569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c389ec6b454405aad0012fe235deac5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:11.900478 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba01f1-c7c8-4612-a0d8-f55f6a1087f7 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:11.902226 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba01f1-c7c8-4612-a0d8-f55f6a1087f7 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:11.902530 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba01f1-c7c8-4612-a0d8-f55f6a1087f7 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] PATH_INFO: `/v3/users/755b4ba0a6554e459937a3c3eda09ad3` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:11.904800 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcba01f1-c7c8-4612-a0d8-f55f6a1087f7 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorizing `identity:delete_user(user_id=755b4ba0a6554e459937a3c3eda09ad3)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:11.906779 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcba01f1-c7c8-4612-a0d8-f55f6a1087f7 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:11.996898 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ee9edf-3d63-4f73-ad51-df0deba53340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:12.001180 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee9edf-3d63-4f73-ad51-df0deba53340 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:12.001180 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee9edf-3d63-4f73-ad51-df0deba53340 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:12.001180 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee9edf-3d63-4f73-ad51-df0deba53340 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:12.001180 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ee9edf-3d63-4f73-ad51-df0deba53340 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:12.001180 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ee9edf-3d63-4f73-ad51-df0deba53340 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:12.087178 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-dcba01f1-c7c8-4612-a0d8-f55f6a1087f7 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '755b4ba0a6554e459937a3c3eda09ad3'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:12.112277 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-dcba01f1-c7c8-4612-a0d8-f55f6a1087f7 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '755b4ba0a6554e459937a3c3eda09ad3'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:12.135837 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2761/5559] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:33:11 2022] POST /identity/v3/projects => generated 373 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:33:12.137601 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ee9edf-3d63-4f73-ad51-df0deba53340 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:12.163948 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-f2ee9edf-3d63-4f73-ad51-df0deba53340 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:12.164164 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-dcba01f1-c7c8-4612-a0d8-f55f6a1087f7 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '755b4ba0a6554e459937a3c3eda09ad3'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:12.250673 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-dcba01f1-c7c8-4612-a0d8-f55f6a1087f7 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '755b4ba0a6554e459937a3c3eda09ad3'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:12.251565 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-dcba01f1-c7c8-4612-a0d8-f55f6a1087f7 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '755b4ba0a6554e459937a3c3eda09ad3'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:12.260531 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2799/5560] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:33:11 2022] DELETE /identity/v3/users/755b4ba0a6554e459937a3c3eda09ad3 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:12.264485 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba01f1-c7c8-4612-a0d8-f55f6a1087f7 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:12.275582 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-dcba01f1-c7c8-4612-a0d8-f55f6a1087f7 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:12.287763 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ee9edf-3d63-4f73-ad51-df0deba53340 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:12.481623 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba01f1-c7c8-4612-a0d8-f55f6a1087f7 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:12.496245 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94735ba6-53df-4974-9841-e4dff17d8326 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dccef27a56140498698b4161fdc9569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c389ec6b454405aad0012fe235deac5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:12.500502 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94735ba6-53df-4974-9841-e4dff17d8326 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:12.501741 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94735ba6-53df-4974-9841-e4dff17d8326 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:12.504493 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50f38fa-5352-4d78-9379-5513ec49469f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:12.504781 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94735ba6-53df-4974-9841-e4dff17d8326 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] PATH_INFO: `/v3/groups/8990544af252475f881b07ca08bca5f8` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:12.506724 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f38fa-5352-4d78-9379-5513ec49469f admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:12.507606 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94735ba6-53df-4974-9841-e4dff17d8326 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorizing `identity:delete_group(group_id=8990544af252475f881b07ca08bca5f8)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:12.507778 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f38fa-5352-4d78-9379-5513ec49469f admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:12.508508 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f38fa-5352-4d78-9379-5513ec49469f admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:12.510447 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50f38fa-5352-4d78-9379-5513ec49469f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:12.533264 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50f38fa-5352-4d78-9379-5513ec49469f admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:12.533555 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94735ba6-53df-4974-9841-e4dff17d8326 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:12.625936 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2762/5561] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:33:12 2022] POST /identity/v3/users => generated 293 bytes in 489 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:33:12.631985 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50f38fa-5352-4d78-9379-5513ec49469f admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:12.636579 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e50f38fa-5352-4d78-9379-5513ec49469f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:12.668427 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50f38fa-5352-4d78-9379-5513ec49469f admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:12.675649 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a82634-9621-4ec6-b397-5079d82b5a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:12.677359 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a82634-9621-4ec6-b397-5079d82b5a51 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:12.677910 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a82634-9621-4ec6-b397-5079d82b5a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:12.678475 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a82634-9621-4ec6-b397-5079d82b5a51 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:12.679567 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a82634-9621-4ec6-b397-5079d82b5a51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:12.683415 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a82634-9621-4ec6-b397-5079d82b5a51 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:12.700699 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2763/5562] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:33:12 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:33:12.705204 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a82634-9621-4ec6-b397-5079d82b5a51 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:12.715542 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2800/5563] 10.222.0.52 () {58 vars in 1226 bytes} [Sat May 14 21:33:12 2022] DELETE /identity/v3/groups/8990544af252475f881b07ca08bca5f8 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:12.716584 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94735ba6-53df-4974-9841-e4dff17d8326 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:12.734326 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a82634-9621-4ec6-b397-5079d82b5a51 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:12.873632 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94735ba6-53df-4974-9841-e4dff17d8326 tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:12.877856 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e98b571-6b9f-41e1-976b-5c69e6444366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:12.878805 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e98b571-6b9f-41e1-976b-5c69e6444366 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:12.879063 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e98b571-6b9f-41e1-976b-5c69e6444366 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:12.879343 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e98b571-6b9f-41e1-976b-5c69e6444366 admin admin] PATH_INFO: `/v3/projects/b971c2d1ade9426c9f9ffbbc92f71b3e/users/c21f9f8f9d704d429163628ad156f69e/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:12.903260 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e7d7ad-1d9a-4f63-8159-91d37dfa396e tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dccef27a56140498698b4161fdc9569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c389ec6b454405aad0012fe235deac5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:12.905280 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e7d7ad-1d9a-4f63-8159-91d37dfa396e tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:12.905280 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e7d7ad-1d9a-4f63-8159-91d37dfa396e tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:12.905487 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e7d7ad-1d9a-4f63-8159-91d37dfa396e tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] PATH_INFO: `/v3/projects/cd9a1471bb814b39bef2a604db5ac07c` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:12.906843 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e7d7ad-1d9a-4f63-8159-91d37dfa396e tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorizing `identity:delete_project(project_id=cd9a1471bb814b39bef2a604db5ac07c)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:12.909098 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e7d7ad-1d9a-4f63-8159-91d37dfa396e tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:12.910346 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e98b571-6b9f-41e1-976b-5c69e6444366 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b971c2d1ade9426c9f9ffbbc92f71b3e, user_id=c21f9f8f9d704d429163628ad156f69e, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:12.914990 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e98b571-6b9f-41e1-976b-5c69e6444366 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:13.056709 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2764/5564] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:33:12 2022] PUT /identity/v3/projects/b971c2d1ade9426c9f9ffbbc92f71b3e/users/c21f9f8f9d704d429163628ad156f69e/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:13.059792 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e98b571-6b9f-41e1-976b-5c69e6444366 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:13.123217 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-64e7d7ad-1d9a-4f63-8159-91d37dfa396e tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd9a1471bb814b39bef2a604db5ac07c', 'request_id': 'req-64e7d7ad-1d9a-4f63-8159-91d37dfa396e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:13.148883 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-64e7d7ad-1d9a-4f63-8159-91d37dfa396e tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd9a1471bb814b39bef2a604db5ac07c', 'request_id': 'req-64e7d7ad-1d9a-4f63-8159-91d37dfa396e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:13.163635 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e98b571-6b9f-41e1-976b-5c69e6444366 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:13.253419 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75639cd-159a-4d39-8318-a5bd3776673a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:13.254118 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75639cd-159a-4d39-8318-a5bd3776673a admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:13.255632 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75639cd-159a-4d39-8318-a5bd3776673a admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:13.255632 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75639cd-159a-4d39-8318-a5bd3776673a admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:13.255632 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75639cd-159a-4d39-8318-a5bd3776673a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:13.259240 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75639cd-159a-4d39-8318-a5bd3776673a admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:13.272202 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-64e7d7ad-1d9a-4f63-8159-91d37dfa396e tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd9a1471bb814b39bef2a604db5ac07c', 'request_id': 'req-64e7d7ad-1d9a-4f63-8159-91d37dfa396e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:13.272658 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2765/5565] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:33:13 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:33:13.276410 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75639cd-159a-4d39-8318-a5bd3776673a admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:13.292366 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75639cd-159a-4d39-8318-a5bd3776673a admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:13.297344 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9941237d-62ca-4440-a9a7-2ac9fcd51145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:13.299694 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-64e7d7ad-1d9a-4f63-8159-91d37dfa396e tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] The token cache is being invalidate because project cd9a1471bb814b39bef2a604db5ac07c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:33:13.299936 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941237d-62ca-4440-a9a7-2ac9fcd51145 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:13.300141 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-64e7d7ad-1d9a-4f63-8159-91d37dfa396e tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:13.300751 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941237d-62ca-4440-a9a7-2ac9fcd51145 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:13.301243 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941237d-62ca-4440-a9a7-2ac9fcd51145 admin admin] PATH_INFO: `/v3/projects/b971c2d1ade9426c9f9ffbbc92f71b3e/users/c21f9f8f9d704d429163628ad156f69e/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:13.302187 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-64e7d7ad-1d9a-4f63-8159-91d37dfa396e tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:13.304687 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2801/5566] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:33:12 2022] DELETE /identity/v3/projects/cd9a1471bb814b39bef2a604db5ac07c => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:13.307597 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9941237d-62ca-4440-a9a7-2ac9fcd51145 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b971c2d1ade9426c9f9ffbbc92f71b3e, user_id=c21f9f8f9d704d429163628ad156f69e, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:13.308794 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e7d7ad-1d9a-4f63-8159-91d37dfa396e tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:13.310415 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-64e7d7ad-1d9a-4f63-8159-91d37dfa396e tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:13.311975 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9941237d-62ca-4440-a9a7-2ac9fcd51145 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:13.346065 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2766/5567] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:33:13 2022] PUT /identity/v3/projects/b971c2d1ade9426c9f9ffbbc92f71b3e/users/c21f9f8f9d704d429163628ad156f69e/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:33:13.346065 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c7644-db9d-4700-83f3-8d6614e7b89f None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:13.346065 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c7644-db9d-4700-83f3-8d6614e7b89f None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:13.346065 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c7644-db9d-4700-83f3-8d6614e7b89f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:13.405671 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-4e0c7644-db9d-4700-83f3-8d6614e7b89f None None] MFA Rules not processed for user `c21f9f8f9d704d429163628ad156f69e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:33:13.407006 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-4e0c7644-db9d-4700-83f3-8d6614e7b89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:13.534983 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e7d7ad-1d9a-4f63-8159-91d37dfa396e tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:13.644190 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2767/5568] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:33:13 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:33:13.645177 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0c7644-db9d-4700-83f3-8d6614e7b89f None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:13.658738 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0c7644-db9d-4700-83f3-8d6614e7b89f None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:13.664653 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e6aab-2526-417d-8df1-fe6ab071daea tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c21f9f8f9d704d429163628ad156f69e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b971c2d1ade9426c9f9ffbbc92f71b3e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:13.669890 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e6aab-2526-417d-8df1-fe6ab071daea tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:13.670353 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e6aab-2526-417d-8df1-fe6ab071daea tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:13.670788 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e6aab-2526-417d-8df1-fe6ab071daea tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:13.672505 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3e6aab-2526-417d-8df1-fe6ab071daea tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:13.675138 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3e6aab-2526-417d-8df1-fe6ab071daea tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:13.709068 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff34893c-c8d1-4f8f-b0bf-4e4108d5d1ce tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dccef27a56140498698b4161fdc9569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c389ec6b454405aad0012fe235deac5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:13.710298 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff34893c-c8d1-4f8f-b0bf-4e4108d5d1ce tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:13.710974 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff34893c-c8d1-4f8f-b0bf-4e4108d5d1ce tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:13.711215 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff34893c-c8d1-4f8f-b0bf-4e4108d5d1ce tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] PATH_INFO: `/v3/domains/449aebffff714e5687e4270cd0a01fb2` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:13.713248 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff34893c-c8d1-4f8f-b0bf-4e4108d5d1ce tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=449aebffff714e5687e4270cd0a01fb2)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:13.714999 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff34893c-c8d1-4f8f-b0bf-4e4108d5d1ce tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:13.740138 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ff34893c-c8d1-4f8f-b0bf-4e4108d5d1ce tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '449aebffff714e5687e4270cd0a01fb2'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:13.741720 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ff34893c-c8d1-4f8f-b0bf-4e4108d5d1ce tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '449aebffff714e5687e4270cd0a01fb2'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:13.774002 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2768/5569] 10.222.0.52 () {60 vars in 1151 bytes} [Sat May 14 21:33:13 2022] POST /identity/v3/projects => generated 349 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:33:13.778756 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e6aab-2526-417d-8df1-fe6ab071daea tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:13.781596 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-ec3e6aab-2526-417d-8df1-fe6ab071daea tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:13.864881 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e6aab-2526-417d-8df1-fe6ab071daea tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:13.870580 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ea3c02-84ce-41c0-add9-37676df391d4 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c21f9f8f9d704d429163628ad156f69e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b971c2d1ade9426c9f9ffbbc92f71b3e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:13.871254 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea3c02-84ce-41c0-add9-37676df391d4 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:13.871578 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea3c02-84ce-41c0-add9-37676df391d4 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:13.872383 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea3c02-84ce-41c0-add9-37676df391d4 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:13.872562 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ea3c02-84ce-41c0-add9-37676df391d4 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:13.874651 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ea3c02-84ce-41c0-add9-37676df391d4 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:13.909367 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ff34893c-c8d1-4f8f-b0bf-4e4108d5d1ce tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '449aebffff714e5687e4270cd0a01fb2'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:13.910386 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ff34893c-c8d1-4f8f-b0bf-4e4108d5d1ce tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '449aebffff714e5687e4270cd0a01fb2'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:13.913906 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2802/5570] 10.222.0.52 () {60 vars in 1248 bytes} [Sat May 14 21:33:13 2022] PATCH /identity/v3/domains/449aebffff714e5687e4270cd0a01fb2 => generated 276 bytes in 605 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:33:13.918174 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff34893c-c8d1-4f8f-b0bf-4e4108d5d1ce tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:13.920358 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ff34893c-c8d1-4f8f-b0bf-4e4108d5d1ce tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:13.990111 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2769/5571] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:33:13 2022] POST /identity/v3/projects => generated 350 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:33:13.995427 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ea3c02-84ce-41c0-add9-37676df391d4 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:13.997580 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-47ea3c02-84ce-41c0-add9-37676df391d4 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:13.999780 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff34893c-c8d1-4f8f-b0bf-4e4108d5d1ce tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:14.073380 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ea3c02-84ce-41c0-add9-37676df391d4 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:14.087193 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67a8a7b-7a40-4c4d-814f-3322fe0d6623 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c21f9f8f9d704d429163628ad156f69e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b971c2d1ade9426c9f9ffbbc92f71b3e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:14.090523 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a8a7b-7a40-4c4d-814f-3322fe0d6623 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:14.091866 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0149d4b-42e2-4f3c-89f2-1bfcb1ddc47a tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dccef27a56140498698b4161fdc9569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c389ec6b454405aad0012fe235deac5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:14.092037 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a8a7b-7a40-4c4d-814f-3322fe0d6623 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:14.092992 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a8a7b-7a40-4c4d-814f-3322fe0d6623 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] PATH_INFO: `/v3/users/5025051634604827b245491e9d9907bf` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:14.093397 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0149d4b-42e2-4f3c-89f2-1bfcb1ddc47a tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:14.094139 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0149d4b-42e2-4f3c-89f2-1bfcb1ddc47a tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:14.095535 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0149d4b-42e2-4f3c-89f2-1bfcb1ddc47a tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] PATH_INFO: `/v3/domains/449aebffff714e5687e4270cd0a01fb2` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:14.098750 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67a8a7b-7a40-4c4d-814f-3322fe0d6623 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] RBAC: Authorizing `identity:get_user(user_id=5025051634604827b245491e9d9907bf)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:14.102223 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67a8a7b-7a40-4c4d-814f-3322fe0d6623 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:14.111088 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2770/5572] 10.222.0.52 () {58 vars in 1220 bytes} [Sat May 14 21:33:13 2022] GET /identity/v3/users/5025051634604827b245491e9d9907bf => generated 287 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:33:14.112713 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67a8a7b-7a40-4c4d-814f-3322fe0d6623 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:14.123741 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0149d4b-42e2-4f3c-89f2-1bfcb1ddc47a tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=449aebffff714e5687e4270cd0a01fb2)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:14.124711 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0149d4b-42e2-4f3c-89f2-1bfcb1ddc47a tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:14.132490 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67a8a7b-7a40-4c4d-814f-3322fe0d6623 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:14.142121 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da348c-d2d3-4db2-8cbb-f39c34d15f69 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c21f9f8f9d704d429163628ad156f69e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b971c2d1ade9426c9f9ffbbc92f71b3e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:14.143954 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da348c-d2d3-4db2-8cbb-f39c34d15f69 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:14.144453 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da348c-d2d3-4db2-8cbb-f39c34d15f69 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:14.145666 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da348c-d2d3-4db2-8cbb-f39c34d15f69 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] PATH_INFO: `/v3/credentials` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:14.147085 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8da348c-d2d3-4db2-8cbb-f39c34d15f69 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:14.150738 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8da348c-d2d3-4db2-8cbb-f39c34d15f69 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:14.156795 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a0149d4b-42e2-4f3c-89f2-1bfcb1ddc47a tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '449aebffff714e5687e4270cd0a01fb2'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:14.162028 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a0149d4b-42e2-4f3c-89f2-1bfcb1ddc47a tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '449aebffff714e5687e4270cd0a01fb2'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:14.280421 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2771/5573] 10.222.0.52 () {60 vars in 1161 bytes} [Sat May 14 21:33:14 2022] POST /identity/v3/credentials => generated 430 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:33:14.284815 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da348c-d2d3-4db2-8cbb-f39c34d15f69 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:14.295728 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da348c-d2d3-4db2-8cbb-f39c34d15f69 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:14.313256 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbede63d-0851-4a32-b406-e55796ed820b tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c21f9f8f9d704d429163628ad156f69e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b971c2d1ade9426c9f9ffbbc92f71b3e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:14.314558 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbede63d-0851-4a32-b406-e55796ed820b tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:14.315042 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbede63d-0851-4a32-b406-e55796ed820b tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:14.315676 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbede63d-0851-4a32-b406-e55796ed820b tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] PATH_INFO: `/v3/credentials/9feade646a290d7be9f7db6f04b5f794b3957d1b5496e31fffbb007b48283fb0` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:14.318477 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbede63d-0851-4a32-b406-e55796ed820b tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=9feade646a290d7be9f7db6f04b5f794b3957d1b5496e31fffbb007b48283fb0)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:14.318747 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a0149d4b-42e2-4f3c-89f2-1bfcb1ddc47a tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '449aebffff714e5687e4270cd0a01fb2', 'request_id': 'req-a0149d4b-42e2-4f3c-89f2-1bfcb1ddc47a'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:14.321025 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbede63d-0851-4a32-b406-e55796ed820b tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:14.324724 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbede63d-0851-4a32-b406-e55796ed820b tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=9feade646a290d7be9f7db6f04b5f794b3957d1b5496e31fffbb007b48283fb0)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:14.325040 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a0149d4b-42e2-4f3c-89f2-1bfcb1ddc47a tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '449aebffff714e5687e4270cd0a01fb2', 'request_id': 'req-a0149d4b-42e2-4f3c-89f2-1bfcb1ddc47a'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:14.326709 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbede63d-0851-4a32-b406-e55796ed820b tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:14.418083 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a0149d4b-42e2-4f3c-89f2-1bfcb1ddc47a tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '449aebffff714e5687e4270cd0a01fb2', 'request_id': 'req-a0149d4b-42e2-4f3c-89f2-1bfcb1ddc47a'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:14.431315 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2772/5574] 10.222.0.52 () {60 vars in 1357 bytes} [Sat May 14 21:33:14 2022] PATCH /identity/v3/credentials/9feade646a290d7be9f7db6f04b5f794b3957d1b5496e31fffbb007b48283fb0 => generated 437 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:33:14.436149 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbede63d-0851-4a32-b406-e55796ed820b tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:14.451082 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a0149d4b-42e2-4f3c-89f2-1bfcb1ddc47a tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] The token cache is being invalidate because project 449aebffff714e5687e4270cd0a01fb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:33:14.451385 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a0149d4b-42e2-4f3c-89f2-1bfcb1ddc47a tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:14.457807 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a0149d4b-42e2-4f3c-89f2-1bfcb1ddc47a tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:14.463128 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbede63d-0851-4a32-b406-e55796ed820b tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:14.484560 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a0149d4b-42e2-4f3c-89f2-1bfcb1ddc47a tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '449aebffff714e5687e4270cd0a01fb2', 'request_id': 'req-a0149d4b-42e2-4f3c-89f2-1bfcb1ddc47a'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:14.486825 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a0149d4b-42e2-4f3c-89f2-1bfcb1ddc47a tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '449aebffff714e5687e4270cd0a01fb2', 'request_id': 'req-a0149d4b-42e2-4f3c-89f2-1bfcb1ddc47a'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:14.518707 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a0149d4b-42e2-4f3c-89f2-1bfcb1ddc47a tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '449aebffff714e5687e4270cd0a01fb2', 'request_id': 'req-a0149d4b-42e2-4f3c-89f2-1bfcb1ddc47a'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:14.547153 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2803/5575] 10.222.0.52 () {58 vars in 1229 bytes} [Sat May 14 21:33:13 2022] DELETE /identity/v3/domains/449aebffff714e5687e4270cd0a01fb2 => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:14.548895 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0149d4b-42e2-4f3c-89f2-1bfcb1ddc47a tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:14.552869 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-a0149d4b-42e2-4f3c-89f2-1bfcb1ddc47a tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:14.588096 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9ab842-6700-4d29-9c01-eaa83bcae695 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c21f9f8f9d704d429163628ad156f69e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b971c2d1ade9426c9f9ffbbc92f71b3e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:14.588096 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ab842-6700-4d29-9c01-eaa83bcae695 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:14.588096 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ab842-6700-4d29-9c01-eaa83bcae695 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:14.589220 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ab842-6700-4d29-9c01-eaa83bcae695 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] PATH_INFO: `/v3/credentials/9feade646a290d7be9f7db6f04b5f794b3957d1b5496e31fffbb007b48283fb0` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:14.589220 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9ab842-6700-4d29-9c01-eaa83bcae695 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] RBAC: Authorizing `identity:get_credential(credential_id=9feade646a290d7be9f7db6f04b5f794b3957d1b5496e31fffbb007b48283fb0)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:14.589220 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9ab842-6700-4d29-9c01-eaa83bcae695 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:14.599358 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2773/5576] 10.222.0.52 () {58 vars in 1334 bytes} [Sat May 14 21:33:14 2022] GET /identity/v3/credentials/9feade646a290d7be9f7db6f04b5f794b3957d1b5496e31fffbb007b48283fb0 => generated 437 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:33:14.604812 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9ab842-6700-4d29-9c01-eaa83bcae695 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:14.607242 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-fe9ab842-6700-4d29-9c01-eaa83bcae695 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:14.659906 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9ab842-6700-4d29-9c01-eaa83bcae695 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:14.688392 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d4ac24-511d-430d-892c-117b922e340e tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c21f9f8f9d704d429163628ad156f69e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b971c2d1ade9426c9f9ffbbc92f71b3e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:14.689354 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d4ac24-511d-430d-892c-117b922e340e tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:14.689645 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d4ac24-511d-430d-892c-117b922e340e tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:14.689929 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d4ac24-511d-430d-892c-117b922e340e tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] PATH_INFO: `/v3/credentials/9feade646a290d7be9f7db6f04b5f794b3957d1b5496e31fffbb007b48283fb0` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:14.699943 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d4ac24-511d-430d-892c-117b922e340e tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=9feade646a290d7be9f7db6f04b5f794b3957d1b5496e31fffbb007b48283fb0)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:14.700459 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0149d4b-42e2-4f3c-89f2-1bfcb1ddc47a tempest-InheritsV3TestJSON-1028803966 tempest-InheritsV3TestJSON-1028803966-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:14.701980 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d4ac24-511d-430d-892c-117b922e340e tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:14.707135 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843a013f-941e-4821-af24-9046e7e586f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:14.708059 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a013f-941e-4821-af24-9046e7e586f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:14.708348 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a013f-941e-4821-af24-9046e7e586f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:14.708628 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a013f-941e-4821-af24-9046e7e586f1 admin admin] PATH_INFO: `/v3/users/7b03cccf523b43a49748977c3739010f` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:14.710264 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843a013f-941e-4821-af24-9046e7e586f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b03cccf523b43a49748977c3739010f)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:14.713782 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843a013f-941e-4821-af24-9046e7e586f1 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:14.835355 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2774/5577] 10.222.0.52 () {58 vars in 1337 bytes} [Sat May 14 21:33:14 2022] DELETE /identity/v3/credentials/9feade646a290d7be9f7db6f04b5f794b3957d1b5496e31fffbb007b48283fb0 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:33:14.841141 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d4ac24-511d-430d-892c-117b922e340e tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:14.859789 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d4ac24-511d-430d-892c-117b922e340e tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:14.865777 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c494a3e-df02-4246-8ef1-4d8b2dc031c5 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c21f9f8f9d704d429163628ad156f69e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b971c2d1ade9426c9f9ffbbc92f71b3e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:14.866471 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c494a3e-df02-4246-8ef1-4d8b2dc031c5 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:14.866760 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c494a3e-df02-4246-8ef1-4d8b2dc031c5 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:14.867045 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c494a3e-df02-4246-8ef1-4d8b2dc031c5 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] PATH_INFO: `/v3/credentials` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:14.868772 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c494a3e-df02-4246-8ef1-4d8b2dc031c5 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:14.873553 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c494a3e-df02-4246-8ef1-4d8b2dc031c5 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:14.974822 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-843a013f-941e-4821-af24-9046e7e586f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b03cccf523b43a49748977c3739010f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:14.979553 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2775/5578] 10.222.0.52 () {60 vars in 1161 bytes} [Sat May 14 21:33:14 2022] POST /identity/v3/credentials => generated 429 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:33:14.980509 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c494a3e-df02-4246-8ef1-4d8b2dc031c5 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:15.008399 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c494a3e-df02-4246-8ef1-4d8b2dc031c5 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:15.012179 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-843a013f-941e-4821-af24-9046e7e586f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b03cccf523b43a49748977c3739010f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:15.026177 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea1aa25-a634-4522-870e-37d5a98de5d4 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c21f9f8f9d704d429163628ad156f69e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b971c2d1ade9426c9f9ffbbc92f71b3e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:15.027240 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea1aa25-a634-4522-870e-37d5a98de5d4 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:15.027703 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea1aa25-a634-4522-870e-37d5a98de5d4 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:15.028134 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea1aa25-a634-4522-870e-37d5a98de5d4 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] PATH_INFO: `/v3/credentials` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:15.029110 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-843a013f-941e-4821-af24-9046e7e586f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b03cccf523b43a49748977c3739010f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:15.029245 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea1aa25-a634-4522-870e-37d5a98de5d4 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:15.032142 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea1aa25-a634-4522-870e-37d5a98de5d4 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:15.177805 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-843a013f-941e-4821-af24-9046e7e586f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b03cccf523b43a49748977c3739010f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:15.178472 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-843a013f-941e-4821-af24-9046e7e586f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b03cccf523b43a49748977c3739010f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:15.187375 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2804/5579] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:33:14 2022] DELETE /identity/v3/users/7b03cccf523b43a49748977c3739010f => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:15.192521 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b50d85-905b-446b-a0d3-174f95f8b607 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:15.193007 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b50d85-905b-446b-a0d3-174f95f8b607 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:15.193391 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b50d85-905b-446b-a0d3-174f95f8b607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:15.226735 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2776/5580] 10.222.0.52 () {60 vars in 1161 bytes} [Sat May 14 21:33:14 2022] POST /identity/v3/credentials => generated 431 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:33:15.231140 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea1aa25-a634-4522-870e-37d5a98de5d4 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:15.235303 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-cea1aa25-a634-4522-870e-37d5a98de5d4 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:15.238429 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-87b50d85-905b-446b-a0d3-174f95f8b607 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:33:15.247859 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-87b50d85-905b-446b-a0d3-174f95f8b607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:15.256699 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea1aa25-a634-4522-870e-37d5a98de5d4 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:15.384841 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2805/5581] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:33:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:33:15.392181 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b50d85-905b-446b-a0d3-174f95f8b607 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:15.394477 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-87b50d85-905b-446b-a0d3-174f95f8b607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:15.394591 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aafee4-512e-4938-9f1a-4265169578b6 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c21f9f8f9d704d429163628ad156f69e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b971c2d1ade9426c9f9ffbbc92f71b3e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:15.395982 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aafee4-512e-4938-9f1a-4265169578b6 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:15.396475 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aafee4-512e-4938-9f1a-4265169578b6 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:15.397160 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aafee4-512e-4938-9f1a-4265169578b6 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] PATH_INFO: `/v3/credentials` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:15.398341 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aafee4-512e-4938-9f1a-4265169578b6 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] RBAC: Authorizing `identity:list_credentials()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:15.401585 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aafee4-512e-4938-9f1a-4265169578b6 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:15.416790 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aafee4-512e-4938-9f1a-4265169578b6 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:15.419744 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aafee4-512e-4938-9f1a-4265169578b6 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:15.421651 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aafee4-512e-4938-9f1a-4265169578b6 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:15.423358 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aafee4-512e-4938-9f1a-4265169578b6 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:15.430715 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2777/5582] 10.222.0.52 () {58 vars in 1139 bytes} [Sat May 14 21:33:15 2022] GET /identity/v3/credentials => generated 945 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:33:15.435346 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aafee4-512e-4938-9f1a-4265169578b6 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:15.449580 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aafee4-512e-4938-9f1a-4265169578b6 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:15.455851 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac2ef3-114d-420d-bc6e-311d34815b4b tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c21f9f8f9d704d429163628ad156f69e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b971c2d1ade9426c9f9ffbbc92f71b3e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:15.456877 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac2ef3-114d-420d-bc6e-311d34815b4b tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:15.457401 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac2ef3-114d-420d-bc6e-311d34815b4b tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:15.457693 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac2ef3-114d-420d-bc6e-311d34815b4b tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] PATH_INFO: `/v3/credentials/31596b59438821d65d1fb54aedb10545b9829c5d711d1250c4d2852a930bbf60` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:15.460275 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ac2ef3-114d-420d-bc6e-311d34815b4b tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=31596b59438821d65d1fb54aedb10545b9829c5d711d1250c4d2852a930bbf60)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:15.463113 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ac2ef3-114d-420d-bc6e-311d34815b4b tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:15.518020 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b50d85-905b-446b-a0d3-174f95f8b607 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:15.522048 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39414c6f-1b51-4bad-9029-85a3b4a4b63f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:15.522707 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39414c6f-1b51-4bad-9029-85a3b4a4b63f service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:15.523327 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39414c6f-1b51-4bad-9029-85a3b4a4b63f service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:15.523448 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39414c6f-1b51-4bad-9029-85a3b4a4b63f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:15.534997 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39414c6f-1b51-4bad-9029-85a3b4a4b63f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:15.536838 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39414c6f-1b51-4bad-9029-85a3b4a4b63f service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:15.547197 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2806/5583] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:33:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:33:15.564051 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2778/5584] 10.222.0.52 () {58 vars in 1337 bytes} [Sat May 14 21:33:15 2022] DELETE /identity/v3/credentials/31596b59438821d65d1fb54aedb10545b9829c5d711d1250c4d2852a930bbf60 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:15.568406 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39414c6f-1b51-4bad-9029-85a3b4a4b63f service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:15.583590 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39414c6f-1b51-4bad-9029-85a3b4a4b63f service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:15.596787 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d54b4a5-c2d3-4dfa-8e27-7d64e11466f2 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c21f9f8f9d704d429163628ad156f69e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b971c2d1ade9426c9f9ffbbc92f71b3e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:15.597741 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d54b4a5-c2d3-4dfa-8e27-7d64e11466f2 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:15.598033 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d54b4a5-c2d3-4dfa-8e27-7d64e11466f2 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:15.598314 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d54b4a5-c2d3-4dfa-8e27-7d64e11466f2 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] PATH_INFO: `/v3/credentials/1377b06c64e7ff956ddf4b650778bf84d6b1c7393ed9b2a4a1d1fb5f50c964ad` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:15.601306 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d54b4a5-c2d3-4dfa-8e27-7d64e11466f2 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=1377b06c64e7ff956ddf4b650778bf84d6b1c7393ed9b2a4a1d1fb5f50c964ad)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:15.603366 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d54b4a5-c2d3-4dfa-8e27-7d64e11466f2 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:15.721110 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2807/5585] 10.222.0.52 () {58 vars in 1337 bytes} [Sat May 14 21:33:15 2022] DELETE /identity/v3/credentials/1377b06c64e7ff956ddf4b650778bf84d6b1c7393ed9b2a4a1d1fb5f50c964ad => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:15.727180 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac2ef3-114d-420d-bc6e-311d34815b4b tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:15.780012 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac2ef3-114d-420d-bc6e-311d34815b4b tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:15.804415 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac2c83e-9972-4f2a-9f5c-547926aebda6 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c21f9f8f9d704d429163628ad156f69e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b971c2d1ade9426c9f9ffbbc92f71b3e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:15.805587 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac2c83e-9972-4f2a-9f5c-547926aebda6 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:15.806695 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac2c83e-9972-4f2a-9f5c-547926aebda6 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:15.807093 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac2c83e-9972-4f2a-9f5c-547926aebda6 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] PATH_INFO: `/v3/projects/134958099ce142fc9f51c6a13f64ccba` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:15.808895 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac2c83e-9972-4f2a-9f5c-547926aebda6 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] RBAC: Authorizing `identity:delete_project(project_id=134958099ce142fc9f51c6a13f64ccba)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:15.811262 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac2c83e-9972-4f2a-9f5c-547926aebda6 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:15.982950 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7ac2c83e-9972-4f2a-9f5c-547926aebda6 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '134958099ce142fc9f51c6a13f64ccba', 'request_id': 'req-7ac2c83e-9972-4f2a-9f5c-547926aebda6'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:15.991140 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7ac2c83e-9972-4f2a-9f5c-547926aebda6 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '134958099ce142fc9f51c6a13f64ccba', 'request_id': 'req-7ac2c83e-9972-4f2a-9f5c-547926aebda6'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:16.005894 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7ac2c83e-9972-4f2a-9f5c-547926aebda6 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '134958099ce142fc9f51c6a13f64ccba', 'request_id': 'req-7ac2c83e-9972-4f2a-9f5c-547926aebda6'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:16.196052 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7ac2c83e-9972-4f2a-9f5c-547926aebda6 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] The token cache is being invalidate because project 134958099ce142fc9f51c6a13f64ccba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:33:16.198100 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7ac2c83e-9972-4f2a-9f5c-547926aebda6 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:16.198976 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7ac2c83e-9972-4f2a-9f5c-547926aebda6 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:16.201178 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2779/5586] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:33:15 2022] DELETE /identity/v3/projects/134958099ce142fc9f51c6a13f64ccba => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:16.205055 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d54b4a5-c2d3-4dfa-8e27-7d64e11466f2 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:16.206890 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-3d54b4a5-c2d3-4dfa-8e27-7d64e11466f2 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:16.232176 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d54b4a5-c2d3-4dfa-8e27-7d64e11466f2 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:16.325503 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4864987-44aa-45d2-9f57-9c195f6f5dc4 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c21f9f8f9d704d429163628ad156f69e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b971c2d1ade9426c9f9ffbbc92f71b3e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:16.327168 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4864987-44aa-45d2-9f57-9c195f6f5dc4 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:16.327824 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4864987-44aa-45d2-9f57-9c195f6f5dc4 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:16.328262 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4864987-44aa-45d2-9f57-9c195f6f5dc4 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] PATH_INFO: `/v3/projects/951a910e937240fa9b81cf8bdbf1c886` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:16.329724 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4864987-44aa-45d2-9f57-9c195f6f5dc4 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] RBAC: Authorizing `identity:delete_project(project_id=951a910e937240fa9b81cf8bdbf1c886)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:16.333063 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4864987-44aa-45d2-9f57-9c195f6f5dc4 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:16.506362 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d4864987-44aa-45d2-9f57-9c195f6f5dc4 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '951a910e937240fa9b81cf8bdbf1c886', 'request_id': 'req-d4864987-44aa-45d2-9f57-9c195f6f5dc4'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:16.519466 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d4864987-44aa-45d2-9f57-9c195f6f5dc4 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '951a910e937240fa9b81cf8bdbf1c886', 'request_id': 'req-d4864987-44aa-45d2-9f57-9c195f6f5dc4'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:16.704374 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d4864987-44aa-45d2-9f57-9c195f6f5dc4 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '951a910e937240fa9b81cf8bdbf1c886', 'request_id': 'req-d4864987-44aa-45d2-9f57-9c195f6f5dc4'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:16.736505 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d4864987-44aa-45d2-9f57-9c195f6f5dc4 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] The token cache is being invalidate because project 951a910e937240fa9b81cf8bdbf1c886 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:33:16.736811 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d4864987-44aa-45d2-9f57-9c195f6f5dc4 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:16.737495 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d4864987-44aa-45d2-9f57-9c195f6f5dc4 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:16.739444 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2808/5587] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:33:16 2022] DELETE /identity/v3/projects/951a910e937240fa9b81cf8bdbf1c886 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:16.744275 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac2c83e-9972-4f2a-9f5c-547926aebda6 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:16.745777 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-7ac2c83e-9972-4f2a-9f5c-547926aebda6 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:16.806500 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4864987-44aa-45d2-9f57-9c195f6f5dc4 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:16.808806 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d4864987-44aa-45d2-9f57-9c195f6f5dc4 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:16.849850 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac2c83e-9972-4f2a-9f5c-547926aebda6 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:16.938876 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4864987-44aa-45d2-9f57-9c195f6f5dc4 tempest-CredentialsTestJSON-326023498 tempest-CredentialsTestJSON-326023498-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:16.942478 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011cbbdd-5e51-4b9f-9f91-7d99a42216c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:16.943510 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011cbbdd-5e51-4b9f-9f91-7d99a42216c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:16.943879 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011cbbdd-5e51-4b9f-9f91-7d99a42216c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:16.944235 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011cbbdd-5e51-4b9f-9f91-7d99a42216c4 admin admin] PATH_INFO: `/v3/users/5025051634604827b245491e9d9907bf` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:16.944819 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b2ea2a-1001-4de4-b65f-5d0b914df58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:16.949983 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2ea2a-1001-4de4-b65f-5d0b914df58b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:16.950108 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011cbbdd-5e51-4b9f-9f91-7d99a42216c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5025051634604827b245491e9d9907bf)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:16.950207 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2ea2a-1001-4de4-b65f-5d0b914df58b admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:16.950207 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2ea2a-1001-4de4-b65f-5d0b914df58b admin admin] PATH_INFO: `/v3/projects/2ab705ce1456448785c121ba9cf6e5c2` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:16.950207 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b2ea2a-1001-4de4-b65f-5d0b914df58b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ab705ce1456448785c121ba9cf6e5c2)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:16.950538 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011cbbdd-5e51-4b9f-9f91-7d99a42216c4 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:16.951085 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b2ea2a-1001-4de4-b65f-5d0b914df58b admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:17.133027 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e9b2ea2a-1001-4de4-b65f-5d0b914df58b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ab705ce1456448785c121ba9cf6e5c2', 'request_id': 'req-e9b2ea2a-1001-4de4-b65f-5d0b914df58b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:17.139774 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e9b2ea2a-1001-4de4-b65f-5d0b914df58b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ab705ce1456448785c121ba9cf6e5c2', 'request_id': 'req-e9b2ea2a-1001-4de4-b65f-5d0b914df58b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:17.215506 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e9b2ea2a-1001-4de4-b65f-5d0b914df58b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ab705ce1456448785c121ba9cf6e5c2', 'request_id': 'req-e9b2ea2a-1001-4de4-b65f-5d0b914df58b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:17.233230 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e9b2ea2a-1001-4de4-b65f-5d0b914df58b admin admin] The token cache is being invalidate because project 2ab705ce1456448785c121ba9cf6e5c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:33:17.233640 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e9b2ea2a-1001-4de4-b65f-5d0b914df58b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:17.235012 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e9b2ea2a-1001-4de4-b65f-5d0b914df58b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:17.238708 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2809/5588] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:33:16 2022] DELETE /identity/v3/projects/2ab705ce1456448785c121ba9cf6e5c2 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:17.242483 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b2ea2a-1001-4de4-b65f-5d0b914df58b admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:17.247157 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e9b2ea2a-1001-4de4-b65f-5d0b914df58b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:17.279025 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-011cbbdd-5e51-4b9f-9f91-7d99a42216c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5025051634604827b245491e9d9907bf'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:17.294886 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-011cbbdd-5e51-4b9f-9f91-7d99a42216c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5025051634604827b245491e9d9907bf'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:17.295915 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-011cbbdd-5e51-4b9f-9f91-7d99a42216c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5025051634604827b245491e9d9907bf'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:17.360133 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b2ea2a-1001-4de4-b65f-5d0b914df58b admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:17.365251 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9db372-9dbd-40b6-ab0c-fd730a101260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:17.366214 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9db372-9dbd-40b6-ab0c-fd730a101260 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:17.366489 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9db372-9dbd-40b6-ab0c-fd730a101260 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:17.366792 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9db372-9dbd-40b6-ab0c-fd730a101260 admin admin] PATH_INFO: `/v3/users/9dccef27a56140498698b4161fdc9569` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:17.368985 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9db372-9dbd-40b6-ab0c-fd730a101260 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dccef27a56140498698b4161fdc9569)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:17.369123 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-011cbbdd-5e51-4b9f-9f91-7d99a42216c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5025051634604827b245491e9d9907bf'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:17.371090 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9db372-9dbd-40b6-ab0c-fd730a101260 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:17.385636 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-011cbbdd-5e51-4b9f-9f91-7d99a42216c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5025051634604827b245491e9d9907bf'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:17.395858 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2780/5589] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:33:16 2022] DELETE /identity/v3/users/5025051634604827b245491e9d9907bf => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:33:17.401705 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b3205c-9613-4eb0-bc07-0cc77fe240f1 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:17.402434 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b3205c-9613-4eb0-bc07-0cc77fe240f1 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:17.402434 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b3205c-9613-4eb0-bc07-0cc77fe240f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:17.424964 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-d8b3205c-9613-4eb0-bc07-0cc77fe240f1 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:33:17.440899 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-d8b3205c-9613-4eb0-bc07-0cc77fe240f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:17.550921 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2781/5590] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:33:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:33:17.562827 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b3205c-9613-4eb0-bc07-0cc77fe240f1 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:17.565425 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-d8b3205c-9613-4eb0-bc07-0cc77fe240f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:17.644548 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b3205c-9613-4eb0-bc07-0cc77fe240f1 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:17.648705 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c8cee2-cdbd-486e-b42b-e08052240048 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:17.649782 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8cee2-cdbd-486e-b42b-e08052240048 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:17.650397 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8cee2-cdbd-486e-b42b-e08052240048 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:17.650835 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8cee2-cdbd-486e-b42b-e08052240048 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:17.661828 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c8cee2-cdbd-486e-b42b-e08052240048 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:17.663569 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c8cee2-cdbd-486e-b42b-e08052240048 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:17.675993 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2782/5591] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:33:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:33:17.688231 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6e9db372-9dbd-40b6-ab0c-fd730a101260 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dccef27a56140498698b4161fdc9569'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:17.710404 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6e9db372-9dbd-40b6-ab0c-fd730a101260 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dccef27a56140498698b4161fdc9569'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:17.721768 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6e9db372-9dbd-40b6-ab0c-fd730a101260 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dccef27a56140498698b4161fdc9569'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:17.815876 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6e9db372-9dbd-40b6-ab0c-fd730a101260 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dccef27a56140498698b4161fdc9569'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:17.821014 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6e9db372-9dbd-40b6-ab0c-fd730a101260 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dccef27a56140498698b4161fdc9569'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:17.840421 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2810/5592] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:33:17 2022] DELETE /identity/v3/users/9dccef27a56140498698b4161fdc9569 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:18.547190 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c8cee2-cdbd-486e-b42b-e08052240048 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:18.550260 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-65c8cee2-cdbd-486e-b42b-e08052240048 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:18.571707 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c8cee2-cdbd-486e-b42b-e08052240048 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:18.616505 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9db372-9dbd-40b6-ab0c-fd730a101260 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:18.618095 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-6e9db372-9dbd-40b6-ab0c-fd730a101260 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:18.702419 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e41751-5a8c-4b3f-8ab6-96b29319c184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:18.703315 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e41751-5a8c-4b3f-8ab6-96b29319c184 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:18.703705 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e41751-5a8c-4b3f-8ab6-96b29319c184 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:18.704032 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e41751-5a8c-4b3f-8ab6-96b29319c184 admin admin] PATH_INFO: `/v3/projects/1e47a259ad71441e8aa863bfef62ff84` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:18.707104 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e41751-5a8c-4b3f-8ab6-96b29319c184 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e47a259ad71441e8aa863bfef62ff84)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:18.709323 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e41751-5a8c-4b3f-8ab6-96b29319c184 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:18.749192 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9db372-9dbd-40b6-ab0c-fd730a101260 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:18.759153 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d23ec75-4481-47c8-85f4-8574af97c76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:18.760795 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d23ec75-4481-47c8-85f4-8574af97c76d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:18.761735 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d23ec75-4481-47c8-85f4-8574af97c76d admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:18.762758 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d23ec75-4481-47c8-85f4-8574af97c76d admin admin] PATH_INFO: `/v3/projects/7c389ec6b454405aad0012fe235deac5` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:18.764226 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d23ec75-4481-47c8-85f4-8574af97c76d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c389ec6b454405aad0012fe235deac5)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:18.770185 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d23ec75-4481-47c8-85f4-8574af97c76d admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:18.870145 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-37e41751-5a8c-4b3f-8ab6-96b29319c184 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e47a259ad71441e8aa863bfef62ff84', 'request_id': 'req-37e41751-5a8c-4b3f-8ab6-96b29319c184'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:18.877632 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-37e41751-5a8c-4b3f-8ab6-96b29319c184 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e47a259ad71441e8aa863bfef62ff84', 'request_id': 'req-37e41751-5a8c-4b3f-8ab6-96b29319c184'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:18.888846 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-37e41751-5a8c-4b3f-8ab6-96b29319c184 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e47a259ad71441e8aa863bfef62ff84', 'request_id': 'req-37e41751-5a8c-4b3f-8ab6-96b29319c184'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:18.950866 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8d23ec75-4481-47c8-85f4-8574af97c76d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c389ec6b454405aad0012fe235deac5', 'request_id': 'req-8d23ec75-4481-47c8-85f4-8574af97c76d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:18.956345 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8d23ec75-4481-47c8-85f4-8574af97c76d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c389ec6b454405aad0012fe235deac5', 'request_id': 'req-8d23ec75-4481-47c8-85f4-8574af97c76d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:18.976005 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-37e41751-5a8c-4b3f-8ab6-96b29319c184 admin admin] The token cache is being invalidate because project 1e47a259ad71441e8aa863bfef62ff84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:33:18.978306 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-37e41751-5a8c-4b3f-8ab6-96b29319c184 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:18.978306 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-37e41751-5a8c-4b3f-8ab6-96b29319c184 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:18.980077 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2783/5593] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:33:18 2022] DELETE /identity/v3/projects/1e47a259ad71441e8aa863bfef62ff84 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:18.984218 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e41751-5a8c-4b3f-8ab6-96b29319c184 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:18.985648 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-37e41751-5a8c-4b3f-8ab6-96b29319c184 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:19.058373 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8d23ec75-4481-47c8-85f4-8574af97c76d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c389ec6b454405aad0012fe235deac5', 'request_id': 'req-8d23ec75-4481-47c8-85f4-8574af97c76d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:19.067283 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e41751-5a8c-4b3f-8ab6-96b29319c184 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:19.077229 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8d23ec75-4481-47c8-85f4-8574af97c76d admin admin] The token cache is being invalidate because project 7c389ec6b454405aad0012fe235deac5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:33:19.077554 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8d23ec75-4481-47c8-85f4-8574af97c76d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:19.078296 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8d23ec75-4481-47c8-85f4-8574af97c76d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:19.084771 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2811/5594] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:33:18 2022] DELETE /identity/v3/projects/7c389ec6b454405aad0012fe235deac5 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:19.086422 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df3d9f-a807-4da7-8db2-168e40581e32 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:19.087601 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df3d9f-a807-4da7-8db2-168e40581e32 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:19.087750 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df3d9f-a807-4da7-8db2-168e40581e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:19.139468 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a3a7ce-5fe0-4c70-ae26-0c8f29a816c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:19.140711 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a3a7ce-5fe0-4c70-ae26-0c8f29a816c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:19.140999 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a3a7ce-5fe0-4c70-ae26-0c8f29a816c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:19.141283 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a3a7ce-5fe0-4c70-ae26-0c8f29a816c4 admin admin] PATH_INFO: `/v3/users/c21f9f8f9d704d429163628ad156f69e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:19.142824 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a3a7ce-5fe0-4c70-ae26-0c8f29a816c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c21f9f8f9d704d429163628ad156f69e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:19.144806 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a3a7ce-5fe0-4c70-ae26-0c8f29a816c4 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:19.146667 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-58df3d9f-a807-4da7-8db2-168e40581e32 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:33:19.151898 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-58df3d9f-a807-4da7-8db2-168e40581e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:19.183687 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2812/5595] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:33:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:33:19.186000 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f31773-c632-489e-af3d-51ae93dcfa11 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:19.186307 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f31773-c632-489e-af3d-51ae93dcfa11 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:19.186576 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f31773-c632-489e-af3d-51ae93dcfa11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:19.210145 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-c6f31773-c632-489e-af3d-51ae93dcfa11 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:33:19.211381 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c6f31773-c632-489e-af3d-51ae93dcfa11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:19.226109 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2813/5596] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:33:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:33:19.236014 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f31773-c632-489e-af3d-51ae93dcfa11 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:19.241241 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f31773-c632-489e-af3d-51ae93dcfa11 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:19.246971 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe14939c-7784-4601-88df-c0064800bc9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:19.247725 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14939c-7784-4601-88df-c0064800bc9a admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:19.248072 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14939c-7784-4601-88df-c0064800bc9a admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:19.248412 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14939c-7784-4601-88df-c0064800bc9a admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:19.249197 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe14939c-7784-4601-88df-c0064800bc9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:33:19.249567 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe14939c-7784-4601-88df-c0064800bc9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:19.251232 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe14939c-7784-4601-88df-c0064800bc9a admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:19.267814 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2814/5597] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:33:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:33:19.272740 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe14939c-7784-4601-88df-c0064800bc9a admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:19.284745 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe14939c-7784-4601-88df-c0064800bc9a admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:19.301886 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bdb186-7269-451d-a91c-0f3a94132b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:19.302693 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bdb186-7269-451d-a91c-0f3a94132b0e admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:19.302977 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bdb186-7269-451d-a91c-0f3a94132b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:19.303276 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bdb186-7269-451d-a91c-0f3a94132b0e admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:19.304059 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bdb186-7269-451d-a91c-0f3a94132b0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:19.307099 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bdb186-7269-451d-a91c-0f3a94132b0e admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:19.418596 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e8a3a7ce-5fe0-4c70-ae26-0c8f29a816c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c21f9f8f9d704d429163628ad156f69e'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:19.424421 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2815/5598] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:33:19 2022] POST /identity/v3/projects => generated 385 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:33:19.428784 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bdb186-7269-451d-a91c-0f3a94132b0e admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:19.429774 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e8a3a7ce-5fe0-4c70-ae26-0c8f29a816c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c21f9f8f9d704d429163628ad156f69e'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:19.431611 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e8a3a7ce-5fe0-4c70-ae26-0c8f29a816c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c21f9f8f9d704d429163628ad156f69e'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:19.493113 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e8a3a7ce-5fe0-4c70-ae26-0c8f29a816c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c21f9f8f9d704d429163628ad156f69e'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:19.512713 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e8a3a7ce-5fe0-4c70-ae26-0c8f29a816c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c21f9f8f9d704d429163628ad156f69e'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:19.524024 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2784/5599] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:33:18 2022] DELETE /identity/v3/users/c21f9f8f9d704d429163628ad156f69e => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:33:19.528248 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bdb186-7269-451d-a91c-0f3a94132b0e admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:19.606697 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b29d47-4e56-436b-bd8f-f4489efdb236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:19.608226 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b29d47-4e56-436b-bd8f-f4489efdb236 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:19.608623 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b29d47-4e56-436b-bd8f-f4489efdb236 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:19.609116 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b29d47-4e56-436b-bd8f-f4489efdb236 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:19.609987 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b29d47-4e56-436b-bd8f-f4489efdb236 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:19.612684 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b29d47-4e56-436b-bd8f-f4489efdb236 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:19.719819 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2816/5600] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:33:19 2022] POST /identity/v3/users => generated 293 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:33:19.724032 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a3a7ce-5fe0-4c70-ae26-0c8f29a816c4 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:19.725600 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e8a3a7ce-5fe0-4c70-ae26-0c8f29a816c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:19.740400 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a3a7ce-5fe0-4c70-ae26-0c8f29a816c4 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:19.750999 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28bea76-63c8-452f-a440-d2333f1365c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:19.750999 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28bea76-63c8-452f-a440-d2333f1365c4 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:19.750999 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28bea76-63c8-452f-a440-d2333f1365c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:19.750999 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28bea76-63c8-452f-a440-d2333f1365c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:19.751411 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28bea76-63c8-452f-a440-d2333f1365c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:19.751411 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28bea76-63c8-452f-a440-d2333f1365c4 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:19.759759 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2785/5601] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:33:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:33:19.763849 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b29d47-4e56-436b-bd8f-f4489efdb236 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:19.775725 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b29d47-4e56-436b-bd8f-f4489efdb236 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:19.781283 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def0734-e1e5-4de6-9bbb-469c426e62a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:19.781953 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def0734-e1e5-4de6-9bbb-469c426e62a7 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:19.782233 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def0734-e1e5-4de6-9bbb-469c426e62a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:19.782506 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def0734-e1e5-4de6-9bbb-469c426e62a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:19.783341 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4def0734-e1e5-4de6-9bbb-469c426e62a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:19.784974 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4def0734-e1e5-4de6-9bbb-469c426e62a7 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:19.796226 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2817/5602] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:33:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:33:19.800681 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28bea76-63c8-452f-a440-d2333f1365c4 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:19.812752 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28bea76-63c8-452f-a440-d2333f1365c4 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:19.826133 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16abe987-b982-483f-b30e-0c1cb4cd5ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:19.827050 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16abe987-b982-483f-b30e-0c1cb4cd5ee5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:19.827336 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16abe987-b982-483f-b30e-0c1cb4cd5ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:19.827650 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16abe987-b982-483f-b30e-0c1cb4cd5ee5 admin admin] PATH_INFO: `/v3/projects/dd659514e6fa4b619978b0fa9173b4f2/users/8319ab9ac944416ab01583a57750c5f0/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:19.848006 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16abe987-b982-483f-b30e-0c1cb4cd5ee5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd659514e6fa4b619978b0fa9173b4f2, user_id=8319ab9ac944416ab01583a57750c5f0, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:19.851241 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16abe987-b982-483f-b30e-0c1cb4cd5ee5 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:20.007727 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2786/5603] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:33:19 2022] PUT /identity/v3/projects/dd659514e6fa4b619978b0fa9173b4f2/users/8319ab9ac944416ab01583a57750c5f0/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:33:20.017304 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ff43d-9f5a-4881-8eb0-0c2ebfa6a3b8 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:20.017602 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ff43d-9f5a-4881-8eb0-0c2ebfa6a3b8 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:20.017885 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ff43d-9f5a-4881-8eb0-0c2ebfa6a3b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:20.055087 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-d16ff43d-9f5a-4881-8eb0-0c2ebfa6a3b8 None None] MFA Rules not processed for user `8319ab9ac944416ab01583a57750c5f0`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:33:20.057768 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d16ff43d-9f5a-4881-8eb0-0c2ebfa6a3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:20.133976 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2818/5604] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:33:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:33:20.138349 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16abe987-b982-483f-b30e-0c1cb4cd5ee5 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:20.165637 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ff43d-9f5a-4881-8eb0-0c2ebfa6a3b8 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:20.167430 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d16ff43d-9f5a-4881-8eb0-0c2ebfa6a3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:20.247750 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16abe987-b982-483f-b30e-0c1cb4cd5ee5 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:20.252714 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a999cb-d72a-4c09-955f-b50c306e0584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:20.253307 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a999cb-d72a-4c09-955f-b50c306e0584 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:20.253590 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a999cb-d72a-4c09-955f-b50c306e0584 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:20.253867 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a999cb-d72a-4c09-955f-b50c306e0584 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:20.254563 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a999cb-d72a-4c09-955f-b50c306e0584 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:20.256667 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a999cb-d72a-4c09-955f-b50c306e0584 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:20.257840 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ff43d-9f5a-4881-8eb0-0c2ebfa6a3b8 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:20.263162 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40563535-eb2c-4e43-a6b7-c7cd958dbf85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:20.264117 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40563535-eb2c-4e43-a6b7-c7cd958dbf85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:20.264403 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40563535-eb2c-4e43-a6b7-c7cd958dbf85 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:20.264727 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40563535-eb2c-4e43-a6b7-c7cd958dbf85 admin admin] PATH_INFO: `/v3/projects/b971c2d1ade9426c9f9ffbbc92f71b3e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:20.265965 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40563535-eb2c-4e43-a6b7-c7cd958dbf85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b971c2d1ade9426c9f9ffbbc92f71b3e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:20.268370 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40563535-eb2c-4e43-a6b7-c7cd958dbf85 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:20.397807 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2787/5605] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:33:20 2022] POST /identity/v3/projects => generated 387 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:33:20.402778 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a999cb-d72a-4c09-955f-b50c306e0584 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:20.431983 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-40563535-eb2c-4e43-a6b7-c7cd958dbf85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b971c2d1ade9426c9f9ffbbc92f71b3e', 'request_id': 'req-40563535-eb2c-4e43-a6b7-c7cd958dbf85'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:20.439627 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-40563535-eb2c-4e43-a6b7-c7cd958dbf85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b971c2d1ade9426c9f9ffbbc92f71b3e', 'request_id': 'req-40563535-eb2c-4e43-a6b7-c7cd958dbf85'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:20.502453 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a999cb-d72a-4c09-955f-b50c306e0584 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:20.507238 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb24e5d-2c75-46f5-bb6f-2c782011750f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:20.507939 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb24e5d-2c75-46f5-bb6f-2c782011750f admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:20.508222 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb24e5d-2c75-46f5-bb6f-2c782011750f admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:20.508497 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb24e5d-2c75-46f5-bb6f-2c782011750f admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:20.509627 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb24e5d-2c75-46f5-bb6f-2c782011750f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:20.511992 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb24e5d-2c75-46f5-bb6f-2c782011750f admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:20.516162 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-40563535-eb2c-4e43-a6b7-c7cd958dbf85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b971c2d1ade9426c9f9ffbbc92f71b3e', 'request_id': 'req-40563535-eb2c-4e43-a6b7-c7cd958dbf85'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:20.528584 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-40563535-eb2c-4e43-a6b7-c7cd958dbf85 admin admin] The token cache is being invalidate because project b971c2d1ade9426c9f9ffbbc92f71b3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:33:20.529190 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-40563535-eb2c-4e43-a6b7-c7cd958dbf85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:20.530063 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-40563535-eb2c-4e43-a6b7-c7cd958dbf85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:20.531773 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2819/5606] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:33:20 2022] DELETE /identity/v3/projects/b971c2d1ade9426c9f9ffbbc92f71b3e => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:20.536605 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36a93b-49b0-40bc-ab02-94996b5ace4e None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:20.537141 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36a93b-49b0-40bc-ab02-94996b5ace4e None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:20.537428 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36a93b-49b0-40bc-ab02-94996b5ace4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:20.562655 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-6b36a93b-49b0-40bc-ab02-94996b5ace4e None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:33:20.562655 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-6b36a93b-49b0-40bc-ab02-94996b5ace4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:20.567494 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2820/5607] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:33:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:33:20.575273 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd69f973-a1ae-4b3c-a426-8760559ed46c None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:20.575583 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd69f973-a1ae-4b3c-a426-8760559ed46c None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:20.575861 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd69f973-a1ae-4b3c-a426-8760559ed46c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:20.594281 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-dd69f973-a1ae-4b3c-a426-8760559ed46c None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:33:20.595810 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-dd69f973-a1ae-4b3c-a426-8760559ed46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:20.602291 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2788/5608] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:33:20 2022] POST /identity/v3/users => generated 300 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:33:20.607529 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2821/5609] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:33:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:33:20.607529 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd69f973-a1ae-4b3c-a426-8760559ed46c None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:20.607971 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-dd69f973-a1ae-4b3c-a426-8760559ed46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:20.609278 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb24e5d-2c75-46f5-bb6f-2c782011750f admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:20.620529 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb24e5d-2c75-46f5-bb6f-2c782011750f admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:20.620736 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd69f973-a1ae-4b3c-a426-8760559ed46c None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:20.625646 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8179cd49-8b86-447b-9063-6cfa1202f208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:20.626403 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179cd49-8b86-447b-9063-6cfa1202f208 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:20.626695 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179cd49-8b86-447b-9063-6cfa1202f208 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:20.627308 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179cd49-8b86-447b-9063-6cfa1202f208 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:20.627425 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411d9460-fe42-4b55-b4ed-408de207f2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:20.627732 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8179cd49-8b86-447b-9063-6cfa1202f208 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:33:20.627964 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411d9460-fe42-4b55-b4ed-408de207f2c2 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:20.628069 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8179cd49-8b86-447b-9063-6cfa1202f208 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:20.628244 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411d9460-fe42-4b55-b4ed-408de207f2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:20.628893 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411d9460-fe42-4b55-b4ed-408de207f2c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:20.629293 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411d9460-fe42-4b55-b4ed-408de207f2c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:20.629644 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8179cd49-8b86-447b-9063-6cfa1202f208 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:20.631035 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411d9460-fe42-4b55-b4ed-408de207f2c2 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:20.645402 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2822/5610] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:33:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:33:20.650236 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411d9460-fe42-4b55-b4ed-408de207f2c2 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:20.655759 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2789/5611] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:33:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:33:20.660281 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8179cd49-8b86-447b-9063-6cfa1202f208 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:20.665023 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411d9460-fe42-4b55-b4ed-408de207f2c2 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:20.671111 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9440f7b-a704-47e9-a6d9-d2a895c0e467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:20.672201 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9440f7b-a704-47e9-a6d9-d2a895c0e467 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:20.672489 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9440f7b-a704-47e9-a6d9-d2a895c0e467 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:20.673086 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9440f7b-a704-47e9-a6d9-d2a895c0e467 admin admin] PATH_INFO: `/v3/projects/a499a459a2c74d81a59092a0e8eedefb/users/89319d7176c948779a4ef1f0f9781187/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:20.675158 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8179cd49-8b86-447b-9063-6cfa1202f208 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:20.681095 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da29cffe-5a1b-4b25-a6b1-1aa31a96414e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:20.681992 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29cffe-5a1b-4b25-a6b1-1aa31a96414e admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:20.682375 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29cffe-5a1b-4b25-a6b1-1aa31a96414e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:20.682746 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29cffe-5a1b-4b25-a6b1-1aa31a96414e admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:20.683581 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da29cffe-5a1b-4b25-a6b1-1aa31a96414e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:20.685631 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da29cffe-5a1b-4b25-a6b1-1aa31a96414e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:20.693242 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9440f7b-a704-47e9-a6d9-d2a895c0e467 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a499a459a2c74d81a59092a0e8eedefb, user_id=89319d7176c948779a4ef1f0f9781187, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:20.712238 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9440f7b-a704-47e9-a6d9-d2a895c0e467 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:20.809937 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2823/5612] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:33:20 2022] PUT /identity/v3/projects/a499a459a2c74d81a59092a0e8eedefb/users/89319d7176c948779a4ef1f0f9781187/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:20.814324 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9440f7b-a704-47e9-a6d9-d2a895c0e467 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:20.822510 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2790/5613] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:33:20 2022] POST /identity/v3/projects => generated 369 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:33:20.826634 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da29cffe-5a1b-4b25-a6b1-1aa31a96414e admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:20.885513 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9440f7b-a704-47e9-a6d9-d2a895c0e467 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:20.894552 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbf0d88-6870-4d24-896b-7b01edd80f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:20.895121 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf0d88-6870-4d24-896b-7b01edd80f7a admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:20.895403 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf0d88-6870-4d24-896b-7b01edd80f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:20.895709 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf0d88-6870-4d24-896b-7b01edd80f7a admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:20.896802 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbf0d88-6870-4d24-896b-7b01edd80f7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:20.898046 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbf0d88-6870-4d24-896b-7b01edd80f7a admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:20.898555 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da29cffe-5a1b-4b25-a6b1-1aa31a96414e admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:20.915333 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2824/5614] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:33:20 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:33:20.915918 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f012d60e-e6b8-4b9b-90f2-37556577fb65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:20.915918 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012d60e-e6b8-4b9b-90f2-37556577fb65 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:20.915918 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012d60e-e6b8-4b9b-90f2-37556577fb65 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:20.915918 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012d60e-e6b8-4b9b-90f2-37556577fb65 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:20.916295 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f012d60e-e6b8-4b9b-90f2-37556577fb65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:20.918783 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f012d60e-e6b8-4b9b-90f2-37556577fb65 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:20.931664 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbf0d88-6870-4d24-896b-7b01edd80f7a admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:20.943872 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbf0d88-6870-4d24-896b-7b01edd80f7a admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:20.950947 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba242932-bd1b-4a1b-9701-c7af406df2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:20.952752 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba242932-bd1b-4a1b-9701-c7af406df2b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:20.960674 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba242932-bd1b-4a1b-9701-c7af406df2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:20.960674 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba242932-bd1b-4a1b-9701-c7af406df2b8 admin admin] PATH_INFO: `/v3/projects/a499a459a2c74d81a59092a0e8eedefb/users/89319d7176c948779a4ef1f0f9781187/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:20.960674 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba242932-bd1b-4a1b-9701-c7af406df2b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a499a459a2c74d81a59092a0e8eedefb, user_id=89319d7176c948779a4ef1f0f9781187, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:20.960674 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba242932-bd1b-4a1b-9701-c7af406df2b8 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:20.971266 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2825/5615] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:33:20 2022] PUT /identity/v3/projects/a499a459a2c74d81a59092a0e8eedefb/users/89319d7176c948779a4ef1f0f9781187/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:20.986686 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95273db5-bf28-431d-823a-07f8f12e0e53 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:20.986854 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95273db5-bf28-431d-823a-07f8f12e0e53 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:20.987040 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95273db5-bf28-431d-823a-07f8f12e0e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:21.016496 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-95273db5-bf28-431d-823a-07f8f12e0e53 None None] MFA Rules not processed for user `89319d7176c948779a4ef1f0f9781187`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:33:21.018091 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-95273db5-bf28-431d-823a-07f8f12e0e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:21.131222 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2826/5616] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:33:20 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:33:21.133314 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95273db5-bf28-431d-823a-07f8f12e0e53 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:21.146604 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95273db5-bf28-431d-823a-07f8f12e0e53 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:21.154588 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd37277-d6d3-4195-9e2b-631fe8f2a8fa tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89319d7176c948779a4ef1f0f9781187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a499a459a2c74d81a59092a0e8eedefb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:21.156126 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd37277-d6d3-4195-9e2b-631fe8f2a8fa tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:21.156577 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd37277-d6d3-4195-9e2b-631fe8f2a8fa tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:21.157017 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd37277-d6d3-4195-9e2b-631fe8f2a8fa tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] PATH_INFO: `/v3/projects/dd659514e6fa4b619978b0fa9173b4f2` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:21.158444 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd37277-d6d3-4195-9e2b-631fe8f2a8fa tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] RBAC: Authorizing `identity:get_project(project_id=dd659514e6fa4b619978b0fa9173b4f2)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:21.160993 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd37277-d6d3-4195-9e2b-631fe8f2a8fa tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:21.163566 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2827/5617] 10.222.0.52 () {58 vars in 1229 bytes} [Sat May 14 21:33:21 2022] GET /identity/v3/projects/dd659514e6fa4b619978b0fa9173b4f2 => generated 385 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:33:21.167240 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd37277-d6d3-4195-9e2b-631fe8f2a8fa tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:21.169031 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2791/5618] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:33:20 2022] POST /identity/v3/users => generated 285 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:33:21.177557 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f012d60e-e6b8-4b9b-90f2-37556577fb65 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:21.178751 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd37277-d6d3-4195-9e2b-631fe8f2a8fa tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:21.184784 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4dae97-7399-47e3-9dff-0cb56dcc4246 tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89319d7176c948779a4ef1f0f9781187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a499a459a2c74d81a59092a0e8eedefb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:21.185545 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4dae97-7399-47e3-9dff-0cb56dcc4246 tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:21.185912 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4dae97-7399-47e3-9dff-0cb56dcc4246 tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:21.186267 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4dae97-7399-47e3-9dff-0cb56dcc4246 tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:21.187069 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4dae97-7399-47e3-9dff-0cb56dcc4246 tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:21.189059 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4dae97-7399-47e3-9dff-0cb56dcc4246 tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:21.189171 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f012d60e-e6b8-4b9b-90f2-37556577fb65 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:21.260071 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e3c47d-0466-4459-a6b7-b6da9f8855e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:21.260766 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e3c47d-0466-4459-a6b7-b6da9f8855e5 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:21.261076 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e3c47d-0466-4459-a6b7-b6da9f8855e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:21.261436 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e3c47d-0466-4459-a6b7-b6da9f8855e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:21.262093 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e3c47d-0466-4459-a6b7-b6da9f8855e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:21.263782 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e3c47d-0466-4459-a6b7-b6da9f8855e5 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:21.280042 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2828/5619] 10.222.0.52 () {60 vars in 1151 bytes} [Sat May 14 21:33:21 2022] POST /identity/v3/projects => generated 338 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:33:21.283524 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2792/5620] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:33:21 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:33:21.284512 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4dae97-7399-47e3-9dff-0cb56dcc4246 tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:21.285253 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e3c47d-0466-4459-a6b7-b6da9f8855e5 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:21.296858 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e3c47d-0466-4459-a6b7-b6da9f8855e5 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:21.367289 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf72af-507f-4c92-ab58-33c7006c2522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:21.369821 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf72af-507f-4c92-ab58-33c7006c2522 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:21.370120 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf72af-507f-4c92-ab58-33c7006c2522 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:21.370405 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf72af-507f-4c92-ab58-33c7006c2522 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:21.371145 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cf72af-507f-4c92-ab58-33c7006c2522 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:21.373020 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cf72af-507f-4c92-ab58-33c7006c2522 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:21.385482 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2793/5621] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:33:21 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:33:21.389791 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf72af-507f-4c92-ab58-33c7006c2522 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:21.394872 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4dae97-7399-47e3-9dff-0cb56dcc4246 tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:21.402307 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf72af-507f-4c92-ab58-33c7006c2522 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:21.403219 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760210d9-dcac-4c2e-ba68-cab7d5ec13cd tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89319d7176c948779a4ef1f0f9781187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a499a459a2c74d81a59092a0e8eedefb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:21.404237 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760210d9-dcac-4c2e-ba68-cab7d5ec13cd tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:21.404535 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760210d9-dcac-4c2e-ba68-cab7d5ec13cd tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:21.404910 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760210d9-dcac-4c2e-ba68-cab7d5ec13cd tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:21.405841 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760210d9-dcac-4c2e-ba68-cab7d5ec13cd tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:21.407885 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59987c7-acb6-4018-86ec-0a899dbc069b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:21.408288 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760210d9-dcac-4c2e-ba68-cab7d5ec13cd tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:21.408919 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59987c7-acb6-4018-86ec-0a899dbc069b admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:21.409273 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59987c7-acb6-4018-86ec-0a899dbc069b admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:21.409630 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59987c7-acb6-4018-86ec-0a899dbc069b admin admin] PATH_INFO: `/v3/projects/eae50436f3714e2cbb5deeb6574aee2e/users/e1f0a129bbe5424ea8d1243ccb5741f9/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:21.432822 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2829/5622] 10.222.0.52 () {58 vars in 1130 bytes} [Sat May 14 21:33:21 2022] GET /identity/v3/projects => generated 6928 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:33:21.438319 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760210d9-dcac-4c2e-ba68-cab7d5ec13cd tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:21.452398 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760210d9-dcac-4c2e-ba68-cab7d5ec13cd tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:21.458332 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59987c7-acb6-4018-86ec-0a899dbc069b admin admin] RBAC: Authorizing `identity:create_grant(project_id=eae50436f3714e2cbb5deeb6574aee2e, user_id=e1f0a129bbe5424ea8d1243ccb5741f9, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:21.459235 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55113802-09d7-4f41-b8e9-9aabb9b4b12c tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89319d7176c948779a4ef1f0f9781187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a499a459a2c74d81a59092a0e8eedefb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:21.460453 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55113802-09d7-4f41-b8e9-9aabb9b4b12c tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:21.460846 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55113802-09d7-4f41-b8e9-9aabb9b4b12c tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:21.461228 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55113802-09d7-4f41-b8e9-9aabb9b4b12c tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] PATH_INFO: `/v3/projects/dd659514e6fa4b619978b0fa9173b4f2` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:21.462711 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55113802-09d7-4f41-b8e9-9aabb9b4b12c tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] RBAC: Authorizing `identity:get_project(project_id=dd659514e6fa4b619978b0fa9173b4f2)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:21.462853 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59987c7-acb6-4018-86ec-0a899dbc069b admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:21.466726 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55113802-09d7-4f41-b8e9-9aabb9b4b12c tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:21.470135 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2830/5623] 10.222.0.52 () {58 vars in 1229 bytes} [Sat May 14 21:33:21 2022] GET /identity/v3/projects/dd659514e6fa4b619978b0fa9173b4f2 => generated 385 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:33:21.474174 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55113802-09d7-4f41-b8e9-9aabb9b4b12c tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:21.486895 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55113802-09d7-4f41-b8e9-9aabb9b4b12c tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:21.496724 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39505c33-63f5-41ec-bc21-4b45df77bfa3 tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89319d7176c948779a4ef1f0f9781187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a499a459a2c74d81a59092a0e8eedefb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:21.498117 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39505c33-63f5-41ec-bc21-4b45df77bfa3 tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:21.498589 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39505c33-63f5-41ec-bc21-4b45df77bfa3 tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:21.499048 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39505c33-63f5-41ec-bc21-4b45df77bfa3 tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] PATH_INFO: `/v3/projects/9d5f2588e97a490f84cf8b3cd34bcd2f` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:21.501784 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39505c33-63f5-41ec-bc21-4b45df77bfa3 tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] RBAC: Authorizing `identity:get_project(project_id=9d5f2588e97a490f84cf8b3cd34bcd2f)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:21.504709 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39505c33-63f5-41ec-bc21-4b45df77bfa3 tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:21.507211 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2831/5624] 10.222.0.52 () {58 vars in 1229 bytes} [Sat May 14 21:33:21 2022] GET /identity/v3/projects/9d5f2588e97a490f84cf8b3cd34bcd2f => generated 338 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:33:21.513471 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39505c33-63f5-41ec-bc21-4b45df77bfa3 tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:21.524387 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39505c33-63f5-41ec-bc21-4b45df77bfa3 tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:21.532128 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e34ad67-b92d-4b22-9429-1798e7043872 tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89319d7176c948779a4ef1f0f9781187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a499a459a2c74d81a59092a0e8eedefb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:21.533243 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34ad67-b92d-4b22-9429-1798e7043872 tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:21.533573 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34ad67-b92d-4b22-9429-1798e7043872 tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:21.533862 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34ad67-b92d-4b22-9429-1798e7043872 tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:21.534607 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e34ad67-b92d-4b22-9429-1798e7043872 tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:21.536546 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e34ad67-b92d-4b22-9429-1798e7043872 tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:21.559935 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2832/5625] 10.222.0.52 () {58 vars in 1130 bytes} [Sat May 14 21:33:21 2022] GET /identity/v3/projects => generated 6928 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:33:21.565025 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e34ad67-b92d-4b22-9429-1798e7043872 tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:21.577701 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e34ad67-b92d-4b22-9429-1798e7043872 tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:21.586581 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2794/5626] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:33:21 2022] PUT /identity/v3/projects/eae50436f3714e2cbb5deeb6574aee2e/users/e1f0a129bbe5424ea8d1243ccb5741f9/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:33:21.601752 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e14e960-a593-4d9d-9ed4-58e2f05ae499 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:21.602246 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e14e960-a593-4d9d-9ed4-58e2f05ae499 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:21.602705 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e14e960-a593-4d9d-9ed4-58e2f05ae499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:21.650975 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d8a8fa-6d3b-452c-b890-2e3002a84898 tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89319d7176c948779a4ef1f0f9781187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a499a459a2c74d81a59092a0e8eedefb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:21.651799 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d8a8fa-6d3b-452c-b890-2e3002a84898 tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:21.652144 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d8a8fa-6d3b-452c-b890-2e3002a84898 tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:21.652377 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d8a8fa-6d3b-452c-b890-2e3002a84898 tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:21.653182 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d8a8fa-6d3b-452c-b890-2e3002a84898 tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:33:21.653494 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d8a8fa-6d3b-452c-b890-2e3002a84898 tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:21.655567 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d8a8fa-6d3b-452c-b890-2e3002a84898 tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:21.659520 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-8e14e960-a593-4d9d-9ed4-58e2f05ae499 None None] MFA Rules not processed for user `e1f0a129bbe5424ea8d1243ccb5741f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:33:21.661038 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8e14e960-a593-4d9d-9ed4-58e2f05ae499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:21.686117 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2833/5627] 10.222.0.52 () {58 vars in 1165 bytes} [Sat May 14 21:33:21 2022] GET /identity/v3/projects?domain_id=default => generated 6597 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:33:21.687994 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d8a8fa-6d3b-452c-b890-2e3002a84898 tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:21.707073 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d8a8fa-6d3b-452c-b890-2e3002a84898 tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:21.718982 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca0fa8f-c105-46b3-8c02-b1ab18ad732a tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89319d7176c948779a4ef1f0f9781187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a499a459a2c74d81a59092a0e8eedefb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:21.720413 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0fa8f-c105-46b3-8c02-b1ab18ad732a tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:21.720813 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0fa8f-c105-46b3-8c02-b1ab18ad732a tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:21.721608 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0fa8f-c105-46b3-8c02-b1ab18ad732a tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:21.722467 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca0fa8f-c105-46b3-8c02-b1ab18ad732a tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:21.726625 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca0fa8f-c105-46b3-8c02-b1ab18ad732a tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:21.763528 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2834/5628] 10.222.0.52 () {58 vars in 1130 bytes} [Sat May 14 21:33:21 2022] GET /identity/v3/projects => generated 6928 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:33:21.764753 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca0fa8f-c105-46b3-8c02-b1ab18ad732a tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:21.787004 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca0fa8f-c105-46b3-8c02-b1ab18ad732a tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:21.795517 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2504cf0-c215-4086-8eaa-89b511700c39 tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89319d7176c948779a4ef1f0f9781187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a499a459a2c74d81a59092a0e8eedefb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:21.797418 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2504cf0-c215-4086-8eaa-89b511700c39 tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:21.797899 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2504cf0-c215-4086-8eaa-89b511700c39 tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:21.798378 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2504cf0-c215-4086-8eaa-89b511700c39 tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:21.800112 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2504cf0-c215-4086-8eaa-89b511700c39 tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:33:21.800608 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2504cf0-c215-4086-8eaa-89b511700c39 tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:21.805022 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2504cf0-c215-4086-8eaa-89b511700c39 tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:21.815238 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2795/5629] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:33:21 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:33:21.819394 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e14e960-a593-4d9d-9ed4-58e2f05ae499 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:21.838616 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2835/5630] 10.222.0.52 () {58 vars in 1165 bytes} [Sat May 14 21:33:21 2022] GET /identity/v3/projects?domain_id=default => generated 6597 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:33:21.840325 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2504cf0-c215-4086-8eaa-89b511700c39 tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:21.853235 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2504cf0-c215-4086-8eaa-89b511700c39 tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:21.859220 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c29aa8c-de86-488a-a230-055cde7a6ceb tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89319d7176c948779a4ef1f0f9781187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a499a459a2c74d81a59092a0e8eedefb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:21.860187 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c29aa8c-de86-488a-a230-055cde7a6ceb tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:21.860636 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c29aa8c-de86-488a-a230-055cde7a6ceb tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:21.861077 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c29aa8c-de86-488a-a230-055cde7a6ceb tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:21.862040 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c29aa8c-de86-488a-a230-055cde7a6ceb tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:21.864124 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c29aa8c-de86-488a-a230-055cde7a6ceb tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:21.893089 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2836/5631] 10.222.0.52 () {58 vars in 1130 bytes} [Sat May 14 21:33:21 2022] GET /identity/v3/projects => generated 6928 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:33:21.900071 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c29aa8c-de86-488a-a230-055cde7a6ceb tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:21.923695 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e14e960-a593-4d9d-9ed4-58e2f05ae499 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:21.926365 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c29aa8c-de86-488a-a230-055cde7a6ceb tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:21.938857 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5517b4e-65dd-41c5-bfd2-075aa17f26e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:21.940241 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba93fb7-5e64-437e-a7c3-7e45679711ca tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89319d7176c948779a4ef1f0f9781187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a499a459a2c74d81a59092a0e8eedefb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:21.944876 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5517b4e-65dd-41c5-bfd2-075aa17f26e0 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:21.944876 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5517b4e-65dd-41c5-bfd2-075aa17f26e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:21.945055 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba93fb7-5e64-437e-a7c3-7e45679711ca tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:21.945168 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5517b4e-65dd-41c5-bfd2-075aa17f26e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:21.945263 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba93fb7-5e64-437e-a7c3-7e45679711ca tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:21.945263 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba93fb7-5e64-437e-a7c3-7e45679711ca tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:21.945426 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5517b4e-65dd-41c5-bfd2-075aa17f26e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:21.945500 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba93fb7-5e64-437e-a7c3-7e45679711ca tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] RBAC: Adding query filter params (name=tempest-ListProjectsStaticTestJSON-61009253) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:33:21.945500 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba93fb7-5e64-437e-a7c3-7e45679711ca tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:21.945643 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5517b4e-65dd-41c5-bfd2-075aa17f26e0 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:21.945718 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba93fb7-5e64-437e-a7c3-7e45679711ca tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:21.976369 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2837/5632] 10.222.0.52 () {58 vars in 1227 bytes} [Sat May 14 21:33:21 2022] GET /identity/v3/projects?name=tempest-ListProjectsStaticTestJSON-61009253 => generated 531 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:33:21.977917 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba93fb7-5e64-437e-a7c3-7e45679711ca tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:21.992434 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba93fb7-5e64-437e-a7c3-7e45679711ca tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:22.000764 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795c928-de72-4969-9604-0505307826f4 tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89319d7176c948779a4ef1f0f9781187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a499a459a2c74d81a59092a0e8eedefb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:22.001836 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795c928-de72-4969-9604-0505307826f4 tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:22.002250 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795c928-de72-4969-9604-0505307826f4 tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:22.002794 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795c928-de72-4969-9604-0505307826f4 tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] PATH_INFO: `/v3/projects/9d5f2588e97a490f84cf8b3cd34bcd2f` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:22.004140 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d795c928-de72-4969-9604-0505307826f4 tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9d5f2588e97a490f84cf8b3cd34bcd2f)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:22.007318 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d795c928-de72-4969-9604-0505307826f4 tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:22.049093 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2796/5633] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:33:21 2022] POST /identity/v3/projects => generated 369 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:33:22.053785 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5517b4e-65dd-41c5-bfd2-075aa17f26e0 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:22.150549 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d795c928-de72-4969-9604-0505307826f4 tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d5f2588e97a490f84cf8b3cd34bcd2f', 'request_id': 'req-d795c928-de72-4969-9604-0505307826f4'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:22.153658 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5517b4e-65dd-41c5-bfd2-075aa17f26e0 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:22.161767 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d795c928-de72-4969-9604-0505307826f4 tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d5f2588e97a490f84cf8b3cd34bcd2f', 'request_id': 'req-d795c928-de72-4969-9604-0505307826f4'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:22.231390 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e56eeb-ef5f-461c-9499-173ccd352f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:22.232126 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e56eeb-ef5f-461c-9499-173ccd352f99 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:22.232415 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e56eeb-ef5f-461c-9499-173ccd352f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:22.232868 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e56eeb-ef5f-461c-9499-173ccd352f99 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:22.233604 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e56eeb-ef5f-461c-9499-173ccd352f99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:22.235610 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e56eeb-ef5f-461c-9499-173ccd352f99 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:22.244244 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d795c928-de72-4969-9604-0505307826f4 tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d5f2588e97a490f84cf8b3cd34bcd2f', 'request_id': 'req-d795c928-de72-4969-9604-0505307826f4'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:22.258174 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d795c928-de72-4969-9604-0505307826f4 tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] The token cache is being invalidate because project 9d5f2588e97a490f84cf8b3cd34bcd2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:33:22.258467 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d795c928-de72-4969-9604-0505307826f4 tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:22.259994 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d795c928-de72-4969-9604-0505307826f4 tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:22.261599 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2838/5634] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:33:21 2022] DELETE /identity/v3/projects/9d5f2588e97a490f84cf8b3cd34bcd2f => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:22.265407 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795c928-de72-4969-9604-0505307826f4 tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:22.267146 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d795c928-de72-4969-9604-0505307826f4 tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:22.281538 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795c928-de72-4969-9604-0505307826f4 tempest-ListProjectsStaticTestJSON-279827652 tempest-ListProjectsStaticTestJSON-279827652-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:22.302552 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2797/5635] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:33:22 2022] POST /identity/v3/users => generated 291 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:33:22.308886 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e56eeb-ef5f-461c-9499-173ccd352f99 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:22.312225 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-25e56eeb-ef5f-461c-9499-173ccd352f99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:22.317206 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a37651-49ae-4e63-91b3-8bd2aa1bde01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:22.318107 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a37651-49ae-4e63-91b3-8bd2aa1bde01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:22.318393 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a37651-49ae-4e63-91b3-8bd2aa1bde01 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:22.318674 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a37651-49ae-4e63-91b3-8bd2aa1bde01 admin admin] PATH_INFO: `/v3/users/8319ab9ac944416ab01583a57750c5f0` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:22.331635 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a37651-49ae-4e63-91b3-8bd2aa1bde01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8319ab9ac944416ab01583a57750c5f0)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:22.333642 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a37651-49ae-4e63-91b3-8bd2aa1bde01 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:22.354355 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e56eeb-ef5f-461c-9499-173ccd352f99 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:22.365153 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b23ce86-230d-4f37-bca0-ed39458690b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:22.365846 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b23ce86-230d-4f37-bca0-ed39458690b1 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:22.366627 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b23ce86-230d-4f37-bca0-ed39458690b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:22.366907 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b23ce86-230d-4f37-bca0-ed39458690b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:22.367939 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b23ce86-230d-4f37-bca0-ed39458690b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:22.369908 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b23ce86-230d-4f37-bca0-ed39458690b1 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:22.387326 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2798/5636] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:33:22 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:33:22.392101 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b23ce86-230d-4f37-bca0-ed39458690b1 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:22.407130 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b23ce86-230d-4f37-bca0-ed39458690b1 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:22.418510 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997cdfca-6003-4856-9158-25a7ab57902e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:22.419965 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997cdfca-6003-4856-9158-25a7ab57902e admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:22.420260 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997cdfca-6003-4856-9158-25a7ab57902e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:22.420537 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997cdfca-6003-4856-9158-25a7ab57902e admin admin] PATH_INFO: `/v3/projects/6399289b82f54d2181dc635e73f101ef/users/3f8f92cd5f6f44e386dae212364d79b8/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:22.442909 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997cdfca-6003-4856-9158-25a7ab57902e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6399289b82f54d2181dc635e73f101ef, user_id=3f8f92cd5f6f44e386dae212364d79b8, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:22.446524 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997cdfca-6003-4856-9158-25a7ab57902e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:22.533000 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2799/5637] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:33:22 2022] PUT /identity/v3/projects/6399289b82f54d2181dc635e73f101ef/users/3f8f92cd5f6f44e386dae212364d79b8/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:22.534042 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997cdfca-6003-4856-9158-25a7ab57902e admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:22.603021 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-86a37651-49ae-4e63-91b3-8bd2aa1bde01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8319ab9ac944416ab01583a57750c5f0'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:22.628055 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-86a37651-49ae-4e63-91b3-8bd2aa1bde01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8319ab9ac944416ab01583a57750c5f0'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:22.636233 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-86a37651-49ae-4e63-91b3-8bd2aa1bde01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8319ab9ac944416ab01583a57750c5f0'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:22.643024 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997cdfca-6003-4856-9158-25a7ab57902e admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:22.655728 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00adc5ca-b6eb-4f1a-82b6-7e5e633f54cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:22.656573 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00adc5ca-b6eb-4f1a-82b6-7e5e633f54cd admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:22.656927 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00adc5ca-b6eb-4f1a-82b6-7e5e633f54cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:22.657796 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00adc5ca-b6eb-4f1a-82b6-7e5e633f54cd admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:22.658091 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00adc5ca-b6eb-4f1a-82b6-7e5e633f54cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:22.659860 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00adc5ca-b6eb-4f1a-82b6-7e5e633f54cd admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:22.676782 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2800/5638] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:33:22 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:33:22.677809 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00adc5ca-b6eb-4f1a-82b6-7e5e633f54cd admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:22.688368 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00adc5ca-b6eb-4f1a-82b6-7e5e633f54cd admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:22.695099 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-86a37651-49ae-4e63-91b3-8bd2aa1bde01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8319ab9ac944416ab01583a57750c5f0'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:22.696058 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-86a37651-49ae-4e63-91b3-8bd2aa1bde01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8319ab9ac944416ab01583a57750c5f0'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:22.708664 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaebaf7-ed06-4dec-a308-7b6b4028f9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:22.709815 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2839/5639] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:33:22 2022] DELETE /identity/v3/users/8319ab9ac944416ab01583a57750c5f0 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:33:22.710618 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaebaf7-ed06-4dec-a308-7b6b4028f9e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:22.711050 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaebaf7-ed06-4dec-a308-7b6b4028f9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:22.711544 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaebaf7-ed06-4dec-a308-7b6b4028f9e8 admin admin] PATH_INFO: `/v3/projects/6399289b82f54d2181dc635e73f101ef/users/3f8f92cd5f6f44e386dae212364d79b8/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:22.715452 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9606023-8447-4827-85cd-fef63b48a265 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:22.715991 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9606023-8447-4827-85cd-fef63b48a265 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:22.717370 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9606023-8447-4827-85cd-fef63b48a265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:22.720559 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaebaf7-ed06-4dec-a308-7b6b4028f9e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6399289b82f54d2181dc635e73f101ef, user_id=3f8f92cd5f6f44e386dae212364d79b8, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:22.723565 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaebaf7-ed06-4dec-a308-7b6b4028f9e8 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:22.738542 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2801/5640] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:33:22 2022] PUT /identity/v3/projects/6399289b82f54d2181dc635e73f101ef/users/3f8f92cd5f6f44e386dae212364d79b8/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:22.739235 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-a9606023-8447-4827-85cd-fef63b48a265 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:33:22.740806 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-a9606023-8447-4827-85cd-fef63b48a265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:22.750525 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee035d6-c431-444b-b5cc-fc3ef26aa72e None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:22.750728 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee035d6-c431-444b-b5cc-fc3ef26aa72e None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:22.750952 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee035d6-c431-444b-b5cc-fc3ef26aa72e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:22.781399 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-0ee035d6-c431-444b-b5cc-fc3ef26aa72e None None] MFA Rules not processed for user `3f8f92cd5f6f44e386dae212364d79b8`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:33:22.782884 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-0ee035d6-c431-444b-b5cc-fc3ef26aa72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:22.830474 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2840/5641] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:33:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:33:22.851870 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9606023-8447-4827-85cd-fef63b48a265 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:22.854428 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-a9606023-8447-4827-85cd-fef63b48a265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:22.879134 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2802/5642] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:33:22 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:33:22.898959 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee035d6-c431-444b-b5cc-fc3ef26aa72e None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:22.902758 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee035d6-c431-444b-b5cc-fc3ef26aa72e None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:22.910362 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f5b2ff-3d2a-4845-99a4-cf91d747d827 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f8f92cd5f6f44e386dae212364d79b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6399289b82f54d2181dc635e73f101ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:22.911190 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f5b2ff-3d2a-4845-99a4-cf91d747d827 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:22.911514 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f5b2ff-3d2a-4845-99a4-cf91d747d827 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:22.911811 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f5b2ff-3d2a-4845-99a4-cf91d747d827 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:22.912647 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f5b2ff-3d2a-4845-99a4-cf91d747d827 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:22.917047 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f5b2ff-3d2a-4845-99a4-cf91d747d827 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:22.952305 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9606023-8447-4827-85cd-fef63b48a265 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:22.956116 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b596d399-0997-4f5b-97db-57eaa7790bee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:22.956779 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b596d399-0997-4f5b-97db-57eaa7790bee service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:22.957061 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b596d399-0997-4f5b-97db-57eaa7790bee service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:22.957335 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b596d399-0997-4f5b-97db-57eaa7790bee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:22.969092 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b596d399-0997-4f5b-97db-57eaa7790bee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:22.971929 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b596d399-0997-4f5b-97db-57eaa7790bee service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:22.988235 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2841/5643] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:33:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:33:23.025561 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2803/5644] 10.222.0.52 () {60 vars in 1148 bytes} [Sat May 14 21:33:22 2022] POST /identity/v3/domains => generated 277 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:33:23.027530 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b596d399-0997-4f5b-97db-57eaa7790bee service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:23.042320 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b596d399-0997-4f5b-97db-57eaa7790bee service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:23.170545 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b01361-2a88-48c3-b426-27978e8193de tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f8f92cd5f6f44e386dae212364d79b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6399289b82f54d2181dc635e73f101ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:23.177003 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b01361-2a88-48c3-b426-27978e8193de tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:23.177003 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b01361-2a88-48c3-b426-27978e8193de tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:23.177003 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b01361-2a88-48c3-b426-27978e8193de tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] PATH_INFO: `/v3/groups` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:23.177003 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b01361-2a88-48c3-b426-27978e8193de tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:23.177003 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b01361-2a88-48c3-b426-27978e8193de tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:23.297480 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2842/5645] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:33:23 2022] POST /identity/v3/groups => generated 279 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:33:23.298725 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f5b2ff-3d2a-4845-99a4-cf91d747d827 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:23.313222 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f5b2ff-3d2a-4845-99a4-cf91d747d827 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:23.319949 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44713b28-6fb9-47c9-b8fc-92b30e13b8b1 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f8f92cd5f6f44e386dae212364d79b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6399289b82f54d2181dc635e73f101ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:23.322073 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44713b28-6fb9-47c9-b8fc-92b30e13b8b1 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:23.322530 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44713b28-6fb9-47c9-b8fc-92b30e13b8b1 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:23.322989 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44713b28-6fb9-47c9-b8fc-92b30e13b8b1 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] PATH_INFO: `/v3/groups/ef8d8cf22e894e5bb28954075befe91c` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:23.337325 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44713b28-6fb9-47c9-b8fc-92b30e13b8b1 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorizing `identity:update_group(group_id=ef8d8cf22e894e5bb28954075befe91c)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:23.343325 ncdv-master-1 devstack@keystone.service[91107]: WARNING py.warnings [None req-44713b28-6fb9-47c9-b8fc-92b30e13b8b1 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 14 21:33:23.343325 ncdv-master-1 devstack@keystone.service[91107]: warnings.warn(msg) May 14 21:33:23.343325 ncdv-master-1 devstack@keystone.service[91107]: May 14 21:33:23.343325 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44713b28-6fb9-47c9-b8fc-92b30e13b8b1 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:23.438358 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2804/5646] 10.222.0.52 () {60 vars in 1246 bytes} [Sat May 14 21:33:23 2022] PATCH /identity/v3/groups/ef8d8cf22e894e5bb28954075befe91c => generated 291 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:33:23.442418 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b01361-2a88-48c3-b426-27978e8193de tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:23.456237 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b01361-2a88-48c3-b426-27978e8193de tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:23.473183 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d9c30b-b85e-454e-8ac5-f6af436dc7ff tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f8f92cd5f6f44e386dae212364d79b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6399289b82f54d2181dc635e73f101ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:23.474375 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9c30b-b85e-454e-8ac5-f6af436dc7ff tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:23.475223 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9c30b-b85e-454e-8ac5-f6af436dc7ff tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:23.475755 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9c30b-b85e-454e-8ac5-f6af436dc7ff tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] PATH_INFO: `/v3/groups/ef8d8cf22e894e5bb28954075befe91c` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:23.483926 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d9c30b-b85e-454e-8ac5-f6af436dc7ff tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorizing `identity:get_group(group_id=ef8d8cf22e894e5bb28954075befe91c)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:23.485492 ncdv-master-1 devstack@keystone.service[91106]: WARNING py.warnings [None req-f3d9c30b-b85e-454e-8ac5-f6af436dc7ff tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 14 21:33:23.485492 ncdv-master-1 devstack@keystone.service[91106]: warnings.warn(msg) May 14 21:33:23.485492 ncdv-master-1 devstack@keystone.service[91106]: May 14 21:33:23.486561 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d9c30b-b85e-454e-8ac5-f6af436dc7ff tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:23.496251 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2843/5647] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:33:23 2022] GET /identity/v3/groups/ef8d8cf22e894e5bb28954075befe91c => generated 291 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:33:23.506642 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44713b28-6fb9-47c9-b8fc-92b30e13b8b1 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:23.518588 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44713b28-6fb9-47c9-b8fc-92b30e13b8b1 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:23.525868 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e81631-686e-4f52-994f-ce210ee77203 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f8f92cd5f6f44e386dae212364d79b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6399289b82f54d2181dc635e73f101ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:23.526749 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e81631-686e-4f52-994f-ce210ee77203 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:23.527025 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e81631-686e-4f52-994f-ce210ee77203 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:23.531034 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e81631-686e-4f52-994f-ce210ee77203 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] PATH_INFO: `/v3/groups/ef8d8cf22e894e5bb28954075befe91c` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:23.531034 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e81631-686e-4f52-994f-ce210ee77203 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorizing `identity:update_group(group_id=ef8d8cf22e894e5bb28954075befe91c)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:23.531034 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e81631-686e-4f52-994f-ce210ee77203 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:23.646712 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2805/5648] 10.222.0.52 () {60 vars in 1245 bytes} [Sat May 14 21:33:23 2022] PATCH /identity/v3/groups/ef8d8cf22e894e5bb28954075befe91c => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:33:23.650144 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d9c30b-b85e-454e-8ac5-f6af436dc7ff tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:23.665714 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d9c30b-b85e-454e-8ac5-f6af436dc7ff tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:23.679065 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5e1e52-0ff2-429b-b1b3-0e458e24ab35 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f8f92cd5f6f44e386dae212364d79b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6399289b82f54d2181dc635e73f101ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:23.679065 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e1e52-0ff2-429b-b1b3-0e458e24ab35 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:23.679065 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e1e52-0ff2-429b-b1b3-0e458e24ab35 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:23.679555 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e1e52-0ff2-429b-b1b3-0e458e24ab35 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] PATH_INFO: `/v3/groups/ef8d8cf22e894e5bb28954075befe91c` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:23.686590 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5e1e52-0ff2-429b-b1b3-0e458e24ab35 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorizing `identity:delete_group(group_id=ef8d8cf22e894e5bb28954075befe91c)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:23.688957 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5e1e52-0ff2-429b-b1b3-0e458e24ab35 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:23.851606 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2844/5649] 10.222.0.52 () {58 vars in 1226 bytes} [Sat May 14 21:33:23 2022] DELETE /identity/v3/groups/ef8d8cf22e894e5bb28954075befe91c => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:23.858670 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e81631-686e-4f52-994f-ce210ee77203 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:23.870638 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e81631-686e-4f52-994f-ce210ee77203 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:23.985387 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e2a7b-5400-4568-8644-838b47edc875 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f8f92cd5f6f44e386dae212364d79b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6399289b82f54d2181dc635e73f101ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:23.985387 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e2a7b-5400-4568-8644-838b47edc875 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:23.986138 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e2a7b-5400-4568-8644-838b47edc875 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:23.987573 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e2a7b-5400-4568-8644-838b47edc875 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] PATH_INFO: `/v3/groups` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:23.988571 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344e2a7b-5400-4568-8644-838b47edc875 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:23.992636 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344e2a7b-5400-4568-8644-838b47edc875 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:24.072156 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2806/5650] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:33:23 2022] POST /identity/v3/groups => generated 326 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:33:24.076669 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5e1e52-0ff2-429b-b1b3-0e458e24ab35 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:24.090063 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5e1e52-0ff2-429b-b1b3-0e458e24ab35 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:24.095702 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849a6765-0fea-4ebe-9405-40bdca8e3f42 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f8f92cd5f6f44e386dae212364d79b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6399289b82f54d2181dc635e73f101ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:24.096445 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a6765-0fea-4ebe-9405-40bdca8e3f42 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:24.096742 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a6765-0fea-4ebe-9405-40bdca8e3f42 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:24.097049 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a6765-0fea-4ebe-9405-40bdca8e3f42 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:24.097740 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849a6765-0fea-4ebe-9405-40bdca8e3f42 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:24.100341 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849a6765-0fea-4ebe-9405-40bdca8e3f42 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:24.202400 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2845/5651] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:33:24 2022] POST /identity/v3/users => generated 321 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:33:24.206416 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e2a7b-5400-4568-8644-838b47edc875 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:24.218764 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e2a7b-5400-4568-8644-838b47edc875 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:24.224460 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7615924b-f240-45e1-9361-2e3c8a2ca489 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f8f92cd5f6f44e386dae212364d79b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6399289b82f54d2181dc635e73f101ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:24.225474 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615924b-f240-45e1-9361-2e3c8a2ca489 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:24.225958 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615924b-f240-45e1-9361-2e3c8a2ca489 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:24.226236 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615924b-f240-45e1-9361-2e3c8a2ca489 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] PATH_INFO: `/v3/groups/65bc5a68b0c04402b5f31a834deacf39/users/fe49789700474b5a830e291a2a5bfbd0` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:24.269542 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7615924b-f240-45e1-9361-2e3c8a2ca489 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=65bc5a68b0c04402b5f31a834deacf39, user_id=fe49789700474b5a830e291a2a5bfbd0)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:24.269542 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7615924b-f240-45e1-9361-2e3c8a2ca489 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:24.273307 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849a6765-0fea-4ebe-9405-40bdca8e3f42 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:24.275993 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-849a6765-0fea-4ebe-9405-40bdca8e3f42 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:24.490311 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849a6765-0fea-4ebe-9405-40bdca8e3f42 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:24.490311 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00326dcb-934e-4b52-9d11-2bf763c9b15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:24.490311 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00326dcb-934e-4b52-9d11-2bf763c9b15d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:24.495793 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00326dcb-934e-4b52-9d11-2bf763c9b15d admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:24.495793 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00326dcb-934e-4b52-9d11-2bf763c9b15d admin admin] PATH_INFO: `/v3/projects/dd659514e6fa4b619978b0fa9173b4f2` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:24.495793 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00326dcb-934e-4b52-9d11-2bf763c9b15d admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd659514e6fa4b619978b0fa9173b4f2)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:24.495793 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00326dcb-934e-4b52-9d11-2bf763c9b15d admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:24.689872 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2807/5652] 10.222.0.52 () {60 vars in 1359 bytes} [Sat May 14 21:33:24 2022] PUT /identity/v3/groups/65bc5a68b0c04402b5f31a834deacf39/users/fe49789700474b5a830e291a2a5bfbd0 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:24.693806 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7615924b-f240-45e1-9361-2e3c8a2ca489 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:24.756503 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7615924b-f240-45e1-9361-2e3c8a2ca489 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:24.765936 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a051e4a-0970-4679-9464-e7c63818397c tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f8f92cd5f6f44e386dae212364d79b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6399289b82f54d2181dc635e73f101ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:24.767452 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a051e4a-0970-4679-9464-e7c63818397c tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:24.767842 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a051e4a-0970-4679-9464-e7c63818397c tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:24.768196 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a051e4a-0970-4679-9464-e7c63818397c tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:24.768965 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a051e4a-0970-4679-9464-e7c63818397c tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:24.770990 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a051e4a-0970-4679-9464-e7c63818397c tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:24.796971 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-00326dcb-934e-4b52-9d11-2bf763c9b15d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd659514e6fa4b619978b0fa9173b4f2', 'request_id': 'req-00326dcb-934e-4b52-9d11-2bf763c9b15d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:24.810496 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-00326dcb-934e-4b52-9d11-2bf763c9b15d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd659514e6fa4b619978b0fa9173b4f2', 'request_id': 'req-00326dcb-934e-4b52-9d11-2bf763c9b15d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:24.906021 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2808/5653] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:33:24 2022] POST /identity/v3/users => generated 323 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:33:24.910937 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a051e4a-0970-4679-9464-e7c63818397c tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:24.924725 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a051e4a-0970-4679-9464-e7c63818397c tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:24.957874 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-00326dcb-934e-4b52-9d11-2bf763c9b15d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd659514e6fa4b619978b0fa9173b4f2', 'request_id': 'req-00326dcb-934e-4b52-9d11-2bf763c9b15d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:24.987677 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-00326dcb-934e-4b52-9d11-2bf763c9b15d admin admin] The token cache is being invalidate because project dd659514e6fa4b619978b0fa9173b4f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:33:24.990155 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-00326dcb-934e-4b52-9d11-2bf763c9b15d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:24.997819 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-00326dcb-934e-4b52-9d11-2bf763c9b15d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:25.005824 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2846/5654] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:33:24 2022] DELETE /identity/v3/projects/dd659514e6fa4b619978b0fa9173b4f2 => generated 0 bytes in 731 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:33:25.009284 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00326dcb-934e-4b52-9d11-2bf763c9b15d admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:25.012963 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-00326dcb-934e-4b52-9d11-2bf763c9b15d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:25.086470 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb67fec0-035d-49d1-a88f-4d13ba55f60d tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f8f92cd5f6f44e386dae212364d79b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6399289b82f54d2181dc635e73f101ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:25.090149 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb67fec0-035d-49d1-a88f-4d13ba55f60d tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:25.090438 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb67fec0-035d-49d1-a88f-4d13ba55f60d tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:25.090717 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb67fec0-035d-49d1-a88f-4d13ba55f60d tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] PATH_INFO: `/v3/groups/65bc5a68b0c04402b5f31a834deacf39/users/042577c0f460467690e6714de5157431` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:25.126957 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb67fec0-035d-49d1-a88f-4d13ba55f60d tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=65bc5a68b0c04402b5f31a834deacf39, user_id=042577c0f460467690e6714de5157431)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:25.132122 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb67fec0-035d-49d1-a88f-4d13ba55f60d tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:25.170980 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00326dcb-934e-4b52-9d11-2bf763c9b15d admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:25.176658 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a7544c-fd91-4a5f-b1d2-b212e9bc453f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:25.177546 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a7544c-fd91-4a5f-b1d2-b212e9bc453f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:25.177830 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a7544c-fd91-4a5f-b1d2-b212e9bc453f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:25.178112 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a7544c-fd91-4a5f-b1d2-b212e9bc453f admin admin] PATH_INFO: `/v3/users/89319d7176c948779a4ef1f0f9781187` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:25.179332 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a7544c-fd91-4a5f-b1d2-b212e9bc453f admin admin] RBAC: Authorizing `identity:delete_user(user_id=89319d7176c948779a4ef1f0f9781187)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:25.181786 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a7544c-fd91-4a5f-b1d2-b212e9bc453f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:25.265969 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2809/5655] 10.222.0.52 () {60 vars in 1359 bytes} [Sat May 14 21:33:24 2022] PUT /identity/v3/groups/65bc5a68b0c04402b5f31a834deacf39/users/042577c0f460467690e6714de5157431 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:25.268882 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb67fec0-035d-49d1-a88f-4d13ba55f60d tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:25.270806 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-fb67fec0-035d-49d1-a88f-4d13ba55f60d tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:25.336346 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb67fec0-035d-49d1-a88f-4d13ba55f60d tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:25.344232 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03e8ab8-c13c-4696-bec4-af60f18e1eed tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f8f92cd5f6f44e386dae212364d79b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6399289b82f54d2181dc635e73f101ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:25.345189 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e8ab8-c13c-4696-bec4-af60f18e1eed tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:25.345480 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e8ab8-c13c-4696-bec4-af60f18e1eed tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:25.345799 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e8ab8-c13c-4696-bec4-af60f18e1eed tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:25.346533 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03e8ab8-c13c-4696-bec4-af60f18e1eed tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:25.348457 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03e8ab8-c13c-4696-bec4-af60f18e1eed tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:25.384746 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e7a7544c-fd91-4a5f-b1d2-b212e9bc453f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89319d7176c948779a4ef1f0f9781187'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:25.398347 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e7a7544c-fd91-4a5f-b1d2-b212e9bc453f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89319d7176c948779a4ef1f0f9781187'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:25.409707 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e7a7544c-fd91-4a5f-b1d2-b212e9bc453f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89319d7176c948779a4ef1f0f9781187'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:25.442766 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2810/5656] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:33:25 2022] POST /identity/v3/users => generated 321 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:33:25.447363 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03e8ab8-c13c-4696-bec4-af60f18e1eed tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:25.460024 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03e8ab8-c13c-4696-bec4-af60f18e1eed tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:25.466423 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b99492f-9eaa-4646-b256-d99de5941603 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f8f92cd5f6f44e386dae212364d79b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6399289b82f54d2181dc635e73f101ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:25.467428 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b99492f-9eaa-4646-b256-d99de5941603 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:25.467859 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b99492f-9eaa-4646-b256-d99de5941603 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:25.468239 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b99492f-9eaa-4646-b256-d99de5941603 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] PATH_INFO: `/v3/groups/65bc5a68b0c04402b5f31a834deacf39/users/ff92fa4cad484b8aaa47bc1b8dea2113` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:25.484087 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e7a7544c-fd91-4a5f-b1d2-b212e9bc453f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89319d7176c948779a4ef1f0f9781187'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:25.484835 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e7a7544c-fd91-4a5f-b1d2-b212e9bc453f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89319d7176c948779a4ef1f0f9781187'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:25.493857 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2847/5657] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:33:25 2022] DELETE /identity/v3/users/89319d7176c948779a4ef1f0f9781187 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:25.499117 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b99492f-9eaa-4646-b256-d99de5941603 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=65bc5a68b0c04402b5f31a834deacf39, user_id=ff92fa4cad484b8aaa47bc1b8dea2113)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:25.501616 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b99492f-9eaa-4646-b256-d99de5941603 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:25.603915 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2811/5658] 10.222.0.52 () {60 vars in 1359 bytes} [Sat May 14 21:33:25 2022] PUT /identity/v3/groups/65bc5a68b0c04402b5f31a834deacf39/users/ff92fa4cad484b8aaa47bc1b8dea2113 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:33:25.607992 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a7544c-fd91-4a5f-b1d2-b212e9bc453f admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:25.614765 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e7a7544c-fd91-4a5f-b1d2-b212e9bc453f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:25.726498 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a7544c-fd91-4a5f-b1d2-b212e9bc453f admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:25.832491 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea6f4cc-6e5d-434c-b2b1-a092d812a539 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f8f92cd5f6f44e386dae212364d79b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6399289b82f54d2181dc635e73f101ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:25.833358 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6f4cc-6e5d-434c-b2b1-a092d812a539 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:25.833641 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6f4cc-6e5d-434c-b2b1-a092d812a539 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:25.834093 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6f4cc-6e5d-434c-b2b1-a092d812a539 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] PATH_INFO: `/v3/groups/65bc5a68b0c04402b5f31a834deacf39/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:25.835620 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea6f4cc-6e5d-434c-b2b1-a092d812a539 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=65bc5a68b0c04402b5f31a834deacf39)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:25.837373 ncdv-master-1 devstack@keystone.service[91106]: WARNING py.warnings [None req-fea6f4cc-6e5d-434c-b2b1-a092d812a539 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 14 21:33:25.837373 ncdv-master-1 devstack@keystone.service[91106]: warnings.warn(msg) May 14 21:33:25.837373 ncdv-master-1 devstack@keystone.service[91106]: May 14 21:33:25.839318 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea6f4cc-6e5d-434c-b2b1-a092d812a539 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:25.884204 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2848/5659] 10.222.0.52 () {58 vars in 1241 bytes} [Sat May 14 21:33:25 2022] GET /identity/v3/groups/65bc5a68b0c04402b5f31a834deacf39/users => generated 1081 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:33:25.888010 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b99492f-9eaa-4646-b256-d99de5941603 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:25.900100 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b99492f-9eaa-4646-b256-d99de5941603 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:25.905793 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597a9ff6-6ef7-4625-ac52-e1e25ee0bef5 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f8f92cd5f6f44e386dae212364d79b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6399289b82f54d2181dc635e73f101ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:25.907266 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a9ff6-6ef7-4625-ac52-e1e25ee0bef5 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:25.907828 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a9ff6-6ef7-4625-ac52-e1e25ee0bef5 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:25.908343 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a9ff6-6ef7-4625-ac52-e1e25ee0bef5 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] PATH_INFO: `/v3/groups/65bc5a68b0c04402b5f31a834deacf39/users/fe49789700474b5a830e291a2a5bfbd0` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:25.910427 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597a9ff6-6ef7-4625-ac52-e1e25ee0bef5 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=65bc5a68b0c04402b5f31a834deacf39, user_id=fe49789700474b5a830e291a2a5bfbd0)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:25.911906 ncdv-master-1 devstack@keystone.service[91107]: WARNING py.warnings [None req-597a9ff6-6ef7-4625-ac52-e1e25ee0bef5 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_user_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 14 21:33:25.911906 ncdv-master-1 devstack@keystone.service[91107]: warnings.warn(msg) May 14 21:33:25.911906 ncdv-master-1 devstack@keystone.service[91107]: May 14 21:33:25.921864 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597a9ff6-6ef7-4625-ac52-e1e25ee0bef5 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:25.935887 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2812/5660] 10.222.0.52 () {58 vars in 1341 bytes} [Sat May 14 21:33:25 2022] HEAD /identity/v3/groups/65bc5a68b0c04402b5f31a834deacf39/users/fe49789700474b5a830e291a2a5bfbd0 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:25.940008 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea6f4cc-6e5d-434c-b2b1-a092d812a539 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:25.955704 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea6f4cc-6e5d-434c-b2b1-a092d812a539 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:25.963287 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c5d794-0941-4e9d-be27-0da8f0a01760 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f8f92cd5f6f44e386dae212364d79b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6399289b82f54d2181dc635e73f101ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:25.964575 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5d794-0941-4e9d-be27-0da8f0a01760 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:25.965087 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5d794-0941-4e9d-be27-0da8f0a01760 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:25.965535 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5d794-0941-4e9d-be27-0da8f0a01760 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] PATH_INFO: `/v3/groups/65bc5a68b0c04402b5f31a834deacf39/users/fe49789700474b5a830e291a2a5bfbd0` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:25.972428 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c5d794-0941-4e9d-be27-0da8f0a01760 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=65bc5a68b0c04402b5f31a834deacf39, user_id=fe49789700474b5a830e291a2a5bfbd0)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:25.978827 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c5d794-0941-4e9d-be27-0da8f0a01760 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:26.098066 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-44c5d794-0941-4e9d-be27-0da8f0a01760 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'fe49789700474b5a830e291a2a5bfbd0'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:26.193759 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2849/5661] 10.222.0.52 () {58 vars in 1343 bytes} [Sat May 14 21:33:25 2022] DELETE /identity/v3/groups/65bc5a68b0c04402b5f31a834deacf39/users/fe49789700474b5a830e291a2a5bfbd0 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:26.198664 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597a9ff6-6ef7-4625-ac52-e1e25ee0bef5 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:26.217089 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597a9ff6-6ef7-4625-ac52-e1e25ee0bef5 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:26.287325 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c5d794-0941-4e9d-be27-0da8f0a01760 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:26.289572 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-44c5d794-0941-4e9d-be27-0da8f0a01760 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:26.343942 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e74fa6-6e34-47bf-a0e9-5e8c02cd61d0 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f8f92cd5f6f44e386dae212364d79b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6399289b82f54d2181dc635e73f101ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:26.345125 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e74fa6-6e34-47bf-a0e9-5e8c02cd61d0 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:26.347364 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e74fa6-6e34-47bf-a0e9-5e8c02cd61d0 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:26.347599 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e74fa6-6e34-47bf-a0e9-5e8c02cd61d0 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] PATH_INFO: `/v3/groups/65bc5a68b0c04402b5f31a834deacf39/users/042577c0f460467690e6714de5157431` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:26.354151 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e74fa6-6e34-47bf-a0e9-5e8c02cd61d0 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=65bc5a68b0c04402b5f31a834deacf39, user_id=042577c0f460467690e6714de5157431)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:26.359812 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e74fa6-6e34-47bf-a0e9-5e8c02cd61d0 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:26.407543 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2813/5662] 10.222.0.52 () {58 vars in 1341 bytes} [Sat May 14 21:33:26 2022] HEAD /identity/v3/groups/65bc5a68b0c04402b5f31a834deacf39/users/042577c0f460467690e6714de5157431 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:33:26.410096 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e74fa6-6e34-47bf-a0e9-5e8c02cd61d0 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:26.427572 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e74fa6-6e34-47bf-a0e9-5e8c02cd61d0 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:26.439010 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d77fd61-48d5-4d75-96af-7315c00469ae tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f8f92cd5f6f44e386dae212364d79b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6399289b82f54d2181dc635e73f101ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:26.439966 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77fd61-48d5-4d75-96af-7315c00469ae tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:26.440254 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77fd61-48d5-4d75-96af-7315c00469ae tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:26.440535 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77fd61-48d5-4d75-96af-7315c00469ae tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] PATH_INFO: `/v3/groups/65bc5a68b0c04402b5f31a834deacf39/users/042577c0f460467690e6714de5157431` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:26.442025 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c5d794-0941-4e9d-be27-0da8f0a01760 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:26.443530 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d77fd61-48d5-4d75-96af-7315c00469ae tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=65bc5a68b0c04402b5f31a834deacf39, user_id=042577c0f460467690e6714de5157431)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:26.445678 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d77fd61-48d5-4d75-96af-7315c00469ae tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:26.447770 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5d86e1-722c-43b1-ac75-a1a371b8a5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:26.449278 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d86e1-722c-43b1-ac75-a1a371b8a5d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:26.449905 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d86e1-722c-43b1-ac75-a1a371b8a5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:26.450302 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d86e1-722c-43b1-ac75-a1a371b8a5d7 admin admin] PATH_INFO: `/v3/projects/a499a459a2c74d81a59092a0e8eedefb` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:26.451729 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5d86e1-722c-43b1-ac75-a1a371b8a5d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a499a459a2c74d81a59092a0e8eedefb)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:26.454136 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5d86e1-722c-43b1-ac75-a1a371b8a5d7 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:26.511679 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9d77fd61-48d5-4d75-96af-7315c00469ae tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '042577c0f460467690e6714de5157431'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:26.625641 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2814/5663] 10.222.0.52 () {58 vars in 1343 bytes} [Sat May 14 21:33:26 2022] DELETE /identity/v3/groups/65bc5a68b0c04402b5f31a834deacf39/users/042577c0f460467690e6714de5157431 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:26.627296 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d77fd61-48d5-4d75-96af-7315c00469ae tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:26.628924 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-7b5d86e1-722c-43b1-ac75-a1a371b8a5d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a499a459a2c74d81a59092a0e8eedefb', 'request_id': 'req-7b5d86e1-722c-43b1-ac75-a1a371b8a5d7'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:26.652614 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-7b5d86e1-722c-43b1-ac75-a1a371b8a5d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a499a459a2c74d81a59092a0e8eedefb', 'request_id': 'req-7b5d86e1-722c-43b1-ac75-a1a371b8a5d7'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:26.750935 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d77fd61-48d5-4d75-96af-7315c00469ae tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:26.756067 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715447a1-e445-4ff9-8b16-27e0cdfa39ab tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f8f92cd5f6f44e386dae212364d79b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6399289b82f54d2181dc635e73f101ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:26.756977 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715447a1-e445-4ff9-8b16-27e0cdfa39ab tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:26.757262 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715447a1-e445-4ff9-8b16-27e0cdfa39ab tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:26.757540 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715447a1-e445-4ff9-8b16-27e0cdfa39ab tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] PATH_INFO: `/v3/groups/65bc5a68b0c04402b5f31a834deacf39/users/ff92fa4cad484b8aaa47bc1b8dea2113` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:26.760932 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715447a1-e445-4ff9-8b16-27e0cdfa39ab tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=65bc5a68b0c04402b5f31a834deacf39, user_id=ff92fa4cad484b8aaa47bc1b8dea2113)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:26.763183 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715447a1-e445-4ff9-8b16-27e0cdfa39ab tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:26.767746 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-7b5d86e1-722c-43b1-ac75-a1a371b8a5d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a499a459a2c74d81a59092a0e8eedefb', 'request_id': 'req-7b5d86e1-722c-43b1-ac75-a1a371b8a5d7'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:26.783015 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2815/5664] 10.222.0.52 () {58 vars in 1341 bytes} [Sat May 14 21:33:26 2022] HEAD /identity/v3/groups/65bc5a68b0c04402b5f31a834deacf39/users/ff92fa4cad484b8aaa47bc1b8dea2113 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:33:26.786925 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715447a1-e445-4ff9-8b16-27e0cdfa39ab tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:26.802425 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715447a1-e445-4ff9-8b16-27e0cdfa39ab tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:26.808601 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831b0e1b-df12-4110-a3cb-e53ab039494c tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f8f92cd5f6f44e386dae212364d79b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6399289b82f54d2181dc635e73f101ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:26.809871 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b0e1b-df12-4110-a3cb-e53ab039494c tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:26.811232 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b0e1b-df12-4110-a3cb-e53ab039494c tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:26.811341 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-7b5d86e1-722c-43b1-ac75-a1a371b8a5d7 admin admin] The token cache is being invalidate because project a499a459a2c74d81a59092a0e8eedefb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:33:26.811428 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b0e1b-df12-4110-a3cb-e53ab039494c tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] PATH_INFO: `/v3/groups/65bc5a68b0c04402b5f31a834deacf39/users/ff92fa4cad484b8aaa47bc1b8dea2113` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:26.811557 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-7b5d86e1-722c-43b1-ac75-a1a371b8a5d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:26.811637 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-7b5d86e1-722c-43b1-ac75-a1a371b8a5d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:26.812493 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831b0e1b-df12-4110-a3cb-e53ab039494c tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=65bc5a68b0c04402b5f31a834deacf39, user_id=ff92fa4cad484b8aaa47bc1b8dea2113)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:26.814517 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831b0e1b-df12-4110-a3cb-e53ab039494c tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:26.816714 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2850/5665] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:33:26 2022] DELETE /identity/v3/projects/a499a459a2c74d81a59092a0e8eedefb => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:26.822807 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1730be2-a5b9-47af-9777-3d4ae82aa514 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:26.823137 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1730be2-a5b9-47af-9777-3d4ae82aa514 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:26.823630 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1730be2-a5b9-47af-9777-3d4ae82aa514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:26.848011 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-c1730be2-a5b9-47af-9777-3d4ae82aa514 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:33:26.849563 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c1730be2-a5b9-47af-9777-3d4ae82aa514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:26.900221 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-831b0e1b-df12-4110-a3cb-e53ab039494c tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'ff92fa4cad484b8aaa47bc1b8dea2113'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:26.976209 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2851/5666] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:33:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:33:26.984026 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c958e25-c978-406d-a621-ef09f2cec22a None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:26.984581 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c958e25-c978-406d-a621-ef09f2cec22a None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:26.984921 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c958e25-c978-406d-a621-ef09f2cec22a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:26.993030 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2816/5667] 10.222.0.52 () {58 vars in 1343 bytes} [Sat May 14 21:33:26 2022] DELETE /identity/v3/groups/65bc5a68b0c04402b5f31a834deacf39/users/ff92fa4cad484b8aaa47bc1b8dea2113 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:33:26.997412 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831b0e1b-df12-4110-a3cb-e53ab039494c tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:27.000337 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-831b0e1b-df12-4110-a3cb-e53ab039494c tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:27.006232 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-3c958e25-c978-406d-a621-ef09f2cec22a None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:33:27.008056 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-3c958e25-c978-406d-a621-ef09f2cec22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:27.138020 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831b0e1b-df12-4110-a3cb-e53ab039494c tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:27.151117 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2852/5668] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:33:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:33:27.157229 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c958e25-c978-406d-a621-ef09f2cec22a None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:27.158572 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa7504d-c190-413d-a5f2-e77ab031ebee tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f8f92cd5f6f44e386dae212364d79b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6399289b82f54d2181dc635e73f101ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:27.163039 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7504d-c190-413d-a5f2-e77ab031ebee tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:27.164061 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7504d-c190-413d-a5f2-e77ab031ebee tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:27.165336 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7504d-c190-413d-a5f2-e77ab031ebee tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] PATH_INFO: `/v3/groups/65bc5a68b0c04402b5f31a834deacf39/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:27.169374 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa7504d-c190-413d-a5f2-e77ab031ebee tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=65bc5a68b0c04402b5f31a834deacf39)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:27.170055 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c958e25-c978-406d-a621-ef09f2cec22a None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:27.171726 ncdv-master-1 devstack@keystone.service[91107]: WARNING py.warnings [None req-eaa7504d-c190-413d-a5f2-e77ab031ebee tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 14 21:33:27.171726 ncdv-master-1 devstack@keystone.service[91107]: warnings.warn(msg) May 14 21:33:27.171726 ncdv-master-1 devstack@keystone.service[91107]: May 14 21:33:27.174934 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa7504d-c190-413d-a5f2-e77ab031ebee tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:27.176038 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3296803-e8a1-44a3-ae74-a3fad3fde3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:27.176934 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3296803-e8a1-44a3-ae74-a3fad3fde3b3 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:27.177415 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3296803-e8a1-44a3-ae74-a3fad3fde3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:27.177886 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3296803-e8a1-44a3-ae74-a3fad3fde3b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:27.178806 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3296803-e8a1-44a3-ae74-a3fad3fde3b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:33:27.179450 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3296803-e8a1-44a3-ae74-a3fad3fde3b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:27.182067 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3296803-e8a1-44a3-ae74-a3fad3fde3b3 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:27.202439 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2853/5669] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:33:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:33:27.206536 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3296803-e8a1-44a3-ae74-a3fad3fde3b3 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:27.212419 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2817/5670] 10.222.0.52 () {58 vars in 1241 bytes} [Sat May 14 21:33:26 2022] GET /identity/v3/groups/65bc5a68b0c04402b5f31a834deacf39/users => generated 145 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:33:27.213468 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa7504d-c190-413d-a5f2-e77ab031ebee tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:27.227822 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa7504d-c190-413d-a5f2-e77ab031ebee tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:27.232844 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a169269-5daa-4104-9d9a-f982a0b1264d tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f8f92cd5f6f44e386dae212364d79b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6399289b82f54d2181dc635e73f101ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:27.233793 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a169269-5daa-4104-9d9a-f982a0b1264d tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:27.234099 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a169269-5daa-4104-9d9a-f982a0b1264d tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:27.234368 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a169269-5daa-4104-9d9a-f982a0b1264d tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] PATH_INFO: `/v3/users/ff92fa4cad484b8aaa47bc1b8dea2113` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:27.235649 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a169269-5daa-4104-9d9a-f982a0b1264d tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorizing `identity:delete_user(user_id=ff92fa4cad484b8aaa47bc1b8dea2113)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:27.238281 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a169269-5daa-4104-9d9a-f982a0b1264d tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:27.241253 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3296803-e8a1-44a3-ae74-a3fad3fde3b3 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:27.248171 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8242461e-7b38-415a-a12a-e82f14bea27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:27.249191 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242461e-7b38-415a-a12a-e82f14bea27d admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:27.249684 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242461e-7b38-415a-a12a-e82f14bea27d admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:27.250166 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242461e-7b38-415a-a12a-e82f14bea27d admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:27.251306 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8242461e-7b38-415a-a12a-e82f14bea27d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:27.255795 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8242461e-7b38-415a-a12a-e82f14bea27d admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:27.370321 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9a169269-5daa-4104-9d9a-f982a0b1264d tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff92fa4cad484b8aaa47bc1b8dea2113'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:27.382049 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9a169269-5daa-4104-9d9a-f982a0b1264d tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff92fa4cad484b8aaa47bc1b8dea2113'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:27.382939 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9a169269-5daa-4104-9d9a-f982a0b1264d tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff92fa4cad484b8aaa47bc1b8dea2113'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:27.386969 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2854/5671] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:33:27 2022] POST /identity/v3/projects => generated 383 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:33:27.391620 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8242461e-7b38-415a-a12a-e82f14bea27d admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:27.476796 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9a169269-5daa-4104-9d9a-f982a0b1264d tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff92fa4cad484b8aaa47bc1b8dea2113'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:27.477878 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8242461e-7b38-415a-a12a-e82f14bea27d admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:27.488215 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed8366-a707-4e4a-8cab-a366506b0020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:27.488990 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed8366-a707-4e4a-8cab-a366506b0020 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:27.489281 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed8366-a707-4e4a-8cab-a366506b0020 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:27.489844 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed8366-a707-4e4a-8cab-a366506b0020 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:27.490592 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ed8366-a707-4e4a-8cab-a366506b0020 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:27.492921 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ed8366-a707-4e4a-8cab-a366506b0020 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:27.506641 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9a169269-5daa-4104-9d9a-f982a0b1264d tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff92fa4cad484b8aaa47bc1b8dea2113'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:27.518322 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2818/5672] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:33:27 2022] DELETE /identity/v3/users/ff92fa4cad484b8aaa47bc1b8dea2113 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:27.522700 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a169269-5daa-4104-9d9a-f982a0b1264d tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:27.524316 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-9a169269-5daa-4104-9d9a-f982a0b1264d tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:27.606107 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2855/5673] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:33:27 2022] POST /identity/v3/users => generated 292 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:33:27.610674 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed8366-a707-4e4a-8cab-a366506b0020 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:27.614616 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-f9ed8366-a707-4e4a-8cab-a366506b0020 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:27.614858 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a169269-5daa-4104-9d9a-f982a0b1264d tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:27.622830 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e9c731-b870-485d-9274-2d1808b7842d tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f8f92cd5f6f44e386dae212364d79b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6399289b82f54d2181dc635e73f101ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:27.623689 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e9c731-b870-485d-9274-2d1808b7842d tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:27.623984 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e9c731-b870-485d-9274-2d1808b7842d tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:27.624270 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e9c731-b870-485d-9274-2d1808b7842d tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] PATH_INFO: `/v3/users/042577c0f460467690e6714de5157431` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:27.625563 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e9c731-b870-485d-9274-2d1808b7842d tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorizing `identity:delete_user(user_id=042577c0f460467690e6714de5157431)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:27.627648 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e9c731-b870-485d-9274-2d1808b7842d tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:27.645718 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed8366-a707-4e4a-8cab-a366506b0020 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:27.794222 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-77e9c731-b870-485d-9274-2d1808b7842d tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '042577c0f460467690e6714de5157431'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:27.813233 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-77e9c731-b870-485d-9274-2d1808b7842d tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '042577c0f460467690e6714de5157431'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:27.815513 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-77e9c731-b870-485d-9274-2d1808b7842d tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '042577c0f460467690e6714de5157431'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:27.823902 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec8450e-67eb-4b35-85a1-3ec6f1c73eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:27.823902 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8450e-67eb-4b35-85a1-3ec6f1c73eb9 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:27.823902 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8450e-67eb-4b35-85a1-3ec6f1c73eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:27.823902 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8450e-67eb-4b35-85a1-3ec6f1c73eb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:27.824887 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec8450e-67eb-4b35-85a1-3ec6f1c73eb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:27.826518 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec8450e-67eb-4b35-85a1-3ec6f1c73eb9 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:27.839417 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2856/5674] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:33:27 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:33:27.843155 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec8450e-67eb-4b35-85a1-3ec6f1c73eb9 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:27.877504 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec8450e-67eb-4b35-85a1-3ec6f1c73eb9 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:27.886290 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af11ac79-0e62-45a0-93a8-29a1059f11f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:27.886980 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af11ac79-0e62-45a0-93a8-29a1059f11f7 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:27.887266 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af11ac79-0e62-45a0-93a8-29a1059f11f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:27.887628 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af11ac79-0e62-45a0-93a8-29a1059f11f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:27.888362 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af11ac79-0e62-45a0-93a8-29a1059f11f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:27.890585 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af11ac79-0e62-45a0-93a8-29a1059f11f7 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:27.908055 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2857/5675] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:33:27 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:33:27.908989 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af11ac79-0e62-45a0-93a8-29a1059f11f7 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:27.926019 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af11ac79-0e62-45a0-93a8-29a1059f11f7 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:27.932650 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d796b-8550-4ab0-9497-13df36f72e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:27.933524 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d796b-8550-4ab0-9497-13df36f72e58 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:27.933811 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d796b-8550-4ab0-9497-13df36f72e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:27.934089 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d796b-8550-4ab0-9497-13df36f72e58 admin admin] PATH_INFO: `/v3/projects/87acd75b9e52482996ab310e28234587/users/07a45c0004c64d2491421acba0abf925/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:27.958314 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701d796b-8550-4ab0-9497-13df36f72e58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87acd75b9e52482996ab310e28234587, user_id=07a45c0004c64d2491421acba0abf925, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:27.961321 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701d796b-8550-4ab0-9497-13df36f72e58 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:28.101269 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-77e9c731-b870-485d-9274-2d1808b7842d tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '042577c0f460467690e6714de5157431'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:28.116690 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2858/5676] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:33:27 2022] PUT /identity/v3/projects/87acd75b9e52482996ab310e28234587/users/07a45c0004c64d2491421acba0abf925/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:28.128734 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c31d3-b770-4e2d-861d-392655c169d3 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:28.130070 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c31d3-b770-4e2d-861d-392655c169d3 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:28.130519 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c31d3-b770-4e2d-861d-392655c169d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:28.131335 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-77e9c731-b870-485d-9274-2d1808b7842d tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '042577c0f460467690e6714de5157431'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:28.154355 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2819/5677] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:33:27 2022] DELETE /identity/v3/users/042577c0f460467690e6714de5157431 => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:28.155645 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e9c731-b870-485d-9274-2d1808b7842d tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:28.158418 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-77e9c731-b870-485d-9274-2d1808b7842d tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:28.188894 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-443c31d3-b770-4e2d-861d-392655c169d3 None None] MFA Rules not processed for user `07a45c0004c64d2491421acba0abf925`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:33:28.190593 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-443c31d3-b770-4e2d-861d-392655c169d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:28.249095 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e9c731-b870-485d-9274-2d1808b7842d tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:28.260278 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c3ac78-99d3-499a-8ea4-93b94c554721 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f8f92cd5f6f44e386dae212364d79b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6399289b82f54d2181dc635e73f101ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:28.262384 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3ac78-99d3-499a-8ea4-93b94c554721 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:28.263587 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3ac78-99d3-499a-8ea4-93b94c554721 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:28.264115 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3ac78-99d3-499a-8ea4-93b94c554721 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] PATH_INFO: `/v3/users/fe49789700474b5a830e291a2a5bfbd0` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:28.265717 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c3ac78-99d3-499a-8ea4-93b94c554721 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorizing `identity:delete_user(user_id=fe49789700474b5a830e291a2a5bfbd0)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:28.268347 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c3ac78-99d3-499a-8ea4-93b94c554721 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:28.332180 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2859/5678] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:33:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:33:28.336381 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443c31d3-b770-4e2d-861d-392655c169d3 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:28.337955 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-443c31d3-b770-4e2d-861d-392655c169d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:28.410837 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443c31d3-b770-4e2d-861d-392655c169d3 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:28.414378 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4c2dba-d74b-4ab6-b43e-4855715c0d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:28.415632 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c2dba-d74b-4ab6-b43e-4855715c0d90 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:28.415923 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c2dba-d74b-4ab6-b43e-4855715c0d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:28.416209 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c2dba-d74b-4ab6-b43e-4855715c0d90 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:28.416918 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4c2dba-d74b-4ab6-b43e-4855715c0d90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:28.420001 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4c2dba-d74b-4ab6-b43e-4855715c0d90 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:28.457106 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-88c3ac78-99d3-499a-8ea4-93b94c554721 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe49789700474b5a830e291a2a5bfbd0'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:28.470520 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-88c3ac78-99d3-499a-8ea4-93b94c554721 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe49789700474b5a830e291a2a5bfbd0'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:28.470520 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-88c3ac78-99d3-499a-8ea4-93b94c554721 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe49789700474b5a830e291a2a5bfbd0'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:28.526767 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2860/5679] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:33:28 2022] POST /identity/v3/projects => generated 383 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:33:28.530549 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4c2dba-d74b-4ab6-b43e-4855715c0d90 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:28.548624 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-88c3ac78-99d3-499a-8ea4-93b94c554721 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe49789700474b5a830e291a2a5bfbd0'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:28.564437 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-88c3ac78-99d3-499a-8ea4-93b94c554721 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe49789700474b5a830e291a2a5bfbd0'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:28.572922 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2820/5680] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:33:28 2022] DELETE /identity/v3/users/fe49789700474b5a830e291a2a5bfbd0 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:28.582157 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c3ac78-99d3-499a-8ea4-93b94c554721 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:28.583766 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-88c3ac78-99d3-499a-8ea4-93b94c554721 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:28.603277 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4c2dba-d74b-4ab6-b43e-4855715c0d90 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:28.660028 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c3ac78-99d3-499a-8ea4-93b94c554721 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:28.665466 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf2f3a9-e496-4181-86fa-4a10aed0bd72 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f8f92cd5f6f44e386dae212364d79b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6399289b82f54d2181dc635e73f101ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:28.666397 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2f3a9-e496-4181-86fa-4a10aed0bd72 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:28.666688 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2f3a9-e496-4181-86fa-4a10aed0bd72 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:28.666963 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2f3a9-e496-4181-86fa-4a10aed0bd72 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] PATH_INFO: `/v3/groups/65bc5a68b0c04402b5f31a834deacf39` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:28.668337 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf2f3a9-e496-4181-86fa-4a10aed0bd72 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorizing `identity:delete_group(group_id=65bc5a68b0c04402b5f31a834deacf39)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:28.670261 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf2f3a9-e496-4181-86fa-4a10aed0bd72 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:28.671867 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b63f866-4508-4838-ab1f-207f3015536f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:28.672706 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b63f866-4508-4838-ab1f-207f3015536f admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:28.673463 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b63f866-4508-4838-ab1f-207f3015536f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:28.673757 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b63f866-4508-4838-ab1f-207f3015536f admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:28.674449 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b63f866-4508-4838-ab1f-207f3015536f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:28.676379 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b63f866-4508-4838-ab1f-207f3015536f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:28.771660 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2861/5681] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:33:28 2022] POST /identity/v3/users => generated 298 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:33:28.775601 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b63f866-4508-4838-ab1f-207f3015536f admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:28.778006 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-4b63f866-4508-4838-ab1f-207f3015536f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:28.797820 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b63f866-4508-4838-ab1f-207f3015536f admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:28.802944 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10297fda-f227-4e9a-bc9d-a70c018055db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:28.803702 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10297fda-f227-4e9a-bc9d-a70c018055db admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:28.803990 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10297fda-f227-4e9a-bc9d-a70c018055db admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:28.804414 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10297fda-f227-4e9a-bc9d-a70c018055db admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:28.805705 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10297fda-f227-4e9a-bc9d-a70c018055db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:28.807990 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10297fda-f227-4e9a-bc9d-a70c018055db admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:28.822541 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2862/5682] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:33:28 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:33:28.826436 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10297fda-f227-4e9a-bc9d-a70c018055db admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:28.843527 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10297fda-f227-4e9a-bc9d-a70c018055db admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:28.844451 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2821/5683] 10.222.0.52 () {58 vars in 1226 bytes} [Sat May 14 21:33:28 2022] DELETE /identity/v3/groups/65bc5a68b0c04402b5f31a834deacf39 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:33:28.850248 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf2f3a9-e496-4181-86fa-4a10aed0bd72 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:28.940793 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf2f3a9-e496-4181-86fa-4a10aed0bd72 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:28.947841 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f02902-fbc8-4b36-a071-fabf78904479 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f8f92cd5f6f44e386dae212364d79b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6399289b82f54d2181dc635e73f101ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:28.948535 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f02902-fbc8-4b36-a071-fabf78904479 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:28.948897 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f02902-fbc8-4b36-a071-fabf78904479 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:28.949195 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f02902-fbc8-4b36-a071-fabf78904479 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] PATH_INFO: `/v3/groups` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:28.949994 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f02902-fbc8-4b36-a071-fabf78904479 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:28.952591 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f02902-fbc8-4b36-a071-fabf78904479 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:28.953988 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1689881-68ea-4a79-84a0-6465f00036c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:28.955631 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1689881-68ea-4a79-84a0-6465f00036c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:28.956409 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1689881-68ea-4a79-84a0-6465f00036c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:28.957318 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1689881-68ea-4a79-84a0-6465f00036c8 admin admin] PATH_INFO: `/v3/projects/049de61d833b45bba49f7ebfc0f343c7/users/063351757a6247db99c643bb221752d5/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:28.974726 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1689881-68ea-4a79-84a0-6465f00036c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=049de61d833b45bba49f7ebfc0f343c7, user_id=063351757a6247db99c643bb221752d5, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:28.978679 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1689881-68ea-4a79-84a0-6465f00036c8 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:29.041480 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2822/5684] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:33:28 2022] POST /identity/v3/groups => generated 326 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:33:29.042605 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f02902-fbc8-4b36-a071-fabf78904479 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:29.053596 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f02902-fbc8-4b36-a071-fabf78904479 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:29.059417 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5429696-e27f-4295-8ee0-10f73745ec48 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f8f92cd5f6f44e386dae212364d79b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6399289b82f54d2181dc635e73f101ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:29.059793 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5429696-e27f-4295-8ee0-10f73745ec48 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:29.060084 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5429696-e27f-4295-8ee0-10f73745ec48 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:29.060365 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5429696-e27f-4295-8ee0-10f73745ec48 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] PATH_INFO: `/v3/groups` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:29.061065 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5429696-e27f-4295-8ee0-10f73745ec48 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:29.063007 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5429696-e27f-4295-8ee0-10f73745ec48 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:29.082316 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2863/5685] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:33:28 2022] PUT /identity/v3/projects/049de61d833b45bba49f7ebfc0f343c7/users/063351757a6247db99c643bb221752d5/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:29.083359 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1689881-68ea-4a79-84a0-6465f00036c8 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:29.159757 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1689881-68ea-4a79-84a0-6465f00036c8 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:29.165110 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fcb0b9-3984-48dc-8790-0b09644828c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:29.165980 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fcb0b9-3984-48dc-8790-0b09644828c9 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:29.165980 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fcb0b9-3984-48dc-8790-0b09644828c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:29.166228 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fcb0b9-3984-48dc-8790-0b09644828c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:29.166948 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fcb0b9-3984-48dc-8790-0b09644828c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:29.168644 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fcb0b9-3984-48dc-8790-0b09644828c9 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:29.179279 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2864/5686] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:33:29 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:33:29.185391 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fcb0b9-3984-48dc-8790-0b09644828c9 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:29.199831 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fcb0b9-3984-48dc-8790-0b09644828c9 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:29.211300 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b16df3-e880-475e-9cda-c76a62d85974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:29.212599 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b16df3-e880-475e-9cda-c76a62d85974 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:29.212999 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b16df3-e880-475e-9cda-c76a62d85974 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:29.213303 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b16df3-e880-475e-9cda-c76a62d85974 admin admin] PATH_INFO: `/v3/projects/049de61d833b45bba49f7ebfc0f343c7/users/063351757a6247db99c643bb221752d5/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:29.215196 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2823/5687] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:33:29 2022] POST /identity/v3/groups => generated 326 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:33:29.215548 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b16df3-e880-475e-9cda-c76a62d85974 admin admin] RBAC: Authorizing `identity:create_grant(project_id=049de61d833b45bba49f7ebfc0f343c7, user_id=063351757a6247db99c643bb221752d5, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:29.218373 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b16df3-e880-475e-9cda-c76a62d85974 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:29.219036 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5429696-e27f-4295-8ee0-10f73745ec48 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:29.230494 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5429696-e27f-4295-8ee0-10f73745ec48 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:29.232147 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2865/5688] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:33:29 2022] PUT /identity/v3/projects/049de61d833b45bba49f7ebfc0f343c7/users/063351757a6247db99c643bb221752d5/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:29.246164 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6241d-5c8f-4ecc-ba0f-a705a86b888f None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:29.246590 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6241d-5c8f-4ecc-ba0f-a705a86b888f None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:29.246880 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6241d-5c8f-4ecc-ba0f-a705a86b888f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:29.273557 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-efd6241d-5c8f-4ecc-ba0f-a705a86b888f None None] MFA Rules not processed for user `063351757a6247db99c643bb221752d5`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:33:29.274800 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-efd6241d-5c8f-4ecc-ba0f-a705a86b888f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:29.290243 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae70d59-8aef-49fa-a43c-3d562e08e678 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f8f92cd5f6f44e386dae212364d79b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6399289b82f54d2181dc635e73f101ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:29.291363 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae70d59-8aef-49fa-a43c-3d562e08e678 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:29.291701 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae70d59-8aef-49fa-a43c-3d562e08e678 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:29.291985 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae70d59-8aef-49fa-a43c-3d562e08e678 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] PATH_INFO: `/v3/groups` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:29.292729 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae70d59-8aef-49fa-a43c-3d562e08e678 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:29.294654 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae70d59-8aef-49fa-a43c-3d562e08e678 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:29.347292 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2866/5689] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:33:29 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:33:29.352763 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd6241d-5c8f-4ecc-ba0f-a705a86b888f None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:29.354448 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-efd6241d-5c8f-4ecc-ba0f-a705a86b888f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:29.422396 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd6241d-5c8f-4ecc-ba0f-a705a86b888f None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:29.424664 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2824/5690] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:33:29 2022] POST /identity/v3/groups => generated 327 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:33:29.425531 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae70d59-8aef-49fa-a43c-3d562e08e678 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:29.429663 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c6f6df-502b-4870-a03f-b5c6bcdc50f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:29.431206 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6f6df-502b-4870-a03f-b5c6bcdc50f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:29.431433 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6f6df-502b-4870-a03f-b5c6bcdc50f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:29.431770 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6f6df-502b-4870-a03f-b5c6bcdc50f3 admin admin] PATH_INFO: `/v3/users/32f31413db6a48f0b18b6698626bef76` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:29.433009 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c6f6df-502b-4870-a03f-b5c6bcdc50f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32f31413db6a48f0b18b6698626bef76)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:29.434934 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c6f6df-502b-4870-a03f-b5c6bcdc50f3 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:29.439057 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae70d59-8aef-49fa-a43c-3d562e08e678 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:29.447008 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ac512-bd6e-4c44-888e-ebc37b53b3b3 tempest-ProjectsNegativeTestJSON-744103698 tempest-ProjectsNegativeTestJSON-744103698-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '063351757a6247db99c643bb221752d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049de61d833b45bba49f7ebfc0f343c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:29.447857 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ac512-bd6e-4c44-888e-ebc37b53b3b3 tempest-ProjectsNegativeTestJSON-744103698 tempest-ProjectsNegativeTestJSON-744103698-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:29.448259 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ac512-bd6e-4c44-888e-ebc37b53b3b3 tempest-ProjectsNegativeTestJSON-744103698 tempest-ProjectsNegativeTestJSON-744103698-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:29.448637 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ac512-bd6e-4c44-888e-ebc37b53b3b3 tempest-ProjectsNegativeTestJSON-744103698 tempest-ProjectsNegativeTestJSON-744103698-project-admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:29.449452 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0ac512-bd6e-4c44-888e-ebc37b53b3b3 tempest-ProjectsNegativeTestJSON-744103698 tempest-ProjectsNegativeTestJSON-744103698-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:29.451451 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0ac512-bd6e-4c44-888e-ebc37b53b3b3 tempest-ProjectsNegativeTestJSON-744103698 tempest-ProjectsNegativeTestJSON-744103698-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:29.601994 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2825/5691] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:33:29 2022] POST /identity/v3/projects => generated 357 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:33:29.601994 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ac512-bd6e-4c44-888e-ebc37b53b3b3 tempest-ProjectsNegativeTestJSON-744103698 tempest-ProjectsNegativeTestJSON-744103698-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:29.665957 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-10c6f6df-502b-4870-a03f-b5c6bcdc50f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32f31413db6a48f0b18b6698626bef76'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:29.673407 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ac512-bd6e-4c44-888e-ebc37b53b3b3 tempest-ProjectsNegativeTestJSON-744103698 tempest-ProjectsNegativeTestJSON-744103698-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:29.678576 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaf371e-d9a2-4976-9560-b51c6a7d4682 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f8f92cd5f6f44e386dae212364d79b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6399289b82f54d2181dc635e73f101ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:29.679249 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf371e-d9a2-4976-9560-b51c6a7d4682 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:29.679560 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf371e-d9a2-4976-9560-b51c6a7d4682 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:29.679840 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf371e-d9a2-4976-9560-b51c6a7d4682 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] PATH_INFO: `/v3/groups` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:29.680082 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-10c6f6df-502b-4870-a03f-b5c6bcdc50f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32f31413db6a48f0b18b6698626bef76'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:29.680738 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaf371e-d9a2-4976-9560-b51c6a7d4682 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorizing `identity:list_groups()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:29.681965 ncdv-master-1 devstack@keystone.service[91107]: WARNING py.warnings [None req-beaf371e-d9a2-4976-9560-b51c6a7d4682 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_groups": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 14 21:33:29.681965 ncdv-master-1 devstack@keystone.service[91107]: warnings.warn(msg) May 14 21:33:29.681965 ncdv-master-1 devstack@keystone.service[91107]: May 14 21:33:29.683168 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaf371e-d9a2-4976-9560-b51c6a7d4682 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:29.689529 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-10c6f6df-502b-4870-a03f-b5c6bcdc50f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32f31413db6a48f0b18b6698626bef76'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:29.690436 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2826/5692] 10.222.0.52 () {58 vars in 1124 bytes} [Sat May 14 21:33:29 2022] GET /identity/v3/groups => generated 1489 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:33:29.691245 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaf371e-d9a2-4976-9560-b51c6a7d4682 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:29.693283 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-beaf371e-d9a2-4976-9560-b51c6a7d4682 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:29.757612 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaf371e-d9a2-4976-9560-b51c6a7d4682 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:29.761196 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-10c6f6df-502b-4870-a03f-b5c6bcdc50f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32f31413db6a48f0b18b6698626bef76'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:29.764560 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-10c6f6df-502b-4870-a03f-b5c6bcdc50f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32f31413db6a48f0b18b6698626bef76'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:29.764678 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caa8437-65da-4b47-856f-10e73f27d4d5 tempest-ProjectsNegativeTestJSON-134570868 tempest-ProjectsNegativeTestJSON-134570868-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07a45c0004c64d2491421acba0abf925', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87acd75b9e52482996ab310e28234587', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:29.764678 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caa8437-65da-4b47-856f-10e73f27d4d5 tempest-ProjectsNegativeTestJSON-134570868 tempest-ProjectsNegativeTestJSON-134570868-project] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:29.764678 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caa8437-65da-4b47-856f-10e73f27d4d5 tempest-ProjectsNegativeTestJSON-134570868 tempest-ProjectsNegativeTestJSON-134570868-project] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:29.764963 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caa8437-65da-4b47-856f-10e73f27d4d5 tempest-ProjectsNegativeTestJSON-134570868 tempest-ProjectsNegativeTestJSON-134570868-project] PATH_INFO: `/v3/projects/5c479736bdaa4adbb4d0fa2331deba97` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:29.765417 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caa8437-65da-4b47-856f-10e73f27d4d5 tempest-ProjectsNegativeTestJSON-134570868 tempest-ProjectsNegativeTestJSON-134570868-project] RBAC: Authorizing `identity:delete_project(project_id=5c479736bdaa4adbb4d0fa2331deba97)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:29.768674 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2867/5693] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:33:29 2022] DELETE /identity/v3/users/32f31413db6a48f0b18b6698626bef76 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:29.772597 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c6f6df-502b-4870-a03f-b5c6bcdc50f3 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:29.774013 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-10c6f6df-502b-4870-a03f-b5c6bcdc50f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:29.776669 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-3caa8437-65da-4b47-856f-10e73f27d4d5 tempest-ProjectsNegativeTestJSON-134570868 tempest-ProjectsNegativeTestJSON-134570868-project] You are not authorized to perform the requested action: identity:delete_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. May 14 21:33:29.776669 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:33:29.776669 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 21:33:29.776669 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 21:33:29.776669 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 21:33:29.776669 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 21:33:29.776669 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 21:33:29.776669 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 21:33:29.776669 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 21:33:29.776669 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 21:33:29.776669 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 21:33:29.776669 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 21:33:29.776669 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 207, in delete May 14 21:33:29.776669 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ENFORCER.enforce_call( May 14 21:33:29.777784 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call May 14 21:33:29.777784 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application enforcer_obj._enforce( May 14 21:33:29.777784 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce May 14 21:33:29.777784 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application result = self._enforcer.enforce( May 14 21:33:29.777784 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 14 21:33:29.777784 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) May 14 21:33:29.777784 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. May 14 21:33:29.777784 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:33:29.778298 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2827/5694] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:33:29 2022] DELETE /identity/v3/projects/5c479736bdaa4adbb4d0fa2331deba97 => generated 136 bytes in 87 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) May 14 21:33:29.779079 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8165462-c220-4d0a-9a49-9e40efe686dd None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:29.779380 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8165462-c220-4d0a-9a49-9e40efe686dd None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:29.779674 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8165462-c220-4d0a-9a49-9e40efe686dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:29.798563 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-b8165462-c220-4d0a-9a49-9e40efe686dd None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:33:29.799892 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b8165462-c220-4d0a-9a49-9e40efe686dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:29.847816 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c6f6df-502b-4870-a03f-b5c6bcdc50f3 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:29.853430 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3498c3b3-ad5c-4153-aa0d-a7b5329bd1ef tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f8f92cd5f6f44e386dae212364d79b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6399289b82f54d2181dc635e73f101ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:29.854387 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3498c3b3-ad5c-4153-aa0d-a7b5329bd1ef tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:29.854682 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3498c3b3-ad5c-4153-aa0d-a7b5329bd1ef tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:29.854964 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3498c3b3-ad5c-4153-aa0d-a7b5329bd1ef tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] PATH_INFO: `/v3/groups/243074e28cab4f988b7f235ec4165ae5` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:29.860605 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3498c3b3-ad5c-4153-aa0d-a7b5329bd1ef tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorizing `identity:delete_group(group_id=243074e28cab4f988b7f235ec4165ae5)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:29.862521 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3498c3b3-ad5c-4153-aa0d-a7b5329bd1ef tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:29.871023 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2828/5695] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:33:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:33:29.873385 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8165462-c220-4d0a-9a49-9e40efe686dd None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:29.876830 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b8165462-c220-4d0a-9a49-9e40efe686dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:29.952846 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8165462-c220-4d0a-9a49-9e40efe686dd None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:29.957626 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d490e353-8d71-4303-924e-4e57069665ed tempest-ProjectsNegativeTestJSON-744103698 tempest-ProjectsNegativeTestJSON-744103698-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '063351757a6247db99c643bb221752d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049de61d833b45bba49f7ebfc0f343c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:29.958504 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490e353-8d71-4303-924e-4e57069665ed tempest-ProjectsNegativeTestJSON-744103698 tempest-ProjectsNegativeTestJSON-744103698-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:29.958793 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490e353-8d71-4303-924e-4e57069665ed tempest-ProjectsNegativeTestJSON-744103698 tempest-ProjectsNegativeTestJSON-744103698-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:29.959069 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490e353-8d71-4303-924e-4e57069665ed tempest-ProjectsNegativeTestJSON-744103698 tempest-ProjectsNegativeTestJSON-744103698-project-admin] PATH_INFO: `/v3/projects/5c479736bdaa4adbb4d0fa2331deba97` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:29.960302 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d490e353-8d71-4303-924e-4e57069665ed tempest-ProjectsNegativeTestJSON-744103698 tempest-ProjectsNegativeTestJSON-744103698-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5c479736bdaa4adbb4d0fa2331deba97)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:29.962443 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d490e353-8d71-4303-924e-4e57069665ed tempest-ProjectsNegativeTestJSON-744103698 tempest-ProjectsNegativeTestJSON-744103698-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:30.038105 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2868/5696] 10.222.0.52 () {58 vars in 1226 bytes} [Sat May 14 21:33:29 2022] DELETE /identity/v3/groups/243074e28cab4f988b7f235ec4165ae5 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:30.039460 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3498c3b3-ad5c-4153-aa0d-a7b5329bd1ef tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:30.042975 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-3498c3b3-ad5c-4153-aa0d-a7b5329bd1ef tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:30.113318 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3498c3b3-ad5c-4153-aa0d-a7b5329bd1ef tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:30.129234 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d490e353-8d71-4303-924e-4e57069665ed tempest-ProjectsNegativeTestJSON-744103698 tempest-ProjectsNegativeTestJSON-744103698-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c479736bdaa4adbb4d0fa2331deba97', 'request_id': 'req-d490e353-8d71-4303-924e-4e57069665ed'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:30.137950 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d490e353-8d71-4303-924e-4e57069665ed tempest-ProjectsNegativeTestJSON-744103698 tempest-ProjectsNegativeTestJSON-744103698-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c479736bdaa4adbb4d0fa2331deba97', 'request_id': 'req-d490e353-8d71-4303-924e-4e57069665ed'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:30.145654 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d490e353-8d71-4303-924e-4e57069665ed tempest-ProjectsNegativeTestJSON-744103698 tempest-ProjectsNegativeTestJSON-744103698-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c479736bdaa4adbb4d0fa2331deba97', 'request_id': 'req-d490e353-8d71-4303-924e-4e57069665ed'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:30.178130 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201887b1-d394-481a-8974-bcf8121535f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:30.178130 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201887b1-d394-481a-8974-bcf8121535f8 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:30.178130 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201887b1-d394-481a-8974-bcf8121535f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:30.178130 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201887b1-d394-481a-8974-bcf8121535f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:30.249753 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201887b1-d394-481a-8974-bcf8121535f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:30.252201 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201887b1-d394-481a-8974-bcf8121535f8 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:30.264287 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d490e353-8d71-4303-924e-4e57069665ed tempest-ProjectsNegativeTestJSON-744103698 tempest-ProjectsNegativeTestJSON-744103698-project-admin] The token cache is being invalidate because project 5c479736bdaa4adbb4d0fa2331deba97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:33:30.264287 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d490e353-8d71-4303-924e-4e57069665ed tempest-ProjectsNegativeTestJSON-744103698 tempest-ProjectsNegativeTestJSON-744103698-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:30.264287 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d490e353-8d71-4303-924e-4e57069665ed tempest-ProjectsNegativeTestJSON-744103698 tempest-ProjectsNegativeTestJSON-744103698-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:30.268117 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2829/5697] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:33:29 2022] DELETE /identity/v3/projects/5c479736bdaa4adbb4d0fa2331deba97 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:30.268935 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d490e353-8d71-4303-924e-4e57069665ed tempest-ProjectsNegativeTestJSON-744103698 tempest-ProjectsNegativeTestJSON-744103698-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:30.273068 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2869/5698] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:33:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:33:30.273229 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-d490e353-8d71-4303-924e-4e57069665ed tempest-ProjectsNegativeTestJSON-744103698 tempest-ProjectsNegativeTestJSON-744103698-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:30.274779 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201887b1-d394-481a-8974-bcf8121535f8 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:30.276222 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-201887b1-d394-481a-8974-bcf8121535f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:30.295387 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201887b1-d394-481a-8974-bcf8121535f8 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:30.301748 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac91040-f980-4904-9e57-e098691deb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:30.302682 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac91040-f980-4904-9e57-e098691deb46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:30.302951 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac91040-f980-4904-9e57-e098691deb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:30.303805 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac91040-f980-4904-9e57-e098691deb46 admin admin] PATH_INFO: `/v3/users/07a45c0004c64d2491421acba0abf925` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:30.306375 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac91040-f980-4904-9e57-e098691deb46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07a45c0004c64d2491421acba0abf925)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:30.308544 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac91040-f980-4904-9e57-e098691deb46 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:30.361725 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d490e353-8d71-4303-924e-4e57069665ed tempest-ProjectsNegativeTestJSON-744103698 tempest-ProjectsNegativeTestJSON-744103698-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:30.366726 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe0d753-d337-4489-962f-4f32ebfde455 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f8f92cd5f6f44e386dae212364d79b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6399289b82f54d2181dc635e73f101ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:30.368401 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe0d753-d337-4489-962f-4f32ebfde455 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:30.368616 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe0d753-d337-4489-962f-4f32ebfde455 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:30.368907 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe0d753-d337-4489-962f-4f32ebfde455 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] PATH_INFO: `/v3/groups/881cd3500db64469b79f8088fe1df8de` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:30.375562 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe0d753-d337-4489-962f-4f32ebfde455 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorizing `identity:delete_group(group_id=881cd3500db64469b79f8088fe1df8de)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:30.378477 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe0d753-d337-4489-962f-4f32ebfde455 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:30.551201 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2830/5699] 10.222.0.52 () {58 vars in 1226 bytes} [Sat May 14 21:33:30 2022] DELETE /identity/v3/groups/881cd3500db64469b79f8088fe1df8de => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:30.553354 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe0d753-d337-4489-962f-4f32ebfde455 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:30.561452 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-fac91040-f980-4904-9e57-e098691deb46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07a45c0004c64d2491421acba0abf925'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:30.577461 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-fac91040-f980-4904-9e57-e098691deb46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07a45c0004c64d2491421acba0abf925'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:30.590901 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-fac91040-f980-4904-9e57-e098691deb46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07a45c0004c64d2491421acba0abf925'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:30.626687 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe0d753-d337-4489-962f-4f32ebfde455 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:30.651106 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a5a89f-be48-4161-bb0c-b5c289756bc2 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f8f92cd5f6f44e386dae212364d79b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6399289b82f54d2181dc635e73f101ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:30.652329 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5a89f-be48-4161-bb0c-b5c289756bc2 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:30.652729 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5a89f-be48-4161-bb0c-b5c289756bc2 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:30.653205 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5a89f-be48-4161-bb0c-b5c289756bc2 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] PATH_INFO: `/v3/groups/99786ba045de4ca48ae60b4350abde4c` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:30.665220 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a5a89f-be48-4161-bb0c-b5c289756bc2 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorizing `identity:delete_group(group_id=99786ba045de4ca48ae60b4350abde4c)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:30.667304 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a5a89f-be48-4161-bb0c-b5c289756bc2 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:30.698318 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-fac91040-f980-4904-9e57-e098691deb46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07a45c0004c64d2491421acba0abf925'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:30.698960 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-fac91040-f980-4904-9e57-e098691deb46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07a45c0004c64d2491421acba0abf925'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:30.705284 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2870/5700] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:33:30 2022] DELETE /identity/v3/users/07a45c0004c64d2491421acba0abf925 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:30.706066 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac91040-f980-4904-9e57-e098691deb46 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:30.707391 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-fac91040-f980-4904-9e57-e098691deb46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:30.795978 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac91040-f980-4904-9e57-e098691deb46 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:30.801822 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33f61b5-dd80-4785-8439-7a95787cc27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:30.802993 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33f61b5-dd80-4785-8439-7a95787cc27a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:30.803501 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33f61b5-dd80-4785-8439-7a95787cc27a admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:30.803926 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33f61b5-dd80-4785-8439-7a95787cc27a admin admin] PATH_INFO: `/v3/projects/01ee6268a3564343aa30b49035a0e4fe` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:30.804613 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2831/5701] 10.222.0.52 () {58 vars in 1226 bytes} [Sat May 14 21:33:30 2022] DELETE /identity/v3/groups/99786ba045de4ca48ae60b4350abde4c => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:30.806119 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33f61b5-dd80-4785-8439-7a95787cc27a admin admin] RBAC: Authorizing `identity:delete_project(project_id=01ee6268a3564343aa30b49035a0e4fe)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:30.808440 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33f61b5-dd80-4785-8439-7a95787cc27a admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:30.811928 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65699ed-62f4-4298-b0be-a8e116f19188 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:30.812219 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65699ed-62f4-4298-b0be-a8e116f19188 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:30.812500 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65699ed-62f4-4298-b0be-a8e116f19188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:30.830886 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-a65699ed-62f4-4298-b0be-a8e116f19188 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:33:30.832339 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-a65699ed-62f4-4298-b0be-a8e116f19188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:30.929981 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2832/5702] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:33:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:33:30.931710 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65699ed-62f4-4298-b0be-a8e116f19188 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:30.933547 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-a65699ed-62f4-4298-b0be-a8e116f19188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:30.984550 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c33f61b5-dd80-4785-8439-7a95787cc27a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01ee6268a3564343aa30b49035a0e4fe', 'request_id': 'req-c33f61b5-dd80-4785-8439-7a95787cc27a'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:30.989961 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c33f61b5-dd80-4785-8439-7a95787cc27a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01ee6268a3564343aa30b49035a0e4fe', 'request_id': 'req-c33f61b5-dd80-4785-8439-7a95787cc27a'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:31.009413 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65699ed-62f4-4298-b0be-a8e116f19188 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:31.070377 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b2e8d8-8e4d-4bc0-bdc8-bccfb8ef5db4 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f8f92cd5f6f44e386dae212364d79b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6399289b82f54d2181dc635e73f101ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:31.071086 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b2e8d8-8e4d-4bc0-bdc8-bccfb8ef5db4 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:31.071373 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b2e8d8-8e4d-4bc0-bdc8-bccfb8ef5db4 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:31.071688 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b2e8d8-8e4d-4bc0-bdc8-bccfb8ef5db4 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:31.072396 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b2e8d8-8e4d-4bc0-bdc8-bccfb8ef5db4 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:31.072512 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c33f61b5-dd80-4785-8439-7a95787cc27a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01ee6268a3564343aa30b49035a0e4fe', 'request_id': 'req-c33f61b5-dd80-4785-8439-7a95787cc27a'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:31.074456 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b2e8d8-8e4d-4bc0-bdc8-bccfb8ef5db4 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:31.085358 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c33f61b5-dd80-4785-8439-7a95787cc27a admin admin] The token cache is being invalidate because project 01ee6268a3564343aa30b49035a0e4fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:33:31.085653 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c33f61b5-dd80-4785-8439-7a95787cc27a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:31.086869 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c33f61b5-dd80-4785-8439-7a95787cc27a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:31.088589 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2871/5703] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:33:30 2022] DELETE /identity/v3/projects/01ee6268a3564343aa30b49035a0e4fe => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:31.089351 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33f61b5-dd80-4785-8439-7a95787cc27a admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:31.090779 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c33f61b5-dd80-4785-8439-7a95787cc27a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:31.151676 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33f61b5-dd80-4785-8439-7a95787cc27a admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:31.155632 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818c9ca6-6391-4ce1-8196-c24a7dc07bf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:31.156243 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c9ca6-6391-4ce1-8196-c24a7dc07bf3 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:31.156521 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c9ca6-6391-4ce1-8196-c24a7dc07bf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:31.157520 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c9ca6-6391-4ce1-8196-c24a7dc07bf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:31.161042 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-818c9ca6-6391-4ce1-8196-c24a7dc07bf3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:31.180555 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2833/5704] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:33:30 2022] POST /identity/v3/users => generated 321 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:33:31.182290 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821b0e8-f706-4a68-873a-b2d3d9cb75f3 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:31.182642 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821b0e8-f706-4a68-873a-b2d3d9cb75f3 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:31.182990 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821b0e8-f706-4a68-873a-b2d3d9cb75f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:31.206489 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-a821b0e8-f706-4a68-873a-b2d3d9cb75f3 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:33:31.208378 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-a821b0e8-f706-4a68-873a-b2d3d9cb75f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:31.240004 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818c9ca6-6391-4ce1-8196-c24a7dc07bf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:31.241767 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818c9ca6-6391-4ce1-8196-c24a7dc07bf3 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:31.253102 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2872/5705] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:33:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:33:31.256035 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818c9ca6-6391-4ce1-8196-c24a7dc07bf3 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:31.256035 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-818c9ca6-6391-4ce1-8196-c24a7dc07bf3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:31.273146 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818c9ca6-6391-4ce1-8196-c24a7dc07bf3 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:31.283022 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2834/5706] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:33:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:33:31.285712 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe8e65-5bef-4192-947e-064b55f8be0d tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f8f92cd5f6f44e386dae212364d79b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6399289b82f54d2181dc635e73f101ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:31.286169 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59620602-6c3b-4545-aabf-2438cd16ecd9 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:31.286537 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe8e65-5bef-4192-947e-064b55f8be0d tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:31.286872 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59620602-6c3b-4545-aabf-2438cd16ecd9 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:31.286986 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe8e65-5bef-4192-947e-064b55f8be0d tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:31.287278 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe8e65-5bef-4192-947e-064b55f8be0d tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] PATH_INFO: `/v3/groups` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:31.287699 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59620602-6c3b-4545-aabf-2438cd16ecd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:31.288170 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfe8e65-5bef-4192-947e-064b55f8be0d tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:31.291757 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfe8e65-5bef-4192-947e-064b55f8be0d tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:31.312508 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-59620602-6c3b-4545-aabf-2438cd16ecd9 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:33:31.314021 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-59620602-6c3b-4545-aabf-2438cd16ecd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:31.326299 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2835/5707] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:33:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:33:31.330588 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59620602-6c3b-4545-aabf-2438cd16ecd9 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:31.342769 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59620602-6c3b-4545-aabf-2438cd16ecd9 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:31.350191 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61a7719-8c28-4d22-b908-fb0a7c21ee93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:31.350593 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a7719-8c28-4d22-b908-fb0a7c21ee93 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:31.350960 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a7719-8c28-4d22-b908-fb0a7c21ee93 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:31.351315 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a7719-8c28-4d22-b908-fb0a7c21ee93 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:31.352265 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61a7719-8c28-4d22-b908-fb0a7c21ee93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:33:31.352650 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61a7719-8c28-4d22-b908-fb0a7c21ee93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:31.355095 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61a7719-8c28-4d22-b908-fb0a7c21ee93 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:31.372908 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2836/5708] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:33:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:33:31.374151 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61a7719-8c28-4d22-b908-fb0a7c21ee93 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:31.385838 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61a7719-8c28-4d22-b908-fb0a7c21ee93 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:31.400961 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39d69e0-5e00-4f3e-96c6-7a3c8405059c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:31.401705 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d69e0-5e00-4f3e-96c6-7a3c8405059c admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:31.402283 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d69e0-5e00-4f3e-96c6-7a3c8405059c admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:31.402420 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2873/5709] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:33:31 2022] POST /identity/v3/groups => generated 327 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:33:31.402640 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d69e0-5e00-4f3e-96c6-7a3c8405059c admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:31.403353 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39d69e0-5e00-4f3e-96c6-7a3c8405059c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:31.405808 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39d69e0-5e00-4f3e-96c6-7a3c8405059c admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:31.406842 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe8e65-5bef-4192-947e-064b55f8be0d tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:31.420997 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe8e65-5bef-4192-947e-064b55f8be0d tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:31.427063 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0d4964-52b0-425c-b34b-db7620176b98 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f8f92cd5f6f44e386dae212364d79b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6399289b82f54d2181dc635e73f101ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:31.428026 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d4964-52b0-425c-b34b-db7620176b98 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:31.428321 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d4964-52b0-425c-b34b-db7620176b98 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:31.428607 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d4964-52b0-425c-b34b-db7620176b98 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] PATH_INFO: `/v3/groups/e5fbd143366e49c5b3cd9cb7052ab0bc/users/bccda1ce0f8c4d3aa37a024c5140a4ae` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:31.449884 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0d4964-52b0-425c-b34b-db7620176b98 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=e5fbd143366e49c5b3cd9cb7052ab0bc, user_id=bccda1ce0f8c4d3aa37a024c5140a4ae)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:31.451822 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0d4964-52b0-425c-b34b-db7620176b98 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:31.517597 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2837/5710] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:33:31 2022] POST /identity/v3/projects => generated 373 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:33:31.522403 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39d69e0-5e00-4f3e-96c6-7a3c8405059c admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:31.542320 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2874/5711] 10.222.0.52 () {60 vars in 1359 bytes} [Sat May 14 21:33:31 2022] PUT /identity/v3/groups/e5fbd143366e49c5b3cd9cb7052ab0bc/users/bccda1ce0f8c4d3aa37a024c5140a4ae => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:31.547976 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0d4964-52b0-425c-b34b-db7620176b98 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:31.617202 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39d69e0-5e00-4f3e-96c6-7a3c8405059c admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:31.653920 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0d4964-52b0-425c-b34b-db7620176b98 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:31.659160 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eff69bc-0964-4785-8943-223eabf43313 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f8f92cd5f6f44e386dae212364d79b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6399289b82f54d2181dc635e73f101ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:31.659857 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff69bc-0964-4785-8943-223eabf43313 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:31.660141 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff69bc-0964-4785-8943-223eabf43313 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:31.660418 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff69bc-0964-4785-8943-223eabf43313 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] PATH_INFO: `/v3/groups` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:31.661128 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eff69bc-0964-4785-8943-223eabf43313 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:31.663080 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eff69bc-0964-4785-8943-223eabf43313 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:31.683432 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1872bb47-dfd1-448c-9657-d9dd8e309042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:31.693975 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872bb47-dfd1-448c-9657-d9dd8e309042 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:31.693975 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872bb47-dfd1-448c-9657-d9dd8e309042 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:31.693975 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872bb47-dfd1-448c-9657-d9dd8e309042 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:31.693975 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1872bb47-dfd1-448c-9657-d9dd8e309042 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:31.693975 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1872bb47-dfd1-448c-9657-d9dd8e309042 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:31.764096 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2875/5712] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:33:31 2022] POST /identity/v3/groups => generated 326 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:33:31.766279 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eff69bc-0964-4785-8943-223eabf43313 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:31.766696 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-2eff69bc-0964-4785-8943-223eabf43313 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:31.783995 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eff69bc-0964-4785-8943-223eabf43313 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:31.790969 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed436077-6936-490a-8fc3-69f7e3d199ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:31.791863 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed436077-6936-490a-8fc3-69f7e3d199ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:31.792145 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed436077-6936-490a-8fc3-69f7e3d199ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:31.792420 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed436077-6936-490a-8fc3-69f7e3d199ba admin admin] PATH_INFO: `/v3/projects/87acd75b9e52482996ab310e28234587` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:31.793619 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed436077-6936-490a-8fc3-69f7e3d199ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=87acd75b9e52482996ab310e28234587)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:31.795572 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed436077-6936-490a-8fc3-69f7e3d199ba admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:31.804363 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2838/5713] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:33:31 2022] POST /identity/v3/users => generated 287 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:33:31.805430 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1872bb47-dfd1-448c-9657-d9dd8e309042 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:31.817705 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1872bb47-dfd1-448c-9657-d9dd8e309042 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:31.822541 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb69545-4b3f-4a6c-9927-7fd8d4a2cb7d tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f8f92cd5f6f44e386dae212364d79b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6399289b82f54d2181dc635e73f101ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:31.823433 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb69545-4b3f-4a6c-9927-7fd8d4a2cb7d tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:31.823747 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb69545-4b3f-4a6c-9927-7fd8d4a2cb7d tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:31.824027 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb69545-4b3f-4a6c-9927-7fd8d4a2cb7d tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] PATH_INFO: `/v3/groups/2ef7e98f024d4d0bb88f6066c0d9ea91/users/bccda1ce0f8c4d3aa37a024c5140a4ae` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:31.829727 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb69545-4b3f-4a6c-9927-7fd8d4a2cb7d tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=2ef7e98f024d4d0bb88f6066c0d9ea91, user_id=bccda1ce0f8c4d3aa37a024c5140a4ae)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:31.831750 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb69545-4b3f-4a6c-9927-7fd8d4a2cb7d tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:31.913288 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ed436077-6936-490a-8fc3-69f7e3d199ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87acd75b9e52482996ab310e28234587', 'request_id': 'req-ed436077-6936-490a-8fc3-69f7e3d199ba'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:31.919795 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ed436077-6936-490a-8fc3-69f7e3d199ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87acd75b9e52482996ab310e28234587', 'request_id': 'req-ed436077-6936-490a-8fc3-69f7e3d199ba'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:31.975302 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2839/5714] 10.222.0.52 () {60 vars in 1359 bytes} [Sat May 14 21:33:31 2022] PUT /identity/v3/groups/2ef7e98f024d4d0bb88f6066c0d9ea91/users/bccda1ce0f8c4d3aa37a024c5140a4ae => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:31.984660 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb69545-4b3f-4a6c-9927-7fd8d4a2cb7d tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:32.041863 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb69545-4b3f-4a6c-9927-7fd8d4a2cb7d tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:32.047262 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770438bd-5dfb-4041-a3f8-77307ca814c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:32.053929 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770438bd-5dfb-4041-a3f8-77307ca814c6 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:32.053929 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770438bd-5dfb-4041-a3f8-77307ca814c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:32.053929 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770438bd-5dfb-4041-a3f8-77307ca814c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:32.053929 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770438bd-5dfb-4041-a3f8-77307ca814c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:32.053929 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770438bd-5dfb-4041-a3f8-77307ca814c6 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:32.065081 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2840/5715] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:33:31 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:33:32.065081 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770438bd-5dfb-4041-a3f8-77307ca814c6 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:32.071539 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ed436077-6936-490a-8fc3-69f7e3d199ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87acd75b9e52482996ab310e28234587', 'request_id': 'req-ed436077-6936-490a-8fc3-69f7e3d199ba'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:32.084960 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ed436077-6936-490a-8fc3-69f7e3d199ba admin admin] The token cache is being invalidate because project 87acd75b9e52482996ab310e28234587 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:33:32.085391 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ed436077-6936-490a-8fc3-69f7e3d199ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:32.086654 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ed436077-6936-490a-8fc3-69f7e3d199ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:32.092133 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2876/5716] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:33:31 2022] DELETE /identity/v3/projects/87acd75b9e52482996ab310e28234587 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:32.092133 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed436077-6936-490a-8fc3-69f7e3d199ba admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:32.092133 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ed436077-6936-490a-8fc3-69f7e3d199ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:32.136599 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770438bd-5dfb-4041-a3f8-77307ca814c6 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:32.141677 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6d9bba-bfff-494e-a4e7-c4c43d06b00f tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f8f92cd5f6f44e386dae212364d79b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6399289b82f54d2181dc635e73f101ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:32.142832 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d9bba-bfff-494e-a4e7-c4c43d06b00f tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:32.143122 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d9bba-bfff-494e-a4e7-c4c43d06b00f tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:32.143400 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d9bba-bfff-494e-a4e7-c4c43d06b00f tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] PATH_INFO: `/v3/users/bccda1ce0f8c4d3aa37a024c5140a4ae/groups` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:32.144824 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6d9bba-bfff-494e-a4e7-c4c43d06b00f tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorizing `identity:list_groups_for_user(user_id=bccda1ce0f8c4d3aa37a024c5140a4ae)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:32.146970 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6d9bba-bfff-494e-a4e7-c4c43d06b00f tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:32.162202 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2841/5717] 10.222.0.52 () {58 vars in 1241 bytes} [Sat May 14 21:33:32 2022] GET /identity/v3/users/bccda1ce0f8c4d3aa37a024c5140a4ae/groups => generated 839 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:33:32.163444 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6d9bba-bfff-494e-a4e7-c4c43d06b00f tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:32.165466 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-7b6d9bba-bfff-494e-a4e7-c4c43d06b00f tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:32.181349 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed436077-6936-490a-8fc3-69f7e3d199ba admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:32.182185 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6d9bba-bfff-494e-a4e7-c4c43d06b00f tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:32.186713 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc15c2-5db6-48ea-857a-c7130bda6a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:32.187378 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc15c2-5db6-48ea-857a-c7130bda6a8f admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:32.187587 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a1fa22-de4d-427c-bdda-fe4c3882dcc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:32.187725 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc15c2-5db6-48ea-857a-c7130bda6a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:32.188052 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc15c2-5db6-48ea-857a-c7130bda6a8f admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:32.188834 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a1fa22-de4d-427c-bdda-fe4c3882dcc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:32.188950 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bc15c2-5db6-48ea-857a-c7130bda6a8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:32.189241 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a1fa22-de4d-427c-bdda-fe4c3882dcc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:32.189594 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a1fa22-de4d-427c-bdda-fe4c3882dcc2 admin admin] PATH_INFO: `/v3/users/063351757a6247db99c643bb221752d5` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:32.190554 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bc15c2-5db6-48ea-857a-c7130bda6a8f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:32.190956 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a1fa22-de4d-427c-bdda-fe4c3882dcc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=063351757a6247db99c643bb221752d5)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:32.193036 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a1fa22-de4d-427c-bdda-fe4c3882dcc2 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:32.204771 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2877/5718] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:33:32 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:33:32.206084 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc15c2-5db6-48ea-857a-c7130bda6a8f admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:32.208050 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-05bc15c2-5db6-48ea-857a-c7130bda6a8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:32.223154 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc15c2-5db6-48ea-857a-c7130bda6a8f admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:32.228857 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53891308-c729-4038-b37a-49089708823b tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f8f92cd5f6f44e386dae212364d79b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6399289b82f54d2181dc635e73f101ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:32.230746 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53891308-c729-4038-b37a-49089708823b tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:32.230746 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53891308-c729-4038-b37a-49089708823b tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:32.230746 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53891308-c729-4038-b37a-49089708823b tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] PATH_INFO: `/v3/groups/2ef7e98f024d4d0bb88f6066c0d9ea91` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:32.231889 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53891308-c729-4038-b37a-49089708823b tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorizing `identity:delete_group(group_id=2ef7e98f024d4d0bb88f6066c0d9ea91)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:32.233836 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53891308-c729-4038-b37a-49089708823b tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:32.366965 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2878/5719] 10.222.0.52 () {58 vars in 1226 bytes} [Sat May 14 21:33:32 2022] DELETE /identity/v3/groups/2ef7e98f024d4d0bb88f6066c0d9ea91 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:32.369020 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53891308-c729-4038-b37a-49089708823b tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:32.393165 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-18a1fa22-de4d-427c-bdda-fe4c3882dcc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '063351757a6247db99c643bb221752d5'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:32.401042 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-18a1fa22-de4d-427c-bdda-fe4c3882dcc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '063351757a6247db99c643bb221752d5'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:32.401952 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-18a1fa22-de4d-427c-bdda-fe4c3882dcc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '063351757a6247db99c643bb221752d5'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:32.438370 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53891308-c729-4038-b37a-49089708823b tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:32.443194 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc3808d-7267-4924-b7df-279fd1250a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:32.444122 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3808d-7267-4924-b7df-279fd1250a5e admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:32.444404 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3808d-7267-4924-b7df-279fd1250a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:32.444678 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3808d-7267-4924-b7df-279fd1250a5e admin admin] PATH_INFO: `/v3/projects/82badb8800bb4096858c945e023ba597/users/330bae366647464baf7e58662b9b2fb1/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:32.460049 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-18a1fa22-de4d-427c-bdda-fe4c3882dcc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '063351757a6247db99c643bb221752d5'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:32.462896 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc3808d-7267-4924-b7df-279fd1250a5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=82badb8800bb4096858c945e023ba597, user_id=330bae366647464baf7e58662b9b2fb1, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:32.465207 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc3808d-7267-4924-b7df-279fd1250a5e admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:32.474070 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-18a1fa22-de4d-427c-bdda-fe4c3882dcc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '063351757a6247db99c643bb221752d5'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:32.480595 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2842/5720] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:33:32 2022] DELETE /identity/v3/users/063351757a6247db99c643bb221752d5 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:32.481629 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a1fa22-de4d-427c-bdda-fe4c3882dcc2 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:32.483056 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-18a1fa22-de4d-427c-bdda-fe4c3882dcc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:32.541892 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2879/5721] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:33:32 2022] PUT /identity/v3/projects/82badb8800bb4096858c945e023ba597/users/330bae366647464baf7e58662b9b2fb1/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:32.551822 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5fdf21-7771-4575-ab05-06f997e11137 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:32.552237 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5fdf21-7771-4575-ab05-06f997e11137 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:32.552634 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5fdf21-7771-4575-ab05-06f997e11137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:32.565453 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a1fa22-de4d-427c-bdda-fe4c3882dcc2 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:32.585471 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-ff5fdf21-7771-4575-ab05-06f997e11137 None None] MFA Rules not processed for user `330bae366647464baf7e58662b9b2fb1`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:33:32.586899 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ff5fdf21-7771-4575-ab05-06f997e11137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:32.640520 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a4fa4-e51e-4f91-9f00-d9e383a99d5f tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f8f92cd5f6f44e386dae212364d79b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6399289b82f54d2181dc635e73f101ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:32.641778 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a4fa4-e51e-4f91-9f00-d9e383a99d5f tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:32.642323 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a4fa4-e51e-4f91-9f00-d9e383a99d5f tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:32.642602 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a4fa4-e51e-4f91-9f00-d9e383a99d5f tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] PATH_INFO: `/v3/groups/e5fbd143366e49c5b3cd9cb7052ab0bc` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:32.643944 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20a4fa4-e51e-4f91-9f00-d9e383a99d5f tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorizing `identity:delete_group(group_id=e5fbd143366e49c5b3cd9cb7052ab0bc)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:32.645970 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20a4fa4-e51e-4f91-9f00-d9e383a99d5f tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:32.660167 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2880/5722] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:33:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:33:32.671309 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5fdf21-7771-4575-ab05-06f997e11137 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:32.674235 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ff5fdf21-7771-4575-ab05-06f997e11137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:32.743785 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5fdf21-7771-4575-ab05-06f997e11137 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:32.748216 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd0e634-9a64-4543-8335-b76b12062d93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:32.748877 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd0e634-9a64-4543-8335-b76b12062d93 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:32.749162 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd0e634-9a64-4543-8335-b76b12062d93 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:32.749441 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd0e634-9a64-4543-8335-b76b12062d93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:32.759999 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd0e634-9a64-4543-8335-b76b12062d93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:32.770254 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd0e634-9a64-4543-8335-b76b12062d93 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:32.770409 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2843/5723] 10.222.0.52 () {58 vars in 1226 bytes} [Sat May 14 21:33:32 2022] DELETE /identity/v3/groups/e5fbd143366e49c5b3cd9cb7052ab0bc => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:32.772239 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2881/5724] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:33:32 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:33:32.774370 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a4fa4-e51e-4f91-9f00-d9e383a99d5f tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:32.842389 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a4fa4-e51e-4f91-9f00-d9e383a99d5f tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:32.847325 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e415286-d1d3-46c1-9b53-9759268423b7 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f8f92cd5f6f44e386dae212364d79b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6399289b82f54d2181dc635e73f101ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:32.850793 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e415286-d1d3-46c1-9b53-9759268423b7 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:32.850793 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e415286-d1d3-46c1-9b53-9759268423b7 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:32.850793 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e415286-d1d3-46c1-9b53-9759268423b7 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] PATH_INFO: `/v3/users/bccda1ce0f8c4d3aa37a024c5140a4ae` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:32.850793 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e415286-d1d3-46c1-9b53-9759268423b7 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorizing `identity:delete_user(user_id=bccda1ce0f8c4d3aa37a024c5140a4ae)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:32.852508 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e415286-d1d3-46c1-9b53-9759268423b7 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:32.979609 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-6e415286-d1d3-46c1-9b53-9759268423b7 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bccda1ce0f8c4d3aa37a024c5140a4ae'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:32.986804 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-6e415286-d1d3-46c1-9b53-9759268423b7 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bccda1ce0f8c4d3aa37a024c5140a4ae'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:32.987536 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-6e415286-d1d3-46c1-9b53-9759268423b7 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bccda1ce0f8c4d3aa37a024c5140a4ae'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:33.075632 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-6e415286-d1d3-46c1-9b53-9759268423b7 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bccda1ce0f8c4d3aa37a024c5140a4ae'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:33.088543 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-6e415286-d1d3-46c1-9b53-9759268423b7 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bccda1ce0f8c4d3aa37a024c5140a4ae'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:33.094435 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2844/5725] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:33:32 2022] DELETE /identity/v3/users/bccda1ce0f8c4d3aa37a024c5140a4ae => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:33.099338 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd0e634-9a64-4543-8335-b76b12062d93 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:33.115185 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd0e634-9a64-4543-8335-b76b12062d93 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:33.118299 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e415286-d1d3-46c1-9b53-9759268423b7 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:33.119738 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-6e415286-d1d3-46c1-9b53-9759268423b7 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:33.199938 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e415286-d1d3-46c1-9b53-9759268423b7 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:33.204615 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3d7dbd-5bd6-47af-9c40-6ca0da152ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:33.205564 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d7dbd-5bd6-47af-9c40-6ca0da152ee1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:33.205853 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d7dbd-5bd6-47af-9c40-6ca0da152ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:33.206130 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d7dbd-5bd6-47af-9c40-6ca0da152ee1 admin admin] PATH_INFO: `/v3/projects/049de61d833b45bba49f7ebfc0f343c7` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:33.208220 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3d7dbd-5bd6-47af-9c40-6ca0da152ee1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=049de61d833b45bba49f7ebfc0f343c7)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:33.213136 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3d7dbd-5bd6-47af-9c40-6ca0da152ee1 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:33.220386 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4f2e92-8b29-44ca-b38f-8f5b2144adfb tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f8f92cd5f6f44e386dae212364d79b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6399289b82f54d2181dc635e73f101ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:33.221626 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4f2e92-8b29-44ca-b38f-8f5b2144adfb tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:33.221921 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4f2e92-8b29-44ca-b38f-8f5b2144adfb tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:33.222202 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4f2e92-8b29-44ca-b38f-8f5b2144adfb tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] PATH_INFO: `/v3/domains/495da423d8b3454ab289f8f698371d70` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:33.223606 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4f2e92-8b29-44ca-b38f-8f5b2144adfb tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=495da423d8b3454ab289f8f698371d70)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:33.225392 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4f2e92-8b29-44ca-b38f-8f5b2144adfb tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:33.247892 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-1e4f2e92-8b29-44ca-b38f-8f5b2144adfb tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '495da423d8b3454ab289f8f698371d70'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:33.248639 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-1e4f2e92-8b29-44ca-b38f-8f5b2144adfb tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '495da423d8b3454ab289f8f698371d70'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:33.340755 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-1e4f2e92-8b29-44ca-b38f-8f5b2144adfb tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '495da423d8b3454ab289f8f698371d70'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:33.341513 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-1e4f2e92-8b29-44ca-b38f-8f5b2144adfb tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '495da423d8b3454ab289f8f698371d70'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:33.344095 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2882/5726] 10.222.0.52 () {60 vars in 1248 bytes} [Sat May 14 21:33:33 2022] PATCH /identity/v3/domains/495da423d8b3454ab289f8f698371d70 => generated 278 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:33:33.346124 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-1e3d7dbd-5bd6-47af-9c40-6ca0da152ee1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '049de61d833b45bba49f7ebfc0f343c7', 'request_id': 'req-1e3d7dbd-5bd6-47af-9c40-6ca0da152ee1'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:33.347913 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4f2e92-8b29-44ca-b38f-8f5b2144adfb tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:33.349324 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-1e4f2e92-8b29-44ca-b38f-8f5b2144adfb tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:33.355344 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-1e3d7dbd-5bd6-47af-9c40-6ca0da152ee1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '049de61d833b45bba49f7ebfc0f343c7', 'request_id': 'req-1e3d7dbd-5bd6-47af-9c40-6ca0da152ee1'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:33.364603 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-1e3d7dbd-5bd6-47af-9c40-6ca0da152ee1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '049de61d833b45bba49f7ebfc0f343c7', 'request_id': 'req-1e3d7dbd-5bd6-47af-9c40-6ca0da152ee1'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:33.441734 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4f2e92-8b29-44ca-b38f-8f5b2144adfb tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:33.448310 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-1e3d7dbd-5bd6-47af-9c40-6ca0da152ee1 admin admin] The token cache is being invalidate because project 049de61d833b45bba49f7ebfc0f343c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:33:33.450614 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-1e3d7dbd-5bd6-47af-9c40-6ca0da152ee1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:33.450614 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-1e3d7dbd-5bd6-47af-9c40-6ca0da152ee1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:33.454973 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2845/5727] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:33:33 2022] DELETE /identity/v3/projects/049de61d833b45bba49f7ebfc0f343c7 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:33:33.469147 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8868995f-fe9f-4188-be81-3a76f832770c None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:33.469655 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8868995f-fe9f-4188-be81-3a76f832770c None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:33.469938 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8868995f-fe9f-4188-be81-3a76f832770c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:33.499635 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-8868995f-fe9f-4188-be81-3a76f832770c None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:33:33.500860 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8868995f-fe9f-4188-be81-3a76f832770c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:33.543811 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535672c2-f383-454e-b04f-b9474e2174e0 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f8f92cd5f6f44e386dae212364d79b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6399289b82f54d2181dc635e73f101ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:33.545072 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535672c2-f383-454e-b04f-b9474e2174e0 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:33.545498 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535672c2-f383-454e-b04f-b9474e2174e0 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:33.545770 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535672c2-f383-454e-b04f-b9474e2174e0 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] PATH_INFO: `/v3/domains/495da423d8b3454ab289f8f698371d70` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:33.563105 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535672c2-f383-454e-b04f-b9474e2174e0 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=495da423d8b3454ab289f8f698371d70)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:33.571568 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535672c2-f383-454e-b04f-b9474e2174e0 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:33.571717 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2846/5728] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:33:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:33:33.577191 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c3195-bd08-4866-99f2-892eaff050e0 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:33.577543 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c3195-bd08-4866-99f2-892eaff050e0 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:33.577976 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c3195-bd08-4866-99f2-892eaff050e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:33.598938 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-262c3195-bd08-4866-99f2-892eaff050e0 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:33:33.600460 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-262c3195-bd08-4866-99f2-892eaff050e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:33.608204 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-535672c2-f383-454e-b04f-b9474e2174e0 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '495da423d8b3454ab289f8f698371d70'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:33.610159 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2847/5729] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:33:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:33:33.614386 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c3195-bd08-4866-99f2-892eaff050e0 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:33.619722 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-535672c2-f383-454e-b04f-b9474e2174e0 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '495da423d8b3454ab289f8f698371d70'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:33.627710 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c3195-bd08-4866-99f2-892eaff050e0 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:33.633569 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5277538d-012d-4475-9292-ede7b3b1417a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:33.634420 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277538d-012d-4475-9292-ede7b3b1417a admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:33.634809 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277538d-012d-4475-9292-ede7b3b1417a admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:33.635275 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277538d-012d-4475-9292-ede7b3b1417a admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:33.636150 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5277538d-012d-4475-9292-ede7b3b1417a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:33:33.636577 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5277538d-012d-4475-9292-ede7b3b1417a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:33.638310 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5277538d-012d-4475-9292-ede7b3b1417a admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:33.653861 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2848/5730] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:33:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:33:33.663572 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5277538d-012d-4475-9292-ede7b3b1417a admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:33.680843 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5277538d-012d-4475-9292-ede7b3b1417a admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:33.687937 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fa450f-b71d-44b5-afb9-775cf4ea34e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:33.687937 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa450f-b71d-44b5-afb9-775cf4ea34e4 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:33.688289 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa450f-b71d-44b5-afb9-775cf4ea34e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:33.688666 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa450f-b71d-44b5-afb9-775cf4ea34e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:33.689469 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fa450f-b71d-44b5-afb9-775cf4ea34e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:33.691672 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fa450f-b71d-44b5-afb9-775cf4ea34e4 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:33.750447 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-535672c2-f383-454e-b04f-b9474e2174e0 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '495da423d8b3454ab289f8f698371d70', 'request_id': 'req-535672c2-f383-454e-b04f-b9474e2174e0'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:33.756413 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-535672c2-f383-454e-b04f-b9474e2174e0 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '495da423d8b3454ab289f8f698371d70', 'request_id': 'req-535672c2-f383-454e-b04f-b9474e2174e0'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:33.807727 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2849/5731] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:33:33 2022] POST /identity/v3/projects => generated 365 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:33:33.808761 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fa450f-b71d-44b5-afb9-775cf4ea34e4 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:33.878009 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fa450f-b71d-44b5-afb9-775cf4ea34e4 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:33.884038 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae52dd9-4423-4771-95de-fec9bbe30c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:33.884715 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae52dd9-4423-4771-95de-fec9bbe30c1c admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:33.885127 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae52dd9-4423-4771-95de-fec9bbe30c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:33.885490 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae52dd9-4423-4771-95de-fec9bbe30c1c admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:33.886281 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae52dd9-4423-4771-95de-fec9bbe30c1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:33.888261 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae52dd9-4423-4771-95de-fec9bbe30c1c admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:33.945873 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-535672c2-f383-454e-b04f-b9474e2174e0 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '495da423d8b3454ab289f8f698371d70', 'request_id': 'req-535672c2-f383-454e-b04f-b9474e2174e0'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:33.962621 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-535672c2-f383-454e-b04f-b9474e2174e0 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] The token cache is being invalidate because project 495da423d8b3454ab289f8f698371d70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:33:33.963206 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-535672c2-f383-454e-b04f-b9474e2174e0 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:33.967845 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-535672c2-f383-454e-b04f-b9474e2174e0 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:33.974549 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-535672c2-f383-454e-b04f-b9474e2174e0 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '495da423d8b3454ab289f8f698371d70', 'request_id': 'req-535672c2-f383-454e-b04f-b9474e2174e0'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:33.976059 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-535672c2-f383-454e-b04f-b9474e2174e0 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '495da423d8b3454ab289f8f698371d70', 'request_id': 'req-535672c2-f383-454e-b04f-b9474e2174e0'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:33.998209 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-535672c2-f383-454e-b04f-b9474e2174e0 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '495da423d8b3454ab289f8f698371d70', 'request_id': 'req-535672c2-f383-454e-b04f-b9474e2174e0'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:34.007987 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2883/5732] 10.222.0.52 () {58 vars in 1229 bytes} [Sat May 14 21:33:33 2022] DELETE /identity/v3/domains/495da423d8b3454ab289f8f698371d70 => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:34.012406 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535672c2-f383-454e-b04f-b9474e2174e0 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:34.015406 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-535672c2-f383-454e-b04f-b9474e2174e0 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:34.050367 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2850/5733] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:33:33 2022] POST /identity/v3/users => generated 283 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:33:34.055272 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae52dd9-4423-4771-95de-fec9bbe30c1c admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:34.060631 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8ae52dd9-4423-4771-95de-fec9bbe30c1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:34.075452 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae52dd9-4423-4771-95de-fec9bbe30c1c admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:34.082451 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f233add4-3c6b-4bbc-a4d8-ecd4ae0668e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:34.083133 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233add4-3c6b-4bbc-a4d8-ecd4ae0668e4 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:34.083420 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233add4-3c6b-4bbc-a4d8-ecd4ae0668e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:34.083729 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233add4-3c6b-4bbc-a4d8-ecd4ae0668e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:34.084457 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f233add4-3c6b-4bbc-a4d8-ecd4ae0668e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:34.086065 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f233add4-3c6b-4bbc-a4d8-ecd4ae0668e4 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:34.093271 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535672c2-f383-454e-b04f-b9474e2174e0 tempest-GroupsV3TestJSON-1108343751 tempest-GroupsV3TestJSON-1108343751-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:34.098098 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83559102-69a0-4e7c-9ab6-4b3a0841cbc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:34.098965 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83559102-69a0-4e7c-9ab6-4b3a0841cbc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:34.099252 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83559102-69a0-4e7c-9ab6-4b3a0841cbc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:34.102936 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83559102-69a0-4e7c-9ab6-4b3a0841cbc0 admin admin] PATH_INFO: `/v3/users/e1f0a129bbe5424ea8d1243ccb5741f9` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:34.103187 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2851/5734] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:33:34 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:33:34.104794 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83559102-69a0-4e7c-9ab6-4b3a0841cbc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1f0a129bbe5424ea8d1243ccb5741f9)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:34.106893 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83559102-69a0-4e7c-9ab6-4b3a0841cbc0 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:34.110624 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f233add4-3c6b-4bbc-a4d8-ecd4ae0668e4 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:34.127057 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f233add4-3c6b-4bbc-a4d8-ecd4ae0668e4 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:34.132584 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c34cf8-3509-4964-9bc0-14db9047208f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:34.133401 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c34cf8-3509-4964-9bc0-14db9047208f admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:34.134010 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c34cf8-3509-4964-9bc0-14db9047208f admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:34.134659 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c34cf8-3509-4964-9bc0-14db9047208f admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:34.135337 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c34cf8-3509-4964-9bc0-14db9047208f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:34.138243 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c34cf8-3509-4964-9bc0-14db9047208f admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:34.154381 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2852/5735] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:33:34 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:33:34.158251 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c34cf8-3509-4964-9bc0-14db9047208f admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:34.170708 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c34cf8-3509-4964-9bc0-14db9047208f admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:34.176599 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8213e84c-514d-4286-9fc6-5563252cf1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:34.177514 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213e84c-514d-4286-9fc6-5563252cf1ad admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:34.177786 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213e84c-514d-4286-9fc6-5563252cf1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:34.178087 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213e84c-514d-4286-9fc6-5563252cf1ad admin admin] PATH_INFO: `/v3/projects/5d62ef5d2df94259814d63ba298d4e20/users/bdd28629a295499aacddeda6945778e3/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:34.197713 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8213e84c-514d-4286-9fc6-5563252cf1ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d62ef5d2df94259814d63ba298d4e20, user_id=bdd28629a295499aacddeda6945778e3, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:34.200935 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8213e84c-514d-4286-9fc6-5563252cf1ad admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:34.330594 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2853/5736] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:33:34 2022] PUT /identity/v3/projects/5d62ef5d2df94259814d63ba298d4e20/users/bdd28629a295499aacddeda6945778e3/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:33:34.342112 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b9614-fcf2-4e48-ac18-c57d95435fa0 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:34.342544 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b9614-fcf2-4e48-ac18-c57d95435fa0 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:34.342701 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b9614-fcf2-4e48-ac18-c57d95435fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:34.382953 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-982b9614-fcf2-4e48-ac18-c57d95435fa0 None None] MFA Rules not processed for user `bdd28629a295499aacddeda6945778e3`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:33:34.385137 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-83559102-69a0-4e7c-9ab6-4b3a0841cbc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1f0a129bbe5424ea8d1243ccb5741f9'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:34.387022 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-982b9614-fcf2-4e48-ac18-c57d95435fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:34.402968 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-83559102-69a0-4e7c-9ab6-4b3a0841cbc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1f0a129bbe5424ea8d1243ccb5741f9'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:34.411284 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-83559102-69a0-4e7c-9ab6-4b3a0841cbc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1f0a129bbe5424ea8d1243ccb5741f9'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:34.485030 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2854/5737] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:33:34 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:33:34.490126 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982b9614-fcf2-4e48-ac18-c57d95435fa0 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:34.527913 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-83559102-69a0-4e7c-9ab6-4b3a0841cbc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1f0a129bbe5424ea8d1243ccb5741f9'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:34.528606 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-83559102-69a0-4e7c-9ab6-4b3a0841cbc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1f0a129bbe5424ea8d1243ccb5741f9'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:34.536277 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2884/5738] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:33:34 2022] DELETE /identity/v3/users/e1f0a129bbe5424ea8d1243ccb5741f9 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:34.540876 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3972c91b-8603-402f-acaf-b34f9c3ebb00 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:34.541165 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3972c91b-8603-402f-acaf-b34f9c3ebb00 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:34.541739 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3972c91b-8603-402f-acaf-b34f9c3ebb00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:34.579158 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-3972c91b-8603-402f-acaf-b34f9c3ebb00 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:33:34.582835 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-3972c91b-8603-402f-acaf-b34f9c3ebb00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:34.605745 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982b9614-fcf2-4e48-ac18-c57d95435fa0 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:34.733119 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6f8862-892b-4fd5-b910-59ff2b05852e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:34.733625 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f8862-892b-4fd5-b910-59ff2b05852e admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:34.733930 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f8862-892b-4fd5-b910-59ff2b05852e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:34.743156 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f8862-892b-4fd5-b910-59ff2b05852e admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:34.743156 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6f8862-892b-4fd5-b910-59ff2b05852e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:34.743156 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6f8862-892b-4fd5-b910-59ff2b05852e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:34.756016 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2885/5739] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:33:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:33:34.756823 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3972c91b-8603-402f-acaf-b34f9c3ebb00 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:34.759219 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-3972c91b-8603-402f-acaf-b34f9c3ebb00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:34.868054 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3972c91b-8603-402f-acaf-b34f9c3ebb00 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:34.875332 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfae1b49-893b-4e11-89db-6167788eed30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:34.875332 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfae1b49-893b-4e11-89db-6167788eed30 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:34.875332 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfae1b49-893b-4e11-89db-6167788eed30 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:34.875332 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfae1b49-893b-4e11-89db-6167788eed30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:34.878627 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-dfae1b49-893b-4e11-89db-6167788eed30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:34.902245 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfae1b49-893b-4e11-89db-6167788eed30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:34.904083 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfae1b49-893b-4e11-89db-6167788eed30 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:34.906953 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2855/5740] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:33:34 2022] POST /identity/v3/projects => generated 363 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:33:34.907981 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6f8862-892b-4fd5-b910-59ff2b05852e admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:34.942766 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2886/5741] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:33:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:33:34.944320 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfae1b49-893b-4e11-89db-6167788eed30 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:34.952498 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-dfae1b49-893b-4e11-89db-6167788eed30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:34.983143 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfae1b49-893b-4e11-89db-6167788eed30 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:34.996650 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6f8862-892b-4fd5-b910-59ff2b05852e admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:35.001502 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a5eb4b-9595-412d-97bd-2ee23d68e425 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:35.002642 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5eb4b-9595-412d-97bd-2ee23d68e425 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:35.002930 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5eb4b-9595-412d-97bd-2ee23d68e425 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:35.003215 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5eb4b-9595-412d-97bd-2ee23d68e425 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:35.123113 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08502930-fdad-4a0f-b330-d182e0ab2d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:35.123864 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08502930-fdad-4a0f-b330-d182e0ab2d07 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:35.124162 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08502930-fdad-4a0f-b330-d182e0ab2d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:35.124444 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08502930-fdad-4a0f-b330-d182e0ab2d07 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:35.125161 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08502930-fdad-4a0f-b330-d182e0ab2d07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:35.128144 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08502930-fdad-4a0f-b330-d182e0ab2d07 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:35.130257 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a5eb4b-9595-412d-97bd-2ee23d68e425 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:35.132382 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a5eb4b-9595-412d-97bd-2ee23d68e425 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:35.150033 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2856/5742] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:33:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:33:35.261430 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2887/5743] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:33:34 2022] POST /identity/v3/users => generated 288 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:33:35.266314 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a5eb4b-9595-412d-97bd-2ee23d68e425 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:35.279013 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a5eb4b-9595-412d-97bd-2ee23d68e425 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:35.286501 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62138c45-51ad-4557-bb7c-267465781a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:35.286501 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62138c45-51ad-4557-bb7c-267465781a69 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:35.286815 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62138c45-51ad-4557-bb7c-267465781a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:35.293971 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62138c45-51ad-4557-bb7c-267465781a69 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:35.293971 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62138c45-51ad-4557-bb7c-267465781a69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:35.293971 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62138c45-51ad-4557-bb7c-267465781a69 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:35.306658 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2857/5744] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:33:35 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:33:35.311277 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08502930-fdad-4a0f-b330-d182e0ab2d07 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:35.334658 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08502930-fdad-4a0f-b330-d182e0ab2d07 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:35.342146 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0f61a0-8445-49c2-a640-2bc0be8c6ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:35.343364 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f61a0-8445-49c2-a640-2bc0be8c6ecb admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:35.343970 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f61a0-8445-49c2-a640-2bc0be8c6ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:35.344120 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f61a0-8445-49c2-a640-2bc0be8c6ecb admin admin] PATH_INFO: `/v3/projects/28e3d40619394585b4a4bec131c82270/users/933f21dfea8141c6b6e1cfc5fafa0183/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:35.373663 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0f61a0-8445-49c2-a640-2bc0be8c6ecb admin admin] RBAC: Authorizing `identity:create_grant(project_id=28e3d40619394585b4a4bec131c82270, user_id=933f21dfea8141c6b6e1cfc5fafa0183, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:35.383637 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0f61a0-8445-49c2-a640-2bc0be8c6ecb admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:35.485726 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2888/5745] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:33:35 2022] PUT /identity/v3/projects/28e3d40619394585b4a4bec131c82270/users/933f21dfea8141c6b6e1cfc5fafa0183/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:35.490072 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62138c45-51ad-4557-bb7c-267465781a69 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:35.507042 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62138c45-51ad-4557-bb7c-267465781a69 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:35.607785 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d45576-2bbb-4588-98af-9a93dd5fee6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:35.608469 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d45576-2bbb-4588-98af-9a93dd5fee6b admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:35.608759 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d45576-2bbb-4588-98af-9a93dd5fee6b admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:35.609037 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d45576-2bbb-4588-98af-9a93dd5fee6b admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:35.609771 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d45576-2bbb-4588-98af-9a93dd5fee6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:35.612029 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d45576-2bbb-4588-98af-9a93dd5fee6b admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:35.628171 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2858/5746] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:33:35 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:33:35.629015 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0f61a0-8445-49c2-a640-2bc0be8c6ecb admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:35.644332 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0f61a0-8445-49c2-a640-2bc0be8c6ecb admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:35.652149 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cc38a2-0b15-43c2-81ad-99779439d03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:35.653198 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc38a2-0b15-43c2-81ad-99779439d03c admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:35.653548 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc38a2-0b15-43c2-81ad-99779439d03c admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:35.653885 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc38a2-0b15-43c2-81ad-99779439d03c admin admin] PATH_INFO: `/v3/projects/28e3d40619394585b4a4bec131c82270/users/933f21dfea8141c6b6e1cfc5fafa0183/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:35.658178 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cc38a2-0b15-43c2-81ad-99779439d03c admin admin] RBAC: Authorizing `identity:create_grant(project_id=28e3d40619394585b4a4bec131c82270, user_id=933f21dfea8141c6b6e1cfc5fafa0183, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:35.663013 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cc38a2-0b15-43c2-81ad-99779439d03c admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:35.681254 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2889/5747] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:33:35 2022] PUT /identity/v3/projects/28e3d40619394585b4a4bec131c82270/users/933f21dfea8141c6b6e1cfc5fafa0183/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:33:35.692400 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa9841-e5d3-4cf3-b267-9b8c56813b1b None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:35.693817 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa9841-e5d3-4cf3-b267-9b8c56813b1b None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:35.694206 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa9841-e5d3-4cf3-b267-9b8c56813b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:35.725285 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-9eaa9841-e5d3-4cf3-b267-9b8c56813b1b None None] MFA Rules not processed for user `933f21dfea8141c6b6e1cfc5fafa0183`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:33:35.726676 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-9eaa9841-e5d3-4cf3-b267-9b8c56813b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:35.812426 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2859/5748] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:33:35 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:33:35.813937 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cc38a2-0b15-43c2-81ad-99779439d03c admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:35.838234 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cc38a2-0b15-43c2-81ad-99779439d03c admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:35.841145 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc4e980-f81b-43e0-9e05-57f127e25d6e tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '933f21dfea8141c6b6e1cfc5fafa0183', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28e3d40619394585b4a4bec131c82270', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:35.841912 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4e980-f81b-43e0-9e05-57f127e25d6e tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:35.842261 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4e980-f81b-43e0-9e05-57f127e25d6e tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:35.843097 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4e980-f81b-43e0-9e05-57f127e25d6e tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] PATH_INFO: `/v3/regions` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:35.844773 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc4e980-f81b-43e0-9e05-57f127e25d6e tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:35.845372 ncdv-master-1 devstack@keystone.service[91106]: WARNING py.warnings [None req-2dc4e980-f81b-43e0-9e05-57f127e25d6e tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:33:35.845372 ncdv-master-1 devstack@keystone.service[91106]: warnings.warn(msg) May 14 21:33:35.845372 ncdv-master-1 devstack@keystone.service[91106]: May 14 21:33:35.846358 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc4e980-f81b-43e0-9e05-57f127e25d6e tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:35.972021 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2890/5749] 10.222.0.52 () {60 vars in 1148 bytes} [Sat May 14 21:33:35 2022] POST /identity/v3/regions => generated 224 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:33:35.975796 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaa9841-e5d3-4cf3-b267-9b8c56813b1b None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:35.992250 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaa9841-e5d3-4cf3-b267-9b8c56813b1b None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:36.064414 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93106a86-1e34-4c5d-b50b-008576ab6dac tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '933f21dfea8141c6b6e1cfc5fafa0183', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28e3d40619394585b4a4bec131c82270', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:36.073084 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93106a86-1e34-4c5d-b50b-008576ab6dac tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:36.073931 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93106a86-1e34-4c5d-b50b-008576ab6dac tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:36.074535 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93106a86-1e34-4c5d-b50b-008576ab6dac tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] PATH_INFO: `/v3/regions` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:36.075598 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93106a86-1e34-4c5d-b50b-008576ab6dac tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:36.077078 ncdv-master-1 devstack@keystone.service[91107]: WARNING py.warnings [None req-93106a86-1e34-4c5d-b50b-008576ab6dac tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:33:36.077078 ncdv-master-1 devstack@keystone.service[91107]: warnings.warn(msg) May 14 21:33:36.077078 ncdv-master-1 devstack@keystone.service[91107]: May 14 21:33:36.078506 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93106a86-1e34-4c5d-b50b-008576ab6dac tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:36.252650 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2860/5750] 10.222.0.52 () {60 vars in 1148 bytes} [Sat May 14 21:33:35 2022] POST /identity/v3/regions => generated 224 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:33:36.256893 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc4e980-f81b-43e0-9e05-57f127e25d6e tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:36.273960 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc4e980-f81b-43e0-9e05-57f127e25d6e tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:36.319011 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a2e076-3e74-48db-9259-2cf108c95294 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '933f21dfea8141c6b6e1cfc5fafa0183', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28e3d40619394585b4a4bec131c82270', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:36.328148 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2e076-3e74-48db-9259-2cf108c95294 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:36.328148 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2e076-3e74-48db-9259-2cf108c95294 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:36.328148 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2e076-3e74-48db-9259-2cf108c95294 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] PATH_INFO: `/v3/regions/110f401d-afbd-4b86-9f9a-3a185c60e863` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:36.328148 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a2e076-3e74-48db-9259-2cf108c95294 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] RBAC: Authorizing `identity:create_region(region_id=110f401d-afbd-4b86-9f9a-3a185c60e863)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:36.332477 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a2e076-3e74-48db-9259-2cf108c95294 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:36.399796 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93106a86-1e34-4c5d-b50b-008576ab6dac tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:36.400528 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-93106a86-1e34-4c5d-b50b-008576ab6dac tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:36.440154 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2891/5751] 10.222.0.52 () {60 vars in 1258 bytes} [Sat May 14 21:33:36 2022] PUT /identity/v3/regions/110f401d-afbd-4b86-9f9a-3a185c60e863 => generated 232 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:33:36.442318 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a2e076-3e74-48db-9259-2cf108c95294 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:36.502987 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a2e076-3e74-48db-9259-2cf108c95294 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:36.513511 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e5126d-5fa0-4e12-8033-6468f4633b85 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '933f21dfea8141c6b6e1cfc5fafa0183', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28e3d40619394585b4a4bec131c82270', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:36.515199 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e5126d-5fa0-4e12-8033-6468f4633b85 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:36.515841 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e5126d-5fa0-4e12-8033-6468f4633b85 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:36.516280 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e5126d-5fa0-4e12-8033-6468f4633b85 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] PATH_INFO: `/v3/regions/110f401d-afbd-4b86-9f9a-3a185c60e863` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:36.518286 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e5126d-5fa0-4e12-8033-6468f4633b85 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] RBAC: Authorizing `identity:delete_region(region_id=110f401d-afbd-4b86-9f9a-3a185c60e863)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:36.520598 ncdv-master-1 devstack@keystone.service[91106]: WARNING py.warnings [None req-b8e5126d-5fa0-4e12-8033-6468f4633b85 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:33:36.520598 ncdv-master-1 devstack@keystone.service[91106]: warnings.warn(msg) May 14 21:33:36.520598 ncdv-master-1 devstack@keystone.service[91106]: May 14 21:33:36.522961 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e5126d-5fa0-4e12-8033-6468f4633b85 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:36.562150 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93106a86-1e34-4c5d-b50b-008576ab6dac tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:36.579898 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139b90ec-ef11-426b-9c84-b448ca2b9e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:36.580912 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b90ec-ef11-426b-9c84-b448ca2b9e95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:36.581307 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b90ec-ef11-426b-9c84-b448ca2b9e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:36.581813 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b90ec-ef11-426b-9c84-b448ca2b9e95 admin admin] PATH_INFO: `/v3/projects/eae50436f3714e2cbb5deeb6574aee2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:36.583849 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139b90ec-ef11-426b-9c84-b448ca2b9e95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eae50436f3714e2cbb5deeb6574aee2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:36.586000 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139b90ec-ef11-426b-9c84-b448ca2b9e95 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:36.679221 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2892/5752] 10.222.0.52 () {58 vars in 1241 bytes} [Sat May 14 21:33:36 2022] DELETE /identity/v3/regions/110f401d-afbd-4b86-9f9a-3a185c60e863 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:36.684781 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e5126d-5fa0-4e12-8033-6468f4633b85 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:36.711782 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e5126d-5fa0-4e12-8033-6468f4633b85 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:36.719133 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfd8075-a2ad-43f9-b4aa-559a734f5ea3 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '933f21dfea8141c6b6e1cfc5fafa0183', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28e3d40619394585b4a4bec131c82270', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:36.720157 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfd8075-a2ad-43f9-b4aa-559a734f5ea3 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:36.720493 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfd8075-a2ad-43f9-b4aa-559a734f5ea3 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:36.722284 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfd8075-a2ad-43f9-b4aa-559a734f5ea3 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] PATH_INFO: `/v3/regions` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:36.723213 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfd8075-a2ad-43f9-b4aa-559a734f5ea3 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:36.725211 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfd8075-a2ad-43f9-b4aa-559a734f5ea3 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:36.748373 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-139b90ec-ef11-426b-9c84-b448ca2b9e95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eae50436f3714e2cbb5deeb6574aee2e', 'request_id': 'req-139b90ec-ef11-426b-9c84-b448ca2b9e95'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:36.757914 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-139b90ec-ef11-426b-9c84-b448ca2b9e95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eae50436f3714e2cbb5deeb6574aee2e', 'request_id': 'req-139b90ec-ef11-426b-9c84-b448ca2b9e95'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:36.765147 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-139b90ec-ef11-426b-9c84-b448ca2b9e95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eae50436f3714e2cbb5deeb6574aee2e', 'request_id': 'req-139b90ec-ef11-426b-9c84-b448ca2b9e95'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:36.876922 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2893/5753] 10.222.0.52 () {60 vars in 1149 bytes} [Sat May 14 21:33:36 2022] POST /identity/v3/regions => generated 253 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:33:36.881080 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfd8075-a2ad-43f9-b4aa-559a734f5ea3 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:36.912674 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfd8075-a2ad-43f9-b4aa-559a734f5ea3 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:36.947725 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-139b90ec-ef11-426b-9c84-b448ca2b9e95 admin admin] The token cache is being invalidate because project eae50436f3714e2cbb5deeb6574aee2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:33:36.948477 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-139b90ec-ef11-426b-9c84-b448ca2b9e95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:36.949259 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-139b90ec-ef11-426b-9c84-b448ca2b9e95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:36.964402 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2861/5754] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:33:36 2022] DELETE /identity/v3/projects/eae50436f3714e2cbb5deeb6574aee2e => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:33:36.970212 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139b90ec-ef11-426b-9c84-b448ca2b9e95 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:36.975499 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-139b90ec-ef11-426b-9c84-b448ca2b9e95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:37.011924 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2fe193-444c-424f-888a-4ec4929538d5 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '933f21dfea8141c6b6e1cfc5fafa0183', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28e3d40619394585b4a4bec131c82270', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:37.016101 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2fe193-444c-424f-888a-4ec4929538d5 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:37.016101 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2fe193-444c-424f-888a-4ec4929538d5 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:37.016101 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2fe193-444c-424f-888a-4ec4929538d5 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] PATH_INFO: `/v3/regions/0d8362bd6eb94a4c929bce21b307b726` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:37.016101 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2fe193-444c-424f-888a-4ec4929538d5 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] RBAC: Authorizing `identity:update_region(region_id=0d8362bd6eb94a4c929bce21b307b726)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:37.017528 ncdv-master-1 devstack@keystone.service[91106]: WARNING py.warnings [None req-1e2fe193-444c-424f-888a-4ec4929538d5 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:33:37.017528 ncdv-master-1 devstack@keystone.service[91106]: warnings.warn(msg) May 14 21:33:37.017528 ncdv-master-1 devstack@keystone.service[91106]: May 14 21:33:37.018470 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2fe193-444c-424f-888a-4ec4929538d5 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:37.137828 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139b90ec-ef11-426b-9c84-b448ca2b9e95 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:37.161881 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eda9034-5113-4a1c-806d-9ea3184653b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:37.175682 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda9034-5113-4a1c-806d-9ea3184653b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:37.175682 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda9034-5113-4a1c-806d-9ea3184653b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:37.175682 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda9034-5113-4a1c-806d-9ea3184653b8 admin admin] PATH_INFO: `/v3/users/3f8f92cd5f6f44e386dae212364d79b8` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:37.175682 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eda9034-5113-4a1c-806d-9ea3184653b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f8f92cd5f6f44e386dae212364d79b8)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:37.175682 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eda9034-5113-4a1c-806d-9ea3184653b8 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:37.176099 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2894/5755] 10.222.0.52 () {60 vars in 1249 bytes} [Sat May 14 21:33:36 2022] PATCH /identity/v3/regions/0d8362bd6eb94a4c929bce21b307b726 => generated 253 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:33:37.179324 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2fe193-444c-424f-888a-4ec4929538d5 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:37.183812 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-1e2fe193-444c-424f-888a-4ec4929538d5 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:37.216842 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2fe193-444c-424f-888a-4ec4929538d5 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:37.222597 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c035b07e-48ee-48db-b988-76881d1e8b0d tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '933f21dfea8141c6b6e1cfc5fafa0183', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28e3d40619394585b4a4bec131c82270', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:37.223468 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c035b07e-48ee-48db-b988-76881d1e8b0d tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:37.223974 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c035b07e-48ee-48db-b988-76881d1e8b0d tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:37.224264 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c035b07e-48ee-48db-b988-76881d1e8b0d tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] PATH_INFO: `/v3/regions/0d8362bd6eb94a4c929bce21b307b726` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:37.224931 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c035b07e-48ee-48db-b988-76881d1e8b0d tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] RBAC: Authorizing `identity:get_region(region_id=0d8362bd6eb94a4c929bce21b307b726)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:37.227454 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c035b07e-48ee-48db-b988-76881d1e8b0d tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:37.237981 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2895/5756] 10.222.0.52 () {58 vars in 1226 bytes} [Sat May 14 21:33:37 2022] GET /identity/v3/regions/0d8362bd6eb94a4c929bce21b307b726 => generated 253 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:33:37.241860 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c035b07e-48ee-48db-b988-76881d1e8b0d tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:37.254122 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c035b07e-48ee-48db-b988-76881d1e8b0d tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:37.260386 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fde593-caf1-4495-80c4-c05e6c15b670 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '933f21dfea8141c6b6e1cfc5fafa0183', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28e3d40619394585b4a4bec131c82270', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:37.261408 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fde593-caf1-4495-80c4-c05e6c15b670 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:37.261704 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fde593-caf1-4495-80c4-c05e6c15b670 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:37.261986 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fde593-caf1-4495-80c4-c05e6c15b670 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] PATH_INFO: `/v3/regions/0d8362bd6eb94a4c929bce21b307b726` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:37.262648 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fde593-caf1-4495-80c4-c05e6c15b670 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] RBAC: Authorizing `identity:delete_region(region_id=0d8362bd6eb94a4c929bce21b307b726)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:37.264422 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fde593-caf1-4495-80c4-c05e6c15b670 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:37.387785 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2896/5757] 10.222.0.52 () {58 vars in 1229 bytes} [Sat May 14 21:33:37 2022] DELETE /identity/v3/regions/0d8362bd6eb94a4c929bce21b307b726 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:33:37.391418 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fde593-caf1-4495-80c4-c05e6c15b670 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:37.417507 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fde593-caf1-4495-80c4-c05e6c15b670 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:37.423041 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed8b40a-dc88-4e26-8e7b-2f74b9131045 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '933f21dfea8141c6b6e1cfc5fafa0183', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28e3d40619394585b4a4bec131c82270', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:37.423804 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8b40a-dc88-4e26-8e7b-2f74b9131045 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:37.424111 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8b40a-dc88-4e26-8e7b-2f74b9131045 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:37.424380 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8b40a-dc88-4e26-8e7b-2f74b9131045 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] PATH_INFO: `/v3/regions` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:37.425171 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed8b40a-dc88-4e26-8e7b-2f74b9131045 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:37.426416 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed8b40a-dc88-4e26-8e7b-2f74b9131045 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:37.440923 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2897/5758] 10.222.0.52 () {58 vars in 1127 bytes} [Sat May 14 21:33:37 2022] GET /identity/v3/regions => generated 670 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:33:37.442070 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed8b40a-dc88-4e26-8e7b-2f74b9131045 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:37.455606 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-8eda9034-5113-4a1c-806d-9ea3184653b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f8f92cd5f6f44e386dae212364d79b8'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:37.457317 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed8b40a-dc88-4e26-8e7b-2f74b9131045 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:37.467934 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59adafad-b720-4d8c-9b37-f66575324ff2 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '933f21dfea8141c6b6e1cfc5fafa0183', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28e3d40619394585b4a4bec131c82270', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:37.467934 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59adafad-b720-4d8c-9b37-f66575324ff2 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:37.467934 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59adafad-b720-4d8c-9b37-f66575324ff2 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:37.468199 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59adafad-b720-4d8c-9b37-f66575324ff2 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] PATH_INFO: `/v3/regions/0d8362bd6eb94a4c929bce21b307b726` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:37.468199 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59adafad-b720-4d8c-9b37-f66575324ff2 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] RBAC: Authorizing `identity:delete_region(region_id=0d8362bd6eb94a4c929bce21b307b726)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:37.468347 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59adafad-b720-4d8c-9b37-f66575324ff2 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:37.469664 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-8eda9034-5113-4a1c-806d-9ea3184653b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f8f92cd5f6f44e386dae212364d79b8'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:37.470962 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-8eda9034-5113-4a1c-806d-9ea3184653b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f8f92cd5f6f44e386dae212364d79b8'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:37.487814 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-59adafad-b720-4d8c-9b37-f66575324ff2 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] Could not find region: 0d8362bd6eb94a4c929bce21b307b726.: keystone.exception.RegionNotFound: Could not find region: 0d8362bd6eb94a4c929bce21b307b726. May 14 21:33:37.487814 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:33:37.487814 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 129, in delete_region May 14 21:33:37.487814 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ret = self.driver.delete_region(region_id) May 14 21:33:37.487814 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 152, in delete_region May 14 21:33:37.487814 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ref = self._get_region(session, region_id) May 14 21:33:37.487814 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 103, in _get_region May 14 21:33:37.487814 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) May 14 21:33:37.487814 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: 0d8362bd6eb94a4c929bce21b307b726. May 14 21:33:37.487814 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:33:37.487814 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 21:33:37.487814 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:33:37.487814 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:33:37.487814 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 21:33:37.487814 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 21:33:37.487814 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 21:33:37.488950 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 21:33:37.488950 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 21:33:37.488950 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 21:33:37.488950 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 21:33:37.488950 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 21:33:37.488950 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 21:33:37.488950 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 21:33:37.488950 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/regions.py", line 92, in delete May 14 21:33:37.488950 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return PROVIDERS.catalog_api.delete_region( May 14 21:33:37.488950 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 21:33:37.488950 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 21:33:37.488950 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 135, in delete_region May 14 21:33:37.488950 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) May 14 21:33:37.488950 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: 0d8362bd6eb94a4c929bce21b307b726. May 14 21:33:37.488950 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:33:37.489861 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2898/5759] 10.222.0.52 () {58 vars in 1229 bytes} [Sat May 14 21:33:37 2022] DELETE /identity/v3/regions/0d8362bd6eb94a4c929bce21b307b726 => generated 112 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 14 21:33:37.500015 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59adafad-b720-4d8c-9b37-f66575324ff2 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:37.512727 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59adafad-b720-4d8c-9b37-f66575324ff2 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:37.519956 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00115547-8cb5-4b61-84b8-127891a19b2d tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '933f21dfea8141c6b6e1cfc5fafa0183', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28e3d40619394585b4a4bec131c82270', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:37.529453 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00115547-8cb5-4b61-84b8-127891a19b2d tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:37.529453 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00115547-8cb5-4b61-84b8-127891a19b2d tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:37.529453 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00115547-8cb5-4b61-84b8-127891a19b2d tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] PATH_INFO: `/v3/regions` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:37.529453 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00115547-8cb5-4b61-84b8-127891a19b2d tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:37.529453 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00115547-8cb5-4b61-84b8-127891a19b2d tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:37.533211 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2899/5760] 10.222.0.52 () {58 vars in 1127 bytes} [Sat May 14 21:33:37 2022] GET /identity/v3/regions => generated 670 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:33:37.535041 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00115547-8cb5-4b61-84b8-127891a19b2d tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:37.549469 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00115547-8cb5-4b61-84b8-127891a19b2d tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:37.555050 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbddc3c-af03-45e9-8697-5ee6173a960e tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '933f21dfea8141c6b6e1cfc5fafa0183', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28e3d40619394585b4a4bec131c82270', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:37.556291 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbddc3c-af03-45e9-8697-5ee6173a960e tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:37.556813 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbddc3c-af03-45e9-8697-5ee6173a960e tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:37.557511 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbddc3c-af03-45e9-8697-5ee6173a960e tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] PATH_INFO: `/v3/regions` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:37.558468 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbddc3c-af03-45e9-8697-5ee6173a960e tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:37.560452 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbddc3c-af03-45e9-8697-5ee6173a960e tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:37.577122 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-8eda9034-5113-4a1c-806d-9ea3184653b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f8f92cd5f6f44e386dae212364d79b8'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:37.597578 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-8eda9034-5113-4a1c-806d-9ea3184653b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f8f92cd5f6f44e386dae212364d79b8'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:37.605317 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2862/5761] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:33:36 2022] DELETE /identity/v3/users/3f8f92cd5f6f44e386dae212364d79b8 => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:37.692456 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2900/5762] 10.222.0.52 () {60 vars in 1149 bytes} [Sat May 14 21:33:37 2022] POST /identity/v3/regions => generated 253 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:33:37.696362 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eda9034-5113-4a1c-806d-9ea3184653b8 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:37.698520 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8eda9034-5113-4a1c-806d-9ea3184653b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:37.921205 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eda9034-5113-4a1c-806d-9ea3184653b8 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:37.921205 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cced9e-3055-4f14-b45e-057075d168b9 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '933f21dfea8141c6b6e1cfc5fafa0183', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28e3d40619394585b4a4bec131c82270', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:37.921205 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cced9e-3055-4f14-b45e-057075d168b9 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:37.921517 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cced9e-3055-4f14-b45e-057075d168b9 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:37.921517 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cced9e-3055-4f14-b45e-057075d168b9 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] PATH_INFO: `/v3/regions` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:37.921517 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cced9e-3055-4f14-b45e-057075d168b9 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] RBAC: Adding query filter params (parent_region_id=806404f3220a48dd97efaf7ff3c84ea2) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:33:37.921517 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cced9e-3055-4f14-b45e-057075d168b9 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:37.921517 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cced9e-3055-4f14-b45e-057075d168b9 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:37.921865 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2863/5763] 10.222.0.52 () {58 vars in 1226 bytes} [Sat May 14 21:33:37 2022] GET /identity/v3/regions?parent_region_id=806404f3220a48dd97efaf7ff3c84ea2 => generated 399 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:33:37.921943 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbddc3c-af03-45e9-8697-5ee6173a960e tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:37.921943 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbddc3c-af03-45e9-8697-5ee6173a960e tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:37.921943 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c081082-d66f-4ec0-a62e-906a2feb2ab9 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '933f21dfea8141c6b6e1cfc5fafa0183', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28e3d40619394585b4a4bec131c82270', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:37.922507 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c081082-d66f-4ec0-a62e-906a2feb2ab9 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:37.922507 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c081082-d66f-4ec0-a62e-906a2feb2ab9 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:37.922507 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c081082-d66f-4ec0-a62e-906a2feb2ab9 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] PATH_INFO: `/v3/regions/7d61e57283d1417a98776d7ba2111c9a` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:37.922507 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c081082-d66f-4ec0-a62e-906a2feb2ab9 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] RBAC: Authorizing `identity:delete_region(region_id=7d61e57283d1417a98776d7ba2111c9a)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:37.922507 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c081082-d66f-4ec0-a62e-906a2feb2ab9 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:38.076633 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2901/5764] 10.222.0.52 () {58 vars in 1229 bytes} [Sat May 14 21:33:37 2022] DELETE /identity/v3/regions/7d61e57283d1417a98776d7ba2111c9a => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:38.077882 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cced9e-3055-4f14-b45e-057075d168b9 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:38.090176 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cced9e-3055-4f14-b45e-057075d168b9 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:38.127137 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7954a2da-6056-488c-988f-3192780d2a38 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '933f21dfea8141c6b6e1cfc5fafa0183', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28e3d40619394585b4a4bec131c82270', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:38.133565 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7954a2da-6056-488c-988f-3192780d2a38 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:38.133565 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7954a2da-6056-488c-988f-3192780d2a38 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:38.133565 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7954a2da-6056-488c-988f-3192780d2a38 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] PATH_INFO: `/v3/regions/e46b88c6f1f54822a354b62f9942b57b` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:38.133565 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7954a2da-6056-488c-988f-3192780d2a38 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] RBAC: Authorizing `identity:delete_region(region_id=e46b88c6f1f54822a354b62f9942b57b)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:38.134116 ncdv-master-1 devstack@keystone.service[91107]: WARNING py.warnings [None req-7954a2da-6056-488c-988f-3192780d2a38 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:33:38.134116 ncdv-master-1 devstack@keystone.service[91107]: warnings.warn(msg) May 14 21:33:38.134116 ncdv-master-1 devstack@keystone.service[91107]: May 14 21:33:38.134116 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7954a2da-6056-488c-988f-3192780d2a38 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:38.329258 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2864/5765] 10.222.0.52 () {58 vars in 1229 bytes} [Sat May 14 21:33:38 2022] DELETE /identity/v3/regions/e46b88c6f1f54822a354b62f9942b57b => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:38.333178 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c081082-d66f-4ec0-a62e-906a2feb2ab9 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:38.356513 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c081082-d66f-4ec0-a62e-906a2feb2ab9 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:38.405988 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8101f61a-29cb-4c5f-b1d3-db8d0b841c09 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '933f21dfea8141c6b6e1cfc5fafa0183', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28e3d40619394585b4a4bec131c82270', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:38.407165 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8101f61a-29cb-4c5f-b1d3-db8d0b841c09 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:38.407884 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8101f61a-29cb-4c5f-b1d3-db8d0b841c09 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:38.408522 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8101f61a-29cb-4c5f-b1d3-db8d0b841c09 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] PATH_INFO: `/v3/regions/806404f3220a48dd97efaf7ff3c84ea2` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:38.409902 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8101f61a-29cb-4c5f-b1d3-db8d0b841c09 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] RBAC: Authorizing `identity:delete_region(region_id=806404f3220a48dd97efaf7ff3c84ea2)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:38.411854 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8101f61a-29cb-4c5f-b1d3-db8d0b841c09 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:38.598554 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2902/5766] 10.222.0.52 () {58 vars in 1229 bytes} [Sat May 14 21:33:38 2022] DELETE /identity/v3/regions/806404f3220a48dd97efaf7ff3c84ea2 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:33:38.600344 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7954a2da-6056-488c-988f-3192780d2a38 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:38.602581 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-7954a2da-6056-488c-988f-3192780d2a38 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:38.647726 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8101f61a-29cb-4c5f-b1d3-db8d0b841c09 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:38.651073 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-8101f61a-29cb-4c5f-b1d3-db8d0b841c09 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:38.786027 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7954a2da-6056-488c-988f-3192780d2a38 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:38.827275 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06fa8ea-aabf-4ff7-9028-1b03354f4897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:38.828223 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06fa8ea-aabf-4ff7-9028-1b03354f4897 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:38.828510 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06fa8ea-aabf-4ff7-9028-1b03354f4897 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:38.828809 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06fa8ea-aabf-4ff7-9028-1b03354f4897 admin admin] PATH_INFO: `/v3/users/bdd28629a295499aacddeda6945778e3` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:38.835292 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06fa8ea-aabf-4ff7-9028-1b03354f4897 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdd28629a295499aacddeda6945778e3)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:38.840493 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06fa8ea-aabf-4ff7-9028-1b03354f4897 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:38.842134 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8101f61a-29cb-4c5f-b1d3-db8d0b841c09 tempest-RegionsTestJSON-77150677 tempest-RegionsTestJSON-77150677-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:38.857937 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfad871f-34d6-4571-a53e-1820749502d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:38.858312 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad871f-34d6-4571-a53e-1820749502d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:38.858592 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad871f-34d6-4571-a53e-1820749502d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:38.858863 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad871f-34d6-4571-a53e-1820749502d9 admin admin] PATH_INFO: `/v3/projects/6399289b82f54d2181dc635e73f101ef` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:38.861517 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfad871f-34d6-4571-a53e-1820749502d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6399289b82f54d2181dc635e73f101ef)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:38.863611 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfad871f-34d6-4571-a53e-1820749502d9 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:39.243068 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-dfad871f-34d6-4571-a53e-1820749502d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6399289b82f54d2181dc635e73f101ef', 'request_id': 'req-dfad871f-34d6-4571-a53e-1820749502d9'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:39.251273 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a06fa8ea-aabf-4ff7-9028-1b03354f4897 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdd28629a295499aacddeda6945778e3'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:39.269254 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-dfad871f-34d6-4571-a53e-1820749502d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6399289b82f54d2181dc635e73f101ef', 'request_id': 'req-dfad871f-34d6-4571-a53e-1820749502d9'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:39.297481 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a06fa8ea-aabf-4ff7-9028-1b03354f4897 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdd28629a295499aacddeda6945778e3'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:39.307000 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a06fa8ea-aabf-4ff7-9028-1b03354f4897 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdd28629a295499aacddeda6945778e3'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:39.405886 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-dfad871f-34d6-4571-a53e-1820749502d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6399289b82f54d2181dc635e73f101ef', 'request_id': 'req-dfad871f-34d6-4571-a53e-1820749502d9'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:39.438705 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-dfad871f-34d6-4571-a53e-1820749502d9 admin admin] The token cache is being invalidate because project 6399289b82f54d2181dc635e73f101ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:33:39.441417 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-dfad871f-34d6-4571-a53e-1820749502d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:39.447881 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-dfad871f-34d6-4571-a53e-1820749502d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:39.474850 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2903/5767] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:33:38 2022] DELETE /identity/v3/projects/6399289b82f54d2181dc635e73f101ef => generated 0 bytes in 826 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:33:39.479743 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94701875-2b0d-44bc-af8f-5905da8e0ffe None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:39.481383 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94701875-2b0d-44bc-af8f-5905da8e0ffe None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:39.481681 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94701875-2b0d-44bc-af8f-5905da8e0ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:39.510620 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a06fa8ea-aabf-4ff7-9028-1b03354f4897 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdd28629a295499aacddeda6945778e3'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:39.543180 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a06fa8ea-aabf-4ff7-9028-1b03354f4897 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdd28629a295499aacddeda6945778e3'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:39.544459 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-94701875-2b0d-44bc-af8f-5905da8e0ffe None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:33:39.548795 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-94701875-2b0d-44bc-af8f-5905da8e0ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:39.560766 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2865/5768] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:33:38 2022] DELETE /identity/v3/users/bdd28629a295499aacddeda6945778e3 => generated 0 bytes in 960 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:39.563394 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcbc12a-59a3-45ea-a69b-eb84b2e9a425 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:39.563716 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcbc12a-59a3-45ea-a69b-eb84b2e9a425 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:39.564078 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcbc12a-59a3-45ea-a69b-eb84b2e9a425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:39.598031 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-efcbc12a-59a3-45ea-a69b-eb84b2e9a425 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:33:39.599658 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-efcbc12a-59a3-45ea-a69b-eb84b2e9a425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:39.671670 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2904/5769] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:33:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:33:39.677264 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5a776-a25a-4f19-8718-3e6f1f76dfcf None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:39.677264 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5a776-a25a-4f19-8718-3e6f1f76dfcf None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:39.677264 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5a776-a25a-4f19-8718-3e6f1f76dfcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:39.677519 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2866/5770] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:33:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:33:39.686421 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcbc12a-59a3-45ea-a69b-eb84b2e9a425 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:39.689537 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-efcbc12a-59a3-45ea-a69b-eb84b2e9a425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:39.725513 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-40b5a776-a25a-4f19-8718-3e6f1f76dfcf None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:33:39.728442 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-40b5a776-a25a-4f19-8718-3e6f1f76dfcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:39.740781 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2905/5771] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:33:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:33:39.751090 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b5a776-a25a-4f19-8718-3e6f1f76dfcf None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:39.773716 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b5a776-a25a-4f19-8718-3e6f1f76dfcf None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:39.776427 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88523d67-0a63-4c6e-b8bf-7aa094390af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:39.777106 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88523d67-0a63-4c6e-b8bf-7aa094390af0 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:39.777392 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88523d67-0a63-4c6e-b8bf-7aa094390af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:39.777669 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88523d67-0a63-4c6e-b8bf-7aa094390af0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:39.778400 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88523d67-0a63-4c6e-b8bf-7aa094390af0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:33:39.778722 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88523d67-0a63-4c6e-b8bf-7aa094390af0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:39.780974 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88523d67-0a63-4c6e-b8bf-7aa094390af0 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:39.806995 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2906/5772] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:33:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:33:39.806995 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88523d67-0a63-4c6e-b8bf-7aa094390af0 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:39.816382 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88523d67-0a63-4c6e-b8bf-7aa094390af0 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:39.838744 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcbc12a-59a3-45ea-a69b-eb84b2e9a425 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:39.847154 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b527c44c-b576-40bf-abe7-a8ade23c098b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:39.847368 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb0e266-2a27-4c6a-9745-83e826cbfa8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:39.848744 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb0e266-2a27-4c6a-9745-83e826cbfa8b service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:39.849200 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527c44c-b576-40bf-abe7-a8ade23c098b admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:39.849338 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb0e266-2a27-4c6a-9745-83e826cbfa8b service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:39.849749 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb0e266-2a27-4c6a-9745-83e826cbfa8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:39.849923 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527c44c-b576-40bf-abe7-a8ade23c098b admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:39.850355 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527c44c-b576-40bf-abe7-a8ade23c098b admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:39.851208 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b527c44c-b576-40bf-abe7-a8ade23c098b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:39.856801 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b527c44c-b576-40bf-abe7-a8ade23c098b admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:39.876328 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb0e266-2a27-4c6a-9745-83e826cbfa8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:39.878130 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb0e266-2a27-4c6a-9745-83e826cbfa8b service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:39.901321 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2867/5773] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:33:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:33:39.998145 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2907/5774] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:33:39 2022] POST /identity/v3/projects => generated 375 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:33:40.003194 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb0e266-2a27-4c6a-9745-83e826cbfa8b service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:40.018109 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb0e266-2a27-4c6a-9745-83e826cbfa8b service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:40.116440 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de12fdc-e94c-4bc5-9df1-b839b66469c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:40.118944 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de12fdc-e94c-4bc5-9df1-b839b66469c9 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:40.119320 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de12fdc-e94c-4bc5-9df1-b839b66469c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:40.119745 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de12fdc-e94c-4bc5-9df1-b839b66469c9 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:40.125683 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de12fdc-e94c-4bc5-9df1-b839b66469c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:40.137979 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de12fdc-e94c-4bc5-9df1-b839b66469c9 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:40.270525 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2868/5775] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:33:40 2022] POST /identity/v3/users => generated 288 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:33:40.271792 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b527c44c-b576-40bf-abe7-a8ade23c098b admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:40.284167 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b527c44c-b576-40bf-abe7-a8ade23c098b admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:40.289822 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda28bc-da53-4f3e-9240-1998215d3a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:40.290432 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda28bc-da53-4f3e-9240-1998215d3a1a admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:40.290762 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda28bc-da53-4f3e-9240-1998215d3a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:40.291054 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda28bc-da53-4f3e-9240-1998215d3a1a admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:40.291854 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddda28bc-da53-4f3e-9240-1998215d3a1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:40.293547 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddda28bc-da53-4f3e-9240-1998215d3a1a admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:40.309807 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de12fdc-e94c-4bc5-9df1-b839b66469c9 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:40.316789 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2908/5776] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:33:40 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:33:40.325931 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de12fdc-e94c-4bc5-9df1-b839b66469c9 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:40.330997 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babaed0e-0f67-46db-ab51-60c89141168e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:40.333335 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babaed0e-0f67-46db-ab51-60c89141168e admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:40.333335 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babaed0e-0f67-46db-ab51-60c89141168e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:40.333335 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babaed0e-0f67-46db-ab51-60c89141168e admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:40.333335 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babaed0e-0f67-46db-ab51-60c89141168e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:40.345826 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babaed0e-0f67-46db-ab51-60c89141168e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:40.368993 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda28bc-da53-4f3e-9240-1998215d3a1a admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:40.371993 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2869/5777] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:33:40 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:33:40.382783 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda28bc-da53-4f3e-9240-1998215d3a1a admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:40.425807 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8264b4a1-4e12-457d-b252-22be4371a5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:40.425807 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264b4a1-4e12-457d-b252-22be4371a5d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:40.425807 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264b4a1-4e12-457d-b252-22be4371a5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:40.425807 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264b4a1-4e12-457d-b252-22be4371a5d1 admin admin] PATH_INFO: `/v3/projects/63a065f76abb45a598ce947ffaa1eefb/users/d389ba08fcae455283edf7573badae37/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:40.466349 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8264b4a1-4e12-457d-b252-22be4371a5d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63a065f76abb45a598ce947ffaa1eefb, user_id=d389ba08fcae455283edf7573badae37, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:40.471956 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8264b4a1-4e12-457d-b252-22be4371a5d1 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:40.653388 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de5807-5398-4acb-89de-2b799b3edf23 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:40.653683 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de5807-5398-4acb-89de-2b799b3edf23 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:40.657978 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de5807-5398-4acb-89de-2b799b3edf23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:40.659328 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2909/5778] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:33:40 2022] PUT /identity/v3/projects/63a065f76abb45a598ce947ffaa1eefb/users/d389ba08fcae455283edf7573badae37/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:40.699127 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-69de5807-5398-4acb-89de-2b799b3edf23 None None] MFA Rules not processed for user `d389ba08fcae455283edf7573badae37`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:33:40.701070 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-69de5807-5398-4acb-89de-2b799b3edf23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:40.786685 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8264b4a1-4e12-457d-b252-22be4371a5d1 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:40.787709 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2870/5779] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:33:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:33:40.909135 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8264b4a1-4e12-457d-b252-22be4371a5d1 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:40.923410 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95446f99-2824-4278-80a8-120e9c6abcea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:40.931211 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95446f99-2824-4278-80a8-120e9c6abcea admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:40.931699 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95446f99-2824-4278-80a8-120e9c6abcea admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:40.932140 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95446f99-2824-4278-80a8-120e9c6abcea admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:40.933050 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95446f99-2824-4278-80a8-120e9c6abcea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:40.940743 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95446f99-2824-4278-80a8-120e9c6abcea admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:41.111087 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2910/5780] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:33:40 2022] POST /identity/v3/projects => generated 377 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:33:41.115552 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69de5807-5398-4acb-89de-2b799b3edf23 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:41.134598 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95446f99-2824-4278-80a8-120e9c6abcea admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:41.142964 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-95446f99-2824-4278-80a8-120e9c6abcea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:41.146143 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69de5807-5398-4acb-89de-2b799b3edf23 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:41.228956 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95446f99-2824-4278-80a8-120e9c6abcea admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:41.233895 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449d1a6-07aa-4ace-b54c-90fb194c752a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:41.234759 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449d1a6-07aa-4ace-b54c-90fb194c752a admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:41.235392 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449d1a6-07aa-4ace-b54c-90fb194c752a admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:41.235813 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449d1a6-07aa-4ace-b54c-90fb194c752a admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:41.236630 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6449d1a6-07aa-4ace-b54c-90fb194c752a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:41.239680 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6449d1a6-07aa-4ace-b54c-90fb194c752a admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:41.240275 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b6ff04-e4fa-4769-aa59-c426160fa153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:41.241262 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b6ff04-e4fa-4769-aa59-c426160fa153 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:41.241556 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b6ff04-e4fa-4769-aa59-c426160fa153 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:41.242024 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b6ff04-e4fa-4769-aa59-c426160fa153 admin admin] PATH_INFO: `/v3/projects/5d62ef5d2df94259814d63ba298d4e20` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:41.245622 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b6ff04-e4fa-4769-aa59-c426160fa153 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d62ef5d2df94259814d63ba298d4e20)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:41.248946 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b6ff04-e4fa-4769-aa59-c426160fa153 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:41.412651 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2871/5781] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:33:41 2022] POST /identity/v3/users => generated 295 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:33:41.413989 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449d1a6-07aa-4ace-b54c-90fb194c752a admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:41.434093 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b1b6ff04-e4fa-4769-aa59-c426160fa153 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d62ef5d2df94259814d63ba298d4e20', 'request_id': 'req-b1b6ff04-e4fa-4769-aa59-c426160fa153'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:41.438304 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449d1a6-07aa-4ace-b54c-90fb194c752a admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:41.447218 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b1b6ff04-e4fa-4769-aa59-c426160fa153 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d62ef5d2df94259814d63ba298d4e20', 'request_id': 'req-b1b6ff04-e4fa-4769-aa59-c426160fa153'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:41.527230 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b1b6ff04-e4fa-4769-aa59-c426160fa153 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d62ef5d2df94259814d63ba298d4e20', 'request_id': 'req-b1b6ff04-e4fa-4769-aa59-c426160fa153'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:41.552605 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b1b6ff04-e4fa-4769-aa59-c426160fa153 admin admin] The token cache is being invalidate because project 5d62ef5d2df94259814d63ba298d4e20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:33:41.552892 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b1b6ff04-e4fa-4769-aa59-c426160fa153 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:41.554081 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b1b6ff04-e4fa-4769-aa59-c426160fa153 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:41.560294 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2911/5782] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:33:41 2022] DELETE /identity/v3/projects/5d62ef5d2df94259814d63ba298d4e20 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:41.561695 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b6ff04-e4fa-4769-aa59-c426160fa153 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:41.564775 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b1b6ff04-e4fa-4769-aa59-c426160fa153 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:41.569235 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f448235-5530-4751-8d0a-075f19469433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:41.571638 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f448235-5530-4751-8d0a-075f19469433 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:41.574576 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f448235-5530-4751-8d0a-075f19469433 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:41.574888 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f448235-5530-4751-8d0a-075f19469433 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:41.575699 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f448235-5530-4751-8d0a-075f19469433 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:41.579143 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f448235-5530-4751-8d0a-075f19469433 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:41.595027 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b6ff04-e4fa-4769-aa59-c426160fa153 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:41.606535 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781eccf0-94c3-4c28-bd3f-747744ff2a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:41.614717 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781eccf0-94c3-4c28-bd3f-747744ff2a18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:41.614717 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781eccf0-94c3-4c28-bd3f-747744ff2a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:41.614717 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781eccf0-94c3-4c28-bd3f-747744ff2a18 admin admin] PATH_INFO: `/v3/users/933f21dfea8141c6b6e1cfc5fafa0183` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:41.614717 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781eccf0-94c3-4c28-bd3f-747744ff2a18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=933f21dfea8141c6b6e1cfc5fafa0183)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:41.614717 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781eccf0-94c3-4c28-bd3f-747744ff2a18 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:41.615514 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2872/5783] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:33:41 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:33:41.615801 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f448235-5530-4751-8d0a-075f19469433 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:41.624891 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-7f448235-5530-4751-8d0a-075f19469433 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:41.652276 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f448235-5530-4751-8d0a-075f19469433 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:41.665020 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b19d1a-abde-4699-9203-ed4cfdbfe828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:41.666376 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b19d1a-abde-4699-9203-ed4cfdbfe828 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:41.666676 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b19d1a-abde-4699-9203-ed4cfdbfe828 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:41.666955 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b19d1a-abde-4699-9203-ed4cfdbfe828 admin admin] PATH_INFO: `/v3/projects/bd8e2b08e11f477fa85b79a9d599f126/users/523707e535e6470985ee018c249a6513/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:41.697339 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b19d1a-abde-4699-9203-ed4cfdbfe828 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd8e2b08e11f477fa85b79a9d599f126, user_id=523707e535e6470985ee018c249a6513, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:41.700206 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b19d1a-abde-4699-9203-ed4cfdbfe828 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:41.793418 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2873/5784] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:33:41 2022] PUT /identity/v3/projects/bd8e2b08e11f477fa85b79a9d599f126/users/523707e535e6470985ee018c249a6513/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:41.795062 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b19d1a-abde-4699-9203-ed4cfdbfe828 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:41.891210 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-781eccf0-94c3-4c28-bd3f-747744ff2a18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '933f21dfea8141c6b6e1cfc5fafa0183'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:41.945926 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b19d1a-abde-4699-9203-ed4cfdbfe828 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:41.952599 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2685be-0b52-45e1-a3b6-c6af922cd41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:41.953549 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2685be-0b52-45e1-a3b6-c6af922cd41d admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:41.953905 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2685be-0b52-45e1-a3b6-c6af922cd41d admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:41.955186 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2685be-0b52-45e1-a3b6-c6af922cd41d admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:41.956059 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2685be-0b52-45e1-a3b6-c6af922cd41d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:41.959243 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2685be-0b52-45e1-a3b6-c6af922cd41d admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:41.960008 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-781eccf0-94c3-4c28-bd3f-747744ff2a18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '933f21dfea8141c6b6e1cfc5fafa0183'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:41.971281 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2874/5785] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:33:41 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:33:41.975903 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2685be-0b52-45e1-a3b6-c6af922cd41d admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:41.980672 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-781eccf0-94c3-4c28-bd3f-747744ff2a18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '933f21dfea8141c6b6e1cfc5fafa0183'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:41.995770 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2685be-0b52-45e1-a3b6-c6af922cd41d admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:42.008820 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc1e5a-f525-47a4-ac73-dedd7f67eb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:42.010295 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc1e5a-f525-47a4-ac73-dedd7f67eb88 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:42.010710 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc1e5a-f525-47a4-ac73-dedd7f67eb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:42.011123 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc1e5a-f525-47a4-ac73-dedd7f67eb88 admin admin] PATH_INFO: `/v3/projects/bd8e2b08e11f477fa85b79a9d599f126/users/523707e535e6470985ee018c249a6513/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:42.013794 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dc1e5a-f525-47a4-ac73-dedd7f67eb88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd8e2b08e11f477fa85b79a9d599f126, user_id=523707e535e6470985ee018c249a6513, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:42.017712 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dc1e5a-f525-47a4-ac73-dedd7f67eb88 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:42.049627 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2875/5786] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:33:41 2022] PUT /identity/v3/projects/bd8e2b08e11f477fa85b79a9d599f126/users/523707e535e6470985ee018c249a6513/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:33:42.052817 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0746c2-3df9-4011-bd7c-b206ffbbbfde None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:42.053176 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0746c2-3df9-4011-bd7c-b206ffbbbfde None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:42.053615 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0746c2-3df9-4011-bd7c-b206ffbbbfde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:42.089795 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-781eccf0-94c3-4c28-bd3f-747744ff2a18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '933f21dfea8141c6b6e1cfc5fafa0183'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:42.090539 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-781eccf0-94c3-4c28-bd3f-747744ff2a18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '933f21dfea8141c6b6e1cfc5fafa0183'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:42.099347 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2912/5787] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:33:41 2022] DELETE /identity/v3/users/933f21dfea8141c6b6e1cfc5fafa0183 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:42.103410 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-bf0746c2-3df9-4011-bd7c-b206ffbbbfde None None] MFA Rules not processed for user `523707e535e6470985ee018c249a6513`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:33:42.104738 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-bf0746c2-3df9-4011-bd7c-b206ffbbbfde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:42.232814 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2876/5788] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:33:42 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:33:42.235070 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781eccf0-94c3-4c28-bd3f-747744ff2a18 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:42.246941 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781eccf0-94c3-4c28-bd3f-747744ff2a18 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:42.259891 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f22b29-5bee-49e9-8287-19af7ac4fd1d tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '523707e535e6470985ee018c249a6513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8e2b08e11f477fa85b79a9d599f126', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:42.260907 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f22b29-5bee-49e9-8287-19af7ac4fd1d tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:42.261411 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f22b29-5bee-49e9-8287-19af7ac4fd1d tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:42.261907 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f22b29-5bee-49e9-8287-19af7ac4fd1d tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:42.262852 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f22b29-5bee-49e9-8287-19af7ac4fd1d tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:42.264934 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f22b29-5bee-49e9-8287-19af7ac4fd1d tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:42.396627 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2913/5789] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:33:42 2022] POST /identity/v3/projects => generated 334 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:33:42.401806 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0746c2-3df9-4011-bd7c-b206ffbbbfde None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:42.420263 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0746c2-3df9-4011-bd7c-b206ffbbbfde None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:42.541230 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125a7c14-5172-4bd8-bcc2-6ec3b4d6e6da tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '523707e535e6470985ee018c249a6513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8e2b08e11f477fa85b79a9d599f126', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:42.542533 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125a7c14-5172-4bd8-bcc2-6ec3b4d6e6da tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:42.543124 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125a7c14-5172-4bd8-bcc2-6ec3b4d6e6da tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:42.543735 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125a7c14-5172-4bd8-bcc2-6ec3b4d6e6da tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:42.544875 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125a7c14-5172-4bd8-bcc2-6ec3b4d6e6da tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:42.548380 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125a7c14-5172-4bd8-bcc2-6ec3b4d6e6da tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:42.679151 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2877/5790] 10.222.0.52 () {60 vars in 1151 bytes} [Sat May 14 21:33:42 2022] POST /identity/v3/projects => generated 333 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:33:42.681647 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f22b29-5bee-49e9-8287-19af7ac4fd1d tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:42.693940 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f22b29-5bee-49e9-8287-19af7ac4fd1d tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:42.826310 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93a95b1-e3ac-405e-9f7f-98b9ac7709fe tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '523707e535e6470985ee018c249a6513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8e2b08e11f477fa85b79a9d599f126', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:42.827341 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a95b1-e3ac-405e-9f7f-98b9ac7709fe tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:42.827969 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a95b1-e3ac-405e-9f7f-98b9ac7709fe tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:42.828482 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a95b1-e3ac-405e-9f7f-98b9ac7709fe tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:42.829357 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93a95b1-e3ac-405e-9f7f-98b9ac7709fe tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:42.832396 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93a95b1-e3ac-405e-9f7f-98b9ac7709fe tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:43.046649 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125a7c14-5172-4bd8-bcc2-6ec3b4d6e6da tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:43.049204 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2914/5791] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:33:42 2022] POST /identity/v3/projects => generated 358 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:33:43.067769 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125a7c14-5172-4bd8-bcc2-6ec3b4d6e6da tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:43.199493 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0817d982-0503-483c-b2ba-06fcf4461b73 tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '523707e535e6470985ee018c249a6513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8e2b08e11f477fa85b79a9d599f126', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:43.200221 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817d982-0503-483c-b2ba-06fcf4461b73 tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:43.200509 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817d982-0503-483c-b2ba-06fcf4461b73 tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:43.200794 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817d982-0503-483c-b2ba-06fcf4461b73 tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:43.201587 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0817d982-0503-483c-b2ba-06fcf4461b73 tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:43.204243 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0817d982-0503-483c-b2ba-06fcf4461b73 tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:43.278666 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2878/5792] 10.222.0.52 () {58 vars in 1130 bytes} [Sat May 14 21:33:43 2022] GET /identity/v3/projects => generated 7569 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:33:43.279041 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93a95b1-e3ac-405e-9f7f-98b9ac7709fe tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:43.314779 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93a95b1-e3ac-405e-9f7f-98b9ac7709fe tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:43.332187 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb57197-8da3-43d2-8e40-59190e814fb7 tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '523707e535e6470985ee018c249a6513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8e2b08e11f477fa85b79a9d599f126', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:43.333749 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb57197-8da3-43d2-8e40-59190e814fb7 tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:43.334200 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb57197-8da3-43d2-8e40-59190e814fb7 tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:43.334766 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb57197-8da3-43d2-8e40-59190e814fb7 tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:43.335578 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb57197-8da3-43d2-8e40-59190e814fb7 tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:33:43.336708 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb57197-8da3-43d2-8e40-59190e814fb7 tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:43.343869 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb57197-8da3-43d2-8e40-59190e814fb7 tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:43.425374 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2915/5793] 10.222.0.52 () {58 vars in 1157 bytes} [Sat May 14 21:33:43 2022] GET /identity/v3/projects?enabled=False => generated 445 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:33:43.431368 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0817d982-0503-483c-b2ba-06fcf4461b73 tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:43.448192 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0817d982-0503-483c-b2ba-06fcf4461b73 tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:43.458887 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3863cd4-6219-427c-853c-7b1780bc8b81 tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '523707e535e6470985ee018c249a6513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8e2b08e11f477fa85b79a9d599f126', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:43.459608 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3863cd4-6219-427c-853c-7b1780bc8b81 tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:43.459901 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3863cd4-6219-427c-853c-7b1780bc8b81 tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:43.460181 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3863cd4-6219-427c-853c-7b1780bc8b81 tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:43.461589 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3863cd4-6219-427c-853c-7b1780bc8b81 tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] RBAC: Adding query filter params (parent_id=172231144d5a4ff1b365f142f9b5f6fb) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:33:43.461986 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3863cd4-6219-427c-853c-7b1780bc8b81 tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:43.464182 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3863cd4-6219-427c-853c-7b1780bc8b81 tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:43.497779 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2879/5794] 10.222.0.52 () {58 vars in 1215 bytes} [Sat May 14 21:33:43 2022] GET /identity/v3/projects?parent_id=172231144d5a4ff1b365f142f9b5f6fb => generated 498 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:33:43.506774 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb57197-8da3-43d2-8e40-59190e814fb7 tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:43.553907 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb57197-8da3-43d2-8e40-59190e814fb7 tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:43.566698 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa9ced1-284d-4650-8561-15d72bff7583 tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '523707e535e6470985ee018c249a6513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8e2b08e11f477fa85b79a9d599f126', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:43.568449 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9ced1-284d-4650-8561-15d72bff7583 tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:43.571915 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9ced1-284d-4650-8561-15d72bff7583 tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:43.571915 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9ced1-284d-4650-8561-15d72bff7583 tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] PATH_INFO: `/v3/projects/2f2f530cb33842649ee785a7e37412f5` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:43.571915 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa9ced1-284d-4650-8561-15d72bff7583 tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2f2f530cb33842649ee785a7e37412f5)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:43.573718 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa9ced1-284d-4650-8561-15d72bff7583 tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:43.734124 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-eaa9ced1-284d-4650-8561-15d72bff7583 tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f2f530cb33842649ee785a7e37412f5', 'request_id': 'req-eaa9ced1-284d-4650-8561-15d72bff7583'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:43.750157 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-eaa9ced1-284d-4650-8561-15d72bff7583 tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f2f530cb33842649ee785a7e37412f5', 'request_id': 'req-eaa9ced1-284d-4650-8561-15d72bff7583'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:43.784462 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3863cd4-6219-427c-853c-7b1780bc8b81 tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:43.785948 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-a3863cd4-6219-427c-853c-7b1780bc8b81 tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:43.894237 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-eaa9ced1-284d-4650-8561-15d72bff7583 tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f2f530cb33842649ee785a7e37412f5', 'request_id': 'req-eaa9ced1-284d-4650-8561-15d72bff7583'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:43.913260 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-eaa9ced1-284d-4650-8561-15d72bff7583 tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] The token cache is being invalidate because project 2f2f530cb33842649ee785a7e37412f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:33:43.913749 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-eaa9ced1-284d-4650-8561-15d72bff7583 tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:43.917117 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-eaa9ced1-284d-4650-8561-15d72bff7583 tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:43.926234 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2916/5795] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:33:43 2022] DELETE /identity/v3/projects/2f2f530cb33842649ee785a7e37412f5 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:43.927397 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa9ced1-284d-4650-8561-15d72bff7583 tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:43.934076 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-eaa9ced1-284d-4650-8561-15d72bff7583 tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:43.945130 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3863cd4-6219-427c-853c-7b1780bc8b81 tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:44.036645 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa9ced1-284d-4650-8561-15d72bff7583 tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:44.045111 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caefc876-69cf-40cf-8a78-48151f53b0c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:44.046709 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caefc876-69cf-40cf-8a78-48151f53b0c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:44.047157 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caefc876-69cf-40cf-8a78-48151f53b0c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:44.047625 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caefc876-69cf-40cf-8a78-48151f53b0c7 admin admin] PATH_INFO: `/v3/users/04e48304473d40ebb8c0c5386c4c3592` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:44.049766 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caefc876-69cf-40cf-8a78-48151f53b0c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04e48304473d40ebb8c0c5386c4c3592)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:44.052263 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caefc876-69cf-40cf-8a78-48151f53b0c7 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:44.056241 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1a05f9-f0b8-44e6-b31e-109c0687701a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:44.057231 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a05f9-f0b8-44e6-b31e-109c0687701a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:44.057518 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a05f9-f0b8-44e6-b31e-109c0687701a admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:44.057799 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a05f9-f0b8-44e6-b31e-109c0687701a admin admin] PATH_INFO: `/v3/projects/28e3d40619394585b4a4bec131c82270` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:44.060556 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1a05f9-f0b8-44e6-b31e-109c0687701a admin admin] RBAC: Authorizing `identity:delete_project(project_id=28e3d40619394585b4a4bec131c82270)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:44.062729 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1a05f9-f0b8-44e6-b31e-109c0687701a admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:44.305773 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-caefc876-69cf-40cf-8a78-48151f53b0c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04e48304473d40ebb8c0c5386c4c3592'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:44.307812 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-1f1a05f9-f0b8-44e6-b31e-109c0687701a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28e3d40619394585b4a4bec131c82270', 'request_id': 'req-1f1a05f9-f0b8-44e6-b31e-109c0687701a'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:44.320674 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-1f1a05f9-f0b8-44e6-b31e-109c0687701a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28e3d40619394585b4a4bec131c82270', 'request_id': 'req-1f1a05f9-f0b8-44e6-b31e-109c0687701a'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:44.334928 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-1f1a05f9-f0b8-44e6-b31e-109c0687701a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28e3d40619394585b4a4bec131c82270', 'request_id': 'req-1f1a05f9-f0b8-44e6-b31e-109c0687701a'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:44.341607 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-caefc876-69cf-40cf-8a78-48151f53b0c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04e48304473d40ebb8c0c5386c4c3592'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:44.357438 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-caefc876-69cf-40cf-8a78-48151f53b0c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04e48304473d40ebb8c0c5386c4c3592'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:44.426010 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-1f1a05f9-f0b8-44e6-b31e-109c0687701a admin admin] The token cache is being invalidate because project 28e3d40619394585b4a4bec131c82270 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:33:44.434757 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-1f1a05f9-f0b8-44e6-b31e-109c0687701a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:44.434757 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-1f1a05f9-f0b8-44e6-b31e-109c0687701a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:44.434757 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2880/5796] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:33:43 2022] DELETE /identity/v3/projects/28e3d40619394585b4a4bec131c82270 => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:44.436274 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1a05f9-f0b8-44e6-b31e-109c0687701a admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:44.437433 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-1f1a05f9-f0b8-44e6-b31e-109c0687701a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:44.488737 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-caefc876-69cf-40cf-8a78-48151f53b0c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04e48304473d40ebb8c0c5386c4c3592'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:44.489641 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-caefc876-69cf-40cf-8a78-48151f53b0c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04e48304473d40ebb8c0c5386c4c3592'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:44.502564 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2917/5797] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:33:43 2022] DELETE /identity/v3/users/04e48304473d40ebb8c0c5386c4c3592 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:44.504957 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00964082-c904-4c15-ae26-373b500f901e None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:44.505258 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00964082-c904-4c15-ae26-373b500f901e None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:44.505543 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00964082-c904-4c15-ae26-373b500f901e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:44.573504 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-00964082-c904-4c15-ae26-373b500f901e None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:33:44.574773 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-00964082-c904-4c15-ae26-373b500f901e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:44.588947 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1a05f9-f0b8-44e6-b31e-109c0687701a admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:44.737529 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a484cb-4552-4076-a9b9-2d2700fbeb3c tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '523707e535e6470985ee018c249a6513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8e2b08e11f477fa85b79a9d599f126', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:44.738432 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a484cb-4552-4076-a9b9-2d2700fbeb3c tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:44.738726 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a484cb-4552-4076-a9b9-2d2700fbeb3c tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:44.739465 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a484cb-4552-4076-a9b9-2d2700fbeb3c tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] PATH_INFO: `/v3/projects/172231144d5a4ff1b365f142f9b5f6fb` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:44.741547 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a484cb-4552-4076-a9b9-2d2700fbeb3c tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] RBAC: Authorizing `identity:delete_project(project_id=172231144d5a4ff1b365f142f9b5f6fb)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:44.743668 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a484cb-4552-4076-a9b9-2d2700fbeb3c tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:44.768313 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2918/5798] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:33:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:33:44.768313 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e568e8a1-d350-4720-ab56-f715ff27069c None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:44.768313 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e568e8a1-d350-4720-ab56-f715ff27069c None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:44.768313 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e568e8a1-d350-4720-ab56-f715ff27069c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:44.802660 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-e568e8a1-d350-4720-ab56-f715ff27069c None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:33:44.805193 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e568e8a1-d350-4720-ab56-f715ff27069c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:44.817818 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2919/5799] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:33:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:33:44.822771 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e568e8a1-d350-4720-ab56-f715ff27069c None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:44.833574 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e568e8a1-d350-4720-ab56-f715ff27069c None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:44.841223 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388279fb-ed58-4a4b-ba63-f33be074b88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:44.843052 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388279fb-ed58-4a4b-ba63-f33be074b88a admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:44.843922 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388279fb-ed58-4a4b-ba63-f33be074b88a admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:44.844216 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388279fb-ed58-4a4b-ba63-f33be074b88a admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:44.845175 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388279fb-ed58-4a4b-ba63-f33be074b88a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:33:44.845486 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388279fb-ed58-4a4b-ba63-f33be074b88a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:44.847295 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388279fb-ed58-4a4b-ba63-f33be074b88a admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:44.880929 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2920/5800] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:33:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:33:44.882106 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388279fb-ed58-4a4b-ba63-f33be074b88a admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:44.917794 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388279fb-ed58-4a4b-ba63-f33be074b88a admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:44.919370 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-03a484cb-4552-4076-a9b9-2d2700fbeb3c tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '172231144d5a4ff1b365f142f9b5f6fb', 'request_id': 'req-03a484cb-4552-4076-a9b9-2d2700fbeb3c'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:44.932821 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-03a484cb-4552-4076-a9b9-2d2700fbeb3c tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '172231144d5a4ff1b365f142f9b5f6fb', 'request_id': 'req-03a484cb-4552-4076-a9b9-2d2700fbeb3c'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:44.955466 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-03a484cb-4552-4076-a9b9-2d2700fbeb3c tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '172231144d5a4ff1b365f142f9b5f6fb', 'request_id': 'req-03a484cb-4552-4076-a9b9-2d2700fbeb3c'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:45.016197 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dcf21f-a24d-4f6d-8f92-d1cdad89f0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:45.019408 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dcf21f-a24d-4f6d-8f92-d1cdad89f0f2 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:45.025256 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dcf21f-a24d-4f6d-8f92-d1cdad89f0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:45.025256 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dcf21f-a24d-4f6d-8f92-d1cdad89f0f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:45.025256 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dcf21f-a24d-4f6d-8f92-d1cdad89f0f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:45.025256 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dcf21f-a24d-4f6d-8f92-d1cdad89f0f2 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:45.061261 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-03a484cb-4552-4076-a9b9-2d2700fbeb3c tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] The token cache is being invalidate because project 172231144d5a4ff1b365f142f9b5f6fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:33:45.062083 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-03a484cb-4552-4076-a9b9-2d2700fbeb3c tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:45.062934 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-03a484cb-4552-4076-a9b9-2d2700fbeb3c tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:45.064693 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2881/5801] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:33:44 2022] DELETE /identity/v3/projects/172231144d5a4ff1b365f142f9b5f6fb => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:45.068891 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a484cb-4552-4076-a9b9-2d2700fbeb3c tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:45.073063 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-03a484cb-4552-4076-a9b9-2d2700fbeb3c tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:45.146687 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2921/5802] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:33:44 2022] POST /identity/v3/projects => generated 365 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:33:45.149227 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dcf21f-a24d-4f6d-8f92-d1cdad89f0f2 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:45.154656 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c3dcf21f-a24d-4f6d-8f92-d1cdad89f0f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:45.203145 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a484cb-4552-4076-a9b9-2d2700fbeb3c tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:45.295589 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16897b6e-bba5-4a5b-82cc-59760f487b18 tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '523707e535e6470985ee018c249a6513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8e2b08e11f477fa85b79a9d599f126', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:45.296789 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16897b6e-bba5-4a5b-82cc-59760f487b18 tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:45.297380 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16897b6e-bba5-4a5b-82cc-59760f487b18 tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:45.297856 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16897b6e-bba5-4a5b-82cc-59760f487b18 tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] PATH_INFO: `/v3/projects/770b4ee586334d6194a7c6dc7cc42b54` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:45.299553 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16897b6e-bba5-4a5b-82cc-59760f487b18 tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] RBAC: Authorizing `identity:delete_project(project_id=770b4ee586334d6194a7c6dc7cc42b54)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:45.301745 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16897b6e-bba5-4a5b-82cc-59760f487b18 tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:45.349298 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dcf21f-a24d-4f6d-8f92-d1cdad89f0f2 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:45.355814 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d41253-daa4-4ef7-86d5-707ec6639da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:45.356848 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d41253-daa4-4ef7-86d5-707ec6639da6 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:45.357335 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d41253-daa4-4ef7-86d5-707ec6639da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:45.358568 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d41253-daa4-4ef7-86d5-707ec6639da6 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:45.360761 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d41253-daa4-4ef7-86d5-707ec6639da6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:45.363229 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d41253-daa4-4ef7-86d5-707ec6639da6 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:45.475143 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-16897b6e-bba5-4a5b-82cc-59760f487b18 tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '770b4ee586334d6194a7c6dc7cc42b54', 'request_id': 'req-16897b6e-bba5-4a5b-82cc-59760f487b18'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:45.483275 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-16897b6e-bba5-4a5b-82cc-59760f487b18 tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '770b4ee586334d6194a7c6dc7cc42b54', 'request_id': 'req-16897b6e-bba5-4a5b-82cc-59760f487b18'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:45.497082 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-16897b6e-bba5-4a5b-82cc-59760f487b18 tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '770b4ee586334d6194a7c6dc7cc42b54', 'request_id': 'req-16897b6e-bba5-4a5b-82cc-59760f487b18'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:45.520451 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2922/5803] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:33:45 2022] POST /identity/v3/users => generated 283 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:33:45.522476 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d41253-daa4-4ef7-86d5-707ec6639da6 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:45.524825 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-a6d41253-daa4-4ef7-86d5-707ec6639da6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:45.543151 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d41253-daa4-4ef7-86d5-707ec6639da6 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:45.585707 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-16897b6e-bba5-4a5b-82cc-59760f487b18 tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] The token cache is being invalidate because project 770b4ee586334d6194a7c6dc7cc42b54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:33:45.586226 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-16897b6e-bba5-4a5b-82cc-59760f487b18 tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:45.589649 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-16897b6e-bba5-4a5b-82cc-59760f487b18 tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:45.589649 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2882/5804] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:33:45 2022] DELETE /identity/v3/projects/770b4ee586334d6194a7c6dc7cc42b54 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:45.589873 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16897b6e-bba5-4a5b-82cc-59760f487b18 tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:45.591195 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-16897b6e-bba5-4a5b-82cc-59760f487b18 tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:45.637817 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd743e6-969f-467b-81ba-2b603f582ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:45.639533 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd743e6-969f-467b-81ba-2b603f582ce4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:45.640037 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd743e6-969f-467b-81ba-2b603f582ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:45.640497 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd743e6-969f-467b-81ba-2b603f582ce4 admin admin] PATH_INFO: `/v3/projects/4989c480608c4b86bd1cd7615fba4d20` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:45.641878 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd743e6-969f-467b-81ba-2b603f582ce4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4989c480608c4b86bd1cd7615fba4d20)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:45.644787 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd743e6-969f-467b-81ba-2b603f582ce4 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:45.671419 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16897b6e-bba5-4a5b-82cc-59760f487b18 tempest-ListProjectsTestJSON-1482796504 tempest-ListProjectsTestJSON-1482796504-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:45.678614 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df5a1e6-d190-4c6a-a989-5509e2a5d612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:45.680801 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5a1e6-d190-4c6a-a989-5509e2a5d612 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:45.681299 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5a1e6-d190-4c6a-a989-5509e2a5d612 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:45.688697 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5a1e6-d190-4c6a-a989-5509e2a5d612 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:45.688697 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df5a1e6-d190-4c6a-a989-5509e2a5d612 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:45.688697 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df5a1e6-d190-4c6a-a989-5509e2a5d612 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:45.703870 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2883/5805] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:33:45 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:33:45.708084 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df5a1e6-d190-4c6a-a989-5509e2a5d612 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:45.708084 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-5df5a1e6-d190-4c6a-a989-5509e2a5d612 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:45.724963 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df5a1e6-d190-4c6a-a989-5509e2a5d612 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:45.732297 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f66d5c-1900-48b8-8f7e-0117f6a0dc4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:45.735513 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f66d5c-1900-48b8-8f7e-0117f6a0dc4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:45.735513 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f66d5c-1900-48b8-8f7e-0117f6a0dc4c admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:45.735513 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f66d5c-1900-48b8-8f7e-0117f6a0dc4c admin admin] PATH_INFO: `/v3/users/d389ba08fcae455283edf7573badae37` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:45.736606 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f66d5c-1900-48b8-8f7e-0117f6a0dc4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d389ba08fcae455283edf7573badae37)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:45.738999 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f66d5c-1900-48b8-8f7e-0117f6a0dc4c admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:45.790066 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ddd743e6-969f-467b-81ba-2b603f582ce4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4989c480608c4b86bd1cd7615fba4d20', 'request_id': 'req-ddd743e6-969f-467b-81ba-2b603f582ce4'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:45.796444 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ddd743e6-969f-467b-81ba-2b603f582ce4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4989c480608c4b86bd1cd7615fba4d20', 'request_id': 'req-ddd743e6-969f-467b-81ba-2b603f582ce4'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:45.889624 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ddd743e6-969f-467b-81ba-2b603f582ce4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4989c480608c4b86bd1cd7615fba4d20', 'request_id': 'req-ddd743e6-969f-467b-81ba-2b603f582ce4'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:45.907044 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ddd743e6-969f-467b-81ba-2b603f582ce4 admin admin] The token cache is being invalidate because project 4989c480608c4b86bd1cd7615fba4d20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:33:45.907627 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ddd743e6-969f-467b-81ba-2b603f582ce4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:45.908533 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ddd743e6-969f-467b-81ba-2b603f582ce4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:45.910539 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2923/5806] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:33:45 2022] DELETE /identity/v3/projects/4989c480608c4b86bd1cd7615fba4d20 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:45.911541 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd743e6-969f-467b-81ba-2b603f582ce4 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:45.913072 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ddd743e6-969f-467b-81ba-2b603f582ce4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:45.969219 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c3f66d5c-1900-48b8-8f7e-0117f6a0dc4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd389ba08fcae455283edf7573badae37'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:45.982601 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c3f66d5c-1900-48b8-8f7e-0117f6a0dc4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd389ba08fcae455283edf7573badae37'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:45.984020 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c3f66d5c-1900-48b8-8f7e-0117f6a0dc4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd389ba08fcae455283edf7573badae37'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:46.011525 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd743e6-969f-467b-81ba-2b603f582ce4 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:46.018340 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cc9c37-e237-4c31-8520-49eacbae6fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:46.019895 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc9c37-e237-4c31-8520-49eacbae6fc7 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:46.020795 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc9c37-e237-4c31-8520-49eacbae6fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:46.021670 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc9c37-e237-4c31-8520-49eacbae6fc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:46.023974 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cc9c37-e237-4c31-8520-49eacbae6fc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:46.026766 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cc9c37-e237-4c31-8520-49eacbae6fc7 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:46.044945 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2924/5807] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:33:45 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:33:46.048234 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb7550b-b659-469a-9661-bd8171eeb9d3 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:46.048988 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb7550b-b659-469a-9661-bd8171eeb9d3 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:46.049502 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb7550b-b659-469a-9661-bd8171eeb9d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:46.083056 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-fcb7550b-b659-469a-9661-bd8171eeb9d3 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:33:46.085534 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-fcb7550b-b659-469a-9661-bd8171eeb9d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:46.092400 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c3f66d5c-1900-48b8-8f7e-0117f6a0dc4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd389ba08fcae455283edf7573badae37'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:46.098290 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2925/5808] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:33:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:33:46.099651 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb7550b-b659-469a-9661-bd8171eeb9d3 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:46.113082 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb7550b-b659-469a-9661-bd8171eeb9d3 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:46.117578 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c3f66d5c-1900-48b8-8f7e-0117f6a0dc4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd389ba08fcae455283edf7573badae37'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:46.121354 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add7f8f9-8afd-4eb7-a8f4-60ac75d8fa80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:46.131586 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7f8f9-8afd-4eb7-a8f4-60ac75d8fa80 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:46.131586 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7f8f9-8afd-4eb7-a8f4-60ac75d8fa80 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:46.131586 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7f8f9-8afd-4eb7-a8f4-60ac75d8fa80 admin admin] PATH_INFO: `/v3/projects/a817c498d25142468b4239855fd084cf/users/9a77e5790314487bb0f11099e0ae5953/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:46.131853 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2884/5809] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:33:45 2022] DELETE /identity/v3/users/d389ba08fcae455283edf7573badae37 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:46.131853 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3431d1-d829-445a-8f78-9d98a6799fb9 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:46.131853 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3431d1-d829-445a-8f78-9d98a6799fb9 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:46.134708 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3431d1-d829-445a-8f78-9d98a6799fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:46.150848 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add7f8f9-8afd-4eb7-a8f4-60ac75d8fa80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a817c498d25142468b4239855fd084cf, user_id=9a77e5790314487bb0f11099e0ae5953, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:46.153743 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add7f8f9-8afd-4eb7-a8f4-60ac75d8fa80 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:46.162426 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-9d3431d1-d829-445a-8f78-9d98a6799fb9 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:33:46.164077 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-9d3431d1-d829-445a-8f78-9d98a6799fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:46.251262 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2926/5810] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:33:46 2022] PUT /identity/v3/projects/a817c498d25142468b4239855fd084cf/users/9a77e5790314487bb0f11099e0ae5953/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:46.253535 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb3fe0-4a7c-471c-83ce-8d51ecabebcd None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:46.257615 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb3fe0-4a7c-471c-83ce-8d51ecabebcd None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:46.257615 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb3fe0-4a7c-471c-83ce-8d51ecabebcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:46.293915 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-56cb3fe0-4a7c-471c-83ce-8d51ecabebcd None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:33:46.296429 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-56cb3fe0-4a7c-471c-83ce-8d51ecabebcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:46.297453 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2885/5811] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:33:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:33:46.302503 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ae719-e773-4e0f-8265-a827d0c349e9 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:46.303121 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ae719-e773-4e0f-8265-a827d0c349e9 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:46.303121 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ae719-e773-4e0f-8265-a827d0c349e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:46.347648 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-c88ae719-e773-4e0f-8265-a827d0c349e9 None None] MFA Rules not processed for user `9a77e5790314487bb0f11099e0ae5953`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:33:46.349298 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c88ae719-e773-4e0f-8265-a827d0c349e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:46.405554 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2927/5812] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:33:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:33:46.409805 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cb3fe0-4a7c-471c-83ce-8d51ecabebcd None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:46.438397 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cb3fe0-4a7c-471c-83ce-8d51ecabebcd None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:46.444288 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2886/5813] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:33:46 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:33:46.444288 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88ae719-e773-4e0f-8265-a827d0c349e9 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:46.446305 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c88ae719-e773-4e0f-8265-a827d0c349e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:46.449575 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0601cf2-0876-43b5-924d-156936474861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:46.450327 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0601cf2-0876-43b5-924d-156936474861 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:46.450619 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0601cf2-0876-43b5-924d-156936474861 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:46.450890 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0601cf2-0876-43b5-924d-156936474861 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:46.451961 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0601cf2-0876-43b5-924d-156936474861 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:33:46.452919 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0601cf2-0876-43b5-924d-156936474861 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:46.454843 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0601cf2-0876-43b5-924d-156936474861 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:46.473587 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2928/5814] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:33:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:33:46.480304 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0601cf2-0876-43b5-924d-156936474861 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:46.484611 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d0601cf2-0876-43b5-924d-156936474861 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:46.517422 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0601cf2-0876-43b5-924d-156936474861 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:46.524019 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155a55c1-3321-43b2-b98c-4bddd0872114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:46.525244 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a55c1-3321-43b2-b98c-4bddd0872114 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:46.525606 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a55c1-3321-43b2-b98c-4bddd0872114 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:46.525799 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a55c1-3321-43b2-b98c-4bddd0872114 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:46.526968 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155a55c1-3321-43b2-b98c-4bddd0872114 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:46.528522 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155a55c1-3321-43b2-b98c-4bddd0872114 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:46.558648 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88ae719-e773-4e0f-8265-a827d0c349e9 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:46.562720 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82169ae1-6bb1-4012-8b48-b4a50bf72e82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:46.563381 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82169ae1-6bb1-4012-8b48-b4a50bf72e82 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:46.563700 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82169ae1-6bb1-4012-8b48-b4a50bf72e82 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:46.563970 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82169ae1-6bb1-4012-8b48-b4a50bf72e82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:46.577079 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82169ae1-6bb1-4012-8b48-b4a50bf72e82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:46.579644 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82169ae1-6bb1-4012-8b48-b4a50bf72e82 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:46.591990 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2887/5815] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:33:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:33:46.593334 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82169ae1-6bb1-4012-8b48-b4a50bf72e82 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:46.606989 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82169ae1-6bb1-4012-8b48-b4a50bf72e82 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:46.616640 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81a7852-a021-4e09-9efe-1c47abf30bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:46.616640 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a7852-a021-4e09-9efe-1c47abf30bb8 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:46.616640 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a7852-a021-4e09-9efe-1c47abf30bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:46.616640 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a7852-a021-4e09-9efe-1c47abf30bb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:46.617558 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81a7852-a021-4e09-9efe-1c47abf30bb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:46.618630 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81a7852-a021-4e09-9efe-1c47abf30bb8 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:46.651587 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2929/5816] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:33:46 2022] POST /identity/v3/projects => generated 367 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:33:46.654143 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155a55c1-3321-43b2-b98c-4bddd0872114 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:46.731556 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2888/5817] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:33:46 2022] POST /identity/v3/projects => generated 401 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:33:46.733688 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81a7852-a021-4e09-9efe-1c47abf30bb8 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:46.783141 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155a55c1-3321-43b2-b98c-4bddd0872114 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:46.842439 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81a7852-a021-4e09-9efe-1c47abf30bb8 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:46.861587 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97196bbb-7ca8-4362-8b42-2e5998ef10ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:46.862919 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97196bbb-7ca8-4362-8b42-2e5998ef10ac admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:46.862919 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97196bbb-7ca8-4362-8b42-2e5998ef10ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:46.863139 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97196bbb-7ca8-4362-8b42-2e5998ef10ac admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:46.863944 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97196bbb-7ca8-4362-8b42-2e5998ef10ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:46.865893 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97196bbb-7ca8-4362-8b42-2e5998ef10ac admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:46.879190 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feafd77-17a6-4275-9d04-3490abafe5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:46.880114 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feafd77-17a6-4275-9d04-3490abafe5a9 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:46.880492 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feafd77-17a6-4275-9d04-3490abafe5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:46.880907 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feafd77-17a6-4275-9d04-3490abafe5a9 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:46.881678 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feafd77-17a6-4275-9d04-3490abafe5a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:46.885038 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feafd77-17a6-4275-9d04-3490abafe5a9 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:46.986665 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2889/5818] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:33:46 2022] POST /identity/v3/users => generated 301 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:33:46.995962 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97196bbb-7ca8-4362-8b42-2e5998ef10ac admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:47.007088 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97196bbb-7ca8-4362-8b42-2e5998ef10ac admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:47.021458 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2930/5819] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:33:46 2022] POST /identity/v3/users => generated 290 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:33:47.024883 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feafd77-17a6-4275-9d04-3490abafe5a9 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:47.026959 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b67c02d-e983-4b79-abc4-6b27da3361ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:47.027675 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67c02d-e983-4b79-abc4-6b27da3361ae admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:47.031918 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67c02d-e983-4b79-abc4-6b27da3361ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:47.032269 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67c02d-e983-4b79-abc4-6b27da3361ae admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:47.033181 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b67c02d-e983-4b79-abc4-6b27da3361ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:47.035000 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b67c02d-e983-4b79-abc4-6b27da3361ae admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:47.037690 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feafd77-17a6-4275-9d04-3490abafe5a9 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:47.043298 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2562b0f-df85-4e26-82bd-a94d77639161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:47.044216 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2562b0f-df85-4e26-82bd-a94d77639161 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:47.044582 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2562b0f-df85-4e26-82bd-a94d77639161 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:47.045321 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2562b0f-df85-4e26-82bd-a94d77639161 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:47.051879 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2562b0f-df85-4e26-82bd-a94d77639161 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:47.051879 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2562b0f-df85-4e26-82bd-a94d77639161 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:47.052097 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2890/5820] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:33:46 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:33:47.053497 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b67c02d-e983-4b79-abc4-6b27da3361ae admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:47.058841 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2931/5821] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:33:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:33:47.062906 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2562b0f-df85-4e26-82bd-a94d77639161 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:47.066172 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b67c02d-e983-4b79-abc4-6b27da3361ae admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:47.071639 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d63a8-551d-4919-8227-708783232618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:47.074731 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d63a8-551d-4919-8227-708783232618 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:47.074731 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d63a8-551d-4919-8227-708783232618 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:47.074731 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d63a8-551d-4919-8227-708783232618 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:47.074731 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4d63a8-551d-4919-8227-708783232618 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:47.075275 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2562b0f-df85-4e26-82bd-a94d77639161 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:47.076215 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4d63a8-551d-4919-8227-708783232618 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:47.081549 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539159e8-8649-4dfe-8aa6-97feb166363a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:47.082727 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539159e8-8649-4dfe-8aa6-97feb166363a admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:47.083019 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539159e8-8649-4dfe-8aa6-97feb166363a admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:47.083296 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539159e8-8649-4dfe-8aa6-97feb166363a admin admin] PATH_INFO: `/v3/projects/6cdd622c16cd46e2b8f1476076af3f39/users/83951651c26f4e138a05108f0fe37ea8/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:47.090984 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2891/5822] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:33:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:33:47.092366 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d63a8-551d-4919-8227-708783232618 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:47.099801 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539159e8-8649-4dfe-8aa6-97feb166363a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cdd622c16cd46e2b8f1476076af3f39, user_id=83951651c26f4e138a05108f0fe37ea8, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:47.104102 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539159e8-8649-4dfe-8aa6-97feb166363a admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:47.105104 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d63a8-551d-4919-8227-708783232618 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:47.127631 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30004914-0d15-47da-bd1f-63aee5b8d998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:47.128786 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30004914-0d15-47da-bd1f-63aee5b8d998 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:47.129759 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30004914-0d15-47da-bd1f-63aee5b8d998 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:47.130795 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30004914-0d15-47da-bd1f-63aee5b8d998 admin admin] PATH_INFO: `/v3/projects/f581de4f93ab4bd3a7da5640198b8aee/users/523d1d4029504507a926d8505b9718da/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:47.154044 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30004914-0d15-47da-bd1f-63aee5b8d998 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f581de4f93ab4bd3a7da5640198b8aee, user_id=523d1d4029504507a926d8505b9718da, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:47.158153 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30004914-0d15-47da-bd1f-63aee5b8d998 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:47.206307 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2932/5823] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:33:47 2022] PUT /identity/v3/projects/6cdd622c16cd46e2b8f1476076af3f39/users/83951651c26f4e138a05108f0fe37ea8/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:33:47.210589 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539159e8-8649-4dfe-8aa6-97feb166363a admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:47.289721 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2892/5824] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:33:47 2022] PUT /identity/v3/projects/f581de4f93ab4bd3a7da5640198b8aee/users/523d1d4029504507a926d8505b9718da/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:33:47.292576 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10741fd-8979-4285-bfd6-b97f18fedb50 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:47.293230 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10741fd-8979-4285-bfd6-b97f18fedb50 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:47.294129 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10741fd-8979-4285-bfd6-b97f18fedb50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:47.326392 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539159e8-8649-4dfe-8aa6-97feb166363a admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:47.350257 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-a10741fd-8979-4285-bfd6-b97f18fedb50 None None] MFA Rules not processed for user `523d1d4029504507a926d8505b9718da`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:33:47.351866 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-a10741fd-8979-4285-bfd6-b97f18fedb50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:47.419290 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f0fb1d-f916-4fbd-b11c-29e186a58b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:47.420002 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0fb1d-f916-4fbd-b11c-29e186a58b8d admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:47.420287 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0fb1d-f916-4fbd-b11c-29e186a58b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:47.420568 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0fb1d-f916-4fbd-b11c-29e186a58b8d admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:47.421292 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f0fb1d-f916-4fbd-b11c-29e186a58b8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:47.422916 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f0fb1d-f916-4fbd-b11c-29e186a58b8d admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:47.442929 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2933/5825] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:33:47 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:33:47.443197 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f0fb1d-f916-4fbd-b11c-29e186a58b8d admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:47.445158 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-12f0fb1d-f916-4fbd-b11c-29e186a58b8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:47.465199 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f0fb1d-f916-4fbd-b11c-29e186a58b8d admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:47.481015 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217dff63-c682-4a74-a08b-a4de7e192e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:47.482653 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217dff63-c682-4a74-a08b-a4de7e192e8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:47.482653 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217dff63-c682-4a74-a08b-a4de7e192e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:47.483138 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217dff63-c682-4a74-a08b-a4de7e192e8b admin admin] PATH_INFO: `/v3/projects/63a065f76abb45a598ce947ffaa1eefb` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:47.484484 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2893/5826] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:33:47 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:33:47.484699 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217dff63-c682-4a74-a08b-a4de7e192e8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=63a065f76abb45a598ce947ffaa1eefb)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:47.485621 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10741fd-8979-4285-bfd6-b97f18fedb50 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:47.487006 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217dff63-c682-4a74-a08b-a4de7e192e8b admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:47.500395 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10741fd-8979-4285-bfd6-b97f18fedb50 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:47.505541 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18778747-7458-43e6-83e6-d1036dd99df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:47.506671 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18778747-7458-43e6-83e6-d1036dd99df8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:47.512722 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18778747-7458-43e6-83e6-d1036dd99df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:47.512722 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18778747-7458-43e6-83e6-d1036dd99df8 admin admin] PATH_INFO: `/v3/projects/6cdd622c16cd46e2b8f1476076af3f39/users/83951651c26f4e138a05108f0fe37ea8/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:47.512722 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18778747-7458-43e6-83e6-d1036dd99df8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cdd622c16cd46e2b8f1476076af3f39, user_id=83951651c26f4e138a05108f0fe37ea8, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:47.513729 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18778747-7458-43e6-83e6-d1036dd99df8 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:47.526435 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2894/5827] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:33:47 2022] PUT /identity/v3/projects/6cdd622c16cd46e2b8f1476076af3f39/users/83951651c26f4e138a05108f0fe37ea8/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:47.529042 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18778747-7458-43e6-83e6-d1036dd99df8 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:47.619111 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18778747-7458-43e6-83e6-d1036dd99df8 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:47.638808 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-217dff63-c682-4a74-a08b-a4de7e192e8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63a065f76abb45a598ce947ffaa1eefb', 'request_id': 'req-217dff63-c682-4a74-a08b-a4de7e192e8b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:47.652515 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-217dff63-c682-4a74-a08b-a4de7e192e8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63a065f76abb45a598ce947ffaa1eefb', 'request_id': 'req-217dff63-c682-4a74-a08b-a4de7e192e8b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:47.713926 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65de0c6d-acad-439e-9376-c9bdb6cfb7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:47.713926 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de0c6d-acad-439e-9376-c9bdb6cfb7e1 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:47.713926 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de0c6d-acad-439e-9376-c9bdb6cfb7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:47.713926 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de0c6d-acad-439e-9376-c9bdb6cfb7e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:47.714511 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65de0c6d-acad-439e-9376-c9bdb6cfb7e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:47.714596 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65de0c6d-acad-439e-9376-c9bdb6cfb7e1 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:47.769326 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-217dff63-c682-4a74-a08b-a4de7e192e8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63a065f76abb45a598ce947ffaa1eefb', 'request_id': 'req-217dff63-c682-4a74-a08b-a4de7e192e8b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:47.785047 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-217dff63-c682-4a74-a08b-a4de7e192e8b admin admin] The token cache is being invalidate because project 63a065f76abb45a598ce947ffaa1eefb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:33:47.785447 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-217dff63-c682-4a74-a08b-a4de7e192e8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:47.786219 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-217dff63-c682-4a74-a08b-a4de7e192e8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:47.788936 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2934/5828] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:33:47 2022] DELETE /identity/v3/projects/63a065f76abb45a598ce947ffaa1eefb => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:47.792936 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e10769-5f54-4944-9832-fb0656ee89ec None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:47.793313 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e10769-5f54-4944-9832-fb0656ee89ec None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:47.793713 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e10769-5f54-4944-9832-fb0656ee89ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:47.825343 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-27e10769-5f54-4944-9832-fb0656ee89ec None None] MFA Rules not processed for user `83951651c26f4e138a05108f0fe37ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:33:47.826686 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-27e10769-5f54-4944-9832-fb0656ee89ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:47.847525 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2895/5829] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:33:47 2022] POST /identity/v3/projects => generated 401 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:33:47.854315 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65de0c6d-acad-439e-9376-c9bdb6cfb7e1 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:47.858343 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-65de0c6d-acad-439e-9376-c9bdb6cfb7e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:47.953485 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2935/5830] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:33:47 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:33:47.954854 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e10769-5f54-4944-9832-fb0656ee89ec None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:47.957414 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-27e10769-5f54-4944-9832-fb0656ee89ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:47.985994 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e10769-5f54-4944-9832-fb0656ee89ec None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:47.986205 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65de0c6d-acad-439e-9376-c9bdb6cfb7e1 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:47.986309 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f218fb-1d32-44a3-9367-173536934835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:47.987114 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f218fb-1d32-44a3-9367-173536934835 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:47.987736 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f218fb-1d32-44a3-9367-173536934835 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:47.988097 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f218fb-1d32-44a3-9367-173536934835 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:47.988322 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eaf44f-c413-4057-b9a8-b47fc26c8009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:47.989144 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f218fb-1d32-44a3-9367-173536934835 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:47.989550 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eaf44f-c413-4057-b9a8-b47fc26c8009 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:47.989907 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eaf44f-c413-4057-b9a8-b47fc26c8009 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:47.990810 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eaf44f-c413-4057-b9a8-b47fc26c8009 admin admin] PATH_INFO: `/v3/users/523707e535e6470985ee018c249a6513` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:47.991630 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f218fb-1d32-44a3-9367-173536934835 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:47.993225 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eaf44f-c413-4057-b9a8-b47fc26c8009 admin admin] RBAC: Authorizing `identity:delete_user(user_id=523707e535e6470985ee018c249a6513)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:47.995607 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eaf44f-c413-4057-b9a8-b47fc26c8009 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:48.090491 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2936/5831] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:33:47 2022] POST /identity/v3/users => generated 307 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:33:48.091972 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f218fb-1d32-44a3-9367-173536934835 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:48.172179 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f218fb-1d32-44a3-9367-173536934835 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:48.177912 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff8b555-7608-4f3a-9908-389a254ba1ea tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83951651c26f4e138a05108f0fe37ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cdd622c16cd46e2b8f1476076af3f39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:48.178606 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8b555-7608-4f3a-9908-389a254ba1ea tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:48.178880 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8b555-7608-4f3a-9908-389a254ba1ea tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:48.179162 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8b555-7608-4f3a-9908-389a254ba1ea tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:48.180677 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff8b555-7608-4f3a-9908-389a254ba1ea tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:48.188448 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff8b555-7608-4f3a-9908-389a254ba1ea tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:48.264674 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f6eaf44f-c413-4057-b9a8-b47fc26c8009 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '523707e535e6470985ee018c249a6513'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:48.273015 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f6eaf44f-c413-4057-b9a8-b47fc26c8009 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '523707e535e6470985ee018c249a6513'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:48.273812 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f6eaf44f-c413-4057-b9a8-b47fc26c8009 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '523707e535e6470985ee018c249a6513'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:48.384178 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2937/5832] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:33:48 2022] POST /identity/v3/projects => generated 358 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:33:48.385363 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff8b555-7608-4f3a-9908-389a254ba1ea tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:48.435367 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f6eaf44f-c413-4057-b9a8-b47fc26c8009 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '523707e535e6470985ee018c249a6513'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:48.453432 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f6eaf44f-c413-4057-b9a8-b47fc26c8009 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '523707e535e6470985ee018c249a6513'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:48.456379 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff8b555-7608-4f3a-9908-389a254ba1ea tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:48.460765 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2896/5833] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:33:47 2022] DELETE /identity/v3/users/523707e535e6470985ee018c249a6513 => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:48.461798 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eaf44f-c413-4057-b9a8-b47fc26c8009 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:48.466101 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ffcc44-a2de-4697-8222-d8d58e22579e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:48.466235 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-f6eaf44f-c413-4057-b9a8-b47fc26c8009 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:48.466330 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ffcc44-a2de-4697-8222-d8d58e22579e admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:48.466330 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ffcc44-a2de-4697-8222-d8d58e22579e admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:48.466330 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ffcc44-a2de-4697-8222-d8d58e22579e admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:48.466330 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ffcc44-a2de-4697-8222-d8d58e22579e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:48.469789 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ffcc44-a2de-4697-8222-d8d58e22579e admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:48.488861 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2938/5834] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:33:48 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:33:48.490060 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ffcc44-a2de-4697-8222-d8d58e22579e admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:48.492547 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e7ffcc44-a2de-4697-8222-d8d58e22579e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:48.508007 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ffcc44-a2de-4697-8222-d8d58e22579e admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:48.571709 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eaf44f-c413-4057-b9a8-b47fc26c8009 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:48.578619 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a7075d-69cf-4fac-af7a-f844cd14f6d6 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83951651c26f4e138a05108f0fe37ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cdd622c16cd46e2b8f1476076af3f39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:48.579313 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a7075d-69cf-4fac-af7a-f844cd14f6d6 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:48.579658 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a7075d-69cf-4fac-af7a-f844cd14f6d6 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:48.580007 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a7075d-69cf-4fac-af7a-f844cd14f6d6 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:48.580897 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a7075d-69cf-4fac-af7a-f844cd14f6d6 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:48.583435 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a7075d-69cf-4fac-af7a-f844cd14f6d6 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:48.590216 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c2a685-b1f3-42bc-ad71-151c66b40b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:48.591023 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c2a685-b1f3-42bc-ad71-151c66b40b63 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:48.597801 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c2a685-b1f3-42bc-ad71-151c66b40b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:48.597801 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c2a685-b1f3-42bc-ad71-151c66b40b63 admin admin] PATH_INFO: `/v3/projects/f176f884005f4842aadd9e5362060a4b/users/3e02c22105f7404fa2c2d628534bb511/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:48.611508 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c2a685-b1f3-42bc-ad71-151c66b40b63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f176f884005f4842aadd9e5362060a4b, user_id=3e02c22105f7404fa2c2d628534bb511, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:48.614332 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c2a685-b1f3-42bc-ad71-151c66b40b63 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:48.728684 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2939/5835] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:33:48 2022] PUT /identity/v3/projects/f176f884005f4842aadd9e5362060a4b/users/3e02c22105f7404fa2c2d628534bb511/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:48.729927 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2897/5836] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:33:48 2022] POST /identity/v3/users => generated 373 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:33:48.733101 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c2a685-b1f3-42bc-ad71-151c66b40b63 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:48.733787 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a7075d-69cf-4fac-af7a-f844cd14f6d6 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:48.746456 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a7075d-69cf-4fac-af7a-f844cd14f6d6 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:48.828965 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c2a685-b1f3-42bc-ad71-151c66b40b63 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:48.839799 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709237f1-8b44-4cf4-8234-c426fa4249f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:48.840508 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709237f1-8b44-4cf4-8234-c426fa4249f0 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:48.842154 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709237f1-8b44-4cf4-8234-c426fa4249f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:48.842463 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709237f1-8b44-4cf4-8234-c426fa4249f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:48.843207 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709237f1-8b44-4cf4-8234-c426fa4249f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:48.845408 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709237f1-8b44-4cf4-8234-c426fa4249f0 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:48.846444 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36be538-c928-4682-8968-7530631b1881 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83951651c26f4e138a05108f0fe37ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cdd622c16cd46e2b8f1476076af3f39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:48.848625 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36be538-c928-4682-8968-7530631b1881 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:48.849071 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36be538-c928-4682-8968-7530631b1881 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:48.849592 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36be538-c928-4682-8968-7530631b1881 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] PATH_INFO: `/v3/users/1c5f36a056834f2e9973f2c489ecac35` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:48.859525 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2940/5837] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:33:48 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:33:48.863052 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709237f1-8b44-4cf4-8234-c426fa4249f0 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:48.874670 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36be538-c928-4682-8968-7530631b1881 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: Authorizing `identity:get_user(user_id=1c5f36a056834f2e9973f2c489ecac35)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:48.878191 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36be538-c928-4682-8968-7530631b1881 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:48.879410 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709237f1-8b44-4cf4-8234-c426fa4249f0 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:48.881616 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2898/5838] 10.222.0.52 () {58 vars in 1220 bytes} [Sat May 14 21:33:48 2022] GET /identity/v3/users/1c5f36a056834f2e9973f2c489ecac35 => generated 373 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:33:48.887492 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a480ca5d-18b3-425d-a8bd-0d960c9aacda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:48.887492 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a480ca5d-18b3-425d-a8bd-0d960c9aacda admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:48.887492 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a480ca5d-18b3-425d-a8bd-0d960c9aacda admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:48.887826 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a480ca5d-18b3-425d-a8bd-0d960c9aacda admin admin] PATH_INFO: `/v3/projects/f176f884005f4842aadd9e5362060a4b/users/3e02c22105f7404fa2c2d628534bb511/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:48.890226 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a480ca5d-18b3-425d-a8bd-0d960c9aacda admin admin] RBAC: Authorizing `identity:create_grant(project_id=f176f884005f4842aadd9e5362060a4b, user_id=3e02c22105f7404fa2c2d628534bb511, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:48.890891 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36be538-c928-4682-8968-7530631b1881 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:48.893656 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a480ca5d-18b3-425d-a8bd-0d960c9aacda admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:48.907000 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2941/5839] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:33:48 2022] PUT /identity/v3/projects/f176f884005f4842aadd9e5362060a4b/users/3e02c22105f7404fa2c2d628534bb511/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:33:48.910560 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36be538-c928-4682-8968-7530631b1881 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:48.919580 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50cfcf9-9bf3-4b63-b8f3-b534cf911ba2 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:48.920018 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50cfcf9-9bf3-4b63-b8f3-b534cf911ba2 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:48.920803 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50cfcf9-9bf3-4b63-b8f3-b534cf911ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:48.961923 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-b50cfcf9-9bf3-4b63-b8f3-b534cf911ba2 None None] MFA Rules not processed for user `3e02c22105f7404fa2c2d628534bb511`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:33:48.963526 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b50cfcf9-9bf3-4b63-b8f3-b534cf911ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:49.011757 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf239e9c-9cf8-4053-b33f-18c101df150c tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83951651c26f4e138a05108f0fe37ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cdd622c16cd46e2b8f1476076af3f39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:49.013022 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf239e9c-9cf8-4053-b33f-18c101df150c tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:49.013485 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf239e9c-9cf8-4053-b33f-18c101df150c tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:49.014563 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf239e9c-9cf8-4053-b33f-18c101df150c tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] PATH_INFO: `/v3/users/1c5f36a056834f2e9973f2c489ecac35` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:49.016804 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf239e9c-9cf8-4053-b33f-18c101df150c tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: Authorizing `identity:delete_user(user_id=1c5f36a056834f2e9973f2c489ecac35)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:49.019755 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf239e9c-9cf8-4053-b33f-18c101df150c tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:49.063587 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2942/5840] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:33:48 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:33:49.068144 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50cfcf9-9bf3-4b63-b8f3-b534cf911ba2 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:49.080528 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50cfcf9-9bf3-4b63-b8f3-b534cf911ba2 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:49.086802 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c4f86e-e099-4815-9ec7-5e75698af34b tempest-ApplicationCredentialsV3AdminTest-469768000 tempest-ApplicationCredentialsV3AdminTest-469768000-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e02c22105f7404fa2c2d628534bb511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f176f884005f4842aadd9e5362060a4b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:49.087503 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4f86e-e099-4815-9ec7-5e75698af34b tempest-ApplicationCredentialsV3AdminTest-469768000 tempest-ApplicationCredentialsV3AdminTest-469768000-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:49.087817 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4f86e-e099-4815-9ec7-5e75698af34b tempest-ApplicationCredentialsV3AdminTest-469768000 tempest-ApplicationCredentialsV3AdminTest-469768000-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:49.088232 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4f86e-e099-4815-9ec7-5e75698af34b tempest-ApplicationCredentialsV3AdminTest-469768000 tempest-ApplicationCredentialsV3AdminTest-469768000-project-admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:49.088861 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c4f86e-e099-4815-9ec7-5e75698af34b tempest-ApplicationCredentialsV3AdminTest-469768000 tempest-ApplicationCredentialsV3AdminTest-469768000-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:49.090593 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c4f86e-e099-4815-9ec7-5e75698af34b tempest-ApplicationCredentialsV3AdminTest-469768000 tempest-ApplicationCredentialsV3AdminTest-469768000-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:49.139854 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-cf239e9c-9cf8-4053-b33f-18c101df150c tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c5f36a056834f2e9973f2c489ecac35'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:49.149228 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-cf239e9c-9cf8-4053-b33f-18c101df150c tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c5f36a056834f2e9973f2c489ecac35'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:49.150439 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-cf239e9c-9cf8-4053-b33f-18c101df150c tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c5f36a056834f2e9973f2c489ecac35'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:49.202348 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2943/5841] 10.222.0.52 () {60 vars in 1142 bytes} [Sat May 14 21:33:49 2022] POST /identity/v3/roles => generated 239 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:33:49.203355 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c4f86e-e099-4815-9ec7-5e75698af34b tempest-ApplicationCredentialsV3AdminTest-469768000 tempest-ApplicationCredentialsV3AdminTest-469768000-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:49.206887 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-68c4f86e-e099-4815-9ec7-5e75698af34b tempest-ApplicationCredentialsV3AdminTest-469768000 tempest-ApplicationCredentialsV3AdminTest-469768000-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:49.220341 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-cf239e9c-9cf8-4053-b33f-18c101df150c tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c5f36a056834f2e9973f2c489ecac35'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:49.240745 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-cf239e9c-9cf8-4053-b33f-18c101df150c tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c5f36a056834f2e9973f2c489ecac35'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:49.248428 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2899/5842] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:33:48 2022] DELETE /identity/v3/users/1c5f36a056834f2e9973f2c489ecac35 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:49.249361 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf239e9c-9cf8-4053-b33f-18c101df150c tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:49.253344 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-cf239e9c-9cf8-4053-b33f-18c101df150c tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:49.284615 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c4f86e-e099-4815-9ec7-5e75698af34b tempest-ApplicationCredentialsV3AdminTest-469768000 tempest-ApplicationCredentialsV3AdminTest-469768000-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:49.319089 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf239e9c-9cf8-4053-b33f-18c101df150c tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:49.323904 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170303ca-a4e2-44c4-b1e7-28d3804b45c0 tempest-ApplicationCredentialsV3AdminTest-469768000 tempest-ApplicationCredentialsV3AdminTest-469768000-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e02c22105f7404fa2c2d628534bb511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f176f884005f4842aadd9e5362060a4b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:49.324781 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170303ca-a4e2-44c4-b1e7-28d3804b45c0 tempest-ApplicationCredentialsV3AdminTest-469768000 tempest-ApplicationCredentialsV3AdminTest-469768000-project-admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:49.325069 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170303ca-a4e2-44c4-b1e7-28d3804b45c0 tempest-ApplicationCredentialsV3AdminTest-469768000 tempest-ApplicationCredentialsV3AdminTest-469768000-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:49.325357 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170303ca-a4e2-44c4-b1e7-28d3804b45c0 tempest-ApplicationCredentialsV3AdminTest-469768000 tempest-ApplicationCredentialsV3AdminTest-469768000-project-admin] PATH_INFO: `/v3/projects/f581de4f93ab4bd3a7da5640198b8aee/users/523d1d4029504507a926d8505b9718da/roles/c2930d4417804856a52ec11f5158e413` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:49.327741 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170303ca-a4e2-44c4-b1e7-28d3804b45c0 tempest-ApplicationCredentialsV3AdminTest-469768000 tempest-ApplicationCredentialsV3AdminTest-469768000-project-admin] RBAC: Authorizing `identity:create_grant(project_id=f581de4f93ab4bd3a7da5640198b8aee, user_id=523d1d4029504507a926d8505b9718da, role_id=c2930d4417804856a52ec11f5158e413)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:49.330413 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170303ca-a4e2-44c4-b1e7-28d3804b45c0 tempest-ApplicationCredentialsV3AdminTest-469768000 tempest-ApplicationCredentialsV3AdminTest-469768000-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:49.342039 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b528439a-63e0-473e-856a-b43988d1808c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:49.342836 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528439a-63e0-473e-856a-b43988d1808c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:49.343221 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528439a-63e0-473e-856a-b43988d1808c admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:49.343533 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528439a-63e0-473e-856a-b43988d1808c admin admin] PATH_INFO: `/v3/projects/bd8e2b08e11f477fa85b79a9d599f126` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:49.344758 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b528439a-63e0-473e-856a-b43988d1808c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd8e2b08e11f477fa85b79a9d599f126)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:49.346663 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b528439a-63e0-473e-856a-b43988d1808c admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:49.475901 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2900/5843] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:33:49 2022] PUT /identity/v3/projects/f581de4f93ab4bd3a7da5640198b8aee/users/523d1d4029504507a926d8505b9718da/roles/c2930d4417804856a52ec11f5158e413 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:49.480810 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170303ca-a4e2-44c4-b1e7-28d3804b45c0 tempest-ApplicationCredentialsV3AdminTest-469768000 tempest-ApplicationCredentialsV3AdminTest-469768000-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:49.489319 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-170303ca-a4e2-44c4-b1e7-28d3804b45c0 tempest-ApplicationCredentialsV3AdminTest-469768000 tempest-ApplicationCredentialsV3AdminTest-469768000-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:49.525588 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b528439a-63e0-473e-856a-b43988d1808c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd8e2b08e11f477fa85b79a9d599f126', 'request_id': 'req-b528439a-63e0-473e-856a-b43988d1808c'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:49.538562 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b528439a-63e0-473e-856a-b43988d1808c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd8e2b08e11f477fa85b79a9d599f126', 'request_id': 'req-b528439a-63e0-473e-856a-b43988d1808c'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:49.592716 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170303ca-a4e2-44c4-b1e7-28d3804b45c0 tempest-ApplicationCredentialsV3AdminTest-469768000 tempest-ApplicationCredentialsV3AdminTest-469768000-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:49.626748 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b528439a-63e0-473e-856a-b43988d1808c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd8e2b08e11f477fa85b79a9d599f126', 'request_id': 'req-b528439a-63e0-473e-856a-b43988d1808c'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:49.652383 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b528439a-63e0-473e-856a-b43988d1808c admin admin] The token cache is being invalidate because project bd8e2b08e11f477fa85b79a9d599f126 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:33:49.652780 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b528439a-63e0-473e-856a-b43988d1808c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:49.654291 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b528439a-63e0-473e-856a-b43988d1808c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:49.655923 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2944/5844] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:33:49 2022] DELETE /identity/v3/projects/bd8e2b08e11f477fa85b79a9d599f126 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:49.657025 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b528439a-63e0-473e-856a-b43988d1808c admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:49.658833 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b528439a-63e0-473e-856a-b43988d1808c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:49.686803 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190dd673-6231-4afd-ac63-759530b86c0c tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83951651c26f4e138a05108f0fe37ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cdd622c16cd46e2b8f1476076af3f39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:49.688250 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190dd673-6231-4afd-ac63-759530b86c0c tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:49.688716 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190dd673-6231-4afd-ac63-759530b86c0c tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:49.689151 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190dd673-6231-4afd-ac63-759530b86c0c tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] PATH_INFO: `/v3/projects/a8ec766e85b94821b6419fb0bf9d28ec` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:49.690802 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190dd673-6231-4afd-ac63-759530b86c0c tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a8ec766e85b94821b6419fb0bf9d28ec)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:49.693714 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190dd673-6231-4afd-ac63-759530b86c0c tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:49.757248 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b528439a-63e0-473e-856a-b43988d1808c admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:49.763978 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a441b-09df-45d8-a48c-8464c73e52af tempest-ApplicationCredentialsV3AdminTest-913494871 tempest-ApplicationCredentialsV3AdminTest-913494871-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '523d1d4029504507a926d8505b9718da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f581de4f93ab4bd3a7da5640198b8aee', 'project_domain_id': 'default', 'roles': ['reader', 'tempest-test_role-650220341', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:49.766017 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a441b-09df-45d8-a48c-8464c73e52af tempest-ApplicationCredentialsV3AdminTest-913494871 tempest-ApplicationCredentialsV3AdminTest-913494871-project] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:49.766017 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a441b-09df-45d8-a48c-8464c73e52af tempest-ApplicationCredentialsV3AdminTest-913494871 tempest-ApplicationCredentialsV3AdminTest-913494871-project] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:49.766017 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a441b-09df-45d8-a48c-8464c73e52af tempest-ApplicationCredentialsV3AdminTest-913494871 tempest-ApplicationCredentialsV3AdminTest-913494871-project] PATH_INFO: `/v3/users/523d1d4029504507a926d8505b9718da/application_credentials` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:49.766932 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987a441b-09df-45d8-a48c-8464c73e52af tempest-ApplicationCredentialsV3AdminTest-913494871 tempest-ApplicationCredentialsV3AdminTest-913494871-project] RBAC: Authorizing `identity:create_application_credential(user_id=523d1d4029504507a926d8505b9718da)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:49.769470 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987a441b-09df-45d8-a48c-8464c73e52af tempest-ApplicationCredentialsV3AdminTest-913494871 tempest-ApplicationCredentialsV3AdminTest-913494871-project] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:49.858037 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-190dd673-6231-4afd-ac63-759530b86c0c tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8ec766e85b94821b6419fb0bf9d28ec', 'request_id': 'req-190dd673-6231-4afd-ac63-759530b86c0c'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:49.868340 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-190dd673-6231-4afd-ac63-759530b86c0c tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8ec766e85b94821b6419fb0bf9d28ec', 'request_id': 'req-190dd673-6231-4afd-ac63-759530b86c0c'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:49.878676 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-190dd673-6231-4afd-ac63-759530b86c0c tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8ec766e85b94821b6419fb0bf9d28ec', 'request_id': 'req-190dd673-6231-4afd-ac63-759530b86c0c'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:50.001197 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-190dd673-6231-4afd-ac63-759530b86c0c tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] The token cache is being invalidate because project a8ec766e85b94821b6419fb0bf9d28ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:33:50.002225 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-190dd673-6231-4afd-ac63-759530b86c0c tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:50.003729 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-190dd673-6231-4afd-ac63-759530b86c0c tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:50.005959 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2901/5845] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:33:49 2022] DELETE /identity/v3/projects/a8ec766e85b94821b6419fb0bf9d28ec => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:50.007278 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03899da1-cc36-49b5-8e59-9d011b2415fa None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:50.007844 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03899da1-cc36-49b5-8e59-9d011b2415fa None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:50.008595 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03899da1-cc36-49b5-8e59-9d011b2415fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:50.031083 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2945/5846] 10.222.0.52 () {60 vars in 1314 bytes} [Sat May 14 21:33:49 2022] POST /identity/v3/users/523d1d4029504507a926d8505b9718da/application_credentials => generated 659 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:33:50.032008 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a441b-09df-45d8-a48c-8464c73e52af tempest-ApplicationCredentialsV3AdminTest-913494871 tempest-ApplicationCredentialsV3AdminTest-913494871-project] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:50.035378 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-987a441b-09df-45d8-a48c-8464c73e52af tempest-ApplicationCredentialsV3AdminTest-913494871 tempest-ApplicationCredentialsV3AdminTest-913494871-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:50.065586 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a441b-09df-45d8-a48c-8464c73e52af tempest-ApplicationCredentialsV3AdminTest-913494871 tempest-ApplicationCredentialsV3AdminTest-913494871-project] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:50.066879 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-03899da1-cc36-49b5-8e59-9d011b2415fa None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:33:50.068799 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-03899da1-cc36-49b5-8e59-9d011b2415fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:50.151523 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da89bba2-60e9-4213-a561-9c454d05f447 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83951651c26f4e138a05108f0fe37ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cdd622c16cd46e2b8f1476076af3f39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:50.152422 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89bba2-60e9-4213-a561-9c454d05f447 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:50.153920 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89bba2-60e9-4213-a561-9c454d05f447 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:50.153920 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89bba2-60e9-4213-a561-9c454d05f447 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:50.154836 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da89bba2-60e9-4213-a561-9c454d05f447 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:50.156901 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da89bba2-60e9-4213-a561-9c454d05f447 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:50.182175 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2902/5847] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:33:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:33:50.183387 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36316df2-644d-42c8-bf11-6dac426c74e3 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:50.183705 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36316df2-644d-42c8-bf11-6dac426c74e3 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:50.183993 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36316df2-644d-42c8-bf11-6dac426c74e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:50.213333 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-36316df2-644d-42c8-bf11-6dac426c74e3 None None] MFA Rules not processed for user `523d1d4029504507a926d8505b9718da`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:33:50.213333 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-36316df2-644d-42c8-bf11-6dac426c74e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:50.308881 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2946/5848] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:33:50 2022] POST /identity/v3/projects => generated 358 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:33:50.310806 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83fb549-e2f5-4910-abc6-1c8f0a74b4f8 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:50.311333 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83fb549-e2f5-4910-abc6-1c8f0a74b4f8 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:50.311640 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83fb549-e2f5-4910-abc6-1c8f0a74b4f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:50.315754 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2903/5849] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:33:50 2022] POST /identity/v3/auth/tokens => generated 3384 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) May 14 21:33:50.316667 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36316df2-644d-42c8-bf11-6dac426c74e3 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:50.337539 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-f83fb549-e2f5-4910-abc6-1c8f0a74b4f8 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:33:50.339267 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-f83fb549-e2f5-4910-abc6-1c8f0a74b4f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:50.393719 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36316df2-644d-42c8-bf11-6dac426c74e3 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:50.399399 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a38f19d-b89b-4793-a5a7-d5a8da9f2ce4 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83951651c26f4e138a05108f0fe37ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cdd622c16cd46e2b8f1476076af3f39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:50.400303 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a38f19d-b89b-4793-a5a7-d5a8da9f2ce4 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:50.400598 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a38f19d-b89b-4793-a5a7-d5a8da9f2ce4 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:50.400884 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a38f19d-b89b-4793-a5a7-d5a8da9f2ce4 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:50.401629 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a38f19d-b89b-4793-a5a7-d5a8da9f2ce4 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:50.403531 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a38f19d-b89b-4793-a5a7-d5a8da9f2ce4 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:50.412609 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2947/5850] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:33:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:33:50.414384 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83fb549-e2f5-4910-abc6-1c8f0a74b4f8 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:50.416391 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-f83fb549-e2f5-4910-abc6-1c8f0a74b4f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:50.483445 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83fb549-e2f5-4910-abc6-1c8f0a74b4f8 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:50.488753 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54cf6ce-55a1-4dcc-b704-12a6f99624fd tempest-ApplicationCredentialsV3AdminTest-913494871 tempest-ApplicationCredentialsV3AdminTest-913494871-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '523d1d4029504507a926d8505b9718da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f581de4f93ab4bd3a7da5640198b8aee', 'project_domain_id': 'default', 'roles': ['reader', 'tempest-test_role-650220341', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:50.489743 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54cf6ce-55a1-4dcc-b704-12a6f99624fd tempest-ApplicationCredentialsV3AdminTest-913494871 tempest-ApplicationCredentialsV3AdminTest-913494871-project] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:50.490012 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54cf6ce-55a1-4dcc-b704-12a6f99624fd tempest-ApplicationCredentialsV3AdminTest-913494871 tempest-ApplicationCredentialsV3AdminTest-913494871-project] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:50.490292 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54cf6ce-55a1-4dcc-b704-12a6f99624fd tempest-ApplicationCredentialsV3AdminTest-913494871 tempest-ApplicationCredentialsV3AdminTest-913494871-project] PATH_INFO: `/v3/users/523d1d4029504507a926d8505b9718da/application_credentials/40773755fd3b48078ae2c045c74eeb37` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:50.491635 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54cf6ce-55a1-4dcc-b704-12a6f99624fd tempest-ApplicationCredentialsV3AdminTest-913494871 tempest-ApplicationCredentialsV3AdminTest-913494871-project] RBAC: Authorizing `identity:delete_application_credential(user_id=523d1d4029504507a926d8505b9718da, application_credential_id=40773755fd3b48078ae2c045c74eeb37)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:50.493790 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54cf6ce-55a1-4dcc-b704-12a6f99624fd tempest-ApplicationCredentialsV3AdminTest-913494871 tempest-ApplicationCredentialsV3AdminTest-913494871-project] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:50.508637 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2904/5851] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:33:50 2022] POST /identity/v3/users => generated 417 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:33:50.510454 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a38f19d-b89b-4793-a5a7-d5a8da9f2ce4 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:50.522791 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a38f19d-b89b-4793-a5a7-d5a8da9f2ce4 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:50.528005 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d67b2a7-4688-47cb-9df6-f9e68ff7045d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:50.528671 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67b2a7-4688-47cb-9df6-f9e68ff7045d admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:50.528962 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67b2a7-4688-47cb-9df6-f9e68ff7045d admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:50.529710 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67b2a7-4688-47cb-9df6-f9e68ff7045d admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:50.529960 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d67b2a7-4688-47cb-9df6-f9e68ff7045d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:33:50.530265 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d67b2a7-4688-47cb-9df6-f9e68ff7045d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:50.532276 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d67b2a7-4688-47cb-9df6-f9e68ff7045d admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:50.544938 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2905/5852] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:33:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:33:50.545859 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d67b2a7-4688-47cb-9df6-f9e68ff7045d admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:50.558030 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d67b2a7-4688-47cb-9df6-f9e68ff7045d admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:50.562720 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f0ed78-994f-477b-8c7d-e21106f9bf6d tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83951651c26f4e138a05108f0fe37ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cdd622c16cd46e2b8f1476076af3f39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:50.563411 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0ed78-994f-477b-8c7d-e21106f9bf6d tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:50.563757 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0ed78-994f-477b-8c7d-e21106f9bf6d tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:50.564040 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0ed78-994f-477b-8c7d-e21106f9bf6d tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:50.566040 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f0ed78-994f-477b-8c7d-e21106f9bf6d tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:50.566372 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f0ed78-994f-477b-8c7d-e21106f9bf6d tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:50.603104 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2948/5853] 10.222.0.52 () {58 vars in 1394 bytes} [Sat May 14 21:33:50 2022] DELETE /identity/v3/users/523d1d4029504507a926d8505b9718da/application_credentials/40773755fd3b48078ae2c045c74eeb37 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:50.606450 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54cf6ce-55a1-4dcc-b704-12a6f99624fd tempest-ApplicationCredentialsV3AdminTest-913494871 tempest-ApplicationCredentialsV3AdminTest-913494871-project] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:50.614463 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54cf6ce-55a1-4dcc-b704-12a6f99624fd tempest-ApplicationCredentialsV3AdminTest-913494871 tempest-ApplicationCredentialsV3AdminTest-913494871-project] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:50.620069 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bcb6ff-5bc7-4e13-9f9d-6b861f6883c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:50.620722 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bcb6ff-5bc7-4e13-9f9d-6b861f6883c2 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:50.621006 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bcb6ff-5bc7-4e13-9f9d-6b861f6883c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:50.621279 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bcb6ff-5bc7-4e13-9f9d-6b861f6883c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:50.621957 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bcb6ff-5bc7-4e13-9f9d-6b861f6883c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:50.624076 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bcb6ff-5bc7-4e13-9f9d-6b861f6883c2 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:50.658926 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2906/5854] 10.222.0.52 () {60 vars in 1142 bytes} [Sat May 14 21:33:50 2022] POST /identity/v3/roles => generated 239 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:33:50.658926 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f0ed78-994f-477b-8c7d-e21106f9bf6d tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:50.661030 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e6f0ed78-994f-477b-8c7d-e21106f9bf6d tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:50.756811 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f0ed78-994f-477b-8c7d-e21106f9bf6d tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:50.765745 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2949/5855] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:33:50 2022] POST /identity/v3/projects => generated 371 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:33:50.765926 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7823006-8d5e-4748-b657-5eb0145cbb24 tempest-ApplicationCredentialsV3AdminTest-469768000 tempest-ApplicationCredentialsV3AdminTest-469768000-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e02c22105f7404fa2c2d628534bb511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f176f884005f4842aadd9e5362060a4b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:50.766048 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bcb6ff-5bc7-4e13-9f9d-6b861f6883c2 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:50.766141 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7823006-8d5e-4748-b657-5eb0145cbb24 tempest-ApplicationCredentialsV3AdminTest-469768000 tempest-ApplicationCredentialsV3AdminTest-469768000-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:50.766141 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7823006-8d5e-4748-b657-5eb0145cbb24 tempest-ApplicationCredentialsV3AdminTest-469768000 tempest-ApplicationCredentialsV3AdminTest-469768000-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:50.766141 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7823006-8d5e-4748-b657-5eb0145cbb24 tempest-ApplicationCredentialsV3AdminTest-469768000 tempest-ApplicationCredentialsV3AdminTest-469768000-project-admin] PATH_INFO: `/v3/roles/c2930d4417804856a52ec11f5158e413` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:50.766851 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7823006-8d5e-4748-b657-5eb0145cbb24 tempest-ApplicationCredentialsV3AdminTest-469768000 tempest-ApplicationCredentialsV3AdminTest-469768000-project-admin] RBAC: Authorizing `identity:delete_role(role_id=c2930d4417804856a52ec11f5158e413)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:50.768797 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7823006-8d5e-4748-b657-5eb0145cbb24 tempest-ApplicationCredentialsV3AdminTest-469768000 tempest-ApplicationCredentialsV3AdminTest-469768000-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:50.879434 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bcb6ff-5bc7-4e13-9f9d-6b861f6883c2 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:50.901199 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c78e178-2780-4ba4-bb11-5e7efd245210 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83951651c26f4e138a05108f0fe37ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cdd622c16cd46e2b8f1476076af3f39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:50.902423 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c78e178-2780-4ba4-bb11-5e7efd245210 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:50.904228 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c78e178-2780-4ba4-bb11-5e7efd245210 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:50.907636 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c78e178-2780-4ba4-bb11-5e7efd245210 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] PATH_INFO: `/v3/users/23f49eb914a94b659effeb5ea15a2433` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:50.940615 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c78e178-2780-4ba4-bb11-5e7efd245210 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: Authorizing `identity:get_user(user_id=23f49eb914a94b659effeb5ea15a2433)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:50.943345 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c78e178-2780-4ba4-bb11-5e7efd245210 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:50.947853 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2950/5856] 10.222.0.52 () {58 vars in 1220 bytes} [Sat May 14 21:33:50 2022] GET /identity/v3/users/23f49eb914a94b659effeb5ea15a2433 => generated 417 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:33:50.947853 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c78e178-2780-4ba4-bb11-5e7efd245210 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:51.029795 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f7823006-8d5e-4748-b657-5eb0145cbb24 tempest-ApplicationCredentialsV3AdminTest-469768000 tempest-ApplicationCredentialsV3AdminTest-469768000-project-admin] Invalidating the token cache because role c2930d4417804856a52ec11f5158e413 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:33:51.030504 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f7823006-8d5e-4748-b657-5eb0145cbb24 tempest-ApplicationCredentialsV3AdminTest-469768000 tempest-ApplicationCredentialsV3AdminTest-469768000-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:51.031470 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f7823006-8d5e-4748-b657-5eb0145cbb24 tempest-ApplicationCredentialsV3AdminTest-469768000 tempest-ApplicationCredentialsV3AdminTest-469768000-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:51.035138 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2907/5857] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:33:50 2022] DELETE /identity/v3/roles/c2930d4417804856a52ec11f5158e413 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:51.036053 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7823006-8d5e-4748-b657-5eb0145cbb24 tempest-ApplicationCredentialsV3AdminTest-469768000 tempest-ApplicationCredentialsV3AdminTest-469768000-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:51.041249 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-f7823006-8d5e-4748-b657-5eb0145cbb24 tempest-ApplicationCredentialsV3AdminTest-469768000 tempest-ApplicationCredentialsV3AdminTest-469768000-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:51.077252 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c78e178-2780-4ba4-bb11-5e7efd245210 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:51.178673 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7823006-8d5e-4748-b657-5eb0145cbb24 tempest-ApplicationCredentialsV3AdminTest-469768000 tempest-ApplicationCredentialsV3AdminTest-469768000-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:51.194082 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae0cdb-ddd2-4a02-891c-ef7c49ecf259 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83951651c26f4e138a05108f0fe37ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cdd622c16cd46e2b8f1476076af3f39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:51.194447 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae0cdb-ddd2-4a02-891c-ef7c49ecf259 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:51.194670 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae0cdb-ddd2-4a02-891c-ef7c49ecf259 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:51.195239 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae0cdb-ddd2-4a02-891c-ef7c49ecf259 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] PATH_INFO: `/v3/roles/46437eb247f2467b8fb782a30a3a00cc` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:51.199244 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ae0cdb-ddd2-4a02-891c-ef7c49ecf259 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: Authorizing `identity:get_role(role_id=46437eb247f2467b8fb782a30a3a00cc)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:51.203506 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ae0cdb-ddd2-4a02-891c-ef7c49ecf259 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:51.205598 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2908/5858] 10.222.0.52 () {58 vars in 1220 bytes} [Sat May 14 21:33:51 2022] GET /identity/v3/roles/46437eb247f2467b8fb782a30a3a00cc => generated 239 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:33:51.212634 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae0cdb-ddd2-4a02-891c-ef7c49ecf259 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:51.217177 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c8ae0cdb-ddd2-4a02-891c-ef7c49ecf259 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:51.224666 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9954bc-439b-4ec4-8cf1-130cd8f225af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:51.224666 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9954bc-439b-4ec4-8cf1-130cd8f225af admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:51.224666 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9954bc-439b-4ec4-8cf1-130cd8f225af admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:51.224666 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9954bc-439b-4ec4-8cf1-130cd8f225af admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:51.225320 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9954bc-439b-4ec4-8cf1-130cd8f225af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:51.226925 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9954bc-439b-4ec4-8cf1-130cd8f225af admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:51.254221 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae0cdb-ddd2-4a02-891c-ef7c49ecf259 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:51.259236 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc42ac-6839-4045-b333-a682ecb804f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:51.260499 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc42ac-6839-4045-b333-a682ecb804f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:51.260814 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc42ac-6839-4045-b333-a682ecb804f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:51.261096 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc42ac-6839-4045-b333-a682ecb804f0 admin admin] PATH_INFO: `/v3/users/523d1d4029504507a926d8505b9718da` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:51.262379 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddc42ac-6839-4045-b333-a682ecb804f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=523d1d4029504507a926d8505b9718da)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:51.264398 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddc42ac-6839-4045-b333-a682ecb804f0 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:51.337353 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2951/5859] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:33:50 2022] POST /identity/v3/users => generated 286 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:33:51.337353 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9954bc-439b-4ec4-8cf1-130cd8f225af admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:51.348883 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9954bc-439b-4ec4-8cf1-130cd8f225af admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:51.356122 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b3e1a1-ddbc-4ca0-a656-61d29f472973 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83951651c26f4e138a05108f0fe37ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cdd622c16cd46e2b8f1476076af3f39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:51.357080 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3e1a1-ddbc-4ca0-a656-61d29f472973 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:51.358396 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3e1a1-ddbc-4ca0-a656-61d29f472973 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:51.365730 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3e1a1-ddbc-4ca0-a656-61d29f472973 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:51.365730 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b3e1a1-ddbc-4ca0-a656-61d29f472973 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:51.365730 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b3e1a1-ddbc-4ca0-a656-61d29f472973 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:51.495767 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2952/5860] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:33:51 2022] POST /identity/v3/projects => generated 360 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:33:51.497515 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b3e1a1-ddbc-4ca0-a656-61d29f472973 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:51.514118 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-67b3e1a1-ddbc-4ca0-a656-61d29f472973 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:51.521746 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-fddc42ac-6839-4045-b333-a682ecb804f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '523d1d4029504507a926d8505b9718da'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:51.530467 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-fddc42ac-6839-4045-b333-a682ecb804f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '523d1d4029504507a926d8505b9718da'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:51.531391 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-fddc42ac-6839-4045-b333-a682ecb804f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '523d1d4029504507a926d8505b9718da'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:51.595707 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b3e1a1-ddbc-4ca0-a656-61d29f472973 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:51.600659 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b019c5cd-823e-4c13-95f7-4e4f173dc63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:51.602232 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b019c5cd-823e-4c13-95f7-4e4f173dc63e admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:51.602403 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b019c5cd-823e-4c13-95f7-4e4f173dc63e admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:51.602680 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b019c5cd-823e-4c13-95f7-4e4f173dc63e admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:51.603621 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b019c5cd-823e-4c13-95f7-4e4f173dc63e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:51.605690 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b019c5cd-823e-4c13-95f7-4e4f173dc63e admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:51.618122 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2953/5861] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:33:51 2022] GET /identity/v3/roles => generated 1650 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:33:51.619025 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b019c5cd-823e-4c13-95f7-4e4f173dc63e admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:51.655615 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-fddc42ac-6839-4045-b333-a682ecb804f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '523d1d4029504507a926d8505b9718da'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:51.678027 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-fddc42ac-6839-4045-b333-a682ecb804f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '523d1d4029504507a926d8505b9718da'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:51.688247 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2909/5862] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:33:51 2022] DELETE /identity/v3/users/523d1d4029504507a926d8505b9718da => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:51.688247 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc42ac-6839-4045-b333-a682ecb804f0 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:51.688247 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-fddc42ac-6839-4045-b333-a682ecb804f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:51.696627 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b019c5cd-823e-4c13-95f7-4e4f173dc63e admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:51.766455 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e08f0d9-6370-421e-aca6-99fac2850e82 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83951651c26f4e138a05108f0fe37ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cdd622c16cd46e2b8f1476076af3f39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:51.767684 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08f0d9-6370-421e-aca6-99fac2850e82 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:51.768052 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08f0d9-6370-421e-aca6-99fac2850e82 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:51.768396 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08f0d9-6370-421e-aca6-99fac2850e82 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] PATH_INFO: `/v3/projects/78b81056bac14e8fb3e737ffd0d20964` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:51.769709 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e08f0d9-6370-421e-aca6-99fac2850e82 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: Authorizing `identity:get_project(project_id=78b81056bac14e8fb3e737ffd0d20964)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:51.769829 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc42ac-6839-4045-b333-a682ecb804f0 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:51.772317 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e08f0d9-6370-421e-aca6-99fac2850e82 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:51.774289 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2954/5863] 10.222.0.52 () {58 vars in 1229 bytes} [Sat May 14 21:33:51 2022] GET /identity/v3/projects/78b81056bac14e8fb3e737ffd0d20964 => generated 360 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:33:51.776555 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e08f0d9-6370-421e-aca6-99fac2850e82 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:51.776709 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea87bcd-50d6-4108-80bb-c7c825228c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:51.777569 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea87bcd-50d6-4108-80bb-c7c825228c71 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:51.778046 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea87bcd-50d6-4108-80bb-c7c825228c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:51.778364 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-1e08f0d9-6370-421e-aca6-99fac2850e82 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:51.778483 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea87bcd-50d6-4108-80bb-c7c825228c71 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:51.779850 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea87bcd-50d6-4108-80bb-c7c825228c71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:51.781523 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea87bcd-50d6-4108-80bb-c7c825228c71 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:51.796755 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2910/5864] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:33:51 2022] GET /identity/v3/roles => generated 1650 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:33:51.796900 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e08f0d9-6370-421e-aca6-99fac2850e82 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:51.797027 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a784e-04fd-4107-8a6e-dfddf02d203c None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:51.797027 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a784e-04fd-4107-8a6e-dfddf02d203c None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:51.797027 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a784e-04fd-4107-8a6e-dfddf02d203c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:51.803690 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48176070-a47b-4e0f-b191-06c48e708bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:51.805491 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48176070-a47b-4e0f-b191-06c48e708bf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:51.805858 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48176070-a47b-4e0f-b191-06c48e708bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:51.807206 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48176070-a47b-4e0f-b191-06c48e708bf1 admin admin] PATH_INFO: `/v3/users/7ac035423b7e4250987fa75efd7893cb` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:51.808488 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48176070-a47b-4e0f-b191-06c48e708bf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ac035423b7e4250987fa75efd7893cb)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:51.810803 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48176070-a47b-4e0f-b191-06c48e708bf1 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:51.815689 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-969a784e-04fd-4107-8a6e-dfddf02d203c None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:33:51.819184 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-969a784e-04fd-4107-8a6e-dfddf02d203c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:51.831729 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2911/5865] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:33:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:33:51.832931 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969a784e-04fd-4107-8a6e-dfddf02d203c None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:51.834313 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-969a784e-04fd-4107-8a6e-dfddf02d203c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:51.849346 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969a784e-04fd-4107-8a6e-dfddf02d203c None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:51.854466 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44e51d3-7e9a-4755-b1ee-7d980c4e12ce tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83951651c26f4e138a05108f0fe37ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cdd622c16cd46e2b8f1476076af3f39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:51.855433 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e51d3-7e9a-4755-b1ee-7d980c4e12ce tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:51.855817 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e51d3-7e9a-4755-b1ee-7d980c4e12ce tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:51.856274 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e51d3-7e9a-4755-b1ee-7d980c4e12ce tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] PATH_INFO: `/v3/projects/78b81056bac14e8fb3e737ffd0d20964/users/23f49eb914a94b659effeb5ea15a2433/roles/46437eb247f2467b8fb782a30a3a00cc` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:51.858636 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44e51d3-7e9a-4755-b1ee-7d980c4e12ce tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: Authorizing `identity:create_grant(project_id=78b81056bac14e8fb3e737ffd0d20964, user_id=23f49eb914a94b659effeb5ea15a2433, role_id=46437eb247f2467b8fb782a30a3a00cc)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:51.861442 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44e51d3-7e9a-4755-b1ee-7d980c4e12ce tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:51.986671 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2912/5866] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:33:51 2022] PUT /identity/v3/projects/78b81056bac14e8fb3e737ffd0d20964/users/23f49eb914a94b659effeb5ea15a2433/roles/46437eb247f2467b8fb782a30a3a00cc => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:51.987609 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44e51d3-7e9a-4755-b1ee-7d980c4e12ce tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:52.052347 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44e51d3-7e9a-4755-b1ee-7d980c4e12ce tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:52.057523 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b7e25c-2958-4f84-84b4-7fbb4209e69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:52.058462 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b7e25c-2958-4f84-84b4-7fbb4209e69f admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:52.059038 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b7e25c-2958-4f84-84b4-7fbb4209e69f admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:52.059319 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b7e25c-2958-4f84-84b4-7fbb4209e69f admin admin] PATH_INFO: `/v3/projects/857222f705324b6bb53df723369d59f2/users/ba2480afbdd040a08fffa3dc2b0479d3/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:52.074419 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-48176070-a47b-4e0f-b191-06c48e708bf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ac035423b7e4250987fa75efd7893cb'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:52.077881 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b7e25c-2958-4f84-84b4-7fbb4209e69f admin admin] RBAC: Authorizing `identity:create_grant(project_id=857222f705324b6bb53df723369d59f2, user_id=ba2480afbdd040a08fffa3dc2b0479d3, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:52.080588 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b7e25c-2958-4f84-84b4-7fbb4209e69f admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:52.088294 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-48176070-a47b-4e0f-b191-06c48e708bf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ac035423b7e4250987fa75efd7893cb'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:52.095252 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-48176070-a47b-4e0f-b191-06c48e708bf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ac035423b7e4250987fa75efd7893cb'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:52.157397 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2913/5867] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:33:51 2022] PUT /identity/v3/projects/857222f705324b6bb53df723369d59f2/users/ba2480afbdd040a08fffa3dc2b0479d3/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:52.158257 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b7e25c-2958-4f84-84b4-7fbb4209e69f admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:52.160066 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-f9b7e25c-2958-4f84-84b4-7fbb4209e69f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:52.181345 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-48176070-a47b-4e0f-b191-06c48e708bf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ac035423b7e4250987fa75efd7893cb'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:52.182872 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-48176070-a47b-4e0f-b191-06c48e708bf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ac035423b7e4250987fa75efd7893cb'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:52.191983 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2955/5868] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:33:51 2022] DELETE /identity/v3/users/7ac035423b7e4250987fa75efd7893cb => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:52.192745 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48176070-a47b-4e0f-b191-06c48e708bf1 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:52.198529 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-48176070-a47b-4e0f-b191-06c48e708bf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:52.227381 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b7e25c-2958-4f84-84b4-7fbb4209e69f admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:52.279676 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48176070-a47b-4e0f-b191-06c48e708bf1 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:52.286263 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367c5943-8c5b-4c4d-a01c-0e4ab4c94ae5 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83951651c26f4e138a05108f0fe37ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cdd622c16cd46e2b8f1476076af3f39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:52.287151 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c5943-8c5b-4c4d-a01c-0e4ab4c94ae5 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:52.287452 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c5943-8c5b-4c4d-a01c-0e4ab4c94ae5 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:52.287762 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c5943-8c5b-4c4d-a01c-0e4ab4c94ae5 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:52.288460 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367c5943-8c5b-4c4d-a01c-0e4ab4c94ae5 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:52.291461 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367c5943-8c5b-4c4d-a01c-0e4ab4c94ae5 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:52.304964 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be41c854-f362-48a3-9caa-57b0fe19d000 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:52.306201 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41c854-f362-48a3-9caa-57b0fe19d000 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:52.306593 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41c854-f362-48a3-9caa-57b0fe19d000 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:52.306980 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41c854-f362-48a3-9caa-57b0fe19d000 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:52.310275 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-be41c854-f362-48a3-9caa-57b0fe19d000 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:52.381220 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be41c854-f362-48a3-9caa-57b0fe19d000 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:52.383404 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be41c854-f362-48a3-9caa-57b0fe19d000 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:52.395192 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2914/5869] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:33:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:33:52.396815 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a162e-9d2f-4c98-810b-46eb1718a5e8 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:52.397102 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a162e-9d2f-4c98-810b-46eb1718a5e8 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:52.397378 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a162e-9d2f-4c98-810b-46eb1718a5e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:52.412427 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2956/5870] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:33:52 2022] POST /identity/v3/projects => generated 358 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:33:52.414919 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba5e41d-dd85-41d3-bf4b-75d144725e2e None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:52.415215 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba5e41d-dd85-41d3-bf4b-75d144725e2e None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:52.415516 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba5e41d-dd85-41d3-bf4b-75d144725e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:52.438060 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-878a162e-9d2f-4c98-810b-46eb1718a5e8 None None] MFA Rules not processed for user `ba2480afbdd040a08fffa3dc2b0479d3`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:33:52.439265 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-878a162e-9d2f-4c98-810b-46eb1718a5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:52.440250 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-1ba5e41d-dd85-41d3-bf4b-75d144725e2e None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:33:52.441764 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-1ba5e41d-dd85-41d3-bf4b-75d144725e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:52.511572 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2915/5871] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:33:52 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:33:52.512967 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a162e-9d2f-4c98-810b-46eb1718a5e8 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:52.519943 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2957/5872] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:33:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:33:52.520792 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba5e41d-dd85-41d3-bf4b-75d144725e2e None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:52.522203 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-1ba5e41d-dd85-41d3-bf4b-75d144725e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:52.538559 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba5e41d-dd85-41d3-bf4b-75d144725e2e None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:52.545101 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aac574-d045-4045-a9f1-226d38ae9796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:52.546315 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aac574-d045-4045-a9f1-226d38ae9796 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:52.549701 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aac574-d045-4045-a9f1-226d38ae9796 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:52.549701 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aac574-d045-4045-a9f1-226d38ae9796 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:52.549701 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aac574-d045-4045-a9f1-226d38ae9796 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:52.549971 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aac574-d045-4045-a9f1-226d38ae9796 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:52.584932 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a162e-9d2f-4c98-810b-46eb1718a5e8 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:52.587838 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3ddc26-1508-4ed0-ac63-7840d4b27b0a tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83951651c26f4e138a05108f0fe37ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cdd622c16cd46e2b8f1476076af3f39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:52.588682 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3ddc26-1508-4ed0-ac63-7840d4b27b0a tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:52.588966 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3ddc26-1508-4ed0-ac63-7840d4b27b0a tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:52.589243 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3ddc26-1508-4ed0-ac63-7840d4b27b0a tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] PATH_INFO: `/v3/projects/c603c45d21af4a9089260c56dbb1937e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:52.590443 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3ddc26-1508-4ed0-ac63-7840d4b27b0a tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: Authorizing `identity:get_project(project_id=c603c45d21af4a9089260c56dbb1937e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:52.592540 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3ddc26-1508-4ed0-ac63-7840d4b27b0a tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:52.594212 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2916/5873] 10.222.0.52 () {58 vars in 1229 bytes} [Sat May 14 21:33:52 2022] GET /identity/v3/projects/c603c45d21af4a9089260c56dbb1937e => generated 358 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:33:52.594963 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3ddc26-1508-4ed0-ac63-7840d4b27b0a tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:52.596705 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-4b3ddc26-1508-4ed0-ac63-7840d4b27b0a tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:52.657695 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3ddc26-1508-4ed0-ac63-7840d4b27b0a tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:52.661400 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e554a3-713a-4dec-8520-ecccd3d169a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:52.662043 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e554a3-713a-4dec-8520-ecccd3d169a6 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:52.662323 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e554a3-713a-4dec-8520-ecccd3d169a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:52.662604 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e554a3-713a-4dec-8520-ecccd3d169a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:52.678638 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e554a3-713a-4dec-8520-ecccd3d169a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:52.682172 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e554a3-713a-4dec-8520-ecccd3d169a6 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:52.683450 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2958/5874] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:33:52 2022] POST /identity/v3/projects => generated 369 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:33:52.684576 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aac574-d045-4045-a9f1-226d38ae9796 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:52.693745 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2917/5875] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:33:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:33:52.694576 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e554a3-713a-4dec-8520-ecccd3d169a6 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:52.707797 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e554a3-713a-4dec-8520-ecccd3d169a6 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:52.785221 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aac574-d045-4045-a9f1-226d38ae9796 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:52.794438 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c44322e-c4b8-417f-857b-69a847224a81 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83951651c26f4e138a05108f0fe37ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cdd622c16cd46e2b8f1476076af3f39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:52.795135 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44322e-c4b8-417f-857b-69a847224a81 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:52.795961 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44322e-c4b8-417f-857b-69a847224a81 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:52.796548 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44322e-c4b8-417f-857b-69a847224a81 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] PATH_INFO: `/v3/projects/c603c45d21af4a9089260c56dbb1937e/users/23f49eb914a94b659effeb5ea15a2433/roles/46437eb247f2467b8fb782a30a3a00cc` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:52.799896 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c44322e-c4b8-417f-857b-69a847224a81 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: Authorizing `identity:create_grant(project_id=c603c45d21af4a9089260c56dbb1937e, user_id=23f49eb914a94b659effeb5ea15a2433, role_id=46437eb247f2467b8fb782a30a3a00cc)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:52.804008 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c44322e-c4b8-417f-857b-69a847224a81 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:52.814752 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc56e5-3ce4-479d-bbe0-069d1b5e77c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:52.815624 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc56e5-3ce4-479d-bbe0-069d1b5e77c1 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:52.815914 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc56e5-3ce4-479d-bbe0-069d1b5e77c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:52.816197 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc56e5-3ce4-479d-bbe0-069d1b5e77c1 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:52.817088 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dc56e5-3ce4-479d-bbe0-069d1b5e77c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:52.820376 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dc56e5-3ce4-479d-bbe0-069d1b5e77c1 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:52.896336 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2959/5876] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:33:52 2022] PUT /identity/v3/projects/c603c45d21af4a9089260c56dbb1937e/users/23f49eb914a94b659effeb5ea15a2433/roles/46437eb247f2467b8fb782a30a3a00cc => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:52.897325 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c44322e-c4b8-417f-857b-69a847224a81 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:52.965307 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2918/5877] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:33:52 2022] POST /identity/v3/users => generated 291 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:33:52.969184 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc56e5-3ce4-479d-bbe0-069d1b5e77c1 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:52.991248 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc56e5-3ce4-479d-bbe0-069d1b5e77c1 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:53.001488 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c44322e-c4b8-417f-857b-69a847224a81 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:53.007528 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85dc19-8a81-4eaa-aa8a-b41027e76c05 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83951651c26f4e138a05108f0fe37ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cdd622c16cd46e2b8f1476076af3f39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:53.008737 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85dc19-8a81-4eaa-aa8a-b41027e76c05 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:53.009121 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85dc19-8a81-4eaa-aa8a-b41027e76c05 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:53.009499 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85dc19-8a81-4eaa-aa8a-b41027e76c05 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] PATH_INFO: `/v3/users/23f49eb914a94b659effeb5ea15a2433/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:53.011124 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb85dc19-8a81-4eaa-aa8a-b41027e76c05 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: Authorizing `identity:list_user_projects(user_id=23f49eb914a94b659effeb5ea15a2433)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:53.013532 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb85dc19-8a81-4eaa-aa8a-b41027e76c05 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:53.053528 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2960/5878] 10.222.0.52 () {58 vars in 1247 bytes} [Sat May 14 21:33:52 2022] GET /identity/v3/users/23f49eb914a94b659effeb5ea15a2433/projects => generated 842 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:33:53.057445 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85dc19-8a81-4eaa-aa8a-b41027e76c05 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:53.073449 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85dc19-8a81-4eaa-aa8a-b41027e76c05 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:53.081071 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3042acd9-b18f-4cb8-88da-b818d08c97e8 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83951651c26f4e138a05108f0fe37ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cdd622c16cd46e2b8f1476076af3f39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:53.081666 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3042acd9-b18f-4cb8-88da-b818d08c97e8 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:53.081840 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3042acd9-b18f-4cb8-88da-b818d08c97e8 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:53.082297 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3042acd9-b18f-4cb8-88da-b818d08c97e8 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] PATH_INFO: `/v3/projects/c603c45d21af4a9089260c56dbb1937e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:53.084194 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3042acd9-b18f-4cb8-88da-b818d08c97e8 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c603c45d21af4a9089260c56dbb1937e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:53.086273 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3042acd9-b18f-4cb8-88da-b818d08c97e8 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:53.100139 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebb173a-6b8e-4d74-b4b3-44b33f79492b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:53.101590 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb173a-6b8e-4d74-b4b3-44b33f79492b admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:53.102151 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb173a-6b8e-4d74-b4b3-44b33f79492b admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:53.103032 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb173a-6b8e-4d74-b4b3-44b33f79492b admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:53.104002 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebb173a-6b8e-4d74-b4b3-44b33f79492b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:53.105953 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebb173a-6b8e-4d74-b4b3-44b33f79492b admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:53.120901 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2919/5879] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:33:52 2022] GET /identity/v3/roles => generated 1650 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:33:53.126380 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebb173a-6b8e-4d74-b4b3-44b33f79492b admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:53.137367 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebb173a-6b8e-4d74-b4b3-44b33f79492b admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:53.144651 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5195405a-1fde-4864-bf31-605540656f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:53.145572 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195405a-1fde-4864-bf31-605540656f95 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:53.148743 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195405a-1fde-4864-bf31-605540656f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:53.148743 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195405a-1fde-4864-bf31-605540656f95 admin admin] PATH_INFO: `/v3/projects/18ef6ea639fd4d01a2d29fc0b826df7b/users/7fb19a2a05a44e00bad9b194a8c63f03/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:53.163231 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5195405a-1fde-4864-bf31-605540656f95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18ef6ea639fd4d01a2d29fc0b826df7b, user_id=7fb19a2a05a44e00bad9b194a8c63f03, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:53.167193 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5195405a-1fde-4864-bf31-605540656f95 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:53.297720 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2920/5880] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:33:53 2022] PUT /identity/v3/projects/18ef6ea639fd4d01a2d29fc0b826df7b/users/7fb19a2a05a44e00bad9b194a8c63f03/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:53.301544 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5195405a-1fde-4864-bf31-605540656f95 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:53.375238 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5195405a-1fde-4864-bf31-605540656f95 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:53.381236 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478e105e-8f50-4a1f-a98b-b50e1908b3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:53.381611 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478e105e-8f50-4a1f-a98b-b50e1908b3e9 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:53.382192 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478e105e-8f50-4a1f-a98b-b50e1908b3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:53.383003 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478e105e-8f50-4a1f-a98b-b50e1908b3e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:53.383852 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478e105e-8f50-4a1f-a98b-b50e1908b3e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:53.398520 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478e105e-8f50-4a1f-a98b-b50e1908b3e9 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:53.410296 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2921/5881] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:33:53 2022] GET /identity/v3/roles => generated 1650 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:33:53.411005 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478e105e-8f50-4a1f-a98b-b50e1908b3e9 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:53.412850 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-478e105e-8f50-4a1f-a98b-b50e1908b3e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:53.426617 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478e105e-8f50-4a1f-a98b-b50e1908b3e9 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:53.433201 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76434a76-dc95-492c-ac90-133b4b518eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:53.435350 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76434a76-dc95-492c-ac90-133b4b518eb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:53.436784 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76434a76-dc95-492c-ac90-133b4b518eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:53.437529 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76434a76-dc95-492c-ac90-133b4b518eb4 admin admin] PATH_INFO: `/v3/projects/f581de4f93ab4bd3a7da5640198b8aee` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:53.439695 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76434a76-dc95-492c-ac90-133b4b518eb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f581de4f93ab4bd3a7da5640198b8aee)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:53.442481 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76434a76-dc95-492c-ac90-133b4b518eb4 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:53.448799 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3042acd9-b18f-4cb8-88da-b818d08c97e8 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c603c45d21af4a9089260c56dbb1937e', 'request_id': 'req-3042acd9-b18f-4cb8-88da-b818d08c97e8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:53.457170 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3042acd9-b18f-4cb8-88da-b818d08c97e8 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c603c45d21af4a9089260c56dbb1937e', 'request_id': 'req-3042acd9-b18f-4cb8-88da-b818d08c97e8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:53.538073 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3042acd9-b18f-4cb8-88da-b818d08c97e8 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c603c45d21af4a9089260c56dbb1937e', 'request_id': 'req-3042acd9-b18f-4cb8-88da-b818d08c97e8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:53.558802 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3042acd9-b18f-4cb8-88da-b818d08c97e8 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] The token cache is being invalidate because project c603c45d21af4a9089260c56dbb1937e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:33:53.559127 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3042acd9-b18f-4cb8-88da-b818d08c97e8 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:53.559940 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3042acd9-b18f-4cb8-88da-b818d08c97e8 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:53.564560 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2961/5882] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:33:53 2022] DELETE /identity/v3/projects/c603c45d21af4a9089260c56dbb1937e => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:53.564560 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3042acd9-b18f-4cb8-88da-b818d08c97e8 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:53.564560 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-3042acd9-b18f-4cb8-88da-b818d08c97e8 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:53.578566 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-76434a76-dc95-492c-ac90-133b4b518eb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f581de4f93ab4bd3a7da5640198b8aee', 'request_id': 'req-76434a76-dc95-492c-ac90-133b4b518eb4'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:53.585589 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-76434a76-dc95-492c-ac90-133b4b518eb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f581de4f93ab4bd3a7da5640198b8aee', 'request_id': 'req-76434a76-dc95-492c-ac90-133b4b518eb4'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:53.595236 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-76434a76-dc95-492c-ac90-133b4b518eb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f581de4f93ab4bd3a7da5640198b8aee', 'request_id': 'req-76434a76-dc95-492c-ac90-133b4b518eb4'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:53.648789 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3042acd9-b18f-4cb8-88da-b818d08c97e8 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:53.705292 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aec152-b039-485f-98f5-7036c0e17b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:53.706156 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aec152-b039-485f-98f5-7036c0e17b6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:53.706438 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aec152-b039-485f-98f5-7036c0e17b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:53.706719 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aec152-b039-485f-98f5-7036c0e17b6c admin admin] PATH_INFO: `/v3/projects/42f767810e984404be0dc9a736a84765` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:53.707939 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aec152-b039-485f-98f5-7036c0e17b6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=42f767810e984404be0dc9a736a84765)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:53.709838 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aec152-b039-485f-98f5-7036c0e17b6c admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:53.716716 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-76434a76-dc95-492c-ac90-133b4b518eb4 admin admin] The token cache is being invalidate because project f581de4f93ab4bd3a7da5640198b8aee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:33:53.717127 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-76434a76-dc95-492c-ac90-133b4b518eb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:53.717781 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-76434a76-dc95-492c-ac90-133b4b518eb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:53.719676 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2922/5883] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:33:53 2022] DELETE /identity/v3/projects/f581de4f93ab4bd3a7da5640198b8aee => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:53.720409 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76434a76-dc95-492c-ac90-133b4b518eb4 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:53.721777 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-76434a76-dc95-492c-ac90-133b4b518eb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:53.734967 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76434a76-dc95-492c-ac90-133b4b518eb4 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:53.740334 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f49996b-6c47-407b-a138-2fe125c02839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:53.744367 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f49996b-6c47-407b-a138-2fe125c02839 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:53.744367 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f49996b-6c47-407b-a138-2fe125c02839 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:53.744367 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f49996b-6c47-407b-a138-2fe125c02839 admin admin] PATH_INFO: `/v3/projects/18ef6ea639fd4d01a2d29fc0b826df7b/users/7fb19a2a05a44e00bad9b194a8c63f03/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:53.745494 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f49996b-6c47-407b-a138-2fe125c02839 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18ef6ea639fd4d01a2d29fc0b826df7b, user_id=7fb19a2a05a44e00bad9b194a8c63f03, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:53.748224 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f49996b-6c47-407b-a138-2fe125c02839 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:53.758832 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2923/5884] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:33:53 2022] PUT /identity/v3/projects/18ef6ea639fd4d01a2d29fc0b826df7b/users/7fb19a2a05a44e00bad9b194a8c63f03/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:53.759710 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f49996b-6c47-407b-a138-2fe125c02839 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:53.761335 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-4f49996b-6c47-407b-a138-2fe125c02839 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:53.843585 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f49996b-6c47-407b-a138-2fe125c02839 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:53.849469 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-14aec152-b039-485f-98f5-7036c0e17b6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42f767810e984404be0dc9a736a84765', 'request_id': 'req-14aec152-b039-485f-98f5-7036c0e17b6c'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:53.862390 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-14aec152-b039-485f-98f5-7036c0e17b6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42f767810e984404be0dc9a736a84765', 'request_id': 'req-14aec152-b039-485f-98f5-7036c0e17b6c'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:53.916330 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f0775c-13e9-4251-a88e-1dddc1cb119a tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83951651c26f4e138a05108f0fe37ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cdd622c16cd46e2b8f1476076af3f39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:53.917262 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0775c-13e9-4251-a88e-1dddc1cb119a tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:53.917548 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0775c-13e9-4251-a88e-1dddc1cb119a tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:53.917826 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0775c-13e9-4251-a88e-1dddc1cb119a tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] PATH_INFO: `/v3/projects/78b81056bac14e8fb3e737ffd0d20964` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:53.919209 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f0775c-13e9-4251-a88e-1dddc1cb119a tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: Authorizing `identity:delete_project(project_id=78b81056bac14e8fb3e737ffd0d20964)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:53.921412 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f0775c-13e9-4251-a88e-1dddc1cb119a tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:53.951693 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-14aec152-b039-485f-98f5-7036c0e17b6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42f767810e984404be0dc9a736a84765', 'request_id': 'req-14aec152-b039-485f-98f5-7036c0e17b6c'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:53.967080 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-14aec152-b039-485f-98f5-7036c0e17b6c admin admin] The token cache is being invalidate because project 42f767810e984404be0dc9a736a84765 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:33:53.974336 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-14aec152-b039-485f-98f5-7036c0e17b6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:53.974336 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-14aec152-b039-485f-98f5-7036c0e17b6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:53.974336 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2962/5885] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:33:53 2022] DELETE /identity/v3/projects/42f767810e984404be0dc9a736a84765 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:53.974336 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aec152-b039-485f-98f5-7036c0e17b6c admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:53.974336 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-14aec152-b039-485f-98f5-7036c0e17b6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:54.057264 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aec152-b039-485f-98f5-7036c0e17b6c admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:54.063814 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceebf91-e4d5-45f3-9473-8762ee3ee550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:54.065594 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceebf91-e4d5-45f3-9473-8762ee3ee550 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:54.066032 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceebf91-e4d5-45f3-9473-8762ee3ee550 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:54.067134 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceebf91-e4d5-45f3-9473-8762ee3ee550 admin admin] PATH_INFO: `/v3/users/3e02c22105f7404fa2c2d628534bb511` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:54.068847 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceebf91-e4d5-45f3-9473-8762ee3ee550 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e02c22105f7404fa2c2d628534bb511)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:54.072189 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceebf91-e4d5-45f3-9473-8762ee3ee550 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:54.201620 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d5f0775c-13e9-4251-a88e-1dddc1cb119a tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78b81056bac14e8fb3e737ffd0d20964', 'request_id': 'req-d5f0775c-13e9-4251-a88e-1dddc1cb119a'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:54.207732 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d5f0775c-13e9-4251-a88e-1dddc1cb119a tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78b81056bac14e8fb3e737ffd0d20964', 'request_id': 'req-d5f0775c-13e9-4251-a88e-1dddc1cb119a'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:54.215221 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d5f0775c-13e9-4251-a88e-1dddc1cb119a tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78b81056bac14e8fb3e737ffd0d20964', 'request_id': 'req-d5f0775c-13e9-4251-a88e-1dddc1cb119a'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:54.337615 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d5f0775c-13e9-4251-a88e-1dddc1cb119a tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] The token cache is being invalidate because project 78b81056bac14e8fb3e737ffd0d20964 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:33:54.338225 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d5f0775c-13e9-4251-a88e-1dddc1cb119a tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:54.338930 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d5f0775c-13e9-4251-a88e-1dddc1cb119a tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:54.340621 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2924/5886] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:33:53 2022] DELETE /identity/v3/projects/78b81056bac14e8fb3e737ffd0d20964 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:54.345549 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea05d24-a955-4022-8ffc-0142131998e6 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:54.346394 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea05d24-a955-4022-8ffc-0142131998e6 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:54.346682 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea05d24-a955-4022-8ffc-0142131998e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:54.394482 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-eea05d24-a955-4022-8ffc-0142131998e6 None None] MFA Rules not processed for user `7fb19a2a05a44e00bad9b194a8c63f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:33:54.397137 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-eea05d24-a955-4022-8ffc-0142131998e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:54.403934 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6ceebf91-e4d5-45f3-9473-8762ee3ee550 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e02c22105f7404fa2c2d628534bb511'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:54.426889 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6ceebf91-e4d5-45f3-9473-8762ee3ee550 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e02c22105f7404fa2c2d628534bb511'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:54.434874 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6ceebf91-e4d5-45f3-9473-8762ee3ee550 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e02c22105f7404fa2c2d628534bb511'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:54.490950 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2925/5887] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:33:54 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:33:54.492679 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea05d24-a955-4022-8ffc-0142131998e6 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:54.494876 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-eea05d24-a955-4022-8ffc-0142131998e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:54.510322 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6ceebf91-e4d5-45f3-9473-8762ee3ee550 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e02c22105f7404fa2c2d628534bb511'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:54.510969 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6ceebf91-e4d5-45f3-9473-8762ee3ee550 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e02c22105f7404fa2c2d628534bb511'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:54.521364 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2963/5888] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:33:53 2022] DELETE /identity/v3/users/3e02c22105f7404fa2c2d628534bb511 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:54.522306 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceebf91-e4d5-45f3-9473-8762ee3ee550 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:54.525484 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-6ceebf91-e4d5-45f3-9473-8762ee3ee550 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:54.584896 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea05d24-a955-4022-8ffc-0142131998e6 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:54.634511 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceebf91-e4d5-45f3-9473-8762ee3ee550 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:54.639861 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b40c484-eb66-432d-9335-cd6f89520ab5 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83951651c26f4e138a05108f0fe37ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cdd622c16cd46e2b8f1476076af3f39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:54.641019 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b40c484-eb66-432d-9335-cd6f89520ab5 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:54.641286 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b40c484-eb66-432d-9335-cd6f89520ab5 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:54.641565 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b40c484-eb66-432d-9335-cd6f89520ab5 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] PATH_INFO: `/v3/roles/46437eb247f2467b8fb782a30a3a00cc` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:54.643337 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b40c484-eb66-432d-9335-cd6f89520ab5 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: Authorizing `identity:delete_role(role_id=46437eb247f2467b8fb782a30a3a00cc)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:54.645309 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b40c484-eb66-432d-9335-cd6f89520ab5 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:54.658758 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d60f3b-10b2-4e77-9505-fcf1cc46abd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:54.660305 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d60f3b-10b2-4e77-9505-fcf1cc46abd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:54.668280 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d60f3b-10b2-4e77-9505-fcf1cc46abd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:54.668280 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d60f3b-10b2-4e77-9505-fcf1cc46abd1 admin admin] PATH_INFO: `/v3/users/32dfb4a72bb343059307d695af4db2da` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:54.668280 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d60f3b-10b2-4e77-9505-fcf1cc46abd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32dfb4a72bb343059307d695af4db2da)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:54.668280 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d60f3b-10b2-4e77-9505-fcf1cc46abd1 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:54.787162 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6b40c484-eb66-432d-9335-cd6f89520ab5 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Invalidating the token cache because role 46437eb247f2467b8fb782a30a3a00cc has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:33:54.787503 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6b40c484-eb66-432d-9335-cd6f89520ab5 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:54.788374 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6b40c484-eb66-432d-9335-cd6f89520ab5 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:54.791845 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2964/5889] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:33:54 2022] DELETE /identity/v3/roles/46437eb247f2467b8fb782a30a3a00cc => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:54.794515 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b40c484-eb66-432d-9335-cd6f89520ab5 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:54.795922 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-6b40c484-eb66-432d-9335-cd6f89520ab5 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:54.870142 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b40c484-eb66-432d-9335-cd6f89520ab5 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:54.875472 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ed4810-6f2b-4066-b095-8061a9525f9b tempest-UsersNegativeTest-704496811 tempest-UsersNegativeTest-704496811-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fb19a2a05a44e00bad9b194a8c63f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18ef6ea639fd4d01a2d29fc0b826df7b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:54.876342 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ed4810-6f2b-4066-b095-8061a9525f9b tempest-UsersNegativeTest-704496811 tempest-UsersNegativeTest-704496811-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:54.876649 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ed4810-6f2b-4066-b095-8061a9525f9b tempest-UsersNegativeTest-704496811 tempest-UsersNegativeTest-704496811-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:54.877067 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ed4810-6f2b-4066-b095-8061a9525f9b tempest-UsersNegativeTest-704496811 tempest-UsersNegativeTest-704496811-project-admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:54.877807 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ed4810-6f2b-4066-b095-8061a9525f9b tempest-UsersNegativeTest-704496811 tempest-UsersNegativeTest-704496811-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:54.879800 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ed4810-6f2b-4066-b095-8061a9525f9b tempest-UsersNegativeTest-704496811 tempest-UsersNegativeTest-704496811-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:54.911892 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b0d60f3b-10b2-4e77-9505-fcf1cc46abd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32dfb4a72bb343059307d695af4db2da'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:54.918819 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b0d60f3b-10b2-4e77-9505-fcf1cc46abd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32dfb4a72bb343059307d695af4db2da'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:54.920104 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b0d60f3b-10b2-4e77-9505-fcf1cc46abd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32dfb4a72bb343059307d695af4db2da'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:54.979925 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2965/5890] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:33:54 2022] POST /identity/v3/projects => generated 360 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:33:54.980928 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ed4810-6f2b-4066-b095-8061a9525f9b tempest-UsersNegativeTest-704496811 tempest-UsersNegativeTest-704496811-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:54.983190 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d5ed4810-6f2b-4066-b095-8061a9525f9b tempest-UsersNegativeTest-704496811 tempest-UsersNegativeTest-704496811-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:55.002547 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b0d60f3b-10b2-4e77-9505-fcf1cc46abd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32dfb4a72bb343059307d695af4db2da'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:55.027629 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b0d60f3b-10b2-4e77-9505-fcf1cc46abd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32dfb4a72bb343059307d695af4db2da'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:55.028018 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2926/5891] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:33:54 2022] DELETE /identity/v3/users/32dfb4a72bb343059307d695af4db2da => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:55.029054 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d60f3b-10b2-4e77-9505-fcf1cc46abd1 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:55.030437 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b0d60f3b-10b2-4e77-9505-fcf1cc46abd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:55.072193 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ed4810-6f2b-4066-b095-8061a9525f9b tempest-UsersNegativeTest-704496811 tempest-UsersNegativeTest-704496811-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:55.123383 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d60f3b-10b2-4e77-9505-fcf1cc46abd1 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:55.129936 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cab141-a1e7-4d04-88f1-5eb8916df562 tempest-UsersNegativeTest-704496811 tempest-UsersNegativeTest-704496811-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fb19a2a05a44e00bad9b194a8c63f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18ef6ea639fd4d01a2d29fc0b826df7b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:55.130692 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cab141-a1e7-4d04-88f1-5eb8916df562 tempest-UsersNegativeTest-704496811 tempest-UsersNegativeTest-704496811-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:55.131000 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cab141-a1e7-4d04-88f1-5eb8916df562 tempest-UsersNegativeTest-704496811 tempest-UsersNegativeTest-704496811-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:55.131326 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cab141-a1e7-4d04-88f1-5eb8916df562 tempest-UsersNegativeTest-704496811 tempest-UsersNegativeTest-704496811-project-admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:55.132516 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cab141-a1e7-4d04-88f1-5eb8916df562 tempest-UsersNegativeTest-704496811 tempest-UsersNegativeTest-704496811-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:55.134736 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cab141-a1e7-4d04-88f1-5eb8916df562 tempest-UsersNegativeTest-704496811 tempest-UsersNegativeTest-704496811-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:55.145552 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf319c15-3ada-44a3-8d7c-2d6ad7e1b740 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83951651c26f4e138a05108f0fe37ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cdd622c16cd46e2b8f1476076af3f39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:55.147530 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf319c15-3ada-44a3-8d7c-2d6ad7e1b740 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:55.148630 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf319c15-3ada-44a3-8d7c-2d6ad7e1b740 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:55.149095 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf319c15-3ada-44a3-8d7c-2d6ad7e1b740 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] PATH_INFO: `/v3/users/23f49eb914a94b659effeb5ea15a2433` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:55.150721 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf319c15-3ada-44a3-8d7c-2d6ad7e1b740 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: Authorizing `identity:delete_user(user_id=23f49eb914a94b659effeb5ea15a2433)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:55.153326 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf319c15-3ada-44a3-8d7c-2d6ad7e1b740 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:55.231471 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2927/5892] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:33:55 2022] POST /identity/v3/users => generated 371 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:33:55.238062 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cab141-a1e7-4d04-88f1-5eb8916df562 tempest-UsersNegativeTest-704496811 tempest-UsersNegativeTest-704496811-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:55.253357 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cab141-a1e7-4d04-88f1-5eb8916df562 tempest-UsersNegativeTest-704496811 tempest-UsersNegativeTest-704496811-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:55.260829 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897e48cc-b25f-4b1d-998c-d0aa747aa1e1 tempest-UsersNegativeTest-704496811 tempest-UsersNegativeTest-704496811-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fb19a2a05a44e00bad9b194a8c63f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18ef6ea639fd4d01a2d29fc0b826df7b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:55.261546 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897e48cc-b25f-4b1d-998c-d0aa747aa1e1 tempest-UsersNegativeTest-704496811 tempest-UsersNegativeTest-704496811-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:55.261890 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897e48cc-b25f-4b1d-998c-d0aa747aa1e1 tempest-UsersNegativeTest-704496811 tempest-UsersNegativeTest-704496811-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:55.262883 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897e48cc-b25f-4b1d-998c-d0aa747aa1e1 tempest-UsersNegativeTest-704496811 tempest-UsersNegativeTest-704496811-project-admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:55.263900 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897e48cc-b25f-4b1d-998c-d0aa747aa1e1 tempest-UsersNegativeTest-704496811 tempest-UsersNegativeTest-704496811-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:33:55.264725 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897e48cc-b25f-4b1d-998c-d0aa747aa1e1 tempest-UsersNegativeTest-704496811 tempest-UsersNegativeTest-704496811-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:55.266963 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897e48cc-b25f-4b1d-998c-d0aa747aa1e1 tempest-UsersNegativeTest-704496811 tempest-UsersNegativeTest-704496811-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:55.310863 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2928/5893] 10.222.0.52 () {58 vars in 1156 bytes} [Sat May 14 21:33:55 2022] GET /identity/v3/users?domain_id=default => generated 8133 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:33:55.311677 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897e48cc-b25f-4b1d-998c-d0aa747aa1e1 tempest-UsersNegativeTest-704496811 tempest-UsersNegativeTest-704496811-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:55.323133 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897e48cc-b25f-4b1d-998c-d0aa747aa1e1 tempest-UsersNegativeTest-704496811 tempest-UsersNegativeTest-704496811-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:55.328140 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c100d7ba-6ce2-4de9-b54d-9ed40fb5ddb4 tempest-UsersNegativeTest-704496811 tempest-UsersNegativeTest-704496811-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fb19a2a05a44e00bad9b194a8c63f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18ef6ea639fd4d01a2d29fc0b826df7b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:55.329070 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100d7ba-6ce2-4de9-b54d-9ed40fb5ddb4 tempest-UsersNegativeTest-704496811 tempest-UsersNegativeTest-704496811-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:55.329486 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100d7ba-6ce2-4de9-b54d-9ed40fb5ddb4 tempest-UsersNegativeTest-704496811 tempest-UsersNegativeTest-704496811-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:55.329773 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100d7ba-6ce2-4de9-b54d-9ed40fb5ddb4 tempest-UsersNegativeTest-704496811 tempest-UsersNegativeTest-704496811-project-admin] PATH_INFO: `/v3/users/b6954ccc757e4623b5fa0f8cdee88567` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:55.346063 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c100d7ba-6ce2-4de9-b54d-9ed40fb5ddb4 tempest-UsersNegativeTest-704496811 tempest-UsersNegativeTest-704496811-project-admin] RBAC: Authorizing `identity:update_user(user_id=b6954ccc757e4623b5fa0f8cdee88567)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:55.347092 ncdv-master-1 devstack@keystone.service[91107]: WARNING py.warnings [None req-c100d7ba-6ce2-4de9-b54d-9ed40fb5ddb4 tempest-UsersNegativeTest-704496811 tempest-UsersNegativeTest-704496811-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 14 21:33:55.347092 ncdv-master-1 devstack@keystone.service[91107]: warnings.warn(msg) May 14 21:33:55.347092 ncdv-master-1 devstack@keystone.service[91107]: May 14 21:33:55.348464 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c100d7ba-6ce2-4de9-b54d-9ed40fb5ddb4 tempest-UsersNegativeTest-704496811 tempest-UsersNegativeTest-704496811-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:55.526549 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-bf319c15-3ada-44a3-8d7c-2d6ad7e1b740 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23f49eb914a94b659effeb5ea15a2433'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:55.535500 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-bf319c15-3ada-44a3-8d7c-2d6ad7e1b740 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23f49eb914a94b659effeb5ea15a2433'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:55.543217 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-bf319c15-3ada-44a3-8d7c-2d6ad7e1b740 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23f49eb914a94b659effeb5ea15a2433'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:55.555647 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c100d7ba-6ce2-4de9-b54d-9ed40fb5ddb4 tempest-UsersNegativeTest-704496811 tempest-UsersNegativeTest-704496811-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'b6954ccc757e4623b5fa0f8cdee88567'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:55.660325 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-bf319c15-3ada-44a3-8d7c-2d6ad7e1b740 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23f49eb914a94b659effeb5ea15a2433'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:55.661726 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-bf319c15-3ada-44a3-8d7c-2d6ad7e1b740 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23f49eb914a94b659effeb5ea15a2433'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:55.669109 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2966/5894] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:33:54 2022] DELETE /identity/v3/users/23f49eb914a94b659effeb5ea15a2433 => generated 0 bytes in 689 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:55.670285 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf319c15-3ada-44a3-8d7c-2d6ad7e1b740 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:55.671341 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-bf319c15-3ada-44a3-8d7c-2d6ad7e1b740 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:55.728637 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c100d7ba-6ce2-4de9-b54d-9ed40fb5ddb4 tempest-UsersNegativeTest-704496811 tempest-UsersNegativeTest-704496811-project-admin] Invalidating the token cache because user b6954ccc757e4623b5fa0f8cdee88567 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:33:55.729232 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c100d7ba-6ce2-4de9-b54d-9ed40fb5ddb4 tempest-UsersNegativeTest-704496811 tempest-UsersNegativeTest-704496811-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:55.729834 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c100d7ba-6ce2-4de9-b54d-9ed40fb5ddb4 tempest-UsersNegativeTest-704496811 tempest-UsersNegativeTest-704496811-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:55.735462 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2929/5895] 10.222.0.52 () {60 vars in 1243 bytes} [Sat May 14 21:33:55 2022] PATCH /identity/v3/users/b6954ccc757e4623b5fa0f8cdee88567 => generated 485 bytes in 424 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:33:55.742880 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c100d7ba-6ce2-4de9-b54d-9ed40fb5ddb4 tempest-UsersNegativeTest-704496811 tempest-UsersNegativeTest-704496811-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:55.743021 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf319c15-3ada-44a3-8d7c-2d6ad7e1b740 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:55.743166 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c100d7ba-6ce2-4de9-b54d-9ed40fb5ddb4 tempest-UsersNegativeTest-704496811 tempest-UsersNegativeTest-704496811-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:55.743270 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161a89bf-7d1d-4654-b2ec-9954f340fbec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:55.743675 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161a89bf-7d1d-4654-b2ec-9954f340fbec admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:55.743958 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161a89bf-7d1d-4654-b2ec-9954f340fbec admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:55.744232 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161a89bf-7d1d-4654-b2ec-9954f340fbec admin admin] PATH_INFO: `/v3/projects/032ba616dcc14854aeef541cdedda6df` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:55.745435 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161a89bf-7d1d-4654-b2ec-9954f340fbec admin admin] RBAC: Authorizing `identity:delete_project(project_id=032ba616dcc14854aeef541cdedda6df)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:55.747332 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161a89bf-7d1d-4654-b2ec-9954f340fbec admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:55.812428 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c100d7ba-6ce2-4de9-b54d-9ed40fb5ddb4 tempest-UsersNegativeTest-704496811 tempest-UsersNegativeTest-704496811-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:55.816905 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89702c4f-3d85-41d2-b39e-4cd52b312e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:55.817767 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89702c4f-3d85-41d2-b39e-4cd52b312e44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:55.818090 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89702c4f-3d85-41d2-b39e-4cd52b312e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:55.818370 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89702c4f-3d85-41d2-b39e-4cd52b312e44 admin admin] PATH_INFO: `/v3/projects/f176f884005f4842aadd9e5362060a4b` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:55.819586 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89702c4f-3d85-41d2-b39e-4cd52b312e44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f176f884005f4842aadd9e5362060a4b)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:55.821568 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89702c4f-3d85-41d2-b39e-4cd52b312e44 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:55.878606 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-161a89bf-7d1d-4654-b2ec-9954f340fbec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '032ba616dcc14854aeef541cdedda6df', 'request_id': 'req-161a89bf-7d1d-4654-b2ec-9954f340fbec'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:55.884990 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-161a89bf-7d1d-4654-b2ec-9954f340fbec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '032ba616dcc14854aeef541cdedda6df', 'request_id': 'req-161a89bf-7d1d-4654-b2ec-9954f340fbec'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:56.000285 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-161a89bf-7d1d-4654-b2ec-9954f340fbec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '032ba616dcc14854aeef541cdedda6df', 'request_id': 'req-161a89bf-7d1d-4654-b2ec-9954f340fbec'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:56.016615 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-161a89bf-7d1d-4654-b2ec-9954f340fbec admin admin] The token cache is being invalidate because project 032ba616dcc14854aeef541cdedda6df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:33:56.016984 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-161a89bf-7d1d-4654-b2ec-9954f340fbec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:56.019154 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-161a89bf-7d1d-4654-b2ec-9954f340fbec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:56.021102 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2967/5896] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:33:55 2022] DELETE /identity/v3/projects/032ba616dcc14854aeef541cdedda6df => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:56.024090 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-89702c4f-3d85-41d2-b39e-4cd52b312e44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f176f884005f4842aadd9e5362060a4b', 'request_id': 'req-89702c4f-3d85-41d2-b39e-4cd52b312e44'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:56.027568 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161a89bf-7d1d-4654-b2ec-9954f340fbec admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:56.029368 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-161a89bf-7d1d-4654-b2ec-9954f340fbec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:56.030196 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-89702c4f-3d85-41d2-b39e-4cd52b312e44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f176f884005f4842aadd9e5362060a4b', 'request_id': 'req-89702c4f-3d85-41d2-b39e-4cd52b312e44'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:56.038569 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-89702c4f-3d85-41d2-b39e-4cd52b312e44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f176f884005f4842aadd9e5362060a4b', 'request_id': 'req-89702c4f-3d85-41d2-b39e-4cd52b312e44'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:56.100680 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161a89bf-7d1d-4654-b2ec-9954f340fbec admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:56.125950 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-89702c4f-3d85-41d2-b39e-4cd52b312e44 admin admin] The token cache is being invalidate because project f176f884005f4842aadd9e5362060a4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:33:56.126689 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-89702c4f-3d85-41d2-b39e-4cd52b312e44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:56.127418 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-89702c4f-3d85-41d2-b39e-4cd52b312e44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:56.129503 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2930/5897] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:33:55 2022] DELETE /identity/v3/projects/f176f884005f4842aadd9e5362060a4b => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:56.131404 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7fa117-5a8c-49a3-9baf-a524ae73c118 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:56.131723 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7fa117-5a8c-49a3-9baf-a524ae73c118 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:56.132001 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7fa117-5a8c-49a3-9baf-a524ae73c118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:56.153286 ncdv-master-1 devstack@keystone.service[91107]: WARNING keystone.auth.plugins.core [None req-8f7fa117-5a8c-49a3-9baf-a524ae73c118 None None] User is disabled: b6954ccc757e4623b5fa0f8cdee88567: AssertionError: User is disabled: b6954ccc757e4623b5fa0f8cdee88567 May 14 21:33:56.172045 ncdv-master-1 devstack@keystone.service[91107]: WARNING keystone.server.flask.application [None req-8f7fa117-5a8c-49a3-9baf-a524ae73c118 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.52: keystone.exception.Unauthorized: The request you have made requires authentication. May 14 21:33:56.180262 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2931/5898] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:33:56 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 50 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) May 14 21:33:56.182645 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf99c8a-7e48-483a-a251-0121420bd26b None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:56.183214 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf99c8a-7e48-483a-a251-0121420bd26b None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:56.183803 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf99c8a-7e48-483a-a251-0121420bd26b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:56.197614 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8a190f-d98b-47c1-9f5d-0aaf3044c5bb tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83951651c26f4e138a05108f0fe37ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cdd622c16cd46e2b8f1476076af3f39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:56.198499 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a190f-d98b-47c1-9f5d-0aaf3044c5bb tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:56.198787 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a190f-d98b-47c1-9f5d-0aaf3044c5bb tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:56.202530 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a190f-d98b-47c1-9f5d-0aaf3044c5bb tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] PATH_INFO: `/v3/projects/ce0118996d614ad1961a516d275659a1` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:56.205791 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8a190f-d98b-47c1-9f5d-0aaf3044c5bb tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ce0118996d614ad1961a516d275659a1)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:56.209512 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8a190f-d98b-47c1-9f5d-0aaf3044c5bb tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:56.212628 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-adf99c8a-7e48-483a-a251-0121420bd26b None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:33:56.212995 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-adf99c8a-7e48-483a-a251-0121420bd26b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:56.292052 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2932/5899] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:33:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:33:56.293430 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3320c5e-3a96-4d0c-a2b4-d5905c8f40c9 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:56.293774 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3320c5e-3a96-4d0c-a2b4-d5905c8f40c9 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:56.294061 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3320c5e-3a96-4d0c-a2b4-d5905c8f40c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:56.316882 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-d3320c5e-3a96-4d0c-a2b4-d5905c8f40c9 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:33:56.318133 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-d3320c5e-3a96-4d0c-a2b4-d5905c8f40c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:56.325749 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-fc8a190f-d98b-47c1-9f5d-0aaf3044c5bb tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce0118996d614ad1961a516d275659a1', 'request_id': 'req-fc8a190f-d98b-47c1-9f5d-0aaf3044c5bb'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:56.331699 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-fc8a190f-d98b-47c1-9f5d-0aaf3044c5bb tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce0118996d614ad1961a516d275659a1', 'request_id': 'req-fc8a190f-d98b-47c1-9f5d-0aaf3044c5bb'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:56.378606 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2933/5900] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:33:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:33:56.379585 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3320c5e-3a96-4d0c-a2b4-d5905c8f40c9 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:56.380908 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-d3320c5e-3a96-4d0c-a2b4-d5905c8f40c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:56.449130 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3320c5e-3a96-4d0c-a2b4-d5905c8f40c9 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:56.454369 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b75c1e-5529-4244-aa37-21294857d4d0 tempest-UsersNegativeTest-704496811 tempest-UsersNegativeTest-704496811-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fb19a2a05a44e00bad9b194a8c63f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18ef6ea639fd4d01a2d29fc0b826df7b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:56.455252 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b75c1e-5529-4244-aa37-21294857d4d0 tempest-UsersNegativeTest-704496811 tempest-UsersNegativeTest-704496811-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:56.455621 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b75c1e-5529-4244-aa37-21294857d4d0 tempest-UsersNegativeTest-704496811 tempest-UsersNegativeTest-704496811-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:56.455983 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b75c1e-5529-4244-aa37-21294857d4d0 tempest-UsersNegativeTest-704496811 tempest-UsersNegativeTest-704496811-project-admin] PATH_INFO: `/v3/users/b6954ccc757e4623b5fa0f8cdee88567` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:56.458230 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-fc8a190f-d98b-47c1-9f5d-0aaf3044c5bb tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce0118996d614ad1961a516d275659a1', 'request_id': 'req-fc8a190f-d98b-47c1-9f5d-0aaf3044c5bb'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:56.479250 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-fc8a190f-d98b-47c1-9f5d-0aaf3044c5bb tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] The token cache is being invalidate because project ce0118996d614ad1961a516d275659a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:33:56.479712 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-fc8a190f-d98b-47c1-9f5d-0aaf3044c5bb tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:56.480604 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-fc8a190f-d98b-47c1-9f5d-0aaf3044c5bb tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:56.483806 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2968/5901] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:33:56 2022] DELETE /identity/v3/projects/ce0118996d614ad1961a516d275659a1 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:56.485299 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9e3b4-2ff2-4fde-9d46-77a4b1713b97 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:56.485682 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9e3b4-2ff2-4fde-9d46-77a4b1713b97 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:56.486053 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9e3b4-2ff2-4fde-9d46-77a4b1713b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:56.494264 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b75c1e-5529-4244-aa37-21294857d4d0 tempest-UsersNegativeTest-704496811 tempest-UsersNegativeTest-704496811-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b6954ccc757e4623b5fa0f8cdee88567)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:56.504140 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b75c1e-5529-4244-aa37-21294857d4d0 tempest-UsersNegativeTest-704496811 tempest-UsersNegativeTest-704496811-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:56.515617 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-f5a9e3b4-2ff2-4fde-9d46-77a4b1713b97 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:33:56.517377 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-f5a9e3b4-2ff2-4fde-9d46-77a4b1713b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:56.529541 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2969/5902] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:33:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:33:56.533398 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d278f2-b628-4b52-9d57-61cb431ddc06 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:56.533994 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d278f2-b628-4b52-9d57-61cb431ddc06 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:56.534452 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d278f2-b628-4b52-9d57-61cb431ddc06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:56.560933 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-82d278f2-b628-4b52-9d57-61cb431ddc06 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:33:56.560933 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-82d278f2-b628-4b52-9d57-61cb431ddc06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:56.566533 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2970/5903] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:33:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:33:56.567389 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d278f2-b628-4b52-9d57-61cb431ddc06 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:56.568933 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-82d278f2-b628-4b52-9d57-61cb431ddc06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:56.635791 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d278f2-b628-4b52-9d57-61cb431ddc06 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:56.640763 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1f7d68-3232-4275-be06-b3796d73bc49 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83951651c26f4e138a05108f0fe37ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cdd622c16cd46e2b8f1476076af3f39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:56.641713 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f7d68-3232-4275-be06-b3796d73bc49 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:56.641899 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f7d68-3232-4275-be06-b3796d73bc49 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:56.642442 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f7d68-3232-4275-be06-b3796d73bc49 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] PATH_INFO: `/v3/users/9a77e5790314487bb0f11099e0ae5953` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:56.643743 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1f7d68-3232-4275-be06-b3796d73bc49 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: Authorizing `identity:update_user(user_id=9a77e5790314487bb0f11099e0ae5953)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:56.644762 ncdv-master-1 devstack@keystone.service[91106]: WARNING py.warnings [None req-2b1f7d68-3232-4275-be06-b3796d73bc49 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 14 21:33:56.644762 ncdv-master-1 devstack@keystone.service[91106]: warnings.warn(msg) May 14 21:33:56.644762 ncdv-master-1 devstack@keystone.service[91106]: May 14 21:33:56.648439 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1f7d68-3232-4275-be06-b3796d73bc49 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:56.669089 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-15b75c1e-5529-4244-aa37-21294857d4d0 tempest-UsersNegativeTest-704496811 tempest-UsersNegativeTest-704496811-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6954ccc757e4623b5fa0f8cdee88567'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:56.676510 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-15b75c1e-5529-4244-aa37-21294857d4d0 tempest-UsersNegativeTest-704496811 tempest-UsersNegativeTest-704496811-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6954ccc757e4623b5fa0f8cdee88567'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:56.677271 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-15b75c1e-5529-4244-aa37-21294857d4d0 tempest-UsersNegativeTest-704496811 tempest-UsersNegativeTest-704496811-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6954ccc757e4623b5fa0f8cdee88567'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:56.759455 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2b1f7d68-3232-4275-be06-b3796d73bc49 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '9a77e5790314487bb0f11099e0ae5953'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:56.789609 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-15b75c1e-5529-4244-aa37-21294857d4d0 tempest-UsersNegativeTest-704496811 tempest-UsersNegativeTest-704496811-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6954ccc757e4623b5fa0f8cdee88567'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:56.803050 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-15b75c1e-5529-4244-aa37-21294857d4d0 tempest-UsersNegativeTest-704496811 tempest-UsersNegativeTest-704496811-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6954ccc757e4623b5fa0f8cdee88567'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:56.812411 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2934/5904] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:33:56 2022] DELETE /identity/v3/users/b6954ccc757e4623b5fa0f8cdee88567 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:56.812654 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b75c1e-5529-4244-aa37-21294857d4d0 tempest-UsersNegativeTest-704496811 tempest-UsersNegativeTest-704496811-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:56.814639 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-15b75c1e-5529-4244-aa37-21294857d4d0 tempest-UsersNegativeTest-704496811 tempest-UsersNegativeTest-704496811-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:56.863416 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2b1f7d68-3232-4275-be06-b3796d73bc49 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Invalidating the token cache because user 9a77e5790314487bb0f11099e0ae5953 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:33:56.863752 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2b1f7d68-3232-4275-be06-b3796d73bc49 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:56.864388 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2b1f7d68-3232-4275-be06-b3796d73bc49 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:56.866925 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2971/5905] 10.222.0.52 () {60 vars in 1242 bytes} [Sat May 14 21:33:56 2022] PATCH /identity/v3/users/9a77e5790314487bb0f11099e0ae5953 => generated 296 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:33:56.871674 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1f7d68-3232-4275-be06-b3796d73bc49 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:56.871674 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-2b1f7d68-3232-4275-be06-b3796d73bc49 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:56.885350 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1f7d68-3232-4275-be06-b3796d73bc49 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:56.885941 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b75c1e-5529-4244-aa37-21294857d4d0 tempest-UsersNegativeTest-704496811 tempest-UsersNegativeTest-704496811-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:56.890240 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ba6dbe-cb5e-4508-8ec1-9f7877ed05f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:56.890705 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eec56c4-9dd0-4eda-9cc9-927cde8d1877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:56.891008 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba6dbe-cb5e-4508-8ec1-9f7877ed05f8 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:56.891300 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba6dbe-cb5e-4508-8ec1-9f7877ed05f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:56.891420 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec56c4-9dd0-4eda-9cc9-927cde8d1877 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:56.891642 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba6dbe-cb5e-4508-8ec1-9f7877ed05f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:56.891761 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec56c4-9dd0-4eda-9cc9-927cde8d1877 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:56.891948 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec56c4-9dd0-4eda-9cc9-927cde8d1877 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:56.892670 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ba6dbe-cb5e-4508-8ec1-9f7877ed05f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:33:56.892939 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eec56c4-9dd0-4eda-9cc9-927cde8d1877 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:33:56.893511 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ba6dbe-cb5e-4508-8ec1-9f7877ed05f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:56.893639 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eec56c4-9dd0-4eda-9cc9-927cde8d1877 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:56.895000 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eec56c4-9dd0-4eda-9cc9-927cde8d1877 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:56.895270 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ba6dbe-cb5e-4508-8ec1-9f7877ed05f8 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:56.908434 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2935/5906] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:33:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:33:56.908630 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2972/5907] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:33:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:33:56.914020 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eec56c4-9dd0-4eda-9cc9-927cde8d1877 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:56.914141 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f80a49-639a-48d0-8ff9-4e816445de0a None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:56.914141 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f80a49-639a-48d0-8ff9-4e816445de0a None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:56.914298 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-7eec56c4-9dd0-4eda-9cc9-927cde8d1877 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:56.914380 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f80a49-639a-48d0-8ff9-4e816445de0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:56.956337 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-50f80a49-639a-48d0-8ff9-4e816445de0a None None] MFA Rules not processed for user `9a77e5790314487bb0f11099e0ae5953`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:33:56.957674 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-50f80a49-639a-48d0-8ff9-4e816445de0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:56.964166 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2973/5908] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:33:56 2022] POST /identity/v3/auth/tokens => generated 348 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 21:33:56.964166 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f80a49-639a-48d0-8ff9-4e816445de0a None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:56.974339 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f80a49-639a-48d0-8ff9-4e816445de0a None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:56.981298 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c703ba7c-3b42-4c5f-9c1c-7ff55cc7dd7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:56.982366 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703ba7c-3b42-4c5f-9c1c-7ff55cc7dd7e admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:56.983056 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703ba7c-3b42-4c5f-9c1c-7ff55cc7dd7e admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:56.983338 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703ba7c-3b42-4c5f-9c1c-7ff55cc7dd7e admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:56.984092 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c703ba7c-3b42-4c5f-9c1c-7ff55cc7dd7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:56.986146 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c703ba7c-3b42-4c5f-9c1c-7ff55cc7dd7e admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:56.988059 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eec56c4-9dd0-4eda-9cc9-927cde8d1877 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:56.994333 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179a822f-6652-4bcd-9092-12b7eef61eb7 tempest-UsersNegativeTest-704496811 tempest-UsersNegativeTest-704496811-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fb19a2a05a44e00bad9b194a8c63f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18ef6ea639fd4d01a2d29fc0b826df7b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:56.995425 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a822f-6652-4bcd-9092-12b7eef61eb7 tempest-UsersNegativeTest-704496811 tempest-UsersNegativeTest-704496811-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:56.995931 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a822f-6652-4bcd-9092-12b7eef61eb7 tempest-UsersNegativeTest-704496811 tempest-UsersNegativeTest-704496811-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:56.996359 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a822f-6652-4bcd-9092-12b7eef61eb7 tempest-UsersNegativeTest-704496811 tempest-UsersNegativeTest-704496811-project-admin] PATH_INFO: `/v3/projects/297dc6876eec4dc794b1759128131a6c` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:56.997753 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179a822f-6652-4bcd-9092-12b7eef61eb7 tempest-UsersNegativeTest-704496811 tempest-UsersNegativeTest-704496811-project-admin] RBAC: Authorizing `identity:delete_project(project_id=297dc6876eec4dc794b1759128131a6c)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:57.000188 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179a822f-6652-4bcd-9092-12b7eef61eb7 tempest-UsersNegativeTest-704496811 tempest-UsersNegativeTest-704496811-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:57.105738 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2974/5909] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:33:56 2022] POST /identity/v3/projects => generated 385 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:33:57.110040 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c703ba7c-3b42-4c5f-9c1c-7ff55cc7dd7e admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:57.111717 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c703ba7c-3b42-4c5f-9c1c-7ff55cc7dd7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:57.143187 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-179a822f-6652-4bcd-9092-12b7eef61eb7 tempest-UsersNegativeTest-704496811 tempest-UsersNegativeTest-704496811-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '297dc6876eec4dc794b1759128131a6c', 'request_id': 'req-179a822f-6652-4bcd-9092-12b7eef61eb7'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:57.150683 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-179a822f-6652-4bcd-9092-12b7eef61eb7 tempest-UsersNegativeTest-704496811 tempest-UsersNegativeTest-704496811-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '297dc6876eec4dc794b1759128131a6c', 'request_id': 'req-179a822f-6652-4bcd-9092-12b7eef61eb7'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:57.159405 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-179a822f-6652-4bcd-9092-12b7eef61eb7 tempest-UsersNegativeTest-704496811 tempest-UsersNegativeTest-704496811-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '297dc6876eec4dc794b1759128131a6c', 'request_id': 'req-179a822f-6652-4bcd-9092-12b7eef61eb7'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:57.190315 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c703ba7c-3b42-4c5f-9c1c-7ff55cc7dd7e admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:57.242303 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-179a822f-6652-4bcd-9092-12b7eef61eb7 tempest-UsersNegativeTest-704496811 tempest-UsersNegativeTest-704496811-project-admin] The token cache is being invalidate because project 297dc6876eec4dc794b1759128131a6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:33:57.243025 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-179a822f-6652-4bcd-9092-12b7eef61eb7 tempest-UsersNegativeTest-704496811 tempest-UsersNegativeTest-704496811-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:57.243731 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-179a822f-6652-4bcd-9092-12b7eef61eb7 tempest-UsersNegativeTest-704496811 tempest-UsersNegativeTest-704496811-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:57.245876 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2936/5910] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:33:56 2022] DELETE /identity/v3/projects/297dc6876eec4dc794b1759128131a6c => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:57.247352 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179a822f-6652-4bcd-9092-12b7eef61eb7 tempest-UsersNegativeTest-704496811 tempest-UsersNegativeTest-704496811-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:57.250975 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-179a822f-6652-4bcd-9092-12b7eef61eb7 tempest-UsersNegativeTest-704496811 tempest-UsersNegativeTest-704496811-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:57.263432 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea45a1aa-f896-4a7d-a960-caa4e38f226a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:57.264131 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45a1aa-f896-4a7d-a960-caa4e38f226a admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:57.264412 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45a1aa-f896-4a7d-a960-caa4e38f226a admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:57.264688 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45a1aa-f896-4a7d-a960-caa4e38f226a admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:57.265372 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea45a1aa-f896-4a7d-a960-caa4e38f226a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:57.267687 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea45a1aa-f896-4a7d-a960-caa4e38f226a admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:57.323008 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179a822f-6652-4bcd-9092-12b7eef61eb7 tempest-UsersNegativeTest-704496811 tempest-UsersNegativeTest-704496811-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:57.328050 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c17ab0-bb46-446e-a7a4-49aca2290c91 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83951651c26f4e138a05108f0fe37ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cdd622c16cd46e2b8f1476076af3f39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:57.328914 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c17ab0-bb46-446e-a7a4-49aca2290c91 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:57.329214 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c17ab0-bb46-446e-a7a4-49aca2290c91 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:57.329471 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c17ab0-bb46-446e-a7a4-49aca2290c91 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] PATH_INFO: `/v3/users/9a77e5790314487bb0f11099e0ae5953` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:57.330714 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c17ab0-bb46-446e-a7a4-49aca2290c91 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: Authorizing `identity:update_user(user_id=9a77e5790314487bb0f11099e0ae5953)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:57.332900 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c17ab0-bb46-446e-a7a4-49aca2290c91 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:57.385188 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2975/5911] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:33:57 2022] POST /identity/v3/projects => generated 365 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:33:57.385935 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea45a1aa-f896-4a7d-a960-caa4e38f226a admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:57.387727 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ea45a1aa-f896-4a7d-a960-caa4e38f226a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:57.450689 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea45a1aa-f896-4a7d-a960-caa4e38f226a admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:57.455050 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-87c17ab0-bb46-446e-a7a4-49aca2290c91 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '9a77e5790314487bb0f11099e0ae5953'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:57.455679 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccfab89-6053-425b-990a-0f1d010c166a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:57.456427 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccfab89-6053-425b-990a-0f1d010c166a admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:57.456781 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccfab89-6053-425b-990a-0f1d010c166a admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:57.457138 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccfab89-6053-425b-990a-0f1d010c166a admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:57.457928 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccfab89-6053-425b-990a-0f1d010c166a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:57.459997 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccfab89-6053-425b-990a-0f1d010c166a admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:57.538003 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-87c17ab0-bb46-446e-a7a4-49aca2290c91 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Invalidating the token cache because user 9a77e5790314487bb0f11099e0ae5953 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:33:57.538447 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-87c17ab0-bb46-446e-a7a4-49aca2290c91 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:57.539208 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-87c17ab0-bb46-446e-a7a4-49aca2290c91 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:57.541409 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2937/5912] 10.222.0.52 () {60 vars in 1242 bytes} [Sat May 14 21:33:57 2022] PATCH /identity/v3/users/9a77e5790314487bb0f11099e0ae5953 => generated 296 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:33:57.542264 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c17ab0-bb46-446e-a7a4-49aca2290c91 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:57.543628 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-87c17ab0-bb46-446e-a7a4-49aca2290c91 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:57.557816 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c17ab0-bb46-446e-a7a4-49aca2290c91 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:57.562493 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2976/5913] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:33:57 2022] POST /identity/v3/users => generated 293 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:33:57.567310 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9bac00-4f73-4f6a-895c-4739fa8f8c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:57.567466 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccfab89-6053-425b-990a-0f1d010c166a admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:57.567705 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9bac00-4f73-4f6a-895c-4739fa8f8c6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:57.567705 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9bac00-4f73-4f6a-895c-4739fa8f8c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:57.567705 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9bac00-4f73-4f6a-895c-4739fa8f8c6f admin admin] PATH_INFO: `/v3/users/330bae366647464baf7e58662b9b2fb1` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:57.567954 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-6ccfab89-6053-425b-990a-0f1d010c166a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:57.568043 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9bac00-4f73-4f6a-895c-4739fa8f8c6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=330bae366647464baf7e58662b9b2fb1)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:57.570013 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9bac00-4f73-4f6a-895c-4739fa8f8c6f admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:57.630873 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccfab89-6053-425b-990a-0f1d010c166a admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:57.636365 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176313f9-c9c3-491e-82dd-61fa17747e57 tempest-UsersNegativeTest-704496811 tempest-UsersNegativeTest-704496811-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fb19a2a05a44e00bad9b194a8c63f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18ef6ea639fd4d01a2d29fc0b826df7b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:57.636990 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176313f9-c9c3-491e-82dd-61fa17747e57 tempest-UsersNegativeTest-704496811 tempest-UsersNegativeTest-704496811-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:57.637261 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176313f9-c9c3-491e-82dd-61fa17747e57 tempest-UsersNegativeTest-704496811 tempest-UsersNegativeTest-704496811-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:57.637541 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176313f9-c9c3-491e-82dd-61fa17747e57 tempest-UsersNegativeTest-704496811 tempest-UsersNegativeTest-704496811-project-admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:57.638230 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176313f9-c9c3-491e-82dd-61fa17747e57 tempest-UsersNegativeTest-704496811 tempest-UsersNegativeTest-704496811-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:57.640264 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176313f9-c9c3-491e-82dd-61fa17747e57 tempest-UsersNegativeTest-704496811 tempest-UsersNegativeTest-704496811-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:57.653559 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-176313f9-c9c3-491e-82dd-61fa17747e57 tempest-UsersNegativeTest-704496811 tempest-UsersNegativeTest-704496811-project-admin] Could not find domain: 8fa1924ef69f4026b33b35521c94ab96.: keystone.exception.DomainNotFound: Could not find domain: 8fa1924ef69f4026b33b35521c94ab96. May 14 21:33:57.653559 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:33:57.653559 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 14 21:33:57.653559 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 14 21:33:57.653559 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 21:33:57.653559 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 21:33:57.653559 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 21:33:57.653559 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 21:33:57.653559 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 8fa1924ef69f4026b33b35521c94ab96. May 14 21:33:57.653559 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:33:57.653559 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 21:33:57.653559 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:33:57.653559 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:33:57.653559 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 21:33:57.653559 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 21:33:57.653559 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 21:33:57.654656 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 21:33:57.654656 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 21:33:57.654656 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 21:33:57.654656 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 21:33:57.654656 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 21:33:57.654656 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 21:33:57.654656 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 21:33:57.654656 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 14 21:33:57.654656 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 14 21:33:57.654656 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 21:33:57.654656 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 21:33:57.654656 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 21:33:57.654656 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 21:33:57.654656 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 14 21:33:57.654656 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 21:33:57.654656 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 987, in create_user May 14 21:33:57.654656 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_domain(domain_id) May 14 21:33:57.656390 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 21:33:57.656390 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 21:33:57.656390 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 21:33:57.656390 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 21:33:57.656390 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 21:33:57.656390 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 21:33:57.656390 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 21:33:57.656390 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 21:33:57.656390 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 21:33:57.656390 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 21:33:57.656390 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 21:33:57.656390 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 21:33:57.656390 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 21:33:57.656390 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 21:33:57.656390 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 21:33:57.656390 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 21:33:57.656390 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 14 21:33:57.657438 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 21:33:57.657438 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 8fa1924ef69f4026b33b35521c94ab96. May 14 21:33:57.657438 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:33:57.657438 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2977/5914] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:33:57 2022] POST /identity/v3/users => generated 112 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 14 21:33:57.657438 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176313f9-c9c3-491e-82dd-61fa17747e57 tempest-UsersNegativeTest-704496811 tempest-UsersNegativeTest-704496811-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:57.659453 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-176313f9-c9c3-491e-82dd-61fa17747e57 tempest-UsersNegativeTest-704496811 tempest-UsersNegativeTest-704496811-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:57.673881 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176313f9-c9c3-491e-82dd-61fa17747e57 tempest-UsersNegativeTest-704496811 tempest-UsersNegativeTest-704496811-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:57.678517 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f96d9d-7a09-44dc-b8f4-aa3bd795a14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:57.679161 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f96d9d-7a09-44dc-b8f4-aa3bd795a14f admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:57.679448 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f96d9d-7a09-44dc-b8f4-aa3bd795a14f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:57.679755 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f96d9d-7a09-44dc-b8f4-aa3bd795a14f admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:57.680430 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f96d9d-7a09-44dc-b8f4-aa3bd795a14f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:57.682621 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f96d9d-7a09-44dc-b8f4-aa3bd795a14f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:57.760560 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4f9bac00-4f73-4f6a-895c-4739fa8f8c6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '330bae366647464baf7e58662b9b2fb1'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:57.767689 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4f9bac00-4f73-4f6a-895c-4739fa8f8c6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '330bae366647464baf7e58662b9b2fb1'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:57.768393 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4f9bac00-4f73-4f6a-895c-4739fa8f8c6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '330bae366647464baf7e58662b9b2fb1'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:57.776079 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2978/5915] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:33:57 2022] POST /identity/v3/users => generated 283 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:33:57.777111 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f96d9d-7a09-44dc-b8f4-aa3bd795a14f admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:57.779411 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c1f96d9d-7a09-44dc-b8f4-aa3bd795a14f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:57.852268 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f96d9d-7a09-44dc-b8f4-aa3bd795a14f admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:57.856982 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a262e045-62c3-42ce-9956-824677fefb9f tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83951651c26f4e138a05108f0fe37ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cdd622c16cd46e2b8f1476076af3f39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:57.857847 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262e045-62c3-42ce-9956-824677fefb9f tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:57.858129 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262e045-62c3-42ce-9956-824677fefb9f tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:57.858401 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262e045-62c3-42ce-9956-824677fefb9f tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] PATH_INFO: `/v3/users/9a77e5790314487bb0f11099e0ae5953` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:57.860434 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4f9bac00-4f73-4f6a-895c-4739fa8f8c6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '330bae366647464baf7e58662b9b2fb1'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:57.874979 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4f9bac00-4f73-4f6a-895c-4739fa8f8c6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '330bae366647464baf7e58662b9b2fb1'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:57.875176 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a262e045-62c3-42ce-9956-824677fefb9f tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: Authorizing `identity:update_user(user_id=9a77e5790314487bb0f11099e0ae5953)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:57.877233 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a262e045-62c3-42ce-9956-824677fefb9f tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:57.881098 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2938/5916] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:33:57 2022] DELETE /identity/v3/users/330bae366647464baf7e58662b9b2fb1 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:57.881854 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9bac00-4f73-4f6a-895c-4739fa8f8c6f admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:57.883303 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-4f9bac00-4f73-4f6a-895c-4739fa8f8c6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:57.947953 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9bac00-4f73-4f6a-895c-4739fa8f8c6f admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:57.952666 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87fd8f1-0d31-49cf-a390-4c3789665921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:57.953329 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87fd8f1-0d31-49cf-a390-4c3789665921 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:57.953616 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87fd8f1-0d31-49cf-a390-4c3789665921 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:57.953893 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87fd8f1-0d31-49cf-a390-4c3789665921 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:57.954607 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87fd8f1-0d31-49cf-a390-4c3789665921 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:57.956361 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87fd8f1-0d31-49cf-a390-4c3789665921 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:57.966780 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2939/5917] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:33:57 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:33:57.967807 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87fd8f1-0d31-49cf-a390-4c3789665921 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:57.969406 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-d87fd8f1-0d31-49cf-a390-4c3789665921 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:57.982809 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87fd8f1-0d31-49cf-a390-4c3789665921 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:57.983007 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a262e045-62c3-42ce-9956-824677fefb9f tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '9a77e5790314487bb0f11099e0ae5953'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:57.987520 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1943d4-de0b-43cb-8726-39cbab65125a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:57.992606 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1943d4-de0b-43cb-8726-39cbab65125a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:57.992606 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1943d4-de0b-43cb-8726-39cbab65125a admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:57.992606 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1943d4-de0b-43cb-8726-39cbab65125a admin admin] PATH_INFO: `/v3/users/ba2480afbdd040a08fffa3dc2b0479d3` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:57.992606 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1943d4-de0b-43cb-8726-39cbab65125a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba2480afbdd040a08fffa3dc2b0479d3)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:57.992606 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1943d4-de0b-43cb-8726-39cbab65125a admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:58.041319 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a262e045-62c3-42ce-9956-824677fefb9f tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Invalidating the token cache because user 9a77e5790314487bb0f11099e0ae5953 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:33:58.041618 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a262e045-62c3-42ce-9956-824677fefb9f tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:58.042253 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a262e045-62c3-42ce-9956-824677fefb9f tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:58.044251 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2979/5918] 10.222.0.52 () {60 vars in 1242 bytes} [Sat May 14 21:33:57 2022] PATCH /identity/v3/users/9a77e5790314487bb0f11099e0ae5953 => generated 296 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:33:58.048955 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a262e045-62c3-42ce-9956-824677fefb9f tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:58.048955 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-a262e045-62c3-42ce-9956-824677fefb9f tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:58.059844 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a262e045-62c3-42ce-9956-824677fefb9f tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:58.064481 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c1885-d3f9-4c20-9557-92694f491e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:58.065120 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c1885-d3f9-4c20-9557-92694f491e63 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:58.065401 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c1885-d3f9-4c20-9557-92694f491e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:58.065673 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c1885-d3f9-4c20-9557-92694f491e63 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:58.066377 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6c1885-d3f9-4c20-9557-92694f491e63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:58.068043 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6c1885-d3f9-4c20-9557-92694f491e63 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:58.081247 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2980/5919] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:33:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:33:58.081247 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce1e32-5679-4ca2-a4db-9354dfc78107 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:58.081247 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce1e32-5679-4ca2-a4db-9354dfc78107 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:58.081247 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce1e32-5679-4ca2-a4db-9354dfc78107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:58.098335 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-5fce1e32-5679-4ca2-a4db-9354dfc78107 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:33:58.099573 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-5fce1e32-5679-4ca2-a4db-9354dfc78107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:58.108307 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2981/5920] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:33:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:33:58.109216 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fce1e32-5679-4ca2-a4db-9354dfc78107 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:58.110457 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-5fce1e32-5679-4ca2-a4db-9354dfc78107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:58.122271 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fce1e32-5679-4ca2-a4db-9354dfc78107 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:58.126900 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e363c308-2b8b-47e3-ae98-f54bcbebe9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:58.127573 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e363c308-2b8b-47e3-ae98-f54bcbebe9f1 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:58.127859 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e363c308-2b8b-47e3-ae98-f54bcbebe9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:58.128136 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e363c308-2b8b-47e3-ae98-f54bcbebe9f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:58.128841 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e363c308-2b8b-47e3-ae98-f54bcbebe9f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:58.130455 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e363c308-2b8b-47e3-ae98-f54bcbebe9f1 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:58.140281 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2982/5921] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:33:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:33:58.141440 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d0425-7c27-43ec-8fe0-399bbd830205 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:58.141729 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d0425-7c27-43ec-8fe0-399bbd830205 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:58.142003 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d0425-7c27-43ec-8fe0-399bbd830205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:58.172100 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-fd1d0425-7c27-43ec-8fe0-399bbd830205 None None] MFA Rules not processed for user `9a77e5790314487bb0f11099e0ae5953`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:33:58.173283 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-fd1d0425-7c27-43ec-8fe0-399bbd830205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:58.176652 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2983/5922] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:33:58 2022] POST /identity/v3/auth/tokens => generated 348 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 21:33:58.177480 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1d0425-7c27-43ec-8fe0-399bbd830205 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:58.189094 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1d0425-7c27-43ec-8fe0-399bbd830205 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:58.194532 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b31d1bf-095b-49b7-9f6d-f1568400e65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:58.195195 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b31d1bf-095b-49b7-9f6d-f1568400e65f admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:58.195875 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b31d1bf-095b-49b7-9f6d-f1568400e65f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:58.196750 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b31d1bf-095b-49b7-9f6d-f1568400e65f admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:58.198264 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b31d1bf-095b-49b7-9f6d-f1568400e65f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:58.200090 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b31d1bf-095b-49b7-9f6d-f1568400e65f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:58.207332 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7d1943d4-de0b-43cb-8726-39cbab65125a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba2480afbdd040a08fffa3dc2b0479d3'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:58.210691 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2984/5923] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:33:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:33:58.211626 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b31d1bf-095b-49b7-9f6d-f1568400e65f admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:58.216593 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-7b31d1bf-095b-49b7-9f6d-f1568400e65f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:58.216713 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7d1943d4-de0b-43cb-8726-39cbab65125a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba2480afbdd040a08fffa3dc2b0479d3'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:58.216713 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7d1943d4-de0b-43cb-8726-39cbab65125a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba2480afbdd040a08fffa3dc2b0479d3'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:58.272042 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b31d1bf-095b-49b7-9f6d-f1568400e65f admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:58.276350 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e2f248-56db-4a48-b299-0b75e86436c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:58.276980 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e2f248-56db-4a48-b299-0b75e86436c0 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:58.277260 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e2f248-56db-4a48-b299-0b75e86436c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:58.277533 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e2f248-56db-4a48-b299-0b75e86436c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:58.286876 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e2f248-56db-4a48-b299-0b75e86436c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:58.288403 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e2f248-56db-4a48-b299-0b75e86436c0 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:58.298551 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2985/5924] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:33:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:33:58.299510 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e2f248-56db-4a48-b299-0b75e86436c0 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:58.305303 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7d1943d4-de0b-43cb-8726-39cbab65125a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba2480afbdd040a08fffa3dc2b0479d3'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:58.320239 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e2f248-56db-4a48-b299-0b75e86436c0 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:58.326543 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7d1943d4-de0b-43cb-8726-39cbab65125a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba2480afbdd040a08fffa3dc2b0479d3'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:58.328409 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8272002-fc00-4ab7-b3e6-ac1c6d061b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:58.330240 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8272002-fc00-4ab7-b3e6-ac1c6d061b84 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:58.330958 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8272002-fc00-4ab7-b3e6-ac1c6d061b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:58.331411 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8272002-fc00-4ab7-b3e6-ac1c6d061b84 admin admin] PATH_INFO: `/v3/projects/81c202907c9c412ea6dc5f2aa0f008e1/users/143f617549794cc8989a200546acb66f/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:58.333600 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2940/5925] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:33:57 2022] DELETE /identity/v3/users/ba2480afbdd040a08fffa3dc2b0479d3 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:58.334421 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1943d4-de0b-43cb-8726-39cbab65125a admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:58.337512 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-7d1943d4-de0b-43cb-8726-39cbab65125a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:58.352185 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8272002-fc00-4ab7-b3e6-ac1c6d061b84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81c202907c9c412ea6dc5f2aa0f008e1, user_id=143f617549794cc8989a200546acb66f, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:58.355223 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8272002-fc00-4ab7-b3e6-ac1c6d061b84 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:58.421561 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1943d4-de0b-43cb-8726-39cbab65125a admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:58.426655 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4366f7d4-881e-4135-831d-c739c71c7396 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83951651c26f4e138a05108f0fe37ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cdd622c16cd46e2b8f1476076af3f39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:58.428166 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4366f7d4-881e-4135-831d-c739c71c7396 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:58.428166 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4366f7d4-881e-4135-831d-c739c71c7396 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:58.428537 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4366f7d4-881e-4135-831d-c739c71c7396 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] PATH_INFO: `/v3/users/9a77e5790314487bb0f11099e0ae5953` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:58.429977 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4366f7d4-881e-4135-831d-c739c71c7396 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: Authorizing `identity:update_user(user_id=9a77e5790314487bb0f11099e0ae5953)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:58.432400 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4366f7d4-881e-4135-831d-c739c71c7396 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:58.440171 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2986/5926] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:33:58 2022] PUT /identity/v3/projects/81c202907c9c412ea6dc5f2aa0f008e1/users/143f617549794cc8989a200546acb66f/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:58.441368 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8272002-fc00-4ab7-b3e6-ac1c6d061b84 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:58.444451 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e8272002-fc00-4ab7-b3e6-ac1c6d061b84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:58.528806 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8272002-fc00-4ab7-b3e6-ac1c6d061b84 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:58.533474 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee682e5-4dad-489e-b46e-b3b536bf0f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:58.534356 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee682e5-4dad-489e-b46e-b3b536bf0f8a admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:58.534637 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee682e5-4dad-489e-b46e-b3b536bf0f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:58.534914 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee682e5-4dad-489e-b46e-b3b536bf0f8a admin admin] PATH_INFO: `/v3/projects/88c8745ee478438bb57cc3b7ffe73fc8/users/2316af2f472948a2bba9cd59951f37a5/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:58.546342 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4366f7d4-881e-4135-831d-c739c71c7396 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '9a77e5790314487bb0f11099e0ae5953'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:58.550271 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee682e5-4dad-489e-b46e-b3b536bf0f8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=88c8745ee478438bb57cc3b7ffe73fc8, user_id=2316af2f472948a2bba9cd59951f37a5, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:58.552969 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee682e5-4dad-489e-b46e-b3b536bf0f8a admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:58.642625 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4366f7d4-881e-4135-831d-c739c71c7396 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Invalidating the token cache because user 9a77e5790314487bb0f11099e0ae5953 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:33:58.643080 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4366f7d4-881e-4135-831d-c739c71c7396 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:58.644098 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4366f7d4-881e-4135-831d-c739c71c7396 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:58.647131 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2941/5927] 10.222.0.52 () {60 vars in 1242 bytes} [Sat May 14 21:33:58 2022] PATCH /identity/v3/users/9a77e5790314487bb0f11099e0ae5953 => generated 296 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:33:58.650779 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ce93d-09f9-44e2-a4dd-8afe9a420f9e None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:58.650779 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ce93d-09f9-44e2-a4dd-8afe9a420f9e None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:58.650779 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ce93d-09f9-44e2-a4dd-8afe9a420f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:58.652561 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2987/5928] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:33:58 2022] PUT /identity/v3/projects/88c8745ee478438bb57cc3b7ffe73fc8/users/2316af2f472948a2bba9cd59951f37a5/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:58.662598 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6874daa-4f0f-4169-a33b-f343b2591751 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:58.662888 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6874daa-4f0f-4169-a33b-f343b2591751 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:58.663166 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6874daa-4f0f-4169-a33b-f343b2591751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:58.671394 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-d36ce93d-09f9-44e2-a4dd-8afe9a420f9e None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:33:58.673114 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-d36ce93d-09f9-44e2-a4dd-8afe9a420f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:58.697687 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-d6874daa-4f0f-4169-a33b-f343b2591751 None None] MFA Rules not processed for user `143f617549794cc8989a200546acb66f`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:33:58.698801 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d6874daa-4f0f-4169-a33b-f343b2591751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:58.735039 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2942/5929] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:33:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:33:58.736436 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36ce93d-09f9-44e2-a4dd-8afe9a420f9e None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:58.737915 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-d36ce93d-09f9-44e2-a4dd-8afe9a420f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:58.752610 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36ce93d-09f9-44e2-a4dd-8afe9a420f9e None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:58.757416 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed18fd4-3197-4268-ba5c-cabf6bbc81d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:58.758284 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed18fd4-3197-4268-ba5c-cabf6bbc81d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:58.758576 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed18fd4-3197-4268-ba5c-cabf6bbc81d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:58.758895 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed18fd4-3197-4268-ba5c-cabf6bbc81d9 admin admin] PATH_INFO: `/v3/projects/82badb8800bb4096858c945e023ba597` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:58.760111 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed18fd4-3197-4268-ba5c-cabf6bbc81d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82badb8800bb4096858c945e023ba597)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:58.762036 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed18fd4-3197-4268-ba5c-cabf6bbc81d9 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:58.763117 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2988/5930] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:33:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:33:58.763976 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6874daa-4f0f-4169-a33b-f343b2591751 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:58.765630 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d6874daa-4f0f-4169-a33b-f343b2591751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:58.828922 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6874daa-4f0f-4169-a33b-f343b2591751 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:58.833556 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcb6762-268a-46b9-8c7a-e3dd802e68b7 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83951651c26f4e138a05108f0fe37ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cdd622c16cd46e2b8f1476076af3f39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:58.834224 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb6762-268a-46b9-8c7a-e3dd802e68b7 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:58.834508 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb6762-268a-46b9-8c7a-e3dd802e68b7 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:58.834787 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb6762-268a-46b9-8c7a-e3dd802e68b7 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:58.835467 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcb6762-268a-46b9-8c7a-e3dd802e68b7 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:58.838143 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcb6762-268a-46b9-8c7a-e3dd802e68b7 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:58.904744 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9ed18fd4-3197-4268-ba5c-cabf6bbc81d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82badb8800bb4096858c945e023ba597', 'request_id': 'req-9ed18fd4-3197-4268-ba5c-cabf6bbc81d9'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:58.910066 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9ed18fd4-3197-4268-ba5c-cabf6bbc81d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82badb8800bb4096858c945e023ba597', 'request_id': 'req-9ed18fd4-3197-4268-ba5c-cabf6bbc81d9'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:58.917281 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9ed18fd4-3197-4268-ba5c-cabf6bbc81d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82badb8800bb4096858c945e023ba597', 'request_id': 'req-9ed18fd4-3197-4268-ba5c-cabf6bbc81d9'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:59.001607 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2989/5931] 10.222.0.52 () {60 vars in 1142 bytes} [Sat May 14 21:33:58 2022] POST /identity/v3/users => generated 264 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:33:59.003004 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2526b0b-cb00-46f5-9b9a-32224858c11e None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:59.003298 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2526b0b-cb00-46f5-9b9a-32224858c11e None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:59.003608 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2526b0b-cb00-46f5-9b9a-32224858c11e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:59.029630 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-e2526b0b-cb00-46f5-9b9a-32224858c11e None None] MFA Rules not processed for user `2316af2f472948a2bba9cd59951f37a5`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:33:59.031191 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e2526b0b-cb00-46f5-9b9a-32224858c11e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:59.053580 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9ed18fd4-3197-4268-ba5c-cabf6bbc81d9 admin admin] The token cache is being invalidate because project 82badb8800bb4096858c945e023ba597 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:33:59.053874 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9ed18fd4-3197-4268-ba5c-cabf6bbc81d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:59.054526 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9ed18fd4-3197-4268-ba5c-cabf6bbc81d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:59.060560 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2943/5932] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:33:58 2022] DELETE /identity/v3/projects/82badb8800bb4096858c945e023ba597 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:59.060560 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed18fd4-3197-4268-ba5c-cabf6bbc81d9 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:59.060560 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-9ed18fd4-3197-4268-ba5c-cabf6bbc81d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:59.101080 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2990/5933] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:33:59 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:33:59.101924 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2526b0b-cb00-46f5-9b9a-32224858c11e None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:59.103928 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e2526b0b-cb00-46f5-9b9a-32224858c11e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:59.127562 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed18fd4-3197-4268-ba5c-cabf6bbc81d9 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:59.131412 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e5f381-c107-4a19-be77-752ce634d6dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:59.132156 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e5f381-c107-4a19-be77-752ce634d6dd service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:59.132441 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e5f381-c107-4a19-be77-752ce634d6dd service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:59.132718 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e5f381-c107-4a19-be77-752ce634d6dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:59.134535 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e3e5f381-c107-4a19-be77-752ce634d6dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:59.173756 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2526b0b-cb00-46f5-9b9a-32224858c11e None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:59.179052 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a8ac1-eb4b-46a7-a1c4-572501fbe3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:59.179864 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a8ac1-eb4b-46a7-a1c4-572501fbe3b6 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:59.180148 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a8ac1-eb4b-46a7-a1c4-572501fbe3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:59.181082 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a8ac1-eb4b-46a7-a1c4-572501fbe3b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:59.181927 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239a8ac1-eb4b-46a7-a1c4-572501fbe3b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:59.184113 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239a8ac1-eb4b-46a7-a1c4-572501fbe3b6 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:59.198738 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e5f381-c107-4a19-be77-752ce634d6dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:59.204497 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e5f381-c107-4a19-be77-752ce634d6dd service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:59.214922 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2944/5934] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:33:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:33:59.215725 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e5f381-c107-4a19-be77-752ce634d6dd service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:59.217029 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e3e5f381-c107-4a19-be77-752ce634d6dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:59.287831 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e5f381-c107-4a19-be77-752ce634d6dd service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:59.293415 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e00313f-f300-40f0-8da5-f6429aadb125 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83951651c26f4e138a05108f0fe37ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cdd622c16cd46e2b8f1476076af3f39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:59.294274 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e00313f-f300-40f0-8da5-f6429aadb125 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:59.294551 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e00313f-f300-40f0-8da5-f6429aadb125 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:59.294819 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e00313f-f300-40f0-8da5-f6429aadb125 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] PATH_INFO: `/v3/users/faff9d616ba740f0af22d2f04ee2096f/password` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:59.307827 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2991/5935] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:33:59 2022] POST /identity/v3/projects => generated 387 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:33:59.309348 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff90b18-33fe-4ad8-9b99-2f018a60e184 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:59.309638 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff90b18-33fe-4ad8-9b99-2f018a60e184 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:59.309919 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff90b18-33fe-4ad8-9b99-2f018a60e184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:59.328936 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-7ff90b18-33fe-4ad8-9b99-2f018a60e184 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:33:59.330139 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-7ff90b18-33fe-4ad8-9b99-2f018a60e184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:59.392483 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2992/5936] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:33:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:33:59.393303 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff90b18-33fe-4ad8-9b99-2f018a60e184 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:59.394648 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-7ff90b18-33fe-4ad8-9b99-2f018a60e184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:59.407388 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff90b18-33fe-4ad8-9b99-2f018a60e184 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:59.412231 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bebaca-f02b-43d8-a42d-a02332c547cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:59.412879 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bebaca-f02b-43d8-a42d-a02332c547cc admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:59.413164 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bebaca-f02b-43d8-a42d-a02332c547cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:59.413439 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bebaca-f02b-43d8-a42d-a02332c547cc admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:59.414146 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bebaca-f02b-43d8-a42d-a02332c547cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:59.417074 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bebaca-f02b-43d8-a42d-a02332c547cc admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:59.437067 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4e00313f-f300-40f0-8da5-f6429aadb125 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'faff9d616ba740f0af22d2f04ee2096f'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:59.586306 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2993/5937] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:33:59 2022] POST /identity/v3/projects => generated 363 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:33:59.587633 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2945/5938] 10.222.0.52 () {60 vars in 1268 bytes} [Sat May 14 21:33:59 2022] POST /identity/v3/users/faff9d616ba740f0af22d2f04ee2096f/password => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:33:59.589882 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bebaca-f02b-43d8-a42d-a02332c547cc admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:59.590293 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8187bbd8-1541-4fca-be5c-6dc76c6193f4 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:59.590751 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8187bbd8-1541-4fca-be5c-6dc76c6193f4 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:59.591401 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8187bbd8-1541-4fca-be5c-6dc76c6193f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:59.611286 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-8187bbd8-1541-4fca-be5c-6dc76c6193f4 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:33:59.612558 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8187bbd8-1541-4fca-be5c-6dc76c6193f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:59.660915 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bebaca-f02b-43d8-a42d-a02332c547cc admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:59.666394 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e177efb-4de3-4720-8ec8-8c047bc93868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:59.667067 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e177efb-4de3-4720-8ec8-8c047bc93868 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:59.667350 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e177efb-4de3-4720-8ec8-8c047bc93868 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:59.667670 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e177efb-4de3-4720-8ec8-8c047bc93868 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:59.668438 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e177efb-4de3-4720-8ec8-8c047bc93868 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:59.670358 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e177efb-4de3-4720-8ec8-8c047bc93868 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:59.684176 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2946/5939] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:33:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:33:59.685269 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8187bbd8-1541-4fca-be5c-6dc76c6193f4 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:59.698714 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8187bbd8-1541-4fca-be5c-6dc76c6193f4 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:59.701335 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfa50cc-eaaa-4109-bc8b-f043b4e0c974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:59.702005 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa50cc-eaaa-4109-bc8b-f043b4e0c974 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:59.702290 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa50cc-eaaa-4109-bc8b-f043b4e0c974 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:59.702566 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa50cc-eaaa-4109-bc8b-f043b4e0c974 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:59.703353 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfa50cc-eaaa-4109-bc8b-f043b4e0c974 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:59.705250 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfa50cc-eaaa-4109-bc8b-f043b4e0c974 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:59.791330 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2994/5940] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:33:59 2022] POST /identity/v3/users => generated 300 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:33:59.792247 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e177efb-4de3-4720-8ec8-8c047bc93868 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:59.793981 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-0e177efb-4de3-4720-8ec8-8c047bc93868 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:33:59.801468 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2947/5941] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:33:59 2022] POST /identity/v3/users => generated 288 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:33:59.802285 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfa50cc-eaaa-4109-bc8b-f043b4e0c974 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:59.807435 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e177efb-4de3-4720-8ec8-8c047bc93868 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:59.812282 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76047e4a-66b2-48d4-9db1-0fe61070904e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:59.813146 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76047e4a-66b2-48d4-9db1-0fe61070904e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:59.813430 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76047e4a-66b2-48d4-9db1-0fe61070904e admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:59.813706 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76047e4a-66b2-48d4-9db1-0fe61070904e admin admin] PATH_INFO: `/v3/projects/857222f705324b6bb53df723369d59f2` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:59.814344 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfa50cc-eaaa-4109-bc8b-f043b4e0c974 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:59.814897 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76047e4a-66b2-48d4-9db1-0fe61070904e admin admin] RBAC: Authorizing `identity:delete_project(project_id=857222f705324b6bb53df723369d59f2)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:59.817228 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76047e4a-66b2-48d4-9db1-0fe61070904e admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:59.822433 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef88797-46ae-47ee-af9b-81681d7a364d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:59.823332 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef88797-46ae-47ee-af9b-81681d7a364d admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:59.823729 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef88797-46ae-47ee-af9b-81681d7a364d admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:59.824006 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef88797-46ae-47ee-af9b-81681d7a364d admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:59.824729 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef88797-46ae-47ee-af9b-81681d7a364d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:33:59.825038 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef88797-46ae-47ee-af9b-81681d7a364d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:59.826632 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef88797-46ae-47ee-af9b-81681d7a364d admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:59.839951 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2948/5942] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:33:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:33:59.840691 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef88797-46ae-47ee-af9b-81681d7a364d admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:59.850365 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef88797-46ae-47ee-af9b-81681d7a364d admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:59.856068 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d063939-a303-4c17-867b-1f2eb266b629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:59.856704 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d063939-a303-4c17-867b-1f2eb266b629 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:59.856983 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d063939-a303-4c17-867b-1f2eb266b629 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:59.857255 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d063939-a303-4c17-867b-1f2eb266b629 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:59.857956 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d063939-a303-4c17-867b-1f2eb266b629 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:59.859614 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d063939-a303-4c17-867b-1f2eb266b629 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:59.870376 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2949/5943] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:33:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:33:59.871153 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d063939-a303-4c17-867b-1f2eb266b629 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:59.880447 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d063939-a303-4c17-867b-1f2eb266b629 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:59.885424 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35115fa6-1a8b-4eb4-a69c-c6e59e76a958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:59.886024 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35115fa6-1a8b-4eb4-a69c-c6e59e76a958 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:59.886307 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35115fa6-1a8b-4eb4-a69c-c6e59e76a958 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:59.886578 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35115fa6-1a8b-4eb4-a69c-c6e59e76a958 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:59.887264 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35115fa6-1a8b-4eb4-a69c-c6e59e76a958 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:59.889681 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35115fa6-1a8b-4eb4-a69c-c6e59e76a958 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:59.899409 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2950/5944] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:33:59 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:33:59.900480 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35115fa6-1a8b-4eb4-a69c-c6e59e76a958 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:33:59.909815 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35115fa6-1a8b-4eb4-a69c-c6e59e76a958 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:33:59.914367 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feee68b-5370-4a48-8bc5-ca0a88939b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:33:59.915633 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feee68b-5370-4a48-8bc5-ca0a88939b94 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:33:59.916047 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feee68b-5370-4a48-8bc5-ca0a88939b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:33:59.916330 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feee68b-5370-4a48-8bc5-ca0a88939b94 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:33:59.916999 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feee68b-5370-4a48-8bc5-ca0a88939b94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:33:59.918860 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feee68b-5370-4a48-8bc5-ca0a88939b94 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:33:59.947060 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-76047e4a-66b2-48d4-9db1-0fe61070904e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '857222f705324b6bb53df723369d59f2', 'request_id': 'req-76047e4a-66b2-48d4-9db1-0fe61070904e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:33:59.952569 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-76047e4a-66b2-48d4-9db1-0fe61070904e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '857222f705324b6bb53df723369d59f2', 'request_id': 'req-76047e4a-66b2-48d4-9db1-0fe61070904e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:00.045398 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2951/5945] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:33:59 2022] POST /identity/v3/projects => generated 381 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:34:00.046331 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feee68b-5370-4a48-8bc5-ca0a88939b94 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:00.060039 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-76047e4a-66b2-48d4-9db1-0fe61070904e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '857222f705324b6bb53df723369d59f2', 'request_id': 'req-76047e4a-66b2-48d4-9db1-0fe61070904e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:00.074460 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-76047e4a-66b2-48d4-9db1-0fe61070904e admin admin] The token cache is being invalidate because project 857222f705324b6bb53df723369d59f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:34:00.074815 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-76047e4a-66b2-48d4-9db1-0fe61070904e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:00.075912 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-76047e4a-66b2-48d4-9db1-0fe61070904e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:00.077255 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2995/5946] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:33:59 2022] DELETE /identity/v3/projects/857222f705324b6bb53df723369d59f2 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:00.081005 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76047e4a-66b2-48d4-9db1-0fe61070904e admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:00.081005 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-76047e4a-66b2-48d4-9db1-0fe61070904e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:00.123312 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feee68b-5370-4a48-8bc5-ca0a88939b94 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:00.129061 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe2d218-1543-4f30-818a-32cb92ee85dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:00.130076 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe2d218-1543-4f30-818a-32cb92ee85dd admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:00.130473 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe2d218-1543-4f30-818a-32cb92ee85dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:00.130944 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe2d218-1543-4f30-818a-32cb92ee85dd admin admin] PATH_INFO: `/v3/projects/a329d238f3f74c22907b2e021f31b7bb/users/7f72e1e37c3f4c698f9eb5d4390c92c5/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:00.150647 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe2d218-1543-4f30-818a-32cb92ee85dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a329d238f3f74c22907b2e021f31b7bb, user_id=7f72e1e37c3f4c698f9eb5d4390c92c5, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:00.152157 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe2d218-1543-4f30-818a-32cb92ee85dd admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:00.154306 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76047e4a-66b2-48d4-9db1-0fe61070904e admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:00.159293 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a013ca-87e9-4bc9-8351-771720c6360a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:00.160309 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a013ca-87e9-4bc9-8351-771720c6360a admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:00.160802 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a013ca-87e9-4bc9-8351-771720c6360a admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:00.161154 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a013ca-87e9-4bc9-8351-771720c6360a admin admin] PATH_INFO: `/v3/projects/6b09813cd5054b258baf9a2e719749c1/users/ca595b8d105a4bd7a652948a7537b438/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:00.177243 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a013ca-87e9-4bc9-8351-771720c6360a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b09813cd5054b258baf9a2e719749c1, user_id=ca595b8d105a4bd7a652948a7537b438, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:00.180128 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a013ca-87e9-4bc9-8351-771720c6360a admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:00.288931 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2952/5947] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:34:00 2022] PUT /identity/v3/projects/a329d238f3f74c22907b2e021f31b7bb/users/7f72e1e37c3f4c698f9eb5d4390c92c5/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:00.289775 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe2d218-1543-4f30-818a-32cb92ee85dd admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:00.291621 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8fe2d218-1543-4f30-818a-32cb92ee85dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:00.298892 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2996/5948] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:34:00 2022] PUT /identity/v3/projects/6b09813cd5054b258baf9a2e719749c1/users/ca595b8d105a4bd7a652948a7537b438/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:00.299897 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a013ca-87e9-4bc9-8351-771720c6360a admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:00.301532 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d9a013ca-87e9-4bc9-8351-771720c6360a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:00.356460 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe2d218-1543-4f30-818a-32cb92ee85dd admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:00.361099 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b93db64-766e-4d68-8eb8-c77b194a871d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:00.361773 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b93db64-766e-4d68-8eb8-c77b194a871d admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:00.362059 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b93db64-766e-4d68-8eb8-c77b194a871d admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:00.362366 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b93db64-766e-4d68-8eb8-c77b194a871d admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:00.363051 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b93db64-766e-4d68-8eb8-c77b194a871d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:00.365117 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b93db64-766e-4d68-8eb8-c77b194a871d admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:00.366414 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a013ca-87e9-4bc9-8351-771720c6360a admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:00.371136 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c353b726-90d6-4273-acc7-8f5e9ad685ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:00.372054 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353b726-90d6-4273-acc7-8f5e9ad685ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:00.372336 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353b726-90d6-4273-acc7-8f5e9ad685ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:00.372615 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353b726-90d6-4273-acc7-8f5e9ad685ab admin admin] PATH_INFO: `/v3/users/7fb19a2a05a44e00bad9b194a8c63f03` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:00.373828 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c353b726-90d6-4273-acc7-8f5e9ad685ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fb19a2a05a44e00bad9b194a8c63f03)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:00.375785 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c353b726-90d6-4273-acc7-8f5e9ad685ab admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:00.435077 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2953/5949] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:34:00 2022] POST /identity/v3/users => generated 291 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:34:00.435930 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b93db64-766e-4d68-8eb8-c77b194a871d admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:00.437497 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-3b93db64-766e-4d68-8eb8-c77b194a871d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:00.449639 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b93db64-766e-4d68-8eb8-c77b194a871d admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:00.454181 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff95e13-20a9-45ad-b1fa-41d7d38143ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:00.454807 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff95e13-20a9-45ad-b1fa-41d7d38143ed admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:00.455089 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff95e13-20a9-45ad-b1fa-41d7d38143ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:00.455360 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff95e13-20a9-45ad-b1fa-41d7d38143ed admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:00.456128 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff95e13-20a9-45ad-b1fa-41d7d38143ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:00.457734 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff95e13-20a9-45ad-b1fa-41d7d38143ed admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:00.468200 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2954/5950] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:34:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:34:00.468987 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff95e13-20a9-45ad-b1fa-41d7d38143ed admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:00.478565 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff95e13-20a9-45ad-b1fa-41d7d38143ed admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:00.483266 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ae016b-e885-4e74-a99d-365adfdc2b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:00.483928 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae016b-e885-4e74-a99d-365adfdc2b3b admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:00.484237 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae016b-e885-4e74-a99d-365adfdc2b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:00.484509 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae016b-e885-4e74-a99d-365adfdc2b3b admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:00.485283 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ae016b-e885-4e74-a99d-365adfdc2b3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:00.486857 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ae016b-e885-4e74-a99d-365adfdc2b3b admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:00.497028 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2955/5951] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:34:00 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:34:00.507183 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ae016b-e885-4e74-a99d-365adfdc2b3b admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:00.507183 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ae016b-e885-4e74-a99d-365adfdc2b3b admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:00.512554 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162aceaf-1bd4-4cac-ae23-efe452f7749a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:00.513156 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162aceaf-1bd4-4cac-ae23-efe452f7749a admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:00.513438 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162aceaf-1bd4-4cac-ae23-efe452f7749a admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:00.513710 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162aceaf-1bd4-4cac-ae23-efe452f7749a admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:00.514389 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162aceaf-1bd4-4cac-ae23-efe452f7749a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:00.515962 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162aceaf-1bd4-4cac-ae23-efe452f7749a admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:00.526402 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2956/5952] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:34:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:34:00.527127 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162aceaf-1bd4-4cac-ae23-efe452f7749a admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:00.537042 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162aceaf-1bd4-4cac-ae23-efe452f7749a admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:00.541624 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afacc8ec-9dee-4b66-9590-e7daccbc9fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:00.542462 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afacc8ec-9dee-4b66-9590-e7daccbc9fca admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:00.542739 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afacc8ec-9dee-4b66-9590-e7daccbc9fca admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:00.543016 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afacc8ec-9dee-4b66-9590-e7daccbc9fca admin admin] PATH_INFO: `/v3/projects/a329d238f3f74c22907b2e021f31b7bb/users/7f72e1e37c3f4c698f9eb5d4390c92c5/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:00.545037 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afacc8ec-9dee-4b66-9590-e7daccbc9fca admin admin] RBAC: Authorizing `identity:create_grant(project_id=a329d238f3f74c22907b2e021f31b7bb, user_id=7f72e1e37c3f4c698f9eb5d4390c92c5, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:00.547657 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afacc8ec-9dee-4b66-9590-e7daccbc9fca admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:00.557593 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2957/5953] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:34:00 2022] PUT /identity/v3/projects/a329d238f3f74c22907b2e021f31b7bb/users/7f72e1e37c3f4c698f9eb5d4390c92c5/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:00.558327 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afacc8ec-9dee-4b66-9590-e7daccbc9fca admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:00.578927 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c353b726-90d6-4273-acc7-8f5e9ad685ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fb19a2a05a44e00bad9b194a8c63f03'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:00.591289 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c353b726-90d6-4273-acc7-8f5e9ad685ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fb19a2a05a44e00bad9b194a8c63f03'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:00.598261 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c353b726-90d6-4273-acc7-8f5e9ad685ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fb19a2a05a44e00bad9b194a8c63f03'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:00.621374 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afacc8ec-9dee-4b66-9590-e7daccbc9fca admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:00.625998 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fcc858-4873-4c3a-8dff-5fcbb017c844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:00.626882 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fcc858-4873-4c3a-8dff-5fcbb017c844 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:00.627166 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fcc858-4873-4c3a-8dff-5fcbb017c844 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:00.627440 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fcc858-4873-4c3a-8dff-5fcbb017c844 admin admin] PATH_INFO: `/v3/projects/6b09813cd5054b258baf9a2e719749c1/users/ca595b8d105a4bd7a652948a7537b438/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:00.629535 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fcc858-4873-4c3a-8dff-5fcbb017c844 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b09813cd5054b258baf9a2e719749c1, user_id=ca595b8d105a4bd7a652948a7537b438, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:00.632269 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fcc858-4873-4c3a-8dff-5fcbb017c844 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:00.642867 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2958/5954] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:34:00 2022] PUT /identity/v3/projects/6b09813cd5054b258baf9a2e719749c1/users/ca595b8d105a4bd7a652948a7537b438/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:00.643739 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fcc858-4873-4c3a-8dff-5fcbb017c844 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:00.690119 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c353b726-90d6-4273-acc7-8f5e9ad685ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fb19a2a05a44e00bad9b194a8c63f03'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:00.690944 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c353b726-90d6-4273-acc7-8f5e9ad685ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fb19a2a05a44e00bad9b194a8c63f03'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:00.701476 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2997/5955] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:34:00 2022] DELETE /identity/v3/users/7fb19a2a05a44e00bad9b194a8c63f03 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:00.701476 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a7828-72cd-488b-8182-fb614e944319 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:00.701476 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a7828-72cd-488b-8182-fb614e944319 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:00.701476 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a7828-72cd-488b-8182-fb614e944319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:00.714266 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fcc858-4873-4c3a-8dff-5fcbb017c844 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:00.732747 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-e24a7828-72cd-488b-8182-fb614e944319 None None] MFA Rules not processed for user `7f72e1e37c3f4c698f9eb5d4390c92c5`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:00.733980 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e24a7828-72cd-488b-8182-fb614e944319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:00.805005 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2897edbf-fe82-4239-85ac-db4f059c34dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:00.807201 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2897edbf-fe82-4239-85ac-db4f059c34dc admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:00.812401 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2897edbf-fe82-4239-85ac-db4f059c34dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:00.812401 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2897edbf-fe82-4239-85ac-db4f059c34dc admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:00.812401 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2897edbf-fe82-4239-85ac-db4f059c34dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:00.812401 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2897edbf-fe82-4239-85ac-db4f059c34dc admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:00.819823 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2998/5956] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:00 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:00.819823 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4a10e-3d2d-4bc7-9720-be202bdf1fb3 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:00.819823 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4a10e-3d2d-4bc7-9720-be202bdf1fb3 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:00.819823 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4a10e-3d2d-4bc7-9720-be202bdf1fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:00.825206 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2959/5957] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:34:00 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:34:00.830174 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1d11c-aa8c-4eaf-982b-6f5f31525a23 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:00.830501 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1d11c-aa8c-4eaf-982b-6f5f31525a23 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:00.830806 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1d11c-aa8c-4eaf-982b-6f5f31525a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:00.840922 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-2ed4a10e-3d2d-4bc7-9720-be202bdf1fb3 None None] MFA Rules not processed for user `faff9d616ba740f0af22d2f04ee2096f`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:00.842198 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-2ed4a10e-3d2d-4bc7-9720-be202bdf1fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:00.845689 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 2999/5958] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:00 2022] POST /identity/v3/auth/tokens => generated 329 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 21:34:00.846286 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed4a10e-3d2d-4bc7-9720-be202bdf1fb3 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:00.861174 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed4a10e-3d2d-4bc7-9720-be202bdf1fb3 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:00.867783 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4347fb-60c4-4eed-8efb-0be6629ee317 tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f72e1e37c3f4c698f9eb5d4390c92c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a329d238f3f74c22907b2e021f31b7bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:00.868996 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4347fb-60c4-4eed-8efb-0be6629ee317 tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:00.869308 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4347fb-60c4-4eed-8efb-0be6629ee317 tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:00.870257 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4347fb-60c4-4eed-8efb-0be6629ee317 tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:00.870257 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4347fb-60c4-4eed-8efb-0be6629ee317 tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:00.871175 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-dbc1d11c-aa8c-4eaf-982b-6f5f31525a23 None None] MFA Rules not processed for user `ca595b8d105a4bd7a652948a7537b438`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:00.872189 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4347fb-60c4-4eed-8efb-0be6629ee317 tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:00.872465 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-dbc1d11c-aa8c-4eaf-982b-6f5f31525a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:00.955110 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2960/5959] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:00 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:00.955110 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc1d11c-aa8c-4eaf-982b-6f5f31525a23 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:00.955110 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-dbc1d11c-aa8c-4eaf-982b-6f5f31525a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:00.966719 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc1d11c-aa8c-4eaf-982b-6f5f31525a23 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:00.971447 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0f716f-4d5d-47d8-b6bf-3fee73b00ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:00.972496 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f716f-4d5d-47d8-b6bf-3fee73b00ec7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:00.972793 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f716f-4d5d-47d8-b6bf-3fee73b00ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:00.973058 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f716f-4d5d-47d8-b6bf-3fee73b00ec7 admin admin] PATH_INFO: `/v3/projects/bc31f3fccb75482f9d0fe81ba4be186a/users/add685ef1a92432da84cdf6520d136d5/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:00.989580 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0f716f-4d5d-47d8-b6bf-3fee73b00ec7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc31f3fccb75482f9d0fe81ba4be186a, user_id=add685ef1a92432da84cdf6520d136d5, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:00.992533 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0f716f-4d5d-47d8-b6bf-3fee73b00ec7 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:00.997479 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3000/5960] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:34:00 2022] POST /identity/v3/projects => generated 358 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:34:00.998415 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4347fb-60c4-4eed-8efb-0be6629ee317 tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:01.000269 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ba4347fb-60c4-4eed-8efb-0be6629ee317 tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:01.065962 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2961/5961] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:34:00 2022] PUT /identity/v3/projects/bc31f3fccb75482f9d0fe81ba4be186a/users/add685ef1a92432da84cdf6520d136d5/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:01.066717 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0f716f-4d5d-47d8-b6bf-3fee73b00ec7 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:01.066842 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4347fb-60c4-4eed-8efb-0be6629ee317 tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:01.068432 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-7b0f716f-4d5d-47d8-b6bf-3fee73b00ec7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:01.130956 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f9c59-a252-4f1d-9552-6557eef700a2 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83951651c26f4e138a05108f0fe37ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cdd622c16cd46e2b8f1476076af3f39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:01.131812 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f9c59-a252-4f1d-9552-6557eef700a2 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:01.132100 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f9c59-a252-4f1d-9552-6557eef700a2 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:01.132228 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f9c59-a252-4f1d-9552-6557eef700a2 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:01.134505 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0f716f-4d5d-47d8-b6bf-3fee73b00ec7 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:01.142800 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837f9c59-a252-4f1d-9552-6557eef700a2 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:01.151190 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837f9c59-a252-4f1d-9552-6557eef700a2 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:01.151828 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35e7b2f-c5c9-4075-afbc-95e93958f40b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:01.151828 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e7b2f-c5c9-4075-afbc-95e93958f40b service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:01.151828 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e7b2f-c5c9-4075-afbc-95e93958f40b service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:01.151828 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e7b2f-c5c9-4075-afbc-95e93958f40b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:01.164235 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3001/5962] 10.222.0.52 () {56 vars in 1262 bytes} [Sat May 14 21:34:00 2022] GET /identity/v3/auth/tokens => generated 329 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 14 21:34:01.164235 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f9c59-a252-4f1d-9552-6557eef700a2 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:01.227055 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35e7b2f-c5c9-4075-afbc-95e93958f40b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:01.229450 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35e7b2f-c5c9-4075-afbc-95e93958f40b service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:01.242005 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2962/5963] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:34:01 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:34:01.243234 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c40120-d25f-4d4e-8674-f9df82aa2fdd None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:01.243642 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c40120-d25f-4d4e-8674-f9df82aa2fdd None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:01.243981 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c40120-d25f-4d4e-8674-f9df82aa2fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:01.244107 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f9c59-a252-4f1d-9552-6557eef700a2 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:01.249897 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faa7f79-a40d-4e4a-b158-915931e6d65f tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f72e1e37c3f4c698f9eb5d4390c92c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a329d238f3f74c22907b2e021f31b7bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:01.251102 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa7f79-a40d-4e4a-b158-915931e6d65f tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:01.252499 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa7f79-a40d-4e4a-b158-915931e6d65f tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:01.253031 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa7f79-a40d-4e4a-b158-915931e6d65f tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] PATH_INFO: `/v3/projects/e4ba9ad60fd444c8b173f5ce7d95283f/tags/tempest-tag-549949936` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:01.254448 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faa7f79-a40d-4e4a-b158-915931e6d65f tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] RBAC: Authorizing `identity:create_project_tag(project_id=e4ba9ad60fd444c8b173f5ce7d95283f, value=tempest-tag-549949936)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:01.256821 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faa7f79-a40d-4e4a-b158-915931e6d65f tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:01.275645 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-c5c40120-d25f-4d4e-8674-f9df82aa2fdd None None] MFA Rules not processed for user `add685ef1a92432da84cdf6520d136d5`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:01.277161 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c5c40120-d25f-4d4e-8674-f9df82aa2fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:01.341132 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2963/5964] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:01.341981 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c40120-d25f-4d4e-8674-f9df82aa2fdd None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:01.343296 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c5c40120-d25f-4d4e-8674-f9df82aa2fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:01.406233 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c40120-d25f-4d4e-8674-f9df82aa2fdd None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:01.410958 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b78b30-c4b3-40e3-84c0-34f1fa39eee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:01.411851 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b78b30-c4b3-40e3-84c0-34f1fa39eee7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:01.412138 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b78b30-c4b3-40e3-84c0-34f1fa39eee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:01.412417 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b78b30-c4b3-40e3-84c0-34f1fa39eee7 admin admin] PATH_INFO: `/v3/projects/18ef6ea639fd4d01a2d29fc0b826df7b` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:01.413629 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b78b30-c4b3-40e3-84c0-34f1fa39eee7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18ef6ea639fd4d01a2d29fc0b826df7b)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:01.415844 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b78b30-c4b3-40e3-84c0-34f1fa39eee7 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:01.474368 ncdv-master-1 devstack@keystone.service[91106]: WARNING py.warnings [None req-6faa7f79-a40d-4e4a-b158-915931e6d65f tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-549949936. To ensure interoperability, identifiers should be a valid uuid. May 14 21:34:01.474368 ncdv-master-1 devstack@keystone.service[91106]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' May 14 21:34:01.474368 ncdv-master-1 devstack@keystone.service[91106]: May 14 21:34:01.482326 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3002/5965] 10.222.0.52 () {60 vars in 1329 bytes} [Sat May 14 21:34:01 2022] PUT /identity/v3/projects/e4ba9ad60fd444c8b173f5ce7d95283f/tags/tempest-tag-549949936 => generated 0 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 290 bytes (1 switches on core 0) May 14 21:34:01.483159 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faa7f79-a40d-4e4a-b158-915931e6d65f tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:01.495794 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faa7f79-a40d-4e4a-b158-915931e6d65f tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:01.500663 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aea4f4e-d1f0-4ac0-b8e3-a6134ec86b28 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83951651c26f4e138a05108f0fe37ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cdd622c16cd46e2b8f1476076af3f39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:01.501562 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea4f4e-d1f0-4ac0-b8e3-a6134ec86b28 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:01.501896 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea4f4e-d1f0-4ac0-b8e3-a6134ec86b28 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:01.502440 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea4f4e-d1f0-4ac0-b8e3-a6134ec86b28 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] PATH_INFO: `/v3/users/faff9d616ba740f0af22d2f04ee2096f` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:01.503796 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aea4f4e-d1f0-4ac0-b8e3-a6134ec86b28 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: Authorizing `identity:delete_user(user_id=faff9d616ba740f0af22d2f04ee2096f)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:01.506474 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aea4f4e-d1f0-4ac0-b8e3-a6134ec86b28 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:01.532901 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-44b78b30-c4b3-40e3-84c0-34f1fa39eee7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18ef6ea639fd4d01a2d29fc0b826df7b', 'request_id': 'req-44b78b30-c4b3-40e3-84c0-34f1fa39eee7'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:01.538161 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-44b78b30-c4b3-40e3-84c0-34f1fa39eee7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18ef6ea639fd4d01a2d29fc0b826df7b', 'request_id': 'req-44b78b30-c4b3-40e3-84c0-34f1fa39eee7'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:01.544710 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-44b78b30-c4b3-40e3-84c0-34f1fa39eee7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18ef6ea639fd4d01a2d29fc0b826df7b', 'request_id': 'req-44b78b30-c4b3-40e3-84c0-34f1fa39eee7'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:01.640919 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-7aea4f4e-d1f0-4ac0-b8e3-a6134ec86b28 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'faff9d616ba740f0af22d2f04ee2096f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:01.641107 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-44b78b30-c4b3-40e3-84c0-34f1fa39eee7 admin admin] The token cache is being invalidate because project 18ef6ea639fd4d01a2d29fc0b826df7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:34:01.641330 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-44b78b30-c4b3-40e3-84c0-34f1fa39eee7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:01.642933 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-44b78b30-c4b3-40e3-84c0-34f1fa39eee7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:01.644697 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2964/5966] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:34:01 2022] DELETE /identity/v3/projects/18ef6ea639fd4d01a2d29fc0b826df7b => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:01.645513 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b78b30-c4b3-40e3-84c0-34f1fa39eee7 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:01.647046 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-44b78b30-c4b3-40e3-84c0-34f1fa39eee7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:01.658314 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-7aea4f4e-d1f0-4ac0-b8e3-a6134ec86b28 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'faff9d616ba740f0af22d2f04ee2096f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:01.666912 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-7aea4f4e-d1f0-4ac0-b8e3-a6134ec86b28 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'faff9d616ba740f0af22d2f04ee2096f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:01.712849 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b78b30-c4b3-40e3-84c0-34f1fa39eee7 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:01.717727 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227a1d5e-46b6-47ee-8e3e-e91e48516d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:01.718391 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227a1d5e-46b6-47ee-8e3e-e91e48516d6f admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:01.718672 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227a1d5e-46b6-47ee-8e3e-e91e48516d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:01.718945 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227a1d5e-46b6-47ee-8e3e-e91e48516d6f admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:01.719665 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227a1d5e-46b6-47ee-8e3e-e91e48516d6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:01.721652 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227a1d5e-46b6-47ee-8e3e-e91e48516d6f admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:01.728543 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-7aea4f4e-d1f0-4ac0-b8e3-a6134ec86b28 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'faff9d616ba740f0af22d2f04ee2096f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:01.729472 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-7aea4f4e-d1f0-4ac0-b8e3-a6134ec86b28 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'faff9d616ba740f0af22d2f04ee2096f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:01.736552 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3003/5967] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:34:01 2022] DELETE /identity/v3/users/faff9d616ba740f0af22d2f04ee2096f => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:01.737710 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aea4f4e-d1f0-4ac0-b8e3-a6134ec86b28 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:01.739192 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-7aea4f4e-d1f0-4ac0-b8e3-a6134ec86b28 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:01.808442 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aea4f4e-d1f0-4ac0-b8e3-a6134ec86b28 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:01.813080 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6df3b9-1499-4e69-ae99-bf26c815bd7d tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f72e1e37c3f4c698f9eb5d4390c92c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a329d238f3f74c22907b2e021f31b7bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:01.813945 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6df3b9-1499-4e69-ae99-bf26c815bd7d tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:01.814230 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6df3b9-1499-4e69-ae99-bf26c815bd7d tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:01.814512 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6df3b9-1499-4e69-ae99-bf26c815bd7d tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] PATH_INFO: `/v3/projects/e4ba9ad60fd444c8b173f5ce7d95283f/tags/tempest-tag-549949936` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:01.825893 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6df3b9-1499-4e69-ae99-bf26c815bd7d tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=e4ba9ad60fd444c8b173f5ce7d95283f, value=tempest-tag-549949936)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:01.830828 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2965/5968] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:34:01 2022] POST /identity/v3/projects => generated 381 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:34:01.830966 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6df3b9-1499-4e69-ae99-bf26c815bd7d tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:01.831065 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb36aa-045c-4660-9eba-2a45c0c37a45 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:01.831065 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb36aa-045c-4660-9eba-2a45c0c37a45 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:01.831065 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb36aa-045c-4660-9eba-2a45c0c37a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:01.840001 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3004/5969] 10.222.0.52 () {58 vars in 1310 bytes} [Sat May 14 21:34:01 2022] GET /identity/v3/projects/e4ba9ad60fd444c8b173f5ce7d95283f/tags/tempest-tag-549949936 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:01.840912 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6df3b9-1499-4e69-ae99-bf26c815bd7d tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:01.845391 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ad6df3b9-1499-4e69-ae99-bf26c815bd7d tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:01.851857 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-aecb36aa-045c-4660-9eba-2a45c0c37a45 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:01.853923 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-aecb36aa-045c-4660-9eba-2a45c0c37a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:01.939112 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2966/5970] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:01.939112 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb36aa-045c-4660-9eba-2a45c0c37a45 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:01.943420 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6df3b9-1499-4e69-ae99-bf26c815bd7d tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:01.943563 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-aecb36aa-045c-4660-9eba-2a45c0c37a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:01.953275 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb36aa-045c-4660-9eba-2a45c0c37a45 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:01.957928 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67be0cc-316a-4d5f-8692-acc497b2e286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:01.958732 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67be0cc-316a-4d5f-8692-acc497b2e286 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:01.959016 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67be0cc-316a-4d5f-8692-acc497b2e286 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:01.959286 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67be0cc-316a-4d5f-8692-acc497b2e286 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:01.960014 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67be0cc-316a-4d5f-8692-acc497b2e286 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:01.962366 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67be0cc-316a-4d5f-8692-acc497b2e286 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:02.003445 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7671be6d-4a90-4312-8dbb-89c70678b106 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83951651c26f4e138a05108f0fe37ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cdd622c16cd46e2b8f1476076af3f39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:02.004261 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7671be6d-4a90-4312-8dbb-89c70678b106 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:02.004550 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7671be6d-4a90-4312-8dbb-89c70678b106 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:02.004830 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7671be6d-4a90-4312-8dbb-89c70678b106 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:02.005589 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7671be6d-4a90-4312-8dbb-89c70678b106 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:02.007463 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7671be6d-4a90-4312-8dbb-89c70678b106 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:02.098938 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2967/5971] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:34:01 2022] POST /identity/v3/users => generated 297 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:34:02.098938 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67be0cc-316a-4d5f-8692-acc497b2e286 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:02.131688 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3005/5972] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:34:01 2022] POST /identity/v3/users => generated 367 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:34:02.139656 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e681bcb-9438-4962-ab4c-e5687836b14c None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:02.139955 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e681bcb-9438-4962-ab4c-e5687836b14c None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:02.140242 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e681bcb-9438-4962-ab4c-e5687836b14c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:02.160995 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-0e681bcb-9438-4962-ab4c-e5687836b14c None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:02.162544 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-0e681bcb-9438-4962-ab4c-e5687836b14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:02.172156 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3006/5973] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:02.172887 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e681bcb-9438-4962-ab4c-e5687836b14c None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:02.179642 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67be0cc-316a-4d5f-8692-acc497b2e286 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:02.183399 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e681bcb-9438-4962-ab4c-e5687836b14c None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:02.184930 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566428d0-d421-48aa-b9a3-677120ca54b0 tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f72e1e37c3f4c698f9eb5d4390c92c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a329d238f3f74c22907b2e021f31b7bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:02.186348 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566428d0-d421-48aa-b9a3-677120ca54b0 tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:02.186592 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566428d0-d421-48aa-b9a3-677120ca54b0 tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:02.186873 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566428d0-d421-48aa-b9a3-677120ca54b0 tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] PATH_INFO: `/v3/projects/e4ba9ad60fd444c8b173f5ce7d95283f/tags` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:02.190699 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566428d0-d421-48aa-b9a3-677120ca54b0 tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] RBAC: Authorizing `identity:update_project_tags(project_id=e4ba9ad60fd444c8b173f5ce7d95283f)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:02.191453 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e1ce69-2c9b-4d9e-a513-dc1ea889dc64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:02.191453 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e1ce69-2c9b-4d9e-a513-dc1ea889dc64 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:02.191705 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566428d0-d421-48aa-b9a3-677120ca54b0 tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:02.191788 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e1ce69-2c9b-4d9e-a513-dc1ea889dc64 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:02.191788 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e1ce69-2c9b-4d9e-a513-dc1ea889dc64 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:02.192143 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e1ce69-2c9b-4d9e-a513-dc1ea889dc64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:02.194014 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e1ce69-2c9b-4d9e-a513-dc1ea889dc64 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:02.207462 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3007/5974] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:34:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:34:02.208363 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e1ce69-2c9b-4d9e-a513-dc1ea889dc64 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:02.221192 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e1ce69-2c9b-4d9e-a513-dc1ea889dc64 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:02.226484 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac3a001-6410-4ff6-be71-87c08f0b49fc tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83951651c26f4e138a05108f0fe37ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cdd622c16cd46e2b8f1476076af3f39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:02.227021 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac3a001-6410-4ff6-be71-87c08f0b49fc tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:02.227458 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac3a001-6410-4ff6-be71-87c08f0b49fc tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:02.227829 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac3a001-6410-4ff6-be71-87c08f0b49fc tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:02.228521 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac3a001-6410-4ff6-be71-87c08f0b49fc tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:02.230437 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac3a001-6410-4ff6-be71-87c08f0b49fc tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:02.329533 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2968/5975] 10.222.0.52 () {60 vars in 1264 bytes} [Sat May 14 21:34:02 2022] PUT /identity/v3/projects/e4ba9ad60fd444c8b173f5ce7d95283f/tags => generated 139 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:34:02.330713 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566428d0-d421-48aa-b9a3-677120ca54b0 tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:02.336710 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3008/5976] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:34:02 2022] POST /identity/v3/projects => generated 360 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:34:02.337825 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac3a001-6410-4ff6-be71-87c08f0b49fc tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:02.342117 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566428d0-d421-48aa-b9a3-677120ca54b0 tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:02.399089 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709d2c50-b0ef-4235-a833-e324f090e372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:02.399937 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d2c50-b0ef-4235-a833-e324f090e372 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:02.400228 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d2c50-b0ef-4235-a833-e324f090e372 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:02.400758 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d2c50-b0ef-4235-a833-e324f090e372 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:02.401339 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709d2c50-b0ef-4235-a833-e324f090e372 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:34:02.401650 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709d2c50-b0ef-4235-a833-e324f090e372 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:02.403273 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709d2c50-b0ef-4235-a833-e324f090e372 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:02.405008 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac3a001-6410-4ff6-be71-87c08f0b49fc tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:02.410215 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb18475d-3333-49b0-a996-2f1a6d9279c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:02.411587 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb18475d-3333-49b0-a996-2f1a6d9279c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:02.412274 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb18475d-3333-49b0-a996-2f1a6d9279c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:02.413479 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb18475d-3333-49b0-a996-2f1a6d9279c3 admin admin] PATH_INFO: `/v3/projects/a8db70dff54747df8dc0ee388e89052a/users/7db54eba4c0b4f6fbc146b2802c6163e/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:02.419200 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2969/5977] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:34:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:34:02.419200 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709d2c50-b0ef-4235-a833-e324f090e372 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:02.431525 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb18475d-3333-49b0-a996-2f1a6d9279c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8db70dff54747df8dc0ee388e89052a, user_id=7db54eba4c0b4f6fbc146b2802c6163e, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:02.434531 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb18475d-3333-49b0-a996-2f1a6d9279c3 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:02.483280 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709d2c50-b0ef-4235-a833-e324f090e372 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:02.488216 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04085b25-b0a0-4309-ab0d-f6ff1a7450bc tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f72e1e37c3f4c698f9eb5d4390c92c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a329d238f3f74c22907b2e021f31b7bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:02.489054 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04085b25-b0a0-4309-ab0d-f6ff1a7450bc tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:02.489339 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04085b25-b0a0-4309-ab0d-f6ff1a7450bc tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:02.489617 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04085b25-b0a0-4309-ab0d-f6ff1a7450bc tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] PATH_INFO: `/v3/projects/e4ba9ad60fd444c8b173f5ce7d95283f/tags` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:02.501446 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04085b25-b0a0-4309-ab0d-f6ff1a7450bc tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=e4ba9ad60fd444c8b173f5ce7d95283f)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:02.506776 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04085b25-b0a0-4309-ab0d-f6ff1a7450bc tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:02.516105 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2970/5978] 10.222.0.52 () {58 vars in 1244 bytes} [Sat May 14 21:34:02 2022] GET /identity/v3/projects/e4ba9ad60fd444c8b173f5ce7d95283f/tags => generated 139 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:34:02.516830 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04085b25-b0a0-4309-ab0d-f6ff1a7450bc tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:02.569543 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3009/5979] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:34:02 2022] PUT /identity/v3/projects/a8db70dff54747df8dc0ee388e89052a/users/7db54eba4c0b4f6fbc146b2802c6163e/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:02.569543 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb18475d-3333-49b0-a996-2f1a6d9279c3 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:02.583223 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04085b25-b0a0-4309-ab0d-f6ff1a7450bc tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:02.642024 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff83a58a-bb69-4449-93b8-62ece292f839 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83951651c26f4e138a05108f0fe37ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cdd622c16cd46e2b8f1476076af3f39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:02.643226 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff83a58a-bb69-4449-93b8-62ece292f839 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:02.643714 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff83a58a-bb69-4449-93b8-62ece292f839 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:02.644011 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff83a58a-bb69-4449-93b8-62ece292f839 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] PATH_INFO: `/v3/users/cfddade5c7f94ec9831ff945e8c16fdc` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:02.659904 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff83a58a-bb69-4449-93b8-62ece292f839 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: Authorizing `identity:update_user(user_id=cfddade5c7f94ec9831ff945e8c16fdc)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:02.661971 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff83a58a-bb69-4449-93b8-62ece292f839 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:02.691273 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb18475d-3333-49b0-a996-2f1a6d9279c3 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:02.697286 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3d7efc-d3b7-4bfc-95f8-0dd8efe94149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:02.698111 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d7efc-d3b7-4bfc-95f8-0dd8efe94149 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:02.698466 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d7efc-d3b7-4bfc-95f8-0dd8efe94149 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:02.698850 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d7efc-d3b7-4bfc-95f8-0dd8efe94149 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:02.699670 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3d7efc-d3b7-4bfc-95f8-0dd8efe94149 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:02.702005 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3d7efc-d3b7-4bfc-95f8-0dd8efe94149 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:02.758615 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2971/5980] 10.222.0.52 () {60 vars in 1243 bytes} [Sat May 14 21:34:02 2022] PATCH /identity/v3/users/cfddade5c7f94ec9831ff945e8c16fdc => generated 524 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:34:02.758615 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff83a58a-bb69-4449-93b8-62ece292f839 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:02.785032 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3010/5981] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:34:02 2022] POST /identity/v3/projects => generated 379 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:34:02.785901 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3d7efc-d3b7-4bfc-95f8-0dd8efe94149 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:02.828514 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff83a58a-bb69-4449-93b8-62ece292f839 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:02.882062 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3d7efc-d3b7-4bfc-95f8-0dd8efe94149 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:02.887820 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e04ab7-b456-4d70-b1b3-85fbb24ab2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:02.888522 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e04ab7-b456-4d70-b1b3-85fbb24ab2e2 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:02.888806 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e04ab7-b456-4d70-b1b3-85fbb24ab2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:02.888914 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b574f60-8eac-4b8e-a133-fdf0b5a8ab9a tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f72e1e37c3f4c698f9eb5d4390c92c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a329d238f3f74c22907b2e021f31b7bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:02.889128 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e04ab7-b456-4d70-b1b3-85fbb24ab2e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:02.889748 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b574f60-8eac-4b8e-a133-fdf0b5a8ab9a tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:02.889875 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e04ab7-b456-4d70-b1b3-85fbb24ab2e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:02.890035 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b574f60-8eac-4b8e-a133-fdf0b5a8ab9a tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:02.890303 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b574f60-8eac-4b8e-a133-fdf0b5a8ab9a tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] PATH_INFO: `/v3/projects/e4ba9ad60fd444c8b173f5ce7d95283f/tags/tempest-tag-42279417` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:02.891501 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e04ab7-b456-4d70-b1b3-85fbb24ab2e2 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:02.891644 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b574f60-8eac-4b8e-a133-fdf0b5a8ab9a tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] RBAC: Authorizing `identity:delete_project_tag(project_id=e4ba9ad60fd444c8b173f5ce7d95283f, value=tempest-tag-42279417)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:02.894499 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b574f60-8eac-4b8e-a133-fdf0b5a8ab9a tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:02.905947 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3011/5982] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:34:02 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:34:02.906886 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e04ab7-b456-4d70-b1b3-85fbb24ab2e2 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:02.995781 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e04ab7-b456-4d70-b1b3-85fbb24ab2e2 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:03.000575 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03147ec-ab50-41ed-b6e1-fba960cb5134 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83951651c26f4e138a05108f0fe37ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cdd622c16cd46e2b8f1476076af3f39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:03.001667 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03147ec-ab50-41ed-b6e1-fba960cb5134 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:03.001983 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03147ec-ab50-41ed-b6e1-fba960cb5134 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:03.002298 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03147ec-ab50-41ed-b6e1-fba960cb5134 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] PATH_INFO: `/v3/users/cfddade5c7f94ec9831ff945e8c16fdc` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:03.016638 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03147ec-ab50-41ed-b6e1-fba960cb5134 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: Authorizing `identity:get_user(user_id=cfddade5c7f94ec9831ff945e8c16fdc)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:03.019556 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03147ec-ab50-41ed-b6e1-fba960cb5134 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:03.025117 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3012/5983] 10.222.0.52 () {58 vars in 1220 bytes} [Sat May 14 21:34:02 2022] GET /identity/v3/users/cfddade5c7f94ec9831ff945e8c16fdc => generated 390 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:34:03.025117 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03147ec-ab50-41ed-b6e1-fba960cb5134 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:03.032342 ncdv-master-1 devstack@keystone.service[91107]: WARNING py.warnings [None req-5b574f60-8eac-4b8e-a133-fdf0b5a8ab9a tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-42279417. To ensure interoperability, identifiers should be a valid uuid. May 14 21:34:03.032342 ncdv-master-1 devstack@keystone.service[91107]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' May 14 21:34:03.032342 ncdv-master-1 devstack@keystone.service[91107]: May 14 21:34:03.035819 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03147ec-ab50-41ed-b6e1-fba960cb5134 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:03.037614 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2972/5984] 10.222.0.52 () {58 vars in 1310 bytes} [Sat May 14 21:34:02 2022] DELETE /identity/v3/projects/e4ba9ad60fd444c8b173f5ce7d95283f/tags/tempest-tag-42279417 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:03.038346 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b574f60-8eac-4b8e-a133-fdf0b5a8ab9a tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:03.042384 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35db4669-167d-4b3e-8037-b85e01a890f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:03.043060 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db4669-167d-4b3e-8037-b85e01a890f3 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:03.043347 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db4669-167d-4b3e-8037-b85e01a890f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:03.043659 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db4669-167d-4b3e-8037-b85e01a890f3 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:03.044347 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35db4669-167d-4b3e-8037-b85e01a890f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:03.046282 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35db4669-167d-4b3e-8037-b85e01a890f3 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:03.051395 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b574f60-8eac-4b8e-a133-fdf0b5a8ab9a tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:03.056287 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995a55f2-b701-4e09-8bad-7339ca1e8c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:03.057326 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995a55f2-b701-4e09-8bad-7339ca1e8c79 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:03.057620 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995a55f2-b701-4e09-8bad-7339ca1e8c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:03.057903 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995a55f2-b701-4e09-8bad-7339ca1e8c79 admin admin] PATH_INFO: `/v3/projects/a8db70dff54747df8dc0ee388e89052a/users/7db54eba4c0b4f6fbc146b2802c6163e/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:03.059974 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995a55f2-b701-4e09-8bad-7339ca1e8c79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8db70dff54747df8dc0ee388e89052a, user_id=7db54eba4c0b4f6fbc146b2802c6163e, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:03.062678 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995a55f2-b701-4e09-8bad-7339ca1e8c79 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:03.073828 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2973/5985] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:34:03 2022] PUT /identity/v3/projects/a8db70dff54747df8dc0ee388e89052a/users/7db54eba4c0b4f6fbc146b2802c6163e/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:03.076370 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995a55f2-b701-4e09-8bad-7339ca1e8c79 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:03.140168 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3013/5986] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:34:03 2022] POST /identity/v3/users => generated 290 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:34:03.141242 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35db4669-167d-4b3e-8037-b85e01a890f3 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:03.152394 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995a55f2-b701-4e09-8bad-7339ca1e8c79 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:03.153810 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35db4669-167d-4b3e-8037-b85e01a890f3 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:03.157242 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfd14ca-dfb7-4419-8d4a-65848ffb3640 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83951651c26f4e138a05108f0fe37ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cdd622c16cd46e2b8f1476076af3f39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:03.158177 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd14ca-dfb7-4419-8d4a-65848ffb3640 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:03.158496 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd14ca-dfb7-4419-8d4a-65848ffb3640 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:03.158780 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd14ca-dfb7-4419-8d4a-65848ffb3640 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] PATH_INFO: `/v3/projects/57f09e7813294d22b1843784130b5d0e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:03.160013 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfd14ca-dfb7-4419-8d4a-65848ffb3640 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: Authorizing `identity:delete_project(project_id=57f09e7813294d22b1843784130b5d0e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:03.161939 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfd14ca-dfb7-4419-8d4a-65848ffb3640 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:03.212788 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff94f27b-fec1-4dcd-a1c3-e2ef25f99614 tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f72e1e37c3f4c698f9eb5d4390c92c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a329d238f3f74c22907b2e021f31b7bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:03.213659 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94f27b-fec1-4dcd-a1c3-e2ef25f99614 tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:03.213971 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94f27b-fec1-4dcd-a1c3-e2ef25f99614 tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:03.214251 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94f27b-fec1-4dcd-a1c3-e2ef25f99614 tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] PATH_INFO: `/v3/projects/e4ba9ad60fd444c8b173f5ce7d95283f/tags/tempest-tag-42279417` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:03.230042 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff94f27b-fec1-4dcd-a1c3-e2ef25f99614 tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=e4ba9ad60fd444c8b173f5ce7d95283f, value=tempest-tag-42279417)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:03.232177 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff94f27b-fec1-4dcd-a1c3-e2ef25f99614 tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:03.251788 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-ff94f27b-fec1-4dcd-a1c3-e2ef25f99614 tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] Could not find project tag: tempest-tag-42279417.: keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-42279417. May 14 21:34:03.251788 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:34:03.251788 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 21:34:03.251788 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 21:34:03.251788 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 21:34:03.251788 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 21:34:03.251788 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 21:34:03.251788 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 21:34:03.251788 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 21:34:03.251788 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 21:34:03.251788 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 21:34:03.251788 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 21:34:03.251788 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 284, in get May 14 21:34:03.251788 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_project_tag(project_id, value) May 14 21:34:03.259584 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 21:34:03.259584 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 21:34:03.259584 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 960, in get_project_tag May 14 21:34:03.259584 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.ProjectTagNotFound(project_tag=tag_name) May 14 21:34:03.259584 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-42279417. May 14 21:34:03.259584 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:34:03.259584 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3014/5987] 10.222.0.52 () {58 vars in 1307 bytes} [Sat May 14 21:34:03 2022] GET /identity/v3/projects/e4ba9ad60fd444c8b173f5ce7d95283f/tags/tempest-tag-42279417 => generated 105 bytes in 112 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 14 21:34:03.259584 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716724db-c86e-4d3e-ac6c-dffb619227c6 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:03.259584 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716724db-c86e-4d3e-ac6c-dffb619227c6 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:03.259584 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716724db-c86e-4d3e-ac6c-dffb619227c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:03.284196 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-716724db-c86e-4d3e-ac6c-dffb619227c6 None None] MFA Rules not processed for user `7db54eba4c0b4f6fbc146b2802c6163e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:03.286931 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-716724db-c86e-4d3e-ac6c-dffb619227c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:03.301133 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dcfd14ca-dfb7-4419-8d4a-65848ffb3640 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57f09e7813294d22b1843784130b5d0e', 'request_id': 'req-dcfd14ca-dfb7-4419-8d4a-65848ffb3640'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:03.306661 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dcfd14ca-dfb7-4419-8d4a-65848ffb3640 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57f09e7813294d22b1843784130b5d0e', 'request_id': 'req-dcfd14ca-dfb7-4419-8d4a-65848ffb3640'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:03.313343 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dcfd14ca-dfb7-4419-8d4a-65848ffb3640 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57f09e7813294d22b1843784130b5d0e', 'request_id': 'req-dcfd14ca-dfb7-4419-8d4a-65848ffb3640'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:03.359082 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3015/5988] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:03 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:03.360077 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716724db-c86e-4d3e-ac6c-dffb619227c6 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:03.401839 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dcfd14ca-dfb7-4419-8d4a-65848ffb3640 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] The token cache is being invalidate because project 57f09e7813294d22b1843784130b5d0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:34:03.401839 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dcfd14ca-dfb7-4419-8d4a-65848ffb3640 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:03.401839 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dcfd14ca-dfb7-4419-8d4a-65848ffb3640 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:03.406177 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2974/5989] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:34:03 2022] DELETE /identity/v3/projects/57f09e7813294d22b1843784130b5d0e => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:03.406177 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfd14ca-dfb7-4419-8d4a-65848ffb3640 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:03.407261 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-dcfd14ca-dfb7-4419-8d4a-65848ffb3640 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:03.435630 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716724db-c86e-4d3e-ac6c-dffb619227c6 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:03.441428 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf7d0a7-47a5-4751-a71d-4a716aaae731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:03.442106 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7d0a7-47a5-4751-a71d-4a716aaae731 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:03.442399 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7d0a7-47a5-4751-a71d-4a716aaae731 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:03.442681 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7d0a7-47a5-4751-a71d-4a716aaae731 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:03.443443 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf7d0a7-47a5-4751-a71d-4a716aaae731 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:03.445115 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf7d0a7-47a5-4751-a71d-4a716aaae731 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:03.456692 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3016/5990] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:34:03 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:34:03.457295 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf7d0a7-47a5-4751-a71d-4a716aaae731 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:03.459039 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-daf7d0a7-47a5-4751-a71d-4a716aaae731 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:03.477959 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfd14ca-dfb7-4419-8d4a-65848ffb3640 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:03.485771 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f6a7b-c55a-4f80-bc0c-fe6cdb1fd5c5 tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f72e1e37c3f4c698f9eb5d4390c92c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a329d238f3f74c22907b2e021f31b7bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:03.486701 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f6a7b-c55a-4f80-bc0c-fe6cdb1fd5c5 tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:03.486996 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f6a7b-c55a-4f80-bc0c-fe6cdb1fd5c5 tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:03.487278 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f6a7b-c55a-4f80-bc0c-fe6cdb1fd5c5 tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] PATH_INFO: `/v3/projects/e4ba9ad60fd444c8b173f5ce7d95283f/tags` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:03.488659 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1f6a7b-c55a-4f80-bc0c-fe6cdb1fd5c5 tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] RBAC: Authorizing `identity:delete_project_tags(project_id=e4ba9ad60fd444c8b173f5ce7d95283f)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:03.490797 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1f6a7b-c55a-4f80-bc0c-fe6cdb1fd5c5 tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:03.533036 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf7d0a7-47a5-4751-a71d-4a716aaae731 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:03.536891 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8264efae-3dd8-4d6f-9ffd-f3a3793f4e7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198271d1c0d44cb58bace41a65f4b94c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:03.537539 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264efae-3dd8-4d6f-9ffd-f3a3793f4e7c service cinder] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:03.537831 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264efae-3dd8-4d6f-9ffd-f3a3793f4e7c service cinder] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:03.538107 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264efae-3dd8-4d6f-9ffd-f3a3793f4e7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:03.540692 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-8264efae-3dd8-4d6f-9ffd-f3a3793f4e7c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:03.552793 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8264efae-3dd8-4d6f-9ffd-f3a3793f4e7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:03.554230 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8264efae-3dd8-4d6f-9ffd-f3a3793f4e7c service cinder] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:03.564969 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3017/5991] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:34:03 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:34:03.571964 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8264efae-3dd8-4d6f-9ffd-f3a3793f4e7c service cinder] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:03.571964 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-8264efae-3dd8-4d6f-9ffd-f3a3793f4e7c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:03.632967 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8264efae-3dd8-4d6f-9ffd-f3a3793f4e7c service cinder] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:03.638167 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9756ac1e-2779-41cd-b3f1-a2ba6aa3fe95 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83951651c26f4e138a05108f0fe37ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cdd622c16cd46e2b8f1476076af3f39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:03.639045 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9756ac1e-2779-41cd-b3f1-a2ba6aa3fe95 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:03.639331 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9756ac1e-2779-41cd-b3f1-a2ba6aa3fe95 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:03.639648 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9756ac1e-2779-41cd-b3f1-a2ba6aa3fe95 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] PATH_INFO: `/v3/users/cfddade5c7f94ec9831ff945e8c16fdc` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:03.640866 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9756ac1e-2779-41cd-b3f1-a2ba6aa3fe95 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: Authorizing `identity:delete_user(user_id=cfddade5c7f94ec9831ff945e8c16fdc)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:03.643069 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9756ac1e-2779-41cd-b3f1-a2ba6aa3fe95 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:03.657630 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2975/5992] 10.222.0.52 () {58 vars in 1247 bytes} [Sat May 14 21:34:03 2022] DELETE /identity/v3/projects/e4ba9ad60fd444c8b173f5ce7d95283f/tags => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:03.658623 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f6a7b-c55a-4f80-bc0c-fe6cdb1fd5c5 tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:03.663913 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-7f1f6a7b-c55a-4f80-bc0c-fe6cdb1fd5c5 tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:03.687041 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f6a7b-c55a-4f80-bc0c-fe6cdb1fd5c5 tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:03.692298 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b44b92-b9c7-4604-9b13-988f2e57f548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:03.693036 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b44b92-b9c7-4604-9b13-988f2e57f548 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:03.693383 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b44b92-b9c7-4604-9b13-988f2e57f548 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:03.698303 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b44b92-b9c7-4604-9b13-988f2e57f548 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:03.698303 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b44b92-b9c7-4604-9b13-988f2e57f548 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:03.698303 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b44b92-b9c7-4604-9b13-988f2e57f548 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:03.708131 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2976/5993] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:34:03 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:34:03.709026 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b44b92-b9c7-4604-9b13-988f2e57f548 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:03.726923 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b44b92-b9c7-4604-9b13-988f2e57f548 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:03.732897 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97cd395-3dca-46fc-8ec9-78bc5fa8a9cc tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f72e1e37c3f4c698f9eb5d4390c92c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a329d238f3f74c22907b2e021f31b7bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:03.733868 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97cd395-3dca-46fc-8ec9-78bc5fa8a9cc tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:03.734198 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97cd395-3dca-46fc-8ec9-78bc5fa8a9cc tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:03.734510 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97cd395-3dca-46fc-8ec9-78bc5fa8a9cc tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] PATH_INFO: `/v3/projects/e4ba9ad60fd444c8b173f5ce7d95283f/tags` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:03.752590 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97cd395-3dca-46fc-8ec9-78bc5fa8a9cc tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=e4ba9ad60fd444c8b173f5ce7d95283f)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:03.754901 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97cd395-3dca-46fc-8ec9-78bc5fa8a9cc tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:03.770516 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2977/5994] 10.222.0.52 () {58 vars in 1244 bytes} [Sat May 14 21:34:03 2022] GET /identity/v3/projects/e4ba9ad60fd444c8b173f5ce7d95283f/tags => generated 66 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 14 21:34:03.771882 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97cd395-3dca-46fc-8ec9-78bc5fa8a9cc tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:03.775169 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9756ac1e-2779-41cd-b3f1-a2ba6aa3fe95 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfddade5c7f94ec9831ff945e8c16fdc'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:03.785466 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97cd395-3dca-46fc-8ec9-78bc5fa8a9cc tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:03.788936 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9756ac1e-2779-41cd-b3f1-a2ba6aa3fe95 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfddade5c7f94ec9831ff945e8c16fdc'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:03.792081 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699876ae-7ce8-47de-a8cd-d95941d7baa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:03.793326 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699876ae-7ce8-47de-a8cd-d95941d7baa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:03.793326 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699876ae-7ce8-47de-a8cd-d95941d7baa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:03.794344 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699876ae-7ce8-47de-a8cd-d95941d7baa2 admin admin] PATH_INFO: `/v3/projects/415a3b147fd74521bbcb82b069157bcf/users/004a6a24f1984ad8b597069bf99cc018/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:03.810347 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9756ac1e-2779-41cd-b3f1-a2ba6aa3fe95 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfddade5c7f94ec9831ff945e8c16fdc'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:03.817241 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699876ae-7ce8-47de-a8cd-d95941d7baa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=415a3b147fd74521bbcb82b069157bcf, user_id=004a6a24f1984ad8b597069bf99cc018, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:03.820282 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699876ae-7ce8-47de-a8cd-d95941d7baa2 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:03.868622 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9756ac1e-2779-41cd-b3f1-a2ba6aa3fe95 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfddade5c7f94ec9831ff945e8c16fdc'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:03.868622 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9756ac1e-2779-41cd-b3f1-a2ba6aa3fe95 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfddade5c7f94ec9831ff945e8c16fdc'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:03.875221 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3018/5995] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:34:03 2022] DELETE /identity/v3/users/cfddade5c7f94ec9831ff945e8c16fdc => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:03.876482 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9756ac1e-2779-41cd-b3f1-a2ba6aa3fe95 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:03.878083 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-9756ac1e-2779-41cd-b3f1-a2ba6aa3fe95 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:03.897061 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2978/5996] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:34:03 2022] PUT /identity/v3/projects/415a3b147fd74521bbcb82b069157bcf/users/004a6a24f1984ad8b597069bf99cc018/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:03.898595 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699876ae-7ce8-47de-a8cd-d95941d7baa2 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:03.901609 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-699876ae-7ce8-47de-a8cd-d95941d7baa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:03.960902 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9756ac1e-2779-41cd-b3f1-a2ba6aa3fe95 tempest-UsersV3TestJSON-1997770868 tempest-UsersV3TestJSON-1997770868-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:03.989778 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699876ae-7ce8-47de-a8cd-d95941d7baa2 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:03.994392 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb9ffb8-9398-487b-bd1f-23f488c5d195 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198271d1c0d44cb58bace41a65f4b94c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:03.995041 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9ffb8-9398-487b-bd1f-23f488c5d195 service cinder] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:03.995322 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9ffb8-9398-487b-bd1f-23f488c5d195 service cinder] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:03.995654 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9ffb8-9398-487b-bd1f-23f488c5d195 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:03.997607 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-0eb9ffb8-9398-487b-bd1f-23f488c5d195 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:04.019162 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99180cb3-df84-4355-bdfd-9e5617fe8376 tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f72e1e37c3f4c698f9eb5d4390c92c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a329d238f3f74c22907b2e021f31b7bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:04.020109 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99180cb3-df84-4355-bdfd-9e5617fe8376 tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:04.020402 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99180cb3-df84-4355-bdfd-9e5617fe8376 tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:04.020680 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99180cb3-df84-4355-bdfd-9e5617fe8376 tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] PATH_INFO: `/v3/projects/e4ba9ad60fd444c8b173f5ce7d95283f` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:04.022389 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99180cb3-df84-4355-bdfd-9e5617fe8376 tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e4ba9ad60fd444c8b173f5ce7d95283f)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:04.024444 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99180cb3-df84-4355-bdfd-9e5617fe8376 tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:04.059138 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb9ffb8-9398-487b-bd1f-23f488c5d195 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:04.060674 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb9ffb8-9398-487b-bd1f-23f488c5d195 service cinder] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:04.070291 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2979/5997] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:34:03 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:34:04.071065 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb9ffb8-9398-487b-bd1f-23f488c5d195 service cinder] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:04.072509 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-0eb9ffb8-9398-487b-bd1f-23f488c5d195 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:04.146929 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb9ffb8-9398-487b-bd1f-23f488c5d195 service cinder] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:04.153654 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a737b7-d30a-4e19-b78b-d243634e6f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:04.154539 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a737b7-d30a-4e19-b78b-d243634e6f5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:04.154819 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a737b7-d30a-4e19-b78b-d243634e6f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:04.155182 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a737b7-d30a-4e19-b78b-d243634e6f5d admin admin] PATH_INFO: `/v3/users/9a77e5790314487bb0f11099e0ae5953` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:04.171591 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a737b7-d30a-4e19-b78b-d243634e6f5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a77e5790314487bb0f11099e0ae5953)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:04.181798 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a737b7-d30a-4e19-b78b-d243634e6f5d admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:04.181916 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-99180cb3-df84-4355-bdfd-9e5617fe8376 tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4ba9ad60fd444c8b173f5ce7d95283f', 'request_id': 'req-99180cb3-df84-4355-bdfd-9e5617fe8376'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:04.189266 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-99180cb3-df84-4355-bdfd-9e5617fe8376 tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4ba9ad60fd444c8b173f5ce7d95283f', 'request_id': 'req-99180cb3-df84-4355-bdfd-9e5617fe8376'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:04.283336 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-99180cb3-df84-4355-bdfd-9e5617fe8376 tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4ba9ad60fd444c8b173f5ce7d95283f', 'request_id': 'req-99180cb3-df84-4355-bdfd-9e5617fe8376'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:04.296819 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-99180cb3-df84-4355-bdfd-9e5617fe8376 tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] The token cache is being invalidate because project e4ba9ad60fd444c8b173f5ce7d95283f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:34:04.297105 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-99180cb3-df84-4355-bdfd-9e5617fe8376 tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:04.297875 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-99180cb3-df84-4355-bdfd-9e5617fe8376 tempest-IdentityV3ProjectTagsTest-1201554824 tempest-IdentityV3ProjectTagsTest-1201554824-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:04.299387 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3019/5998] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:34:03 2022] DELETE /identity/v3/projects/e4ba9ad60fd444c8b173f5ce7d95283f => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:04.300887 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa508e8-26f7-4e2c-8fda-9bacce1f89a7 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:04.301183 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa508e8-26f7-4e2c-8fda-9bacce1f89a7 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:04.303386 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa508e8-26f7-4e2c-8fda-9bacce1f89a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:04.332378 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-4aa508e8-26f7-4e2c-8fda-9bacce1f89a7 None None] MFA Rules not processed for user `004a6a24f1984ad8b597069bf99cc018`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:04.333611 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-4aa508e8-26f7-4e2c-8fda-9bacce1f89a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:04.406750 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d3a737b7-d30a-4e19-b78b-d243634e6f5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a77e5790314487bb0f11099e0ae5953'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:04.414047 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d3a737b7-d30a-4e19-b78b-d243634e6f5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a77e5790314487bb0f11099e0ae5953'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:04.415348 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d3a737b7-d30a-4e19-b78b-d243634e6f5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a77e5790314487bb0f11099e0ae5953'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:04.418146 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3020/5999] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:04 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:04.419195 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa508e8-26f7-4e2c-8fda-9bacce1f89a7 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:04.420558 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-4aa508e8-26f7-4e2c-8fda-9bacce1f89a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:04.490662 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa508e8-26f7-4e2c-8fda-9bacce1f89a7 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:04.496439 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c00d828-d3c7-41bc-8c91-07bef58ffedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:04.498759 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c00d828-d3c7-41bc-8c91-07bef58ffedf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:04.498759 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c00d828-d3c7-41bc-8c91-07bef58ffedf admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:04.498759 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c00d828-d3c7-41bc-8c91-07bef58ffedf admin admin] PATH_INFO: `/v3/users/143f617549794cc8989a200546acb66f` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:04.499872 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c00d828-d3c7-41bc-8c91-07bef58ffedf admin admin] RBAC: Authorizing `identity:delete_user(user_id=143f617549794cc8989a200546acb66f)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:04.501819 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c00d828-d3c7-41bc-8c91-07bef58ffedf admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:04.512420 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d3a737b7-d30a-4e19-b78b-d243634e6f5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a77e5790314487bb0f11099e0ae5953'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:04.532143 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d3a737b7-d30a-4e19-b78b-d243634e6f5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a77e5790314487bb0f11099e0ae5953'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:04.541129 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2980/6000] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:34:04 2022] DELETE /identity/v3/users/9a77e5790314487bb0f11099e0ae5953 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:04.542219 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a737b7-d30a-4e19-b78b-d243634e6f5d admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:04.544046 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-d3a737b7-d30a-4e19-b78b-d243634e6f5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:04.621424 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a737b7-d30a-4e19-b78b-d243634e6f5d admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:04.624431 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528af883-8c8a-436a-b732-0a4615465688 tempest-DefaultDomainTestJSON-1655645140 tempest-DefaultDomainTestJSON-1655645140-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '004a6a24f1984ad8b597069bf99cc018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '415a3b147fd74521bbcb82b069157bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:04.625755 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528af883-8c8a-436a-b732-0a4615465688 tempest-DefaultDomainTestJSON-1655645140 tempest-DefaultDomainTestJSON-1655645140-project] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:04.626206 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528af883-8c8a-436a-b732-0a4615465688 tempest-DefaultDomainTestJSON-1655645140 tempest-DefaultDomainTestJSON-1655645140-project] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:04.626652 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528af883-8c8a-436a-b732-0a4615465688 tempest-DefaultDomainTestJSON-1655645140 tempest-DefaultDomainTestJSON-1655645140-project] PATH_INFO: `/v3/domains/default` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:04.628076 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528af883-8c8a-436a-b732-0a4615465688 tempest-DefaultDomainTestJSON-1655645140 tempest-DefaultDomainTestJSON-1655645140-project] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:04.629934 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528af883-8c8a-436a-b732-0a4615465688 tempest-DefaultDomainTestJSON-1655645140 tempest-DefaultDomainTestJSON-1655645140-project] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:04.632117 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2981/6001] 10.222.0.52 () {58 vars in 1151 bytes} [Sat May 14 21:34:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:34:04.633519 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0c43a-fa03-44d2-a34d-429eaa191b54 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:04.633989 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0c43a-fa03-44d2-a34d-429eaa191b54 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:04.634524 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0c43a-fa03-44d2-a34d-429eaa191b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:04.652974 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-c4d0c43a-fa03-44d2-a34d-429eaa191b54 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:04.654182 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c4d0c43a-fa03-44d2-a34d-429eaa191b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:04.718097 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2982/6002] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:04.718961 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d0c43a-fa03-44d2-a34d-429eaa191b54 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:04.720370 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c4d0c43a-fa03-44d2-a34d-429eaa191b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:04.780997 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d0c43a-fa03-44d2-a34d-429eaa191b54 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:04.784703 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd34004-fb76-4157-b6a4-62fe8053cec8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:04.785356 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd34004-fb76-4157-b6a4-62fe8053cec8 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:04.785643 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd34004-fb76-4157-b6a4-62fe8053cec8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:04.785928 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd34004-fb76-4157-b6a4-62fe8053cec8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:04.787752 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-0dd34004-fb76-4157-b6a4-62fe8053cec8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:04.793997 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5c00d828-d3c7-41bc-8c91-07bef58ffedf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '143f617549794cc8989a200546acb66f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:04.806925 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5c00d828-d3c7-41bc-8c91-07bef58ffedf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '143f617549794cc8989a200546acb66f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:04.814111 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5c00d828-d3c7-41bc-8c91-07bef58ffedf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '143f617549794cc8989a200546acb66f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:04.846248 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd34004-fb76-4157-b6a4-62fe8053cec8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:04.847734 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd34004-fb76-4157-b6a4-62fe8053cec8 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:04.857463 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2983/6003] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:34:04 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:34:04.858320 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd34004-fb76-4157-b6a4-62fe8053cec8 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:04.859735 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-0dd34004-fb76-4157-b6a4-62fe8053cec8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:04.873493 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd34004-fb76-4157-b6a4-62fe8053cec8 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:04.878428 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b98eca0-28f0-4a2a-89bc-d3b82bfd7115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:04.879338 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b98eca0-28f0-4a2a-89bc-d3b82bfd7115 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:04.879667 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b98eca0-28f0-4a2a-89bc-d3b82bfd7115 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:04.879947 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b98eca0-28f0-4a2a-89bc-d3b82bfd7115 admin admin] PATH_INFO: `/v3/users/004a6a24f1984ad8b597069bf99cc018` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:04.881175 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b98eca0-28f0-4a2a-89bc-d3b82bfd7115 admin admin] RBAC: Authorizing `identity:delete_user(user_id=004a6a24f1984ad8b597069bf99cc018)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:04.883123 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b98eca0-28f0-4a2a-89bc-d3b82bfd7115 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:04.911602 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5c00d828-d3c7-41bc-8c91-07bef58ffedf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '143f617549794cc8989a200546acb66f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:04.912283 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5c00d828-d3c7-41bc-8c91-07bef58ffedf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '143f617549794cc8989a200546acb66f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:04.919731 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3021/6004] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:34:04 2022] DELETE /identity/v3/users/143f617549794cc8989a200546acb66f => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:04.920329 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c00d828-d3c7-41bc-8c91-07bef58ffedf admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:04.923611 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-5c00d828-d3c7-41bc-8c91-07bef58ffedf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:04.986309 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c00d828-d3c7-41bc-8c91-07bef58ffedf admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:04.989942 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bcdfc5-1bab-4b34-a0f6-fa69a85a56d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:04.990596 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bcdfc5-1bab-4b34-a0f6-fa69a85a56d9 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:04.990881 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bcdfc5-1bab-4b34-a0f6-fa69a85a56d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:04.991161 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bcdfc5-1bab-4b34-a0f6-fa69a85a56d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:04.993048 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-f8bcdfc5-1bab-4b34-a0f6-fa69a85a56d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:05.050365 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-1b98eca0-28f0-4a2a-89bc-d3b82bfd7115 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '004a6a24f1984ad8b597069bf99cc018'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:05.058072 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-1b98eca0-28f0-4a2a-89bc-d3b82bfd7115 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '004a6a24f1984ad8b597069bf99cc018'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:05.058863 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-1b98eca0-28f0-4a2a-89bc-d3b82bfd7115 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '004a6a24f1984ad8b597069bf99cc018'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:05.061438 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bcdfc5-1bab-4b34-a0f6-fa69a85a56d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:05.063051 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bcdfc5-1bab-4b34-a0f6-fa69a85a56d9 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:05.074032 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3022/6005] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:34:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:34:05.075363 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6340cf4f-f317-4b71-8c1e-6db9b20d97ed None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:05.075691 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6340cf4f-f317-4b71-8c1e-6db9b20d97ed None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:05.075976 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6340cf4f-f317-4b71-8c1e-6db9b20d97ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:05.097073 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-6340cf4f-f317-4b71-8c1e-6db9b20d97ed None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:05.098342 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-6340cf4f-f317-4b71-8c1e-6db9b20d97ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:05.108630 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3023/6006] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:05.120536 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6340cf4f-f317-4b71-8c1e-6db9b20d97ed None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:05.131857 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-1b98eca0-28f0-4a2a-89bc-d3b82bfd7115 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '004a6a24f1984ad8b597069bf99cc018'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:05.137466 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6340cf4f-f317-4b71-8c1e-6db9b20d97ed None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:05.144106 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c1afd6-9720-49cb-8d35-254cb8706382 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:05.145132 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1afd6-9720-49cb-8d35-254cb8706382 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:05.145600 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1afd6-9720-49cb-8d35-254cb8706382 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:05.146532 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1afd6-9720-49cb-8d35-254cb8706382 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:05.153823 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-1b98eca0-28f0-4a2a-89bc-d3b82bfd7115 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '004a6a24f1984ad8b597069bf99cc018'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:05.162085 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2984/6007] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:34:04 2022] DELETE /identity/v3/users/004a6a24f1984ad8b597069bf99cc018 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:05.166714 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e5085-f2bd-407e-98b9-0b9bba21ef37 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:05.168133 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c1afd6-9720-49cb-8d35-254cb8706382 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:05.169729 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c1afd6-9720-49cb-8d35-254cb8706382 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:05.170066 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e5085-f2bd-407e-98b9-0b9bba21ef37 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:05.170452 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e5085-f2bd-407e-98b9-0b9bba21ef37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:05.190918 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3024/6008] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:34:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:34:05.199525 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-0c2e5085-f2bd-407e-98b9-0b9bba21ef37 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:05.200603 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-0c2e5085-f2bd-407e-98b9-0b9bba21ef37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:05.268386 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2985/6009] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:05.283445 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c1afd6-9720-49cb-8d35-254cb8706382 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:05.285040 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-17c1afd6-9720-49cb-8d35-254cb8706382 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:05.298836 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c1afd6-9720-49cb-8d35-254cb8706382 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:05.348138 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0fe8e-c6dc-496b-b468-b633beff6832 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:05.348783 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0fe8e-c6dc-496b-b468-b633beff6832 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:05.349067 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0fe8e-c6dc-496b-b468-b633beff6832 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:05.349343 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0fe8e-c6dc-496b-b468-b633beff6832 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:05.358414 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a0fe8e-c6dc-496b-b468-b633beff6832 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:05.359868 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a0fe8e-c6dc-496b-b468-b633beff6832 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:05.369814 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3025/6010] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:34:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:34:05.687426 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e5085-f2bd-407e-98b9-0b9bba21ef37 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:05.689023 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-0c2e5085-f2bd-407e-98b9-0b9bba21ef37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:05.701530 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e5085-f2bd-407e-98b9-0b9bba21ef37 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:05.708711 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed90798e-4862-41f0-832f-f887d3884602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:05.710426 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed90798e-4862-41f0-832f-f887d3884602 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:05.710890 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed90798e-4862-41f0-832f-f887d3884602 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:05.711391 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed90798e-4862-41f0-832f-f887d3884602 admin admin] PATH_INFO: `/v3/projects/81c202907c9c412ea6dc5f2aa0f008e1` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:05.712904 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed90798e-4862-41f0-832f-f887d3884602 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81c202907c9c412ea6dc5f2aa0f008e1)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:05.715042 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed90798e-4862-41f0-832f-f887d3884602 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:05.791782 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0fe8e-c6dc-496b-b468-b633beff6832 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:05.793273 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-23a0fe8e-c6dc-496b-b468-b633beff6832 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:05.812208 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0fe8e-c6dc-496b-b468-b633beff6832 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:05.819551 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a9cef3-2fd9-4395-99cf-f3cf53382693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:05.821483 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9cef3-2fd9-4395-99cf-f3cf53382693 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:05.821990 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9cef3-2fd9-4395-99cf-f3cf53382693 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:05.822334 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9cef3-2fd9-4395-99cf-f3cf53382693 admin admin] PATH_INFO: `/v3/projects/a817c498d25142468b4239855fd084cf` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:05.824229 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a9cef3-2fd9-4395-99cf-f3cf53382693 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a817c498d25142468b4239855fd084cf)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:05.826797 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a9cef3-2fd9-4395-99cf-f3cf53382693 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:05.851881 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ed90798e-4862-41f0-832f-f887d3884602 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81c202907c9c412ea6dc5f2aa0f008e1', 'request_id': 'req-ed90798e-4862-41f0-832f-f887d3884602'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:05.880618 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ed90798e-4862-41f0-832f-f887d3884602 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81c202907c9c412ea6dc5f2aa0f008e1', 'request_id': 'req-ed90798e-4862-41f0-832f-f887d3884602'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:05.894667 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ed90798e-4862-41f0-832f-f887d3884602 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81c202907c9c412ea6dc5f2aa0f008e1', 'request_id': 'req-ed90798e-4862-41f0-832f-f887d3884602'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:06.004109 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d4a9cef3-2fd9-4395-99cf-f3cf53382693 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a817c498d25142468b4239855fd084cf', 'request_id': 'req-d4a9cef3-2fd9-4395-99cf-f3cf53382693'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:06.009871 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d4a9cef3-2fd9-4395-99cf-f3cf53382693 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a817c498d25142468b4239855fd084cf', 'request_id': 'req-d4a9cef3-2fd9-4395-99cf-f3cf53382693'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:06.077303 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ed90798e-4862-41f0-832f-f887d3884602 admin admin] The token cache is being invalidate because project 81c202907c9c412ea6dc5f2aa0f008e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:34:06.077735 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ed90798e-4862-41f0-832f-f887d3884602 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:06.078425 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ed90798e-4862-41f0-832f-f887d3884602 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:06.080308 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2986/6011] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:34:05 2022] DELETE /identity/v3/projects/81c202907c9c412ea6dc5f2aa0f008e1 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:06.083919 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed90798e-4862-41f0-832f-f887d3884602 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:06.085412 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-ed90798e-4862-41f0-832f-f887d3884602 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:06.171619 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed90798e-4862-41f0-832f-f887d3884602 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:06.185518 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d4a9cef3-2fd9-4395-99cf-f3cf53382693 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a817c498d25142468b4239855fd084cf', 'request_id': 'req-d4a9cef3-2fd9-4395-99cf-f3cf53382693'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:06.200567 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d4a9cef3-2fd9-4395-99cf-f3cf53382693 admin admin] The token cache is being invalidate because project a817c498d25142468b4239855fd084cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:34:06.200913 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d4a9cef3-2fd9-4395-99cf-f3cf53382693 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:06.201604 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d4a9cef3-2fd9-4395-99cf-f3cf53382693 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:06.203150 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3026/6012] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:34:05 2022] DELETE /identity/v3/projects/a817c498d25142468b4239855fd084cf => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:06.204018 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a9cef3-2fd9-4395-99cf-f3cf53382693 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:06.205287 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d4a9cef3-2fd9-4395-99cf-f3cf53382693 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:06.241922 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e64439-5b96-4edc-8b46-29c705a428d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:06.243687 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e64439-5b96-4edc-8b46-29c705a428d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:06.244138 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e64439-5b96-4edc-8b46-29c705a428d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:06.244413 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e64439-5b96-4edc-8b46-29c705a428d5 admin admin] PATH_INFO: `/v3/users/7f72e1e37c3f4c698f9eb5d4390c92c5` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:06.245655 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e64439-5b96-4edc-8b46-29c705a428d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f72e1e37c3f4c698f9eb5d4390c92c5)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:06.247762 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e64439-5b96-4edc-8b46-29c705a428d5 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:06.276492 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a9cef3-2fd9-4395-99cf-f3cf53382693 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:06.290303 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d9185-5371-42da-82f4-6bb068bf71ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:06.290303 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d9185-5371-42da-82f4-6bb068bf71ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:06.290303 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d9185-5371-42da-82f4-6bb068bf71ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:06.290303 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d9185-5371-42da-82f4-6bb068bf71ee admin admin] PATH_INFO: `/v3/projects/415a3b147fd74521bbcb82b069157bcf` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:06.290756 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5d9185-5371-42da-82f4-6bb068bf71ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=415a3b147fd74521bbcb82b069157bcf)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:06.290756 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5d9185-5371-42da-82f4-6bb068bf71ee admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:06.502313 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-01e64439-5b96-4edc-8b46-29c705a428d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f72e1e37c3f4c698f9eb5d4390c92c5'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:06.503590 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3e5d9185-5371-42da-82f4-6bb068bf71ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '415a3b147fd74521bbcb82b069157bcf', 'request_id': 'req-3e5d9185-5371-42da-82f4-6bb068bf71ee'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:06.512014 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-01e64439-5b96-4edc-8b46-29c705a428d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f72e1e37c3f4c698f9eb5d4390c92c5'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:06.512014 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-01e64439-5b96-4edc-8b46-29c705a428d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f72e1e37c3f4c698f9eb5d4390c92c5'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:06.514671 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3e5d9185-5371-42da-82f4-6bb068bf71ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '415a3b147fd74521bbcb82b069157bcf', 'request_id': 'req-3e5d9185-5371-42da-82f4-6bb068bf71ee'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:06.600152 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-01e64439-5b96-4edc-8b46-29c705a428d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f72e1e37c3f4c698f9eb5d4390c92c5'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:06.613738 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-01e64439-5b96-4edc-8b46-29c705a428d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f72e1e37c3f4c698f9eb5d4390c92c5'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:06.620610 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2987/6013] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:34:06 2022] DELETE /identity/v3/users/7f72e1e37c3f4c698f9eb5d4390c92c5 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:34:06.624233 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e64439-5b96-4edc-8b46-29c705a428d5 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:06.625592 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-01e64439-5b96-4edc-8b46-29c705a428d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:06.659978 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3e5d9185-5371-42da-82f4-6bb068bf71ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '415a3b147fd74521bbcb82b069157bcf', 'request_id': 'req-3e5d9185-5371-42da-82f4-6bb068bf71ee'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:06.681389 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3e5d9185-5371-42da-82f4-6bb068bf71ee admin admin] The token cache is being invalidate because project 415a3b147fd74521bbcb82b069157bcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:34:06.681710 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3e5d9185-5371-42da-82f4-6bb068bf71ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:06.682527 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3e5d9185-5371-42da-82f4-6bb068bf71ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:06.690290 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3027/6014] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:34:06 2022] DELETE /identity/v3/projects/415a3b147fd74521bbcb82b069157bcf => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:06.691249 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d9185-5371-42da-82f4-6bb068bf71ee admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:06.692703 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-3e5d9185-5371-42da-82f4-6bb068bf71ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:06.701419 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e64439-5b96-4edc-8b46-29c705a428d5 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:06.710460 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fbe8f1-29ef-4f08-ba72-b1192ed6e938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:06.710460 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fbe8f1-29ef-4f08-ba72-b1192ed6e938 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:06.710460 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fbe8f1-29ef-4f08-ba72-b1192ed6e938 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:06.710460 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fbe8f1-29ef-4f08-ba72-b1192ed6e938 admin admin] PATH_INFO: `/v3/users/83951651c26f4e138a05108f0fe37ea8` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:06.711664 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fbe8f1-29ef-4f08-ba72-b1192ed6e938 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83951651c26f4e138a05108f0fe37ea8)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:06.714035 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fbe8f1-29ef-4f08-ba72-b1192ed6e938 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:06.779976 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d9185-5371-42da-82f4-6bb068bf71ee admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:06.785159 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b5432b-d22d-4eb7-8e81-580cb355f1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:06.786126 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b5432b-d22d-4eb7-8e81-580cb355f1ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:06.786477 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b5432b-d22d-4eb7-8e81-580cb355f1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:06.786832 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b5432b-d22d-4eb7-8e81-580cb355f1ae admin admin] PATH_INFO: `/v3/users/2316af2f472948a2bba9cd59951f37a5` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:06.788194 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b5432b-d22d-4eb7-8e81-580cb355f1ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=2316af2f472948a2bba9cd59951f37a5)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:06.793333 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b5432b-d22d-4eb7-8e81-580cb355f1ae admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:06.927371 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-84fbe8f1-29ef-4f08-ba72-b1192ed6e938 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83951651c26f4e138a05108f0fe37ea8'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:06.934845 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-84fbe8f1-29ef-4f08-ba72-b1192ed6e938 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83951651c26f4e138a05108f0fe37ea8'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:06.935705 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-84fbe8f1-29ef-4f08-ba72-b1192ed6e938 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83951651c26f4e138a05108f0fe37ea8'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:07.054118 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-84fbe8f1-29ef-4f08-ba72-b1192ed6e938 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83951651c26f4e138a05108f0fe37ea8'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:07.071877 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-84fbe8f1-29ef-4f08-ba72-b1192ed6e938 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83951651c26f4e138a05108f0fe37ea8'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:07.072123 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e0b5432b-d22d-4eb7-8e81-580cb355f1ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2316af2f472948a2bba9cd59951f37a5'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:07.086250 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e0b5432b-d22d-4eb7-8e81-580cb355f1ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2316af2f472948a2bba9cd59951f37a5'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:07.091406 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2988/6015] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:34:06 2022] DELETE /identity/v3/users/83951651c26f4e138a05108f0fe37ea8 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:07.092955 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bffddf3-ad47-4415-85d5-b32c82439acf None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:07.093243 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bffddf3-ad47-4415-85d5-b32c82439acf None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:07.093527 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bffddf3-ad47-4415-85d5-b32c82439acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:07.094014 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e0b5432b-d22d-4eb7-8e81-580cb355f1ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2316af2f472948a2bba9cd59951f37a5'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:07.119340 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-1bffddf3-ad47-4415-85d5-b32c82439acf None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:07.120723 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-1bffddf3-ad47-4415-85d5-b32c82439acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:07.191382 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e0b5432b-d22d-4eb7-8e81-580cb355f1ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2316af2f472948a2bba9cd59951f37a5'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:07.191382 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e0b5432b-d22d-4eb7-8e81-580cb355f1ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2316af2f472948a2bba9cd59951f37a5'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:07.197708 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3028/6016] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:34:06 2022] DELETE /identity/v3/users/2316af2f472948a2bba9cd59951f37a5 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:07.199396 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b5432b-d22d-4eb7-8e81-580cb355f1ae admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:07.201233 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e0b5432b-d22d-4eb7-8e81-580cb355f1ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:07.219859 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2989/6017] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:07.222708 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738bb7c3-86ae-4e08-bc83-65507517376f None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:07.223008 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738bb7c3-86ae-4e08-bc83-65507517376f None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:07.223375 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738bb7c3-86ae-4e08-bc83-65507517376f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:07.251619 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-738bb7c3-86ae-4e08-bc83-65507517376f None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:07.254687 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-738bb7c3-86ae-4e08-bc83-65507517376f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:07.305994 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b5432b-d22d-4eb7-8e81-580cb355f1ae admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:07.310414 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e2b316-4c38-4a0f-a7d6-f5d35eeeca30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:07.311584 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2b316-4c38-4a0f-a7d6-f5d35eeeca30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:07.311960 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2b316-4c38-4a0f-a7d6-f5d35eeeca30 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:07.312305 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2b316-4c38-4a0f-a7d6-f5d35eeeca30 admin admin] PATH_INFO: `/v3/projects/a329d238f3f74c22907b2e021f31b7bb` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:07.313599 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e2b316-4c38-4a0f-a7d6-f5d35eeeca30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a329d238f3f74c22907b2e021f31b7bb)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:07.315662 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e2b316-4c38-4a0f-a7d6-f5d35eeeca30 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:07.337207 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2990/6018] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:07.338156 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6029a-6ed5-4396-9526-003540b19971 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:07.338453 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6029a-6ed5-4396-9526-003540b19971 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:07.339113 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6029a-6ed5-4396-9526-003540b19971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:07.361853 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-bdf6029a-6ed5-4396-9526-003540b19971 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:07.363135 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-bdf6029a-6ed5-4396-9526-003540b19971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:07.373330 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2991/6019] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:07.375059 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf6029a-6ed5-4396-9526-003540b19971 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:07.376769 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-bdf6029a-6ed5-4396-9526-003540b19971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:07.443132 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf6029a-6ed5-4396-9526-003540b19971 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:07.448948 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-72e2b316-4c38-4a0f-a7d6-f5d35eeeca30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a329d238f3f74c22907b2e021f31b7bb', 'request_id': 'req-72e2b316-4c38-4a0f-a7d6-f5d35eeeca30'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:07.456447 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-72e2b316-4c38-4a0f-a7d6-f5d35eeeca30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a329d238f3f74c22907b2e021f31b7bb', 'request_id': 'req-72e2b316-4c38-4a0f-a7d6-f5d35eeeca30'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:07.495925 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2dcc6d-1b33-4d94-8a60-72e358dae2b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:07.496583 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2dcc6d-1b33-4d94-8a60-72e358dae2b1 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:07.496870 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2dcc6d-1b33-4d94-8a60-72e358dae2b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:07.497148 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2dcc6d-1b33-4d94-8a60-72e358dae2b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:07.515701 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-72e2b316-4c38-4a0f-a7d6-f5d35eeeca30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a329d238f3f74c22907b2e021f31b7bb', 'request_id': 'req-72e2b316-4c38-4a0f-a7d6-f5d35eeeca30'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:07.528807 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-72e2b316-4c38-4a0f-a7d6-f5d35eeeca30 admin admin] The token cache is being invalidate because project a329d238f3f74c22907b2e021f31b7bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:34:07.529181 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-72e2b316-4c38-4a0f-a7d6-f5d35eeeca30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:07.529851 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-72e2b316-4c38-4a0f-a7d6-f5d35eeeca30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:07.531462 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3029/6020] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:34:07 2022] DELETE /identity/v3/projects/a329d238f3f74c22907b2e021f31b7bb => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:07.532251 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e2b316-4c38-4a0f-a7d6-f5d35eeeca30 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:07.533552 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-72e2b316-4c38-4a0f-a7d6-f5d35eeeca30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:07.565283 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2dcc6d-1b33-4d94-8a60-72e358dae2b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:07.566735 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2dcc6d-1b33-4d94-8a60-72e358dae2b1 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:07.577770 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2992/6021] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:34:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:34:07.579869 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a3405-cff9-4c78-97e8-7ca54439843a None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:07.579869 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a3405-cff9-4c78-97e8-7ca54439843a None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:07.580094 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a3405-cff9-4c78-97e8-7ca54439843a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:07.600722 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-b21a3405-cff9-4c78-97e8-7ca54439843a None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:07.602093 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b21a3405-cff9-4c78-97e8-7ca54439843a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:07.612362 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2993/6022] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:07.617323 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e2b316-4c38-4a0f-a7d6-f5d35eeeca30 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:07.620824 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d49e93-a68f-4e78-b7cd-cc325e762f19 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:07.621377 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d49e93-a68f-4e78-b7cd-cc325e762f19 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:07.621893 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d49e93-a68f-4e78-b7cd-cc325e762f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:07.625715 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7779af83-86b6-48e0-9719-ef29ee95ab36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:07.626815 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779af83-86b6-48e0-9719-ef29ee95ab36 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:07.627192 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779af83-86b6-48e0-9719-ef29ee95ab36 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:07.627771 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779af83-86b6-48e0-9719-ef29ee95ab36 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:07.629096 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7779af83-86b6-48e0-9719-ef29ee95ab36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:34:07.629515 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7779af83-86b6-48e0-9719-ef29ee95ab36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:07.631688 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7779af83-86b6-48e0-9719-ef29ee95ab36 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:07.646683 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-c7d49e93-a68f-4e78-b7cd-cc325e762f19 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:07.649589 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3030/6023] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:34:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:34:07.650535 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c7d49e93-a68f-4e78-b7cd-cc325e762f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:07.653649 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7779af83-86b6-48e0-9719-ef29ee95ab36 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:07.669973 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2994/6024] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:07.669973 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d49e93-a68f-4e78-b7cd-cc325e762f19 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:07.679836 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c7d49e93-a68f-4e78-b7cd-cc325e762f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:07.679972 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7779af83-86b6-48e0-9719-ef29ee95ab36 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:07.681251 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162aa9e9-5350-493e-8fc0-fbdbe3f2f021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:07.681916 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162aa9e9-5350-493e-8fc0-fbdbe3f2f021 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:07.682216 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162aa9e9-5350-493e-8fc0-fbdbe3f2f021 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:07.682465 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162aa9e9-5350-493e-8fc0-fbdbe3f2f021 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:07.683267 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162aa9e9-5350-493e-8fc0-fbdbe3f2f021 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:07.685195 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162aa9e9-5350-493e-8fc0-fbdbe3f2f021 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:07.707395 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d49e93-a68f-4e78-b7cd-cc325e762f19 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:07.712185 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a865450-5219-44b0-bec7-56f110c4c63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:07.713661 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a865450-5219-44b0-bec7-56f110c4c63b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:07.713949 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a865450-5219-44b0-bec7-56f110c4c63b admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:07.714228 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a865450-5219-44b0-bec7-56f110c4c63b admin admin] PATH_INFO: `/v3/projects/6cdd622c16cd46e2b8f1476076af3f39` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:07.715685 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a865450-5219-44b0-bec7-56f110c4c63b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cdd622c16cd46e2b8f1476076af3f39)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:07.717614 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a865450-5219-44b0-bec7-56f110c4c63b admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:07.834936 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3031/6025] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:34:07 2022] POST /identity/v3/projects => generated 385 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:34:07.835831 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162aa9e9-5350-493e-8fc0-fbdbe3f2f021 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:07.906071 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-6a865450-5219-44b0-bec7-56f110c4c63b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cdd622c16cd46e2b8f1476076af3f39', 'request_id': 'req-6a865450-5219-44b0-bec7-56f110c4c63b'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:07.916549 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-6a865450-5219-44b0-bec7-56f110c4c63b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cdd622c16cd46e2b8f1476076af3f39', 'request_id': 'req-6a865450-5219-44b0-bec7-56f110c4c63b'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:07.925102 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-6a865450-5219-44b0-bec7-56f110c4c63b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cdd622c16cd46e2b8f1476076af3f39', 'request_id': 'req-6a865450-5219-44b0-bec7-56f110c4c63b'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:07.930297 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162aa9e9-5350-493e-8fc0-fbdbe3f2f021 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:07.989206 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8032f24c-532a-4d21-b0e9-212b0faeba0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:07.989883 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032f24c-532a-4d21-b0e9-212b0faeba0f admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:07.990188 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032f24c-532a-4d21-b0e9-212b0faeba0f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:07.990474 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032f24c-532a-4d21-b0e9-212b0faeba0f admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:07.991195 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8032f24c-532a-4d21-b0e9-212b0faeba0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:34:07.991672 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8032f24c-532a-4d21-b0e9-212b0faeba0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:07.993997 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8032f24c-532a-4d21-b0e9-212b0faeba0f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:08.005528 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3032/6026] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:34:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:34:08.006494 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8032f24c-532a-4d21-b0e9-212b0faeba0f admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:08.017030 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8032f24c-532a-4d21-b0e9-212b0faeba0f admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:08.022140 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a69de36-7993-4489-a98d-959f16385a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:08.022839 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a69de36-7993-4489-a98d-959f16385a70 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:08.023124 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a69de36-7993-4489-a98d-959f16385a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:08.023407 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a69de36-7993-4489-a98d-959f16385a70 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:08.024329 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a69de36-7993-4489-a98d-959f16385a70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:08.024854 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-6a865450-5219-44b0-bec7-56f110c4c63b admin admin] The token cache is being invalidate because project 6cdd622c16cd46e2b8f1476076af3f39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:34:08.025226 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-6a865450-5219-44b0-bec7-56f110c4c63b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:08.025973 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-6a865450-5219-44b0-bec7-56f110c4c63b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:08.026200 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a69de36-7993-4489-a98d-959f16385a70 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:08.027735 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2995/6027] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:34:07 2022] DELETE /identity/v3/projects/6cdd622c16cd46e2b8f1476076af3f39 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:08.028527 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a865450-5219-44b0-bec7-56f110c4c63b admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:08.030002 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-6a865450-5219-44b0-bec7-56f110c4c63b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:08.043159 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a865450-5219-44b0-bec7-56f110c4c63b admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:08.047877 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e27977-8468-49d3-b667-3f2cb90e38ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:08.048517 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e27977-8468-49d3-b667-3f2cb90e38ab admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:08.048799 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e27977-8468-49d3-b667-3f2cb90e38ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:08.049071 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e27977-8468-49d3-b667-3f2cb90e38ab admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:08.049741 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e27977-8468-49d3-b667-3f2cb90e38ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:08.051670 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e27977-8468-49d3-b667-3f2cb90e38ab admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:08.135451 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3033/6028] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:34:08 2022] POST /identity/v3/users => generated 293 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:34:08.135451 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3336dc2-9931-4057-8911-cdc0d64969a3 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:08.135451 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3336dc2-9931-4057-8911-cdc0d64969a3 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:08.135451 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3336dc2-9931-4057-8911-cdc0d64969a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:08.143586 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2996/6029] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:34:08 2022] POST /identity/v3/projects => generated 369 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:34:08.143586 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e27977-8468-49d3-b667-3f2cb90e38ab admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:08.143586 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-23e27977-8468-49d3-b667-3f2cb90e38ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:08.155947 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-d3336dc2-9931-4057-8911-cdc0d64969a3 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:08.157173 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d3336dc2-9931-4057-8911-cdc0d64969a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:08.214369 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e27977-8468-49d3-b667-3f2cb90e38ab admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:08.217992 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3034/6030] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:08.218923 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3336dc2-9931-4057-8911-cdc0d64969a3 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:08.224874 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d3336dc2-9931-4057-8911-cdc0d64969a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:08.225453 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d9196-66d1-47af-8fcf-2d7498a071a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:08.226423 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d9196-66d1-47af-8fcf-2d7498a071a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:08.226748 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d9196-66d1-47af-8fcf-2d7498a071a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:08.227598 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d9196-66d1-47af-8fcf-2d7498a071a1 admin admin] PATH_INFO: `/v3/projects/88c8745ee478438bb57cc3b7ffe73fc8` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:08.229001 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0d9196-66d1-47af-8fcf-2d7498a071a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88c8745ee478438bb57cc3b7ffe73fc8)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:08.230975 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0d9196-66d1-47af-8fcf-2d7498a071a1 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:08.237531 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3336dc2-9931-4057-8911-cdc0d64969a3 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:08.242331 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5927c980-4c4a-4e2e-9ab6-a8bc5ffdbff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:08.243207 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5927c980-4c4a-4e2e-9ab6-a8bc5ffdbff7 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:08.243517 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5927c980-4c4a-4e2e-9ab6-a8bc5ffdbff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:08.243800 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5927c980-4c4a-4e2e-9ab6-a8bc5ffdbff7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:08.244515 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5927c980-4c4a-4e2e-9ab6-a8bc5ffdbff7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:08.246100 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5927c980-4c4a-4e2e-9ab6-a8bc5ffdbff7 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:08.256288 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3035/6031] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:34:08 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:34:08.257092 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5927c980-4c4a-4e2e-9ab6-a8bc5ffdbff7 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:08.267369 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5927c980-4c4a-4e2e-9ab6-a8bc5ffdbff7 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:08.272677 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc373fe0-942e-4de0-b817-9ca9d5ae54a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:08.278291 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc373fe0-942e-4de0-b817-9ca9d5ae54a1 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:08.278291 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc373fe0-942e-4de0-b817-9ca9d5ae54a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:08.278291 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc373fe0-942e-4de0-b817-9ca9d5ae54a1 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:08.278291 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc373fe0-942e-4de0-b817-9ca9d5ae54a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:08.278291 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc373fe0-942e-4de0-b817-9ca9d5ae54a1 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:08.370122 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0b0d9196-66d1-47af-8fcf-2d7498a071a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88c8745ee478438bb57cc3b7ffe73fc8', 'request_id': 'req-0b0d9196-66d1-47af-8fcf-2d7498a071a1'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:08.375833 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0b0d9196-66d1-47af-8fcf-2d7498a071a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88c8745ee478438bb57cc3b7ffe73fc8', 'request_id': 'req-0b0d9196-66d1-47af-8fcf-2d7498a071a1'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:08.384619 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0b0d9196-66d1-47af-8fcf-2d7498a071a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88c8745ee478438bb57cc3b7ffe73fc8', 'request_id': 'req-0b0d9196-66d1-47af-8fcf-2d7498a071a1'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:08.417801 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3036/6032] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:34:08 2022] POST /identity/v3/users => generated 285 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:34:08.419266 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c8c685-d518-4ee5-9cd1-3fbc755a9a14 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:08.419590 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c8c685-d518-4ee5-9cd1-3fbc755a9a14 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:08.419905 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c8c685-d518-4ee5-9cd1-3fbc755a9a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:08.438441 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-70c8c685-d518-4ee5-9cd1-3fbc755a9a14 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:08.439707 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-70c8c685-d518-4ee5-9cd1-3fbc755a9a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:08.502819 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3037/6033] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:08.502977 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0b0d9196-66d1-47af-8fcf-2d7498a071a1 admin admin] The token cache is being invalidate because project 88c8745ee478438bb57cc3b7ffe73fc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:34:08.502977 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0b0d9196-66d1-47af-8fcf-2d7498a071a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:08.503202 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c8c685-d518-4ee5-9cd1-3fbc755a9a14 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:08.503297 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0b0d9196-66d1-47af-8fcf-2d7498a071a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:08.505113 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2997/6034] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:34:08 2022] DELETE /identity/v3/projects/88c8745ee478438bb57cc3b7ffe73fc8 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:08.505836 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d9196-66d1-47af-8fcf-2d7498a071a1 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:08.507503 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-0b0d9196-66d1-47af-8fcf-2d7498a071a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:08.512763 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c8c685-d518-4ee5-9cd1-3fbc755a9a14 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:08.517711 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e830798f-06a6-4dcd-8f46-589c2006c88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:08.518408 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830798f-06a6-4dcd-8f46-589c2006c88c admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:08.520798 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830798f-06a6-4dcd-8f46-589c2006c88c admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:08.520798 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830798f-06a6-4dcd-8f46-589c2006c88c admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:08.520798 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e830798f-06a6-4dcd-8f46-589c2006c88c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:08.521261 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e830798f-06a6-4dcd-8f46-589c2006c88c admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:08.521884 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d9196-66d1-47af-8fcf-2d7498a071a1 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:08.526690 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27144400-0615-467a-8878-6caeacdc2351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:08.527360 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27144400-0615-467a-8878-6caeacdc2351 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:08.527690 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27144400-0615-467a-8878-6caeacdc2351 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:08.527974 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27144400-0615-467a-8878-6caeacdc2351 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:08.528701 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27144400-0615-467a-8878-6caeacdc2351 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:08.530293 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27144400-0615-467a-8878-6caeacdc2351 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:08.531804 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3038/6035] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:34:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:34:08.532616 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e830798f-06a6-4dcd-8f46-589c2006c88c admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:08.534206 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e830798f-06a6-4dcd-8f46-589c2006c88c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:08.545116 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2998/6036] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:34:08 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:34:08.545116 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27144400-0615-467a-8878-6caeacdc2351 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:08.550990 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-27144400-0615-467a-8878-6caeacdc2351 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:08.551109 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e830798f-06a6-4dcd-8f46-589c2006c88c admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:08.551341 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447c780e-0ccd-470f-ab62-54b7918ad372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:08.551999 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c780e-0ccd-470f-ab62-54b7918ad372 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:08.552283 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c780e-0ccd-470f-ab62-54b7918ad372 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:08.552564 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c780e-0ccd-470f-ab62-54b7918ad372 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:08.553279 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447c780e-0ccd-470f-ab62-54b7918ad372 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:34:08.553594 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447c780e-0ccd-470f-ab62-54b7918ad372 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:08.556162 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447c780e-0ccd-470f-ab62-54b7918ad372 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:08.559992 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27144400-0615-467a-8878-6caeacdc2351 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:08.564706 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b3adb8-57b3-4cd3-a644-19d7fbf88735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:08.565568 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b3adb8-57b3-4cd3-a644-19d7fbf88735 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:08.565908 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b3adb8-57b3-4cd3-a644-19d7fbf88735 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:08.566195 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b3adb8-57b3-4cd3-a644-19d7fbf88735 admin admin] PATH_INFO: `/v3/users/ca595b8d105a4bd7a652948a7537b438` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:08.568899 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3039/6037] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:34:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:34:08.569706 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447c780e-0ccd-470f-ab62-54b7918ad372 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:08.572617 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-447c780e-0ccd-470f-ab62-54b7918ad372 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:08.572838 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b3adb8-57b3-4cd3-a644-19d7fbf88735 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca595b8d105a4bd7a652948a7537b438)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:08.575208 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b3adb8-57b3-4cd3-a644-19d7fbf88735 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:08.585269 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447c780e-0ccd-470f-ab62-54b7918ad372 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:08.590604 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c32410-d863-4a83-8def-e307cd466a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:08.591747 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c32410-d863-4a83-8def-e307cd466a6b admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:08.592036 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c32410-d863-4a83-8def-e307cd466a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:08.592318 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c32410-d863-4a83-8def-e307cd466a6b admin admin] PATH_INFO: `/v3/projects/c44381aa7d104743a382b437425dcedb/users/7e957956c8df4ae987e28723f1fef30a/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:08.606912 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c32410-d863-4a83-8def-e307cd466a6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c44381aa7d104743a382b437425dcedb, user_id=7e957956c8df4ae987e28723f1fef30a, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:08.609700 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c32410-d863-4a83-8def-e307cd466a6b admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:08.700016 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3040/6038] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:34:08 2022] PUT /identity/v3/projects/c44381aa7d104743a382b437425dcedb/users/7e957956c8df4ae987e28723f1fef30a/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:08.700914 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c32410-d863-4a83-8def-e307cd466a6b admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:08.737084 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-43b3adb8-57b3-4cd3-a644-19d7fbf88735 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca595b8d105a4bd7a652948a7537b438'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:08.745040 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-43b3adb8-57b3-4cd3-a644-19d7fbf88735 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca595b8d105a4bd7a652948a7537b438'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:08.745940 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-43b3adb8-57b3-4cd3-a644-19d7fbf88735 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca595b8d105a4bd7a652948a7537b438'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:08.771155 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c32410-d863-4a83-8def-e307cd466a6b admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:08.776203 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f811d116-29e4-4130-b903-3324abb8fc3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:08.776876 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811d116-29e4-4130-b903-3324abb8fc3f admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:08.777161 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811d116-29e4-4130-b903-3324abb8fc3f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:08.777444 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811d116-29e4-4130-b903-3324abb8fc3f admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:08.778168 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f811d116-29e4-4130-b903-3324abb8fc3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:08.779794 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f811d116-29e4-4130-b903-3324abb8fc3f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:08.790605 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3041/6039] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:34:08 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:34:08.792090 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f811d116-29e4-4130-b903-3324abb8fc3f admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:08.804811 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f811d116-29e4-4130-b903-3324abb8fc3f admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:08.816281 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292fa06e-fb9e-4916-bc7e-e97923247335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:08.816281 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292fa06e-fb9e-4916-bc7e-e97923247335 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:08.816281 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292fa06e-fb9e-4916-bc7e-e97923247335 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:08.816281 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292fa06e-fb9e-4916-bc7e-e97923247335 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:08.816603 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292fa06e-fb9e-4916-bc7e-e97923247335 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:08.816603 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292fa06e-fb9e-4916-bc7e-e97923247335 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:08.876761 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-43b3adb8-57b3-4cd3-a644-19d7fbf88735 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca595b8d105a4bd7a652948a7537b438'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:08.889966 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-43b3adb8-57b3-4cd3-a644-19d7fbf88735 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca595b8d105a4bd7a652948a7537b438'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:08.896366 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 2999/6040] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:34:08 2022] DELETE /identity/v3/users/ca595b8d105a4bd7a652948a7537b438 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:08.897731 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc302c-57c8-41ae-89f4-daa4580a2806 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:08.898026 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc302c-57c8-41ae-89f4-daa4580a2806 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:08.898358 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc302c-57c8-41ae-89f4-daa4580a2806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:08.929822 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-80bc302c-57c8-41ae-89f4-daa4580a2806 None None] MFA Rules not processed for user `7e957956c8df4ae987e28723f1fef30a`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:08.932215 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-80bc302c-57c8-41ae-89f4-daa4580a2806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:08.997793 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3042/6041] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:34:08 2022] POST /identity/v3/projects => generated 391 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:34:08.998976 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292fa06e-fb9e-4916-bc7e-e97923247335 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:09.002390 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-292fa06e-fb9e-4916-bc7e-e97923247335 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:09.038843 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3000/6042] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:09.040597 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bc302c-57c8-41ae-89f4-daa4580a2806 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:09.041969 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-80bc302c-57c8-41ae-89f4-daa4580a2806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:09.081503 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292fa06e-fb9e-4916-bc7e-e97923247335 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:09.086225 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c329d068-58f3-47be-9c14-a1aa81308cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:09.087932 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c329d068-58f3-47be-9c14-a1aa81308cb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:09.088215 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c329d068-58f3-47be-9c14-a1aa81308cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:09.088489 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c329d068-58f3-47be-9c14-a1aa81308cb7 admin admin] PATH_INFO: `/v3/projects/6ac9d212545f4b64bbca41e474fd9c08/users/eb49b0f450324eb3bade523412add786/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:09.103646 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c329d068-58f3-47be-9c14-a1aa81308cb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ac9d212545f4b64bbca41e474fd9c08, user_id=eb49b0f450324eb3bade523412add786, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:09.106285 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bc302c-57c8-41ae-89f4-daa4580a2806 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:09.106447 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c329d068-58f3-47be-9c14-a1aa81308cb7 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:09.111453 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ce60a4-1319-4a53-b04b-43d14f9f3404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:09.112181 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce60a4-1319-4a53-b04b-43d14f9f3404 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:09.112470 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce60a4-1319-4a53-b04b-43d14f9f3404 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:09.112751 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce60a4-1319-4a53-b04b-43d14f9f3404 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:09.113499 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ce60a4-1319-4a53-b04b-43d14f9f3404 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:09.115584 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ce60a4-1319-4a53-b04b-43d14f9f3404 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:09.207012 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3043/6043] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:34:08 2022] PUT /identity/v3/projects/6ac9d212545f4b64bbca41e474fd9c08/users/eb49b0f450324eb3bade523412add786/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:09.208243 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c329d068-58f3-47be-9c14-a1aa81308cb7 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:09.217607 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c329d068-58f3-47be-9c14-a1aa81308cb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:09.254454 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3001/6044] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:34:09 2022] POST /identity/v3/users => generated 296 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:34:09.255991 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571f90b-07b6-47ba-8ef5-c9420be50b76 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:09.256393 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571f90b-07b6-47ba-8ef5-c9420be50b76 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:09.256773 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571f90b-07b6-47ba-8ef5-c9420be50b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:09.292311 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c329d068-58f3-47be-9c14-a1aa81308cb7 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:09.295689 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-a571f90b-07b6-47ba-8ef5-c9420be50b76 None None] MFA Rules not processed for user `eb49b0f450324eb3bade523412add786`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:09.296996 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-a571f90b-07b6-47ba-8ef5-c9420be50b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:09.298125 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1ec704-561f-47ef-a673-3c6cf693543e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:09.299006 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1ec704-561f-47ef-a673-3c6cf693543e admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:09.299302 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1ec704-561f-47ef-a673-3c6cf693543e admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:09.299614 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1ec704-561f-47ef-a673-3c6cf693543e admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:09.300311 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1ec704-561f-47ef-a673-3c6cf693543e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:09.302233 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1ec704-561f-47ef-a673-3c6cf693543e admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:09.371575 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3002/6045] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:09 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:09.372513 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a571f90b-07b6-47ba-8ef5-c9420be50b76 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:09.382699 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a571f90b-07b6-47ba-8ef5-c9420be50b76 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:09.388421 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5415fa9-edc7-419e-941f-3b3601646205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:09.389144 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5415fa9-edc7-419e-941f-3b3601646205 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:09.389432 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5415fa9-edc7-419e-941f-3b3601646205 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:09.389712 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5415fa9-edc7-419e-941f-3b3601646205 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:09.390429 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5415fa9-edc7-419e-941f-3b3601646205 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:09.392079 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5415fa9-edc7-419e-941f-3b3601646205 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:09.402361 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3003/6046] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:34:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:34:09.403074 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5415fa9-edc7-419e-941f-3b3601646205 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:09.412371 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5415fa9-edc7-419e-941f-3b3601646205 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:09.417639 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4613223-8460-4b19-a531-6a6744bedd48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:09.423436 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4613223-8460-4b19-a531-6a6744bedd48 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:09.423436 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4613223-8460-4b19-a531-6a6744bedd48 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:09.423436 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4613223-8460-4b19-a531-6a6744bedd48 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:09.423436 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4613223-8460-4b19-a531-6a6744bedd48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:09.423436 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4613223-8460-4b19-a531-6a6744bedd48 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:09.450506 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3044/6047] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:34:09 2022] POST /identity/v3/projects => generated 385 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:34:09.451712 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1ec704-561f-47ef-a673-3c6cf693543e admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:09.502922 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3004/6048] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:34:09 2022] POST /identity/v3/projects => generated 369 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:34:09.504204 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4613223-8460-4b19-a531-6a6744bedd48 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:09.531338 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1ec704-561f-47ef-a673-3c6cf693543e admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:09.571658 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4613223-8460-4b19-a531-6a6744bedd48 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:09.576095 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a20e624-2341-482a-bc81-1a22b06d015c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:09.576775 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20e624-2341-482a-bc81-1a22b06d015c admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:09.577056 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20e624-2341-482a-bc81-1a22b06d015c admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:09.577333 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20e624-2341-482a-bc81-1a22b06d015c admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:09.578025 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a20e624-2341-482a-bc81-1a22b06d015c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:09.580023 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a20e624-2341-482a-bc81-1a22b06d015c admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:09.596774 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463404a6-7e88-4738-819d-14d9a299e986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:09.597923 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463404a6-7e88-4738-819d-14d9a299e986 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:09.598516 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463404a6-7e88-4738-819d-14d9a299e986 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:09.598883 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463404a6-7e88-4738-819d-14d9a299e986 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:09.599762 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463404a6-7e88-4738-819d-14d9a299e986 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:09.601566 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463404a6-7e88-4738-819d-14d9a299e986 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:09.618474 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3045/6049] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:34:09 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:34:09.618474 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463404a6-7e88-4738-819d-14d9a299e986 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:09.618474 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-463404a6-7e88-4738-819d-14d9a299e986 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:09.633083 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463404a6-7e88-4738-819d-14d9a299e986 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:09.640214 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c25fc-9165-45df-865d-6e5ffc50cab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:09.640898 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c25fc-9165-45df-865d-6e5ffc50cab0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:09.641181 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c25fc-9165-45df-865d-6e5ffc50cab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:09.641545 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c25fc-9165-45df-865d-6e5ffc50cab0 admin admin] PATH_INFO: `/v3/projects/6b09813cd5054b258baf9a2e719749c1` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:09.644141 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579c25fc-9165-45df-865d-6e5ffc50cab0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b09813cd5054b258baf9a2e719749c1)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:09.647057 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579c25fc-9165-45df-865d-6e5ffc50cab0 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:09.679129 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3005/6050] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:34:09 2022] POST /identity/v3/users => generated 293 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:34:09.680731 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a20e624-2341-482a-bc81-1a22b06d015c admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:09.692766 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a20e624-2341-482a-bc81-1a22b06d015c admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:09.698089 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f96058c-baeb-4e1c-b69c-4ccc4f35a7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:09.698544 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f96058c-baeb-4e1c-b69c-4ccc4f35a7b3 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:09.698825 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f96058c-baeb-4e1c-b69c-4ccc4f35a7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:09.699101 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f96058c-baeb-4e1c-b69c-4ccc4f35a7b3 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:09.699855 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f96058c-baeb-4e1c-b69c-4ccc4f35a7b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:09.701772 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f96058c-baeb-4e1c-b69c-4ccc4f35a7b3 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:09.779592 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3006/6051] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:34:09 2022] POST /identity/v3/users => generated 291 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:34:09.779592 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f96058c-baeb-4e1c-b69c-4ccc4f35a7b3 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:09.787858 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f96058c-baeb-4e1c-b69c-4ccc4f35a7b3 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:09.791747 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-579c25fc-9165-45df-865d-6e5ffc50cab0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b09813cd5054b258baf9a2e719749c1', 'request_id': 'req-579c25fc-9165-45df-865d-6e5ffc50cab0'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:09.797120 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-579c25fc-9165-45df-865d-6e5ffc50cab0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b09813cd5054b258baf9a2e719749c1', 'request_id': 'req-579c25fc-9165-45df-865d-6e5ffc50cab0'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:09.848415 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2067c143-7604-4849-905c-4208684aca18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:09.849307 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067c143-7604-4849-905c-4208684aca18 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:09.849613 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067c143-7604-4849-905c-4208684aca18 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:09.849890 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067c143-7604-4849-905c-4208684aca18 admin admin] PATH_INFO: `/v3/projects/5d1c19b791654ed0b9facf59e9b2357f/users/edf93cf4adf642efb9673e3ae72dd0ae/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:09.866191 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2067c143-7604-4849-905c-4208684aca18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d1c19b791654ed0b9facf59e9b2357f, user_id=edf93cf4adf642efb9673e3ae72dd0ae, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:09.868947 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2067c143-7604-4849-905c-4208684aca18 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:09.874465 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-579c25fc-9165-45df-865d-6e5ffc50cab0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b09813cd5054b258baf9a2e719749c1', 'request_id': 'req-579c25fc-9165-45df-865d-6e5ffc50cab0'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:09.886097 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-579c25fc-9165-45df-865d-6e5ffc50cab0 admin admin] The token cache is being invalidate because project 6b09813cd5054b258baf9a2e719749c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:34:09.886383 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-579c25fc-9165-45df-865d-6e5ffc50cab0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:09.887036 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-579c25fc-9165-45df-865d-6e5ffc50cab0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:09.888729 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3046/6052] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:34:09 2022] DELETE /identity/v3/projects/6b09813cd5054b258baf9a2e719749c1 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:09.889491 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c25fc-9165-45df-865d-6e5ffc50cab0 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:09.890821 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-579c25fc-9165-45df-865d-6e5ffc50cab0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:09.904197 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c25fc-9165-45df-865d-6e5ffc50cab0 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:09.908925 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950fa004-2bb4-4acb-9ad6-2ec4c21543b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:09.915324 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950fa004-2bb4-4acb-9ad6-2ec4c21543b0 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:09.915324 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950fa004-2bb4-4acb-9ad6-2ec4c21543b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:09.915324 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950fa004-2bb4-4acb-9ad6-2ec4c21543b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:09.915324 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950fa004-2bb4-4acb-9ad6-2ec4c21543b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:09.915324 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950fa004-2bb4-4acb-9ad6-2ec4c21543b0 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:09.923327 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3047/6053] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:34:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:34:09.924042 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950fa004-2bb4-4acb-9ad6-2ec4c21543b0 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:09.926734 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-950fa004-2bb4-4acb-9ad6-2ec4c21543b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:09.950379 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950fa004-2bb4-4acb-9ad6-2ec4c21543b0 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:09.950379 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9082e5-35a9-4da2-b2fe-f88406f12ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:09.950379 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9082e5-35a9-4da2-b2fe-f88406f12ed4 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:09.950379 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9082e5-35a9-4da2-b2fe-f88406f12ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:09.951351 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9082e5-35a9-4da2-b2fe-f88406f12ed4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:09.951351 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9082e5-35a9-4da2-b2fe-f88406f12ed4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:09.951351 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9082e5-35a9-4da2-b2fe-f88406f12ed4 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:09.958896 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3048/6054] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:34:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:34:09.960303 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f69b9-c226-4bc4-ae55-37f6ee236299 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:09.960662 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f69b9-c226-4bc4-ae55-37f6ee236299 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:09.961014 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f69b9-c226-4bc4-ae55-37f6ee236299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:09.972594 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3007/6055] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:34:09 2022] PUT /identity/v3/projects/5d1c19b791654ed0b9facf59e9b2357f/users/edf93cf4adf642efb9673e3ae72dd0ae/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:09.974551 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2067c143-7604-4849-905c-4208684aca18 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:09.989239 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-c70f69b9-c226-4bc4-ae55-37f6ee236299 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:09.990463 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c70f69b9-c226-4bc4-ae55-37f6ee236299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:10.042260 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2067c143-7604-4849-905c-4208684aca18 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:10.046985 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9df9d99-843f-4d61-938d-4e54f15fbdde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:10.047683 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df9d99-843f-4d61-938d-4e54f15fbdde admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:10.047965 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df9d99-843f-4d61-938d-4e54f15fbdde admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:10.048250 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df9d99-843f-4d61-938d-4e54f15fbdde admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:10.049007 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9df9d99-843f-4d61-938d-4e54f15fbdde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:10.050638 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9df9d99-843f-4d61-938d-4e54f15fbdde admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:10.052797 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3049/6056] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:10.053788 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70f69b9-c226-4bc4-ae55-37f6ee236299 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:10.063522 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3008/6057] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:34:09 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:34:10.063522 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672586ea-ccaa-4197-ab6e-9f68c161a938 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:10.063815 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672586ea-ccaa-4197-ab6e-9f68c161a938 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:10.063908 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672586ea-ccaa-4197-ab6e-9f68c161a938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:10.064774 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70f69b9-c226-4bc4-ae55-37f6ee236299 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:10.069658 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c3af42-769d-4184-b84b-442ade3e5b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:10.070542 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3af42-769d-4184-b84b-442ade3e5b22 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:10.070878 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3af42-769d-4184-b84b-442ade3e5b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:10.071283 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3af42-769d-4184-b84b-442ade3e5b22 admin admin] PATH_INFO: `/v3/projects/829ec5c876a244508f4f4ba36b1e332d/users/4b2c730729bc414a9eda1eb1e63e2726/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:10.087315 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c3af42-769d-4184-b84b-442ade3e5b22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=829ec5c876a244508f4f4ba36b1e332d, user_id=4b2c730729bc414a9eda1eb1e63e2726, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:10.090239 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c3af42-769d-4184-b84b-442ade3e5b22 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:10.093893 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-672586ea-ccaa-4197-ab6e-9f68c161a938 None None] MFA Rules not processed for user `edf93cf4adf642efb9673e3ae72dd0ae`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:10.095421 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-672586ea-ccaa-4197-ab6e-9f68c161a938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:10.160547 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3009/6058] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:10.161968 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c5221-633f-4e02-b6c3-755fbb97efd2 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:10.162262 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c5221-633f-4e02-b6c3-755fbb97efd2 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:10.162542 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c5221-633f-4e02-b6c3-755fbb97efd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:10.181212 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-079c5221-633f-4e02-b6c3-755fbb97efd2 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:10.183014 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-079c5221-633f-4e02-b6c3-755fbb97efd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:10.186323 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3050/6059] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:34:10 2022] PUT /identity/v3/projects/829ec5c876a244508f4f4ba36b1e332d/users/4b2c730729bc414a9eda1eb1e63e2726/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:10.187198 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c3af42-769d-4184-b84b-442ade3e5b22 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:10.247428 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3010/6060] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:10.248594 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079c5221-633f-4e02-b6c3-755fbb97efd2 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:10.261079 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c3af42-769d-4184-b84b-442ade3e5b22 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:10.265928 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f8ecc-7f3e-4655-924d-3d5b5516eff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:10.266846 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f8ecc-7f3e-4655-924d-3d5b5516eff2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:10.267384 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f8ecc-7f3e-4655-924d-3d5b5516eff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:10.267719 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f8ecc-7f3e-4655-924d-3d5b5516eff2 admin admin] PATH_INFO: `/v3/projects/d5a76b72cce44047aba65ab9b0ebe59d/users/a317c0093fa842c394b3b60b3b6cc7fd/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:10.283095 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364f8ecc-7f3e-4655-924d-3d5b5516eff2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5a76b72cce44047aba65ab9b0ebe59d, user_id=a317c0093fa842c394b3b60b3b6cc7fd, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:10.285804 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364f8ecc-7f3e-4655-924d-3d5b5516eff2 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:10.309803 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079c5221-633f-4e02-b6c3-755fbb97efd2 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:10.314264 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085eb0b3-4c1d-486b-b4cc-d1af699dac54 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf93cf4adf642efb9673e3ae72dd0ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1c19b791654ed0b9facf59e9b2357f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:10.320944 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085eb0b3-4c1d-486b-b4cc-d1af699dac54 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:10.320944 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085eb0b3-4c1d-486b-b4cc-d1af699dac54 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:10.320944 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085eb0b3-4c1d-486b-b4cc-d1af699dac54 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] PATH_INFO: `/v3/users/edf93cf4adf642efb9673e3ae72dd0ae/application_credentials` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:10.320944 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085eb0b3-4c1d-486b-b4cc-d1af699dac54 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] RBAC: Authorizing `identity:create_application_credential(user_id=edf93cf4adf642efb9673e3ae72dd0ae)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:10.321333 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085eb0b3-4c1d-486b-b4cc-d1af699dac54 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:10.380582 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3051/6061] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:34:10 2022] PUT /identity/v3/projects/d5a76b72cce44047aba65ab9b0ebe59d/users/a317c0093fa842c394b3b60b3b6cc7fd/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:10.381599 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f8ecc-7f3e-4655-924d-3d5b5516eff2 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:10.451304 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f8ecc-7f3e-4655-924d-3d5b5516eff2 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:10.455962 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c13256b-e7a7-4bea-b9ec-6e384b5e139a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:10.456629 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c13256b-e7a7-4bea-b9ec-6e384b5e139a admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:10.456914 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c13256b-e7a7-4bea-b9ec-6e384b5e139a admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:10.457196 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c13256b-e7a7-4bea-b9ec-6e384b5e139a admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:10.457916 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c13256b-e7a7-4bea-b9ec-6e384b5e139a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:10.459862 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c13256b-e7a7-4bea-b9ec-6e384b5e139a admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:10.467553 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3011/6062] 10.222.0.52 () {60 vars in 1313 bytes} [Sat May 14 21:34:10 2022] POST /identity/v3/users/edf93cf4adf642efb9673e3ae72dd0ae/application_credentials => generated 788 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:34:10.468527 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085eb0b3-4c1d-486b-b4cc-d1af699dac54 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:10.477309 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3052/6063] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:34:10 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:34:10.478719 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c3597-25b7-46c6-a793-82b6b1203d06 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:10.479236 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c3597-25b7-46c6-a793-82b6b1203d06 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:10.479539 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c3597-25b7-46c6-a793-82b6b1203d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:10.482727 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085eb0b3-4c1d-486b-b4cc-d1af699dac54 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:10.489941 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c485e11-990e-4d5f-993e-c9119743e601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:10.490706 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c485e11-990e-4d5f-993e-c9119743e601 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:10.491087 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c485e11-990e-4d5f-993e-c9119743e601 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:10.491430 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c485e11-990e-4d5f-993e-c9119743e601 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:10.492256 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c485e11-990e-4d5f-993e-c9119743e601 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:34:10.494009 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c485e11-990e-4d5f-993e-c9119743e601 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:10.495739 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c485e11-990e-4d5f-993e-c9119743e601 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:10.507991 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-c80c3597-25b7-46c6-a793-82b6b1203d06 None None] MFA Rules not processed for user `a317c0093fa842c394b3b60b3b6cc7fd`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:10.509856 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c80c3597-25b7-46c6-a793-82b6b1203d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:10.511780 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3012/6064] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:34:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:34:10.516128 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c485e11-990e-4d5f-993e-c9119743e601 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:10.581866 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c485e11-990e-4d5f-993e-c9119743e601 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:10.583655 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3053/6065] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:10.584582 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80c3597-25b7-46c6-a793-82b6b1203d06 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:10.592224 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64cb234-9593-4aa3-bf1f-ea7196b88ff5 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf93cf4adf642efb9673e3ae72dd0ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1c19b791654ed0b9facf59e9b2357f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:10.593187 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64cb234-9593-4aa3-bf1f-ea7196b88ff5 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:10.593529 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64cb234-9593-4aa3-bf1f-ea7196b88ff5 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:10.593874 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64cb234-9593-4aa3-bf1f-ea7196b88ff5 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] PATH_INFO: `/v3/users/edf93cf4adf642efb9673e3ae72dd0ae/application_credentials/336baac00abc4fbfb01868b0c93d5e4d` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:10.603854 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80c3597-25b7-46c6-a793-82b6b1203d06 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:10.604920 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64cb234-9593-4aa3-bf1f-ea7196b88ff5 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] RBAC: Authorizing `identity:get_application_credential(user_id=edf93cf4adf642efb9673e3ae72dd0ae, application_credential_id=336baac00abc4fbfb01868b0c93d5e4d)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:10.606730 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64cb234-9593-4aa3-bf1f-ea7196b88ff5 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:10.608722 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3013/6066] 10.222.0.52 () {58 vars in 1391 bytes} [Sat May 14 21:34:10 2022] GET /identity/v3/users/edf93cf4adf642efb9673e3ae72dd0ae/application_credentials/336baac00abc4fbfb01868b0c93d5e4d => generated 688 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:34:10.612276 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64cb234-9593-4aa3-bf1f-ea7196b88ff5 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:10.612389 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7de831-7395-4f55-b79d-6cb6da404c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:10.612389 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7de831-7395-4f55-b79d-6cb6da404c4e admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:10.612389 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7de831-7395-4f55-b79d-6cb6da404c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:10.612389 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7de831-7395-4f55-b79d-6cb6da404c4e admin admin] PATH_INFO: `/v3/projects/829ec5c876a244508f4f4ba36b1e332d/users/4b2c730729bc414a9eda1eb1e63e2726/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:10.613628 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7de831-7395-4f55-b79d-6cb6da404c4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=829ec5c876a244508f4f4ba36b1e332d, user_id=4b2c730729bc414a9eda1eb1e63e2726, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:10.616347 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7de831-7395-4f55-b79d-6cb6da404c4e admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:10.621162 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64cb234-9593-4aa3-bf1f-ea7196b88ff5 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:10.628155 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3054/6067] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:34:10 2022] PUT /identity/v3/projects/829ec5c876a244508f4f4ba36b1e332d/users/4b2c730729bc414a9eda1eb1e63e2726/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:10.628993 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7de831-7395-4f55-b79d-6cb6da404c4e admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:10.639814 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-0b7de831-7395-4f55-b79d-6cb6da404c4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:10.697384 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf46eb0-bfcc-4b8e-a225-bee309ef919c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:10.698045 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf46eb0-bfcc-4b8e-a225-bee309ef919c admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:10.698330 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf46eb0-bfcc-4b8e-a225-bee309ef919c admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:10.698605 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf46eb0-bfcc-4b8e-a225-bee309ef919c admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:10.699284 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf46eb0-bfcc-4b8e-a225-bee309ef919c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:10.701236 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf46eb0-bfcc-4b8e-a225-bee309ef919c admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:10.732144 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7de831-7395-4f55-b79d-6cb6da404c4e admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:10.735877 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e89ee80-dc65-4c5e-b16b-756beebe6e18 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b5cb86f190f4fcfb06d66cb8f14643f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:10.736523 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89ee80-dc65-4c5e-b16b-756beebe6e18 service glance] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:10.736810 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89ee80-dc65-4c5e-b16b-756beebe6e18 service glance] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:10.737084 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89ee80-dc65-4c5e-b16b-756beebe6e18 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:10.738909 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-3e89ee80-dc65-4c5e-b16b-756beebe6e18 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:10.797123 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3014/6068] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:34:10 2022] POST /identity/v3/projects => generated 397 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:34:10.799327 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce646719-514c-441a-ab2a-6754c4a9763e None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:10.799647 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce646719-514c-441a-ab2a-6754c4a9763e None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:10.799929 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce646719-514c-441a-ab2a-6754c4a9763e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:10.804303 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e89ee80-dc65-4c5e-b16b-756beebe6e18 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:10.805774 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e89ee80-dc65-4c5e-b16b-756beebe6e18 service glance] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:10.816521 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-ce646719-514c-441a-ab2a-6754c4a9763e None None] MFA Rules not processed for user `edf93cf4adf642efb9673e3ae72dd0ae`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:10.817818 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-ce646719-514c-441a-ab2a-6754c4a9763e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:10.818827 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3055/6069] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:34:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:34:10.820524 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35906e3c-d03d-4fda-86bb-ca033f1e5e25 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:10.821086 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35906e3c-d03d-4fda-86bb-ca033f1e5e25 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:10.821368 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35906e3c-d03d-4fda-86bb-ca033f1e5e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:10.855811 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-35906e3c-d03d-4fda-86bb-ca033f1e5e25 None None] MFA Rules not processed for user `4b2c730729bc414a9eda1eb1e63e2726`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:10.857125 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-35906e3c-d03d-4fda-86bb-ca033f1e5e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:10.947643 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3015/6070] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:10 2022] POST /identity/v3/auth/tokens => generated 3414 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) May 14 21:34:10.948558 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce646719-514c-441a-ab2a-6754c4a9763e None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:10.958538 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3056/6071] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:10 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:10.959450 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35906e3c-d03d-4fda-86bb-ca033f1e5e25 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:11.027158 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35906e3c-d03d-4fda-86bb-ca033f1e5e25 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:11.028233 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce646719-514c-441a-ab2a-6754c4a9763e None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:11.031954 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822ea019-b63c-4870-8c98-d17510e3cca9 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf93cf4adf642efb9673e3ae72dd0ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1c19b791654ed0b9facf59e9b2357f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:11.033009 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ea019-b63c-4870-8c98-d17510e3cca9 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:11.033159 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56883b8b-b42a-4313-a25f-969d024d7ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:11.033296 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ea019-b63c-4870-8c98-d17510e3cca9 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:11.033571 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ea019-b63c-4870-8c98-d17510e3cca9 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] PATH_INFO: `/v3/users/edf93cf4adf642efb9673e3ae72dd0ae/application_credentials/336baac00abc4fbfb01868b0c93d5e4d` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:11.033807 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56883b8b-b42a-4313-a25f-969d024d7ccf admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:11.034093 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56883b8b-b42a-4313-a25f-969d024d7ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:11.034372 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56883b8b-b42a-4313-a25f-969d024d7ccf admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:11.035008 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822ea019-b63c-4870-8c98-d17510e3cca9 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] RBAC: Authorizing `identity:delete_application_credential(user_id=edf93cf4adf642efb9673e3ae72dd0ae, application_credential_id=336baac00abc4fbfb01868b0c93d5e4d)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:11.035114 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56883b8b-b42a-4313-a25f-969d024d7ccf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:11.036615 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822ea019-b63c-4870-8c98-d17510e3cca9 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:11.037044 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56883b8b-b42a-4313-a25f-969d024d7ccf admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:11.139248 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3057/6072] 10.222.0.52 () {58 vars in 1394 bytes} [Sat May 14 21:34:10 2022] DELETE /identity/v3/users/edf93cf4adf642efb9673e3ae72dd0ae/application_credentials/336baac00abc4fbfb01868b0c93d5e4d => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:11.139248 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822ea019-b63c-4870-8c98-d17510e3cca9 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:11.139572 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3016/6073] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:34:10 2022] POST /identity/v3/users => generated 299 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:34:11.140466 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56883b8b-b42a-4313-a25f-969d024d7ccf admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:11.151425 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822ea019-b63c-4870-8c98-d17510e3cca9 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:11.157020 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c42590e-e6fa-4a67-bcf3-fc2d2b2dc3ab tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2c730729bc414a9eda1eb1e63e2726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '829ec5c876a244508f4f4ba36b1e332d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:11.157682 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42590e-e6fa-4a67-bcf3-fc2d2b2dc3ab tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:11.159035 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42590e-e6fa-4a67-bcf3-fc2d2b2dc3ab tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:11.159035 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42590e-e6fa-4a67-bcf3-fc2d2b2dc3ab tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] PATH_INFO: `/v3/services` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:11.159035 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c42590e-e6fa-4a67-bcf3-fc2d2b2dc3ab tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:11.161026 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c42590e-e6fa-4a67-bcf3-fc2d2b2dc3ab tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:11.200516 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56883b8b-b42a-4313-a25f-969d024d7ccf admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:11.204272 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f879b408-047a-45c8-8fa8-4aa99d03f900 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b5cb86f190f4fcfb06d66cb8f14643f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:11.204971 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879b408-047a-45c8-8fa8-4aa99d03f900 service glance] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:11.205254 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879b408-047a-45c8-8fa8-4aa99d03f900 service glance] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:11.205529 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879b408-047a-45c8-8fa8-4aa99d03f900 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:11.262167 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f879b408-047a-45c8-8fa8-4aa99d03f900 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:11.263584 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f879b408-047a-45c8-8fa8-4aa99d03f900 service glance] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:11.273103 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3017/6074] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:34:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:34:11.274776 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f879b408-047a-45c8-8fa8-4aa99d03f900 service glance] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:11.285852 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f879b408-047a-45c8-8fa8-4aa99d03f900 service glance] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:11.292939 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca7b75-9bef-4711-9269-dbc2612ade25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:11.293865 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca7b75-9bef-4711-9269-dbc2612ade25 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:11.294323 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca7b75-9bef-4711-9269-dbc2612ade25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:11.294603 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca7b75-9bef-4711-9269-dbc2612ade25 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:11.295321 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fca7b75-9bef-4711-9269-dbc2612ade25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:11.297075 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3058/6075] 10.222.0.52 () {60 vars in 1151 bytes} [Sat May 14 21:34:11 2022] POST /identity/v3/services => generated 241 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:34:11.300661 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fca7b75-9bef-4711-9269-dbc2612ade25 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:11.302640 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c42590e-e6fa-4a67-bcf3-fc2d2b2dc3ab tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:11.311202 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3018/6076] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:34:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:34:11.312066 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca7b75-9bef-4711-9269-dbc2612ade25 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:11.326850 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca7b75-9bef-4711-9269-dbc2612ade25 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:11.330675 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c42590e-e6fa-4a67-bcf3-fc2d2b2dc3ab tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:11.341612 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d557584b-7789-40cf-b52c-8d0221afd3ac tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf93cf4adf642efb9673e3ae72dd0ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1c19b791654ed0b9facf59e9b2357f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:11.343422 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d557584b-7789-40cf-b52c-8d0221afd3ac tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:11.343422 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d557584b-7789-40cf-b52c-8d0221afd3ac tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:11.343870 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d557584b-7789-40cf-b52c-8d0221afd3ac tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] PATH_INFO: `/v3/users/edf93cf4adf642efb9673e3ae72dd0ae/application_credentials` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:11.344615 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d557584b-7789-40cf-b52c-8d0221afd3ac tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] RBAC: Authorizing `identity:create_application_credential(user_id=edf93cf4adf642efb9673e3ae72dd0ae)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:11.345776 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d557584b-7789-40cf-b52c-8d0221afd3ac tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:11.351971 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2bebea-4c66-4347-888e-edde0bfb6153 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2c730729bc414a9eda1eb1e63e2726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '829ec5c876a244508f4f4ba36b1e332d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:11.354043 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2bebea-4c66-4347-888e-edde0bfb6153 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:11.354427 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2bebea-4c66-4347-888e-edde0bfb6153 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:11.354807 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2bebea-4c66-4347-888e-edde0bfb6153 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] PATH_INFO: `/v3/services/4d8f0aaeb6db4368921202a4411a4f2c` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:11.355912 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2bebea-4c66-4347-888e-edde0bfb6153 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] RBAC: Authorizing `identity:delete_service(service_id=4d8f0aaeb6db4368921202a4411a4f2c)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:11.358376 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2bebea-4c66-4347-888e-edde0bfb6153 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:11.517764 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3019/6077] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:34:11 2022] DELETE /identity/v3/services/4d8f0aaeb6db4368921202a4411a4f2c => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:11.521863 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2bebea-4c66-4347-888e-edde0bfb6153 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:11.545892 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3059/6078] 10.222.0.52 () {60 vars in 1314 bytes} [Sat May 14 21:34:11 2022] POST /identity/v3/users/edf93cf4adf642efb9673e3ae72dd0ae/application_credentials => generated 920 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:34:11.547156 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d557584b-7789-40cf-b52c-8d0221afd3ac tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:11.549890 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2bebea-4c66-4347-888e-edde0bfb6153 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:11.563857 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d557584b-7789-40cf-b52c-8d0221afd3ac tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:11.565684 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bdcead-28a7-40b2-baf0-96e826b53804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:11.566554 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bdcead-28a7-40b2-baf0-96e826b53804 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:11.566834 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bdcead-28a7-40b2-baf0-96e826b53804 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:11.567126 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bdcead-28a7-40b2-baf0-96e826b53804 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:11.567961 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bdcead-28a7-40b2-baf0-96e826b53804 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:11.569620 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bdcead-28a7-40b2-baf0-96e826b53804 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:11.584421 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3020/6079] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:34:11 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:34:11.584641 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e4450-3e72-43c5-b0e5-713ce6e292fd tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2c730729bc414a9eda1eb1e63e2726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '829ec5c876a244508f4f4ba36b1e332d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:11.584764 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bdcead-28a7-40b2-baf0-96e826b53804 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:11.586524 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e4450-3e72-43c5-b0e5-713ce6e292fd tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:11.586524 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e4450-3e72-43c5-b0e5-713ce6e292fd tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:11.586524 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e4450-3e72-43c5-b0e5-713ce6e292fd tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] PATH_INFO: `/v3/services` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:11.586524 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7e4450-3e72-43c5-b0e5-713ce6e292fd tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:11.586524 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7e4450-3e72-43c5-b0e5-713ce6e292fd tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:11.610745 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bdcead-28a7-40b2-baf0-96e826b53804 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:11.615812 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9304f93e-931b-43f0-8d45-33e2b79fe126 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf93cf4adf642efb9673e3ae72dd0ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1c19b791654ed0b9facf59e9b2357f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:11.616778 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9304f93e-931b-43f0-8d45-33e2b79fe126 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:11.621049 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9304f93e-931b-43f0-8d45-33e2b79fe126 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:11.621049 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9304f93e-931b-43f0-8d45-33e2b79fe126 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] PATH_INFO: `/v3/users/edf93cf4adf642efb9673e3ae72dd0ae/application_credentials/9d806bc3146c4466a311065327557222` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:11.628453 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9304f93e-931b-43f0-8d45-33e2b79fe126 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] RBAC: Authorizing `identity:delete_application_credential(user_id=edf93cf4adf642efb9673e3ae72dd0ae, application_credential_id=9d806bc3146c4466a311065327557222)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:11.629965 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9304f93e-931b-43f0-8d45-33e2b79fe126 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:11.676735 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3060/6080] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:34:11 2022] POST /identity/v3/services => generated 288 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:34:11.676735 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e4450-3e72-43c5-b0e5-713ce6e292fd tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:11.700125 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e4450-3e72-43c5-b0e5-713ce6e292fd tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:11.707380 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13e6b33-a135-44ce-91bb-4ac613206038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:11.707380 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e6b33-a135-44ce-91bb-4ac613206038 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:11.707380 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e6b33-a135-44ce-91bb-4ac613206038 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:11.707380 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e6b33-a135-44ce-91bb-4ac613206038 admin admin] PATH_INFO: `/v3/projects/b5b858647966413b879a40dae63bc55c/users/ec1b48e9b1c543e09ece4fec1b666c80/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:11.721748 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13e6b33-a135-44ce-91bb-4ac613206038 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5b858647966413b879a40dae63bc55c, user_id=ec1b48e9b1c543e09ece4fec1b666c80, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:11.724476 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13e6b33-a135-44ce-91bb-4ac613206038 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:11.761954 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3021/6081] 10.222.0.52 () {58 vars in 1394 bytes} [Sat May 14 21:34:11 2022] DELETE /identity/v3/users/edf93cf4adf642efb9673e3ae72dd0ae/application_credentials/9d806bc3146c4466a311065327557222 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:11.762831 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9304f93e-931b-43f0-8d45-33e2b79fe126 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:11.774757 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9304f93e-931b-43f0-8d45-33e2b79fe126 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:11.790066 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e11594-e055-415d-80f8-8dcb72875862 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2c730729bc414a9eda1eb1e63e2726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '829ec5c876a244508f4f4ba36b1e332d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:11.791149 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e11594-e055-415d-80f8-8dcb72875862 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:11.791436 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e11594-e055-415d-80f8-8dcb72875862 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:11.793558 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e11594-e055-415d-80f8-8dcb72875862 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] PATH_INFO: `/v3/services/b92b16c25b124a5b9f011dd57f32f7af` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:11.793558 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e11594-e055-415d-80f8-8dcb72875862 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] RBAC: Authorizing `identity:update_service(service_id=b92b16c25b124a5b9f011dd57f32f7af)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:11.793558 ncdv-master-1 devstack@keystone.service[91107]: WARNING py.warnings [None req-c0e11594-e055-415d-80f8-8dcb72875862 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:34:11.793558 ncdv-master-1 devstack@keystone.service[91107]: warnings.warn(msg) May 14 21:34:11.793558 ncdv-master-1 devstack@keystone.service[91107]: May 14 21:34:11.794311 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e11594-e055-415d-80f8-8dcb72875862 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:11.817988 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3061/6082] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:34:11 2022] PUT /identity/v3/projects/b5b858647966413b879a40dae63bc55c/users/ec1b48e9b1c543e09ece4fec1b666c80/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:11.819334 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de09a95a-7c41-46f5-94ea-f3be8f9973eb None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:11.819717 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de09a95a-7c41-46f5-94ea-f3be8f9973eb None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:11.820050 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de09a95a-7c41-46f5-94ea-f3be8f9973eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:11.839179 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-de09a95a-7c41-46f5-94ea-f3be8f9973eb None None] MFA Rules not processed for user `cbb8c5cf2d144e3791171eb3d6f83eca`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:11.840468 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-de09a95a-7c41-46f5-94ea-f3be8f9973eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:11.875356 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3022/6083] 10.222.0.52 () {60 vars in 1251 bytes} [Sat May 14 21:34:11 2022] PATCH /identity/v3/services/b92b16c25b124a5b9f011dd57f32f7af => generated 282 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:34:11.876784 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e11594-e055-415d-80f8-8dcb72875862 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:11.902562 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e11594-e055-415d-80f8-8dcb72875862 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:11.918715 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3062/6084] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:11 2022] POST /identity/v3/auth/tokens => generated 3390 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:11.920256 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947fdf97-04ce-4124-b55c-a0fffa84ab35 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:11.920545 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947fdf97-04ce-4124-b55c-a0fffa84ab35 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:11.920822 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947fdf97-04ce-4124-b55c-a0fffa84ab35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:11.953639 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-947fdf97-04ce-4124-b55c-a0fffa84ab35 None None] MFA Rules not processed for user `ec1b48e9b1c543e09ece4fec1b666c80`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:11.954835 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-947fdf97-04ce-4124-b55c-a0fffa84ab35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:11.991655 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec2794-167c-41df-996c-e67808717f6a tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf93cf4adf642efb9673e3ae72dd0ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1c19b791654ed0b9facf59e9b2357f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:11.992741 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec2794-167c-41df-996c-e67808717f6a tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:11.993243 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec2794-167c-41df-996c-e67808717f6a tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:11.993527 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec2794-167c-41df-996c-e67808717f6a tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] PATH_INFO: `/v3/users/edf93cf4adf642efb9673e3ae72dd0ae/application_credentials` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:11.994297 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ec2794-167c-41df-996c-e67808717f6a tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] RBAC: Authorizing `identity:create_application_credential(user_id=edf93cf4adf642efb9673e3ae72dd0ae)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:11.995721 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ec2794-167c-41df-996c-e67808717f6a tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:12.035534 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3063/6085] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:11 2022] POST /identity/v3/auth/tokens => generated 3396 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:12.036723 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947fdf97-04ce-4124-b55c-a0fffa84ab35 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:12.115384 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947fdf97-04ce-4124-b55c-a0fffa84ab35 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:12.120943 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8528c5e1-02b2-4d43-9d6f-22ea2e3b3ef5 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2c730729bc414a9eda1eb1e63e2726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '829ec5c876a244508f4f4ba36b1e332d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:12.121830 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8528c5e1-02b2-4d43-9d6f-22ea2e3b3ef5 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:12.122115 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8528c5e1-02b2-4d43-9d6f-22ea2e3b3ef5 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:12.122390 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8528c5e1-02b2-4d43-9d6f-22ea2e3b3ef5 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] PATH_INFO: `/v3/services/b92b16c25b124a5b9f011dd57f32f7af` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:12.123048 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8528c5e1-02b2-4d43-9d6f-22ea2e3b3ef5 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] RBAC: Authorizing `identity:get_service(service_id=b92b16c25b124a5b9f011dd57f32f7af)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:12.124097 ncdv-master-1 devstack@keystone.service[91106]: WARNING py.warnings [None req-8528c5e1-02b2-4d43-9d6f-22ea2e3b3ef5 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:34:12.124097 ncdv-master-1 devstack@keystone.service[91106]: warnings.warn(msg) May 14 21:34:12.124097 ncdv-master-1 devstack@keystone.service[91106]: May 14 21:34:12.125017 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8528c5e1-02b2-4d43-9d6f-22ea2e3b3ef5 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:12.134991 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3064/6086] 10.222.0.52 () {58 vars in 1229 bytes} [Sat May 14 21:34:12 2022] GET /identity/v3/services/b92b16c25b124a5b9f011dd57f32f7af => generated 282 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:34:12.134991 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8528c5e1-02b2-4d43-9d6f-22ea2e3b3ef5 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:12.134991 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-8528c5e1-02b2-4d43-9d6f-22ea2e3b3ef5 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:12.146807 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3023/6087] 10.222.0.52 () {60 vars in 1314 bytes} [Sat May 14 21:34:11 2022] POST /identity/v3/users/edf93cf4adf642efb9673e3ae72dd0ae/application_credentials => generated 812 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:34:12.148171 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec2794-167c-41df-996c-e67808717f6a tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:12.211686 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8528c5e1-02b2-4d43-9d6f-22ea2e3b3ef5 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:12.215854 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5432e6fc-9be3-407c-98a9-523811318d45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:12.217912 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432e6fc-9be3-407c-98a9-523811318d45 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:12.217912 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432e6fc-9be3-407c-98a9-523811318d45 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:12.217912 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432e6fc-9be3-407c-98a9-523811318d45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:12.226701 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5432e6fc-9be3-407c-98a9-523811318d45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:12.228240 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5432e6fc-9be3-407c-98a9-523811318d45 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:12.230104 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec2794-167c-41df-996c-e67808717f6a tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:12.236623 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc78c564-bce7-4ad9-966a-116c97889c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:12.237642 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc78c564-bce7-4ad9-966a-116c97889c62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:12.237930 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc78c564-bce7-4ad9-966a-116c97889c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:12.238398 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3065/6088] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:34:12 2022] GET /identity/v3/auth/tokens => generated 3396 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:34:12.240814 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc78c564-bce7-4ad9-966a-116c97889c62 admin admin] PATH_INFO: `/v3/users/7e957956c8df4ae987e28723f1fef30a` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:12.240814 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc78c564-bce7-4ad9-966a-116c97889c62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e957956c8df4ae987e28723f1fef30a)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:12.241879 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc78c564-bce7-4ad9-966a-116c97889c62 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:12.244739 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5432e6fc-9be3-407c-98a9-523811318d45 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:12.260001 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5432e6fc-9be3-407c-98a9-523811318d45 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:12.265572 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121acfc0-e24a-4e72-a3c4-79c7ff300571 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2c730729bc414a9eda1eb1e63e2726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '829ec5c876a244508f4f4ba36b1e332d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:12.266624 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121acfc0-e24a-4e72-a3c4-79c7ff300571 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:12.272507 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121acfc0-e24a-4e72-a3c4-79c7ff300571 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:12.272507 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121acfc0-e24a-4e72-a3c4-79c7ff300571 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] PATH_INFO: `/v3/services/b92b16c25b124a5b9f011dd57f32f7af` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:12.272507 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121acfc0-e24a-4e72-a3c4-79c7ff300571 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] RBAC: Authorizing `identity:delete_service(service_id=b92b16c25b124a5b9f011dd57f32f7af)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:12.272507 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121acfc0-e24a-4e72-a3c4-79c7ff300571 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:12.360780 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3066/6089] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:34:12 2022] DELETE /identity/v3/services/b92b16c25b124a5b9f011dd57f32f7af => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:12.361712 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121acfc0-e24a-4e72-a3c4-79c7ff300571 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:12.388332 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121acfc0-e24a-4e72-a3c4-79c7ff300571 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:12.393516 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df0dbf3-0317-4cdd-82cb-0bc794dfbc30 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf93cf4adf642efb9673e3ae72dd0ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1c19b791654ed0b9facf59e9b2357f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:12.394571 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0dbf3-0317-4cdd-82cb-0bc794dfbc30 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:12.394914 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0dbf3-0317-4cdd-82cb-0bc794dfbc30 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:12.396019 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0dbf3-0317-4cdd-82cb-0bc794dfbc30 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] PATH_INFO: `/v3/users/edf93cf4adf642efb9673e3ae72dd0ae/application_credentials/16a5d7aa5e7d4f2caf81cb600806222b` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:12.408167 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df0dbf3-0317-4cdd-82cb-0bc794dfbc30 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] RBAC: Authorizing `identity:delete_application_credential(user_id=edf93cf4adf642efb9673e3ae72dd0ae, application_credential_id=16a5d7aa5e7d4f2caf81cb600806222b)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:12.409794 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df0dbf3-0317-4cdd-82cb-0bc794dfbc30 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:12.442556 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-bc78c564-bce7-4ad9-966a-116c97889c62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e957956c8df4ae987e28723f1fef30a'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:12.450558 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-bc78c564-bce7-4ad9-966a-116c97889c62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e957956c8df4ae987e28723f1fef30a'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:12.453368 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-bc78c564-bce7-4ad9-966a-116c97889c62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e957956c8df4ae987e28723f1fef30a'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:12.499901 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3067/6090] 10.222.0.52 () {58 vars in 1394 bytes} [Sat May 14 21:34:12 2022] DELETE /identity/v3/users/edf93cf4adf642efb9673e3ae72dd0ae/application_credentials/16a5d7aa5e7d4f2caf81cb600806222b => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:12.500765 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df0dbf3-0317-4cdd-82cb-0bc794dfbc30 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:12.525226 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df0dbf3-0317-4cdd-82cb-0bc794dfbc30 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:12.526196 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-bc78c564-bce7-4ad9-966a-116c97889c62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e957956c8df4ae987e28723f1fef30a'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:12.531515 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db789d7b-8d20-478d-8d59-1f65e903e889 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2c730729bc414a9eda1eb1e63e2726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '829ec5c876a244508f4f4ba36b1e332d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:12.532386 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db789d7b-8d20-478d-8d59-1f65e903e889 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:12.533744 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db789d7b-8d20-478d-8d59-1f65e903e889 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:12.533744 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db789d7b-8d20-478d-8d59-1f65e903e889 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] PATH_INFO: `/v3/services/b92b16c25b124a5b9f011dd57f32f7af` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:12.533744 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db789d7b-8d20-478d-8d59-1f65e903e889 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] RBAC: Authorizing `identity:get_service(service_id=b92b16c25b124a5b9f011dd57f32f7af)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:12.535489 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db789d7b-8d20-478d-8d59-1f65e903e889 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:12.544497 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-bc78c564-bce7-4ad9-966a-116c97889c62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e957956c8df4ae987e28723f1fef30a'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:12.552410 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-db789d7b-8d20-478d-8d59-1f65e903e889 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] Could not find service: b92b16c25b124a5b9f011dd57f32f7af.: keystone.exception.ServiceNotFound: Could not find service: b92b16c25b124a5b9f011dd57f32f7af. May 14 21:34:12.552410 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:34:12.552410 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 14 21:34:12.552410 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 14 21:34:12.552410 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 14 21:34:12.552410 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 14 21:34:12.552410 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 14 21:34:12.552410 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 21:34:12.552410 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: b92b16c25b124a5b9f011dd57f32f7af. May 14 21:34:12.552410 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:34:12.552410 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 21:34:12.552410 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:34:12.552410 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:34:12.552410 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 21:34:12.552410 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 21:34:12.553594 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 21:34:12.553594 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 21:34:12.553594 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 21:34:12.553594 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 21:34:12.553594 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 21:34:12.553594 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 21:34:12.553594 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 21:34:12.553594 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 21:34:12.553594 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 14 21:34:12.553594 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_service(service_id) May 14 21:34:12.553594 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 14 21:34:12.553594 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 14 21:34:12.553594 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 21:34:12.553594 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 21:34:12.553594 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 21:34:12.553594 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 21:34:12.554545 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 21:34:12.554545 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 21:34:12.554545 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 21:34:12.554545 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 21:34:12.554545 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 21:34:12.554545 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 21:34:12.554545 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 21:34:12.554545 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 21:34:12.554545 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 21:34:12.554545 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 21:34:12.554545 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 21:34:12.554545 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 21:34:12.554545 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 14 21:34:12.554545 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 21:34:12.554545 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: b92b16c25b124a5b9f011dd57f32f7af. May 14 21:34:12.554545 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:34:12.556008 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3068/6092] 10.222.0.52 () {58 vars in 1229 bytes} [Sat May 14 21:34:12 2022] GET /identity/v3/services/b92b16c25b124a5b9f011dd57f32f7af => generated 113 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 14 21:34:12.556008 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db789d7b-8d20-478d-8d59-1f65e903e889 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:12.556279 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3024/6092] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:34:12 2022] DELETE /identity/v3/users/7e957956c8df4ae987e28723f1fef30a => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:12.556904 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-db789d7b-8d20-478d-8d59-1f65e903e889 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:12.558173 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c934e4a6-e3b7-4f86-ae96-fd7de4389667 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:12.558660 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c934e4a6-e3b7-4f86-ae96-fd7de4389667 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:12.559040 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c934e4a6-e3b7-4f86-ae96-fd7de4389667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:12.575139 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db789d7b-8d20-478d-8d59-1f65e903e889 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:12.578880 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-c934e4a6-e3b7-4f86-ae96-fd7de4389667 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:12.580433 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c934e4a6-e3b7-4f86-ae96-fd7de4389667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:12.649521 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7a85d0-bf11-46e2-8efc-0eaa92e37255 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf93cf4adf642efb9673e3ae72dd0ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1c19b791654ed0b9facf59e9b2357f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:12.651174 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7a85d0-bf11-46e2-8efc-0eaa92e37255 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:12.652212 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7a85d0-bf11-46e2-8efc-0eaa92e37255 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:12.652615 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7a85d0-bf11-46e2-8efc-0eaa92e37255 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] PATH_INFO: `/v3/users/edf93cf4adf642efb9673e3ae72dd0ae/application_credentials` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:12.653419 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7a85d0-bf11-46e2-8efc-0eaa92e37255 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] RBAC: Authorizing `identity:create_application_credential(user_id=edf93cf4adf642efb9673e3ae72dd0ae)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:12.654981 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7a85d0-bf11-46e2-8efc-0eaa92e37255 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:12.664629 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3025/6093] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:12.664629 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c934e4a6-e3b7-4f86-ae96-fd7de4389667 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:12.664629 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c934e4a6-e3b7-4f86-ae96-fd7de4389667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:12.746938 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c934e4a6-e3b7-4f86-ae96-fd7de4389667 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:12.752925 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f429d-4419-4117-a948-48ca4385bbe7 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2c730729bc414a9eda1eb1e63e2726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '829ec5c876a244508f4f4ba36b1e332d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:12.754075 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f429d-4419-4117-a948-48ca4385bbe7 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:12.754411 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f429d-4419-4117-a948-48ca4385bbe7 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:12.754700 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f429d-4419-4117-a948-48ca4385bbe7 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] PATH_INFO: `/v3/services` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:12.755537 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151f429d-4419-4117-a948-48ca4385bbe7 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:12.757623 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151f429d-4419-4117-a948-48ca4385bbe7 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:12.810340 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3069/6094] 10.222.0.52 () {60 vars in 1313 bytes} [Sat May 14 21:34:12 2022] POST /identity/v3/users/edf93cf4adf642efb9673e3ae72dd0ae/application_credentials => generated 786 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:34:12.811032 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7a85d0-bf11-46e2-8efc-0eaa92e37255 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:12.812626 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-0f7a85d0-bf11-46e2-8efc-0eaa92e37255 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:12.865164 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3026/6095] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:34:12 2022] POST /identity/v3/services => generated 274 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:34:12.866478 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f429d-4419-4117-a948-48ca4385bbe7 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:12.869123 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-151f429d-4419-4117-a948-48ca4385bbe7 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:12.904062 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7a85d0-bf11-46e2-8efc-0eaa92e37255 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:12.922692 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b18f25e-5bbe-49a8-8d2d-fb8732c9b50a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:12.923352 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18f25e-5bbe-49a8-8d2d-fb8732c9b50a service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:12.923798 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18f25e-5bbe-49a8-8d2d-fb8732c9b50a service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:12.924080 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18f25e-5bbe-49a8-8d2d-fb8732c9b50a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:12.926149 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-1b18f25e-5bbe-49a8-8d2d-fb8732c9b50a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:12.929816 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f429d-4419-4117-a948-48ca4385bbe7 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:12.936013 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25c5079-893b-488e-bb7a-f12b023e1e17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:12.936930 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c5079-893b-488e-bb7a-f12b023e1e17 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:12.937499 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c5079-893b-488e-bb7a-f12b023e1e17 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:12.941238 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c5079-893b-488e-bb7a-f12b023e1e17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:12.941871 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b18f25e-5bbe-49a8-8d2d-fb8732c9b50a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:12.941871 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b18f25e-5bbe-49a8-8d2d-fb8732c9b50a service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:12.953526 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25c5079-893b-488e-bb7a-f12b023e1e17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:12.954998 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25c5079-893b-488e-bb7a-f12b023e1e17 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:12.955665 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3070/6096] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:34:12 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:34:12.956425 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b18f25e-5bbe-49a8-8d2d-fb8732c9b50a service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:12.980590 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3027/6097] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:34:12 2022] GET /identity/v3/auth/tokens => generated 3396 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:34:12.981287 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25c5079-893b-488e-bb7a-f12b023e1e17 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:12.981841 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b18f25e-5bbe-49a8-8d2d-fb8732c9b50a service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:12.986747 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeec2dc-5f56-4390-a40c-a2ac6422daa4 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf93cf4adf642efb9673e3ae72dd0ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1c19b791654ed0b9facf59e9b2357f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:12.988695 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeec2dc-5f56-4390-a40c-a2ac6422daa4 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:12.988990 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeec2dc-5f56-4390-a40c-a2ac6422daa4 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:12.989274 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeec2dc-5f56-4390-a40c-a2ac6422daa4 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] PATH_INFO: `/v3/users/edf93cf4adf642efb9673e3ae72dd0ae/application_credentials` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:12.990165 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeec2dc-5f56-4390-a40c-a2ac6422daa4 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] RBAC: Authorizing `identity:create_application_credential(user_id=edf93cf4adf642efb9673e3ae72dd0ae)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:12.993061 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeec2dc-5f56-4390-a40c-a2ac6422daa4 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:13.004049 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25c5079-893b-488e-bb7a-f12b023e1e17 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:13.009885 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b38a4f-2004-4527-a841-c448873eea12 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2c730729bc414a9eda1eb1e63e2726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '829ec5c876a244508f4f4ba36b1e332d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:13.010560 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b38a4f-2004-4527-a841-c448873eea12 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:13.010895 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b38a4f-2004-4527-a841-c448873eea12 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:13.011129 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b38a4f-2004-4527-a841-c448873eea12 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] PATH_INFO: `/v3/services` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:13.011883 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b38a4f-2004-4527-a841-c448873eea12 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:13.013501 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b38a4f-2004-4527-a841-c448873eea12 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:13.157214 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3028/6098] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:34:12 2022] POST /identity/v3/services => generated 274 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:34:13.158311 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b38a4f-2004-4527-a841-c448873eea12 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:13.180914 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b38a4f-2004-4527-a841-c448873eea12 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:13.185950 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4351695d-8045-463b-b784-121828d77ad0 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2c730729bc414a9eda1eb1e63e2726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '829ec5c876a244508f4f4ba36b1e332d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:13.186749 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4351695d-8045-463b-b784-121828d77ad0 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:13.187844 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4351695d-8045-463b-b784-121828d77ad0 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:13.187844 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4351695d-8045-463b-b784-121828d77ad0 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] PATH_INFO: `/v3/services` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:13.188063 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4351695d-8045-463b-b784-121828d77ad0 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:13.189639 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4351695d-8045-463b-b784-121828d77ad0 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:13.194087 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3071/6099] 10.222.0.52 () {60 vars in 1313 bytes} [Sat May 14 21:34:12 2022] POST /identity/v3/users/edf93cf4adf642efb9673e3ae72dd0ae/application_credentials => generated 789 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:34:13.198761 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeec2dc-5f56-4390-a40c-a2ac6422daa4 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:13.207828 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeec2dc-5f56-4390-a40c-a2ac6422daa4 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:13.224539 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e02161e-904c-4984-89c9-02a8ef7df121 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf93cf4adf642efb9673e3ae72dd0ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1c19b791654ed0b9facf59e9b2357f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:13.225835 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02161e-904c-4984-89c9-02a8ef7df121 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:13.226544 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02161e-904c-4984-89c9-02a8ef7df121 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:13.226987 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02161e-904c-4984-89c9-02a8ef7df121 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] PATH_INFO: `/v3/users/edf93cf4adf642efb9673e3ae72dd0ae/application_credentials` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:13.227933 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e02161e-904c-4984-89c9-02a8ef7df121 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] RBAC: Authorizing `identity:list_application_credentials(user_id=edf93cf4adf642efb9673e3ae72dd0ae)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:13.229699 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e02161e-904c-4984-89c9-02a8ef7df121 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:13.243760 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3072/6100] 10.222.0.52 () {58 vars in 1292 bytes} [Sat May 14 21:34:13 2022] GET /identity/v3/users/edf93cf4adf642efb9673e3ae72dd0ae/application_credentials => generated 1499 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:34:13.246997 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e02161e-904c-4984-89c9-02a8ef7df121 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:13.256652 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e02161e-904c-4984-89c9-02a8ef7df121 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:13.262066 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d609651-c8f5-4c90-b111-010c30bae7ac tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf93cf4adf642efb9673e3ae72dd0ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1c19b791654ed0b9facf59e9b2357f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:13.262994 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d609651-c8f5-4c90-b111-010c30bae7ac tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:13.263274 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d609651-c8f5-4c90-b111-010c30bae7ac tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:13.263594 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d609651-c8f5-4c90-b111-010c30bae7ac tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] PATH_INFO: `/v3/users/edf93cf4adf642efb9673e3ae72dd0ae/application_credentials/7dc5aa3698ac4319a533793c436b60b0` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:13.272310 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d609651-c8f5-4c90-b111-010c30bae7ac tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] RBAC: Authorizing `identity:delete_application_credential(user_id=edf93cf4adf642efb9673e3ae72dd0ae, application_credential_id=7dc5aa3698ac4319a533793c436b60b0)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:13.274569 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d609651-c8f5-4c90-b111-010c30bae7ac tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:13.286807 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3029/6101] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:34:13 2022] POST /identity/v3/services => generated 274 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:34:13.296665 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4351695d-8045-463b-b784-121828d77ad0 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:13.317640 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4351695d-8045-463b-b784-121828d77ad0 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:13.323745 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d45eb31-4b42-48da-adf8-91de29cfad98 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2c730729bc414a9eda1eb1e63e2726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '829ec5c876a244508f4f4ba36b1e332d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:13.324594 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45eb31-4b42-48da-adf8-91de29cfad98 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:13.324988 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45eb31-4b42-48da-adf8-91de29cfad98 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:13.325367 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45eb31-4b42-48da-adf8-91de29cfad98 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] PATH_INFO: `/v3/services` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:13.326493 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d45eb31-4b42-48da-adf8-91de29cfad98 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:13.328395 ncdv-master-1 devstack@keystone.service[91107]: WARNING py.warnings [None req-5d45eb31-4b42-48da-adf8-91de29cfad98 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:34:13.328395 ncdv-master-1 devstack@keystone.service[91107]: warnings.warn(msg) May 14 21:34:13.328395 ncdv-master-1 devstack@keystone.service[91107]: May 14 21:34:13.329566 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d45eb31-4b42-48da-adf8-91de29cfad98 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:13.340884 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3030/6102] 10.222.0.52 () {58 vars in 1130 bytes} [Sat May 14 21:34:13 2022] GET /identity/v3/services => generated 2977 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:34:13.355707 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d45eb31-4b42-48da-adf8-91de29cfad98 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:13.375462 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d45eb31-4b42-48da-adf8-91de29cfad98 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:13.382287 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7b5529-6679-4c12-919f-5af5e0a9b5e8 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2c730729bc414a9eda1eb1e63e2726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '829ec5c876a244508f4f4ba36b1e332d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:13.383356 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b5529-6679-4c12-919f-5af5e0a9b5e8 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:13.383796 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b5529-6679-4c12-919f-5af5e0a9b5e8 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:13.384323 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b5529-6679-4c12-919f-5af5e0a9b5e8 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] PATH_INFO: `/v3/services` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:13.385321 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7b5529-6679-4c12-919f-5af5e0a9b5e8 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1588735823) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:34:13.385735 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7b5529-6679-4c12-919f-5af5e0a9b5e8 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:13.387745 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7b5529-6679-4c12-919f-5af5e0a9b5e8 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:13.405806 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3073/6103] 10.222.0.52 () {58 vars in 1394 bytes} [Sat May 14 21:34:13 2022] DELETE /identity/v3/users/edf93cf4adf642efb9673e3ae72dd0ae/application_credentials/7dc5aa3698ac4319a533793c436b60b0 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:34:13.410811 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d609651-c8f5-4c90-b111-010c30bae7ac tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:13.413730 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3031/6104] 10.222.0.52 () {58 vars in 1221 bytes} [Sat May 14 21:34:13 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1588735823 => generated 417 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:34:13.417891 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7b5529-6679-4c12-919f-5af5e0a9b5e8 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:13.428318 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7b5529-6679-4c12-919f-5af5e0a9b5e8 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:13.434082 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f765d9d5-febe-4cb7-bd90-7fef2c1b4565 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2c730729bc414a9eda1eb1e63e2726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '829ec5c876a244508f4f4ba36b1e332d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:13.434849 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f765d9d5-febe-4cb7-bd90-7fef2c1b4565 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:13.435340 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f765d9d5-febe-4cb7-bd90-7fef2c1b4565 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:13.435520 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f765d9d5-febe-4cb7-bd90-7fef2c1b4565 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] PATH_INFO: `/v3/services` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:13.436302 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f765d9d5-febe-4cb7-bd90-7fef2c1b4565 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1367371141) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:34:13.437063 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f765d9d5-febe-4cb7-bd90-7fef2c1b4565 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:13.438342 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f765d9d5-febe-4cb7-bd90-7fef2c1b4565 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:13.445360 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3032/6105] 10.222.0.52 () {58 vars in 1221 bytes} [Sat May 14 21:34:13 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1367371141 => generated 417 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:34:13.446113 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d609651-c8f5-4c90-b111-010c30bae7ac tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:13.497776 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa00b8ac-ade6-4383-a379-6fddf1b5f19e tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf93cf4adf642efb9673e3ae72dd0ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1c19b791654ed0b9facf59e9b2357f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:13.498129 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa00b8ac-ade6-4383-a379-6fddf1b5f19e tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:13.498429 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa00b8ac-ade6-4383-a379-6fddf1b5f19e tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:13.498746 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa00b8ac-ade6-4383-a379-6fddf1b5f19e tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] PATH_INFO: `/v3/users/edf93cf4adf642efb9673e3ae72dd0ae/application_credentials/ed581e13daf143678d4355d7d88bfe60` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:13.523286 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa00b8ac-ade6-4383-a379-6fddf1b5f19e tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] RBAC: Authorizing `identity:delete_application_credential(user_id=edf93cf4adf642efb9673e3ae72dd0ae, application_credential_id=ed581e13daf143678d4355d7d88bfe60)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:13.529159 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa00b8ac-ade6-4383-a379-6fddf1b5f19e tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:13.533452 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f765d9d5-febe-4cb7-bd90-7fef2c1b4565 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:13.546856 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f765d9d5-febe-4cb7-bd90-7fef2c1b4565 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:13.553664 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf9eb4b-d140-4d58-9ba4-f3e6afe25437 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2c730729bc414a9eda1eb1e63e2726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '829ec5c876a244508f4f4ba36b1e332d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:13.554432 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf9eb4b-d140-4d58-9ba4-f3e6afe25437 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:13.554788 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf9eb4b-d140-4d58-9ba4-f3e6afe25437 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:13.555333 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf9eb4b-d140-4d58-9ba4-f3e6afe25437 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] PATH_INFO: `/v3/services` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:13.556161 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf9eb4b-d140-4d58-9ba4-f3e6afe25437 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-714312205) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:34:13.556545 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf9eb4b-d140-4d58-9ba4-f3e6afe25437 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:13.558281 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf9eb4b-d140-4d58-9ba4-f3e6afe25437 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:13.564659 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3033/6106] 10.222.0.52 () {58 vars in 1219 bytes} [Sat May 14 21:34:13 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-714312205 => generated 416 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:34:13.568612 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf9eb4b-d140-4d58-9ba4-f3e6afe25437 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:13.579661 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf9eb4b-d140-4d58-9ba4-f3e6afe25437 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:13.586642 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79f4ecc-1e66-4ce6-af87-0a86368ebd62 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2c730729bc414a9eda1eb1e63e2726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '829ec5c876a244508f4f4ba36b1e332d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:13.587779 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f4ecc-1e66-4ce6-af87-0a86368ebd62 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:13.588063 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f4ecc-1e66-4ce6-af87-0a86368ebd62 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:13.588337 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f4ecc-1e66-4ce6-af87-0a86368ebd62 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] PATH_INFO: `/v3/services/c166da534d79490faa9a9ebe395dcddb` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:13.588987 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79f4ecc-1e66-4ce6-af87-0a86368ebd62 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] RBAC: Authorizing `identity:delete_service(service_id=c166da534d79490faa9a9ebe395dcddb)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:13.590594 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79f4ecc-1e66-4ce6-af87-0a86368ebd62 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:13.663620 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3074/6107] 10.222.0.52 () {58 vars in 1394 bytes} [Sat May 14 21:34:13 2022] DELETE /identity/v3/users/edf93cf4adf642efb9673e3ae72dd0ae/application_credentials/ed581e13daf143678d4355d7d88bfe60 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:13.669010 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa00b8ac-ade6-4383-a379-6fddf1b5f19e tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:13.677843 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa00b8ac-ade6-4383-a379-6fddf1b5f19e tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:13.687888 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ac536f-af0a-41d2-b81d-2071f745ad98 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf93cf4adf642efb9673e3ae72dd0ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1c19b791654ed0b9facf59e9b2357f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:13.687888 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ac536f-af0a-41d2-b81d-2071f745ad98 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:13.687888 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ac536f-af0a-41d2-b81d-2071f745ad98 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:13.688209 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ac536f-af0a-41d2-b81d-2071f745ad98 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] PATH_INFO: `/v3/users/edf93cf4adf642efb9673e3ae72dd0ae/application_credentials` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:13.688209 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ac536f-af0a-41d2-b81d-2071f745ad98 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] RBAC: Authorizing `identity:create_application_credential(user_id=edf93cf4adf642efb9673e3ae72dd0ae)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:13.688209 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ac536f-af0a-41d2-b81d-2071f745ad98 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:13.694721 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3034/6108] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:34:13 2022] DELETE /identity/v3/services/c166da534d79490faa9a9ebe395dcddb => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:34:13.695935 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79f4ecc-1e66-4ce6-af87-0a86368ebd62 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:13.698267 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-f79f4ecc-1e66-4ce6-af87-0a86368ebd62 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:13.749890 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79f4ecc-1e66-4ce6-af87-0a86368ebd62 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:13.764594 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e706f-5391-4f52-871c-58b6658b35f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:13.764594 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e706f-5391-4f52-871c-58b6658b35f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:13.764594 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e706f-5391-4f52-871c-58b6658b35f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:13.764594 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e706f-5391-4f52-871c-58b6658b35f7 admin admin] PATH_INFO: `/v3/projects/c44381aa7d104743a382b437425dcedb` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:13.765271 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607e706f-5391-4f52-871c-58b6658b35f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c44381aa7d104743a382b437425dcedb)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:13.771895 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607e706f-5391-4f52-871c-58b6658b35f7 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:13.931878 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3075/6109] 10.222.0.52 () {60 vars in 1313 bytes} [Sat May 14 21:34:13 2022] POST /identity/v3/users/edf93cf4adf642efb9673e3ae72dd0ae/application_credentials => generated 789 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:34:13.933077 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ac536f-af0a-41d2-b81d-2071f745ad98 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:13.940856 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-607e706f-5391-4f52-871c-58b6658b35f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c44381aa7d104743a382b437425dcedb', 'request_id': 'req-607e706f-5391-4f52-871c-58b6658b35f7'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:13.947620 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-607e706f-5391-4f52-871c-58b6658b35f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c44381aa7d104743a382b437425dcedb', 'request_id': 'req-607e706f-5391-4f52-871c-58b6658b35f7'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:13.947811 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ac536f-af0a-41d2-b81d-2071f745ad98 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:13.954053 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-607e706f-5391-4f52-871c-58b6658b35f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c44381aa7d104743a382b437425dcedb', 'request_id': 'req-607e706f-5391-4f52-871c-58b6658b35f7'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:14.025859 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88aa899-c588-4e52-961e-799902c6e3cc tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2c730729bc414a9eda1eb1e63e2726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '829ec5c876a244508f4f4ba36b1e332d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:14.026714 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88aa899-c588-4e52-961e-799902c6e3cc tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:14.026996 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88aa899-c588-4e52-961e-799902c6e3cc tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:14.027273 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88aa899-c588-4e52-961e-799902c6e3cc tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] PATH_INFO: `/v3/services/de6fec1846ec48469ae7739640678036` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:14.027949 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88aa899-c588-4e52-961e-799902c6e3cc tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] RBAC: Authorizing `identity:delete_service(service_id=de6fec1846ec48469ae7739640678036)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:14.029864 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88aa899-c588-4e52-961e-799902c6e3cc tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:14.064823 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-607e706f-5391-4f52-871c-58b6658b35f7 admin admin] The token cache is being invalidate because project c44381aa7d104743a382b437425dcedb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:34:14.065120 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-607e706f-5391-4f52-871c-58b6658b35f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:14.065841 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-607e706f-5391-4f52-871c-58b6658b35f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:14.067525 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3035/6110] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:34:13 2022] DELETE /identity/v3/projects/c44381aa7d104743a382b437425dcedb => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:14.068339 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e706f-5391-4f52-871c-58b6658b35f7 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:14.069642 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-607e706f-5391-4f52-871c-58b6658b35f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:14.145411 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3076/6111] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:34:13 2022] DELETE /identity/v3/services/de6fec1846ec48469ae7739640678036 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:14.145411 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88aa899-c588-4e52-961e-799902c6e3cc tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:14.147503 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e88aa899-c588-4e52-961e-799902c6e3cc tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:14.148065 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e706f-5391-4f52-871c-58b6658b35f7 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:14.164315 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e3397-9b74-422e-8320-c6207d699db0 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf93cf4adf642efb9673e3ae72dd0ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1c19b791654ed0b9facf59e9b2357f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:14.164784 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e3397-9b74-422e-8320-c6207d699db0 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:14.165089 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e3397-9b74-422e-8320-c6207d699db0 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:14.165366 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e3397-9b74-422e-8320-c6207d699db0 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] PATH_INFO: `/v3/users/edf93cf4adf642efb9673e3ae72dd0ae/application_credentials` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:14.166113 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e3397-9b74-422e-8320-c6207d699db0 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] RBAC: Authorizing `identity:create_application_credential(user_id=edf93cf4adf642efb9673e3ae72dd0ae)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:14.167272 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e3397-9b74-422e-8320-c6207d699db0 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:14.248763 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88aa899-c588-4e52-961e-799902c6e3cc tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:14.254170 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f686de89-76ec-4896-a9d4-43156d868b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:14.254901 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f686de89-76ec-4896-a9d4-43156d868b30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:14.255202 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f686de89-76ec-4896-a9d4-43156d868b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:14.255507 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f686de89-76ec-4896-a9d4-43156d868b30 admin admin] PATH_INFO: `/v3/users/a317c0093fa842c394b3b60b3b6cc7fd` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:14.256770 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f686de89-76ec-4896-a9d4-43156d868b30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a317c0093fa842c394b3b60b3b6cc7fd)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:14.259051 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f686de89-76ec-4896-a9d4-43156d868b30 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:14.393241 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3036/6112] 10.222.0.52 () {60 vars in 1313 bytes} [Sat May 14 21:34:14 2022] POST /identity/v3/users/edf93cf4adf642efb9673e3ae72dd0ae/application_credentials => generated 789 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:34:14.394267 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e3397-9b74-422e-8320-c6207d699db0 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:14.396503 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b69e3397-9b74-422e-8320-c6207d699db0 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:14.421251 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e3397-9b74-422e-8320-c6207d699db0 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:14.426055 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9c106-ae10-4223-8c1a-d448006d5b06 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2c730729bc414a9eda1eb1e63e2726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '829ec5c876a244508f4f4ba36b1e332d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:14.426935 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9c106-ae10-4223-8c1a-d448006d5b06 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:14.427375 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9c106-ae10-4223-8c1a-d448006d5b06 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:14.432845 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9c106-ae10-4223-8c1a-d448006d5b06 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] PATH_INFO: `/v3/services/f853ff57e4f6457ea7d3a5f2a3fcb907` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:14.432845 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d9c106-ae10-4223-8c1a-d448006d5b06 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] RBAC: Authorizing `identity:delete_service(service_id=f853ff57e4f6457ea7d3a5f2a3fcb907)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:14.432845 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d9c106-ae10-4223-8c1a-d448006d5b06 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:14.600243 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3037/6113] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:34:14 2022] DELETE /identity/v3/services/f853ff57e4f6457ea7d3a5f2a3fcb907 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:14.601871 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9c106-ae10-4223-8c1a-d448006d5b06 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:14.613566 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f686de89-76ec-4896-a9d4-43156d868b30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a317c0093fa842c394b3b60b3b6cc7fd'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:14.636980 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9c106-ae10-4223-8c1a-d448006d5b06 tempest-ServicesTestJSON-1675364863 tempest-ServicesTestJSON-1675364863-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:14.640305 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f686de89-76ec-4896-a9d4-43156d868b30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a317c0093fa842c394b3b60b3b6cc7fd'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:14.645723 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cefdb66-31a9-4685-9757-fc31f95bbdab tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf93cf4adf642efb9673e3ae72dd0ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1c19b791654ed0b9facf59e9b2357f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:14.654545 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cefdb66-31a9-4685-9757-fc31f95bbdab tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:14.660709 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cefdb66-31a9-4685-9757-fc31f95bbdab tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:14.660709 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cefdb66-31a9-4685-9757-fc31f95bbdab tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] PATH_INFO: `/v3/users/edf93cf4adf642efb9673e3ae72dd0ae/application_credentials` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:14.661394 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f686de89-76ec-4896-a9d4-43156d868b30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a317c0093fa842c394b3b60b3b6cc7fd'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:14.661493 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cefdb66-31a9-4685-9757-fc31f95bbdab tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] RBAC: Adding query filter params (name=tempest-application_credential-1806292083) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:34:14.661493 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cefdb66-31a9-4685-9757-fc31f95bbdab tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] RBAC: Authorizing `identity:list_application_credentials(user_id=edf93cf4adf642efb9673e3ae72dd0ae)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:14.662903 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cefdb66-31a9-4685-9757-fc31f95bbdab tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:14.689386 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3038/6114] 10.222.0.52 () {58 vars in 1385 bytes} [Sat May 14 21:34:14 2022] GET /identity/v3/users/edf93cf4adf642efb9673e3ae72dd0ae/application_credentials?name=tempest-application_credential-1806292083 => generated 887 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:34:14.689539 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cefdb66-31a9-4685-9757-fc31f95bbdab tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:14.695208 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-1cefdb66-31a9-4685-9757-fc31f95bbdab tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:14.728153 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cefdb66-31a9-4685-9757-fc31f95bbdab tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:14.734404 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120bf748-03a4-4c66-8369-e8a4973ab162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:14.735626 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120bf748-03a4-4c66-8369-e8a4973ab162 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:14.736071 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120bf748-03a4-4c66-8369-e8a4973ab162 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:14.736535 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120bf748-03a4-4c66-8369-e8a4973ab162 admin admin] PATH_INFO: `/v3/users/eb49b0f450324eb3bade523412add786` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:14.738307 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120bf748-03a4-4c66-8369-e8a4973ab162 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb49b0f450324eb3bade523412add786)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:14.740943 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120bf748-03a4-4c66-8369-e8a4973ab162 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:14.747185 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f686de89-76ec-4896-a9d4-43156d868b30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a317c0093fa842c394b3b60b3b6cc7fd'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:14.751904 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f686de89-76ec-4896-a9d4-43156d868b30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a317c0093fa842c394b3b60b3b6cc7fd'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:14.765099 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3077/6115] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:34:14 2022] DELETE /identity/v3/users/a317c0093fa842c394b3b60b3b6cc7fd => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:14.766021 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f686de89-76ec-4896-a9d4-43156d868b30 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:14.772712 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-f686de89-76ec-4896-a9d4-43156d868b30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:14.861444 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f686de89-76ec-4896-a9d4-43156d868b30 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:14.872642 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b36eb2-d0e7-4690-86e3-413f4a898301 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf93cf4adf642efb9673e3ae72dd0ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1c19b791654ed0b9facf59e9b2357f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:14.874582 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b36eb2-d0e7-4690-86e3-413f4a898301 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:14.875044 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b36eb2-d0e7-4690-86e3-413f4a898301 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:14.875573 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b36eb2-d0e7-4690-86e3-413f4a898301 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] PATH_INFO: `/v3/users/edf93cf4adf642efb9673e3ae72dd0ae/application_credentials/68f6a5dbab404e79b068f320087813e8` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:14.886864 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b36eb2-d0e7-4690-86e3-413f4a898301 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] RBAC: Authorizing `identity:delete_application_credential(user_id=edf93cf4adf642efb9673e3ae72dd0ae, application_credential_id=68f6a5dbab404e79b068f320087813e8)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:14.888405 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b36eb2-d0e7-4690-86e3-413f4a898301 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:15.033652 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-120bf748-03a4-4c66-8369-e8a4973ab162 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb49b0f450324eb3bade523412add786'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:15.034724 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3078/6116] 10.222.0.52 () {58 vars in 1394 bytes} [Sat May 14 21:34:14 2022] DELETE /identity/v3/users/edf93cf4adf642efb9673e3ae72dd0ae/application_credentials/68f6a5dbab404e79b068f320087813e8 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:15.038749 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b36eb2-d0e7-4690-86e3-413f4a898301 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:15.054040 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b36eb2-d0e7-4690-86e3-413f4a898301 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:15.066756 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b887c0-18f4-487c-8615-5b57c30871a2 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf93cf4adf642efb9673e3ae72dd0ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1c19b791654ed0b9facf59e9b2357f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:15.067817 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b887c0-18f4-487c-8615-5b57c30871a2 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:15.068108 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b887c0-18f4-487c-8615-5b57c30871a2 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:15.068398 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b887c0-18f4-487c-8615-5b57c30871a2 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] PATH_INFO: `/v3/users/edf93cf4adf642efb9673e3ae72dd0ae/application_credentials/eaede2bb065147d09d885c8d79c4ea5c` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:15.079340 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-120bf748-03a4-4c66-8369-e8a4973ab162 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb49b0f450324eb3bade523412add786'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:15.081888 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-120bf748-03a4-4c66-8369-e8a4973ab162 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb49b0f450324eb3bade523412add786'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:15.094762 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b887c0-18f4-487c-8615-5b57c30871a2 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] RBAC: Authorizing `identity:delete_application_credential(user_id=edf93cf4adf642efb9673e3ae72dd0ae, application_credential_id=eaede2bb065147d09d885c8d79c4ea5c)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:15.096400 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b887c0-18f4-487c-8615-5b57c30871a2 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:15.168236 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-120bf748-03a4-4c66-8369-e8a4973ab162 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb49b0f450324eb3bade523412add786'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:15.190240 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-120bf748-03a4-4c66-8369-e8a4973ab162 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb49b0f450324eb3bade523412add786'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:15.200459 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3039/6117] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:34:14 2022] DELETE /identity/v3/users/eb49b0f450324eb3bade523412add786 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:15.213095 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60343f53-a881-479b-88e7-ecd059a0d633 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:15.213382 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60343f53-a881-479b-88e7-ecd059a0d633 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:15.217395 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3079/6118] 10.222.0.52 () {58 vars in 1394 bytes} [Sat May 14 21:34:15 2022] DELETE /identity/v3/users/edf93cf4adf642efb9673e3ae72dd0ae/application_credentials/eaede2bb065147d09d885c8d79c4ea5c => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:34:15.217522 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60343f53-a881-479b-88e7-ecd059a0d633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:15.218415 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b887c0-18f4-487c-8615-5b57c30871a2 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:15.220482 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-24b887c0-18f4-487c-8615-5b57c30871a2 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:15.247250 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-60343f53-a881-479b-88e7-ecd059a0d633 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:15.248567 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-60343f53-a881-479b-88e7-ecd059a0d633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:15.412533 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3040/6119] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:15.422864 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60343f53-a881-479b-88e7-ecd059a0d633 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:15.424361 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-60343f53-a881-479b-88e7-ecd059a0d633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:15.432473 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b887c0-18f4-487c-8615-5b57c30871a2 tempest-ApplicationCredentialsV3Test-718761828 tempest-ApplicationCredentialsV3Test-718761828-project] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:15.437443 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fc9c3c-ca08-49e7-8098-82ea3982642d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:15.438345 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc9c3c-ca08-49e7-8098-82ea3982642d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:15.438799 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc9c3c-ca08-49e7-8098-82ea3982642d admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:15.439027 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc9c3c-ca08-49e7-8098-82ea3982642d admin admin] PATH_INFO: `/v3/users/edf93cf4adf642efb9673e3ae72dd0ae` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:15.440305 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fc9c3c-ca08-49e7-8098-82ea3982642d admin admin] RBAC: Authorizing `identity:delete_user(user_id=edf93cf4adf642efb9673e3ae72dd0ae)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:15.442245 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fc9c3c-ca08-49e7-8098-82ea3982642d admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:15.513986 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60343f53-a881-479b-88e7-ecd059a0d633 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:15.517954 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b1535-d150-4329-bdd8-d3451f1ca4fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:15.518612 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b1535-d150-4329-bdd8-d3451f1ca4fa service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:15.519048 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b1535-d150-4329-bdd8-d3451f1ca4fa service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:15.519328 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b1535-d150-4329-bdd8-d3451f1ca4fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:15.536024 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7b1535-d150-4329-bdd8-d3451f1ca4fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:15.548116 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7b1535-d150-4329-bdd8-d3451f1ca4fa service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:15.551632 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3041/6120] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:34:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:34:15.552366 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b1535-d150-4329-bdd8-d3451f1ca4fa service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:15.553971 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-9c7b1535-d150-4329-bdd8-d3451f1ca4fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:15.575586 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b1535-d150-4329-bdd8-d3451f1ca4fa service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:15.580877 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9942e0-4a6d-40d7-a2e2-18d3b88a46d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:15.581873 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9942e0-4a6d-40d7-a2e2-18d3b88a46d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:15.582264 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9942e0-4a6d-40d7-a2e2-18d3b88a46d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:15.582615 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9942e0-4a6d-40d7-a2e2-18d3b88a46d0 admin admin] PATH_INFO: `/v3/projects/d5a76b72cce44047aba65ab9b0ebe59d` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:15.584209 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9942e0-4a6d-40d7-a2e2-18d3b88a46d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5a76b72cce44047aba65ab9b0ebe59d)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:15.586396 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9942e0-4a6d-40d7-a2e2-18d3b88a46d0 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:15.675669 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-09fc9c3c-ca08-49e7-8098-82ea3982642d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edf93cf4adf642efb9673e3ae72dd0ae'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:15.769351 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-cf9942e0-4a6d-40d7-a2e2-18d3b88a46d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5a76b72cce44047aba65ab9b0ebe59d', 'request_id': 'req-cf9942e0-4a6d-40d7-a2e2-18d3b88a46d0'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:15.776191 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-cf9942e0-4a6d-40d7-a2e2-18d3b88a46d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5a76b72cce44047aba65ab9b0ebe59d', 'request_id': 'req-cf9942e0-4a6d-40d7-a2e2-18d3b88a46d0'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:15.782452 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-cf9942e0-4a6d-40d7-a2e2-18d3b88a46d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5a76b72cce44047aba65ab9b0ebe59d', 'request_id': 'req-cf9942e0-4a6d-40d7-a2e2-18d3b88a46d0'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:15.801765 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-09fc9c3c-ca08-49e7-8098-82ea3982642d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edf93cf4adf642efb9673e3ae72dd0ae'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:15.810170 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-09fc9c3c-ca08-49e7-8098-82ea3982642d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edf93cf4adf642efb9673e3ae72dd0ae'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:15.901517 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-cf9942e0-4a6d-40d7-a2e2-18d3b88a46d0 admin admin] The token cache is being invalidate because project d5a76b72cce44047aba65ab9b0ebe59d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:34:15.901970 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-cf9942e0-4a6d-40d7-a2e2-18d3b88a46d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:15.902795 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-cf9942e0-4a6d-40d7-a2e2-18d3b88a46d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:15.905939 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3042/6121] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:34:15 2022] DELETE /identity/v3/projects/d5a76b72cce44047aba65ab9b0ebe59d => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:15.911520 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281ad87-d1f9-478d-87c7-0b913f7d06f4 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:15.911792 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281ad87-d1f9-478d-87c7-0b913f7d06f4 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:15.912087 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281ad87-d1f9-478d-87c7-0b913f7d06f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:15.945368 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-0281ad87-d1f9-478d-87c7-0b913f7d06f4 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:15.946779 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-0281ad87-d1f9-478d-87c7-0b913f7d06f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:16.031733 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-09fc9c3c-ca08-49e7-8098-82ea3982642d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edf93cf4adf642efb9673e3ae72dd0ae'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:16.032482 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-09fc9c3c-ca08-49e7-8098-82ea3982642d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edf93cf4adf642efb9673e3ae72dd0ae'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:16.040532 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3043/6122] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:16.041371 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3080/6123] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:34:15 2022] DELETE /identity/v3/users/edf93cf4adf642efb9673e3ae72dd0ae => generated 0 bytes in 823 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:16.044237 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1b2f1-ced2-48fa-bd54-000e701a8484 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:16.045738 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac856de5-f6a0-42d2-a4af-2f2bc6c3021b None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:16.046024 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac856de5-f6a0-42d2-a4af-2f2bc6c3021b None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:16.046300 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac856de5-f6a0-42d2-a4af-2f2bc6c3021b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:16.046601 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1b2f1-ced2-48fa-bd54-000e701a8484 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:16.048161 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1b2f1-ced2-48fa-bd54-000e701a8484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:16.096455 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-ac856de5-f6a0-42d2-a4af-2f2bc6c3021b None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:16.098839 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ac856de5-f6a0-42d2-a4af-2f2bc6c3021b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:16.108043 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-c6f1b2f1-ced2-48fa-bd54-000e701a8484 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:16.108043 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c6f1b2f1-ced2-48fa-bd54-000e701a8484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:16.202261 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3081/6124] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:16.229195 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac856de5-f6a0-42d2-a4af-2f2bc6c3021b None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:16.233970 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ac856de5-f6a0-42d2-a4af-2f2bc6c3021b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:16.245915 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3044/6125] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:16.245915 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f1b2f1-ced2-48fa-bd54-000e701a8484 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:16.245915 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c6f1b2f1-ced2-48fa-bd54-000e701a8484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:16.258849 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f1b2f1-ced2-48fa-bd54-000e701a8484 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:16.268351 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50461c87-c447-4812-916c-ec8a018a4a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:16.269919 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50461c87-c447-4812-916c-ec8a018a4a6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:16.270385 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50461c87-c447-4812-916c-ec8a018a4a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:16.270941 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50461c87-c447-4812-916c-ec8a018a4a6c admin admin] PATH_INFO: `/v3/projects/6ac9d212545f4b64bbca41e474fd9c08` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:16.272581 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50461c87-c447-4812-916c-ec8a018a4a6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ac9d212545f4b64bbca41e474fd9c08)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:16.276427 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50461c87-c447-4812-916c-ec8a018a4a6c admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:16.333815 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac856de5-f6a0-42d2-a4af-2f2bc6c3021b None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:16.348372 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f52844-0956-4d1f-8284-39e52e0442d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:16.349481 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f52844-0956-4d1f-8284-39e52e0442d5 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:16.349709 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f52844-0956-4d1f-8284-39e52e0442d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:16.349931 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f52844-0956-4d1f-8284-39e52e0442d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:16.383671 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f52844-0956-4d1f-8284-39e52e0442d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:16.394807 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f52844-0956-4d1f-8284-39e52e0442d5 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:16.403020 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-50461c87-c447-4812-916c-ec8a018a4a6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ac9d212545f4b64bbca41e474fd9c08', 'request_id': 'req-50461c87-c447-4812-916c-ec8a018a4a6c'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:16.413656 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3082/6126] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:34:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:34:16.416635 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-50461c87-c447-4812-916c-ec8a018a4a6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ac9d212545f4b64bbca41e474fd9c08', 'request_id': 'req-50461c87-c447-4812-916c-ec8a018a4a6c'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:16.425147 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-50461c87-c447-4812-916c-ec8a018a4a6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ac9d212545f4b64bbca41e474fd9c08', 'request_id': 'req-50461c87-c447-4812-916c-ec8a018a4a6c'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:16.432800 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f52844-0956-4d1f-8284-39e52e0442d5 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:16.444734 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f52844-0956-4d1f-8284-39e52e0442d5 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:16.522756 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-50461c87-c447-4812-916c-ec8a018a4a6c admin admin] The token cache is being invalidate because project 6ac9d212545f4b64bbca41e474fd9c08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:34:16.524619 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-50461c87-c447-4812-916c-ec8a018a4a6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:16.525477 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-50461c87-c447-4812-916c-ec8a018a4a6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:16.530330 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3045/6127] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:34:16 2022] DELETE /identity/v3/projects/6ac9d212545f4b64bbca41e474fd9c08 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:16.531583 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50461c87-c447-4812-916c-ec8a018a4a6c admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:16.534068 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-50461c87-c447-4812-916c-ec8a018a4a6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:16.561833 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbada50-6e2f-4772-813c-6cf043ed7ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:16.562858 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbada50-6e2f-4772-813c-6cf043ed7ca3 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:16.563307 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbada50-6e2f-4772-813c-6cf043ed7ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:16.563767 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbada50-6e2f-4772-813c-6cf043ed7ca3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:16.564684 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbada50-6e2f-4772-813c-6cf043ed7ca3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:34:16.565188 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbada50-6e2f-4772-813c-6cf043ed7ca3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:16.567026 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbada50-6e2f-4772-813c-6cf043ed7ca3 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:16.611541 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3083/6128] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:34:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:34:16.617345 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbada50-6e2f-4772-813c-6cf043ed7ca3 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:16.620970 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-fcbada50-6e2f-4772-813c-6cf043ed7ca3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:16.652545 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbada50-6e2f-4772-813c-6cf043ed7ca3 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:16.657176 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3952195-eecb-44f2-a27e-0323f2080a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:16.658478 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3952195-eecb-44f2-a27e-0323f2080a6c admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:16.658941 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3952195-eecb-44f2-a27e-0323f2080a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:16.659602 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3952195-eecb-44f2-a27e-0323f2080a6c admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:16.660625 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3952195-eecb-44f2-a27e-0323f2080a6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:16.664961 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3952195-eecb-44f2-a27e-0323f2080a6c admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:16.672438 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50461c87-c447-4812-916c-ec8a018a4a6c admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:16.679342 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13862dee-ca94-45d7-87fa-90c2c02fb8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:16.681785 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13862dee-ca94-45d7-87fa-90c2c02fb8a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:16.681785 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13862dee-ca94-45d7-87fa-90c2c02fb8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:16.681785 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13862dee-ca94-45d7-87fa-90c2c02fb8a2 admin admin] PATH_INFO: `/v3/users/4b2c730729bc414a9eda1eb1e63e2726` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:16.683422 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13862dee-ca94-45d7-87fa-90c2c02fb8a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b2c730729bc414a9eda1eb1e63e2726)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:16.685763 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13862dee-ca94-45d7-87fa-90c2c02fb8a2 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:16.874147 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3084/6129] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:34:16 2022] POST /identity/v3/projects => generated 381 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:34:16.875614 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3952195-eecb-44f2-a27e-0323f2080a6c admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:17.006806 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-13862dee-ca94-45d7-87fa-90c2c02fb8a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b2c730729bc414a9eda1eb1e63e2726'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:17.008987 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3952195-eecb-44f2-a27e-0323f2080a6c admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:17.018574 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaefd24-2955-4fec-8048-8f2d8cb53e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:17.019299 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaefd24-2955-4fec-8048-8f2d8cb53e9b admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:17.019781 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaefd24-2955-4fec-8048-8f2d8cb53e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:17.020199 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaefd24-2955-4fec-8048-8f2d8cb53e9b admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:17.020897 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaefd24-2955-4fec-8048-8f2d8cb53e9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:17.021687 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-13862dee-ca94-45d7-87fa-90c2c02fb8a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b2c730729bc414a9eda1eb1e63e2726'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:17.022660 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-13862dee-ca94-45d7-87fa-90c2c02fb8a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b2c730729bc414a9eda1eb1e63e2726'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:17.022846 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaefd24-2955-4fec-8048-8f2d8cb53e9b admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:17.151435 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-13862dee-ca94-45d7-87fa-90c2c02fb8a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b2c730729bc414a9eda1eb1e63e2726'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:17.170298 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3085/6130] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:34:16 2022] POST /identity/v3/users => generated 291 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:34:17.172780 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-13862dee-ca94-45d7-87fa-90c2c02fb8a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b2c730729bc414a9eda1eb1e63e2726'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:17.175849 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaefd24-2955-4fec-8048-8f2d8cb53e9b admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:17.180952 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-deaefd24-2955-4fec-8048-8f2d8cb53e9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:17.187650 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3046/6131] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:34:16 2022] DELETE /identity/v3/users/4b2c730729bc414a9eda1eb1e63e2726 => generated 0 bytes in 651 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:17.221879 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaefd24-2955-4fec-8048-8f2d8cb53e9b admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:17.318223 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e70a073-3dd9-4f08-8be7-015625c010a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:17.319308 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e70a073-3dd9-4f08-8be7-015625c010a5 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:17.319824 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e70a073-3dd9-4f08-8be7-015625c010a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:17.320920 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e70a073-3dd9-4f08-8be7-015625c010a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:17.322295 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e70a073-3dd9-4f08-8be7-015625c010a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:17.324047 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e70a073-3dd9-4f08-8be7-015625c010a5 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:17.339095 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3086/6132] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:34:17 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:34:17.343850 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13862dee-ca94-45d7-87fa-90c2c02fb8a2 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:17.364807 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13862dee-ca94-45d7-87fa-90c2c02fb8a2 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:17.373485 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a84c92-b3be-4ffb-827d-86c72269ee01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:17.375766 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a84c92-b3be-4ffb-827d-86c72269ee01 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:17.376066 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a84c92-b3be-4ffb-827d-86c72269ee01 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:17.376351 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a84c92-b3be-4ffb-827d-86c72269ee01 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:17.377628 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a84c92-b3be-4ffb-827d-86c72269ee01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:17.382705 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a84c92-b3be-4ffb-827d-86c72269ee01 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:17.383762 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e70a073-3dd9-4f08-8be7-015625c010a5 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:17.385989 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-5e70a073-3dd9-4f08-8be7-015625c010a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:17.411180 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e70a073-3dd9-4f08-8be7-015625c010a5 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:17.416160 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a2ab2-6d18-4199-a251-3df30e205461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:17.417301 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a2ab2-6d18-4199-a251-3df30e205461 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:17.417693 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a2ab2-6d18-4199-a251-3df30e205461 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:17.418083 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a2ab2-6d18-4199-a251-3df30e205461 admin admin] PATH_INFO: `/v3/projects/5d1c19b791654ed0b9facf59e9b2357f` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:17.420464 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599a2ab2-6d18-4199-a251-3df30e205461 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d1c19b791654ed0b9facf59e9b2357f)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:17.422770 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599a2ab2-6d18-4199-a251-3df30e205461 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:17.438352 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3047/6133] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:34:17 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:34:17.439164 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a84c92-b3be-4ffb-827d-86c72269ee01 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:17.480501 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a84c92-b3be-4ffb-827d-86c72269ee01 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:17.496490 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56dc140-683e-4602-9c5b-9eabcadb07a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:17.497686 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56dc140-683e-4602-9c5b-9eabcadb07a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:17.498169 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56dc140-683e-4602-9c5b-9eabcadb07a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:17.498552 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56dc140-683e-4602-9c5b-9eabcadb07a5 admin admin] PATH_INFO: `/v3/projects/f187941dc447483bad8f36293de5c259/users/604ba13e7bfb4a71a08c0954af0dfc3b/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:17.566979 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56dc140-683e-4602-9c5b-9eabcadb07a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f187941dc447483bad8f36293de5c259, user_id=604ba13e7bfb4a71a08c0954af0dfc3b, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:17.575624 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56dc140-683e-4602-9c5b-9eabcadb07a5 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:17.589249 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-599a2ab2-6d18-4199-a251-3df30e205461 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d1c19b791654ed0b9facf59e9b2357f', 'request_id': 'req-599a2ab2-6d18-4199-a251-3df30e205461'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:17.601814 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-599a2ab2-6d18-4199-a251-3df30e205461 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d1c19b791654ed0b9facf59e9b2357f', 'request_id': 'req-599a2ab2-6d18-4199-a251-3df30e205461'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:17.673349 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3048/6134] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:34:17 2022] PUT /identity/v3/projects/f187941dc447483bad8f36293de5c259/users/604ba13e7bfb4a71a08c0954af0dfc3b/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:17.681341 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd6d82e-2e68-47d2-a9d4-38d4b837295a None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:17.681634 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd6d82e-2e68-47d2-a9d4-38d4b837295a None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:17.681911 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd6d82e-2e68-47d2-a9d4-38d4b837295a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:17.705843 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-599a2ab2-6d18-4199-a251-3df30e205461 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d1c19b791654ed0b9facf59e9b2357f', 'request_id': 'req-599a2ab2-6d18-4199-a251-3df30e205461'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:17.731957 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-599a2ab2-6d18-4199-a251-3df30e205461 admin admin] The token cache is being invalidate because project 5d1c19b791654ed0b9facf59e9b2357f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:34:17.732405 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-599a2ab2-6d18-4199-a251-3df30e205461 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:17.733996 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-599a2ab2-6d18-4199-a251-3df30e205461 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:17.737170 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3087/6135] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:34:17 2022] DELETE /identity/v3/projects/5d1c19b791654ed0b9facf59e9b2357f => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:34:17.742680 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53efbfb0-4225-4515-9f9f-af1e0df42b34 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:17.743363 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-7cd6d82e-2e68-47d2-a9d4-38d4b837295a None None] MFA Rules not processed for user `604ba13e7bfb4a71a08c0954af0dfc3b`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:17.744022 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53efbfb0-4225-4515-9f9f-af1e0df42b34 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:17.744547 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53efbfb0-4225-4515-9f9f-af1e0df42b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:17.744673 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-7cd6d82e-2e68-47d2-a9d4-38d4b837295a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:17.786495 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-53efbfb0-4225-4515-9f9f-af1e0df42b34 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:17.787921 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-53efbfb0-4225-4515-9f9f-af1e0df42b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:17.874854 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3049/6136] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:17.902075 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3088/6137] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:17.907885 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd6d82e-2e68-47d2-a9d4-38d4b837295a None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:17.909393 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-7cd6d82e-2e68-47d2-a9d4-38d4b837295a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:17.913959 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad043799-742a-4056-b0f1-fba055ce585d None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:17.924539 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad043799-742a-4056-b0f1-fba055ce585d None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:17.925183 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad043799-742a-4056-b0f1-fba055ce585d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:17.973984 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-ad043799-742a-4056-b0f1-fba055ce585d None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:17.975703 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ad043799-742a-4056-b0f1-fba055ce585d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:17.989235 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3089/6138] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:17.993270 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad043799-742a-4056-b0f1-fba055ce585d None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:18.006011 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad043799-742a-4056-b0f1-fba055ce585d None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:18.011985 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f051737-176d-4ce8-8e7d-297a89540b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:18.013067 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f051737-176d-4ce8-8e7d-297a89540b28 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:18.013563 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f051737-176d-4ce8-8e7d-297a89540b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:18.014009 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f051737-176d-4ce8-8e7d-297a89540b28 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:18.014747 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f051737-176d-4ce8-8e7d-297a89540b28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:34:18.015063 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f051737-176d-4ce8-8e7d-297a89540b28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:18.016801 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f051737-176d-4ce8-8e7d-297a89540b28 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:18.025739 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd6d82e-2e68-47d2-a9d4-38d4b837295a None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:18.035220 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb63ae3b-68d1-4873-a1dc-9ce076bcc932 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:18.036411 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63ae3b-68d1-4873-a1dc-9ce076bcc932 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:18.036911 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63ae3b-68d1-4873-a1dc-9ce076bcc932 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:18.038061 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63ae3b-68d1-4873-a1dc-9ce076bcc932 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:18.042036 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3090/6139] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:34:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:34:18.045672 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f051737-176d-4ce8-8e7d-297a89540b28 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:18.056892 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f051737-176d-4ce8-8e7d-297a89540b28 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:18.061496 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb63ae3b-68d1-4873-a1dc-9ce076bcc932 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:18.062343 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7780fdd9-8a9f-4385-aab6-94a977c89f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:18.062983 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb63ae3b-68d1-4873-a1dc-9ce076bcc932 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:18.063427 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7780fdd9-8a9f-4385-aab6-94a977c89f34 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:18.063911 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7780fdd9-8a9f-4385-aab6-94a977c89f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:18.064279 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7780fdd9-8a9f-4385-aab6-94a977c89f34 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:18.067225 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7780fdd9-8a9f-4385-aab6-94a977c89f34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:18.067225 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7780fdd9-8a9f-4385-aab6-94a977c89f34 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:18.082329 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3050/6140] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:34:17 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:34:18.084811 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb63ae3b-68d1-4873-a1dc-9ce076bcc932 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:18.088587 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-bb63ae3b-68d1-4873-a1dc-9ce076bcc932 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:18.110482 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb63ae3b-68d1-4873-a1dc-9ce076bcc932 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:18.114566 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e892c78-bd0b-4edd-a2f7-2d750725d2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:18.115277 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e892c78-bd0b-4edd-a2f7-2d750725d2fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:18.115757 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e892c78-bd0b-4edd-a2f7-2d750725d2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:18.116117 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e892c78-bd0b-4edd-a2f7-2d750725d2fc admin admin] PATH_INFO: `/v3/projects/829ec5c876a244508f4f4ba36b1e332d` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:18.117964 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e892c78-bd0b-4edd-a2f7-2d750725d2fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=829ec5c876a244508f4f4ba36b1e332d)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:18.120228 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e892c78-bd0b-4edd-a2f7-2d750725d2fc admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:18.169171 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3091/6141] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:34:18 2022] POST /identity/v3/projects => generated 373 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:34:18.174244 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7780fdd9-8a9f-4385-aab6-94a977c89f34 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:18.293548 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7780fdd9-8a9f-4385-aab6-94a977c89f34 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:18.299200 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f45a548-9a10-464d-aa03-8fb4f8dc6dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:18.299874 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45a548-9a10-464d-aa03-8fb4f8dc6dd4 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:18.300233 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45a548-9a10-464d-aa03-8fb4f8dc6dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:18.300578 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45a548-9a10-464d-aa03-8fb4f8dc6dd4 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:18.301343 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f45a548-9a10-464d-aa03-8fb4f8dc6dd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:18.303513 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f45a548-9a10-464d-aa03-8fb4f8dc6dd4 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:18.354813 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7e892c78-bd0b-4edd-a2f7-2d750725d2fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '829ec5c876a244508f4f4ba36b1e332d', 'request_id': 'req-7e892c78-bd0b-4edd-a2f7-2d750725d2fc'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:18.365356 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7e892c78-bd0b-4edd-a2f7-2d750725d2fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '829ec5c876a244508f4f4ba36b1e332d', 'request_id': 'req-7e892c78-bd0b-4edd-a2f7-2d750725d2fc'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:18.375697 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7e892c78-bd0b-4edd-a2f7-2d750725d2fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '829ec5c876a244508f4f4ba36b1e332d', 'request_id': 'req-7e892c78-bd0b-4edd-a2f7-2d750725d2fc'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:18.391319 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3092/6142] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:34:18 2022] POST /identity/v3/users => generated 287 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:34:18.396155 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f45a548-9a10-464d-aa03-8fb4f8dc6dd4 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:18.432237 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f45a548-9a10-464d-aa03-8fb4f8dc6dd4 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:18.491807 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7e892c78-bd0b-4edd-a2f7-2d750725d2fc admin admin] The token cache is being invalidate because project 829ec5c876a244508f4f4ba36b1e332d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:34:18.496245 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7e892c78-bd0b-4edd-a2f7-2d750725d2fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:18.496245 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7e892c78-bd0b-4edd-a2f7-2d750725d2fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:18.496245 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3051/6143] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:34:18 2022] DELETE /identity/v3/projects/829ec5c876a244508f4f4ba36b1e332d => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:18.502710 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a924113-56e9-4da5-8b85-9ca03761396d None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:18.503085 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a924113-56e9-4da5-8b85-9ca03761396d None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:18.503424 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a924113-56e9-4da5-8b85-9ca03761396d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:18.549387 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-5a924113-56e9-4da5-8b85-9ca03761396d None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:18.550687 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-5a924113-56e9-4da5-8b85-9ca03761396d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:18.551554 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b37ac31-7496-4e4b-934a-f975743f4540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:18.552448 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b37ac31-7496-4e4b-934a-f975743f4540 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:18.553334 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b37ac31-7496-4e4b-934a-f975743f4540 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:18.553789 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b37ac31-7496-4e4b-934a-f975743f4540 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:18.556248 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b37ac31-7496-4e4b-934a-f975743f4540 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:18.559427 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b37ac31-7496-4e4b-934a-f975743f4540 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:18.574453 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3052/6144] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:18.581614 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f349e-5f13-48ac-a5ca-3d2b00ef09c5 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:18.581895 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f349e-5f13-48ac-a5ca-3d2b00ef09c5 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:18.582223 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f349e-5f13-48ac-a5ca-3d2b00ef09c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:18.588595 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3093/6145] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:34:18 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:34:18.592280 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b37ac31-7496-4e4b-934a-f975743f4540 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:18.596712 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-1b37ac31-7496-4e4b-934a-f975743f4540 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:18.622628 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-994f349e-5f13-48ac-a5ca-3d2b00ef09c5 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:18.622628 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-994f349e-5f13-48ac-a5ca-3d2b00ef09c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:18.625808 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b37ac31-7496-4e4b-934a-f975743f4540 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:18.645387 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3053/6146] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:34:18.657951 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994f349e-5f13-48ac-a5ca-3d2b00ef09c5 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:18.661330 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afb8a00-b1ac-4b31-8fbf-be810124318f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:18.662056 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb8a00-b1ac-4b31-8fbf-be810124318f admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:18.662724 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb8a00-b1ac-4b31-8fbf-be810124318f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:18.663730 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb8a00-b1ac-4b31-8fbf-be810124318f admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:18.665548 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afb8a00-b1ac-4b31-8fbf-be810124318f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:18.668096 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afb8a00-b1ac-4b31-8fbf-be810124318f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:18.671813 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994f349e-5f13-48ac-a5ca-3d2b00ef09c5 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:18.678982 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24598a09-4ac0-4e53-9bab-fb7fbaa4db18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:18.680574 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24598a09-4ac0-4e53-9bab-fb7fbaa4db18 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:18.687270 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24598a09-4ac0-4e53-9bab-fb7fbaa4db18 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:18.687270 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24598a09-4ac0-4e53-9bab-fb7fbaa4db18 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:18.687270 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24598a09-4ac0-4e53-9bab-fb7fbaa4db18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:34:18.687270 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24598a09-4ac0-4e53-9bab-fb7fbaa4db18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:18.687270 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24598a09-4ac0-4e53-9bab-fb7fbaa4db18 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:18.689559 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3094/6147] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:34:18 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:34:18.693802 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afb8a00-b1ac-4b31-8fbf-be810124318f admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:18.700244 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3054/6148] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:34:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:34:18.704051 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24598a09-4ac0-4e53-9bab-fb7fbaa4db18 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:18.718693 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24598a09-4ac0-4e53-9bab-fb7fbaa4db18 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:18.724197 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afb8a00-b1ac-4b31-8fbf-be810124318f admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:18.730648 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac7ab60-65a1-4c09-b9e6-7c10a0447f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:18.731692 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7ab60-65a1-4c09-b9e6-7c10a0447f2a admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:18.732101 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ff4005-2f43-4318-a323-0132fa43685b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:18.733189 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7ab60-65a1-4c09-b9e6-7c10a0447f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:18.733553 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7ab60-65a1-4c09-b9e6-7c10a0447f2a admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:18.734373 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ff4005-2f43-4318-a323-0132fa43685b admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:18.735167 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac7ab60-65a1-4c09-b9e6-7c10a0447f2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:18.735672 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ff4005-2f43-4318-a323-0132fa43685b admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:18.736167 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ff4005-2f43-4318-a323-0132fa43685b admin admin] PATH_INFO: `/v3/projects/e9e283a4783c4bcc8acc4e2986c87f1a/users/9efb64ead35e4feb8393410c86256e39/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:18.737861 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac7ab60-65a1-4c09-b9e6-7c10a0447f2a admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:18.760508 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ff4005-2f43-4318-a323-0132fa43685b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9e283a4783c4bcc8acc4e2986c87f1a, user_id=9efb64ead35e4feb8393410c86256e39, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:18.762968 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ff4005-2f43-4318-a323-0132fa43685b admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:18.858337 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3055/6149] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:34:18 2022] POST /identity/v3/projects => generated 373 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:34:18.862278 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac7ab60-65a1-4c09-b9e6-7c10a0447f2a admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:18.886630 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3095/6150] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:34:18 2022] PUT /identity/v3/projects/e9e283a4783c4bcc8acc4e2986c87f1a/users/9efb64ead35e4feb8393410c86256e39/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:18.898084 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd8ef2-a47e-4f9c-ac82-d8f430668924 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:18.900062 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd8ef2-a47e-4f9c-ac82-d8f430668924 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:18.901300 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd8ef2-a47e-4f9c-ac82-d8f430668924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:18.947692 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-7acd8ef2-a47e-4f9c-ac82-d8f430668924 None None] MFA Rules not processed for user `9efb64ead35e4feb8393410c86256e39`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:18.949046 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-7acd8ef2-a47e-4f9c-ac82-d8f430668924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:18.968729 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac7ab60-65a1-4c09-b9e6-7c10a0447f2a admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:19.047514 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b88802d-0982-42f9-b4cc-22ab890a5f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:19.048272 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b88802d-0982-42f9-b4cc-22ab890a5f92 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:19.048272 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b88802d-0982-42f9-b4cc-22ab890a5f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:19.048272 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b88802d-0982-42f9-b4cc-22ab890a5f92 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:19.049298 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b88802d-0982-42f9-b4cc-22ab890a5f92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:19.051226 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b88802d-0982-42f9-b4cc-22ab890a5f92 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:19.057163 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3096/6151] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:19.062846 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acd8ef2-a47e-4f9c-ac82-d8f430668924 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:19.077511 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acd8ef2-a47e-4f9c-ac82-d8f430668924 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:19.082950 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bc05ac-88c6-4b5f-b175-25477248b8d3 tempest-IdentityCatalogTest-970512118 tempest-IdentityCatalogTest-970512118-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9efb64ead35e4feb8393410c86256e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9e283a4783c4bcc8acc4e2986c87f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:19.084309 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc05ac-88c6-4b5f-b175-25477248b8d3 tempest-IdentityCatalogTest-970512118 tempest-IdentityCatalogTest-970512118-project] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:19.084309 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc05ac-88c6-4b5f-b175-25477248b8d3 tempest-IdentityCatalogTest-970512118 tempest-IdentityCatalogTest-970512118-project] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:19.084309 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc05ac-88c6-4b5f-b175-25477248b8d3 tempest-IdentityCatalogTest-970512118 tempest-IdentityCatalogTest-970512118-project] PATH_INFO: `/v3/auth/catalog` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:19.084830 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bc05ac-88c6-4b5f-b175-25477248b8d3 tempest-IdentityCatalogTest-970512118 tempest-IdentityCatalogTest-970512118-project] RBAC: Authorizing `identity:get_auth_catalog()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:19.086703 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bc05ac-88c6-4b5f-b175-25477248b8d3 tempest-IdentityCatalogTest-970512118 tempest-IdentityCatalogTest-970512118-project] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:19.088973 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3097/6152] 10.222.0.52 () {58 vars in 1142 bytes} [Sat May 14 21:34:19 2022] GET /identity/v3/auth/catalog => generated 2648 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:34:19.093901 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bc05ac-88c6-4b5f-b175-25477248b8d3 tempest-IdentityCatalogTest-970512118 tempest-IdentityCatalogTest-970512118-project] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:19.112446 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bc05ac-88c6-4b5f-b175-25477248b8d3 tempest-IdentityCatalogTest-970512118 tempest-IdentityCatalogTest-970512118-project] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:19.115457 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceffe556-8222-4f3b-aedc-e0e3cc5c2cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:19.116875 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceffe556-8222-4f3b-aedc-e0e3cc5c2cd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:19.116875 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceffe556-8222-4f3b-aedc-e0e3cc5c2cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:19.117091 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceffe556-8222-4f3b-aedc-e0e3cc5c2cd4 admin admin] PATH_INFO: `/v3/users/9efb64ead35e4feb8393410c86256e39` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:19.118484 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceffe556-8222-4f3b-aedc-e0e3cc5c2cd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9efb64ead35e4feb8393410c86256e39)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:19.120521 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceffe556-8222-4f3b-aedc-e0e3cc5c2cd4 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:19.163520 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3056/6153] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:34:18 2022] POST /identity/v3/users => generated 287 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:34:19.165208 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b88802d-0982-42f9-b4cc-22ab890a5f92 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:19.175086 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b88802d-0982-42f9-b4cc-22ab890a5f92 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:19.182987 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed266f3e-16c9-47ca-abec-c983f7b7e55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:19.183716 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed266f3e-16c9-47ca-abec-c983f7b7e55e admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:19.184004 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed266f3e-16c9-47ca-abec-c983f7b7e55e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:19.184281 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed266f3e-16c9-47ca-abec-c983f7b7e55e admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:19.185018 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed266f3e-16c9-47ca-abec-c983f7b7e55e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:19.188568 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed266f3e-16c9-47ca-abec-c983f7b7e55e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:19.203637 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3057/6154] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:34:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:34:19.205530 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed266f3e-16c9-47ca-abec-c983f7b7e55e admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:19.219728 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed266f3e-16c9-47ca-abec-c983f7b7e55e admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:19.229906 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce97d85b-a686-4123-863e-64c362aa45a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:19.230598 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce97d85b-a686-4123-863e-64c362aa45a7 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:19.230880 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce97d85b-a686-4123-863e-64c362aa45a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:19.231154 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce97d85b-a686-4123-863e-64c362aa45a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:19.231911 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce97d85b-a686-4123-863e-64c362aa45a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:19.233519 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce97d85b-a686-4123-863e-64c362aa45a7 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:19.252176 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3058/6155] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:34:19 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:34:19.252176 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce97d85b-a686-4123-863e-64c362aa45a7 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:19.278224 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce97d85b-a686-4123-863e-64c362aa45a7 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:19.289343 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca20ae2-e56f-45be-aa79-e0844b154263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:19.290443 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca20ae2-e56f-45be-aa79-e0844b154263 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:19.290735 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca20ae2-e56f-45be-aa79-e0844b154263 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:19.291002 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca20ae2-e56f-45be-aa79-e0844b154263 admin admin] PATH_INFO: `/v3/projects/e6392084e6f942aca6701f8f01419ab4/users/0e789a633f77451cb9d15d8812ca4a50/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:19.314367 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca20ae2-e56f-45be-aa79-e0844b154263 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6392084e6f942aca6701f8f01419ab4, user_id=0e789a633f77451cb9d15d8812ca4a50, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:19.317892 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca20ae2-e56f-45be-aa79-e0844b154263 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:19.386162 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ceffe556-8222-4f3b-aedc-e0e3cc5c2cd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9efb64ead35e4feb8393410c86256e39'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:19.407021 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ceffe556-8222-4f3b-aedc-e0e3cc5c2cd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9efb64ead35e4feb8393410c86256e39'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:19.409859 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3059/6156] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:34:19 2022] PUT /identity/v3/projects/e6392084e6f942aca6701f8f01419ab4/users/0e789a633f77451cb9d15d8812ca4a50/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:34:19.425169 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf226971-75c2-4b45-aded-38952a22f471 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:19.425461 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf226971-75c2-4b45-aded-38952a22f471 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:19.425939 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf226971-75c2-4b45-aded-38952a22f471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:19.426844 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ceffe556-8222-4f3b-aedc-e0e3cc5c2cd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9efb64ead35e4feb8393410c86256e39'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:19.488043 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ceffe556-8222-4f3b-aedc-e0e3cc5c2cd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9efb64ead35e4feb8393410c86256e39'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:19.489109 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ceffe556-8222-4f3b-aedc-e0e3cc5c2cd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9efb64ead35e4feb8393410c86256e39'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:19.501154 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3098/6157] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:34:19 2022] DELETE /identity/v3/users/9efb64ead35e4feb8393410c86256e39 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:34:19.505595 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f929cb98-7ac4-4e27-9112-09cdba3b2789 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:19.505989 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f929cb98-7ac4-4e27-9112-09cdba3b2789 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:19.506371 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f929cb98-7ac4-4e27-9112-09cdba3b2789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:19.521001 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-cf226971-75c2-4b45-aded-38952a22f471 None None] MFA Rules not processed for user `0e789a633f77451cb9d15d8812ca4a50`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:19.522510 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-cf226971-75c2-4b45-aded-38952a22f471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:19.549267 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-f929cb98-7ac4-4e27-9112-09cdba3b2789 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:19.552247 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-f929cb98-7ac4-4e27-9112-09cdba3b2789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:19.666925 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3060/6158] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:19.670111 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf226971-75c2-4b45-aded-38952a22f471 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:19.689025 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf226971-75c2-4b45-aded-38952a22f471 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:19.702078 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a69c1-0214-4f37-b6f9-a6f08bf8f1f1 tempest-IdentityV3UsersTest-175546455 tempest-IdentityV3UsersTest-175546455-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e789a633f77451cb9d15d8812ca4a50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6392084e6f942aca6701f8f01419ab4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:19.703218 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a69c1-0214-4f37-b6f9-a6f08bf8f1f1 tempest-IdentityV3UsersTest-175546455 tempest-IdentityV3UsersTest-175546455-project] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:19.703602 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a69c1-0214-4f37-b6f9-a6f08bf8f1f1 tempest-IdentityV3UsersTest-175546455 tempest-IdentityV3UsersTest-175546455-project] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:19.703892 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a69c1-0214-4f37-b6f9-a6f08bf8f1f1 tempest-IdentityV3UsersTest-175546455 tempest-IdentityV3UsersTest-175546455-project] PATH_INFO: `/v3/users/0e789a633f77451cb9d15d8812ca4a50/password` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:19.775057 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3099/6159] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:19.803282 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f929cb98-7ac4-4e27-9112-09cdba3b2789 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:19.805789 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-f929cb98-7ac4-4e27-9112-09cdba3b2789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:19.809679 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-923a69c1-0214-4f37-b6f9-a6f08bf8f1f1 tempest-IdentityV3UsersTest-175546455 tempest-IdentityV3UsersTest-175546455-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '0e789a633f77451cb9d15d8812ca4a50'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:19.889991 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3061/6160] 10.222.0.52 () {60 vars in 1268 bytes} [Sat May 14 21:34:19 2022] POST /identity/v3/users/0e789a633f77451cb9d15d8812ca4a50/password => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:19.917888 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f929cb98-7ac4-4e27-9112-09cdba3b2789 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:19.925716 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d33ee-e811-4407-b420-d96bd060a173 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:19.926712 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d33ee-e811-4407-b420-d96bd060a173 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:19.932339 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d33ee-e811-4407-b420-d96bd060a173 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:19.932339 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d33ee-e811-4407-b420-d96bd060a173 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:19.943301 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831d33ee-e811-4407-b420-d96bd060a173 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:19.944906 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831d33ee-e811-4407-b420-d96bd060a173 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:19.957752 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3100/6161] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:34:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:34:20.901879 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a1208-01c7-4976-9640-110281a935b9 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:20.902494 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a1208-01c7-4976-9640-110281a935b9 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:20.902494 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a1208-01c7-4976-9640-110281a935b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:20.941801 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-115a1208-01c7-4976-9640-110281a935b9 None None] MFA Rules not processed for user `0e789a633f77451cb9d15d8812ca4a50`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:20.943339 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-115a1208-01c7-4976-9640-110281a935b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:20.948185 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3062/6162] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:20 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 21:34:20.953137 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1550885e-fddf-41dc-86a5-f724a4b69977 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:20.953523 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1550885e-fddf-41dc-86a5-f724a4b69977 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:20.954047 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1550885e-fddf-41dc-86a5-f724a4b69977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:20.977868 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-1550885e-fddf-41dc-86a5-f724a4b69977 None None] MFA Rules not processed for user `0e789a633f77451cb9d15d8812ca4a50`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:20.979119 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-1550885e-fddf-41dc-86a5-f724a4b69977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:20.990827 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3101/6163] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:20.993014 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115a1208-01c7-4976-9640-110281a935b9 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:21.006286 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115a1208-01c7-4976-9640-110281a935b9 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:21.013035 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f639202f-0df1-4b34-bbef-50f3e0cb44db tempest-IdentityV3UsersTest-175546455 tempest-IdentityV3UsersTest-175546455-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e789a633f77451cb9d15d8812ca4a50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6392084e6f942aca6701f8f01419ab4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:21.013929 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f639202f-0df1-4b34-bbef-50f3e0cb44db tempest-IdentityV3UsersTest-175546455 tempest-IdentityV3UsersTest-175546455-project] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:21.014219 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f639202f-0df1-4b34-bbef-50f3e0cb44db tempest-IdentityV3UsersTest-175546455 tempest-IdentityV3UsersTest-175546455-project] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:21.014498 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f639202f-0df1-4b34-bbef-50f3e0cb44db tempest-IdentityV3UsersTest-175546455 tempest-IdentityV3UsersTest-175546455-project] PATH_INFO: `/v3/users/0e789a633f77451cb9d15d8812ca4a50/password` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:21.116350 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-f639202f-0df1-4b34-bbef-50f3e0cb44db tempest-IdentityV3UsersTest-175546455 tempest-IdentityV3UsersTest-175546455-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. May 14 21:34:21.116350 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:34:21.116350 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 21:34:21.116350 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 21:34:21.116350 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 21:34:21.116350 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 21:34:21.116350 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 21:34:21.116350 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 21:34:21.116350 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 21:34:21.116350 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 21:34:21.116350 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 21:34:21.116350 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 21:34:21.116350 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper May 14 21:34:21.122669 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return f(*args, **kwargs) May 14 21:34:21.122669 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post May 14 21:34:21.122669 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( May 14 21:34:21.122669 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 21:34:21.122669 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 21:34:21.122669 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 21:34:21.122669 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 21:34:21.122669 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password May 14 21:34:21.122669 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) May 14 21:34:21.122669 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password May 14 21:34:21.122669 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) May 14 21:34:21.122669 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history May 14 21:34:21.122669 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( May 14 21:34:21.122669 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. May 14 21:34:21.122669 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:34:21.124181 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3063/6164] 10.222.0.52 () {60 vars in 1268 bytes} [Sat May 14 21:34:20 2022] POST /identity/v3/users/0e789a633f77451cb9d15d8812ca4a50/password => generated 188 bytes in 126 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) May 14 21:34:21.124269 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1550885e-fddf-41dc-86a5-f724a4b69977 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:21.147105 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1550885e-fddf-41dc-86a5-f724a4b69977 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:21.163713 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc5e3e-2d24-4124-b9de-fd8f558f0f72 tempest-IdentityV3UsersTest-175546455 tempest-IdentityV3UsersTest-175546455-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e789a633f77451cb9d15d8812ca4a50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6392084e6f942aca6701f8f01419ab4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:21.165086 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc5e3e-2d24-4124-b9de-fd8f558f0f72 tempest-IdentityV3UsersTest-175546455 tempest-IdentityV3UsersTest-175546455-project] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:21.165909 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc5e3e-2d24-4124-b9de-fd8f558f0f72 tempest-IdentityV3UsersTest-175546455 tempest-IdentityV3UsersTest-175546455-project] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:21.166358 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc5e3e-2d24-4124-b9de-fd8f558f0f72 tempest-IdentityV3UsersTest-175546455 tempest-IdentityV3UsersTest-175546455-project] PATH_INFO: `/v3/users/0e789a633f77451cb9d15d8812ca4a50/password` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:21.252880 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-15fc5e3e-2d24-4124-b9de-fd8f558f0f72 tempest-IdentityV3UsersTest-175546455 tempest-IdentityV3UsersTest-175546455-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. May 14 21:34:21.252880 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:34:21.252880 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 21:34:21.252880 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 21:34:21.252880 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 21:34:21.252880 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 21:34:21.252880 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 21:34:21.252880 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 21:34:21.252880 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 21:34:21.252880 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 21:34:21.252880 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 21:34:21.252880 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 21:34:21.252880 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper May 14 21:34:21.254011 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return f(*args, **kwargs) May 14 21:34:21.254011 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post May 14 21:34:21.254011 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( May 14 21:34:21.254011 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 21:34:21.254011 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 21:34:21.254011 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 21:34:21.254011 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 21:34:21.254011 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password May 14 21:34:21.254011 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) May 14 21:34:21.254011 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password May 14 21:34:21.254011 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) May 14 21:34:21.254011 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history May 14 21:34:21.254011 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( May 14 21:34:21.254011 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. May 14 21:34:21.254011 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:34:21.256509 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3102/6165] 10.222.0.52 () {60 vars in 1268 bytes} [Sat May 14 21:34:21 2022] POST /identity/v3/users/0e789a633f77451cb9d15d8812ca4a50/password => generated 188 bytes in 132 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) May 14 21:34:21.258833 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f639202f-0df1-4b34-bbef-50f3e0cb44db tempest-IdentityV3UsersTest-175546455 tempest-IdentityV3UsersTest-175546455-project] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:21.268913 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f639202f-0df1-4b34-bbef-50f3e0cb44db tempest-IdentityV3UsersTest-175546455 tempest-IdentityV3UsersTest-175546455-project] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:21.275395 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc5e3e-2d24-4124-b9de-fd8f558f0f72 tempest-IdentityV3UsersTest-175546455 tempest-IdentityV3UsersTest-175546455-project] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:21.277232 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-15fc5e3e-2d24-4124-b9de-fd8f558f0f72 tempest-IdentityV3UsersTest-175546455 tempest-IdentityV3UsersTest-175546455-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:21.277794 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b23b7-2b0b-4ad3-a795-2710027f0b5d tempest-IdentityV3UsersTest-175546455 tempest-IdentityV3UsersTest-175546455-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e789a633f77451cb9d15d8812ca4a50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6392084e6f942aca6701f8f01419ab4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:21.278799 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b23b7-2b0b-4ad3-a795-2710027f0b5d tempest-IdentityV3UsersTest-175546455 tempest-IdentityV3UsersTest-175546455-project] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:21.279865 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b23b7-2b0b-4ad3-a795-2710027f0b5d tempest-IdentityV3UsersTest-175546455 tempest-IdentityV3UsersTest-175546455-project] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:21.280411 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b23b7-2b0b-4ad3-a795-2710027f0b5d tempest-IdentityV3UsersTest-175546455 tempest-IdentityV3UsersTest-175546455-project] PATH_INFO: `/v3/users/0e789a633f77451cb9d15d8812ca4a50/password` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:21.292985 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc5e3e-2d24-4124-b9de-fd8f558f0f72 tempest-IdentityV3UsersTest-175546455 tempest-IdentityV3UsersTest-175546455-project] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:21.298098 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e54d61-ed80-46a7-a015-e5dbc487b84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:21.298968 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e54d61-ed80-46a7-a015-e5dbc487b84e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:21.299252 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e54d61-ed80-46a7-a015-e5dbc487b84e admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:21.299561 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e54d61-ed80-46a7-a015-e5dbc487b84e admin admin] PATH_INFO: `/v3/projects/e9e283a4783c4bcc8acc4e2986c87f1a` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:21.300953 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e54d61-ed80-46a7-a015-e5dbc487b84e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9e283a4783c4bcc8acc4e2986c87f1a)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:21.302974 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e54d61-ed80-46a7-a015-e5dbc487b84e admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:21.413434 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-704b23b7-2b0b-4ad3-a795-2710027f0b5d tempest-IdentityV3UsersTest-175546455 tempest-IdentityV3UsersTest-175546455-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '0e789a633f77451cb9d15d8812ca4a50'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:21.456493 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f9e54d61-ed80-46a7-a015-e5dbc487b84e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9e283a4783c4bcc8acc4e2986c87f1a', 'request_id': 'req-f9e54d61-ed80-46a7-a015-e5dbc487b84e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:21.466384 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f9e54d61-ed80-46a7-a015-e5dbc487b84e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9e283a4783c4bcc8acc4e2986c87f1a', 'request_id': 'req-f9e54d61-ed80-46a7-a015-e5dbc487b84e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:21.481748 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3064/6166] 10.222.0.52 () {60 vars in 1268 bytes} [Sat May 14 21:34:21 2022] POST /identity/v3/users/0e789a633f77451cb9d15d8812ca4a50/password => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:21.602653 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f9e54d61-ed80-46a7-a015-e5dbc487b84e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9e283a4783c4bcc8acc4e2986c87f1a', 'request_id': 'req-f9e54d61-ed80-46a7-a015-e5dbc487b84e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:21.616175 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f9e54d61-ed80-46a7-a015-e5dbc487b84e admin admin] The token cache is being invalidate because project e9e283a4783c4bcc8acc4e2986c87f1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:34:21.616569 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f9e54d61-ed80-46a7-a015-e5dbc487b84e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:21.617523 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f9e54d61-ed80-46a7-a015-e5dbc487b84e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:21.619538 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3103/6167] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:34:21 2022] DELETE /identity/v3/projects/e9e283a4783c4bcc8acc4e2986c87f1a => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:21.624571 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae491b-e3b2-42d8-b70f-bf21d38f83c4 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:21.624863 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae491b-e3b2-42d8-b70f-bf21d38f83c4 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:21.625149 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae491b-e3b2-42d8-b70f-bf21d38f83c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:21.648992 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-7aae491b-e3b2-42d8-b70f-bf21d38f83c4 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:21.650416 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-7aae491b-e3b2-42d8-b70f-bf21d38f83c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:21.712856 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3065/6168] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:21.720752 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e623b64-cce6-47d3-9368-cd973727f7c1 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:21.721086 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e623b64-cce6-47d3-9368-cd973727f7c1 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:21.721373 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e623b64-cce6-47d3-9368-cd973727f7c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:21.739805 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-7e623b64-cce6-47d3-9368-cd973727f7c1 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:21.741017 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-7e623b64-cce6-47d3-9368-cd973727f7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:21.752755 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3104/6169] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:21.753978 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aae491b-e3b2-42d8-b70f-bf21d38f83c4 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:21.766414 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aae491b-e3b2-42d8-b70f-bf21d38f83c4 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:21.771943 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee40242f-6e48-4c10-ba32-666e87d3b416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:21.772724 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee40242f-6e48-4c10-ba32-666e87d3b416 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:21.774330 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee40242f-6e48-4c10-ba32-666e87d3b416 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:21.774330 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee40242f-6e48-4c10-ba32-666e87d3b416 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:21.775072 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee40242f-6e48-4c10-ba32-666e87d3b416 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:34:21.775521 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee40242f-6e48-4c10-ba32-666e87d3b416 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:21.777233 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee40242f-6e48-4c10-ba32-666e87d3b416 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:21.798069 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3066/6170] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:34:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:34:21.798190 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e623b64-cce6-47d3-9368-cd973727f7c1 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:21.807159 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e623b64-cce6-47d3-9368-cd973727f7c1 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:21.812068 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79602ea-0c3f-43b9-aed4-d6f22d12257c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:21.812745 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79602ea-0c3f-43b9-aed4-d6f22d12257c admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:21.813630 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79602ea-0c3f-43b9-aed4-d6f22d12257c admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:21.815047 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79602ea-0c3f-43b9-aed4-d6f22d12257c admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:21.817488 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79602ea-0c3f-43b9-aed4-d6f22d12257c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:21.823269 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79602ea-0c3f-43b9-aed4-d6f22d12257c admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:21.944408 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3105/6171] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:34:21 2022] POST /identity/v3/projects => generated 371 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:34:21.949279 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee40242f-6e48-4c10-ba32-666e87d3b416 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:21.962428 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee40242f-6e48-4c10-ba32-666e87d3b416 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:22.047121 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e839294-76fa-40b3-8808-90392a80ffbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:22.047896 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e839294-76fa-40b3-8808-90392a80ffbb admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:22.048153 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e839294-76fa-40b3-8808-90392a80ffbb admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:22.048424 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e839294-76fa-40b3-8808-90392a80ffbb admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:22.049127 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e839294-76fa-40b3-8808-90392a80ffbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:22.051238 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e839294-76fa-40b3-8808-90392a80ffbb admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:22.174256 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79602ea-0c3f-43b9-aed4-d6f22d12257c admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:22.174745 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3067/6172] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:34:21 2022] POST /identity/v3/users => generated 286 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:34:22.185924 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79602ea-0c3f-43b9-aed4-d6f22d12257c admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:22.192200 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7145204-c161-4069-8f73-5518165d9b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:22.192877 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7145204-c161-4069-8f73-5518165d9b0c admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:22.193159 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7145204-c161-4069-8f73-5518165d9b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:22.193438 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7145204-c161-4069-8f73-5518165d9b0c admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:22.194189 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7145204-c161-4069-8f73-5518165d9b0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:22.195868 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7145204-c161-4069-8f73-5518165d9b0c admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:22.207077 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3106/6173] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:34:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:34:22.210529 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e839294-76fa-40b3-8808-90392a80ffbb admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:22.222694 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e839294-76fa-40b3-8808-90392a80ffbb admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:22.228672 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822e4c74-2641-4787-b068-313710e0eb13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:22.229279 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822e4c74-2641-4787-b068-313710e0eb13 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:22.229561 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822e4c74-2641-4787-b068-313710e0eb13 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:22.229833 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822e4c74-2641-4787-b068-313710e0eb13 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:22.230549 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822e4c74-2641-4787-b068-313710e0eb13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:22.232172 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822e4c74-2641-4787-b068-313710e0eb13 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:22.247419 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3068/6174] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:34:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:34:22.248433 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7145204-c161-4069-8f73-5518165d9b0c admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:22.260737 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7145204-c161-4069-8f73-5518165d9b0c admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:22.268214 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e0faab-add8-4d94-ac04-5bbdb338e94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:22.280298 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e0faab-add8-4d94-ac04-5bbdb338e94a admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:22.280597 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e0faab-add8-4d94-ac04-5bbdb338e94a admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:22.280926 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e0faab-add8-4d94-ac04-5bbdb338e94a admin admin] PATH_INFO: `/v3/projects/637ccc6c96d649a68284b09ddb5a0b0a/users/d8177f12450e405785ae4c29d00f7ec6/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:22.297265 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e0faab-add8-4d94-ac04-5bbdb338e94a admin admin] RBAC: Authorizing `identity:create_grant(project_id=637ccc6c96d649a68284b09ddb5a0b0a, user_id=d8177f12450e405785ae4c29d00f7ec6, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:22.300201 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e0faab-add8-4d94-ac04-5bbdb338e94a admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:22.378269 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3107/6175] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:34:22 2022] PUT /identity/v3/projects/637ccc6c96d649a68284b09ddb5a0b0a/users/d8177f12450e405785ae4c29d00f7ec6/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:34:22.394961 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7de447-c79b-4656-a092-dd725bf9b4b4 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:22.395293 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7de447-c79b-4656-a092-dd725bf9b4b4 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:22.395621 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7de447-c79b-4656-a092-dd725bf9b4b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:22.425697 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-6b7de447-c79b-4656-a092-dd725bf9b4b4 None None] MFA Rules not processed for user `d8177f12450e405785ae4c29d00f7ec6`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:22.426920 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-6b7de447-c79b-4656-a092-dd725bf9b4b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:22.486594 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef1646b-cce5-4aee-a2aa-8a10f82ec883 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:22.486812 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef1646b-cce5-4aee-a2aa-8a10f82ec883 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:22.487101 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef1646b-cce5-4aee-a2aa-8a10f82ec883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:22.511209 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-8ef1646b-cce5-4aee-a2aa-8a10f82ec883 None None] MFA Rules not processed for user `0e789a633f77451cb9d15d8812ca4a50`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:22.512238 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3069/6176] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:22 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:22.513207 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-8ef1646b-cce5-4aee-a2aa-8a10f82ec883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:22.516634 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3108/6177] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:22 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 14 21:34:22.526304 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f47055-7927-484d-bfcd-6c37bb9f7d0e None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:22.526966 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f47055-7927-484d-bfcd-6c37bb9f7d0e None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:22.526966 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f47055-7927-484d-bfcd-6c37bb9f7d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:22.527838 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef1646b-cce5-4aee-a2aa-8a10f82ec883 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:22.529472 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-8ef1646b-cce5-4aee-a2aa-8a10f82ec883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:22.548119 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-55f47055-7927-484d-bfcd-6c37bb9f7d0e None None] MFA Rules not processed for user `0e789a633f77451cb9d15d8812ca4a50`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:22.549329 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-55f47055-7927-484d-bfcd-6c37bb9f7d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:22.614207 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3070/6178] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:22.619512 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f47055-7927-484d-bfcd-6c37bb9f7d0e None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:22.629607 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f47055-7927-484d-bfcd-6c37bb9f7d0e None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:22.632113 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef1646b-cce5-4aee-a2aa-8a10f82ec883 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:22.636625 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1151899e-d623-4b43-875f-32c41d300b35 tempest-IdentityV3UsersTest-175546455 tempest-IdentityV3UsersTest-175546455-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e789a633f77451cb9d15d8812ca4a50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6392084e6f942aca6701f8f01419ab4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:22.640514 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1151899e-d623-4b43-875f-32c41d300b35 tempest-IdentityV3UsersTest-175546455 tempest-IdentityV3UsersTest-175546455-project] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:22.640639 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2845534b-2712-4bf6-8af4-58d2c81fe15c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b5cb86f190f4fcfb06d66cb8f14643f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:22.640750 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1151899e-d623-4b43-875f-32c41d300b35 tempest-IdentityV3UsersTest-175546455 tempest-IdentityV3UsersTest-175546455-project] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:22.640750 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1151899e-d623-4b43-875f-32c41d300b35 tempest-IdentityV3UsersTest-175546455 tempest-IdentityV3UsersTest-175546455-project] PATH_INFO: `/v3/users/0e789a633f77451cb9d15d8812ca4a50/password` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:22.640921 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845534b-2712-4bf6-8af4-58d2c81fe15c service glance] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:22.640921 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845534b-2712-4bf6-8af4-58d2c81fe15c service glance] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:22.640921 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845534b-2712-4bf6-8af4-58d2c81fe15c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:22.652396 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2845534b-2712-4bf6-8af4-58d2c81fe15c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:22.654466 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2845534b-2712-4bf6-8af4-58d2c81fe15c service glance] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:22.666899 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3109/6179] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:34:22 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:34:22.768043 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-1151899e-d623-4b43-875f-32c41d300b35 tempest-IdentityV3UsersTest-175546455 tempest-IdentityV3UsersTest-175546455-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '0e789a633f77451cb9d15d8812ca4a50'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:22.866822 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3071/6180] 10.222.0.52 () {60 vars in 1268 bytes} [Sat May 14 21:34:22 2022] POST /identity/v3/users/0e789a633f77451cb9d15d8812ca4a50/password => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:34:23.874160 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47781e-0203-4a95-8ae4-8d7ca7f8e06a None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:23.874783 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47781e-0203-4a95-8ae4-8d7ca7f8e06a None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:23.874957 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47781e-0203-4a95-8ae4-8d7ca7f8e06a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:23.911954 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-ff47781e-0203-4a95-8ae4-8d7ca7f8e06a None None] MFA Rules not processed for user `0e789a633f77451cb9d15d8812ca4a50`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:23.914401 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ff47781e-0203-4a95-8ae4-8d7ca7f8e06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:23.923224 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3110/6181] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:23 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 21:34:23.929389 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda2ca8-e5cb-48ab-befa-4790ab65bb08 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:23.931315 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda2ca8-e5cb-48ab-befa-4790ab65bb08 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:23.931793 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda2ca8-e5cb-48ab-befa-4790ab65bb08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:23.957672 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-4eda2ca8-e5cb-48ab-befa-4790ab65bb08 None None] MFA Rules not processed for user `0e789a633f77451cb9d15d8812ca4a50`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:23.959762 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-4eda2ca8-e5cb-48ab-befa-4790ab65bb08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:23.975995 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff47781e-0203-4a95-8ae4-8d7ca7f8e06a None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:23.978059 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3072/6182] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:23.998120 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff47781e-0203-4a95-8ae4-8d7ca7f8e06a None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:24.018988 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e17ffe2-e083-44e0-bd52-a1ef85dfef6d tempest-IdentityV3UsersTest-175546455 tempest-IdentityV3UsersTest-175546455-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e789a633f77451cb9d15d8812ca4a50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6392084e6f942aca6701f8f01419ab4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:24.020205 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17ffe2-e083-44e0-bd52-a1ef85dfef6d tempest-IdentityV3UsersTest-175546455 tempest-IdentityV3UsersTest-175546455-project] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:24.020722 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17ffe2-e083-44e0-bd52-a1ef85dfef6d tempest-IdentityV3UsersTest-175546455 tempest-IdentityV3UsersTest-175546455-project] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:24.021269 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17ffe2-e083-44e0-bd52-a1ef85dfef6d tempest-IdentityV3UsersTest-175546455 tempest-IdentityV3UsersTest-175546455-project] PATH_INFO: `/v3/users/0e789a633f77451cb9d15d8812ca4a50/password` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:24.183396 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eda2ca8-e5cb-48ab-befa-4790ab65bb08 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:24.196298 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8e17ffe2-e083-44e0-bd52-a1ef85dfef6d tempest-IdentityV3UsersTest-175546455 tempest-IdentityV3UsersTest-175546455-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '0e789a633f77451cb9d15d8812ca4a50'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:24.255468 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eda2ca8-e5cb-48ab-befa-4790ab65bb08 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:24.260651 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3785e75-1a51-4815-b665-f3c758af1728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:24.261511 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3785e75-1a51-4815-b665-f3c758af1728 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:24.261796 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3785e75-1a51-4815-b665-f3c758af1728 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:24.262072 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3785e75-1a51-4815-b665-f3c758af1728 admin admin] PATH_INFO: `/v3/users/d8177f12450e405785ae4c29d00f7ec6` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:24.263407 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3785e75-1a51-4815-b665-f3c758af1728 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8177f12450e405785ae4c29d00f7ec6)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:24.265254 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3785e75-1a51-4815-b665-f3c758af1728 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:24.321736 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3111/6183] 10.222.0.52 () {60 vars in 1268 bytes} [Sat May 14 21:34:23 2022] POST /identity/v3/users/0e789a633f77451cb9d15d8812ca4a50/password => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:24.495108 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b3785e75-1a51-4815-b665-f3c758af1728 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8177f12450e405785ae4c29d00f7ec6'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:24.505721 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b3785e75-1a51-4815-b665-f3c758af1728 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8177f12450e405785ae4c29d00f7ec6'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:24.506614 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b3785e75-1a51-4815-b665-f3c758af1728 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8177f12450e405785ae4c29d00f7ec6'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:24.595096 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b3785e75-1a51-4815-b665-f3c758af1728 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8177f12450e405785ae4c29d00f7ec6'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:24.621729 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b3785e75-1a51-4815-b665-f3c758af1728 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8177f12450e405785ae4c29d00f7ec6'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:24.630220 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3073/6184] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:34:24 2022] DELETE /identity/v3/users/d8177f12450e405785ae4c29d00f7ec6 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:34:24.636135 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678db1f2-9b11-4449-8d17-d0def6cb83de None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:24.636354 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678db1f2-9b11-4449-8d17-d0def6cb83de None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:24.636634 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678db1f2-9b11-4449-8d17-d0def6cb83de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:24.667410 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-678db1f2-9b11-4449-8d17-d0def6cb83de None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:24.669344 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-678db1f2-9b11-4449-8d17-d0def6cb83de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:24.759121 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3112/6185] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:24.768852 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3785e75-1a51-4815-b665-f3c758af1728 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:24.770875 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b3785e75-1a51-4815-b665-f3c758af1728 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:24.831902 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3785e75-1a51-4815-b665-f3c758af1728 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:24.835568 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671fa313-a83f-4bcf-82be-d4e52417c41c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:24.836705 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671fa313-a83f-4bcf-82be-d4e52417c41c service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:24.836985 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671fa313-a83f-4bcf-82be-d4e52417c41c service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:24.837256 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671fa313-a83f-4bcf-82be-d4e52417c41c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:24.846841 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671fa313-a83f-4bcf-82be-d4e52417c41c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:24.848312 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671fa313-a83f-4bcf-82be-d4e52417c41c service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:24.858526 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3074/6186] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:34:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:34:25.326656 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77b409-fd25-4c2b-ae30-a2589c4940de None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:25.327255 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77b409-fd25-4c2b-ae30-a2589c4940de None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:25.327255 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77b409-fd25-4c2b-ae30-a2589c4940de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:25.358974 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-2d77b409-fd25-4c2b-ae30-a2589c4940de None None] MFA Rules not processed for user `0e789a633f77451cb9d15d8812ca4a50`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:25.360514 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-2d77b409-fd25-4c2b-ae30-a2589c4940de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:25.361116 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671fa313-a83f-4bcf-82be-d4e52417c41c service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:25.362723 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-671fa313-a83f-4bcf-82be-d4e52417c41c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:25.364137 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3113/6187] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:25 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 21:34:25.374565 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4130f2-890a-4ee7-bffb-27150318d141 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:25.374977 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4130f2-890a-4ee7-bffb-27150318d141 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:25.375521 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4130f2-890a-4ee7-bffb-27150318d141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:25.389171 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671fa313-a83f-4bcf-82be-d4e52417c41c service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:25.402880 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cbc093-907a-4461-a221-86e61b67864f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:25.403815 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cbc093-907a-4461-a221-86e61b67864f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:25.404105 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cbc093-907a-4461-a221-86e61b67864f admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:25.404386 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cbc093-907a-4461-a221-86e61b67864f admin admin] PATH_INFO: `/v3/projects/637ccc6c96d649a68284b09ddb5a0b0a` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:25.405278 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-2e4130f2-890a-4ee7-bffb-27150318d141 None None] MFA Rules not processed for user `0e789a633f77451cb9d15d8812ca4a50`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:25.406519 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cbc093-907a-4461-a221-86e61b67864f admin admin] RBAC: Authorizing `identity:delete_project(project_id=637ccc6c96d649a68284b09ddb5a0b0a)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:25.407280 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-2e4130f2-890a-4ee7-bffb-27150318d141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:25.408532 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cbc093-907a-4461-a221-86e61b67864f admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:25.485289 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3114/6188] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:25.486275 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4130f2-890a-4ee7-bffb-27150318d141 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:25.496317 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4130f2-890a-4ee7-bffb-27150318d141 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:25.512112 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3789a24-9070-40ae-9dd4-c8131bf32faf tempest-IdentityV3UsersTest-175546455 tempest-IdentityV3UsersTest-175546455-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e789a633f77451cb9d15d8812ca4a50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6392084e6f942aca6701f8f01419ab4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:25.512112 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3789a24-9070-40ae-9dd4-c8131bf32faf tempest-IdentityV3UsersTest-175546455 tempest-IdentityV3UsersTest-175546455-project] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:25.512112 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3789a24-9070-40ae-9dd4-c8131bf32faf tempest-IdentityV3UsersTest-175546455 tempest-IdentityV3UsersTest-175546455-project] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:25.512551 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3789a24-9070-40ae-9dd4-c8131bf32faf tempest-IdentityV3UsersTest-175546455 tempest-IdentityV3UsersTest-175546455-project] PATH_INFO: `/v3/users/0e789a633f77451cb9d15d8812ca4a50/password` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:25.553231 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-15cbc093-907a-4461-a221-86e61b67864f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '637ccc6c96d649a68284b09ddb5a0b0a', 'request_id': 'req-15cbc093-907a-4461-a221-86e61b67864f'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:25.562173 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-15cbc093-907a-4461-a221-86e61b67864f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '637ccc6c96d649a68284b09ddb5a0b0a', 'request_id': 'req-15cbc093-907a-4461-a221-86e61b67864f'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:25.571460 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-15cbc093-907a-4461-a221-86e61b67864f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '637ccc6c96d649a68284b09ddb5a0b0a', 'request_id': 'req-15cbc093-907a-4461-a221-86e61b67864f'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:25.637222 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a3789a24-9070-40ae-9dd4-c8131bf32faf tempest-IdentityV3UsersTest-175546455 tempest-IdentityV3UsersTest-175546455-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '0e789a633f77451cb9d15d8812ca4a50'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:25.675877 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-15cbc093-907a-4461-a221-86e61b67864f admin admin] The token cache is being invalidate because project 637ccc6c96d649a68284b09ddb5a0b0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:34:25.675877 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-15cbc093-907a-4461-a221-86e61b67864f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:25.676831 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-15cbc093-907a-4461-a221-86e61b67864f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:25.680545 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3075/6189] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:34:25 2022] DELETE /identity/v3/projects/637ccc6c96d649a68284b09ddb5a0b0a => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:25.685230 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c7053-9c77-40be-9131-07d5421964f7 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:25.685605 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c7053-9c77-40be-9131-07d5421964f7 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:25.685958 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c7053-9c77-40be-9131-07d5421964f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:25.711533 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-258c7053-9c77-40be-9131-07d5421964f7 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:25.713456 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-258c7053-9c77-40be-9131-07d5421964f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:25.757465 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3115/6190] 10.222.0.52 () {60 vars in 1268 bytes} [Sat May 14 21:34:25 2022] POST /identity/v3/users/0e789a633f77451cb9d15d8812ca4a50/password => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:25.813536 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3076/6191] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:25.821775 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b048e2-8a80-49d1-9573-9776383fb5c9 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:25.822067 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b048e2-8a80-49d1-9573-9776383fb5c9 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:25.822349 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b048e2-8a80-49d1-9573-9776383fb5c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:25.842134 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-05b048e2-8a80-49d1-9573-9776383fb5c9 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:25.843914 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-05b048e2-8a80-49d1-9573-9776383fb5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:25.855283 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3116/6192] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:25.859780 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258c7053-9c77-40be-9131-07d5421964f7 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:25.872519 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258c7053-9c77-40be-9131-07d5421964f7 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:25.877969 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c7c34b-dbcb-448c-9173-417e28d0dd73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:25.878655 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c7c34b-dbcb-448c-9173-417e28d0dd73 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:25.878942 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c7c34b-dbcb-448c-9173-417e28d0dd73 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:25.879223 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c7c34b-dbcb-448c-9173-417e28d0dd73 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:25.880245 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c7c34b-dbcb-448c-9173-417e28d0dd73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:34:25.880567 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c7c34b-dbcb-448c-9173-417e28d0dd73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:25.882196 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c7c34b-dbcb-448c-9173-417e28d0dd73 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:25.897543 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3077/6193] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:34:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:34:25.902415 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b048e2-8a80-49d1-9573-9776383fb5c9 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:25.911996 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b048e2-8a80-49d1-9573-9776383fb5c9 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:25.924654 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2535250c-cf3d-4124-9b05-77ff9ba2ccea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:25.925580 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2535250c-cf3d-4124-9b05-77ff9ba2ccea admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:25.926157 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2535250c-cf3d-4124-9b05-77ff9ba2ccea admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:25.926733 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2535250c-cf3d-4124-9b05-77ff9ba2ccea admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:25.928530 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2535250c-cf3d-4124-9b05-77ff9ba2ccea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:25.931854 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2535250c-cf3d-4124-9b05-77ff9ba2ccea admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:26.212380 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3117/6194] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:34:25 2022] POST /identity/v3/projects => generated 361 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:34:26.217556 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c7c34b-dbcb-448c-9173-417e28d0dd73 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:26.239785 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c7c34b-dbcb-448c-9173-417e28d0dd73 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:26.328849 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ab8027-7c2c-4064-9e3e-bf49e419a0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:26.330162 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab8027-7c2c-4064-9e3e-bf49e419a0a5 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:26.330559 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab8027-7c2c-4064-9e3e-bf49e419a0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:26.331086 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab8027-7c2c-4064-9e3e-bf49e419a0a5 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:26.331982 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ab8027-7c2c-4064-9e3e-bf49e419a0a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:26.334757 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ab8027-7c2c-4064-9e3e-bf49e419a0a5 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:26.470365 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3078/6195] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:34:26 2022] POST /identity/v3/users => generated 281 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:34:26.474643 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2535250c-cf3d-4124-9b05-77ff9ba2ccea admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:26.496022 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2535250c-cf3d-4124-9b05-77ff9ba2ccea admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:26.496481 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2ac402-4257-4250-98b5-d532a0616c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:26.497212 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ac402-4257-4250-98b5-d532a0616c9e admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:26.497702 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ac402-4257-4250-98b5-d532a0616c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:26.497989 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ac402-4257-4250-98b5-d532a0616c9e admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:26.499256 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2ac402-4257-4250-98b5-d532a0616c9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:26.501301 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2ac402-4257-4250-98b5-d532a0616c9e admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:26.519956 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3118/6196] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:34:26 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:34:26.531514 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ab8027-7c2c-4064-9e3e-bf49e419a0a5 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:26.561679 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ab8027-7c2c-4064-9e3e-bf49e419a0a5 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:26.563277 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca05ac-b506-4967-8126-47feb737c700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:26.564967 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca05ac-b506-4967-8126-47feb737c700 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:26.565258 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca05ac-b506-4967-8126-47feb737c700 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:26.565536 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca05ac-b506-4967-8126-47feb737c700 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:26.566293 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ca05ac-b506-4967-8126-47feb737c700 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:26.571645 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ca05ac-b506-4967-8126-47feb737c700 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:26.583783 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3079/6197] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:34:26 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:34:26.589060 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2ac402-4257-4250-98b5-d532a0616c9e admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:26.602367 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2ac402-4257-4250-98b5-d532a0616c9e admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:26.608675 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afdaf18-f05d-48a3-883c-f9939f542f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:26.609587 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afdaf18-f05d-48a3-883c-f9939f542f23 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:26.609872 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afdaf18-f05d-48a3-883c-f9939f542f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:26.610150 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afdaf18-f05d-48a3-883c-f9939f542f23 admin admin] PATH_INFO: `/v3/projects/23a1ad0b54aa4bc798bdae748849d409/users/e13283fa808a4c0e941a55d34144c7cd/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:26.632256 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afdaf18-f05d-48a3-883c-f9939f542f23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23a1ad0b54aa4bc798bdae748849d409, user_id=e13283fa808a4c0e941a55d34144c7cd, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:26.635409 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afdaf18-f05d-48a3-883c-f9939f542f23 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:26.733741 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3119/6198] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:34:26 2022] PUT /identity/v3/projects/23a1ad0b54aa4bc798bdae748849d409/users/e13283fa808a4c0e941a55d34144c7cd/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:26.736242 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6ed34-c802-4f0f-9f40-fd0be7dead3a None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:26.736786 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6ed34-c802-4f0f-9f40-fd0be7dead3a None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:26.737068 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6ed34-c802-4f0f-9f40-fd0be7dead3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:26.764115 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9db91d-be1d-4500-bfbb-1ed5c71cbbab None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:26.764407 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9db91d-be1d-4500-bfbb-1ed5c71cbbab None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:26.764694 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9db91d-be1d-4500-bfbb-1ed5c71cbbab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:26.776232 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-c6e6ed34-c802-4f0f-9f40-fd0be7dead3a None None] MFA Rules not processed for user `e13283fa808a4c0e941a55d34144c7cd`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:26.778174 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c6e6ed34-c802-4f0f-9f40-fd0be7dead3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:26.800864 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-8f9db91d-be1d-4500-bfbb-1ed5c71cbbab None None] MFA Rules not processed for user `0e789a633f77451cb9d15d8812ca4a50`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:26.802093 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-8f9db91d-be1d-4500-bfbb-1ed5c71cbbab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:26.806077 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3120/6199] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:26 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 14 21:34:26.883682 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3080/6200] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:26 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:26.904454 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9db91d-be1d-4500-bfbb-1ed5c71cbbab None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:26.908876 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-8f9db91d-be1d-4500-bfbb-1ed5c71cbbab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:27.005388 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9db91d-be1d-4500-bfbb-1ed5c71cbbab None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:27.009903 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f223e74-ebb9-4394-a148-7f1e8a88b8d2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b5cb86f190f4fcfb06d66cb8f14643f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:27.012872 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f223e74-ebb9-4394-a148-7f1e8a88b8d2 service glance] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:27.012872 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f223e74-ebb9-4394-a148-7f1e8a88b8d2 service glance] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:27.012872 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f223e74-ebb9-4394-a148-7f1e8a88b8d2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:27.020659 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f223e74-ebb9-4394-a148-7f1e8a88b8d2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:27.022159 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f223e74-ebb9-4394-a148-7f1e8a88b8d2 service glance] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:27.032478 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3121/6201] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:34:26 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:34:27.812448 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa549c6-177f-41c6-94c3-1ba150313507 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:27.814317 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa549c6-177f-41c6-94c3-1ba150313507 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:27.814613 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa549c6-177f-41c6-94c3-1ba150313507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:27.816431 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f223e74-ebb9-4394-a148-7f1e8a88b8d2 service glance] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:27.839282 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-bfa549c6-177f-41c6-94c3-1ba150313507 None None] MFA Rules not processed for user `0e789a633f77451cb9d15d8812ca4a50`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:27.852013 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-bfa549c6-177f-41c6-94c3-1ba150313507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:27.899245 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f223e74-ebb9-4394-a148-7f1e8a88b8d2 service glance] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:27.912211 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97072536-729f-43c0-8118-8898f64530d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:27.913247 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97072536-729f-43c0-8118-8898f64530d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:27.915546 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97072536-729f-43c0-8118-8898f64530d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:27.915936 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97072536-729f-43c0-8118-8898f64530d9 admin admin] PATH_INFO: `/v3/users/e13283fa808a4c0e941a55d34144c7cd` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:27.917941 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97072536-729f-43c0-8118-8898f64530d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e13283fa808a4c0e941a55d34144c7cd)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:27.920080 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97072536-729f-43c0-8118-8898f64530d9 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:27.981423 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3081/6202] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:27.988499 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646bfa7-0cb9-49fa-b05d-e8b3a0ec5621 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:27.989765 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646bfa7-0cb9-49fa-b05d-e8b3a0ec5621 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:27.990690 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646bfa7-0cb9-49fa-b05d-e8b3a0ec5621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:28.011956 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-2646bfa7-0cb9-49fa-b05d-e8b3a0ec5621 None None] MFA Rules not processed for user `0e789a633f77451cb9d15d8812ca4a50`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:28.013651 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-2646bfa7-0cb9-49fa-b05d-e8b3a0ec5621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:28.020195 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3082/6203] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:27 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 21:34:28.025694 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9bf275-4acd-4d83-877e-a3842d54683a None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:28.026299 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9bf275-4acd-4d83-877e-a3842d54683a None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:28.026788 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9bf275-4acd-4d83-877e-a3842d54683a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:28.168404 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-97072536-729f-43c0-8118-8898f64530d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e13283fa808a4c0e941a55d34144c7cd'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:28.187010 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-97072536-729f-43c0-8118-8898f64530d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e13283fa808a4c0e941a55d34144c7cd'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:28.197371 ncdv-master-1 devstack@keystone.service[91107]: WARNING keystone.server.flask.application [None req-9a9bf275-4acd-4d83-877e-a3842d54683a None None] Authorization failed. The request you have made requires authentication. from 10.222.0.52: keystone.exception.Unauthorized: The request you have made requires authentication. May 14 21:34:28.202284 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3083/6204] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:28 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 176 msecs (HTTP/1.1 401) 6 headers in 252 bytes (2 switches on core 0) May 14 21:34:28.202555 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-97072536-729f-43c0-8118-8898f64530d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e13283fa808a4c0e941a55d34144c7cd'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:28.204981 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc4c679-47dc-4338-a000-32c23ecb96bb None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:28.205265 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc4c679-47dc-4338-a000-32c23ecb96bb None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:28.205542 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc4c679-47dc-4338-a000-32c23ecb96bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:28.310032 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-97072536-729f-43c0-8118-8898f64530d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e13283fa808a4c0e941a55d34144c7cd'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:28.315018 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-97072536-729f-43c0-8118-8898f64530d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e13283fa808a4c0e941a55d34144c7cd'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:28.337358 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3122/6205] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:34:27 2022] DELETE /identity/v3/users/e13283fa808a4c0e941a55d34144c7cd => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:28.357429 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f5729-591b-4676-8fb1-f36b8fee2c06 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:28.362575 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f5729-591b-4676-8fb1-f36b8fee2c06 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:28.362575 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f5729-591b-4676-8fb1-f36b8fee2c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:28.379601 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-e10f5729-591b-4676-8fb1-f36b8fee2c06 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:28.381011 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e10f5729-591b-4676-8fb1-f36b8fee2c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:28.399161 ncdv-master-1 devstack@keystone.service[91107]: WARNING keystone.server.flask.application [None req-6dc4c679-47dc-4338-a000-32c23ecb96bb None None] Authorization failed. The request you have made requires authentication. from 10.222.0.52: keystone.exception.Unauthorized: The request you have made requires authentication. May 14 21:34:28.402568 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3084/6206] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:28 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 198 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) May 14 21:34:28.416075 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b477ba-7e76-453f-8ae8-2fa80a12057c None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:28.418897 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b477ba-7e76-453f-8ae8-2fa80a12057c None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:28.419470 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b477ba-7e76-453f-8ae8-2fa80a12057c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:28.466768 ncdv-master-1 devstack@keystone.service[91107]: WARNING keystone.server.flask.application [None req-70b477ba-7e76-453f-8ae8-2fa80a12057c None None] Authorization failed. The request you have made requires authentication. from 10.222.0.52: keystone.exception.Unauthorized: The request you have made requires authentication. May 14 21:34:28.471317 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3085/6207] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:28 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 65 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) May 14 21:34:28.509322 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3123/6208] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:28.520790 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b477ba-7e76-453f-8ae8-2fa80a12057c None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:28.523878 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-70b477ba-7e76-453f-8ae8-2fa80a12057c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:28.596265 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b477ba-7e76-453f-8ae8-2fa80a12057c None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:28.604424 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f8ce13-eafa-435d-9be7-475d24fb3556 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:28.609938 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8ce13-eafa-435d-9be7-475d24fb3556 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:28.609938 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8ce13-eafa-435d-9be7-475d24fb3556 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:28.609938 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8ce13-eafa-435d-9be7-475d24fb3556 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:28.619010 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f8ce13-eafa-435d-9be7-475d24fb3556 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:28.620713 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f8ce13-eafa-435d-9be7-475d24fb3556 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:28.634386 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3086/6209] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:34:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:34:30.012248 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f5729-591b-4676-8fb1-f36b8fee2c06 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:30.013795 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e10f5729-591b-4676-8fb1-f36b8fee2c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:30.042065 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f5729-591b-4676-8fb1-f36b8fee2c06 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:30.054868 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab4fe81-139f-4061-a0e3-33582afc7e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:30.055985 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab4fe81-139f-4061-a0e3-33582afc7e22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:30.063666 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab4fe81-139f-4061-a0e3-33582afc7e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:30.063666 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab4fe81-139f-4061-a0e3-33582afc7e22 admin admin] PATH_INFO: `/v3/projects/23a1ad0b54aa4bc798bdae748849d409` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:30.063666 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab4fe81-139f-4061-a0e3-33582afc7e22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23a1ad0b54aa4bc798bdae748849d409)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:30.064905 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab4fe81-139f-4061-a0e3-33582afc7e22 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:30.247024 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-1ab4fe81-139f-4061-a0e3-33582afc7e22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23a1ad0b54aa4bc798bdae748849d409', 'request_id': 'req-1ab4fe81-139f-4061-a0e3-33582afc7e22'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:30.258674 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-1ab4fe81-139f-4061-a0e3-33582afc7e22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23a1ad0b54aa4bc798bdae748849d409', 'request_id': 'req-1ab4fe81-139f-4061-a0e3-33582afc7e22'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:30.343422 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-1ab4fe81-139f-4061-a0e3-33582afc7e22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23a1ad0b54aa4bc798bdae748849d409', 'request_id': 'req-1ab4fe81-139f-4061-a0e3-33582afc7e22'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:30.369961 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-1ab4fe81-139f-4061-a0e3-33582afc7e22 admin admin] The token cache is being invalidate because project 23a1ad0b54aa4bc798bdae748849d409 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:34:30.370667 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-1ab4fe81-139f-4061-a0e3-33582afc7e22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:30.372744 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-1ab4fe81-139f-4061-a0e3-33582afc7e22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:30.375820 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3124/6210] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:34:30 2022] DELETE /identity/v3/projects/23a1ad0b54aa4bc798bdae748849d409 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:30.389715 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7716426b-60dc-4f9d-a3ec-0c3628ebf0a2 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:30.390988 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7716426b-60dc-4f9d-a3ec-0c3628ebf0a2 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:30.391651 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7716426b-60dc-4f9d-a3ec-0c3628ebf0a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:30.430477 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab4fe81-139f-4061-a0e3-33582afc7e22 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:30.445907 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-1ab4fe81-139f-4061-a0e3-33582afc7e22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:30.483549 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-7716426b-60dc-4f9d-a3ec-0c3628ebf0a2 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:30.486258 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-7716426b-60dc-4f9d-a3ec-0c3628ebf0a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:30.628914 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab4fe81-139f-4061-a0e3-33582afc7e22 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:30.649558 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3087/6211] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:30.652570 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f7b1eb-5d90-4ab0-9850-0f88a10457cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:30.653036 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7716426b-60dc-4f9d-a3ec-0c3628ebf0a2 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:30.654275 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7b1eb-5d90-4ab0-9850-0f88a10457cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:30.654564 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7b1eb-5d90-4ab0-9850-0f88a10457cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:30.657110 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7b1eb-5d90-4ab0-9850-0f88a10457cf admin admin] PATH_INFO: `/v3/users/add685ef1a92432da84cdf6520d136d5` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:30.657788 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-7716426b-60dc-4f9d-a3ec-0c3628ebf0a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:30.659212 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f7b1eb-5d90-4ab0-9850-0f88a10457cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=add685ef1a92432da84cdf6520d136d5)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:30.665384 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f7b1eb-5d90-4ab0-9850-0f88a10457cf admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:30.872816 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7716426b-60dc-4f9d-a3ec-0c3628ebf0a2 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:30.879783 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614a77c5-f3a2-43b0-a2cc-38cd0048fad2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:30.881219 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a77c5-f3a2-43b0-a2cc-38cd0048fad2 service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:30.881219 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a77c5-f3a2-43b0-a2cc-38cd0048fad2 service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:30.881219 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a77c5-f3a2-43b0-a2cc-38cd0048fad2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:30.883272 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-614a77c5-f3a2-43b0-a2cc-38cd0048fad2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:30.938437 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c0f7b1eb-5d90-4ab0-9850-0f88a10457cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'add685ef1a92432da84cdf6520d136d5'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:30.946104 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614a77c5-f3a2-43b0-a2cc-38cd0048fad2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:30.953880 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614a77c5-f3a2-43b0-a2cc-38cd0048fad2 service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:30.975221 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c0f7b1eb-5d90-4ab0-9850-0f88a10457cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'add685ef1a92432da84cdf6520d136d5'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:30.987633 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3088/6212] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:34:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:34:30.992954 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c0f7b1eb-5d90-4ab0-9850-0f88a10457cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'add685ef1a92432da84cdf6520d136d5'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:30.997607 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42837dbf-004b-4c26-8dfa-8e9f620bda28 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:30.997607 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42837dbf-004b-4c26-8dfa-8e9f620bda28 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:30.997607 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42837dbf-004b-4c26-8dfa-8e9f620bda28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:31.031052 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-42837dbf-004b-4c26-8dfa-8e9f620bda28 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:31.032737 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-42837dbf-004b-4c26-8dfa-8e9f620bda28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:31.050602 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3089/6213] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:31.055156 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42837dbf-004b-4c26-8dfa-8e9f620bda28 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:31.066408 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42837dbf-004b-4c26-8dfa-8e9f620bda28 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:31.075426 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435c272f-7d27-4847-a168-b875726863d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:31.078339 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c272f-7d27-4847-a168-b875726863d7 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:31.078339 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c272f-7d27-4847-a168-b875726863d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:31.078339 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c272f-7d27-4847-a168-b875726863d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:31.078339 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435c272f-7d27-4847-a168-b875726863d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:34:31.078339 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435c272f-7d27-4847-a168-b875726863d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:31.080250 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435c272f-7d27-4847-a168-b875726863d7 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:31.102137 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3090/6214] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:34:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:34:31.102327 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c0f7b1eb-5d90-4ab0-9850-0f88a10457cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'add685ef1a92432da84cdf6520d136d5'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:31.102327 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c0f7b1eb-5d90-4ab0-9850-0f88a10457cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'add685ef1a92432da84cdf6520d136d5'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:31.106223 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3125/6215] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:34:30 2022] DELETE /identity/v3/users/add685ef1a92432da84cdf6520d136d5 => generated 0 bytes in 682 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:31.110142 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435c272f-7d27-4847-a168-b875726863d7 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:31.112283 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd5476-a470-418e-b553-ebd0278f6f1a None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:31.112753 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd5476-a470-418e-b553-ebd0278f6f1a None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:31.113043 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd5476-a470-418e-b553-ebd0278f6f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:31.115922 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-435c272f-7d27-4847-a168-b875726863d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:31.147781 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435c272f-7d27-4847-a168-b875726863d7 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:31.153877 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-0cdd5476-a470-418e-b553-ebd0278f6f1a None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:31.156686 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-0cdd5476-a470-418e-b553-ebd0278f6f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:31.258611 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a64bdda-07e4-4b41-894f-aa54ff5174fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:31.259848 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a64bdda-07e4-4b41-894f-aa54ff5174fb admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:31.260377 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a64bdda-07e4-4b41-894f-aa54ff5174fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:31.260880 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a64bdda-07e4-4b41-894f-aa54ff5174fb admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:31.262788 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a64bdda-07e4-4b41-894f-aa54ff5174fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:31.265273 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a64bdda-07e4-4b41-894f-aa54ff5174fb admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:31.291823 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3126/6216] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:31.311893 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdd5476-a470-418e-b553-ebd0278f6f1a None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:31.318705 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-0cdd5476-a470-418e-b553-ebd0278f6f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:31.413234 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdd5476-a470-418e-b553-ebd0278f6f1a None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:31.420489 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb336fe-c562-4390-b397-721ca860093f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:31.431573 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3091/6217] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:34:31 2022] POST /identity/v3/projects => generated 383 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:34:31.431573 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a64bdda-07e4-4b41-894f-aa54ff5174fb admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:31.432196 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb336fe-c562-4390-b397-721ca860093f service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:31.432196 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb336fe-c562-4390-b397-721ca860093f service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:31.432196 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb336fe-c562-4390-b397-721ca860093f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:31.436143 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-7a64bdda-07e4-4b41-894f-aa54ff5174fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:31.457007 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb336fe-c562-4390-b397-721ca860093f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:31.458838 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb336fe-c562-4390-b397-721ca860093f service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:31.471879 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3127/6218] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:34:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:34:31.472851 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb336fe-c562-4390-b397-721ca860093f service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:31.487053 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb336fe-c562-4390-b397-721ca860093f service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:31.555650 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a64bdda-07e4-4b41-894f-aa54ff5174fb admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:31.562668 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab6f8d2-fe2c-4b36-805e-069572a3714e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:31.564185 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab6f8d2-fe2c-4b36-805e-069572a3714e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:31.564886 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab6f8d2-fe2c-4b36-805e-069572a3714e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:31.565440 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab6f8d2-fe2c-4b36-805e-069572a3714e admin admin] PATH_INFO: `/v3/users/ec1b48e9b1c543e09ece4fec1b666c80` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:31.566767 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab6f8d2-fe2c-4b36-805e-069572a3714e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec1b48e9b1c543e09ece4fec1b666c80)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:31.568068 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c208a7cb-dc45-4eeb-a9d8-0e7bc52ad7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:31.568888 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab6f8d2-fe2c-4b36-805e-069572a3714e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:31.569019 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c208a7cb-dc45-4eeb-a9d8-0e7bc52ad7b5 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:31.569452 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c208a7cb-dc45-4eeb-a9d8-0e7bc52ad7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:31.571383 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c208a7cb-dc45-4eeb-a9d8-0e7bc52ad7b5 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:31.578194 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c208a7cb-dc45-4eeb-a9d8-0e7bc52ad7b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:31.583176 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c208a7cb-dc45-4eeb-a9d8-0e7bc52ad7b5 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:31.690000 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3128/6219] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:34:31 2022] POST /identity/v3/users => generated 292 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:34:31.691276 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c208a7cb-dc45-4eeb-a9d8-0e7bc52ad7b5 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:31.712085 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c208a7cb-dc45-4eeb-a9d8-0e7bc52ad7b5 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:31.717622 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7339bd3f-6dc1-44eb-81fb-2c6de676a0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:31.718649 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7339bd3f-6dc1-44eb-81fb-2c6de676a0ea admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:31.719136 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7339bd3f-6dc1-44eb-81fb-2c6de676a0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:31.719678 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7339bd3f-6dc1-44eb-81fb-2c6de676a0ea admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:31.720751 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7339bd3f-6dc1-44eb-81fb-2c6de676a0ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:31.722663 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7339bd3f-6dc1-44eb-81fb-2c6de676a0ea admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:31.735424 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3129/6220] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:34:31 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:34:31.739393 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7339bd3f-6dc1-44eb-81fb-2c6de676a0ea admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:31.759211 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7339bd3f-6dc1-44eb-81fb-2c6de676a0ea admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:31.766402 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df42d194-cd8a-42e6-ab6a-1e7d0ff0dee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:31.767184 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df42d194-cd8a-42e6-ab6a-1e7d0ff0dee7 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:31.767825 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df42d194-cd8a-42e6-ab6a-1e7d0ff0dee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:31.768167 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df42d194-cd8a-42e6-ab6a-1e7d0ff0dee7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:31.768969 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df42d194-cd8a-42e6-ab6a-1e7d0ff0dee7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:31.770689 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df42d194-cd8a-42e6-ab6a-1e7d0ff0dee7 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:31.786482 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3130/6221] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:34:31 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:34:31.791618 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df42d194-cd8a-42e6-ab6a-1e7d0ff0dee7 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:31.803030 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df42d194-cd8a-42e6-ab6a-1e7d0ff0dee7 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:31.808863 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fd3b2b-0f87-4e7e-8e91-eafc87908baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:31.810048 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd3b2b-0f87-4e7e-8e91-eafc87908baa admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:31.810426 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd3b2b-0f87-4e7e-8e91-eafc87908baa admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:31.810755 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd3b2b-0f87-4e7e-8e91-eafc87908baa admin admin] PATH_INFO: `/v3/projects/5a1920fe976b4f6da96a03177d55b7f2/users/153f1ba3ff4f4075abb0b66bdf236fa7/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:31.829631 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fd3b2b-0f87-4e7e-8e91-eafc87908baa admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a1920fe976b4f6da96a03177d55b7f2, user_id=153f1ba3ff4f4075abb0b66bdf236fa7, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:31.833189 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fd3b2b-0f87-4e7e-8e91-eafc87908baa admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:31.849998 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9ab6f8d2-fe2c-4b36-805e-069572a3714e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec1b48e9b1c543e09ece4fec1b666c80'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:31.860431 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9ab6f8d2-fe2c-4b36-805e-069572a3714e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec1b48e9b1c543e09ece4fec1b666c80'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:31.861398 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9ab6f8d2-fe2c-4b36-805e-069572a3714e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec1b48e9b1c543e09ece4fec1b666c80'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:31.923369 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3131/6222] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:34:31 2022] PUT /identity/v3/projects/5a1920fe976b4f6da96a03177d55b7f2/users/153f1ba3ff4f4075abb0b66bdf236fa7/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:31.934867 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957b2d8f-be80-4d18-9657-4b8adc5cd6f0 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:31.935229 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957b2d8f-be80-4d18-9657-4b8adc5cd6f0 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:31.935605 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957b2d8f-be80-4d18-9657-4b8adc5cd6f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:31.967204 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-957b2d8f-be80-4d18-9657-4b8adc5cd6f0 None None] MFA Rules not processed for user `153f1ba3ff4f4075abb0b66bdf236fa7`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:31.968485 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-957b2d8f-be80-4d18-9657-4b8adc5cd6f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:31.989317 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9ab6f8d2-fe2c-4b36-805e-069572a3714e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec1b48e9b1c543e09ece4fec1b666c80'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:32.004506 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9ab6f8d2-fe2c-4b36-805e-069572a3714e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec1b48e9b1c543e09ece4fec1b666c80'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:32.014621 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3092/6223] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:34:31 2022] DELETE /identity/v3/users/ec1b48e9b1c543e09ece4fec1b666c80 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:32.019733 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f7017-7af1-440e-9894-3b826c0d7689 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:32.020019 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f7017-7af1-440e-9894-3b826c0d7689 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:32.020486 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f7017-7af1-440e-9894-3b826c0d7689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:32.040329 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-059f7017-7af1-440e-9894-3b826c0d7689 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:32.043065 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-059f7017-7af1-440e-9894-3b826c0d7689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:32.086105 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3132/6224] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:32.102495 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957b2d8f-be80-4d18-9657-4b8adc5cd6f0 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:32.104523 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-957b2d8f-be80-4d18-9657-4b8adc5cd6f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:32.155548 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3093/6225] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:32.169928 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f7017-7af1-440e-9894-3b826c0d7689 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:32.171519 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-059f7017-7af1-440e-9894-3b826c0d7689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:32.221828 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957b2d8f-be80-4d18-9657-4b8adc5cd6f0 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:32.294358 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f7017-7af1-440e-9894-3b826c0d7689 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:32.324459 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c38f4a-f071-40e7-aa93-2d611de600af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:32.324630 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bef1ec-386e-4d5c-ab2b-917720978c71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:32.325185 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bef1ec-386e-4d5c-ab2b-917720978c71 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:32.325475 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bef1ec-386e-4d5c-ab2b-917720978c71 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:32.325755 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bef1ec-386e-4d5c-ab2b-917720978c71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:32.326766 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c38f4a-f071-40e7-aa93-2d611de600af service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:32.327999 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c38f4a-f071-40e7-aa93-2d611de600af service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:32.328155 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c38f4a-f071-40e7-aa93-2d611de600af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:32.340092 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c38f4a-f071-40e7-aa93-2d611de600af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:32.341516 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c38f4a-f071-40e7-aa93-2d611de600af service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:32.364492 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3094/6226] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:34:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:34:32.365570 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c38f4a-f071-40e7-aa93-2d611de600af service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:32.371004 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-61c38f4a-f071-40e7-aa93-2d611de600af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:32.398899 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c38f4a-f071-40e7-aa93-2d611de600af service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:32.407786 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad6badb-2dbe-4898-8943-30233e2e16bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:32.409097 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6badb-2dbe-4898-8943-30233e2e16bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:32.410663 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6badb-2dbe-4898-8943-30233e2e16bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:32.412864 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6badb-2dbe-4898-8943-30233e2e16bc admin admin] PATH_INFO: `/v3/projects/bc31f3fccb75482f9d0fe81ba4be186a` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:32.415088 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bef1ec-386e-4d5c-ab2b-917720978c71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:32.415678 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad6badb-2dbe-4898-8943-30233e2e16bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc31f3fccb75482f9d0fe81ba4be186a)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:32.416639 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bef1ec-386e-4d5c-ab2b-917720978c71 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:32.418426 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad6badb-2dbe-4898-8943-30233e2e16bc admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:32.427001 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3133/6227] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:34:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:34:32.569285 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-aad6badb-2dbe-4898-8943-30233e2e16bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc31f3fccb75482f9d0fe81ba4be186a', 'request_id': 'req-aad6badb-2dbe-4898-8943-30233e2e16bc'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:32.576270 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-aad6badb-2dbe-4898-8943-30233e2e16bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc31f3fccb75482f9d0fe81ba4be186a', 'request_id': 'req-aad6badb-2dbe-4898-8943-30233e2e16bc'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:32.586548 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-aad6badb-2dbe-4898-8943-30233e2e16bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc31f3fccb75482f9d0fe81ba4be186a', 'request_id': 'req-aad6badb-2dbe-4898-8943-30233e2e16bc'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:32.694527 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-aad6badb-2dbe-4898-8943-30233e2e16bc admin admin] The token cache is being invalidate because project bc31f3fccb75482f9d0fe81ba4be186a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:34:32.698041 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-aad6badb-2dbe-4898-8943-30233e2e16bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:32.698041 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-aad6badb-2dbe-4898-8943-30233e2e16bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:32.698041 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3095/6228] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:34:32 2022] DELETE /identity/v3/projects/bc31f3fccb75482f9d0fe81ba4be186a => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:32.702130 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bef1ec-386e-4d5c-ab2b-917720978c71 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:32.714287 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bef1ec-386e-4d5c-ab2b-917720978c71 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:32.768023 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad6badb-2dbe-4898-8943-30233e2e16bc admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:32.771669 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-aad6badb-2dbe-4898-8943-30233e2e16bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:32.801762 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c4f43-7a14-4171-ad92-f75c445903b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:32.807164 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c4f43-7a14-4171-ad92-f75c445903b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:32.807164 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c4f43-7a14-4171-ad92-f75c445903b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:32.807164 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c4f43-7a14-4171-ad92-f75c445903b4 admin admin] PATH_INFO: `/v3/users/7db54eba4c0b4f6fbc146b2802c6163e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:32.807164 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c4f43-7a14-4171-ad92-f75c445903b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7db54eba4c0b4f6fbc146b2802c6163e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:32.809583 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c4f43-7a14-4171-ad92-f75c445903b4 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:32.855914 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad6badb-2dbe-4898-8943-30233e2e16bc admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:32.862489 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e26098-1543-465c-85cc-1e7f4f6dcb40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:32.863530 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e26098-1543-465c-85cc-1e7f4f6dcb40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:32.863922 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e26098-1543-465c-85cc-1e7f4f6dcb40 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:32.864301 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e26098-1543-465c-85cc-1e7f4f6dcb40 admin admin] PATH_INFO: `/v3/projects/b5b858647966413b879a40dae63bc55c` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:32.865780 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e26098-1543-465c-85cc-1e7f4f6dcb40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5b858647966413b879a40dae63bc55c)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:32.870900 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e26098-1543-465c-85cc-1e7f4f6dcb40 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:33.103691 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e57c4f43-7a14-4171-ad92-f75c445903b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7db54eba4c0b4f6fbc146b2802c6163e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:33.120764 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-53e26098-1543-465c-85cc-1e7f4f6dcb40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5b858647966413b879a40dae63bc55c', 'request_id': 'req-53e26098-1543-465c-85cc-1e7f4f6dcb40'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:33.126142 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e57c4f43-7a14-4171-ad92-f75c445903b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7db54eba4c0b4f6fbc146b2802c6163e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:33.131126 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-53e26098-1543-465c-85cc-1e7f4f6dcb40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5b858647966413b879a40dae63bc55c', 'request_id': 'req-53e26098-1543-465c-85cc-1e7f4f6dcb40'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:33.138700 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e57c4f43-7a14-4171-ad92-f75c445903b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7db54eba4c0b4f6fbc146b2802c6163e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:33.139278 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-53e26098-1543-465c-85cc-1e7f4f6dcb40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5b858647966413b879a40dae63bc55c', 'request_id': 'req-53e26098-1543-465c-85cc-1e7f4f6dcb40'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:33.237749 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-53e26098-1543-465c-85cc-1e7f4f6dcb40 admin admin] The token cache is being invalidate because project b5b858647966413b879a40dae63bc55c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:34:33.243151 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-53e26098-1543-465c-85cc-1e7f4f6dcb40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:33.244416 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-53e26098-1543-465c-85cc-1e7f4f6dcb40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:33.246717 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3096/6229] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:34:32 2022] DELETE /identity/v3/projects/b5b858647966413b879a40dae63bc55c => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:33.251678 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49826f-aaba-4e53-9d90-ae2c85d5e1ab None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:33.252240 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49826f-aaba-4e53-9d90-ae2c85d5e1ab None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:33.252713 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49826f-aaba-4e53-9d90-ae2c85d5e1ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:33.281122 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-cd49826f-aaba-4e53-9d90-ae2c85d5e1ab None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:33.282717 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-cd49826f-aaba-4e53-9d90-ae2c85d5e1ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:33.292421 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e57c4f43-7a14-4171-ad92-f75c445903b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7db54eba4c0b4f6fbc146b2802c6163e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:33.293273 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e57c4f43-7a14-4171-ad92-f75c445903b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7db54eba4c0b4f6fbc146b2802c6163e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:33.302975 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3134/6230] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:34:32 2022] DELETE /identity/v3/users/7db54eba4c0b4f6fbc146b2802c6163e => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:34:33.369564 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3097/6231] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:33.380453 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9deafd6-1d1d-4443-a030-f7bdc7a87f36 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:33.380748 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9deafd6-1d1d-4443-a030-f7bdc7a87f36 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:33.381037 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9deafd6-1d1d-4443-a030-f7bdc7a87f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:33.405775 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-f9deafd6-1d1d-4443-a030-f7bdc7a87f36 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:33.419214 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-f9deafd6-1d1d-4443-a030-f7bdc7a87f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:33.497144 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3135/6232] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:33.505326 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd49826f-aaba-4e53-9d90-ae2c85d5e1ab None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:33.511970 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd49826f-aaba-4e53-9d90-ae2c85d5e1ab None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:33.517586 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a517abe-99ae-454c-9e9c-12ad59efe6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:33.518498 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a517abe-99ae-454c-9e9c-12ad59efe6f8 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:33.518942 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a517abe-99ae-454c-9e9c-12ad59efe6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:33.519376 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a517abe-99ae-454c-9e9c-12ad59efe6f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:33.520320 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a517abe-99ae-454c-9e9c-12ad59efe6f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:34:33.520898 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a517abe-99ae-454c-9e9c-12ad59efe6f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:33.522546 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a517abe-99ae-454c-9e9c-12ad59efe6f8 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:33.546272 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3098/6233] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:34:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:34:33.548344 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9deafd6-1d1d-4443-a030-f7bdc7a87f36 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:33.562951 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9deafd6-1d1d-4443-a030-f7bdc7a87f36 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:33.573865 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718ed6fd-3c6b-469a-a722-b16c67d3e53a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:33.573865 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ed6fd-3c6b-469a-a722-b16c67d3e53a admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:33.573865 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ed6fd-3c6b-469a-a722-b16c67d3e53a admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:33.573865 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ed6fd-3c6b-469a-a722-b16c67d3e53a admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:33.574336 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718ed6fd-3c6b-469a-a722-b16c67d3e53a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:33.574753 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718ed6fd-3c6b-469a-a722-b16c67d3e53a admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:33.699592 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3136/6234] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:34:33 2022] POST /identity/v3/projects => generated 371 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:34:33.704572 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a517abe-99ae-454c-9e9c-12ad59efe6f8 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:33.719075 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a517abe-99ae-454c-9e9c-12ad59efe6f8 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:33.792619 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77e75b0-23f5-48b7-bfc1-dbbc42722983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:33.793260 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e75b0-23f5-48b7-bfc1-dbbc42722983 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:33.793546 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e75b0-23f5-48b7-bfc1-dbbc42722983 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:33.793827 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e75b0-23f5-48b7-bfc1-dbbc42722983 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:33.794524 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77e75b0-23f5-48b7-bfc1-dbbc42722983 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:33.796880 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77e75b0-23f5-48b7-bfc1-dbbc42722983 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:33.927471 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718ed6fd-3c6b-469a-a722-b16c67d3e53a admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:33.934669 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3099/6235] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:34:33 2022] POST /identity/v3/users => generated 286 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:34:33.944293 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718ed6fd-3c6b-469a-a722-b16c67d3e53a admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:33.955811 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5446d41-8086-4c1e-8db3-d5273bdc38b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:33.956519 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5446d41-8086-4c1e-8db3-d5273bdc38b8 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:33.956805 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5446d41-8086-4c1e-8db3-d5273bdc38b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:33.957086 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5446d41-8086-4c1e-8db3-d5273bdc38b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:33.957818 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5446d41-8086-4c1e-8db3-d5273bdc38b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:33.959431 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5446d41-8086-4c1e-8db3-d5273bdc38b8 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:33.983175 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3137/6236] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:34:33 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:34:33.987892 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77e75b0-23f5-48b7-bfc1-dbbc42722983 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:34.009176 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77e75b0-23f5-48b7-bfc1-dbbc42722983 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:34.014726 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72653be1-ee95-448f-a826-06193789702f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:34.015778 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72653be1-ee95-448f-a826-06193789702f admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:34.016288 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72653be1-ee95-448f-a826-06193789702f admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:34.016572 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72653be1-ee95-448f-a826-06193789702f admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:34.017315 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72653be1-ee95-448f-a826-06193789702f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:34.019234 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72653be1-ee95-448f-a826-06193789702f admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:34.031244 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3100/6237] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:34:33 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:34:34.036511 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5446d41-8086-4c1e-8db3-d5273bdc38b8 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:34.050195 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5446d41-8086-4c1e-8db3-d5273bdc38b8 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:34.054717 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72653be1-ee95-448f-a826-06193789702f admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:34.061435 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-72653be1-ee95-448f-a826-06193789702f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:34.064063 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa88d586-64a2-46b4-a740-f37752cbbddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:34.065098 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa88d586-64a2-46b4-a740-f37752cbbddc admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:34.065487 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa88d586-64a2-46b4-a740-f37752cbbddc admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:34.065890 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa88d586-64a2-46b4-a740-f37752cbbddc admin admin] PATH_INFO: `/v3/projects/d5e5588cb62d4ad0a93f58e84d398598/users/0cdc336efd5b499d99a964b95acec924/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:34.074699 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72653be1-ee95-448f-a826-06193789702f admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:34.080448 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f2a94f-ee6f-4cc8-9347-8f9f5ccce92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:34.085243 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f2a94f-ee6f-4cc8-9347-8f9f5ccce92c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:34.085243 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f2a94f-ee6f-4cc8-9347-8f9f5ccce92c admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:34.085243 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f2a94f-ee6f-4cc8-9347-8f9f5ccce92c admin admin] PATH_INFO: `/v3/projects/a8db70dff54747df8dc0ee388e89052a` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:34.085243 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f2a94f-ee6f-4cc8-9347-8f9f5ccce92c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8db70dff54747df8dc0ee388e89052a)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:34.086956 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f2a94f-ee6f-4cc8-9347-8f9f5ccce92c admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:34.089488 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa88d586-64a2-46b4-a740-f37752cbbddc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5e5588cb62d4ad0a93f58e84d398598, user_id=0cdc336efd5b499d99a964b95acec924, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:34.093384 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa88d586-64a2-46b4-a740-f37752cbbddc admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:34.243763 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3138/6238] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:34:34 2022] PUT /identity/v3/projects/d5e5588cb62d4ad0a93f58e84d398598/users/0cdc336efd5b499d99a964b95acec924/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:34.249175 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31d91c-cb33-4a0f-90b5-d6720a805fee None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:34.250899 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31d91c-cb33-4a0f-90b5-d6720a805fee None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:34.259129 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31d91c-cb33-4a0f-90b5-d6720a805fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:34.260729 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-97f2a94f-ee6f-4cc8-9347-8f9f5ccce92c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8db70dff54747df8dc0ee388e89052a', 'request_id': 'req-97f2a94f-ee6f-4cc8-9347-8f9f5ccce92c'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:34.287371 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-97f2a94f-ee6f-4cc8-9347-8f9f5ccce92c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8db70dff54747df8dc0ee388e89052a', 'request_id': 'req-97f2a94f-ee6f-4cc8-9347-8f9f5ccce92c'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:34.308609 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-97f2a94f-ee6f-4cc8-9347-8f9f5ccce92c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8db70dff54747df8dc0ee388e89052a', 'request_id': 'req-97f2a94f-ee6f-4cc8-9347-8f9f5ccce92c'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:34.366167 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-fe31d91c-cb33-4a0f-90b5-d6720a805fee None None] MFA Rules not processed for user `0cdc336efd5b499d99a964b95acec924`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:34.367457 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-fe31d91c-cb33-4a0f-90b5-d6720a805fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:34.423138 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-97f2a94f-ee6f-4cc8-9347-8f9f5ccce92c admin admin] The token cache is being invalidate because project a8db70dff54747df8dc0ee388e89052a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:34:34.423138 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-97f2a94f-ee6f-4cc8-9347-8f9f5ccce92c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:34.423138 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-97f2a94f-ee6f-4cc8-9347-8f9f5ccce92c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:34.423138 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3101/6239] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:34:34 2022] DELETE /identity/v3/projects/a8db70dff54747df8dc0ee388e89052a => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:34:34.423138 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580b8a4-d40b-4b27-874a-2abec3beaf7b None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:34.424013 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580b8a4-d40b-4b27-874a-2abec3beaf7b None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:34.424013 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580b8a4-d40b-4b27-874a-2abec3beaf7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:34.464873 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-c580b8a4-d40b-4b27-874a-2abec3beaf7b None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:34.466122 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c580b8a4-d40b-4b27-874a-2abec3beaf7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:34.544559 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3139/6240] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:34 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:34.556701 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe31d91c-cb33-4a0f-90b5-d6720a805fee None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:34.558898 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-fe31d91c-cb33-4a0f-90b5-d6720a805fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:34.617677 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3102/6241] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:34.647655 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c717240-091e-4f15-875d-499466cbd681 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:34.648221 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c717240-091e-4f15-875d-499466cbd681 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:34.648445 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c717240-091e-4f15-875d-499466cbd681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:34.689894 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-1c717240-091e-4f15-875d-499466cbd681 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:34.694383 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-1c717240-091e-4f15-875d-499466cbd681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:34.704032 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3103/6242] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:34.708258 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c717240-091e-4f15-875d-499466cbd681 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:34.719855 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe31d91c-cb33-4a0f-90b5-d6720a805fee None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:34.722834 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c717240-091e-4f15-875d-499466cbd681 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:34.724765 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc06119e-280d-43ec-8b3e-bd3f73304d0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:34.725776 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc06119e-280d-43ec-8b3e-bd3f73304d0f service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:34.726342 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc06119e-280d-43ec-8b3e-bd3f73304d0f service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:34.726721 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc06119e-280d-43ec-8b3e-bd3f73304d0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:34.732765 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f892b4-d172-4fe7-afb0-f3cda62ce87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:34.733873 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f892b4-d172-4fe7-afb0-f3cda62ce87b admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:34.734911 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f892b4-d172-4fe7-afb0-f3cda62ce87b admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:34.735350 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f892b4-d172-4fe7-afb0-f3cda62ce87b admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:34.736272 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f892b4-d172-4fe7-afb0-f3cda62ce87b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:34:34.736745 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f892b4-d172-4fe7-afb0-f3cda62ce87b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:34.738058 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc06119e-280d-43ec-8b3e-bd3f73304d0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:34.739738 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc06119e-280d-43ec-8b3e-bd3f73304d0f service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:34.740342 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f892b4-d172-4fe7-afb0-f3cda62ce87b admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:34.752061 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3140/6243] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:34:34 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:34:34.768218 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc06119e-280d-43ec-8b3e-bd3f73304d0f service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:34.775084 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3104/6244] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:34:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:34:34.782982 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc06119e-280d-43ec-8b3e-bd3f73304d0f service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:34.796212 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebdbe32-abba-47d0-8ff9-015afc6c1a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:34.797236 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdbe32-abba-47d0-8ff9-015afc6c1a93 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:34.797834 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdbe32-abba-47d0-8ff9-015afc6c1a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:34.798249 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdbe32-abba-47d0-8ff9-015afc6c1a93 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:34.799278 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebdbe32-abba-47d0-8ff9-015afc6c1a93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:34.802708 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebdbe32-abba-47d0-8ff9-015afc6c1a93 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:34.906173 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f892b4-d172-4fe7-afb0-f3cda62ce87b admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:34.911055 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3141/6245] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:34:34 2022] POST /identity/v3/projects => generated 375 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:34:34.922735 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f892b4-d172-4fe7-afb0-f3cda62ce87b admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:35.055265 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6895d79-a173-4290-9137-e3c09277de5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:35.057306 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6895d79-a173-4290-9137-e3c09277de5c admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:35.057597 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6895d79-a173-4290-9137-e3c09277de5c admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:35.059634 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6895d79-a173-4290-9137-e3c09277de5c admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:35.060386 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6895d79-a173-4290-9137-e3c09277de5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:35.062885 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6895d79-a173-4290-9137-e3c09277de5c admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:35.222923 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3105/6246] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:34:34 2022] POST /identity/v3/users => generated 288 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:34:35.226891 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebdbe32-abba-47d0-8ff9-015afc6c1a93 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:35.242532 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebdbe32-abba-47d0-8ff9-015afc6c1a93 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:35.254285 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3112011c-cc6b-4e56-b496-fe211b4cc9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:35.255082 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112011c-cc6b-4e56-b496-fe211b4cc9aa admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:35.255470 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112011c-cc6b-4e56-b496-fe211b4cc9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:35.255470 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112011c-cc6b-4e56-b496-fe211b4cc9aa admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:35.256637 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3112011c-cc6b-4e56-b496-fe211b4cc9aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:35.259440 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3112011c-cc6b-4e56-b496-fe211b4cc9aa admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:35.274563 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3142/6247] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:34:35 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:34:35.278663 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6895d79-a173-4290-9137-e3c09277de5c admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:35.293779 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6895d79-a173-4290-9137-e3c09277de5c admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:35.301997 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48054998-40ba-4da4-a92e-cd6b7a67a5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:35.302693 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48054998-40ba-4da4-a92e-cd6b7a67a5a1 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:35.303003 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48054998-40ba-4da4-a92e-cd6b7a67a5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:35.303282 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48054998-40ba-4da4-a92e-cd6b7a67a5a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:35.308952 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48054998-40ba-4da4-a92e-cd6b7a67a5a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:35.314106 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48054998-40ba-4da4-a92e-cd6b7a67a5a1 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:35.341807 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3106/6248] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:34:35 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:34:35.345646 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3112011c-cc6b-4e56-b496-fe211b4cc9aa admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:35.359233 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3112011c-cc6b-4e56-b496-fe211b4cc9aa admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:35.375249 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a95a08-9dd7-4d9d-9504-dcd5ca823531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:35.376430 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a95a08-9dd7-4d9d-9504-dcd5ca823531 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:35.376781 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a95a08-9dd7-4d9d-9504-dcd5ca823531 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:35.377133 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a95a08-9dd7-4d9d-9504-dcd5ca823531 admin admin] PATH_INFO: `/v3/projects/8d4a57a44aef42c6ac17a7f245f7a90e/users/8a4211529de143a2876d1cf8fec15936/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:35.407247 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a95a08-9dd7-4d9d-9504-dcd5ca823531 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d4a57a44aef42c6ac17a7f245f7a90e, user_id=8a4211529de143a2876d1cf8fec15936, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:35.410848 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a95a08-9dd7-4d9d-9504-dcd5ca823531 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:35.515520 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3143/6249] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:34:35 2022] PUT /identity/v3/projects/8d4a57a44aef42c6ac17a7f245f7a90e/users/8a4211529de143a2876d1cf8fec15936/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:35.517200 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7cfc1b-38d2-401c-8405-4049acd65c7b None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:35.517768 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7cfc1b-38d2-401c-8405-4049acd65c7b None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:35.518057 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7cfc1b-38d2-401c-8405-4049acd65c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:35.559087 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-fb7cfc1b-38d2-401c-8405-4049acd65c7b None None] MFA Rules not processed for user `8a4211529de143a2876d1cf8fec15936`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:35.561824 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-fb7cfc1b-38d2-401c-8405-4049acd65c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:35.679436 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3107/6250] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:34:35.684890 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a95a08-9dd7-4d9d-9504-dcd5ca823531 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:35.811386 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a95a08-9dd7-4d9d-9504-dcd5ca823531 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:35.821353 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f285902-a7dc-4c77-93a0-747e9dbeb78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:35.822600 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f285902-a7dc-4c77-93a0-747e9dbeb78b admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:35.823124 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f285902-a7dc-4c77-93a0-747e9dbeb78b admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:35.823586 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f285902-a7dc-4c77-93a0-747e9dbeb78b admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:35.824392 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f285902-a7dc-4c77-93a0-747e9dbeb78b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:35.831471 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f285902-a7dc-4c77-93a0-747e9dbeb78b admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:35.980318 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3144/6251] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:34:35 2022] POST /identity/v3/projects => generated 375 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:34:35.984458 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7cfc1b-38d2-401c-8405-4049acd65c7b None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:36.018873 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7cfc1b-38d2-401c-8405-4049acd65c7b None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:36.142911 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69c2a71-bb12-4d90-8845-451bbbb30fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:36.144653 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c2a71-bb12-4d90-8845-451bbbb30fcb admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:36.144653 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c2a71-bb12-4d90-8845-451bbbb30fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:36.144653 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c2a71-bb12-4d90-8845-451bbbb30fcb admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:36.146504 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69c2a71-bb12-4d90-8845-451bbbb30fcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:36.149949 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69c2a71-bb12-4d90-8845-451bbbb30fcb admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:36.314993 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3108/6252] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:34:35 2022] POST /identity/v3/users => generated 294 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:34:36.317740 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f285902-a7dc-4c77-93a0-747e9dbeb78b admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:36.338238 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f285902-a7dc-4c77-93a0-747e9dbeb78b admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:36.353389 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5b31da-14bd-468b-b233-672defd872f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:36.355227 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b31da-14bd-468b-b233-672defd872f4 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:36.355860 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b31da-14bd-468b-b233-672defd872f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:36.356335 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b31da-14bd-468b-b233-672defd872f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:36.357330 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5b31da-14bd-468b-b233-672defd872f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:36.359861 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5b31da-14bd-468b-b233-672defd872f4 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:36.403071 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3145/6253] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:34:36 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:34:36.407710 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69c2a71-bb12-4d90-8845-451bbbb30fcb admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:36.426133 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69c2a71-bb12-4d90-8845-451bbbb30fcb admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:36.435982 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4748e13-86c8-4ae7-a4be-b712ae433609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:36.436833 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4748e13-86c8-4ae7-a4be-b712ae433609 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:36.437358 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4748e13-86c8-4ae7-a4be-b712ae433609 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:36.437854 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4748e13-86c8-4ae7-a4be-b712ae433609 admin admin] PATH_INFO: `/v3/projects/b1283c2133f745ac80652c89269a1bb0/users/14894db57c734903b47cc586ba193935/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:36.460835 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4748e13-86c8-4ae7-a4be-b712ae433609 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1283c2133f745ac80652c89269a1bb0, user_id=14894db57c734903b47cc586ba193935, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:36.465858 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4748e13-86c8-4ae7-a4be-b712ae433609 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:36.561856 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3109/6254] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:34:36 2022] PUT /identity/v3/projects/b1283c2133f745ac80652c89269a1bb0/users/14894db57c734903b47cc586ba193935/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:36.570630 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5b31da-14bd-468b-b233-672defd872f4 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:36.584927 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5b31da-14bd-468b-b233-672defd872f4 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:36.710340 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc09343-4d76-4cf7-b9f3-4bfb2d591fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:36.711299 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc09343-4d76-4cf7-b9f3-4bfb2d591fac admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:36.711609 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc09343-4d76-4cf7-b9f3-4bfb2d591fac admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:36.711899 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc09343-4d76-4cf7-b9f3-4bfb2d591fac admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:36.712668 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc09343-4d76-4cf7-b9f3-4bfb2d591fac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:36.714330 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc09343-4d76-4cf7-b9f3-4bfb2d591fac admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:36.737473 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3146/6255] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:34:36 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:34:36.741386 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4748e13-86c8-4ae7-a4be-b712ae433609 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:36.754124 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4748e13-86c8-4ae7-a4be-b712ae433609 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:36.762772 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7755cc-495d-47c0-9988-c2ca0957c687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:36.764134 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7755cc-495d-47c0-9988-c2ca0957c687 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:36.764775 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7755cc-495d-47c0-9988-c2ca0957c687 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:36.765237 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7755cc-495d-47c0-9988-c2ca0957c687 admin admin] PATH_INFO: `/v3/projects/b1283c2133f745ac80652c89269a1bb0/users/14894db57c734903b47cc586ba193935/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:36.768429 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7755cc-495d-47c0-9988-c2ca0957c687 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1283c2133f745ac80652c89269a1bb0, user_id=14894db57c734903b47cc586ba193935, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:36.771461 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7755cc-495d-47c0-9988-c2ca0957c687 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:36.786407 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3110/6256] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:34:36 2022] PUT /identity/v3/projects/b1283c2133f745ac80652c89269a1bb0/users/14894db57c734903b47cc586ba193935/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:36.797320 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b31712-c193-428e-87b4-08082656062c None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:36.798193 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b31712-c193-428e-87b4-08082656062c None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:36.798694 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b31712-c193-428e-87b4-08082656062c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:36.918532 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-58b31712-c193-428e-87b4-08082656062c None None] MFA Rules not processed for user `14894db57c734903b47cc586ba193935`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:36.921507 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-58b31712-c193-428e-87b4-08082656062c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:37.047247 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3147/6257] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:36 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:37.059195 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7755cc-495d-47c0-9988-c2ca0957c687 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:37.061820 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-da7755cc-495d-47c0-9988-c2ca0957c687 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:37.197022 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7755cc-495d-47c0-9988-c2ca0957c687 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:37.201516 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c8a736-be12-44a4-873f-49f4b4c4e956 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198271d1c0d44cb58bace41a65f4b94c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:37.202431 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c8a736-be12-44a4-873f-49f4b4c4e956 service cinder] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:37.202730 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c8a736-be12-44a4-873f-49f4b4c4e956 service cinder] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:37.203109 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c8a736-be12-44a4-873f-49f4b4c4e956 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:37.300853 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c8a736-be12-44a4-873f-49f4b4c4e956 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:37.310420 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c8a736-be12-44a4-873f-49f4b4c4e956 service cinder] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:37.330827 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3111/6258] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:34:37 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:34:39.448824 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b31712-c193-428e-87b4-08082656062c None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:39.455881 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-58b31712-c193-428e-87b4-08082656062c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:39.483581 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c9ec1-d0ac-457c-ab00-32a6a6ddc9a7 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:39.484138 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c9ec1-d0ac-457c-ab00-32a6a6ddc9a7 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:39.484138 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c9ec1-d0ac-457c-ab00-32a6a6ddc9a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:39.569996 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b31712-c193-428e-87b4-08082656062c None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:39.576216 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd53ebc-1cbd-4dfc-8043-4a23e36f5734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:39.577240 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd53ebc-1cbd-4dfc-8043-4a23e36f5734 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:39.577587 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd53ebc-1cbd-4dfc-8043-4a23e36f5734 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:39.578066 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd53ebc-1cbd-4dfc-8043-4a23e36f5734 admin admin] PATH_INFO: `/v3/users/604ba13e7bfb4a71a08c0954af0dfc3b` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:39.579586 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd53ebc-1cbd-4dfc-8043-4a23e36f5734 admin admin] RBAC: Authorizing `identity:delete_user(user_id=604ba13e7bfb4a71a08c0954af0dfc3b)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:39.582861 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd53ebc-1cbd-4dfc-8043-4a23e36f5734 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:39.669087 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-4a3c9ec1-d0ac-457c-ab00-32a6a6ddc9a7 None None] MFA Rules not processed for user `0e789a633f77451cb9d15d8812ca4a50`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:39.670315 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-4a3c9ec1-d0ac-457c-ab00-32a6a6ddc9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:39.681641 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3112/6259] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:39 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 14 21:34:39.687689 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3c9ec1-d0ac-457c-ab00-32a6a6ddc9a7 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:39.695311 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-4a3c9ec1-d0ac-457c-ab00-32a6a6ddc9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:39.802564 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3c9ec1-d0ac-457c-ab00-32a6a6ddc9a7 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:39.815201 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713166db-c78c-43d0-b42e-359797423cd6 tempest-IdentityV3UsersTest-175546455 tempest-IdentityV3UsersTest-175546455-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e789a633f77451cb9d15d8812ca4a50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6392084e6f942aca6701f8f01419ab4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:39.817364 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713166db-c78c-43d0-b42e-359797423cd6 tempest-IdentityV3UsersTest-175546455 tempest-IdentityV3UsersTest-175546455-project] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:39.817891 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713166db-c78c-43d0-b42e-359797423cd6 tempest-IdentityV3UsersTest-175546455 tempest-IdentityV3UsersTest-175546455-project] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:39.818384 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713166db-c78c-43d0-b42e-359797423cd6 tempest-IdentityV3UsersTest-175546455 tempest-IdentityV3UsersTest-175546455-project] PATH_INFO: `/v3/users/0e789a633f77451cb9d15d8812ca4a50/password` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:39.895606 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-4dd53ebc-1cbd-4dfc-8043-4a23e36f5734 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '604ba13e7bfb4a71a08c0954af0dfc3b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:39.923616 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-4dd53ebc-1cbd-4dfc-8043-4a23e36f5734 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '604ba13e7bfb4a71a08c0954af0dfc3b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:39.961893 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-4dd53ebc-1cbd-4dfc-8043-4a23e36f5734 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '604ba13e7bfb4a71a08c0954af0dfc3b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:39.985330 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-713166db-c78c-43d0-b42e-359797423cd6 tempest-IdentityV3UsersTest-175546455 tempest-IdentityV3UsersTest-175546455-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '0e789a633f77451cb9d15d8812ca4a50'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:40.083444 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-4dd53ebc-1cbd-4dfc-8043-4a23e36f5734 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '604ba13e7bfb4a71a08c0954af0dfc3b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:40.086930 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-4dd53ebc-1cbd-4dfc-8043-4a23e36f5734 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '604ba13e7bfb4a71a08c0954af0dfc3b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:40.096530 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3148/6260] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:34:39 2022] DELETE /identity/v3/users/604ba13e7bfb4a71a08c0954af0dfc3b => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:40.101269 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a2107-04aa-429b-863c-364bc7dffce1 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:40.101617 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a2107-04aa-429b-863c-364bc7dffce1 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:40.101972 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a2107-04aa-429b-863c-364bc7dffce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:40.165705 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-1d2a2107-04aa-429b-863c-364bc7dffce1 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:40.169617 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-1d2a2107-04aa-429b-863c-364bc7dffce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:40.260508 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3113/6261] 10.222.0.52 () {60 vars in 1268 bytes} [Sat May 14 21:34:39 2022] POST /identity/v3/users/0e789a633f77451cb9d15d8812ca4a50/password => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:40.312893 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3149/6262] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:34:40.410150 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713166db-c78c-43d0-b42e-359797423cd6 tempest-IdentityV3UsersTest-175546455 tempest-IdentityV3UsersTest-175546455-project] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:40.417617 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-713166db-c78c-43d0-b42e-359797423cd6 tempest-IdentityV3UsersTest-175546455 tempest-IdentityV3UsersTest-175546455-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:40.656827 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713166db-c78c-43d0-b42e-359797423cd6 tempest-IdentityV3UsersTest-175546455 tempest-IdentityV3UsersTest-175546455-project] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:40.793397 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b12c73-182a-425b-988d-b4644de4f8bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:40.794419 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b12c73-182a-425b-988d-b4644de4f8bb service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:40.796634 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b12c73-182a-425b-988d-b4644de4f8bb service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:40.797281 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b12c73-182a-425b-988d-b4644de4f8bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:40.814395 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b12c73-182a-425b-988d-b4644de4f8bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:40.817122 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b12c73-182a-425b-988d-b4644de4f8bb service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:40.832011 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3114/6263] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:34:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:34:41.266142 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507931b-f9d1-4633-9eac-c6e238686038 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:41.266627 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507931b-f9d1-4633-9eac-c6e238686038 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:41.266730 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507931b-f9d1-4633-9eac-c6e238686038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:41.330050 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-d507931b-f9d1-4633-9eac-c6e238686038 None None] MFA Rules not processed for user `0e789a633f77451cb9d15d8812ca4a50`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:41.332151 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d507931b-f9d1-4633-9eac-c6e238686038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:41.338042 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3150/6264] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:41 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 21:34:41.343269 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397782f4-ea58-4d28-b92c-d316b742e619 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:41.359578 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397782f4-ea58-4d28-b92c-d316b742e619 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:41.359578 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397782f4-ea58-4d28-b92c-d316b742e619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:41.359578 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-397782f4-ea58-4d28-b92c-d316b742e619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:41.376478 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d507931b-f9d1-4633-9eac-c6e238686038 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:41.380415 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d507931b-f9d1-4633-9eac-c6e238686038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:41.427205 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d507931b-f9d1-4633-9eac-c6e238686038 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:41.434295 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3cff96-91a0-4e91-8631-ad02555126e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:41.435669 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3cff96-91a0-4e91-8631-ad02555126e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:41.436250 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3cff96-91a0-4e91-8631-ad02555126e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:41.436826 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3cff96-91a0-4e91-8631-ad02555126e2 admin admin] PATH_INFO: `/v3/projects/f187941dc447483bad8f36293de5c259` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:41.438518 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3cff96-91a0-4e91-8631-ad02555126e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f187941dc447483bad8f36293de5c259)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:41.440744 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3cff96-91a0-4e91-8631-ad02555126e2 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:41.495943 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-397782f4-ea58-4d28-b92c-d316b742e619 None None] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token May 14 21:34:41.495943 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:34:41.495943 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 21:34:41.495943 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 21:34:41.495943 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 21:34:41.495943 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 21:34:41.495943 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 21:34:41.495943 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 21:34:41.495943 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 21:34:41.495943 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 21:34:41.495943 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 21:34:41.495943 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 21:34:41.495943 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper May 14 21:34:41.495943 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return f(*args, **kwargs) May 14 21:34:41.495943 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post May 14 21:34:41.495943 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) May 14 21:34:41.497283 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 185, in authenticate_for_token May 14 21:34:41.497283 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application authenticate(auth_info, auth_context) May 14 21:34:41.497283 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 152, in authenticate May 14 21:34:41.497283 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = method.authenticate(auth_info.get_method_data(method_name)) May 14 21:34:41.497283 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 42, in authenticate May 14 21:34:41.497283 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application token = self._get_token_ref(auth_payload) May 14 21:34:41.497283 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 36, in _get_token_ref May 14 21:34:41.497283 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return PROVIDERS.token_provider_api.validate_token(token_id) May 14 21:34:41.497283 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 21:34:41.497283 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 21:34:41.497283 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token May 14 21:34:41.497283 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) May 14 21:34:41.497283 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token May 14 21:34:41.497283 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application self.check_revocation(token) May 14 21:34:41.497283 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 21:34:41.497283 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 21:34:41.498459 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation May 14 21:34:41.498459 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) May 14 21:34:41.498459 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 21:34:41.498459 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 21:34:41.498459 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 May 14 21:34:41.498459 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) May 14 21:34:41.498459 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 21:34:41.498459 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 21:34:41.498459 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token May 14 21:34:41.498459 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) May 14 21:34:41.498459 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token May 14 21:34:41.498459 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:34:41.499444 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3115/6265] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:41 2022] POST /identity/v3/auth/tokens => generated 80 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 21:34:41.506584 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16e870-b34f-4882-bca3-3fd329a0f82d None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:41.506584 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16e870-b34f-4882-bca3-3fd329a0f82d None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:41.506794 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16e870-b34f-4882-bca3-3fd329a0f82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:41.610666 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5e3cff96-91a0-4e91-8631-ad02555126e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f187941dc447483bad8f36293de5c259', 'request_id': 'req-5e3cff96-91a0-4e91-8631-ad02555126e2'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:41.617864 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5e3cff96-91a0-4e91-8631-ad02555126e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f187941dc447483bad8f36293de5c259', 'request_id': 'req-5e3cff96-91a0-4e91-8631-ad02555126e2'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:41.694768 ncdv-master-1 devstack@keystone.service[91107]: WARNING keystone.server.flask.application [None req-5f16e870-b34f-4882-bca3-3fd329a0f82d None None] Authorization failed. The request you have made requires authentication. from 10.222.0.52: keystone.exception.Unauthorized: The request you have made requires authentication. May 14 21:34:41.699533 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3116/6266] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:41 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 193 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) May 14 21:34:41.701912 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5b017-2865-4089-a5cc-76cf384f73b7 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:41.702206 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5b017-2865-4089-a5cc-76cf384f73b7 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:41.702693 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5b017-2865-4089-a5cc-76cf384f73b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:41.710946 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5e3cff96-91a0-4e91-8631-ad02555126e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f187941dc447483bad8f36293de5c259', 'request_id': 'req-5e3cff96-91a0-4e91-8631-ad02555126e2'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:41.732019 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5e3cff96-91a0-4e91-8631-ad02555126e2 admin admin] The token cache is being invalidate because project f187941dc447483bad8f36293de5c259 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:34:41.732317 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5e3cff96-91a0-4e91-8631-ad02555126e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:41.733065 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5e3cff96-91a0-4e91-8631-ad02555126e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:41.737821 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3151/6267] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:34:41 2022] DELETE /identity/v3/projects/f187941dc447483bad8f36293de5c259 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:41.745083 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270012d0-12a1-4dd9-842b-f92db6e5d0ad None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:41.745083 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270012d0-12a1-4dd9-842b-f92db6e5d0ad None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:41.745083 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270012d0-12a1-4dd9-842b-f92db6e5d0ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:41.771422 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-270012d0-12a1-4dd9-842b-f92db6e5d0ad None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:41.777475 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-270012d0-12a1-4dd9-842b-f92db6e5d0ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:41.865690 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-cfb5b017-2865-4089-a5cc-76cf384f73b7 None None] MFA Rules not processed for user `0e789a633f77451cb9d15d8812ca4a50`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:41.866955 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-cfb5b017-2865-4089-a5cc-76cf384f73b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:41.948350 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3152/6268] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:41.948350 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270012d0-12a1-4dd9-842b-f92db6e5d0ad None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:41.948350 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-270012d0-12a1-4dd9-842b-f92db6e5d0ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:41.954298 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3117/6269] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:41.955711 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169fd243-e1f4-4e78-9f1d-5108e1058308 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:41.955956 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169fd243-e1f4-4e78-9f1d-5108e1058308 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:41.956234 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169fd243-e1f4-4e78-9f1d-5108e1058308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:41.990199 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-169fd243-e1f4-4e78-9f1d-5108e1058308 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:41.991782 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-169fd243-e1f4-4e78-9f1d-5108e1058308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:42.003867 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3118/6270] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:42.005064 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169fd243-e1f4-4e78-9f1d-5108e1058308 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:42.018778 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169fd243-e1f4-4e78-9f1d-5108e1058308 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:42.024916 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b1ff8-8c10-44cf-848e-1bd85410b0ca tempest-IdentityV3UsersTest-175546455 tempest-IdentityV3UsersTest-175546455-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e789a633f77451cb9d15d8812ca4a50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6392084e6f942aca6701f8f01419ab4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:42.026016 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b1ff8-8c10-44cf-848e-1bd85410b0ca tempest-IdentityV3UsersTest-175546455 tempest-IdentityV3UsersTest-175546455-project] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:42.026614 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b1ff8-8c10-44cf-848e-1bd85410b0ca tempest-IdentityV3UsersTest-175546455 tempest-IdentityV3UsersTest-175546455-project] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:42.027052 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b1ff8-8c10-44cf-848e-1bd85410b0ca tempest-IdentityV3UsersTest-175546455 tempest-IdentityV3UsersTest-175546455-project] PATH_INFO: `/v3/users/0e789a633f77451cb9d15d8812ca4a50/password` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:42.051341 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270012d0-12a1-4dd9-842b-f92db6e5d0ad None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:42.071754 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c81d555-b2ea-4db0-bdca-5de26f998875 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:42.072472 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c81d555-b2ea-4db0-bdca-5de26f998875 service placement] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:42.072784 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c81d555-b2ea-4db0-bdca-5de26f998875 service placement] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:42.073058 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c81d555-b2ea-4db0-bdca-5de26f998875 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:42.077715 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-5c81d555-b2ea-4db0-bdca-5de26f998875 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:42.093485 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c81d555-b2ea-4db0-bdca-5de26f998875 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:42.095374 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c81d555-b2ea-4db0-bdca-5de26f998875 service placement] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:42.121692 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3153/6271] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:34:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:34:42.123818 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c81d555-b2ea-4db0-bdca-5de26f998875 service placement] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:42.143595 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c81d555-b2ea-4db0-bdca-5de26f998875 service placement] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:42.150571 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8790ae28-a1d0-484c-8dbf-6d37d5da0d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:42.154093 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8790ae28-a1d0-484c-8dbf-6d37d5da0d66 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:42.154093 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8790ae28-a1d0-484c-8dbf-6d37d5da0d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:42.154093 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8790ae28-a1d0-484c-8dbf-6d37d5da0d66 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:42.154093 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8790ae28-a1d0-484c-8dbf-6d37d5da0d66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:34:42.154093 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8790ae28-a1d0-484c-8dbf-6d37d5da0d66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:42.154555 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8790ae28-a1d0-484c-8dbf-6d37d5da0d66 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:42.177003 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3154/6272] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:34:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:34:42.178234 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8790ae28-a1d0-484c-8dbf-6d37d5da0d66 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:42.191234 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8790ae28-a1d0-484c-8dbf-6d37d5da0d66 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:42.196913 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96467e35-8b5d-4f04-bc67-f9a16f499ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:42.197716 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96467e35-8b5d-4f04-bc67-f9a16f499ccf admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:42.198017 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96467e35-8b5d-4f04-bc67-f9a16f499ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:42.200492 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96467e35-8b5d-4f04-bc67-f9a16f499ccf admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:42.200492 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96467e35-8b5d-4f04-bc67-f9a16f499ccf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:42.201142 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96467e35-8b5d-4f04-bc67-f9a16f499ccf admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:42.202238 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-540b1ff8-8c10-44cf-848e-1bd85410b0ca tempest-IdentityV3UsersTest-175546455 tempest-IdentityV3UsersTest-175546455-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '0e789a633f77451cb9d15d8812ca4a50'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:42.277241 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3119/6273] 10.222.0.52 () {60 vars in 1268 bytes} [Sat May 14 21:34:42 2022] POST /identity/v3/users/0e789a633f77451cb9d15d8812ca4a50/password => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:42.334199 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3155/6274] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:34:42 2022] POST /identity/v3/projects => generated 383 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:34:42.336689 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b1ff8-8c10-44cf-848e-1bd85410b0ca tempest-IdentityV3UsersTest-175546455 tempest-IdentityV3UsersTest-175546455-project] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:42.354075 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b1ff8-8c10-44cf-848e-1bd85410b0ca tempest-IdentityV3UsersTest-175546455 tempest-IdentityV3UsersTest-175546455-project] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:42.459911 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d29a9c-b509-464c-b536-e94bb25d735a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:42.461208 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d29a9c-b509-464c-b536-e94bb25d735a admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:42.461539 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d29a9c-b509-464c-b536-e94bb25d735a admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:42.461777 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d29a9c-b509-464c-b536-e94bb25d735a admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:42.462493 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d29a9c-b509-464c-b536-e94bb25d735a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:42.464707 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d29a9c-b509-464c-b536-e94bb25d735a admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:42.581730 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3120/6275] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:34:42 2022] POST /identity/v3/users => generated 292 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:34:42.585884 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96467e35-8b5d-4f04-bc67-f9a16f499ccf admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:42.598491 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96467e35-8b5d-4f04-bc67-f9a16f499ccf admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:42.604583 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b361093a-2119-4fe4-9efb-3015e12075cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:42.605628 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b361093a-2119-4fe4-9efb-3015e12075cd admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:42.606048 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b361093a-2119-4fe4-9efb-3015e12075cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:42.607107 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b361093a-2119-4fe4-9efb-3015e12075cd admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:42.608193 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b361093a-2119-4fe4-9efb-3015e12075cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:42.610206 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b361093a-2119-4fe4-9efb-3015e12075cd admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:42.628780 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3156/6276] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:34:42 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:34:42.630109 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d29a9c-b509-464c-b536-e94bb25d735a admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:42.650618 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d29a9c-b509-464c-b536-e94bb25d735a admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:42.656799 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5388f0b9-0880-435f-b335-f9ed96d52183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:42.658127 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388f0b9-0880-435f-b335-f9ed96d52183 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:42.658578 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388f0b9-0880-435f-b335-f9ed96d52183 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:42.659019 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388f0b9-0880-435f-b335-f9ed96d52183 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:42.660916 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5388f0b9-0880-435f-b335-f9ed96d52183 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:42.676199 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5388f0b9-0880-435f-b335-f9ed96d52183 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:42.701435 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3121/6277] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:34:42 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:34:42.702305 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b361093a-2119-4fe4-9efb-3015e12075cd admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:42.718240 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b361093a-2119-4fe4-9efb-3015e12075cd admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:42.732386 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a3453f-6bae-4067-bd2e-72230f69f41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:42.733310 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a3453f-6bae-4067-bd2e-72230f69f41d admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:42.733702 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a3453f-6bae-4067-bd2e-72230f69f41d admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:42.734196 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a3453f-6bae-4067-bd2e-72230f69f41d admin admin] PATH_INFO: `/v3/projects/df09456b8d2940809a315d195dceab11/users/6af2f5ca4593443997e6357d27a957bc/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:42.775240 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a3453f-6bae-4067-bd2e-72230f69f41d admin admin] RBAC: Authorizing `identity:create_grant(project_id=df09456b8d2940809a315d195dceab11, user_id=6af2f5ca4593443997e6357d27a957bc, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:42.778374 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a3453f-6bae-4067-bd2e-72230f69f41d admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:42.894188 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3157/6278] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:34:42 2022] PUT /identity/v3/projects/df09456b8d2940809a315d195dceab11/users/6af2f5ca4593443997e6357d27a957bc/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:34:42.906287 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d10b3c4-7c0a-498d-b278-0e345941aa21 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:42.906768 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d10b3c4-7c0a-498d-b278-0e345941aa21 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:42.907202 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d10b3c4-7c0a-498d-b278-0e345941aa21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:42.956858 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-8d10b3c4-7c0a-498d-b278-0e345941aa21 None None] MFA Rules not processed for user `6af2f5ca4593443997e6357d27a957bc`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:42.963667 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8d10b3c4-7c0a-498d-b278-0e345941aa21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:43.049231 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3122/6279] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:43.060957 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a3453f-6bae-4067-bd2e-72230f69f41d admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:43.063563 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-f1a3453f-6bae-4067-bd2e-72230f69f41d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:43.134987 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a3453f-6bae-4067-bd2e-72230f69f41d admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:43.139301 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da224ce-eaf9-4b57-9e48-90350a71e19f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:43.140124 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da224ce-eaf9-4b57-9e48-90350a71e19f service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:43.140584 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da224ce-eaf9-4b57-9e48-90350a71e19f service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:43.141067 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da224ce-eaf9-4b57-9e48-90350a71e19f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:43.154503 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da224ce-eaf9-4b57-9e48-90350a71e19f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:43.157026 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da224ce-eaf9-4b57-9e48-90350a71e19f service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:43.168906 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3158/6280] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:34:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:34:43.282266 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd890db-d07a-4c77-aefa-9a850bac9949 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:43.282707 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd890db-d07a-4c77-aefa-9a850bac9949 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:43.286821 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd890db-d07a-4c77-aefa-9a850bac9949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:43.314429 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-3dd890db-d07a-4c77-aefa-9a850bac9949 None None] MFA Rules not processed for user `0e789a633f77451cb9d15d8812ca4a50`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:43.314429 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-3dd890db-d07a-4c77-aefa-9a850bac9949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:43.321550 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3123/6281] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:43 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 21:34:43.326731 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ee99f-47aa-4d8a-ae13-b7d679a86449 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:43.332409 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ee99f-47aa-4d8a-ae13-b7d679a86449 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:43.332409 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ee99f-47aa-4d8a-ae13-b7d679a86449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:43.361045 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-238ee99f-47aa-4d8a-ae13-b7d679a86449 None None] MFA Rules not processed for user `0e789a633f77451cb9d15d8812ca4a50`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:43.363009 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-238ee99f-47aa-4d8a-ae13-b7d679a86449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:43.475544 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3159/6282] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:43.477836 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd890db-d07a-4c77-aefa-9a850bac9949 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:43.490209 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd890db-d07a-4c77-aefa-9a850bac9949 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:43.495303 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f43ae55-62ff-4645-b15e-610085cdb2b3 tempest-IdentityV3UsersTest-175546455 tempest-IdentityV3UsersTest-175546455-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e789a633f77451cb9d15d8812ca4a50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6392084e6f942aca6701f8f01419ab4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:43.495926 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f43ae55-62ff-4645-b15e-610085cdb2b3 tempest-IdentityV3UsersTest-175546455 tempest-IdentityV3UsersTest-175546455-project] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:43.496216 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f43ae55-62ff-4645-b15e-610085cdb2b3 tempest-IdentityV3UsersTest-175546455 tempest-IdentityV3UsersTest-175546455-project] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:43.496496 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f43ae55-62ff-4645-b15e-610085cdb2b3 tempest-IdentityV3UsersTest-175546455 tempest-IdentityV3UsersTest-175546455-project] PATH_INFO: `/v3/users/0e789a633f77451cb9d15d8812ca4a50/password` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:43.602386 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238ee99f-47aa-4d8a-ae13-b7d679a86449 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:43.639472 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3f43ae55-62ff-4645-b15e-610085cdb2b3 tempest-IdentityV3UsersTest-175546455 tempest-IdentityV3UsersTest-175546455-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '0e789a633f77451cb9d15d8812ca4a50'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:43.709141 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238ee99f-47aa-4d8a-ae13-b7d679a86449 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:43.724163 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e2a2cb-081e-41cd-86d8-f8a15fbff76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:43.725060 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e2a2cb-081e-41cd-86d8-f8a15fbff76f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:43.725344 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e2a2cb-081e-41cd-86d8-f8a15fbff76f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:43.726251 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e2a2cb-081e-41cd-86d8-f8a15fbff76f admin admin] PATH_INFO: `/v3/users/6af2f5ca4593443997e6357d27a957bc` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:43.736262 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e2a2cb-081e-41cd-86d8-f8a15fbff76f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6af2f5ca4593443997e6357d27a957bc)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:43.738223 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e2a2cb-081e-41cd-86d8-f8a15fbff76f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:43.758708 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3124/6283] 10.222.0.52 () {60 vars in 1268 bytes} [Sat May 14 21:34:43 2022] POST /identity/v3/users/0e789a633f77451cb9d15d8812ca4a50/password => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:34:43.940007 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c6e2a2cb-081e-41cd-86d8-f8a15fbff76f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6af2f5ca4593443997e6357d27a957bc'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:43.956842 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c6e2a2cb-081e-41cd-86d8-f8a15fbff76f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6af2f5ca4593443997e6357d27a957bc'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:43.965453 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c6e2a2cb-081e-41cd-86d8-f8a15fbff76f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6af2f5ca4593443997e6357d27a957bc'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:44.031163 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c6e2a2cb-081e-41cd-86d8-f8a15fbff76f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6af2f5ca4593443997e6357d27a957bc'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:44.034503 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c6e2a2cb-081e-41cd-86d8-f8a15fbff76f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6af2f5ca4593443997e6357d27a957bc'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:44.046567 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3160/6284] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:34:43 2022] DELETE /identity/v3/users/6af2f5ca4593443997e6357d27a957bc => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:44.051157 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f3ab8-6176-4f2f-816b-6cfe049868ef None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:44.051689 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f3ab8-6176-4f2f-816b-6cfe049868ef None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:44.052139 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f3ab8-6176-4f2f-816b-6cfe049868ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:44.070423 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-388f3ab8-6176-4f2f-816b-6cfe049868ef None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:44.071985 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-388f3ab8-6176-4f2f-816b-6cfe049868ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:44.180056 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3125/6285] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:34:44.224981 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e2a2cb-081e-41cd-86d8-f8a15fbff76f admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:44.232028 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c6e2a2cb-081e-41cd-86d8-f8a15fbff76f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:44.330213 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e2a2cb-081e-41cd-86d8-f8a15fbff76f admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:44.355879 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc8b103-6d0c-459c-b4b7-916c08be1802 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:44.356559 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8b103-6d0c-459c-b4b7-916c08be1802 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:44.356847 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8b103-6d0c-459c-b4b7-916c08be1802 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:44.357127 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8b103-6d0c-459c-b4b7-916c08be1802 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:44.377598 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc8b103-6d0c-459c-b4b7-916c08be1802 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:44.379116 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc8b103-6d0c-459c-b4b7-916c08be1802 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:44.400588 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3161/6286] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:34:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:34:44.756282 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f3ab8-6176-4f2f-816b-6cfe049868ef None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:44.761094 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-388f3ab8-6176-4f2f-816b-6cfe049868ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:44.765217 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a003e-8383-44a1-861b-e1a505f4c587 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:44.765715 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a003e-8383-44a1-861b-e1a505f4c587 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:44.766154 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a003e-8383-44a1-861b-e1a505f4c587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:44.781834 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f3ab8-6176-4f2f-816b-6cfe049868ef None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:44.797750 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07866a4b-d1d1-4dc2-a282-2f52045df229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:44.799141 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07866a4b-d1d1-4dc2-a282-2f52045df229 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:44.800599 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07866a4b-d1d1-4dc2-a282-2f52045df229 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:44.801219 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07866a4b-d1d1-4dc2-a282-2f52045df229 admin admin] PATH_INFO: `/v3/users/153f1ba3ff4f4075abb0b66bdf236fa7` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:44.802814 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07866a4b-d1d1-4dc2-a282-2f52045df229 admin admin] RBAC: Authorizing `identity:delete_user(user_id=153f1ba3ff4f4075abb0b66bdf236fa7)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:44.806554 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07866a4b-d1d1-4dc2-a282-2f52045df229 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:44.814391 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-eb5a003e-8383-44a1-861b-e1a505f4c587 None None] MFA Rules not processed for user `0e789a633f77451cb9d15d8812ca4a50`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:44.815696 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-eb5a003e-8383-44a1-861b-e1a505f4c587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:44.824526 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3162/6287] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:44 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 21:34:44.826173 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e2bc9-abd9-49a4-9c02-e383cfebe156 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:44.827351 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e2bc9-abd9-49a4-9c02-e383cfebe156 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:44.828218 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e2bc9-abd9-49a4-9c02-e383cfebe156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:44.866405 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-088e2bc9-abd9-49a4-9c02-e383cfebe156 None None] MFA Rules not processed for user `0e789a633f77451cb9d15d8812ca4a50`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:44.868131 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-088e2bc9-abd9-49a4-9c02-e383cfebe156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:44.979425 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3163/6288] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:44.987096 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088e2bc9-abd9-49a4-9c02-e383cfebe156 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:44.999446 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088e2bc9-abd9-49a4-9c02-e383cfebe156 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:45.008676 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d9bbeb-498f-494e-8b24-be513cc00cf2 tempest-IdentityV3UsersTest-175546455 tempest-IdentityV3UsersTest-175546455-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e789a633f77451cb9d15d8812ca4a50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6392084e6f942aca6701f8f01419ab4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:45.010563 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d9bbeb-498f-494e-8b24-be513cc00cf2 tempest-IdentityV3UsersTest-175546455 tempest-IdentityV3UsersTest-175546455-project] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:45.010852 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d9bbeb-498f-494e-8b24-be513cc00cf2 tempest-IdentityV3UsersTest-175546455 tempest-IdentityV3UsersTest-175546455-project] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:45.012066 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d9bbeb-498f-494e-8b24-be513cc00cf2 tempest-IdentityV3UsersTest-175546455 tempest-IdentityV3UsersTest-175546455-project] PATH_INFO: `/v3/users/0e789a633f77451cb9d15d8812ca4a50/password` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:45.101722 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-07866a4b-d1d1-4dc2-a282-2f52045df229 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '153f1ba3ff4f4075abb0b66bdf236fa7'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:45.113852 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-07866a4b-d1d1-4dc2-a282-2f52045df229 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '153f1ba3ff4f4075abb0b66bdf236fa7'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:45.115026 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-07866a4b-d1d1-4dc2-a282-2f52045df229 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '153f1ba3ff4f4075abb0b66bdf236fa7'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:45.219955 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-07866a4b-d1d1-4dc2-a282-2f52045df229 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '153f1ba3ff4f4075abb0b66bdf236fa7'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:45.227736 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-69d9bbeb-498f-494e-8b24-be513cc00cf2 tempest-IdentityV3UsersTest-175546455 tempest-IdentityV3UsersTest-175546455-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '0e789a633f77451cb9d15d8812ca4a50'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:45.275945 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-07866a4b-d1d1-4dc2-a282-2f52045df229 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '153f1ba3ff4f4075abb0b66bdf236fa7'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:45.285839 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3126/6289] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:34:44 2022] DELETE /identity/v3/users/153f1ba3ff4f4075abb0b66bdf236fa7 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:45.286785 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07866a4b-d1d1-4dc2-a282-2f52045df229 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:45.290362 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-07866a4b-d1d1-4dc2-a282-2f52045df229 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:45.326494 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3164/6290] 10.222.0.52 () {60 vars in 1268 bytes} [Sat May 14 21:34:44 2022] POST /identity/v3/users/0e789a633f77451cb9d15d8812ca4a50/password => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:34:45.328168 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ed784b-fce3-4478-8eb8-85f299eb9b16 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:45.328527 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ed784b-fce3-4478-8eb8-85f299eb9b16 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:45.328873 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ed784b-fce3-4478-8eb8-85f299eb9b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:45.354537 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-c1ed784b-fce3-4478-8eb8-85f299eb9b16 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:45.355887 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c1ed784b-fce3-4478-8eb8-85f299eb9b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:45.425088 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07866a4b-d1d1-4dc2-a282-2f52045df229 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:45.434357 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32d0d7d-11bc-49cb-b86f-7f1027bcb884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:45.435320 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d0d7d-11bc-49cb-b86f-7f1027bcb884 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:45.435726 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d0d7d-11bc-49cb-b86f-7f1027bcb884 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:45.436103 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d0d7d-11bc-49cb-b86f-7f1027bcb884 admin admin] PATH_INFO: `/v3/projects/df09456b8d2940809a315d195dceab11` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:45.437447 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32d0d7d-11bc-49cb-b86f-7f1027bcb884 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df09456b8d2940809a315d195dceab11)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:45.439725 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32d0d7d-11bc-49cb-b86f-7f1027bcb884 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:45.448092 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3165/6291] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:45.461109 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ed784b-fce3-4478-8eb8-85f299eb9b16 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:45.464357 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c1ed784b-fce3-4478-8eb8-85f299eb9b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:45.558501 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ed784b-fce3-4478-8eb8-85f299eb9b16 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:45.577743 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e32d0d7d-11bc-49cb-b86f-7f1027bcb884 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df09456b8d2940809a315d195dceab11', 'request_id': 'req-e32d0d7d-11bc-49cb-b86f-7f1027bcb884'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:45.585393 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e32d0d7d-11bc-49cb-b86f-7f1027bcb884 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df09456b8d2940809a315d195dceab11', 'request_id': 'req-e32d0d7d-11bc-49cb-b86f-7f1027bcb884'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:45.593120 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e32d0d7d-11bc-49cb-b86f-7f1027bcb884 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df09456b8d2940809a315d195dceab11', 'request_id': 'req-e32d0d7d-11bc-49cb-b86f-7f1027bcb884'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:45.628309 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0b3ed5-fb43-4a8d-9547-f7141f370c8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:45.635224 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b3ed5-fb43-4a8d-9547-f7141f370c8b service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:45.635224 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b3ed5-fb43-4a8d-9547-f7141f370c8b service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:45.635224 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b3ed5-fb43-4a8d-9547-f7141f370c8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:45.693592 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e32d0d7d-11bc-49cb-b86f-7f1027bcb884 admin admin] The token cache is being invalidate because project df09456b8d2940809a315d195dceab11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:34:45.694866 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e32d0d7d-11bc-49cb-b86f-7f1027bcb884 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:45.696083 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e32d0d7d-11bc-49cb-b86f-7f1027bcb884 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:45.698879 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3127/6292] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:34:45 2022] DELETE /identity/v3/projects/df09456b8d2940809a315d195dceab11 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:45.700179 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32d0d7d-11bc-49cb-b86f-7f1027bcb884 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:45.702759 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e32d0d7d-11bc-49cb-b86f-7f1027bcb884 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:45.727560 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0b3ed5-fb43-4a8d-9547-f7141f370c8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:45.738274 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0b3ed5-fb43-4a8d-9547-f7141f370c8b service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:45.762700 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3166/6293] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:34:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:34:45.766171 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028acee-79ba-4e99-aa08-8d8196ec64ee None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:45.766465 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028acee-79ba-4e99-aa08-8d8196ec64ee None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:45.766743 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028acee-79ba-4e99-aa08-8d8196ec64ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:45.794786 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-0028acee-79ba-4e99-aa08-8d8196ec64ee None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:45.796187 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-0028acee-79ba-4e99-aa08-8d8196ec64ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:45.808373 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3167/6294] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:45.816767 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52bf68a-fb83-480a-a0ea-30041cda665d None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:45.817043 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52bf68a-fb83-480a-a0ea-30041cda665d None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:45.817946 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52bf68a-fb83-480a-a0ea-30041cda665d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:45.854320 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32d0d7d-11bc-49cb-b86f-7f1027bcb884 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:45.862332 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-e52bf68a-fb83-480a-a0ea-30041cda665d None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:45.864230 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e52bf68a-fb83-480a-a0ea-30041cda665d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:45.869668 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2361d99-b558-4525-81ba-a9ee46b16fcd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:45.871657 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2361d99-b558-4525-81ba-a9ee46b16fcd service placement] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:45.872587 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2361d99-b558-4525-81ba-a9ee46b16fcd service placement] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:45.873554 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2361d99-b558-4525-81ba-a9ee46b16fcd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:45.878762 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-d2361d99-b558-4525-81ba-a9ee46b16fcd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:45.891588 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3168/6295] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:45.899910 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52bf68a-fb83-480a-a0ea-30041cda665d None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:45.920658 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2361d99-b558-4525-81ba-a9ee46b16fcd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:45.923087 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2361d99-b558-4525-81ba-a9ee46b16fcd service placement] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:45.938161 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52bf68a-fb83-480a-a0ea-30041cda665d None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:45.951040 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3128/6296] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:34:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:34:45.951831 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f6b9c4-4da7-475f-b175-9fdc20b3a092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:45.953736 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f6b9c4-4da7-475f-b175-9fdc20b3a092 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:45.954031 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f6b9c4-4da7-475f-b175-9fdc20b3a092 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:45.954315 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f6b9c4-4da7-475f-b175-9fdc20b3a092 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:45.955957 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f6b9c4-4da7-475f-b175-9fdc20b3a092 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:34:45.956277 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f6b9c4-4da7-475f-b175-9fdc20b3a092 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:45.959890 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f6b9c4-4da7-475f-b175-9fdc20b3a092 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:45.996606 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3169/6297] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:34:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:34:46.000469 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2361d99-b558-4525-81ba-a9ee46b16fcd service placement] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:46.012836 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2361d99-b558-4525-81ba-a9ee46b16fcd service placement] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:46.020787 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c887ec7-8132-450c-b197-411af08c7a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:46.021479 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c887ec7-8132-450c-b197-411af08c7a7d admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:46.028639 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c887ec7-8132-450c-b197-411af08c7a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:46.028639 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c887ec7-8132-450c-b197-411af08c7a7d admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:46.028639 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c887ec7-8132-450c-b197-411af08c7a7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:46.028639 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c887ec7-8132-450c-b197-411af08c7a7d admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:46.217889 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3129/6298] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:34:45 2022] POST /identity/v3/projects => generated 365 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:34:46.218343 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f6b9c4-4da7-475f-b175-9fdc20b3a092 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:46.220453 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-02f6b9c4-4da7-475f-b175-9fdc20b3a092 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:46.222087 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c887ec7-8132-450c-b197-411af08c7a7d admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:46.239842 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f6b9c4-4da7-475f-b175-9fdc20b3a092 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:46.333002 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c887ec7-8132-450c-b197-411af08c7a7d admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:46.349631 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e90d315-68dd-4fcb-a5c2-50ff5a038215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:46.349631 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90d315-68dd-4fcb-a5c2-50ff5a038215 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:46.349631 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90d315-68dd-4fcb-a5c2-50ff5a038215 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:46.349631 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90d315-68dd-4fcb-a5c2-50ff5a038215 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:46.349970 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e90d315-68dd-4fcb-a5c2-50ff5a038215 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:46.353145 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e90d315-68dd-4fcb-a5c2-50ff5a038215 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:46.358220 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ea6008-fafb-4bda-a3b5-5be9e103fea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:46.359087 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea6008-fafb-4bda-a3b5-5be9e103fea7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:46.359367 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea6008-fafb-4bda-a3b5-5be9e103fea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:46.359674 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea6008-fafb-4bda-a3b5-5be9e103fea7 admin admin] PATH_INFO: `/v3/projects/5a1920fe976b4f6da96a03177d55b7f2` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:46.362092 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ea6008-fafb-4bda-a3b5-5be9e103fea7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a1920fe976b4f6da96a03177d55b7f2)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:46.362843 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ea6008-fafb-4bda-a3b5-5be9e103fea7 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:46.461439 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3130/6299] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:34:46 2022] POST /identity/v3/users => generated 283 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:34:46.465204 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e90d315-68dd-4fcb-a5c2-50ff5a038215 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:46.467235 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-6e90d315-68dd-4fcb-a5c2-50ff5a038215 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:46.489979 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-27ea6008-fafb-4bda-a3b5-5be9e103fea7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a1920fe976b4f6da96a03177d55b7f2', 'request_id': 'req-27ea6008-fafb-4bda-a3b5-5be9e103fea7'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:46.496273 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-27ea6008-fafb-4bda-a3b5-5be9e103fea7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a1920fe976b4f6da96a03177d55b7f2', 'request_id': 'req-27ea6008-fafb-4bda-a3b5-5be9e103fea7'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:46.557895 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e90d315-68dd-4fcb-a5c2-50ff5a038215 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:46.565873 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-27ea6008-fafb-4bda-a3b5-5be9e103fea7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a1920fe976b4f6da96a03177d55b7f2', 'request_id': 'req-27ea6008-fafb-4bda-a3b5-5be9e103fea7'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:46.580721 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-27ea6008-fafb-4bda-a3b5-5be9e103fea7 admin admin] The token cache is being invalidate because project 5a1920fe976b4f6da96a03177d55b7f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:34:46.581083 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-27ea6008-fafb-4bda-a3b5-5be9e103fea7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:46.582100 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-27ea6008-fafb-4bda-a3b5-5be9e103fea7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:46.588216 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3170/6300] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:34:46 2022] DELETE /identity/v3/projects/5a1920fe976b4f6da96a03177d55b7f2 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:46.589591 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509552db-3983-4dcf-ab1a-3731d52bdf0e None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:46.590467 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509552db-3983-4dcf-ab1a-3731d52bdf0e None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:46.590753 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509552db-3983-4dcf-ab1a-3731d52bdf0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:46.614344 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-509552db-3983-4dcf-ab1a-3731d52bdf0e None None] MFA Rules not processed for user `0e789a633f77451cb9d15d8812ca4a50`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:46.617851 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-509552db-3983-4dcf-ab1a-3731d52bdf0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:46.624949 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3171/6301] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:46 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 21:34:46.626026 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509552db-3983-4dcf-ab1a-3731d52bdf0e None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:46.627670 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-509552db-3983-4dcf-ab1a-3731d52bdf0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:46.655026 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc151f-5793-43bb-abba-50c7c40faee5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:46.656307 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc151f-5793-43bb-abba-50c7c40faee5 service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:46.656928 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc151f-5793-43bb-abba-50c7c40faee5 service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:46.657380 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc151f-5793-43bb-abba-50c7c40faee5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:46.662585 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-a5cc151f-5793-43bb-abba-50c7c40faee5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:46.720646 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509552db-3983-4dcf-ab1a-3731d52bdf0e None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:46.731873 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ba901-2082-4906-a292-050fc2f12e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:46.732556 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ba901-2082-4906-a292-050fc2f12e3b admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:46.732899 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ba901-2082-4906-a292-050fc2f12e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:46.733189 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ba901-2082-4906-a292-050fc2f12e3b admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:46.734583 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ba901-2082-4906-a292-050fc2f12e3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:46.736597 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ba901-2082-4906-a292-050fc2f12e3b admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:46.751760 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cc151f-5793-43bb-abba-50c7c40faee5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:46.754201 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3172/6302] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:34:46 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:34:46.754463 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cc151f-5793-43bb-abba-50c7c40faee5 service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:46.759131 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ba901-2082-4906-a292-050fc2f12e3b admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:46.761583 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-505ba901-2082-4906-a292-050fc2f12e3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:46.783783 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3131/6303] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:34:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:34:46.785985 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980bd74e-bc20-48ef-9e33-3a33beee4260 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:46.786322 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980bd74e-bc20-48ef-9e33-3a33beee4260 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:46.786607 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980bd74e-bc20-48ef-9e33-3a33beee4260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:46.810967 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-980bd74e-bc20-48ef-9e33-3a33beee4260 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:46.810967 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-980bd74e-bc20-48ef-9e33-3a33beee4260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:46.820293 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3132/6304] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:46.821262 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980bd74e-bc20-48ef-9e33-3a33beee4260 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:46.851122 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980bd74e-bc20-48ef-9e33-3a33beee4260 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:46.859620 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b24ed5-b3d0-4cf2-be07-da3f830146f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:46.860453 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b24ed5-b3d0-4cf2-be07-da3f830146f8 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:46.860811 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b24ed5-b3d0-4cf2-be07-da3f830146f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:46.861165 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b24ed5-b3d0-4cf2-be07-da3f830146f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:46.861969 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b24ed5-b3d0-4cf2-be07-da3f830146f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:46.864799 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b24ed5-b3d0-4cf2-be07-da3f830146f8 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:46.884671 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3133/6305] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:34:46 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:34:46.886611 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb4b479-77f1-4523-aff3-21197a7cffb6 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:46.887036 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb4b479-77f1-4523-aff3-21197a7cffb6 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:46.887395 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb4b479-77f1-4523-aff3-21197a7cffb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:46.888668 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ba901-2082-4906-a292-050fc2f12e3b admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:46.893802 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a6549a-cf91-402a-9916-3ca5bb789827 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198271d1c0d44cb58bace41a65f4b94c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:46.894889 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6549a-cf91-402a-9916-3ca5bb789827 service cinder] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:46.895365 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6549a-cf91-402a-9916-3ca5bb789827 service cinder] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:46.895821 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6549a-cf91-402a-9916-3ca5bb789827 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:46.899544 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-20a6549a-cf91-402a-9916-3ca5bb789827 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:46.915184 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-8bb4b479-77f1-4523-aff3-21197a7cffb6 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:46.917109 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8bb4b479-77f1-4523-aff3-21197a7cffb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:46.936278 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3134/6306] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:46.937617 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb4b479-77f1-4523-aff3-21197a7cffb6 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:46.952250 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb4b479-77f1-4523-aff3-21197a7cffb6 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:46.965271 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa911f3c-ab60-4a0f-bf13-5198b21a4c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:46.967214 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa911f3c-ab60-4a0f-bf13-5198b21a4c40 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:46.967541 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa911f3c-ab60-4a0f-bf13-5198b21a4c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:46.967828 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa911f3c-ab60-4a0f-bf13-5198b21a4c40 admin admin] PATH_INFO: `/v3/projects/b88b4e0c3d484786ba5e40614156bbab/users/77610b4a6cb04b2fa37a700b6c67baef/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:46.999828 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa911f3c-ab60-4a0f-bf13-5198b21a4c40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b88b4e0c3d484786ba5e40614156bbab, user_id=77610b4a6cb04b2fa37a700b6c67baef, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:47.002521 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa911f3c-ab60-4a0f-bf13-5198b21a4c40 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:47.017196 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a6549a-cf91-402a-9916-3ca5bb789827 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:47.018995 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a6549a-cf91-402a-9916-3ca5bb789827 service cinder] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:47.028924 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3173/6307] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:34:46 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:34:47.029724 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a6549a-cf91-402a-9916-3ca5bb789827 service cinder] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:47.040188 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a6549a-cf91-402a-9916-3ca5bb789827 service cinder] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:47.044867 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eae68a5-0e6d-4b30-ba6f-90613cb3709f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:47.045515 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae68a5-0e6d-4b30-ba6f-90613cb3709f admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:47.045825 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae68a5-0e6d-4b30-ba6f-90613cb3709f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:47.046104 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae68a5-0e6d-4b30-ba6f-90613cb3709f admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:47.046812 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eae68a5-0e6d-4b30-ba6f-90613cb3709f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:34:47.047113 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eae68a5-0e6d-4b30-ba6f-90613cb3709f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:47.048738 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eae68a5-0e6d-4b30-ba6f-90613cb3709f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:47.062321 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3174/6308] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:34:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:34:47.066584 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eae68a5-0e6d-4b30-ba6f-90613cb3709f admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:47.076811 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eae68a5-0e6d-4b30-ba6f-90613cb3709f admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:47.081771 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ae147-d6ac-4da6-b451-c28197ca3600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:47.094534 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ae147-d6ac-4da6-b451-c28197ca3600 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:47.094534 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ae147-d6ac-4da6-b451-c28197ca3600 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:47.094534 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ae147-d6ac-4da6-b451-c28197ca3600 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:47.094534 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9ae147-d6ac-4da6-b451-c28197ca3600 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:47.094534 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9ae147-d6ac-4da6-b451-c28197ca3600 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:47.152432 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3135/6309] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:34:46 2022] PUT /identity/v3/projects/b88b4e0c3d484786ba5e40614156bbab/users/77610b4a6cb04b2fa37a700b6c67baef/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:47.164164 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6662078-25a1-4ddb-a10c-c4079e25c62d None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:47.164474 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6662078-25a1-4ddb-a10c-c4079e25c62d None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:47.164740 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6662078-25a1-4ddb-a10c-c4079e25c62d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:47.195995 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-c6662078-25a1-4ddb-a10c-c4079e25c62d None None] MFA Rules not processed for user `77610b4a6cb04b2fa37a700b6c67baef`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:47.195995 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c6662078-25a1-4ddb-a10c-c4079e25c62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:47.276845 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3136/6310] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:47 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:34:47.287587 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6662078-25a1-4ddb-a10c-c4079e25c62d None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:47.289231 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c6662078-25a1-4ddb-a10c-c4079e25c62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:47.297276 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3175/6311] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:34:47 2022] POST /identity/v3/projects => generated 367 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:34:47.298671 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ae147-d6ac-4da6-b451-c28197ca3600 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:47.377075 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6662078-25a1-4ddb-a10c-c4079e25c62d None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:47.377257 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ae147-d6ac-4da6-b451-c28197ca3600 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:47.382462 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93d1ba1-c6e9-4e85-8088-cd9dd31d6673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:47.382814 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d1ba1-c6e9-4e85-8088-cd9dd31d6673 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:47.383375 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d1ba1-c6e9-4e85-8088-cd9dd31d6673 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:47.383696 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d1ba1-c6e9-4e85-8088-cd9dd31d6673 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:47.384613 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93d1ba1-c6e9-4e85-8088-cd9dd31d6673 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:47.390513 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93d1ba1-c6e9-4e85-8088-cd9dd31d6673 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:47.436653 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26effbde-f51f-41ca-b4cc-d317485c30cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:47.437309 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26effbde-f51f-41ca-b4cc-d317485c30cf service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:47.437592 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26effbde-f51f-41ca-b4cc-d317485c30cf service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:47.437869 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26effbde-f51f-41ca-b4cc-d317485c30cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:47.514739 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26effbde-f51f-41ca-b4cc-d317485c30cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:47.517041 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26effbde-f51f-41ca-b4cc-d317485c30cf service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:47.520461 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3176/6312] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:34:47 2022] POST /identity/v3/users => generated 284 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:34:47.525196 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93d1ba1-c6e9-4e85-8088-cd9dd31d6673 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:47.535082 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3137/6313] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:34:47 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:34:47.542219 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93d1ba1-c6e9-4e85-8088-cd9dd31d6673 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:47.546514 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e41490-2a82-4ca9-9a64-b99dc3c9868f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:47.547288 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e41490-2a82-4ca9-9a64-b99dc3c9868f admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:47.547913 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e41490-2a82-4ca9-9a64-b99dc3c9868f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:47.548296 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e41490-2a82-4ca9-9a64-b99dc3c9868f admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:47.549242 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e41490-2a82-4ca9-9a64-b99dc3c9868f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:47.550948 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e41490-2a82-4ca9-9a64-b99dc3c9868f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:47.563871 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3177/6314] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:34:47.567386 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26effbde-f51f-41ca-b4cc-d317485c30cf service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:47.580597 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26effbde-f51f-41ca-b4cc-d317485c30cf service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:47.585688 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d957d98b-8735-435f-9e94-e2cb66e557a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:47.586440 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957d98b-8735-435f-9e94-e2cb66e557a8 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:47.586722 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957d98b-8735-435f-9e94-e2cb66e557a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:47.587003 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957d98b-8735-435f-9e94-e2cb66e557a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:47.587922 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d957d98b-8735-435f-9e94-e2cb66e557a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:47.589909 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d957d98b-8735-435f-9e94-e2cb66e557a8 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:47.604434 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3138/6315] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:34:47.608577 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e41490-2a82-4ca9-9a64-b99dc3c9868f admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:47.620446 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e41490-2a82-4ca9-9a64-b99dc3c9868f admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:47.625396 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7019cd52-9688-4520-beac-5cb6678d9460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:47.626295 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019cd52-9688-4520-beac-5cb6678d9460 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:47.626576 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019cd52-9688-4520-beac-5cb6678d9460 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:47.626852 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019cd52-9688-4520-beac-5cb6678d9460 admin admin] PATH_INFO: `/v3/projects/139b7ddd79864270813fc6a41f46439d/users/4520497ff0cc42bba0a4ddb6d04cfb63/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:47.631127 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddfdde3-e515-4284-ab52-63b7b829f2eb None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:47.631127 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddfdde3-e515-4284-ab52-63b7b829f2eb None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:47.631127 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddfdde3-e515-4284-ab52-63b7b829f2eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:47.650873 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7019cd52-9688-4520-beac-5cb6678d9460 admin admin] RBAC: Authorizing `identity:create_grant(project_id=139b7ddd79864270813fc6a41f46439d, user_id=4520497ff0cc42bba0a4ddb6d04cfb63, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:47.655684 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7019cd52-9688-4520-beac-5cb6678d9460 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:47.660193 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-0ddfdde3-e515-4284-ab52-63b7b829f2eb None None] MFA Rules not processed for user `0e789a633f77451cb9d15d8812ca4a50`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:47.661626 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-0ddfdde3-e515-4284-ab52-63b7b829f2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:47.733031 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3139/6316] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:34:47.738679 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddfdde3-e515-4284-ab52-63b7b829f2eb None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:47.740347 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-0ddfdde3-e515-4284-ab52-63b7b829f2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:47.757379 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddfdde3-e515-4284-ab52-63b7b829f2eb None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:47.763365 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb2cbf-bc1b-4173-acab-29d4f29690af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:47.764535 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb2cbf-bc1b-4173-acab-29d4f29690af admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:47.764920 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb2cbf-bc1b-4173-acab-29d4f29690af admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:47.765438 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb2cbf-bc1b-4173-acab-29d4f29690af admin admin] PATH_INFO: `/v3/users/0e789a633f77451cb9d15d8812ca4a50` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:47.767145 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cb2cbf-bc1b-4173-acab-29d4f29690af admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e789a633f77451cb9d15d8812ca4a50)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:47.769520 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cb2cbf-bc1b-4173-acab-29d4f29690af admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:47.776278 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3178/6317] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:34:47 2022] PUT /identity/v3/projects/139b7ddd79864270813fc6a41f46439d/users/4520497ff0cc42bba0a4ddb6d04cfb63/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:47.788184 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd6f016-47b8-4a86-b202-c5d1e200e143 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:47.788749 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd6f016-47b8-4a86-b202-c5d1e200e143 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:47.789308 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd6f016-47b8-4a86-b202-c5d1e200e143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:47.832425 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-8fd6f016-47b8-4a86-b202-c5d1e200e143 None None] MFA Rules not processed for user `4520497ff0cc42bba0a4ddb6d04cfb63`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:47.834681 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-8fd6f016-47b8-4a86-b202-c5d1e200e143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:47.903587 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3179/6318] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:47 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:34:47.914029 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd6f016-47b8-4a86-b202-c5d1e200e143 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:47.916361 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-8fd6f016-47b8-4a86-b202-c5d1e200e143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:47.992712 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b6cb2cbf-bc1b-4173-acab-29d4f29690af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e789a633f77451cb9d15d8812ca4a50'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:48.003224 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b6cb2cbf-bc1b-4173-acab-29d4f29690af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e789a633f77451cb9d15d8812ca4a50'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:48.004173 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b6cb2cbf-bc1b-4173-acab-29d4f29690af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e789a633f77451cb9d15d8812ca4a50'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:48.026143 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd6f016-47b8-4a86-b202-c5d1e200e143 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:48.030527 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb65689-1a74-42a2-96b9-83650b9a92fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:48.031337 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb65689-1a74-42a2-96b9-83650b9a92fc service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:48.031673 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb65689-1a74-42a2-96b9-83650b9a92fc service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:48.031942 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb65689-1a74-42a2-96b9-83650b9a92fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:48.045907 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb65689-1a74-42a2-96b9-83650b9a92fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:48.049738 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb65689-1a74-42a2-96b9-83650b9a92fc service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:48.063975 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3180/6319] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:34:47 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:34:48.104655 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b6cb2cbf-bc1b-4173-acab-29d4f29690af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e789a633f77451cb9d15d8812ca4a50'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:48.132370 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b6cb2cbf-bc1b-4173-acab-29d4f29690af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e789a633f77451cb9d15d8812ca4a50'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:48.187756 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3140/6320] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:34:47 2022] DELETE /identity/v3/users/0e789a633f77451cb9d15d8812ca4a50 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:48.199103 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251058d5-350c-4c4f-88f7-c7fcf236aec4 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:48.199103 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251058d5-350c-4c4f-88f7-c7fcf236aec4 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:48.199103 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251058d5-350c-4c4f-88f7-c7fcf236aec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:48.220462 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-251058d5-350c-4c4f-88f7-c7fcf236aec4 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:48.222403 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-251058d5-350c-4c4f-88f7-c7fcf236aec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:48.321563 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3181/6321] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:48.330468 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb2cbf-bc1b-4173-acab-29d4f29690af admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:48.332239 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b6cb2cbf-bc1b-4173-acab-29d4f29690af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:48.495590 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb2cbf-bc1b-4173-acab-29d4f29690af admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:48.502818 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11765e1-bbd6-44c6-acef-02e240bb11c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:48.503691 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11765e1-bbd6-44c6-acef-02e240bb11c4 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:48.503896 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11765e1-bbd6-44c6-acef-02e240bb11c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:48.504549 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11765e1-bbd6-44c6-acef-02e240bb11c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:48.516882 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11765e1-bbd6-44c6-acef-02e240bb11c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:48.518907 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11765e1-bbd6-44c6-acef-02e240bb11c4 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:48.561061 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3141/6322] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:34:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:34:49.442141 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251058d5-350c-4c4f-88f7-c7fcf236aec4 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:49.445843 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-251058d5-350c-4c4f-88f7-c7fcf236aec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:49.495082 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251058d5-350c-4c4f-88f7-c7fcf236aec4 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:49.500667 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4405a1-dddd-42e7-9591-ccd8a1feb93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:49.501530 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4405a1-dddd-42e7-9591-ccd8a1feb93b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:49.501940 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4405a1-dddd-42e7-9591-ccd8a1feb93b admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:49.502279 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4405a1-dddd-42e7-9591-ccd8a1feb93b admin admin] PATH_INFO: `/v3/projects/e6392084e6f942aca6701f8f01419ab4` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:49.503655 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4405a1-dddd-42e7-9591-ccd8a1feb93b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6392084e6f942aca6701f8f01419ab4)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:49.505615 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4405a1-dddd-42e7-9591-ccd8a1feb93b admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:49.664978 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0a4405a1-dddd-42e7-9591-ccd8a1feb93b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6392084e6f942aca6701f8f01419ab4', 'request_id': 'req-0a4405a1-dddd-42e7-9591-ccd8a1feb93b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:49.675315 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0a4405a1-dddd-42e7-9591-ccd8a1feb93b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6392084e6f942aca6701f8f01419ab4', 'request_id': 'req-0a4405a1-dddd-42e7-9591-ccd8a1feb93b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:49.765601 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0a4405a1-dddd-42e7-9591-ccd8a1feb93b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6392084e6f942aca6701f8f01419ab4', 'request_id': 'req-0a4405a1-dddd-42e7-9591-ccd8a1feb93b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:49.783765 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0a4405a1-dddd-42e7-9591-ccd8a1feb93b admin admin] The token cache is being invalidate because project e6392084e6f942aca6701f8f01419ab4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:34:49.784412 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0a4405a1-dddd-42e7-9591-ccd8a1feb93b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:49.785509 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0a4405a1-dddd-42e7-9591-ccd8a1feb93b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:49.787325 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3182/6323] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:34:49 2022] DELETE /identity/v3/projects/e6392084e6f942aca6701f8f01419ab4 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:49.797081 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeccd9e-ba22-4ed0-b5f0-b9ad57eee997 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:49.797525 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeccd9e-ba22-4ed0-b5f0-b9ad57eee997 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:49.797630 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeccd9e-ba22-4ed0-b5f0-b9ad57eee997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:49.825702 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-0eeccd9e-ba22-4ed0-b5f0-b9ad57eee997 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:49.826994 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-0eeccd9e-ba22-4ed0-b5f0-b9ad57eee997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:49.929621 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3142/6324] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:49.939348 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd11ed3-ea18-4565-91f7-e814cacdee92 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:49.939659 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd11ed3-ea18-4565-91f7-e814cacdee92 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:49.939945 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd11ed3-ea18-4565-91f7-e814cacdee92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:49.973774 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-3dd11ed3-ea18-4565-91f7-e814cacdee92 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:49.977287 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-3dd11ed3-ea18-4565-91f7-e814cacdee92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:49.998264 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3183/6325] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:50.002632 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeccd9e-ba22-4ed0-b5f0-b9ad57eee997 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:50.014259 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeccd9e-ba22-4ed0-b5f0-b9ad57eee997 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:50.028791 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523829c8-0298-4e64-9b63-03faf9218b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:50.031395 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523829c8-0298-4e64-9b63-03faf9218b42 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:50.031774 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523829c8-0298-4e64-9b63-03faf9218b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:50.032072 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523829c8-0298-4e64-9b63-03faf9218b42 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:50.032805 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523829c8-0298-4e64-9b63-03faf9218b42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:34:50.033765 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523829c8-0298-4e64-9b63-03faf9218b42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:50.036327 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523829c8-0298-4e64-9b63-03faf9218b42 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:50.073423 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3143/6326] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:34:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:34:50.078064 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd11ed3-ea18-4565-91f7-e814cacdee92 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:50.090951 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd11ed3-ea18-4565-91f7-e814cacdee92 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:50.107916 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9fc393-91d1-49bf-ab28-21c8e9971120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:50.108903 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9fc393-91d1-49bf-ab28-21c8e9971120 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:50.109048 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9fc393-91d1-49bf-ab28-21c8e9971120 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:50.109218 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9fc393-91d1-49bf-ab28-21c8e9971120 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:50.110009 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9fc393-91d1-49bf-ab28-21c8e9971120 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:50.111857 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9fc393-91d1-49bf-ab28-21c8e9971120 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:50.244607 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3184/6327] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:34:50 2022] POST /identity/v3/projects => generated 385 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:34:50.249608 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523829c8-0298-4e64-9b63-03faf9218b42 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:50.271388 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523829c8-0298-4e64-9b63-03faf9218b42 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:50.366658 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245c0ac1-38ed-4ff8-ba59-a6c70a25f5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:50.368012 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c0ac1-38ed-4ff8-ba59-a6c70a25f5f2 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:50.368300 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c0ac1-38ed-4ff8-ba59-a6c70a25f5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:50.368573 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c0ac1-38ed-4ff8-ba59-a6c70a25f5f2 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:50.369263 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245c0ac1-38ed-4ff8-ba59-a6c70a25f5f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:50.371210 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245c0ac1-38ed-4ff8-ba59-a6c70a25f5f2 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:50.504940 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3144/6328] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:34:50 2022] POST /identity/v3/users => generated 293 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:34:50.509033 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9fc393-91d1-49bf-ab28-21c8e9971120 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:50.523730 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9fc393-91d1-49bf-ab28-21c8e9971120 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:50.530217 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f4bea2-0821-4c78-8aee-e622ec44035d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:50.531238 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f4bea2-0821-4c78-8aee-e622ec44035d admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:50.531797 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f4bea2-0821-4c78-8aee-e622ec44035d admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:50.532259 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f4bea2-0821-4c78-8aee-e622ec44035d admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:50.533170 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f4bea2-0821-4c78-8aee-e622ec44035d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:50.537034 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f4bea2-0821-4c78-8aee-e622ec44035d admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:50.552529 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3185/6329] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:34:50 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:34:50.556350 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245c0ac1-38ed-4ff8-ba59-a6c70a25f5f2 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:50.568820 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245c0ac1-38ed-4ff8-ba59-a6c70a25f5f2 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:50.575546 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8956ba61-a487-44fb-a805-b72fac16cdce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:50.577724 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8956ba61-a487-44fb-a805-b72fac16cdce admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:50.578230 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8956ba61-a487-44fb-a805-b72fac16cdce admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:50.578700 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8956ba61-a487-44fb-a805-b72fac16cdce admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:50.579919 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8956ba61-a487-44fb-a805-b72fac16cdce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:50.583016 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8956ba61-a487-44fb-a805-b72fac16cdce admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:50.623829 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3145/6330] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:34:50 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:34:50.626114 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f4bea2-0821-4c78-8aee-e622ec44035d admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:50.637287 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f4bea2-0821-4c78-8aee-e622ec44035d admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:50.662482 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e8876-ee5c-460b-83ca-9f559bfecd07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:50.663892 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e8876-ee5c-460b-83ca-9f559bfecd07 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:50.665109 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e8876-ee5c-460b-83ca-9f559bfecd07 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:50.666391 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e8876-ee5c-460b-83ca-9f559bfecd07 admin admin] PATH_INFO: `/v3/projects/289416fa3e14424cac2db2c12b1c80d1/users/dcda35b0569c43519ee4ffc6edba2d41/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:50.698342 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046e8876-ee5c-460b-83ca-9f559bfecd07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=289416fa3e14424cac2db2c12b1c80d1, user_id=dcda35b0569c43519ee4ffc6edba2d41, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:50.712822 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046e8876-ee5c-460b-83ca-9f559bfecd07 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:50.852433 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3186/6331] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:34:50 2022] PUT /identity/v3/projects/289416fa3e14424cac2db2c12b1c80d1/users/dcda35b0569c43519ee4ffc6edba2d41/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:34:50.862255 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd923f1-4fb3-484b-b7f2-746e4ee5df95 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:50.862802 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd923f1-4fb3-484b-b7f2-746e4ee5df95 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:50.863317 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd923f1-4fb3-484b-b7f2-746e4ee5df95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:50.891446 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-ffd923f1-4fb3-484b-b7f2-746e4ee5df95 None None] MFA Rules not processed for user `dcda35b0569c43519ee4ffc6edba2d41`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:50.893175 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-ffd923f1-4fb3-484b-b7f2-746e4ee5df95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:50.967640 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3146/6332] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:50.979610 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e8876-ee5c-460b-83ca-9f559bfecd07 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:50.981716 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-046e8876-ee5c-460b-83ca-9f559bfecd07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:51.064470 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e8876-ee5c-460b-83ca-9f559bfecd07 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:51.072035 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c1eab8-759f-43d2-84e0-e59c52639f36 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b5cb86f190f4fcfb06d66cb8f14643f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:51.072818 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1eab8-759f-43d2-84e0-e59c52639f36 service glance] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:51.073206 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1eab8-759f-43d2-84e0-e59c52639f36 service glance] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:51.073585 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1eab8-759f-43d2-84e0-e59c52639f36 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:51.094432 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c1eab8-759f-43d2-84e0-e59c52639f36 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:51.096416 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c1eab8-759f-43d2-84e0-e59c52639f36 service glance] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:51.130935 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3187/6333] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:34:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:34:51.418809 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad72b7-6021-4345-9493-f79e23fccd7c None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:51.419641 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad72b7-6021-4345-9493-f79e23fccd7c None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:51.420202 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad72b7-6021-4345-9493-f79e23fccd7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:51.511351 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-15ad72b7-6021-4345-9493-f79e23fccd7c None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:51.513181 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-15ad72b7-6021-4345-9493-f79e23fccd7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:51.633692 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3147/6334] 10.222.0.52 () {58 vars in 1009 bytes} [Sat May 14 21:34:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:51.804500 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c1eab8-759f-43d2-84e0-e59c52639f36 service glance] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:51.808110 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-45c1eab8-759f-43d2-84e0-e59c52639f36 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:51.930672 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c1eab8-759f-43d2-84e0-e59c52639f36 service glance] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:51.938066 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bec26df-e672-4649-bec3-0f19b3c1fb51 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:51.946654 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec26df-e672-4649-bec3-0f19b3c1fb51 service swift] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:51.946654 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec26df-e672-4649-bec3-0f19b3c1fb51 service swift] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:51.946654 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec26df-e672-4649-bec3-0f19b3c1fb51 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:51.955201 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bec26df-e672-4649-bec3-0f19b3c1fb51 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:51.957896 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bec26df-e672-4649-bec3-0f19b3c1fb51 service swift] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:51.977898 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3188/6335] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 21:34:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 21:34:53.032498 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b885db93-7a70-46a3-8bfe-3de8534debaa None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:53.033347 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b885db93-7a70-46a3-8bfe-3de8534debaa None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:53.033825 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b885db93-7a70-46a3-8bfe-3de8534debaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:53.054947 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-b885db93-7a70-46a3-8bfe-3de8534debaa None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:53.056624 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b885db93-7a70-46a3-8bfe-3de8534debaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:53.083365 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bec26df-e672-4649-bec3-0f19b3c1fb51 service swift] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:53.091837 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3148/6336] 10.222.0.52 () {58 vars in 1009 bytes} [Sat May 14 21:34:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:53.098689 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bec26df-e672-4649-bec3-0f19b3c1fb51 service swift] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:53.106796 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e06fd99-1ee2-4faf-bfdd-93512c6f782c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:53.107920 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06fd99-1ee2-4faf-bfdd-93512c6f782c service swift] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:53.108396 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06fd99-1ee2-4faf-bfdd-93512c6f782c service swift] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:53.108999 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06fd99-1ee2-4faf-bfdd-93512c6f782c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:53.120798 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e06fd99-1ee2-4faf-bfdd-93512c6f782c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:53.126298 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e06fd99-1ee2-4faf-bfdd-93512c6f782c service swift] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:53.141420 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3189/6337] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 21:34:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 21:34:54.242100 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed13f11-c2fe-4c23-87b3-6f9a14d8e4a1 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:54.243937 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed13f11-c2fe-4c23-87b3-6f9a14d8e4a1 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:54.245265 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed13f11-c2fe-4c23-87b3-6f9a14d8e4a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:54.281386 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-5ed13f11-c2fe-4c23-87b3-6f9a14d8e4a1 None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:54.282812 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-5ed13f11-c2fe-4c23-87b3-6f9a14d8e4a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:54.301180 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3149/6338] 10.222.0.52 () {58 vars in 1009 bytes} [Sat May 14 21:34:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:54.314943 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e06fd99-1ee2-4faf-bfdd-93512c6f782c service swift] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:54.342175 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e06fd99-1ee2-4faf-bfdd-93512c6f782c service swift] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:54.347662 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ab429-6fc2-45c2-b33d-76d9afa15c2d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:54.349286 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ab429-6fc2-45c2-b33d-76d9afa15c2d service swift] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:54.349286 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ab429-6fc2-45c2-b33d-76d9afa15c2d service swift] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:54.349286 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ab429-6fc2-45c2-b33d-76d9afa15c2d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:54.359046 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194ab429-6fc2-45c2-b33d-76d9afa15c2d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:54.360735 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194ab429-6fc2-45c2-b33d-76d9afa15c2d service swift] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:54.371298 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3190/6339] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 21:34:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 21:34:54.955446 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89155d76-7082-4d5a-a531-49d012c8f620 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:54.955765 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89155d76-7082-4d5a-a531-49d012c8f620 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:54.956134 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89155d76-7082-4d5a-a531-49d012c8f620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:54.992233 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-89155d76-7082-4d5a-a531-49d012c8f620 None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:54.995636 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-89155d76-7082-4d5a-a531-49d012c8f620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:55.022615 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3150/6340] 10.222.0.52 () {58 vars in 1009 bytes} [Sat May 14 21:34:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:55.047639 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ab429-6fc2-45c2-b33d-76d9afa15c2d service swift] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:55.064641 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ab429-6fc2-45c2-b33d-76d9afa15c2d service swift] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:55.091433 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b059717-5162-46f0-88ad-f71e5dd4887a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:55.095280 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b059717-5162-46f0-88ad-f71e5dd4887a service swift] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:55.095686 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b059717-5162-46f0-88ad-f71e5dd4887a service swift] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:55.095974 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b059717-5162-46f0-88ad-f71e5dd4887a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:55.133200 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b059717-5162-46f0-88ad-f71e5dd4887a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:55.135558 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b059717-5162-46f0-88ad-f71e5dd4887a service swift] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:55.158128 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3191/6341] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 21:34:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 21:34:56.207447 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee8e2a-4534-4dec-acaa-87910528111d None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:56.207447 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee8e2a-4534-4dec-acaa-87910528111d None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:56.207447 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee8e2a-4534-4dec-acaa-87910528111d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:56.239363 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-cbee8e2a-4534-4dec-acaa-87910528111d None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:56.241382 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-cbee8e2a-4534-4dec-acaa-87910528111d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:56.252885 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3151/6342] 10.222.0.52 () {58 vars in 967 bytes} [Sat May 14 21:34:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:56.268387 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b059717-5162-46f0-88ad-f71e5dd4887a service swift] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:56.296403 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b059717-5162-46f0-88ad-f71e5dd4887a service swift] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:56.336371 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c03017-4a22-42cc-ae92-7f30ee436411 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:56.337454 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c03017-4a22-42cc-ae92-7f30ee436411 service swift] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:56.337909 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c03017-4a22-42cc-ae92-7f30ee436411 service swift] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:56.339247 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c03017-4a22-42cc-ae92-7f30ee436411 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:56.360001 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c03017-4a22-42cc-ae92-7f30ee436411 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:56.362307 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c03017-4a22-42cc-ae92-7f30ee436411 service swift] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:56.375143 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3192/6343] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 21:34:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 21:34:57.377373 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0278b8-9298-4bc5-bd18-ad4df2929f38 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:57.377913 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0278b8-9298-4bc5-bd18-ad4df2929f38 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:57.377913 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0278b8-9298-4bc5-bd18-ad4df2929f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:57.405421 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-ba0278b8-9298-4bc5-bd18-ad4df2929f38 None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:57.407383 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-ba0278b8-9298-4bc5-bd18-ad4df2929f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:57.419884 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3152/6344] 10.222.0.52 () {58 vars in 967 bytes} [Sat May 14 21:34:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:34:57.439628 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c03017-4a22-42cc-ae92-7f30ee436411 service swift] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:57.468537 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c03017-4a22-42cc-ae92-7f30ee436411 service swift] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:57.470008 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39909953-2fdb-499b-bda1-01911ebf0017 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:57.470891 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39909953-2fdb-499b-bda1-01911ebf0017 service swift] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:57.471335 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39909953-2fdb-499b-bda1-01911ebf0017 service swift] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:57.471823 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39909953-2fdb-499b-bda1-01911ebf0017 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:57.484827 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39909953-2fdb-499b-bda1-01911ebf0017 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:57.486843 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39909953-2fdb-499b-bda1-01911ebf0017 service swift] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:57.518811 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3193/6345] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 21:34:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 21:34:58.196469 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0278b8-9298-4bc5-bd18-ad4df2929f38 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:58.338510 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0278b8-9298-4bc5-bd18-ad4df2929f38 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:58.348670 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade1501-14a6-4f25-b92c-3b9a5aa19006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:58.350582 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade1501-14a6-4f25-b92c-3b9a5aa19006 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:58.351127 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade1501-14a6-4f25-b92c-3b9a5aa19006 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:58.351673 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade1501-14a6-4f25-b92c-3b9a5aa19006 admin admin] PATH_INFO: `/v3/users/dcda35b0569c43519ee4ffc6edba2d41` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:58.353312 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dade1501-14a6-4f25-b92c-3b9a5aa19006 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcda35b0569c43519ee4ffc6edba2d41)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:58.355644 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dade1501-14a6-4f25-b92c-3b9a5aa19006 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:58.623030 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dade1501-14a6-4f25-b92c-3b9a5aa19006 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcda35b0569c43519ee4ffc6edba2d41'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:58.644589 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dade1501-14a6-4f25-b92c-3b9a5aa19006 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcda35b0569c43519ee4ffc6edba2d41'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:58.648071 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dade1501-14a6-4f25-b92c-3b9a5aa19006 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcda35b0569c43519ee4ffc6edba2d41'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:58.722169 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dade1501-14a6-4f25-b92c-3b9a5aa19006 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcda35b0569c43519ee4ffc6edba2d41'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:58.745731 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dade1501-14a6-4f25-b92c-3b9a5aa19006 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcda35b0569c43519ee4ffc6edba2d41'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:34:58.766531 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3153/6346] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:34:58 2022] DELETE /identity/v3/users/dcda35b0569c43519ee4ffc6edba2d41 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:34:58.768244 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1792d50-8303-4252-bd02-24083ddd5dc1 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:58.769444 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1792d50-8303-4252-bd02-24083ddd5dc1 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:58.769957 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1792d50-8303-4252-bd02-24083ddd5dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:58.840631 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-b1792d50-8303-4252-bd02-24083ddd5dc1 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:34:58.845520 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b1792d50-8303-4252-bd02-24083ddd5dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:58.943065 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3194/6347] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:34:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:34:58.973071 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade1501-14a6-4f25-b92c-3b9a5aa19006 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:58.975619 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-dade1501-14a6-4f25-b92c-3b9a5aa19006 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:59.128857 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade1501-14a6-4f25-b92c-3b9a5aa19006 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:59.144273 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980ad1b5-0b2f-4de2-a836-a970faa098f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:59.145985 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ad1b5-0b2f-4de2-a836-a970faa098f1 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:59.146491 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ad1b5-0b2f-4de2-a836-a970faa098f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:59.147529 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ad1b5-0b2f-4de2-a836-a970faa098f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:59.170341 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980ad1b5-0b2f-4de2-a836-a970faa098f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:59.174365 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980ad1b5-0b2f-4de2-a836-a970faa098f1 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:34:59.198827 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3154/6348] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:34:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:34:59.955698 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1792d50-8303-4252-bd02-24083ddd5dc1 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:34:59.956959 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b1792d50-8303-4252-bd02-24083ddd5dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:34:59.984528 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1792d50-8303-4252-bd02-24083ddd5dc1 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:34:59.992287 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc5fe30-e18b-48cf-a690-59dc71abdd09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:34:59.993344 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5fe30-e18b-48cf-a690-59dc71abdd09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:34:59.993639 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5fe30-e18b-48cf-a690-59dc71abdd09 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:34:59.993915 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5fe30-e18b-48cf-a690-59dc71abdd09 admin admin] PATH_INFO: `/v3/projects/289416fa3e14424cac2db2c12b1c80d1` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:34:59.996455 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc5fe30-e18b-48cf-a690-59dc71abdd09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=289416fa3e14424cac2db2c12b1c80d1)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:34:59.998586 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc5fe30-e18b-48cf-a690-59dc71abdd09 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:35:00.253248 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-7dc5fe30-e18b-48cf-a690-59dc71abdd09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '289416fa3e14424cac2db2c12b1c80d1', 'request_id': 'req-7dc5fe30-e18b-48cf-a690-59dc71abdd09'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:00.260346 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-7dc5fe30-e18b-48cf-a690-59dc71abdd09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '289416fa3e14424cac2db2c12b1c80d1', 'request_id': 'req-7dc5fe30-e18b-48cf-a690-59dc71abdd09'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:00.333440 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-7dc5fe30-e18b-48cf-a690-59dc71abdd09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '289416fa3e14424cac2db2c12b1c80d1', 'request_id': 'req-7dc5fe30-e18b-48cf-a690-59dc71abdd09'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:00.346963 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-7dc5fe30-e18b-48cf-a690-59dc71abdd09 admin admin] The token cache is being invalidate because project 289416fa3e14424cac2db2c12b1c80d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:35:00.347545 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-7dc5fe30-e18b-48cf-a690-59dc71abdd09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:00.348991 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-7dc5fe30-e18b-48cf-a690-59dc71abdd09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:00.350922 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3195/6349] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:34:59 2022] DELETE /identity/v3/projects/289416fa3e14424cac2db2c12b1c80d1 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:35:00.355672 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b44298f-38aa-4eab-8627-2a07095bcc22 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:00.356824 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b44298f-38aa-4eab-8627-2a07095bcc22 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:00.357331 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b44298f-38aa-4eab-8627-2a07095bcc22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:00.385830 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-8b44298f-38aa-4eab-8627-2a07095bcc22 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:35:00.388391 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8b44298f-38aa-4eab-8627-2a07095bcc22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:35:00.479592 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3155/6350] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:35:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:35:00.488256 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaea907-70ec-4950-a208-60564b9aa992 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:00.488875 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaea907-70ec-4950-a208-60564b9aa992 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:00.489490 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaea907-70ec-4950-a208-60564b9aa992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:00.512194 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-2aaea907-70ec-4950-a208-60564b9aa992 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:35:00.513927 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-2aaea907-70ec-4950-a208-60564b9aa992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:35:00.525046 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3196/6351] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:35:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:35:00.542519 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b44298f-38aa-4eab-8627-2a07095bcc22 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:35:00.553335 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b44298f-38aa-4eab-8627-2a07095bcc22 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:35:00.578985 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a9e712-124a-4a10-986c-0a1777376cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:35:00.580240 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9e712-124a-4a10-986c-0a1777376cfd admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:00.580957 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9e712-124a-4a10-986c-0a1777376cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:00.582645 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9e712-124a-4a10-986c-0a1777376cfd admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:00.585472 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a9e712-124a-4a10-986c-0a1777376cfd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:35:00.586440 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a9e712-124a-4a10-986c-0a1777376cfd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:35:00.593083 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a9e712-124a-4a10-986c-0a1777376cfd admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:35:00.617650 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3156/6352] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:35:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:35:00.619817 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaea907-70ec-4950-a208-60564b9aa992 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:35:00.634504 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaea907-70ec-4950-a208-60564b9aa992 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:35:00.640323 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fce109-4e81-46a3-b719-336bfa39c20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:35:00.641281 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fce109-4e81-46a3-b719-336bfa39c20a admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:00.641760 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fce109-4e81-46a3-b719-336bfa39c20a admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:00.642364 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fce109-4e81-46a3-b719-336bfa39c20a admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:00.643585 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fce109-4e81-46a3-b719-336bfa39c20a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:35:00.645744 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fce109-4e81-46a3-b719-336bfa39c20a admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:35:00.770933 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3197/6353] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:35:00 2022] POST /identity/v3/projects => generated 381 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:35:00.776287 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a9e712-124a-4a10-986c-0a1777376cfd admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:35:00.787976 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a9e712-124a-4a10-986c-0a1777376cfd admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:35:00.855384 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a5081a-0b7b-4767-98ad-8515b82455e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:35:00.856281 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a5081a-0b7b-4767-98ad-8515b82455e5 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:00.856798 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a5081a-0b7b-4767-98ad-8515b82455e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:00.857234 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a5081a-0b7b-4767-98ad-8515b82455e5 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:00.858058 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a5081a-0b7b-4767-98ad-8515b82455e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:35:00.860882 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a5081a-0b7b-4767-98ad-8515b82455e5 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:35:00.963147 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3157/6354] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:35:00 2022] POST /identity/v3/users => generated 291 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:35:00.967360 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fce109-4e81-46a3-b719-336bfa39c20a admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:35:00.979970 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fce109-4e81-46a3-b719-336bfa39c20a admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:35:00.985773 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6b9d40-e036-462a-a8ea-b80d59da54be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:35:00.987129 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b9d40-e036-462a-a8ea-b80d59da54be admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:00.987640 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b9d40-e036-462a-a8ea-b80d59da54be admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:00.987923 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b9d40-e036-462a-a8ea-b80d59da54be admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:00.988655 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6b9d40-e036-462a-a8ea-b80d59da54be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:35:00.990285 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6b9d40-e036-462a-a8ea-b80d59da54be admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:35:01.005062 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3198/6355] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:35:00 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:35:01.009175 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a5081a-0b7b-4767-98ad-8515b82455e5 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:35:01.021153 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a5081a-0b7b-4767-98ad-8515b82455e5 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:35:01.028383 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd16099b-ed80-41fc-8609-2ee4604af8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:35:01.029210 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd16099b-ed80-41fc-8609-2ee4604af8b6 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:01.035399 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd16099b-ed80-41fc-8609-2ee4604af8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:01.035399 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd16099b-ed80-41fc-8609-2ee4604af8b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:01.035399 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd16099b-ed80-41fc-8609-2ee4604af8b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:35:01.035399 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd16099b-ed80-41fc-8609-2ee4604af8b6 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:35:01.044037 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3158/6356] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:35:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:35:01.048377 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6b9d40-e036-462a-a8ea-b80d59da54be admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:35:01.059445 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6b9d40-e036-462a-a8ea-b80d59da54be admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:35:01.066139 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74be76e-9cc2-4b1b-b0fc-6695b6d67c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:35:01.067021 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74be76e-9cc2-4b1b-b0fc-6695b6d67c7d admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:01.067307 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74be76e-9cc2-4b1b-b0fc-6695b6d67c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:01.067611 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74be76e-9cc2-4b1b-b0fc-6695b6d67c7d admin admin] PATH_INFO: `/v3/projects/122b28d20a6441228c557d18558267c0/users/c6b5d351d04b41a38987822931a4f4b0/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:01.086001 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74be76e-9cc2-4b1b-b0fc-6695b6d67c7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=122b28d20a6441228c557d18558267c0, user_id=c6b5d351d04b41a38987822931a4f4b0, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:35:01.089197 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74be76e-9cc2-4b1b-b0fc-6695b6d67c7d admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:35:01.202396 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3199/6357] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:35:01 2022] PUT /identity/v3/projects/122b28d20a6441228c557d18558267c0/users/c6b5d351d04b41a38987822931a4f4b0/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:35:01.216055 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a53cf-6515-4515-bd00-1cc41ed1f77d None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:01.216343 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a53cf-6515-4515-bd00-1cc41ed1f77d None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:01.216623 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a53cf-6515-4515-bd00-1cc41ed1f77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:01.251264 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-b33a53cf-6515-4515-bd00-1cc41ed1f77d None None] MFA Rules not processed for user `c6b5d351d04b41a38987822931a4f4b0`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:35:01.253075 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b33a53cf-6515-4515-bd00-1cc41ed1f77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:35:01.364974 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3159/6358] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:35:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:35:01.379468 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74be76e-9cc2-4b1b-b0fc-6695b6d67c7d admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:35:01.382162 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-f74be76e-9cc2-4b1b-b0fc-6695b6d67c7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:35:01.473859 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74be76e-9cc2-4b1b-b0fc-6695b6d67c7d admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:35:01.479726 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855aa2d2-801c-4557-a56c-3f68365f06ba service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b5cb86f190f4fcfb06d66cb8f14643f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:35:01.480546 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855aa2d2-801c-4557-a56c-3f68365f06ba service glance] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:01.480955 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855aa2d2-801c-4557-a56c-3f68365f06ba service glance] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:01.481465 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855aa2d2-801c-4557-a56c-3f68365f06ba service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:01.494083 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855aa2d2-801c-4557-a56c-3f68365f06ba service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:35:01.498658 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855aa2d2-801c-4557-a56c-3f68365f06ba service glance] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:35:01.507184 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3200/6359] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:35:01 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:35:02.062616 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33a53cf-6515-4515-bd00-1cc41ed1f77d None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:35:02.164690 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33a53cf-6515-4515-bd00-1cc41ed1f77d None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:35:02.170060 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d6d7fa-1d19-4cb0-8684-67a17ede38f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:35:02.171424 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6d7fa-1d19-4cb0-8684-67a17ede38f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:02.171951 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6d7fa-1d19-4cb0-8684-67a17ede38f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:02.172438 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6d7fa-1d19-4cb0-8684-67a17ede38f6 admin admin] PATH_INFO: `/v3/users/c6b5d351d04b41a38987822931a4f4b0` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:02.173894 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d6d7fa-1d19-4cb0-8684-67a17ede38f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6b5d351d04b41a38987822931a4f4b0)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:35:02.176082 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d6d7fa-1d19-4cb0-8684-67a17ede38f6 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:35:02.531445 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-98d6d7fa-1d19-4cb0-8684-67a17ede38f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6b5d351d04b41a38987822931a4f4b0'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:02.543252 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-98d6d7fa-1d19-4cb0-8684-67a17ede38f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6b5d351d04b41a38987822931a4f4b0'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:02.544441 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-98d6d7fa-1d19-4cb0-8684-67a17ede38f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6b5d351d04b41a38987822931a4f4b0'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:02.668183 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-98d6d7fa-1d19-4cb0-8684-67a17ede38f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6b5d351d04b41a38987822931a4f4b0'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:02.694224 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-98d6d7fa-1d19-4cb0-8684-67a17ede38f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6b5d351d04b41a38987822931a4f4b0'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:02.703441 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3160/6360] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:35:02 2022] DELETE /identity/v3/users/c6b5d351d04b41a38987822931a4f4b0 => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:35:02.707730 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a07440-2387-4cd0-8008-04761fbc27d7 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:02.708747 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a07440-2387-4cd0-8008-04761fbc27d7 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:02.713709 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a07440-2387-4cd0-8008-04761fbc27d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:02.729986 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-69a07440-2387-4cd0-8008-04761fbc27d7 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:35:02.731697 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-69a07440-2387-4cd0-8008-04761fbc27d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:35:02.826402 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3201/6361] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:35:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:35:02.899216 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d6d7fa-1d19-4cb0-8684-67a17ede38f6 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:35:02.901839 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-98d6d7fa-1d19-4cb0-8684-67a17ede38f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:35:02.996332 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d6d7fa-1d19-4cb0-8684-67a17ede38f6 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:35:03.000643 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679b59e8-4fae-4287-8839-443295754929 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:35:03.003874 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b59e8-4fae-4287-8839-443295754929 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:03.003874 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b59e8-4fae-4287-8839-443295754929 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:03.003874 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b59e8-4fae-4287-8839-443295754929 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:03.013638 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679b59e8-4fae-4287-8839-443295754929 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:35:03.015323 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679b59e8-4fae-4287-8839-443295754929 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:35:03.033129 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3161/6362] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:35:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:35:04.001087 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a07440-2387-4cd0-8008-04761fbc27d7 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:35:04.004737 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-69a07440-2387-4cd0-8008-04761fbc27d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:35:04.032171 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a07440-2387-4cd0-8008-04761fbc27d7 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:35:04.044843 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dd69f4-732c-4fc1-80ee-110cd276c5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:35:04.046514 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd69f4-732c-4fc1-80ee-110cd276c5ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:04.046803 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd69f4-732c-4fc1-80ee-110cd276c5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:04.047109 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd69f4-732c-4fc1-80ee-110cd276c5ee admin admin] PATH_INFO: `/v3/projects/122b28d20a6441228c557d18558267c0` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:04.050182 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dd69f4-732c-4fc1-80ee-110cd276c5ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=122b28d20a6441228c557d18558267c0)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:35:04.058487 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dd69f4-732c-4fc1-80ee-110cd276c5ee admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:35:04.287603 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-53dd69f4-732c-4fc1-80ee-110cd276c5ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '122b28d20a6441228c557d18558267c0', 'request_id': 'req-53dd69f4-732c-4fc1-80ee-110cd276c5ee'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:04.293865 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-53dd69f4-732c-4fc1-80ee-110cd276c5ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '122b28d20a6441228c557d18558267c0', 'request_id': 'req-53dd69f4-732c-4fc1-80ee-110cd276c5ee'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:04.398284 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-53dd69f4-732c-4fc1-80ee-110cd276c5ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '122b28d20a6441228c557d18558267c0', 'request_id': 'req-53dd69f4-732c-4fc1-80ee-110cd276c5ee'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:04.410431 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-53dd69f4-732c-4fc1-80ee-110cd276c5ee admin admin] The token cache is being invalidate because project 122b28d20a6441228c557d18558267c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:35:04.411028 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-53dd69f4-732c-4fc1-80ee-110cd276c5ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:04.411841 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-53dd69f4-732c-4fc1-80ee-110cd276c5ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:04.415168 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3202/6363] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:35:03 2022] DELETE /identity/v3/projects/122b28d20a6441228c557d18558267c0 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:35:04.420713 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91ae8c-938a-4be1-a771-27436e5deefa None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:04.421620 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91ae8c-938a-4be1-a771-27436e5deefa None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:04.422226 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91ae8c-938a-4be1-a771-27436e5deefa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:04.452202 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-4c91ae8c-938a-4be1-a771-27436e5deefa None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:35:04.461637 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-4c91ae8c-938a-4be1-a771-27436e5deefa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:35:04.604160 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3162/6364] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:35:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:35:04.613053 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a429d-a9af-41c3-ba8b-48749cb6c9a3 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:04.617298 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a429d-a9af-41c3-ba8b-48749cb6c9a3 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:04.617298 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a429d-a9af-41c3-ba8b-48749cb6c9a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:04.665023 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-ed8a429d-a9af-41c3-ba8b-48749cb6c9a3 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:35:04.681590 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ed8a429d-a9af-41c3-ba8b-48749cb6c9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:35:04.705824 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3203/6365] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:35:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:35:04.710678 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c91ae8c-938a-4be1-a771-27436e5deefa None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:35:04.727313 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c91ae8c-938a-4be1-a771-27436e5deefa None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:35:04.734911 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5caa88-0b7e-45a7-9383-390914e93509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:35:04.735940 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5caa88-0b7e-45a7-9383-390914e93509 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:04.736407 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5caa88-0b7e-45a7-9383-390914e93509 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:04.736847 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5caa88-0b7e-45a7-9383-390914e93509 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:04.738016 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5caa88-0b7e-45a7-9383-390914e93509 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:35:04.738545 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5caa88-0b7e-45a7-9383-390914e93509 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:35:04.741670 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5caa88-0b7e-45a7-9383-390914e93509 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:35:04.791468 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3163/6366] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:35:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:35:04.793145 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8a429d-a9af-41c3-ba8b-48749cb6c9a3 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:35:04.818174 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8a429d-a9af-41c3-ba8b-48749cb6c9a3 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:35:04.840715 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273a2157-c747-4016-b681-e242facc2c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:35:04.840715 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a2157-c747-4016-b681-e242facc2c06 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:04.840715 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a2157-c747-4016-b681-e242facc2c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:04.840715 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a2157-c747-4016-b681-e242facc2c06 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:04.841152 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273a2157-c747-4016-b681-e242facc2c06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:35:04.841152 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273a2157-c747-4016-b681-e242facc2c06 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:35:04.978046 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3204/6367] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:35:04 2022] POST /identity/v3/projects => generated 409 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:35:04.979212 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5caa88-0b7e-45a7-9383-390914e93509 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:35:04.996234 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5caa88-0b7e-45a7-9383-390914e93509 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:35:05.091669 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26adb97-474b-4465-a9ab-8ea00b6d426e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:35:05.091669 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26adb97-474b-4465-a9ab-8ea00b6d426e admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:05.091669 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26adb97-474b-4465-a9ab-8ea00b6d426e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:05.091669 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26adb97-474b-4465-a9ab-8ea00b6d426e admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:05.092079 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26adb97-474b-4465-a9ab-8ea00b6d426e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:35:05.104129 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26adb97-474b-4465-a9ab-8ea00b6d426e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:35:05.287019 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3164/6368] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:35:04 2022] POST /identity/v3/users => generated 305 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:35:05.289647 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273a2157-c747-4016-b681-e242facc2c06 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:35:05.305486 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273a2157-c747-4016-b681-e242facc2c06 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:35:05.327608 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13417126-25ec-45c1-91e5-29139d97058d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:35:05.339788 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13417126-25ec-45c1-91e5-29139d97058d admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:05.340193 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13417126-25ec-45c1-91e5-29139d97058d admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:05.340586 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13417126-25ec-45c1-91e5-29139d97058d admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:05.343664 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13417126-25ec-45c1-91e5-29139d97058d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:35:05.347721 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13417126-25ec-45c1-91e5-29139d97058d admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:35:05.413498 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3205/6369] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:35:05 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:35:05.416109 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26adb97-474b-4465-a9ab-8ea00b6d426e admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:35:05.429607 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26adb97-474b-4465-a9ab-8ea00b6d426e admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:35:05.453087 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c485b15b-d4ae-40d0-9d75-ab4d1e9a656c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:35:05.453087 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485b15b-d4ae-40d0-9d75-ab4d1e9a656c admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:05.457902 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485b15b-d4ae-40d0-9d75-ab4d1e9a656c admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:05.457902 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485b15b-d4ae-40d0-9d75-ab4d1e9a656c admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:05.457902 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c485b15b-d4ae-40d0-9d75-ab4d1e9a656c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:35:05.462266 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c485b15b-d4ae-40d0-9d75-ab4d1e9a656c admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:35:05.501645 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3165/6370] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:35:05 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:35:05.503361 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13417126-25ec-45c1-91e5-29139d97058d admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:35:05.507869 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139d4a5-c2fe-4673-bab2-156055e28b9d None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:05.508419 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139d4a5-c2fe-4673-bab2-156055e28b9d None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:05.508918 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139d4a5-c2fe-4673-bab2-156055e28b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:05.517555 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13417126-25ec-45c1-91e5-29139d97058d admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:35:05.532465 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-b139d4a5-c2fe-4673-bab2-156055e28b9d None None] MFA Rules not processed for user `a8e967d05266477dbc5748ed77b8c69e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:35:05.534115 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b139d4a5-c2fe-4673-bab2-156055e28b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:35:05.541182 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ba500-3770-41f0-94e5-5e093148ad63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:35:05.543350 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ba500-3770-41f0-94e5-5e093148ad63 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:05.554778 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ba500-3770-41f0-94e5-5e093148ad63 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:05.555170 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ba500-3770-41f0-94e5-5e093148ad63 admin admin] PATH_INFO: `/v3/projects/f78ef912a3794e5ba44fa30fe40bde74/users/f4ffaa86a8b04280b7b776b2238e216f/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:05.622075 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3166/6371] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:35:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:35:05.629763 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02ba500-3770-41f0-94e5-5e093148ad63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f78ef912a3794e5ba44fa30fe40bde74, user_id=f4ffaa86a8b04280b7b776b2238e216f, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:35:05.632982 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02ba500-3770-41f0-94e5-5e093148ad63 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:35:05.746199 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3206/6372] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:35:05 2022] PUT /identity/v3/projects/f78ef912a3794e5ba44fa30fe40bde74/users/f4ffaa86a8b04280b7b776b2238e216f/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:35:05.758365 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c15fe-c8fa-4b0a-90d8-ca82066ce105 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:05.758802 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c15fe-c8fa-4b0a-90d8-ca82066ce105 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:05.759387 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c15fe-c8fa-4b0a-90d8-ca82066ce105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:05.805603 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-2d5c15fe-c8fa-4b0a-90d8-ca82066ce105 None None] MFA Rules not processed for user `f4ffaa86a8b04280b7b776b2238e216f`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:35:05.808222 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-2d5c15fe-c8fa-4b0a-90d8-ca82066ce105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:35:05.916690 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ba500-3770-41f0-94e5-5e093148ad63 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:35:05.919512 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3167/6373] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:35:05 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:35:06.008003 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ba500-3770-41f0-94e5-5e093148ad63 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:35:06.014502 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e321e93-5d2c-4115-8019-3feab01155f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:35:06.015610 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e321e93-5d2c-4115-8019-3feab01155f3 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:06.016141 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e321e93-5d2c-4115-8019-3feab01155f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:06.016639 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e321e93-5d2c-4115-8019-3feab01155f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:06.017559 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e321e93-5d2c-4115-8019-3feab01155f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:35:06.020673 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e321e93-5d2c-4115-8019-3feab01155f3 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:35:06.162066 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3207/6374] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:35:05 2022] POST /identity/v3/projects => generated 411 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:35:06.167146 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5c15fe-c8fa-4b0a-90d8-ca82066ce105 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:35:06.187054 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5c15fe-c8fa-4b0a-90d8-ca82066ce105 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:35:06.326032 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e7b2c-ac45-47cd-9e26-28da13a6fe92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:35:06.327052 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e7b2c-ac45-47cd-9e26-28da13a6fe92 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:06.327416 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e7b2c-ac45-47cd-9e26-28da13a6fe92 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:06.327872 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e7b2c-ac45-47cd-9e26-28da13a6fe92 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:06.328709 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5e7b2c-ac45-47cd-9e26-28da13a6fe92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:35:06.330946 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5e7b2c-ac45-47cd-9e26-28da13a6fe92 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:35:06.513084 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3168/6375] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:35:06 2022] POST /identity/v3/users => generated 312 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:35:06.517171 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e321e93-5d2c-4115-8019-3feab01155f3 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:35:06.531025 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e321e93-5d2c-4115-8019-3feab01155f3 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:35:06.546112 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8832a3-f9e9-43f4-99fa-d519cec00017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:35:06.546810 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8832a3-f9e9-43f4-99fa-d519cec00017 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:06.547095 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8832a3-f9e9-43f4-99fa-d519cec00017 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:06.547507 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8832a3-f9e9-43f4-99fa-d519cec00017 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:06.548452 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8832a3-f9e9-43f4-99fa-d519cec00017 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:35:06.550162 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8832a3-f9e9-43f4-99fa-d519cec00017 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:35:06.577736 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3208/6376] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:35:06 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:35:06.581548 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e7b2c-ac45-47cd-9e26-28da13a6fe92 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:35:06.592936 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e7b2c-ac45-47cd-9e26-28da13a6fe92 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:35:06.613640 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9435019-2a0b-4fbc-9005-bee117f15e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:35:06.614565 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9435019-2a0b-4fbc-9005-bee117f15e3a admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:06.614852 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9435019-2a0b-4fbc-9005-bee117f15e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:06.615135 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9435019-2a0b-4fbc-9005-bee117f15e3a admin admin] PATH_INFO: `/v3/projects/885fcccf08f84a09978e51ceccdca374/users/9e5fad07154a4d6aaaba2f911a02d3e8/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:06.650851 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9435019-2a0b-4fbc-9005-bee117f15e3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=885fcccf08f84a09978e51ceccdca374, user_id=9e5fad07154a4d6aaaba2f911a02d3e8, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:35:06.653608 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9435019-2a0b-4fbc-9005-bee117f15e3a admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:35:06.793955 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3169/6377] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:35:06 2022] PUT /identity/v3/projects/885fcccf08f84a09978e51ceccdca374/users/9e5fad07154a4d6aaaba2f911a02d3e8/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:35:06.794920 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8832a3-f9e9-43f4-99fa-d519cec00017 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:35:06.807656 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8832a3-f9e9-43f4-99fa-d519cec00017 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:35:06.914251 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b54ea5-9043-4c5c-802d-120e0ef1b4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:35:06.915365 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b54ea5-9043-4c5c-802d-120e0ef1b4a9 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:06.915915 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b54ea5-9043-4c5c-802d-120e0ef1b4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:06.916786 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b54ea5-9043-4c5c-802d-120e0ef1b4a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:06.921151 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b54ea5-9043-4c5c-802d-120e0ef1b4a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:35:06.925647 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b54ea5-9043-4c5c-802d-120e0ef1b4a9 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:35:06.955958 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3209/6378] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:35:06 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:35:06.963073 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9435019-2a0b-4fbc-9005-bee117f15e3a admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:35:06.991071 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9435019-2a0b-4fbc-9005-bee117f15e3a admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:35:07.035718 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd1b9df-9bc1-4247-80dd-3c2899836a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:35:07.036627 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1b9df-9bc1-4247-80dd-3c2899836a8e admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:07.038539 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1b9df-9bc1-4247-80dd-3c2899836a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:07.041717 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1b9df-9bc1-4247-80dd-3c2899836a8e admin admin] PATH_INFO: `/v3/projects/885fcccf08f84a09978e51ceccdca374/users/9e5fad07154a4d6aaaba2f911a02d3e8/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:07.049843 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd1b9df-9bc1-4247-80dd-3c2899836a8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=885fcccf08f84a09978e51ceccdca374, user_id=9e5fad07154a4d6aaaba2f911a02d3e8, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:35:07.059593 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd1b9df-9bc1-4247-80dd-3c2899836a8e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:35:07.080563 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3170/6379] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:35:06 2022] PUT /identity/v3/projects/885fcccf08f84a09978e51ceccdca374/users/9e5fad07154a4d6aaaba2f911a02d3e8/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:35:07.094863 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d6462-77c8-4801-bf56-8c54145e7695 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:07.095224 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d6462-77c8-4801-bf56-8c54145e7695 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:07.097306 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d6462-77c8-4801-bf56-8c54145e7695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:07.169532 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-a16d6462-77c8-4801-bf56-8c54145e7695 None None] MFA Rules not processed for user `9e5fad07154a4d6aaaba2f911a02d3e8`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:35:07.171209 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-a16d6462-77c8-4801-bf56-8c54145e7695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:35:07.437601 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3210/6380] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:35:07 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:35:07.457792 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd1b9df-9bc1-4247-80dd-3c2899836a8e admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:35:07.459796 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-9dd1b9df-9bc1-4247-80dd-3c2899836a8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:35:07.550412 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd1b9df-9bc1-4247-80dd-3c2899836a8e admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:35:07.555813 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482a48b0-ec69-4676-9d70-870a0fb482e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:35:07.556583 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a48b0-ec69-4676-9d70-870a0fb482e7 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:07.556938 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a48b0-ec69-4676-9d70-870a0fb482e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:07.557344 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a48b0-ec69-4676-9d70-870a0fb482e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:07.567581 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482a48b0-ec69-4676-9d70-870a0fb482e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:35:07.569950 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482a48b0-ec69-4676-9d70-870a0fb482e7 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:35:07.580703 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3171/6381] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:35:07 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:35:13.806865 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16d6462-77c8-4801-bf56-8c54145e7695 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:35:13.900128 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16d6462-77c8-4801-bf56-8c54145e7695 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:35:13.929321 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae52ec6-1539-4939-bb66-88e4d0c7927a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:35:13.932193 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae52ec6-1539-4939-bb66-88e4d0c7927a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:13.933760 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae52ec6-1539-4939-bb66-88e4d0c7927a admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:13.936039 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae52ec6-1539-4939-bb66-88e4d0c7927a admin admin] PATH_INFO: `/v3/users/f4ffaa86a8b04280b7b776b2238e216f` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:13.939204 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae52ec6-1539-4939-bb66-88e4d0c7927a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4ffaa86a8b04280b7b776b2238e216f)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:35:13.966205 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae52ec6-1539-4939-bb66-88e4d0c7927a admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:35:14.247823 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-1ae52ec6-1539-4939-bb66-88e4d0c7927a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4ffaa86a8b04280b7b776b2238e216f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:14.269503 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-1ae52ec6-1539-4939-bb66-88e4d0c7927a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4ffaa86a8b04280b7b776b2238e216f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:14.289565 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-1ae52ec6-1539-4939-bb66-88e4d0c7927a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4ffaa86a8b04280b7b776b2238e216f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:14.371161 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-1ae52ec6-1539-4939-bb66-88e4d0c7927a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4ffaa86a8b04280b7b776b2238e216f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:14.372072 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-1ae52ec6-1539-4939-bb66-88e4d0c7927a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4ffaa86a8b04280b7b776b2238e216f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:14.381430 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3211/6382] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:35:13 2022] DELETE /identity/v3/users/f4ffaa86a8b04280b7b776b2238e216f => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:35:14.387651 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ff4f87-7f8a-4b9c-9914-f705ce0c78b7 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:14.388241 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ff4f87-7f8a-4b9c-9914-f705ce0c78b7 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:14.388505 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ff4f87-7f8a-4b9c-9914-f705ce0c78b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:14.428478 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-10ff4f87-7f8a-4b9c-9914-f705ce0c78b7 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:35:14.432191 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-10ff4f87-7f8a-4b9c-9914-f705ce0c78b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:35:14.579125 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3172/6383] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:35:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:35:14.579661 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae52ec6-1539-4939-bb66-88e4d0c7927a admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:35:14.581136 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-1ae52ec6-1539-4939-bb66-88e4d0c7927a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:35:14.697988 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae52ec6-1539-4939-bb66-88e4d0c7927a admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:35:14.702051 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe480f60-6565-482a-a0a6-0ccf012642eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:35:14.702710 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe480f60-6565-482a-a0a6-0ccf012642eb service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:14.702996 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe480f60-6565-482a-a0a6-0ccf012642eb service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:14.707425 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe480f60-6565-482a-a0a6-0ccf012642eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:14.713883 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe480f60-6565-482a-a0a6-0ccf012642eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:35:14.715348 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe480f60-6565-482a-a0a6-0ccf012642eb service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:35:14.725110 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3212/6384] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:35:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:35:15.839347 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ff4f87-7f8a-4b9c-9914-f705ce0c78b7 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:35:15.841978 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-10ff4f87-7f8a-4b9c-9914-f705ce0c78b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:35:15.862942 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ff4f87-7f8a-4b9c-9914-f705ce0c78b7 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:35:15.878402 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c7f3d1-fed6-4afa-874e-951f1d98cd54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:35:15.879287 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c7f3d1-fed6-4afa-874e-951f1d98cd54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:15.883945 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c7f3d1-fed6-4afa-874e-951f1d98cd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:15.884191 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c7f3d1-fed6-4afa-874e-951f1d98cd54 admin admin] PATH_INFO: `/v3/projects/f78ef912a3794e5ba44fa30fe40bde74` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:15.890549 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c7f3d1-fed6-4afa-874e-951f1d98cd54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f78ef912a3794e5ba44fa30fe40bde74)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:35:15.892668 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c7f3d1-fed6-4afa-874e-951f1d98cd54 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:35:16.145047 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-26c7f3d1-fed6-4afa-874e-951f1d98cd54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f78ef912a3794e5ba44fa30fe40bde74', 'request_id': 'req-26c7f3d1-fed6-4afa-874e-951f1d98cd54'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:16.157131 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-26c7f3d1-fed6-4afa-874e-951f1d98cd54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f78ef912a3794e5ba44fa30fe40bde74', 'request_id': 'req-26c7f3d1-fed6-4afa-874e-951f1d98cd54'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:16.190319 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-26c7f3d1-fed6-4afa-874e-951f1d98cd54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f78ef912a3794e5ba44fa30fe40bde74', 'request_id': 'req-26c7f3d1-fed6-4afa-874e-951f1d98cd54'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:16.300886 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-26c7f3d1-fed6-4afa-874e-951f1d98cd54 admin admin] The token cache is being invalidate because project f78ef912a3794e5ba44fa30fe40bde74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:35:16.301654 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-26c7f3d1-fed6-4afa-874e-951f1d98cd54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:16.303375 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-26c7f3d1-fed6-4afa-874e-951f1d98cd54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:16.305894 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3173/6385] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:35:15 2022] DELETE /identity/v3/projects/f78ef912a3794e5ba44fa30fe40bde74 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:35:16.309802 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe480f60-6565-482a-a0a6-0ccf012642eb service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:35:16.322499 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe480f60-6565-482a-a0a6-0ccf012642eb service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:35:16.399375 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d1dff8-d9f6-4989-86e2-4cd4e7f16fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:35:16.400724 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d1dff8-d9f6-4989-86e2-4cd4e7f16fe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:16.401230 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d1dff8-d9f6-4989-86e2-4cd4e7f16fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:16.401754 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d1dff8-d9f6-4989-86e2-4cd4e7f16fe9 admin admin] PATH_INFO: `/v3/users/9e5fad07154a4d6aaaba2f911a02d3e8` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:16.403277 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d1dff8-d9f6-4989-86e2-4cd4e7f16fe9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e5fad07154a4d6aaaba2f911a02d3e8)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:35:16.405732 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d1dff8-d9f6-4989-86e2-4cd4e7f16fe9 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:35:16.718383 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-01d1dff8-d9f6-4989-86e2-4cd4e7f16fe9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e5fad07154a4d6aaaba2f911a02d3e8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:16.770129 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-01d1dff8-d9f6-4989-86e2-4cd4e7f16fe9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e5fad07154a4d6aaaba2f911a02d3e8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:16.780666 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-01d1dff8-d9f6-4989-86e2-4cd4e7f16fe9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e5fad07154a4d6aaaba2f911a02d3e8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:16.882137 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-01d1dff8-d9f6-4989-86e2-4cd4e7f16fe9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e5fad07154a4d6aaaba2f911a02d3e8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:16.883051 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-01d1dff8-d9f6-4989-86e2-4cd4e7f16fe9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e5fad07154a4d6aaaba2f911a02d3e8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:16.893560 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3213/6386] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:35:16 2022] DELETE /identity/v3/users/9e5fad07154a4d6aaaba2f911a02d3e8 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:35:17.716769 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c7f3d1-fed6-4afa-874e-951f1d98cd54 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:35:17.718271 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-26c7f3d1-fed6-4afa-874e-951f1d98cd54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:35:17.743284 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c7f3d1-fed6-4afa-874e-951f1d98cd54 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:35:17.846830 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b8de7e-37ef-47b5-aaae-e4bcdf4b568a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:35:17.848052 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b8de7e-37ef-47b5-aaae-e4bcdf4b568a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:17.848529 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b8de7e-37ef-47b5-aaae-e4bcdf4b568a admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:17.848966 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b8de7e-37ef-47b5-aaae-e4bcdf4b568a admin admin] PATH_INFO: `/v3/projects/885fcccf08f84a09978e51ceccdca374` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:17.852408 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b8de7e-37ef-47b5-aaae-e4bcdf4b568a admin admin] RBAC: Authorizing `identity:delete_project(project_id=885fcccf08f84a09978e51ceccdca374)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:35:17.855278 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b8de7e-37ef-47b5-aaae-e4bcdf4b568a admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:35:18.081306 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-41b8de7e-37ef-47b5-aaae-e4bcdf4b568a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '885fcccf08f84a09978e51ceccdca374', 'request_id': 'req-41b8de7e-37ef-47b5-aaae-e4bcdf4b568a'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:18.092002 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-41b8de7e-37ef-47b5-aaae-e4bcdf4b568a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '885fcccf08f84a09978e51ceccdca374', 'request_id': 'req-41b8de7e-37ef-47b5-aaae-e4bcdf4b568a'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:18.101224 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-41b8de7e-37ef-47b5-aaae-e4bcdf4b568a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '885fcccf08f84a09978e51ceccdca374', 'request_id': 'req-41b8de7e-37ef-47b5-aaae-e4bcdf4b568a'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:18.269139 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-41b8de7e-37ef-47b5-aaae-e4bcdf4b568a admin admin] The token cache is being invalidate because project 885fcccf08f84a09978e51ceccdca374 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:35:18.269819 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-41b8de7e-37ef-47b5-aaae-e4bcdf4b568a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:18.270768 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-41b8de7e-37ef-47b5-aaae-e4bcdf4b568a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:18.272981 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3174/6387] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:35:17 2022] DELETE /identity/v3/projects/885fcccf08f84a09978e51ceccdca374 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:35:18.279231 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d17e0-98c1-45ac-a5e0-d021d4bde1bd None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:18.279773 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d17e0-98c1-45ac-a5e0-d021d4bde1bd None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:18.279856 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d17e0-98c1-45ac-a5e0-d021d4bde1bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:18.313188 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-c19d17e0-98c1-45ac-a5e0-d021d4bde1bd None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:35:18.314552 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c19d17e0-98c1-45ac-a5e0-d021d4bde1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:35:18.482568 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3214/6388] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:35:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:35:18.491307 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b03575-e2ff-4860-805a-7570302aef2c None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:18.491586 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b03575-e2ff-4860-805a-7570302aef2c None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:18.491800 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b03575-e2ff-4860-805a-7570302aef2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:18.518310 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-78b03575-e2ff-4860-805a-7570302aef2c None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:35:18.519856 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-78b03575-e2ff-4860-805a-7570302aef2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:35:18.533924 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3175/6389] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:35:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:35:18.534718 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19d17e0-98c1-45ac-a5e0-d021d4bde1bd None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:35:18.546507 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19d17e0-98c1-45ac-a5e0-d021d4bde1bd None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:35:18.552049 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f1ed63-7892-45c6-b478-8ca83c85aeba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:35:18.553343 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f1ed63-7892-45c6-b478-8ca83c85aeba admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:18.553789 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f1ed63-7892-45c6-b478-8ca83c85aeba admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:18.554643 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f1ed63-7892-45c6-b478-8ca83c85aeba admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:18.555395 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f1ed63-7892-45c6-b478-8ca83c85aeba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:35:18.555745 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f1ed63-7892-45c6-b478-8ca83c85aeba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:35:18.557732 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f1ed63-7892-45c6-b478-8ca83c85aeba admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:35:18.575443 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b03575-e2ff-4860-805a-7570302aef2c None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:35:18.581762 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3215/6390] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:35:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:35:18.586525 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b03575-e2ff-4860-805a-7570302aef2c None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:35:18.591436 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fdde85-5db1-4063-9285-1126b8a594cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:35:18.592405 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fdde85-5db1-4063-9285-1126b8a594cd admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:18.592698 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fdde85-5db1-4063-9285-1126b8a594cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:18.592976 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fdde85-5db1-4063-9285-1126b8a594cd admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:18.594062 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fdde85-5db1-4063-9285-1126b8a594cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:35:18.596318 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fdde85-5db1-4063-9285-1126b8a594cd admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:35:18.726105 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3176/6391] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:35:18 2022] POST /identity/v3/projects => generated 385 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:35:18.730200 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f1ed63-7892-45c6-b478-8ca83c85aeba admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:35:18.752288 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f1ed63-7892-45c6-b478-8ca83c85aeba admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:35:18.825199 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe52bcd4-bd96-46c4-b44e-b30231f83222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:35:18.826096 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe52bcd4-bd96-46c4-b44e-b30231f83222 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:18.826384 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe52bcd4-bd96-46c4-b44e-b30231f83222 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:18.826675 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe52bcd4-bd96-46c4-b44e-b30231f83222 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:18.827612 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe52bcd4-bd96-46c4-b44e-b30231f83222 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:35:18.829789 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe52bcd4-bd96-46c4-b44e-b30231f83222 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:35:18.969414 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3216/6392] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:35:18 2022] POST /identity/v3/users => generated 293 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:35:18.971257 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fdde85-5db1-4063-9285-1126b8a594cd admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:35:18.991414 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fdde85-5db1-4063-9285-1126b8a594cd admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:35:19.000410 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da198488-c522-445e-9d4d-ca696e19b49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:35:19.001413 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da198488-c522-445e-9d4d-ca696e19b49f admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:19.002231 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da198488-c522-445e-9d4d-ca696e19b49f admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:19.003315 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da198488-c522-445e-9d4d-ca696e19b49f admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:19.004279 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da198488-c522-445e-9d4d-ca696e19b49f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:35:19.007761 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da198488-c522-445e-9d4d-ca696e19b49f admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:35:19.289019 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3177/6393] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:35:18 2022] GET /identity/v3/roles => generated 1420 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:35:19.291547 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe52bcd4-bd96-46c4-b44e-b30231f83222 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:35:19.307799 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe52bcd4-bd96-46c4-b44e-b30231f83222 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:35:19.320170 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa491bfd-044f-4d0f-b1a0-5ffb7f1a7b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:35:19.321240 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa491bfd-044f-4d0f-b1a0-5ffb7f1a7b1f admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:19.322105 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa491bfd-044f-4d0f-b1a0-5ffb7f1a7b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:19.322535 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa491bfd-044f-4d0f-b1a0-5ffb7f1a7b1f admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:19.323983 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa491bfd-044f-4d0f-b1a0-5ffb7f1a7b1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:35:19.328521 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa491bfd-044f-4d0f-b1a0-5ffb7f1a7b1f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:35:19.353040 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3217/6394] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:35:19 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:35:19.358060 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da198488-c522-445e-9d4d-ca696e19b49f admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:35:19.370730 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da198488-c522-445e-9d4d-ca696e19b49f admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:35:19.381905 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da8df0-9800-44dd-b208-f4d9555fbf74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:35:19.383278 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da8df0-9800-44dd-b208-f4d9555fbf74 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:19.383756 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da8df0-9800-44dd-b208-f4d9555fbf74 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:19.384254 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da8df0-9800-44dd-b208-f4d9555fbf74 admin admin] PATH_INFO: `/v3/projects/3bb281d754bf41c0a7100d7880ed8b7c/users/c8b24ffa7663455ca205012eba130954/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:19.412257 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71da8df0-9800-44dd-b208-f4d9555fbf74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bb281d754bf41c0a7100d7880ed8b7c, user_id=c8b24ffa7663455ca205012eba130954, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:35:19.416686 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71da8df0-9800-44dd-b208-f4d9555fbf74 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:35:19.509486 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3178/6395] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:35:19 2022] PUT /identity/v3/projects/3bb281d754bf41c0a7100d7880ed8b7c/users/c8b24ffa7663455ca205012eba130954/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:35:19.525104 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34cd44-2226-4ce7-9095-d94746407730 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:19.526435 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34cd44-2226-4ce7-9095-d94746407730 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:19.527527 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34cd44-2226-4ce7-9095-d94746407730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:19.582055 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-1c34cd44-2226-4ce7-9095-d94746407730 None None] MFA Rules not processed for user `c8b24ffa7663455ca205012eba130954`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:35:19.592248 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-1c34cd44-2226-4ce7-9095-d94746407730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:35:19.757273 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da8df0-9800-44dd-b208-f4d9555fbf74 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:35:19.758433 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3218/6396] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:35:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:35:19.905690 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da8df0-9800-44dd-b208-f4d9555fbf74 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:35:19.913787 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2083b925-6b57-40c4-b8d0-94cb7ebc9130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:35:19.913787 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2083b925-6b57-40c4-b8d0-94cb7ebc9130 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:19.921960 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2083b925-6b57-40c4-b8d0-94cb7ebc9130 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:19.922527 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2083b925-6b57-40c4-b8d0-94cb7ebc9130 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:19.923443 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2083b925-6b57-40c4-b8d0-94cb7ebc9130 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:35:19.931157 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2083b925-6b57-40c4-b8d0-94cb7ebc9130 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:35:20.199343 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3179/6397] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:35:19 2022] POST /identity/v3/projects => generated 383 bytes in 443 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:35:20.210013 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c34cd44-2226-4ce7-9095-d94746407730 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:35:20.230831 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c34cd44-2226-4ce7-9095-d94746407730 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:35:20.362397 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f176f8-d20a-45ec-a6d6-d1c8b21ac63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:35:20.363276 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f176f8-d20a-45ec-a6d6-d1c8b21ac63c admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:20.363699 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f176f8-d20a-45ec-a6d6-d1c8b21ac63c admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:20.364245 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f176f8-d20a-45ec-a6d6-d1c8b21ac63c admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:20.365712 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f176f8-d20a-45ec-a6d6-d1c8b21ac63c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:35:20.368111 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f176f8-d20a-45ec-a6d6-d1c8b21ac63c admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:35:20.519952 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3219/6398] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:35:20 2022] POST /identity/v3/users => generated 298 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:35:20.522012 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2083b925-6b57-40c4-b8d0-94cb7ebc9130 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:35:20.549360 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2083b925-6b57-40c4-b8d0-94cb7ebc9130 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:35:20.581630 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556b5125-e3b5-413d-96d5-b07ddb33907d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:35:20.582732 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556b5125-e3b5-413d-96d5-b07ddb33907d admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:20.583269 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556b5125-e3b5-413d-96d5-b07ddb33907d admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:20.584387 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556b5125-e3b5-413d-96d5-b07ddb33907d admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:20.588655 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556b5125-e3b5-413d-96d5-b07ddb33907d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:35:20.599126 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556b5125-e3b5-413d-96d5-b07ddb33907d admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:35:20.610296 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3180/6399] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:35:20 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:35:20.615429 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f176f8-d20a-45ec-a6d6-d1c8b21ac63c admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:35:20.629815 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f176f8-d20a-45ec-a6d6-d1c8b21ac63c admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:35:20.639921 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae3052-2c05-409f-9b04-0a954537509f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:35:20.641195 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae3052-2c05-409f-9b04-0a954537509f admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:20.641725 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae3052-2c05-409f-9b04-0a954537509f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:20.642224 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae3052-2c05-409f-9b04-0a954537509f admin admin] PATH_INFO: `/v3/projects/9d1bf008243b4b1b99fe50688803ca3e/users/2874bbdb3f574757a99d334f46bd5fe0/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:20.696600 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ae3052-2c05-409f-9b04-0a954537509f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d1bf008243b4b1b99fe50688803ca3e, user_id=2874bbdb3f574757a99d334f46bd5fe0, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:35:20.699965 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ae3052-2c05-409f-9b04-0a954537509f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:35:20.803446 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3220/6400] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:35:20 2022] PUT /identity/v3/projects/9d1bf008243b4b1b99fe50688803ca3e/users/2874bbdb3f574757a99d334f46bd5fe0/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:35:20.807754 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556b5125-e3b5-413d-96d5-b07ddb33907d admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:35:20.824171 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556b5125-e3b5-413d-96d5-b07ddb33907d admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:35:20.999198 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdaca3a-f012-4009-8caa-e7733d72a3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:35:21.000348 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdaca3a-f012-4009-8caa-e7733d72a3c0 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:21.000949 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdaca3a-f012-4009-8caa-e7733d72a3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:21.001411 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdaca3a-f012-4009-8caa-e7733d72a3c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:21.002629 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdaca3a-f012-4009-8caa-e7733d72a3c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:35:21.004698 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdaca3a-f012-4009-8caa-e7733d72a3c0 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:35:21.022603 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3181/6401] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:35:20 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:35:21.023699 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae3052-2c05-409f-9b04-0a954537509f admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:35:21.043708 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae3052-2c05-409f-9b04-0a954537509f admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:35:21.048920 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db79beca-e02c-4747-9e1a-54c382c52dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:35:21.049970 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db79beca-e02c-4747-9e1a-54c382c52dbf admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:21.050324 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db79beca-e02c-4747-9e1a-54c382c52dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:21.050655 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db79beca-e02c-4747-9e1a-54c382c52dbf admin admin] PATH_INFO: `/v3/projects/9d1bf008243b4b1b99fe50688803ca3e/users/2874bbdb3f574757a99d334f46bd5fe0/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:21.053224 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db79beca-e02c-4747-9e1a-54c382c52dbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d1bf008243b4b1b99fe50688803ca3e, user_id=2874bbdb3f574757a99d334f46bd5fe0, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:35:21.056736 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db79beca-e02c-4747-9e1a-54c382c52dbf admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:35:21.072876 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3221/6402] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:35:21 2022] PUT /identity/v3/projects/9d1bf008243b4b1b99fe50688803ca3e/users/2874bbdb3f574757a99d334f46bd5fe0/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:35:21.087290 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b4f5fc-dd98-4cd7-b877-eec1a7c72aeb None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:21.087612 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b4f5fc-dd98-4cd7-b877-eec1a7c72aeb None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:21.087892 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b4f5fc-dd98-4cd7-b877-eec1a7c72aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:21.130798 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-72b4f5fc-dd98-4cd7-b877-eec1a7c72aeb None None] MFA Rules not processed for user `2874bbdb3f574757a99d334f46bd5fe0`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:35:21.134100 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-72b4f5fc-dd98-4cd7-b877-eec1a7c72aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:35:21.250302 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3182/6403] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:35:21 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:35:21.294176 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db79beca-e02c-4747-9e1a-54c382c52dbf admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:35:21.296239 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-db79beca-e02c-4747-9e1a-54c382c52dbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:35:21.421061 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db79beca-e02c-4747-9e1a-54c382c52dbf admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:35:21.431406 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7d5446-735f-4318-9de0-65f6a01731b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:35:21.432587 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d5446-735f-4318-9de0-65f6a01731b5 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:21.433106 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d5446-735f-4318-9de0-65f6a01731b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:21.433583 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d5446-735f-4318-9de0-65f6a01731b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:21.454471 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7d5446-735f-4318-9de0-65f6a01731b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:35:21.456352 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7d5446-735f-4318-9de0-65f6a01731b5 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:35:21.483926 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3222/6404] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:35:21 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:35:25.062276 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8ca48-0bbb-42a4-881f-80e085200094 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:25.062276 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8ca48-0bbb-42a4-881f-80e085200094 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:25.062781 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8ca48-0bbb-42a4-881f-80e085200094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:25.092679 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-b9a8ca48-0bbb-42a4-881f-80e085200094 None None] MFA Rules not processed for user `cbb8c5cf2d144e3791171eb3d6f83eca`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:35:25.094391 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b9a8ca48-0bbb-42a4-881f-80e085200094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:35:25.216646 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3183/6405] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:35:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:35:28.354071 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7d5446-735f-4318-9de0-65f6a01731b5 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:35:28.470677 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7d5446-735f-4318-9de0-65f6a01731b5 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:35:28.474873 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fc0bd6-f6cb-4b14-875a-7f1d96d58d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:35:28.476005 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc0bd6-f6cb-4b14-875a-7f1d96d58d99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:28.476294 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc0bd6-f6cb-4b14-875a-7f1d96d58d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:28.476573 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc0bd6-f6cb-4b14-875a-7f1d96d58d99 admin admin] PATH_INFO: `/v3/users/c8b24ffa7663455ca205012eba130954` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:28.477804 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fc0bd6-f6cb-4b14-875a-7f1d96d58d99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8b24ffa7663455ca205012eba130954)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:35:28.479776 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fc0bd6-f6cb-4b14-875a-7f1d96d58d99 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:35:28.757075 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-29fc0bd6-f6cb-4b14-875a-7f1d96d58d99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8b24ffa7663455ca205012eba130954'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:28.786852 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-29fc0bd6-f6cb-4b14-875a-7f1d96d58d99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8b24ffa7663455ca205012eba130954'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:28.803871 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-29fc0bd6-f6cb-4b14-875a-7f1d96d58d99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8b24ffa7663455ca205012eba130954'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:28.930639 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-29fc0bd6-f6cb-4b14-875a-7f1d96d58d99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8b24ffa7663455ca205012eba130954'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:28.934378 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-29fc0bd6-f6cb-4b14-875a-7f1d96d58d99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8b24ffa7663455ca205012eba130954'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:28.941938 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3223/6406] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:35:28 2022] DELETE /identity/v3/users/c8b24ffa7663455ca205012eba130954 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:35:28.953902 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7955dcb-8f99-4f47-b7f1-23505e253d7e None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:28.953902 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7955dcb-8f99-4f47-b7f1-23505e253d7e None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:28.953902 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7955dcb-8f99-4f47-b7f1-23505e253d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:28.978351 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-b7955dcb-8f99-4f47-b7f1-23505e253d7e None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:35:28.979829 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b7955dcb-8f99-4f47-b7f1-23505e253d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:35:29.116668 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3184/6407] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:35:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:35:29.133243 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fc0bd6-f6cb-4b14-875a-7f1d96d58d99 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:35:29.134857 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-29fc0bd6-f6cb-4b14-875a-7f1d96d58d99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:35:29.276185 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fc0bd6-f6cb-4b14-875a-7f1d96d58d99 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:35:29.281035 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f008e4-e3c9-4859-9746-6ab8dcba89f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:35:29.281713 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f008e4-e3c9-4859-9746-6ab8dcba89f8 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:29.282001 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f008e4-e3c9-4859-9746-6ab8dcba89f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:29.282280 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f008e4-e3c9-4859-9746-6ab8dcba89f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:29.305004 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f008e4-e3c9-4859-9746-6ab8dcba89f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:35:29.305004 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f008e4-e3c9-4859-9746-6ab8dcba89f8 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:35:29.316586 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3224/6408] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:35:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:35:30.359799 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7955dcb-8f99-4f47-b7f1-23505e253d7e None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:35:30.360937 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b7955dcb-8f99-4f47-b7f1-23505e253d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:35:30.385426 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7955dcb-8f99-4f47-b7f1-23505e253d7e None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:35:30.398451 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24856c38-eeb4-459e-bc45-b9022bc7ef10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:35:30.399967 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24856c38-eeb4-459e-bc45-b9022bc7ef10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:30.400438 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24856c38-eeb4-459e-bc45-b9022bc7ef10 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:30.400885 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24856c38-eeb4-459e-bc45-b9022bc7ef10 admin admin] PATH_INFO: `/v3/projects/3bb281d754bf41c0a7100d7880ed8b7c` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:30.402491 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24856c38-eeb4-459e-bc45-b9022bc7ef10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bb281d754bf41c0a7100d7880ed8b7c)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:35:30.405158 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24856c38-eeb4-459e-bc45-b9022bc7ef10 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:35:30.599121 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-24856c38-eeb4-459e-bc45-b9022bc7ef10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bb281d754bf41c0a7100d7880ed8b7c', 'request_id': 'req-24856c38-eeb4-459e-bc45-b9022bc7ef10'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:30.612073 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-24856c38-eeb4-459e-bc45-b9022bc7ef10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bb281d754bf41c0a7100d7880ed8b7c', 'request_id': 'req-24856c38-eeb4-459e-bc45-b9022bc7ef10'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:30.629491 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-24856c38-eeb4-459e-bc45-b9022bc7ef10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bb281d754bf41c0a7100d7880ed8b7c', 'request_id': 'req-24856c38-eeb4-459e-bc45-b9022bc7ef10'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:30.749673 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-24856c38-eeb4-459e-bc45-b9022bc7ef10 admin admin] The token cache is being invalidate because project 3bb281d754bf41c0a7100d7880ed8b7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:35:30.750172 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-24856c38-eeb4-459e-bc45-b9022bc7ef10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:30.751029 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-24856c38-eeb4-459e-bc45-b9022bc7ef10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:30.753310 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3185/6409] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:35:30 2022] DELETE /identity/v3/projects/3bb281d754bf41c0a7100d7880ed8b7c => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:35:30.757741 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f008e4-e3c9-4859-9746-6ab8dcba89f8 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:35:30.790488 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f008e4-e3c9-4859-9746-6ab8dcba89f8 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:35:30.921617 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3adf7f-4b70-4911-86ff-433eb740ade7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:35:30.922825 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3adf7f-4b70-4911-86ff-433eb740ade7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:30.923278 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3adf7f-4b70-4911-86ff-433eb740ade7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:30.925038 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3adf7f-4b70-4911-86ff-433eb740ade7 admin admin] PATH_INFO: `/v3/users/2874bbdb3f574757a99d334f46bd5fe0` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:30.926764 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3adf7f-4b70-4911-86ff-433eb740ade7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2874bbdb3f574757a99d334f46bd5fe0)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:35:30.933544 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3adf7f-4b70-4911-86ff-433eb740ade7 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:35:31.229692 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-dc3adf7f-4b70-4911-86ff-433eb740ade7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2874bbdb3f574757a99d334f46bd5fe0'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:31.247217 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-dc3adf7f-4b70-4911-86ff-433eb740ade7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2874bbdb3f574757a99d334f46bd5fe0'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:31.262105 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-dc3adf7f-4b70-4911-86ff-433eb740ade7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2874bbdb3f574757a99d334f46bd5fe0'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:31.454254 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-dc3adf7f-4b70-4911-86ff-433eb740ade7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2874bbdb3f574757a99d334f46bd5fe0'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:31.456227 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-dc3adf7f-4b70-4911-86ff-433eb740ade7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2874bbdb3f574757a99d334f46bd5fe0'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:31.473483 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3225/6410] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:35:30 2022] DELETE /identity/v3/users/2874bbdb3f574757a99d334f46bd5fe0 => generated 0 bytes in 716 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:35:32.445412 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24856c38-eeb4-459e-bc45-b9022bc7ef10 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:35:32.447925 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-24856c38-eeb4-459e-bc45-b9022bc7ef10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:35:32.514538 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24856c38-eeb4-459e-bc45-b9022bc7ef10 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:35:32.701355 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4714cd38-c296-4568-931e-ee44071850e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:35:32.702239 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4714cd38-c296-4568-931e-ee44071850e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:32.702519 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4714cd38-c296-4568-931e-ee44071850e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:32.702790 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4714cd38-c296-4568-931e-ee44071850e5 admin admin] PATH_INFO: `/v3/projects/9d1bf008243b4b1b99fe50688803ca3e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:32.707884 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4714cd38-c296-4568-931e-ee44071850e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d1bf008243b4b1b99fe50688803ca3e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:35:32.712929 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4714cd38-c296-4568-931e-ee44071850e5 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:35:32.885651 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4714cd38-c296-4568-931e-ee44071850e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d1bf008243b4b1b99fe50688803ca3e', 'request_id': 'req-4714cd38-c296-4568-931e-ee44071850e5'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:32.901198 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4714cd38-c296-4568-931e-ee44071850e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d1bf008243b4b1b99fe50688803ca3e', 'request_id': 'req-4714cd38-c296-4568-931e-ee44071850e5'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:32.930179 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4714cd38-c296-4568-931e-ee44071850e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d1bf008243b4b1b99fe50688803ca3e', 'request_id': 'req-4714cd38-c296-4568-931e-ee44071850e5'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:33.151725 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4714cd38-c296-4568-931e-ee44071850e5 admin admin] The token cache is being invalidate because project 9d1bf008243b4b1b99fe50688803ca3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:35:33.152275 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4714cd38-c296-4568-931e-ee44071850e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:33.153097 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4714cd38-c296-4568-931e-ee44071850e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:33.158700 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3186/6411] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:35:32 2022] DELETE /identity/v3/projects/9d1bf008243b4b1b99fe50688803ca3e => generated 0 bytes in 710 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:35:33.160513 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb211f-fabd-4ceb-a2e2-4604f63c72cc None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:33.160966 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb211f-fabd-4ceb-a2e2-4604f63c72cc None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:33.160966 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb211f-fabd-4ceb-a2e2-4604f63c72cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:33.180218 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-06bb211f-fabd-4ceb-a2e2-4604f63c72cc None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:35:33.181438 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-06bb211f-fabd-4ceb-a2e2-4604f63c72cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:35:33.271056 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3226/6412] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:35:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:35:33.285405 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fbed96-1184-4822-92e2-3a037fd6595a None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:33.286050 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fbed96-1184-4822-92e2-3a037fd6595a None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:33.287092 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fbed96-1184-4822-92e2-3a037fd6595a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:33.312381 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-13fbed96-1184-4822-92e2-3a037fd6595a None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:35:33.318441 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-13fbed96-1184-4822-92e2-3a037fd6595a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:35:33.335079 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3187/6413] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:35:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:35:33.342575 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bb211f-fabd-4ceb-a2e2-4604f63c72cc None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:35:33.367050 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bb211f-fabd-4ceb-a2e2-4604f63c72cc None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:35:33.373915 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c8779b-ac9f-4e10-91fb-802413646fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:35:33.375696 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c8779b-ac9f-4e10-91fb-802413646fc1 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:33.375696 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c8779b-ac9f-4e10-91fb-802413646fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:33.375696 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c8779b-ac9f-4e10-91fb-802413646fc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:33.378441 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c8779b-ac9f-4e10-91fb-802413646fc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:35:33.379206 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c8779b-ac9f-4e10-91fb-802413646fc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:35:33.381805 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c8779b-ac9f-4e10-91fb-802413646fc1 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:35:33.394446 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3227/6414] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:35:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:35:33.399588 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fbed96-1184-4822-92e2-3a037fd6595a None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:35:33.409222 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fbed96-1184-4822-92e2-3a037fd6595a None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:35:33.415926 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da746e5-148f-424f-981f-f1d4acc62486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:35:33.416330 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da746e5-148f-424f-981f-f1d4acc62486 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:33.416607 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da746e5-148f-424f-981f-f1d4acc62486 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:33.416882 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da746e5-148f-424f-981f-f1d4acc62486 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:33.417745 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da746e5-148f-424f-981f-f1d4acc62486 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:35:33.419756 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da746e5-148f-424f-981f-f1d4acc62486 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:35:33.613292 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3188/6415] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:35:33 2022] POST /identity/v3/projects => generated 361 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:35:33.616183 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c8779b-ac9f-4e10-91fb-802413646fc1 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:35:33.633427 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c8779b-ac9f-4e10-91fb-802413646fc1 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:35:33.757774 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ee5239-3b0f-49ca-8023-a716768ec372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:35:33.758764 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee5239-3b0f-49ca-8023-a716768ec372 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:33.759113 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee5239-3b0f-49ca-8023-a716768ec372 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:33.759403 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee5239-3b0f-49ca-8023-a716768ec372 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:33.760643 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ee5239-3b0f-49ca-8023-a716768ec372 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:35:33.765971 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ee5239-3b0f-49ca-8023-a716768ec372 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:35:33.929982 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3228/6416] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:35:33 2022] POST /identity/v3/users => generated 281 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:35:33.933890 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da746e5-148f-424f-981f-f1d4acc62486 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:35:33.950802 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da746e5-148f-424f-981f-f1d4acc62486 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:35:33.963714 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25458321-5bf1-4d47-9bec-d497d8288ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:35:33.969279 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25458321-5bf1-4d47-9bec-d497d8288ba5 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:33.972472 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25458321-5bf1-4d47-9bec-d497d8288ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:33.973164 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25458321-5bf1-4d47-9bec-d497d8288ba5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:33.976684 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25458321-5bf1-4d47-9bec-d497d8288ba5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:35:33.981373 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25458321-5bf1-4d47-9bec-d497d8288ba5 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:35:34.005406 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3189/6417] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:35:33 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:35:34.010803 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ee5239-3b0f-49ca-8023-a716768ec372 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:35:34.033269 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ee5239-3b0f-49ca-8023-a716768ec372 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:35:34.047722 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aedb2b-ccfd-4a22-8879-81c5b3c970b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:35:34.048885 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aedb2b-ccfd-4a22-8879-81c5b3c970b8 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:34.049324 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aedb2b-ccfd-4a22-8879-81c5b3c970b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:34.049752 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aedb2b-ccfd-4a22-8879-81c5b3c970b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:34.050922 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aedb2b-ccfd-4a22-8879-81c5b3c970b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:35:34.060327 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aedb2b-ccfd-4a22-8879-81c5b3c970b8 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:35:34.093787 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3229/6418] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:35:34 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:35:34.095582 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25458321-5bf1-4d47-9bec-d497d8288ba5 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:35:34.112121 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25458321-5bf1-4d47-9bec-d497d8288ba5 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:35:34.139923 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd1eff5-c5c4-4560-9b4f-16c41f0f585c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:35:34.141461 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd1eff5-c5c4-4560-9b4f-16c41f0f585c admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:34.141461 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd1eff5-c5c4-4560-9b4f-16c41f0f585c admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:34.143647 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd1eff5-c5c4-4560-9b4f-16c41f0f585c admin admin] PATH_INFO: `/v3/projects/25cc3625fe5f4ee1bcd59980468c5a56/users/23b8ea40426d4ba9a9525ffc88683ee4/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:34.180997 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd1eff5-c5c4-4560-9b4f-16c41f0f585c admin admin] RBAC: Authorizing `identity:create_grant(project_id=25cc3625fe5f4ee1bcd59980468c5a56, user_id=23b8ea40426d4ba9a9525ffc88683ee4, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:35:34.183683 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd1eff5-c5c4-4560-9b4f-16c41f0f585c admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:35:34.298914 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3190/6419] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:35:34 2022] PUT /identity/v3/projects/25cc3625fe5f4ee1bcd59980468c5a56/users/23b8ea40426d4ba9a9525ffc88683ee4/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:35:34.311373 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe4e87-f8a0-43ce-99de-b5087008d2c6 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:34.312299 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe4e87-f8a0-43ce-99de-b5087008d2c6 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:34.312588 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe4e87-f8a0-43ce-99de-b5087008d2c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:34.346425 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-5cbe4e87-f8a0-43ce-99de-b5087008d2c6 None None] MFA Rules not processed for user `23b8ea40426d4ba9a9525ffc88683ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:35:34.351584 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-5cbe4e87-f8a0-43ce-99de-b5087008d2c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:35:34.568978 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3230/6420] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:35:34 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:35:34.682969 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd1eff5-c5c4-4560-9b4f-16c41f0f585c admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:35:34.687797 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-3dd1eff5-c5c4-4560-9b4f-16c41f0f585c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:35:34.835397 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd1eff5-c5c4-4560-9b4f-16c41f0f585c admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:35:34.844355 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba2ed4b-2eb4-4ce5-a7e4-5e0b3d670774 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:35:34.845415 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2ed4b-2eb4-4ce5-a7e4-5e0b3d670774 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:34.845735 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2ed4b-2eb4-4ce5-a7e4-5e0b3d670774 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:34.846952 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2ed4b-2eb4-4ce5-a7e4-5e0b3d670774 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:34.862010 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba2ed4b-2eb4-4ce5-a7e4-5e0b3d670774 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:35:34.865202 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba2ed4b-2eb4-4ce5-a7e4-5e0b3d670774 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:35:34.893596 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3191/6421] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:35:34 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:35:48.222066 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbe4e87-f8a0-43ce-99de-b5087008d2c6 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:35:48.223717 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-5cbe4e87-f8a0-43ce-99de-b5087008d2c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:35:48.296188 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbe4e87-f8a0-43ce-99de-b5087008d2c6 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:35:48.305090 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c9384f-d534-47d4-9e26-7181bd6f04de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:35:48.306318 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9384f-d534-47d4-9e26-7181bd6f04de admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:48.306890 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9384f-d534-47d4-9e26-7181bd6f04de admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:48.307363 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9384f-d534-47d4-9e26-7181bd6f04de admin admin] PATH_INFO: `/v3/users/4520497ff0cc42bba0a4ddb6d04cfb63` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:48.312705 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c9384f-d534-47d4-9e26-7181bd6f04de admin admin] RBAC: Authorizing `identity:delete_user(user_id=4520497ff0cc42bba0a4ddb6d04cfb63)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:35:48.316010 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c9384f-d534-47d4-9e26-7181bd6f04de admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:35:48.559397 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-50c9384f-d534-47d4-9e26-7181bd6f04de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4520497ff0cc42bba0a4ddb6d04cfb63'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:48.592025 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-50c9384f-d534-47d4-9e26-7181bd6f04de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4520497ff0cc42bba0a4ddb6d04cfb63'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:48.606721 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-50c9384f-d534-47d4-9e26-7181bd6f04de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4520497ff0cc42bba0a4ddb6d04cfb63'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:48.693310 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-50c9384f-d534-47d4-9e26-7181bd6f04de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4520497ff0cc42bba0a4ddb6d04cfb63'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:48.700519 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-50c9384f-d534-47d4-9e26-7181bd6f04de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4520497ff0cc42bba0a4ddb6d04cfb63'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:48.712612 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3231/6422] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:35:48 2022] DELETE /identity/v3/users/4520497ff0cc42bba0a4ddb6d04cfb63 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:35:48.717993 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995fa79c-2941-4722-bccb-16b4e1be0a31 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:48.719023 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995fa79c-2941-4722-bccb-16b4e1be0a31 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:48.719852 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995fa79c-2941-4722-bccb-16b4e1be0a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:48.758006 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-995fa79c-2941-4722-bccb-16b4e1be0a31 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:35:48.759551 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-995fa79c-2941-4722-bccb-16b4e1be0a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:35:48.863322 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3192/6423] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:35:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:35:48.883158 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c9384f-d534-47d4-9e26-7181bd6f04de admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:35:48.884868 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-50c9384f-d534-47d4-9e26-7181bd6f04de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:35:48.964480 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c9384f-d534-47d4-9e26-7181bd6f04de admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:35:48.968295 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5ffd02-e2fb-4f6b-95ce-3a366538da0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:35:48.968960 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ffd02-e2fb-4f6b-95ce-3a366538da0b service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:48.969247 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ffd02-e2fb-4f6b-95ce-3a366538da0b service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:48.969527 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ffd02-e2fb-4f6b-95ce-3a366538da0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:48.981843 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5ffd02-e2fb-4f6b-95ce-3a366538da0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:35:48.983311 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5ffd02-e2fb-4f6b-95ce-3a366538da0b service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:35:49.005039 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3232/6424] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:35:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:35:49.568284 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995fa79c-2941-4722-bccb-16b4e1be0a31 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:35:49.570361 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-995fa79c-2941-4722-bccb-16b4e1be0a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:35:49.597586 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995fa79c-2941-4722-bccb-16b4e1be0a31 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:35:49.604658 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4e57f4-502b-4302-9323-51b5fd876c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:35:49.606032 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e57f4-502b-4302-9323-51b5fd876c19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:49.606321 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e57f4-502b-4302-9323-51b5fd876c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:49.606599 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e57f4-502b-4302-9323-51b5fd876c19 admin admin] PATH_INFO: `/v3/projects/139b7ddd79864270813fc6a41f46439d` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:49.608221 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4e57f4-502b-4302-9323-51b5fd876c19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=139b7ddd79864270813fc6a41f46439d)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:35:49.610186 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4e57f4-502b-4302-9323-51b5fd876c19 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:35:49.814057 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3f4e57f4-502b-4302-9323-51b5fd876c19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '139b7ddd79864270813fc6a41f46439d', 'request_id': 'req-3f4e57f4-502b-4302-9323-51b5fd876c19'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:49.832112 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3f4e57f4-502b-4302-9323-51b5fd876c19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '139b7ddd79864270813fc6a41f46439d', 'request_id': 'req-3f4e57f4-502b-4302-9323-51b5fd876c19'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:49.839048 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3f4e57f4-502b-4302-9323-51b5fd876c19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '139b7ddd79864270813fc6a41f46439d', 'request_id': 'req-3f4e57f4-502b-4302-9323-51b5fd876c19'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:49.942636 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3f4e57f4-502b-4302-9323-51b5fd876c19 admin admin] The token cache is being invalidate because project 139b7ddd79864270813fc6a41f46439d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:35:49.942937 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3f4e57f4-502b-4302-9323-51b5fd876c19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:49.947399 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3f4e57f4-502b-4302-9323-51b5fd876c19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:49.949391 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3193/6425] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:35:49 2022] DELETE /identity/v3/projects/139b7ddd79864270813fc6a41f46439d => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:35:49.954678 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e8521-040d-4340-9b87-b6a03c5ac51c None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:49.954678 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e8521-040d-4340-9b87-b6a03c5ac51c None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:49.955324 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e8521-040d-4340-9b87-b6a03c5ac51c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:49.985935 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-819e8521-040d-4340-9b87-b6a03c5ac51c None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:35:49.989414 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-819e8521-040d-4340-9b87-b6a03c5ac51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:35:50.094029 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3233/6426] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:35:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:35:50.111290 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb6739d-6b52-46a5-ae70-e61cdd92eb70 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:50.111290 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb6739d-6b52-46a5-ae70-e61cdd92eb70 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:50.111290 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb6739d-6b52-46a5-ae70-e61cdd92eb70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:50.134054 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-5fb6739d-6b52-46a5-ae70-e61cdd92eb70 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:35:50.136033 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-5fb6739d-6b52-46a5-ae70-e61cdd92eb70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:35:50.151085 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3194/6427] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:35:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:35:50.152402 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819e8521-040d-4340-9b87-b6a03c5ac51c None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:35:50.170761 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819e8521-040d-4340-9b87-b6a03c5ac51c None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:35:50.174330 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be907d4-79e4-4e6a-965d-5affa1c9c0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:35:50.175836 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be907d4-79e4-4e6a-965d-5affa1c9c0e8 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:50.177481 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be907d4-79e4-4e6a-965d-5affa1c9c0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:50.178097 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be907d4-79e4-4e6a-965d-5affa1c9c0e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:50.179053 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be907d4-79e4-4e6a-965d-5affa1c9c0e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:35:50.179635 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be907d4-79e4-4e6a-965d-5affa1c9c0e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:35:50.182201 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be907d4-79e4-4e6a-965d-5affa1c9c0e8 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:35:50.203433 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3234/6428] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:35:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:35:50.208505 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb6739d-6b52-46a5-ae70-e61cdd92eb70 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:35:50.225858 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb6739d-6b52-46a5-ae70-e61cdd92eb70 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:35:50.231349 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4dbf06-e9c3-4f67-b1ce-db57c58dde20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:35:50.232248 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4dbf06-e9c3-4f67-b1ce-db57c58dde20 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:50.233566 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4dbf06-e9c3-4f67-b1ce-db57c58dde20 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:50.233566 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4dbf06-e9c3-4f67-b1ce-db57c58dde20 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:50.234137 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4dbf06-e9c3-4f67-b1ce-db57c58dde20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:35:50.236303 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4dbf06-e9c3-4f67-b1ce-db57c58dde20 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:35:50.383103 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be907d4-79e4-4e6a-965d-5affa1c9c0e8 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:35:50.399582 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3195/6429] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:35:50 2022] POST /identity/v3/projects => generated 355 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:35:50.417170 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be907d4-79e4-4e6a-965d-5affa1c9c0e8 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:35:50.500897 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069e832-0a63-4e1a-a8db-b6c67fc2e533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:35:50.501711 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069e832-0a63-4e1a-a8db-b6c67fc2e533 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:50.502767 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069e832-0a63-4e1a-a8db-b6c67fc2e533 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:50.503107 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069e832-0a63-4e1a-a8db-b6c67fc2e533 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:50.503939 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a069e832-0a63-4e1a-a8db-b6c67fc2e533 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:35:50.506512 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a069e832-0a63-4e1a-a8db-b6c67fc2e533 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:35:50.603837 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3235/6430] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:35:50 2022] POST /identity/v3/users => generated 278 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:35:50.607577 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4dbf06-e9c3-4f67-b1ce-db57c58dde20 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:35:50.620061 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4dbf06-e9c3-4f67-b1ce-db57c58dde20 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:35:50.626295 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17df917-79dc-428a-99f5-8c7d8adafa8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:35:50.627398 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17df917-79dc-428a-99f5-8c7d8adafa8b admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:50.627933 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17df917-79dc-428a-99f5-8c7d8adafa8b admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:50.628454 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17df917-79dc-428a-99f5-8c7d8adafa8b admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:50.631200 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17df917-79dc-428a-99f5-8c7d8adafa8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:35:50.633301 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17df917-79dc-428a-99f5-8c7d8adafa8b admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:35:50.646573 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3196/6431] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:35:50 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:35:50.650632 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069e832-0a63-4e1a-a8db-b6c67fc2e533 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:35:50.664932 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069e832-0a63-4e1a-a8db-b6c67fc2e533 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:35:50.670760 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f76a8f-ddd3-41b2-83df-aa40d1c2705d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:35:50.671766 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f76a8f-ddd3-41b2-83df-aa40d1c2705d admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:50.672277 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f76a8f-ddd3-41b2-83df-aa40d1c2705d admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:50.673280 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f76a8f-ddd3-41b2-83df-aa40d1c2705d admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:50.674125 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f76a8f-ddd3-41b2-83df-aa40d1c2705d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:35:50.676163 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f76a8f-ddd3-41b2-83df-aa40d1c2705d admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:35:50.692615 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3236/6432] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:35:50 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:35:50.696714 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17df917-79dc-428a-99f5-8c7d8adafa8b admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:35:50.727617 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17df917-79dc-428a-99f5-8c7d8adafa8b admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:35:50.734014 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67497d79-7529-462d-8ce3-0c1f90e3fd14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:35:50.735159 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67497d79-7529-462d-8ce3-0c1f90e3fd14 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:50.735674 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67497d79-7529-462d-8ce3-0c1f90e3fd14 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:50.736105 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67497d79-7529-462d-8ce3-0c1f90e3fd14 admin admin] PATH_INFO: `/v3/projects/67c41a850dc04e9da422be7688c38925/users/0e73e527bf1641afb2ffddd0dab69111/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:50.755174 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67497d79-7529-462d-8ce3-0c1f90e3fd14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67c41a850dc04e9da422be7688c38925, user_id=0e73e527bf1641afb2ffddd0dab69111, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:35:50.758472 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67497d79-7529-462d-8ce3-0c1f90e3fd14 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:35:50.837831 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3197/6433] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:35:50 2022] PUT /identity/v3/projects/67c41a850dc04e9da422be7688c38925/users/0e73e527bf1641afb2ffddd0dab69111/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:35:50.847338 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f393f-e4d7-41b2-a6b6-89f9bb2cb499 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:50.847903 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f393f-e4d7-41b2-a6b6-89f9bb2cb499 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:50.848927 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f393f-e4d7-41b2-a6b6-89f9bb2cb499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:50.878850 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-6b6f393f-e4d7-41b2-a6b6-89f9bb2cb499 None None] MFA Rules not processed for user `0e73e527bf1641afb2ffddd0dab69111`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:35:50.881652 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-6b6f393f-e4d7-41b2-a6b6-89f9bb2cb499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:35:50.989264 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3237/6434] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:35:50 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:35:51.006635 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67497d79-7529-462d-8ce3-0c1f90e3fd14 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:35:51.008459 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-67497d79-7529-462d-8ce3-0c1f90e3fd14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:35:51.139741 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67497d79-7529-462d-8ce3-0c1f90e3fd14 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:35:51.146317 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e557b7-6897-4d8b-a128-40ce4bc3cd3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:35:51.147407 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e557b7-6897-4d8b-a128-40ce4bc3cd3b service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:51.148158 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e557b7-6897-4d8b-a128-40ce4bc3cd3b service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:51.148670 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e557b7-6897-4d8b-a128-40ce4bc3cd3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:51.163669 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e557b7-6897-4d8b-a128-40ce4bc3cd3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:35:51.167304 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e557b7-6897-4d8b-a128-40ce4bc3cd3b service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:35:51.236121 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3198/6435] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:35:51 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:35:51.827664 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f393f-e4d7-41b2-a6b6-89f9bb2cb499 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:35:51.829135 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-6b6f393f-e4d7-41b2-a6b6-89f9bb2cb499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:35:51.944137 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f393f-e4d7-41b2-a6b6-89f9bb2cb499 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:35:51.950488 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6055fa08-9c17-44c7-80f5-75aac24ad607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:35:51.951745 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055fa08-9c17-44c7-80f5-75aac24ad607 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:51.952271 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055fa08-9c17-44c7-80f5-75aac24ad607 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:51.952803 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055fa08-9c17-44c7-80f5-75aac24ad607 admin admin] PATH_INFO: `/v3/users/8a4211529de143a2876d1cf8fec15936` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:51.954298 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6055fa08-9c17-44c7-80f5-75aac24ad607 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a4211529de143a2876d1cf8fec15936)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:35:51.956591 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6055fa08-9c17-44c7-80f5-75aac24ad607 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:35:52.270596 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6055fa08-9c17-44c7-80f5-75aac24ad607 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a4211529de143a2876d1cf8fec15936'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:52.293377 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6055fa08-9c17-44c7-80f5-75aac24ad607 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a4211529de143a2876d1cf8fec15936'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:52.311186 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6055fa08-9c17-44c7-80f5-75aac24ad607 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a4211529de143a2876d1cf8fec15936'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:52.392372 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6055fa08-9c17-44c7-80f5-75aac24ad607 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a4211529de143a2876d1cf8fec15936'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:52.394390 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6055fa08-9c17-44c7-80f5-75aac24ad607 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a4211529de143a2876d1cf8fec15936'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:52.423624 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3238/6436] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:35:51 2022] DELETE /identity/v3/users/8a4211529de143a2876d1cf8fec15936 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:35:52.428607 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b26c22f-1684-4911-a92f-48c049504a52 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:52.429230 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b26c22f-1684-4911-a92f-48c049504a52 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:52.429230 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b26c22f-1684-4911-a92f-48c049504a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:52.459802 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-9b26c22f-1684-4911-a92f-48c049504a52 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:35:52.469159 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-9b26c22f-1684-4911-a92f-48c049504a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:35:52.583089 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3199/6437] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:35:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:35:52.612758 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6055fa08-9c17-44c7-80f5-75aac24ad607 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:35:52.614437 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-6055fa08-9c17-44c7-80f5-75aac24ad607 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:35:52.718496 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6055fa08-9c17-44c7-80f5-75aac24ad607 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:35:52.735302 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42771f57-ae6c-4272-9079-5e48c7ec1d27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:35:52.736507 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42771f57-ae6c-4272-9079-5e48c7ec1d27 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:52.737010 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42771f57-ae6c-4272-9079-5e48c7ec1d27 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:52.737534 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42771f57-ae6c-4272-9079-5e48c7ec1d27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:52.760891 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42771f57-ae6c-4272-9079-5e48c7ec1d27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:35:52.763393 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42771f57-ae6c-4272-9079-5e48c7ec1d27 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:35:52.778787 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3239/6438] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:35:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:35:54.679673 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b26c22f-1684-4911-a92f-48c049504a52 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:35:54.681647 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-9b26c22f-1684-4911-a92f-48c049504a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:35:54.695639 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b26c22f-1684-4911-a92f-48c049504a52 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:35:54.702816 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af99e7-83bb-4406-a6c4-f7c5052199b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:35:54.704331 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af99e7-83bb-4406-a6c4-f7c5052199b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:54.704785 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af99e7-83bb-4406-a6c4-f7c5052199b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:54.705256 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af99e7-83bb-4406-a6c4-f7c5052199b8 admin admin] PATH_INFO: `/v3/projects/8d4a57a44aef42c6ac17a7f245f7a90e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:54.706800 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56af99e7-83bb-4406-a6c4-f7c5052199b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d4a57a44aef42c6ac17a7f245f7a90e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:35:54.709166 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56af99e7-83bb-4406-a6c4-f7c5052199b8 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:35:54.863390 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-56af99e7-83bb-4406-a6c4-f7c5052199b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d4a57a44aef42c6ac17a7f245f7a90e', 'request_id': 'req-56af99e7-83bb-4406-a6c4-f7c5052199b8'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:54.872425 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-56af99e7-83bb-4406-a6c4-f7c5052199b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d4a57a44aef42c6ac17a7f245f7a90e', 'request_id': 'req-56af99e7-83bb-4406-a6c4-f7c5052199b8'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:54.879141 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-56af99e7-83bb-4406-a6c4-f7c5052199b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d4a57a44aef42c6ac17a7f245f7a90e', 'request_id': 'req-56af99e7-83bb-4406-a6c4-f7c5052199b8'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:54.956666 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-56af99e7-83bb-4406-a6c4-f7c5052199b8 admin admin] The token cache is being invalidate because project 8d4a57a44aef42c6ac17a7f245f7a90e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:35:54.957007 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-56af99e7-83bb-4406-a6c4-f7c5052199b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:54.958082 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-56af99e7-83bb-4406-a6c4-f7c5052199b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:54.963908 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3200/6439] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:35:54 2022] DELETE /identity/v3/projects/8d4a57a44aef42c6ac17a7f245f7a90e => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:35:54.964493 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42771f57-ae6c-4272-9079-5e48c7ec1d27 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:35:54.975119 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42771f57-ae6c-4272-9079-5e48c7ec1d27 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:35:55.041677 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c3c967-4d8b-41c1-8779-278198dae95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:35:55.043424 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c3c967-4d8b-41c1-8779-278198dae95b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:55.044084 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c3c967-4d8b-41c1-8779-278198dae95b admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:55.044631 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c3c967-4d8b-41c1-8779-278198dae95b admin admin] PATH_INFO: `/v3/users/14894db57c734903b47cc586ba193935` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:55.046279 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c3c967-4d8b-41c1-8779-278198dae95b admin admin] RBAC: Authorizing `identity:delete_user(user_id=14894db57c734903b47cc586ba193935)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:35:55.048722 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c3c967-4d8b-41c1-8779-278198dae95b admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:35:55.277381 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-52c3c967-4d8b-41c1-8779-278198dae95b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14894db57c734903b47cc586ba193935'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:55.293309 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-52c3c967-4d8b-41c1-8779-278198dae95b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14894db57c734903b47cc586ba193935'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:55.302722 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-52c3c967-4d8b-41c1-8779-278198dae95b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14894db57c734903b47cc586ba193935'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:55.388197 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-52c3c967-4d8b-41c1-8779-278198dae95b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14894db57c734903b47cc586ba193935'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:55.388542 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-52c3c967-4d8b-41c1-8779-278198dae95b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14894db57c734903b47cc586ba193935'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:55.397028 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3240/6440] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:35:54 2022] DELETE /identity/v3/users/14894db57c734903b47cc586ba193935 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:35:56.879791 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af99e7-83bb-4406-a6c4-f7c5052199b8 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:35:56.881697 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-56af99e7-83bb-4406-a6c4-f7c5052199b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:35:56.907534 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af99e7-83bb-4406-a6c4-f7c5052199b8 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:35:57.043883 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a8c551-1123-409f-b86f-9b934d43f9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:35:57.045992 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a8c551-1123-409f-b86f-9b934d43f9b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:57.047464 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a8c551-1123-409f-b86f-9b934d43f9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:57.048228 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a8c551-1123-409f-b86f-9b934d43f9b7 admin admin] PATH_INFO: `/v3/projects/b1283c2133f745ac80652c89269a1bb0` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:57.064923 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a8c551-1123-409f-b86f-9b934d43f9b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1283c2133f745ac80652c89269a1bb0)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:35:57.068625 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a8c551-1123-409f-b86f-9b934d43f9b7 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:35:57.263516 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-96a8c551-1123-409f-b86f-9b934d43f9b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1283c2133f745ac80652c89269a1bb0', 'request_id': 'req-96a8c551-1123-409f-b86f-9b934d43f9b7'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:57.279122 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-96a8c551-1123-409f-b86f-9b934d43f9b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1283c2133f745ac80652c89269a1bb0', 'request_id': 'req-96a8c551-1123-409f-b86f-9b934d43f9b7'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:57.292502 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-96a8c551-1123-409f-b86f-9b934d43f9b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1283c2133f745ac80652c89269a1bb0', 'request_id': 'req-96a8c551-1123-409f-b86f-9b934d43f9b7'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:57.372420 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-96a8c551-1123-409f-b86f-9b934d43f9b7 admin admin] The token cache is being invalidate because project b1283c2133f745ac80652c89269a1bb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:35:57.373524 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-96a8c551-1123-409f-b86f-9b934d43f9b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:57.375846 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-96a8c551-1123-409f-b86f-9b934d43f9b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:35:57.378337 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3201/6441] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:35:56 2022] DELETE /identity/v3/projects/b1283c2133f745ac80652c89269a1bb0 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:35:57.384542 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08ede3-e07b-45d0-9bdd-8bad33b5fedc None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:57.385586 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08ede3-e07b-45d0-9bdd-8bad33b5fedc None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:57.386192 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08ede3-e07b-45d0-9bdd-8bad33b5fedc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:57.420011 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-5c08ede3-e07b-45d0-9bdd-8bad33b5fedc None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:35:57.424422 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-5c08ede3-e07b-45d0-9bdd-8bad33b5fedc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:35:57.585452 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3241/6442] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:35:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:35:57.589804 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c87d1-5e51-467e-9ddc-c088d9f131d8 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:57.589931 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c87d1-5e51-467e-9ddc-c088d9f131d8 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:57.590262 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c87d1-5e51-467e-9ddc-c088d9f131d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:57.634880 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-469c87d1-5e51-467e-9ddc-c088d9f131d8 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:35:57.636168 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-469c87d1-5e51-467e-9ddc-c088d9f131d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:35:57.654418 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3202/6443] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:35:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:35:57.658587 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c08ede3-e07b-45d0-9bdd-8bad33b5fedc None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:35:57.674030 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c08ede3-e07b-45d0-9bdd-8bad33b5fedc None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:35:57.685110 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a3ccf-0df4-4295-a934-053808d21c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:35:57.688164 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a3ccf-0df4-4295-a934-053808d21c32 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:57.690203 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a3ccf-0df4-4295-a934-053808d21c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:57.691049 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a3ccf-0df4-4295-a934-053808d21c32 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:57.693903 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75a3ccf-0df4-4295-a934-053808d21c32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:35:57.696436 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75a3ccf-0df4-4295-a934-053808d21c32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:35:57.699348 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75a3ccf-0df4-4295-a934-053808d21c32 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:35:57.723935 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3242/6444] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:35:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:35:57.724742 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469c87d1-5e51-467e-9ddc-c088d9f131d8 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:35:57.753843 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469c87d1-5e51-467e-9ddc-c088d9f131d8 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:35:57.769157 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd223406-f776-4ae8-9bdc-84c2c21eae7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:35:57.773448 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd223406-f776-4ae8-9bdc-84c2c21eae7b admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:57.773739 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd223406-f776-4ae8-9bdc-84c2c21eae7b admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:57.774541 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd223406-f776-4ae8-9bdc-84c2c21eae7b admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:57.775930 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd223406-f776-4ae8-9bdc-84c2c21eae7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:35:57.779344 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd223406-f776-4ae8-9bdc-84c2c21eae7b admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:35:57.899586 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3203/6445] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:35:57 2022] POST /identity/v3/projects => generated 387 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:35:57.904188 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a3ccf-0df4-4295-a934-053808d21c32 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:35:57.923884 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a3ccf-0df4-4295-a934-053808d21c32 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:35:58.007916 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1053d881-266e-4646-a73f-2f55b8cb6efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:35:58.010254 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1053d881-266e-4646-a73f-2f55b8cb6efe admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:58.010254 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1053d881-266e-4646-a73f-2f55b8cb6efe admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:58.010254 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1053d881-266e-4646-a73f-2f55b8cb6efe admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:58.010254 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1053d881-266e-4646-a73f-2f55b8cb6efe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:35:58.014695 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1053d881-266e-4646-a73f-2f55b8cb6efe admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:35:58.124208 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3243/6446] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:35:57 2022] POST /identity/v3/users => generated 294 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:35:58.124428 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd223406-f776-4ae8-9bdc-84c2c21eae7b admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:35:58.135875 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd223406-f776-4ae8-9bdc-84c2c21eae7b admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:35:58.141705 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3674a7e7-c569-4597-8b2a-30ce7cfc0b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:35:58.142636 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674a7e7-c569-4597-8b2a-30ce7cfc0b12 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:58.145760 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674a7e7-c569-4597-8b2a-30ce7cfc0b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:58.145760 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674a7e7-c569-4597-8b2a-30ce7cfc0b12 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:58.145760 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3674a7e7-c569-4597-8b2a-30ce7cfc0b12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:35:58.146549 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3674a7e7-c569-4597-8b2a-30ce7cfc0b12 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:35:58.178357 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3204/6447] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:35:58 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:35:58.182509 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1053d881-266e-4646-a73f-2f55b8cb6efe admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:35:58.197852 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1053d881-266e-4646-a73f-2f55b8cb6efe admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:35:58.204405 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b25b09-c555-4387-bdc2-90b22bf0b11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:35:58.205842 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b25b09-c555-4387-bdc2-90b22bf0b11b admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:58.206134 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b25b09-c555-4387-bdc2-90b22bf0b11b admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:58.206464 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b25b09-c555-4387-bdc2-90b22bf0b11b admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:58.207491 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b25b09-c555-4387-bdc2-90b22bf0b11b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:35:58.210059 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b25b09-c555-4387-bdc2-90b22bf0b11b admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:35:58.226030 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3244/6448] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:35:58 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:35:58.234829 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3674a7e7-c569-4597-8b2a-30ce7cfc0b12 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:35:58.250240 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3674a7e7-c569-4597-8b2a-30ce7cfc0b12 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:35:58.260767 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f0ebf3-1e7d-42b5-802b-f6a6f09d2189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:35:58.260767 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0ebf3-1e7d-42b5-802b-f6a6f09d2189 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:58.260767 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0ebf3-1e7d-42b5-802b-f6a6f09d2189 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:58.260767 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0ebf3-1e7d-42b5-802b-f6a6f09d2189 admin admin] PATH_INFO: `/v3/projects/c3fca887bdec47efa050d2bb472a923e/users/f33e758535ac44a48c735a799cbf789d/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:58.281111 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f0ebf3-1e7d-42b5-802b-f6a6f09d2189 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3fca887bdec47efa050d2bb472a923e, user_id=f33e758535ac44a48c735a799cbf789d, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:35:58.284195 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f0ebf3-1e7d-42b5-802b-f6a6f09d2189 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:35:58.357268 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3205/6449] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:35:58 2022] PUT /identity/v3/projects/c3fca887bdec47efa050d2bb472a923e/users/f33e758535ac44a48c735a799cbf789d/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:35:58.369101 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ba564-2581-4422-b8b9-4011fbe044a8 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:58.369101 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ba564-2581-4422-b8b9-4011fbe044a8 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:58.369101 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ba564-2581-4422-b8b9-4011fbe044a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:58.403869 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-de4ba564-2581-4422-b8b9-4011fbe044a8 None None] MFA Rules not processed for user `f33e758535ac44a48c735a799cbf789d`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:35:58.406176 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-de4ba564-2581-4422-b8b9-4011fbe044a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:35:58.506920 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3245/6450] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:35:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:35:58.511075 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f0ebf3-1e7d-42b5-802b-f6a6f09d2189 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:35:58.609279 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f0ebf3-1e7d-42b5-802b-f6a6f09d2189 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:35:58.616105 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a84c680-81e0-4cd2-9581-500d7483e8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:35:58.617706 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a84c680-81e0-4cd2-9581-500d7483e8dc admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:58.618011 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a84c680-81e0-4cd2-9581-500d7483e8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:58.619654 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a84c680-81e0-4cd2-9581-500d7483e8dc admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:58.619654 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a84c680-81e0-4cd2-9581-500d7483e8dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:35:58.622554 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a84c680-81e0-4cd2-9581-500d7483e8dc admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:35:58.877891 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3206/6451] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:35:58 2022] POST /identity/v3/projects => generated 385 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:35:58.882152 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ba564-2581-4422-b8b9-4011fbe044a8 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:35:58.899705 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ba564-2581-4422-b8b9-4011fbe044a8 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:35:59.216526 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2631e836-59f4-4a99-bab4-c2141aa0641f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:35:59.216526 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2631e836-59f4-4a99-bab4-c2141aa0641f admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:59.216526 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2631e836-59f4-4a99-bab4-c2141aa0641f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:59.216526 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2631e836-59f4-4a99-bab4-c2141aa0641f admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:59.216978 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2631e836-59f4-4a99-bab4-c2141aa0641f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:35:59.218015 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2631e836-59f4-4a99-bab4-c2141aa0641f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:35:59.311944 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3246/6452] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:35:58 2022] POST /identity/v3/users => generated 299 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:35:59.316132 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a84c680-81e0-4cd2-9581-500d7483e8dc admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:35:59.341445 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a84c680-81e0-4cd2-9581-500d7483e8dc admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:35:59.350512 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47cb160-7d8f-4765-8283-ad0c827a486e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:35:59.352012 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47cb160-7d8f-4765-8283-ad0c827a486e admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:59.353014 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47cb160-7d8f-4765-8283-ad0c827a486e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:59.353491 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47cb160-7d8f-4765-8283-ad0c827a486e admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:59.354575 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47cb160-7d8f-4765-8283-ad0c827a486e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:35:59.360869 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47cb160-7d8f-4765-8283-ad0c827a486e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:35:59.387439 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2631e836-59f4-4a99-bab4-c2141aa0641f admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:35:59.400121 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2631e836-59f4-4a99-bab4-c2141aa0641f admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:35:59.400343 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3207/6453] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:35:59 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:35:59.407865 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a1d670-d1f9-4d3d-8d09-ac64f3c20bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:35:59.411201 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a1d670-d1f9-4d3d-8d09-ac64f3c20bb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:59.412218 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a1d670-d1f9-4d3d-8d09-ac64f3c20bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:59.413519 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a1d670-d1f9-4d3d-8d09-ac64f3c20bb0 admin admin] PATH_INFO: `/v3/projects/4c123c66c9ed48269db43421cb8f439b/users/b3ab3d3cadc1422d8cdae432a0230db3/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:59.448594 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a1d670-d1f9-4d3d-8d09-ac64f3c20bb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c123c66c9ed48269db43421cb8f439b, user_id=b3ab3d3cadc1422d8cdae432a0230db3, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:35:59.452033 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a1d670-d1f9-4d3d-8d09-ac64f3c20bb0 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:35:59.538441 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47cb160-7d8f-4765-8283-ad0c827a486e admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:35:59.539290 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3247/6454] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:35:59 2022] PUT /identity/v3/projects/4c123c66c9ed48269db43421cb8f439b/users/b3ab3d3cadc1422d8cdae432a0230db3/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:35:59.558777 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47cb160-7d8f-4765-8283-ad0c827a486e admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:35:59.659305 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c0af53-dc4d-469c-bdf2-29147acb3fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:35:59.660244 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0af53-dc4d-469c-bdf2-29147acb3fd2 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:59.660444 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0af53-dc4d-469c-bdf2-29147acb3fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:59.660933 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0af53-dc4d-469c-bdf2-29147acb3fd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:59.661671 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c0af53-dc4d-469c-bdf2-29147acb3fd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:35:59.663353 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c0af53-dc4d-469c-bdf2-29147acb3fd2 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:35:59.678146 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3208/6455] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:35:59 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:35:59.683065 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a1d670-d1f9-4d3d-8d09-ac64f3c20bb0 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:35:59.704205 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a1d670-d1f9-4d3d-8d09-ac64f3c20bb0 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:35:59.736388 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6d194c-9a1e-4a94-8dd4-f7130c893b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:35:59.736388 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d194c-9a1e-4a94-8dd4-f7130c893b2a admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:59.736388 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d194c-9a1e-4a94-8dd4-f7130c893b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:59.736388 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d194c-9a1e-4a94-8dd4-f7130c893b2a admin admin] PATH_INFO: `/v3/projects/4c123c66c9ed48269db43421cb8f439b/users/b3ab3d3cadc1422d8cdae432a0230db3/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:59.743220 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6d194c-9a1e-4a94-8dd4-f7130c893b2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c123c66c9ed48269db43421cb8f439b, user_id=b3ab3d3cadc1422d8cdae432a0230db3, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:35:59.749064 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6d194c-9a1e-4a94-8dd4-f7130c893b2a admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:35:59.778778 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3248/6456] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:35:59 2022] PUT /identity/v3/projects/4c123c66c9ed48269db43421cb8f439b/users/b3ab3d3cadc1422d8cdae432a0230db3/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:35:59.782065 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d2b38-9d28-496c-b36d-9de3583fcbb4 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:35:59.782065 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d2b38-9d28-496c-b36d-9de3583fcbb4 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:35:59.782065 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d2b38-9d28-496c-b36d-9de3583fcbb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:35:59.824511 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-ce9d2b38-9d28-496c-b36d-9de3583fcbb4 None None] MFA Rules not processed for user `b3ab3d3cadc1422d8cdae432a0230db3`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:35:59.827912 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-ce9d2b38-9d28-496c-b36d-9de3583fcbb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:35:59.972490 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3209/6457] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:35:59 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:35:59.985707 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6d194c-9a1e-4a94-8dd4-f7130c893b2a admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:35:59.988410 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ba6d194c-9a1e-4a94-8dd4-f7130c893b2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:36:00.209646 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6d194c-9a1e-4a94-8dd4-f7130c893b2a admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:00.232816 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01906335-6a66-4751-804e-b8b5d490bf1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198271d1c0d44cb58bace41a65f4b94c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:00.239068 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01906335-6a66-4751-804e-b8b5d490bf1d service cinder] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:00.239068 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01906335-6a66-4751-804e-b8b5d490bf1d service cinder] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:00.239068 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01906335-6a66-4751-804e-b8b5d490bf1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:00.254722 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01906335-6a66-4751-804e-b8b5d490bf1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:00.256530 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01906335-6a66-4751-804e-b8b5d490bf1d service cinder] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:00.268638 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3249/6458] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:35:59 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:36:00.581268 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d2b38-9d28-496c-b36d-9de3583fcbb4 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:00.739214 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d2b38-9d28-496c-b36d-9de3583fcbb4 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:00.752300 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04386366-9ea0-41c9-9ebc-368b65de9665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:00.753520 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04386366-9ea0-41c9-9ebc-368b65de9665 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:00.755233 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04386366-9ea0-41c9-9ebc-368b65de9665 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:00.755792 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04386366-9ea0-41c9-9ebc-368b65de9665 admin admin] PATH_INFO: `/v3/users/f33e758535ac44a48c735a799cbf789d` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:00.759450 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04386366-9ea0-41c9-9ebc-368b65de9665 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f33e758535ac44a48c735a799cbf789d)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:00.762193 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04386366-9ea0-41c9-9ebc-368b65de9665 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:01.060561 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-04386366-9ea0-41c9-9ebc-368b65de9665 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f33e758535ac44a48c735a799cbf789d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:01.075634 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-04386366-9ea0-41c9-9ebc-368b65de9665 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f33e758535ac44a48c735a799cbf789d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:01.080124 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-04386366-9ea0-41c9-9ebc-368b65de9665 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f33e758535ac44a48c735a799cbf789d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:01.183627 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-04386366-9ea0-41c9-9ebc-368b65de9665 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f33e758535ac44a48c735a799cbf789d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:01.223180 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-04386366-9ea0-41c9-9ebc-368b65de9665 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f33e758535ac44a48c735a799cbf789d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:01.243280 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3210/6459] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:36:00 2022] DELETE /identity/v3/users/f33e758535ac44a48c735a799cbf789d => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:36:01.245076 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c1500-7dfa-4275-b72f-7d8abccaf3f0 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:01.245532 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c1500-7dfa-4275-b72f-7d8abccaf3f0 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:01.245686 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c1500-7dfa-4275-b72f-7d8abccaf3f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:01.313453 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-7d8c1500-7dfa-4275-b72f-7d8abccaf3f0 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:36:01.325852 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-7d8c1500-7dfa-4275-b72f-7d8abccaf3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:36:01.524446 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3250/6460] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:36:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:36:01.561120 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04386366-9ea0-41c9-9ebc-368b65de9665 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:01.564153 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-04386366-9ea0-41c9-9ebc-368b65de9665 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:36:01.676766 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04386366-9ea0-41c9-9ebc-368b65de9665 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:01.684050 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df08f574-284b-4333-936c-758b9c4fc069 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:01.685365 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df08f574-284b-4333-936c-758b9c4fc069 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:01.686023 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df08f574-284b-4333-936c-758b9c4fc069 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:01.686515 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df08f574-284b-4333-936c-758b9c4fc069 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:01.765669 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df08f574-284b-4333-936c-758b9c4fc069 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:01.774310 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df08f574-284b-4333-936c-758b9c4fc069 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:01.821199 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3211/6461] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:36:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:36:03.275827 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c1500-7dfa-4275-b72f-7d8abccaf3f0 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:03.278842 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-7d8c1500-7dfa-4275-b72f-7d8abccaf3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:36:03.307249 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c1500-7dfa-4275-b72f-7d8abccaf3f0 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:03.336691 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f444358-9680-4908-af1e-766df56a0086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:03.337851 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f444358-9680-4908-af1e-766df56a0086 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:03.338325 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f444358-9680-4908-af1e-766df56a0086 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:03.338971 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f444358-9680-4908-af1e-766df56a0086 admin admin] PATH_INFO: `/v3/projects/c3fca887bdec47efa050d2bb472a923e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:03.340444 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f444358-9680-4908-af1e-766df56a0086 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3fca887bdec47efa050d2bb472a923e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:03.344885 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f444358-9680-4908-af1e-766df56a0086 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:03.568225 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-1f444358-9680-4908-af1e-766df56a0086 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3fca887bdec47efa050d2bb472a923e', 'request_id': 'req-1f444358-9680-4908-af1e-766df56a0086'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:03.593959 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-1f444358-9680-4908-af1e-766df56a0086 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3fca887bdec47efa050d2bb472a923e', 'request_id': 'req-1f444358-9680-4908-af1e-766df56a0086'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:03.687327 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-1f444358-9680-4908-af1e-766df56a0086 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3fca887bdec47efa050d2bb472a923e', 'request_id': 'req-1f444358-9680-4908-af1e-766df56a0086'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:03.728192 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-1f444358-9680-4908-af1e-766df56a0086 admin admin] The token cache is being invalidate because project c3fca887bdec47efa050d2bb472a923e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:36:03.728574 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-1f444358-9680-4908-af1e-766df56a0086 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:03.729348 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-1f444358-9680-4908-af1e-766df56a0086 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:03.736778 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3251/6462] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:36:03 2022] DELETE /identity/v3/projects/c3fca887bdec47efa050d2bb472a923e => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:36:03.741481 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df08f574-284b-4333-936c-758b9c4fc069 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:03.767374 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df08f574-284b-4333-936c-758b9c4fc069 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:03.981504 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522205bb-c472-4eb3-a3e9-d1962ac04482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:03.982613 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522205bb-c472-4eb3-a3e9-d1962ac04482 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:03.983001 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522205bb-c472-4eb3-a3e9-d1962ac04482 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:03.983379 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522205bb-c472-4eb3-a3e9-d1962ac04482 admin admin] PATH_INFO: `/v3/users/b3ab3d3cadc1422d8cdae432a0230db3` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:03.984765 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522205bb-c472-4eb3-a3e9-d1962ac04482 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3ab3d3cadc1422d8cdae432a0230db3)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:03.986825 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522205bb-c472-4eb3-a3e9-d1962ac04482 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:04.296208 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-522205bb-c472-4eb3-a3e9-d1962ac04482 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3ab3d3cadc1422d8cdae432a0230db3'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:04.314308 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-522205bb-c472-4eb3-a3e9-d1962ac04482 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3ab3d3cadc1422d8cdae432a0230db3'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:04.315289 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-522205bb-c472-4eb3-a3e9-d1962ac04482 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3ab3d3cadc1422d8cdae432a0230db3'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:04.415508 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-522205bb-c472-4eb3-a3e9-d1962ac04482 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3ab3d3cadc1422d8cdae432a0230db3'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:04.440254 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-522205bb-c472-4eb3-a3e9-d1962ac04482 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3ab3d3cadc1422d8cdae432a0230db3'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:04.449228 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3212/6463] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:36:03 2022] DELETE /identity/v3/users/b3ab3d3cadc1422d8cdae432a0230db3 => generated 0 bytes in 708 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:36:05.475194 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f444358-9680-4908-af1e-766df56a0086 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:05.476732 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-1f444358-9680-4908-af1e-766df56a0086 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:36:05.503415 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f444358-9680-4908-af1e-766df56a0086 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:05.628457 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9d7302-1880-4ac1-a3e0-6f84b4ba6135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:05.629511 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d7302-1880-4ac1-a3e0-6f84b4ba6135 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:05.629638 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d7302-1880-4ac1-a3e0-6f84b4ba6135 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:05.630002 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d7302-1880-4ac1-a3e0-6f84b4ba6135 admin admin] PATH_INFO: `/v3/projects/4c123c66c9ed48269db43421cb8f439b` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:05.633039 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9d7302-1880-4ac1-a3e0-6f84b4ba6135 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c123c66c9ed48269db43421cb8f439b)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:05.635753 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9d7302-1880-4ac1-a3e0-6f84b4ba6135 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:05.809026 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3a9d7302-1880-4ac1-a3e0-6f84b4ba6135 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c123c66c9ed48269db43421cb8f439b', 'request_id': 'req-3a9d7302-1880-4ac1-a3e0-6f84b4ba6135'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:05.818134 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3a9d7302-1880-4ac1-a3e0-6f84b4ba6135 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c123c66c9ed48269db43421cb8f439b', 'request_id': 'req-3a9d7302-1880-4ac1-a3e0-6f84b4ba6135'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:05.924539 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3a9d7302-1880-4ac1-a3e0-6f84b4ba6135 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c123c66c9ed48269db43421cb8f439b', 'request_id': 'req-3a9d7302-1880-4ac1-a3e0-6f84b4ba6135'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:05.947189 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3a9d7302-1880-4ac1-a3e0-6f84b4ba6135 admin admin] The token cache is being invalidate because project 4c123c66c9ed48269db43421cb8f439b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:36:05.947576 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3a9d7302-1880-4ac1-a3e0-6f84b4ba6135 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:05.949986 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3a9d7302-1880-4ac1-a3e0-6f84b4ba6135 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:05.953425 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3252/6464] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:36:05 2022] DELETE /identity/v3/projects/4c123c66c9ed48269db43421cb8f439b => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:36:05.958982 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bd5f1-3871-41b7-b777-090b7f8f09ed None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:05.959918 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bd5f1-3871-41b7-b777-090b7f8f09ed None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:05.960783 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bd5f1-3871-41b7-b777-090b7f8f09ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:06.028053 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-971bd5f1-3871-41b7-b777-090b7f8f09ed None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:36:06.029766 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-971bd5f1-3871-41b7-b777-090b7f8f09ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:36:06.153177 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3213/6465] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:36:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:36:06.162679 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9568c072-88e1-4abf-b465-5c61f1f8e7fa None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:06.162966 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9568c072-88e1-4abf-b465-5c61f1f8e7fa None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:06.163372 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9568c072-88e1-4abf-b465-5c61f1f8e7fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:06.182873 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-9568c072-88e1-4abf-b465-5c61f1f8e7fa None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:36:06.184143 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-9568c072-88e1-4abf-b465-5c61f1f8e7fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:36:06.193232 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3253/6466] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:36:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:36:06.197648 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971bd5f1-3871-41b7-b777-090b7f8f09ed None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:06.214837 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971bd5f1-3871-41b7-b777-090b7f8f09ed None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:06.216901 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bffc6f5-9726-4c11-b233-c04e062e4a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:06.217859 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bffc6f5-9726-4c11-b233-c04e062e4a57 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:06.218383 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bffc6f5-9726-4c11-b233-c04e062e4a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:06.218879 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bffc6f5-9726-4c11-b233-c04e062e4a57 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:06.219940 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bffc6f5-9726-4c11-b233-c04e062e4a57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:36:06.220506 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bffc6f5-9726-4c11-b233-c04e062e4a57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:06.222399 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bffc6f5-9726-4c11-b233-c04e062e4a57 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:06.242788 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3214/6467] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:36:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:36:06.242924 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9568c072-88e1-4abf-b465-5c61f1f8e7fa None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:06.252828 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9568c072-88e1-4abf-b465-5c61f1f8e7fa None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:06.260274 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d62648-54a4-4f8c-91a9-2a9e66fbb2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:06.266342 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d62648-54a4-4f8c-91a9-2a9e66fbb2b2 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:06.266342 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d62648-54a4-4f8c-91a9-2a9e66fbb2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:06.266342 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d62648-54a4-4f8c-91a9-2a9e66fbb2b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:06.266342 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d62648-54a4-4f8c-91a9-2a9e66fbb2b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:06.266342 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d62648-54a4-4f8c-91a9-2a9e66fbb2b2 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:06.390881 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3254/6468] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:36:06 2022] POST /identity/v3/projects => generated 379 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:36:06.396174 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bffc6f5-9726-4c11-b233-c04e062e4a57 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:06.414263 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bffc6f5-9726-4c11-b233-c04e062e4a57 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:06.508456 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73309b3d-21cd-41a9-bb53-5b523d5f132c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:06.509367 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73309b3d-21cd-41a9-bb53-5b523d5f132c admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:06.509841 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73309b3d-21cd-41a9-bb53-5b523d5f132c admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:06.511550 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73309b3d-21cd-41a9-bb53-5b523d5f132c admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:06.512475 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73309b3d-21cd-41a9-bb53-5b523d5f132c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:06.515544 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73309b3d-21cd-41a9-bb53-5b523d5f132c admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:06.650085 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3215/6469] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:36:06 2022] POST /identity/v3/users => generated 290 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:36:06.657228 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d62648-54a4-4f8c-91a9-2a9e66fbb2b2 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:06.669350 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d62648-54a4-4f8c-91a9-2a9e66fbb2b2 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:06.674940 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc7180d-16eb-47f6-a015-ae8445787d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:06.676189 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc7180d-16eb-47f6-a015-ae8445787d50 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:06.676777 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc7180d-16eb-47f6-a015-ae8445787d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:06.677220 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc7180d-16eb-47f6-a015-ae8445787d50 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:06.678241 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc7180d-16eb-47f6-a015-ae8445787d50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:06.680128 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc7180d-16eb-47f6-a015-ae8445787d50 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:06.699365 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73309b3d-21cd-41a9-bb53-5b523d5f132c admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:06.706306 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3255/6470] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:36:06 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:36:06.711075 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73309b3d-21cd-41a9-bb53-5b523d5f132c admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:06.725402 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c40f7bd-bf97-4ece-8e17-62bd5c48561c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:06.725402 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c40f7bd-bf97-4ece-8e17-62bd5c48561c admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:06.725402 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c40f7bd-bf97-4ece-8e17-62bd5c48561c admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:06.725402 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c40f7bd-bf97-4ece-8e17-62bd5c48561c admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:06.725883 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c40f7bd-bf97-4ece-8e17-62bd5c48561c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:06.725883 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c40f7bd-bf97-4ece-8e17-62bd5c48561c admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:06.735724 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3216/6471] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:36:06 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:36:06.740541 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc7180d-16eb-47f6-a015-ae8445787d50 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:06.751330 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc7180d-16eb-47f6-a015-ae8445787d50 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:06.757939 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02226ea-b7a9-42ea-80ed-7283003f2ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:06.758902 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02226ea-b7a9-42ea-80ed-7283003f2ed1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:06.759189 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02226ea-b7a9-42ea-80ed-7283003f2ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:06.759468 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02226ea-b7a9-42ea-80ed-7283003f2ed1 admin admin] PATH_INFO: `/v3/projects/d4214b0ff5dd43a9a0200401fa549116/users/c09c0eb2977e42ebbc5de42792bee22c/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:06.778529 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02226ea-b7a9-42ea-80ed-7283003f2ed1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4214b0ff5dd43a9a0200401fa549116, user_id=c09c0eb2977e42ebbc5de42792bee22c, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:06.781782 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02226ea-b7a9-42ea-80ed-7283003f2ed1 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:06.872802 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3256/6472] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:36:06 2022] PUT /identity/v3/projects/d4214b0ff5dd43a9a0200401fa549116/users/c09c0eb2977e42ebbc5de42792bee22c/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:36:06.886096 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca2f812-070a-49b6-b0e4-fbfba0c35ece None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:06.886636 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca2f812-070a-49b6-b0e4-fbfba0c35ece None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:06.887124 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca2f812-070a-49b6-b0e4-fbfba0c35ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:06.945379 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-fca2f812-070a-49b6-b0e4-fbfba0c35ece None None] MFA Rules not processed for user `c09c0eb2977e42ebbc5de42792bee22c`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:36:06.946896 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-fca2f812-070a-49b6-b0e4-fbfba0c35ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:36:07.077426 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02226ea-b7a9-42ea-80ed-7283003f2ed1 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:07.077640 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3217/6473] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:36:06 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:36:07.199425 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02226ea-b7a9-42ea-80ed-7283003f2ed1 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:07.210915 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62700c7f-1c64-43e8-9ba8-d3cc77449079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:07.215959 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62700c7f-1c64-43e8-9ba8-d3cc77449079 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:07.216277 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62700c7f-1c64-43e8-9ba8-d3cc77449079 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:07.216713 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62700c7f-1c64-43e8-9ba8-d3cc77449079 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:07.217666 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62700c7f-1c64-43e8-9ba8-d3cc77449079 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:07.220726 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62700c7f-1c64-43e8-9ba8-d3cc77449079 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:07.360733 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca2f812-070a-49b6-b0e4-fbfba0c35ece None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:07.375128 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3257/6474] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:36:07 2022] POST /identity/v3/projects => generated 377 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:36:07.382383 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca2f812-070a-49b6-b0e4-fbfba0c35ece None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:07.516900 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc9582d-cd26-4d4d-a694-43ccabc7272b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:07.520159 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9582d-cd26-4d4d-a694-43ccabc7272b admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:07.520820 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9582d-cd26-4d4d-a694-43ccabc7272b admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:07.521266 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9582d-cd26-4d4d-a694-43ccabc7272b admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:07.526183 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc9582d-cd26-4d4d-a694-43ccabc7272b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:07.528855 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc9582d-cd26-4d4d-a694-43ccabc7272b admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:07.658071 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62700c7f-1c64-43e8-9ba8-d3cc77449079 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:07.660440 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3218/6475] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:36:07 2022] POST /identity/v3/users => generated 295 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:36:07.684887 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62700c7f-1c64-43e8-9ba8-d3cc77449079 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:07.715524 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f85f8-32fe-4337-8a32-b96319f112ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:07.719320 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f85f8-32fe-4337-8a32-b96319f112ef admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:07.723639 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f85f8-32fe-4337-8a32-b96319f112ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:07.728625 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f85f8-32fe-4337-8a32-b96319f112ef admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:07.728625 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091f85f8-32fe-4337-8a32-b96319f112ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:07.733404 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091f85f8-32fe-4337-8a32-b96319f112ef admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:07.771822 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3258/6476] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:36:07 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:36:07.775081 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc9582d-cd26-4d4d-a694-43ccabc7272b admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:07.786503 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc9582d-cd26-4d4d-a694-43ccabc7272b admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:07.799913 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a78309-413b-427f-9891-2d40459ffe5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:07.801673 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a78309-413b-427f-9891-2d40459ffe5e admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:07.802937 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a78309-413b-427f-9891-2d40459ffe5e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:07.803380 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a78309-413b-427f-9891-2d40459ffe5e admin admin] PATH_INFO: `/v3/projects/3c075ca5be1b45b292f21b4047f317e2/users/6bf6b1b4e9794fdeb85d3104f93bbfce/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:07.837329 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a78309-413b-427f-9891-2d40459ffe5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c075ca5be1b45b292f21b4047f317e2, user_id=6bf6b1b4e9794fdeb85d3104f93bbfce, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:07.837329 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a78309-413b-427f-9891-2d40459ffe5e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:07.954871 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3219/6477] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:36:07 2022] PUT /identity/v3/projects/3c075ca5be1b45b292f21b4047f317e2/users/6bf6b1b4e9794fdeb85d3104f93bbfce/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:36:07.959112 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f85f8-32fe-4337-8a32-b96319f112ef admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:07.975124 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f85f8-32fe-4337-8a32-b96319f112ef admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:08.141322 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341a4772-ef9d-4a55-aa76-6aa843032051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:08.141852 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a4772-ef9d-4a55-aa76-6aa843032051 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:08.142211 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a4772-ef9d-4a55-aa76-6aa843032051 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:08.142566 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a4772-ef9d-4a55-aa76-6aa843032051 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:08.143779 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341a4772-ef9d-4a55-aa76-6aa843032051 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:08.146091 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341a4772-ef9d-4a55-aa76-6aa843032051 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:08.165446 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3259/6478] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:36:07 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:36:08.166633 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a78309-413b-427f-9891-2d40459ffe5e admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:08.193434 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a78309-413b-427f-9891-2d40459ffe5e admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:08.206132 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0043d48b-bd54-40fe-a4cb-56ce766ffdd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:08.207019 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043d48b-bd54-40fe-a4cb-56ce766ffdd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:08.207303 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043d48b-bd54-40fe-a4cb-56ce766ffdd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:08.212189 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043d48b-bd54-40fe-a4cb-56ce766ffdd5 admin admin] PATH_INFO: `/v3/projects/3c075ca5be1b45b292f21b4047f317e2/users/6bf6b1b4e9794fdeb85d3104f93bbfce/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:08.215654 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0043d48b-bd54-40fe-a4cb-56ce766ffdd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c075ca5be1b45b292f21b4047f317e2, user_id=6bf6b1b4e9794fdeb85d3104f93bbfce, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:08.221154 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0043d48b-bd54-40fe-a4cb-56ce766ffdd5 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:08.248501 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c97c6-b6a4-47b6-b207-b908a15c1bbc None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:08.249515 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c97c6-b6a4-47b6-b207-b908a15c1bbc None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:08.249515 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c97c6-b6a4-47b6-b207-b908a15c1bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:08.251239 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3220/6479] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:36:08 2022] PUT /identity/v3/projects/3c075ca5be1b45b292f21b4047f317e2/users/6bf6b1b4e9794fdeb85d3104f93bbfce/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:36:08.292314 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-f28c97c6-b6a4-47b6-b207-b908a15c1bbc None None] MFA Rules not processed for user `6bf6b1b4e9794fdeb85d3104f93bbfce`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:36:08.294220 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-f28c97c6-b6a4-47b6-b207-b908a15c1bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:36:08.424966 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3260/6480] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:36:08 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:36:08.446511 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0043d48b-bd54-40fe-a4cb-56ce766ffdd5 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:08.451283 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-0043d48b-bd54-40fe-a4cb-56ce766ffdd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:36:08.618594 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0043d48b-bd54-40fe-a4cb-56ce766ffdd5 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:08.636238 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b95eca-afdc-496a-b06b-d16d9dd9ce85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198271d1c0d44cb58bace41a65f4b94c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:08.636935 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b95eca-afdc-496a-b06b-d16d9dd9ce85 service cinder] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:08.637223 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b95eca-afdc-496a-b06b-d16d9dd9ce85 service cinder] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:08.637502 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b95eca-afdc-496a-b06b-d16d9dd9ce85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:08.656279 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b95eca-afdc-496a-b06b-d16d9dd9ce85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:08.658160 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b95eca-afdc-496a-b06b-d16d9dd9ce85 service cinder] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:08.670759 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3221/6481] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:36:08 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:36:09.864994 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28c97c6-b6a4-47b6-b207-b908a15c1bbc None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:09.876382 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28c97c6-b6a4-47b6-b207-b908a15c1bbc None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:09.881850 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8500d8fd-854b-4ae6-a16a-7a76d0f7e11f tempest-VolumeQuotaClassesTest-87439671 tempest-VolumeQuotaClassesTest-87439671-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bf6b1b4e9794fdeb85d3104f93bbfce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c075ca5be1b45b292f21b4047f317e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:09.882877 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8500d8fd-854b-4ae6-a16a-7a76d0f7e11f tempest-VolumeQuotaClassesTest-87439671 tempest-VolumeQuotaClassesTest-87439671-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:09.883433 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8500d8fd-854b-4ae6-a16a-7a76d0f7e11f tempest-VolumeQuotaClassesTest-87439671 tempest-VolumeQuotaClassesTest-87439671-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:09.883953 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8500d8fd-854b-4ae6-a16a-7a76d0f7e11f tempest-VolumeQuotaClassesTest-87439671 tempest-VolumeQuotaClassesTest-87439671-project-admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:09.885086 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8500d8fd-854b-4ae6-a16a-7a76d0f7e11f tempest-VolumeQuotaClassesTest-87439671 tempest-VolumeQuotaClassesTest-87439671-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:36:09.885604 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8500d8fd-854b-4ae6-a16a-7a76d0f7e11f tempest-VolumeQuotaClassesTest-87439671 tempest-VolumeQuotaClassesTest-87439671-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:09.887778 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8500d8fd-854b-4ae6-a16a-7a76d0f7e11f tempest-VolumeQuotaClassesTest-87439671 tempest-VolumeQuotaClassesTest-87439671-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:09.905374 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3261/6482] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:36:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:36:09.912567 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b95eca-afdc-496a-b06b-d16d9dd9ce85 service cinder] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:09.923039 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b95eca-afdc-496a-b06b-d16d9dd9ce85 service cinder] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:09.929749 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6337864-ecdf-41a8-b895-527b0db4fcba tempest-VolumeQuotaClassesTest-87439671 tempest-VolumeQuotaClassesTest-87439671-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bf6b1b4e9794fdeb85d3104f93bbfce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c075ca5be1b45b292f21b4047f317e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:09.934603 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6337864-ecdf-41a8-b895-527b0db4fcba tempest-VolumeQuotaClassesTest-87439671 tempest-VolumeQuotaClassesTest-87439671-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:09.935231 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6337864-ecdf-41a8-b895-527b0db4fcba tempest-VolumeQuotaClassesTest-87439671 tempest-VolumeQuotaClassesTest-87439671-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:09.935925 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6337864-ecdf-41a8-b895-527b0db4fcba tempest-VolumeQuotaClassesTest-87439671 tempest-VolumeQuotaClassesTest-87439671-project-admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:09.948244 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6337864-ecdf-41a8-b895-527b0db4fcba tempest-VolumeQuotaClassesTest-87439671 tempest-VolumeQuotaClassesTest-87439671-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:09.951083 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6337864-ecdf-41a8-b895-527b0db4fcba tempest-VolumeQuotaClassesTest-87439671 tempest-VolumeQuotaClassesTest-87439671-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:10.081508 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3222/6483] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:36:09 2022] POST /identity/v3/projects => generated 353 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:36:10.085888 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8500d8fd-854b-4ae6-a16a-7a76d0f7e11f tempest-VolumeQuotaClassesTest-87439671 tempest-VolumeQuotaClassesTest-87439671-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:10.100313 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8500d8fd-854b-4ae6-a16a-7a76d0f7e11f tempest-VolumeQuotaClassesTest-87439671 tempest-VolumeQuotaClassesTest-87439671-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:10.219106 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4aef4c-cd4f-46f8-982e-eabf764e9d13 tempest-VolumeQuotaClassesTest-87439671 tempest-VolumeQuotaClassesTest-87439671-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bf6b1b4e9794fdeb85d3104f93bbfce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c075ca5be1b45b292f21b4047f317e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:10.220210 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4aef4c-cd4f-46f8-982e-eabf764e9d13 tempest-VolumeQuotaClassesTest-87439671 tempest-VolumeQuotaClassesTest-87439671-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:10.220718 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4aef4c-cd4f-46f8-982e-eabf764e9d13 tempest-VolumeQuotaClassesTest-87439671 tempest-VolumeQuotaClassesTest-87439671-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:10.221923 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4aef4c-cd4f-46f8-982e-eabf764e9d13 tempest-VolumeQuotaClassesTest-87439671 tempest-VolumeQuotaClassesTest-87439671-project-admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:10.223938 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4aef4c-cd4f-46f8-982e-eabf764e9d13 tempest-VolumeQuotaClassesTest-87439671 tempest-VolumeQuotaClassesTest-87439671-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:36:10.224638 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4aef4c-cd4f-46f8-982e-eabf764e9d13 tempest-VolumeQuotaClassesTest-87439671 tempest-VolumeQuotaClassesTest-87439671-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:10.226292 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4aef4c-cd4f-46f8-982e-eabf764e9d13 tempest-VolumeQuotaClassesTest-87439671 tempest-VolumeQuotaClassesTest-87439671-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:10.251320 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3262/6484] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:36:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:36:10.315399 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6337864-ecdf-41a8-b895-527b0db4fcba tempest-VolumeQuotaClassesTest-87439671 tempest-VolumeQuotaClassesTest-87439671-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:10.332526 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6337864-ecdf-41a8-b895-527b0db4fcba tempest-VolumeQuotaClassesTest-87439671 tempest-VolumeQuotaClassesTest-87439671-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:10.350187 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c1a31-d1d9-4bd4-a923-92327f8e9452 tempest-VolumeQuotaClassesTest-87439671 tempest-VolumeQuotaClassesTest-87439671-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bf6b1b4e9794fdeb85d3104f93bbfce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c075ca5be1b45b292f21b4047f317e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:10.351497 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c1a31-d1d9-4bd4-a923-92327f8e9452 tempest-VolumeQuotaClassesTest-87439671 tempest-VolumeQuotaClassesTest-87439671-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:10.352012 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c1a31-d1d9-4bd4-a923-92327f8e9452 tempest-VolumeQuotaClassesTest-87439671 tempest-VolumeQuotaClassesTest-87439671-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:10.352884 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c1a31-d1d9-4bd4-a923-92327f8e9452 tempest-VolumeQuotaClassesTest-87439671 tempest-VolumeQuotaClassesTest-87439671-project-admin] PATH_INFO: `/v3/projects/afb6bfedcc2846e4864025a80d008f1d` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:10.354782 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203c1a31-d1d9-4bd4-a923-92327f8e9452 tempest-VolumeQuotaClassesTest-87439671 tempest-VolumeQuotaClassesTest-87439671-project-admin] RBAC: Authorizing `identity:delete_project(project_id=afb6bfedcc2846e4864025a80d008f1d)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:10.357314 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203c1a31-d1d9-4bd4-a923-92327f8e9452 tempest-VolumeQuotaClassesTest-87439671 tempest-VolumeQuotaClassesTest-87439671-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:10.516268 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-203c1a31-d1d9-4bd4-a923-92327f8e9452 tempest-VolumeQuotaClassesTest-87439671 tempest-VolumeQuotaClassesTest-87439671-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afb6bfedcc2846e4864025a80d008f1d', 'request_id': 'req-203c1a31-d1d9-4bd4-a923-92327f8e9452'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:10.539956 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-203c1a31-d1d9-4bd4-a923-92327f8e9452 tempest-VolumeQuotaClassesTest-87439671 tempest-VolumeQuotaClassesTest-87439671-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afb6bfedcc2846e4864025a80d008f1d', 'request_id': 'req-203c1a31-d1d9-4bd4-a923-92327f8e9452'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:10.551211 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-203c1a31-d1d9-4bd4-a923-92327f8e9452 tempest-VolumeQuotaClassesTest-87439671 tempest-VolumeQuotaClassesTest-87439671-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afb6bfedcc2846e4864025a80d008f1d', 'request_id': 'req-203c1a31-d1d9-4bd4-a923-92327f8e9452'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:10.644223 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-203c1a31-d1d9-4bd4-a923-92327f8e9452 tempest-VolumeQuotaClassesTest-87439671 tempest-VolumeQuotaClassesTest-87439671-project-admin] The token cache is being invalidate because project afb6bfedcc2846e4864025a80d008f1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:36:10.645441 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-203c1a31-d1d9-4bd4-a923-92327f8e9452 tempest-VolumeQuotaClassesTest-87439671 tempest-VolumeQuotaClassesTest-87439671-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:10.649497 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-203c1a31-d1d9-4bd4-a923-92327f8e9452 tempest-VolumeQuotaClassesTest-87439671 tempest-VolumeQuotaClassesTest-87439671-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:10.651511 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3223/6485] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:36:10 2022] DELETE /identity/v3/projects/afb6bfedcc2846e4864025a80d008f1d => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:36:11.637678 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4aef4c-cd4f-46f8-982e-eabf764e9d13 tempest-VolumeQuotaClassesTest-87439671 tempest-VolumeQuotaClassesTest-87439671-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:11.640216 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-df4aef4c-cd4f-46f8-982e-eabf764e9d13 tempest-VolumeQuotaClassesTest-87439671 tempest-VolumeQuotaClassesTest-87439671-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:36:11.715904 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4aef4c-cd4f-46f8-982e-eabf764e9d13 tempest-VolumeQuotaClassesTest-87439671 tempest-VolumeQuotaClassesTest-87439671-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:11.795356 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1264f82c-3498-4794-977d-4e7ad3c9ad5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:11.796809 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1264f82c-3498-4794-977d-4e7ad3c9ad5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:11.797257 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1264f82c-3498-4794-977d-4e7ad3c9ad5c admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:11.797696 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1264f82c-3498-4794-977d-4e7ad3c9ad5c admin admin] PATH_INFO: `/v3/users/c09c0eb2977e42ebbc5de42792bee22c` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:11.799742 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1264f82c-3498-4794-977d-4e7ad3c9ad5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c09c0eb2977e42ebbc5de42792bee22c)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:11.802580 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1264f82c-3498-4794-977d-4e7ad3c9ad5c admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:12.076860 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-1264f82c-3498-4794-977d-4e7ad3c9ad5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c09c0eb2977e42ebbc5de42792bee22c'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:12.098169 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-1264f82c-3498-4794-977d-4e7ad3c9ad5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c09c0eb2977e42ebbc5de42792bee22c'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:12.121302 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-1264f82c-3498-4794-977d-4e7ad3c9ad5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c09c0eb2977e42ebbc5de42792bee22c'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:12.201007 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-1264f82c-3498-4794-977d-4e7ad3c9ad5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c09c0eb2977e42ebbc5de42792bee22c'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:12.202621 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-1264f82c-3498-4794-977d-4e7ad3c9ad5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c09c0eb2977e42ebbc5de42792bee22c'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:12.210786 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3263/6486] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:36:11 2022] DELETE /identity/v3/users/c09c0eb2977e42ebbc5de42792bee22c => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:36:12.215411 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac113f65-4edf-4048-96df-5da6b023908f None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:12.215940 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac113f65-4edf-4048-96df-5da6b023908f None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:12.216029 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac113f65-4edf-4048-96df-5da6b023908f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:12.242485 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-ac113f65-4edf-4048-96df-5da6b023908f None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:36:12.242485 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-ac113f65-4edf-4048-96df-5da6b023908f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:36:12.327888 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3224/6487] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:36:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:36:12.349155 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1264f82c-3498-4794-977d-4e7ad3c9ad5c admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:12.350569 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-1264f82c-3498-4794-977d-4e7ad3c9ad5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:36:12.447203 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1264f82c-3498-4794-977d-4e7ad3c9ad5c admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:12.453113 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb8365b-2964-4d69-a1cf-e7d81a467a05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:12.454997 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb8365b-2964-4d69-a1cf-e7d81a467a05 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:12.455541 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb8365b-2964-4d69-a1cf-e7d81a467a05 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:12.456033 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb8365b-2964-4d69-a1cf-e7d81a467a05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:12.474777 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb8365b-2964-4d69-a1cf-e7d81a467a05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:12.476426 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb8365b-2964-4d69-a1cf-e7d81a467a05 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:12.493119 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3264/6488] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:36:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:36:14.142687 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac113f65-4edf-4048-96df-5da6b023908f None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:14.145205 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-ac113f65-4edf-4048-96df-5da6b023908f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:36:14.162712 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac113f65-4edf-4048-96df-5da6b023908f None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:14.175975 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac4cc20-581a-4a30-8f72-2163269e5c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:14.179632 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4cc20-581a-4a30-8f72-2163269e5c50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:14.179632 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4cc20-581a-4a30-8f72-2163269e5c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:14.179632 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4cc20-581a-4a30-8f72-2163269e5c50 admin admin] PATH_INFO: `/v3/projects/d4214b0ff5dd43a9a0200401fa549116` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:14.180843 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac4cc20-581a-4a30-8f72-2163269e5c50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4214b0ff5dd43a9a0200401fa549116)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:14.187063 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac4cc20-581a-4a30-8f72-2163269e5c50 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:14.532684 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-fac4cc20-581a-4a30-8f72-2163269e5c50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4214b0ff5dd43a9a0200401fa549116', 'request_id': 'req-fac4cc20-581a-4a30-8f72-2163269e5c50'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:14.548334 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-fac4cc20-581a-4a30-8f72-2163269e5c50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4214b0ff5dd43a9a0200401fa549116', 'request_id': 'req-fac4cc20-581a-4a30-8f72-2163269e5c50'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:14.585458 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-fac4cc20-581a-4a30-8f72-2163269e5c50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4214b0ff5dd43a9a0200401fa549116', 'request_id': 'req-fac4cc20-581a-4a30-8f72-2163269e5c50'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:14.678703 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-fac4cc20-581a-4a30-8f72-2163269e5c50 admin admin] The token cache is being invalidate because project d4214b0ff5dd43a9a0200401fa549116 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:36:14.679368 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-fac4cc20-581a-4a30-8f72-2163269e5c50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:14.680619 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-fac4cc20-581a-4a30-8f72-2163269e5c50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:14.683389 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3225/6489] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:36:14 2022] DELETE /identity/v3/projects/d4214b0ff5dd43a9a0200401fa549116 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:36:14.687546 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb8365b-2964-4d69-a1cf-e7d81a467a05 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:14.703586 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb8365b-2964-4d69-a1cf-e7d81a467a05 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:14.818161 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e002fe16-c3e2-4542-94dc-e165b49c2847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:14.819284 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e002fe16-c3e2-4542-94dc-e165b49c2847 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:14.819693 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e002fe16-c3e2-4542-94dc-e165b49c2847 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:14.820133 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e002fe16-c3e2-4542-94dc-e165b49c2847 admin admin] PATH_INFO: `/v3/users/6bf6b1b4e9794fdeb85d3104f93bbfce` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:14.821495 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e002fe16-c3e2-4542-94dc-e165b49c2847 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bf6b1b4e9794fdeb85d3104f93bbfce)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:14.824798 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e002fe16-c3e2-4542-94dc-e165b49c2847 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:15.122370 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e002fe16-c3e2-4542-94dc-e165b49c2847 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bf6b1b4e9794fdeb85d3104f93bbfce'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:15.151802 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e002fe16-c3e2-4542-94dc-e165b49c2847 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bf6b1b4e9794fdeb85d3104f93bbfce'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:15.168180 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e002fe16-c3e2-4542-94dc-e165b49c2847 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bf6b1b4e9794fdeb85d3104f93bbfce'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:15.295420 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e002fe16-c3e2-4542-94dc-e165b49c2847 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bf6b1b4e9794fdeb85d3104f93bbfce'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:15.295420 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e002fe16-c3e2-4542-94dc-e165b49c2847 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bf6b1b4e9794fdeb85d3104f93bbfce'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:15.301274 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3265/6490] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:36:14 2022] DELETE /identity/v3/users/6bf6b1b4e9794fdeb85d3104f93bbfce => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:36:16.642598 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac4cc20-581a-4a30-8f72-2163269e5c50 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:16.644969 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-fac4cc20-581a-4a30-8f72-2163269e5c50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:36:16.666891 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac4cc20-581a-4a30-8f72-2163269e5c50 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:16.796504 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644a3847-665e-462b-892d-a56d9df0886d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:16.797689 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a3847-665e-462b-892d-a56d9df0886d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:16.798130 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a3847-665e-462b-892d-a56d9df0886d admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:16.798573 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a3847-665e-462b-892d-a56d9df0886d admin admin] PATH_INFO: `/v3/projects/3c075ca5be1b45b292f21b4047f317e2` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:16.800684 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644a3847-665e-462b-892d-a56d9df0886d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c075ca5be1b45b292f21b4047f317e2)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:16.803076 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644a3847-665e-462b-892d-a56d9df0886d admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:16.961268 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-644a3847-665e-462b-892d-a56d9df0886d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c075ca5be1b45b292f21b4047f317e2', 'request_id': 'req-644a3847-665e-462b-892d-a56d9df0886d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:16.972902 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-644a3847-665e-462b-892d-a56d9df0886d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c075ca5be1b45b292f21b4047f317e2', 'request_id': 'req-644a3847-665e-462b-892d-a56d9df0886d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:16.991856 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-644a3847-665e-462b-892d-a56d9df0886d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c075ca5be1b45b292f21b4047f317e2', 'request_id': 'req-644a3847-665e-462b-892d-a56d9df0886d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:17.090727 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-644a3847-665e-462b-892d-a56d9df0886d admin admin] The token cache is being invalidate because project 3c075ca5be1b45b292f21b4047f317e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:36:17.091568 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-644a3847-665e-462b-892d-a56d9df0886d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:17.092261 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-644a3847-665e-462b-892d-a56d9df0886d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:17.093859 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3226/6491] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:36:16 2022] DELETE /identity/v3/projects/3c075ca5be1b45b292f21b4047f317e2 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:36:17.101580 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca13a49f-3c86-4f48-9d13-767ce164334b None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:17.101580 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca13a49f-3c86-4f48-9d13-767ce164334b None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:17.101580 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca13a49f-3c86-4f48-9d13-767ce164334b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:17.155047 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-ca13a49f-3c86-4f48-9d13-767ce164334b None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:36:17.156720 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ca13a49f-3c86-4f48-9d13-767ce164334b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:36:17.367770 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3266/6492] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:36:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:36:17.375844 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda99fd-d58d-445c-8076-af522f6ff533 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:17.376134 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda99fd-d58d-445c-8076-af522f6ff533 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:17.376416 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda99fd-d58d-445c-8076-af522f6ff533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:17.424335 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-fcda99fd-d58d-445c-8076-af522f6ff533 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:36:17.426134 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-fcda99fd-d58d-445c-8076-af522f6ff533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:36:17.451274 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3227/6493] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:36:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:36:17.457372 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca13a49f-3c86-4f48-9d13-767ce164334b None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:17.479332 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca13a49f-3c86-4f48-9d13-767ce164334b None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:17.488078 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda82f7e-072a-4425-bb05-8d4959c543fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:17.488870 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda82f7e-072a-4425-bb05-8d4959c543fb admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:17.489151 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda82f7e-072a-4425-bb05-8d4959c543fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:17.489428 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda82f7e-072a-4425-bb05-8d4959c543fb admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:17.490485 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda82f7e-072a-4425-bb05-8d4959c543fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:36:17.490485 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda82f7e-072a-4425-bb05-8d4959c543fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:17.492111 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda82f7e-072a-4425-bb05-8d4959c543fb admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:17.512716 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3267/6494] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:36:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:36:17.516905 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcda99fd-d58d-445c-8076-af522f6ff533 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:17.544936 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcda99fd-d58d-445c-8076-af522f6ff533 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:17.546004 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6931cf31-2773-444f-b507-5e571a80b034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:17.547002 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931cf31-2773-444f-b507-5e571a80b034 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:17.547779 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931cf31-2773-444f-b507-5e571a80b034 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:17.548140 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931cf31-2773-444f-b507-5e571a80b034 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:17.549070 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6931cf31-2773-444f-b507-5e571a80b034 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:17.551293 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6931cf31-2773-444f-b507-5e571a80b034 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:17.710522 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3228/6495] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:36:17 2022] POST /identity/v3/projects => generated 383 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:36:17.714562 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda82f7e-072a-4425-bb05-8d4959c543fb admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:17.733776 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda82f7e-072a-4425-bb05-8d4959c543fb admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:17.897557 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29433ec-9005-4416-b12e-b555ae0dbcd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:17.898902 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29433ec-9005-4416-b12e-b555ae0dbcd6 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:17.899193 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29433ec-9005-4416-b12e-b555ae0dbcd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:17.899637 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29433ec-9005-4416-b12e-b555ae0dbcd6 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:17.900370 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29433ec-9005-4416-b12e-b555ae0dbcd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:17.903223 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29433ec-9005-4416-b12e-b555ae0dbcd6 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:18.019045 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3268/6496] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:36:17 2022] POST /identity/v3/users => generated 292 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:36:18.020068 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6931cf31-2773-444f-b507-5e571a80b034 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:18.041566 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6931cf31-2773-444f-b507-5e571a80b034 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:18.056561 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e14c92-4895-44a2-a8c4-207dd5304584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:18.057539 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e14c92-4895-44a2-a8c4-207dd5304584 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:18.058029 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e14c92-4895-44a2-a8c4-207dd5304584 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:18.058463 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e14c92-4895-44a2-a8c4-207dd5304584 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:18.059426 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e14c92-4895-44a2-a8c4-207dd5304584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:18.061284 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e14c92-4895-44a2-a8c4-207dd5304584 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:18.082504 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3229/6497] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:36:18 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:36:18.086913 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29433ec-9005-4416-b12e-b555ae0dbcd6 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:18.107377 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29433ec-9005-4416-b12e-b555ae0dbcd6 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:18.117810 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9d84dc-ba33-41d4-875b-1009a879f1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:18.118496 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d84dc-ba33-41d4-875b-1009a879f1b8 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:18.118779 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d84dc-ba33-41d4-875b-1009a879f1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:18.119106 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d84dc-ba33-41d4-875b-1009a879f1b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:18.120048 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9d84dc-ba33-41d4-875b-1009a879f1b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:18.124849 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9d84dc-ba33-41d4-875b-1009a879f1b8 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:18.154452 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e14c92-4895-44a2-a8c4-207dd5304584 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:18.165101 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3269/6498] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:36:18 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:36:18.169029 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e14c92-4895-44a2-a8c4-207dd5304584 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:18.189424 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bbf809-70c5-4edb-919f-9fe5512075d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:18.193472 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bbf809-70c5-4edb-919f-9fe5512075d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:18.193472 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bbf809-70c5-4edb-919f-9fe5512075d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:18.193472 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bbf809-70c5-4edb-919f-9fe5512075d4 admin admin] PATH_INFO: `/v3/projects/6aadc80362174e27af7447356225b8a1/users/160298e5de5c4186a46f39c33df3b31e/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:18.245249 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bbf809-70c5-4edb-919f-9fe5512075d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6aadc80362174e27af7447356225b8a1, user_id=160298e5de5c4186a46f39c33df3b31e, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:18.246271 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bbf809-70c5-4edb-919f-9fe5512075d4 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:18.345664 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3230/6499] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:36:18 2022] PUT /identity/v3/projects/6aadc80362174e27af7447356225b8a1/users/160298e5de5c4186a46f39c33df3b31e/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:36:18.357557 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb67b60-a964-4d38-bbfa-8f9b874332bc None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:18.357858 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb67b60-a964-4d38-bbfa-8f9b874332bc None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:18.358139 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb67b60-a964-4d38-bbfa-8f9b874332bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:18.388522 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-bcb67b60-a964-4d38-bbfa-8f9b874332bc None None] MFA Rules not processed for user `160298e5de5c4186a46f39c33df3b31e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:36:18.390137 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-bcb67b60-a964-4d38-bbfa-8f9b874332bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:36:18.515683 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3270/6500] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:36:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:36:18.521551 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bbf809-70c5-4edb-919f-9fe5512075d4 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:18.625283 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bbf809-70c5-4edb-919f-9fe5512075d4 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:18.633225 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392f76fe-cbea-4441-85a6-75f99f6ca954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:18.633958 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f76fe-cbea-4441-85a6-75f99f6ca954 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:18.634305 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f76fe-cbea-4441-85a6-75f99f6ca954 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:18.639005 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f76fe-cbea-4441-85a6-75f99f6ca954 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:18.639923 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392f76fe-cbea-4441-85a6-75f99f6ca954 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:18.642248 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392f76fe-cbea-4441-85a6-75f99f6ca954 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:18.760128 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3231/6501] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:36:18 2022] POST /identity/v3/projects => generated 381 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:36:18.763900 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb67b60-a964-4d38-bbfa-8f9b874332bc None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:18.786693 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb67b60-a964-4d38-bbfa-8f9b874332bc None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:18.941417 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dfc216-085a-4551-940a-ee3a35d3ce07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:18.942101 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dfc216-085a-4551-940a-ee3a35d3ce07 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:18.942386 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dfc216-085a-4551-940a-ee3a35d3ce07 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:18.942770 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dfc216-085a-4551-940a-ee3a35d3ce07 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:18.943565 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dfc216-085a-4551-940a-ee3a35d3ce07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:18.945642 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dfc216-085a-4551-940a-ee3a35d3ce07 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:19.102331 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3271/6502] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:36:18 2022] POST /identity/v3/users => generated 297 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:36:19.108252 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392f76fe-cbea-4441-85a6-75f99f6ca954 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:19.121855 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392f76fe-cbea-4441-85a6-75f99f6ca954 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:19.142148 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a92d583-838c-481b-9495-ad44bea6f760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:19.142859 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a92d583-838c-481b-9495-ad44bea6f760 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:19.145896 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a92d583-838c-481b-9495-ad44bea6f760 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:19.145896 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a92d583-838c-481b-9495-ad44bea6f760 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:19.146689 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a92d583-838c-481b-9495-ad44bea6f760 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:19.148461 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a92d583-838c-481b-9495-ad44bea6f760 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:19.165720 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3232/6503] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:36:19 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:36:19.166918 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dfc216-085a-4551-940a-ee3a35d3ce07 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:19.186198 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dfc216-085a-4551-940a-ee3a35d3ce07 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:19.203741 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ded0cd-6372-4f56-bbad-0a308e41b120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:19.206870 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ded0cd-6372-4f56-bbad-0a308e41b120 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:19.207378 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ded0cd-6372-4f56-bbad-0a308e41b120 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:19.207918 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ded0cd-6372-4f56-bbad-0a308e41b120 admin admin] PATH_INFO: `/v3/projects/00eb2b07cb654ea18b0911bba2ae7538/users/486fd1f920204424bafa04b66788553c/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:19.228219 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ded0cd-6372-4f56-bbad-0a308e41b120 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00eb2b07cb654ea18b0911bba2ae7538, user_id=486fd1f920204424bafa04b66788553c, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:19.233446 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ded0cd-6372-4f56-bbad-0a308e41b120 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:19.339737 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3272/6504] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:36:19 2022] PUT /identity/v3/projects/00eb2b07cb654ea18b0911bba2ae7538/users/486fd1f920204424bafa04b66788553c/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:36:19.343761 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a92d583-838c-481b-9495-ad44bea6f760 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:19.360500 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a92d583-838c-481b-9495-ad44bea6f760 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:19.463131 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e2beb5-4e84-4142-9a5a-5efbf1dd91ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:19.467141 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2beb5-4e84-4142-9a5a-5efbf1dd91ba admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:19.467141 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2beb5-4e84-4142-9a5a-5efbf1dd91ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:19.467141 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2beb5-4e84-4142-9a5a-5efbf1dd91ba admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:19.467141 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e2beb5-4e84-4142-9a5a-5efbf1dd91ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:19.467141 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e2beb5-4e84-4142-9a5a-5efbf1dd91ba admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:19.490151 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3233/6505] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:36:19 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:36:19.499144 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ded0cd-6372-4f56-bbad-0a308e41b120 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:19.510472 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ded0cd-6372-4f56-bbad-0a308e41b120 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:19.515725 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b1d228-1a9f-4745-8d5a-e6640fa42d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:19.516945 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b1d228-1a9f-4745-8d5a-e6640fa42d48 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:19.517278 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b1d228-1a9f-4745-8d5a-e6640fa42d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:19.517606 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b1d228-1a9f-4745-8d5a-e6640fa42d48 admin admin] PATH_INFO: `/v3/projects/00eb2b07cb654ea18b0911bba2ae7538/users/486fd1f920204424bafa04b66788553c/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:19.521627 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b1d228-1a9f-4745-8d5a-e6640fa42d48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00eb2b07cb654ea18b0911bba2ae7538, user_id=486fd1f920204424bafa04b66788553c, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:19.524734 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b1d228-1a9f-4745-8d5a-e6640fa42d48 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:19.550467 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3273/6506] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:36:19 2022] PUT /identity/v3/projects/00eb2b07cb654ea18b0911bba2ae7538/users/486fd1f920204424bafa04b66788553c/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:36:19.552062 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4803beab-482a-4cee-ae03-d26a894c3149 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:19.552532 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4803beab-482a-4cee-ae03-d26a894c3149 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:19.553101 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4803beab-482a-4cee-ae03-d26a894c3149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:19.591206 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-4803beab-482a-4cee-ae03-d26a894c3149 None None] MFA Rules not processed for user `486fd1f920204424bafa04b66788553c`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:36:19.596481 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-4803beab-482a-4cee-ae03-d26a894c3149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:36:19.730171 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3234/6507] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:36:19 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:36:19.746583 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b1d228-1a9f-4745-8d5a-e6640fa42d48 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:19.746583 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-f0b1d228-1a9f-4745-8d5a-e6640fa42d48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:36:19.962091 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b1d228-1a9f-4745-8d5a-e6640fa42d48 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:19.979825 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde3e02b-3c7b-427d-9572-625747d90e58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198271d1c0d44cb58bace41a65f4b94c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:19.980432 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde3e02b-3c7b-427d-9572-625747d90e58 service cinder] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:19.980877 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde3e02b-3c7b-427d-9572-625747d90e58 service cinder] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:19.981282 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde3e02b-3c7b-427d-9572-625747d90e58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:20.010872 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde3e02b-3c7b-427d-9572-625747d90e58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:20.012726 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde3e02b-3c7b-427d-9572-625747d90e58 service cinder] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:20.050683 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3274/6508] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:36:19 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:36:20.180913 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4803beab-482a-4cee-ae03-d26a894c3149 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:20.193394 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4803beab-482a-4cee-ae03-d26a894c3149 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:20.197142 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e10d6-c335-4100-b21b-03e66ce2533f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198271d1c0d44cb58bace41a65f4b94c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:20.197805 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e10d6-c335-4100-b21b-03e66ce2533f service cinder] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:20.198092 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e10d6-c335-4100-b21b-03e66ce2533f service cinder] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:20.198372 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e10d6-c335-4100-b21b-03e66ce2533f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:20.268857 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15e10d6-c335-4100-b21b-03e66ce2533f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:20.270765 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15e10d6-c335-4100-b21b-03e66ce2533f service cinder] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:20.291862 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3235/6509] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:36:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:36:33.979780 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde3e02b-3c7b-427d-9572-625747d90e58 service cinder] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:34.098056 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde3e02b-3c7b-427d-9572-625747d90e58 service cinder] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:34.103321 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed687b3-9af4-4069-b4be-097b43e7813d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:34.104495 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed687b3-9af4-4069-b4be-097b43e7813d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:34.104781 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed687b3-9af4-4069-b4be-097b43e7813d admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:34.105063 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed687b3-9af4-4069-b4be-097b43e7813d admin admin] PATH_INFO: `/v3/users/160298e5de5c4186a46f39c33df3b31e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:34.106282 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed687b3-9af4-4069-b4be-097b43e7813d admin admin] RBAC: Authorizing `identity:delete_user(user_id=160298e5de5c4186a46f39c33df3b31e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:34.108363 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed687b3-9af4-4069-b4be-097b43e7813d admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:34.467844 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6ed687b3-9af4-4069-b4be-097b43e7813d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '160298e5de5c4186a46f39c33df3b31e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:34.494629 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6ed687b3-9af4-4069-b4be-097b43e7813d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '160298e5de5c4186a46f39c33df3b31e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:34.505389 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6ed687b3-9af4-4069-b4be-097b43e7813d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '160298e5de5c4186a46f39c33df3b31e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:34.626672 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6ed687b3-9af4-4069-b4be-097b43e7813d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '160298e5de5c4186a46f39c33df3b31e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:34.627331 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6ed687b3-9af4-4069-b4be-097b43e7813d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '160298e5de5c4186a46f39c33df3b31e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:34.644034 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920bd9f-1404-4619-99b1-312a36cb3f53 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:34.644930 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920bd9f-1404-4619-99b1-312a36cb3f53 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:34.645376 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920bd9f-1404-4619-99b1-312a36cb3f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:34.646888 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3275/6510] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:36:33 2022] DELETE /identity/v3/users/160298e5de5c4186a46f39c33df3b31e => generated 0 bytes in 659 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:36:34.666454 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-8920bd9f-1404-4619-99b1-312a36cb3f53 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:36:34.668949 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8920bd9f-1404-4619-99b1-312a36cb3f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:36:34.777653 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3236/6511] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:36:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:36:34.817973 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed687b3-9af4-4069-b4be-097b43e7813d admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:34.821006 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-6ed687b3-9af4-4069-b4be-097b43e7813d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:36:34.945691 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed687b3-9af4-4069-b4be-097b43e7813d admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:34.949767 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dca333-ccb1-4ac5-ba45-782eb8f3b1ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:34.950902 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dca333-ccb1-4ac5-ba45-782eb8f3b1ed service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:34.952300 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dca333-ccb1-4ac5-ba45-782eb8f3b1ed service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:34.953591 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dca333-ccb1-4ac5-ba45-782eb8f3b1ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:34.968759 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dca333-ccb1-4ac5-ba45-782eb8f3b1ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:34.970506 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dca333-ccb1-4ac5-ba45-782eb8f3b1ed service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:34.986443 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3276/6512] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:36:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:36:36.537866 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8920bd9f-1404-4619-99b1-312a36cb3f53 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:36.539550 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8920bd9f-1404-4619-99b1-312a36cb3f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:36:36.556666 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8920bd9f-1404-4619-99b1-312a36cb3f53 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:36.565975 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e89f7-5fa1-4247-bf8b-e6689c680655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:36.568379 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e89f7-5fa1-4247-bf8b-e6689c680655 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:36.574950 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e89f7-5fa1-4247-bf8b-e6689c680655 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:36.576430 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e89f7-5fa1-4247-bf8b-e6689c680655 admin admin] PATH_INFO: `/v3/projects/6aadc80362174e27af7447356225b8a1` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:36.579548 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19e89f7-5fa1-4247-bf8b-e6689c680655 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6aadc80362174e27af7447356225b8a1)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:36.582931 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19e89f7-5fa1-4247-bf8b-e6689c680655 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:36.743094 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a19e89f7-5fa1-4247-bf8b-e6689c680655 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6aadc80362174e27af7447356225b8a1', 'request_id': 'req-a19e89f7-5fa1-4247-bf8b-e6689c680655'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:36.756787 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a19e89f7-5fa1-4247-bf8b-e6689c680655 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6aadc80362174e27af7447356225b8a1', 'request_id': 'req-a19e89f7-5fa1-4247-bf8b-e6689c680655'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:36.775322 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a19e89f7-5fa1-4247-bf8b-e6689c680655 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6aadc80362174e27af7447356225b8a1', 'request_id': 'req-a19e89f7-5fa1-4247-bf8b-e6689c680655'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:36.939693 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a19e89f7-5fa1-4247-bf8b-e6689c680655 admin admin] The token cache is being invalidate because project 6aadc80362174e27af7447356225b8a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:36:36.940391 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a19e89f7-5fa1-4247-bf8b-e6689c680655 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:36.941731 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a19e89f7-5fa1-4247-bf8b-e6689c680655 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:36.957261 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3237/6513] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:36:36 2022] DELETE /identity/v3/projects/6aadc80362174e27af7447356225b8a1 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:36:36.960986 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dca333-ccb1-4ac5-ba45-782eb8f3b1ed service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:36.972879 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dca333-ccb1-4ac5-ba45-782eb8f3b1ed service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:37.111191 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46d2763-cd4a-41fc-b133-9f0a5c6c24e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:37.114290 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d2763-cd4a-41fc-b133-9f0a5c6c24e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:37.114706 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d2763-cd4a-41fc-b133-9f0a5c6c24e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:37.115326 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d2763-cd4a-41fc-b133-9f0a5c6c24e0 admin admin] PATH_INFO: `/v3/users/486fd1f920204424bafa04b66788553c` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:37.117037 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46d2763-cd4a-41fc-b133-9f0a5c6c24e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=486fd1f920204424bafa04b66788553c)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:37.120332 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46d2763-cd4a-41fc-b133-9f0a5c6c24e0 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:37.365717 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e46d2763-cd4a-41fc-b133-9f0a5c6c24e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '486fd1f920204424bafa04b66788553c'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:37.384028 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e46d2763-cd4a-41fc-b133-9f0a5c6c24e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '486fd1f920204424bafa04b66788553c'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:37.392885 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e46d2763-cd4a-41fc-b133-9f0a5c6c24e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '486fd1f920204424bafa04b66788553c'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:37.489130 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e46d2763-cd4a-41fc-b133-9f0a5c6c24e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '486fd1f920204424bafa04b66788553c'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:37.489779 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e46d2763-cd4a-41fc-b133-9f0a5c6c24e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '486fd1f920204424bafa04b66788553c'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:37.498808 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3277/6514] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:36:36 2022] DELETE /identity/v3/users/486fd1f920204424bafa04b66788553c => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:36:38.660190 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e89f7-5fa1-4247-bf8b-e6689c680655 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:38.663515 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-a19e89f7-5fa1-4247-bf8b-e6689c680655 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:36:38.709798 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e89f7-5fa1-4247-bf8b-e6689c680655 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:38.845974 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657076af-33cd-4b67-8f4b-56b556ef10be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:38.848249 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657076af-33cd-4b67-8f4b-56b556ef10be admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:38.849160 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657076af-33cd-4b67-8f4b-56b556ef10be admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:38.849662 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657076af-33cd-4b67-8f4b-56b556ef10be admin admin] PATH_INFO: `/v3/projects/00eb2b07cb654ea18b0911bba2ae7538` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:38.851588 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657076af-33cd-4b67-8f4b-56b556ef10be admin admin] RBAC: Authorizing `identity:delete_project(project_id=00eb2b07cb654ea18b0911bba2ae7538)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:38.854614 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657076af-33cd-4b67-8f4b-56b556ef10be admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:39.045819 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-657076af-33cd-4b67-8f4b-56b556ef10be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00eb2b07cb654ea18b0911bba2ae7538', 'request_id': 'req-657076af-33cd-4b67-8f4b-56b556ef10be'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:39.060921 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-657076af-33cd-4b67-8f4b-56b556ef10be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00eb2b07cb654ea18b0911bba2ae7538', 'request_id': 'req-657076af-33cd-4b67-8f4b-56b556ef10be'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:39.071257 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-657076af-33cd-4b67-8f4b-56b556ef10be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00eb2b07cb654ea18b0911bba2ae7538', 'request_id': 'req-657076af-33cd-4b67-8f4b-56b556ef10be'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:39.191918 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-657076af-33cd-4b67-8f4b-56b556ef10be admin admin] The token cache is being invalidate because project 00eb2b07cb654ea18b0911bba2ae7538 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:36:39.192473 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-657076af-33cd-4b67-8f4b-56b556ef10be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:39.195600 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-657076af-33cd-4b67-8f4b-56b556ef10be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:39.197669 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3238/6515] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:36:38 2022] DELETE /identity/v3/projects/00eb2b07cb654ea18b0911bba2ae7538 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:36:39.203856 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf83a48-e24e-424d-a293-046b9e3e9ba8 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:39.209590 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf83a48-e24e-424d-a293-046b9e3e9ba8 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:39.209590 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf83a48-e24e-424d-a293-046b9e3e9ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:39.232648 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-ebf83a48-e24e-424d-a293-046b9e3e9ba8 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:36:39.232648 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ebf83a48-e24e-424d-a293-046b9e3e9ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:36:39.342044 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3278/6516] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:36:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:36:39.350491 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31403910-0d5c-4c29-8c4f-7659f36c9ec0 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:39.350776 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31403910-0d5c-4c29-8c4f-7659f36c9ec0 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:39.351240 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31403910-0d5c-4c29-8c4f-7659f36c9ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:39.392800 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-31403910-0d5c-4c29-8c4f-7659f36c9ec0 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:36:39.395528 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-31403910-0d5c-4c29-8c4f-7659f36c9ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:36:39.412681 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3239/6517] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:36:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:36:39.417237 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf83a48-e24e-424d-a293-046b9e3e9ba8 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:39.451057 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf83a48-e24e-424d-a293-046b9e3e9ba8 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:39.459078 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8aa5fa-b1cc-4087-9f33-4ac4e0f9fe24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:39.460063 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8aa5fa-b1cc-4087-9f33-4ac4e0f9fe24 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:39.460507 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8aa5fa-b1cc-4087-9f33-4ac4e0f9fe24 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:39.460942 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8aa5fa-b1cc-4087-9f33-4ac4e0f9fe24 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:39.463244 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8aa5fa-b1cc-4087-9f33-4ac4e0f9fe24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:36:39.463823 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8aa5fa-b1cc-4087-9f33-4ac4e0f9fe24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:39.467885 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8aa5fa-b1cc-4087-9f33-4ac4e0f9fe24 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:39.496237 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3279/6518] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:36:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:36:39.500740 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31403910-0d5c-4c29-8c4f-7659f36c9ec0 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:39.514005 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31403910-0d5c-4c29-8c4f-7659f36c9ec0 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:39.529900 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35776536-ffb7-4066-b1db-827ea5a10d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:39.531288 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35776536-ffb7-4066-b1db-827ea5a10d60 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:39.532125 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35776536-ffb7-4066-b1db-827ea5a10d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:39.532652 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35776536-ffb7-4066-b1db-827ea5a10d60 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:39.534124 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35776536-ffb7-4066-b1db-827ea5a10d60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:39.536754 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35776536-ffb7-4066-b1db-827ea5a10d60 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:39.665563 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3240/6519] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:36:39 2022] POST /identity/v3/projects => generated 389 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:36:39.666284 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8aa5fa-b1cc-4087-9f33-4ac4e0f9fe24 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:39.680012 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8aa5fa-b1cc-4087-9f33-4ac4e0f9fe24 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:39.824408 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5234a480-1ff4-4b49-a1c2-d1f445817c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:39.825107 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5234a480-1ff4-4b49-a1c2-d1f445817c8a admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:39.830818 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5234a480-1ff4-4b49-a1c2-d1f445817c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:39.830818 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5234a480-1ff4-4b49-a1c2-d1f445817c8a admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:39.830818 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5234a480-1ff4-4b49-a1c2-d1f445817c8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:39.831237 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35776536-ffb7-4066-b1db-827ea5a10d60 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:39.832969 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-35776536-ffb7-4066-b1db-827ea5a10d60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:36:39.836249 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5234a480-1ff4-4b49-a1c2-d1f445817c8a admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:39.975530 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35776536-ffb7-4066-b1db-827ea5a10d60 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:39.979278 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a71869c-0435-4108-b616-3e44419c7312 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:39.980064 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71869c-0435-4108-b616-3e44419c7312 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:39.980354 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71869c-0435-4108-b616-3e44419c7312 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:39.980658 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71869c-0435-4108-b616-3e44419c7312 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:39.982548 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-0a71869c-0435-4108-b616-3e44419c7312 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:36:39.999311 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3280/6520] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:36:39 2022] POST /identity/v3/users => generated 295 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:36:40.000848 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5234a480-1ff4-4b49-a1c2-d1f445817c8a admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:40.032895 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5234a480-1ff4-4b49-a1c2-d1f445817c8a admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:40.045701 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b892c3e-a3ac-4e88-9e28-2742d4c2c512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:40.049932 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b892c3e-a3ac-4e88-9e28-2742d4c2c512 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:40.049932 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b892c3e-a3ac-4e88-9e28-2742d4c2c512 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:40.052428 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b892c3e-a3ac-4e88-9e28-2742d4c2c512 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:40.053281 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b892c3e-a3ac-4e88-9e28-2742d4c2c512 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:40.054923 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b892c3e-a3ac-4e88-9e28-2742d4c2c512 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:40.086604 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3281/6521] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:36:39 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:36:40.087924 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b892c3e-a3ac-4e88-9e28-2742d4c2c512 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:40.112650 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b892c3e-a3ac-4e88-9e28-2742d4c2c512 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:40.118775 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea62f431-8645-4c7a-a8a6-a6de770cf736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:40.119877 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62f431-8645-4c7a-a8a6-a6de770cf736 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:40.120160 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62f431-8645-4c7a-a8a6-a6de770cf736 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:40.120615 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62f431-8645-4c7a-a8a6-a6de770cf736 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:40.121403 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea62f431-8645-4c7a-a8a6-a6de770cf736 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:40.123331 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea62f431-8645-4c7a-a8a6-a6de770cf736 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:40.144662 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3282/6522] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:36:40 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:36:40.149820 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea62f431-8645-4c7a-a8a6-a6de770cf736 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:40.163699 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea62f431-8645-4c7a-a8a6-a6de770cf736 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:40.170481 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3429999b-d681-4705-93bc-1900b5d46e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:40.172351 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429999b-d681-4705-93bc-1900b5d46e06 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:40.172652 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429999b-d681-4705-93bc-1900b5d46e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:40.173125 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429999b-d681-4705-93bc-1900b5d46e06 admin admin] PATH_INFO: `/v3/projects/e0bbbedb51a444deb0d14c288a4c3362/users/e1623198acee4a6eb32bbdec454bd3ef/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:40.213004 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3429999b-d681-4705-93bc-1900b5d46e06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0bbbedb51a444deb0d14c288a4c3362, user_id=e1623198acee4a6eb32bbdec454bd3ef, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:40.216719 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3429999b-d681-4705-93bc-1900b5d46e06 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:40.236483 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a71869c-0435-4108-b616-3e44419c7312 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:40.238416 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a71869c-0435-4108-b616-3e44419c7312 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:40.259709 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3241/6523] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:36:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:36:40.306290 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3283/6524] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:36:40 2022] PUT /identity/v3/projects/e0bbbedb51a444deb0d14c288a4c3362/users/e1623198acee4a6eb32bbdec454bd3ef/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:36:40.321576 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff73972-871b-46a1-89f5-dbd966e0b72e None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:40.322012 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff73972-871b-46a1-89f5-dbd966e0b72e None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:40.322391 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff73972-871b-46a1-89f5-dbd966e0b72e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:40.377880 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-bff73972-871b-46a1-89f5-dbd966e0b72e None None] MFA Rules not processed for user `e1623198acee4a6eb32bbdec454bd3ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:36:40.379405 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-bff73972-871b-46a1-89f5-dbd966e0b72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:36:40.548490 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3242/6525] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:36:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:36:40.550601 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3429999b-d681-4705-93bc-1900b5d46e06 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:40.693218 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3429999b-d681-4705-93bc-1900b5d46e06 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:40.703569 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd58550-d6d6-45d9-bb58-14c1f404334b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:40.713641 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd58550-d6d6-45d9-bb58-14c1f404334b admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:40.713641 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd58550-d6d6-45d9-bb58-14c1f404334b admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:40.713641 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd58550-d6d6-45d9-bb58-14c1f404334b admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:40.713641 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd58550-d6d6-45d9-bb58-14c1f404334b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:40.713641 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd58550-d6d6-45d9-bb58-14c1f404334b admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:40.866300 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3284/6526] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:36:40 2022] POST /identity/v3/projects => generated 387 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:36:40.870400 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff73972-871b-46a1-89f5-dbd966e0b72e None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:40.913908 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff73972-871b-46a1-89f5-dbd966e0b72e None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:41.075084 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06616a5b-a15b-4d7c-b3eb-97a25b67928d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:41.076085 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06616a5b-a15b-4d7c-b3eb-97a25b67928d admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:41.076537 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06616a5b-a15b-4d7c-b3eb-97a25b67928d admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:41.077598 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06616a5b-a15b-4d7c-b3eb-97a25b67928d admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:41.078516 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06616a5b-a15b-4d7c-b3eb-97a25b67928d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:41.080925 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06616a5b-a15b-4d7c-b3eb-97a25b67928d admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:41.281072 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3243/6527] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:36:40 2022] POST /identity/v3/users => generated 300 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:36:41.285040 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd58550-d6d6-45d9-bb58-14c1f404334b admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:41.301964 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd58550-d6d6-45d9-bb58-14c1f404334b admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:41.315895 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f50aab9-2922-4f48-ad9b-a91be9742244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:41.316861 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50aab9-2922-4f48-ad9b-a91be9742244 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:41.317489 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50aab9-2922-4f48-ad9b-a91be9742244 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:41.317950 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50aab9-2922-4f48-ad9b-a91be9742244 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:41.318875 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f50aab9-2922-4f48-ad9b-a91be9742244 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:41.320820 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f50aab9-2922-4f48-ad9b-a91be9742244 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:41.346233 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3285/6528] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:36:41.347592 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06616a5b-a15b-4d7c-b3eb-97a25b67928d admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:41.366315 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06616a5b-a15b-4d7c-b3eb-97a25b67928d admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:41.375417 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5012bb8-712e-4a97-a693-74722c87a9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:41.376372 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5012bb8-712e-4a97-a693-74722c87a9fb admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:41.376651 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5012bb8-712e-4a97-a693-74722c87a9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:41.376929 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5012bb8-712e-4a97-a693-74722c87a9fb admin admin] PATH_INFO: `/v3/projects/1ea34e0c985742da852ce5334c3c3d7e/users/bde5f6856a774e28befac575c2f9c7f8/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:41.415540 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5012bb8-712e-4a97-a693-74722c87a9fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ea34e0c985742da852ce5334c3c3d7e, user_id=bde5f6856a774e28befac575c2f9c7f8, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:41.419756 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5012bb8-712e-4a97-a693-74722c87a9fb admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:41.541015 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3244/6529] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:36:41 2022] PUT /identity/v3/projects/1ea34e0c985742da852ce5334c3c3d7e/users/bde5f6856a774e28befac575c2f9c7f8/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:36:41.544994 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f50aab9-2922-4f48-ad9b-a91be9742244 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:41.563455 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f50aab9-2922-4f48-ad9b-a91be9742244 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:41.722424 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e5caab-7fff-4e2d-8942-e011b6e314a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:41.723223 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e5caab-7fff-4e2d-8942-e011b6e314a7 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:41.723536 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e5caab-7fff-4e2d-8942-e011b6e314a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:41.723893 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e5caab-7fff-4e2d-8942-e011b6e314a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:41.724982 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e5caab-7fff-4e2d-8942-e011b6e314a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:41.728143 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e5caab-7fff-4e2d-8942-e011b6e314a7 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:41.772284 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3286/6530] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:36:41.776328 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5012bb8-712e-4a97-a693-74722c87a9fb admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:41.790774 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5012bb8-712e-4a97-a693-74722c87a9fb admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:41.798311 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f7e43-db19-4023-8fdc-0ba131b01868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:41.802669 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f7e43-db19-4023-8fdc-0ba131b01868 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:41.802866 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f7e43-db19-4023-8fdc-0ba131b01868 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:41.803130 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f7e43-db19-4023-8fdc-0ba131b01868 admin admin] PATH_INFO: `/v3/projects/1ea34e0c985742da852ce5334c3c3d7e/users/bde5f6856a774e28befac575c2f9c7f8/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:41.805746 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544f7e43-db19-4023-8fdc-0ba131b01868 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ea34e0c985742da852ce5334c3c3d7e, user_id=bde5f6856a774e28befac575c2f9c7f8, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:41.809607 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544f7e43-db19-4023-8fdc-0ba131b01868 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:41.827014 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3245/6531] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:36:41 2022] PUT /identity/v3/projects/1ea34e0c985742da852ce5334c3c3d7e/users/bde5f6856a774e28befac575c2f9c7f8/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:36:41.838259 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d18f85d-7de6-4c20-96b2-839ec58e1162 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:41.839008 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d18f85d-7de6-4c20-96b2-839ec58e1162 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:41.839393 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d18f85d-7de6-4c20-96b2-839ec58e1162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:41.905968 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-3d18f85d-7de6-4c20-96b2-839ec58e1162 None None] MFA Rules not processed for user `bde5f6856a774e28befac575c2f9c7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:36:41.907293 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-3d18f85d-7de6-4c20-96b2-839ec58e1162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:36:42.050840 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3287/6532] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:36:41 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:36:42.062742 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f7e43-db19-4023-8fdc-0ba131b01868 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:42.068397 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-544f7e43-db19-4023-8fdc-0ba131b01868 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:36:42.214839 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f7e43-db19-4023-8fdc-0ba131b01868 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:42.222949 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beea231a-d61d-4780-a8d2-b846a72dd2da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198271d1c0d44cb58bace41a65f4b94c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:42.224819 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea231a-d61d-4780-a8d2-b846a72dd2da service cinder] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:42.225105 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea231a-d61d-4780-a8d2-b846a72dd2da service cinder] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:42.225384 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea231a-d61d-4780-a8d2-b846a72dd2da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:42.254386 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beea231a-d61d-4780-a8d2-b846a72dd2da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:42.255862 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beea231a-d61d-4780-a8d2-b846a72dd2da service cinder] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:42.267649 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3246/6533] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:36:42 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:36:42.445314 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d18f85d-7de6-4c20-96b2-839ec58e1162 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:42.552648 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d18f85d-7de6-4c20-96b2-839ec58e1162 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:42.558088 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af6da2e-d214-4dc9-88b4-808b8585a734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:42.559268 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6da2e-d214-4dc9-88b4-808b8585a734 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:42.559650 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6da2e-d214-4dc9-88b4-808b8585a734 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:42.559931 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6da2e-d214-4dc9-88b4-808b8585a734 admin admin] PATH_INFO: `/v3/users/e1623198acee4a6eb32bbdec454bd3ef` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:42.561295 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af6da2e-d214-4dc9-88b4-808b8585a734 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1623198acee4a6eb32bbdec454bd3ef)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:42.564591 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af6da2e-d214-4dc9-88b4-808b8585a734 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:42.818573 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8af6da2e-d214-4dc9-88b4-808b8585a734 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1623198acee4a6eb32bbdec454bd3ef'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:42.835434 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8af6da2e-d214-4dc9-88b4-808b8585a734 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1623198acee4a6eb32bbdec454bd3ef'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:42.846878 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8af6da2e-d214-4dc9-88b4-808b8585a734 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1623198acee4a6eb32bbdec454bd3ef'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:42.969507 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8af6da2e-d214-4dc9-88b4-808b8585a734 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1623198acee4a6eb32bbdec454bd3ef'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:42.970602 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8af6da2e-d214-4dc9-88b4-808b8585a734 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1623198acee4a6eb32bbdec454bd3ef'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:42.982073 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3288/6534] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:36:42 2022] DELETE /identity/v3/users/e1623198acee4a6eb32bbdec454bd3ef => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:36:42.987877 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b963de2-23c8-4a00-a157-9073f46f71f5 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:42.988842 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b963de2-23c8-4a00-a157-9073f46f71f5 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:42.989330 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b963de2-23c8-4a00-a157-9073f46f71f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:43.014589 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-8b963de2-23c8-4a00-a157-9073f46f71f5 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:36:43.016753 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8b963de2-23c8-4a00-a157-9073f46f71f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:36:43.107253 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3247/6535] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:36:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:36:43.204351 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af6da2e-d214-4dc9-88b4-808b8585a734 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:43.208737 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-8af6da2e-d214-4dc9-88b4-808b8585a734 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:36:43.378084 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af6da2e-d214-4dc9-88b4-808b8585a734 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:43.387866 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c425f7a-b8a3-493f-a656-61d357230b2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:43.388416 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c425f7a-b8a3-493f-a656-61d357230b2d service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:43.388761 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c425f7a-b8a3-493f-a656-61d357230b2d service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:43.389049 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c425f7a-b8a3-493f-a656-61d357230b2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:43.435828 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c425f7a-b8a3-493f-a656-61d357230b2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:43.437306 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c425f7a-b8a3-493f-a656-61d357230b2d service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:43.472568 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3289/6536] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:36:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:36:43.671127 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b963de2-23c8-4a00-a157-9073f46f71f5 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:43.700425 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b963de2-23c8-4a00-a157-9073f46f71f5 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:43.706730 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d066cb7-165c-46f7-9762-5ae26c92d599 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:43.707689 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d066cb7-165c-46f7-9762-5ae26c92d599 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:43.708229 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d066cb7-165c-46f7-9762-5ae26c92d599 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:43.709320 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d066cb7-165c-46f7-9762-5ae26c92d599 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:43.718061 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-4d066cb7-165c-46f7-9762-5ae26c92d599 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:36:43.851945 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c425f7a-b8a3-493f-a656-61d357230b2d service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:43.866238 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c425f7a-b8a3-493f-a656-61d357230b2d service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:43.880778 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e25bc05-9c30-4845-9bf8-95274efba2bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:43.882587 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25bc05-9c30-4845-9bf8-95274efba2bd service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:43.883041 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25bc05-9c30-4845-9bf8-95274efba2bd service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:43.883470 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25bc05-9c30-4845-9bf8-95274efba2bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:43.888211 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-1e25bc05-9c30-4845-9bf8-95274efba2bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:36:43.910979 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d066cb7-165c-46f7-9762-5ae26c92d599 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:43.913594 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d066cb7-165c-46f7-9762-5ae26c92d599 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:43.948863 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e25bc05-9c30-4845-9bf8-95274efba2bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:43.948863 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e25bc05-9c30-4845-9bf8-95274efba2bd service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:43.989235 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3248/6537] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:36:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:36:43.990067 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3290/6538] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:36:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:36:45.506096 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d066cb7-165c-46f7-9762-5ae26c92d599 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:45.507750 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-4d066cb7-165c-46f7-9762-5ae26c92d599 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:36:45.536544 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d066cb7-165c-46f7-9762-5ae26c92d599 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:45.557130 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0963ad88-7f0a-44a9-85be-a68da3b7a5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:45.558874 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0963ad88-7f0a-44a9-85be-a68da3b7a5fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:45.559824 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0963ad88-7f0a-44a9-85be-a68da3b7a5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:45.560295 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0963ad88-7f0a-44a9-85be-a68da3b7a5fe admin admin] PATH_INFO: `/v3/projects/e0bbbedb51a444deb0d14c288a4c3362` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:45.567149 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0963ad88-7f0a-44a9-85be-a68da3b7a5fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0bbbedb51a444deb0d14c288a4c3362)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:45.572358 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0963ad88-7f0a-44a9-85be-a68da3b7a5fe admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:45.745592 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0963ad88-7f0a-44a9-85be-a68da3b7a5fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0bbbedb51a444deb0d14c288a4c3362', 'request_id': 'req-0963ad88-7f0a-44a9-85be-a68da3b7a5fe'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:45.763550 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0963ad88-7f0a-44a9-85be-a68da3b7a5fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0bbbedb51a444deb0d14c288a4c3362', 'request_id': 'req-0963ad88-7f0a-44a9-85be-a68da3b7a5fe'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:45.781531 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0963ad88-7f0a-44a9-85be-a68da3b7a5fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0bbbedb51a444deb0d14c288a4c3362', 'request_id': 'req-0963ad88-7f0a-44a9-85be-a68da3b7a5fe'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:45.873678 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0963ad88-7f0a-44a9-85be-a68da3b7a5fe admin admin] The token cache is being invalidate because project e0bbbedb51a444deb0d14c288a4c3362 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:36:45.876492 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0963ad88-7f0a-44a9-85be-a68da3b7a5fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:45.879679 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0963ad88-7f0a-44a9-85be-a68da3b7a5fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:45.881950 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3249/6539] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:36:45 2022] DELETE /identity/v3/projects/e0bbbedb51a444deb0d14c288a4c3362 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:36:45.886081 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e25bc05-9c30-4845-9bf8-95274efba2bd service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:45.907286 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e25bc05-9c30-4845-9bf8-95274efba2bd service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:46.121266 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96611729-3b2d-4adc-917f-92373f8bc487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:46.122988 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96611729-3b2d-4adc-917f-92373f8bc487 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:46.123533 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96611729-3b2d-4adc-917f-92373f8bc487 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:46.124653 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96611729-3b2d-4adc-917f-92373f8bc487 admin admin] PATH_INFO: `/v3/users/bde5f6856a774e28befac575c2f9c7f8` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:46.127788 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96611729-3b2d-4adc-917f-92373f8bc487 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bde5f6856a774e28befac575c2f9c7f8)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:46.141749 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96611729-3b2d-4adc-917f-92373f8bc487 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:46.381725 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-96611729-3b2d-4adc-917f-92373f8bc487 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bde5f6856a774e28befac575c2f9c7f8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:46.399013 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-96611729-3b2d-4adc-917f-92373f8bc487 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bde5f6856a774e28befac575c2f9c7f8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:46.410305 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-96611729-3b2d-4adc-917f-92373f8bc487 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bde5f6856a774e28befac575c2f9c7f8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:46.477616 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-96611729-3b2d-4adc-917f-92373f8bc487 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bde5f6856a774e28befac575c2f9c7f8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:46.478306 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-96611729-3b2d-4adc-917f-92373f8bc487 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bde5f6856a774e28befac575c2f9c7f8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:46.486839 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3291/6540] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:36:45 2022] DELETE /identity/v3/users/bde5f6856a774e28befac575c2f9c7f8 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:36:48.348436 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0963ad88-7f0a-44a9-85be-a68da3b7a5fe admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:48.350805 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-0963ad88-7f0a-44a9-85be-a68da3b7a5fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:36:48.386445 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0963ad88-7f0a-44a9-85be-a68da3b7a5fe admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:48.618576 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e32c34-712e-4217-b72c-0f35df5b9331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:48.620739 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e32c34-712e-4217-b72c-0f35df5b9331 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:48.621029 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e32c34-712e-4217-b72c-0f35df5b9331 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:48.621309 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e32c34-712e-4217-b72c-0f35df5b9331 admin admin] PATH_INFO: `/v3/projects/1ea34e0c985742da852ce5334c3c3d7e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:48.626610 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e32c34-712e-4217-b72c-0f35df5b9331 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ea34e0c985742da852ce5334c3c3d7e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:48.632089 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e32c34-712e-4217-b72c-0f35df5b9331 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:48.864706 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-45e32c34-712e-4217-b72c-0f35df5b9331 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ea34e0c985742da852ce5334c3c3d7e', 'request_id': 'req-45e32c34-712e-4217-b72c-0f35df5b9331'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:48.878952 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-45e32c34-712e-4217-b72c-0f35df5b9331 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ea34e0c985742da852ce5334c3c3d7e', 'request_id': 'req-45e32c34-712e-4217-b72c-0f35df5b9331'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:48.900895 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-45e32c34-712e-4217-b72c-0f35df5b9331 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ea34e0c985742da852ce5334c3c3d7e', 'request_id': 'req-45e32c34-712e-4217-b72c-0f35df5b9331'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:49.053353 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-45e32c34-712e-4217-b72c-0f35df5b9331 admin admin] The token cache is being invalidate because project 1ea34e0c985742da852ce5334c3c3d7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:36:49.053637 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-45e32c34-712e-4217-b72c-0f35df5b9331 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:49.054631 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-45e32c34-712e-4217-b72c-0f35df5b9331 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:49.059010 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3250/6541] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:36:48 2022] DELETE /identity/v3/projects/1ea34e0c985742da852ce5334c3c3d7e => generated 0 bytes in 711 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:36:49.068053 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829570c-cc51-45c1-8375-d6869788931b None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:49.068631 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829570c-cc51-45c1-8375-d6869788931b None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:49.068631 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829570c-cc51-45c1-8375-d6869788931b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:49.122157 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-3829570c-cc51-45c1-8375-d6869788931b None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:36:49.123388 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-3829570c-cc51-45c1-8375-d6869788931b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:36:49.272687 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3292/6542] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:36:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:36:49.281645 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf91615-573c-4389-b7ef-8f618a12f818 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:49.283962 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf91615-573c-4389-b7ef-8f618a12f818 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:49.283962 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf91615-573c-4389-b7ef-8f618a12f818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:49.324559 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-8cf91615-573c-4389-b7ef-8f618a12f818 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:36:49.325785 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8cf91615-573c-4389-b7ef-8f618a12f818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:36:49.350214 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3251/6543] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:36:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:36:49.354806 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3829570c-cc51-45c1-8375-d6869788931b None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:49.396668 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3829570c-cc51-45c1-8375-d6869788931b None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:49.418747 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0bdcf-802d-4a90-a6a5-0eb4747d9f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:49.419775 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0bdcf-802d-4a90-a6a5-0eb4747d9f68 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:49.420673 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0bdcf-802d-4a90-a6a5-0eb4747d9f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:49.421354 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0bdcf-802d-4a90-a6a5-0eb4747d9f68 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:49.422419 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf0bdcf-802d-4a90-a6a5-0eb4747d9f68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:36:49.422953 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf0bdcf-802d-4a90-a6a5-0eb4747d9f68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:49.427200 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf0bdcf-802d-4a90-a6a5-0eb4747d9f68 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:49.452187 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3293/6544] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:36:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:36:49.456926 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf91615-573c-4389-b7ef-8f618a12f818 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:49.488630 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf91615-573c-4389-b7ef-8f618a12f818 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:49.500789 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf7b70-5e1f-4794-a5e4-79da9c3a0cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:49.506883 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf7b70-5e1f-4794-a5e4-79da9c3a0cdc admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:49.506883 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf7b70-5e1f-4794-a5e4-79da9c3a0cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:49.506883 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf7b70-5e1f-4794-a5e4-79da9c3a0cdc admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:49.509228 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaf7b70-5e1f-4794-a5e4-79da9c3a0cdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:49.521084 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaf7b70-5e1f-4794-a5e4-79da9c3a0cdc admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:49.641546 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3252/6545] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:36:49 2022] POST /identity/v3/projects => generated 367 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:36:49.645874 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0bdcf-802d-4a90-a6a5-0eb4747d9f68 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:49.665955 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0bdcf-802d-4a90-a6a5-0eb4747d9f68 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:49.775275 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5663f1-359a-4391-bfa2-afcb156eafb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:49.778080 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5663f1-359a-4391-bfa2-afcb156eafb1 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:49.778909 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5663f1-359a-4391-bfa2-afcb156eafb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:49.779423 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5663f1-359a-4391-bfa2-afcb156eafb1 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:49.791420 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5663f1-359a-4391-bfa2-afcb156eafb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:49.793064 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5663f1-359a-4391-bfa2-afcb156eafb1 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:49.944398 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3294/6546] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:36:49 2022] POST /identity/v3/users => generated 284 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:36:49.948320 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf7b70-5e1f-4794-a5e4-79da9c3a0cdc admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:49.965750 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf7b70-5e1f-4794-a5e4-79da9c3a0cdc admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:49.975506 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db3d74-e329-4904-a569-1b44ffa0771b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:49.978334 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db3d74-e329-4904-a569-1b44ffa0771b admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:49.979445 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db3d74-e329-4904-a569-1b44ffa0771b admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:49.979999 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db3d74-e329-4904-a569-1b44ffa0771b admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:49.981083 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06db3d74-e329-4904-a569-1b44ffa0771b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:49.983864 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06db3d74-e329-4904-a569-1b44ffa0771b admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:50.003275 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3253/6547] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:36:49 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:36:50.006936 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5663f1-359a-4391-bfa2-afcb156eafb1 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:50.020371 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5663f1-359a-4391-bfa2-afcb156eafb1 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:50.026927 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4ab23f-0929-4a1f-a2f3-7e61395741e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:50.027782 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ab23f-0929-4a1f-a2f3-7e61395741e6 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:50.030539 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ab23f-0929-4a1f-a2f3-7e61395741e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:50.030539 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ab23f-0929-4a1f-a2f3-7e61395741e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:50.030539 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4ab23f-0929-4a1f-a2f3-7e61395741e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:50.031557 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4ab23f-0929-4a1f-a2f3-7e61395741e6 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:50.045854 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3295/6548] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:36:50 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:36:50.049715 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db3d74-e329-4904-a569-1b44ffa0771b admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:50.070038 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db3d74-e329-4904-a569-1b44ffa0771b admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:50.080842 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac54b1-2bb2-4d2b-b6b4-ed21cef48c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:50.082228 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac54b1-2bb2-4d2b-b6b4-ed21cef48c49 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:50.082577 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac54b1-2bb2-4d2b-b6b4-ed21cef48c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:50.083287 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac54b1-2bb2-4d2b-b6b4-ed21cef48c49 admin admin] PATH_INFO: `/v3/projects/a46379eb12e1415da18d84dd5e1cf7b8/users/33f8ff4ebd434eff9d18afb0ed75252f/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:50.111552 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ac54b1-2bb2-4d2b-b6b4-ed21cef48c49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a46379eb12e1415da18d84dd5e1cf7b8, user_id=33f8ff4ebd434eff9d18afb0ed75252f, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:50.115998 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ac54b1-2bb2-4d2b-b6b4-ed21cef48c49 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:50.227921 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3254/6549] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:36:50 2022] PUT /identity/v3/projects/a46379eb12e1415da18d84dd5e1cf7b8/users/33f8ff4ebd434eff9d18afb0ed75252f/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:36:50.239429 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e6fb7-a376-4c3c-8076-3a4e25eb6400 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:50.240409 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e6fb7-a376-4c3c-8076-3a4e25eb6400 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:50.240899 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e6fb7-a376-4c3c-8076-3a4e25eb6400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:50.343966 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-ed3e6fb7-a376-4c3c-8076-3a4e25eb6400 None None] MFA Rules not processed for user `33f8ff4ebd434eff9d18afb0ed75252f`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:36:50.350179 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ed3e6fb7-a376-4c3c-8076-3a4e25eb6400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:36:50.510954 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3296/6550] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:36:50 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:36:50.515415 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac54b1-2bb2-4d2b-b6b4-ed21cef48c49 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:50.654872 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac54b1-2bb2-4d2b-b6b4-ed21cef48c49 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:50.663442 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ed1758-f85d-4df0-b961-a1f2a95c7be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:50.664177 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed1758-f85d-4df0-b961-a1f2a95c7be9 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:50.664650 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed1758-f85d-4df0-b961-a1f2a95c7be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:50.665106 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed1758-f85d-4df0-b961-a1f2a95c7be9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:50.667906 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ed1758-f85d-4df0-b961-a1f2a95c7be9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:50.675891 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ed1758-f85d-4df0-b961-a1f2a95c7be9 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:50.815109 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3255/6551] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:36:50 2022] POST /identity/v3/projects => generated 365 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:36:50.816748 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e6fb7-a376-4c3c-8076-3a4e25eb6400 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:50.829923 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e6fb7-a376-4c3c-8076-3a4e25eb6400 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:50.903895 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9627b704-1f45-4a73-a9b6-8b9aee98ebb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:50.904615 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9627b704-1f45-4a73-a9b6-8b9aee98ebb9 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:50.904901 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9627b704-1f45-4a73-a9b6-8b9aee98ebb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:50.905178 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9627b704-1f45-4a73-a9b6-8b9aee98ebb9 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:50.906540 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9627b704-1f45-4a73-a9b6-8b9aee98ebb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:50.908848 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9627b704-1f45-4a73-a9b6-8b9aee98ebb9 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:51.047164 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3297/6552] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:36:50 2022] POST /identity/v3/users => generated 289 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:36:51.050043 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ed1758-f85d-4df0-b961-a1f2a95c7be9 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:51.068972 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ed1758-f85d-4df0-b961-a1f2a95c7be9 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:51.075805 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67895e5b-c666-4cdf-a7fe-3da48521e377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:51.076926 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67895e5b-c666-4cdf-a7fe-3da48521e377 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:51.077318 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67895e5b-c666-4cdf-a7fe-3da48521e377 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:51.077683 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67895e5b-c666-4cdf-a7fe-3da48521e377 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:51.078754 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67895e5b-c666-4cdf-a7fe-3da48521e377 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:51.082028 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67895e5b-c666-4cdf-a7fe-3da48521e377 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:51.106341 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9627b704-1f45-4a73-a9b6-8b9aee98ebb9 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:51.108431 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3256/6553] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:36:51 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:36:51.126556 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9627b704-1f45-4a73-a9b6-8b9aee98ebb9 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:51.132606 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8270417-61c8-4422-a1ff-2c9dfa785f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:51.137435 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8270417-61c8-4422-a1ff-2c9dfa785f1d admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:51.137435 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8270417-61c8-4422-a1ff-2c9dfa785f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:51.137435 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8270417-61c8-4422-a1ff-2c9dfa785f1d admin admin] PATH_INFO: `/v3/projects/4be29be078d84dbc8a6460811df2e627/users/0b6a2e069f5444eda2ae6e12f6ec1458/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:51.157748 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8270417-61c8-4422-a1ff-2c9dfa785f1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4be29be078d84dbc8a6460811df2e627, user_id=0b6a2e069f5444eda2ae6e12f6ec1458, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:51.161447 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8270417-61c8-4422-a1ff-2c9dfa785f1d admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:51.242980 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67895e5b-c666-4cdf-a7fe-3da48521e377 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:51.244519 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3298/6554] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:36:51 2022] PUT /identity/v3/projects/4be29be078d84dbc8a6460811df2e627/users/0b6a2e069f5444eda2ae6e12f6ec1458/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:36:51.266554 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67895e5b-c666-4cdf-a7fe-3da48521e377 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:51.374939 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce5ad15-64fd-4897-896a-4c45179cb12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:51.378603 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5ad15-64fd-4897-896a-4c45179cb12e admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:51.378970 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5ad15-64fd-4897-896a-4c45179cb12e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:51.379319 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5ad15-64fd-4897-896a-4c45179cb12e admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:51.381664 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce5ad15-64fd-4897-896a-4c45179cb12e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:51.383762 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce5ad15-64fd-4897-896a-4c45179cb12e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:51.406733 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8270417-61c8-4422-a1ff-2c9dfa785f1d admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:51.424968 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3257/6555] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:36:51 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:36:51.440171 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8270417-61c8-4422-a1ff-2c9dfa785f1d admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:51.448370 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4a0476-8475-46e2-ae29-dc0b7285faab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:51.450658 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a0476-8475-46e2-ae29-dc0b7285faab admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:51.450658 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a0476-8475-46e2-ae29-dc0b7285faab admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:51.450658 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a0476-8475-46e2-ae29-dc0b7285faab admin admin] PATH_INFO: `/v3/projects/4be29be078d84dbc8a6460811df2e627/users/0b6a2e069f5444eda2ae6e12f6ec1458/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:51.454249 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4a0476-8475-46e2-ae29-dc0b7285faab admin admin] RBAC: Authorizing `identity:create_grant(project_id=4be29be078d84dbc8a6460811df2e627, user_id=0b6a2e069f5444eda2ae6e12f6ec1458, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:51.469102 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4a0476-8475-46e2-ae29-dc0b7285faab admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:51.482792 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3299/6556] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:36:51 2022] PUT /identity/v3/projects/4be29be078d84dbc8a6460811df2e627/users/0b6a2e069f5444eda2ae6e12f6ec1458/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:36:51.494605 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0521d10e-068d-4762-8c8e-b747ef671e9e None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:51.494905 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0521d10e-068d-4762-8c8e-b747ef671e9e None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:51.495193 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0521d10e-068d-4762-8c8e-b747ef671e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:51.542410 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-0521d10e-068d-4762-8c8e-b747ef671e9e None None] MFA Rules not processed for user `0b6a2e069f5444eda2ae6e12f6ec1458`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:36:51.543677 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-0521d10e-068d-4762-8c8e-b747ef671e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:36:51.707343 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3258/6557] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:36:51 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:36:51.720161 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4a0476-8475-46e2-ae29-dc0b7285faab admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:51.723128 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-6a4a0476-8475-46e2-ae29-dc0b7285faab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:36:51.782475 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0521d10e-068d-4762-8c8e-b747ef671e9e None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:51.784009 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-0521d10e-068d-4762-8c8e-b747ef671e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:36:51.883645 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4a0476-8475-46e2-ae29-dc0b7285faab admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:51.899382 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ce5de-07fd-4693-abc2-ed42cd7635c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198271d1c0d44cb58bace41a65f4b94c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:51.900860 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ce5de-07fd-4693-abc2-ed42cd7635c9 service cinder] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:51.901152 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ce5de-07fd-4693-abc2-ed42cd7635c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:51.901784 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ce5de-07fd-4693-abc2-ed42cd7635c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:51.934196 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989ce5de-07fd-4693-abc2-ed42cd7635c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:51.935961 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989ce5de-07fd-4693-abc2-ed42cd7635c9 service cinder] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:51.966077 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3300/6558] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:36:51 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:36:51.994117 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0521d10e-068d-4762-8c8e-b747ef671e9e None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:52.017206 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b16b6-a909-488b-9b2f-7c4848d2824f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:52.018354 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b16b6-a909-488b-9b2f-7c4848d2824f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:52.018907 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b16b6-a909-488b-9b2f-7c4848d2824f admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:52.019264 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b16b6-a909-488b-9b2f-7c4848d2824f admin admin] PATH_INFO: `/v3/users/23b8ea40426d4ba9a9525ffc88683ee4` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:52.022442 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993b16b6-a909-488b-9b2f-7c4848d2824f admin admin] RBAC: Authorizing `identity:delete_user(user_id=23b8ea40426d4ba9a9525ffc88683ee4)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:52.024927 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993b16b6-a909-488b-9b2f-7c4848d2824f admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:52.241300 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-993b16b6-a909-488b-9b2f-7c4848d2824f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23b8ea40426d4ba9a9525ffc88683ee4'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:52.252605 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-993b16b6-a909-488b-9b2f-7c4848d2824f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23b8ea40426d4ba9a9525ffc88683ee4'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:52.253635 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-993b16b6-a909-488b-9b2f-7c4848d2824f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23b8ea40426d4ba9a9525ffc88683ee4'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:52.300548 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ce5de-07fd-4693-abc2-ed42cd7635c9 service cinder] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:52.313828 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ce5de-07fd-4693-abc2-ed42cd7635c9 service cinder] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:52.320275 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a584e204-0858-43fb-8b15-9a0a6c3be061 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198271d1c0d44cb58bace41a65f4b94c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:52.321205 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584e204-0858-43fb-8b15-9a0a6c3be061 service cinder] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:52.321653 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584e204-0858-43fb-8b15-9a0a6c3be061 service cinder] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:52.322127 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584e204-0858-43fb-8b15-9a0a6c3be061 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:52.364118 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-993b16b6-a909-488b-9b2f-7c4848d2824f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23b8ea40426d4ba9a9525ffc88683ee4'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:52.388101 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-993b16b6-a909-488b-9b2f-7c4848d2824f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23b8ea40426d4ba9a9525ffc88683ee4'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:52.405013 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3259/6559] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:36:51 2022] DELETE /identity/v3/users/23b8ea40426d4ba9a9525ffc88683ee4 => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:36:52.411146 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905abe4-9b9c-474b-8515-0cf8318350eb None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:52.411562 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905abe4-9b9c-474b-8515-0cf8318350eb None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:52.411768 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905abe4-9b9c-474b-8515-0cf8318350eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:52.449513 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-1905abe4-9b9c-474b-8515-0cf8318350eb None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:36:52.450769 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-1905abe4-9b9c-474b-8515-0cf8318350eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:36:52.474559 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a584e204-0858-43fb-8b15-9a0a6c3be061 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:52.476725 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a584e204-0858-43fb-8b15-9a0a6c3be061 service cinder] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:52.490734 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3301/6560] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:36:52 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:36:52.563718 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3260/6561] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:36:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:36:52.599096 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a584e204-0858-43fb-8b15-9a0a6c3be061 service cinder] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:52.600600 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-a584e204-0858-43fb-8b15-9a0a6c3be061 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:36:52.754198 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a584e204-0858-43fb-8b15-9a0a6c3be061 service cinder] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:52.847696 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fd9d6e-5b6b-4a48-994e-80d4936b3add service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:52.848856 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fd9d6e-5b6b-4a48-994e-80d4936b3add service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:52.849677 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fd9d6e-5b6b-4a48-994e-80d4936b3add service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:52.850187 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fd9d6e-5b6b-4a48-994e-80d4936b3add service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:52.863414 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fd9d6e-5b6b-4a48-994e-80d4936b3add service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:52.865599 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fd9d6e-5b6b-4a48-994e-80d4936b3add service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:52.882197 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3302/6562] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:36:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:36:54.508046 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1905abe4-9b9c-474b-8515-0cf8318350eb None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:54.512397 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-1905abe4-9b9c-474b-8515-0cf8318350eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:36:54.554692 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1905abe4-9b9c-474b-8515-0cf8318350eb None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:54.572197 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf7ae36-a5a6-4e1f-8f62-3a51eb279f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:54.578735 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf7ae36-a5a6-4e1f-8f62-3a51eb279f41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:54.579354 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf7ae36-a5a6-4e1f-8f62-3a51eb279f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:54.580375 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf7ae36-a5a6-4e1f-8f62-3a51eb279f41 admin admin] PATH_INFO: `/v3/projects/25cc3625fe5f4ee1bcd59980468c5a56` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:54.585084 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf7ae36-a5a6-4e1f-8f62-3a51eb279f41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25cc3625fe5f4ee1bcd59980468c5a56)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:54.589470 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf7ae36-a5a6-4e1f-8f62-3a51eb279f41 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:54.812712 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-fdf7ae36-a5a6-4e1f-8f62-3a51eb279f41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25cc3625fe5f4ee1bcd59980468c5a56', 'request_id': 'req-fdf7ae36-a5a6-4e1f-8f62-3a51eb279f41'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:54.843357 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-fdf7ae36-a5a6-4e1f-8f62-3a51eb279f41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25cc3625fe5f4ee1bcd59980468c5a56', 'request_id': 'req-fdf7ae36-a5a6-4e1f-8f62-3a51eb279f41'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:54.856016 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-fdf7ae36-a5a6-4e1f-8f62-3a51eb279f41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25cc3625fe5f4ee1bcd59980468c5a56', 'request_id': 'req-fdf7ae36-a5a6-4e1f-8f62-3a51eb279f41'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:54.950564 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-fdf7ae36-a5a6-4e1f-8f62-3a51eb279f41 admin admin] The token cache is being invalidate because project 25cc3625fe5f4ee1bcd59980468c5a56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:36:54.951232 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-fdf7ae36-a5a6-4e1f-8f62-3a51eb279f41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:54.953167 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-fdf7ae36-a5a6-4e1f-8f62-3a51eb279f41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:36:54.955490 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3261/6563] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:36:54 2022] DELETE /identity/v3/projects/25cc3625fe5f4ee1bcd59980468c5a56 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:36:54.960595 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d086577-6141-4207-b569-94c48e285c3e None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:54.961107 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d086577-6141-4207-b569-94c48e285c3e None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:54.961241 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d086577-6141-4207-b569-94c48e285c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:55.008918 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-6d086577-6141-4207-b569-94c48e285c3e None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:36:55.011205 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-6d086577-6141-4207-b569-94c48e285c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:36:55.135933 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3303/6564] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:36:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:36:55.145888 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e618a97-4dfa-4d17-873d-2cb0e9fc350d None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:55.151215 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e618a97-4dfa-4d17-873d-2cb0e9fc350d None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:55.151770 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e618a97-4dfa-4d17-873d-2cb0e9fc350d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:55.191655 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-3e618a97-4dfa-4d17-873d-2cb0e9fc350d None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:36:55.193362 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-3e618a97-4dfa-4d17-873d-2cb0e9fc350d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:36:55.217951 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3262/6565] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:36:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:36:55.219558 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d086577-6141-4207-b569-94c48e285c3e None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:55.243113 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d086577-6141-4207-b569-94c48e285c3e None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:55.255220 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddf2ea2-c6e8-4df3-8595-1fdb231e0671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:55.256203 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf2ea2-c6e8-4df3-8595-1fdb231e0671 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:55.257356 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf2ea2-c6e8-4df3-8595-1fdb231e0671 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:55.257356 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf2ea2-c6e8-4df3-8595-1fdb231e0671 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:55.258059 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddf2ea2-c6e8-4df3-8595-1fdb231e0671 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:36:55.258950 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddf2ea2-c6e8-4df3-8595-1fdb231e0671 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:55.265454 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddf2ea2-c6e8-4df3-8595-1fdb231e0671 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:55.292432 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3304/6566] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:36:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:36:55.297889 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e618a97-4dfa-4d17-873d-2cb0e9fc350d None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:55.316589 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e618a97-4dfa-4d17-873d-2cb0e9fc350d None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:55.334211 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f96a7d8-ec3b-4888-8521-b339fc930c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:55.344273 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f96a7d8-ec3b-4888-8521-b339fc930c63 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:55.345108 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f96a7d8-ec3b-4888-8521-b339fc930c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:55.347708 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f96a7d8-ec3b-4888-8521-b339fc930c63 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:55.349071 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f96a7d8-ec3b-4888-8521-b339fc930c63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:55.351803 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f96a7d8-ec3b-4888-8521-b339fc930c63 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:55.512494 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3263/6567] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:36:55 2022] POST /identity/v3/projects => generated 363 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:36:55.516738 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddf2ea2-c6e8-4df3-8595-1fdb231e0671 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:55.565684 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddf2ea2-c6e8-4df3-8595-1fdb231e0671 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:55.746654 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882a10c5-62ff-4855-ab13-8f37e36ab9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:55.747574 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a10c5-62ff-4855-ab13-8f37e36ab9c6 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:55.747938 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a10c5-62ff-4855-ab13-8f37e36ab9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:55.748228 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a10c5-62ff-4855-ab13-8f37e36ab9c6 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:55.749041 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882a10c5-62ff-4855-ab13-8f37e36ab9c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:55.752678 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882a10c5-62ff-4855-ab13-8f37e36ab9c6 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:55.854461 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3305/6568] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:36:55 2022] POST /identity/v3/users => generated 282 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:36:55.856048 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f96a7d8-ec3b-4888-8521-b339fc930c63 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:55.875219 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f96a7d8-ec3b-4888-8521-b339fc930c63 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:55.884815 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b726a0-4620-40e0-9a81-4f813f4178c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:55.885541 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b726a0-4620-40e0-9a81-4f813f4178c5 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:55.888771 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b726a0-4620-40e0-9a81-4f813f4178c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:55.888771 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b726a0-4620-40e0-9a81-4f813f4178c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:55.888771 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b726a0-4620-40e0-9a81-4f813f4178c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:55.889225 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b726a0-4620-40e0-9a81-4f813f4178c5 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:55.907291 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3264/6569] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:36:55 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:36:55.911894 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882a10c5-62ff-4855-ab13-8f37e36ab9c6 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:55.963166 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882a10c5-62ff-4855-ab13-8f37e36ab9c6 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:55.986746 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c523819-56b4-47be-9fea-0e0b8efaec70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:55.989429 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c523819-56b4-47be-9fea-0e0b8efaec70 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:55.990051 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c523819-56b4-47be-9fea-0e0b8efaec70 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:55.990557 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c523819-56b4-47be-9fea-0e0b8efaec70 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:55.993396 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c523819-56b4-47be-9fea-0e0b8efaec70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:55.998209 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c523819-56b4-47be-9fea-0e0b8efaec70 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:56.032481 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3306/6570] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:36:55 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:36:56.034699 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b726a0-4620-40e0-9a81-4f813f4178c5 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:56.050727 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b726a0-4620-40e0-9a81-4f813f4178c5 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:56.075651 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f013c1b0-3545-411c-853f-2c21d77c2755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:56.078942 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013c1b0-3545-411c-853f-2c21d77c2755 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:56.082562 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013c1b0-3545-411c-853f-2c21d77c2755 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:56.083839 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013c1b0-3545-411c-853f-2c21d77c2755 admin admin] PATH_INFO: `/v3/projects/166828606cad42a9a9d59436584ad80f/users/bc369d055704435f803b20a9b8f16a8a/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:56.120957 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f013c1b0-3545-411c-853f-2c21d77c2755 admin admin] RBAC: Authorizing `identity:create_grant(project_id=166828606cad42a9a9d59436584ad80f, user_id=bc369d055704435f803b20a9b8f16a8a, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:56.125067 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f013c1b0-3545-411c-853f-2c21d77c2755 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:56.229347 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3265/6571] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:36:56 2022] PUT /identity/v3/projects/166828606cad42a9a9d59436584ad80f/users/bc369d055704435f803b20a9b8f16a8a/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:36:56.240852 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4e27fa-6715-4f7b-bae6-85efdb739855 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:56.241144 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4e27fa-6715-4f7b-bae6-85efdb739855 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:56.241424 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4e27fa-6715-4f7b-bae6-85efdb739855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:56.279265 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-ca4e27fa-6715-4f7b-bae6-85efdb739855 None None] MFA Rules not processed for user `bc369d055704435f803b20a9b8f16a8a`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:36:56.280567 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ca4e27fa-6715-4f7b-bae6-85efdb739855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:36:56.387354 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3307/6572] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:36:56 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:36:56.452439 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f013c1b0-3545-411c-853f-2c21d77c2755 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:36:56.455074 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-f013c1b0-3545-411c-853f-2c21d77c2755 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:36:56.569454 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f013c1b0-3545-411c-853f-2c21d77c2755 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:36:56.578449 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d09e0ac-ed9b-4516-a918-6f84f80e163c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:36:56.579239 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09e0ac-ed9b-4516-a918-6f84f80e163c service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:36:56.579629 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09e0ac-ed9b-4516-a918-6f84f80e163c service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:36:56.580584 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09e0ac-ed9b-4516-a918-6f84f80e163c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:36:56.591993 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d09e0ac-ed9b-4516-a918-6f84f80e163c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:36:56.593810 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d09e0ac-ed9b-4516-a918-6f84f80e163c service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:36:56.606891 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3266/6573] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:36:56 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:37:01.918493 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4e27fa-6715-4f7b-bae6-85efdb739855 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:01.920298 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ca4e27fa-6715-4f7b-bae6-85efdb739855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:02.072570 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4e27fa-6715-4f7b-bae6-85efdb739855 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:02.082508 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39557fe8-09d8-4d96-be5f-cfca39ea8b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:02.083821 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39557fe8-09d8-4d96-be5f-cfca39ea8b42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:02.084339 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39557fe8-09d8-4d96-be5f-cfca39ea8b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:02.084860 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39557fe8-09d8-4d96-be5f-cfca39ea8b42 admin admin] PATH_INFO: `/v3/users/cbb8c5cf2d144e3791171eb3d6f83eca` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:02.103365 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39557fe8-09d8-4d96-be5f-cfca39ea8b42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbb8c5cf2d144e3791171eb3d6f83eca)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:02.105984 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39557fe8-09d8-4d96-be5f-cfca39ea8b42 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:02.390403 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-39557fe8-09d8-4d96-be5f-cfca39ea8b42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbb8c5cf2d144e3791171eb3d6f83eca'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:02.417345 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-39557fe8-09d8-4d96-be5f-cfca39ea8b42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbb8c5cf2d144e3791171eb3d6f83eca'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:02.427910 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-39557fe8-09d8-4d96-be5f-cfca39ea8b42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbb8c5cf2d144e3791171eb3d6f83eca'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:02.523909 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-39557fe8-09d8-4d96-be5f-cfca39ea8b42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbb8c5cf2d144e3791171eb3d6f83eca'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:02.523909 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-39557fe8-09d8-4d96-be5f-cfca39ea8b42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbb8c5cf2d144e3791171eb3d6f83eca'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:02.538817 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3308/6574] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:37:01 2022] DELETE /identity/v3/users/cbb8c5cf2d144e3791171eb3d6f83eca => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:37:03.674296 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d09e0ac-ed9b-4516-a918-6f84f80e163c service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:03.692792 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d09e0ac-ed9b-4516-a918-6f84f80e163c service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:03.901966 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de2e31-7899-4d95-9633-4aa4fc443007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:03.906341 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de2e31-7899-4d95-9633-4aa4fc443007 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:03.909296 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de2e31-7899-4d95-9633-4aa4fc443007 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:03.909643 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de2e31-7899-4d95-9633-4aa4fc443007 admin admin] PATH_INFO: `/v3/projects/59c0f4df562340e5bb096ef2eed9239e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:03.915351 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46de2e31-7899-4d95-9633-4aa4fc443007 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59c0f4df562340e5bb096ef2eed9239e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:03.922568 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46de2e31-7899-4d95-9633-4aa4fc443007 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:04.169883 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-46de2e31-7899-4d95-9633-4aa4fc443007 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59c0f4df562340e5bb096ef2eed9239e', 'request_id': 'req-46de2e31-7899-4d95-9633-4aa4fc443007'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:04.184895 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-46de2e31-7899-4d95-9633-4aa4fc443007 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59c0f4df562340e5bb096ef2eed9239e', 'request_id': 'req-46de2e31-7899-4d95-9633-4aa4fc443007'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:04.196752 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-46de2e31-7899-4d95-9633-4aa4fc443007 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59c0f4df562340e5bb096ef2eed9239e', 'request_id': 'req-46de2e31-7899-4d95-9633-4aa4fc443007'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:04.398070 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-46de2e31-7899-4d95-9633-4aa4fc443007 admin admin] The token cache is being invalidate because project 59c0f4df562340e5bb096ef2eed9239e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:37:04.399200 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-46de2e31-7899-4d95-9633-4aa4fc443007 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:04.399440 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-46de2e31-7899-4d95-9633-4aa4fc443007 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:04.403445 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3267/6575] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:37:03 2022] DELETE /identity/v3/projects/59c0f4df562340e5bb096ef2eed9239e => generated 0 bytes in 730 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:37:04.409675 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ac3707-b278-4978-a526-d3b5ef2cf97f None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:04.410228 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ac3707-b278-4978-a526-d3b5ef2cf97f None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:04.410228 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ac3707-b278-4978-a526-d3b5ef2cf97f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:04.448286 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-f1ac3707-b278-4978-a526-d3b5ef2cf97f None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:37:04.451751 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-f1ac3707-b278-4978-a526-d3b5ef2cf97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:04.573592 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3309/6576] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:37:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:37:04.582369 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e34ed9d-6146-413b-b3f5-29e6910148fe None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:04.582584 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e34ed9d-6146-413b-b3f5-29e6910148fe None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:04.582928 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e34ed9d-6146-413b-b3f5-29e6910148fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:04.616690 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-7e34ed9d-6146-413b-b3f5-29e6910148fe None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:37:04.618163 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-7e34ed9d-6146-413b-b3f5-29e6910148fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:04.632312 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3268/6577] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:37:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:37:04.636980 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ac3707-b278-4978-a526-d3b5ef2cf97f None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:04.652758 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ac3707-b278-4978-a526-d3b5ef2cf97f None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:04.661768 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06997059-5243-4b59-b1dd-9e3c5b1d9e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:04.661768 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06997059-5243-4b59-b1dd-9e3c5b1d9e1a admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:04.662403 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06997059-5243-4b59-b1dd-9e3c5b1d9e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:04.663039 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06997059-5243-4b59-b1dd-9e3c5b1d9e1a admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:04.664106 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06997059-5243-4b59-b1dd-9e3c5b1d9e1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:37:04.664492 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06997059-5243-4b59-b1dd-9e3c5b1d9e1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:04.666983 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06997059-5243-4b59-b1dd-9e3c5b1d9e1a admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:04.693829 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3310/6578] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:37:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:37:04.697569 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e34ed9d-6146-413b-b3f5-29e6910148fe None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:04.710740 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e34ed9d-6146-413b-b3f5-29e6910148fe None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:04.716840 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b59f28e-aa23-4f57-aef3-3e0fb2df736c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:04.717653 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b59f28e-aa23-4f57-aef3-3e0fb2df736c admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:04.718016 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b59f28e-aa23-4f57-aef3-3e0fb2df736c admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:04.718636 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b59f28e-aa23-4f57-aef3-3e0fb2df736c admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:04.720037 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b59f28e-aa23-4f57-aef3-3e0fb2df736c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:04.722486 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b59f28e-aa23-4f57-aef3-3e0fb2df736c admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:04.855362 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3269/6579] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:37:04 2022] POST /identity/v3/projects => generated 361 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:37:04.859685 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06997059-5243-4b59-b1dd-9e3c5b1d9e1a admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:04.874341 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06997059-5243-4b59-b1dd-9e3c5b1d9e1a admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:04.973628 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cb78d1-cbc4-470a-954e-c9e1766881c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:04.975713 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb78d1-cbc4-470a-954e-c9e1766881c6 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:04.975713 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb78d1-cbc4-470a-954e-c9e1766881c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:04.975713 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb78d1-cbc4-470a-954e-c9e1766881c6 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:04.977281 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cb78d1-cbc4-470a-954e-c9e1766881c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:04.979786 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cb78d1-cbc4-470a-954e-c9e1766881c6 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:05.058815 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3311/6580] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:37:04 2022] POST /identity/v3/users => generated 281 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:37:05.063252 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b59f28e-aa23-4f57-aef3-3e0fb2df736c admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:05.075050 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b59f28e-aa23-4f57-aef3-3e0fb2df736c admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:05.082897 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cf81ff-b069-42a4-bc8d-59a5eb5305d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:05.083881 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf81ff-b069-42a4-bc8d-59a5eb5305d9 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:05.084360 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf81ff-b069-42a4-bc8d-59a5eb5305d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:05.084740 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf81ff-b069-42a4-bc8d-59a5eb5305d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:05.085637 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cf81ff-b069-42a4-bc8d-59a5eb5305d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:05.088187 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cf81ff-b069-42a4-bc8d-59a5eb5305d9 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:05.112200 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3270/6581] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:37:05 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:37:05.113885 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cb78d1-cbc4-470a-954e-c9e1766881c6 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:05.150553 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cb78d1-cbc4-470a-954e-c9e1766881c6 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:05.164404 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e9bd0-e980-4333-acec-945db9b5d592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:05.171897 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e9bd0-e980-4333-acec-945db9b5d592 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:05.172438 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e9bd0-e980-4333-acec-945db9b5d592 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:05.175370 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e9bd0-e980-4333-acec-945db9b5d592 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:05.176584 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7e9bd0-e980-4333-acec-945db9b5d592 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:05.179160 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7e9bd0-e980-4333-acec-945db9b5d592 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:05.194913 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3312/6582] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:37:05 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:37:05.198654 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cf81ff-b069-42a4-bc8d-59a5eb5305d9 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:05.223364 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cf81ff-b069-42a4-bc8d-59a5eb5305d9 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:05.230098 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221f64f5-cde1-43a1-8cc1-5c253538a9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:05.231541 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f64f5-cde1-43a1-8cc1-5c253538a9a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:05.232129 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f64f5-cde1-43a1-8cc1-5c253538a9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:05.232506 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f64f5-cde1-43a1-8cc1-5c253538a9a3 admin admin] PATH_INFO: `/v3/projects/7509bf473de34194a876d89adea1132e/users/a6163176c4ce4ff482d443da027d2dce/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:05.257335 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221f64f5-cde1-43a1-8cc1-5c253538a9a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7509bf473de34194a876d89adea1132e, user_id=a6163176c4ce4ff482d443da027d2dce, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:05.260915 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221f64f5-cde1-43a1-8cc1-5c253538a9a3 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:05.393554 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3271/6583] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:37:05 2022] PUT /identity/v3/projects/7509bf473de34194a876d89adea1132e/users/a6163176c4ce4ff482d443da027d2dce/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:37:05.405660 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e0370-e378-436a-a14c-ff6a3e797f41 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:05.405960 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e0370-e378-436a-a14c-ff6a3e797f41 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:05.406246 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e0370-e378-436a-a14c-ff6a3e797f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:05.475381 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-801e0370-e378-436a-a14c-ff6a3e797f41 None None] MFA Rules not processed for user `a6163176c4ce4ff482d443da027d2dce`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:37:05.479270 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-801e0370-e378-436a-a14c-ff6a3e797f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:05.632050 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3313/6584] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:37:05 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:37:05.680730 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221f64f5-cde1-43a1-8cc1-5c253538a9a3 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:05.814732 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221f64f5-cde1-43a1-8cc1-5c253538a9a3 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:05.825867 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e9601d-73b2-433f-85b3-bbdc98f10c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:05.826769 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e9601d-73b2-433f-85b3-bbdc98f10c7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:05.831152 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e9601d-73b2-433f-85b3-bbdc98f10c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:05.831716 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e9601d-73b2-433f-85b3-bbdc98f10c7d admin admin] PATH_INFO: `/v3/users/a6163176c4ce4ff482d443da027d2dce` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:05.835967 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e9601d-73b2-433f-85b3-bbdc98f10c7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6163176c4ce4ff482d443da027d2dce)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:05.838775 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e9601d-73b2-433f-85b3-bbdc98f10c7d admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:05.985068 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801e0370-e378-436a-a14c-ff6a3e797f41 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:05.988433 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-801e0370-e378-436a-a14c-ff6a3e797f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:06.006440 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801e0370-e378-436a-a14c-ff6a3e797f41 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:06.011776 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3cd301-42b4-46c4-8984-fd207ab5ab0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:06.012777 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3cd301-42b4-46c4-8984-fd207ab5ab0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:06.013130 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3cd301-42b4-46c4-8984-fd207ab5ab0f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:06.013552 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3cd301-42b4-46c4-8984-fd207ab5ab0f admin admin] PATH_INFO: `/v3/users/33f8ff4ebd434eff9d18afb0ed75252f` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:06.015031 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3cd301-42b4-46c4-8984-fd207ab5ab0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=33f8ff4ebd434eff9d18afb0ed75252f)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:06.017399 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3cd301-42b4-46c4-8984-fd207ab5ab0f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:06.138611 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-33e9601d-73b2-433f-85b3-bbdc98f10c7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6163176c4ce4ff482d443da027d2dce'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:06.172967 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-33e9601d-73b2-433f-85b3-bbdc98f10c7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6163176c4ce4ff482d443da027d2dce'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:06.177054 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-33e9601d-73b2-433f-85b3-bbdc98f10c7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6163176c4ce4ff482d443da027d2dce'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:06.257531 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-33e9601d-73b2-433f-85b3-bbdc98f10c7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6163176c4ce4ff482d443da027d2dce'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:06.279150 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-33e9601d-73b2-433f-85b3-bbdc98f10c7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6163176c4ce4ff482d443da027d2dce'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:06.285584 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5b3cd301-42b4-46c4-8984-fd207ab5ab0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33f8ff4ebd434eff9d18afb0ed75252f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:06.294475 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3272/6585] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:37:05 2022] DELETE /identity/v3/users/a6163176c4ce4ff482d443da027d2dce => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:37:06.298933 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16522d93-a1d5-42fc-a1ee-978061deb44c None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:06.299255 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16522d93-a1d5-42fc-a1ee-978061deb44c None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:06.299454 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16522d93-a1d5-42fc-a1ee-978061deb44c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:06.310184 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5b3cd301-42b4-46c4-8984-fd207ab5ab0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33f8ff4ebd434eff9d18afb0ed75252f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:06.320522 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5b3cd301-42b4-46c4-8984-fd207ab5ab0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33f8ff4ebd434eff9d18afb0ed75252f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:06.340278 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-16522d93-a1d5-42fc-a1ee-978061deb44c None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:37:06.340546 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-16522d93-a1d5-42fc-a1ee-978061deb44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:06.391711 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5b3cd301-42b4-46c4-8984-fd207ab5ab0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33f8ff4ebd434eff9d18afb0ed75252f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:06.392831 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5b3cd301-42b4-46c4-8984-fd207ab5ab0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33f8ff4ebd434eff9d18afb0ed75252f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:06.403756 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3314/6586] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:37:05 2022] DELETE /identity/v3/users/33f8ff4ebd434eff9d18afb0ed75252f => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:37:06.405852 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419ddc0-c2f0-4985-82aa-447acea50616 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:06.406151 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419ddc0-c2f0-4985-82aa-447acea50616 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:06.406435 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419ddc0-c2f0-4985-82aa-447acea50616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:06.443810 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3273/6587] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:37:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:37:06.453383 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-8419ddc0-c2f0-4985-82aa-447acea50616 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:37:06.456166 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-8419ddc0-c2f0-4985-82aa-447acea50616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:06.473142 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16522d93-a1d5-42fc-a1ee-978061deb44c None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:06.475223 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-16522d93-a1d5-42fc-a1ee-978061deb44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:06.566164 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3315/6588] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:37:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:37:06.590351 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16522d93-a1d5-42fc-a1ee-978061deb44c None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:06.604715 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8419ddc0-c2f0-4985-82aa-447acea50616 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:06.606247 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-8419ddc0-c2f0-4985-82aa-447acea50616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:06.702168 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287af41f-0823-4302-aa88-97ad4d3693a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:06.703197 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287af41f-0823-4302-aa88-97ad4d3693a1 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:06.703563 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287af41f-0823-4302-aa88-97ad4d3693a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:06.704754 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287af41f-0823-4302-aa88-97ad4d3693a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:06.727603 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287af41f-0823-4302-aa88-97ad4d3693a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:06.729202 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8419ddc0-c2f0-4985-82aa-447acea50616 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:06.731259 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287af41f-0823-4302-aa88-97ad4d3693a1 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:06.739169 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb8055a-1ec8-46fa-8f2b-adc33c387d75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:06.740595 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb8055a-1ec8-46fa-8f2b-adc33c387d75 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:06.740595 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb8055a-1ec8-46fa-8f2b-adc33c387d75 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:06.740871 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb8055a-1ec8-46fa-8f2b-adc33c387d75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:06.746661 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3274/6589] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:37:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:37:06.752171 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb8055a-1ec8-46fa-8f2b-adc33c387d75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:06.753750 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb8055a-1ec8-46fa-8f2b-adc33c387d75 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:06.772011 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3316/6590] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:37:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:37:07.841564 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287af41f-0823-4302-aa88-97ad4d3693a1 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:07.852796 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-287af41f-0823-4302-aa88-97ad4d3693a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:07.887299 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287af41f-0823-4302-aa88-97ad4d3693a1 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:07.896747 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac8a85f-9751-4daa-8d75-eb36517d694b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:07.898039 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8a85f-9751-4daa-8d75-eb36517d694b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:07.900938 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8a85f-9751-4daa-8d75-eb36517d694b admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:07.901424 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8a85f-9751-4daa-8d75-eb36517d694b admin admin] PATH_INFO: `/v3/projects/a46379eb12e1415da18d84dd5e1cf7b8` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:07.904211 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac8a85f-9751-4daa-8d75-eb36517d694b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a46379eb12e1415da18d84dd5e1cf7b8)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:07.907457 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac8a85f-9751-4daa-8d75-eb36517d694b admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:08.156131 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-bac8a85f-9751-4daa-8d75-eb36517d694b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a46379eb12e1415da18d84dd5e1cf7b8', 'request_id': 'req-bac8a85f-9751-4daa-8d75-eb36517d694b'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:08.175855 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-bac8a85f-9751-4daa-8d75-eb36517d694b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a46379eb12e1415da18d84dd5e1cf7b8', 'request_id': 'req-bac8a85f-9751-4daa-8d75-eb36517d694b'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:08.190329 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-bac8a85f-9751-4daa-8d75-eb36517d694b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a46379eb12e1415da18d84dd5e1cf7b8', 'request_id': 'req-bac8a85f-9751-4daa-8d75-eb36517d694b'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:08.297171 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-bac8a85f-9751-4daa-8d75-eb36517d694b admin admin] The token cache is being invalidate because project a46379eb12e1415da18d84dd5e1cf7b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:37:08.297736 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-bac8a85f-9751-4daa-8d75-eb36517d694b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:08.302541 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-bac8a85f-9751-4daa-8d75-eb36517d694b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:08.305328 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3275/6591] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:37:07 2022] DELETE /identity/v3/projects/a46379eb12e1415da18d84dd5e1cf7b8 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:37:08.309252 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb8055a-1ec8-46fa-8f2b-adc33c387d75 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:08.327568 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb8055a-1ec8-46fa-8f2b-adc33c387d75 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:08.402382 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb4fb22-d212-474f-b2d3-e38ab779d040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:08.403356 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb4fb22-d212-474f-b2d3-e38ab779d040 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:08.403851 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb4fb22-d212-474f-b2d3-e38ab779d040 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:08.404319 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb4fb22-d212-474f-b2d3-e38ab779d040 admin admin] PATH_INFO: `/v3/users/0b6a2e069f5444eda2ae6e12f6ec1458` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:08.405830 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb4fb22-d212-474f-b2d3-e38ab779d040 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b6a2e069f5444eda2ae6e12f6ec1458)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:08.408375 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb4fb22-d212-474f-b2d3-e38ab779d040 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:08.608245 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-abb4fb22-d212-474f-b2d3-e38ab779d040 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b6a2e069f5444eda2ae6e12f6ec1458'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:08.632548 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-abb4fb22-d212-474f-b2d3-e38ab779d040 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b6a2e069f5444eda2ae6e12f6ec1458'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:08.642879 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-abb4fb22-d212-474f-b2d3-e38ab779d040 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b6a2e069f5444eda2ae6e12f6ec1458'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:08.698606 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac8a85f-9751-4daa-8d75-eb36517d694b admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:08.701844 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-bac8a85f-9751-4daa-8d75-eb36517d694b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:08.722462 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac8a85f-9751-4daa-8d75-eb36517d694b admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:08.727962 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f664d543-4384-4854-8af2-65520e1fbeb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:08.729222 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664d543-4384-4854-8af2-65520e1fbeb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:08.729508 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664d543-4384-4854-8af2-65520e1fbeb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:08.729973 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664d543-4384-4854-8af2-65520e1fbeb4 admin admin] PATH_INFO: `/v3/projects/7509bf473de34194a876d89adea1132e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:08.732701 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f664d543-4384-4854-8af2-65520e1fbeb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7509bf473de34194a876d89adea1132e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:08.737583 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-abb4fb22-d212-474f-b2d3-e38ab779d040 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b6a2e069f5444eda2ae6e12f6ec1458'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:08.739177 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-abb4fb22-d212-474f-b2d3-e38ab779d040 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b6a2e069f5444eda2ae6e12f6ec1458'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:08.750921 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3317/6592] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:37:08 2022] DELETE /identity/v3/users/0b6a2e069f5444eda2ae6e12f6ec1458 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:37:08.756144 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f664d543-4384-4854-8af2-65520e1fbeb4 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:08.917252 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f664d543-4384-4854-8af2-65520e1fbeb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7509bf473de34194a876d89adea1132e', 'request_id': 'req-f664d543-4384-4854-8af2-65520e1fbeb4'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:08.950020 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f664d543-4384-4854-8af2-65520e1fbeb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7509bf473de34194a876d89adea1132e', 'request_id': 'req-f664d543-4384-4854-8af2-65520e1fbeb4'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:08.959388 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f664d543-4384-4854-8af2-65520e1fbeb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7509bf473de34194a876d89adea1132e', 'request_id': 'req-f664d543-4384-4854-8af2-65520e1fbeb4'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:09.064001 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f664d543-4384-4854-8af2-65520e1fbeb4 admin admin] The token cache is being invalidate because project 7509bf473de34194a876d89adea1132e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:37:09.066038 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f664d543-4384-4854-8af2-65520e1fbeb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:09.070468 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f664d543-4384-4854-8af2-65520e1fbeb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:09.083504 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3c9c3-2ad6-4b2d-88a7-39be5aa08d83 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:09.084163 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3c9c3-2ad6-4b2d-88a7-39be5aa08d83 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:09.084443 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3c9c3-2ad6-4b2d-88a7-39be5aa08d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:09.087527 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3276/6593] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:37:08 2022] DELETE /identity/v3/projects/7509bf473de34194a876d89adea1132e => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:37:09.112914 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-fff3c9c3-2ad6-4b2d-88a7-39be5aa08d83 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:37:09.114534 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-fff3c9c3-2ad6-4b2d-88a7-39be5aa08d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:09.184787 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3318/6594] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:37:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:37:09.196571 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e95ca-0d6f-4167-8e68-726bdd119547 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:09.196571 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e95ca-0d6f-4167-8e68-726bdd119547 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:09.196571 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e95ca-0d6f-4167-8e68-726bdd119547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:09.225198 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-573e95ca-0d6f-4167-8e68-726bdd119547 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:37:09.227092 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-573e95ca-0d6f-4167-8e68-726bdd119547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:09.247682 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3277/6595] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:37:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:37:09.248037 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff3c9c3-2ad6-4b2d-88a7-39be5aa08d83 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:09.258926 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff3c9c3-2ad6-4b2d-88a7-39be5aa08d83 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:09.276300 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10d64aa-b5e8-496d-a63f-e0dfa7b1d0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:09.277095 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d64aa-b5e8-496d-a63f-e0dfa7b1d0c3 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:09.277624 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d64aa-b5e8-496d-a63f-e0dfa7b1d0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:09.278152 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d64aa-b5e8-496d-a63f-e0dfa7b1d0c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:09.279128 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10d64aa-b5e8-496d-a63f-e0dfa7b1d0c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:37:09.279694 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10d64aa-b5e8-496d-a63f-e0dfa7b1d0c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:09.281595 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10d64aa-b5e8-496d-a63f-e0dfa7b1d0c3 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:09.318839 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3319/6596] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:37:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:37:09.323677 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573e95ca-0d6f-4167-8e68-726bdd119547 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:09.338568 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573e95ca-0d6f-4167-8e68-726bdd119547 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:09.344877 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf333a7e-f6d9-46c1-96dc-4913e603a61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:09.350115 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf333a7e-f6d9-46c1-96dc-4913e603a61c admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:09.350115 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf333a7e-f6d9-46c1-96dc-4913e603a61c admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:09.350115 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf333a7e-f6d9-46c1-96dc-4913e603a61c admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:09.350115 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf333a7e-f6d9-46c1-96dc-4913e603a61c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:09.350115 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf333a7e-f6d9-46c1-96dc-4913e603a61c admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:09.482123 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3278/6597] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:37:09 2022] POST /identity/v3/projects => generated 365 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:37:09.485550 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10d64aa-b5e8-496d-a63f-e0dfa7b1d0c3 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:09.511465 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10d64aa-b5e8-496d-a63f-e0dfa7b1d0c3 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:09.666445 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8fb626-9ef0-4b10-96a9-e88022f1e547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:09.667351 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8fb626-9ef0-4b10-96a9-e88022f1e547 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:09.667845 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8fb626-9ef0-4b10-96a9-e88022f1e547 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:09.668320 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8fb626-9ef0-4b10-96a9-e88022f1e547 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:09.669512 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8fb626-9ef0-4b10-96a9-e88022f1e547 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:09.675345 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8fb626-9ef0-4b10-96a9-e88022f1e547 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:09.782994 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3320/6598] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:37:09 2022] POST /identity/v3/users => generated 283 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:37:09.787189 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf333a7e-f6d9-46c1-96dc-4913e603a61c admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:09.792360 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8fb626-9ef0-4b10-96a9-e88022f1e547 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:09.795208 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-4f8fb626-9ef0-4b10-96a9-e88022f1e547 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:09.805058 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf333a7e-f6d9-46c1-96dc-4913e603a61c admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:09.815540 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e961bf-0fd3-4e41-a947-d674deb6ff1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:09.816686 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e961bf-0fd3-4e41-a947-d674deb6ff1a admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:09.827055 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8fb626-9ef0-4b10-96a9-e88022f1e547 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:09.832890 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e961bf-0fd3-4e41-a947-d674deb6ff1a admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:09.833617 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e961bf-0fd3-4e41-a947-d674deb6ff1a admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:09.834942 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e961bf-0fd3-4e41-a947-d674deb6ff1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:09.839159 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dffeb3-539b-41dd-906d-30cc5d4a9672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:09.840211 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e961bf-0fd3-4e41-a947-d674deb6ff1a admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:09.842389 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dffeb3-539b-41dd-906d-30cc5d4a9672 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:09.842622 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dffeb3-539b-41dd-906d-30cc5d4a9672 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:09.843757 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dffeb3-539b-41dd-906d-30cc5d4a9672 admin admin] PATH_INFO: `/v3/users/22a06bece449427d91289ade79c94822` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:09.864428 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3279/6599] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:37:09 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:37:09.868469 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e961bf-0fd3-4e41-a947-d674deb6ff1a admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:09.877873 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dffeb3-539b-41dd-906d-30cc5d4a9672 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22a06bece449427d91289ade79c94822)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:09.881166 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dffeb3-539b-41dd-906d-30cc5d4a9672 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:09.889313 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e961bf-0fd3-4e41-a947-d674deb6ff1a admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:09.914706 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22b6294-c95a-4d1b-b695-fad4094a6292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:09.915404 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b6294-c95a-4d1b-b695-fad4094a6292 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:09.915743 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b6294-c95a-4d1b-b695-fad4094a6292 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:09.915997 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b6294-c95a-4d1b-b695-fad4094a6292 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:09.916729 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22b6294-c95a-4d1b-b695-fad4094a6292 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:09.918363 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22b6294-c95a-4d1b-b695-fad4094a6292 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:09.942046 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3280/6600] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:37:09 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:37:09.943280 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22b6294-c95a-4d1b-b695-fad4094a6292 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:09.962744 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22b6294-c95a-4d1b-b695-fad4094a6292 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:09.969880 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe60025-1d42-46e8-862e-8a2c7af1a188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:09.971766 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe60025-1d42-46e8-862e-8a2c7af1a188 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:09.972260 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe60025-1d42-46e8-862e-8a2c7af1a188 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:09.972973 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe60025-1d42-46e8-862e-8a2c7af1a188 admin admin] PATH_INFO: `/v3/projects/ace0f9b1178842f6a16963f30c8eb022/users/877e681d48ed49ca9c989c851ca5d378/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:10.019364 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe60025-1d42-46e8-862e-8a2c7af1a188 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ace0f9b1178842f6a16963f30c8eb022, user_id=877e681d48ed49ca9c989c851ca5d378, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:10.025776 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe60025-1d42-46e8-862e-8a2c7af1a188 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:10.136042 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3281/6601] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:37:09 2022] PUT /identity/v3/projects/ace0f9b1178842f6a16963f30c8eb022/users/877e681d48ed49ca9c989c851ca5d378/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:37:10.137311 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe60025-1d42-46e8-862e-8a2c7af1a188 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:10.139268 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8fe60025-1d42-46e8-862e-8a2c7af1a188 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:10.211611 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a8dffeb3-539b-41dd-906d-30cc5d4a9672 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22a06bece449427d91289ade79c94822'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:10.234568 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a8dffeb3-539b-41dd-906d-30cc5d4a9672 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22a06bece449427d91289ade79c94822'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:10.245414 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a8dffeb3-539b-41dd-906d-30cc5d4a9672 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22a06bece449427d91289ade79c94822'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:10.261471 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe60025-1d42-46e8-862e-8a2c7af1a188 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:10.266805 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fcf89d-cae0-4523-8eb7-721282f76f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:10.268429 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fcf89d-cae0-4523-8eb7-721282f76f82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:10.269877 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fcf89d-cae0-4523-8eb7-721282f76f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:10.270354 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fcf89d-cae0-4523-8eb7-721282f76f82 admin admin] PATH_INFO: `/v3/projects/4be29be078d84dbc8a6460811df2e627` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:10.272080 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fcf89d-cae0-4523-8eb7-721282f76f82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4be29be078d84dbc8a6460811df2e627)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:10.274378 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fcf89d-cae0-4523-8eb7-721282f76f82 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:10.338360 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a8dffeb3-539b-41dd-906d-30cc5d4a9672 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22a06bece449427d91289ade79c94822'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:10.339243 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a8dffeb3-539b-41dd-906d-30cc5d4a9672 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22a06bece449427d91289ade79c94822'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:10.362042 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3321/6602] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:37:09 2022] DELETE /identity/v3/users/22a06bece449427d91289ade79c94822 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:37:10.363917 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb4b64-ed95-4460-bd54-37a282c1443d None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:10.364499 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb4b64-ed95-4460-bd54-37a282c1443d None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:10.364988 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb4b64-ed95-4460-bd54-37a282c1443d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:10.439911 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-39fcf89d-cae0-4523-8eb7-721282f76f82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4be29be078d84dbc8a6460811df2e627', 'request_id': 'req-39fcf89d-cae0-4523-8eb7-721282f76f82'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:10.446131 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-2afb4b64-ed95-4460-bd54-37a282c1443d None None] MFA Rules not processed for user `877e681d48ed49ca9c989c851ca5d378`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:37:10.449614 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-2afb4b64-ed95-4460-bd54-37a282c1443d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:10.457039 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-39fcf89d-cae0-4523-8eb7-721282f76f82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4be29be078d84dbc8a6460811df2e627', 'request_id': 'req-39fcf89d-cae0-4523-8eb7-721282f76f82'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:10.465348 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-39fcf89d-cae0-4523-8eb7-721282f76f82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4be29be078d84dbc8a6460811df2e627', 'request_id': 'req-39fcf89d-cae0-4523-8eb7-721282f76f82'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:10.577607 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-39fcf89d-cae0-4523-8eb7-721282f76f82 admin admin] The token cache is being invalidate because project 4be29be078d84dbc8a6460811df2e627 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:37:10.578808 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-39fcf89d-cae0-4523-8eb7-721282f76f82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:10.580576 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-39fcf89d-cae0-4523-8eb7-721282f76f82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:10.582922 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3282/6603] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:37:10 2022] DELETE /identity/v3/projects/4be29be078d84dbc8a6460811df2e627 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:37:10.594385 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483edb53-8dba-4c63-9128-117374575da9 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:10.594682 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483edb53-8dba-4c63-9128-117374575da9 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:10.597144 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483edb53-8dba-4c63-9128-117374575da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:10.603806 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3322/6604] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:37:10 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:37:10.605074 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afb4b64-ed95-4460-bd54-37a282c1443d None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:10.608088 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-2afb4b64-ed95-4460-bd54-37a282c1443d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:10.652142 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-483edb53-8dba-4c63-9128-117374575da9 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:37:10.655004 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-483edb53-8dba-4c63-9128-117374575da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:10.760113 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3283/6605] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:37:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:37:10.772142 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13163d2-f1c3-4894-a731-c6cecad829d7 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:10.772532 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13163d2-f1c3-4894-a731-c6cecad829d7 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:10.772915 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13163d2-f1c3-4894-a731-c6cecad829d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:10.785877 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afb4b64-ed95-4460-bd54-37a282c1443d None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:10.795083 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4a158f-0864-47b4-ad86-504c2fd7d2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:10.802828 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4a158f-0864-47b4-ad86-504c2fd7d2a4 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:10.802828 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4a158f-0864-47b4-ad86-504c2fd7d2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:10.802828 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4a158f-0864-47b4-ad86-504c2fd7d2a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:10.802828 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4a158f-0864-47b4-ad86-504c2fd7d2a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:10.806923 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4a158f-0864-47b4-ad86-504c2fd7d2a4 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:10.810436 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-a13163d2-f1c3-4894-a731-c6cecad829d7 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:37:10.811731 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-a13163d2-f1c3-4894-a731-c6cecad829d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:10.829820 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3284/6606] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:37:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:37:10.831111 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13163d2-f1c3-4894-a731-c6cecad829d7 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:10.841622 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13163d2-f1c3-4894-a731-c6cecad829d7 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:10.849286 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea143b7d-2b02-42fc-86fa-60061b42d2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:10.849975 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea143b7d-2b02-42fc-86fa-60061b42d2da admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:10.850320 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea143b7d-2b02-42fc-86fa-60061b42d2da admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:10.850613 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea143b7d-2b02-42fc-86fa-60061b42d2da admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:10.852770 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea143b7d-2b02-42fc-86fa-60061b42d2da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:37:10.853095 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea143b7d-2b02-42fc-86fa-60061b42d2da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:10.854815 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea143b7d-2b02-42fc-86fa-60061b42d2da admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:10.878572 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3285/6607] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:37:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:37:10.881908 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea143b7d-2b02-42fc-86fa-60061b42d2da admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:10.901495 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea143b7d-2b02-42fc-86fa-60061b42d2da admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:10.910679 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61016b76-4f91-4ee3-a7c3-cb5676f996aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:10.912442 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61016b76-4f91-4ee3-a7c3-cb5676f996aa admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:10.912896 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61016b76-4f91-4ee3-a7c3-cb5676f996aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:10.913419 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61016b76-4f91-4ee3-a7c3-cb5676f996aa admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:10.914855 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61016b76-4f91-4ee3-a7c3-cb5676f996aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:10.924253 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61016b76-4f91-4ee3-a7c3-cb5676f996aa admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:10.929334 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3323/6608] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:37:10 2022] POST /identity/v3/projects => generated 367 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:37:10.933715 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4a158f-0864-47b4-ad86-504c2fd7d2a4 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:10.937403 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-8c4a158f-0864-47b4-ad86-504c2fd7d2a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:11.054625 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3286/6609] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:37:10 2022] POST /identity/v3/projects => generated 383 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:37:11.058892 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61016b76-4f91-4ee3-a7c3-cb5676f996aa admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:11.065313 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-61016b76-4f91-4ee3-a7c3-cb5676f996aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:11.090904 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4a158f-0864-47b4-ad86-504c2fd7d2a4 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:11.190261 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61016b76-4f91-4ee3-a7c3-cb5676f996aa admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:11.197806 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab37da82-3828-474e-9374-80b9dfcb6d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:11.199060 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab37da82-3828-474e-9374-80b9dfcb6d67 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:11.201906 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2724a2ac-700e-4b19-9303-1c917f1a22dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:11.202084 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab37da82-3828-474e-9374-80b9dfcb6d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:11.202084 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab37da82-3828-474e-9374-80b9dfcb6d67 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:11.202284 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724a2ac-700e-4b19-9303-1c917f1a22dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:11.202383 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab37da82-3828-474e-9374-80b9dfcb6d67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:11.202490 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724a2ac-700e-4b19-9303-1c917f1a22dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:11.202490 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724a2ac-700e-4b19-9303-1c917f1a22dd admin admin] PATH_INFO: `/v3/projects/1df1ae61bf82472dadc4830840421a63` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:11.208377 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab37da82-3828-474e-9374-80b9dfcb6d67 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:11.221229 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2724a2ac-700e-4b19-9303-1c917f1a22dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=1df1ae61bf82472dadc4830840421a63)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:11.228766 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2724a2ac-700e-4b19-9303-1c917f1a22dd admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:11.324810 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3324/6610] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:37:10 2022] POST /identity/v3/users => generated 290 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:37:11.326250 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab37da82-3828-474e-9374-80b9dfcb6d67 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:11.339441 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab37da82-3828-474e-9374-80b9dfcb6d67 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:11.347816 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a7ece5-e0b1-414e-a526-57cb6dc05238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:11.348999 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a7ece5-e0b1-414e-a526-57cb6dc05238 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:11.349552 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a7ece5-e0b1-414e-a526-57cb6dc05238 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:11.350059 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a7ece5-e0b1-414e-a526-57cb6dc05238 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:11.351307 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a7ece5-e0b1-414e-a526-57cb6dc05238 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:11.353478 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a7ece5-e0b1-414e-a526-57cb6dc05238 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:11.387093 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-2724a2ac-700e-4b19-9303-1c917f1a22dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1df1ae61bf82472dadc4830840421a63', 'request_id': 'req-2724a2ac-700e-4b19-9303-1c917f1a22dd'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:11.396616 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-2724a2ac-700e-4b19-9303-1c917f1a22dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1df1ae61bf82472dadc4830840421a63', 'request_id': 'req-2724a2ac-700e-4b19-9303-1c917f1a22dd'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:11.412956 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-2724a2ac-700e-4b19-9303-1c917f1a22dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1df1ae61bf82472dadc4830840421a63', 'request_id': 'req-2724a2ac-700e-4b19-9303-1c917f1a22dd'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:11.448099 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3325/6611] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:37:11 2022] POST /identity/v3/users => generated 292 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:37:11.450363 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a7ece5-e0b1-414e-a526-57cb6dc05238 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:11.470111 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a7ece5-e0b1-414e-a526-57cb6dc05238 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:11.510808 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-2724a2ac-700e-4b19-9303-1c917f1a22dd admin admin] The token cache is being invalidate because project 1df1ae61bf82472dadc4830840421a63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:37:11.511100 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-2724a2ac-700e-4b19-9303-1c917f1a22dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:11.512265 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-2724a2ac-700e-4b19-9303-1c917f1a22dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:11.513902 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3287/6612] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:37:11 2022] DELETE /identity/v3/projects/1df1ae61bf82472dadc4830840421a63 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:37:11.517733 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2724a2ac-700e-4b19-9303-1c917f1a22dd admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:11.523159 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-2724a2ac-700e-4b19-9303-1c917f1a22dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:11.587327 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c0c89c-9915-40b6-aacc-a0fb9fe2bd81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:11.588570 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c0c89c-9915-40b6-aacc-a0fb9fe2bd81 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:11.589029 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c0c89c-9915-40b6-aacc-a0fb9fe2bd81 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:11.589486 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c0c89c-9915-40b6-aacc-a0fb9fe2bd81 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:11.590532 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c0c89c-9915-40b6-aacc-a0fb9fe2bd81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:11.592437 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c0c89c-9915-40b6-aacc-a0fb9fe2bd81 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:11.606118 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3326/6613] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:37:11 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:37:11.607355 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c0c89c-9915-40b6-aacc-a0fb9fe2bd81 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:11.610518 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-51c0c89c-9915-40b6-aacc-a0fb9fe2bd81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:11.645363 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c0c89c-9915-40b6-aacc-a0fb9fe2bd81 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:11.658039 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6025f938-6dbe-4673-97e6-13b7e34b4aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:11.659245 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025f938-6dbe-4673-97e6-13b7e34b4aa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:11.659583 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025f938-6dbe-4673-97e6-13b7e34b4aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:11.660422 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025f938-6dbe-4673-97e6-13b7e34b4aa9 admin admin] PATH_INFO: `/v3/users/21104d85a5cc470a8faf69a3fd83a2d1` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:11.682627 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6025f938-6dbe-4673-97e6-13b7e34b4aa9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21104d85a5cc470a8faf69a3fd83a2d1)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:11.684633 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6025f938-6dbe-4673-97e6-13b7e34b4aa9 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:11.719723 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2724a2ac-700e-4b19-9303-1c917f1a22dd admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:11.734417 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1097e410-29e4-48a5-8244-2549b255c694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:11.735120 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1097e410-29e4-48a5-8244-2549b255c694 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:11.735405 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1097e410-29e4-48a5-8244-2549b255c694 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:11.736445 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1097e410-29e4-48a5-8244-2549b255c694 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:11.738248 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1097e410-29e4-48a5-8244-2549b255c694 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:11.739946 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1097e410-29e4-48a5-8244-2549b255c694 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:11.760541 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3288/6614] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:37:11 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:37:11.764833 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1097e410-29e4-48a5-8244-2549b255c694 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:11.769115 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-1097e410-29e4-48a5-8244-2549b255c694 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:11.785825 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1097e410-29e4-48a5-8244-2549b255c694 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:11.792343 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d77815-86da-4669-82e7-e7d1a2f5068c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:11.793704 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d77815-86da-4669-82e7-e7d1a2f5068c admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:11.794180 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d77815-86da-4669-82e7-e7d1a2f5068c admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:11.794328 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d77815-86da-4669-82e7-e7d1a2f5068c admin admin] PATH_INFO: `/v3/projects/b3af19d6975042e9ae8347d2093f3f30/users/73d2e2a0d2e043688d1bd544cbaeb63a/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:11.829392 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d77815-86da-4669-82e7-e7d1a2f5068c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3af19d6975042e9ae8347d2093f3f30, user_id=73d2e2a0d2e043688d1bd544cbaeb63a, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:11.837336 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d77815-86da-4669-82e7-e7d1a2f5068c admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:11.936104 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6025f938-6dbe-4673-97e6-13b7e34b4aa9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21104d85a5cc470a8faf69a3fd83a2d1'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:11.962933 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3289/6615] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:37:11 2022] PUT /identity/v3/projects/b3af19d6975042e9ae8347d2093f3f30/users/73d2e2a0d2e043688d1bd544cbaeb63a/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:37:11.963909 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d77815-86da-4669-82e7-e7d1a2f5068c admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:11.973963 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6025f938-6dbe-4673-97e6-13b7e34b4aa9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21104d85a5cc470a8faf69a3fd83a2d1'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:11.992040 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6025f938-6dbe-4673-97e6-13b7e34b4aa9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21104d85a5cc470a8faf69a3fd83a2d1'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:12.077497 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6025f938-6dbe-4673-97e6-13b7e34b4aa9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21104d85a5cc470a8faf69a3fd83a2d1'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:12.078032 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6025f938-6dbe-4673-97e6-13b7e34b4aa9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21104d85a5cc470a8faf69a3fd83a2d1'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:12.088898 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d77815-86da-4669-82e7-e7d1a2f5068c admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:12.091516 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3327/6616] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:37:11 2022] DELETE /identity/v3/users/21104d85a5cc470a8faf69a3fd83a2d1 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:37:12.092455 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6025f938-6dbe-4673-97e6-13b7e34b4aa9 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:12.094192 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-6025f938-6dbe-4673-97e6-13b7e34b4aa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:12.182111 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a03cec-4177-4df3-b8c0-148e096d87b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:12.182936 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a03cec-4177-4df3-b8c0-148e096d87b0 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:12.183225 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a03cec-4177-4df3-b8c0-148e096d87b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:12.184288 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a03cec-4177-4df3-b8c0-148e096d87b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:12.185003 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a03cec-4177-4df3-b8c0-148e096d87b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:12.186639 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a03cec-4177-4df3-b8c0-148e096d87b0 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:12.202955 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3290/6617] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:37:11 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:37:12.208384 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a03cec-4177-4df3-b8c0-148e096d87b0 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:12.210637 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-94a03cec-4177-4df3-b8c0-148e096d87b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:12.227169 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a03cec-4177-4df3-b8c0-148e096d87b0 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:12.229823 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6025f938-6dbe-4673-97e6-13b7e34b4aa9 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:12.233608 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0ee8da-0068-4168-bf7d-5fb097a58859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:12.234621 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ee8da-0068-4168-bf7d-5fb097a58859 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:12.235272 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ee8da-0068-4168-bf7d-5fb097a58859 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:12.235272 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ee8da-0068-4168-bf7d-5fb097a58859 admin admin] PATH_INFO: `/v3/projects/6b1d1d97f3d34eff879e452a0a75cb97/users/1dd8f876d94849e8bb2808fa844ffd60/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:12.243108 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0add919b-584c-44a4-98c2-db6490ffc951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:12.243833 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add919b-584c-44a4-98c2-db6490ffc951 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:12.244123 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add919b-584c-44a4-98c2-db6490ffc951 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:12.245825 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add919b-584c-44a4-98c2-db6490ffc951 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:12.246580 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0add919b-584c-44a4-98c2-db6490ffc951 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:12.252290 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0add919b-584c-44a4-98c2-db6490ffc951 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:12.254058 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0ee8da-0068-4168-bf7d-5fb097a58859 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b1d1d97f3d34eff879e452a0a75cb97, user_id=1dd8f876d94849e8bb2808fa844ffd60, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:12.257047 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0ee8da-0068-4168-bf7d-5fb097a58859 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:12.272901 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3328/6618] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:37:12 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:37:12.277382 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0add919b-584c-44a4-98c2-db6490ffc951 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:12.291467 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0add919b-584c-44a4-98c2-db6490ffc951 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:12.297055 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fc7765-823a-4909-acf7-f78b3c31557f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:12.299135 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc7765-823a-4909-acf7-f78b3c31557f admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:12.299421 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc7765-823a-4909-acf7-f78b3c31557f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:12.299749 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc7765-823a-4909-acf7-f78b3c31557f admin admin] PATH_INFO: `/v3/projects/b3af19d6975042e9ae8347d2093f3f30/users/73d2e2a0d2e043688d1bd544cbaeb63a/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:12.302072 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fc7765-823a-4909-acf7-f78b3c31557f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3af19d6975042e9ae8347d2093f3f30, user_id=73d2e2a0d2e043688d1bd544cbaeb63a, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:12.305142 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fc7765-823a-4909-acf7-f78b3c31557f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:12.322130 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3329/6619] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:37:12 2022] PUT /identity/v3/projects/b3af19d6975042e9ae8347d2093f3f30/users/73d2e2a0d2e043688d1bd544cbaeb63a/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:37:12.409072 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3291/6620] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:37:12 2022] PUT /identity/v3/projects/6b1d1d97f3d34eff879e452a0a75cb97/users/1dd8f876d94849e8bb2808fa844ffd60/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:37:12.420834 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6684b193-77a7-4dc6-bd9e-ece49e72d768 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:12.421393 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6684b193-77a7-4dc6-bd9e-ece49e72d768 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:12.421755 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6684b193-77a7-4dc6-bd9e-ece49e72d768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:12.425583 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda1d6f1-1605-4cad-bd5c-2b3f3c879319 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:12.426017 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda1d6f1-1605-4cad-bd5c-2b3f3c879319 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:12.426419 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda1d6f1-1605-4cad-bd5c-2b3f3c879319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:12.483749 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-dda1d6f1-1605-4cad-bd5c-2b3f3c879319 None None] MFA Rules not processed for user `73d2e2a0d2e043688d1bd544cbaeb63a`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:37:12.485240 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-dda1d6f1-1605-4cad-bd5c-2b3f3c879319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:12.489977 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-6684b193-77a7-4dc6-bd9e-ece49e72d768 None None] MFA Rules not processed for user `1dd8f876d94849e8bb2808fa844ffd60`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:37:12.491651 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-6684b193-77a7-4dc6-bd9e-ece49e72d768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:12.634067 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3330/6621] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:37:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:37:12.639418 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6684b193-77a7-4dc6-bd9e-ece49e72d768 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:12.645269 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-6684b193-77a7-4dc6-bd9e-ece49e72d768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:12.666191 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3292/6622] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:37:12 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:37:12.670384 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda1d6f1-1605-4cad-bd5c-2b3f3c879319 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:12.673765 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-dda1d6f1-1605-4cad-bd5c-2b3f3c879319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:12.801073 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6684b193-77a7-4dc6-bd9e-ece49e72d768 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:12.819451 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda1d6f1-1605-4cad-bd5c-2b3f3c879319 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:12.820429 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71794742-5c18-4ebc-aea3-6223d6767169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:12.826041 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71794742-5c18-4ebc-aea3-6223d6767169 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:12.826385 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71794742-5c18-4ebc-aea3-6223d6767169 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:12.826718 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71794742-5c18-4ebc-aea3-6223d6767169 admin admin] PATH_INFO: `/v3/projects/8898bc5dedb1443a9e4f09d9866360a4` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:12.831332 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cffa04-e8af-4c1b-b994-d0cf588bc3b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198271d1c0d44cb58bace41a65f4b94c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:12.832215 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cffa04-e8af-4c1b-b994-d0cf588bc3b3 service cinder] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:12.836155 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cffa04-e8af-4c1b-b994-d0cf588bc3b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:12.836155 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cffa04-e8af-4c1b-b994-d0cf588bc3b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:12.849405 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71794742-5c18-4ebc-aea3-6223d6767169 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8898bc5dedb1443a9e4f09d9866360a4)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:12.851586 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71794742-5c18-4ebc-aea3-6223d6767169 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:12.857279 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cffa04-e8af-4c1b-b994-d0cf588bc3b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:12.860154 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cffa04-e8af-4c1b-b994-d0cf588bc3b3 service cinder] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:12.882964 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3293/6623] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:37:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:37:12.885722 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cffa04-e8af-4c1b-b994-d0cf588bc3b3 service cinder] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:12.903625 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cffa04-e8af-4c1b-b994-d0cf588bc3b3 service cinder] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:12.913221 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9da0ca-0fd8-40e9-a54e-49ec683e328d tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73d2e2a0d2e043688d1bd544cbaeb63a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3af19d6975042e9ae8347d2093f3f30', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:12.918877 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9da0ca-0fd8-40e9-a54e-49ec683e328d tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:12.918877 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9da0ca-0fd8-40e9-a54e-49ec683e328d tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:12.918877 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9da0ca-0fd8-40e9-a54e-49ec683e328d tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:12.918877 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9da0ca-0fd8-40e9-a54e-49ec683e328d tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:12.919334 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9da0ca-0fd8-40e9-a54e-49ec683e328d tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:13.138158 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3294/6624] 10.222.0.52 () {60 vars in 1149 bytes} [Sat May 14 21:37:12 2022] POST /identity/v3/domains => generated 277 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:37:13.139854 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9da0ca-0fd8-40e9-a54e-49ec683e328d tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:13.154834 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-71794742-5c18-4ebc-aea3-6223d6767169 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8898bc5dedb1443a9e4f09d9866360a4', 'request_id': 'req-71794742-5c18-4ebc-aea3-6223d6767169'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:13.163109 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-71794742-5c18-4ebc-aea3-6223d6767169 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8898bc5dedb1443a9e4f09d9866360a4', 'request_id': 'req-71794742-5c18-4ebc-aea3-6223d6767169'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:13.259802 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-71794742-5c18-4ebc-aea3-6223d6767169 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8898bc5dedb1443a9e4f09d9866360a4', 'request_id': 'req-71794742-5c18-4ebc-aea3-6223d6767169'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:13.288926 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-71794742-5c18-4ebc-aea3-6223d6767169 admin admin] The token cache is being invalidate because project 8898bc5dedb1443a9e4f09d9866360a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:37:13.289635 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-71794742-5c18-4ebc-aea3-6223d6767169 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:13.292067 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-71794742-5c18-4ebc-aea3-6223d6767169 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:13.296499 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3331/6625] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:37:12 2022] DELETE /identity/v3/projects/8898bc5dedb1443a9e4f09d9866360a4 => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:37:13.299126 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71794742-5c18-4ebc-aea3-6223d6767169 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:13.304497 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-71794742-5c18-4ebc-aea3-6223d6767169 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:13.339793 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9da0ca-0fd8-40e9-a54e-49ec683e328d tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:13.349189 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21edf653-3e09-4ce9-825a-54314d7eaaaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:13.350131 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21edf653-3e09-4ce9-825a-54314d7eaaaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:13.350414 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21edf653-3e09-4ce9-825a-54314d7eaaaa admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:13.350741 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21edf653-3e09-4ce9-825a-54314d7eaaaa admin admin] PATH_INFO: `/v3/users/1dd8f876d94849e8bb2808fa844ffd60` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:13.352066 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21edf653-3e09-4ce9-825a-54314d7eaaaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=1dd8f876d94849e8bb2808fa844ffd60)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:13.356438 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21edf653-3e09-4ce9-825a-54314d7eaaaa admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:13.441279 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71794742-5c18-4ebc-aea3-6223d6767169 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:13.562665 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ab621f-33a3-438e-865d-4f379f21acb8 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73d2e2a0d2e043688d1bd544cbaeb63a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3af19d6975042e9ae8347d2093f3f30', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:13.563732 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab621f-33a3-438e-865d-4f379f21acb8 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:13.564129 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab621f-33a3-438e-865d-4f379f21acb8 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:13.564638 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab621f-33a3-438e-865d-4f379f21acb8 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:13.569175 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ab621f-33a3-438e-865d-4f379f21acb8 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:13.569175 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ab621f-33a3-438e-865d-4f379f21acb8 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:13.721897 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-21edf653-3e09-4ce9-825a-54314d7eaaaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1dd8f876d94849e8bb2808fa844ffd60'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:13.730899 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-21edf653-3e09-4ce9-825a-54314d7eaaaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1dd8f876d94849e8bb2808fa844ffd60'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:13.732010 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-21edf653-3e09-4ce9-825a-54314d7eaaaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1dd8f876d94849e8bb2808fa844ffd60'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:13.762227 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3332/6626] 10.222.0.52 () {60 vars in 1149 bytes} [Sat May 14 21:37:13 2022] POST /identity/v3/domains => generated 277 bytes in 464 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:37:13.765636 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce9501-2b4e-4188-b9c4-0342e5e714f6 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:13.765944 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce9501-2b4e-4188-b9c4-0342e5e714f6 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:13.766225 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce9501-2b4e-4188-b9c4-0342e5e714f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:13.817168 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-80ce9501-2b4e-4188-b9c4-0342e5e714f6 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:37:13.819593 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-80ce9501-2b4e-4188-b9c4-0342e5e714f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:13.837678 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-21edf653-3e09-4ce9-825a-54314d7eaaaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1dd8f876d94849e8bb2808fa844ffd60'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:13.859849 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-21edf653-3e09-4ce9-825a-54314d7eaaaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1dd8f876d94849e8bb2808fa844ffd60'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:13.876801 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3295/6627] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:37:13 2022] DELETE /identity/v3/users/1dd8f876d94849e8bb2808fa844ffd60 => generated 0 bytes in 734 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:37:13.877763 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21edf653-3e09-4ce9-825a-54314d7eaaaa admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:13.879198 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-21edf653-3e09-4ce9-825a-54314d7eaaaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:13.972565 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3333/6628] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:37:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:37:13.974229 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5307a4b-826b-495c-945f-151e1352bf61 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:13.974844 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5307a4b-826b-495c-945f-151e1352bf61 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:13.975284 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5307a4b-826b-495c-945f-151e1352bf61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:14.000344 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-e5307a4b-826b-495c-945f-151e1352bf61 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:37:14.002193 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e5307a4b-826b-495c-945f-151e1352bf61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:14.054489 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21edf653-3e09-4ce9-825a-54314d7eaaaa admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:14.069991 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1fbaa1-4337-445a-9591-2ff813c789b8 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73d2e2a0d2e043688d1bd544cbaeb63a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3af19d6975042e9ae8347d2093f3f30', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:14.070744 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1fbaa1-4337-445a-9591-2ff813c789b8 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:14.071035 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1fbaa1-4337-445a-9591-2ff813c789b8 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:14.071328 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1fbaa1-4337-445a-9591-2ff813c789b8 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:14.073164 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1fbaa1-4337-445a-9591-2ff813c789b8 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:14.076059 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1fbaa1-4337-445a-9591-2ff813c789b8 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:14.161364 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3334/6629] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:37:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:37:14.161364 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7743257c-cfb9-4ccf-be83-efeb5734d243 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:14.161364 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7743257c-cfb9-4ccf-be83-efeb5734d243 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:14.161364 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7743257c-cfb9-4ccf-be83-efeb5734d243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:14.192144 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3296/6630] 10.222.0.52 () {60 vars in 1149 bytes} [Sat May 14 21:37:13 2022] POST /identity/v3/domains => generated 278 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:37:14.192967 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-7743257c-cfb9-4ccf-be83-efeb5734d243 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:37:14.194812 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-7743257c-cfb9-4ccf-be83-efeb5734d243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:14.195326 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1fbaa1-4337-445a-9591-2ff813c789b8 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:14.201107 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-bb1fbaa1-4337-445a-9591-2ff813c789b8 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:14.318179 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1fbaa1-4337-445a-9591-2ff813c789b8 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:14.324971 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88ec932-9fc9-4534-8eb5-9fb9889a350a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:14.325762 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88ec932-9fc9-4534-8eb5-9fb9889a350a service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:14.326158 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88ec932-9fc9-4534-8eb5-9fb9889a350a service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:14.326343 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88ec932-9fc9-4534-8eb5-9fb9889a350a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:14.349217 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3335/6631] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:37:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:37:14.350316 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7743257c-cfb9-4ccf-be83-efeb5734d243 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:14.353064 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88ec932-9fc9-4534-8eb5-9fb9889a350a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:14.355826 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88ec932-9fc9-4534-8eb5-9fb9889a350a service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:14.375138 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3297/6632] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:37:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:37:14.378010 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88ec932-9fc9-4534-8eb5-9fb9889a350a service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:14.392690 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88ec932-9fc9-4534-8eb5-9fb9889a350a service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:14.404461 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037265c3-7c2b-48e6-9ea5-8223916a3266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:14.405475 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037265c3-7c2b-48e6-9ea5-8223916a3266 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:14.406514 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037265c3-7c2b-48e6-9ea5-8223916a3266 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:14.406868 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037265c3-7c2b-48e6-9ea5-8223916a3266 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:14.408286 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037265c3-7c2b-48e6-9ea5-8223916a3266 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:37:14.408592 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037265c3-7c2b-48e6-9ea5-8223916a3266 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:14.414858 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037265c3-7c2b-48e6-9ea5-8223916a3266 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:14.443534 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3298/6633] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:37:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:37:14.445981 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037265c3-7c2b-48e6-9ea5-8223916a3266 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:14.467452 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037265c3-7c2b-48e6-9ea5-8223916a3266 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:14.480950 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ed2116-1bf6-4e5f-b3c3-2e4b66ffe29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:14.480950 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed2116-1bf6-4e5f-b3c3-2e4b66ffe29d admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:14.483036 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed2116-1bf6-4e5f-b3c3-2e4b66ffe29d admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:14.483404 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed2116-1bf6-4e5f-b3c3-2e4b66ffe29d admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:14.484174 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ed2116-1bf6-4e5f-b3c3-2e4b66ffe29d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:14.484304 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7743257c-cfb9-4ccf-be83-efeb5734d243 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:14.489312 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ed2116-1bf6-4e5f-b3c3-2e4b66ffe29d admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:14.497727 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cb54a6-a311-42dc-8865-3e6779ff13b6 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73d2e2a0d2e043688d1bd544cbaeb63a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3af19d6975042e9ae8347d2093f3f30', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:14.498500 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb54a6-a311-42dc-8865-3e6779ff13b6 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:14.498873 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb54a6-a311-42dc-8865-3e6779ff13b6 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:14.499221 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb54a6-a311-42dc-8865-3e6779ff13b6 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:14.500596 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cb54a6-a311-42dc-8865-3e6779ff13b6 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:14.503309 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cb54a6-a311-42dc-8865-3e6779ff13b6 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:14.609234 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3299/6634] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:37:14 2022] POST /identity/v3/projects => generated 385 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:37:14.611681 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ed2116-1bf6-4e5f-b3c3-2e4b66ffe29d admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:14.628985 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3336/6635] 10.222.0.52 () {60 vars in 1149 bytes} [Sat May 14 21:37:14 2022] POST /identity/v3/domains => generated 278 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:37:14.633090 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cb54a6-a311-42dc-8865-3e6779ff13b6 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:14.723941 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ed2116-1bf6-4e5f-b3c3-2e4b66ffe29d admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:14.821482 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e92f91-275c-477b-9178-4b64fbf784c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:14.822185 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e92f91-275c-477b-9178-4b64fbf784c5 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:14.822472 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e92f91-275c-477b-9178-4b64fbf784c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:14.822753 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e92f91-275c-477b-9178-4b64fbf784c5 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:14.823453 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e92f91-275c-477b-9178-4b64fbf784c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:14.831727 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e92f91-275c-477b-9178-4b64fbf784c5 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:14.837634 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cb54a6-a311-42dc-8865-3e6779ff13b6 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:14.843233 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe42882a-5c4b-4df7-9d5c-f0df4856c6e8 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73d2e2a0d2e043688d1bd544cbaeb63a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3af19d6975042e9ae8347d2093f3f30', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:14.844268 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe42882a-5c4b-4df7-9d5c-f0df4856c6e8 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:14.844659 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe42882a-5c4b-4df7-9d5c-f0df4856c6e8 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:14.845575 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe42882a-5c4b-4df7-9d5c-f0df4856c6e8 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] PATH_INFO: `/v3/domains/3d2bfcf51b84404bb47e26a7ea55b1af` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:14.870901 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe42882a-5c4b-4df7-9d5c-f0df4856c6e8 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=3d2bfcf51b84404bb47e26a7ea55b1af)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:14.872740 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe42882a-5c4b-4df7-9d5c-f0df4856c6e8 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:14.921968 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-fe42882a-5c4b-4df7-9d5c-f0df4856c6e8 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '3d2bfcf51b84404bb47e26a7ea55b1af'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:14.940263 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-fe42882a-5c4b-4df7-9d5c-f0df4856c6e8 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '3d2bfcf51b84404bb47e26a7ea55b1af'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:14.989926 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3300/6636] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:37:14 2022] POST /identity/v3/users => generated 293 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:37:14.994498 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e92f91-275c-477b-9178-4b64fbf784c5 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:15.014426 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e92f91-275c-477b-9178-4b64fbf784c5 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:15.027813 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68bff69-51b3-4ce6-87e8-51b84d946324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:15.028261 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68bff69-51b3-4ce6-87e8-51b84d946324 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:15.028567 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68bff69-51b3-4ce6-87e8-51b84d946324 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:15.029306 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68bff69-51b3-4ce6-87e8-51b84d946324 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:15.030212 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68bff69-51b3-4ce6-87e8-51b84d946324 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:15.033190 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68bff69-51b3-4ce6-87e8-51b84d946324 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:15.074222 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3301/6637] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:37:14 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:37:15.076825 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68bff69-51b3-4ce6-87e8-51b84d946324 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:15.102170 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68bff69-51b3-4ce6-87e8-51b84d946324 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:15.115925 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-fe42882a-5c4b-4df7-9d5c-f0df4856c6e8 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d2bfcf51b84404bb47e26a7ea55b1af', 'request_id': 'req-fe42882a-5c4b-4df7-9d5c-f0df4856c6e8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:15.128914 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-fe42882a-5c4b-4df7-9d5c-f0df4856c6e8 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d2bfcf51b84404bb47e26a7ea55b1af', 'request_id': 'req-fe42882a-5c4b-4df7-9d5c-f0df4856c6e8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:15.231553 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c1803f-5900-4126-9823-8d4b9ece02d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:15.232373 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1803f-5900-4126-9823-8d4b9ece02d8 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:15.232776 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1803f-5900-4126-9823-8d4b9ece02d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:15.233152 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1803f-5900-4126-9823-8d4b9ece02d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:15.238542 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-fe42882a-5c4b-4df7-9d5c-f0df4856c6e8 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d2bfcf51b84404bb47e26a7ea55b1af', 'request_id': 'req-fe42882a-5c4b-4df7-9d5c-f0df4856c6e8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:15.246706 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c1803f-5900-4126-9823-8d4b9ece02d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:15.249141 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c1803f-5900-4126-9823-8d4b9ece02d8 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:15.266115 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3302/6638] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:37:15 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:37:15.268610 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-fe42882a-5c4b-4df7-9d5c-f0df4856c6e8 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] The token cache is being invalidate because project 3d2bfcf51b84404bb47e26a7ea55b1af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:37:15.271659 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c1803f-5900-4126-9823-8d4b9ece02d8 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:15.273109 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-fe42882a-5c4b-4df7-9d5c-f0df4856c6e8 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:15.276549 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-fe42882a-5c4b-4df7-9d5c-f0df4856c6e8 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:15.296167 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c1803f-5900-4126-9823-8d4b9ece02d8 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:15.303134 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-fe42882a-5c4b-4df7-9d5c-f0df4856c6e8 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '3d2bfcf51b84404bb47e26a7ea55b1af', 'request_id': 'req-fe42882a-5c4b-4df7-9d5c-f0df4856c6e8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:15.304599 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-fe42882a-5c4b-4df7-9d5c-f0df4856c6e8 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '3d2bfcf51b84404bb47e26a7ea55b1af', 'request_id': 'req-fe42882a-5c4b-4df7-9d5c-f0df4856c6e8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:15.311895 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-fe42882a-5c4b-4df7-9d5c-f0df4856c6e8 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '3d2bfcf51b84404bb47e26a7ea55b1af', 'request_id': 'req-fe42882a-5c4b-4df7-9d5c-f0df4856c6e8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:15.326268 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d8d4c-71ec-454f-aa16-ec1f9a25f37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:15.327188 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d8d4c-71ec-454f-aa16-ec1f9a25f37b admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:15.327471 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d8d4c-71ec-454f-aa16-ec1f9a25f37b admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:15.327788 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d8d4c-71ec-454f-aa16-ec1f9a25f37b admin admin] PATH_INFO: `/v3/projects/37fb22eb2ef44be9a5bc66079c2ad71f/users/1096012950d645a0ab7050ea661826db/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:15.329699 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3337/6639] 10.222.0.52 () {58 vars in 1229 bytes} [Sat May 14 21:37:14 2022] DELETE /identity/v3/domains/3d2bfcf51b84404bb47e26a7ea55b1af => generated 0 bytes in 697 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:37:15.335244 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe42882a-5c4b-4df7-9d5c-f0df4856c6e8 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:15.343516 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-fe42882a-5c4b-4df7-9d5c-f0df4856c6e8 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:15.371791 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5d8d4c-71ec-454f-aa16-ec1f9a25f37b admin admin] RBAC: Authorizing `identity:create_grant(project_id=37fb22eb2ef44be9a5bc66079c2ad71f, user_id=1096012950d645a0ab7050ea661826db, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:15.375498 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5d8d4c-71ec-454f-aa16-ec1f9a25f37b admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:15.475702 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3303/6640] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:37:15 2022] PUT /identity/v3/projects/37fb22eb2ef44be9a5bc66079c2ad71f/users/1096012950d645a0ab7050ea661826db/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:37:15.480989 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe42882a-5c4b-4df7-9d5c-f0df4856c6e8 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:15.481259 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb251160-7854-4a36-be0d-e47c3d6d99e9 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:15.481556 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb251160-7854-4a36-be0d-e47c3d6d99e9 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:15.481850 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb251160-7854-4a36-be0d-e47c3d6d99e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:15.551412 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-bb251160-7854-4a36-be0d-e47c3d6d99e9 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:37:15.552845 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-bb251160-7854-4a36-be0d-e47c3d6d99e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:15.560234 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783d3fe6-834a-4649-a417-3e2a8a625480 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73d2e2a0d2e043688d1bd544cbaeb63a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3af19d6975042e9ae8347d2093f3f30', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:15.561523 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d3fe6-834a-4649-a417-3e2a8a625480 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:15.562173 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d3fe6-834a-4649-a417-3e2a8a625480 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:15.567733 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d3fe6-834a-4649-a417-3e2a8a625480 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:15.568719 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783d3fe6-834a-4649-a417-3e2a8a625480 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:15.574082 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783d3fe6-834a-4649-a417-3e2a8a625480 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:15.650626 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3304/6641] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:37:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:37:15.681440 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb251160-7854-4a36-be0d-e47c3d6d99e9 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:15.682979 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-bb251160-7854-4a36-be0d-e47c3d6d99e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:15.702714 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3338/6642] 10.222.0.52 () {60 vars in 1148 bytes} [Sat May 14 21:37:15 2022] POST /identity/v3/domains => generated 248 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:37:15.706952 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783d3fe6-834a-4649-a417-3e2a8a625480 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:15.826238 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783d3fe6-834a-4649-a417-3e2a8a625480 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:15.831856 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb251160-7854-4a36-be0d-e47c3d6d99e9 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:15.833953 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79130188-51e9-4902-82f8-38f4f5ce43f3 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73d2e2a0d2e043688d1bd544cbaeb63a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3af19d6975042e9ae8347d2093f3f30', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:15.835292 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79130188-51e9-4902-82f8-38f4f5ce43f3 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:15.835692 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79130188-51e9-4902-82f8-38f4f5ce43f3 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:15.835996 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79130188-51e9-4902-82f8-38f4f5ce43f3 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] PATH_INFO: `/v3/domains/7c6e55811a00419d82d56a16693d41de` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:15.865005 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79130188-51e9-4902-82f8-38f4f5ce43f3 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=7c6e55811a00419d82d56a16693d41de)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:15.873393 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79130188-51e9-4902-82f8-38f4f5ce43f3 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:15.900873 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-79130188-51e9-4902-82f8-38f4f5ce43f3 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '7c6e55811a00419d82d56a16693d41de'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:15.901939 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-79130188-51e9-4902-82f8-38f4f5ce43f3 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '7c6e55811a00419d82d56a16693d41de'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:15.943306 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4e8471-f4f9-44b3-b5a3-e5b565c16806 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:15.944092 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e8471-f4f9-44b3-b5a3-e5b565c16806 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:15.944424 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e8471-f4f9-44b3-b5a3-e5b565c16806 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:15.944705 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e8471-f4f9-44b3-b5a3-e5b565c16806 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:15.948870 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-0c4e8471-f4f9-44b3-b5a3-e5b565c16806 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:16.040569 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-79130188-51e9-4902-82f8-38f4f5ce43f3 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '7c6e55811a00419d82d56a16693d41de'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:16.042748 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-79130188-51e9-4902-82f8-38f4f5ce43f3 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '7c6e55811a00419d82d56a16693d41de'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:16.050608 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3339/6643] 10.222.0.52 () {60 vars in 1248 bytes} [Sat May 14 21:37:15 2022] PATCH /identity/v3/domains/7c6e55811a00419d82d56a16693d41de => generated 249 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:37:16.051596 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79130188-51e9-4902-82f8-38f4f5ce43f3 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:16.053590 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-79130188-51e9-4902-82f8-38f4f5ce43f3 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:16.075132 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4e8471-f4f9-44b3-b5a3-e5b565c16806 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:16.080423 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4e8471-f4f9-44b3-b5a3-e5b565c16806 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:16.112020 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3305/6644] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:37:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:37:16.189105 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79130188-51e9-4902-82f8-38f4f5ce43f3 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:16.194754 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30408f9-d7ee-4f64-8a29-9748ff0ff65e tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73d2e2a0d2e043688d1bd544cbaeb63a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3af19d6975042e9ae8347d2093f3f30', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:16.204239 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30408f9-d7ee-4f64-8a29-9748ff0ff65e tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:16.204239 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30408f9-d7ee-4f64-8a29-9748ff0ff65e tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:16.204239 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30408f9-d7ee-4f64-8a29-9748ff0ff65e tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] PATH_INFO: `/v3/domains/7c6e55811a00419d82d56a16693d41de` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:16.237266 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30408f9-d7ee-4f64-8a29-9748ff0ff65e tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=7c6e55811a00419d82d56a16693d41de)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:16.238809 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30408f9-d7ee-4f64-8a29-9748ff0ff65e tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:16.281669 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e30408f9-d7ee-4f64-8a29-9748ff0ff65e tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '7c6e55811a00419d82d56a16693d41de'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:16.286622 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e30408f9-d7ee-4f64-8a29-9748ff0ff65e tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '7c6e55811a00419d82d56a16693d41de'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:16.405746 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4e8471-f4f9-44b3-b5a3-e5b565c16806 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:16.407906 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-0c4e8471-f4f9-44b3-b5a3-e5b565c16806 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:16.429481 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4e8471-f4f9-44b3-b5a3-e5b565c16806 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:16.480874 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e30408f9-d7ee-4f64-8a29-9748ff0ff65e tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c6e55811a00419d82d56a16693d41de', 'request_id': 'req-e30408f9-d7ee-4f64-8a29-9748ff0ff65e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:16.491504 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e30408f9-d7ee-4f64-8a29-9748ff0ff65e tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c6e55811a00419d82d56a16693d41de', 'request_id': 'req-e30408f9-d7ee-4f64-8a29-9748ff0ff65e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:16.534687 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d4a5cb-79a8-4c02-8e43-f2b664ed1659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:16.536140 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d4a5cb-79a8-4c02-8e43-f2b664ed1659 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:16.536431 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d4a5cb-79a8-4c02-8e43-f2b664ed1659 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:16.536704 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d4a5cb-79a8-4c02-8e43-f2b664ed1659 admin admin] PATH_INFO: `/v3/projects/6b1d1d97f3d34eff879e452a0a75cb97` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:16.538592 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d4a5cb-79a8-4c02-8e43-f2b664ed1659 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b1d1d97f3d34eff879e452a0a75cb97)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:16.540722 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d4a5cb-79a8-4c02-8e43-f2b664ed1659 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:16.565934 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e30408f9-d7ee-4f64-8a29-9748ff0ff65e tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c6e55811a00419d82d56a16693d41de', 'request_id': 'req-e30408f9-d7ee-4f64-8a29-9748ff0ff65e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:16.580929 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e30408f9-d7ee-4f64-8a29-9748ff0ff65e tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] The token cache is being invalidate because project 7c6e55811a00419d82d56a16693d41de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:37:16.581228 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e30408f9-d7ee-4f64-8a29-9748ff0ff65e tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:16.581910 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e30408f9-d7ee-4f64-8a29-9748ff0ff65e tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:16.590631 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e30408f9-d7ee-4f64-8a29-9748ff0ff65e tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '7c6e55811a00419d82d56a16693d41de', 'request_id': 'req-e30408f9-d7ee-4f64-8a29-9748ff0ff65e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:16.591533 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e30408f9-d7ee-4f64-8a29-9748ff0ff65e tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '7c6e55811a00419d82d56a16693d41de', 'request_id': 'req-e30408f9-d7ee-4f64-8a29-9748ff0ff65e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:16.595766 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e30408f9-d7ee-4f64-8a29-9748ff0ff65e tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '7c6e55811a00419d82d56a16693d41de', 'request_id': 'req-e30408f9-d7ee-4f64-8a29-9748ff0ff65e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:16.604306 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3340/6645] 10.222.0.52 () {58 vars in 1229 bytes} [Sat May 14 21:37:16 2022] DELETE /identity/v3/domains/7c6e55811a00419d82d56a16693d41de => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:37:16.609582 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30408f9-d7ee-4f64-8a29-9748ff0ff65e tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:16.612305 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e30408f9-d7ee-4f64-8a29-9748ff0ff65e tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:16.686210 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b8d4a5cb-79a8-4c02-8e43-f2b664ed1659 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b1d1d97f3d34eff879e452a0a75cb97', 'request_id': 'req-b8d4a5cb-79a8-4c02-8e43-f2b664ed1659'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:16.694290 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b8d4a5cb-79a8-4c02-8e43-f2b664ed1659 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b1d1d97f3d34eff879e452a0a75cb97', 'request_id': 'req-b8d4a5cb-79a8-4c02-8e43-f2b664ed1659'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:16.709995 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b8d4a5cb-79a8-4c02-8e43-f2b664ed1659 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b1d1d97f3d34eff879e452a0a75cb97', 'request_id': 'req-b8d4a5cb-79a8-4c02-8e43-f2b664ed1659'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:16.746380 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30408f9-d7ee-4f64-8a29-9748ff0ff65e tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:16.799065 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b8d4a5cb-79a8-4c02-8e43-f2b664ed1659 admin admin] The token cache is being invalidate because project 6b1d1d97f3d34eff879e452a0a75cb97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:37:16.800028 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b8d4a5cb-79a8-4c02-8e43-f2b664ed1659 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:16.801651 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b8d4a5cb-79a8-4c02-8e43-f2b664ed1659 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:16.806854 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3306/6646] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:37:16 2022] DELETE /identity/v3/projects/6b1d1d97f3d34eff879e452a0a75cb97 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:37:16.811909 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f182621-53c5-4d79-9da8-c983de64563c None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:16.812204 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f182621-53c5-4d79-9da8-c983de64563c None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:16.812484 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f182621-53c5-4d79-9da8-c983de64563c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:16.828626 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5286beb-77b7-4ea1-8f5a-44a9b26ccecc tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73d2e2a0d2e043688d1bd544cbaeb63a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3af19d6975042e9ae8347d2093f3f30', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:16.829944 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5286beb-77b7-4ea1-8f5a-44a9b26ccecc tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:16.830688 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5286beb-77b7-4ea1-8f5a-44a9b26ccecc tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:16.831162 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5286beb-77b7-4ea1-8f5a-44a9b26ccecc tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:16.832182 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5286beb-77b7-4ea1-8f5a-44a9b26ccecc tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:16.834088 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5286beb-77b7-4ea1-8f5a-44a9b26ccecc tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:16.850794 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-4f182621-53c5-4d79-9da8-c983de64563c None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:37:16.854439 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-4f182621-53c5-4d79-9da8-c983de64563c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:16.904523 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3341/6647] 10.222.0.52 () {60 vars in 1148 bytes} [Sat May 14 21:37:16 2022] POST /identity/v3/domains => generated 278 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:37:16.909477 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5286beb-77b7-4ea1-8f5a-44a9b26ccecc tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:16.912746 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b5286beb-77b7-4ea1-8f5a-44a9b26ccecc tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:17.037016 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3307/6648] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:37:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:37:17.044292 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5286beb-77b7-4ea1-8f5a-44a9b26ccecc tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:17.044507 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232cdfa3-e5fe-4381-8bee-0388c6a8debe None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:17.044842 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232cdfa3-e5fe-4381-8bee-0388c6a8debe None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:17.045168 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232cdfa3-e5fe-4381-8bee-0388c6a8debe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:17.050672 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e0b618-d458-4895-8e4c-47b1fc104384 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73d2e2a0d2e043688d1bd544cbaeb63a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3af19d6975042e9ae8347d2093f3f30', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:17.051921 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e0b618-d458-4895-8e4c-47b1fc104384 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:17.052594 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e0b618-d458-4895-8e4c-47b1fc104384 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:17.053316 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e0b618-d458-4895-8e4c-47b1fc104384 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] PATH_INFO: `/v3/domains/7f8e54801b05488fa6f2e59576442804` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:17.074627 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e0b618-d458-4895-8e4c-47b1fc104384 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=7f8e54801b05488fa6f2e59576442804)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:17.077740 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e0b618-d458-4895-8e4c-47b1fc104384 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:17.082987 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-232cdfa3-e5fe-4381-8bee-0388c6a8debe None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:37:17.084381 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-232cdfa3-e5fe-4381-8bee-0388c6a8debe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:17.110598 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-45e0b618-d458-4895-8e4c-47b1fc104384 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '7f8e54801b05488fa6f2e59576442804'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:17.113285 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-45e0b618-d458-4895-8e4c-47b1fc104384 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '7f8e54801b05488fa6f2e59576442804'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:17.194421 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3308/6649] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:37:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:37:17.199528 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232cdfa3-e5fe-4381-8bee-0388c6a8debe None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:17.215618 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232cdfa3-e5fe-4381-8bee-0388c6a8debe None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:17.288016 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-45e0b618-d458-4895-8e4c-47b1fc104384 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '7f8e54801b05488fa6f2e59576442804'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:17.288919 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-45e0b618-d458-4895-8e4c-47b1fc104384 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '7f8e54801b05488fa6f2e59576442804'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:17.289948 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093c2278-ec10-446c-8e66-e8f2cd72abc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:17.290731 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c2278-ec10-446c-8e66-e8f2cd72abc5 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:17.291017 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c2278-ec10-446c-8e66-e8f2cd72abc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:17.291293 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c2278-ec10-446c-8e66-e8f2cd72abc5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:17.292699 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3342/6650] 10.222.0.52 () {60 vars in 1249 bytes} [Sat May 14 21:37:16 2022] PATCH /identity/v3/domains/7f8e54801b05488fa6f2e59576442804 => generated 275 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:37:17.296962 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e0b618-d458-4895-8e4c-47b1fc104384 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:17.300174 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-45e0b618-d458-4895-8e4c-47b1fc104384 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:17.300756 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093c2278-ec10-446c-8e66-e8f2cd72abc5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:37:17.301086 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093c2278-ec10-446c-8e66-e8f2cd72abc5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:17.302760 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093c2278-ec10-446c-8e66-e8f2cd72abc5 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:17.342258 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3309/6651] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:37:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:37:17.343920 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093c2278-ec10-446c-8e66-e8f2cd72abc5 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:17.347454 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-093c2278-ec10-446c-8e66-e8f2cd72abc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:17.378172 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093c2278-ec10-446c-8e66-e8f2cd72abc5 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:17.397765 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0cf0eb-024a-4c5b-93b3-b3fbf92d719f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:17.399448 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0cf0eb-024a-4c5b-93b3-b3fbf92d719f admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:17.399807 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0cf0eb-024a-4c5b-93b3-b3fbf92d719f admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:17.400887 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0cf0eb-024a-4c5b-93b3-b3fbf92d719f admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:17.401622 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0cf0eb-024a-4c5b-93b3-b3fbf92d719f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:17.406012 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0cf0eb-024a-4c5b-93b3-b3fbf92d719f admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:17.450455 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e0b618-d458-4895-8e4c-47b1fc104384 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:17.467325 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9507eb7b-0eec-42ad-905a-4fe5525d5322 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73d2e2a0d2e043688d1bd544cbaeb63a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3af19d6975042e9ae8347d2093f3f30', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:17.468051 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9507eb7b-0eec-42ad-905a-4fe5525d5322 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:17.470653 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9507eb7b-0eec-42ad-905a-4fe5525d5322 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:17.470952 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9507eb7b-0eec-42ad-905a-4fe5525d5322 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] PATH_INFO: `/v3/domains/7f8e54801b05488fa6f2e59576442804` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:17.498866 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9507eb7b-0eec-42ad-905a-4fe5525d5322 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=7f8e54801b05488fa6f2e59576442804)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:17.501127 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9507eb7b-0eec-42ad-905a-4fe5525d5322 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:17.506594 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3343/6652] 10.222.0.52 () {58 vars in 1226 bytes} [Sat May 14 21:37:17 2022] GET /identity/v3/domains/7f8e54801b05488fa6f2e59576442804 => generated 275 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:37:17.511148 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9507eb7b-0eec-42ad-905a-4fe5525d5322 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:17.527511 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9507eb7b-0eec-42ad-905a-4fe5525d5322 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:17.534054 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613f0534-793d-469f-89ad-cf9183e5e91d tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73d2e2a0d2e043688d1bd544cbaeb63a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3af19d6975042e9ae8347d2093f3f30', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:17.535449 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613f0534-793d-469f-89ad-cf9183e5e91d tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:17.536006 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613f0534-793d-469f-89ad-cf9183e5e91d tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:17.536489 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613f0534-793d-469f-89ad-cf9183e5e91d tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] PATH_INFO: `/v3/domains/7f8e54801b05488fa6f2e59576442804` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:17.551218 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3310/6653] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:37:17 2022] POST /identity/v3/projects => generated 371 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:37:17.551745 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613f0534-793d-469f-89ad-cf9183e5e91d tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=7f8e54801b05488fa6f2e59576442804)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:17.551745 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613f0534-793d-469f-89ad-cf9183e5e91d tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:17.552200 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0cf0eb-024a-4c5b-93b3-b3fbf92d719f admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:17.587863 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-613f0534-793d-469f-89ad-cf9183e5e91d tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '7f8e54801b05488fa6f2e59576442804'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:17.593089 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-613f0534-793d-469f-89ad-cf9183e5e91d tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '7f8e54801b05488fa6f2e59576442804'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:17.688914 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0cf0eb-024a-4c5b-93b3-b3fbf92d719f admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:17.696540 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a2b93-b065-45c1-a227-c16b9885547f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:17.697422 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a2b93-b065-45c1-a227-c16b9885547f admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:17.697899 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a2b93-b065-45c1-a227-c16b9885547f admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:17.698274 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a2b93-b065-45c1-a227-c16b9885547f admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:17.699076 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80a2b93-b065-45c1-a227-c16b9885547f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:17.702500 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80a2b93-b065-45c1-a227-c16b9885547f admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:17.757316 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-613f0534-793d-469f-89ad-cf9183e5e91d tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f8e54801b05488fa6f2e59576442804', 'request_id': 'req-613f0534-793d-469f-89ad-cf9183e5e91d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:17.765670 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-613f0534-793d-469f-89ad-cf9183e5e91d tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f8e54801b05488fa6f2e59576442804', 'request_id': 'req-613f0534-793d-469f-89ad-cf9183e5e91d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:17.813277 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3311/6654] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:37:17 2022] POST /identity/v3/users => generated 286 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:37:17.824288 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a2b93-b065-45c1-a227-c16b9885547f admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:17.848528 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-613f0534-793d-469f-89ad-cf9183e5e91d tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f8e54801b05488fa6f2e59576442804', 'request_id': 'req-613f0534-793d-469f-89ad-cf9183e5e91d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:17.860300 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a2b93-b065-45c1-a227-c16b9885547f admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:17.902669 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-613f0534-793d-469f-89ad-cf9183e5e91d tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] The token cache is being invalidate because project 7f8e54801b05488fa6f2e59576442804 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:37:17.905923 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-613f0534-793d-469f-89ad-cf9183e5e91d tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:17.909747 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-613f0534-793d-469f-89ad-cf9183e5e91d tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:17.926711 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-613f0534-793d-469f-89ad-cf9183e5e91d tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '7f8e54801b05488fa6f2e59576442804', 'request_id': 'req-613f0534-793d-469f-89ad-cf9183e5e91d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:17.928583 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-613f0534-793d-469f-89ad-cf9183e5e91d tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '7f8e54801b05488fa6f2e59576442804', 'request_id': 'req-613f0534-793d-469f-89ad-cf9183e5e91d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:17.940703 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-613f0534-793d-469f-89ad-cf9183e5e91d tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '7f8e54801b05488fa6f2e59576442804', 'request_id': 'req-613f0534-793d-469f-89ad-cf9183e5e91d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:17.959619 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3344/6655] 10.222.0.52 () {58 vars in 1229 bytes} [Sat May 14 21:37:17 2022] DELETE /identity/v3/domains/7f8e54801b05488fa6f2e59576442804 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:37:17.960586 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613f0534-793d-469f-89ad-cf9183e5e91d tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:17.962979 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-613f0534-793d-469f-89ad-cf9183e5e91d tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:17.964327 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef4de4-a91a-476c-9bcc-1219bbe82def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:17.966676 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef4de4-a91a-476c-9bcc-1219bbe82def admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:17.966676 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef4de4-a91a-476c-9bcc-1219bbe82def admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:17.966676 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef4de4-a91a-476c-9bcc-1219bbe82def admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:17.967303 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aef4de4-a91a-476c-9bcc-1219bbe82def admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:17.969236 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aef4de4-a91a-476c-9bcc-1219bbe82def admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:17.994811 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3312/6656] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:37:17 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:37:18.000556 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef4de4-a91a-476c-9bcc-1219bbe82def admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:18.002803 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-2aef4de4-a91a-476c-9bcc-1219bbe82def admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:18.020742 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef4de4-a91a-476c-9bcc-1219bbe82def admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:18.028729 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c45a5ef-9b06-42f3-b8d9-218572949f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:18.029621 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c45a5ef-9b06-42f3-b8d9-218572949f0f admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:18.030217 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c45a5ef-9b06-42f3-b8d9-218572949f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:18.033857 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c45a5ef-9b06-42f3-b8d9-218572949f0f admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:18.033857 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c45a5ef-9b06-42f3-b8d9-218572949f0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:18.035229 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c45a5ef-9b06-42f3-b8d9-218572949f0f admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:18.050692 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3313/6657] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:37:17 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:37:18.054904 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c45a5ef-9b06-42f3-b8d9-218572949f0f admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:18.071492 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c45a5ef-9b06-42f3-b8d9-218572949f0f admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:18.093441 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c28a70-5926-4ab6-b5b8-78841fc7501e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:18.094355 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c28a70-5926-4ab6-b5b8-78841fc7501e admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:18.095318 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c28a70-5926-4ab6-b5b8-78841fc7501e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:18.095318 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c28a70-5926-4ab6-b5b8-78841fc7501e admin admin] PATH_INFO: `/v3/projects/7646e9d3454645fb828ff54bcd16eeaf/users/059cd3da2c34499a85e3a55300a73bde/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:18.121793 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613f0534-793d-469f-89ad-cf9183e5e91d tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:18.133678 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2118e2a-8d97-48b0-a418-c153fec44fe8 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73d2e2a0d2e043688d1bd544cbaeb63a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3af19d6975042e9ae8347d2093f3f30', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:18.134364 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2118e2a-8d97-48b0-a418-c153fec44fe8 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:18.134650 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2118e2a-8d97-48b0-a418-c153fec44fe8 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:18.134935 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2118e2a-8d97-48b0-a418-c153fec44fe8 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:18.136143 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2118e2a-8d97-48b0-a418-c153fec44fe8 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:18.139333 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2118e2a-8d97-48b0-a418-c153fec44fe8 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:18.161237 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c28a70-5926-4ab6-b5b8-78841fc7501e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7646e9d3454645fb828ff54bcd16eeaf, user_id=059cd3da2c34499a85e3a55300a73bde, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:18.164630 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3345/6658] 10.222.0.52 () {58 vars in 1127 bytes} [Sat May 14 21:37:17 2022] GET /identity/v3/domains => generated 1350 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:37:18.169299 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c28a70-5926-4ab6-b5b8-78841fc7501e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:18.181043 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2118e2a-8d97-48b0-a418-c153fec44fe8 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:18.198714 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2118e2a-8d97-48b0-a418-c153fec44fe8 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:18.208474 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5b80e3-0f1f-47d4-9870-d0b5d47e8665 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73d2e2a0d2e043688d1bd544cbaeb63a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3af19d6975042e9ae8347d2093f3f30', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:18.208474 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b80e3-0f1f-47d4-9870-d0b5d47e8665 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:18.208474 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b80e3-0f1f-47d4-9870-d0b5d47e8665 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:18.209033 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b80e3-0f1f-47d4-9870-d0b5d47e8665 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] PATH_INFO: `/v3/domains/7f8e54801b05488fa6f2e59576442804` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:18.224818 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5b80e3-0f1f-47d4-9870-d0b5d47e8665 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 21:37:18.257937 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-9e5b80e3-0f1f-47d4-9870-d0b5d47e8665 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Could not find domain: 7f8e54801b05488fa6f2e59576442804.: keystone.exception.DomainNotFound: Could not find domain: 7f8e54801b05488fa6f2e59576442804. May 14 21:37:18.257937 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:37:18.257937 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 14 21:37:18.257937 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 14 21:37:18.257937 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 21:37:18.257937 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 21:37:18.257937 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 21:37:18.257937 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 21:37:18.257937 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 7f8e54801b05488fa6f2e59576442804. May 14 21:37:18.257937 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:37:18.257937 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 21:37:18.257937 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:37:18.257937 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:37:18.257937 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 21:37:18.257937 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 21:37:18.257937 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 21:37:18.259173 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 21:37:18.259173 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 21:37:18.259173 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 21:37:18.259173 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 21:37:18.259173 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 21:37:18.259173 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 21:37:18.259173 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 21:37:18.259173 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch May 14 21:37:18.259173 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') May 14 21:37:18.259173 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 21:37:18.259173 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 21:37:18.259173 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 21:37:18.259173 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 21:37:18.259173 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 21:37:18.259173 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 21:37:18.259173 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 21:37:18.260346 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 21:37:18.260346 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 21:37:18.260346 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 21:37:18.260346 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 21:37:18.260346 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 21:37:18.260346 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 21:37:18.260346 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 21:37:18.260346 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 21:37:18.260346 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 21:37:18.260346 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 21:37:18.260346 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 21:37:18.260346 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 21:37:18.260346 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 21:37:18.260346 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 14 21:37:18.260346 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 21:37:18.260346 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 7f8e54801b05488fa6f2e59576442804. May 14 21:37:18.260346 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:37:18.266259 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3346/6659] 10.222.0.52 () {60 vars in 1248 bytes} [Sat May 14 21:37:18 2022] PATCH /identity/v3/domains/7f8e54801b05488fa6f2e59576442804 => generated 112 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 14 21:37:18.272304 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5b80e3-0f1f-47d4-9870-d0b5d47e8665 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:18.315434 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3314/6660] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:37:18 2022] PUT /identity/v3/projects/7646e9d3454645fb828ff54bcd16eeaf/users/059cd3da2c34499a85e3a55300a73bde/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:37:18.319843 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5b80e3-0f1f-47d4-9870-d0b5d47e8665 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:18.436909 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a79dc-a38b-46ad-b9cb-6af0929c4908 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:18.437388 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a79dc-a38b-46ad-b9cb-6af0929c4908 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:18.437653 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a79dc-a38b-46ad-b9cb-6af0929c4908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:18.491229 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-123a79dc-a38b-46ad-b9cb-6af0929c4908 None None] MFA Rules not processed for user `059cd3da2c34499a85e3a55300a73bde`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:37:18.493805 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-123a79dc-a38b-46ad-b9cb-6af0929c4908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:18.500011 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604155b5-9a85-4b2b-98e1-6f046ffdbbcb tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73d2e2a0d2e043688d1bd544cbaeb63a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3af19d6975042e9ae8347d2093f3f30', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:18.504157 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604155b5-9a85-4b2b-98e1-6f046ffdbbcb tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:18.504635 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604155b5-9a85-4b2b-98e1-6f046ffdbbcb tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:18.505093 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604155b5-9a85-4b2b-98e1-6f046ffdbbcb tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:18.506112 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604155b5-9a85-4b2b-98e1-6f046ffdbbcb tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:18.508377 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604155b5-9a85-4b2b-98e1-6f046ffdbbcb tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:18.599940 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3347/6661] 10.222.0.52 () {60 vars in 1148 bytes} [Sat May 14 21:37:18 2022] POST /identity/v3/domains => generated 275 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:37:18.605070 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604155b5-9a85-4b2b-98e1-6f046ffdbbcb tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:18.616209 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3315/6662] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:37:18 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:37:18.628867 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a79dc-a38b-46ad-b9cb-6af0929c4908 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:18.631655 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-123a79dc-a38b-46ad-b9cb-6af0929c4908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:18.736492 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604155b5-9a85-4b2b-98e1-6f046ffdbbcb tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:18.745719 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f15b10c-e3c8-45af-8981-30d39afa0f68 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73d2e2a0d2e043688d1bd544cbaeb63a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3af19d6975042e9ae8347d2093f3f30', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:18.747051 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f15b10c-e3c8-45af-8981-30d39afa0f68 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:18.747730 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f15b10c-e3c8-45af-8981-30d39afa0f68 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:18.751955 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f15b10c-e3c8-45af-8981-30d39afa0f68 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:18.751955 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f15b10c-e3c8-45af-8981-30d39afa0f68 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:18.756200 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f15b10c-e3c8-45af-8981-30d39afa0f68 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:18.773938 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a79dc-a38b-46ad-b9cb-6af0929c4908 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:18.876724 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3348/6663] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:37:18 2022] POST /identity/v3/users => generated 346 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:37:18.877922 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f15b10c-e3c8-45af-8981-30d39afa0f68 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:18.878666 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441209e7-66a1-4055-b3ac-b6cc809182b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198271d1c0d44cb58bace41a65f4b94c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:18.879342 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441209e7-66a1-4055-b3ac-b6cc809182b6 service cinder] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:18.880090 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441209e7-66a1-4055-b3ac-b6cc809182b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:18.885323 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441209e7-66a1-4055-b3ac-b6cc809182b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:18.894713 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f15b10c-e3c8-45af-8981-30d39afa0f68 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:18.910626 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eaf769-b951-47fa-a0b0-3c431a9bb855 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73d2e2a0d2e043688d1bd544cbaeb63a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3af19d6975042e9ae8347d2093f3f30', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:18.912046 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eaf769-b951-47fa-a0b0-3c431a9bb855 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:18.913567 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eaf769-b951-47fa-a0b0-3c431a9bb855 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:18.913872 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eaf769-b951-47fa-a0b0-3c431a9bb855 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] PATH_INFO: `/v3/groups` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:18.914595 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eaf769-b951-47fa-a0b0-3c431a9bb855 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:18.918654 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eaf769-b951-47fa-a0b0-3c431a9bb855 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:19.025192 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3349/6664] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:37:18 2022] POST /identity/v3/groups => generated 324 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:37:19.026324 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eaf769-b951-47fa-a0b0-3c431a9bb855 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:19.047250 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441209e7-66a1-4055-b3ac-b6cc809182b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:19.050509 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eaf769-b951-47fa-a0b0-3c431a9bb855 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:19.051802 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441209e7-66a1-4055-b3ac-b6cc809182b6 service cinder] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:19.060214 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c94b3c-dfef-4f02-9c08-a3242c57abb2 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73d2e2a0d2e043688d1bd544cbaeb63a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3af19d6975042e9ae8347d2093f3f30', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:19.061993 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c94b3c-dfef-4f02-9c08-a3242c57abb2 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:19.064197 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c94b3c-dfef-4f02-9c08-a3242c57abb2 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:19.064397 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c94b3c-dfef-4f02-9c08-a3242c57abb2 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] PATH_INFO: `/v3/domains/495906607c7647d99d01dedf20db105c` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:19.066628 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c94b3c-dfef-4f02-9c08-a3242c57abb2 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=495906607c7647d99d01dedf20db105c)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:19.068550 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c94b3c-dfef-4f02-9c08-a3242c57abb2 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:19.085789 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3316/6665] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:37:18 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:37:19.107256 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-37c94b3c-dfef-4f02-9c08-a3242c57abb2 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '495906607c7647d99d01dedf20db105c'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:19.108245 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-37c94b3c-dfef-4f02-9c08-a3242c57abb2 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '495906607c7647d99d01dedf20db105c'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:19.130330 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441209e7-66a1-4055-b3ac-b6cc809182b6 service cinder] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:19.207093 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-37c94b3c-dfef-4f02-9c08-a3242c57abb2 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '495906607c7647d99d01dedf20db105c'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:19.208217 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-37c94b3c-dfef-4f02-9c08-a3242c57abb2 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '495906607c7647d99d01dedf20db105c'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:19.211210 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3350/6666] 10.222.0.52 () {60 vars in 1248 bytes} [Sat May 14 21:37:19 2022] PATCH /identity/v3/domains/495906607c7647d99d01dedf20db105c => generated 276 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:37:19.215388 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c94b3c-dfef-4f02-9c08-a3242c57abb2 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:19.220505 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441209e7-66a1-4055-b3ac-b6cc809182b6 service cinder] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:19.220657 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-37c94b3c-dfef-4f02-9c08-a3242c57abb2 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:19.323656 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c94b3c-dfef-4f02-9c08-a3242c57abb2 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:19.335053 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b833766-fbf6-4df0-89e7-203c178743ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:19.336738 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b833766-fbf6-4df0-89e7-203c178743ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:19.336738 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b833766-fbf6-4df0-89e7-203c178743ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:19.336738 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b833766-fbf6-4df0-89e7-203c178743ec admin admin] PATH_INFO: `/v3/users/059cd3da2c34499a85e3a55300a73bde` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:19.338397 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b833766-fbf6-4df0-89e7-203c178743ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=059cd3da2c34499a85e3a55300a73bde)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:19.338545 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d959222-8e05-4b6d-9c96-ddd4b8728c70 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73d2e2a0d2e043688d1bd544cbaeb63a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3af19d6975042e9ae8347d2093f3f30', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:19.342049 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d959222-8e05-4b6d-9c96-ddd4b8728c70 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:19.342238 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b833766-fbf6-4df0-89e7-203c178743ec admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:19.342360 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d959222-8e05-4b6d-9c96-ddd4b8728c70 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:19.342360 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d959222-8e05-4b6d-9c96-ddd4b8728c70 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] PATH_INFO: `/v3/domains/495906607c7647d99d01dedf20db105c` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:19.377336 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d959222-8e05-4b6d-9c96-ddd4b8728c70 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=495906607c7647d99d01dedf20db105c)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:19.379450 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d959222-8e05-4b6d-9c96-ddd4b8728c70 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:19.408931 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9d959222-8e05-4b6d-9c96-ddd4b8728c70 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '495906607c7647d99d01dedf20db105c'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:19.412954 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9d959222-8e05-4b6d-9c96-ddd4b8728c70 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '495906607c7647d99d01dedf20db105c'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:19.505283 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4b833766-fbf6-4df0-89e7-203c178743ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '059cd3da2c34499a85e3a55300a73bde'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:19.516362 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4b833766-fbf6-4df0-89e7-203c178743ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '059cd3da2c34499a85e3a55300a73bde'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:19.523857 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4b833766-fbf6-4df0-89e7-203c178743ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '059cd3da2c34499a85e3a55300a73bde'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:19.594070 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4b833766-fbf6-4df0-89e7-203c178743ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '059cd3da2c34499a85e3a55300a73bde'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:19.612949 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4b833766-fbf6-4df0-89e7-203c178743ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '059cd3da2c34499a85e3a55300a73bde'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:19.622988 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3317/6667] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:37:19 2022] DELETE /identity/v3/users/059cd3da2c34499a85e3a55300a73bde => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:37:19.622988 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75616450-8ac3-4b64-b3f8-2a17253fcafc None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:19.622988 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75616450-8ac3-4b64-b3f8-2a17253fcafc None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:19.622988 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75616450-8ac3-4b64-b3f8-2a17253fcafc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:19.654778 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-75616450-8ac3-4b64-b3f8-2a17253fcafc None None] MFA Rules not processed for user `1096012950d645a0ab7050ea661826db`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:37:19.656538 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-75616450-8ac3-4b64-b3f8-2a17253fcafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:19.751170 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9d959222-8e05-4b6d-9c96-ddd4b8728c70 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4059ae3ed60045e29a92b633087667d3'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:19.772939 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9d959222-8e05-4b6d-9c96-ddd4b8728c70 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4059ae3ed60045e29a92b633087667d3'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:19.783808 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3318/6668] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:37:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:37:19.783808 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7d0ea-0f67-460d-adf4-e68d6ceaf32f None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:19.783808 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7d0ea-0f67-460d-adf4-e68d6ceaf32f None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:19.783808 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7d0ea-0f67-460d-adf4-e68d6ceaf32f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:19.787525 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9d959222-8e05-4b6d-9c96-ddd4b8728c70 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4059ae3ed60045e29a92b633087667d3'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:19.810000 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-9eb7d0ea-0f67-460d-adf4-e68d6ceaf32f None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:37:19.810817 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-9eb7d0ea-0f67-460d-adf4-e68d6ceaf32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:19.863171 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9d959222-8e05-4b6d-9c96-ddd4b8728c70 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4059ae3ed60045e29a92b633087667d3'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:19.863843 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9d959222-8e05-4b6d-9c96-ddd4b8728c70 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4059ae3ed60045e29a92b633087667d3'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:19.902519 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3319/6669] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:37:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:37:19.903884 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8851b7bd-7a1b-4892-9e88-aacf2976e78a None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:19.904168 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8851b7bd-7a1b-4892-9e88-aacf2976e78a None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:19.904442 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8851b7bd-7a1b-4892-9e88-aacf2976e78a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:19.932899 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-8851b7bd-7a1b-4892-9e88-aacf2976e78a None None] MFA Rules not processed for user `1096012950d645a0ab7050ea661826db`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:37:19.934079 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8851b7bd-7a1b-4892-9e88-aacf2976e78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:20.008791 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3320/6670] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:37:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:37:20.010030 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8851b7bd-7a1b-4892-9e88-aacf2976e78a None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:20.012637 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8851b7bd-7a1b-4892-9e88-aacf2976e78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:20.027726 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9d959222-8e05-4b6d-9c96-ddd4b8728c70 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '495906607c7647d99d01dedf20db105c', 'request_id': 'req-9d959222-8e05-4b6d-9c96-ddd4b8728c70'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:20.057910 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9d959222-8e05-4b6d-9c96-ddd4b8728c70 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '495906607c7647d99d01dedf20db105c', 'request_id': 'req-9d959222-8e05-4b6d-9c96-ddd4b8728c70'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:20.119097 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8851b7bd-7a1b-4892-9e88-aacf2976e78a None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:20.143259 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9d959222-8e05-4b6d-9c96-ddd4b8728c70 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '495906607c7647d99d01dedf20db105c', 'request_id': 'req-9d959222-8e05-4b6d-9c96-ddd4b8728c70'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:20.165031 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9d959222-8e05-4b6d-9c96-ddd4b8728c70 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] The token cache is being invalidate because project 495906607c7647d99d01dedf20db105c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:37:20.165304 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9d959222-8e05-4b6d-9c96-ddd4b8728c70 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:20.170487 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9d959222-8e05-4b6d-9c96-ddd4b8728c70 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:20.179189 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f0f6e7-ec79-490b-bc33-3f8a9820a4b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:20.180285 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0f6e7-ec79-490b-bc33-3f8a9820a4b5 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:20.180773 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0f6e7-ec79-490b-bc33-3f8a9820a4b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:20.181251 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0f6e7-ec79-490b-bc33-3f8a9820a4b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:20.183387 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-65f0f6e7-ec79-490b-bc33-3f8a9820a4b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:20.190602 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9d959222-8e05-4b6d-9c96-ddd4b8728c70 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '495906607c7647d99d01dedf20db105c', 'request_id': 'req-9d959222-8e05-4b6d-9c96-ddd4b8728c70'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:20.192359 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9d959222-8e05-4b6d-9c96-ddd4b8728c70 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '495906607c7647d99d01dedf20db105c', 'request_id': 'req-9d959222-8e05-4b6d-9c96-ddd4b8728c70'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:20.197338 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9d959222-8e05-4b6d-9c96-ddd4b8728c70 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '495906607c7647d99d01dedf20db105c', 'request_id': 'req-9d959222-8e05-4b6d-9c96-ddd4b8728c70'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:20.211119 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3351/6671] 10.222.0.52 () {58 vars in 1229 bytes} [Sat May 14 21:37:19 2022] DELETE /identity/v3/domains/495906607c7647d99d01dedf20db105c => generated 0 bytes in 990 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:37:20.219446 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4e70f-589e-472d-b40f-fb86f7220910 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:20.221192 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4e70f-589e-472d-b40f-fb86f7220910 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:20.221504 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4e70f-589e-472d-b40f-fb86f7220910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:20.251642 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-50b4e70f-589e-472d-b40f-fb86f7220910 None None] MFA Rules not processed for user `1096012950d645a0ab7050ea661826db`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:37:20.253101 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-50b4e70f-589e-472d-b40f-fb86f7220910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:20.299009 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f0f6e7-ec79-490b-bc33-3f8a9820a4b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:20.300711 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f0f6e7-ec79-490b-bc33-3f8a9820a4b5 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:20.311998 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3321/6672] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:37:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:37:20.312862 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f0f6e7-ec79-490b-bc33-3f8a9820a4b5 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:20.314685 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-65f0f6e7-ec79-490b-bc33-3f8a9820a4b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:20.395985 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3352/6673] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:37:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:37:20.403254 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b4e70f-589e-472d-b40f-fb86f7220910 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:20.404822 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-50b4e70f-589e-472d-b40f-fb86f7220910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:20.459518 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f0f6e7-ec79-490b-bc33-3f8a9820a4b5 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:20.466772 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b18a53-7102-4065-b8c2-602104f916c6 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73d2e2a0d2e043688d1bd544cbaeb63a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3af19d6975042e9ae8347d2093f3f30', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:20.467553 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b18a53-7102-4065-b8c2-602104f916c6 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:20.467846 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b18a53-7102-4065-b8c2-602104f916c6 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:20.468220 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b18a53-7102-4065-b8c2-602104f916c6 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] PATH_INFO: `/v3/domains/495906607c7647d99d01dedf20db105c` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:20.478927 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b18a53-7102-4065-b8c2-602104f916c6 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=495906607c7647d99d01dedf20db105c)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:20.487095 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b18a53-7102-4065-b8c2-602104f916c6 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:20.516044 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-50b18a53-7102-4065-b8c2-602104f916c6 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Could not find domain: 495906607c7647d99d01dedf20db105c.: keystone.exception.DomainNotFound: Could not find domain: 495906607c7647d99d01dedf20db105c. May 14 21:37:20.516044 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:37:20.516044 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 14 21:37:20.516044 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 14 21:37:20.516044 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 21:37:20.516044 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 21:37:20.516044 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 21:37:20.516044 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 21:37:20.516044 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 495906607c7647d99d01dedf20db105c. May 14 21:37:20.516044 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:37:20.516044 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 21:37:20.516044 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:37:20.516044 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:37:20.516044 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 21:37:20.516044 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 21:37:20.516044 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 21:37:20.518143 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 21:37:20.518143 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 21:37:20.518143 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 21:37:20.518143 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 21:37:20.518143 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 21:37:20.518143 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 21:37:20.518143 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 21:37:20.518143 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 21:37:20.518143 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 21:37:20.518143 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 21:37:20.518143 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 21:37:20.518143 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 21:37:20.518143 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 21:37:20.518143 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 21:37:20.518143 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 21:37:20.518143 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 21:37:20.518143 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 21:37:20.523948 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 21:37:20.523948 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 21:37:20.523948 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 21:37:20.523948 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 21:37:20.523948 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 21:37:20.523948 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 21:37:20.523948 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 21:37:20.523948 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 21:37:20.523948 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 21:37:20.523948 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 21:37:20.523948 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 14 21:37:20.523948 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 21:37:20.523948 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 495906607c7647d99d01dedf20db105c. May 14 21:37:20.523948 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:37:20.523948 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3322/6674] 10.222.0.52 () {58 vars in 1226 bytes} [Sat May 14 21:37:20 2022] GET /identity/v3/domains/495906607c7647d99d01dedf20db105c => generated 112 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 14 21:37:20.526776 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b18a53-7102-4065-b8c2-602104f916c6 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:20.529626 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-50b18a53-7102-4065-b8c2-602104f916c6 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:20.533510 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b4e70f-589e-472d-b40f-fb86f7220910 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:20.541425 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aab7e9f-ef55-4a71-822b-785060f4bdde service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:20.542701 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aab7e9f-ef55-4a71-822b-785060f4bdde service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:20.543158 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aab7e9f-ef55-4a71-822b-785060f4bdde service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:20.543812 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aab7e9f-ef55-4a71-822b-785060f4bdde service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:20.545548 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b18a53-7102-4065-b8c2-602104f916c6 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:20.547573 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-9aab7e9f-ef55-4a71-822b-785060f4bdde service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:20.552487 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d5169f-445d-4e29-809e-ec17cef3165e tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73d2e2a0d2e043688d1bd544cbaeb63a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3af19d6975042e9ae8347d2093f3f30', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:20.553429 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d5169f-445d-4e29-809e-ec17cef3165e tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:20.553820 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d5169f-445d-4e29-809e-ec17cef3165e tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:20.554229 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d5169f-445d-4e29-809e-ec17cef3165e tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] PATH_INFO: `/v3/users/4059ae3ed60045e29a92b633087667d3` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:20.564378 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d5169f-445d-4e29-809e-ec17cef3165e tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: Authorizing `identity:get_user(user_id=4059ae3ed60045e29a92b633087667d3)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:20.567207 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d5169f-445d-4e29-809e-ec17cef3165e tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:20.567512 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aab7e9f-ef55-4a71-822b-785060f4bdde service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:20.569286 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aab7e9f-ef55-4a71-822b-785060f4bdde service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:20.586573 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3353/6675] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:37:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:37:20.588362 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-04d5169f-445d-4e29-809e-ec17cef3165e tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Could not find user: 4059ae3ed60045e29a92b633087667d3.: keystone.exception.UserNotFound: Could not find user: 4059ae3ed60045e29a92b633087667d3. May 14 21:37:20.588362 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:37:20.588362 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 21:37:20.588362 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 21:37:20.588362 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 21:37:20.588362 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 21:37:20.588362 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 21:37:20.588362 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 21:37:20.588362 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 21:37:20.588362 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 21:37:20.588362 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 21:37:20.588362 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 21:37:20.588362 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 14 21:37:20.588362 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_user(user_id) May 14 21:37:20.589654 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 14 21:37:20.589654 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 14 21:37:20.589654 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 21:37:20.589654 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 21:37:20.589654 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 21:37:20.589654 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 21:37:20.589654 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 14 21:37:20.589654 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 21:37:20.589654 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 21:37:20.589654 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 21:37:20.589654 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 21:37:20.589654 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 21:37:20.589654 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 21:37:20.589654 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 21:37:20.589654 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 21:37:20.589654 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 21:37:20.589654 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 21:37:20.591029 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 21:37:20.591029 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 21:37:20.591029 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 21:37:20.591029 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 21:37:20.591029 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 21:37:20.591029 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 14 21:37:20.591029 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 14 21:37:20.591029 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 14 21:37:20.591029 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 14 21:37:20.591029 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 14 21:37:20.591029 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 14 21:37:20.591029 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 4059ae3ed60045e29a92b633087667d3. May 14 21:37:20.591029 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:37:20.596281 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3323/6676] 10.222.0.52 () {58 vars in 1220 bytes} [Sat May 14 21:37:20 2022] GET /identity/v3/users/4059ae3ed60045e29a92b633087667d3 => generated 110 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 14 21:37:20.598915 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aab7e9f-ef55-4a71-822b-785060f4bdde service nova] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:20.631138 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aab7e9f-ef55-4a71-822b-785060f4bdde service nova] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:20.636766 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b60d9e-3382-4d11-9202-733a05194893 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73d2e2a0d2e043688d1bd544cbaeb63a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3af19d6975042e9ae8347d2093f3f30', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:20.637629 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b60d9e-3382-4d11-9202-733a05194893 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:20.637922 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b60d9e-3382-4d11-9202-733a05194893 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:20.638186 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b60d9e-3382-4d11-9202-733a05194893 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] PATH_INFO: `/v3/groups/caed9235bafe4747859172076b8a748f` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:20.644851 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b60d9e-3382-4d11-9202-733a05194893 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: Authorizing `identity:get_group(group_id=caed9235bafe4747859172076b8a748f)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:20.647203 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b60d9e-3382-4d11-9202-733a05194893 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:20.672846 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-68b60d9e-3382-4d11-9202-733a05194893 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Could not find group: caed9235bafe4747859172076b8a748f.: keystone.exception.GroupNotFound: Could not find group: caed9235bafe4747859172076b8a748f. May 14 21:37:20.672846 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:37:20.672846 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 21:37:20.672846 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 21:37:20.672846 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 21:37:20.672846 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 21:37:20.672846 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 21:37:20.672846 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 21:37:20.672846 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 21:37:20.672846 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 21:37:20.672846 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 21:37:20.672846 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 21:37:20.672846 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 58, in get May 14 21:37:20.672846 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_group(group_id) May 14 21:37:20.674024 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 70, in _get_group May 14 21:37:20.674024 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.identity_api.get_group(group_id)) May 14 21:37:20.674024 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 21:37:20.674024 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 21:37:20.674024 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 21:37:20.674024 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 21:37:20.674024 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 14 21:37:20.674024 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 21:37:20.674024 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 21:37:20.674024 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 21:37:20.674024 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 21:37:20.674024 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 21:37:20.674024 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 21:37:20.674024 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 21:37:20.674024 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 21:37:20.674024 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 21:37:20.674024 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 21:37:20.679599 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 21:37:20.679599 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 21:37:20.679599 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 21:37:20.679599 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 21:37:20.679599 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 21:37:20.679599 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group May 14 21:37:20.679599 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) May 14 21:37:20.679599 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group May 14 21:37:20.679599 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() May 14 21:37:20.679599 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group May 14 21:37:20.679599 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) May 14 21:37:20.679599 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: caed9235bafe4747859172076b8a748f. May 14 21:37:20.679599 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:37:20.679599 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3354/6677] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:37:20 2022] GET /identity/v3/groups/caed9235bafe4747859172076b8a748f => generated 111 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 14 21:37:20.680851 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d5169f-445d-4e29-809e-ec17cef3165e tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:20.695570 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d5169f-445d-4e29-809e-ec17cef3165e tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:20.706672 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff03df2-4b6c-45ab-905d-4264efccb05a tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73d2e2a0d2e043688d1bd544cbaeb63a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3af19d6975042e9ae8347d2093f3f30', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:20.707391 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff03df2-4b6c-45ab-905d-4264efccb05a tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:20.707701 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff03df2-4b6c-45ab-905d-4264efccb05a tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:20.708067 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff03df2-4b6c-45ab-905d-4264efccb05a tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] PATH_INFO: `/v3/groups/caed9235bafe4747859172076b8a748f` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:20.726340 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff03df2-4b6c-45ab-905d-4264efccb05a tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 21:37:20.738492 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-dff03df2-4b6c-45ab-905d-4264efccb05a tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Could not find group: caed9235bafe4747859172076b8a748f.: keystone.exception.GroupNotFound: Could not find group: caed9235bafe4747859172076b8a748f. May 14 21:37:20.738492 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:37:20.738492 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 21:37:20.738492 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 21:37:20.738492 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 21:37:20.738492 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 21:37:20.738492 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 21:37:20.738492 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 21:37:20.738492 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 21:37:20.738492 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 21:37:20.738492 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 21:37:20.738492 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 21:37:20.738492 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 133, in delete May 14 21:37:20.738492 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_group') May 14 21:37:20.739634 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 21:37:20.739634 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 21:37:20.739634 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 21:37:20.739634 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 21:37:20.739634 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 21:37:20.739634 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 21:37:20.739634 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 21:37:20.739634 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 21:37:20.739634 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 14 21:37:20.739634 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 21:37:20.739634 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 21:37:20.739634 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 21:37:20.739634 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 21:37:20.739634 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 21:37:20.739634 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 21:37:20.739634 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 21:37:20.739634 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 21:37:20.741073 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 21:37:20.741073 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 21:37:20.741073 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 21:37:20.741073 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 21:37:20.741073 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 21:37:20.741073 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 21:37:20.741073 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 21:37:20.741073 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group May 14 21:37:20.741073 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) May 14 21:37:20.741073 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group May 14 21:37:20.741073 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() May 14 21:37:20.741073 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group May 14 21:37:20.741073 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) May 14 21:37:20.741073 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: caed9235bafe4747859172076b8a748f. May 14 21:37:20.741073 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:37:20.743743 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3324/6678] 10.222.0.52 () {58 vars in 1226 bytes} [Sat May 14 21:37:20 2022] DELETE /identity/v3/groups/caed9235bafe4747859172076b8a748f => generated 111 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 14 21:37:20.744378 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b60d9e-3382-4d11-9202-733a05194893 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:20.758088 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b60d9e-3382-4d11-9202-733a05194893 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:20.764697 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f3f2d3-0448-4c43-9cd7-203f3215c1dc tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73d2e2a0d2e043688d1bd544cbaeb63a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3af19d6975042e9ae8347d2093f3f30', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:20.765867 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f3f2d3-0448-4c43-9cd7-203f3215c1dc tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:20.766680 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f3f2d3-0448-4c43-9cd7-203f3215c1dc tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:20.767526 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f3f2d3-0448-4c43-9cd7-203f3215c1dc tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] PATH_INFO: `/v3/users/4059ae3ed60045e29a92b633087667d3` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:20.778798 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f3f2d3-0448-4c43-9cd7-203f3215c1dc tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: Authorizing `identity:delete_user(user_id=4059ae3ed60045e29a92b633087667d3)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:20.784579 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f3f2d3-0448-4c43-9cd7-203f3215c1dc tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:20.807700 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-27f3f2d3-0448-4c43-9cd7-203f3215c1dc tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Could not find user: 4059ae3ed60045e29a92b633087667d3.: keystone.exception.UserNotFound: Could not find user: 4059ae3ed60045e29a92b633087667d3. May 14 21:37:20.807700 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:37:20.807700 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 21:37:20.807700 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 21:37:20.807700 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 21:37:20.807700 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 21:37:20.807700 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 21:37:20.807700 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 21:37:20.807700 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 21:37:20.807700 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 21:37:20.807700 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 21:37:20.807700 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 21:37:20.807700 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 14 21:37:20.807700 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user(user_id) May 14 21:37:20.808879 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 21:37:20.808879 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 21:37:20.808879 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 21:37:20.808879 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 21:37:20.808879 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 14 21:37:20.808879 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 21:37:20.808879 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 14 21:37:20.808879 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 14 21:37:20.808879 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 21:37:20.808879 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 21:37:20.808879 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 21:37:20.808879 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 21:37:20.808879 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 14 21:37:20.808879 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 21:37:20.808879 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 21:37:20.808879 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 21:37:20.808879 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 21:37:20.808879 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 21:37:20.810199 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 21:37:20.810199 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 21:37:20.810199 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 21:37:20.810199 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 21:37:20.810199 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 21:37:20.810199 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 21:37:20.810199 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 21:37:20.810199 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 21:37:20.810199 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 21:37:20.810199 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 21:37:20.810199 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 14 21:37:20.810199 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 14 21:37:20.810199 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 14 21:37:20.810199 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 14 21:37:20.810199 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 14 21:37:20.810199 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 14 21:37:20.810199 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 4059ae3ed60045e29a92b633087667d3. May 14 21:37:20.810199 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:37:20.818276 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff03df2-4b6c-45ab-905d-4264efccb05a tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:20.818694 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3355/6679] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:37:20 2022] DELETE /identity/v3/users/4059ae3ed60045e29a92b633087667d3 => generated 110 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 14 21:37:20.839795 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff03df2-4b6c-45ab-905d-4264efccb05a tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:20.854973 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a1b2a-b997-4106-8bdd-04218e5ecbdd tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73d2e2a0d2e043688d1bd544cbaeb63a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3af19d6975042e9ae8347d2093f3f30', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:20.856083 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a1b2a-b997-4106-8bdd-04218e5ecbdd tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:20.856375 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a1b2a-b997-4106-8bdd-04218e5ecbdd tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:20.856657 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a1b2a-b997-4106-8bdd-04218e5ecbdd tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] PATH_INFO: `/v3/domains/495906607c7647d99d01dedf20db105c` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:20.880427 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20a1b2a-b997-4106-8bdd-04218e5ecbdd tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 21:37:20.893301 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-d20a1b2a-b997-4106-8bdd-04218e5ecbdd tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Could not find domain: 495906607c7647d99d01dedf20db105c.: keystone.exception.DomainNotFound: Could not find domain: 495906607c7647d99d01dedf20db105c. May 14 21:37:20.893301 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:37:20.893301 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 14 21:37:20.893301 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 14 21:37:20.893301 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 21:37:20.893301 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 21:37:20.893301 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 21:37:20.893301 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 21:37:20.893301 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 495906607c7647d99d01dedf20db105c. May 14 21:37:20.893301 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:37:20.893301 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 21:37:20.893301 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:37:20.893301 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:37:20.893301 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 21:37:20.893301 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 21:37:20.893301 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 21:37:20.894883 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 21:37:20.894883 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 21:37:20.894883 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 21:37:20.894883 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 21:37:20.894883 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 21:37:20.894883 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 21:37:20.894883 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 21:37:20.894883 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch May 14 21:37:20.894883 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') May 14 21:37:20.894883 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 21:37:20.894883 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 21:37:20.894883 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 21:37:20.894883 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 21:37:20.894883 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 21:37:20.894883 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 21:37:20.894883 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 21:37:20.896612 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 21:37:20.896612 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 21:37:20.896612 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 21:37:20.896612 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 21:37:20.896612 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 21:37:20.896612 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 21:37:20.896612 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 21:37:20.896612 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 21:37:20.896612 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 21:37:20.896612 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 21:37:20.896612 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 21:37:20.896612 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 21:37:20.896612 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 21:37:20.896612 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 14 21:37:20.896612 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 21:37:20.896612 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 495906607c7647d99d01dedf20db105c. May 14 21:37:20.896612 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:37:20.897798 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3325/6680] 10.222.0.52 () {60 vars in 1248 bytes} [Sat May 14 21:37:20 2022] PATCH /identity/v3/domains/495906607c7647d99d01dedf20db105c => generated 112 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 14 21:37:20.902964 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f3f2d3-0448-4c43-9cd7-203f3215c1dc tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:20.918577 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f3f2d3-0448-4c43-9cd7-203f3215c1dc tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:20.928261 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f2b1af-6847-4df7-9bb2-fe70ff5c6af9 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73d2e2a0d2e043688d1bd544cbaeb63a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3af19d6975042e9ae8347d2093f3f30', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:20.928954 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f2b1af-6847-4df7-9bb2-fe70ff5c6af9 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:20.929204 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f2b1af-6847-4df7-9bb2-fe70ff5c6af9 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:20.929510 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f2b1af-6847-4df7-9bb2-fe70ff5c6af9 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:20.933013 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f2b1af-6847-4df7-9bb2-fe70ff5c6af9 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:20.934915 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f2b1af-6847-4df7-9bb2-fe70ff5c6af9 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:20.975988 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a1b2a-b997-4106-8bdd-04218e5ecbdd tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:20.976664 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3356/6681] 10.222.0.52 () {58 vars in 1127 bytes} [Sat May 14 21:37:20 2022] GET /identity/v3/domains => generated 1350 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:37:20.993596 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a1b2a-b997-4106-8bdd-04218e5ecbdd tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:21.004505 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11b8e06-9363-4fab-8401-647952d80b97 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73d2e2a0d2e043688d1bd544cbaeb63a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3af19d6975042e9ae8347d2093f3f30', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:21.004874 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b8e06-9363-4fab-8401-647952d80b97 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:21.005188 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b8e06-9363-4fab-8401-647952d80b97 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:21.005533 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b8e06-9363-4fab-8401-647952d80b97 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:21.006908 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11b8e06-9363-4fab-8401-647952d80b97 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: Adding query filter params (enabled=True) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:37:21.006908 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11b8e06-9363-4fab-8401-647952d80b97 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:21.008577 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11b8e06-9363-4fab-8401-647952d80b97 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:21.040349 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3326/6682] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:37:20 2022] GET /identity/v3/domains?enabled=True => generated 1096 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:37:21.045973 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f2b1af-6847-4df7-9bb2-fe70ff5c6af9 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:21.087047 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f2b1af-6847-4df7-9bb2-fe70ff5c6af9 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:21.106941 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207d6e97-731a-4055-9e47-7344830c7c07 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73d2e2a0d2e043688d1bd544cbaeb63a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3af19d6975042e9ae8347d2093f3f30', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:21.107806 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d6e97-731a-4055-9e47-7344830c7c07 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:21.108095 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d6e97-731a-4055-9e47-7344830c7c07 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:21.108376 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d6e97-731a-4055-9e47-7344830c7c07 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:21.109468 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207d6e97-731a-4055-9e47-7344830c7c07 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: Adding query filter params (name=tempest-test_domain-1744284061) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:37:21.111931 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207d6e97-731a-4055-9e47-7344830c7c07 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:21.113568 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207d6e97-731a-4055-9e47-7344830c7c07 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:21.128811 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3357/6683] 10.222.0.52 () {58 vars in 1198 bytes} [Sat May 14 21:37:21 2022] GET /identity/v3/domains?name=tempest-test_domain-1744284061 => generated 409 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:37:21.133991 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11b8e06-9363-4fab-8401-647952d80b97 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:21.147611 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11b8e06-9363-4fab-8401-647952d80b97 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:21.163398 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7971fc9-b462-4b54-9fa2-cc256a132b34 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73d2e2a0d2e043688d1bd544cbaeb63a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3af19d6975042e9ae8347d2093f3f30', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:21.164417 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7971fc9-b462-4b54-9fa2-cc256a132b34 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:21.164777 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7971fc9-b462-4b54-9fa2-cc256a132b34 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:21.165105 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7971fc9-b462-4b54-9fa2-cc256a132b34 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] PATH_INFO: `/v3/domains/495906607c7647d99d01dedf20db105c` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:21.183766 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7971fc9-b462-4b54-9fa2-cc256a132b34 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 21:37:21.208273 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-c7971fc9-b462-4b54-9fa2-cc256a132b34 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Could not find domain: 495906607c7647d99d01dedf20db105c.: keystone.exception.DomainNotFound: Could not find domain: 495906607c7647d99d01dedf20db105c. May 14 21:37:21.208273 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:37:21.208273 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 14 21:37:21.208273 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 14 21:37:21.208273 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 21:37:21.208273 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 21:37:21.208273 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 21:37:21.208273 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 21:37:21.208273 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 495906607c7647d99d01dedf20db105c. May 14 21:37:21.208273 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:37:21.208273 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 21:37:21.208273 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:37:21.208273 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:37:21.208273 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 21:37:21.208273 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 21:37:21.208273 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 21:37:21.209485 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 21:37:21.209485 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 21:37:21.209485 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 21:37:21.209485 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 21:37:21.209485 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 21:37:21.209485 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 21:37:21.209485 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 21:37:21.209485 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch May 14 21:37:21.209485 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') May 14 21:37:21.209485 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 21:37:21.209485 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 21:37:21.209485 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 21:37:21.209485 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 21:37:21.209485 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 21:37:21.209485 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 21:37:21.209485 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 21:37:21.210572 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 21:37:21.210572 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 21:37:21.210572 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 21:37:21.210572 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 21:37:21.210572 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 21:37:21.210572 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 21:37:21.210572 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 21:37:21.210572 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 21:37:21.210572 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 21:37:21.210572 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 21:37:21.210572 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 21:37:21.210572 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 21:37:21.210572 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 21:37:21.210572 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 14 21:37:21.210572 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 21:37:21.210572 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 495906607c7647d99d01dedf20db105c. May 14 21:37:21.210572 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:37:21.211761 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3327/6684] 10.222.0.52 () {60 vars in 1248 bytes} [Sat May 14 21:37:21 2022] PATCH /identity/v3/domains/495906607c7647d99d01dedf20db105c => generated 112 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 14 21:37:21.216876 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207d6e97-731a-4055-9e47-7344830c7c07 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:21.228829 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207d6e97-731a-4055-9e47-7344830c7c07 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:21.237761 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078ac795-6390-4b2d-99f1-009a11a1af10 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73d2e2a0d2e043688d1bd544cbaeb63a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3af19d6975042e9ae8347d2093f3f30', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:21.238654 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ac795-6390-4b2d-99f1-009a11a1af10 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:21.239013 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ac795-6390-4b2d-99f1-009a11a1af10 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:21.239452 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ac795-6390-4b2d-99f1-009a11a1af10 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] PATH_INFO: `/v3/domains/78cc5894e01d4085a03e9147829562af` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:21.280463 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078ac795-6390-4b2d-99f1-009a11a1af10 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=78cc5894e01d4085a03e9147829562af)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:21.284288 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078ac795-6390-4b2d-99f1-009a11a1af10 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:21.440134 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3358/6685] 10.222.0.52 () {60 vars in 1248 bytes} [Sat May 14 21:37:21 2022] PATCH /identity/v3/domains/78cc5894e01d4085a03e9147829562af => generated 278 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:37:21.442138 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7971fc9-b462-4b54-9fa2-cc256a132b34 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:21.463376 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7971fc9-b462-4b54-9fa2-cc256a132b34 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:21.480337 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4bfa9c-f099-4c75-9f7d-006abadf9e70 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73d2e2a0d2e043688d1bd544cbaeb63a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3af19d6975042e9ae8347d2093f3f30', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:21.481241 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4bfa9c-f099-4c75-9f7d-006abadf9e70 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:21.481530 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4bfa9c-f099-4c75-9f7d-006abadf9e70 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:21.481805 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4bfa9c-f099-4c75-9f7d-006abadf9e70 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] PATH_INFO: `/v3/domains/78cc5894e01d4085a03e9147829562af` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:21.520227 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078ac795-6390-4b2d-99f1-009a11a1af10 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:21.523890 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-078ac795-6390-4b2d-99f1-009a11a1af10 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:21.528959 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4bfa9c-f099-4c75-9f7d-006abadf9e70 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=78cc5894e01d4085a03e9147829562af)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:21.528959 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4bfa9c-f099-4c75-9f7d-006abadf9e70 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:21.556917 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078ac795-6390-4b2d-99f1-009a11a1af10 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:21.566606 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c2c0b-de7e-48f4-a6e9-a3c8b02f6f62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:21.567362 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c2c0b-de7e-48f4-a6e9-a3c8b02f6f62 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:21.568770 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c2c0b-de7e-48f4-a6e9-a3c8b02f6f62 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:21.569088 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c2c0b-de7e-48f4-a6e9-a3c8b02f6f62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:21.575445 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-523c2c0b-de7e-48f4-a6e9-a3c8b02f6f62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:21.611040 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c2c0b-de7e-48f4-a6e9-a3c8b02f6f62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:21.612650 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c2c0b-de7e-48f4-a6e9-a3c8b02f6f62 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:21.620846 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-cb4bfa9c-f099-4c75-9f7d-006abadf9e70 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '78cc5894e01d4085a03e9147829562af'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:21.657689 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3359/6686] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:37:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:37:21.685867 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-cb4bfa9c-f099-4c75-9f7d-006abadf9e70 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '78cc5894e01d4085a03e9147829562af'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:21.898759 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-cb4bfa9c-f099-4c75-9f7d-006abadf9e70 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78cc5894e01d4085a03e9147829562af', 'request_id': 'req-cb4bfa9c-f099-4c75-9f7d-006abadf9e70'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:21.919558 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-cb4bfa9c-f099-4c75-9f7d-006abadf9e70 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78cc5894e01d4085a03e9147829562af', 'request_id': 'req-cb4bfa9c-f099-4c75-9f7d-006abadf9e70'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:21.961826 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c2c0b-de7e-48f4-a6e9-a3c8b02f6f62 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:21.962479 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-cb4bfa9c-f099-4c75-9f7d-006abadf9e70 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78cc5894e01d4085a03e9147829562af', 'request_id': 'req-cb4bfa9c-f099-4c75-9f7d-006abadf9e70'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:21.963449 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-523c2c0b-de7e-48f4-a6e9-a3c8b02f6f62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:21.988027 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c2c0b-de7e-48f4-a6e9-a3c8b02f6f62 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:22.097438 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-cb4bfa9c-f099-4c75-9f7d-006abadf9e70 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] The token cache is being invalidate because project 78cc5894e01d4085a03e9147829562af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:37:22.097804 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-cb4bfa9c-f099-4c75-9f7d-006abadf9e70 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:22.101927 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-cb4bfa9c-f099-4c75-9f7d-006abadf9e70 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:22.118443 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-cb4bfa9c-f099-4c75-9f7d-006abadf9e70 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '78cc5894e01d4085a03e9147829562af', 'request_id': 'req-cb4bfa9c-f099-4c75-9f7d-006abadf9e70'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:22.128367 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-cb4bfa9c-f099-4c75-9f7d-006abadf9e70 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '78cc5894e01d4085a03e9147829562af', 'request_id': 'req-cb4bfa9c-f099-4c75-9f7d-006abadf9e70'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:22.142144 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-cb4bfa9c-f099-4c75-9f7d-006abadf9e70 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '78cc5894e01d4085a03e9147829562af', 'request_id': 'req-cb4bfa9c-f099-4c75-9f7d-006abadf9e70'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:22.163756 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd017698-9825-4bcd-9859-73d04f9899a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:22.169195 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd017698-9825-4bcd-9859-73d04f9899a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:22.169195 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd017698-9825-4bcd-9859-73d04f9899a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:22.169195 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd017698-9825-4bcd-9859-73d04f9899a2 admin admin] PATH_INFO: `/v3/projects/7646e9d3454645fb828ff54bcd16eeaf` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:22.169195 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd017698-9825-4bcd-9859-73d04f9899a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7646e9d3454645fb828ff54bcd16eeaf)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:22.170278 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd017698-9825-4bcd-9859-73d04f9899a2 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:22.177541 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3328/6687] 10.222.0.52 () {58 vars in 1229 bytes} [Sat May 14 21:37:21 2022] DELETE /identity/v3/domains/78cc5894e01d4085a03e9147829562af => generated 0 bytes in 736 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:37:22.183887 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4bfa9c-f099-4c75-9f7d-006abadf9e70 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:22.190496 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-cb4bfa9c-f099-4c75-9f7d-006abadf9e70 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:22.347994 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4bfa9c-f099-4c75-9f7d-006abadf9e70 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:22.367829 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-fd017698-9825-4bcd-9859-73d04f9899a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7646e9d3454645fb828ff54bcd16eeaf', 'request_id': 'req-fd017698-9825-4bcd-9859-73d04f9899a2'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:22.375043 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-fd017698-9825-4bcd-9859-73d04f9899a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7646e9d3454645fb828ff54bcd16eeaf', 'request_id': 'req-fd017698-9825-4bcd-9859-73d04f9899a2'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:22.465120 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f2fafb-ce64-4c0a-949d-9f88f89927b2 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73d2e2a0d2e043688d1bd544cbaeb63a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3af19d6975042e9ae8347d2093f3f30', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:22.466144 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2fafb-ce64-4c0a-949d-9f88f89927b2 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:22.469292 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2fafb-ce64-4c0a-949d-9f88f89927b2 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:22.469292 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2fafb-ce64-4c0a-949d-9f88f89927b2 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] PATH_INFO: `/v3/domains/194953757f8440028080bcde807c8084` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:22.481997 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f2fafb-ce64-4c0a-949d-9f88f89927b2 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=194953757f8440028080bcde807c8084)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:22.484575 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f2fafb-ce64-4c0a-949d-9f88f89927b2 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:22.494482 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-fd017698-9825-4bcd-9859-73d04f9899a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7646e9d3454645fb828ff54bcd16eeaf', 'request_id': 'req-fd017698-9825-4bcd-9859-73d04f9899a2'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:22.517734 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-fd017698-9825-4bcd-9859-73d04f9899a2 admin admin] The token cache is being invalidate because project 7646e9d3454645fb828ff54bcd16eeaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:37:22.518078 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-fd017698-9825-4bcd-9859-73d04f9899a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:22.518798 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-fd017698-9825-4bcd-9859-73d04f9899a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:22.520165 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e0f2fafb-ce64-4c0a-949d-9f88f89927b2 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '194953757f8440028080bcde807c8084'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:22.521508 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e0f2fafb-ce64-4c0a-949d-9f88f89927b2 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '194953757f8440028080bcde807c8084'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:22.531126 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3360/6688] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:37:21 2022] DELETE /identity/v3/projects/7646e9d3454645fb828ff54bcd16eeaf => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:37:22.534030 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77378250-442e-46cc-8335-000ff2e5c02c None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:22.534321 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77378250-442e-46cc-8335-000ff2e5c02c None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:22.537275 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77378250-442e-46cc-8335-000ff2e5c02c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:22.569363 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-77378250-442e-46cc-8335-000ff2e5c02c None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:37:22.570945 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-77378250-442e-46cc-8335-000ff2e5c02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:22.640277 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e0f2fafb-ce64-4c0a-949d-9f88f89927b2 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '194953757f8440028080bcde807c8084'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:22.641612 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e0f2fafb-ce64-4c0a-949d-9f88f89927b2 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '194953757f8440028080bcde807c8084'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:22.649574 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3329/6689] 10.222.0.52 () {60 vars in 1248 bytes} [Sat May 14 21:37:22 2022] PATCH /identity/v3/domains/194953757f8440028080bcde807c8084 => generated 278 bytes in 467 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:37:22.651431 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f2fafb-ce64-4c0a-949d-9f88f89927b2 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:22.654501 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e0f2fafb-ce64-4c0a-949d-9f88f89927b2 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:22.675347 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3361/6690] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:37:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:37:22.684349 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1409b83-503d-4f0d-bfe2-9ca690aa6d86 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:22.685141 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1409b83-503d-4f0d-bfe2-9ca690aa6d86 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:22.685439 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1409b83-503d-4f0d-bfe2-9ca690aa6d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:22.711107 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-a1409b83-503d-4f0d-bfe2-9ca690aa6d86 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:37:22.713020 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-a1409b83-503d-4f0d-bfe2-9ca690aa6d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:22.724106 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3362/6691] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:37:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:37:22.731390 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1409b83-503d-4f0d-bfe2-9ca690aa6d86 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:22.743852 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1409b83-503d-4f0d-bfe2-9ca690aa6d86 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:22.751122 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be68c6-f19c-4c7f-8b55-b65a53fe6432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:22.752945 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be68c6-f19c-4c7f-8b55-b65a53fe6432 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:22.755058 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be68c6-f19c-4c7f-8b55-b65a53fe6432 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:22.755918 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be68c6-f19c-4c7f-8b55-b65a53fe6432 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:22.756876 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72be68c6-f19c-4c7f-8b55-b65a53fe6432 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:37:22.757400 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72be68c6-f19c-4c7f-8b55-b65a53fe6432 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:22.759291 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72be68c6-f19c-4c7f-8b55-b65a53fe6432 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:22.782602 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3363/6692] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:37:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:37:22.784741 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be68c6-f19c-4c7f-8b55-b65a53fe6432 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:22.798496 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be68c6-f19c-4c7f-8b55-b65a53fe6432 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:22.807215 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b501d69-92df-4881-badf-f4eef8992c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:22.809106 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b501d69-92df-4881-badf-f4eef8992c3e admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:22.809524 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b501d69-92df-4881-badf-f4eef8992c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:22.809900 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b501d69-92df-4881-badf-f4eef8992c3e admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:22.810703 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b501d69-92df-4881-badf-f4eef8992c3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:22.812999 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b501d69-92df-4881-badf-f4eef8992c3e admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:22.834613 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f2fafb-ce64-4c0a-949d-9f88f89927b2 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:22.845919 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86402968-ab80-4f2c-87c2-2dd25d9ccf32 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73d2e2a0d2e043688d1bd544cbaeb63a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3af19d6975042e9ae8347d2093f3f30', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:22.847412 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86402968-ab80-4f2c-87c2-2dd25d9ccf32 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:22.847847 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86402968-ab80-4f2c-87c2-2dd25d9ccf32 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:22.848917 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86402968-ab80-4f2c-87c2-2dd25d9ccf32 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] PATH_INFO: `/v3/domains/194953757f8440028080bcde807c8084` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:22.868766 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86402968-ab80-4f2c-87c2-2dd25d9ccf32 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=194953757f8440028080bcde807c8084)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:22.871165 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86402968-ab80-4f2c-87c2-2dd25d9ccf32 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:22.916516 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-86402968-ab80-4f2c-87c2-2dd25d9ccf32 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '194953757f8440028080bcde807c8084'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:22.939627 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-86402968-ab80-4f2c-87c2-2dd25d9ccf32 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '194953757f8440028080bcde807c8084'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:22.969011 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3364/6693] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:37:22 2022] POST /identity/v3/projects => generated 385 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:37:22.970900 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b501d69-92df-4881-badf-f4eef8992c3e admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:23.112564 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b501d69-92df-4881-badf-f4eef8992c3e admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:23.142569 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-86402968-ab80-4f2c-87c2-2dd25d9ccf32 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '194953757f8440028080bcde807c8084', 'request_id': 'req-86402968-ab80-4f2c-87c2-2dd25d9ccf32'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:23.162408 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-86402968-ab80-4f2c-87c2-2dd25d9ccf32 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '194953757f8440028080bcde807c8084', 'request_id': 'req-86402968-ab80-4f2c-87c2-2dd25d9ccf32'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:23.176510 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-86402968-ab80-4f2c-87c2-2dd25d9ccf32 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '194953757f8440028080bcde807c8084', 'request_id': 'req-86402968-ab80-4f2c-87c2-2dd25d9ccf32'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:23.228370 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076c41af-f007-41be-89c7-c89945cf544f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:23.229066 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c41af-f007-41be-89c7-c89945cf544f admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:23.229350 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c41af-f007-41be-89c7-c89945cf544f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:23.229628 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c41af-f007-41be-89c7-c89945cf544f admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:23.230471 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076c41af-f007-41be-89c7-c89945cf544f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:23.243687 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076c41af-f007-41be-89c7-c89945cf544f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:23.273370 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-86402968-ab80-4f2c-87c2-2dd25d9ccf32 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] The token cache is being invalidate because project 194953757f8440028080bcde807c8084 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:37:23.273941 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-86402968-ab80-4f2c-87c2-2dd25d9ccf32 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:23.277202 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-86402968-ab80-4f2c-87c2-2dd25d9ccf32 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:23.311877 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-86402968-ab80-4f2c-87c2-2dd25d9ccf32 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '194953757f8440028080bcde807c8084', 'request_id': 'req-86402968-ab80-4f2c-87c2-2dd25d9ccf32'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:23.313581 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-86402968-ab80-4f2c-87c2-2dd25d9ccf32 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '194953757f8440028080bcde807c8084', 'request_id': 'req-86402968-ab80-4f2c-87c2-2dd25d9ccf32'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:23.320964 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-86402968-ab80-4f2c-87c2-2dd25d9ccf32 tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '194953757f8440028080bcde807c8084', 'request_id': 'req-86402968-ab80-4f2c-87c2-2dd25d9ccf32'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:23.345200 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3330/6694] 10.222.0.52 () {58 vars in 1229 bytes} [Sat May 14 21:37:22 2022] DELETE /identity/v3/domains/194953757f8440028080bcde807c8084 => generated 0 bytes in 694 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:37:23.350701 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9860e78-56ac-40e4-b62e-7f9c299df3dd None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:23.351643 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9860e78-56ac-40e4-b62e-7f9c299df3dd None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:23.351943 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9860e78-56ac-40e4-b62e-7f9c299df3dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:23.366455 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3365/6695] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:37:22 2022] POST /identity/v3/users => generated 293 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:37:23.367409 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076c41af-f007-41be-89c7-c89945cf544f admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:23.371131 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-076c41af-f007-41be-89c7-c89945cf544f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:23.425137 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-e9860e78-56ac-40e4-b62e-7f9c299df3dd None None] MFA Rules not processed for user `1096012950d645a0ab7050ea661826db`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:37:23.431257 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e9860e78-56ac-40e4-b62e-7f9c299df3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:23.560768 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076c41af-f007-41be-89c7-c89945cf544f admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:23.575682 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9444ca19-acff-470f-b177-eddf0b5f7e4c tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73d2e2a0d2e043688d1bd544cbaeb63a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3af19d6975042e9ae8347d2093f3f30', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:23.579206 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9444ca19-acff-470f-b177-eddf0b5f7e4c tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:23.580772 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9444ca19-acff-470f-b177-eddf0b5f7e4c tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:23.581082 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9444ca19-acff-470f-b177-eddf0b5f7e4c tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] PATH_INFO: `/v3/domains/ca5db2c5a27a4c128cf7d025bae1d6e9` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:23.591451 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3331/6696] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:37:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:37:23.591451 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9860e78-56ac-40e4-b62e-7f9c299df3dd None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:23.593995 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e9860e78-56ac-40e4-b62e-7f9c299df3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:23.612771 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9444ca19-acff-470f-b177-eddf0b5f7e4c tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=ca5db2c5a27a4c128cf7d025bae1d6e9)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:23.616489 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9444ca19-acff-470f-b177-eddf0b5f7e4c tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:23.637471 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9860e78-56ac-40e4-b62e-7f9c299df3dd None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:23.650861 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd39dfa-991f-4059-8e22-a8a00e349056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:23.652421 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd39dfa-991f-4059-8e22-a8a00e349056 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:23.652721 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd39dfa-991f-4059-8e22-a8a00e349056 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:23.653882 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd39dfa-991f-4059-8e22-a8a00e349056 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:23.657661 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd39dfa-991f-4059-8e22-a8a00e349056 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:23.663330 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd39dfa-991f-4059-8e22-a8a00e349056 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:23.676070 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9444ca19-acff-470f-b177-eddf0b5f7e4c tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'ca5db2c5a27a4c128cf7d025bae1d6e9'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:23.679333 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9444ca19-acff-470f-b177-eddf0b5f7e4c tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'ca5db2c5a27a4c128cf7d025bae1d6e9'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:23.689198 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3332/6697] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:37:23 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:37:23.699162 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd39dfa-991f-4059-8e22-a8a00e349056 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:23.714145 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-3fd39dfa-991f-4059-8e22-a8a00e349056 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:23.760609 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd39dfa-991f-4059-8e22-a8a00e349056 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:23.831293 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e03a26-3822-42d7-b0cb-66678106663b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:23.832165 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e03a26-3822-42d7-b0cb-66678106663b admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:23.832525 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e03a26-3822-42d7-b0cb-66678106663b admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:23.832874 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e03a26-3822-42d7-b0cb-66678106663b admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:23.833684 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e03a26-3822-42d7-b0cb-66678106663b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:23.853461 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e03a26-3822-42d7-b0cb-66678106663b admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:23.854446 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9444ca19-acff-470f-b177-eddf0b5f7e4c tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'ca5db2c5a27a4c128cf7d025bae1d6e9'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:23.856773 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9444ca19-acff-470f-b177-eddf0b5f7e4c tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'ca5db2c5a27a4c128cf7d025bae1d6e9'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:23.865898 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3366/6698] 10.222.0.52 () {60 vars in 1248 bytes} [Sat May 14 21:37:23 2022] PATCH /identity/v3/domains/ca5db2c5a27a4c128cf7d025bae1d6e9 => generated 278 bytes in 499 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:37:23.871420 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9444ca19-acff-470f-b177-eddf0b5f7e4c tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:23.875885 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-9444ca19-acff-470f-b177-eddf0b5f7e4c tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:23.886962 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3333/6699] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:37:23 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:37:23.893425 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e03a26-3822-42d7-b0cb-66678106663b admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:23.898044 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-d8e03a26-3822-42d7-b0cb-66678106663b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:23.947845 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e03a26-3822-42d7-b0cb-66678106663b admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:23.953115 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e2cc52-e3a6-4577-a80d-b6bfc66c3e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:23.955453 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e2cc52-e3a6-4577-a80d-b6bfc66c3e60 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:23.955453 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e2cc52-e3a6-4577-a80d-b6bfc66c3e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:23.955453 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e2cc52-e3a6-4577-a80d-b6bfc66c3e60 admin admin] PATH_INFO: `/v3/projects/e823ee6e054449beab0e61898a5ed615/users/d9bef3c273cd48979539489880ef5edc/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:23.977355 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e2cc52-e3a6-4577-a80d-b6bfc66c3e60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e823ee6e054449beab0e61898a5ed615, user_id=d9bef3c273cd48979539489880ef5edc, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:23.980221 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e2cc52-e3a6-4577-a80d-b6bfc66c3e60 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:24.074933 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3334/6700] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:37:23 2022] PUT /identity/v3/projects/e823ee6e054449beab0e61898a5ed615/users/d9bef3c273cd48979539489880ef5edc/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:37:24.081909 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9444ca19-acff-470f-b177-eddf0b5f7e4c tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:24.088730 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b556cdd-93c3-4a86-8f46-c688976b0d64 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:24.089040 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b556cdd-93c3-4a86-8f46-c688976b0d64 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:24.089324 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b556cdd-93c3-4a86-8f46-c688976b0d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:24.169311 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-6b556cdd-93c3-4a86-8f46-c688976b0d64 None None] MFA Rules not processed for user `d9bef3c273cd48979539489880ef5edc`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:37:24.170595 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-6b556cdd-93c3-4a86-8f46-c688976b0d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:24.276364 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dd019c-d473-45db-a3ac-fd74ed4a7cef tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73d2e2a0d2e043688d1bd544cbaeb63a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3af19d6975042e9ae8347d2093f3f30', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:24.277258 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dd019c-d473-45db-a3ac-fd74ed4a7cef tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:24.281277 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dd019c-d473-45db-a3ac-fd74ed4a7cef tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:24.281624 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dd019c-d473-45db-a3ac-fd74ed4a7cef tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] PATH_INFO: `/v3/domains/ca5db2c5a27a4c128cf7d025bae1d6e9` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:24.325055 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dd019c-d473-45db-a3ac-fd74ed4a7cef tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=ca5db2c5a27a4c128cf7d025bae1d6e9)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:24.336207 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dd019c-d473-45db-a3ac-fd74ed4a7cef tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:24.408705 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-67dd019c-d473-45db-a3ac-fd74ed4a7cef tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'ca5db2c5a27a4c128cf7d025bae1d6e9'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:24.418459 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3335/6701] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:37:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:37:24.419506 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b556cdd-93c3-4a86-8f46-c688976b0d64 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:24.419709 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-67dd019c-d473-45db-a3ac-fd74ed4a7cef tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'ca5db2c5a27a4c128cf7d025bae1d6e9'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:24.598246 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b556cdd-93c3-4a86-8f46-c688976b0d64 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:24.621420 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-67dd019c-d473-45db-a3ac-fd74ed4a7cef tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca5db2c5a27a4c128cf7d025bae1d6e9', 'request_id': 'req-67dd019c-d473-45db-a3ac-fd74ed4a7cef'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:24.630730 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-67dd019c-d473-45db-a3ac-fd74ed4a7cef tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca5db2c5a27a4c128cf7d025bae1d6e9', 'request_id': 'req-67dd019c-d473-45db-a3ac-fd74ed4a7cef'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:24.713728 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-67dd019c-d473-45db-a3ac-fd74ed4a7cef tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca5db2c5a27a4c128cf7d025bae1d6e9', 'request_id': 'req-67dd019c-d473-45db-a3ac-fd74ed4a7cef'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:24.737583 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b20b0f-e5e1-44b6-8052-313760e69e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:24.741524 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-67dd019c-d473-45db-a3ac-fd74ed4a7cef tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] The token cache is being invalidate because project ca5db2c5a27a4c128cf7d025bae1d6e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:37:24.744746 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-67dd019c-d473-45db-a3ac-fd74ed4a7cef tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:24.752663 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-67dd019c-d473-45db-a3ac-fd74ed4a7cef tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:24.753224 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b20b0f-e5e1-44b6-8052-313760e69e94 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:24.753518 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b20b0f-e5e1-44b6-8052-313760e69e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:24.753781 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b20b0f-e5e1-44b6-8052-313760e69e94 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:24.757132 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b20b0f-e5e1-44b6-8052-313760e69e94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:24.759638 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b20b0f-e5e1-44b6-8052-313760e69e94 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:24.772974 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-67dd019c-d473-45db-a3ac-fd74ed4a7cef tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'ca5db2c5a27a4c128cf7d025bae1d6e9', 'request_id': 'req-67dd019c-d473-45db-a3ac-fd74ed4a7cef'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:24.774996 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-67dd019c-d473-45db-a3ac-fd74ed4a7cef tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'ca5db2c5a27a4c128cf7d025bae1d6e9', 'request_id': 'req-67dd019c-d473-45db-a3ac-fd74ed4a7cef'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:24.782939 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-67dd019c-d473-45db-a3ac-fd74ed4a7cef tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'ca5db2c5a27a4c128cf7d025bae1d6e9', 'request_id': 'req-67dd019c-d473-45db-a3ac-fd74ed4a7cef'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:24.805014 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3367/6702] 10.222.0.52 () {58 vars in 1229 bytes} [Sat May 14 21:37:23 2022] DELETE /identity/v3/domains/ca5db2c5a27a4c128cf7d025bae1d6e9 => generated 0 bytes in 934 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:37:24.811382 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dd019c-d473-45db-a3ac-fd74ed4a7cef tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:24.813216 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-67dd019c-d473-45db-a3ac-fd74ed4a7cef tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:24.830468 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dd019c-d473-45db-a3ac-fd74ed4a7cef tempest-DomainsTestJSON-1399135058 tempest-DomainsTestJSON-1399135058-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:24.840454 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5fc807-4979-4e6f-9f79-420a386eb9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:24.842080 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5fc807-4979-4e6f-9f79-420a386eb9d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:24.842367 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5fc807-4979-4e6f-9f79-420a386eb9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:24.842648 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5fc807-4979-4e6f-9f79-420a386eb9d5 admin admin] PATH_INFO: `/v3/users/877e681d48ed49ca9c989c851ca5d378` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:24.845161 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5fc807-4979-4e6f-9f79-420a386eb9d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=877e681d48ed49ca9c989c851ca5d378)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:24.847205 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5fc807-4979-4e6f-9f79-420a386eb9d5 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:24.946319 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3336/6703] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:37:24 2022] POST /identity/v3/projects => generated 387 bytes in 527 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:37:24.949326 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b20b0f-e5e1-44b6-8052-313760e69e94 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:24.952869 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b0b20b0f-e5e1-44b6-8052-313760e69e94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:25.138878 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-bf5fc807-4979-4e6f-9f79-420a386eb9d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '877e681d48ed49ca9c989c851ca5d378'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:25.153915 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b20b0f-e5e1-44b6-8052-313760e69e94 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:25.167571 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f2eaa1-40d2-4116-be76-f881e85a5f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:25.167741 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-bf5fc807-4979-4e6f-9f79-420a386eb9d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '877e681d48ed49ca9c989c851ca5d378'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:25.168521 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2eaa1-40d2-4116-be76-f881e85a5f8e admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:25.168848 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2eaa1-40d2-4116-be76-f881e85a5f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:25.180933 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-bf5fc807-4979-4e6f-9f79-420a386eb9d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '877e681d48ed49ca9c989c851ca5d378'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:25.189275 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2eaa1-40d2-4116-be76-f881e85a5f8e admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:25.189960 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f2eaa1-40d2-4116-be76-f881e85a5f8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:25.192498 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f2eaa1-40d2-4116-be76-f881e85a5f8e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:25.270052 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-bf5fc807-4979-4e6f-9f79-420a386eb9d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '877e681d48ed49ca9c989c851ca5d378'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:25.270958 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-bf5fc807-4979-4e6f-9f79-420a386eb9d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '877e681d48ed49ca9c989c851ca5d378'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:25.281940 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3368/6704] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:37:24 2022] DELETE /identity/v3/users/877e681d48ed49ca9c989c851ca5d378 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:37:25.285630 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee08a92-2525-4197-81aa-baff81bac058 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:25.285769 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee08a92-2525-4197-81aa-baff81bac058 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:25.286292 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee08a92-2525-4197-81aa-baff81bac058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:25.310352 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3337/6705] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:37:24 2022] POST /identity/v3/users => generated 301 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:37:25.314186 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f2eaa1-40d2-4116-be76-f881e85a5f8e admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:25.319531 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-07f2eaa1-40d2-4116-be76-f881e85a5f8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:25.347794 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f2eaa1-40d2-4116-be76-f881e85a5f8e admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:25.349803 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-9ee08a92-2525-4197-81aa-baff81bac058 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:37:25.354955 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-9ee08a92-2525-4197-81aa-baff81bac058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:25.483193 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeac607-e212-4734-b2d8-b3862902d61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:25.483852 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeac607-e212-4734-b2d8-b3862902d61a admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:25.484138 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeac607-e212-4734-b2d8-b3862902d61a admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:25.484421 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeac607-e212-4734-b2d8-b3862902d61a admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:25.485501 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeac607-e212-4734-b2d8-b3862902d61a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:25.486895 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeac607-e212-4734-b2d8-b3862902d61a admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:25.528213 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3338/6706] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:37:25 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:37:25.531110 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeac607-e212-4734-b2d8-b3862902d61a admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:25.546943 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeac607-e212-4734-b2d8-b3862902d61a admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:25.572312 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ee7ac4-a5f2-4b36-a97c-89fa9b387910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:25.573599 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee7ac4-a5f2-4b36-a97c-89fa9b387910 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:25.574056 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee7ac4-a5f2-4b36-a97c-89fa9b387910 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:25.574508 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee7ac4-a5f2-4b36-a97c-89fa9b387910 admin admin] PATH_INFO: `/v3/projects/7bdee4f5bd8a4fe6a33e699bd2ab5051/users/19cba4251a1c4f78821185718eb04a55/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:25.621467 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ee7ac4-a5f2-4b36-a97c-89fa9b387910 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bdee4f5bd8a4fe6a33e699bd2ab5051, user_id=19cba4251a1c4f78821185718eb04a55, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:25.625098 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ee7ac4-a5f2-4b36-a97c-89fa9b387910 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:25.630804 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3369/6707] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:37:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:37:25.660557 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee08a92-2525-4197-81aa-baff81bac058 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:25.668581 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-9ee08a92-2525-4197-81aa-baff81bac058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:25.721149 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3339/6708] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:37:25 2022] PUT /identity/v3/projects/7bdee4f5bd8a4fe6a33e699bd2ab5051/users/19cba4251a1c4f78821185718eb04a55/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:37:25.731671 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c0b450-45fc-47e4-add2-3f68e266133f None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:25.732133 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c0b450-45fc-47e4-add2-3f68e266133f None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:25.735913 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c0b450-45fc-47e4-add2-3f68e266133f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:25.790644 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-29c0b450-45fc-47e4-add2-3f68e266133f None None] MFA Rules not processed for user `19cba4251a1c4f78821185718eb04a55`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:37:25.792559 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-29c0b450-45fc-47e4-add2-3f68e266133f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:25.852660 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee08a92-2525-4197-81aa-baff81bac058 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:25.948389 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3340/6709] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:37:25 2022] POST /identity/v3/auth/tokens => generated 3261 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:37:25.968061 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6276e6-57f2-4d22-865e-84a935371a7c None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:25.979964 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6276e6-57f2-4d22-865e-84a935371a7c None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:25.982434 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6276e6-57f2-4d22-865e-84a935371a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:25.986786 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be217374-ad60-45dc-92ac-654ec2808bc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:25.987599 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be217374-ad60-45dc-92ac-654ec2808bc1 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:25.988012 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be217374-ad60-45dc-92ac-654ec2808bc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:25.988368 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be217374-ad60-45dc-92ac-654ec2808bc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:26.035502 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-8f6276e6-57f2-4d22-865e-84a935371a7c None None] MFA Rules not processed for user `1096012950d645a0ab7050ea661826db`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:37:26.039500 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8f6276e6-57f2-4d22-865e-84a935371a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:26.144855 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be217374-ad60-45dc-92ac-654ec2808bc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:26.146406 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be217374-ad60-45dc-92ac-654ec2808bc1 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:26.173532 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3370/6710] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:37:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:37:26.180358 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be217374-ad60-45dc-92ac-654ec2808bc1 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:26.188692 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-be217374-ad60-45dc-92ac-654ec2808bc1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:26.217877 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3341/6711] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:37:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:37:26.429949 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be217374-ad60-45dc-92ac-654ec2808bc1 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:26.448893 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cddff9-2dc6-4db7-b606-1129ebdaa01b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:26.449682 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cddff9-2dc6-4db7-b606-1129ebdaa01b service swift] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:26.449965 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cddff9-2dc6-4db7-b606-1129ebdaa01b service swift] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:26.450238 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cddff9-2dc6-4db7-b606-1129ebdaa01b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:26.470064 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cddff9-2dc6-4db7-b606-1129ebdaa01b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:26.472254 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cddff9-2dc6-4db7-b606-1129ebdaa01b service swift] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:26.486685 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3371/6712] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 21:37:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 680 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 21:37:27.350402 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6276e6-57f2-4d22-865e-84a935371a7c None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:27.351874 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8f6276e6-57f2-4d22-865e-84a935371a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:27.596154 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6276e6-57f2-4d22-865e-84a935371a7c None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:27.603306 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e945f0e6-f772-44a9-8724-527f4ed9d956 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:27.604051 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945f0e6-f772-44a9-8724-527f4ed9d956 service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:27.604340 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945f0e6-f772-44a9-8724-527f4ed9d956 service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:27.604666 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945f0e6-f772-44a9-8724-527f4ed9d956 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:27.606819 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e945f0e6-f772-44a9-8724-527f4ed9d956 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:27.632129 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e945f0e6-f772-44a9-8724-527f4ed9d956 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:27.634386 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e945f0e6-f772-44a9-8724-527f4ed9d956 service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:27.652156 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3342/6713] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:37:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:37:28.813630 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cddff9-2dc6-4db7-b606-1129ebdaa01b service swift] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:28.816555 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-33cddff9-2dc6-4db7-b606-1129ebdaa01b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:28.851707 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cddff9-2dc6-4db7-b606-1129ebdaa01b service swift] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:28.884225 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05744623-7709-4cb3-ad01-794f8d25f0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:28.885425 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05744623-7709-4cb3-ad01-794f8d25f0f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:28.885911 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05744623-7709-4cb3-ad01-794f8d25f0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:28.888976 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05744623-7709-4cb3-ad01-794f8d25f0f3 admin admin] PATH_INFO: `/v3/projects/ace0f9b1178842f6a16963f30c8eb022` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:28.891890 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05744623-7709-4cb3-ad01-794f8d25f0f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ace0f9b1178842f6a16963f30c8eb022)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:28.902011 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05744623-7709-4cb3-ad01-794f8d25f0f3 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:29.073686 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-05744623-7709-4cb3-ad01-794f8d25f0f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ace0f9b1178842f6a16963f30c8eb022', 'request_id': 'req-05744623-7709-4cb3-ad01-794f8d25f0f3'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:29.081348 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-05744623-7709-4cb3-ad01-794f8d25f0f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ace0f9b1178842f6a16963f30c8eb022', 'request_id': 'req-05744623-7709-4cb3-ad01-794f8d25f0f3'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:29.242326 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-05744623-7709-4cb3-ad01-794f8d25f0f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ace0f9b1178842f6a16963f30c8eb022', 'request_id': 'req-05744623-7709-4cb3-ad01-794f8d25f0f3'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:29.286948 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-05744623-7709-4cb3-ad01-794f8d25f0f3 admin admin] The token cache is being invalidate because project ace0f9b1178842f6a16963f30c8eb022 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:37:29.294315 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-05744623-7709-4cb3-ad01-794f8d25f0f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:29.296176 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-05744623-7709-4cb3-ad01-794f8d25f0f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:29.303924 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3372/6714] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:37:28 2022] DELETE /identity/v3/projects/ace0f9b1178842f6a16963f30c8eb022 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:37:29.305254 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e945f0e6-f772-44a9-8724-527f4ed9d956 service nova] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:29.328312 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e945f0e6-f772-44a9-8724-527f4ed9d956 service nova] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:29.466893 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54fdde7-86fe-4ad8-8614-82ff3b564459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:29.469394 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54fdde7-86fe-4ad8-8614-82ff3b564459 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:29.470254 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54fdde7-86fe-4ad8-8614-82ff3b564459 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:29.470959 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54fdde7-86fe-4ad8-8614-82ff3b564459 admin admin] PATH_INFO: `/v3/users/73d2e2a0d2e043688d1bd544cbaeb63a` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:29.472858 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54fdde7-86fe-4ad8-8614-82ff3b564459 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73d2e2a0d2e043688d1bd544cbaeb63a)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:29.478188 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54fdde7-86fe-4ad8-8614-82ff3b564459 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:29.738459 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f54fdde7-86fe-4ad8-8614-82ff3b564459 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73d2e2a0d2e043688d1bd544cbaeb63a'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:29.747170 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f54fdde7-86fe-4ad8-8614-82ff3b564459 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73d2e2a0d2e043688d1bd544cbaeb63a'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:29.748209 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f54fdde7-86fe-4ad8-8614-82ff3b564459 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73d2e2a0d2e043688d1bd544cbaeb63a'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:29.842317 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f54fdde7-86fe-4ad8-8614-82ff3b564459 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73d2e2a0d2e043688d1bd544cbaeb63a'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:29.868059 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f54fdde7-86fe-4ad8-8614-82ff3b564459 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73d2e2a0d2e043688d1bd544cbaeb63a'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:29.882119 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3343/6715] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:37:29 2022] DELETE /identity/v3/users/73d2e2a0d2e043688d1bd544cbaeb63a => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:37:29.911062 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05744623-7709-4cb3-ad01-794f8d25f0f3 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:29.912761 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-05744623-7709-4cb3-ad01-794f8d25f0f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:29.931688 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05744623-7709-4cb3-ad01-794f8d25f0f3 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:30.053123 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1fdcbd-bcd4-4a1f-8b7a-56e4b3d33c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:30.058016 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1fdcbd-bcd4-4a1f-8b7a-56e4b3d33c29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:30.058016 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1fdcbd-bcd4-4a1f-8b7a-56e4b3d33c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:30.058016 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1fdcbd-bcd4-4a1f-8b7a-56e4b3d33c29 admin admin] PATH_INFO: `/v3/users/77610b4a6cb04b2fa37a700b6c67baef` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:30.058016 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1fdcbd-bcd4-4a1f-8b7a-56e4b3d33c29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77610b4a6cb04b2fa37a700b6c67baef)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:30.059667 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1fdcbd-bcd4-4a1f-8b7a-56e4b3d33c29 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:30.140761 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54fdde7-86fe-4ad8-8614-82ff3b564459 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:30.143435 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-f54fdde7-86fe-4ad8-8614-82ff3b564459 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:30.195175 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54fdde7-86fe-4ad8-8614-82ff3b564459 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:30.208191 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11801417-1120-4c5b-aaec-95c4dc951187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:30.210090 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11801417-1120-4c5b-aaec-95c4dc951187 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:30.212367 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11801417-1120-4c5b-aaec-95c4dc951187 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:30.212886 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11801417-1120-4c5b-aaec-95c4dc951187 admin admin] PATH_INFO: `/v3/users/d9bef3c273cd48979539489880ef5edc` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:30.217168 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11801417-1120-4c5b-aaec-95c4dc951187 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9bef3c273cd48979539489880ef5edc)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:30.223363 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11801417-1120-4c5b-aaec-95c4dc951187 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:30.317795 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-af1fdcbd-bcd4-4a1f-8b7a-56e4b3d33c29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77610b4a6cb04b2fa37a700b6c67baef'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:30.342573 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-af1fdcbd-bcd4-4a1f-8b7a-56e4b3d33c29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77610b4a6cb04b2fa37a700b6c67baef'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:30.352787 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-af1fdcbd-bcd4-4a1f-8b7a-56e4b3d33c29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77610b4a6cb04b2fa37a700b6c67baef'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:30.487778 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-11801417-1120-4c5b-aaec-95c4dc951187 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9bef3c273cd48979539489880ef5edc'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:30.503083 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-af1fdcbd-bcd4-4a1f-8b7a-56e4b3d33c29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77610b4a6cb04b2fa37a700b6c67baef'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:30.504520 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-af1fdcbd-bcd4-4a1f-8b7a-56e4b3d33c29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77610b4a6cb04b2fa37a700b6c67baef'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:30.516697 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3373/6716] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:37:29 2022] DELETE /identity/v3/users/77610b4a6cb04b2fa37a700b6c67baef => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:37:30.518476 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d12743-3ee5-4179-b10b-cd31682341e1 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:30.519208 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d12743-3ee5-4179-b10b-cd31682341e1 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:30.519512 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d12743-3ee5-4179-b10b-cd31682341e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:30.543922 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-11801417-1120-4c5b-aaec-95c4dc951187 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9bef3c273cd48979539489880ef5edc'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:30.548994 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-11801417-1120-4c5b-aaec-95c4dc951187 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9bef3c273cd48979539489880ef5edc'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:30.575728 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-b3d12743-3ee5-4179-b10b-cd31682341e1 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:37:30.577206 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b3d12743-3ee5-4179-b10b-cd31682341e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:30.688757 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-11801417-1120-4c5b-aaec-95c4dc951187 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9bef3c273cd48979539489880ef5edc'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:30.711025 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3374/6717] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:37:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:37:30.721696 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-11801417-1120-4c5b-aaec-95c4dc951187 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9bef3c273cd48979539489880ef5edc'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:30.746885 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3344/6718] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:37:30 2022] DELETE /identity/v3/users/d9bef3c273cd48979539489880ef5edc => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:37:30.752752 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1504e40-fd5a-4da8-9185-625bdd908cdd None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:30.753401 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1504e40-fd5a-4da8-9185-625bdd908cdd None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:30.753873 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1504e40-fd5a-4da8-9185-625bdd908cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:30.778960 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11801417-1120-4c5b-aaec-95c4dc951187 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:30.780722 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-11801417-1120-4c5b-aaec-95c4dc951187 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:30.789001 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-e1504e40-fd5a-4da8-9185-625bdd908cdd None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:37:30.790215 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e1504e40-fd5a-4da8-9185-625bdd908cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:30.934305 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11801417-1120-4c5b-aaec-95c4dc951187 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:30.946431 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36f4dc8-15ea-4579-b36f-ba4b333d8825 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:30.949031 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36f4dc8-15ea-4579-b36f-ba4b333d8825 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:30.949443 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36f4dc8-15ea-4579-b36f-ba4b333d8825 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:30.949826 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36f4dc8-15ea-4579-b36f-ba4b333d8825 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:30.950945 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3375/6719] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:37:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:37:30.952837 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c36f4dc8-15ea-4579-b36f-ba4b333d8825 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:30.970928 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36f4dc8-15ea-4579-b36f-ba4b333d8825 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:30.972843 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36f4dc8-15ea-4579-b36f-ba4b333d8825 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:30.980541 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1504e40-fd5a-4da8-9185-625bdd908cdd None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:30.998526 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1504e40-fd5a-4da8-9185-625bdd908cdd None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:31.006282 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3345/6720] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:37:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:37:31.012533 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffefa211-c77c-4c63-9ae4-8d95668ffec4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:31.013360 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffefa211-c77c-4c63-9ae4-8d95668ffec4 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:31.015096 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffefa211-c77c-4c63-9ae4-8d95668ffec4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:31.015096 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffefa211-c77c-4c63-9ae4-8d95668ffec4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:31.027720 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffefa211-c77c-4c63-9ae4-8d95668ffec4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:31.029104 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffefa211-c77c-4c63-9ae4-8d95668ffec4 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:31.049379 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3376/6721] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:37:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:37:31.911419 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36f4dc8-15ea-4579-b36f-ba4b333d8825 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:31.912921 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c36f4dc8-15ea-4579-b36f-ba4b333d8825 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:31.939355 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36f4dc8-15ea-4579-b36f-ba4b333d8825 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:31.952254 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7076b332-754d-4ee6-b28f-eb1ac850bcbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:31.953580 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076b332-754d-4ee6-b28f-eb1ac850bcbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:31.954300 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076b332-754d-4ee6-b28f-eb1ac850bcbd admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:31.954814 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076b332-754d-4ee6-b28f-eb1ac850bcbd admin admin] PATH_INFO: `/v3/projects/b88b4e0c3d484786ba5e40614156bbab` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:31.960515 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7076b332-754d-4ee6-b28f-eb1ac850bcbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=b88b4e0c3d484786ba5e40614156bbab)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:31.962828 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7076b332-754d-4ee6-b28f-eb1ac850bcbd admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:31.974934 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffefa211-c77c-4c63-9ae4-8d95668ffec4 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:31.976756 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ffefa211-c77c-4c63-9ae4-8d95668ffec4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:31.998057 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffefa211-c77c-4c63-9ae4-8d95668ffec4 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:32.011026 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5747c3cf-704a-4248-be82-0613a76c7162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:32.012333 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5747c3cf-704a-4248-be82-0613a76c7162 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:32.012803 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5747c3cf-704a-4248-be82-0613a76c7162 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:32.013243 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5747c3cf-704a-4248-be82-0613a76c7162 admin admin] PATH_INFO: `/v3/projects/b3af19d6975042e9ae8347d2093f3f30` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:32.014793 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5747c3cf-704a-4248-be82-0613a76c7162 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3af19d6975042e9ae8347d2093f3f30)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:32.028636 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5747c3cf-704a-4248-be82-0613a76c7162 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:32.133326 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7076b332-754d-4ee6-b28f-eb1ac850bcbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b88b4e0c3d484786ba5e40614156bbab', 'request_id': 'req-7076b332-754d-4ee6-b28f-eb1ac850bcbd'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:32.148131 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7076b332-754d-4ee6-b28f-eb1ac850bcbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b88b4e0c3d484786ba5e40614156bbab', 'request_id': 'req-7076b332-754d-4ee6-b28f-eb1ac850bcbd'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:32.158666 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7076b332-754d-4ee6-b28f-eb1ac850bcbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b88b4e0c3d484786ba5e40614156bbab', 'request_id': 'req-7076b332-754d-4ee6-b28f-eb1ac850bcbd'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:32.182535 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5747c3cf-704a-4248-be82-0613a76c7162 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3af19d6975042e9ae8347d2093f3f30', 'request_id': 'req-5747c3cf-704a-4248-be82-0613a76c7162'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:32.190786 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5747c3cf-704a-4248-be82-0613a76c7162 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3af19d6975042e9ae8347d2093f3f30', 'request_id': 'req-5747c3cf-704a-4248-be82-0613a76c7162'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:32.295280 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7076b332-754d-4ee6-b28f-eb1ac850bcbd admin admin] The token cache is being invalidate because project b88b4e0c3d484786ba5e40614156bbab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:37:32.295601 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7076b332-754d-4ee6-b28f-eb1ac850bcbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:32.296550 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7076b332-754d-4ee6-b28f-eb1ac850bcbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:32.300889 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3346/6722] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:37:31 2022] DELETE /identity/v3/projects/b88b4e0c3d484786ba5e40614156bbab => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:37:32.302811 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7076b332-754d-4ee6-b28f-eb1ac850bcbd admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:32.306744 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-7076b332-754d-4ee6-b28f-eb1ac850bcbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:32.406106 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7076b332-754d-4ee6-b28f-eb1ac850bcbd admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:32.488029 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5747c3cf-704a-4248-be82-0613a76c7162 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3af19d6975042e9ae8347d2093f3f30', 'request_id': 'req-5747c3cf-704a-4248-be82-0613a76c7162'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:32.527658 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385cda6a-2a65-4edb-9679-627f70901012 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:32.527989 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385cda6a-2a65-4edb-9679-627f70901012 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:32.528473 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385cda6a-2a65-4edb-9679-627f70901012 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:32.529879 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385cda6a-2a65-4edb-9679-627f70901012 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:32.533617 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-385cda6a-2a65-4edb-9679-627f70901012 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:32.535113 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5747c3cf-704a-4248-be82-0613a76c7162 admin admin] The token cache is being invalidate because project b3af19d6975042e9ae8347d2093f3f30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:37:32.536605 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5747c3cf-704a-4248-be82-0613a76c7162 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:32.539997 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5747c3cf-704a-4248-be82-0613a76c7162 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:32.549464 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3377/6723] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:37:31 2022] DELETE /identity/v3/projects/b3af19d6975042e9ae8347d2093f3f30 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:37:32.552155 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc6ca8-a715-4d3e-aab9-72963bcf8c5c None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:32.556263 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc6ca8-a715-4d3e-aab9-72963bcf8c5c None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:32.556263 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc6ca8-a715-4d3e-aab9-72963bcf8c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:32.558450 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385cda6a-2a65-4edb-9679-627f70901012 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:32.572955 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385cda6a-2a65-4edb-9679-627f70901012 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:32.584723 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-25fc6ca8-a715-4d3e-aab9-72963bcf8c5c None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:37:32.584723 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-25fc6ca8-a715-4d3e-aab9-72963bcf8c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:32.597545 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3347/6724] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:37:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:37:32.599629 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385cda6a-2a65-4edb-9679-627f70901012 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:32.601761 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-385cda6a-2a65-4edb-9679-627f70901012 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:32.712753 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3378/6725] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:37:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:37:32.715298 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2997d7-cf3a-4c63-8422-9984093edfc7 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:32.715629 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2997d7-cf3a-4c63-8422-9984093edfc7 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:32.715906 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2997d7-cf3a-4c63-8422-9984093edfc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:32.721941 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385cda6a-2a65-4edb-9679-627f70901012 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:32.729713 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaf7471-1348-48ad-8230-68ba9183d423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:32.730723 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf7471-1348-48ad-8230-68ba9183d423 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:32.731108 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf7471-1348-48ad-8230-68ba9183d423 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:32.731675 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf7471-1348-48ad-8230-68ba9183d423 admin admin] PATH_INFO: `/v3/projects/e823ee6e054449beab0e61898a5ed615` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:32.733853 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaf7471-1348-48ad-8230-68ba9183d423 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e823ee6e054449beab0e61898a5ed615)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:32.737484 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaf7471-1348-48ad-8230-68ba9183d423 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:32.739567 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-ea2997d7-cf3a-4c63-8422-9984093edfc7 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:37:32.741037 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ea2997d7-cf3a-4c63-8422-9984093edfc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:32.750812 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3379/6726] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:37:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:37:32.761634 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145c496-4e6a-4caf-8a30-e49b155775d2 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:32.762321 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145c496-4e6a-4caf-8a30-e49b155775d2 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:32.762775 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145c496-4e6a-4caf-8a30-e49b155775d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:32.790849 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-1145c496-4e6a-4caf-8a30-e49b155775d2 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:37:32.792673 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-1145c496-4e6a-4caf-8a30-e49b155775d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:32.803124 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3380/6727] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:37:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:37:32.805437 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72ac4a-f9be-4465-a97e-939d85953d67 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:32.806046 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72ac4a-f9be-4465-a97e-939d85953d67 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:32.806728 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72ac4a-f9be-4465-a97e-939d85953d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:32.830961 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-da72ac4a-f9be-4465-a97e-939d85953d67 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:37:32.832422 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-da72ac4a-f9be-4465-a97e-939d85953d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:32.845016 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3381/6728] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:37:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:37:32.846216 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da72ac4a-f9be-4465-a97e-939d85953d67 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:32.864845 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da72ac4a-f9be-4465-a97e-939d85953d67 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:32.880667 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-2eaf7471-1348-48ad-8230-68ba9183d423 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e823ee6e054449beab0e61898a5ed615', 'request_id': 'req-2eaf7471-1348-48ad-8230-68ba9183d423'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:32.903146 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-2eaf7471-1348-48ad-8230-68ba9183d423 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e823ee6e054449beab0e61898a5ed615', 'request_id': 'req-2eaf7471-1348-48ad-8230-68ba9183d423'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:32.919540 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-2eaf7471-1348-48ad-8230-68ba9183d423 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e823ee6e054449beab0e61898a5ed615', 'request_id': 'req-2eaf7471-1348-48ad-8230-68ba9183d423'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:32.987461 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac3afda-ae54-481c-91a8-cd392c621e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:32.989147 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac3afda-ae54-481c-91a8-cd392c621e1f admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:32.989587 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac3afda-ae54-481c-91a8-cd392c621e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:32.989778 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac3afda-ae54-481c-91a8-cd392c621e1f admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:32.991051 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac3afda-ae54-481c-91a8-cd392c621e1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:37:32.992734 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac3afda-ae54-481c-91a8-cd392c621e1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:32.994424 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac3afda-ae54-481c-91a8-cd392c621e1f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:33.009243 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3382/6729] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:37:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:37:33.010511 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac3afda-ae54-481c-91a8-cd392c621e1f admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:33.014012 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-2eaf7471-1348-48ad-8230-68ba9183d423 admin admin] The token cache is being invalidate because project e823ee6e054449beab0e61898a5ed615 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:37:33.014687 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-2eaf7471-1348-48ad-8230-68ba9183d423 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:33.015684 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-2eaf7471-1348-48ad-8230-68ba9183d423 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:33.021705 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3348/6730] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:37:32 2022] DELETE /identity/v3/projects/e823ee6e054449beab0e61898a5ed615 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:37:33.022641 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaf7471-1348-48ad-8230-68ba9183d423 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:33.024793 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-2eaf7471-1348-48ad-8230-68ba9183d423 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:33.027191 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac3afda-ae54-481c-91a8-cd392c621e1f admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:33.037569 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7725303e-eb0a-4c38-bfce-b5e5e3a799fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:33.038591 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7725303e-eb0a-4c38-bfce-b5e5e3a799fb admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:33.039057 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7725303e-eb0a-4c38-bfce-b5e5e3a799fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:33.039600 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7725303e-eb0a-4c38-bfce-b5e5e3a799fb admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:33.040594 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7725303e-eb0a-4c38-bfce-b5e5e3a799fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:37:33.041215 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7725303e-eb0a-4c38-bfce-b5e5e3a799fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:33.042867 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaf7471-1348-48ad-8230-68ba9183d423 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:33.043425 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7725303e-eb0a-4c38-bfce-b5e5e3a799fb admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:33.049351 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8519332-a045-4909-9b0b-b3d3168fb5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:33.050165 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8519332-a045-4909-9b0b-b3d3168fb5bc admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:33.050547 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8519332-a045-4909-9b0b-b3d3168fb5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:33.050915 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8519332-a045-4909-9b0b-b3d3168fb5bc admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:33.051856 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8519332-a045-4909-9b0b-b3d3168fb5bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:33.054078 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8519332-a045-4909-9b0b-b3d3168fb5bc admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:33.071115 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3383/6731] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:37:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:37:33.072857 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7725303e-eb0a-4c38-bfce-b5e5e3a799fb admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:33.076094 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-7725303e-eb0a-4c38-bfce-b5e5e3a799fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:33.099864 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7725303e-eb0a-4c38-bfce-b5e5e3a799fb admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:33.105090 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5af56a-5eb9-4a2c-83ec-81f40e31692e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:33.105976 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5af56a-5eb9-4a2c-83ec-81f40e31692e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:33.106264 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5af56a-5eb9-4a2c-83ec-81f40e31692e admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:33.106544 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5af56a-5eb9-4a2c-83ec-81f40e31692e admin admin] PATH_INFO: `/v3/users/19cba4251a1c4f78821185718eb04a55` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:33.108506 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5af56a-5eb9-4a2c-83ec-81f40e31692e admin admin] RBAC: Authorizing `identity:delete_user(user_id=19cba4251a1c4f78821185718eb04a55)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:33.110532 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5af56a-5eb9-4a2c-83ec-81f40e31692e admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:33.148327 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3349/6732] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:37:33 2022] POST /identity/v3/projects => generated 367 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:37:33.149718 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8519332-a045-4909-9b0b-b3d3168fb5bc admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:33.153873 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b8519332-a045-4909-9b0b-b3d3168fb5bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:33.239764 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8519332-a045-4909-9b0b-b3d3168fb5bc admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:33.259588 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9624117b-7b9e-4669-ac83-7c8a4780d79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:33.261583 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9624117b-7b9e-4669-ac83-7c8a4780d79e admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:33.261879 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9624117b-7b9e-4669-ac83-7c8a4780d79e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:33.262160 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9624117b-7b9e-4669-ac83-7c8a4780d79e admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:33.262861 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9624117b-7b9e-4669-ac83-7c8a4780d79e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:33.271192 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9624117b-7b9e-4669-ac83-7c8a4780d79e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:33.338732 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-bf5af56a-5eb9-4a2c-83ec-81f40e31692e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19cba4251a1c4f78821185718eb04a55'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:33.369574 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3350/6733] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:37:33 2022] POST /identity/v3/projects => generated 381 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:37:33.369574 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9624117b-7b9e-4669-ac83-7c8a4780d79e admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:33.377079 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-bf5af56a-5eb9-4a2c-83ec-81f40e31692e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19cba4251a1c4f78821185718eb04a55'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:33.394506 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-bf5af56a-5eb9-4a2c-83ec-81f40e31692e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19cba4251a1c4f78821185718eb04a55'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:33.480785 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9624117b-7b9e-4669-ac83-7c8a4780d79e admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:33.487764 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3090b6b-4e20-45da-9083-6451a32f8a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:33.488480 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3090b6b-4e20-45da-9083-6451a32f8a9c admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:33.488933 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3090b6b-4e20-45da-9083-6451a32f8a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:33.489262 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3090b6b-4e20-45da-9083-6451a32f8a9c admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:33.490262 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3090b6b-4e20-45da-9083-6451a32f8a9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:33.492408 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3090b6b-4e20-45da-9083-6451a32f8a9c admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:33.520101 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-bf5af56a-5eb9-4a2c-83ec-81f40e31692e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19cba4251a1c4f78821185718eb04a55'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:33.521018 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-bf5af56a-5eb9-4a2c-83ec-81f40e31692e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19cba4251a1c4f78821185718eb04a55'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:33.528965 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3384/6734] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:37:33 2022] DELETE /identity/v3/users/19cba4251a1c4f78821185718eb04a55 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:37:33.532311 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5af56a-5eb9-4a2c-83ec-81f40e31692e admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:33.535685 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-bf5af56a-5eb9-4a2c-83ec-81f40e31692e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:33.596294 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3351/6735] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:37:33 2022] POST /identity/v3/users => generated 284 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:37:33.601801 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3090b6b-4e20-45da-9083-6451a32f8a9c admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:33.606581 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e3090b6b-4e20-45da-9083-6451a32f8a9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:33.655740 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3090b6b-4e20-45da-9083-6451a32f8a9c admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:33.699285 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5af56a-5eb9-4a2c-83ec-81f40e31692e admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:33.705425 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ffac9c-794b-46ed-a87e-766dd9634ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:33.706131 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ffac9c-794b-46ed-a87e-766dd9634ef3 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:33.706608 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ffac9c-794b-46ed-a87e-766dd9634ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:33.706896 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ffac9c-794b-46ed-a87e-766dd9634ef3 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:33.707756 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ffac9c-794b-46ed-a87e-766dd9634ef3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:33.709908 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ffac9c-794b-46ed-a87e-766dd9634ef3 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:33.804581 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3385/6736] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:37:33 2022] POST /identity/v3/users => generated 291 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:37:33.809804 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ffac9c-794b-46ed-a87e-766dd9634ef3 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:33.827037 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ffac9c-794b-46ed-a87e-766dd9634ef3 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:33.839950 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808083d9-edc5-44cb-9570-db573dd2d6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:33.841955 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808083d9-edc5-44cb-9570-db573dd2d6bc admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:33.842783 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808083d9-edc5-44cb-9570-db573dd2d6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:33.843880 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808083d9-edc5-44cb-9570-db573dd2d6bc admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:33.846355 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1946bef0-12f6-45c5-b043-4f65d0955311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:33.847049 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946bef0-12f6-45c5-b043-4f65d0955311 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:33.847344 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946bef0-12f6-45c5-b043-4f65d0955311 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:33.847649 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946bef0-12f6-45c5-b043-4f65d0955311 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:33.848386 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1946bef0-12f6-45c5-b043-4f65d0955311 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:33.850341 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1946bef0-12f6-45c5-b043-4f65d0955311 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:33.851808 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808083d9-edc5-44cb-9570-db573dd2d6bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:33.854358 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808083d9-edc5-44cb-9570-db573dd2d6bc admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:33.871056 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3352/6737] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:37:33 2022] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:37:33.873874 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808083d9-edc5-44cb-9570-db573dd2d6bc admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:33.877237 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3386/6738] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:37:33 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:37:33.882132 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1946bef0-12f6-45c5-b043-4f65d0955311 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:33.888669 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808083d9-edc5-44cb-9570-db573dd2d6bc admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:33.896793 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d626c04-5517-4ac1-9dbe-4f180b49715c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:33.897490 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d626c04-5517-4ac1-9dbe-4f180b49715c admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:33.897780 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d626c04-5517-4ac1-9dbe-4f180b49715c admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:33.898061 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d626c04-5517-4ac1-9dbe-4f180b49715c admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:33.898791 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d626c04-5517-4ac1-9dbe-4f180b49715c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:33.901105 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d626c04-5517-4ac1-9dbe-4f180b49715c admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:33.908080 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1946bef0-12f6-45c5-b043-4f65d0955311 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:33.913993 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3353/6739] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:37:33 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:37:33.919589 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef459d9-3feb-4ab5-a55d-bbbf8866ea86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:33.919589 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef459d9-3feb-4ab5-a55d-bbbf8866ea86 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:33.925191 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d626c04-5517-4ac1-9dbe-4f180b49715c admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:33.925830 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef459d9-3feb-4ab5-a55d-bbbf8866ea86 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:33.925830 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef459d9-3feb-4ab5-a55d-bbbf8866ea86 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:33.925830 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef459d9-3feb-4ab5-a55d-bbbf8866ea86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:33.925830 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef459d9-3feb-4ab5-a55d-bbbf8866ea86 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:33.934827 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d626c04-5517-4ac1-9dbe-4f180b49715c admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:33.939711 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3387/6740] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:37:33 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:37:33.942298 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef459d9-3feb-4ab5-a55d-bbbf8866ea86 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:33.948581 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca4b779-6292-467a-b3b6-365354767041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:33.948581 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca4b779-6292-467a-b3b6-365354767041 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:33.948581 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca4b779-6292-467a-b3b6-365354767041 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:33.948581 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca4b779-6292-467a-b3b6-365354767041 admin admin] PATH_INFO: `/v3/projects/2955d2e0483e4645b492bb49013e6b30/users/3163775667fa459991d34624701d7a01/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:33.955614 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef459d9-3feb-4ab5-a55d-bbbf8866ea86 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:33.960784 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86da9c61-0d77-4e8a-a4d4-e61e2129c7c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:33.961670 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da9c61-0d77-4e8a-a4d4-e61e2129c7c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:33.962018 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da9c61-0d77-4e8a-a4d4-e61e2129c7c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:33.962306 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da9c61-0d77-4e8a-a4d4-e61e2129c7c2 admin admin] PATH_INFO: `/v3/projects/38e028c5b1ce45b3bc7abfb1e4938ea5/users/4dcf555d747d41fe8849e4a27001b976/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:33.968008 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca4b779-6292-467a-b3b6-365354767041 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2955d2e0483e4645b492bb49013e6b30, user_id=3163775667fa459991d34624701d7a01, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:33.971111 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca4b779-6292-467a-b3b6-365354767041 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:33.981044 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86da9c61-0d77-4e8a-a4d4-e61e2129c7c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38e028c5b1ce45b3bc7abfb1e4938ea5, user_id=4dcf555d747d41fe8849e4a27001b976, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:33.983931 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86da9c61-0d77-4e8a-a4d4-e61e2129c7c2 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:34.108103 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3388/6741] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:37:33 2022] PUT /identity/v3/projects/38e028c5b1ce45b3bc7abfb1e4938ea5/users/4dcf555d747d41fe8849e4a27001b976/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:37:34.112827 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7ae61-6410-472b-b7ae-6969695d1f4b None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:34.113214 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7ae61-6410-472b-b7ae-6969695d1f4b None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:34.113477 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7ae61-6410-472b-b7ae-6969695d1f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:34.114160 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3354/6742] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:37:33 2022] PUT /identity/v3/projects/2955d2e0483e4645b492bb49013e6b30/users/3163775667fa459991d34624701d7a01/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:37:34.121930 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd920bea-57d4-4f08-804a-cf19c07937af None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:34.123644 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd920bea-57d4-4f08-804a-cf19c07937af None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:34.124767 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd920bea-57d4-4f08-804a-cf19c07937af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:34.176789 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-dd920bea-57d4-4f08-804a-cf19c07937af None None] MFA Rules not processed for user `3163775667fa459991d34624701d7a01`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:37:34.178141 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-dd920bea-57d4-4f08-804a-cf19c07937af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:34.180409 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-e3e7ae61-6410-472b-b7ae-6969695d1f4b None None] MFA Rules not processed for user `4dcf555d747d41fe8849e4a27001b976`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:37:34.183662 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e3e7ae61-6410-472b-b7ae-6969695d1f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:34.319187 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3389/6743] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:37:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:37:34.320372 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e7ae61-6410-472b-b7ae-6969695d1f4b None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:34.345155 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3355/6744] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:37:34 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:37:34.367911 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd920bea-57d4-4f08-804a-cf19c07937af None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:34.367911 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-dd920bea-57d4-4f08-804a-cf19c07937af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:34.435290 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e7ae61-6410-472b-b7ae-6969695d1f4b None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:34.442237 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7db962-be38-49a5-a403-a95756ac4ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:34.442437 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd920bea-57d4-4f08-804a-cf19c07937af None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:34.442977 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7db962-be38-49a5-a403-a95756ac4ea9 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:34.443860 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7db962-be38-49a5-a403-a95756ac4ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:34.443860 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7db962-be38-49a5-a403-a95756ac4ea9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:34.444547 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7db962-be38-49a5-a403-a95756ac4ea9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:34.446727 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7db962-be38-49a5-a403-a95756ac4ea9 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:34.450333 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab5e866-022e-4eb3-85aa-19bb386d7550 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:34.451108 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab5e866-022e-4eb3-85aa-19bb386d7550 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:34.451501 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab5e866-022e-4eb3-85aa-19bb386d7550 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:34.451899 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab5e866-022e-4eb3-85aa-19bb386d7550 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:34.462139 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab5e866-022e-4eb3-85aa-19bb386d7550 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:34.463738 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab5e866-022e-4eb3-85aa-19bb386d7550 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:34.473935 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3356/6745] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:37:34 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:37:34.543140 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab5e866-022e-4eb3-85aa-19bb386d7550 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:34.544238 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3390/6746] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:37:34 2022] POST /identity/v3/projects => generated 383 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:37:34.566334 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab5e866-022e-4eb3-85aa-19bb386d7550 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:34.637082 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd969d9-1103-4e35-9bb6-1ffe91c905df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:34.638005 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd969d9-1103-4e35-9bb6-1ffe91c905df admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:34.638293 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd969d9-1103-4e35-9bb6-1ffe91c905df admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:34.638575 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd969d9-1103-4e35-9bb6-1ffe91c905df admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:34.639917 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd969d9-1103-4e35-9bb6-1ffe91c905df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:34.644581 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd969d9-1103-4e35-9bb6-1ffe91c905df admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:34.802275 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3357/6747] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:37:34 2022] POST /identity/v3/users => generated 298 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:37:34.806360 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7db962-be38-49a5-a403-a95756ac4ea9 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:34.817333 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7db962-be38-49a5-a403-a95756ac4ea9 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:34.830481 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaf718a-b711-4900-b80d-4c0e8cad98de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:34.831277 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf718a-b711-4900-b80d-4c0e8cad98de admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:34.832486 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf718a-b711-4900-b80d-4c0e8cad98de admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:34.833088 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf718a-b711-4900-b80d-4c0e8cad98de admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:34.834193 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaf718a-b711-4900-b80d-4c0e8cad98de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:34.837252 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaf718a-b711-4900-b80d-4c0e8cad98de admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:34.854271 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3391/6748] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:37:34 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:37:34.858231 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd969d9-1103-4e35-9bb6-1ffe91c905df admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:34.876802 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd969d9-1103-4e35-9bb6-1ffe91c905df admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:34.901594 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e10df15-d3cd-49c3-a171-7bf50ae99e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:34.904007 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10df15-d3cd-49c3-a171-7bf50ae99e7c admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:34.904007 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10df15-d3cd-49c3-a171-7bf50ae99e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:34.904007 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10df15-d3cd-49c3-a171-7bf50ae99e7c admin admin] PATH_INFO: `/v3/projects/9ad4690e87914500b98536b03da79e90/users/fbf8b005a8e94b889abd5f74a42356cc/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:34.938629 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e10df15-d3cd-49c3-a171-7bf50ae99e7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ad4690e87914500b98536b03da79e90, user_id=fbf8b005a8e94b889abd5f74a42356cc, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:34.941427 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e10df15-d3cd-49c3-a171-7bf50ae99e7c admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:35.114994 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3358/6749] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:37:34 2022] PUT /identity/v3/projects/9ad4690e87914500b98536b03da79e90/users/fbf8b005a8e94b889abd5f74a42356cc/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:37:35.116269 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaf718a-b711-4900-b80d-4c0e8cad98de admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:35.129116 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaf718a-b711-4900-b80d-4c0e8cad98de admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:35.223542 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb193cad-b667-454a-bcca-45c0e67df875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:35.224244 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb193cad-b667-454a-bcca-45c0e67df875 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:35.224531 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb193cad-b667-454a-bcca-45c0e67df875 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:35.224810 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb193cad-b667-454a-bcca-45c0e67df875 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:35.225545 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb193cad-b667-454a-bcca-45c0e67df875 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:35.227181 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb193cad-b667-454a-bcca-45c0e67df875 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:35.272256 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3392/6750] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:37:35 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:37:35.276439 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e10df15-d3cd-49c3-a171-7bf50ae99e7c admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:35.299295 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e10df15-d3cd-49c3-a171-7bf50ae99e7c admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:35.307830 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4535432-b059-45de-83d8-9d1c319366f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:35.308682 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4535432-b059-45de-83d8-9d1c319366f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:35.308964 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4535432-b059-45de-83d8-9d1c319366f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:35.309240 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4535432-b059-45de-83d8-9d1c319366f9 admin admin] PATH_INFO: `/v3/projects/9ad4690e87914500b98536b03da79e90/users/fbf8b005a8e94b889abd5f74a42356cc/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:35.314053 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4535432-b059-45de-83d8-9d1c319366f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ad4690e87914500b98536b03da79e90, user_id=fbf8b005a8e94b889abd5f74a42356cc, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:35.316724 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4535432-b059-45de-83d8-9d1c319366f9 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:35.371180 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa44cd86-acf9-4a8b-850c-74289eb89707 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:35.371860 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa44cd86-acf9-4a8b-850c-74289eb89707 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:35.375549 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa44cd86-acf9-4a8b-850c-74289eb89707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:35.375880 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3359/6751] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:37:35 2022] PUT /identity/v3/projects/9ad4690e87914500b98536b03da79e90/users/fbf8b005a8e94b889abd5f74a42356cc/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:37:35.403867 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-fa44cd86-acf9-4a8b-850c-74289eb89707 None None] MFA Rules not processed for user `fbf8b005a8e94b889abd5f74a42356cc`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:37:35.405382 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-fa44cd86-acf9-4a8b-850c-74289eb89707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:35.537520 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4535432-b059-45de-83d8-9d1c319366f9 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:35.538739 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3393/6752] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:37:35 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:37:35.551692 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4535432-b059-45de-83d8-9d1c319366f9 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:35.557092 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f4a250-4a84-408c-89c1-d0b10bbc6152 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbf8b005a8e94b889abd5f74a42356cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ad4690e87914500b98536b03da79e90', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:35.558116 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f4a250-4a84-408c-89c1-d0b10bbc6152 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:35.558589 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f4a250-4a84-408c-89c1-d0b10bbc6152 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:35.559259 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f4a250-4a84-408c-89c1-d0b10bbc6152 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:35.560202 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f4a250-4a84-408c-89c1-d0b10bbc6152 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:35.561988 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f4a250-4a84-408c-89c1-d0b10bbc6152 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:35.569428 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-83f4a250-4a84-408c-89c1-d0b10bbc6152 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] Invalid input for field 'name': '' is too short May 14 21:37:35.569428 ncdv-master-1 devstack@keystone.service[91107]: Failed validating 'minLength' in schema['properties']['name']: May 14 21:37:35.569428 ncdv-master-1 devstack@keystone.service[91107]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} May 14 21:37:35.569428 ncdv-master-1 devstack@keystone.service[91107]: On instance['name']: May 14 21:37:35.569428 ncdv-master-1 devstack@keystone.service[91107]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short May 14 21:37:35.569428 ncdv-master-1 devstack@keystone.service[91107]: Failed validating 'minLength' in schema['properties']['name']: May 14 21:37:35.569428 ncdv-master-1 devstack@keystone.service[91107]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} May 14 21:37:35.569428 ncdv-master-1 devstack@keystone.service[91107]: On instance['name']: May 14 21:37:35.569428 ncdv-master-1 devstack@keystone.service[91107]: '' May 14 21:37:35.569428 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:37:35.569428 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate May 14 21:37:35.569428 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) May 14 21:37:35.569428 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 14 21:37:35.569428 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise error May 14 21:37:35.569428 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short May 14 21:37:35.569428 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:37:35.569428 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: May 14 21:37:35.569428 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} May 14 21:37:35.569428 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:37:35.569428 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application On instance['name']: May 14 21:37:35.569428 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application '' May 14 21:37:35.569428 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:37:35.569428 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 21:37:35.571611 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:37:35.571611 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:37:35.571611 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 21:37:35.571611 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 21:37:35.571611 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 21:37:35.571611 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 21:37:35.571611 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 21:37:35.571611 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 21:37:35.571611 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 21:37:35.571611 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 21:37:35.571611 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 21:37:35.571611 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 21:37:35.571611 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post May 14 21:37:35.571611 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) May 14 21:37:35.571611 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate May 14 21:37:35.571611 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) May 14 21:37:35.571611 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate May 14 21:37:35.572996 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) May 14 21:37:35.572996 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short May 14 21:37:35.572996 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:37:35.572996 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: May 14 21:37:35.572996 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} May 14 21:37:35.572996 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:37:35.572996 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application On instance['name']: May 14 21:37:35.572996 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application '' May 14 21:37:35.572996 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:37:35.580942 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa44cd86-acf9-4a8b-850c-74289eb89707 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:35.586800 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3360/6753] 10.222.0.52 () {60 vars in 1148 bytes} [Sat May 14 21:37:35 2022] POST /identity/v3/domains => generated 283 bytes in 50 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) May 14 21:37:35.591014 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa44cd86-acf9-4a8b-850c-74289eb89707 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:35.597449 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689bc0f9-1cb2-41e4-bf12-6b4b91040765 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbf8b005a8e94b889abd5f74a42356cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ad4690e87914500b98536b03da79e90', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:35.598416 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689bc0f9-1cb2-41e4-bf12-6b4b91040765 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:35.598903 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689bc0f9-1cb2-41e4-bf12-6b4b91040765 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:35.599673 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689bc0f9-1cb2-41e4-bf12-6b4b91040765 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:35.603706 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689bc0f9-1cb2-41e4-bf12-6b4b91040765 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:35.608850 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689bc0f9-1cb2-41e4-bf12-6b4b91040765 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:35.614426 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-689bc0f9-1cb2-41e4-bf12-6b4b91040765 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 14 21:37:35.614426 ncdv-master-1 devstack@keystone.service[91106]: Failed validating 'maxLength' in schema['properties']['name']: May 14 21:37:35.614426 ncdv-master-1 devstack@keystone.service[91106]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} May 14 21:37:35.614426 ncdv-master-1 devstack@keystone.service[91106]: On instance['name']: May 14 21:37:35.614426 ncdv-master-1 devstack@keystone.service[91106]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 14 21:37:35.614426 ncdv-master-1 devstack@keystone.service[91106]: Failed validating 'maxLength' in schema['properties']['name']: May 14 21:37:35.614426 ncdv-master-1 devstack@keystone.service[91106]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} May 14 21:37:35.614426 ncdv-master-1 devstack@keystone.service[91106]: On instance['name']: May 14 21:37:35.614426 ncdv-master-1 devstack@keystone.service[91106]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' May 14 21:37:35.614426 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:37:35.614426 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate May 14 21:37:35.614426 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) May 14 21:37:35.614426 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 14 21:37:35.614426 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise error May 14 21:37:35.614426 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 14 21:37:35.614426 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:37:35.614426 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: May 14 21:37:35.614426 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} May 14 21:37:35.614426 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:37:35.616156 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application On instance['name']: May 14 21:37:35.616156 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' May 14 21:37:35.616156 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:37:35.616156 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 21:37:35.616156 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:37:35.616156 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:37:35.616156 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 21:37:35.616156 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 21:37:35.616156 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 21:37:35.616156 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 21:37:35.616156 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 21:37:35.616156 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 21:37:35.616156 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 21:37:35.616156 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 21:37:35.616156 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 21:37:35.616156 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 21:37:35.616156 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post May 14 21:37:35.616156 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) May 14 21:37:35.617597 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate May 14 21:37:35.617597 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) May 14 21:37:35.617597 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate May 14 21:37:35.617597 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) May 14 21:37:35.617597 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 14 21:37:35.617597 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:37:35.617597 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: May 14 21:37:35.617597 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} May 14 21:37:35.617597 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:37:35.617597 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application On instance['name']: May 14 21:37:35.617597 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' May 14 21:37:35.617597 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:37:35.627314 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f4a250-4a84-408c-89c1-d0b10bbc6152 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:35.627980 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3394/6754] 10.222.0.52 () {60 vars in 1148 bytes} [Sat May 14 21:37:35 2022] POST /identity/v3/domains => generated 412 bytes in 46 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) May 14 21:37:35.642242 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f4a250-4a84-408c-89c1-d0b10bbc6152 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:35.648332 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e6add8-c998-48b5-96ad-66edfb043eff tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbf8b005a8e94b889abd5f74a42356cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ad4690e87914500b98536b03da79e90', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:35.649699 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6add8-c998-48b5-96ad-66edfb043eff tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:35.650167 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6add8-c998-48b5-96ad-66edfb043eff tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:35.651372 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6add8-c998-48b5-96ad-66edfb043eff tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:35.652556 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e6add8-c998-48b5-96ad-66edfb043eff tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:35.655015 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e6add8-c998-48b5-96ad-66edfb043eff tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:35.806274 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689bc0f9-1cb2-41e4-bf12-6b4b91040765 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:35.811615 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3361/6755] 10.222.0.52 () {60 vars in 1148 bytes} [Sat May 14 21:37:35 2022] POST /identity/v3/domains => generated 277 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:37:35.823094 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689bc0f9-1cb2-41e4-bf12-6b4b91040765 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:35.902641 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c179c7-cac5-4905-bf29-4a0b51c76757 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbf8b005a8e94b889abd5f74a42356cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ad4690e87914500b98536b03da79e90', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:35.903643 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c179c7-cac5-4905-bf29-4a0b51c76757 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:35.903930 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c179c7-cac5-4905-bf29-4a0b51c76757 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:35.904220 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c179c7-cac5-4905-bf29-4a0b51c76757 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] PATH_INFO: `/v3/domains/68494ae2979046dca8f56a92361c38b8` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:35.917474 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c179c7-cac5-4905-bf29-4a0b51c76757 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=68494ae2979046dca8f56a92361c38b8)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:35.919263 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c179c7-cac5-4905-bf29-4a0b51c76757 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:35.941388 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e6add8-c998-48b5-96ad-66edfb043eff tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:35.944840 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-40e6add8-c998-48b5-96ad-66edfb043eff tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:35.957112 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-34c179c7-cac5-4905-bf29-4a0b51c76757 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] Cannot delete a domain that is enabled, please disable it first.: keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. May 14 21:37:35.957112 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:37:35.957112 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 21:37:35.957112 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 21:37:35.957112 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 21:37:35.957112 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 21:37:35.957112 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 21:37:35.957112 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 21:37:35.957112 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 21:37:35.957112 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 21:37:35.957112 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 21:37:35.957112 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 21:37:35.957112 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 151, in delete May 14 21:37:35.957112 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_domain( May 14 21:37:35.958375 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 21:37:35.958375 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 21:37:35.958375 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 802, in delete_domain May 14 21:37:35.958375 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application self._delete_domain(domain, initiator) May 14 21:37:35.958375 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 815, in _delete_domain May 14 21:37:35.958375 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( May 14 21:37:35.958375 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. May 14 21:37:35.958375 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:37:35.964984 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3395/6756] 10.222.0.52 () {58 vars in 1229 bytes} [Sat May 14 21:37:35 2022] DELETE /identity/v3/domains/68494ae2979046dca8f56a92361c38b8 => generated 120 bytes in 160 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) May 14 21:37:35.966163 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c179c7-cac5-4905-bf29-4a0b51c76757 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:35.979781 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c179c7-cac5-4905-bf29-4a0b51c76757 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:35.986414 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59142a5-a75a-4825-ab56-634bca65d13f tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbf8b005a8e94b889abd5f74a42356cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ad4690e87914500b98536b03da79e90', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:35.987613 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59142a5-a75a-4825-ab56-634bca65d13f tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:35.988461 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59142a5-a75a-4825-ab56-634bca65d13f tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:35.989008 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59142a5-a75a-4825-ab56-634bca65d13f tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] PATH_INFO: `/v3/domains/68494ae2979046dca8f56a92361c38b8` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:35.990630 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59142a5-a75a-4825-ab56-634bca65d13f tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=68494ae2979046dca8f56a92361c38b8)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:35.993158 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59142a5-a75a-4825-ab56-634bca65d13f tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:36.036559 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d59142a5-a75a-4825-ab56-634bca65d13f tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '68494ae2979046dca8f56a92361c38b8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:36.037790 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d59142a5-a75a-4825-ab56-634bca65d13f tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '68494ae2979046dca8f56a92361c38b8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:36.059272 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e6add8-c998-48b5-96ad-66edfb043eff tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:36.176714 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea7d6b-7f5d-46b6-ad5d-f26136258340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:36.186716 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea7d6b-7f5d-46b6-ad5d-f26136258340 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:36.187584 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea7d6b-7f5d-46b6-ad5d-f26136258340 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:36.189386 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea7d6b-7f5d-46b6-ad5d-f26136258340 admin admin] PATH_INFO: `/v3/projects/7bdee4f5bd8a4fe6a33e699bd2ab5051` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:36.196986 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dea7d6b-7f5d-46b6-ad5d-f26136258340 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bdee4f5bd8a4fe6a33e699bd2ab5051)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:36.199062 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dea7d6b-7f5d-46b6-ad5d-f26136258340 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:36.258807 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d59142a5-a75a-4825-ab56-634bca65d13f tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '68494ae2979046dca8f56a92361c38b8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:36.260153 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d59142a5-a75a-4825-ab56-634bca65d13f tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '68494ae2979046dca8f56a92361c38b8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:36.264597 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3396/6757] 10.222.0.52 () {60 vars in 1248 bytes} [Sat May 14 21:37:35 2022] PATCH /identity/v3/domains/68494ae2979046dca8f56a92361c38b8 => generated 278 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:37:36.268937 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59142a5-a75a-4825-ab56-634bca65d13f tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:36.271611 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d59142a5-a75a-4825-ab56-634bca65d13f tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:36.386832 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0dea7d6b-7f5d-46b6-ad5d-f26136258340 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bdee4f5bd8a4fe6a33e699bd2ab5051', 'request_id': 'req-0dea7d6b-7f5d-46b6-ad5d-f26136258340'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:36.400862 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0dea7d6b-7f5d-46b6-ad5d-f26136258340 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bdee4f5bd8a4fe6a33e699bd2ab5051', 'request_id': 'req-0dea7d6b-7f5d-46b6-ad5d-f26136258340'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:36.421836 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0dea7d6b-7f5d-46b6-ad5d-f26136258340 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bdee4f5bd8a4fe6a33e699bd2ab5051', 'request_id': 'req-0dea7d6b-7f5d-46b6-ad5d-f26136258340'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:36.439908 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59142a5-a75a-4825-ab56-634bca65d13f tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:36.497526 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0dea7d6b-7f5d-46b6-ad5d-f26136258340 admin admin] The token cache is being invalidate because project 7bdee4f5bd8a4fe6a33e699bd2ab5051 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:37:36.498176 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0dea7d6b-7f5d-46b6-ad5d-f26136258340 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:36.502043 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0dea7d6b-7f5d-46b6-ad5d-f26136258340 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:36.506229 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3362/6758] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:37:35 2022] DELETE /identity/v3/projects/7bdee4f5bd8a4fe6a33e699bd2ab5051 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:37:36.536535 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd68a6-4bfb-4b0e-8c33-c1e98c1759b6 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbf8b005a8e94b889abd5f74a42356cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ad4690e87914500b98536b03da79e90', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:36.537724 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd68a6-4bfb-4b0e-8c33-c1e98c1759b6 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:36.538862 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd68a6-4bfb-4b0e-8c33-c1e98c1759b6 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:36.539536 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd68a6-4bfb-4b0e-8c33-c1e98c1759b6 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] PATH_INFO: `/v3/domains/68494ae2979046dca8f56a92361c38b8` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:36.553571 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbd68a6-4bfb-4b0e-8c33-c1e98c1759b6 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=68494ae2979046dca8f56a92361c38b8)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:36.555450 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbd68a6-4bfb-4b0e-8c33-c1e98c1759b6 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:36.585074 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5bbd68a6-4bfb-4b0e-8c33-c1e98c1759b6 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '68494ae2979046dca8f56a92361c38b8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:36.591602 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5bbd68a6-4bfb-4b0e-8c33-c1e98c1759b6 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '68494ae2979046dca8f56a92361c38b8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:36.829056 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5bbd68a6-4bfb-4b0e-8c33-c1e98c1759b6 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68494ae2979046dca8f56a92361c38b8', 'request_id': 'req-5bbd68a6-4bfb-4b0e-8c33-c1e98c1759b6'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:36.871996 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5bbd68a6-4bfb-4b0e-8c33-c1e98c1759b6 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68494ae2979046dca8f56a92361c38b8', 'request_id': 'req-5bbd68a6-4bfb-4b0e-8c33-c1e98c1759b6'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:36.977228 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5bbd68a6-4bfb-4b0e-8c33-c1e98c1759b6 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68494ae2979046dca8f56a92361c38b8', 'request_id': 'req-5bbd68a6-4bfb-4b0e-8c33-c1e98c1759b6'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:37.016232 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5bbd68a6-4bfb-4b0e-8c33-c1e98c1759b6 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] The token cache is being invalidate because project 68494ae2979046dca8f56a92361c38b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:37:37.016936 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5bbd68a6-4bfb-4b0e-8c33-c1e98c1759b6 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:37.023977 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5bbd68a6-4bfb-4b0e-8c33-c1e98c1759b6 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:37.042645 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5bbd68a6-4bfb-4b0e-8c33-c1e98c1759b6 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '68494ae2979046dca8f56a92361c38b8', 'request_id': 'req-5bbd68a6-4bfb-4b0e-8c33-c1e98c1759b6'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:37.044673 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5bbd68a6-4bfb-4b0e-8c33-c1e98c1759b6 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '68494ae2979046dca8f56a92361c38b8', 'request_id': 'req-5bbd68a6-4bfb-4b0e-8c33-c1e98c1759b6'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:37.058842 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5bbd68a6-4bfb-4b0e-8c33-c1e98c1759b6 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '68494ae2979046dca8f56a92361c38b8', 'request_id': 'req-5bbd68a6-4bfb-4b0e-8c33-c1e98c1759b6'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:37.083541 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3397/6759] 10.222.0.52 () {58 vars in 1229 bytes} [Sat May 14 21:37:36 2022] DELETE /identity/v3/domains/68494ae2979046dca8f56a92361c38b8 => generated 0 bytes in 815 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:37:37.088383 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea7d6b-7f5d-46b6-ad5d-f26136258340 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:37.091357 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-0dea7d6b-7f5d-46b6-ad5d-f26136258340 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:37.136633 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea7d6b-7f5d-46b6-ad5d-f26136258340 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:37.262888 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80fc3b0-8628-41e0-809c-92c0fbc85056 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbf8b005a8e94b889abd5f74a42356cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ad4690e87914500b98536b03da79e90', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:37.263897 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80fc3b0-8628-41e0-809c-92c0fbc85056 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:37.264381 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80fc3b0-8628-41e0-809c-92c0fbc85056 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:37.265423 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80fc3b0-8628-41e0-809c-92c0fbc85056 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] PATH_INFO: `/v3/domains/4c375dec1de74f598eef8835cfb716df` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:37.278768 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80fc3b0-8628-41e0-809c-92c0fbc85056 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 21:37:37.290297 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-e80fc3b0-8628-41e0-809c-92c0fbc85056 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] Could not find domain: 4c375dec1de74f598eef8835cfb716df.: keystone.exception.DomainNotFound: Could not find domain: 4c375dec1de74f598eef8835cfb716df. May 14 21:37:37.290297 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:37:37.290297 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 14 21:37:37.290297 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 14 21:37:37.290297 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 21:37:37.290297 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 21:37:37.290297 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 21:37:37.290297 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 21:37:37.290297 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 4c375dec1de74f598eef8835cfb716df. May 14 21:37:37.290297 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:37:37.290297 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 21:37:37.290297 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:37:37.290297 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:37:37.290297 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 21:37:37.290297 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 21:37:37.291815 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 21:37:37.291815 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 21:37:37.291815 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 21:37:37.291815 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 21:37:37.291815 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 21:37:37.291815 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 21:37:37.291815 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 21:37:37.291815 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 21:37:37.291815 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 150, in delete May 14 21:37:37.291815 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_domain') May 14 21:37:37.291815 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 21:37:37.291815 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 21:37:37.291815 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 21:37:37.291815 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 21:37:37.291815 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 21:37:37.291815 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 21:37:37.293326 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 21:37:37.293326 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 21:37:37.293326 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 21:37:37.293326 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 21:37:37.293326 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 21:37:37.293326 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 21:37:37.293326 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 21:37:37.293326 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 21:37:37.293326 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 21:37:37.293326 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 21:37:37.293326 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 21:37:37.293326 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 21:37:37.293326 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 21:37:37.293326 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 21:37:37.293326 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 14 21:37:37.293326 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 21:37:37.293326 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 4c375dec1de74f598eef8835cfb716df. May 14 21:37:37.295955 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:37:37.295955 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3363/6760] 10.222.0.52 () {58 vars in 1229 bytes} [Sat May 14 21:37:37 2022] DELETE /identity/v3/domains/4c375dec1de74f598eef8835cfb716df => generated 112 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 14 21:37:37.298315 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd68a6-4bfb-4b0e-8c33-c1e98c1759b6 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:37.300758 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-5bbd68a6-4bfb-4b0e-8c33-c1e98c1759b6 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:37.319997 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd68a6-4bfb-4b0e-8c33-c1e98c1759b6 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:37.326734 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb28a4f-f8e1-4e78-a7a6-b8a010dec93d tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbf8b005a8e94b889abd5f74a42356cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ad4690e87914500b98536b03da79e90', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:37.328101 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb28a4f-f8e1-4e78-a7a6-b8a010dec93d tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:37.328790 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb28a4f-f8e1-4e78-a7a6-b8a010dec93d tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:37.329307 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb28a4f-f8e1-4e78-a7a6-b8a010dec93d tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:37.331133 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb28a4f-f8e1-4e78-a7a6-b8a010dec93d tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:37.333070 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb28a4f-f8e1-4e78-a7a6-b8a010dec93d tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:37.440522 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3398/6761] 10.222.0.52 () {60 vars in 1148 bytes} [Sat May 14 21:37:37 2022] POST /identity/v3/domains => generated 252 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:37:37.441939 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80fc3b0-8628-41e0-809c-92c0fbc85056 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:37.473427 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80fc3b0-8628-41e0-809c-92c0fbc85056 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:37.593345 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec70f30-f2c0-4b86-81dc-a4f6f3cefb72 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbf8b005a8e94b889abd5f74a42356cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ad4690e87914500b98536b03da79e90', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:37.594113 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec70f30-f2c0-4b86-81dc-a4f6f3cefb72 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:37.594407 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec70f30-f2c0-4b86-81dc-a4f6f3cefb72 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:37.595058 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec70f30-f2c0-4b86-81dc-a4f6f3cefb72 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:37.596377 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec70f30-f2c0-4b86-81dc-a4f6f3cefb72 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:37.598006 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec70f30-f2c0-4b86-81dc-a4f6f3cefb72 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:37.661602 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.sql.core [None req-5ec70f30-f2c0-4b86-81dc-a4f6f3cefb72 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-445953955' for key 'project.ixu_project_name_domain_id'") May 14 21:37:37.661602 ncdv-master-1 devstack@keystone.service[91107]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 14 21:37:37.661602 ncdv-master-1 devstack@keystone.service[91107]: [parameters: {'id': '490407181c0b43388b662f47639cb395', 'name': 'tempest-domain-dup-445953955', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] May 14 21:37:37.661602 ncdv-master-1 devstack@keystone.service[91107]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91107) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 14 21:37:37.677321 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-5ec70f30-f2c0-4b86-81dc-a4f6f3cefb72 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-445953955.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-445953955. May 14 21:37:37.677321 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:37:37.677321 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 14 21:37:37.677321 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application self.dialect.do_execute( May 14 21:37:37.677321 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 14 21:37:37.677321 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 14 21:37:37.677321 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 14 21:37:37.677321 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application result = self._query(query) May 14 21:37:37.677321 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 14 21:37:37.677321 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application conn.query(q) May 14 21:37:37.677321 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 14 21:37:37.677321 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 14 21:37:37.677321 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 14 21:37:37.678503 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application result.read() May 14 21:37:37.678503 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 14 21:37:37.678503 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 14 21:37:37.678503 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 14 21:37:37.678503 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application packet.raise_for_error() May 14 21:37:37.678503 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 14 21:37:37.678503 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 14 21:37:37.678503 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 14 21:37:37.678503 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 14 21:37:37.678503 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-tempest-domain-dup-445953955' for key 'project.ixu_project_name_domain_id'") May 14 21:37:37.678503 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:37:37.678503 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 14 21:37:37.678503 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:37:37.678503 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:37:37.678503 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 14 21:37:37.678503 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 14 21:37:37.678503 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 14 21:37:37.678503 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return project_ref.to_dict() May 14 21:37:37.680194 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 14 21:37:37.680194 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application next(self.gen) May 14 21:37:37.680194 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 14 21:37:37.680194 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application yield resource May 14 21:37:37.680194 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 14 21:37:37.680194 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application next(self.gen) May 14 21:37:37.680194 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 14 21:37:37.680194 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application self.session.rollback() May 14 21:37:37.680194 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 14 21:37:37.680194 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application self.force_reraise() May 14 21:37:37.680194 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 14 21:37:37.680194 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise self.value May 14 21:37:37.680194 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 14 21:37:37.680194 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 14 21:37:37.680194 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 14 21:37:37.680194 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application session.commit() May 14 21:37:37.680194 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 14 21:37:37.681552 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 14 21:37:37.681552 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 14 21:37:37.681552 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application self._prepare_impl() May 14 21:37:37.681552 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 14 21:37:37.681552 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application self.session.flush() May 14 21:37:37.681552 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 14 21:37:37.681552 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application self._flush(objects) May 14 21:37:37.681552 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 14 21:37:37.681552 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 14 21:37:37.681552 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 14 21:37:37.681552 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application compat.raise_( May 14 21:37:37.681552 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 14 21:37:37.681552 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception May 14 21:37:37.681552 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 14 21:37:37.681552 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application flush_context.execute() May 14 21:37:37.681552 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 14 21:37:37.681552 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rec.execute(self) May 14 21:37:37.683068 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 14 21:37:37.683068 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 14 21:37:37.683068 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 14 21:37:37.683068 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application _emit_insert_statements( May 14 21:37:37.683068 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 14 21:37:37.683068 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application c = connection._execute_20( May 14 21:37:37.683068 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 14 21:37:37.683068 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 14 21:37:37.683068 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 14 21:37:37.683068 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 14 21:37:37.683068 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 14 21:37:37.683068 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ret = self._execute_context( May 14 21:37:37.683068 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 14 21:37:37.683068 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 14 21:37:37.683068 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 14 21:37:37.684350 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 14 21:37:37.684350 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 14 21:37:37.684350 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception May 14 21:37:37.684350 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 14 21:37:37.684350 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application self.dialect.do_execute( May 14 21:37:37.684350 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 14 21:37:37.684350 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 14 21:37:37.684350 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 14 21:37:37.684350 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application result = self._query(query) May 14 21:37:37.684350 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 14 21:37:37.684350 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application conn.query(q) May 14 21:37:37.684350 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 14 21:37:37.684350 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 14 21:37:37.684350 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 14 21:37:37.684350 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application result.read() May 14 21:37:37.684350 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 14 21:37:37.684350 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 14 21:37:37.685801 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 14 21:37:37.685801 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application packet.raise_for_error() May 14 21:37:37.685801 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 14 21:37:37.685801 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 14 21:37:37.685801 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 14 21:37:37.685801 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 14 21:37:37.685801 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-445953955' for key 'project.ixu_project_name_domain_id'") May 14 21:37:37.685801 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 14 21:37:37.685801 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [parameters: {'id': '490407181c0b43388b662f47639cb395', 'name': 'tempest-domain-dup-445953955', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] May 14 21:37:37.685801 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 14 21:37:37.685801 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:37:37.685801 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 21:37:37.685801 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:37:37.685801 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:37:37.687040 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 14 21:37:37.687040 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 14 21:37:37.687040 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 14 21:37:37.687040 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 14 21:37:37.687040 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-domain-dup-445953955. May 14 21:37:37.687040 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:37:37.687040 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 21:37:37.687040 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:37:37.687040 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:37:37.687040 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 21:37:37.687040 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 21:37:37.687040 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 21:37:37.687040 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 21:37:37.687040 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 21:37:37.687040 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 21:37:37.687040 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 21:37:37.687040 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 21:37:37.693350 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 21:37:37.693350 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 21:37:37.693350 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post May 14 21:37:37.693350 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( May 14 21:37:37.693350 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 21:37:37.693350 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 21:37:37.693350 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain May 14 21:37:37.693350 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application is_domain_project = self.create_project( May 14 21:37:37.693350 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 21:37:37.693350 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 21:37:37.693350 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 14 21:37:37.693350 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.Conflict( May 14 21:37:37.693350 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-445953955. May 14 21:37:37.693350 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:37:37.693350 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3364/6762] 10.222.0.52 () {60 vars in 1148 bytes} [Sat May 14 21:37:37 2022] POST /identity/v3/domains => generated 211 bytes in 237 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 14 21:37:37.694580 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb28a4f-f8e1-4e78-a7a6-b8a010dec93d tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:37.696417 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb28a4f-f8e1-4e78-a7a6-b8a010dec93d tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:37.708386 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba3b4b-929b-41e6-82ac-3d530f1df3ef tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbf8b005a8e94b889abd5f74a42356cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ad4690e87914500b98536b03da79e90', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:37.709312 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba3b4b-929b-41e6-82ac-3d530f1df3ef tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:37.709657 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba3b4b-929b-41e6-82ac-3d530f1df3ef tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:37.709938 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba3b4b-929b-41e6-82ac-3d530f1df3ef tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] PATH_INFO: `/v3/domains/3806ac6a36114de8bd66718b7d848d89` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:37.736852 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebba3b4b-929b-41e6-82ac-3d530f1df3ef tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=3806ac6a36114de8bd66718b7d848d89)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:37.738810 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebba3b4b-929b-41e6-82ac-3d530f1df3ef tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:37.778538 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ebba3b4b-929b-41e6-82ac-3d530f1df3ef tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '3806ac6a36114de8bd66718b7d848d89'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:37.779353 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ebba3b4b-929b-41e6-82ac-3d530f1df3ef tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '3806ac6a36114de8bd66718b7d848d89'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:37.908331 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ebba3b4b-929b-41e6-82ac-3d530f1df3ef tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '3806ac6a36114de8bd66718b7d848d89'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:37.909318 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ebba3b4b-929b-41e6-82ac-3d530f1df3ef tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '3806ac6a36114de8bd66718b7d848d89'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:37.913526 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3399/6763] 10.222.0.52 () {60 vars in 1248 bytes} [Sat May 14 21:37:37 2022] PATCH /identity/v3/domains/3806ac6a36114de8bd66718b7d848d89 => generated 253 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:37:37.917342 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec70f30-f2c0-4b86-81dc-a4f6f3cefb72 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:37.925389 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-5ec70f30-f2c0-4b86-81dc-a4f6f3cefb72 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:37.942302 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec70f30-f2c0-4b86-81dc-a4f6f3cefb72 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:38.082118 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625dab5c-15b6-42c7-a2c2-979e6a3b1151 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbf8b005a8e94b889abd5f74a42356cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ad4690e87914500b98536b03da79e90', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:38.082118 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625dab5c-15b6-42c7-a2c2-979e6a3b1151 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:38.082732 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625dab5c-15b6-42c7-a2c2-979e6a3b1151 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:38.083031 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625dab5c-15b6-42c7-a2c2-979e6a3b1151 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] PATH_INFO: `/v3/domains/3806ac6a36114de8bd66718b7d848d89` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:38.100639 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625dab5c-15b6-42c7-a2c2-979e6a3b1151 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=3806ac6a36114de8bd66718b7d848d89)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:38.102832 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625dab5c-15b6-42c7-a2c2-979e6a3b1151 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:38.162985 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-625dab5c-15b6-42c7-a2c2-979e6a3b1151 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '3806ac6a36114de8bd66718b7d848d89'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:38.195993 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-625dab5c-15b6-42c7-a2c2-979e6a3b1151 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '3806ac6a36114de8bd66718b7d848d89'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:38.393934 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-625dab5c-15b6-42c7-a2c2-979e6a3b1151 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3806ac6a36114de8bd66718b7d848d89', 'request_id': 'req-625dab5c-15b6-42c7-a2c2-979e6a3b1151'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:38.401050 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-625dab5c-15b6-42c7-a2c2-979e6a3b1151 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3806ac6a36114de8bd66718b7d848d89', 'request_id': 'req-625dab5c-15b6-42c7-a2c2-979e6a3b1151'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:38.410667 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-625dab5c-15b6-42c7-a2c2-979e6a3b1151 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3806ac6a36114de8bd66718b7d848d89', 'request_id': 'req-625dab5c-15b6-42c7-a2c2-979e6a3b1151'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:38.487037 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-625dab5c-15b6-42c7-a2c2-979e6a3b1151 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] The token cache is being invalidate because project 3806ac6a36114de8bd66718b7d848d89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:37:38.487683 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-625dab5c-15b6-42c7-a2c2-979e6a3b1151 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:38.488673 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-625dab5c-15b6-42c7-a2c2-979e6a3b1151 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:38.532665 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-625dab5c-15b6-42c7-a2c2-979e6a3b1151 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '3806ac6a36114de8bd66718b7d848d89', 'request_id': 'req-625dab5c-15b6-42c7-a2c2-979e6a3b1151'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:38.534026 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-625dab5c-15b6-42c7-a2c2-979e6a3b1151 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '3806ac6a36114de8bd66718b7d848d89', 'request_id': 'req-625dab5c-15b6-42c7-a2c2-979e6a3b1151'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:38.538137 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-625dab5c-15b6-42c7-a2c2-979e6a3b1151 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '3806ac6a36114de8bd66718b7d848d89', 'request_id': 'req-625dab5c-15b6-42c7-a2c2-979e6a3b1151'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:38.547009 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3365/6764] 10.222.0.52 () {58 vars in 1229 bytes} [Sat May 14 21:37:37 2022] DELETE /identity/v3/domains/3806ac6a36114de8bd66718b7d848d89 => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:37:38.551936 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba3b4b-929b-41e6-82ac-3d530f1df3ef tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:38.574531 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba3b4b-929b-41e6-82ac-3d530f1df3ef tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:38.692039 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db456324-d02e-43b5-840f-28e164e4492b tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbf8b005a8e94b889abd5f74a42356cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ad4690e87914500b98536b03da79e90', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:38.693226 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db456324-d02e-43b5-840f-28e164e4492b tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:38.694705 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db456324-d02e-43b5-840f-28e164e4492b tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:38.695229 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db456324-d02e-43b5-840f-28e164e4492b tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] PATH_INFO: `/v3/domains/68494ae2979046dca8f56a92361c38b8` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:38.706176 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db456324-d02e-43b5-840f-28e164e4492b tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 21:37:38.720257 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-db456324-d02e-43b5-840f-28e164e4492b tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] Could not find domain: 68494ae2979046dca8f56a92361c38b8.: keystone.exception.DomainNotFound: Could not find domain: 68494ae2979046dca8f56a92361c38b8. May 14 21:37:38.720257 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:37:38.720257 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 14 21:37:38.720257 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 14 21:37:38.720257 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 21:37:38.720257 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 21:37:38.720257 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 21:37:38.720257 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 21:37:38.720257 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 68494ae2979046dca8f56a92361c38b8. May 14 21:37:38.720257 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:37:38.720257 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 21:37:38.720257 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:37:38.720257 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:37:38.720257 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 21:37:38.720257 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 21:37:38.721497 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 21:37:38.721497 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 21:37:38.721497 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 21:37:38.721497 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 21:37:38.721497 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 21:37:38.721497 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 21:37:38.721497 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 21:37:38.721497 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 21:37:38.721497 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch May 14 21:37:38.721497 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') May 14 21:37:38.721497 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 21:37:38.721497 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 21:37:38.721497 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 21:37:38.721497 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 21:37:38.721497 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 21:37:38.721497 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 21:37:38.722692 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 21:37:38.722692 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 21:37:38.722692 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 21:37:38.722692 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 21:37:38.722692 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 21:37:38.722692 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 21:37:38.722692 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 21:37:38.722692 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 21:37:38.722692 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 21:37:38.722692 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 21:37:38.722692 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 21:37:38.722692 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 21:37:38.722692 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 21:37:38.722692 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 21:37:38.722692 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 14 21:37:38.722692 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 21:37:38.722692 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 68494ae2979046dca8f56a92361c38b8. May 14 21:37:38.723976 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:37:38.737096 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3400/6765] 10.222.0.52 () {60 vars in 1248 bytes} [Sat May 14 21:37:38 2022] PATCH /identity/v3/domains/68494ae2979046dca8f56a92361c38b8 => generated 112 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 14 21:37:38.741434 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625dab5c-15b6-42c7-a2c2-979e6a3b1151 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:38.743663 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-625dab5c-15b6-42c7-a2c2-979e6a3b1151 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:38.902857 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625dab5c-15b6-42c7-a2c2-979e6a3b1151 tempest-DomainsNegativeTestJSON-1695907120 tempest-DomainsNegativeTestJSON-1695907120-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:38.911013 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c4eea8-81cd-4364-9982-560d44cf5277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:38.914445 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4eea8-81cd-4364-9982-560d44cf5277 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:38.914696 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4eea8-81cd-4364-9982-560d44cf5277 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:38.914933 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4eea8-81cd-4364-9982-560d44cf5277 admin admin] PATH_INFO: `/v3/users/4dcf555d747d41fe8849e4a27001b976` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:38.942572 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c4eea8-81cd-4364-9982-560d44cf5277 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dcf555d747d41fe8849e4a27001b976)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:38.955395 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c4eea8-81cd-4364-9982-560d44cf5277 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:39.231926 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-13c4eea8-81cd-4364-9982-560d44cf5277 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dcf555d747d41fe8849e4a27001b976'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:39.242838 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-13c4eea8-81cd-4364-9982-560d44cf5277 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dcf555d747d41fe8849e4a27001b976'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:39.244104 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-13c4eea8-81cd-4364-9982-560d44cf5277 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dcf555d747d41fe8849e4a27001b976'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:39.355170 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-13c4eea8-81cd-4364-9982-560d44cf5277 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dcf555d747d41fe8849e4a27001b976'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:39.385347 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-13c4eea8-81cd-4364-9982-560d44cf5277 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dcf555d747d41fe8849e4a27001b976'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:39.403422 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3366/6766] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:37:38 2022] DELETE /identity/v3/users/4dcf555d747d41fe8849e4a27001b976 => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:37:39.408410 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d60dc32-24bb-4ac9-8850-99c92cc3017b None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:39.409447 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d60dc32-24bb-4ac9-8850-99c92cc3017b None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:39.409981 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d60dc32-24bb-4ac9-8850-99c92cc3017b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:39.466477 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-9d60dc32-24bb-4ac9-8850-99c92cc3017b None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:37:39.472709 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-9d60dc32-24bb-4ac9-8850-99c92cc3017b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:39.622056 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3401/6767] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:37:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:37:39.672766 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c4eea8-81cd-4364-9982-560d44cf5277 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:39.676377 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-13c4eea8-81cd-4364-9982-560d44cf5277 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:39.810570 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c4eea8-81cd-4364-9982-560d44cf5277 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:39.816362 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8af983f-499c-4fdf-92a5-773329a59b67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:39.816754 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af983f-499c-4fdf-92a5-773329a59b67 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:39.817255 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af983f-499c-4fdf-92a5-773329a59b67 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:39.818384 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af983f-499c-4fdf-92a5-773329a59b67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:39.839385 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8af983f-499c-4fdf-92a5-773329a59b67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:39.841791 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8af983f-499c-4fdf-92a5-773329a59b67 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:39.853830 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3367/6768] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:37:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:37:41.319569 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d60dc32-24bb-4ac9-8850-99c92cc3017b None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:41.321044 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-9d60dc32-24bb-4ac9-8850-99c92cc3017b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:41.345785 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d60dc32-24bb-4ac9-8850-99c92cc3017b None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:41.374109 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2463314-3e72-4aaa-9e60-6323f70abfb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:41.375105 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2463314-3e72-4aaa-9e60-6323f70abfb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:41.375521 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2463314-3e72-4aaa-9e60-6323f70abfb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:41.375838 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2463314-3e72-4aaa-9e60-6323f70abfb3 admin admin] PATH_INFO: `/v3/projects/38e028c5b1ce45b3bc7abfb1e4938ea5` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:41.378633 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2463314-3e72-4aaa-9e60-6323f70abfb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38e028c5b1ce45b3bc7abfb1e4938ea5)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:41.393593 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2463314-3e72-4aaa-9e60-6323f70abfb3 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:41.585202 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d2463314-3e72-4aaa-9e60-6323f70abfb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38e028c5b1ce45b3bc7abfb1e4938ea5', 'request_id': 'req-d2463314-3e72-4aaa-9e60-6323f70abfb3'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:41.607674 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d2463314-3e72-4aaa-9e60-6323f70abfb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38e028c5b1ce45b3bc7abfb1e4938ea5', 'request_id': 'req-d2463314-3e72-4aaa-9e60-6323f70abfb3'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:41.713900 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d2463314-3e72-4aaa-9e60-6323f70abfb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38e028c5b1ce45b3bc7abfb1e4938ea5', 'request_id': 'req-d2463314-3e72-4aaa-9e60-6323f70abfb3'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:41.731802 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d2463314-3e72-4aaa-9e60-6323f70abfb3 admin admin] The token cache is being invalidate because project 38e028c5b1ce45b3bc7abfb1e4938ea5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:37:41.732353 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d2463314-3e72-4aaa-9e60-6323f70abfb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:41.733305 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d2463314-3e72-4aaa-9e60-6323f70abfb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:41.735934 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3402/6769] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:37:41 2022] DELETE /identity/v3/projects/38e028c5b1ce45b3bc7abfb1e4938ea5 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:37:41.739643 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8af983f-499c-4fdf-92a5-773329a59b67 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:41.753835 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8af983f-499c-4fdf-92a5-773329a59b67 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:41.835215 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f857a034-b103-47d4-a9ff-ee47a04e65a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:41.836226 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857a034-b103-47d4-a9ff-ee47a04e65a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:41.836518 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857a034-b103-47d4-a9ff-ee47a04e65a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:41.836801 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857a034-b103-47d4-a9ff-ee47a04e65a6 admin admin] PATH_INFO: `/v3/users/fbf8b005a8e94b889abd5f74a42356cc` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:41.838600 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f857a034-b103-47d4-a9ff-ee47a04e65a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbf8b005a8e94b889abd5f74a42356cc)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:41.840838 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f857a034-b103-47d4-a9ff-ee47a04e65a6 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:42.099034 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f857a034-b103-47d4-a9ff-ee47a04e65a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbf8b005a8e94b889abd5f74a42356cc'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:42.108339 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f857a034-b103-47d4-a9ff-ee47a04e65a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbf8b005a8e94b889abd5f74a42356cc'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:42.110099 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f857a034-b103-47d4-a9ff-ee47a04e65a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbf8b005a8e94b889abd5f74a42356cc'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:42.222742 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f857a034-b103-47d4-a9ff-ee47a04e65a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbf8b005a8e94b889abd5f74a42356cc'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:42.246354 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f857a034-b103-47d4-a9ff-ee47a04e65a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbf8b005a8e94b889abd5f74a42356cc'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:42.253413 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3368/6770] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:37:41 2022] DELETE /identity/v3/users/fbf8b005a8e94b889abd5f74a42356cc => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:37:42.876387 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2463314-3e72-4aaa-9e60-6323f70abfb3 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:42.877961 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d2463314-3e72-4aaa-9e60-6323f70abfb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:42.896740 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2463314-3e72-4aaa-9e60-6323f70abfb3 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:42.990973 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f56bfe-25e4-4c82-a572-fcf09ca293bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:42.992450 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f56bfe-25e4-4c82-a572-fcf09ca293bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:42.992957 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f56bfe-25e4-4c82-a572-fcf09ca293bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:42.993557 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f56bfe-25e4-4c82-a572-fcf09ca293bd admin admin] PATH_INFO: `/v3/projects/9ad4690e87914500b98536b03da79e90` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:42.996987 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f56bfe-25e4-4c82-a572-fcf09ca293bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ad4690e87914500b98536b03da79e90)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:42.999238 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f56bfe-25e4-4c82-a572-fcf09ca293bd admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:43.273829 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-49f56bfe-25e4-4c82-a572-fcf09ca293bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ad4690e87914500b98536b03da79e90', 'request_id': 'req-49f56bfe-25e4-4c82-a572-fcf09ca293bd'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:43.281648 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-49f56bfe-25e4-4c82-a572-fcf09ca293bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ad4690e87914500b98536b03da79e90', 'request_id': 'req-49f56bfe-25e4-4c82-a572-fcf09ca293bd'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:43.373666 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-49f56bfe-25e4-4c82-a572-fcf09ca293bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ad4690e87914500b98536b03da79e90', 'request_id': 'req-49f56bfe-25e4-4c82-a572-fcf09ca293bd'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:43.418591 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-49f56bfe-25e4-4c82-a572-fcf09ca293bd admin admin] The token cache is being invalidate because project 9ad4690e87914500b98536b03da79e90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:37:43.418973 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-49f56bfe-25e4-4c82-a572-fcf09ca293bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:43.422529 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-49f56bfe-25e4-4c82-a572-fcf09ca293bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:43.429518 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3403/6771] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:37:42 2022] DELETE /identity/v3/projects/9ad4690e87914500b98536b03da79e90 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:37:43.430658 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f56bfe-25e4-4c82-a572-fcf09ca293bd admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:43.431682 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403906e8-36e4-4fa2-994f-66e5e1e978c8 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:43.432324 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-49f56bfe-25e4-4c82-a572-fcf09ca293bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:43.432551 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403906e8-36e4-4fa2-994f-66e5e1e978c8 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:43.433320 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403906e8-36e4-4fa2-994f-66e5e1e978c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:43.462585 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-403906e8-36e4-4fa2-994f-66e5e1e978c8 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:37:43.464292 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-403906e8-36e4-4fa2-994f-66e5e1e978c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:43.538062 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f56bfe-25e4-4c82-a572-fcf09ca293bd admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:43.544680 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022922af-8db5-4139-975f-0251a0b8d7a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:43.545854 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022922af-8db5-4139-975f-0251a0b8d7a7 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:43.546355 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022922af-8db5-4139-975f-0251a0b8d7a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:43.547359 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022922af-8db5-4139-975f-0251a0b8d7a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:43.550412 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-022922af-8db5-4139-975f-0251a0b8d7a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:43.567818 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022922af-8db5-4139-975f-0251a0b8d7a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:43.569579 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022922af-8db5-4139-975f-0251a0b8d7a7 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:43.590371 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3404/6772] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:37:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:37:43.619499 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3369/6773] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:37:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:37:43.629377 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301c902-12af-480a-a731-cdd096b4d1aa None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:43.630044 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301c902-12af-480a-a731-cdd096b4d1aa None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:43.640659 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301c902-12af-480a-a731-cdd096b4d1aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:43.667350 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-3301c902-12af-480a-a731-cdd096b4d1aa None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:37:43.669001 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-3301c902-12af-480a-a731-cdd096b4d1aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:43.681912 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3405/6774] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:37:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:37:43.685639 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403906e8-36e4-4fa2-994f-66e5e1e978c8 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:43.703956 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403906e8-36e4-4fa2-994f-66e5e1e978c8 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:43.710190 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797dcf5-1569-404b-8ea5-dd3c55b12e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:43.710870 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797dcf5-1569-404b-8ea5-dd3c55b12e3e admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:43.711153 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797dcf5-1569-404b-8ea5-dd3c55b12e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:43.711428 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797dcf5-1569-404b-8ea5-dd3c55b12e3e admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:43.712185 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9797dcf5-1569-404b-8ea5-dd3c55b12e3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:37:43.712491 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9797dcf5-1569-404b-8ea5-dd3c55b12e3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:43.714105 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9797dcf5-1569-404b-8ea5-dd3c55b12e3e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:43.729536 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3370/6775] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:37:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:37:43.736633 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3301c902-12af-480a-a731-cdd096b4d1aa None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:43.751818 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3301c902-12af-480a-a731-cdd096b4d1aa None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:43.760830 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b01cd14-3385-4f68-b653-253059f02bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:43.761778 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b01cd14-3385-4f68-b653-253059f02bdc admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:43.762222 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b01cd14-3385-4f68-b653-253059f02bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:43.763118 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b01cd14-3385-4f68-b653-253059f02bdc admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:43.763874 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b01cd14-3385-4f68-b653-253059f02bdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:43.767024 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b01cd14-3385-4f68-b653-253059f02bdc admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:43.882701 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3406/6776] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:37:43 2022] POST /identity/v3/projects => generated 371 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:37:43.887087 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797dcf5-1569-404b-8ea5-dd3c55b12e3e admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:43.899988 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797dcf5-1569-404b-8ea5-dd3c55b12e3e admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:44.020350 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6778f2a-9ae8-4ea1-a83e-6a8a0053fa27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:44.022413 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6778f2a-9ae8-4ea1-a83e-6a8a0053fa27 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:44.022933 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6778f2a-9ae8-4ea1-a83e-6a8a0053fa27 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:44.023437 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6778f2a-9ae8-4ea1-a83e-6a8a0053fa27 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:44.025033 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6778f2a-9ae8-4ea1-a83e-6a8a0053fa27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:44.027810 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6778f2a-9ae8-4ea1-a83e-6a8a0053fa27 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:44.151703 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3371/6777] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:37:43 2022] POST /identity/v3/users => generated 286 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:37:44.155962 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b01cd14-3385-4f68-b653-253059f02bdc admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:44.166714 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b01cd14-3385-4f68-b653-253059f02bdc admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:44.172707 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3243d8-1fa7-47c1-83a7-4de6df6263bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:44.179020 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3243d8-1fa7-47c1-83a7-4de6df6263bd admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:44.179020 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3243d8-1fa7-47c1-83a7-4de6df6263bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:44.179020 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3243d8-1fa7-47c1-83a7-4de6df6263bd admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:44.179020 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3243d8-1fa7-47c1-83a7-4de6df6263bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:44.179020 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3243d8-1fa7-47c1-83a7-4de6df6263bd admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:44.193238 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3407/6778] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:37:44.198726 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6778f2a-9ae8-4ea1-a83e-6a8a0053fa27 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:44.209794 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6778f2a-9ae8-4ea1-a83e-6a8a0053fa27 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:44.215995 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d955dd8-de3b-41f4-8eeb-3a80c3719809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:44.216679 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d955dd8-de3b-41f4-8eeb-3a80c3719809 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:44.216963 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d955dd8-de3b-41f4-8eeb-3a80c3719809 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:44.217242 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d955dd8-de3b-41f4-8eeb-3a80c3719809 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:44.218746 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d955dd8-de3b-41f4-8eeb-3a80c3719809 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:44.220788 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d955dd8-de3b-41f4-8eeb-3a80c3719809 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:44.235027 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3372/6779] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:37:44.239219 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3243d8-1fa7-47c1-83a7-4de6df6263bd admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:44.250930 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3243d8-1fa7-47c1-83a7-4de6df6263bd admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:44.255672 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff706b23-669e-4430-978f-58786fecaa64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:44.256568 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff706b23-669e-4430-978f-58786fecaa64 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:44.256857 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff706b23-669e-4430-978f-58786fecaa64 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:44.257138 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff706b23-669e-4430-978f-58786fecaa64 admin admin] PATH_INFO: `/v3/projects/256fd64ac4aa41f599fd76a0d59f9261/users/7c105578a75c4751b45277ba007f0249/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:44.273413 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff706b23-669e-4430-978f-58786fecaa64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=256fd64ac4aa41f599fd76a0d59f9261, user_id=7c105578a75c4751b45277ba007f0249, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:44.276176 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff706b23-669e-4430-978f-58786fecaa64 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:44.379166 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3408/6780] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:37:44 2022] PUT /identity/v3/projects/256fd64ac4aa41f599fd76a0d59f9261/users/7c105578a75c4751b45277ba007f0249/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:37:44.391978 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b3d2f-c8d8-40e7-afa5-d120eb38bed2 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:44.392258 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b3d2f-c8d8-40e7-afa5-d120eb38bed2 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:44.392541 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b3d2f-c8d8-40e7-afa5-d120eb38bed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:44.443176 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-cf7b3d2f-c8d8-40e7-afa5-d120eb38bed2 None None] MFA Rules not processed for user `7c105578a75c4751b45277ba007f0249`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:37:44.448297 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-cf7b3d2f-c8d8-40e7-afa5-d120eb38bed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:44.546610 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3373/6781] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:37:44 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:37:44.552373 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff706b23-669e-4430-978f-58786fecaa64 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:44.636775 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff706b23-669e-4430-978f-58786fecaa64 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:44.642917 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60445c0-d5d9-40f6-8d88-885e7a7ee93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:44.643825 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60445c0-d5d9-40f6-8d88-885e7a7ee93a admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:44.644716 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60445c0-d5d9-40f6-8d88-885e7a7ee93a admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:44.645169 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60445c0-d5d9-40f6-8d88-885e7a7ee93a admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:44.646081 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60445c0-d5d9-40f6-8d88-885e7a7ee93a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:44.648737 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60445c0-d5d9-40f6-8d88-885e7a7ee93a admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:44.758881 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3409/6782] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:37:44 2022] POST /identity/v3/projects => generated 371 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:37:44.762857 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b3d2f-c8d8-40e7-afa5-d120eb38bed2 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:44.779010 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b3d2f-c8d8-40e7-afa5-d120eb38bed2 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:44.940335 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c698a-7221-4506-b6e1-6ed6c15baef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:44.941048 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c698a-7221-4506-b6e1-6ed6c15baef3 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:44.941338 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c698a-7221-4506-b6e1-6ed6c15baef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:44.941622 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c698a-7221-4506-b6e1-6ed6c15baef3 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:44.942420 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305c698a-7221-4506-b6e1-6ed6c15baef3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:44.945271 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305c698a-7221-4506-b6e1-6ed6c15baef3 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:45.080609 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3374/6783] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:37:44 2022] POST /identity/v3/users => generated 292 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:37:45.081503 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60445c0-d5d9-40f6-8d88-885e7a7ee93a admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:45.094445 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60445c0-d5d9-40f6-8d88-885e7a7ee93a admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:45.100135 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd332c2-1203-4920-9fd0-20410a2f3fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:45.101590 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd332c2-1203-4920-9fd0-20410a2f3fda admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:45.102048 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd332c2-1203-4920-9fd0-20410a2f3fda admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:45.102518 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd332c2-1203-4920-9fd0-20410a2f3fda admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:45.103434 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd332c2-1203-4920-9fd0-20410a2f3fda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:45.106924 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd332c2-1203-4920-9fd0-20410a2f3fda admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:45.127236 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c698a-7221-4506-b6e1-6ed6c15baef3 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:45.134602 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3410/6784] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:37:45.139337 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c698a-7221-4506-b6e1-6ed6c15baef3 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:45.146142 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb76609-3bb8-46b8-9448-2532bfaa1648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:45.147515 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb76609-3bb8-46b8-9448-2532bfaa1648 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:45.147936 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb76609-3bb8-46b8-9448-2532bfaa1648 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:45.148336 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb76609-3bb8-46b8-9448-2532bfaa1648 admin admin] PATH_INFO: `/v3/projects/80590373711e4060ae02a2b03a88d5da/users/bcb44e16bf5c4f8abf562abbd16e7288/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:45.173239 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb76609-3bb8-46b8-9448-2532bfaa1648 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80590373711e4060ae02a2b03a88d5da, user_id=bcb44e16bf5c4f8abf562abbd16e7288, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:45.176177 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb76609-3bb8-46b8-9448-2532bfaa1648 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:45.342193 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3375/6785] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:37:45 2022] PUT /identity/v3/projects/80590373711e4060ae02a2b03a88d5da/users/bcb44e16bf5c4f8abf562abbd16e7288/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:37:45.343081 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd332c2-1203-4920-9fd0-20410a2f3fda admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:45.355567 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd332c2-1203-4920-9fd0-20410a2f3fda admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:45.428692 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dd67c5-b8fe-4e2a-b94b-40b27230e3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:45.429381 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd67c5-b8fe-4e2a-b94b-40b27230e3b7 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:45.429668 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd67c5-b8fe-4e2a-b94b-40b27230e3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:45.429949 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd67c5-b8fe-4e2a-b94b-40b27230e3b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:45.430682 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dd67c5-b8fe-4e2a-b94b-40b27230e3b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:45.432643 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dd67c5-b8fe-4e2a-b94b-40b27230e3b7 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:45.451791 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3411/6786] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:37:45.452404 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb76609-3bb8-46b8-9448-2532bfaa1648 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:45.467669 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb76609-3bb8-46b8-9448-2532bfaa1648 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:45.473485 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db14014-adb2-4cae-886b-94bab5b3fec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:45.474406 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db14014-adb2-4cae-886b-94bab5b3fec8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:45.474688 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db14014-adb2-4cae-886b-94bab5b3fec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:45.475188 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db14014-adb2-4cae-886b-94bab5b3fec8 admin admin] PATH_INFO: `/v3/projects/80590373711e4060ae02a2b03a88d5da/users/bcb44e16bf5c4f8abf562abbd16e7288/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:45.477576 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db14014-adb2-4cae-886b-94bab5b3fec8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80590373711e4060ae02a2b03a88d5da, user_id=bcb44e16bf5c4f8abf562abbd16e7288, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:45.480602 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db14014-adb2-4cae-886b-94bab5b3fec8 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:45.493205 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3376/6787] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:37:45 2022] PUT /identity/v3/projects/80590373711e4060ae02a2b03a88d5da/users/bcb44e16bf5c4f8abf562abbd16e7288/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:37:45.505180 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff08a92-3937-485f-a8c8-789a1789d3de None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:45.505780 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff08a92-3937-485f-a8c8-789a1789d3de None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:45.506069 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff08a92-3937-485f-a8c8-789a1789d3de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:45.546650 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-1ff08a92-3937-485f-a8c8-789a1789d3de None None] MFA Rules not processed for user `bcb44e16bf5c4f8abf562abbd16e7288`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:37:45.548723 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-1ff08a92-3937-485f-a8c8-789a1789d3de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:45.639267 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3412/6788] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:37:45 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:37:45.644588 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db14014-adb2-4cae-886b-94bab5b3fec8 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:45.661718 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db14014-adb2-4cae-886b-94bab5b3fec8 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:45.664821 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f40cf2-6959-4979-842e-7b32ed9efe2c tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb44e16bf5c4f8abf562abbd16e7288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80590373711e4060ae02a2b03a88d5da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:45.667735 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f40cf2-6959-4979-842e-7b32ed9efe2c tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:45.668212 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f40cf2-6959-4979-842e-7b32ed9efe2c tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:45.668787 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f40cf2-6959-4979-842e-7b32ed9efe2c tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] PATH_INFO: `/v3/services` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:45.669897 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f40cf2-6959-4979-842e-7b32ed9efe2c tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:45.672098 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f40cf2-6959-4979-842e-7b32ed9efe2c tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:45.811753 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3377/6789] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:37:45 2022] POST /identity/v3/services => generated 289 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:37:45.815913 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff08a92-3937-485f-a8c8-789a1789d3de None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:45.833115 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff08a92-3937-485f-a8c8-789a1789d3de None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:45.853932 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43179966-3783-49b3-a5f7-549876fd451b tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb44e16bf5c4f8abf562abbd16e7288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80590373711e4060ae02a2b03a88d5da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:45.854699 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43179966-3783-49b3-a5f7-549876fd451b tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:45.854870 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43179966-3783-49b3-a5f7-549876fd451b tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:45.855337 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43179966-3783-49b3-a5f7-549876fd451b tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:45.856282 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43179966-3783-49b3-a5f7-549876fd451b tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:45.857639 ncdv-master-1 devstack@keystone.service[91106]: WARNING py.warnings [None req-43179966-3783-49b3-a5f7-549876fd451b tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:37:45.857639 ncdv-master-1 devstack@keystone.service[91106]: warnings.warn(msg) May 14 21:37:45.857639 ncdv-master-1 devstack@keystone.service[91106]: May 14 21:37:45.858547 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43179966-3783-49b3-a5f7-549876fd451b tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:45.993807 ncdv-master-1 devstack@keystone.service[91106]: WARNING py.warnings [None req-43179966-3783-49b3-a5f7-549876fd451b tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-140920928. To ensure interoperability, identifiers should be a valid uuid. May 14 21:37:45.993807 ncdv-master-1 devstack@keystone.service[91106]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' May 14 21:37:45.993807 ncdv-master-1 devstack@keystone.service[91106]: May 14 21:37:46.178026 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3413/6790] 10.222.0.52 () {60 vars in 1155 bytes} [Sat May 14 21:37:45 2022] POST /identity/v3/endpoints => generated 358 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:37:46.181835 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f40cf2-6959-4979-842e-7b32ed9efe2c tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:46.200819 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f40cf2-6959-4979-842e-7b32ed9efe2c tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:46.218458 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae6b659-b417-487e-8076-e0435130ce91 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb44e16bf5c4f8abf562abbd16e7288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80590373711e4060ae02a2b03a88d5da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:46.219995 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6b659-b417-487e-8076-e0435130ce91 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:46.220283 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6b659-b417-487e-8076-e0435130ce91 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:46.220591 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6b659-b417-487e-8076-e0435130ce91 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] PATH_INFO: `/v3/regions/tempest-region-140920928` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:46.221725 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae6b659-b417-487e-8076-e0435130ce91 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-140920928)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:46.222381 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae6b659-b417-487e-8076-e0435130ce91 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:46.227558 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3378/6791] 10.222.0.52 () {58 vars in 1202 bytes} [Sat May 14 21:37:46 2022] GET /identity/v3/regions/tempest-region-140920928 => generated 178 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:37:46.228835 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43179966-3783-49b3-a5f7-549876fd451b tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:46.240783 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43179966-3783-49b3-a5f7-549876fd451b tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:46.246046 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7183ba63-a682-4ba6-adb2-e0a3e06cfa91 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb44e16bf5c4f8abf562abbd16e7288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80590373711e4060ae02a2b03a88d5da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:46.246723 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7183ba63-a682-4ba6-adb2-e0a3e06cfa91 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:46.247012 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7183ba63-a682-4ba6-adb2-e0a3e06cfa91 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:46.247293 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7183ba63-a682-4ba6-adb2-e0a3e06cfa91 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] PATH_INFO: `/v3/services` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:46.248150 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7183ba63-a682-4ba6-adb2-e0a3e06cfa91 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:46.252267 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7183ba63-a682-4ba6-adb2-e0a3e06cfa91 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:46.341545 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3414/6792] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:37:46 2022] POST /identity/v3/services => generated 288 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:37:46.346205 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae6b659-b417-487e-8076-e0435130ce91 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:46.366494 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae6b659-b417-487e-8076-e0435130ce91 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:46.408548 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc731eaf-3cff-4a4f-9fc0-823813d2e597 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb44e16bf5c4f8abf562abbd16e7288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80590373711e4060ae02a2b03a88d5da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:46.409745 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc731eaf-3cff-4a4f-9fc0-823813d2e597 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:46.410315 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc731eaf-3cff-4a4f-9fc0-823813d2e597 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:46.411459 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc731eaf-3cff-4a4f-9fc0-823813d2e597 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:46.412939 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc731eaf-3cff-4a4f-9fc0-823813d2e597 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:46.414249 ncdv-master-1 devstack@keystone.service[91107]: WARNING py.warnings [None req-dc731eaf-3cff-4a4f-9fc0-823813d2e597 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:37:46.414249 ncdv-master-1 devstack@keystone.service[91107]: warnings.warn(msg) May 14 21:37:46.414249 ncdv-master-1 devstack@keystone.service[91107]: May 14 21:37:46.415545 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc731eaf-3cff-4a4f-9fc0-823813d2e597 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:46.522088 ncdv-master-1 devstack@keystone.service[91107]: WARNING py.warnings [None req-dc731eaf-3cff-4a4f-9fc0-823813d2e597 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-54887796. To ensure interoperability, identifiers should be a valid uuid. May 14 21:37:46.522088 ncdv-master-1 devstack@keystone.service[91107]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' May 14 21:37:46.522088 ncdv-master-1 devstack@keystone.service[91107]: May 14 21:37:46.628143 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3379/6793] 10.222.0.52 () {60 vars in 1155 bytes} [Sat May 14 21:37:46 2022] POST /identity/v3/endpoints => generated 359 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:37:46.632066 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7183ba63-a682-4ba6-adb2-e0a3e06cfa91 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:46.651930 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7183ba63-a682-4ba6-adb2-e0a3e06cfa91 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:46.675890 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027ad228-da58-434c-b12d-802d184bea33 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb44e16bf5c4f8abf562abbd16e7288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80590373711e4060ae02a2b03a88d5da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:46.677059 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ad228-da58-434c-b12d-802d184bea33 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:46.677523 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ad228-da58-434c-b12d-802d184bea33 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:46.677978 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ad228-da58-434c-b12d-802d184bea33 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] PATH_INFO: `/v3/regions/tempest-region-54887796` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:46.678826 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027ad228-da58-434c-b12d-802d184bea33 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-54887796)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:46.680191 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027ad228-da58-434c-b12d-802d184bea33 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:46.682684 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3415/6794] 10.222.0.52 () {58 vars in 1199 bytes} [Sat May 14 21:37:46 2022] GET /identity/v3/regions/tempest-region-54887796 => generated 176 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:37:46.687249 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc731eaf-3cff-4a4f-9fc0-823813d2e597 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:46.701608 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc731eaf-3cff-4a4f-9fc0-823813d2e597 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:46.708972 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f786092a-7694-4326-8d00-74d35c656dd6 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb44e16bf5c4f8abf562abbd16e7288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80590373711e4060ae02a2b03a88d5da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:46.709872 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786092a-7694-4326-8d00-74d35c656dd6 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:46.710329 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786092a-7694-4326-8d00-74d35c656dd6 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:46.710798 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786092a-7694-4326-8d00-74d35c656dd6 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:46.712147 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f786092a-7694-4326-8d00-74d35c656dd6 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:46.714185 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f786092a-7694-4326-8d00-74d35c656dd6 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:46.827882 ncdv-master-1 devstack@keystone.service[91107]: WARNING py.warnings [None req-f786092a-7694-4326-8d00-74d35c656dd6 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-701595103. To ensure interoperability, identifiers should be a valid uuid. May 14 21:37:46.827882 ncdv-master-1 devstack@keystone.service[91107]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' May 14 21:37:46.827882 ncdv-master-1 devstack@keystone.service[91107]: May 14 21:37:46.944986 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3380/6795] 10.222.0.52 () {60 vars in 1155 bytes} [Sat May 14 21:37:46 2022] POST /identity/v3/endpoints => generated 359 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:37:46.949589 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027ad228-da58-434c-b12d-802d184bea33 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:46.962258 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027ad228-da58-434c-b12d-802d184bea33 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:46.982308 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eceea5-cf59-4067-95a5-48b0f5ca6171 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb44e16bf5c4f8abf562abbd16e7288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80590373711e4060ae02a2b03a88d5da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:46.983154 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eceea5-cf59-4067-95a5-48b0f5ca6171 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:46.983448 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eceea5-cf59-4067-95a5-48b0f5ca6171 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:46.983770 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eceea5-cf59-4067-95a5-48b0f5ca6171 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] PATH_INFO: `/v3/regions/tempest-region-701595103` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:46.984978 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eceea5-cf59-4067-95a5-48b0f5ca6171 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-701595103)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:46.986638 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eceea5-cf59-4067-95a5-48b0f5ca6171 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:46.989523 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3416/6796] 10.222.0.52 () {58 vars in 1202 bytes} [Sat May 14 21:37:46 2022] GET /identity/v3/regions/tempest-region-701595103 => generated 178 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:37:46.993770 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f786092a-7694-4326-8d00-74d35c656dd6 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:47.009220 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f786092a-7694-4326-8d00-74d35c656dd6 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:47.018656 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184a64df-c4f7-40e8-a14c-d58f3f44051b tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb44e16bf5c4f8abf562abbd16e7288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80590373711e4060ae02a2b03a88d5da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:47.019457 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a64df-c4f7-40e8-a14c-d58f3f44051b tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:47.019867 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a64df-c4f7-40e8-a14c-d58f3f44051b tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:47.020103 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a64df-c4f7-40e8-a14c-d58f3f44051b tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:47.020868 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184a64df-c4f7-40e8-a14c-d58f3f44051b tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:47.021887 ncdv-master-1 devstack@keystone.service[91107]: WARNING py.warnings [None req-184a64df-c4f7-40e8-a14c-d58f3f44051b tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:37:47.021887 ncdv-master-1 devstack@keystone.service[91107]: warnings.warn(msg) May 14 21:37:47.021887 ncdv-master-1 devstack@keystone.service[91107]: May 14 21:37:47.023310 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184a64df-c4f7-40e8-a14c-d58f3f44051b tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:47.036172 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3381/6797] 10.222.0.52 () {58 vars in 1133 bytes} [Sat May 14 21:37:46 2022] GET /identity/v3/endpoints => generated 4380 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:37:47.041203 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eceea5-cf59-4067-95a5-48b0f5ca6171 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:47.053457 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eceea5-cf59-4067-95a5-48b0f5ca6171 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:47.058721 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c9441-f9a3-42e2-9b79-7d34e520800a tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb44e16bf5c4f8abf562abbd16e7288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80590373711e4060ae02a2b03a88d5da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:47.059712 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c9441-f9a3-42e2-9b79-7d34e520800a tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:47.060071 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c9441-f9a3-42e2-9b79-7d34e520800a tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:47.060413 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c9441-f9a3-42e2-9b79-7d34e520800a tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] PATH_INFO: `/v3/endpoints/916b1739b6934f908a5faad39af2842e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:47.068196 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2c9441-f9a3-42e2-9b79-7d34e520800a tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: Authorizing `identity:get_endpoint(endpoint_id=916b1739b6934f908a5faad39af2842e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:47.069483 ncdv-master-1 devstack@keystone.service[91106]: WARNING py.warnings [None req-5b2c9441-f9a3-42e2-9b79-7d34e520800a tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:37:47.069483 ncdv-master-1 devstack@keystone.service[91106]: warnings.warn(msg) May 14 21:37:47.069483 ncdv-master-1 devstack@keystone.service[91106]: May 14 21:37:47.070488 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2c9441-f9a3-42e2-9b79-7d34e520800a tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:47.077289 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184a64df-c4f7-40e8-a14c-d58f3f44051b tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:47.085136 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3417/6798] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:37:47 2022] GET /identity/v3/endpoints/916b1739b6934f908a5faad39af2842e => generated 359 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:37:47.090119 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184a64df-c4f7-40e8-a14c-d58f3f44051b tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:47.100272 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac32c84-b7d2-4980-b30f-886b14eafc84 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb44e16bf5c4f8abf562abbd16e7288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80590373711e4060ae02a2b03a88d5da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:47.100272 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac32c84-b7d2-4980-b30f-886b14eafc84 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:47.100272 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac32c84-b7d2-4980-b30f-886b14eafc84 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:47.100707 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac32c84-b7d2-4980-b30f-886b14eafc84 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] PATH_INFO: `/v3/endpoints/916b1739b6934f908a5faad39af2842e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:47.100707 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac32c84-b7d2-4980-b30f-886b14eafc84 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=916b1739b6934f908a5faad39af2842e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:47.100707 ncdv-master-1 devstack@keystone.service[91107]: WARNING py.warnings [None req-eac32c84-b7d2-4980-b30f-886b14eafc84 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:37:47.100707 ncdv-master-1 devstack@keystone.service[91107]: warnings.warn(msg) May 14 21:37:47.100707 ncdv-master-1 devstack@keystone.service[91107]: May 14 21:37:47.101836 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac32c84-b7d2-4980-b30f-886b14eafc84 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:47.304787 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-eac32c84-b7d2-4980-b30f-886b14eafc84 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '916b1739b6934f908a5faad39af2842e', 'request_id': 'req-eac32c84-b7d2-4980-b30f-886b14eafc84'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:47.323411 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3382/6799] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:37:47 2022] DELETE /identity/v3/endpoints/916b1739b6934f908a5faad39af2842e => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:37:47.327628 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c9441-f9a3-42e2-9b79-7d34e520800a tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:47.347734 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c9441-f9a3-42e2-9b79-7d34e520800a tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:47.368727 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b38fd-50b0-4cd1-8b23-18a28b458c7e tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb44e16bf5c4f8abf562abbd16e7288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80590373711e4060ae02a2b03a88d5da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:47.369780 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b38fd-50b0-4cd1-8b23-18a28b458c7e tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:47.370495 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b38fd-50b0-4cd1-8b23-18a28b458c7e tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:47.370994 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b38fd-50b0-4cd1-8b23-18a28b458c7e tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:47.371985 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46b38fd-50b0-4cd1-8b23-18a28b458c7e tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:47.373326 ncdv-master-1 devstack@keystone.service[91106]: WARNING py.warnings [None req-a46b38fd-50b0-4cd1-8b23-18a28b458c7e tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:37:47.373326 ncdv-master-1 devstack@keystone.service[91106]: warnings.warn(msg) May 14 21:37:47.373326 ncdv-master-1 devstack@keystone.service[91106]: May 14 21:37:47.375431 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46b38fd-50b0-4cd1-8b23-18a28b458c7e tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:47.386230 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3418/6800] 10.222.0.52 () {58 vars in 1133 bytes} [Sat May 14 21:37:47 2022] GET /identity/v3/endpoints => generated 4034 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:37:47.396401 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac32c84-b7d2-4980-b30f-886b14eafc84 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:47.411123 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac32c84-b7d2-4980-b30f-886b14eafc84 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:47.416658 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cfeb0d-1a23-40f0-9562-f94b9f5f3aa6 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb44e16bf5c4f8abf562abbd16e7288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80590373711e4060ae02a2b03a88d5da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:47.420865 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cfeb0d-1a23-40f0-9562-f94b9f5f3aa6 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:47.420865 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cfeb0d-1a23-40f0-9562-f94b9f5f3aa6 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:47.420865 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cfeb0d-1a23-40f0-9562-f94b9f5f3aa6 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] PATH_INFO: `/v3/endpoints/916b1739b6934f908a5faad39af2842e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:47.423630 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cfeb0d-1a23-40f0-9562-f94b9f5f3aa6 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 21:37:47.442491 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-b4cfeb0d-1a23-40f0-9562-f94b9f5f3aa6 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] Could not find endpoint: 916b1739b6934f908a5faad39af2842e.: keystone.exception.EndpointNotFound: Could not find endpoint: 916b1739b6934f908a5faad39af2842e. May 14 21:37:47.442491 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:37:47.442491 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 236, in _get_endpoint May 14 21:37:47.442491 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return session.query(Endpoint).filter_by(id=endpoint_id).one() May 14 21:37:47.442491 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2865, in one May 14 21:37:47.442491 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._iter().one() May 14 21:37:47.442491 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1417, in one May 14 21:37:47.442491 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._only_one_row( May 14 21:37:47.442491 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row May 14 21:37:47.442491 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exc.NoResultFound( May 14 21:37:47.442491 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required May 14 21:37:47.442491 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:37:47.442491 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 21:37:47.442491 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:37:47.442491 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:37:47.442491 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 228, in get_endpoint May 14 21:37:47.443880 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.driver.get_endpoint(endpoint_id) May 14 21:37:47.443880 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 242, in get_endpoint May 14 21:37:47.443880 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._get_endpoint(session, endpoint_id).to_dict() May 14 21:37:47.443880 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 238, in _get_endpoint May 14 21:37:47.443880 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) May 14 21:37:47.443880 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: 916b1739b6934f908a5faad39af2842e. May 14 21:37:47.443880 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:37:47.443880 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 21:37:47.443880 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:37:47.443880 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:37:47.443880 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 21:37:47.443880 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 21:37:47.443880 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 21:37:47.443880 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 21:37:47.443880 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 21:37:47.443880 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 21:37:47.443880 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 21:37:47.445065 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 21:37:47.445065 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 21:37:47.445065 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 21:37:47.445065 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 113, in delete May 14 21:37:47.445065 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_endpoint') May 14 21:37:47.445065 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 21:37:47.445065 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 21:37:47.445065 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 21:37:47.445065 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 21:37:47.445065 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 21:37:47.445065 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 21:37:47.445065 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 21:37:47.445065 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 21:37:47.445065 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 21:37:47.445065 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.get_or_create( May 14 21:37:47.445065 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 21:37:47.446165 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application with Lock( May 14 21:37:47.446165 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 21:37:47.446165 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self._enter() May 14 21:37:47.446165 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 21:37:47.446165 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 21:37:47.446165 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 21:37:47.446165 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.creator() May 14 21:37:47.446165 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 21:37:47.446165 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application created_value = creator( May 14 21:37:47.446165 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 230, in get_endpoint May 14 21:37:47.446165 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) May 14 21:37:47.446165 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: 916b1739b6934f908a5faad39af2842e. May 14 21:37:47.446165 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:37:47.446165 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3383/6801] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:37:47 2022] DELETE /identity/v3/endpoints/916b1739b6934f908a5faad39af2842e => generated 114 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 14 21:37:47.448396 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b38fd-50b0-4cd1-8b23-18a28b458c7e tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:47.459595 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b38fd-50b0-4cd1-8b23-18a28b458c7e tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:47.465827 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4473f9-aef6-4286-a911-0c3786160220 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb44e16bf5c4f8abf562abbd16e7288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80590373711e4060ae02a2b03a88d5da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:47.467040 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4473f9-aef6-4286-a911-0c3786160220 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:47.467358 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4473f9-aef6-4286-a911-0c3786160220 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:47.467739 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4473f9-aef6-4286-a911-0c3786160220 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] PATH_INFO: `/v3/regions/tempest-region-701595103` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:47.470640 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4473f9-aef6-4286-a911-0c3786160220 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-701595103)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:47.472987 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4473f9-aef6-4286-a911-0c3786160220 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:47.608452 ncdv-master-1 devstack@keystone.service[91106]: WARNING py.warnings [None req-ff4473f9-aef6-4286-a911-0c3786160220 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-701595103. To ensure interoperability, identifiers should be a valid uuid. May 14 21:37:47.608452 ncdv-master-1 devstack@keystone.service[91106]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' May 14 21:37:47.608452 ncdv-master-1 devstack@keystone.service[91106]: May 14 21:37:47.626369 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cfeb0d-1a23-40f0-9562-f94b9f5f3aa6 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:47.626915 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3419/6802] 10.222.0.52 () {58 vars in 1205 bytes} [Sat May 14 21:37:47 2022] DELETE /identity/v3/regions/tempest-region-701595103 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:37:47.645320 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cfeb0d-1a23-40f0-9562-f94b9f5f3aa6 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:47.695952 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae68468d-fff0-4d37-b11b-7ed870534501 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb44e16bf5c4f8abf562abbd16e7288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80590373711e4060ae02a2b03a88d5da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:47.696536 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae68468d-fff0-4d37-b11b-7ed870534501 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:47.696831 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae68468d-fff0-4d37-b11b-7ed870534501 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:47.697125 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae68468d-fff0-4d37-b11b-7ed870534501 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:47.697835 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae68468d-fff0-4d37-b11b-7ed870534501 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:47.699492 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae68468d-fff0-4d37-b11b-7ed870534501 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:47.717849 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3384/6803] 10.222.0.52 () {58 vars in 1133 bytes} [Sat May 14 21:37:47 2022] GET /identity/v3/endpoints => generated 4034 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:37:47.723097 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4473f9-aef6-4286-a911-0c3786160220 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:47.735306 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4473f9-aef6-4286-a911-0c3786160220 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:47.743691 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49a809c-4cb8-4057-a5ce-5f528adbcf96 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb44e16bf5c4f8abf562abbd16e7288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80590373711e4060ae02a2b03a88d5da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:47.744618 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a809c-4cb8-4057-a5ce-5f528adbcf96 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:47.757721 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a809c-4cb8-4057-a5ce-5f528adbcf96 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:47.758591 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a809c-4cb8-4057-a5ce-5f528adbcf96 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:47.759604 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49a809c-4cb8-4057-a5ce-5f528adbcf96 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: Adding query filter params (service_id=28a6453dea944d3aa5103acca5f0e191) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:37:47.760104 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49a809c-4cb8-4057-a5ce-5f528adbcf96 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:47.763197 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49a809c-4cb8-4057-a5ce-5f528adbcf96 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:47.778186 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3420/6804] 10.222.0.52 () {58 vars in 1220 bytes} [Sat May 14 21:37:47 2022] GET /identity/v3/endpoints?service_id=28a6453dea944d3aa5103acca5f0e191 => generated 500 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:37:47.779524 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae68468d-fff0-4d37-b11b-7ed870534501 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:47.809659 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae68468d-fff0-4d37-b11b-7ed870534501 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:47.820985 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c29e29-d159-4d66-96ca-a8c3b35412c9 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb44e16bf5c4f8abf562abbd16e7288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80590373711e4060ae02a2b03a88d5da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:47.822578 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c29e29-d159-4d66-96ca-a8c3b35412c9 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:47.822887 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c29e29-d159-4d66-96ca-a8c3b35412c9 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:47.823438 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c29e29-d159-4d66-96ca-a8c3b35412c9 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:47.824690 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c29e29-d159-4d66-96ca-a8c3b35412c9 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: Adding query filter params (service_id=d26c1f532dcd437eb30c9780e9c5616b) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:37:47.825221 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c29e29-d159-4d66-96ca-a8c3b35412c9 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:47.827076 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c29e29-d159-4d66-96ca-a8c3b35412c9 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:47.835288 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3385/6805] 10.222.0.52 () {58 vars in 1220 bytes} [Sat May 14 21:37:47 2022] GET /identity/v3/endpoints?service_id=d26c1f532dcd437eb30c9780e9c5616b => generated 501 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:37:47.839288 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49a809c-4cb8-4057-a5ce-5f528adbcf96 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:47.854356 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49a809c-4cb8-4057-a5ce-5f528adbcf96 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:47.866268 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251c08ec-300f-4ec5-bea0-72136cfe9f92 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb44e16bf5c4f8abf562abbd16e7288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80590373711e4060ae02a2b03a88d5da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:47.879329 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c08ec-300f-4ec5-bea0-72136cfe9f92 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:47.880027 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c08ec-300f-4ec5-bea0-72136cfe9f92 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:47.881246 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c08ec-300f-4ec5-bea0-72136cfe9f92 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:47.882437 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251c08ec-300f-4ec5-bea0-72136cfe9f92 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: Adding query filter params (interface=public) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:37:47.882960 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251c08ec-300f-4ec5-bea0-72136cfe9f92 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:47.885155 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251c08ec-300f-4ec5-bea0-72136cfe9f92 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:47.899738 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3421/6806] 10.222.0.52 () {58 vars in 1166 bytes} [Sat May 14 21:37:47 2022] GET /identity/v3/endpoints?interface=public => generated 3393 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:37:47.903890 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c29e29-d159-4d66-96ca-a8c3b35412c9 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:47.922713 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c29e29-d159-4d66-96ca-a8c3b35412c9 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:47.938816 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f7905-c9a3-4435-a95f-efa941da320e tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb44e16bf5c4f8abf562abbd16e7288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80590373711e4060ae02a2b03a88d5da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:47.940275 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f7905-c9a3-4435-a95f-efa941da320e tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:47.942148 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f7905-c9a3-4435-a95f-efa941da320e tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:47.942554 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f7905-c9a3-4435-a95f-efa941da320e tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:47.944867 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11f7905-c9a3-4435-a95f-efa941da320e tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: Adding query filter params (interface=internal) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:37:47.952408 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11f7905-c9a3-4435-a95f-efa941da320e tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:47.952408 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11f7905-c9a3-4435-a95f-efa941da320e tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:47.966558 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3386/6807] 10.222.0.52 () {58 vars in 1170 bytes} [Sat May 14 21:37:47 2022] GET /identity/v3/endpoints?interface=internal => generated 476 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:37:47.973337 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251c08ec-300f-4ec5-bea0-72136cfe9f92 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:47.996258 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251c08ec-300f-4ec5-bea0-72136cfe9f92 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:48.004616 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462cb068-8d71-42c5-8b1b-0c0d870cd854 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb44e16bf5c4f8abf562abbd16e7288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80590373711e4060ae02a2b03a88d5da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:48.020757 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462cb068-8d71-42c5-8b1b-0c0d870cd854 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:48.021671 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462cb068-8d71-42c5-8b1b-0c0d870cd854 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:48.022202 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462cb068-8d71-42c5-8b1b-0c0d870cd854 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] PATH_INFO: `/v3/services` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:48.023839 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462cb068-8d71-42c5-8b1b-0c0d870cd854 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:48.025573 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462cb068-8d71-42c5-8b1b-0c0d870cd854 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:48.146483 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3422/6808] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:37:47 2022] POST /identity/v3/services => generated 288 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:37:48.150640 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f7905-c9a3-4435-a95f-efa941da320e tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:48.175640 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f7905-c9a3-4435-a95f-efa941da320e tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:48.199077 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39faca58-5ead-4036-89c6-0946f566e878 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb44e16bf5c4f8abf562abbd16e7288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80590373711e4060ae02a2b03a88d5da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:48.199874 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39faca58-5ead-4036-89c6-0946f566e878 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:48.200223 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39faca58-5ead-4036-89c6-0946f566e878 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:48.200609 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39faca58-5ead-4036-89c6-0946f566e878 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:48.201565 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39faca58-5ead-4036-89c6-0946f566e878 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:48.214713 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39faca58-5ead-4036-89c6-0946f566e878 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:48.373296 ncdv-master-1 devstack@keystone.service[91107]: WARNING py.warnings [None req-39faca58-5ead-4036-89c6-0946f566e878 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-695137739. To ensure interoperability, identifiers should be a valid uuid. May 14 21:37:48.373296 ncdv-master-1 devstack@keystone.service[91107]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' May 14 21:37:48.373296 ncdv-master-1 devstack@keystone.service[91107]: May 14 21:37:48.494553 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3387/6809] 10.222.0.52 () {60 vars in 1155 bytes} [Sat May 14 21:37:48 2022] POST /identity/v3/endpoints => generated 359 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:37:48.506593 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462cb068-8d71-42c5-8b1b-0c0d870cd854 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:48.529794 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462cb068-8d71-42c5-8b1b-0c0d870cd854 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:48.589223 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de8b571-57ef-4ec0-aa18-d03f5660cc04 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb44e16bf5c4f8abf562abbd16e7288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80590373711e4060ae02a2b03a88d5da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:48.594468 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de8b571-57ef-4ec0-aa18-d03f5660cc04 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:48.594468 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de8b571-57ef-4ec0-aa18-d03f5660cc04 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:48.594468 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de8b571-57ef-4ec0-aa18-d03f5660cc04 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] PATH_INFO: `/v3/regions/tempest-region-695137739` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:48.594468 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de8b571-57ef-4ec0-aa18-d03f5660cc04 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-695137739)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:48.608995 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de8b571-57ef-4ec0-aa18-d03f5660cc04 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:48.613664 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3423/6810] 10.222.0.52 () {58 vars in 1202 bytes} [Sat May 14 21:37:48 2022] GET /identity/v3/regions/tempest-region-695137739 => generated 178 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:37:48.619017 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39faca58-5ead-4036-89c6-0946f566e878 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:48.664659 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39faca58-5ead-4036-89c6-0946f566e878 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:48.684852 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f13b1f-c032-401e-aba8-4123fd6894f4 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb44e16bf5c4f8abf562abbd16e7288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80590373711e4060ae02a2b03a88d5da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:48.690909 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f13b1f-c032-401e-aba8-4123fd6894f4 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:48.691219 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f13b1f-c032-401e-aba8-4123fd6894f4 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:48.692226 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f13b1f-c032-401e-aba8-4123fd6894f4 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] PATH_INFO: `/v3/endpoints/bd97e6a56be64c218058b37d311b2fa4` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:48.710807 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f13b1f-c032-401e-aba8-4123fd6894f4 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=bd97e6a56be64c218058b37d311b2fa4)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:48.714882 ncdv-master-1 devstack@keystone.service[91107]: WARNING py.warnings [None req-98f13b1f-c032-401e-aba8-4123fd6894f4 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:37:48.714882 ncdv-master-1 devstack@keystone.service[91107]: warnings.warn(msg) May 14 21:37:48.714882 ncdv-master-1 devstack@keystone.service[91107]: May 14 21:37:48.717089 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f13b1f-c032-401e-aba8-4123fd6894f4 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:48.836018 ncdv-master-1 devstack@keystone.service[91107]: WARNING py.warnings [None req-98f13b1f-c032-401e-aba8-4123fd6894f4 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1910642977. To ensure interoperability, identifiers should be a valid uuid. May 14 21:37:48.836018 ncdv-master-1 devstack@keystone.service[91107]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' May 14 21:37:48.836018 ncdv-master-1 devstack@keystone.service[91107]: May 14 21:37:49.008037 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3388/6811] 10.222.0.52 () {60 vars in 1255 bytes} [Sat May 14 21:37:48 2022] PATCH /identity/v3/endpoints/bd97e6a56be64c218058b37d311b2fa4 => generated 364 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:37:49.011095 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de8b571-57ef-4ec0-aa18-d03f5660cc04 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:49.023388 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de8b571-57ef-4ec0-aa18-d03f5660cc04 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:49.054158 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e47ed9-be1b-451b-8f90-04a5a2b243e9 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb44e16bf5c4f8abf562abbd16e7288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80590373711e4060ae02a2b03a88d5da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:49.055581 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e47ed9-be1b-451b-8f90-04a5a2b243e9 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:49.059263 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e47ed9-be1b-451b-8f90-04a5a2b243e9 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:49.059789 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e47ed9-be1b-451b-8f90-04a5a2b243e9 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] PATH_INFO: `/v3/regions/tempest-region-1910642977` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:49.060475 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e47ed9-be1b-451b-8f90-04a5a2b243e9 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1910642977)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:49.061629 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e47ed9-be1b-451b-8f90-04a5a2b243e9 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:49.066242 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3424/6812] 10.222.0.52 () {58 vars in 1205 bytes} [Sat May 14 21:37:49 2022] GET /identity/v3/regions/tempest-region-1910642977 => generated 180 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:37:49.072268 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f13b1f-c032-401e-aba8-4123fd6894f4 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:49.084951 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f13b1f-c032-401e-aba8-4123fd6894f4 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:49.092201 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d16b77-02b4-4f60-8d0b-64bf52859f2a tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb44e16bf5c4f8abf562abbd16e7288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80590373711e4060ae02a2b03a88d5da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:49.093850 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d16b77-02b4-4f60-8d0b-64bf52859f2a tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:49.096463 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d16b77-02b4-4f60-8d0b-64bf52859f2a tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:49.097180 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d16b77-02b4-4f60-8d0b-64bf52859f2a tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] PATH_INFO: `/v3/endpoints/bd97e6a56be64c218058b37d311b2fa4` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:49.106783 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d16b77-02b4-4f60-8d0b-64bf52859f2a tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=bd97e6a56be64c218058b37d311b2fa4)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:49.109558 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d16b77-02b4-4f60-8d0b-64bf52859f2a tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:49.232657 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c9d16b77-02b4-4f60-8d0b-64bf52859f2a tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'bd97e6a56be64c218058b37d311b2fa4', 'request_id': 'req-c9d16b77-02b4-4f60-8d0b-64bf52859f2a'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:49.244566 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3389/6813] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:37:49 2022] DELETE /identity/v3/endpoints/bd97e6a56be64c218058b37d311b2fa4 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:37:49.248565 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e47ed9-be1b-451b-8f90-04a5a2b243e9 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:49.262482 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e47ed9-be1b-451b-8f90-04a5a2b243e9 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:49.282117 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9d9df1-bb05-49dc-ac33-248d278bb5b6 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb44e16bf5c4f8abf562abbd16e7288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80590373711e4060ae02a2b03a88d5da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:49.283215 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d9df1-bb05-49dc-ac33-248d278bb5b6 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:49.283537 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d9df1-bb05-49dc-ac33-248d278bb5b6 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:49.283826 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d9df1-bb05-49dc-ac33-248d278bb5b6 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] PATH_INFO: `/v3/regions/tempest-region-1910642977` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:49.284483 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9d9df1-bb05-49dc-ac33-248d278bb5b6 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1910642977)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:49.286096 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9d9df1-bb05-49dc-ac33-248d278bb5b6 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:49.382492 ncdv-master-1 devstack@keystone.service[91106]: WARNING py.warnings [None req-dd9d9df1-bb05-49dc-ac33-248d278bb5b6 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1910642977. To ensure interoperability, identifiers should be a valid uuid. May 14 21:37:49.382492 ncdv-master-1 devstack@keystone.service[91106]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' May 14 21:37:49.382492 ncdv-master-1 devstack@keystone.service[91106]: May 14 21:37:49.398159 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3425/6814] 10.222.0.52 () {58 vars in 1208 bytes} [Sat May 14 21:37:49 2022] DELETE /identity/v3/regions/tempest-region-1910642977 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:37:49.402043 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d16b77-02b4-4f60-8d0b-64bf52859f2a tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:49.438415 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d16b77-02b4-4f60-8d0b-64bf52859f2a tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:49.504786 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0106590c-f562-4ee3-b271-aca82f1813b7 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb44e16bf5c4f8abf562abbd16e7288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80590373711e4060ae02a2b03a88d5da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:49.508214 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106590c-f562-4ee3-b271-aca82f1813b7 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:49.508742 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106590c-f562-4ee3-b271-aca82f1813b7 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:49.510086 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106590c-f562-4ee3-b271-aca82f1813b7 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] PATH_INFO: `/v3/regions/tempest-region-695137739` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:49.512202 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0106590c-f562-4ee3-b271-aca82f1813b7 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-695137739)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:49.516410 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0106590c-f562-4ee3-b271-aca82f1813b7 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:49.615385 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3390/6815] 10.222.0.52 () {58 vars in 1205 bytes} [Sat May 14 21:37:49 2022] DELETE /identity/v3/regions/tempest-region-695137739 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:37:49.615716 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9d9df1-bb05-49dc-ac33-248d278bb5b6 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:49.635673 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9d9df1-bb05-49dc-ac33-248d278bb5b6 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:49.675593 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2201514-06d9-43d4-ab91-bc8f15a40995 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb44e16bf5c4f8abf562abbd16e7288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80590373711e4060ae02a2b03a88d5da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:49.678396 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2201514-06d9-43d4-ab91-bc8f15a40995 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:49.678396 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2201514-06d9-43d4-ab91-bc8f15a40995 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:49.678396 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2201514-06d9-43d4-ab91-bc8f15a40995 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] PATH_INFO: `/v3/services/34a01760a3b041a383054e6b51cb8b64` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:49.679555 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2201514-06d9-43d4-ab91-bc8f15a40995 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: Authorizing `identity:delete_service(service_id=34a01760a3b041a383054e6b51cb8b64)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:49.683355 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2201514-06d9-43d4-ab91-bc8f15a40995 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:49.820601 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3426/6816] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:37:49 2022] DELETE /identity/v3/services/34a01760a3b041a383054e6b51cb8b64 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:37:49.821981 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0106590c-f562-4ee3-b271-aca82f1813b7 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:49.838369 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0106590c-f562-4ee3-b271-aca82f1813b7 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:49.880190 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6dfeec-50eb-49ca-aadb-718e0b481fe7 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb44e16bf5c4f8abf562abbd16e7288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80590373711e4060ae02a2b03a88d5da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:49.881209 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6dfeec-50eb-49ca-aadb-718e0b481fe7 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:49.884086 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6dfeec-50eb-49ca-aadb-718e0b481fe7 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:49.884593 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6dfeec-50eb-49ca-aadb-718e0b481fe7 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] PATH_INFO: `/v3/endpoints/96606161e3d6449185326ac0464fd798` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:49.902293 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6dfeec-50eb-49ca-aadb-718e0b481fe7 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=96606161e3d6449185326ac0464fd798)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:49.903925 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6dfeec-50eb-49ca-aadb-718e0b481fe7 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:49.987717 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-8e6dfeec-50eb-49ca-aadb-718e0b481fe7 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '96606161e3d6449185326ac0464fd798', 'request_id': 'req-8e6dfeec-50eb-49ca-aadb-718e0b481fe7'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:50.010144 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2201514-06d9-43d4-ab91-bc8f15a40995 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:50.010560 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3391/6817] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:37:49 2022] DELETE /identity/v3/endpoints/96606161e3d6449185326ac0464fd798 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:37:50.022039 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2201514-06d9-43d4-ab91-bc8f15a40995 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:50.042233 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47123650-4c47-48ec-a694-a1eec80a4f2a tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb44e16bf5c4f8abf562abbd16e7288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80590373711e4060ae02a2b03a88d5da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:50.044233 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47123650-4c47-48ec-a694-a1eec80a4f2a tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:50.044530 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47123650-4c47-48ec-a694-a1eec80a4f2a tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:50.044821 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47123650-4c47-48ec-a694-a1eec80a4f2a tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] PATH_INFO: `/v3/regions/tempest-region-54887796` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:50.045489 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47123650-4c47-48ec-a694-a1eec80a4f2a tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-54887796)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:50.047989 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47123650-4c47-48ec-a694-a1eec80a4f2a tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:50.157072 ncdv-master-1 devstack@keystone.service[91106]: WARNING py.warnings [None req-47123650-4c47-48ec-a694-a1eec80a4f2a tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-54887796. To ensure interoperability, identifiers should be a valid uuid. May 14 21:37:50.157072 ncdv-master-1 devstack@keystone.service[91106]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' May 14 21:37:50.157072 ncdv-master-1 devstack@keystone.service[91106]: May 14 21:37:50.176859 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3427/6818] 10.222.0.52 () {58 vars in 1202 bytes} [Sat May 14 21:37:50 2022] DELETE /identity/v3/regions/tempest-region-54887796 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:37:50.180177 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6dfeec-50eb-49ca-aadb-718e0b481fe7 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:50.197645 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6dfeec-50eb-49ca-aadb-718e0b481fe7 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:50.217293 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc79264d-cbb2-4505-af4c-7c8593d90d0f tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb44e16bf5c4f8abf562abbd16e7288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80590373711e4060ae02a2b03a88d5da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:50.218860 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79264d-cbb2-4505-af4c-7c8593d90d0f tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:50.219840 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79264d-cbb2-4505-af4c-7c8593d90d0f tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:50.220348 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79264d-cbb2-4505-af4c-7c8593d90d0f tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] PATH_INFO: `/v3/services/d26c1f532dcd437eb30c9780e9c5616b` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:50.221238 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc79264d-cbb2-4505-af4c-7c8593d90d0f tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: Authorizing `identity:delete_service(service_id=d26c1f532dcd437eb30c9780e9c5616b)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:50.223200 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc79264d-cbb2-4505-af4c-7c8593d90d0f tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:50.335315 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3392/6819] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:37:50 2022] DELETE /identity/v3/services/d26c1f532dcd437eb30c9780e9c5616b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:37:50.339178 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47123650-4c47-48ec-a694-a1eec80a4f2a tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:50.351130 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47123650-4c47-48ec-a694-a1eec80a4f2a tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:50.367131 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9cd8c5-8397-4854-a464-df32a0f52937 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb44e16bf5c4f8abf562abbd16e7288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80590373711e4060ae02a2b03a88d5da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:50.368012 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9cd8c5-8397-4854-a464-df32a0f52937 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:50.368293 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9cd8c5-8397-4854-a464-df32a0f52937 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:50.368572 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9cd8c5-8397-4854-a464-df32a0f52937 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] PATH_INFO: `/v3/endpoints/2403463e98314b9ab9465cb1c6ef663b` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:50.373769 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9cd8c5-8397-4854-a464-df32a0f52937 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=2403463e98314b9ab9465cb1c6ef663b)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:50.375634 ncdv-master-1 devstack@keystone.service[91106]: WARNING py.warnings [None req-8a9cd8c5-8397-4854-a464-df32a0f52937 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:37:50.375634 ncdv-master-1 devstack@keystone.service[91106]: warnings.warn(msg) May 14 21:37:50.375634 ncdv-master-1 devstack@keystone.service[91106]: May 14 21:37:50.377018 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9cd8c5-8397-4854-a464-df32a0f52937 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:50.505605 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8a9cd8c5-8397-4854-a464-df32a0f52937 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '2403463e98314b9ab9465cb1c6ef663b', 'request_id': 'req-8a9cd8c5-8397-4854-a464-df32a0f52937'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:50.526622 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3428/6820] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:37:50 2022] DELETE /identity/v3/endpoints/2403463e98314b9ab9465cb1c6ef663b => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:37:50.527721 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc79264d-cbb2-4505-af4c-7c8593d90d0f tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:50.543382 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc79264d-cbb2-4505-af4c-7c8593d90d0f tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:50.560570 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce1e649-79f9-4054-96d1-fe870ff812e1 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb44e16bf5c4f8abf562abbd16e7288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80590373711e4060ae02a2b03a88d5da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:50.561890 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce1e649-79f9-4054-96d1-fe870ff812e1 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:50.562493 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce1e649-79f9-4054-96d1-fe870ff812e1 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:50.563016 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce1e649-79f9-4054-96d1-fe870ff812e1 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] PATH_INFO: `/v3/regions/tempest-region-140920928` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:50.563780 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce1e649-79f9-4054-96d1-fe870ff812e1 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-140920928)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:50.567016 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce1e649-79f9-4054-96d1-fe870ff812e1 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:50.733489 ncdv-master-1 devstack@keystone.service[91107]: WARNING py.warnings [None req-8ce1e649-79f9-4054-96d1-fe870ff812e1 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-140920928. To ensure interoperability, identifiers should be a valid uuid. May 14 21:37:50.733489 ncdv-master-1 devstack@keystone.service[91107]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' May 14 21:37:50.733489 ncdv-master-1 devstack@keystone.service[91107]: May 14 21:37:50.753271 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3393/6821] 10.222.0.52 () {58 vars in 1205 bytes} [Sat May 14 21:37:50 2022] DELETE /identity/v3/regions/tempest-region-140920928 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:37:50.753475 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9cd8c5-8397-4854-a464-df32a0f52937 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:50.770195 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9cd8c5-8397-4854-a464-df32a0f52937 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:50.816855 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dc35e0-58f8-4b97-93ba-95be5a953ddc tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb44e16bf5c4f8abf562abbd16e7288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80590373711e4060ae02a2b03a88d5da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:50.816855 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc35e0-58f8-4b97-93ba-95be5a953ddc tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:50.816855 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc35e0-58f8-4b97-93ba-95be5a953ddc tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:50.817694 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc35e0-58f8-4b97-93ba-95be5a953ddc tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] PATH_INFO: `/v3/services/28a6453dea944d3aa5103acca5f0e191` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:50.817694 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dc35e0-58f8-4b97-93ba-95be5a953ddc tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: Authorizing `identity:delete_service(service_id=28a6453dea944d3aa5103acca5f0e191)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:50.817694 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dc35e0-58f8-4b97-93ba-95be5a953ddc tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:50.972533 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3429/6822] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:37:50 2022] DELETE /identity/v3/services/28a6453dea944d3aa5103acca5f0e191 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:37:50.978630 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce1e649-79f9-4054-96d1-fe870ff812e1 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:51.105033 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce1e649-79f9-4054-96d1-fe870ff812e1 tempest-EndPointsTestJSON-1631849196 tempest-EndPointsTestJSON-1631849196-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:51.122881 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db14a4-9cc5-4233-9d89-0c8d4ebd01c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:51.123983 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db14a4-9cc5-4233-9d89-0c8d4ebd01c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:51.124272 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db14a4-9cc5-4233-9d89-0c8d4ebd01c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:51.124574 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db14a4-9cc5-4233-9d89-0c8d4ebd01c2 admin admin] PATH_INFO: `/v3/users/7c105578a75c4751b45277ba007f0249` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:51.126224 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8db14a4-9cc5-4233-9d89-0c8d4ebd01c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c105578a75c4751b45277ba007f0249)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:51.128364 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8db14a4-9cc5-4233-9d89-0c8d4ebd01c2 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:51.406697 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c8db14a4-9cc5-4233-9d89-0c8d4ebd01c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c105578a75c4751b45277ba007f0249'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:51.416815 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c8db14a4-9cc5-4233-9d89-0c8d4ebd01c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c105578a75c4751b45277ba007f0249'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:51.417659 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c8db14a4-9cc5-4233-9d89-0c8d4ebd01c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c105578a75c4751b45277ba007f0249'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:51.544334 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c8db14a4-9cc5-4233-9d89-0c8d4ebd01c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c105578a75c4751b45277ba007f0249'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:51.567253 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c8db14a4-9cc5-4233-9d89-0c8d4ebd01c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c105578a75c4751b45277ba007f0249'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:51.584521 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3394/6823] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:37:50 2022] DELETE /identity/v3/users/7c105578a75c4751b45277ba007f0249 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:37:51.586494 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0717a8d2-6937-4009-bf45-06a318de2517 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:51.586707 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0717a8d2-6937-4009-bf45-06a318de2517 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:51.586996 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0717a8d2-6937-4009-bf45-06a318de2517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:51.623941 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-0717a8d2-6937-4009-bf45-06a318de2517 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:37:51.625127 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-0717a8d2-6937-4009-bf45-06a318de2517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:51.729439 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3430/6824] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:37:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:37:51.743495 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db14a4-9cc5-4233-9d89-0c8d4ebd01c2 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:51.745421 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c8db14a4-9cc5-4233-9d89-0c8d4ebd01c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:51.914888 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db14a4-9cc5-4233-9d89-0c8d4ebd01c2 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:51.919042 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25afb386-6823-48e5-8155-34ae2d873bf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:51.919736 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25afb386-6823-48e5-8155-34ae2d873bf3 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:51.920023 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25afb386-6823-48e5-8155-34ae2d873bf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:51.923912 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25afb386-6823-48e5-8155-34ae2d873bf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:51.935236 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25afb386-6823-48e5-8155-34ae2d873bf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:51.937086 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25afb386-6823-48e5-8155-34ae2d873bf3 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:51.955149 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3395/6825] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:37:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:37:53.518355 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0717a8d2-6937-4009-bf45-06a318de2517 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:53.521237 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-0717a8d2-6937-4009-bf45-06a318de2517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:53.544051 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0717a8d2-6937-4009-bf45-06a318de2517 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:53.555144 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f08b40-2a62-451f-b481-e98f73b99bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:53.556592 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f08b40-2a62-451f-b481-e98f73b99bbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:53.557253 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f08b40-2a62-451f-b481-e98f73b99bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:53.557719 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f08b40-2a62-451f-b481-e98f73b99bbf admin admin] PATH_INFO: `/v3/projects/256fd64ac4aa41f599fd76a0d59f9261` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:53.559852 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f08b40-2a62-451f-b481-e98f73b99bbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=256fd64ac4aa41f599fd76a0d59f9261)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:53.562028 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f08b40-2a62-451f-b481-e98f73b99bbf admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:53.754400 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-67f08b40-2a62-451f-b481-e98f73b99bbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '256fd64ac4aa41f599fd76a0d59f9261', 'request_id': 'req-67f08b40-2a62-451f-b481-e98f73b99bbf'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:53.761230 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-67f08b40-2a62-451f-b481-e98f73b99bbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '256fd64ac4aa41f599fd76a0d59f9261', 'request_id': 'req-67f08b40-2a62-451f-b481-e98f73b99bbf'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:53.872618 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-67f08b40-2a62-451f-b481-e98f73b99bbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '256fd64ac4aa41f599fd76a0d59f9261', 'request_id': 'req-67f08b40-2a62-451f-b481-e98f73b99bbf'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:53.904600 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-67f08b40-2a62-451f-b481-e98f73b99bbf admin admin] The token cache is being invalidate because project 256fd64ac4aa41f599fd76a0d59f9261 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:37:53.904913 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-67f08b40-2a62-451f-b481-e98f73b99bbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:53.909674 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-67f08b40-2a62-451f-b481-e98f73b99bbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:53.925737 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25afb386-6823-48e5-8155-34ae2d873bf3 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:53.933872 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3431/6826] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:37:53 2022] DELETE /identity/v3/projects/256fd64ac4aa41f599fd76a0d59f9261 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:37:53.945249 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25afb386-6823-48e5-8155-34ae2d873bf3 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:54.019042 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93869bbe-1095-4d4a-8edf-2933a0da3ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:54.020646 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93869bbe-1095-4d4a-8edf-2933a0da3ba1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:54.020922 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93869bbe-1095-4d4a-8edf-2933a0da3ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:54.021647 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93869bbe-1095-4d4a-8edf-2933a0da3ba1 admin admin] PATH_INFO: `/v3/users/bcb44e16bf5c4f8abf562abbd16e7288` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:54.023022 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93869bbe-1095-4d4a-8edf-2933a0da3ba1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcb44e16bf5c4f8abf562abbd16e7288)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:54.025239 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93869bbe-1095-4d4a-8edf-2933a0da3ba1 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:54.363158 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-93869bbe-1095-4d4a-8edf-2933a0da3ba1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcb44e16bf5c4f8abf562abbd16e7288'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:54.380898 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-93869bbe-1095-4d4a-8edf-2933a0da3ba1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcb44e16bf5c4f8abf562abbd16e7288'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:54.382976 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-93869bbe-1095-4d4a-8edf-2933a0da3ba1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcb44e16bf5c4f8abf562abbd16e7288'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:54.476778 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-93869bbe-1095-4d4a-8edf-2933a0da3ba1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcb44e16bf5c4f8abf562abbd16e7288'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:54.496918 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-93869bbe-1095-4d4a-8edf-2933a0da3ba1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcb44e16bf5c4f8abf562abbd16e7288'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:54.528127 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3396/6827] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:37:53 2022] DELETE /identity/v3/users/bcb44e16bf5c4f8abf562abbd16e7288 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:37:57.383526 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f08b40-2a62-451f-b481-e98f73b99bbf admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:57.386356 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-67f08b40-2a62-451f-b481-e98f73b99bbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:57.447943 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f08b40-2a62-451f-b481-e98f73b99bbf admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:57.696020 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0c8b7b-5eaa-499d-b6b4-faf8c5ec5345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:57.697227 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c8b7b-5eaa-499d-b6b4-faf8c5ec5345 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:57.697695 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c8b7b-5eaa-499d-b6b4-faf8c5ec5345 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:57.698936 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c8b7b-5eaa-499d-b6b4-faf8c5ec5345 admin admin] PATH_INFO: `/v3/projects/80590373711e4060ae02a2b03a88d5da` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:57.700733 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0c8b7b-5eaa-499d-b6b4-faf8c5ec5345 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80590373711e4060ae02a2b03a88d5da)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:57.744924 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0c8b7b-5eaa-499d-b6b4-faf8c5ec5345 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:57.960182 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-dd0c8b7b-5eaa-499d-b6b4-faf8c5ec5345 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80590373711e4060ae02a2b03a88d5da', 'request_id': 'req-dd0c8b7b-5eaa-499d-b6b4-faf8c5ec5345'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:57.988903 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-dd0c8b7b-5eaa-499d-b6b4-faf8c5ec5345 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80590373711e4060ae02a2b03a88d5da', 'request_id': 'req-dd0c8b7b-5eaa-499d-b6b4-faf8c5ec5345'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:58.152231 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-dd0c8b7b-5eaa-499d-b6b4-faf8c5ec5345 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80590373711e4060ae02a2b03a88d5da', 'request_id': 'req-dd0c8b7b-5eaa-499d-b6b4-faf8c5ec5345'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:58.174424 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-dd0c8b7b-5eaa-499d-b6b4-faf8c5ec5345 admin admin] The token cache is being invalidate because project 80590373711e4060ae02a2b03a88d5da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:37:58.174722 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-dd0c8b7b-5eaa-499d-b6b4-faf8c5ec5345 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:58.180861 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-dd0c8b7b-5eaa-499d-b6b4-faf8c5ec5345 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:37:58.191917 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3432/6828] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:37:57 2022] DELETE /identity/v3/projects/80590373711e4060ae02a2b03a88d5da => generated 0 bytes in 809 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:37:58.197058 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2d9c9-0ecd-49e3-b6c2-bf539fb81613 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:58.204099 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2d9c9-0ecd-49e3-b6c2-bf539fb81613 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:58.204099 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2d9c9-0ecd-49e3-b6c2-bf539fb81613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:58.253544 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-dbd2d9c9-0ecd-49e3-b6c2-bf539fb81613 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:37:58.255990 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-dbd2d9c9-0ecd-49e3-b6c2-bf539fb81613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:58.348393 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3397/6829] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:37:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:37:58.356318 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f0fa72-d6bd-4d35-9aed-7e0de8f5eda6 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:58.356812 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f0fa72-d6bd-4d35-9aed-7e0de8f5eda6 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:58.357193 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f0fa72-d6bd-4d35-9aed-7e0de8f5eda6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:58.397022 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-74f0fa72-d6bd-4d35-9aed-7e0de8f5eda6 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:37:58.400981 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-74f0fa72-d6bd-4d35-9aed-7e0de8f5eda6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:58.413741 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3433/6830] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:37:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:37:58.416347 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd2d9c9-0ecd-49e3-b6c2-bf539fb81613 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:58.429652 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd2d9c9-0ecd-49e3-b6c2-bf539fb81613 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:58.442286 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d00035-b51b-42e2-a5e5-ea49ed700d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:58.443272 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d00035-b51b-42e2-a5e5-ea49ed700d40 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:58.443870 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d00035-b51b-42e2-a5e5-ea49ed700d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:58.444309 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d00035-b51b-42e2-a5e5-ea49ed700d40 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:58.445378 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d00035-b51b-42e2-a5e5-ea49ed700d40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:37:58.445856 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d00035-b51b-42e2-a5e5-ea49ed700d40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:58.450484 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d00035-b51b-42e2-a5e5-ea49ed700d40 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:58.470032 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3398/6831] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:37:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:37:58.474315 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f0fa72-d6bd-4d35-9aed-7e0de8f5eda6 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:58.485616 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f0fa72-d6bd-4d35-9aed-7e0de8f5eda6 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:58.490726 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d2abaa-ce62-4139-8e14-94f7acd24c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:58.491851 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d2abaa-ce62-4139-8e14-94f7acd24c38 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:58.492322 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d2abaa-ce62-4139-8e14-94f7acd24c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:58.493240 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d2abaa-ce62-4139-8e14-94f7acd24c38 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:58.494115 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d2abaa-ce62-4139-8e14-94f7acd24c38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:58.496345 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d2abaa-ce62-4139-8e14-94f7acd24c38 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:58.635765 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d00035-b51b-42e2-a5e5-ea49ed700d40 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:58.637313 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3434/6832] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:37:58 2022] POST /identity/v3/projects => generated 387 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:37:58.650161 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d00035-b51b-42e2-a5e5-ea49ed700d40 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:58.776907 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0245f-6887-4f32-8109-f493cbfbd43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:58.777717 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0245f-6887-4f32-8109-f493cbfbd43c admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:58.778105 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0245f-6887-4f32-8109-f493cbfbd43c admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:58.778484 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0245f-6887-4f32-8109-f493cbfbd43c admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:58.779356 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea0245f-6887-4f32-8109-f493cbfbd43c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:58.783677 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea0245f-6887-4f32-8109-f493cbfbd43c admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:58.906396 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3399/6833] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:37:58 2022] POST /identity/v3/users => generated 294 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:37:58.910672 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d2abaa-ce62-4139-8e14-94f7acd24c38 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:58.930168 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d2abaa-ce62-4139-8e14-94f7acd24c38 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:58.950497 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfac67c6-ee3c-4720-8974-18d6137f66f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:58.951314 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac67c6-ee3c-4720-8974-18d6137f66f1 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:58.952253 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac67c6-ee3c-4720-8974-18d6137f66f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:58.953797 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac67c6-ee3c-4720-8974-18d6137f66f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:58.954822 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfac67c6-ee3c-4720-8974-18d6137f66f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:58.956750 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfac67c6-ee3c-4720-8974-18d6137f66f1 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:58.992235 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0245f-6887-4f32-8109-f493cbfbd43c admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:58.997410 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3435/6834] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:37:59.003111 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0245f-6887-4f32-8109-f493cbfbd43c admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:59.023533 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705e555d-af4b-4a8b-b0ab-1f9f4236e2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:59.024098 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e555d-af4b-4a8b-b0ab-1f9f4236e2c2 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:59.025226 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e555d-af4b-4a8b-b0ab-1f9f4236e2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:59.025515 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e555d-af4b-4a8b-b0ab-1f9f4236e2c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:59.028246 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705e555d-af4b-4a8b-b0ab-1f9f4236e2c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:59.035961 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705e555d-af4b-4a8b-b0ab-1f9f4236e2c2 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:59.061599 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3400/6835] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:37:59.066260 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfac67c6-ee3c-4720-8974-18d6137f66f1 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:59.081760 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfac67c6-ee3c-4720-8974-18d6137f66f1 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:59.097216 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64190eef-d6f3-482f-8b3e-d74e26ae88f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:59.098251 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64190eef-d6f3-482f-8b3e-d74e26ae88f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:59.098641 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64190eef-d6f3-482f-8b3e-d74e26ae88f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:59.099026 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64190eef-d6f3-482f-8b3e-d74e26ae88f8 admin admin] PATH_INFO: `/v3/projects/0f05daa890ae4bdda3dcc344d0d842fe/users/304d24ce7ce848b99070f3331e6834d4/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:59.160764 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64190eef-d6f3-482f-8b3e-d74e26ae88f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f05daa890ae4bdda3dcc344d0d842fe, user_id=304d24ce7ce848b99070f3331e6834d4, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:59.163759 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64190eef-d6f3-482f-8b3e-d74e26ae88f8 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:59.278411 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3436/6836] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:37:59 2022] PUT /identity/v3/projects/0f05daa890ae4bdda3dcc344d0d842fe/users/304d24ce7ce848b99070f3331e6834d4/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:37:59.292338 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76992e7-b385-4d56-b65b-4f45a78cc0e3 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:59.292812 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76992e7-b385-4d56-b65b-4f45a78cc0e3 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:59.292948 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76992e7-b385-4d56-b65b-4f45a78cc0e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:59.345225 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-b76992e7-b385-4d56-b65b-4f45a78cc0e3 None None] MFA Rules not processed for user `304d24ce7ce848b99070f3331e6834d4`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:37:59.346477 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b76992e7-b385-4d56-b65b-4f45a78cc0e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:37:59.499288 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3401/6837] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:37:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:37:59.504439 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64190eef-d6f3-482f-8b3e-d74e26ae88f8 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:59.747439 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64190eef-d6f3-482f-8b3e-d74e26ae88f8 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:37:59.755129 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969cf7ff-2239-4f8a-aa0a-b87be892f0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:37:59.755630 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969cf7ff-2239-4f8a-aa0a-b87be892f0f4 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:37:59.755925 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969cf7ff-2239-4f8a-aa0a-b87be892f0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:37:59.756203 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969cf7ff-2239-4f8a-aa0a-b87be892f0f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:37:59.756928 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969cf7ff-2239-4f8a-aa0a-b87be892f0f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:37:59.777003 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969cf7ff-2239-4f8a-aa0a-b87be892f0f4 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:37:59.913276 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3437/6838] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:37:59 2022] POST /identity/v3/projects => generated 385 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:37:59.923287 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76992e7-b385-4d56-b65b-4f45a78cc0e3 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:37:59.967156 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76992e7-b385-4d56-b65b-4f45a78cc0e3 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:00.084688 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9536204-517a-4870-9f4a-95bdf03687d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:00.088463 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9536204-517a-4870-9f4a-95bdf03687d1 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:00.091955 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9536204-517a-4870-9f4a-95bdf03687d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:00.092249 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9536204-517a-4870-9f4a-95bdf03687d1 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:00.093078 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9536204-517a-4870-9f4a-95bdf03687d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:00.095594 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9536204-517a-4870-9f4a-95bdf03687d1 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:00.222391 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3402/6839] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:37:59 2022] POST /identity/v3/users => generated 299 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:38:00.224665 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969cf7ff-2239-4f8a-aa0a-b87be892f0f4 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:00.244205 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969cf7ff-2239-4f8a-aa0a-b87be892f0f4 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:00.251760 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b066fc4a-5560-4cc8-a2e5-64ada8723e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:00.253141 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066fc4a-5560-4cc8-a2e5-64ada8723e36 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:00.254870 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066fc4a-5560-4cc8-a2e5-64ada8723e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:00.255389 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066fc4a-5560-4cc8-a2e5-64ada8723e36 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:00.256610 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b066fc4a-5560-4cc8-a2e5-64ada8723e36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:00.259723 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b066fc4a-5560-4cc8-a2e5-64ada8723e36 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:00.282275 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3438/6840] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:38:00.286383 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9536204-517a-4870-9f4a-95bdf03687d1 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:00.298402 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9536204-517a-4870-9f4a-95bdf03687d1 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:00.306680 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeef35b-f8f5-4a05-8879-3814dfece67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:00.307644 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeef35b-f8f5-4a05-8879-3814dfece67e admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:00.307928 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeef35b-f8f5-4a05-8879-3814dfece67e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:00.308401 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeef35b-f8f5-4a05-8879-3814dfece67e admin admin] PATH_INFO: `/v3/projects/0b89816b5754475d9f14664defe9eebc/users/0e966792c4264221965197e75cc50687/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:00.326539 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeef35b-f8f5-4a05-8879-3814dfece67e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b89816b5754475d9f14664defe9eebc, user_id=0e966792c4264221965197e75cc50687, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:00.330364 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeef35b-f8f5-4a05-8879-3814dfece67e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:00.430828 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b066fc4a-5560-4cc8-a2e5-64ada8723e36 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:00.431252 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3403/6841] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:38:00 2022] PUT /identity/v3/projects/0b89816b5754475d9f14664defe9eebc/users/0e966792c4264221965197e75cc50687/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:38:00.443560 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b066fc4a-5560-4cc8-a2e5-64ada8723e36 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:00.600228 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdea607-b55c-4f85-9c98-74737c678f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:00.602355 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdea607-b55c-4f85-9c98-74737c678f75 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:00.603067 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdea607-b55c-4f85-9c98-74737c678f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:00.603723 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdea607-b55c-4f85-9c98-74737c678f75 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:00.605499 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdea607-b55c-4f85-9c98-74737c678f75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:00.610149 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdea607-b55c-4f85-9c98-74737c678f75 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:00.652837 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3439/6842] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:38:00.657346 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeef35b-f8f5-4a05-8879-3814dfece67e admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:00.681964 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeef35b-f8f5-4a05-8879-3814dfece67e admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:00.698308 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4c1e4b-d19b-4cef-bd47-2b45dac8663b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:00.699766 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c1e4b-d19b-4cef-bd47-2b45dac8663b admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:00.701456 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c1e4b-d19b-4cef-bd47-2b45dac8663b admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:00.702820 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c1e4b-d19b-4cef-bd47-2b45dac8663b admin admin] PATH_INFO: `/v3/projects/0b89816b5754475d9f14664defe9eebc/users/0e966792c4264221965197e75cc50687/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:00.707380 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4c1e4b-d19b-4cef-bd47-2b45dac8663b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b89816b5754475d9f14664defe9eebc, user_id=0e966792c4264221965197e75cc50687, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:00.713611 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4c1e4b-d19b-4cef-bd47-2b45dac8663b admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:00.742528 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3404/6843] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:38:00 2022] PUT /identity/v3/projects/0b89816b5754475d9f14664defe9eebc/users/0e966792c4264221965197e75cc50687/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:38:00.761027 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246c8ba-ecaa-452e-8900-afb313746cc6 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:00.761027 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246c8ba-ecaa-452e-8900-afb313746cc6 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:00.761027 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246c8ba-ecaa-452e-8900-afb313746cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:00.820145 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-6246c8ba-ecaa-452e-8900-afb313746cc6 None None] MFA Rules not processed for user `0e966792c4264221965197e75cc50687`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:38:00.821202 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-6246c8ba-ecaa-452e-8900-afb313746cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:00.950114 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3440/6844] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:38:00 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:38:00.955640 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4c1e4b-d19b-4cef-bd47-2b45dac8663b admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:00.975286 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4c1e4b-d19b-4cef-bd47-2b45dac8663b admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:00.980461 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ef1b25-536f-4d4d-a22b-ddf727dec213 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e966792c4264221965197e75cc50687', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b89816b5754475d9f14664defe9eebc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:00.981417 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef1b25-536f-4d4d-a22b-ddf727dec213 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:00.981878 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef1b25-536f-4d4d-a22b-ddf727dec213 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:00.982344 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef1b25-536f-4d4d-a22b-ddf727dec213 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] PATH_INFO: `/v3/services` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:00.983289 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ef1b25-536f-4d4d-a22b-ddf727dec213 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:00.985937 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ef1b25-536f-4d4d-a22b-ddf727dec213 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:01.116772 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3405/6845] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:38:00 2022] POST /identity/v3/services => generated 289 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:38:01.122650 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6246c8ba-ecaa-452e-8900-afb313746cc6 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:01.134493 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6246c8ba-ecaa-452e-8900-afb313746cc6 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:01.156848 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b934e70-7527-4b6e-9ff4-c08e3c992164 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e966792c4264221965197e75cc50687', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b89816b5754475d9f14664defe9eebc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:01.158056 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b934e70-7527-4b6e-9ff4-c08e3c992164 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:01.158749 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b934e70-7527-4b6e-9ff4-c08e3c992164 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:01.159411 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b934e70-7527-4b6e-9ff4-c08e3c992164 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:01.160709 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b934e70-7527-4b6e-9ff4-c08e3c992164 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:01.162954 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b934e70-7527-4b6e-9ff4-c08e3c992164 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:01.185477 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-3b934e70-7527-4b6e-9ff4-c08e3c992164 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' May 14 21:38:01.185477 ncdv-master-1 devstack@keystone.service[91106]: Failed validating 'type' in schema['properties']['enabled']: May 14 21:38:01.185477 ncdv-master-1 devstack@keystone.service[91106]: {'enum': [True, False, None], 'type': 'boolean'} May 14 21:38:01.185477 ncdv-master-1 devstack@keystone.service[91106]: On instance['enabled']: May 14 21:38:01.185477 ncdv-master-1 devstack@keystone.service[91106]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' May 14 21:38:01.185477 ncdv-master-1 devstack@keystone.service[91106]: Failed validating 'type' in schema['properties']['enabled']: May 14 21:38:01.185477 ncdv-master-1 devstack@keystone.service[91106]: {'enum': [True, False, None], 'type': 'boolean'} May 14 21:38:01.185477 ncdv-master-1 devstack@keystone.service[91106]: On instance['enabled']: May 14 21:38:01.185477 ncdv-master-1 devstack@keystone.service[91106]: 'False' May 14 21:38:01.185477 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:38:01.185477 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate May 14 21:38:01.185477 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) May 14 21:38:01.185477 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 14 21:38:01.185477 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise error May 14 21:38:01.185477 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' May 14 21:38:01.185477 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:38:01.185477 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: May 14 21:38:01.185477 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} May 14 21:38:01.185477 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:38:01.185477 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application On instance['enabled']: May 14 21:38:01.185477 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application 'False' May 14 21:38:01.185477 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:38:01.185477 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 21:38:01.188120 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:38:01.188120 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:38:01.188120 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 21:38:01.188120 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 21:38:01.188120 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 21:38:01.188120 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 21:38:01.188120 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 21:38:01.188120 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 21:38:01.188120 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 21:38:01.188120 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 21:38:01.188120 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 21:38:01.188120 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 21:38:01.188120 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post May 14 21:38:01.188120 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) May 14 21:38:01.188120 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate May 14 21:38:01.188120 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) May 14 21:38:01.188120 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate May 14 21:38:01.189368 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) May 14 21:38:01.189368 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' May 14 21:38:01.189368 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:38:01.189368 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: May 14 21:38:01.189368 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} May 14 21:38:01.189368 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:38:01.189368 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application On instance['enabled']: May 14 21:38:01.189368 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application 'False' May 14 21:38:01.189368 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:38:01.189368 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3441/6846] 10.222.0.52 () {60 vars in 1155 bytes} [Sat May 14 21:38:01 2022] POST /identity/v3/endpoints => generated 283 bytes in 56 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) May 14 21:38:01.190211 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ef1b25-536f-4d4d-a22b-ddf727dec213 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:01.201266 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ef1b25-536f-4d4d-a22b-ddf727dec213 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:01.207752 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd6e721-f39e-477f-9588-a0050217a260 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e966792c4264221965197e75cc50687', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b89816b5754475d9f14664defe9eebc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:01.208954 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd6e721-f39e-477f-9588-a0050217a260 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:01.209314 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd6e721-f39e-477f-9588-a0050217a260 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:01.209670 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd6e721-f39e-477f-9588-a0050217a260 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:01.211151 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd6e721-f39e-477f-9588-a0050217a260 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:01.213818 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd6e721-f39e-477f-9588-a0050217a260 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:01.220062 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-5bd6e721-f39e-477f-9588-a0050217a260 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' May 14 21:38:01.220062 ncdv-master-1 devstack@keystone.service[91107]: Failed validating 'type' in schema['properties']['enabled']: May 14 21:38:01.220062 ncdv-master-1 devstack@keystone.service[91107]: {'enum': [True, False, None], 'type': 'boolean'} May 14 21:38:01.220062 ncdv-master-1 devstack@keystone.service[91107]: On instance['enabled']: May 14 21:38:01.220062 ncdv-master-1 devstack@keystone.service[91107]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' May 14 21:38:01.220062 ncdv-master-1 devstack@keystone.service[91107]: Failed validating 'type' in schema['properties']['enabled']: May 14 21:38:01.220062 ncdv-master-1 devstack@keystone.service[91107]: {'enum': [True, False, None], 'type': 'boolean'} May 14 21:38:01.220062 ncdv-master-1 devstack@keystone.service[91107]: On instance['enabled']: May 14 21:38:01.220062 ncdv-master-1 devstack@keystone.service[91107]: 'True' May 14 21:38:01.220062 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:38:01.220062 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate May 14 21:38:01.220062 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) May 14 21:38:01.220062 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 14 21:38:01.220062 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise error May 14 21:38:01.220062 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' May 14 21:38:01.220062 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:38:01.220062 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: May 14 21:38:01.220062 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} May 14 21:38:01.220062 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:38:01.220062 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application On instance['enabled']: May 14 21:38:01.220062 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application 'True' May 14 21:38:01.220062 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:38:01.220062 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 21:38:01.221890 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:38:01.221890 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:38:01.221890 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 21:38:01.221890 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 21:38:01.221890 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 21:38:01.221890 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 21:38:01.221890 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 21:38:01.221890 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 21:38:01.221890 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 21:38:01.221890 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 21:38:01.221890 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 21:38:01.221890 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 21:38:01.221890 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post May 14 21:38:01.221890 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) May 14 21:38:01.221890 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate May 14 21:38:01.221890 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) May 14 21:38:01.221890 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate May 14 21:38:01.229430 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) May 14 21:38:01.229430 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' May 14 21:38:01.229430 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:38:01.229430 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: May 14 21:38:01.229430 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} May 14 21:38:01.229430 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:38:01.229430 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application On instance['enabled']: May 14 21:38:01.229430 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application 'True' May 14 21:38:01.229430 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:38:01.229430 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3406/6847] 10.222.0.52 () {60 vars in 1155 bytes} [Sat May 14 21:38:01 2022] POST /identity/v3/endpoints => generated 281 bytes in 46 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) May 14 21:38:01.231532 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b934e70-7527-4b6e-9ff4-c08e3c992164 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:01.244236 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b934e70-7527-4b6e-9ff4-c08e3c992164 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:01.253313 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee8ec44-385c-4538-9f84-9fa13ab0b890 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e966792c4264221965197e75cc50687', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b89816b5754475d9f14664defe9eebc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:01.254213 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee8ec44-385c-4538-9f84-9fa13ab0b890 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:01.254601 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee8ec44-385c-4538-9f84-9fa13ab0b890 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:01.255097 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee8ec44-385c-4538-9f84-9fa13ab0b890 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:01.256123 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee8ec44-385c-4538-9f84-9fa13ab0b890 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:01.258176 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee8ec44-385c-4538-9f84-9fa13ab0b890 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:01.356616 ncdv-master-1 devstack@keystone.service[91106]: WARNING py.warnings [None req-6ee8ec44-385c-4538-9f84-9fa13ab0b890 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1948114070. To ensure interoperability, identifiers should be a valid uuid. May 14 21:38:01.356616 ncdv-master-1 devstack@keystone.service[91106]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' May 14 21:38:01.356616 ncdv-master-1 devstack@keystone.service[91106]: May 14 21:38:01.533840 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3442/6848] 10.222.0.52 () {60 vars in 1155 bytes} [Sat May 14 21:38:01 2022] POST /identity/v3/endpoints => generated 361 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:38:01.538825 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd6e721-f39e-477f-9588-a0050217a260 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:01.560541 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd6e721-f39e-477f-9588-a0050217a260 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:01.593486 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab315c2-20e1-475c-b628-a9ee7db42d49 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e966792c4264221965197e75cc50687', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b89816b5754475d9f14664defe9eebc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:01.594615 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab315c2-20e1-475c-b628-a9ee7db42d49 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:01.595275 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab315c2-20e1-475c-b628-a9ee7db42d49 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:01.595760 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab315c2-20e1-475c-b628-a9ee7db42d49 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] PATH_INFO: `/v3/regions/tempest-region-1948114070` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:01.599993 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab315c2-20e1-475c-b628-a9ee7db42d49 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1948114070)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:01.599993 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab315c2-20e1-475c-b628-a9ee7db42d49 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:01.600447 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3407/6849] 10.222.0.52 () {58 vars in 1205 bytes} [Sat May 14 21:38:01 2022] GET /identity/v3/regions/tempest-region-1948114070 => generated 180 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:38:01.604359 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee8ec44-385c-4538-9f84-9fa13ab0b890 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:01.646309 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee8ec44-385c-4538-9f84-9fa13ab0b890 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:01.654173 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f74e8-fb82-4c8e-a55b-8cab32d19d6a tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e966792c4264221965197e75cc50687', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b89816b5754475d9f14664defe9eebc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:01.655169 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f74e8-fb82-4c8e-a55b-8cab32d19d6a tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:01.655820 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f74e8-fb82-4c8e-a55b-8cab32d19d6a tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:01.656203 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f74e8-fb82-4c8e-a55b-8cab32d19d6a tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] PATH_INFO: `/v3/endpoints/e675b729419d48a6994b7063aba0039e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:01.670334 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4f74e8-fb82-4c8e-a55b-8cab32d19d6a tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=e675b729419d48a6994b7063aba0039e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:01.674978 ncdv-master-1 devstack@keystone.service[91106]: WARNING py.warnings [None req-7b4f74e8-fb82-4c8e-a55b-8cab32d19d6a tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:38:01.674978 ncdv-master-1 devstack@keystone.service[91106]: warnings.warn(msg) May 14 21:38:01.674978 ncdv-master-1 devstack@keystone.service[91106]: May 14 21:38:01.674978 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4f74e8-fb82-4c8e-a55b-8cab32d19d6a tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:01.713468 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-7b4f74e8-fb82-4c8e-a55b-8cab32d19d6a tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' May 14 21:38:01.713468 ncdv-master-1 devstack@keystone.service[91106]: Failed validating 'type' in schema['properties']['enabled']: May 14 21:38:01.713468 ncdv-master-1 devstack@keystone.service[91106]: {'enum': [True, False, None], 'type': 'boolean'} May 14 21:38:01.713468 ncdv-master-1 devstack@keystone.service[91106]: On instance['enabled']: May 14 21:38:01.713468 ncdv-master-1 devstack@keystone.service[91106]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' May 14 21:38:01.713468 ncdv-master-1 devstack@keystone.service[91106]: Failed validating 'type' in schema['properties']['enabled']: May 14 21:38:01.713468 ncdv-master-1 devstack@keystone.service[91106]: {'enum': [True, False, None], 'type': 'boolean'} May 14 21:38:01.713468 ncdv-master-1 devstack@keystone.service[91106]: On instance['enabled']: May 14 21:38:01.713468 ncdv-master-1 devstack@keystone.service[91106]: 'False' May 14 21:38:01.713468 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:38:01.713468 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate May 14 21:38:01.713468 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) May 14 21:38:01.713468 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 14 21:38:01.713468 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise error May 14 21:38:01.713468 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' May 14 21:38:01.713468 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:38:01.713468 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: May 14 21:38:01.713468 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} May 14 21:38:01.713468 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:38:01.713468 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application On instance['enabled']: May 14 21:38:01.713468 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application 'False' May 14 21:38:01.713468 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:38:01.713468 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 21:38:01.715183 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:38:01.715183 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:38:01.715183 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 21:38:01.715183 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 21:38:01.715183 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 21:38:01.715183 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 21:38:01.715183 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 21:38:01.715183 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 21:38:01.715183 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 21:38:01.715183 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 21:38:01.715183 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 21:38:01.715183 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 21:38:01.715183 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch May 14 21:38:01.715183 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) May 14 21:38:01.715183 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate May 14 21:38:01.715183 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) May 14 21:38:01.715183 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate May 14 21:38:01.716445 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) May 14 21:38:01.716445 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' May 14 21:38:01.716445 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:38:01.716445 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: May 14 21:38:01.716445 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} May 14 21:38:01.716445 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:38:01.716445 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application On instance['enabled']: May 14 21:38:01.716445 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application 'False' May 14 21:38:01.716445 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:38:01.721550 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3443/6850] 10.222.0.52 () {60 vars in 1254 bytes} [Sat May 14 21:38:01 2022] PATCH /identity/v3/endpoints/e675b729419d48a6994b7063aba0039e => generated 283 bytes in 118 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) May 14 21:38:01.729816 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab315c2-20e1-475c-b628-a9ee7db42d49 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:01.756649 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab315c2-20e1-475c-b628-a9ee7db42d49 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:01.762387 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea6f5d-4f87-4687-821e-d9695fb46fc6 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e966792c4264221965197e75cc50687', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b89816b5754475d9f14664defe9eebc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:01.763718 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea6f5d-4f87-4687-821e-d9695fb46fc6 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:01.764239 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea6f5d-4f87-4687-821e-d9695fb46fc6 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:01.764742 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea6f5d-4f87-4687-821e-d9695fb46fc6 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] PATH_INFO: `/v3/endpoints/e675b729419d48a6994b7063aba0039e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:01.766959 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fea6f5d-4f87-4687-821e-d9695fb46fc6 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=e675b729419d48a6994b7063aba0039e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:01.769497 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fea6f5d-4f87-4687-821e-d9695fb46fc6 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:01.865224 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9fea6f5d-4f87-4687-821e-d9695fb46fc6 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'e675b729419d48a6994b7063aba0039e', 'request_id': 'req-9fea6f5d-4f87-4687-821e-d9695fb46fc6'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:01.879063 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3408/6851] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:38:01 2022] DELETE /identity/v3/endpoints/e675b729419d48a6994b7063aba0039e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:38:01.883103 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f74e8-fb82-4c8e-a55b-8cab32d19d6a tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:01.904346 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f74e8-fb82-4c8e-a55b-8cab32d19d6a tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:01.967721 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b2897-16a8-43e9-b51e-339a0117e820 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e966792c4264221965197e75cc50687', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b89816b5754475d9f14664defe9eebc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:01.971767 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b2897-16a8-43e9-b51e-339a0117e820 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:01.971767 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b2897-16a8-43e9-b51e-339a0117e820 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:01.971767 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b2897-16a8-43e9-b51e-339a0117e820 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] PATH_INFO: `/v3/regions/tempest-region-1948114070` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:01.971767 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525b2897-16a8-43e9-b51e-339a0117e820 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1948114070)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:01.975429 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525b2897-16a8-43e9-b51e-339a0117e820 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:02.163852 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea6f5d-4f87-4687-821e-d9695fb46fc6 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:02.164038 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3444/6852] 10.222.0.52 () {58 vars in 1208 bytes} [Sat May 14 21:38:01 2022] DELETE /identity/v3/regions/tempest-region-1948114070 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:38:02.169761 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea6f5d-4f87-4687-821e-d9695fb46fc6 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:02.192824 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc3cb5a-70e8-489a-9422-a00982b37721 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e966792c4264221965197e75cc50687', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b89816b5754475d9f14664defe9eebc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:02.193616 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc3cb5a-70e8-489a-9422-a00982b37721 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:02.194224 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc3cb5a-70e8-489a-9422-a00982b37721 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:02.194699 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc3cb5a-70e8-489a-9422-a00982b37721 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:02.195614 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc3cb5a-70e8-489a-9422-a00982b37721 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:02.197407 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc3cb5a-70e8-489a-9422-a00982b37721 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:02.316796 ncdv-master-1 devstack@keystone.service[91107]: WARNING py.warnings [None req-6dc3cb5a-70e8-489a-9422-a00982b37721 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-158736238. To ensure interoperability, identifiers should be a valid uuid. May 14 21:38:02.316796 ncdv-master-1 devstack@keystone.service[91107]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' May 14 21:38:02.316796 ncdv-master-1 devstack@keystone.service[91107]: May 14 21:38:02.450090 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3409/6853] 10.222.0.52 () {60 vars in 1155 bytes} [Sat May 14 21:38:02 2022] POST /identity/v3/endpoints => generated 358 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:38:02.451438 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b2897-16a8-43e9-b51e-339a0117e820 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:02.465958 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b2897-16a8-43e9-b51e-339a0117e820 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:02.522190 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f070feb-6f07-416d-8f4a-ed3bf0112821 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e966792c4264221965197e75cc50687', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b89816b5754475d9f14664defe9eebc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:02.523298 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f070feb-6f07-416d-8f4a-ed3bf0112821 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:02.525138 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f070feb-6f07-416d-8f4a-ed3bf0112821 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:02.527053 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f070feb-6f07-416d-8f4a-ed3bf0112821 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] PATH_INFO: `/v3/regions/tempest-region-158736238` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:02.528706 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f070feb-6f07-416d-8f4a-ed3bf0112821 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-158736238)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:02.532567 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f070feb-6f07-416d-8f4a-ed3bf0112821 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:02.545105 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3445/6854] 10.222.0.52 () {58 vars in 1202 bytes} [Sat May 14 21:38:02 2022] GET /identity/v3/regions/tempest-region-158736238 => generated 178 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:38:02.549533 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc3cb5a-70e8-489a-9422-a00982b37721 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:02.570006 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc3cb5a-70e8-489a-9422-a00982b37721 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:02.614595 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae517c9-bd2e-4fac-8eef-91e188b7ee84 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e966792c4264221965197e75cc50687', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b89816b5754475d9f14664defe9eebc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:02.616252 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae517c9-bd2e-4fac-8eef-91e188b7ee84 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:02.616252 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae517c9-bd2e-4fac-8eef-91e188b7ee84 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:02.623840 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae517c9-bd2e-4fac-8eef-91e188b7ee84 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] PATH_INFO: `/v3/endpoints/e449dda92e3c4e6da3bfc52274a30d4c` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:02.642671 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae517c9-bd2e-4fac-8eef-91e188b7ee84 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=e449dda92e3c4e6da3bfc52274a30d4c)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:02.644830 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae517c9-bd2e-4fac-8eef-91e188b7ee84 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:02.705943 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-7ae517c9-bd2e-4fac-8eef-91e188b7ee84 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' May 14 21:38:02.705943 ncdv-master-1 devstack@keystone.service[91107]: Failed validating 'type' in schema['properties']['enabled']: May 14 21:38:02.705943 ncdv-master-1 devstack@keystone.service[91107]: {'enum': [True, False, None], 'type': 'boolean'} May 14 21:38:02.705943 ncdv-master-1 devstack@keystone.service[91107]: On instance['enabled']: May 14 21:38:02.705943 ncdv-master-1 devstack@keystone.service[91107]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' May 14 21:38:02.705943 ncdv-master-1 devstack@keystone.service[91107]: Failed validating 'type' in schema['properties']['enabled']: May 14 21:38:02.705943 ncdv-master-1 devstack@keystone.service[91107]: {'enum': [True, False, None], 'type': 'boolean'} May 14 21:38:02.705943 ncdv-master-1 devstack@keystone.service[91107]: On instance['enabled']: May 14 21:38:02.705943 ncdv-master-1 devstack@keystone.service[91107]: 'True' May 14 21:38:02.705943 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:38:02.705943 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate May 14 21:38:02.705943 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) May 14 21:38:02.705943 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 14 21:38:02.705943 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise error May 14 21:38:02.705943 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' May 14 21:38:02.705943 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:38:02.705943 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: May 14 21:38:02.705943 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} May 14 21:38:02.705943 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:38:02.705943 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application On instance['enabled']: May 14 21:38:02.705943 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application 'True' May 14 21:38:02.705943 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:38:02.705943 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 21:38:02.708963 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:38:02.708963 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:38:02.708963 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 21:38:02.708963 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 21:38:02.708963 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 21:38:02.708963 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 21:38:02.708963 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 21:38:02.708963 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 21:38:02.708963 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 21:38:02.708963 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 21:38:02.708963 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 21:38:02.708963 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 21:38:02.708963 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch May 14 21:38:02.708963 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) May 14 21:38:02.708963 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate May 14 21:38:02.708963 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) May 14 21:38:02.708963 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate May 14 21:38:02.710314 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) May 14 21:38:02.710314 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' May 14 21:38:02.710314 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:38:02.710314 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: May 14 21:38:02.710314 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} May 14 21:38:02.710314 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:38:02.710314 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application On instance['enabled']: May 14 21:38:02.710314 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application 'True' May 14 21:38:02.710314 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:38:02.710314 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3410/6855] 10.222.0.52 () {60 vars in 1254 bytes} [Sat May 14 21:38:02 2022] PATCH /identity/v3/endpoints/e449dda92e3c4e6da3bfc52274a30d4c => generated 281 bytes in 129 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) May 14 21:38:02.712942 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f070feb-6f07-416d-8f4a-ed3bf0112821 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:02.736839 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f070feb-6f07-416d-8f4a-ed3bf0112821 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:02.746672 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70393e75-3788-4808-8d91-a38e2d9c4d89 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e966792c4264221965197e75cc50687', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b89816b5754475d9f14664defe9eebc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:02.748064 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70393e75-3788-4808-8d91-a38e2d9c4d89 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:02.748607 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70393e75-3788-4808-8d91-a38e2d9c4d89 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:02.749803 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70393e75-3788-4808-8d91-a38e2d9c4d89 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] PATH_INFO: `/v3/endpoints/e449dda92e3c4e6da3bfc52274a30d4c` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:02.752782 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70393e75-3788-4808-8d91-a38e2d9c4d89 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=e449dda92e3c4e6da3bfc52274a30d4c)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:02.760635 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70393e75-3788-4808-8d91-a38e2d9c4d89 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:02.892226 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-70393e75-3788-4808-8d91-a38e2d9c4d89 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'e449dda92e3c4e6da3bfc52274a30d4c', 'request_id': 'req-70393e75-3788-4808-8d91-a38e2d9c4d89'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:02.918699 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3446/6856] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:38:02 2022] DELETE /identity/v3/endpoints/e449dda92e3c4e6da3bfc52274a30d4c => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:38:02.923164 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae517c9-bd2e-4fac-8eef-91e188b7ee84 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:02.942889 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae517c9-bd2e-4fac-8eef-91e188b7ee84 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:02.987491 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c1eee6-e234-4b2b-85bc-1352ac787b19 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e966792c4264221965197e75cc50687', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b89816b5754475d9f14664defe9eebc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:02.987491 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c1eee6-e234-4b2b-85bc-1352ac787b19 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:02.987491 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c1eee6-e234-4b2b-85bc-1352ac787b19 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:02.987868 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c1eee6-e234-4b2b-85bc-1352ac787b19 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] PATH_INFO: `/v3/regions/tempest-region-158736238` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:02.988059 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c1eee6-e234-4b2b-85bc-1352ac787b19 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-158736238)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:02.989999 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c1eee6-e234-4b2b-85bc-1352ac787b19 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:03.221291 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3411/6857] 10.222.0.52 () {58 vars in 1205 bytes} [Sat May 14 21:38:02 2022] DELETE /identity/v3/regions/tempest-region-158736238 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:38:03.227986 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70393e75-3788-4808-8d91-a38e2d9c4d89 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:03.251935 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70393e75-3788-4808-8d91-a38e2d9c4d89 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:03.307452 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a962cf-2a4a-4f12-a6ef-453e9616ea87 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e966792c4264221965197e75cc50687', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b89816b5754475d9f14664defe9eebc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:03.308526 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a962cf-2a4a-4f12-a6ef-453e9616ea87 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:03.308829 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a962cf-2a4a-4f12-a6ef-453e9616ea87 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:03.309113 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a962cf-2a4a-4f12-a6ef-453e9616ea87 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] PATH_INFO: `/v3/services/4cd8d917901848bfbb9150a86dc7a1e1` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:03.309941 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a962cf-2a4a-4f12-a6ef-453e9616ea87 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] RBAC: Authorizing `identity:delete_service(service_id=4cd8d917901848bfbb9150a86dc7a1e1)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:03.311624 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a962cf-2a4a-4f12-a6ef-453e9616ea87 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:03.428930 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3447/6858] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:38:03 2022] DELETE /identity/v3/services/4cd8d917901848bfbb9150a86dc7a1e1 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:38:03.438638 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c1eee6-e234-4b2b-85bc-1352ac787b19 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:03.645641 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c1eee6-e234-4b2b-85bc-1352ac787b19 tempest-EndpointsNegativeTestJSON-472916515 tempest-EndpointsNegativeTestJSON-472916515-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:03.692908 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5886b8-93df-4d75-b9d3-e69818516225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:03.696334 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5886b8-93df-4d75-b9d3-e69818516225 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:03.696630 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5886b8-93df-4d75-b9d3-e69818516225 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:03.697156 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5886b8-93df-4d75-b9d3-e69818516225 admin admin] PATH_INFO: `/v3/users/304d24ce7ce848b99070f3331e6834d4` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:03.700062 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5886b8-93df-4d75-b9d3-e69818516225 admin admin] RBAC: Authorizing `identity:delete_user(user_id=304d24ce7ce848b99070f3331e6834d4)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:03.704414 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5886b8-93df-4d75-b9d3-e69818516225 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:03.984354 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-bb5886b8-93df-4d75-b9d3-e69818516225 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '304d24ce7ce848b99070f3331e6834d4'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:03.995326 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-bb5886b8-93df-4d75-b9d3-e69818516225 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '304d24ce7ce848b99070f3331e6834d4'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:03.996695 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-bb5886b8-93df-4d75-b9d3-e69818516225 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '304d24ce7ce848b99070f3331e6834d4'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:04.155198 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-bb5886b8-93df-4d75-b9d3-e69818516225 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '304d24ce7ce848b99070f3331e6834d4'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:04.219146 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-bb5886b8-93df-4d75-b9d3-e69818516225 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '304d24ce7ce848b99070f3331e6834d4'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:04.230491 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3412/6859] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:38:03 2022] DELETE /identity/v3/users/304d24ce7ce848b99070f3331e6834d4 => generated 0 bytes in 792 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:38:04.240696 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c310fa-72d0-48a5-9c35-425fed5ee1fa None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:04.240696 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c310fa-72d0-48a5-9c35-425fed5ee1fa None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:04.240696 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c310fa-72d0-48a5-9c35-425fed5ee1fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:04.284006 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-98c310fa-72d0-48a5-9c35-425fed5ee1fa None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:38:04.285453 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-98c310fa-72d0-48a5-9c35-425fed5ee1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:04.441544 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3448/6860] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:38:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:38:04.459047 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5886b8-93df-4d75-b9d3-e69818516225 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:04.460714 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-bb5886b8-93df-4d75-b9d3-e69818516225 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:04.609105 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5886b8-93df-4d75-b9d3-e69818516225 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:04.616097 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c97375-ff1b-47f9-983a-30b8f079a14f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:04.616782 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c97375-ff1b-47f9-983a-30b8f079a14f service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:04.617071 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c97375-ff1b-47f9-983a-30b8f079a14f service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:04.617355 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c97375-ff1b-47f9-983a-30b8f079a14f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:04.628555 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c97375-ff1b-47f9-983a-30b8f079a14f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:04.630176 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c97375-ff1b-47f9-983a-30b8f079a14f service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:04.642806 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3413/6861] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:38:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:38:05.677416 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c310fa-72d0-48a5-9c35-425fed5ee1fa None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:05.679053 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-98c310fa-72d0-48a5-9c35-425fed5ee1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:05.697743 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c310fa-72d0-48a5-9c35-425fed5ee1fa None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:05.703747 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32cdf57-f940-46a7-8d52-48797f019827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:05.705172 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32cdf57-f940-46a7-8d52-48797f019827 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:05.705641 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32cdf57-f940-46a7-8d52-48797f019827 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:05.706187 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32cdf57-f940-46a7-8d52-48797f019827 admin admin] PATH_INFO: `/v3/projects/0f05daa890ae4bdda3dcc344d0d842fe` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:05.707738 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32cdf57-f940-46a7-8d52-48797f019827 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f05daa890ae4bdda3dcc344d0d842fe)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:05.710673 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32cdf57-f940-46a7-8d52-48797f019827 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:05.880575 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e32cdf57-f940-46a7-8d52-48797f019827 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f05daa890ae4bdda3dcc344d0d842fe', 'request_id': 'req-e32cdf57-f940-46a7-8d52-48797f019827'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:05.891099 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e32cdf57-f940-46a7-8d52-48797f019827 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f05daa890ae4bdda3dcc344d0d842fe', 'request_id': 'req-e32cdf57-f940-46a7-8d52-48797f019827'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:05.978406 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e32cdf57-f940-46a7-8d52-48797f019827 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f05daa890ae4bdda3dcc344d0d842fe', 'request_id': 'req-e32cdf57-f940-46a7-8d52-48797f019827'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:05.998868 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e32cdf57-f940-46a7-8d52-48797f019827 admin admin] The token cache is being invalidate because project 0f05daa890ae4bdda3dcc344d0d842fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:38:06.000061 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e32cdf57-f940-46a7-8d52-48797f019827 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:06.002095 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e32cdf57-f940-46a7-8d52-48797f019827 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:06.010509 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3449/6862] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:38:05 2022] DELETE /identity/v3/projects/0f05daa890ae4bdda3dcc344d0d842fe => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:38:06.011959 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c97375-ff1b-47f9-983a-30b8f079a14f service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:06.026132 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c97375-ff1b-47f9-983a-30b8f079a14f service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:06.176800 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9c1390-c7f3-46c5-98cd-03ab7f9b65b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:06.177985 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c1390-c7f3-46c5-98cd-03ab7f9b65b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:06.178453 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c1390-c7f3-46c5-98cd-03ab7f9b65b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:06.178905 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c1390-c7f3-46c5-98cd-03ab7f9b65b2 admin admin] PATH_INFO: `/v3/users/0e966792c4264221965197e75cc50687` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:06.189974 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9c1390-c7f3-46c5-98cd-03ab7f9b65b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e966792c4264221965197e75cc50687)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:06.192451 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9c1390-c7f3-46c5-98cd-03ab7f9b65b2 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:06.443330 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-eb9c1390-c7f3-46c5-98cd-03ab7f9b65b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e966792c4264221965197e75cc50687'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:06.457219 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-eb9c1390-c7f3-46c5-98cd-03ab7f9b65b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e966792c4264221965197e75cc50687'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:06.458884 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-eb9c1390-c7f3-46c5-98cd-03ab7f9b65b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e966792c4264221965197e75cc50687'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:06.545355 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-eb9c1390-c7f3-46c5-98cd-03ab7f9b65b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e966792c4264221965197e75cc50687'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:06.569717 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-eb9c1390-c7f3-46c5-98cd-03ab7f9b65b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e966792c4264221965197e75cc50687'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:06.579534 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3414/6863] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:38:06 2022] DELETE /identity/v3/users/0e966792c4264221965197e75cc50687 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:38:07.892816 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32cdf57-f940-46a7-8d52-48797f019827 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:07.894664 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e32cdf57-f940-46a7-8d52-48797f019827 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:07.925739 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32cdf57-f940-46a7-8d52-48797f019827 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:08.044162 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6361b85-4a3b-4afb-9e29-74d98ee9d2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:08.045321 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6361b85-4a3b-4afb-9e29-74d98ee9d2e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:08.046134 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6361b85-4a3b-4afb-9e29-74d98ee9d2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:08.046816 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6361b85-4a3b-4afb-9e29-74d98ee9d2e1 admin admin] PATH_INFO: `/v3/projects/0b89816b5754475d9f14664defe9eebc` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:08.049119 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6361b85-4a3b-4afb-9e29-74d98ee9d2e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b89816b5754475d9f14664defe9eebc)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:08.051380 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6361b85-4a3b-4afb-9e29-74d98ee9d2e1 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:08.280638 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a6361b85-4a3b-4afb-9e29-74d98ee9d2e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b89816b5754475d9f14664defe9eebc', 'request_id': 'req-a6361b85-4a3b-4afb-9e29-74d98ee9d2e1'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:08.287595 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a6361b85-4a3b-4afb-9e29-74d98ee9d2e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b89816b5754475d9f14664defe9eebc', 'request_id': 'req-a6361b85-4a3b-4afb-9e29-74d98ee9d2e1'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:08.394978 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a6361b85-4a3b-4afb-9e29-74d98ee9d2e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b89816b5754475d9f14664defe9eebc', 'request_id': 'req-a6361b85-4a3b-4afb-9e29-74d98ee9d2e1'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:08.432523 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a6361b85-4a3b-4afb-9e29-74d98ee9d2e1 admin admin] The token cache is being invalidate because project 0b89816b5754475d9f14664defe9eebc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:38:08.432900 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a6361b85-4a3b-4afb-9e29-74d98ee9d2e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:08.433803 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a6361b85-4a3b-4afb-9e29-74d98ee9d2e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:08.439551 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3450/6864] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:38:07 2022] DELETE /identity/v3/projects/0b89816b5754475d9f14664defe9eebc => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:38:08.441662 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca35d3-376e-43f1-aeae-47eabce2c1da None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:08.442143 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca35d3-376e-43f1-aeae-47eabce2c1da None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:08.442251 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca35d3-376e-43f1-aeae-47eabce2c1da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:08.462937 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-69ca35d3-376e-43f1-aeae-47eabce2c1da None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:38:08.464261 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-69ca35d3-376e-43f1-aeae-47eabce2c1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:08.541234 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d643877-b58c-482d-8566-964c51de93bd None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:08.541544 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d643877-b58c-482d-8566-964c51de93bd None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:08.542035 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d643877-b58c-482d-8566-964c51de93bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:08.549017 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3415/6865] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:38:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:38:08.567048 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-3d643877-b58c-482d-8566-964c51de93bd None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:38:08.568652 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-3d643877-b58c-482d-8566-964c51de93bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:08.584055 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ca35d3-376e-43f1-aeae-47eabce2c1da None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:08.595972 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3451/6866] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:38:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:38:08.597858 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ca35d3-376e-43f1-aeae-47eabce2c1da None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:08.614164 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dd7a20-aefe-461c-8624-454aa9fa6c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:08.616359 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd7a20-aefe-461c-8624-454aa9fa6c08 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:08.616888 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd7a20-aefe-461c-8624-454aa9fa6c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:08.617541 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd7a20-aefe-461c-8624-454aa9fa6c08 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:08.618601 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dd7a20-aefe-461c-8624-454aa9fa6c08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:38:08.619166 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dd7a20-aefe-461c-8624-454aa9fa6c08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:08.621617 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dd7a20-aefe-461c-8624-454aa9fa6c08 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:08.641315 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d643877-b58c-482d-8566-964c51de93bd None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:08.651962 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3416/6867] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:38:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:38:08.653353 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d643877-b58c-482d-8566-964c51de93bd None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:08.672711 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8c5f9c-5fb9-4c74-a1a3-555e52d52165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:08.672711 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8c5f9c-5fb9-4c74-a1a3-555e52d52165 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:08.672711 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8c5f9c-5fb9-4c74-a1a3-555e52d52165 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:08.672711 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8c5f9c-5fb9-4c74-a1a3-555e52d52165 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:08.673112 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8c5f9c-5fb9-4c74-a1a3-555e52d52165 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:08.677923 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8c5f9c-5fb9-4c74-a1a3-555e52d52165 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:08.820534 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dd7a20-aefe-461c-8624-454aa9fa6c08 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:08.823097 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-42dd7a20-aefe-461c-8624-454aa9fa6c08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:08.837811 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dd7a20-aefe-461c-8624-454aa9fa6c08 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:08.844250 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdf256a-5172-4f22-9042-c0b854222676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:08.845492 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf256a-5172-4f22-9042-c0b854222676 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:08.845996 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf256a-5172-4f22-9042-c0b854222676 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:08.846525 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf256a-5172-4f22-9042-c0b854222676 admin admin] PATH_INFO: `/v3/users/3163775667fa459991d34624701d7a01` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:08.850212 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdf256a-5172-4f22-9042-c0b854222676 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3163775667fa459991d34624701d7a01)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:08.852611 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdf256a-5172-4f22-9042-c0b854222676 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:08.870740 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3452/6868] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:38:08 2022] POST /identity/v3/projects => generated 365 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:38:08.875628 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8c5f9c-5fb9-4c74-a1a3-555e52d52165 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:08.955831 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8c5f9c-5fb9-4c74-a1a3-555e52d52165 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:08.961080 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245e603f-3e17-4da1-9319-76bf22f30f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:08.961827 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e603f-3e17-4da1-9319-76bf22f30f87 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:08.963616 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e603f-3e17-4da1-9319-76bf22f30f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:08.963616 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e603f-3e17-4da1-9319-76bf22f30f87 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:08.963616 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245e603f-3e17-4da1-9319-76bf22f30f87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:08.965730 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245e603f-3e17-4da1-9319-76bf22f30f87 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:09.135586 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3453/6869] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:38:08 2022] POST /identity/v3/users => generated 283 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:38:09.136900 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245e603f-3e17-4da1-9319-76bf22f30f87 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:09.163712 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245e603f-3e17-4da1-9319-76bf22f30f87 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:09.170236 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07cf007-7f99-417b-bb2d-fe54d7c8db20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:09.171878 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07cf007-7f99-417b-bb2d-fe54d7c8db20 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:09.172902 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07cf007-7f99-417b-bb2d-fe54d7c8db20 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:09.173406 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07cf007-7f99-417b-bb2d-fe54d7c8db20 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:09.174395 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07cf007-7f99-417b-bb2d-fe54d7c8db20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:09.176276 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07cf007-7f99-417b-bb2d-fe54d7c8db20 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:09.179886 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-bfdf256a-5172-4f22-9042-c0b854222676 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3163775667fa459991d34624701d7a01'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:09.189071 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3454/6870] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:38:09 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:38:09.191672 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-bfdf256a-5172-4f22-9042-c0b854222676 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3163775667fa459991d34624701d7a01'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:09.193258 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-bfdf256a-5172-4f22-9042-c0b854222676 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3163775667fa459991d34624701d7a01'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:09.193531 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07cf007-7f99-417b-bb2d-fe54d7c8db20 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:09.220874 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07cf007-7f99-417b-bb2d-fe54d7c8db20 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:09.225763 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4d29a1-94d1-4f2a-9a9a-1978064fe8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:09.227144 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d29a1-94d1-4f2a-9a9a-1978064fe8c8 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:09.227743 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d29a1-94d1-4f2a-9a9a-1978064fe8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:09.228597 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d29a1-94d1-4f2a-9a9a-1978064fe8c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:09.230342 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4d29a1-94d1-4f2a-9a9a-1978064fe8c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:09.232796 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4d29a1-94d1-4f2a-9a9a-1978064fe8c8 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:09.252395 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3455/6871] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:38:09 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:38:09.256399 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4d29a1-94d1-4f2a-9a9a-1978064fe8c8 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:09.270270 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4d29a1-94d1-4f2a-9a9a-1978064fe8c8 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:09.276667 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b0c793-1946-4027-989f-63ff7ed73c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:09.277914 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b0c793-1946-4027-989f-63ff7ed73c19 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:09.278474 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b0c793-1946-4027-989f-63ff7ed73c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:09.279067 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b0c793-1946-4027-989f-63ff7ed73c19 admin admin] PATH_INFO: `/v3/projects/790d853ac2414670bf070cb10b80e675/users/b45f627afcd74c31835ac5cea8db1624/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:09.300931 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b0c793-1946-4027-989f-63ff7ed73c19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=790d853ac2414670bf070cb10b80e675, user_id=b45f627afcd74c31835ac5cea8db1624, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:09.305802 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b0c793-1946-4027-989f-63ff7ed73c19 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:09.317208 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-bfdf256a-5172-4f22-9042-c0b854222676 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3163775667fa459991d34624701d7a01'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:09.334597 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-bfdf256a-5172-4f22-9042-c0b854222676 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3163775667fa459991d34624701d7a01'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:09.344924 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3417/6872] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:38:08 2022] DELETE /identity/v3/users/3163775667fa459991d34624701d7a01 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:38:09.350573 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0afbbab-a175-4cf7-8268-0a4ee42c5885 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:09.354161 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0afbbab-a175-4cf7-8268-0a4ee42c5885 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:09.354161 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0afbbab-a175-4cf7-8268-0a4ee42c5885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:09.382802 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3456/6873] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:38:09 2022] PUT /identity/v3/projects/790d853ac2414670bf070cb10b80e675/users/b45f627afcd74c31835ac5cea8db1624/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:38:09.396902 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-b0afbbab-a175-4cf7-8268-0a4ee42c5885 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:38:09.398510 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f6861-fcd4-45a9-9ebd-f92b9f2ef854 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:09.400729 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b0afbbab-a175-4cf7-8268-0a4ee42c5885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:09.400881 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f6861-fcd4-45a9-9ebd-f92b9f2ef854 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:09.400881 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f6861-fcd4-45a9-9ebd-f92b9f2ef854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:09.471586 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-b26f6861-fcd4-45a9-9ebd-f92b9f2ef854 None None] MFA Rules not processed for user `b45f627afcd74c31835ac5cea8db1624`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:38:09.472887 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b26f6861-fcd4-45a9-9ebd-f92b9f2ef854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:09.505769 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3418/6874] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:38:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:38:09.517240 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0afbbab-a175-4cf7-8268-0a4ee42c5885 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:09.518951 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b0afbbab-a175-4cf7-8268-0a4ee42c5885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:09.633312 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3457/6875] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:38:09 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:38:09.637993 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26f6861-fcd4-45a9-9ebd-f92b9f2ef854 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:09.640279 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b26f6861-fcd4-45a9-9ebd-f92b9f2ef854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:09.640404 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0afbbab-a175-4cf7-8268-0a4ee42c5885 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:09.650778 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0b2997-1cc4-4d04-b0d7-4c37d28a8105 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:09.652130 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b2997-1cc4-4d04-b0d7-4c37d28a8105 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:09.652602 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b2997-1cc4-4d04-b0d7-4c37d28a8105 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:09.653186 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b2997-1cc4-4d04-b0d7-4c37d28a8105 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:09.665718 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26f6861-fcd4-45a9-9ebd-f92b9f2ef854 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:09.677785 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34703b08-226d-4c3b-b91d-40d0b17c243e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:09.678884 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34703b08-226d-4c3b-b91d-40d0b17c243e admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:09.679175 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34703b08-226d-4c3b-b91d-40d0b17c243e admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:09.679458 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34703b08-226d-4c3b-b91d-40d0b17c243e admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:09.680247 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34703b08-226d-4c3b-b91d-40d0b17c243e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:09.682192 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34703b08-226d-4c3b-b91d-40d0b17c243e admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:09.695710 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0b2997-1cc4-4d04-b0d7-4c37d28a8105 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:09.697854 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0b2997-1cc4-4d04-b0d7-4c37d28a8105 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:09.721438 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3419/6876] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:38:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:38:09.811634 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3458/6877] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:38:09 2022] POST /identity/v3/projects => generated 365 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:38:09.812563 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0b2997-1cc4-4d04-b0d7-4c37d28a8105 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:09.823554 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0b2997-1cc4-4d04-b0d7-4c37d28a8105 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:09.924882 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0b77cd-84cb-45eb-b755-d99237f678f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:09.926641 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b77cd-84cb-45eb-b755-d99237f678f3 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:09.928235 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b77cd-84cb-45eb-b755-d99237f678f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:09.929361 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b77cd-84cb-45eb-b755-d99237f678f3 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:09.932429 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0b77cd-84cb-45eb-b755-d99237f678f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:09.940002 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0b77cd-84cb-45eb-b755-d99237f678f3 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:10.074787 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3420/6878] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:38:09 2022] POST /identity/v3/users => generated 289 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:38:10.075539 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34703b08-226d-4c3b-b91d-40d0b17c243e admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:10.090782 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34703b08-226d-4c3b-b91d-40d0b17c243e admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:10.098583 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138680c8-eac8-4c9a-ad1e-80f573b6ca6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:10.100243 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138680c8-eac8-4c9a-ad1e-80f573b6ca6c admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:10.101130 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138680c8-eac8-4c9a-ad1e-80f573b6ca6c admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:10.101706 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138680c8-eac8-4c9a-ad1e-80f573b6ca6c admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:10.102864 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138680c8-eac8-4c9a-ad1e-80f573b6ca6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:10.106810 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138680c8-eac8-4c9a-ad1e-80f573b6ca6c admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:10.124258 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3459/6879] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:38:10.129134 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0b77cd-84cb-45eb-b755-d99237f678f3 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:10.152923 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0b77cd-84cb-45eb-b755-d99237f678f3 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:10.161447 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bccbb3c-2381-43ca-886f-210938474c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:10.162926 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bccbb3c-2381-43ca-886f-210938474c49 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:10.163403 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bccbb3c-2381-43ca-886f-210938474c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:10.164385 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bccbb3c-2381-43ca-886f-210938474c49 admin admin] PATH_INFO: `/v3/projects/985c6143b49e45d991e0bba09fd0dd99/users/f728f9fa43804a4d859ae1b631a7e4f5/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:10.191564 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bccbb3c-2381-43ca-886f-210938474c49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=985c6143b49e45d991e0bba09fd0dd99, user_id=f728f9fa43804a4d859ae1b631a7e4f5, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:10.195604 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bccbb3c-2381-43ca-886f-210938474c49 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:10.315398 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3421/6880] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:38:10 2022] PUT /identity/v3/projects/985c6143b49e45d991e0bba09fd0dd99/users/f728f9fa43804a4d859ae1b631a7e4f5/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:38:10.318521 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138680c8-eac8-4c9a-ad1e-80f573b6ca6c admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:10.328957 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138680c8-eac8-4c9a-ad1e-80f573b6ca6c admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:10.413576 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c2ec7-e1bf-477a-9c90-eebdd2ca2e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:10.414319 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c2ec7-e1bf-477a-9c90-eebdd2ca2e45 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:10.414709 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c2ec7-e1bf-477a-9c90-eebdd2ca2e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:10.414996 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c2ec7-e1bf-477a-9c90-eebdd2ca2e45 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:10.423438 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89c2ec7-e1bf-477a-9c90-eebdd2ca2e45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:10.426735 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89c2ec7-e1bf-477a-9c90-eebdd2ca2e45 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:10.435720 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bccbb3c-2381-43ca-886f-210938474c49 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:10.439344 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-0bccbb3c-2381-43ca-886f-210938474c49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:10.448025 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3460/6881] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:38:10.457262 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c2ec7-e1bf-477a-9c90-eebdd2ca2e45 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:10.457845 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bccbb3c-2381-43ca-886f-210938474c49 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:10.464207 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f9e639-082e-4f5d-bfcd-2fbcc8e74bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:10.465726 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9e639-082e-4f5d-bfcd-2fbcc8e74bcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:10.466289 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9e639-082e-4f5d-bfcd-2fbcc8e74bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:10.466809 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9e639-082e-4f5d-bfcd-2fbcc8e74bcf admin admin] PATH_INFO: `/v3/projects/2955d2e0483e4645b492bb49013e6b30` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:10.469240 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f9e639-082e-4f5d-bfcd-2fbcc8e74bcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=2955d2e0483e4645b492bb49013e6b30)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:10.472388 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f9e639-082e-4f5d-bfcd-2fbcc8e74bcf admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:10.500480 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c2ec7-e1bf-477a-9c90-eebdd2ca2e45 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:10.520316 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be35647e-9a81-4022-96bf-7fefd4b68f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:10.521287 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be35647e-9a81-4022-96bf-7fefd4b68f2a admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:10.521573 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be35647e-9a81-4022-96bf-7fefd4b68f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:10.522444 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be35647e-9a81-4022-96bf-7fefd4b68f2a admin admin] PATH_INFO: `/v3/projects/985c6143b49e45d991e0bba09fd0dd99/users/f728f9fa43804a4d859ae1b631a7e4f5/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:10.532095 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be35647e-9a81-4022-96bf-7fefd4b68f2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=985c6143b49e45d991e0bba09fd0dd99, user_id=f728f9fa43804a4d859ae1b631a7e4f5, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:10.559984 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be35647e-9a81-4022-96bf-7fefd4b68f2a admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:10.605093 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3461/6882] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:38:10 2022] PUT /identity/v3/projects/985c6143b49e45d991e0bba09fd0dd99/users/f728f9fa43804a4d859ae1b631a7e4f5/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:38:10.617751 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b4af66-1816-4fe7-baba-2dfe4f48279b None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:10.618042 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b4af66-1816-4fe7-baba-2dfe4f48279b None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:10.618326 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b4af66-1816-4fe7-baba-2dfe4f48279b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:10.683319 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-91b4af66-1816-4fe7-baba-2dfe4f48279b None None] MFA Rules not processed for user `f728f9fa43804a4d859ae1b631a7e4f5`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:38:10.684637 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-91b4af66-1816-4fe7-baba-2dfe4f48279b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:10.696654 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-05f9e639-082e-4f5d-bfcd-2fbcc8e74bcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2955d2e0483e4645b492bb49013e6b30', 'request_id': 'req-05f9e639-082e-4f5d-bfcd-2fbcc8e74bcf'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:10.710795 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-05f9e639-082e-4f5d-bfcd-2fbcc8e74bcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2955d2e0483e4645b492bb49013e6b30', 'request_id': 'req-05f9e639-082e-4f5d-bfcd-2fbcc8e74bcf'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:10.732505 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-05f9e639-082e-4f5d-bfcd-2fbcc8e74bcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2955d2e0483e4645b492bb49013e6b30', 'request_id': 'req-05f9e639-082e-4f5d-bfcd-2fbcc8e74bcf'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:10.849451 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-05f9e639-082e-4f5d-bfcd-2fbcc8e74bcf admin admin] The token cache is being invalidate because project 2955d2e0483e4645b492bb49013e6b30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:38:10.849991 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-05f9e639-082e-4f5d-bfcd-2fbcc8e74bcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:10.851171 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-05f9e639-082e-4f5d-bfcd-2fbcc8e74bcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:10.853162 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3422/6883] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:38:10 2022] DELETE /identity/v3/projects/2955d2e0483e4645b492bb49013e6b30 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:38:10.858854 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343fd3c-b8ee-4caf-bba7-379cb771ce62 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:10.859463 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343fd3c-b8ee-4caf-bba7-379cb771ce62 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:10.866229 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343fd3c-b8ee-4caf-bba7-379cb771ce62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:10.925674 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3462/6884] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:38:10 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:38:10.928084 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b4af66-1816-4fe7-baba-2dfe4f48279b None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:10.940915 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b4af66-1816-4fe7-baba-2dfe4f48279b None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:10.946657 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bfd5cb-4b49-42f5-9bea-95c49e696da1 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f9fa43804a4d859ae1b631a7e4f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '985c6143b49e45d991e0bba09fd0dd99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:10.947524 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bfd5cb-4b49-42f5-9bea-95c49e696da1 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:10.947922 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bfd5cb-4b49-42f5-9bea-95c49e696da1 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:10.948275 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bfd5cb-4b49-42f5-9bea-95c49e696da1 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:10.949656 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bfd5cb-4b49-42f5-9bea-95c49e696da1 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:10.952910 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bfd5cb-4b49-42f5-9bea-95c49e696da1 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:10.954279 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-2343fd3c-b8ee-4caf-bba7-379cb771ce62 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:38:10.965599 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-2343fd3c-b8ee-4caf-bba7-379cb771ce62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:11.085303 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3463/6885] 10.222.0.52 () {60 vars in 1148 bytes} [Sat May 14 21:38:10 2022] POST /identity/v3/domains => generated 275 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:38:11.089889 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bfd5cb-4b49-42f5-9bea-95c49e696da1 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:11.207716 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3423/6886] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:38:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:38:11.216167 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7f541-2673-43c5-9526-28f4758d3316 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:11.216456 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7f541-2673-43c5-9526-28f4758d3316 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:11.217073 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7f541-2673-43c5-9526-28f4758d3316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:11.297547 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-e2b7f541-2673-43c5-9526-28f4758d3316 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:38:11.299161 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e2b7f541-2673-43c5-9526-28f4758d3316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:11.299441 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bfd5cb-4b49-42f5-9bea-95c49e696da1 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:11.310818 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c584d8-62d7-4c1b-b31b-2617732b968f tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f9fa43804a4d859ae1b631a7e4f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '985c6143b49e45d991e0bba09fd0dd99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:11.316715 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c584d8-62d7-4c1b-b31b-2617732b968f tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:11.316715 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c584d8-62d7-4c1b-b31b-2617732b968f tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:11.316715 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c584d8-62d7-4c1b-b31b-2617732b968f tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:11.316715 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c584d8-62d7-4c1b-b31b-2617732b968f tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:11.319318 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c584d8-62d7-4c1b-b31b-2617732b968f tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:11.433767 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3424/6887] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:38:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:38:11.445573 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b7f541-2673-43c5-9526-28f4758d3316 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:11.454022 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b7f541-2673-43c5-9526-28f4758d3316 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:11.461531 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80df0d3-1edf-4bb0-b9ab-ea699fd4f3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:11.462798 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80df0d3-1edf-4bb0-b9ab-ea699fd4f3ef admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:11.463310 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80df0d3-1edf-4bb0-b9ab-ea699fd4f3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:11.463812 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80df0d3-1edf-4bb0-b9ab-ea699fd4f3ef admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:11.468326 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80df0d3-1edf-4bb0-b9ab-ea699fd4f3ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:38:11.468326 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80df0d3-1edf-4bb0-b9ab-ea699fd4f3ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:11.468326 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80df0d3-1edf-4bb0-b9ab-ea699fd4f3ef admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:11.519728 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3464/6888] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:38:11 2022] POST /identity/v3/users => generated 348 bytes in 427 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:38:11.522066 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c584d8-62d7-4c1b-b31b-2617732b968f tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:11.535625 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3425/6889] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:38:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:38:11.541215 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80df0d3-1edf-4bb0-b9ab-ea699fd4f3ef admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:11.548460 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c584d8-62d7-4c1b-b31b-2617732b968f tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:11.555620 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f666b75-3237-4af5-b5ea-dd99ec6484b7 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f9fa43804a4d859ae1b631a7e4f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '985c6143b49e45d991e0bba09fd0dd99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:11.556364 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f666b75-3237-4af5-b5ea-dd99ec6484b7 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:11.556652 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f666b75-3237-4af5-b5ea-dd99ec6484b7 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:11.556977 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f666b75-3237-4af5-b5ea-dd99ec6484b7 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:11.557674 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f666b75-3237-4af5-b5ea-dd99ec6484b7 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:11.559736 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f666b75-3237-4af5-b5ea-dd99ec6484b7 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:11.563231 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80df0d3-1edf-4bb0-b9ab-ea699fd4f3ef admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:11.578255 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71cf8f9-1128-42e7-865a-9c9d4c473c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:11.579789 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71cf8f9-1128-42e7-865a-9c9d4c473c10 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:11.580849 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71cf8f9-1128-42e7-865a-9c9d4c473c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:11.581217 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71cf8f9-1128-42e7-865a-9c9d4c473c10 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:11.582004 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71cf8f9-1128-42e7-865a-9c9d4c473c10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:11.584587 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71cf8f9-1128-42e7-865a-9c9d4c473c10 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:11.700677 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3426/6890] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:38:11 2022] POST /identity/v3/projects => generated 361 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:38:11.706414 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71cf8f9-1128-42e7-865a-9c9d4c473c10 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:11.789851 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3465/6891] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:38:11 2022] POST /identity/v3/users => generated 324 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:38:11.800396 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f666b75-3237-4af5-b5ea-dd99ec6484b7 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:11.827512 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f666b75-3237-4af5-b5ea-dd99ec6484b7 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:12.025570 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b25f447-db4e-461f-aff1-c102fa637d59 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f9fa43804a4d859ae1b631a7e4f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '985c6143b49e45d991e0bba09fd0dd99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:12.026762 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25f447-db4e-461f-aff1-c102fa637d59 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:12.027157 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25f447-db4e-461f-aff1-c102fa637d59 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:12.027552 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25f447-db4e-461f-aff1-c102fa637d59 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] PATH_INFO: `/v3/users/4443c5d9fd6246ea846732f4fd28786d` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:12.058108 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71cf8f9-1128-42e7-865a-9c9d4c473c10 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:12.065280 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b25f447-db4e-461f-aff1-c102fa637d59 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] RBAC: Authorizing `identity:get_user(user_id=4443c5d9fd6246ea846732f4fd28786d)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:12.073678 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b25f447-db4e-461f-aff1-c102fa637d59 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:12.088586 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3466/6892] 10.222.0.52 () {58 vars in 1220 bytes} [Sat May 14 21:38:11 2022] GET /identity/v3/users/4443c5d9fd6246ea846732f4fd28786d => generated 348 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:38:12.089569 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739f4cd3-005f-4dd7-9299-4cd55dd13405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:12.090401 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f4cd3-005f-4dd7-9299-4cd55dd13405 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:12.091121 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b25f447-db4e-461f-aff1-c102fa637d59 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:12.092900 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f4cd3-005f-4dd7-9299-4cd55dd13405 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:12.093379 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f4cd3-005f-4dd7-9299-4cd55dd13405 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:12.096608 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739f4cd3-005f-4dd7-9299-4cd55dd13405 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:12.101344 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739f4cd3-005f-4dd7-9299-4cd55dd13405 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:12.134482 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b25f447-db4e-461f-aff1-c102fa637d59 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:12.153834 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d328066-be50-44b9-80e7-36f24d751db2 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f9fa43804a4d859ae1b631a7e4f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '985c6143b49e45d991e0bba09fd0dd99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:12.154901 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d328066-be50-44b9-80e7-36f24d751db2 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:12.157650 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d328066-be50-44b9-80e7-36f24d751db2 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:12.158030 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d328066-be50-44b9-80e7-36f24d751db2 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:12.158971 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d328066-be50-44b9-80e7-36f24d751db2 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] RBAC: Adding query filter params (domain_id=6ea38127165b49e3b0c41a0d5c275c6d) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:38:12.160084 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d328066-be50-44b9-80e7-36f24d751db2 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:12.165765 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d328066-be50-44b9-80e7-36f24d751db2 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:12.202825 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3467/6893] 10.222.0.52 () {58 vars in 1206 bytes} [Sat May 14 21:38:12 2022] GET /identity/v3/users?domain_id=6ea38127165b49e3b0c41a0d5c275c6d => generated 485 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:38:12.202825 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d328066-be50-44b9-80e7-36f24d751db2 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:12.232316 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d328066-be50-44b9-80e7-36f24d751db2 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:12.255196 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a568070-f203-49e0-b6d9-3b80171054d5 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f9fa43804a4d859ae1b631a7e4f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '985c6143b49e45d991e0bba09fd0dd99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:12.257310 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a568070-f203-49e0-b6d9-3b80171054d5 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:12.257786 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a568070-f203-49e0-b6d9-3b80171054d5 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:12.258258 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a568070-f203-49e0-b6d9-3b80171054d5 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:12.259242 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a568070-f203-49e0-b6d9-3b80171054d5 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:12.276190 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3427/6894] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:38:11 2022] POST /identity/v3/users => generated 281 bytes in 571 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:38:12.278216 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739f4cd3-005f-4dd7-9299-4cd55dd13405 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:12.284721 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a568070-f203-49e0-b6d9-3b80171054d5 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:12.293978 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739f4cd3-005f-4dd7-9299-4cd55dd13405 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:12.310953 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7014a6ef-457a-4d85-8b84-d7ca03734d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:12.310953 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7014a6ef-457a-4d85-8b84-d7ca03734d8e admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:12.310953 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7014a6ef-457a-4d85-8b84-d7ca03734d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:12.310953 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7014a6ef-457a-4d85-8b84-d7ca03734d8e admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:12.313402 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7014a6ef-457a-4d85-8b84-d7ca03734d8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:12.315228 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7014a6ef-457a-4d85-8b84-d7ca03734d8e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:12.341960 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3428/6895] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:38:12 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:38:12.343395 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7014a6ef-457a-4d85-8b84-d7ca03734d8e admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:12.358005 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7014a6ef-457a-4d85-8b84-d7ca03734d8e admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:12.365137 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f749e4-c4dc-4d38-b662-5fb26ce615e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:12.365964 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f749e4-c4dc-4d38-b662-5fb26ce615e9 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:12.366257 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f749e4-c4dc-4d38-b662-5fb26ce615e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:12.366532 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f749e4-c4dc-4d38-b662-5fb26ce615e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:12.367258 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f749e4-c4dc-4d38-b662-5fb26ce615e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:12.372274 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f749e4-c4dc-4d38-b662-5fb26ce615e9 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:12.388614 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3429/6896] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:38:12 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:38:12.394727 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f749e4-c4dc-4d38-b662-5fb26ce615e9 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:12.400739 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3468/6897] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:38:12 2022] GET /identity/v3/users => generated 7983 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:38:12.406357 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a568070-f203-49e0-b6d9-3b80171054d5 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:12.421644 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f749e4-c4dc-4d38-b662-5fb26ce615e9 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:12.435249 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72dc2e2-e5ac-47d8-9f29-4079f863911f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:12.436209 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72dc2e2-e5ac-47d8-9f29-4079f863911f admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:12.437156 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72dc2e2-e5ac-47d8-9f29-4079f863911f admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:12.437859 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72dc2e2-e5ac-47d8-9f29-4079f863911f admin admin] PATH_INFO: `/v3/projects/1c8d3753c9034eceb725613ccda18e12/users/4319690d69584655bded3ff4dc0eb050/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:12.457006 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a568070-f203-49e0-b6d9-3b80171054d5 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:12.469609 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72dc2e2-e5ac-47d8-9f29-4079f863911f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c8d3753c9034eceb725613ccda18e12, user_id=4319690d69584655bded3ff4dc0eb050, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:12.473600 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72dc2e2-e5ac-47d8-9f29-4079f863911f admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:12.480440 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc220d71-67f0-4a7f-a385-7b8c1ae83d31 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f9fa43804a4d859ae1b631a7e4f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '985c6143b49e45d991e0bba09fd0dd99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:12.490051 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc220d71-67f0-4a7f-a385-7b8c1ae83d31 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:12.493230 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc220d71-67f0-4a7f-a385-7b8c1ae83d31 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:12.493588 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc220d71-67f0-4a7f-a385-7b8c1ae83d31 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:12.499612 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc220d71-67f0-4a7f-a385-7b8c1ae83d31 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] RBAC: Adding query filter params (name=tempest-test_user-1768414257) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:38:12.504585 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc220d71-67f0-4a7f-a385-7b8c1ae83d31 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:12.510265 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc220d71-67f0-4a7f-a385-7b8c1ae83d31 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:12.600333 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3430/6898] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:38:12 2022] PUT /identity/v3/projects/1c8d3753c9034eceb725613ccda18e12/users/4319690d69584655bded3ff4dc0eb050/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:38:12.602980 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc77d3c-a1fd-41ef-9f69-953862322ad0 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:12.603291 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc77d3c-a1fd-41ef-9f69-953862322ad0 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:12.605712 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc77d3c-a1fd-41ef-9f69-953862322ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:12.617355 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3469/6899] 10.222.0.52 () {58 vars in 1188 bytes} [Sat May 14 21:38:12 2022] GET /identity/v3/users?name=tempest-test_user-1768414257 => generated 476 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:38:12.618362 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc220d71-67f0-4a7f-a385-7b8c1ae83d31 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:12.645981 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc220d71-67f0-4a7f-a385-7b8c1ae83d31 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:12.681167 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-3bc77d3c-a1fd-41ef-9f69-953862322ad0 None None] MFA Rules not processed for user `4319690d69584655bded3ff4dc0eb050`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:38:12.682670 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-3bc77d3c-a1fd-41ef-9f69-953862322ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:12.815529 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea73b70-7851-45ba-85e6-ce433181a92c tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f9fa43804a4d859ae1b631a7e4f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '985c6143b49e45d991e0bba09fd0dd99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:12.817956 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea73b70-7851-45ba-85e6-ce433181a92c tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:12.818489 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea73b70-7851-45ba-85e6-ce433181a92c tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:12.819003 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea73b70-7851-45ba-85e6-ce433181a92c tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:12.820830 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea73b70-7851-45ba-85e6-ce433181a92c tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:38:12.821929 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea73b70-7851-45ba-85e6-ce433181a92c tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:12.826740 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea73b70-7851-45ba-85e6-ce433181a92c tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:12.827905 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3431/6900] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:38:12 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:38:12.893202 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3470/6901] 10.222.0.52 () {58 vars in 1148 bytes} [Sat May 14 21:38:12 2022] GET /identity/v3/users?enabled=False => generated 432 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:38:12.894116 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc77d3c-a1fd-41ef-9f69-953862322ad0 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:12.895679 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea73b70-7851-45ba-85e6-ce433181a92c tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:12.895867 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-3bc77d3c-a1fd-41ef-9f69-953862322ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:12.910631 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea73b70-7851-45ba-85e6-ce433181a92c tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:12.961723 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaef1e8c-5019-433c-a440-feb6060b7f03 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f9fa43804a4d859ae1b631a7e4f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '985c6143b49e45d991e0bba09fd0dd99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:12.963378 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef1e8c-5019-433c-a440-feb6060b7f03 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:12.964379 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef1e8c-5019-433c-a440-feb6060b7f03 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:12.964838 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef1e8c-5019-433c-a440-feb6060b7f03 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] PATH_INFO: `/v3/users/08bce988844541019223eb1c1232b230` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:12.989204 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaef1e8c-5019-433c-a440-feb6060b7f03 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] RBAC: Authorizing `identity:delete_user(user_id=08bce988844541019223eb1c1232b230)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:13.002256 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaef1e8c-5019-433c-a440-feb6060b7f03 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:13.081456 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc77d3c-a1fd-41ef-9f69-953862322ad0 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:13.093066 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f32eb3-0ee2-4557-aa5c-55171f072fca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:13.094047 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f32eb3-0ee2-4557-aa5c-55171f072fca service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:13.094431 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f32eb3-0ee2-4557-aa5c-55171f072fca service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:13.094809 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f32eb3-0ee2-4557-aa5c-55171f072fca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:13.107715 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f32eb3-0ee2-4557-aa5c-55171f072fca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:13.109955 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f32eb3-0ee2-4557-aa5c-55171f072fca service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:13.122641 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3432/6902] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:38:12 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:38:13.176276 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-eaef1e8c-5019-433c-a440-feb6060b7f03 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08bce988844541019223eb1c1232b230'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:13.203682 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-eaef1e8c-5019-433c-a440-feb6060b7f03 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08bce988844541019223eb1c1232b230'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:13.217142 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-eaef1e8c-5019-433c-a440-feb6060b7f03 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08bce988844541019223eb1c1232b230'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:13.324966 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-eaef1e8c-5019-433c-a440-feb6060b7f03 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08bce988844541019223eb1c1232b230'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:13.324966 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-eaef1e8c-5019-433c-a440-feb6060b7f03 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08bce988844541019223eb1c1232b230'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:13.335966 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3471/6903] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:38:12 2022] DELETE /identity/v3/users/08bce988844541019223eb1c1232b230 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:38:13.337214 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f32eb3-0ee2-4557-aa5c-55171f072fca service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:13.357908 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f32eb3-0ee2-4557-aa5c-55171f072fca service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:13.468088 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5c82e7-092e-4a92-876d-b14c4a24405b tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f9fa43804a4d859ae1b631a7e4f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '985c6143b49e45d991e0bba09fd0dd99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:13.469543 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5c82e7-092e-4a92-876d-b14c4a24405b tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:13.473113 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5c82e7-092e-4a92-876d-b14c4a24405b tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:13.473113 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5c82e7-092e-4a92-876d-b14c4a24405b tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] PATH_INFO: `/v3/users/4443c5d9fd6246ea846732f4fd28786d` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:13.474142 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5c82e7-092e-4a92-876d-b14c4a24405b tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] RBAC: Authorizing `identity:delete_user(user_id=4443c5d9fd6246ea846732f4fd28786d)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:13.478183 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5c82e7-092e-4a92-876d-b14c4a24405b tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:13.612358 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ab5c82e7-092e-4a92-876d-b14c4a24405b tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4443c5d9fd6246ea846732f4fd28786d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:13.625009 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ab5c82e7-092e-4a92-876d-b14c4a24405b tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4443c5d9fd6246ea846732f4fd28786d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:13.627103 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ab5c82e7-092e-4a92-876d-b14c4a24405b tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4443c5d9fd6246ea846732f4fd28786d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:13.720180 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ab5c82e7-092e-4a92-876d-b14c4a24405b tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4443c5d9fd6246ea846732f4fd28786d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:13.738316 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ab5c82e7-092e-4a92-876d-b14c4a24405b tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4443c5d9fd6246ea846732f4fd28786d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:13.747858 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3433/6904] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:38:13 2022] DELETE /identity/v3/users/4443c5d9fd6246ea846732f4fd28786d => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:38:13.752175 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaef1e8c-5019-433c-a440-feb6060b7f03 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:13.753755 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-eaef1e8c-5019-433c-a440-feb6060b7f03 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:13.773988 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaef1e8c-5019-433c-a440-feb6060b7f03 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:13.861735 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a2d37-359f-4a36-b376-9e208a162829 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f9fa43804a4d859ae1b631a7e4f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '985c6143b49e45d991e0bba09fd0dd99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:13.862647 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a2d37-359f-4a36-b376-9e208a162829 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:13.863138 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a2d37-359f-4a36-b376-9e208a162829 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:13.863431 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a2d37-359f-4a36-b376-9e208a162829 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] PATH_INFO: `/v3/domains/6ea38127165b49e3b0c41a0d5c275c6d` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:13.865153 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38a2d37-359f-4a36-b376-9e208a162829 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=6ea38127165b49e3b0c41a0d5c275c6d)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:13.867035 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38a2d37-359f-4a36-b376-9e208a162829 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:13.894884 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f38a2d37-359f-4a36-b376-9e208a162829 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '6ea38127165b49e3b0c41a0d5c275c6d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:13.896361 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f38a2d37-359f-4a36-b376-9e208a162829 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '6ea38127165b49e3b0c41a0d5c275c6d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:14.024991 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f38a2d37-359f-4a36-b376-9e208a162829 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '6ea38127165b49e3b0c41a0d5c275c6d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:14.025630 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f38a2d37-359f-4a36-b376-9e208a162829 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '6ea38127165b49e3b0c41a0d5c275c6d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:14.036917 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5c82e7-092e-4a92-876d-b14c4a24405b tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:14.039972 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-ab5c82e7-092e-4a92-876d-b14c4a24405b tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:14.042835 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3472/6905] 10.222.0.52 () {60 vars in 1248 bytes} [Sat May 14 21:38:13 2022] PATCH /identity/v3/domains/6ea38127165b49e3b0c41a0d5c275c6d => generated 276 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:38:14.059623 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5c82e7-092e-4a92-876d-b14c4a24405b tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:14.265638 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafd8941-dc30-4f8a-a2e3-2073904679f0 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f9fa43804a4d859ae1b631a7e4f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '985c6143b49e45d991e0bba09fd0dd99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:14.274237 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd8941-dc30-4f8a-a2e3-2073904679f0 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:14.274237 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd8941-dc30-4f8a-a2e3-2073904679f0 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:14.274237 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd8941-dc30-4f8a-a2e3-2073904679f0 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] PATH_INFO: `/v3/domains/6ea38127165b49e3b0c41a0d5c275c6d` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:14.310414 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafd8941-dc30-4f8a-a2e3-2073904679f0 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=6ea38127165b49e3b0c41a0d5c275c6d)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:14.312916 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafd8941-dc30-4f8a-a2e3-2073904679f0 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:14.368065 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dafd8941-dc30-4f8a-a2e3-2073904679f0 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '6ea38127165b49e3b0c41a0d5c275c6d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:14.379460 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dafd8941-dc30-4f8a-a2e3-2073904679f0 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '6ea38127165b49e3b0c41a0d5c275c6d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:14.518910 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dafd8941-dc30-4f8a-a2e3-2073904679f0 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ea38127165b49e3b0c41a0d5c275c6d', 'request_id': 'req-dafd8941-dc30-4f8a-a2e3-2073904679f0'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:14.526643 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dafd8941-dc30-4f8a-a2e3-2073904679f0 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ea38127165b49e3b0c41a0d5c275c6d', 'request_id': 'req-dafd8941-dc30-4f8a-a2e3-2073904679f0'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:14.551121 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dafd8941-dc30-4f8a-a2e3-2073904679f0 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ea38127165b49e3b0c41a0d5c275c6d', 'request_id': 'req-dafd8941-dc30-4f8a-a2e3-2073904679f0'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:14.662783 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dafd8941-dc30-4f8a-a2e3-2073904679f0 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] The token cache is being invalidate because project 6ea38127165b49e3b0c41a0d5c275c6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:38:14.663793 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dafd8941-dc30-4f8a-a2e3-2073904679f0 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:14.666115 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dafd8941-dc30-4f8a-a2e3-2073904679f0 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:14.696416 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dafd8941-dc30-4f8a-a2e3-2073904679f0 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '6ea38127165b49e3b0c41a0d5c275c6d', 'request_id': 'req-dafd8941-dc30-4f8a-a2e3-2073904679f0'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:14.704130 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dafd8941-dc30-4f8a-a2e3-2073904679f0 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '6ea38127165b49e3b0c41a0d5c275c6d', 'request_id': 'req-dafd8941-dc30-4f8a-a2e3-2073904679f0'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:14.710007 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dafd8941-dc30-4f8a-a2e3-2073904679f0 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '6ea38127165b49e3b0c41a0d5c275c6d', 'request_id': 'req-dafd8941-dc30-4f8a-a2e3-2073904679f0'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:14.721650 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3434/6906] 10.222.0.52 () {58 vars in 1229 bytes} [Sat May 14 21:38:14 2022] DELETE /identity/v3/domains/6ea38127165b49e3b0c41a0d5c275c6d => generated 0 bytes in 685 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:38:14.725707 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a2d37-359f-4a36-b376-9e208a162829 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:14.727166 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-f38a2d37-359f-4a36-b376-9e208a162829 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:14.969735 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a2d37-359f-4a36-b376-9e208a162829 tempest-UsersV3TestJSON-175267452 tempest-UsersV3TestJSON-175267452-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:15.122370 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6b461e-fce4-421f-9543-042babb86d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:15.124788 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b461e-fce4-421f-9543-042babb86d50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:15.125466 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b461e-fce4-421f-9543-042babb86d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:15.125834 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b461e-fce4-421f-9543-042babb86d50 admin admin] PATH_INFO: `/v3/users/b45f627afcd74c31835ac5cea8db1624` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:15.128647 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6b461e-fce4-421f-9543-042babb86d50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b45f627afcd74c31835ac5cea8db1624)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:15.133149 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6b461e-fce4-421f-9543-042babb86d50 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:15.455030 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6e6b461e-fce4-421f-9543-042babb86d50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b45f627afcd74c31835ac5cea8db1624'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:15.481726 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6e6b461e-fce4-421f-9543-042babb86d50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b45f627afcd74c31835ac5cea8db1624'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:15.504210 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6e6b461e-fce4-421f-9543-042babb86d50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b45f627afcd74c31835ac5cea8db1624'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:15.580666 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6e6b461e-fce4-421f-9543-042babb86d50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b45f627afcd74c31835ac5cea8db1624'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:15.582722 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6e6b461e-fce4-421f-9543-042babb86d50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b45f627afcd74c31835ac5cea8db1624'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:15.592907 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3473/6907] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:38:14 2022] DELETE /identity/v3/users/b45f627afcd74c31835ac5cea8db1624 => generated 0 bytes in 868 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:38:15.598404 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b4732-ec92-4e3c-8560-9392e831ba4a None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:15.598984 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b4732-ec92-4e3c-8560-9392e831ba4a None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:15.598984 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b4732-ec92-4e3c-8560-9392e831ba4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:15.658604 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-ea0b4732-ec92-4e3c-8560-9392e831ba4a None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:38:15.660423 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-ea0b4732-ec92-4e3c-8560-9392e831ba4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:15.776620 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3435/6908] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:38:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:38:15.842805 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6b461e-fce4-421f-9543-042babb86d50 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:15.844494 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-6e6b461e-fce4-421f-9543-042babb86d50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:15.992898 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6b461e-fce4-421f-9543-042babb86d50 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:16.011899 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2ac475-a37c-4af3-aa0c-a77edb1db3a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:16.012593 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ac475-a37c-4af3-aa0c-a77edb1db3a6 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:16.012881 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ac475-a37c-4af3-aa0c-a77edb1db3a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:16.013166 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ac475-a37c-4af3-aa0c-a77edb1db3a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:16.024950 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2ac475-a37c-4af3-aa0c-a77edb1db3a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:16.026421 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2ac475-a37c-4af3-aa0c-a77edb1db3a6 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:16.053542 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3474/6909] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:38:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:38:17.203871 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0b4732-ec92-4e3c-8560-9392e831ba4a None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:17.203871 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-ea0b4732-ec92-4e3c-8560-9392e831ba4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:17.212245 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0b4732-ec92-4e3c-8560-9392e831ba4a None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:17.227926 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42da2e5-dcdf-4274-8aab-602f4bc9cdb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:17.228801 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42da2e5-dcdf-4274-8aab-602f4bc9cdb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:17.229366 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42da2e5-dcdf-4274-8aab-602f4bc9cdb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:17.229807 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42da2e5-dcdf-4274-8aab-602f4bc9cdb9 admin admin] PATH_INFO: `/v3/projects/790d853ac2414670bf070cb10b80e675` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:17.235636 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42da2e5-dcdf-4274-8aab-602f4bc9cdb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=790d853ac2414670bf070cb10b80e675)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:17.237850 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42da2e5-dcdf-4274-8aab-602f4bc9cdb9 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:17.401202 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d42da2e5-dcdf-4274-8aab-602f4bc9cdb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '790d853ac2414670bf070cb10b80e675', 'request_id': 'req-d42da2e5-dcdf-4274-8aab-602f4bc9cdb9'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:17.410762 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d42da2e5-dcdf-4274-8aab-602f4bc9cdb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '790d853ac2414670bf070cb10b80e675', 'request_id': 'req-d42da2e5-dcdf-4274-8aab-602f4bc9cdb9'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:17.423939 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d42da2e5-dcdf-4274-8aab-602f4bc9cdb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '790d853ac2414670bf070cb10b80e675', 'request_id': 'req-d42da2e5-dcdf-4274-8aab-602f4bc9cdb9'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:17.545321 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d42da2e5-dcdf-4274-8aab-602f4bc9cdb9 admin admin] The token cache is being invalidate because project 790d853ac2414670bf070cb10b80e675 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:38:17.547710 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d42da2e5-dcdf-4274-8aab-602f4bc9cdb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:17.548697 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d42da2e5-dcdf-4274-8aab-602f4bc9cdb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:17.554295 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3436/6910] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:38:17 2022] DELETE /identity/v3/projects/790d853ac2414670bf070cb10b80e675 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:38:17.559811 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2ac475-a37c-4af3-aa0c-a77edb1db3a6 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:17.571496 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2ac475-a37c-4af3-aa0c-a77edb1db3a6 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:17.674683 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07138528-c1ee-4054-80f9-87f419c37119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:17.675887 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07138528-c1ee-4054-80f9-87f419c37119 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:17.676380 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07138528-c1ee-4054-80f9-87f419c37119 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:17.676865 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07138528-c1ee-4054-80f9-87f419c37119 admin admin] PATH_INFO: `/v3/users/f728f9fa43804a4d859ae1b631a7e4f5` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:17.678470 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07138528-c1ee-4054-80f9-87f419c37119 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f728f9fa43804a4d859ae1b631a7e4f5)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:17.680583 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07138528-c1ee-4054-80f9-87f419c37119 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:17.947637 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-07138528-c1ee-4054-80f9-87f419c37119 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f728f9fa43804a4d859ae1b631a7e4f5'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:17.970601 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-07138528-c1ee-4054-80f9-87f419c37119 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f728f9fa43804a4d859ae1b631a7e4f5'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:17.985268 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-07138528-c1ee-4054-80f9-87f419c37119 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f728f9fa43804a4d859ae1b631a7e4f5'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:18.085194 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-07138528-c1ee-4054-80f9-87f419c37119 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f728f9fa43804a4d859ae1b631a7e4f5'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:18.086174 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-07138528-c1ee-4054-80f9-87f419c37119 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f728f9fa43804a4d859ae1b631a7e4f5'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:18.095527 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3475/6911] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:38:17 2022] DELETE /identity/v3/users/f728f9fa43804a4d859ae1b631a7e4f5 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:38:19.011336 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42da2e5-dcdf-4274-8aab-602f4bc9cdb9 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:19.013182 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-d42da2e5-dcdf-4274-8aab-602f4bc9cdb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:19.034696 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42da2e5-dcdf-4274-8aab-602f4bc9cdb9 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:19.144199 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4e4cd8-9cc2-4099-9591-dbb0c3663dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:19.146265 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e4cd8-9cc2-4099-9591-dbb0c3663dea admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:19.146555 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e4cd8-9cc2-4099-9591-dbb0c3663dea admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:19.147060 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e4cd8-9cc2-4099-9591-dbb0c3663dea admin admin] PATH_INFO: `/v3/projects/985c6143b49e45d991e0bba09fd0dd99` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:19.149439 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4e4cd8-9cc2-4099-9591-dbb0c3663dea admin admin] RBAC: Authorizing `identity:delete_project(project_id=985c6143b49e45d991e0bba09fd0dd99)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:19.152623 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4e4cd8-9cc2-4099-9591-dbb0c3663dea admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:19.414087 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9f4e4cd8-9cc2-4099-9591-dbb0c3663dea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '985c6143b49e45d991e0bba09fd0dd99', 'request_id': 'req-9f4e4cd8-9cc2-4099-9591-dbb0c3663dea'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:19.432613 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9f4e4cd8-9cc2-4099-9591-dbb0c3663dea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '985c6143b49e45d991e0bba09fd0dd99', 'request_id': 'req-9f4e4cd8-9cc2-4099-9591-dbb0c3663dea'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:19.451106 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9f4e4cd8-9cc2-4099-9591-dbb0c3663dea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '985c6143b49e45d991e0bba09fd0dd99', 'request_id': 'req-9f4e4cd8-9cc2-4099-9591-dbb0c3663dea'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:19.592477 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9f4e4cd8-9cc2-4099-9591-dbb0c3663dea admin admin] The token cache is being invalidate because project 985c6143b49e45d991e0bba09fd0dd99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:38:19.592991 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9f4e4cd8-9cc2-4099-9591-dbb0c3663dea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:19.594730 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9f4e4cd8-9cc2-4099-9591-dbb0c3663dea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:19.597519 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3437/6912] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:38:19 2022] DELETE /identity/v3/projects/985c6143b49e45d991e0bba09fd0dd99 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:38:19.602688 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd065f-66cf-40ce-b104-adb3b0c994d1 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:19.603135 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd065f-66cf-40ce-b104-adb3b0c994d1 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:19.603135 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd065f-66cf-40ce-b104-adb3b0c994d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:19.633751 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-79dd065f-66cf-40ce-b104-adb3b0c994d1 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:38:19.636555 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-79dd065f-66cf-40ce-b104-adb3b0c994d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:19.716796 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3476/6913] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:38:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:38:19.726626 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad24a5a0-fd83-4e3b-b690-549bb137b6f6 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:19.726909 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad24a5a0-fd83-4e3b-b690-549bb137b6f6 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:19.727192 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad24a5a0-fd83-4e3b-b690-549bb137b6f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:19.747446 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-ad24a5a0-fd83-4e3b-b690-549bb137b6f6 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:38:19.749241 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-ad24a5a0-fd83-4e3b-b690-549bb137b6f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:19.762679 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3438/6914] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:38:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:38:19.767236 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd065f-66cf-40ce-b104-adb3b0c994d1 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:19.788147 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd065f-66cf-40ce-b104-adb3b0c994d1 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:19.801608 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d11366-0332-45e8-9975-54c637f09455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:19.802430 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d11366-0332-45e8-9975-54c637f09455 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:19.803028 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d11366-0332-45e8-9975-54c637f09455 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:19.803555 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d11366-0332-45e8-9975-54c637f09455 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:19.804618 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d11366-0332-45e8-9975-54c637f09455 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:38:19.805183 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d11366-0332-45e8-9975-54c637f09455 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:19.807497 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d11366-0332-45e8-9975-54c637f09455 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:19.826073 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3477/6915] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:38:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:38:19.831135 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad24a5a0-fd83-4e3b-b690-549bb137b6f6 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:19.841933 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad24a5a0-fd83-4e3b-b690-549bb137b6f6 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:19.848388 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ae8f80-ef8c-4417-a996-5c0823468d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:19.848557 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ae8f80-ef8c-4417-a996-5c0823468d3d admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:19.850755 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ae8f80-ef8c-4417-a996-5c0823468d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:19.851358 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ae8f80-ef8c-4417-a996-5c0823468d3d admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:19.852370 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ae8f80-ef8c-4417-a996-5c0823468d3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:19.854587 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ae8f80-ef8c-4417-a996-5c0823468d3d admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:19.979734 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3439/6916] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:38:19 2022] POST /identity/v3/projects => generated 369 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:38:19.982270 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d11366-0332-45e8-9975-54c637f09455 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:19.994989 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d11366-0332-45e8-9975-54c637f09455 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:20.186163 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9b4462-fa2d-4ecf-9e43-35c015cb25ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:20.186962 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b4462-fa2d-4ecf-9e43-35c015cb25ec admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:20.187244 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b4462-fa2d-4ecf-9e43-35c015cb25ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:20.187545 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b4462-fa2d-4ecf-9e43-35c015cb25ec admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:20.188374 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9b4462-fa2d-4ecf-9e43-35c015cb25ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:20.202213 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9b4462-fa2d-4ecf-9e43-35c015cb25ec admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:20.362443 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3478/6917] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:38:19 2022] POST /identity/v3/users => generated 285 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:38:20.362796 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ae8f80-ef8c-4417-a996-5c0823468d3d admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:20.376902 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ae8f80-ef8c-4417-a996-5c0823468d3d admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:20.391212 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8291faa2-109a-49f3-9223-eb1106391d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:20.391977 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291faa2-109a-49f3-9223-eb1106391d2e admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:20.392251 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291faa2-109a-49f3-9223-eb1106391d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:20.392530 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291faa2-109a-49f3-9223-eb1106391d2e admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:20.393276 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8291faa2-109a-49f3-9223-eb1106391d2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:20.418381 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8291faa2-109a-49f3-9223-eb1106391d2e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:20.464138 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3440/6918] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:38:20 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:38:20.471420 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9b4462-fa2d-4ecf-9e43-35c015cb25ec admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:20.494051 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9b4462-fa2d-4ecf-9e43-35c015cb25ec admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:20.502369 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb39c5-fd74-4f34-b87e-a3ab8b382a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:20.506107 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb39c5-fd74-4f34-b87e-a3ab8b382a4f admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:20.506107 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb39c5-fd74-4f34-b87e-a3ab8b382a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:20.506107 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb39c5-fd74-4f34-b87e-a3ab8b382a4f admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:20.506107 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeb39c5-fd74-4f34-b87e-a3ab8b382a4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:20.506789 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeb39c5-fd74-4f34-b87e-a3ab8b382a4f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:20.523917 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3479/6919] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:38:20 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:38:20.524735 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8291faa2-109a-49f3-9223-eb1106391d2e admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:20.540137 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8291faa2-109a-49f3-9223-eb1106391d2e admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:20.550437 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386bdb62-5fe4-40d3-b27e-b2ee321c0efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:20.554039 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386bdb62-5fe4-40d3-b27e-b2ee321c0efb admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:20.554588 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386bdb62-5fe4-40d3-b27e-b2ee321c0efb admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:20.556429 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386bdb62-5fe4-40d3-b27e-b2ee321c0efb admin admin] PATH_INFO: `/v3/projects/a58c1f86b2014db5a0f907c201f0be44/users/b29b852d5c6e4295bd77a9d54e29884f/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:20.582735 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386bdb62-5fe4-40d3-b27e-b2ee321c0efb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a58c1f86b2014db5a0f907c201f0be44, user_id=b29b852d5c6e4295bd77a9d54e29884f, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:20.586706 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386bdb62-5fe4-40d3-b27e-b2ee321c0efb admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:20.663660 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3441/6920] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:38:20 2022] PUT /identity/v3/projects/a58c1f86b2014db5a0f907c201f0be44/users/b29b852d5c6e4295bd77a9d54e29884f/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:38:20.675630 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff447c12-0cc6-4752-bc42-6007f00a86ec None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:20.676986 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff447c12-0cc6-4752-bc42-6007f00a86ec None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:20.677564 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff447c12-0cc6-4752-bc42-6007f00a86ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:20.718969 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-ff447c12-0cc6-4752-bc42-6007f00a86ec None None] MFA Rules not processed for user `b29b852d5c6e4295bd77a9d54e29884f`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:38:20.720647 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ff447c12-0cc6-4752-bc42-6007f00a86ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:20.817162 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3480/6921] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:38:20 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:38:20.821406 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386bdb62-5fe4-40d3-b27e-b2ee321c0efb admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:20.984776 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386bdb62-5fe4-40d3-b27e-b2ee321c0efb admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:21.006272 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d325b935-bbb8-4593-b2c1-d95cc1a14cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:21.006272 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325b935-bbb8-4593-b2c1-d95cc1a14cdc admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:21.006272 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325b935-bbb8-4593-b2c1-d95cc1a14cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:21.006272 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325b935-bbb8-4593-b2c1-d95cc1a14cdc admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:21.006707 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d325b935-bbb8-4593-b2c1-d95cc1a14cdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:21.009106 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d325b935-bbb8-4593-b2c1-d95cc1a14cdc admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:21.136196 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3442/6922] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:38:20 2022] POST /identity/v3/projects => generated 367 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:38:21.141703 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff447c12-0cc6-4752-bc42-6007f00a86ec None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:21.159806 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff447c12-0cc6-4752-bc42-6007f00a86ec None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:21.261100 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef079367-70ea-44f6-9b90-0eadc422937c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:21.262109 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef079367-70ea-44f6-9b90-0eadc422937c admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:21.262629 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef079367-70ea-44f6-9b90-0eadc422937c admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:21.263127 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef079367-70ea-44f6-9b90-0eadc422937c admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:21.264787 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef079367-70ea-44f6-9b90-0eadc422937c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:21.267650 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef079367-70ea-44f6-9b90-0eadc422937c admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:21.426083 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3481/6923] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:38:21 2022] POST /identity/v3/users => generated 290 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:38:21.440697 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d325b935-bbb8-4593-b2c1-d95cc1a14cdc admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:21.468653 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d325b935-bbb8-4593-b2c1-d95cc1a14cdc admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:21.500783 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c917434-d06b-4c5d-ae5e-55261f72ee83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:21.501851 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c917434-d06b-4c5d-ae5e-55261f72ee83 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:21.503500 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c917434-d06b-4c5d-ae5e-55261f72ee83 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:21.504037 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c917434-d06b-4c5d-ae5e-55261f72ee83 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:21.505035 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c917434-d06b-4c5d-ae5e-55261f72ee83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:21.508895 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c917434-d06b-4c5d-ae5e-55261f72ee83 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:21.538165 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3443/6924] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:38:21 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:38:21.542472 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef079367-70ea-44f6-9b90-0eadc422937c admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:21.559904 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef079367-70ea-44f6-9b90-0eadc422937c admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:21.575840 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b3bfa2-2bed-4b19-b659-1016fb1140be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:21.577637 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3bfa2-2bed-4b19-b659-1016fb1140be admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:21.578270 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3bfa2-2bed-4b19-b659-1016fb1140be admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:21.578653 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3bfa2-2bed-4b19-b659-1016fb1140be admin admin] PATH_INFO: `/v3/projects/2efafd9e9c5a4b49a0a6498e393f3c83/users/ba2afc68bd144e05989a1da4a22ecbd5/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:21.604391 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b3bfa2-2bed-4b19-b659-1016fb1140be admin admin] RBAC: Authorizing `identity:create_grant(project_id=2efafd9e9c5a4b49a0a6498e393f3c83, user_id=ba2afc68bd144e05989a1da4a22ecbd5, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:21.607366 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b3bfa2-2bed-4b19-b659-1016fb1140be admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:21.749246 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3482/6925] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:38:21 2022] PUT /identity/v3/projects/2efafd9e9c5a4b49a0a6498e393f3c83/users/ba2afc68bd144e05989a1da4a22ecbd5/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:38:21.753091 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c917434-d06b-4c5d-ae5e-55261f72ee83 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:21.765407 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c917434-d06b-4c5d-ae5e-55261f72ee83 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:21.944140 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483394ad-b5c6-4463-b267-84e38f153f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:21.945002 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483394ad-b5c6-4463-b267-84e38f153f7b admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:21.945456 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483394ad-b5c6-4463-b267-84e38f153f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:21.945838 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483394ad-b5c6-4463-b267-84e38f153f7b admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:21.946650 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483394ad-b5c6-4463-b267-84e38f153f7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:21.953450 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483394ad-b5c6-4463-b267-84e38f153f7b admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:21.981313 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3444/6926] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:38:21 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:38:21.987458 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b3bfa2-2bed-4b19-b659-1016fb1140be admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:21.999626 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b3bfa2-2bed-4b19-b659-1016fb1140be admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:22.007086 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1bc78b-9f01-445a-b27e-ed7ce44f5d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:22.008768 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1bc78b-9f01-445a-b27e-ed7ce44f5d66 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:22.009285 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1bc78b-9f01-445a-b27e-ed7ce44f5d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:22.009736 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1bc78b-9f01-445a-b27e-ed7ce44f5d66 admin admin] PATH_INFO: `/v3/projects/2efafd9e9c5a4b49a0a6498e393f3c83/users/ba2afc68bd144e05989a1da4a22ecbd5/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:22.012154 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1bc78b-9f01-445a-b27e-ed7ce44f5d66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2efafd9e9c5a4b49a0a6498e393f3c83, user_id=ba2afc68bd144e05989a1da4a22ecbd5, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:22.016076 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1bc78b-9f01-445a-b27e-ed7ce44f5d66 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:22.040225 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3483/6927] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:38:21 2022] PUT /identity/v3/projects/2efafd9e9c5a4b49a0a6498e393f3c83/users/ba2afc68bd144e05989a1da4a22ecbd5/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:38:22.049344 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85163d55-7811-461e-b47c-df9fcfcec869 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:22.049857 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85163d55-7811-461e-b47c-df9fcfcec869 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:22.050220 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85163d55-7811-461e-b47c-df9fcfcec869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:22.093211 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-85163d55-7811-461e-b47c-df9fcfcec869 None None] MFA Rules not processed for user `ba2afc68bd144e05989a1da4a22ecbd5`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:38:22.094802 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-85163d55-7811-461e-b47c-df9fcfcec869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:22.277978 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3445/6928] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:38:22 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:38:22.284655 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1bc78b-9f01-445a-b27e-ed7ce44f5d66 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:22.300377 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1bc78b-9f01-445a-b27e-ed7ce44f5d66 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:22.307153 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392cb53-d6fa-444c-8f84-98a7a906a6e0 tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2afc68bd144e05989a1da4a22ecbd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efafd9e9c5a4b49a0a6498e393f3c83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:22.308854 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392cb53-d6fa-444c-8f84-98a7a906a6e0 tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:22.309337 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392cb53-d6fa-444c-8f84-98a7a906a6e0 tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:22.309841 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392cb53-d6fa-444c-8f84-98a7a906a6e0 tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] PATH_INFO: `/v3/policies` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:22.311642 ncdv-master-1 devstack@keystone.service[91106]: WARNING oslo_log.versionutils [None req-4392cb53-d6fa-444c-8f84-98a7a906a6e0 tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. May 14 21:38:22.312551 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4392cb53-d6fa-444c-8f84-98a7a906a6e0 tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:22.314521 ncdv-master-1 devstack@keystone.service[91106]: WARNING py.warnings [None req-4392cb53-d6fa-444c-8f84-98a7a906a6e0 tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:38:22.314521 ncdv-master-1 devstack@keystone.service[91106]: warnings.warn(msg) May 14 21:38:22.314521 ncdv-master-1 devstack@keystone.service[91106]: May 14 21:38:22.316913 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4392cb53-d6fa-444c-8f84-98a7a906a6e0 tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:22.418550 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3484/6929] 10.222.0.52 () {60 vars in 1151 bytes} [Sat May 14 21:38:22 2022] POST /identity/v3/policies => generated 227 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:38:22.424946 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85163d55-7811-461e-b47c-df9fcfcec869 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:22.438773 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85163d55-7811-461e-b47c-df9fcfcec869 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:22.445076 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd911c04-9c22-414b-8dfd-352fa5d9881b tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2afc68bd144e05989a1da4a22ecbd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efafd9e9c5a4b49a0a6498e393f3c83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:22.446340 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd911c04-9c22-414b-8dfd-352fa5d9881b tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:22.453107 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd911c04-9c22-414b-8dfd-352fa5d9881b tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:22.453107 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd911c04-9c22-414b-8dfd-352fa5d9881b tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] PATH_INFO: `/v3/policies/a223e1c4030a4b3ebb512a78cc1cdad0` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:22.453107 ncdv-master-1 devstack@keystone.service[91107]: WARNING oslo_log.versionutils [None req-cd911c04-9c22-414b-8dfd-352fa5d9881b tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] Deprecated: identity:update_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. May 14 21:38:22.453107 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd911c04-9c22-414b-8dfd-352fa5d9881b tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] RBAC: Authorizing `identity:update_policy(policy_id=a223e1c4030a4b3ebb512a78cc1cdad0)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:22.453644 ncdv-master-1 devstack@keystone.service[91107]: WARNING py.warnings [None req-cd911c04-9c22-414b-8dfd-352fa5d9881b tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:38:22.453644 ncdv-master-1 devstack@keystone.service[91107]: warnings.warn(msg) May 14 21:38:22.453644 ncdv-master-1 devstack@keystone.service[91107]: May 14 21:38:22.453644 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd911c04-9c22-414b-8dfd-352fa5d9881b tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:22.592201 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3446/6930] 10.222.0.52 () {60 vars in 1251 bytes} [Sat May 14 21:38:22 2022] PATCH /identity/v3/policies/a223e1c4030a4b3ebb512a78cc1cdad0 => generated 236 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:38:22.596241 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392cb53-d6fa-444c-8f84-98a7a906a6e0 tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:22.610101 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392cb53-d6fa-444c-8f84-98a7a906a6e0 tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:22.625563 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102adc14-13d3-4b00-a845-49580d560fe1 tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2afc68bd144e05989a1da4a22ecbd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efafd9e9c5a4b49a0a6498e393f3c83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:22.625563 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102adc14-13d3-4b00-a845-49580d560fe1 tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:22.625563 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102adc14-13d3-4b00-a845-49580d560fe1 tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:22.626093 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102adc14-13d3-4b00-a845-49580d560fe1 tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] PATH_INFO: `/v3/policies/a223e1c4030a4b3ebb512a78cc1cdad0` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:22.626885 ncdv-master-1 devstack@keystone.service[91106]: WARNING oslo_log.versionutils [None req-102adc14-13d3-4b00-a845-49580d560fe1 tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] Deprecated: identity:get_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. May 14 21:38:22.631670 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102adc14-13d3-4b00-a845-49580d560fe1 tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] RBAC: Authorizing `identity:get_policy(policy_id=a223e1c4030a4b3ebb512a78cc1cdad0)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:22.637171 ncdv-master-1 devstack@keystone.service[91106]: WARNING py.warnings [None req-102adc14-13d3-4b00-a845-49580d560fe1 tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_policy": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:38:22.637171 ncdv-master-1 devstack@keystone.service[91106]: warnings.warn(msg) May 14 21:38:22.637171 ncdv-master-1 devstack@keystone.service[91106]: May 14 21:38:22.638544 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102adc14-13d3-4b00-a845-49580d560fe1 tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:22.664540 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3485/6931] 10.222.0.52 () {58 vars in 1229 bytes} [Sat May 14 21:38:22 2022] GET /identity/v3/policies/a223e1c4030a4b3ebb512a78cc1cdad0 => generated 236 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:38:22.671907 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd911c04-9c22-414b-8dfd-352fa5d9881b tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:22.687922 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd911c04-9c22-414b-8dfd-352fa5d9881b tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:22.695352 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2018b2-2218-4b20-b8a1-fbc47c02193d tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2afc68bd144e05989a1da4a22ecbd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efafd9e9c5a4b49a0a6498e393f3c83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:22.697119 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2018b2-2218-4b20-b8a1-fbc47c02193d tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:22.697966 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2018b2-2218-4b20-b8a1-fbc47c02193d tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:22.698475 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2018b2-2218-4b20-b8a1-fbc47c02193d tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] PATH_INFO: `/v3/policies/a223e1c4030a4b3ebb512a78cc1cdad0` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:22.699538 ncdv-master-1 devstack@keystone.service[91107]: WARNING oslo_log.versionutils [None req-da2018b2-2218-4b20-b8a1-fbc47c02193d tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. May 14 21:38:22.700341 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2018b2-2218-4b20-b8a1-fbc47c02193d tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=a223e1c4030a4b3ebb512a78cc1cdad0)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:22.702720 ncdv-master-1 devstack@keystone.service[91107]: WARNING py.warnings [None req-da2018b2-2218-4b20-b8a1-fbc47c02193d tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:38:22.702720 ncdv-master-1 devstack@keystone.service[91107]: warnings.warn(msg) May 14 21:38:22.702720 ncdv-master-1 devstack@keystone.service[91107]: May 14 21:38:22.704453 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2018b2-2218-4b20-b8a1-fbc47c02193d tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:22.791335 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3447/6932] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:38:22 2022] DELETE /identity/v3/policies/a223e1c4030a4b3ebb512a78cc1cdad0 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:38:22.799017 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102adc14-13d3-4b00-a845-49580d560fe1 tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:22.817062 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102adc14-13d3-4b00-a845-49580d560fe1 tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:22.830918 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f2fc52-01fa-462b-9bc6-21634c8749ca tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2afc68bd144e05989a1da4a22ecbd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efafd9e9c5a4b49a0a6498e393f3c83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:22.831861 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2fc52-01fa-462b-9bc6-21634c8749ca tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:22.832713 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2fc52-01fa-462b-9bc6-21634c8749ca tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:22.834129 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2fc52-01fa-462b-9bc6-21634c8749ca tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] PATH_INFO: `/v3/policies` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:22.835520 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f2fc52-01fa-462b-9bc6-21634c8749ca tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:22.843113 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f2fc52-01fa-462b-9bc6-21634c8749ca tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:22.982571 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3486/6933] 10.222.0.52 () {60 vars in 1151 bytes} [Sat May 14 21:38:22 2022] POST /identity/v3/policies => generated 229 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:38:22.985916 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2018b2-2218-4b20-b8a1-fbc47c02193d tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:22.999546 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2018b2-2218-4b20-b8a1-fbc47c02193d tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:23.012340 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3462385-c201-4b7a-ab59-ac96088186c8 tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2afc68bd144e05989a1da4a22ecbd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efafd9e9c5a4b49a0a6498e393f3c83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:23.015741 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3462385-c201-4b7a-ab59-ac96088186c8 tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:23.015741 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3462385-c201-4b7a-ab59-ac96088186c8 tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:23.015741 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3462385-c201-4b7a-ab59-ac96088186c8 tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] PATH_INFO: `/v3/policies` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:23.016209 ncdv-master-1 devstack@keystone.service[91107]: WARNING oslo_log.versionutils [None req-a3462385-c201-4b7a-ab59-ac96088186c8 tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. May 14 21:38:23.018731 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3462385-c201-4b7a-ab59-ac96088186c8 tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:23.020742 ncdv-master-1 devstack@keystone.service[91107]: WARNING py.warnings [None req-a3462385-c201-4b7a-ab59-ac96088186c8 tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:38:23.020742 ncdv-master-1 devstack@keystone.service[91107]: warnings.warn(msg) May 14 21:38:23.020742 ncdv-master-1 devstack@keystone.service[91107]: May 14 21:38:23.022073 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3462385-c201-4b7a-ab59-ac96088186c8 tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:23.130677 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3448/6934] 10.222.0.52 () {60 vars in 1151 bytes} [Sat May 14 21:38:22 2022] POST /identity/v3/policies => generated 228 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:38:23.134830 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f2fc52-01fa-462b-9bc6-21634c8749ca tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:23.171412 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f2fc52-01fa-462b-9bc6-21634c8749ca tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:23.185760 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f650c0-44bb-4be1-a211-8377c4af648a tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2afc68bd144e05989a1da4a22ecbd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efafd9e9c5a4b49a0a6498e393f3c83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:23.187123 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f650c0-44bb-4be1-a211-8377c4af648a tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:23.188211 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f650c0-44bb-4be1-a211-8377c4af648a tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:23.188499 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f650c0-44bb-4be1-a211-8377c4af648a tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] PATH_INFO: `/v3/policies` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:23.190945 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f650c0-44bb-4be1-a211-8377c4af648a tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:23.193193 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f650c0-44bb-4be1-a211-8377c4af648a tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:23.399879 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3487/6935] 10.222.0.52 () {60 vars in 1151 bytes} [Sat May 14 21:38:23 2022] POST /identity/v3/policies => generated 230 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:38:23.406262 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3462385-c201-4b7a-ab59-ac96088186c8 tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:23.423744 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3462385-c201-4b7a-ab59-ac96088186c8 tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:23.431163 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d397a-e242-49c5-8d32-68adf5e86e05 tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2afc68bd144e05989a1da4a22ecbd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efafd9e9c5a4b49a0a6498e393f3c83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:23.433190 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d397a-e242-49c5-8d32-68adf5e86e05 tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:23.433553 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d397a-e242-49c5-8d32-68adf5e86e05 tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:23.434146 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d397a-e242-49c5-8d32-68adf5e86e05 tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] PATH_INFO: `/v3/policies` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:23.435328 ncdv-master-1 devstack@keystone.service[91107]: WARNING oslo_log.versionutils [None req-038d397a-e242-49c5-8d32-68adf5e86e05 tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] Deprecated: identity:list_policies of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. May 14 21:38:23.436214 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038d397a-e242-49c5-8d32-68adf5e86e05 tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] RBAC: Authorizing `identity:list_policies()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:23.438795 ncdv-master-1 devstack@keystone.service[91107]: WARNING py.warnings [None req-038d397a-e242-49c5-8d32-68adf5e86e05 tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_policies": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:38:23.438795 ncdv-master-1 devstack@keystone.service[91107]: warnings.warn(msg) May 14 21:38:23.438795 ncdv-master-1 devstack@keystone.service[91107]: May 14 21:38:23.439788 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038d397a-e242-49c5-8d32-68adf5e86e05 tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:23.462525 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3449/6936] 10.222.0.52 () {58 vars in 1130 bytes} [Sat May 14 21:38:23 2022] GET /identity/v3/policies => generated 763 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:38:23.464322 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f650c0-44bb-4be1-a211-8377c4af648a tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:23.478166 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f650c0-44bb-4be1-a211-8377c4af648a tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:23.483214 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe65e8bf-6649-4aa5-a9f8-238f1c8fad5e tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2afc68bd144e05989a1da4a22ecbd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efafd9e9c5a4b49a0a6498e393f3c83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:23.484227 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65e8bf-6649-4aa5-a9f8-238f1c8fad5e tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:23.484518 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65e8bf-6649-4aa5-a9f8-238f1c8fad5e tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:23.485577 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65e8bf-6649-4aa5-a9f8-238f1c8fad5e tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] PATH_INFO: `/v3/policies/ff8f65ebed5540ef901c53742595c38c` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:23.486618 ncdv-master-1 devstack@keystone.service[91106]: WARNING oslo_log.versionutils [None req-fe65e8bf-6649-4aa5-a9f8-238f1c8fad5e tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. May 14 21:38:23.487083 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe65e8bf-6649-4aa5-a9f8-238f1c8fad5e tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=ff8f65ebed5540ef901c53742595c38c)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:23.488376 ncdv-master-1 devstack@keystone.service[91106]: WARNING py.warnings [None req-fe65e8bf-6649-4aa5-a9f8-238f1c8fad5e tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:38:23.488376 ncdv-master-1 devstack@keystone.service[91106]: warnings.warn(msg) May 14 21:38:23.488376 ncdv-master-1 devstack@keystone.service[91106]: May 14 21:38:23.489298 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe65e8bf-6649-4aa5-a9f8-238f1c8fad5e tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:23.621957 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3488/6937] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:38:23 2022] DELETE /identity/v3/policies/ff8f65ebed5540ef901c53742595c38c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:38:23.623765 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d397a-e242-49c5-8d32-68adf5e86e05 tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:23.641507 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d397a-e242-49c5-8d32-68adf5e86e05 tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:23.709896 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b5182c-c457-44ec-81ce-b59595784501 tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2afc68bd144e05989a1da4a22ecbd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efafd9e9c5a4b49a0a6498e393f3c83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:23.711701 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b5182c-c457-44ec-81ce-b59595784501 tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:23.712788 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b5182c-c457-44ec-81ce-b59595784501 tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:23.713271 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b5182c-c457-44ec-81ce-b59595784501 tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] PATH_INFO: `/v3/policies/47b4d8d84e0c4a0f8d66f8f56e027781` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:23.714813 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b5182c-c457-44ec-81ce-b59595784501 tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=47b4d8d84e0c4a0f8d66f8f56e027781)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:23.718121 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b5182c-c457-44ec-81ce-b59595784501 tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:23.813706 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3450/6938] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:38:23 2022] DELETE /identity/v3/policies/47b4d8d84e0c4a0f8d66f8f56e027781 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:38:23.828194 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe65e8bf-6649-4aa5-a9f8-238f1c8fad5e tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:23.828757 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b5182c-c457-44ec-81ce-b59595784501 tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:23.831461 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-fe65e8bf-6649-4aa5-a9f8-238f1c8fad5e tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:23.853994 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b5182c-c457-44ec-81ce-b59595784501 tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:23.867016 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d236a750-5357-4de3-9e7a-f012194a10ac tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2afc68bd144e05989a1da4a22ecbd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efafd9e9c5a4b49a0a6498e393f3c83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:23.867976 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236a750-5357-4de3-9e7a-f012194a10ac tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:23.868271 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236a750-5357-4de3-9e7a-f012194a10ac tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:23.868553 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236a750-5357-4de3-9e7a-f012194a10ac tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] PATH_INFO: `/v3/policies/0c0ead8f65f74f9097a4fa6bc7186c20` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:23.869706 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d236a750-5357-4de3-9e7a-f012194a10ac tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=0c0ead8f65f74f9097a4fa6bc7186c20)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:23.871838 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d236a750-5357-4de3-9e7a-f012194a10ac tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:23.962543 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3451/6939] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:38:23 2022] DELETE /identity/v3/policies/0c0ead8f65f74f9097a4fa6bc7186c20 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:38:23.965784 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe65e8bf-6649-4aa5-a9f8-238f1c8fad5e tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:23.973826 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d236a750-5357-4de3-9e7a-f012194a10ac tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:23.978344 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255e4ec3-6d3b-40c0-8b42-99593a30cb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:23.981289 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e4ec3-6d3b-40c0-8b42-99593a30cb6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:23.981289 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e4ec3-6d3b-40c0-8b42-99593a30cb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:23.981289 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e4ec3-6d3b-40c0-8b42-99593a30cb6f admin admin] PATH_INFO: `/v3/users/0cdc336efd5b499d99a964b95acec924` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:23.985634 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255e4ec3-6d3b-40c0-8b42-99593a30cb6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cdc336efd5b499d99a964b95acec924)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:23.995920 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255e4ec3-6d3b-40c0-8b42-99593a30cb6f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:24.000685 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d236a750-5357-4de3-9e7a-f012194a10ac tempest-PoliciesTestJSON-292504042 tempest-PoliciesTestJSON-292504042-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:24.006731 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c9e66e-bc00-4615-a83c-04db4ff7a6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:24.007672 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c9e66e-bc00-4615-a83c-04db4ff7a6cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:24.007955 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c9e66e-bc00-4615-a83c-04db4ff7a6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:24.008259 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c9e66e-bc00-4615-a83c-04db4ff7a6cf admin admin] PATH_INFO: `/v3/users/b29b852d5c6e4295bd77a9d54e29884f` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:24.009497 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c9e66e-bc00-4615-a83c-04db4ff7a6cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=b29b852d5c6e4295bd77a9d54e29884f)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:24.013021 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c9e66e-bc00-4615-a83c-04db4ff7a6cf admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:24.220533 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-255e4ec3-6d3b-40c0-8b42-99593a30cb6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cdc336efd5b499d99a964b95acec924'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:24.253849 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-255e4ec3-6d3b-40c0-8b42-99593a30cb6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cdc336efd5b499d99a964b95acec924'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:24.270584 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-255e4ec3-6d3b-40c0-8b42-99593a30cb6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cdc336efd5b499d99a964b95acec924'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:24.285372 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f2c9e66e-bc00-4615-a83c-04db4ff7a6cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b29b852d5c6e4295bd77a9d54e29884f'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:24.302613 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f2c9e66e-bc00-4615-a83c-04db4ff7a6cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b29b852d5c6e4295bd77a9d54e29884f'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:24.303529 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f2c9e66e-bc00-4615-a83c-04db4ff7a6cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b29b852d5c6e4295bd77a9d54e29884f'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:24.354713 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-255e4ec3-6d3b-40c0-8b42-99593a30cb6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cdc336efd5b499d99a964b95acec924'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:24.358560 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-255e4ec3-6d3b-40c0-8b42-99593a30cb6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cdc336efd5b499d99a964b95acec924'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:24.368742 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3489/6940] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:38:23 2022] DELETE /identity/v3/users/0cdc336efd5b499d99a964b95acec924 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:38:24.373707 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc77a44-bbaa-4422-8fa8-f221abd0e4eb None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:24.374631 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc77a44-bbaa-4422-8fa8-f221abd0e4eb None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:24.375118 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc77a44-bbaa-4422-8fa8-f221abd0e4eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:24.422410 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-6dc77a44-bbaa-4422-8fa8-f221abd0e4eb None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:38:24.423709 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-6dc77a44-bbaa-4422-8fa8-f221abd0e4eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:24.457050 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f2c9e66e-bc00-4615-a83c-04db4ff7a6cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b29b852d5c6e4295bd77a9d54e29884f'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:24.477575 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f2c9e66e-bc00-4615-a83c-04db4ff7a6cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b29b852d5c6e4295bd77a9d54e29884f'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:24.500591 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3452/6941] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:38:23 2022] DELETE /identity/v3/users/b29b852d5c6e4295bd77a9d54e29884f => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:38:24.509197 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea26af4-74c3-47fe-b759-76d7b365bbb3 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:24.509816 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea26af4-74c3-47fe-b759-76d7b365bbb3 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:24.511241 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea26af4-74c3-47fe-b759-76d7b365bbb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:24.531995 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3490/6942] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:38:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:38:24.545246 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc77a44-bbaa-4422-8fa8-f221abd0e4eb None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:24.547262 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-6dc77a44-bbaa-4422-8fa8-f221abd0e4eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:24.562431 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-1ea26af4-74c3-47fe-b759-76d7b365bbb3 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:38:24.565987 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-1ea26af4-74c3-47fe-b759-76d7b365bbb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:24.679798 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3453/6943] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:38:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:38:24.689221 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc77a44-bbaa-4422-8fa8-f221abd0e4eb None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:24.705944 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea26af4-74c3-47fe-b759-76d7b365bbb3 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:24.781869 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f8ce8-79f6-4374-b7d8-4cfe69135810 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:24.782023 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f8ce8-79f6-4374-b7d8-4cfe69135810 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:24.782220 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f8ce8-79f6-4374-b7d8-4cfe69135810 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:24.782506 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f8ce8-79f6-4374-b7d8-4cfe69135810 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:24.808948 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3f8ce8-79f6-4374-b7d8-4cfe69135810 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:24.812555 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3f8ce8-79f6-4374-b7d8-4cfe69135810 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:24.816737 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea26af4-74c3-47fe-b759-76d7b365bbb3 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:24.821460 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda63f21-e6f3-499e-a9da-f1f3ca64d6f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:24.822391 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda63f21-e6f3-499e-a9da-f1f3ca64d6f3 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:24.827541 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda63f21-e6f3-499e-a9da-f1f3ca64d6f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:24.827541 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda63f21-e6f3-499e-a9da-f1f3ca64d6f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:24.836022 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda63f21-e6f3-499e-a9da-f1f3ca64d6f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:24.839097 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda63f21-e6f3-499e-a9da-f1f3ca64d6f3 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:24.840748 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3491/6944] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:38:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:38:24.854059 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3454/6945] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:38:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:38:25.698597 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f8ce8-79f6-4374-b7d8-4cfe69135810 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:25.699743 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-0e3f8ce8-79f6-4374-b7d8-4cfe69135810 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:25.721787 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f8ce8-79f6-4374-b7d8-4cfe69135810 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:25.732264 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8923a2-5092-4fc2-bbc4-8808bb58f1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:25.734404 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8923a2-5092-4fc2-bbc4-8808bb58f1ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:25.735250 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8923a2-5092-4fc2-bbc4-8808bb58f1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:25.736712 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8923a2-5092-4fc2-bbc4-8808bb58f1ec admin admin] PATH_INFO: `/v3/projects/d5e5588cb62d4ad0a93f58e84d398598` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:25.739155 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8923a2-5092-4fc2-bbc4-8808bb58f1ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5e5588cb62d4ad0a93f58e84d398598)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:25.743101 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8923a2-5092-4fc2-bbc4-8808bb58f1ec admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:25.978265 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-de8923a2-5092-4fc2-bbc4-8808bb58f1ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5e5588cb62d4ad0a93f58e84d398598', 'request_id': 'req-de8923a2-5092-4fc2-bbc4-8808bb58f1ec'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:25.987625 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-de8923a2-5092-4fc2-bbc4-8808bb58f1ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5e5588cb62d4ad0a93f58e84d398598', 'request_id': 'req-de8923a2-5092-4fc2-bbc4-8808bb58f1ec'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:26.093716 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-de8923a2-5092-4fc2-bbc4-8808bb58f1ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5e5588cb62d4ad0a93f58e84d398598', 'request_id': 'req-de8923a2-5092-4fc2-bbc4-8808bb58f1ec'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:26.130049 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-de8923a2-5092-4fc2-bbc4-8808bb58f1ec admin admin] The token cache is being invalidate because project d5e5588cb62d4ad0a93f58e84d398598 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:38:26.131991 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-de8923a2-5092-4fc2-bbc4-8808bb58f1ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:26.133690 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-de8923a2-5092-4fc2-bbc4-8808bb58f1ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:26.143835 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3492/6946] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:38:25 2022] DELETE /identity/v3/projects/d5e5588cb62d4ad0a93f58e84d398598 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:38:26.146515 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc934dcc-7555-41e9-8050-b5a15fe23b19 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:26.146983 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc934dcc-7555-41e9-8050-b5a15fe23b19 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:26.147088 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc934dcc-7555-41e9-8050-b5a15fe23b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:26.217643 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-dc934dcc-7555-41e9-8050-b5a15fe23b19 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:38:26.218913 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-dc934dcc-7555-41e9-8050-b5a15fe23b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:26.319655 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8923a2-5092-4fc2-bbc4-8808bb58f1ec admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:26.324900 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-de8923a2-5092-4fc2-bbc4-8808bb58f1ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:26.387103 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3455/6947] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:38:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:38:26.396913 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9819e0ea-1a38-41ad-8747-4fb4d27585c3 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:26.397538 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9819e0ea-1a38-41ad-8747-4fb4d27585c3 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:26.398000 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9819e0ea-1a38-41ad-8747-4fb4d27585c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:26.431540 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-9819e0ea-1a38-41ad-8747-4fb4d27585c3 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:38:26.433130 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-9819e0ea-1a38-41ad-8747-4fb4d27585c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:26.460390 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3456/6948] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:38:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:38:26.465590 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9819e0ea-1a38-41ad-8747-4fb4d27585c3 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:26.476399 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8923a2-5092-4fc2-bbc4-8808bb58f1ec admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:26.488817 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9819e0ea-1a38-41ad-8747-4fb4d27585c3 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:26.489865 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded34ecb-a985-44cb-84f5-1fc0e25f0e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:26.493239 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded34ecb-a985-44cb-84f5-1fc0e25f0e3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:26.493239 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded34ecb-a985-44cb-84f5-1fc0e25f0e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:26.493239 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded34ecb-a985-44cb-84f5-1fc0e25f0e3b admin admin] PATH_INFO: `/v3/projects/a58c1f86b2014db5a0f907c201f0be44` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:26.494132 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded34ecb-a985-44cb-84f5-1fc0e25f0e3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a58c1f86b2014db5a0f907c201f0be44)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:26.497754 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded34ecb-a985-44cb-84f5-1fc0e25f0e3b admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:26.502976 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a84da2f-8f44-4c7d-8d08-8f194c6d6472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:26.503671 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a84da2f-8f44-4c7d-8d08-8f194c6d6472 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:26.504143 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a84da2f-8f44-4c7d-8d08-8f194c6d6472 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:26.504783 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a84da2f-8f44-4c7d-8d08-8f194c6d6472 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:26.505674 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a84da2f-8f44-4c7d-8d08-8f194c6d6472 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:38:26.506357 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a84da2f-8f44-4c7d-8d08-8f194c6d6472 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:26.508227 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a84da2f-8f44-4c7d-8d08-8f194c6d6472 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:26.551838 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3457/6949] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:38:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:38:26.556594 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a84da2f-8f44-4c7d-8d08-8f194c6d6472 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:26.578056 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a84da2f-8f44-4c7d-8d08-8f194c6d6472 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:26.597071 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3562d682-e868-435b-bc37-0fc8499dd3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:26.598129 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3562d682-e868-435b-bc37-0fc8499dd3b7 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:26.598636 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3562d682-e868-435b-bc37-0fc8499dd3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:26.599132 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3562d682-e868-435b-bc37-0fc8499dd3b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:26.600059 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3562d682-e868-435b-bc37-0fc8499dd3b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:26.611801 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3562d682-e868-435b-bc37-0fc8499dd3b7 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:26.685375 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ded34ecb-a985-44cb-84f5-1fc0e25f0e3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a58c1f86b2014db5a0f907c201f0be44', 'request_id': 'req-ded34ecb-a985-44cb-84f5-1fc0e25f0e3b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:26.692764 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ded34ecb-a985-44cb-84f5-1fc0e25f0e3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a58c1f86b2014db5a0f907c201f0be44', 'request_id': 'req-ded34ecb-a985-44cb-84f5-1fc0e25f0e3b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:26.741618 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3458/6950] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:38:26 2022] POST /identity/v3/projects => generated 379 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:38:26.744419 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3562d682-e868-435b-bc37-0fc8499dd3b7 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:26.801633 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ded34ecb-a985-44cb-84f5-1fc0e25f0e3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a58c1f86b2014db5a0f907c201f0be44', 'request_id': 'req-ded34ecb-a985-44cb-84f5-1fc0e25f0e3b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:26.822820 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ded34ecb-a985-44cb-84f5-1fc0e25f0e3b admin admin] The token cache is being invalidate because project a58c1f86b2014db5a0f907c201f0be44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:38:26.828508 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ded34ecb-a985-44cb-84f5-1fc0e25f0e3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:26.828956 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ded34ecb-a985-44cb-84f5-1fc0e25f0e3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:26.838006 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3493/6951] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:38:26 2022] DELETE /identity/v3/projects/a58c1f86b2014db5a0f907c201f0be44 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:38:26.841715 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded34ecb-a985-44cb-84f5-1fc0e25f0e3b admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:26.844359 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ded34ecb-a985-44cb-84f5-1fc0e25f0e3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:26.899174 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3562d682-e868-435b-bc37-0fc8499dd3b7 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:26.912091 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c35527-45a4-4d83-8052-fe60212963b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:26.912757 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c35527-45a4-4d83-8052-fe60212963b1 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:26.913041 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c35527-45a4-4d83-8052-fe60212963b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:26.913314 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c35527-45a4-4d83-8052-fe60212963b1 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:26.915190 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c35527-45a4-4d83-8052-fe60212963b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:26.918145 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c35527-45a4-4d83-8052-fe60212963b1 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:26.966192 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded34ecb-a985-44cb-84f5-1fc0e25f0e3b admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:26.987691 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8ee48e-aec2-49fd-ac0e-716bbc662b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:26.989012 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ee48e-aec2-49fd-ac0e-716bbc662b25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:26.989296 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ee48e-aec2-49fd-ac0e-716bbc662b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:26.989965 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ee48e-aec2-49fd-ac0e-716bbc662b25 admin admin] PATH_INFO: `/v3/users/ba2afc68bd144e05989a1da4a22ecbd5` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:26.992187 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8ee48e-aec2-49fd-ac0e-716bbc662b25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba2afc68bd144e05989a1da4a22ecbd5)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:26.994484 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8ee48e-aec2-49fd-ac0e-716bbc662b25 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:27.029055 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3459/6952] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:38:26 2022] POST /identity/v3/users => generated 290 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:38:27.040842 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c35527-45a4-4d83-8052-fe60212963b1 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:27.047286 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b8c35527-45a4-4d83-8052-fe60212963b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:27.082787 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c35527-45a4-4d83-8052-fe60212963b1 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:27.089628 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28256464-b45d-493f-aee4-49c727bf0955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:27.090580 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28256464-b45d-493f-aee4-49c727bf0955 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:27.091087 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28256464-b45d-493f-aee4-49c727bf0955 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:27.091592 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28256464-b45d-493f-aee4-49c727bf0955 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:27.092875 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28256464-b45d-493f-aee4-49c727bf0955 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:27.095298 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28256464-b45d-493f-aee4-49c727bf0955 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:27.120739 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3460/6953] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:38:27.124960 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28256464-b45d-493f-aee4-49c727bf0955 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:27.141159 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28256464-b45d-493f-aee4-49c727bf0955 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:27.151740 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668aca97-4512-4107-ac59-5ea40b64270e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:27.153495 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668aca97-4512-4107-ac59-5ea40b64270e admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:27.153974 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668aca97-4512-4107-ac59-5ea40b64270e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:27.154885 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668aca97-4512-4107-ac59-5ea40b64270e admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:27.156306 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668aca97-4512-4107-ac59-5ea40b64270e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:27.158496 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668aca97-4512-4107-ac59-5ea40b64270e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:27.173113 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3461/6954] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:38:27.177174 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668aca97-4512-4107-ac59-5ea40b64270e admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:27.193167 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668aca97-4512-4107-ac59-5ea40b64270e admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:27.200008 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e17b6a9-de7f-4be8-bcfd-99da034c0190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:27.207248 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17b6a9-de7f-4be8-bcfd-99da034c0190 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:27.207248 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17b6a9-de7f-4be8-bcfd-99da034c0190 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:27.207662 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17b6a9-de7f-4be8-bcfd-99da034c0190 admin admin] PATH_INFO: `/v3/projects/f9e4e67fc84c4c94ab063e29b82de39e/users/5928b39ff4f5407a8e6c3b8a3bd678a4/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:27.231408 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e17b6a9-de7f-4be8-bcfd-99da034c0190 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9e4e67fc84c4c94ab063e29b82de39e, user_id=5928b39ff4f5407a8e6c3b8a3bd678a4, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:27.248814 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e17b6a9-de7f-4be8-bcfd-99da034c0190 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:27.335921 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3462/6955] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:38:27 2022] PUT /identity/v3/projects/f9e4e67fc84c4c94ab063e29b82de39e/users/5928b39ff4f5407a8e6c3b8a3bd678a4/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:38:27.345667 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5bc427-855d-4874-9337-78f4ab51fed6 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:27.345807 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5bc427-855d-4874-9337-78f4ab51fed6 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:27.346287 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5bc427-855d-4874-9337-78f4ab51fed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:27.349905 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0b8ee48e-aec2-49fd-ac0e-716bbc662b25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba2afc68bd144e05989a1da4a22ecbd5'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:27.378320 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0b8ee48e-aec2-49fd-ac0e-716bbc662b25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba2afc68bd144e05989a1da4a22ecbd5'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:27.397272 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0b8ee48e-aec2-49fd-ac0e-716bbc662b25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba2afc68bd144e05989a1da4a22ecbd5'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:27.407747 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-8f5bc427-855d-4874-9337-78f4ab51fed6 None None] MFA Rules not processed for user `5928b39ff4f5407a8e6c3b8a3bd678a4`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:38:27.409330 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8f5bc427-855d-4874-9337-78f4ab51fed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:27.477706 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0b8ee48e-aec2-49fd-ac0e-716bbc662b25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba2afc68bd144e05989a1da4a22ecbd5'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:27.478654 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0b8ee48e-aec2-49fd-ac0e-716bbc662b25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba2afc68bd144e05989a1da4a22ecbd5'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:27.492085 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3494/6956] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:38:26 2022] DELETE /identity/v3/users/ba2afc68bd144e05989a1da4a22ecbd5 => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:38:27.571184 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3463/6957] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:38:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:38:27.667470 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8ee48e-aec2-49fd-ac0e-716bbc662b25 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:27.669298 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-0b8ee48e-aec2-49fd-ac0e-716bbc662b25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:27.773981 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8ee48e-aec2-49fd-ac0e-716bbc662b25 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:27.778896 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375fee75-fbde-4d3d-896e-f34541b8fd25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:27.780237 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375fee75-fbde-4d3d-896e-f34541b8fd25 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:27.780933 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375fee75-fbde-4d3d-896e-f34541b8fd25 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:27.781217 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375fee75-fbde-4d3d-896e-f34541b8fd25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:27.913494 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375fee75-fbde-4d3d-896e-f34541b8fd25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:27.916194 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375fee75-fbde-4d3d-896e-f34541b8fd25 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:27.949635 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3495/6958] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:38:27 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:38:27.976463 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5bc427-855d-4874-9337-78f4ab51fed6 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:27.978213 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8f5bc427-855d-4874-9337-78f4ab51fed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:28.091570 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5bc427-855d-4874-9337-78f4ab51fed6 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:28.190325 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d81cebd-b22b-40fa-83da-58e7b3b991d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:28.191221 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81cebd-b22b-40fa-83da-58e7b3b991d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:28.191674 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81cebd-b22b-40fa-83da-58e7b3b991d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:28.191961 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81cebd-b22b-40fa-83da-58e7b3b991d3 admin admin] PATH_INFO: `/v3/users/5928b39ff4f5407a8e6c3b8a3bd678a4` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:28.198436 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d81cebd-b22b-40fa-83da-58e7b3b991d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5928b39ff4f5407a8e6c3b8a3bd678a4)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:28.201214 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d81cebd-b22b-40fa-83da-58e7b3b991d3 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:28.255514 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375fee75-fbde-4d3d-896e-f34541b8fd25 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:28.257861 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-375fee75-fbde-4d3d-896e-f34541b8fd25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:28.308356 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375fee75-fbde-4d3d-896e-f34541b8fd25 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:28.324602 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1aa994-dbda-40dc-bf08-60bd61ca6fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:28.325066 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1aa994-dbda-40dc-bf08-60bd61ca6fee admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:28.325367 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1aa994-dbda-40dc-bf08-60bd61ca6fee admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:28.325647 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1aa994-dbda-40dc-bf08-60bd61ca6fee admin admin] PATH_INFO: `/v3/projects/2efafd9e9c5a4b49a0a6498e393f3c83` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:28.327751 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1aa994-dbda-40dc-bf08-60bd61ca6fee admin admin] RBAC: Authorizing `identity:delete_project(project_id=2efafd9e9c5a4b49a0a6498e393f3c83)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:28.343436 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1aa994-dbda-40dc-bf08-60bd61ca6fee admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:28.523054 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7d81cebd-b22b-40fa-83da-58e7b3b991d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5928b39ff4f5407a8e6c3b8a3bd678a4'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:28.545757 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7d81cebd-b22b-40fa-83da-58e7b3b991d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5928b39ff4f5407a8e6c3b8a3bd678a4'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:28.547979 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7d81cebd-b22b-40fa-83da-58e7b3b991d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5928b39ff4f5407a8e6c3b8a3bd678a4'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:28.596911 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5d1aa994-dbda-40dc-bf08-60bd61ca6fee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2efafd9e9c5a4b49a0a6498e393f3c83', 'request_id': 'req-5d1aa994-dbda-40dc-bf08-60bd61ca6fee'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:28.606946 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5d1aa994-dbda-40dc-bf08-60bd61ca6fee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2efafd9e9c5a4b49a0a6498e393f3c83', 'request_id': 'req-5d1aa994-dbda-40dc-bf08-60bd61ca6fee'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:28.654544 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7d81cebd-b22b-40fa-83da-58e7b3b991d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5928b39ff4f5407a8e6c3b8a3bd678a4'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:28.681815 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7d81cebd-b22b-40fa-83da-58e7b3b991d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5928b39ff4f5407a8e6c3b8a3bd678a4'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:28.715182 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3464/6959] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:38:27 2022] DELETE /identity/v3/users/5928b39ff4f5407a8e6c3b8a3bd678a4 => generated 0 bytes in 740 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:38:28.723766 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ebf8bb-6853-44a9-b4d1-2837d7db5358 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:28.724080 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ebf8bb-6853-44a9-b4d1-2837d7db5358 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:28.724360 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ebf8bb-6853-44a9-b4d1-2837d7db5358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:28.733430 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5d1aa994-dbda-40dc-bf08-60bd61ca6fee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2efafd9e9c5a4b49a0a6498e393f3c83', 'request_id': 'req-5d1aa994-dbda-40dc-bf08-60bd61ca6fee'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:28.755193 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-b6ebf8bb-6853-44a9-b4d1-2837d7db5358 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:38:28.755784 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5d1aa994-dbda-40dc-bf08-60bd61ca6fee admin admin] The token cache is being invalidate because project 2efafd9e9c5a4b49a0a6498e393f3c83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:38:28.756212 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5d1aa994-dbda-40dc-bf08-60bd61ca6fee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:28.756456 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b6ebf8bb-6853-44a9-b4d1-2837d7db5358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:28.757094 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5d1aa994-dbda-40dc-bf08-60bd61ca6fee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:28.769204 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3496/6960] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:38:28 2022] DELETE /identity/v3/projects/2efafd9e9c5a4b49a0a6498e393f3c83 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:38:28.774648 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd159c9-b751-4db3-bad5-bef9db58d66d None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:28.775159 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd159c9-b751-4db3-bad5-bef9db58d66d None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:28.775747 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd159c9-b751-4db3-bad5-bef9db58d66d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:28.821164 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-1dd159c9-b751-4db3-bad5-bef9db58d66d None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:38:28.824531 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-1dd159c9-b751-4db3-bad5-bef9db58d66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:28.879471 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3465/6961] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:38:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:38:28.903875 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ebf8bb-6853-44a9-b4d1-2837d7db5358 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:28.906664 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b6ebf8bb-6853-44a9-b4d1-2837d7db5358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:28.994987 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3497/6962] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:38:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:38:29.003852 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed093e4b-b507-4f69-86d8-7362ae2201fe None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:29.004146 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed093e4b-b507-4f69-86d8-7362ae2201fe None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:29.004806 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed093e4b-b507-4f69-86d8-7362ae2201fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:29.043587 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-ed093e4b-b507-4f69-86d8-7362ae2201fe None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:38:29.046727 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ed093e4b-b507-4f69-86d8-7362ae2201fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:29.068357 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3498/6963] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:38:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:38:29.072543 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed093e4b-b507-4f69-86d8-7362ae2201fe None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:29.098105 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ebf8bb-6853-44a9-b4d1-2837d7db5358 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:29.099132 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed093e4b-b507-4f69-86d8-7362ae2201fe None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:29.102688 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291c0beb-b3e0-4530-bf36-c9edae5e4eab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:29.103461 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c0beb-b3e0-4530-bf36-c9edae5e4eab service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:29.103852 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c0beb-b3e0-4530-bf36-c9edae5e4eab service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:29.104195 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c0beb-b3e0-4530-bf36-c9edae5e4eab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:29.109556 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d1ad3-94b6-4acb-9cc2-3a8cf15d9dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:29.110498 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d1ad3-94b6-4acb-9cc2-3a8cf15d9dc6 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:29.111835 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d1ad3-94b6-4acb-9cc2-3a8cf15d9dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:29.113871 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d1ad3-94b6-4acb-9cc2-3a8cf15d9dc6 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:29.114630 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1d1ad3-94b6-4acb-9cc2-3a8cf15d9dc6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:38:29.114958 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1d1ad3-94b6-4acb-9cc2-3a8cf15d9dc6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:29.116602 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1d1ad3-94b6-4acb-9cc2-3a8cf15d9dc6 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:29.121131 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291c0beb-b3e0-4530-bf36-c9edae5e4eab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:29.127834 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291c0beb-b3e0-4530-bf36-c9edae5e4eab service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:29.143750 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3466/6964] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:38:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:38:29.172628 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3499/6965] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:38:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:38:29.177268 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291c0beb-b3e0-4530-bf36-c9edae5e4eab service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:29.193126 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291c0beb-b3e0-4530-bf36-c9edae5e4eab service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:29.206007 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cd6818-56b2-4c2a-b692-a31efbbf45d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:29.206586 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd6818-56b2-4c2a-b692-a31efbbf45d7 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:29.206876 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd6818-56b2-4c2a-b692-a31efbbf45d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:29.207151 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd6818-56b2-4c2a-b692-a31efbbf45d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:29.207910 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cd6818-56b2-4c2a-b692-a31efbbf45d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:29.210485 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cd6818-56b2-4c2a-b692-a31efbbf45d7 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:29.311916 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3467/6966] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:38:29 2022] POST /identity/v3/projects => generated 379 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:38:29.316371 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d1ad3-94b6-4acb-9cc2-3a8cf15d9dc6 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:29.341632 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d1ad3-94b6-4acb-9cc2-3a8cf15d9dc6 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:29.559669 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a773c73-5833-4e7d-ade3-aa8297a2e241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:29.564317 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a773c73-5833-4e7d-ade3-aa8297a2e241 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:29.564317 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a773c73-5833-4e7d-ade3-aa8297a2e241 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:29.564317 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a773c73-5833-4e7d-ade3-aa8297a2e241 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:29.565235 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a773c73-5833-4e7d-ade3-aa8297a2e241 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:29.570635 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a773c73-5833-4e7d-ade3-aa8297a2e241 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:29.690108 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3500/6967] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:38:29 2022] POST /identity/v3/users => generated 290 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:38:29.696237 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cd6818-56b2-4c2a-b692-a31efbbf45d7 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:29.714716 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cd6818-56b2-4c2a-b692-a31efbbf45d7 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:29.729170 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dfb827-3f4e-441e-94f7-012a4e52fb30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:29.730292 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dfb827-3f4e-441e-94f7-012a4e52fb30 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:29.731396 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dfb827-3f4e-441e-94f7-012a4e52fb30 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:29.733345 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dfb827-3f4e-441e-94f7-012a4e52fb30 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:29.738426 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dfb827-3f4e-441e-94f7-012a4e52fb30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:29.742067 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dfb827-3f4e-441e-94f7-012a4e52fb30 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:29.787911 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3468/6968] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:38:29 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:38:29.791806 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a773c73-5833-4e7d-ade3-aa8297a2e241 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:29.806941 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a773c73-5833-4e7d-ade3-aa8297a2e241 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:29.820284 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9054bdc-c1cd-4b42-bd12-bad6a62df380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:29.820991 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9054bdc-c1cd-4b42-bd12-bad6a62df380 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:29.821815 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9054bdc-c1cd-4b42-bd12-bad6a62df380 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:29.821815 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9054bdc-c1cd-4b42-bd12-bad6a62df380 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:29.822278 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9054bdc-c1cd-4b42-bd12-bad6a62df380 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:29.824207 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9054bdc-c1cd-4b42-bd12-bad6a62df380 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:29.849325 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3501/6969] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:38:29 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:38:29.853220 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dfb827-3f4e-441e-94f7-012a4e52fb30 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:29.868439 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dfb827-3f4e-441e-94f7-012a4e52fb30 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:29.880759 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a1291-e690-4f0a-a387-6355e1e95b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:29.886186 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a1291-e690-4f0a-a387-6355e1e95b72 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:29.886712 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a1291-e690-4f0a-a387-6355e1e95b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:29.887363 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a1291-e690-4f0a-a387-6355e1e95b72 admin admin] PATH_INFO: `/v3/projects/a529a2c993ca48eca643a2585818001e/users/dd1ae03f6c9b4f1aa6b0249041bd7bc2/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:29.948945 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6a1291-e690-4f0a-a387-6355e1e95b72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a529a2c993ca48eca643a2585818001e, user_id=dd1ae03f6c9b4f1aa6b0249041bd7bc2, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:29.948945 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6a1291-e690-4f0a-a387-6355e1e95b72 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:30.079840 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3469/6970] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:38:29 2022] PUT /identity/v3/projects/a529a2c993ca48eca643a2585818001e/users/dd1ae03f6c9b4f1aa6b0249041bd7bc2/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:38:30.090342 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486aa35d-b22a-4ade-8690-57ec612ff384 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:30.090647 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486aa35d-b22a-4ade-8690-57ec612ff384 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:30.090921 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486aa35d-b22a-4ade-8690-57ec612ff384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:30.143789 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-486aa35d-b22a-4ade-8690-57ec612ff384 None None] MFA Rules not processed for user `dd1ae03f6c9b4f1aa6b0249041bd7bc2`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:38:30.149615 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-486aa35d-b22a-4ade-8690-57ec612ff384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:30.188071 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a1291-e690-4f0a-a387-6355e1e95b72 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:30.190915 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-0a6a1291-e690-4f0a-a387-6355e1e95b72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:30.332144 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3502/6971] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:38:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:38:30.336685 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486aa35d-b22a-4ade-8690-57ec612ff384 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:30.375654 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a1291-e690-4f0a-a387-6355e1e95b72 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:30.405139 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd37bfe-71af-4709-a44f-8d2a6cf8efc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:30.419012 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd37bfe-71af-4709-a44f-8d2a6cf8efc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:30.419398 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd37bfe-71af-4709-a44f-8d2a6cf8efc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:30.420039 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd37bfe-71af-4709-a44f-8d2a6cf8efc6 admin admin] PATH_INFO: `/v3/projects/f9e4e67fc84c4c94ab063e29b82de39e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:30.422094 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd37bfe-71af-4709-a44f-8d2a6cf8efc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9e4e67fc84c4c94ab063e29b82de39e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:30.424758 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd37bfe-71af-4709-a44f-8d2a6cf8efc6 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:30.548952 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486aa35d-b22a-4ade-8690-57ec612ff384 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:30.570779 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4ff69d-83f0-4634-9170-e79dd9a56d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:30.573237 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ff69d-83f0-4634-9170-e79dd9a56d71 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:30.574179 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ff69d-83f0-4634-9170-e79dd9a56d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:30.574535 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ff69d-83f0-4634-9170-e79dd9a56d71 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:30.579009 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4ff69d-83f0-4634-9170-e79dd9a56d71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:30.584775 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4ff69d-83f0-4634-9170-e79dd9a56d71 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:30.620617 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ebd37bfe-71af-4709-a44f-8d2a6cf8efc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9e4e67fc84c4c94ab063e29b82de39e', 'request_id': 'req-ebd37bfe-71af-4709-a44f-8d2a6cf8efc6'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:30.635205 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ebd37bfe-71af-4709-a44f-8d2a6cf8efc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9e4e67fc84c4c94ab063e29b82de39e', 'request_id': 'req-ebd37bfe-71af-4709-a44f-8d2a6cf8efc6'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:30.648228 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ebd37bfe-71af-4709-a44f-8d2a6cf8efc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9e4e67fc84c4c94ab063e29b82de39e', 'request_id': 'req-ebd37bfe-71af-4709-a44f-8d2a6cf8efc6'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:30.745214 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3503/6972] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:38:30 2022] POST /identity/v3/projects => generated 381 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:38:30.750955 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4ff69d-83f0-4634-9170-e79dd9a56d71 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:30.772870 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ebd37bfe-71af-4709-a44f-8d2a6cf8efc6 admin admin] The token cache is being invalidate because project f9e4e67fc84c4c94ab063e29b82de39e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:38:30.773196 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ebd37bfe-71af-4709-a44f-8d2a6cf8efc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:30.775104 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ebd37bfe-71af-4709-a44f-8d2a6cf8efc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:30.778205 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3470/6973] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:38:30 2022] DELETE /identity/v3/projects/f9e4e67fc84c4c94ab063e29b82de39e => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:38:30.788759 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280b141-98f1-4fae-a48b-bc18173b2344 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:30.788759 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280b141-98f1-4fae-a48b-bc18173b2344 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:30.788759 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280b141-98f1-4fae-a48b-bc18173b2344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:30.843400 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-e280b141-98f1-4fae-a48b-bc18173b2344 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:38:30.844863 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e280b141-98f1-4fae-a48b-bc18173b2344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:30.906618 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4ff69d-83f0-4634-9170-e79dd9a56d71 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:30.925795 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d885614a-e860-4b7c-8e2b-2af9f328c65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:30.926483 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d885614a-e860-4b7c-8e2b-2af9f328c65f admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:30.926766 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d885614a-e860-4b7c-8e2b-2af9f328c65f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:30.927044 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d885614a-e860-4b7c-8e2b-2af9f328c65f admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:30.927770 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d885614a-e860-4b7c-8e2b-2af9f328c65f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:30.929894 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d885614a-e860-4b7c-8e2b-2af9f328c65f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:30.977098 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3471/6974] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:38:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:38:30.985842 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8804eb57-b9c4-4f9c-9afa-5e8ad710dd10 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:30.986218 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8804eb57-b9c4-4f9c-9afa-5e8ad710dd10 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:30.986400 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8804eb57-b9c4-4f9c-9afa-5e8ad710dd10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:31.022498 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-8804eb57-b9c4-4f9c-9afa-5e8ad710dd10 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:38:31.024623 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8804eb57-b9c4-4f9c-9afa-5e8ad710dd10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:31.039243 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3472/6975] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:38:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:38:31.040207 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8804eb57-b9c4-4f9c-9afa-5e8ad710dd10 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:31.058122 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8804eb57-b9c4-4f9c-9afa-5e8ad710dd10 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:31.064599 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3504/6976] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:38:30 2022] POST /identity/v3/users => generated 291 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:38:31.064778 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034d278a-9432-459a-9ab7-a3486f310d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:31.064778 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034d278a-9432-459a-9ab7-a3486f310d4d admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:31.065950 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d885614a-e860-4b7c-8e2b-2af9f328c65f admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:31.066701 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034d278a-9432-459a-9ab7-a3486f310d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:31.067015 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034d278a-9432-459a-9ab7-a3486f310d4d admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:31.068769 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d885614a-e860-4b7c-8e2b-2af9f328c65f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:31.068912 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034d278a-9432-459a-9ab7-a3486f310d4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:38:31.069220 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034d278a-9432-459a-9ab7-a3486f310d4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:31.073709 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034d278a-9432-459a-9ab7-a3486f310d4d admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:31.096982 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d885614a-e860-4b7c-8e2b-2af9f328c65f admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:31.102977 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6872d5d2-475d-4d04-8eef-35ae93628871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:31.104109 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6872d5d2-475d-4d04-8eef-35ae93628871 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:31.104693 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6872d5d2-475d-4d04-8eef-35ae93628871 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:31.105485 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3473/6977] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:38:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:38:31.110987 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034d278a-9432-459a-9ab7-a3486f310d4d admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:31.113170 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6872d5d2-475d-4d04-8eef-35ae93628871 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:31.114295 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6872d5d2-475d-4d04-8eef-35ae93628871 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:31.116321 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6872d5d2-475d-4d04-8eef-35ae93628871 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:31.122873 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034d278a-9432-459a-9ab7-a3486f310d4d admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:31.136797 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3505/6978] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:38:31.137388 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84595ecf-91e4-493b-b71a-bf5669456392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:31.138223 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84595ecf-91e4-493b-b71a-bf5669456392 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:31.138422 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84595ecf-91e4-493b-b71a-bf5669456392 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:31.139219 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84595ecf-91e4-493b-b71a-bf5669456392 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:31.141000 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84595ecf-91e4-493b-b71a-bf5669456392 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:31.141866 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6872d5d2-475d-4d04-8eef-35ae93628871 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:31.144262 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84595ecf-91e4-493b-b71a-bf5669456392 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:31.159980 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6872d5d2-475d-4d04-8eef-35ae93628871 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:31.171245 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494493a8-5328-4b5a-bb99-214f17d4aa54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:31.172188 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494493a8-5328-4b5a-bb99-214f17d4aa54 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:31.172687 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494493a8-5328-4b5a-bb99-214f17d4aa54 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:31.173197 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494493a8-5328-4b5a-bb99-214f17d4aa54 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:31.173954 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494493a8-5328-4b5a-bb99-214f17d4aa54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:31.175666 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494493a8-5328-4b5a-bb99-214f17d4aa54 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:31.194617 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3506/6979] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:38:31.198868 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494493a8-5328-4b5a-bb99-214f17d4aa54 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:31.225011 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494493a8-5328-4b5a-bb99-214f17d4aa54 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:31.240688 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a014dd86-43a2-4584-8a1d-a34feedde47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:31.240950 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a014dd86-43a2-4584-8a1d-a34feedde47a admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:31.241173 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a014dd86-43a2-4584-8a1d-a34feedde47a admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:31.241664 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a014dd86-43a2-4584-8a1d-a34feedde47a admin admin] PATH_INFO: `/v3/projects/7d7e2fc7ee6345c78a4042528d77de37/users/69a573bf330d4931a85510806a3468b8/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:31.273176 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3474/6980] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:38:31 2022] POST /identity/v3/projects => generated 383 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:38:31.277668 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84595ecf-91e4-493b-b71a-bf5669456392 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:31.301967 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a014dd86-43a2-4584-8a1d-a34feedde47a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d7e2fc7ee6345c78a4042528d77de37, user_id=69a573bf330d4931a85510806a3468b8, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:31.307557 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a014dd86-43a2-4584-8a1d-a34feedde47a admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:31.415550 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3507/6981] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:38:31 2022] PUT /identity/v3/projects/7d7e2fc7ee6345c78a4042528d77de37/users/69a573bf330d4931a85510806a3468b8/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:38:31.420928 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b198f-d8cf-4f56-8f70-00e97e6cd1ea None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:31.421220 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b198f-d8cf-4f56-8f70-00e97e6cd1ea None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:31.421723 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b198f-d8cf-4f56-8f70-00e97e6cd1ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:31.444243 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84595ecf-91e4-493b-b71a-bf5669456392 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:31.500644 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-1f9b198f-d8cf-4f56-8f70-00e97e6cd1ea None None] MFA Rules not processed for user `69a573bf330d4931a85510806a3468b8`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:38:31.504083 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-1f9b198f-d8cf-4f56-8f70-00e97e6cd1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:31.613931 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c8883d-6701-4076-8309-de28081c7f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:31.615869 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c8883d-6701-4076-8309-de28081c7f64 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:31.615869 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c8883d-6701-4076-8309-de28081c7f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:31.615869 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c8883d-6701-4076-8309-de28081c7f64 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:31.616196 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c8883d-6701-4076-8309-de28081c7f64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:31.618068 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c8883d-6701-4076-8309-de28081c7f64 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:31.639214 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3508/6982] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:38:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:38:31.645010 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9b198f-d8cf-4f56-8f70-00e97e6cd1ea None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:31.650754 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-1f9b198f-d8cf-4f56-8f70-00e97e6cd1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:31.718940 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3475/6983] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:38:31 2022] POST /identity/v3/users => generated 292 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:38:31.722570 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c8883d-6701-4076-8309-de28081c7f64 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:31.742828 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c8883d-6701-4076-8309-de28081c7f64 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:31.756114 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b01229-564f-46c1-9ada-75751d9a161a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:31.756899 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b01229-564f-46c1-9ada-75751d9a161a admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:31.759469 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b01229-564f-46c1-9ada-75751d9a161a admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:31.759469 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b01229-564f-46c1-9ada-75751d9a161a admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:31.759469 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b01229-564f-46c1-9ada-75751d9a161a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:31.764664 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9b198f-d8cf-4f56-8f70-00e97e6cd1ea None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:31.769886 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db501a0a-d37f-4dfc-89b5-413584d7ac49 tempest-IdentityV3ProjectsTest-563327840 tempest-IdentityV3ProjectsTest-563327840-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd1ae03f6c9b4f1aa6b0249041bd7bc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a529a2c993ca48eca643a2585818001e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:31.770290 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b01229-564f-46c1-9ada-75751d9a161a admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:31.771031 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db501a0a-d37f-4dfc-89b5-413584d7ac49 tempest-IdentityV3ProjectsTest-563327840 tempest-IdentityV3ProjectsTest-563327840-project] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:31.771418 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db501a0a-d37f-4dfc-89b5-413584d7ac49 tempest-IdentityV3ProjectsTest-563327840 tempest-IdentityV3ProjectsTest-563327840-project] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:31.771827 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db501a0a-d37f-4dfc-89b5-413584d7ac49 tempest-IdentityV3ProjectsTest-563327840 tempest-IdentityV3ProjectsTest-563327840-project] PATH_INFO: `/v3/users/dd1ae03f6c9b4f1aa6b0249041bd7bc2/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:31.773210 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db501a0a-d37f-4dfc-89b5-413584d7ac49 tempest-IdentityV3ProjectsTest-563327840 tempest-IdentityV3ProjectsTest-563327840-project] RBAC: Authorizing `identity:list_user_projects(user_id=dd1ae03f6c9b4f1aa6b0249041bd7bc2)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:31.775322 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db501a0a-d37f-4dfc-89b5-413584d7ac49 tempest-IdentityV3ProjectsTest-563327840 tempest-IdentityV3ProjectsTest-563327840-project] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:31.783934 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3476/6984] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:38:31.788508 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b01229-564f-46c1-9ada-75751d9a161a admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:31.806842 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b01229-564f-46c1-9ada-75751d9a161a admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:31.821473 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9958e4bf-1162-4dec-9fd0-bfa81e634d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:31.822222 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958e4bf-1162-4dec-9fd0-bfa81e634d2b admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:31.822486 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958e4bf-1162-4dec-9fd0-bfa81e634d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:31.822736 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958e4bf-1162-4dec-9fd0-bfa81e634d2b admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:31.823467 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9958e4bf-1162-4dec-9fd0-bfa81e634d2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:31.825134 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9958e4bf-1162-4dec-9fd0-bfa81e634d2b admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:31.858379 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3477/6985] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:38:31.860753 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9958e4bf-1162-4dec-9fd0-bfa81e634d2b admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:31.871346 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3509/6986] 10.222.0.52 () {58 vars in 1247 bytes} [Sat May 14 21:38:31 2022] GET /identity/v3/users/dd1ae03f6c9b4f1aa6b0249041bd7bc2/projects => generated 515 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:38:31.877774 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb545a-a985-4fb7-96e4-cb460aa26a19 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:31.878488 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb545a-a985-4fb7-96e4-cb460aa26a19 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:31.879015 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb545a-a985-4fb7-96e4-cb460aa26a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:31.884515 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9958e4bf-1162-4dec-9fd0-bfa81e634d2b admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:31.900430 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e063fbb-a1eb-4ebd-bc34-ff48c55e4092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:31.902112 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e063fbb-a1eb-4ebd-bc34-ff48c55e4092 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:31.903023 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e063fbb-a1eb-4ebd-bc34-ff48c55e4092 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:31.904792 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e063fbb-a1eb-4ebd-bc34-ff48c55e4092 admin admin] PATH_INFO: `/v3/projects/1a15ad3303f64af7a8ec37d20e2fdf03/users/1a893f84b21840d2852ae1e5c320f45e/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:31.944051 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e063fbb-a1eb-4ebd-bc34-ff48c55e4092 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a15ad3303f64af7a8ec37d20e2fdf03, user_id=1a893f84b21840d2852ae1e5c320f45e, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:31.946631 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-dbdb545a-a985-4fb7-96e4-cb460aa26a19 None None] MFA Rules not processed for user `dd1ae03f6c9b4f1aa6b0249041bd7bc2`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:38:31.947027 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e063fbb-a1eb-4ebd-bc34-ff48c55e4092 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:31.948268 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-dbdb545a-a985-4fb7-96e4-cb460aa26a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:31.967724 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3510/6987] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:38:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:38:31.969610 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a8931b-4bf6-4afd-b7a1-d5a3ec1783ab None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:31.969990 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a8931b-4bf6-4afd-b7a1-d5a3ec1783ab None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:31.970937 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a8931b-4bf6-4afd-b7a1-d5a3ec1783ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:31.991822 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-e1a8931b-4bf6-4afd-b7a1-d5a3ec1783ab None None] MFA Rules not processed for user `dd1ae03f6c9b4f1aa6b0249041bd7bc2`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:38:31.993128 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e1a8931b-4bf6-4afd-b7a1-d5a3ec1783ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:32.066677 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3478/6988] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:38:31 2022] PUT /identity/v3/projects/1a15ad3303f64af7a8ec37d20e2fdf03/users/1a893f84b21840d2852ae1e5c320f45e/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:38:32.078613 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc8b55-37c9-4386-8068-85cc3da744f0 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:32.078899 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc8b55-37c9-4386-8068-85cc3da744f0 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:32.079178 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc8b55-37c9-4386-8068-85cc3da744f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:32.079709 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.models.token_model [None req-e1a8931b-4bf6-4afd-b7a1-d5a3ec1783ab None None] User dd1ae03f6c9b4f1aa6b0249041bd7bc2 has no access to project 7d7e2fc7ee6345c78a4042528d77de37 {{(pid=91106) _validate_project_scope /opt/stack/keystone/keystone/models/token_model.py:539}} May 14 21:38:32.087699 ncdv-master-1 devstack@keystone.service[91106]: WARNING keystone.server.flask.application [None req-e1a8931b-4bf6-4afd-b7a1-d5a3ec1783ab None None] Authorization failed. The request you have made requires authentication. from 10.222.0.52: keystone.exception.Unauthorized: The request you have made requires authentication. May 14 21:38:32.093653 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3511/6989] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:38:31 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 125 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) May 14 21:38:32.094715 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a8931b-4bf6-4afd-b7a1-d5a3ec1783ab None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:32.117901 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-6bdc8b55-37c9-4386-8068-85cc3da744f0 None None] MFA Rules not processed for user `1a893f84b21840d2852ae1e5c320f45e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:38:32.119916 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-6bdc8b55-37c9-4386-8068-85cc3da744f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:32.120726 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a8931b-4bf6-4afd-b7a1-d5a3ec1783ab None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:32.254949 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3479/6990] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:38:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:38:32.284046 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cf1829-0cd0-4bca-9ba4-4ac19213a09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:32.285168 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf1829-0cd0-4bca-9ba4-4ac19213a09e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:32.285617 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf1829-0cd0-4bca-9ba4-4ac19213a09e admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:32.286057 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf1829-0cd0-4bca-9ba4-4ac19213a09e admin admin] PATH_INFO: `/v3/users/dd1ae03f6c9b4f1aa6b0249041bd7bc2` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:32.288561 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cf1829-0cd0-4bca-9ba4-4ac19213a09e admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd1ae03f6c9b4f1aa6b0249041bd7bc2)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:32.292214 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cf1829-0cd0-4bca-9ba4-4ac19213a09e admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:32.304535 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdc8b55-37c9-4386-8068-85cc3da744f0 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:32.312499 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-6bdc8b55-37c9-4386-8068-85cc3da744f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:32.457507 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdc8b55-37c9-4386-8068-85cc3da744f0 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:32.462850 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8852dc-8f24-406b-9d48-0a1d72c6afc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:32.463868 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8852dc-8f24-406b-9d48-0a1d72c6afc9 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:32.464318 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8852dc-8f24-406b-9d48-0a1d72c6afc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:32.464756 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8852dc-8f24-406b-9d48-0a1d72c6afc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:32.477235 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8852dc-8f24-406b-9d48-0a1d72c6afc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:32.486166 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8852dc-8f24-406b-9d48-0a1d72c6afc9 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:32.499651 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3480/6991] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:38:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:38:32.546190 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d5cf1829-0cd0-4bca-9ba4-4ac19213a09e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd1ae03f6c9b4f1aa6b0249041bd7bc2'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:32.573405 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d5cf1829-0cd0-4bca-9ba4-4ac19213a09e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd1ae03f6c9b4f1aa6b0249041bd7bc2'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:32.595958 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d5cf1829-0cd0-4bca-9ba4-4ac19213a09e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd1ae03f6c9b4f1aa6b0249041bd7bc2'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:32.727000 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d5cf1829-0cd0-4bca-9ba4-4ac19213a09e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd1ae03f6c9b4f1aa6b0249041bd7bc2'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:32.727713 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d5cf1829-0cd0-4bca-9ba4-4ac19213a09e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd1ae03f6c9b4f1aa6b0249041bd7bc2'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:32.737727 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3512/6992] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:38:32 2022] DELETE /identity/v3/users/dd1ae03f6c9b4f1aa6b0249041bd7bc2 => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:38:32.739912 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b40c3b-9173-48dd-a257-b345be028eb0 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:32.740235 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b40c3b-9173-48dd-a257-b345be028eb0 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:32.740502 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b40c3b-9173-48dd-a257-b345be028eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:32.762708 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-67b40c3b-9173-48dd-a257-b345be028eb0 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:38:32.764139 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-67b40c3b-9173-48dd-a257-b345be028eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:32.876956 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3481/6993] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:38:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:38:32.888954 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cf1829-0cd0-4bca-9ba4-4ac19213a09e admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:32.892774 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d5cf1829-0cd0-4bca-9ba4-4ac19213a09e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:33.020807 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cf1829-0cd0-4bca-9ba4-4ac19213a09e admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:33.025903 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3430ab2-8825-4d89-8bc1-ba6aa43b626f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:33.026855 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3430ab2-8825-4d89-8bc1-ba6aa43b626f service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:33.027387 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3430ab2-8825-4d89-8bc1-ba6aa43b626f service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:33.028442 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3430ab2-8825-4d89-8bc1-ba6aa43b626f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:33.040917 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3430ab2-8825-4d89-8bc1-ba6aa43b626f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:33.042546 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3430ab2-8825-4d89-8bc1-ba6aa43b626f service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:33.063129 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3513/6994] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:38:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:38:34.033144 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b40c3b-9173-48dd-a257-b345be028eb0 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:34.035125 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-67b40c3b-9173-48dd-a257-b345be028eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:34.079705 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b40c3b-9173-48dd-a257-b345be028eb0 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:34.092261 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3cca2e-a07a-4f28-b6a3-94e1ac775e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:34.093384 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3cca2e-a07a-4f28-b6a3-94e1ac775e38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:34.096771 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3cca2e-a07a-4f28-b6a3-94e1ac775e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:34.097271 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3cca2e-a07a-4f28-b6a3-94e1ac775e38 admin admin] PATH_INFO: `/v3/projects/a529a2c993ca48eca643a2585818001e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:34.104467 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3cca2e-a07a-4f28-b6a3-94e1ac775e38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a529a2c993ca48eca643a2585818001e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:34.122410 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3cca2e-a07a-4f28-b6a3-94e1ac775e38 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:34.307038 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-6c3cca2e-a07a-4f28-b6a3-94e1ac775e38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a529a2c993ca48eca643a2585818001e', 'request_id': 'req-6c3cca2e-a07a-4f28-b6a3-94e1ac775e38'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:34.316613 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-6c3cca2e-a07a-4f28-b6a3-94e1ac775e38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a529a2c993ca48eca643a2585818001e', 'request_id': 'req-6c3cca2e-a07a-4f28-b6a3-94e1ac775e38'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:34.325234 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-6c3cca2e-a07a-4f28-b6a3-94e1ac775e38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a529a2c993ca48eca643a2585818001e', 'request_id': 'req-6c3cca2e-a07a-4f28-b6a3-94e1ac775e38'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:34.429990 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-6c3cca2e-a07a-4f28-b6a3-94e1ac775e38 admin admin] The token cache is being invalidate because project a529a2c993ca48eca643a2585818001e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:38:34.430284 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-6c3cca2e-a07a-4f28-b6a3-94e1ac775e38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:34.430946 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-6c3cca2e-a07a-4f28-b6a3-94e1ac775e38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:34.432533 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3482/6995] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:38:34 2022] DELETE /identity/v3/projects/a529a2c993ca48eca643a2585818001e => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:38:34.437275 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3430ab2-8825-4d89-8bc1-ba6aa43b626f service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:34.447285 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3430ab2-8825-4d89-8bc1-ba6aa43b626f service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:34.511785 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99251f5d-a3f7-4c5c-8922-04a3f8bb0c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:34.512921 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99251f5d-a3f7-4c5c-8922-04a3f8bb0c41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:34.513309 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99251f5d-a3f7-4c5c-8922-04a3f8bb0c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:34.514366 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99251f5d-a3f7-4c5c-8922-04a3f8bb0c41 admin admin] PATH_INFO: `/v3/users/69a573bf330d4931a85510806a3468b8` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:34.516170 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99251f5d-a3f7-4c5c-8922-04a3f8bb0c41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69a573bf330d4931a85510806a3468b8)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:34.518343 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99251f5d-a3f7-4c5c-8922-04a3f8bb0c41 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:34.820310 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-99251f5d-a3f7-4c5c-8922-04a3f8bb0c41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69a573bf330d4931a85510806a3468b8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:34.853657 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-99251f5d-a3f7-4c5c-8922-04a3f8bb0c41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69a573bf330d4931a85510806a3468b8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:34.890814 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-99251f5d-a3f7-4c5c-8922-04a3f8bb0c41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69a573bf330d4931a85510806a3468b8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:35.064749 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-99251f5d-a3f7-4c5c-8922-04a3f8bb0c41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69a573bf330d4931a85510806a3468b8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:35.065551 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-99251f5d-a3f7-4c5c-8922-04a3f8bb0c41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69a573bf330d4931a85510806a3468b8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:35.082217 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3514/6996] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:38:34 2022] DELETE /identity/v3/users/69a573bf330d4931a85510806a3468b8 => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:38:36.997091 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3cca2e-a07a-4f28-b6a3-94e1ac775e38 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:37.000339 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-6c3cca2e-a07a-4f28-b6a3-94e1ac775e38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:37.018033 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3cca2e-a07a-4f28-b6a3-94e1ac775e38 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:37.141348 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b3e665-0609-4186-9e42-8c34cae4d223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:37.142558 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3e665-0609-4186-9e42-8c34cae4d223 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:37.143047 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3e665-0609-4186-9e42-8c34cae4d223 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:37.143520 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3e665-0609-4186-9e42-8c34cae4d223 admin admin] PATH_INFO: `/v3/projects/7d7e2fc7ee6345c78a4042528d77de37` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:37.145336 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b3e665-0609-4186-9e42-8c34cae4d223 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d7e2fc7ee6345c78a4042528d77de37)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:37.148365 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b3e665-0609-4186-9e42-8c34cae4d223 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:37.407409 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-54b3e665-0609-4186-9e42-8c34cae4d223 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d7e2fc7ee6345c78a4042528d77de37', 'request_id': 'req-54b3e665-0609-4186-9e42-8c34cae4d223'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:37.417706 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-54b3e665-0609-4186-9e42-8c34cae4d223 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d7e2fc7ee6345c78a4042528d77de37', 'request_id': 'req-54b3e665-0609-4186-9e42-8c34cae4d223'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:37.428568 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-54b3e665-0609-4186-9e42-8c34cae4d223 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d7e2fc7ee6345c78a4042528d77de37', 'request_id': 'req-54b3e665-0609-4186-9e42-8c34cae4d223'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:37.538851 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-54b3e665-0609-4186-9e42-8c34cae4d223 admin admin] The token cache is being invalidate because project 7d7e2fc7ee6345c78a4042528d77de37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:38:37.539771 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-54b3e665-0609-4186-9e42-8c34cae4d223 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:37.541262 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-54b3e665-0609-4186-9e42-8c34cae4d223 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:37.547994 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3483/6997] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:38:36 2022] DELETE /identity/v3/projects/7d7e2fc7ee6345c78a4042528d77de37 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:38:37.550380 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6232828-820e-47c8-8c7a-61607949a9d3 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:37.550894 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6232828-820e-47c8-8c7a-61607949a9d3 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:37.551018 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6232828-820e-47c8-8c7a-61607949a9d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:37.606043 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-c6232828-820e-47c8-8c7a-61607949a9d3 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:38:37.611844 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c6232828-820e-47c8-8c7a-61607949a9d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:37.743781 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3515/6998] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:38:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:38:37.752262 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e00902-eff4-4f95-a312-3fa63c50b530 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:37.757424 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e00902-eff4-4f95-a312-3fa63c50b530 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:37.757424 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e00902-eff4-4f95-a312-3fa63c50b530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:37.775583 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-e6e00902-eff4-4f95-a312-3fa63c50b530 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:38:37.777017 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e6e00902-eff4-4f95-a312-3fa63c50b530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:37.791376 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3484/6999] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:38:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:38:37.952295 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6232828-820e-47c8-8c7a-61607949a9d3 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:37.952295 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6232828-820e-47c8-8c7a-61607949a9d3 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:37.952295 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd0ff25-bc24-4c63-8bcd-f329991ba65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:37.952295 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd0ff25-bc24-4c63-8bcd-f329991ba65e admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:37.955034 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd0ff25-bc24-4c63-8bcd-f329991ba65e admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:37.955034 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd0ff25-bc24-4c63-8bcd-f329991ba65e admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:37.955034 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd0ff25-bc24-4c63-8bcd-f329991ba65e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:38:37.955034 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd0ff25-bc24-4c63-8bcd-f329991ba65e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:37.955034 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd0ff25-bc24-4c63-8bcd-f329991ba65e admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:37.955034 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3516/7000] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:38:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:38:37.955673 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e00902-eff4-4f95-a312-3fa63c50b530 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:37.955673 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e00902-eff4-4f95-a312-3fa63c50b530 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:37.955673 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47baf081-a8e7-44ec-8b32-8f435ed049ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:37.955673 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47baf081-a8e7-44ec-8b32-8f435ed049ec admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:37.956106 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47baf081-a8e7-44ec-8b32-8f435ed049ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:37.956106 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47baf081-a8e7-44ec-8b32-8f435ed049ec admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:37.956106 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47baf081-a8e7-44ec-8b32-8f435ed049ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:37.956106 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47baf081-a8e7-44ec-8b32-8f435ed049ec admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:38.135169 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3485/7001] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:38:37 2022] POST /identity/v3/projects => generated 397 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:38:38.147994 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd0ff25-bc24-4c63-8bcd-f329991ba65e admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:38.166678 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd0ff25-bc24-4c63-8bcd-f329991ba65e admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:38.397316 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d6cad8-0709-4332-9eca-284867f92711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:38.409980 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6cad8-0709-4332-9eca-284867f92711 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:38.413146 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6cad8-0709-4332-9eca-284867f92711 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:38.413146 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6cad8-0709-4332-9eca-284867f92711 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:38.413146 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d6cad8-0709-4332-9eca-284867f92711 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:38.413678 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d6cad8-0709-4332-9eca-284867f92711 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:38.573784 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3517/7002] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:38:38 2022] POST /identity/v3/users => generated 305 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:38:38.574712 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47baf081-a8e7-44ec-8b32-8f435ed049ec admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:38.595541 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47baf081-a8e7-44ec-8b32-8f435ed049ec admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:38.602195 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dcf969-aefa-4471-b32c-93ebed15e0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:38.603363 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dcf969-aefa-4471-b32c-93ebed15e0da admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:38.603974 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dcf969-aefa-4471-b32c-93ebed15e0da admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:38.604430 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dcf969-aefa-4471-b32c-93ebed15e0da admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:38.605350 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dcf969-aefa-4471-b32c-93ebed15e0da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:38.608393 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dcf969-aefa-4471-b32c-93ebed15e0da admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:38.626871 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3486/7003] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:38:38 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:38:38.631231 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d6cad8-0709-4332-9eca-284867f92711 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:38.645612 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d6cad8-0709-4332-9eca-284867f92711 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:38.651733 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad4589b-2053-4912-a71f-fc005bb18e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:38.653477 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad4589b-2053-4912-a71f-fc005bb18e30 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:38.654504 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad4589b-2053-4912-a71f-fc005bb18e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:38.656016 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad4589b-2053-4912-a71f-fc005bb18e30 admin admin] PATH_INFO: `/v3/projects/d0262fa0e0c245ff8736a5e7ec66b4ff/users/0b264ec91cd9469c8750ab53fb89dbde/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:38.687027 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad4589b-2053-4912-a71f-fc005bb18e30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0262fa0e0c245ff8736a5e7ec66b4ff, user_id=0b264ec91cd9469c8750ab53fb89dbde, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:38.738748 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad4589b-2053-4912-a71f-fc005bb18e30 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:38.845488 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3518/7004] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:38:38 2022] PUT /identity/v3/projects/d0262fa0e0c245ff8736a5e7ec66b4ff/users/0b264ec91cd9469c8750ab53fb89dbde/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:38:38.854891 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dcf969-aefa-4471-b32c-93ebed15e0da admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:38.874338 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dcf969-aefa-4471-b32c-93ebed15e0da admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:38.975336 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7305e7a5-ae41-4b6d-9323-91fa2b16074a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:38.976943 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305e7a5-ae41-4b6d-9323-91fa2b16074a admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:38.977736 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305e7a5-ae41-4b6d-9323-91fa2b16074a admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:38.978244 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305e7a5-ae41-4b6d-9323-91fa2b16074a admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:38.979278 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7305e7a5-ae41-4b6d-9323-91fa2b16074a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:38.983460 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7305e7a5-ae41-4b6d-9323-91fa2b16074a admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:38.999439 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3487/7005] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:38:38 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:38:39.007415 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad4589b-2053-4912-a71f-fc005bb18e30 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:39.030797 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad4589b-2053-4912-a71f-fc005bb18e30 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:39.043456 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d67fc-ce16-4d43-83a5-e167f0257bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:39.045329 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d67fc-ce16-4d43-83a5-e167f0257bb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:39.045797 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d67fc-ce16-4d43-83a5-e167f0257bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:39.046395 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d67fc-ce16-4d43-83a5-e167f0257bb1 admin admin] PATH_INFO: `/v3/projects/d0262fa0e0c245ff8736a5e7ec66b4ff/users/0b264ec91cd9469c8750ab53fb89dbde/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:39.055119 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d67fc-ce16-4d43-83a5-e167f0257bb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0262fa0e0c245ff8736a5e7ec66b4ff, user_id=0b264ec91cd9469c8750ab53fb89dbde, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:39.064030 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d67fc-ce16-4d43-83a5-e167f0257bb1 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:39.088216 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3519/7006] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:38:39 2022] PUT /identity/v3/projects/d0262fa0e0c245ff8736a5e7ec66b4ff/users/0b264ec91cd9469c8750ab53fb89dbde/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:38:39.101457 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1af80-2d6f-4f3e-857c-f9a051ee20e5 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:39.102864 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1af80-2d6f-4f3e-857c-f9a051ee20e5 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:39.103814 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1af80-2d6f-4f3e-857c-f9a051ee20e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:39.165397 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-56b1af80-2d6f-4f3e-857c-f9a051ee20e5 None None] MFA Rules not processed for user `0b264ec91cd9469c8750ab53fb89dbde`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:38:39.170453 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-56b1af80-2d6f-4f3e-857c-f9a051ee20e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:39.316122 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3488/7007] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:38:39 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:38:39.320439 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d67fc-ce16-4d43-83a5-e167f0257bb1 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:39.411088 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d67fc-ce16-4d43-83a5-e167f0257bb1 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:39.420882 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef7a924-ade9-43f2-b89c-13970bb7097f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:39.421968 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef7a924-ade9-43f2-b89c-13970bb7097f admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:39.422418 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef7a924-ade9-43f2-b89c-13970bb7097f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:39.422895 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef7a924-ade9-43f2-b89c-13970bb7097f admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:39.424187 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef7a924-ade9-43f2-b89c-13970bb7097f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:39.428495 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef7a924-ade9-43f2-b89c-13970bb7097f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:39.612732 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3520/7008] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:38:39 2022] POST /identity/v3/projects => generated 397 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:38:39.616706 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b1af80-2d6f-4f3e-857c-f9a051ee20e5 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:39.634576 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b1af80-2d6f-4f3e-857c-f9a051ee20e5 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:39.735822 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2037a0c8-57df-4192-9377-c7a83e5a4e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:39.738149 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037a0c8-57df-4192-9377-c7a83e5a4e91 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:39.738149 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037a0c8-57df-4192-9377-c7a83e5a4e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:39.738149 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037a0c8-57df-4192-9377-c7a83e5a4e91 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:39.739132 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2037a0c8-57df-4192-9377-c7a83e5a4e91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:39.743190 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2037a0c8-57df-4192-9377-c7a83e5a4e91 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:39.843568 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3489/7009] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:38:39 2022] POST /identity/v3/users => generated 299 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:38:39.845674 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef7a924-ade9-43f2-b89c-13970bb7097f admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:39.858058 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef7a924-ade9-43f2-b89c-13970bb7097f admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:39.865506 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c0e3e-b3ee-4c16-b41a-c8054f221142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:39.866870 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c0e3e-b3ee-4c16-b41a-c8054f221142 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:39.867431 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c0e3e-b3ee-4c16-b41a-c8054f221142 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:39.867993 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c0e3e-b3ee-4c16-b41a-c8054f221142 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:39.869221 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6c0e3e-b3ee-4c16-b41a-c8054f221142 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:39.871212 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6c0e3e-b3ee-4c16-b41a-c8054f221142 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:39.884685 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3521/7010] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:38:39 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:38:39.888291 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2037a0c8-57df-4192-9377-c7a83e5a4e91 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:39.901896 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2037a0c8-57df-4192-9377-c7a83e5a4e91 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:39.916337 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f7078e-a4f3-4b90-a78a-0dd5c851b98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:39.917298 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7078e-a4f3-4b90-a78a-0dd5c851b98a admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:39.917768 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7078e-a4f3-4b90-a78a-0dd5c851b98a admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:39.918409 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7078e-a4f3-4b90-a78a-0dd5c851b98a admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:39.919323 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f7078e-a4f3-4b90-a78a-0dd5c851b98a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:39.922311 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f7078e-a4f3-4b90-a78a-0dd5c851b98a admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:39.939026 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3490/7011] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:38:39 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:38:39.943263 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c0e3e-b3ee-4c16-b41a-c8054f221142 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:39.957546 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c0e3e-b3ee-4c16-b41a-c8054f221142 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:39.970496 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697f8a46-aa41-4014-b3d9-df4095cad8c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:39.971975 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697f8a46-aa41-4014-b3d9-df4095cad8c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:39.972609 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697f8a46-aa41-4014-b3d9-df4095cad8c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:39.973066 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697f8a46-aa41-4014-b3d9-df4095cad8c9 admin admin] PATH_INFO: `/v3/projects/5795324cb87f4d5a9517970e8b3f0088/users/33f754bafc7142acb3aa75cdd513b797/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:40.007968 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697f8a46-aa41-4014-b3d9-df4095cad8c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5795324cb87f4d5a9517970e8b3f0088, user_id=33f754bafc7142acb3aa75cdd513b797, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:40.011728 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697f8a46-aa41-4014-b3d9-df4095cad8c9 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:40.126156 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3522/7012] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:38:39 2022] PUT /identity/v3/projects/5795324cb87f4d5a9517970e8b3f0088/users/33f754bafc7142acb3aa75cdd513b797/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:38:40.137838 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386da33-49fe-42e5-b240-b050fb541160 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:40.138143 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386da33-49fe-42e5-b240-b050fb541160 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:40.138545 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386da33-49fe-42e5-b240-b050fb541160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:40.195585 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-0386da33-49fe-42e5-b240-b050fb541160 None None] MFA Rules not processed for user `33f754bafc7142acb3aa75cdd513b797`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:38:40.197018 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-0386da33-49fe-42e5-b240-b050fb541160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:40.364373 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3491/7013] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:38:40 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:38:40.377275 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697f8a46-aa41-4014-b3d9-df4095cad8c9 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:40.382349 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-697f8a46-aa41-4014-b3d9-df4095cad8c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:40.489005 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697f8a46-aa41-4014-b3d9-df4095cad8c9 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:40.494682 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d20840-ac8c-4558-8dfc-36ed85c9d6d7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b5cb86f190f4fcfb06d66cb8f14643f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:40.495659 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d20840-ac8c-4558-8dfc-36ed85c9d6d7 service glance] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:40.496018 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d20840-ac8c-4558-8dfc-36ed85c9d6d7 service glance] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:40.496364 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d20840-ac8c-4558-8dfc-36ed85c9d6d7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:40.582054 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d20840-ac8c-4558-8dfc-36ed85c9d6d7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:40.584754 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d20840-ac8c-4558-8dfc-36ed85c9d6d7 service glance] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:40.596606 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3523/7014] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:38:40 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:38:41.100164 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0386da33-49fe-42e5-b240-b050fb541160 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:41.101671 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-0386da33-49fe-42e5-b240-b050fb541160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:41.187387 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0386da33-49fe-42e5-b240-b050fb541160 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:41.204815 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f171d8c-d2a4-4a1f-9913-00e5be0aec9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:41.207530 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f171d8c-d2a4-4a1f-9913-00e5be0aec9f service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:41.207834 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f171d8c-d2a4-4a1f-9913-00e5be0aec9f service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:41.208121 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f171d8c-d2a4-4a1f-9913-00e5be0aec9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:41.210192 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-0f171d8c-d2a4-4a1f-9913-00e5be0aec9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:41.293951 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f171d8c-d2a4-4a1f-9913-00e5be0aec9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:41.296728 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f171d8c-d2a4-4a1f-9913-00e5be0aec9f service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:41.316883 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3492/7015] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:38:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:38:41.584651 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d20840-ac8c-4558-8dfc-36ed85c9d6d7 service glance] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:41.601733 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d20840-ac8c-4558-8dfc-36ed85c9d6d7 service glance] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:41.618552 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7123f4f-293d-40e2-95e1-01c036bfb120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:41.621162 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7123f4f-293d-40e2-95e1-01c036bfb120 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:41.621892 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7123f4f-293d-40e2-95e1-01c036bfb120 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:41.622183 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7123f4f-293d-40e2-95e1-01c036bfb120 admin admin] PATH_INFO: `/v3/users/0b264ec91cd9469c8750ab53fb89dbde` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:41.627503 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7123f4f-293d-40e2-95e1-01c036bfb120 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b264ec91cd9469c8750ab53fb89dbde)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:41.634635 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7123f4f-293d-40e2-95e1-01c036bfb120 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:41.866698 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f7123f4f-293d-40e2-95e1-01c036bfb120 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b264ec91cd9469c8750ab53fb89dbde'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:41.887121 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f7123f4f-293d-40e2-95e1-01c036bfb120 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b264ec91cd9469c8750ab53fb89dbde'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:41.902375 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f7123f4f-293d-40e2-95e1-01c036bfb120 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b264ec91cd9469c8750ab53fb89dbde'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:42.053559 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f7123f4f-293d-40e2-95e1-01c036bfb120 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b264ec91cd9469c8750ab53fb89dbde'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:42.054752 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f7123f4f-293d-40e2-95e1-01c036bfb120 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b264ec91cd9469c8750ab53fb89dbde'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:42.081825 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3524/7016] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:38:41 2022] DELETE /identity/v3/users/0b264ec91cd9469c8750ab53fb89dbde => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:38:42.087431 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea7bbd-e619-4b93-a9ce-0da7ffdeadff None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:42.092106 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea7bbd-e619-4b93-a9ce-0da7ffdeadff None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:42.092106 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea7bbd-e619-4b93-a9ce-0da7ffdeadff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:42.116152 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-97ea7bbd-e619-4b93-a9ce-0da7ffdeadff None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:38:42.117387 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-97ea7bbd-e619-4b93-a9ce-0da7ffdeadff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:42.229553 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3493/7017] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:38:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:38:42.277526 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7123f4f-293d-40e2-95e1-01c036bfb120 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:42.279455 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-f7123f4f-293d-40e2-95e1-01c036bfb120 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:42.389427 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7123f4f-293d-40e2-95e1-01c036bfb120 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:42.395649 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794a3d1e-a257-4ce9-aae6-aae90ce1a08f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:42.396818 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a3d1e-a257-4ce9-aae6-aae90ce1a08f service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:42.397276 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a3d1e-a257-4ce9-aae6-aae90ce1a08f service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:42.397777 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a3d1e-a257-4ce9-aae6-aae90ce1a08f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:42.409675 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea7bbd-e619-4b93-a9ce-0da7ffdeadff None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:42.411736 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-97ea7bbd-e619-4b93-a9ce-0da7ffdeadff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:42.423083 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794a3d1e-a257-4ce9-aae6-aae90ce1a08f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:42.425015 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794a3d1e-a257-4ce9-aae6-aae90ce1a08f service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:42.433582 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea7bbd-e619-4b93-a9ce-0da7ffdeadff None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:42.449566 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3525/7018] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:38:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:38:42.452504 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e82721-a489-4753-9472-b766dba1c404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:42.453538 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e82721-a489-4753-9472-b766dba1c404 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:42.453837 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e82721-a489-4753-9472-b766dba1c404 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:42.454139 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e82721-a489-4753-9472-b766dba1c404 admin admin] PATH_INFO: `/v3/users/a8e967d05266477dbc5748ed77b8c69e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:42.458345 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e82721-a489-4753-9472-b766dba1c404 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8e967d05266477dbc5748ed77b8c69e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:42.463063 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e82721-a489-4753-9472-b766dba1c404 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:42.681440 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-21e82721-a489-4753-9472-b766dba1c404 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8e967d05266477dbc5748ed77b8c69e'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:42.689044 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-21e82721-a489-4753-9472-b766dba1c404 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8e967d05266477dbc5748ed77b8c69e'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:42.689823 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-21e82721-a489-4753-9472-b766dba1c404 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8e967d05266477dbc5748ed77b8c69e'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:42.796014 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-21e82721-a489-4753-9472-b766dba1c404 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8e967d05266477dbc5748ed77b8c69e'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:42.846561 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-21e82721-a489-4753-9472-b766dba1c404 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8e967d05266477dbc5748ed77b8c69e'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:42.866290 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3494/7019] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:38:42 2022] DELETE /identity/v3/users/a8e967d05266477dbc5748ed77b8c69e => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:38:43.181009 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794a3d1e-a257-4ce9-aae6-aae90ce1a08f service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:43.186017 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-794a3d1e-a257-4ce9-aae6-aae90ce1a08f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:43.205352 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794a3d1e-a257-4ce9-aae6-aae90ce1a08f service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:43.419358 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e82721-a489-4753-9472-b766dba1c404 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:43.423243 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761eaee1-f8a5-480e-a7af-a332c211ab18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:43.424598 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-21e82721-a489-4753-9472-b766dba1c404 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:43.425224 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761eaee1-f8a5-480e-a7af-a332c211ab18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:43.425839 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761eaee1-f8a5-480e-a7af-a332c211ab18 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:43.429372 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761eaee1-f8a5-480e-a7af-a332c211ab18 admin admin] PATH_INFO: `/v3/projects/d0262fa0e0c245ff8736a5e7ec66b4ff` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:43.437874 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761eaee1-f8a5-480e-a7af-a332c211ab18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0262fa0e0c245ff8736a5e7ec66b4ff)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:43.448020 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761eaee1-f8a5-480e-a7af-a332c211ab18 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:43.505684 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e82721-a489-4753-9472-b766dba1c404 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:43.522922 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcbc3d2-af02-484b-b6af-db7106bbaa6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:43.525141 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcbc3d2-af02-484b-b6af-db7106bbaa6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:43.526652 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcbc3d2-af02-484b-b6af-db7106bbaa6d admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:43.530251 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcbc3d2-af02-484b-b6af-db7106bbaa6d admin admin] PATH_INFO: `/v3/projects/162610ac2697486d8a05f41713cc5ba2` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:43.533122 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcbc3d2-af02-484b-b6af-db7106bbaa6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=162610ac2697486d8a05f41713cc5ba2)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:43.535511 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcbc3d2-af02-484b-b6af-db7106bbaa6d admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:43.660899 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-761eaee1-f8a5-480e-a7af-a332c211ab18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0262fa0e0c245ff8736a5e7ec66b4ff', 'request_id': 'req-761eaee1-f8a5-480e-a7af-a332c211ab18'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:43.679111 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-761eaee1-f8a5-480e-a7af-a332c211ab18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0262fa0e0c245ff8736a5e7ec66b4ff', 'request_id': 'req-761eaee1-f8a5-480e-a7af-a332c211ab18'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:43.747519 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0bcbc3d2-af02-484b-b6af-db7106bbaa6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '162610ac2697486d8a05f41713cc5ba2', 'request_id': 'req-0bcbc3d2-af02-484b-b6af-db7106bbaa6d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:43.765783 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0bcbc3d2-af02-484b-b6af-db7106bbaa6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '162610ac2697486d8a05f41713cc5ba2', 'request_id': 'req-0bcbc3d2-af02-484b-b6af-db7106bbaa6d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:43.775193 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0bcbc3d2-af02-484b-b6af-db7106bbaa6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '162610ac2697486d8a05f41713cc5ba2', 'request_id': 'req-0bcbc3d2-af02-484b-b6af-db7106bbaa6d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:43.778260 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-761eaee1-f8a5-480e-a7af-a332c211ab18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0262fa0e0c245ff8736a5e7ec66b4ff', 'request_id': 'req-761eaee1-f8a5-480e-a7af-a332c211ab18'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:43.805533 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-761eaee1-f8a5-480e-a7af-a332c211ab18 admin admin] The token cache is being invalidate because project d0262fa0e0c245ff8736a5e7ec66b4ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:38:43.805931 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-761eaee1-f8a5-480e-a7af-a332c211ab18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:43.807997 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-761eaee1-f8a5-480e-a7af-a332c211ab18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:43.811611 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3526/7020] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:38:43 2022] DELETE /identity/v3/projects/d0262fa0e0c245ff8736a5e7ec66b4ff => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:38:43.814994 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761eaee1-f8a5-480e-a7af-a332c211ab18 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:43.820396 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-761eaee1-f8a5-480e-a7af-a332c211ab18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:43.914345 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761eaee1-f8a5-480e-a7af-a332c211ab18 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:43.930998 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0bcbc3d2-af02-484b-b6af-db7106bbaa6d admin admin] The token cache is being invalidate because project 162610ac2697486d8a05f41713cc5ba2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:38:43.931732 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0bcbc3d2-af02-484b-b6af-db7106bbaa6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:43.932638 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0bcbc3d2-af02-484b-b6af-db7106bbaa6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:43.935813 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3495/7021] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:38:43 2022] DELETE /identity/v3/projects/162610ac2697486d8a05f41713cc5ba2 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:38:43.941339 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db704734-4f0d-4ab2-ac0d-72a8b70d40d9 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:43.942130 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db704734-4f0d-4ab2-ac0d-72a8b70d40d9 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:43.942651 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db704734-4f0d-4ab2-ac0d-72a8b70d40d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:43.967650 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-db704734-4f0d-4ab2-ac0d-72a8b70d40d9 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:38:43.970069 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-db704734-4f0d-4ab2-ac0d-72a8b70d40d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:44.013504 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e80e24-f8e0-4b87-8666-57080c218098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:44.014841 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e80e24-f8e0-4b87-8666-57080c218098 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:44.015706 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e80e24-f8e0-4b87-8666-57080c218098 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:44.016102 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e80e24-f8e0-4b87-8666-57080c218098 admin admin] PATH_INFO: `/v3/users/33f754bafc7142acb3aa75cdd513b797` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:44.017606 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e80e24-f8e0-4b87-8666-57080c218098 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33f754bafc7142acb3aa75cdd513b797)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:44.020462 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e80e24-f8e0-4b87-8666-57080c218098 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:44.112896 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3496/7022] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:38:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:38:44.119913 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29929dc-70d5-44a4-9006-7676d6a67475 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:44.120210 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29929dc-70d5-44a4-9006-7676d6a67475 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:44.120475 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29929dc-70d5-44a4-9006-7676d6a67475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:44.151337 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-c29929dc-70d5-44a4-9006-7676d6a67475 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:38:44.152543 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c29929dc-70d5-44a4-9006-7676d6a67475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:44.164582 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3497/7023] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:38:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:38:44.168456 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29929dc-70d5-44a4-9006-7676d6a67475 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:44.181744 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29929dc-70d5-44a4-9006-7676d6a67475 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:44.188391 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e78fd5-30b6-4988-9401-037668017c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:44.189151 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e78fd5-30b6-4988-9401-037668017c8b admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:44.189510 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e78fd5-30b6-4988-9401-037668017c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:44.189864 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e78fd5-30b6-4988-9401-037668017c8b admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:44.190668 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e78fd5-30b6-4988-9401-037668017c8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:38:44.191046 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e78fd5-30b6-4988-9401-037668017c8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:44.192847 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e78fd5-30b6-4988-9401-037668017c8b admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:44.217772 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3498/7024] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:38:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:38:44.219621 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e78fd5-30b6-4988-9401-037668017c8b admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:44.243836 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e78fd5-30b6-4988-9401-037668017c8b admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:44.256278 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64f9a68-9da7-4cd8-8725-fcc8cfc8361c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:44.257577 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f9a68-9da7-4cd8-8725-fcc8cfc8361c admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:44.257577 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f9a68-9da7-4cd8-8725-fcc8cfc8361c admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:44.257577 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f9a68-9da7-4cd8-8725-fcc8cfc8361c admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:44.258885 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64f9a68-9da7-4cd8-8725-fcc8cfc8361c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:44.261136 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64f9a68-9da7-4cd8-8725-fcc8cfc8361c admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:44.319504 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e0e80e24-f8e0-4b87-8666-57080c218098 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33f754bafc7142acb3aa75cdd513b797'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:44.348774 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e0e80e24-f8e0-4b87-8666-57080c218098 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33f754bafc7142acb3aa75cdd513b797'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:44.377832 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e0e80e24-f8e0-4b87-8666-57080c218098 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33f754bafc7142acb3aa75cdd513b797'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:44.382469 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3499/7025] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:38:44 2022] POST /identity/v3/projects => generated 391 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:38:44.386247 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64f9a68-9da7-4cd8-8725-fcc8cfc8361c admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:44.476326 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64f9a68-9da7-4cd8-8725-fcc8cfc8361c admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:44.481148 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e0e80e24-f8e0-4b87-8666-57080c218098 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33f754bafc7142acb3aa75cdd513b797'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:44.482196 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e0e80e24-f8e0-4b87-8666-57080c218098 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33f754bafc7142acb3aa75cdd513b797'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:44.490068 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3527/7026] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:38:43 2022] DELETE /identity/v3/users/33f754bafc7142acb3aa75cdd513b797 => generated 0 bytes in 676 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:38:44.493476 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e59d82-04ce-4eeb-bb5f-d4d5545af34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:44.494591 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e59d82-04ce-4eeb-bb5f-d4d5545af34f admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:44.495691 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e59d82-04ce-4eeb-bb5f-d4d5545af34f admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:44.496810 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e59d82-04ce-4eeb-bb5f-d4d5545af34f admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:44.497777 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e59d82-04ce-4eeb-bb5f-d4d5545af34f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:44.500551 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e59d82-04ce-4eeb-bb5f-d4d5545af34f admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:44.602301 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3500/7027] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:38:44 2022] POST /identity/v3/users => generated 296 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:38:44.606639 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e80e24-f8e0-4b87-8666-57080c218098 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:44.608967 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e0e80e24-f8e0-4b87-8666-57080c218098 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:44.692363 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e80e24-f8e0-4b87-8666-57080c218098 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:44.703630 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48319f86-3b09-4c19-a29e-a3935ff28865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:44.717582 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48319f86-3b09-4c19-a29e-a3935ff28865 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:44.718848 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48319f86-3b09-4c19-a29e-a3935ff28865 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:44.720039 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48319f86-3b09-4c19-a29e-a3935ff28865 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:44.720992 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48319f86-3b09-4c19-a29e-a3935ff28865 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:44.722790 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48319f86-3b09-4c19-a29e-a3935ff28865 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:44.736490 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3528/7028] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:38:44 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:38:44.739697 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e59d82-04ce-4eeb-bb5f-d4d5545af34f admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:44.751610 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e59d82-04ce-4eeb-bb5f-d4d5545af34f admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:44.777322 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6be25b-71b8-46a6-b574-b664216a64ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:44.779908 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6be25b-71b8-46a6-b574-b664216a64ce admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:44.779908 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6be25b-71b8-46a6-b574-b664216a64ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:44.780413 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6be25b-71b8-46a6-b574-b664216a64ce admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:44.780869 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6be25b-71b8-46a6-b574-b664216a64ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:44.782484 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6be25b-71b8-46a6-b574-b664216a64ce admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:44.796728 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3501/7029] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:38:44 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:38:44.800418 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48319f86-3b09-4c19-a29e-a3935ff28865 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:44.816815 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48319f86-3b09-4c19-a29e-a3935ff28865 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:44.826444 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359c359a-9668-4e1a-b474-a572f1ce74bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:44.827369 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c359a-9668-4e1a-b474-a572f1ce74bb admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:44.828922 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c359a-9668-4e1a-b474-a572f1ce74bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:44.829214 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c359a-9668-4e1a-b474-a572f1ce74bb admin admin] PATH_INFO: `/v3/projects/74928faf25b04ff1ad55aeed69b6d573/users/0fbfc456f35f40f7b068b0afbfb49633/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:44.848855 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359c359a-9668-4e1a-b474-a572f1ce74bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=74928faf25b04ff1ad55aeed69b6d573, user_id=0fbfc456f35f40f7b068b0afbfb49633, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:44.851691 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359c359a-9668-4e1a-b474-a572f1ce74bb admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:44.973866 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3529/7030] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:38:44 2022] PUT /identity/v3/projects/74928faf25b04ff1ad55aeed69b6d573/users/0fbfc456f35f40f7b068b0afbfb49633/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:38:44.987926 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4d609d-75e5-4168-9f0d-d6a40db00f6e None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:44.988541 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4d609d-75e5-4168-9f0d-d6a40db00f6e None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:44.988886 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4d609d-75e5-4168-9f0d-d6a40db00f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:45.018634 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-0d4d609d-75e5-4168-9f0d-d6a40db00f6e None None] MFA Rules not processed for user `0fbfc456f35f40f7b068b0afbfb49633`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:38:45.020078 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-0d4d609d-75e5-4168-9f0d-d6a40db00f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:45.099528 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3502/7031] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:38:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:38:45.112312 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359c359a-9668-4e1a-b474-a572f1ce74bb admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:45.114464 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-359c359a-9668-4e1a-b474-a572f1ce74bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:45.116315 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4d609d-75e5-4168-9f0d-d6a40db00f6e None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:45.118346 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-0d4d609d-75e5-4168-9f0d-d6a40db00f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:45.226282 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4d609d-75e5-4168-9f0d-d6a40db00f6e None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:45.234523 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40161966-4c7f-4627-ab19-e01afc220b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:45.235880 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40161966-4c7f-4627-ab19-e01afc220b38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:45.236274 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40161966-4c7f-4627-ab19-e01afc220b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:45.236742 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40161966-4c7f-4627-ab19-e01afc220b38 admin admin] PATH_INFO: `/v3/projects/5795324cb87f4d5a9517970e8b3f0088` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:45.238256 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40161966-4c7f-4627-ab19-e01afc220b38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5795324cb87f4d5a9517970e8b3f0088)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:45.240422 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40161966-4c7f-4627-ab19-e01afc220b38 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:45.271799 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359c359a-9668-4e1a-b474-a572f1ce74bb admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:45.276175 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de93f32-1c51-43fd-86cd-5cb006caaa2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198271d1c0d44cb58bace41a65f4b94c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:45.277036 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de93f32-1c51-43fd-86cd-5cb006caaa2d service cinder] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:45.277492 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de93f32-1c51-43fd-86cd-5cb006caaa2d service cinder] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:45.283329 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de93f32-1c51-43fd-86cd-5cb006caaa2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:45.290189 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de93f32-1c51-43fd-86cd-5cb006caaa2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:45.292755 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de93f32-1c51-43fd-86cd-5cb006caaa2d service cinder] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:45.307831 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3530/7032] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:38:45 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:38:45.309003 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de93f32-1c51-43fd-86cd-5cb006caaa2d service cinder] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:45.310701 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-8de93f32-1c51-43fd-86cd-5cb006caaa2d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:45.336825 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de93f32-1c51-43fd-86cd-5cb006caaa2d service cinder] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:45.342100 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb6f988-805a-4a66-abe4-b89a26963cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:45.343212 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6f988-805a-4a66-abe4-b89a26963cde admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:45.344136 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6f988-805a-4a66-abe4-b89a26963cde admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:45.344589 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6f988-805a-4a66-abe4-b89a26963cde admin admin] PATH_INFO: `/v3/users/4319690d69584655bded3ff4dc0eb050` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:45.346236 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb6f988-805a-4a66-abe4-b89a26963cde admin admin] RBAC: Authorizing `identity:delete_user(user_id=4319690d69584655bded3ff4dc0eb050)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:45.349532 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb6f988-805a-4a66-abe4-b89a26963cde admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:45.400564 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-40161966-4c7f-4627-ab19-e01afc220b38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5795324cb87f4d5a9517970e8b3f0088', 'request_id': 'req-40161966-4c7f-4627-ab19-e01afc220b38'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:45.409893 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-40161966-4c7f-4627-ab19-e01afc220b38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5795324cb87f4d5a9517970e8b3f0088', 'request_id': 'req-40161966-4c7f-4627-ab19-e01afc220b38'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:45.420244 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-40161966-4c7f-4627-ab19-e01afc220b38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5795324cb87f4d5a9517970e8b3f0088', 'request_id': 'req-40161966-4c7f-4627-ab19-e01afc220b38'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:45.549030 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-40161966-4c7f-4627-ab19-e01afc220b38 admin admin] The token cache is being invalidate because project 5795324cb87f4d5a9517970e8b3f0088 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:38:45.550026 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-40161966-4c7f-4627-ab19-e01afc220b38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:45.552221 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-40161966-4c7f-4627-ab19-e01afc220b38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:45.553249 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3503/7033] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:38:45 2022] DELETE /identity/v3/projects/5795324cb87f4d5a9517970e8b3f0088 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:38:45.559224 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47843d27-a5cf-44a6-9848-b01d11d53190 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:45.559772 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47843d27-a5cf-44a6-9848-b01d11d53190 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:45.560310 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47843d27-a5cf-44a6-9848-b01d11d53190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:45.587202 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-47843d27-a5cf-44a6-9848-b01d11d53190 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:38:45.593878 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-47843d27-a5cf-44a6-9848-b01d11d53190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:45.653609 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-4eb6f988-805a-4a66-abe4-b89a26963cde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4319690d69584655bded3ff4dc0eb050'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:45.683462 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-4eb6f988-805a-4a66-abe4-b89a26963cde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4319690d69584655bded3ff4dc0eb050'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:45.707070 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-4eb6f988-805a-4a66-abe4-b89a26963cde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4319690d69584655bded3ff4dc0eb050'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:45.739429 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3504/7034] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:38:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:38:45.740928 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac601e27-5637-4395-b8a2-f9c23f4c3533 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:45.743363 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac601e27-5637-4395-b8a2-f9c23f4c3533 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:45.743695 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac601e27-5637-4395-b8a2-f9c23f4c3533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:45.792015 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-ac601e27-5637-4395-b8a2-f9c23f4c3533 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:38:45.793225 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-ac601e27-5637-4395-b8a2-f9c23f4c3533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:45.802632 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3505/7035] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:38:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:38:45.806987 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac601e27-5637-4395-b8a2-f9c23f4c3533 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:45.817726 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac601e27-5637-4395-b8a2-f9c23f4c3533 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:45.822657 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d1949-3251-4499-b702-847abb1f7255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:45.823340 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d1949-3251-4499-b702-847abb1f7255 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:45.823659 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d1949-3251-4499-b702-847abb1f7255 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:45.823944 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d1949-3251-4499-b702-847abb1f7255 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:45.824673 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4d1949-3251-4499-b702-847abb1f7255 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:38:45.824975 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4d1949-3251-4499-b702-847abb1f7255 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:45.827258 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4d1949-3251-4499-b702-847abb1f7255 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:45.840342 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3506/7036] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:38:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:38:45.845147 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d1949-3251-4499-b702-847abb1f7255 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:45.856685 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d1949-3251-4499-b702-847abb1f7255 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:45.867874 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcdf504-2d34-46fa-a734-7e16719bd16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:45.868558 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcdf504-2d34-46fa-a734-7e16719bd16b admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:45.868847 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcdf504-2d34-46fa-a734-7e16719bd16b admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:45.869055 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-4eb6f988-805a-4a66-abe4-b89a26963cde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4319690d69584655bded3ff4dc0eb050'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:45.869179 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcdf504-2d34-46fa-a734-7e16719bd16b admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:45.871022 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcdf504-2d34-46fa-a734-7e16719bd16b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:45.871876 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-4eb6f988-805a-4a66-abe4-b89a26963cde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4319690d69584655bded3ff4dc0eb050'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:45.875749 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcdf504-2d34-46fa-a734-7e16719bd16b admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:45.887690 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3531/7037] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:38:45 2022] DELETE /identity/v3/users/4319690d69584655bded3ff4dc0eb050 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:38:45.892830 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a225be5c-f59c-40f0-919c-7cbb9a387195 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:45.893125 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a225be5c-f59c-40f0-919c-7cbb9a387195 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:45.893406 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a225be5c-f59c-40f0-919c-7cbb9a387195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:45.922073 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-a225be5c-f59c-40f0-919c-7cbb9a387195 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:38:45.924925 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-a225be5c-f59c-40f0-919c-7cbb9a387195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:45.979711 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3507/7038] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:38:45 2022] POST /identity/v3/projects => generated 369 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:38:45.984576 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcdf504-2d34-46fa-a734-7e16719bd16b admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:45.987126 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-edcdf504-2d34-46fa-a734-7e16719bd16b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:46.040385 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3532/7039] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:38:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:38:46.128384 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcdf504-2d34-46fa-a734-7e16719bd16b admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:46.161429 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0204bcc-aae2-42ee-8b69-b97ac3258d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:46.164004 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0204bcc-aae2-42ee-8b69-b97ac3258d86 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:46.165349 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0204bcc-aae2-42ee-8b69-b97ac3258d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:46.165713 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0204bcc-aae2-42ee-8b69-b97ac3258d86 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:46.168233 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0204bcc-aae2-42ee-8b69-b97ac3258d86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:46.170394 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0204bcc-aae2-42ee-8b69-b97ac3258d86 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:46.283033 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3508/7040] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:38:45 2022] POST /identity/v3/users => generated 285 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:38:46.287354 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a225be5c-f59c-40f0-919c-7cbb9a387195 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:46.299149 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a225be5c-f59c-40f0-919c-7cbb9a387195 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:46.312503 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f64df6-f87a-474b-96bf-2f46cad04ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:46.313199 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f64df6-f87a-474b-96bf-2f46cad04ec2 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:46.313495 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f64df6-f87a-474b-96bf-2f46cad04ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:46.313771 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f64df6-f87a-474b-96bf-2f46cad04ec2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:46.314512 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f64df6-f87a-474b-96bf-2f46cad04ec2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:46.320781 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f64df6-f87a-474b-96bf-2f46cad04ec2 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:46.359941 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3533/7041] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:38:46.364351 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0204bcc-aae2-42ee-8b69-b97ac3258d86 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:46.396055 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0204bcc-aae2-42ee-8b69-b97ac3258d86 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:46.404933 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23b8a0-6979-49b8-93a6-6d59dea460bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:46.405661 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23b8a0-6979-49b8-93a6-6d59dea460bd admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:46.405949 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23b8a0-6979-49b8-93a6-6d59dea460bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:46.406275 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23b8a0-6979-49b8-93a6-6d59dea460bd admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:46.408211 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b23b8a0-6979-49b8-93a6-6d59dea460bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:46.409523 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b23b8a0-6979-49b8-93a6-6d59dea460bd admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:46.423524 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3509/7042] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:38:46.426450 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f64df6-f87a-474b-96bf-2f46cad04ec2 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:46.438593 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f64df6-f87a-474b-96bf-2f46cad04ec2 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:46.443692 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357d3803-1c46-4ca5-92e9-7d5d0086be7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:46.444782 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d3803-1c46-4ca5-92e9-7d5d0086be7e admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:46.445184 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d3803-1c46-4ca5-92e9-7d5d0086be7e admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:46.445675 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d3803-1c46-4ca5-92e9-7d5d0086be7e admin admin] PATH_INFO: `/v3/projects/a9bd0567ddff48ac9abc5e0ae0494b38/users/2e84b773d7ed483882aab9492e9c597f/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:46.463629 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357d3803-1c46-4ca5-92e9-7d5d0086be7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9bd0567ddff48ac9abc5e0ae0494b38, user_id=2e84b773d7ed483882aab9492e9c597f, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:46.466535 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357d3803-1c46-4ca5-92e9-7d5d0086be7e admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:46.521557 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23b8a0-6979-49b8-93a6-6d59dea460bd admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:46.523144 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-2b23b8a0-6979-49b8-93a6-6d59dea460bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:46.570338 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3534/7043] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:38:46 2022] PUT /identity/v3/projects/a9bd0567ddff48ac9abc5e0ae0494b38/users/2e84b773d7ed483882aab9492e9c597f/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:38:46.587528 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb181150-6c45-4521-a6c0-572ea875dec1 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:46.588288 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb181150-6c45-4521-a6c0-572ea875dec1 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:46.588288 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb181150-6c45-4521-a6c0-572ea875dec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:46.615153 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23b8a0-6979-49b8-93a6-6d59dea460bd admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:46.647069 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-fb181150-6c45-4521-a6c0-572ea875dec1 None None] MFA Rules not processed for user `2e84b773d7ed483882aab9492e9c597f`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:38:46.649977 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-fb181150-6c45-4521-a6c0-572ea875dec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:46.680649 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfddd5c-4377-44f9-b1cd-9c94c876f775 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:46.681346 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfddd5c-4377-44f9-b1cd-9c94c876f775 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:46.681628 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfddd5c-4377-44f9-b1cd-9c94c876f775 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:46.681903 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfddd5c-4377-44f9-b1cd-9c94c876f775 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:46.730382 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3535/7044] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:38:46 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:38:46.736255 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb181150-6c45-4521-a6c0-572ea875dec1 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:46.757952 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfddd5c-4377-44f9-b1cd-9c94c876f775 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:46.759567 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfddd5c-4377-44f9-b1cd-9c94c876f775 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:46.771262 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3510/7045] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:38:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:38:46.817328 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb181150-6c45-4521-a6c0-572ea875dec1 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:46.822623 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a53c19c-fb5a-42a5-8abf-987bdd6536d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:46.823671 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53c19c-fb5a-42a5-8abf-987bdd6536d3 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:46.823841 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53c19c-fb5a-42a5-8abf-987bdd6536d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:46.824360 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53c19c-fb5a-42a5-8abf-987bdd6536d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:46.824888 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a53c19c-fb5a-42a5-8abf-987bdd6536d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:46.827622 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a53c19c-fb5a-42a5-8abf-987bdd6536d3 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:46.935517 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3536/7046] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:38:46 2022] POST /identity/v3/projects => generated 367 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:38:46.940148 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfddd5c-4377-44f9-b1cd-9c94c876f775 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:46.955274 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfddd5c-4377-44f9-b1cd-9c94c876f775 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:47.044358 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d53eca2-44cf-4744-8419-c7afedbab73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:47.046151 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d53eca2-44cf-4744-8419-c7afedbab73d admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:47.046151 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d53eca2-44cf-4744-8419-c7afedbab73d admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:47.046151 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d53eca2-44cf-4744-8419-c7afedbab73d admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:47.046771 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d53eca2-44cf-4744-8419-c7afedbab73d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:47.049416 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d53eca2-44cf-4744-8419-c7afedbab73d admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:47.077365 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a53c19c-fb5a-42a5-8abf-987bdd6536d3 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:47.079357 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-5a53c19c-fb5a-42a5-8abf-987bdd6536d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:47.095346 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a53c19c-fb5a-42a5-8abf-987bdd6536d3 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:47.113519 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cc4bcd-1e48-4cb2-8413-a6b91463329c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:47.114705 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc4bcd-1e48-4cb2-8413-a6b91463329c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:47.115082 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc4bcd-1e48-4cb2-8413-a6b91463329c admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:47.115775 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc4bcd-1e48-4cb2-8413-a6b91463329c admin admin] PATH_INFO: `/v3/projects/1c8d3753c9034eceb725613ccda18e12` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:47.117483 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cc4bcd-1e48-4cb2-8413-a6b91463329c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c8d3753c9034eceb725613ccda18e12)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:47.119563 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cc4bcd-1e48-4cb2-8413-a6b91463329c admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:47.156963 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3511/7047] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:38:46 2022] POST /identity/v3/users => generated 284 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:38:47.161002 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d53eca2-44cf-4744-8419-c7afedbab73d admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:47.173205 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d53eca2-44cf-4744-8419-c7afedbab73d admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:47.186792 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eee0314-d89c-4b35-9739-bcea3970b011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:47.187674 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee0314-d89c-4b35-9739-bcea3970b011 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:47.188057 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee0314-d89c-4b35-9739-bcea3970b011 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:47.188787 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee0314-d89c-4b35-9739-bcea3970b011 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:47.189476 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eee0314-d89c-4b35-9739-bcea3970b011 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:47.192045 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eee0314-d89c-4b35-9739-bcea3970b011 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:47.207826 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3512/7048] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:38:47 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:38:47.211162 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eee0314-d89c-4b35-9739-bcea3970b011 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:47.233673 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eee0314-d89c-4b35-9739-bcea3970b011 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:47.245943 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dd932d-eeb3-4e2c-9a35-ddfce8cc7742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:47.249628 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd932d-eeb3-4e2c-9a35-ddfce8cc7742 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:47.249928 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd932d-eeb3-4e2c-9a35-ddfce8cc7742 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:47.250214 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd932d-eeb3-4e2c-9a35-ddfce8cc7742 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:47.251359 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dd932d-eeb3-4e2c-9a35-ddfce8cc7742 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:47.253044 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dd932d-eeb3-4e2c-9a35-ddfce8cc7742 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:47.277607 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3513/7049] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:38:47 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:38:47.278166 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d7cc4bcd-1e48-4cb2-8413-a6b91463329c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c8d3753c9034eceb725613ccda18e12', 'request_id': 'req-d7cc4bcd-1e48-4cb2-8413-a6b91463329c'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:47.278538 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dd932d-eeb3-4e2c-9a35-ddfce8cc7742 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:47.291347 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dd932d-eeb3-4e2c-9a35-ddfce8cc7742 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:47.292679 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d7cc4bcd-1e48-4cb2-8413-a6b91463329c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c8d3753c9034eceb725613ccda18e12', 'request_id': 'req-d7cc4bcd-1e48-4cb2-8413-a6b91463329c'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:47.382183 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ac51b9-d13c-4bc6-98e5-778af117e1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:47.383084 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac51b9-d13c-4bc6-98e5-778af117e1ff admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:47.383367 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac51b9-d13c-4bc6-98e5-778af117e1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:47.383681 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac51b9-d13c-4bc6-98e5-778af117e1ff admin admin] PATH_INFO: `/v3/projects/029467e0e3c845f9bf7efaf2afea051f/users/7b85fe91f94e4683aceeb5861ee7fad8/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:47.402408 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ac51b9-d13c-4bc6-98e5-778af117e1ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=029467e0e3c845f9bf7efaf2afea051f, user_id=7b85fe91f94e4683aceeb5861ee7fad8, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:47.405506 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ac51b9-d13c-4bc6-98e5-778af117e1ff admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:47.444823 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d7cc4bcd-1e48-4cb2-8413-a6b91463329c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c8d3753c9034eceb725613ccda18e12', 'request_id': 'req-d7cc4bcd-1e48-4cb2-8413-a6b91463329c'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:47.458726 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d7cc4bcd-1e48-4cb2-8413-a6b91463329c admin admin] The token cache is being invalidate because project 1c8d3753c9034eceb725613ccda18e12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:38:47.459117 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d7cc4bcd-1e48-4cb2-8413-a6b91463329c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:47.459869 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d7cc4bcd-1e48-4cb2-8413-a6b91463329c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:47.461569 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3537/7050] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:38:47 2022] DELETE /identity/v3/projects/1c8d3753c9034eceb725613ccda18e12 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:38:47.468547 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b58ecf8-c95a-405a-9f29-568a7ac3d21e None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:47.474055 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b58ecf8-c95a-405a-9f29-568a7ac3d21e None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:47.474055 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b58ecf8-c95a-405a-9f29-568a7ac3d21e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:47.489131 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-4b58ecf8-c95a-405a-9f29-568a7ac3d21e None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:38:47.496272 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-4b58ecf8-c95a-405a-9f29-568a7ac3d21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:47.513725 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3538/7051] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:38:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:38:47.517490 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3514/7052] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:38:47 2022] PUT /identity/v3/projects/029467e0e3c845f9bf7efaf2afea051f/users/7b85fe91f94e4683aceeb5861ee7fad8/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:38:47.528745 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75736e05-6c2f-4f31-91b1-ded7ac8ad399 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:47.531126 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898d9aa-6c3a-4a11-b248-758e371b6232 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:47.531745 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75736e05-6c2f-4f31-91b1-ded7ac8ad399 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:47.532268 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75736e05-6c2f-4f31-91b1-ded7ac8ad399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:47.533853 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898d9aa-6c3a-4a11-b248-758e371b6232 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:47.534137 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898d9aa-6c3a-4a11-b248-758e371b6232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:47.566038 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-e898d9aa-6c3a-4a11-b248-758e371b6232 None None] MFA Rules not processed for user `7b85fe91f94e4683aceeb5861ee7fad8`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:38:47.567544 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e898d9aa-6c3a-4a11-b248-758e371b6232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:47.571740 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-75736e05-6c2f-4f31-91b1-ded7ac8ad399 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:38:47.573669 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-75736e05-6c2f-4f31-91b1-ded7ac8ad399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:47.685399 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3515/7053] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:38:47 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:38:47.721713 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3539/7054] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:38:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:38:47.721845 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e898d9aa-6c3a-4a11-b248-758e371b6232 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:47.721845 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e898d9aa-6c3a-4a11-b248-758e371b6232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:47.722042 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75736e05-6c2f-4f31-91b1-ded7ac8ad399 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:47.722042 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75736e05-6c2f-4f31-91b1-ded7ac8ad399 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:47.722042 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc44ca-af19-44e9-96ab-54c06c3d6f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:47.722042 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc44ca-af19-44e9-96ab-54c06c3d6f73 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:47.722463 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc44ca-af19-44e9-96ab-54c06c3d6f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:47.722463 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc44ca-af19-44e9-96ab-54c06c3d6f73 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:47.722463 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffc44ca-af19-44e9-96ab-54c06c3d6f73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:38:47.722463 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffc44ca-af19-44e9-96ab-54c06c3d6f73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:47.722463 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffc44ca-af19-44e9-96ab-54c06c3d6f73 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:47.734376 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3540/7055] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:38:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:38:47.741100 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc44ca-af19-44e9-96ab-54c06c3d6f73 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:47.775078 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc44ca-af19-44e9-96ab-54c06c3d6f73 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:47.789445 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4864d3c2-928d-45d7-9001-4e271bbba09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:47.790599 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4864d3c2-928d-45d7-9001-4e271bbba09c admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:47.790886 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4864d3c2-928d-45d7-9001-4e271bbba09c admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:47.791166 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4864d3c2-928d-45d7-9001-4e271bbba09c admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:47.792511 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4864d3c2-928d-45d7-9001-4e271bbba09c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:47.797652 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4864d3c2-928d-45d7-9001-4e271bbba09c admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:47.832787 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e898d9aa-6c3a-4a11-b248-758e371b6232 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:47.839354 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724b6ff3-248a-48e1-90e5-7dbc302573ac service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b5cb86f190f4fcfb06d66cb8f14643f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:47.840564 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b6ff3-248a-48e1-90e5-7dbc302573ac service glance] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:47.840564 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b6ff3-248a-48e1-90e5-7dbc302573ac service glance] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:47.840817 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b6ff3-248a-48e1-90e5-7dbc302573ac service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:47.845484 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-724b6ff3-248a-48e1-90e5-7dbc302573ac service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:47.940836 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724b6ff3-248a-48e1-90e5-7dbc302573ac service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:47.942735 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724b6ff3-248a-48e1-90e5-7dbc302573ac service glance] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:47.956276 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3516/7056] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:38:47 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:38:47.993398 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3541/7057] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:38:47 2022] POST /identity/v3/projects => generated 385 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:38:48.000635 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724b6ff3-248a-48e1-90e5-7dbc302573ac service glance] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:48.012801 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724b6ff3-248a-48e1-90e5-7dbc302573ac service glance] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:48.085273 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0119dac2-9217-4c1b-8134-1d20997a1ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:48.086285 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0119dac2-9217-4c1b-8134-1d20997a1ceb admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:48.086934 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0119dac2-9217-4c1b-8134-1d20997a1ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:48.087314 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0119dac2-9217-4c1b-8134-1d20997a1ceb admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:48.088266 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0119dac2-9217-4c1b-8134-1d20997a1ceb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:48.090583 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0119dac2-9217-4c1b-8134-1d20997a1ceb admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:48.188900 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4864d3c2-928d-45d7-9001-4e271bbba09c admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:48.189219 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3517/7058] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:38:47 2022] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:38:48.200173 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4864d3c2-928d-45d7-9001-4e271bbba09c admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:48.206220 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b863451b-12f4-4361-a8f0-9cf94bbc26eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:48.206965 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b863451b-12f4-4361-a8f0-9cf94bbc26eb admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:48.207270 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b863451b-12f4-4361-a8f0-9cf94bbc26eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:48.207554 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b863451b-12f4-4361-a8f0-9cf94bbc26eb admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:48.208536 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b863451b-12f4-4361-a8f0-9cf94bbc26eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:48.209993 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b863451b-12f4-4361-a8f0-9cf94bbc26eb admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:48.224993 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3542/7059] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:38:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:38:48.227398 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0119dac2-9217-4c1b-8134-1d20997a1ceb admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:48.250059 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0119dac2-9217-4c1b-8134-1d20997a1ceb admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:48.257974 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126f4ced-f106-4c8f-8a6c-27d814aa648d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:48.265662 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f4ced-f106-4c8f-8a6c-27d814aa648d admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:48.267138 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f4ced-f106-4c8f-8a6c-27d814aa648d admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:48.267774 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f4ced-f106-4c8f-8a6c-27d814aa648d admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:48.269935 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126f4ced-f106-4c8f-8a6c-27d814aa648d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:48.273315 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b863451b-12f4-4361-a8f0-9cf94bbc26eb admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:48.273690 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126f4ced-f106-4c8f-8a6c-27d814aa648d admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:48.297892 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3518/7060] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:38:48 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:38:48.299170 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126f4ced-f106-4c8f-8a6c-27d814aa648d admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:48.327623 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126f4ced-f106-4c8f-8a6c-27d814aa648d admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:48.350818 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92692d4-d5b1-4147-a9e5-1cf79d4d998b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:48.350818 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92692d4-d5b1-4147-a9e5-1cf79d4d998b admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:48.351469 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92692d4-d5b1-4147-a9e5-1cf79d4d998b admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:48.351826 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92692d4-d5b1-4147-a9e5-1cf79d4d998b admin admin] PATH_INFO: `/v3/projects/053ba9042deb4f0cab69f8aae86cf1fd/users/87725a05720b4dcbb090f43be8b5c36f/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:48.393121 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92692d4-d5b1-4147-a9e5-1cf79d4d998b admin admin] RBAC: Authorizing `identity:create_grant(project_id=053ba9042deb4f0cab69f8aae86cf1fd, user_id=87725a05720b4dcbb090f43be8b5c36f, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:48.396116 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92692d4-d5b1-4147-a9e5-1cf79d4d998b admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:48.416860 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b863451b-12f4-4361-a8f0-9cf94bbc26eb admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:48.421709 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7245a0f8-2ed1-4da3-aef8-1d4da58490a2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b5cb86f190f4fcfb06d66cb8f14643f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:48.422826 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7245a0f8-2ed1-4da3-aef8-1d4da58490a2 service glance] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:48.423309 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7245a0f8-2ed1-4da3-aef8-1d4da58490a2 service glance] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:48.423803 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7245a0f8-2ed1-4da3-aef8-1d4da58490a2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:48.504496 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3519/7061] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:38:48 2022] PUT /identity/v3/projects/053ba9042deb4f0cab69f8aae86cf1fd/users/87725a05720b4dcbb090f43be8b5c36f/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:38:48.505887 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249e049-cb51-4267-90c1-a861829f8500 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:48.506245 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249e049-cb51-4267-90c1-a861829f8500 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:48.506524 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249e049-cb51-4267-90c1-a861829f8500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:48.531920 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7245a0f8-2ed1-4da3-aef8-1d4da58490a2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:48.534246 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7245a0f8-2ed1-4da3-aef8-1d4da58490a2 service glance] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:48.548620 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3543/7062] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:38:48 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:38:48.564780 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-5249e049-cb51-4267-90c1-a861829f8500 None None] MFA Rules not processed for user `87725a05720b4dcbb090f43be8b5c36f`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:38:48.566054 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-5249e049-cb51-4267-90c1-a861829f8500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:48.708960 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3520/7063] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:38:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:38:48.712277 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7245a0f8-2ed1-4da3-aef8-1d4da58490a2 service glance] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:48.734187 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7245a0f8-2ed1-4da3-aef8-1d4da58490a2 service glance] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:48.845838 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97fabf2-b287-43d7-8167-a8ab769ad76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:48.846220 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97fabf2-b287-43d7-8167-a8ab769ad76f admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:48.847608 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97fabf2-b287-43d7-8167-a8ab769ad76f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:48.847608 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97fabf2-b287-43d7-8167-a8ab769ad76f admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:48.847608 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97fabf2-b287-43d7-8167-a8ab769ad76f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:48.850121 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97fabf2-b287-43d7-8167-a8ab769ad76f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:49.014804 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3544/7064] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:38:48 2022] POST /identity/v3/projects => generated 387 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:38:49.016338 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5249e049-cb51-4267-90c1-a861829f8500 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:49.038267 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5249e049-cb51-4267-90c1-a861829f8500 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:49.233595 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c16fba6-e0b7-4325-a299-bd9ff595636e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:49.234250 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c16fba6-e0b7-4325-a299-bd9ff595636e admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:49.235160 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c16fba6-e0b7-4325-a299-bd9ff595636e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:49.235582 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c16fba6-e0b7-4325-a299-bd9ff595636e admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:49.236898 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c16fba6-e0b7-4325-a299-bd9ff595636e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:49.239088 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c16fba6-e0b7-4325-a299-bd9ff595636e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:49.332537 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97fabf2-b287-43d7-8167-a8ab769ad76f admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:49.333320 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3521/7065] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:38:49 2022] POST /identity/v3/users => generated 300 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:38:49.351408 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97fabf2-b287-43d7-8167-a8ab769ad76f admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:49.363332 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a608ba1-f2b1-4804-a262-ef60e5f7be53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:49.364324 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a608ba1-f2b1-4804-a262-ef60e5f7be53 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:49.364816 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a608ba1-f2b1-4804-a262-ef60e5f7be53 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:49.365315 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a608ba1-f2b1-4804-a262-ef60e5f7be53 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:49.366223 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a608ba1-f2b1-4804-a262-ef60e5f7be53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:49.368119 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a608ba1-f2b1-4804-a262-ef60e5f7be53 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:49.382278 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3545/7066] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:38:49 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:38:49.387052 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c16fba6-e0b7-4325-a299-bd9ff595636e admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:49.404875 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c16fba6-e0b7-4325-a299-bd9ff595636e admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:49.420010 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e568e0d0-4187-4901-908a-af3e583c2c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:49.421489 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e568e0d0-4187-4901-908a-af3e583c2c10 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:49.423185 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e568e0d0-4187-4901-908a-af3e583c2c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:49.428508 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e568e0d0-4187-4901-908a-af3e583c2c10 admin admin] PATH_INFO: `/v3/projects/968517a42a22436bb2e30b0cd4836fb5/users/4643b01ac25a4723b7482547ac946fb0/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:49.461845 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e568e0d0-4187-4901-908a-af3e583c2c10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=968517a42a22436bb2e30b0cd4836fb5, user_id=4643b01ac25a4723b7482547ac946fb0, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:49.465677 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e568e0d0-4187-4901-908a-af3e583c2c10 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:49.570951 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3522/7067] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:38:49 2022] PUT /identity/v3/projects/968517a42a22436bb2e30b0cd4836fb5/users/4643b01ac25a4723b7482547ac946fb0/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:38:49.575010 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a608ba1-f2b1-4804-a262-ef60e5f7be53 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:49.586137 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a608ba1-f2b1-4804-a262-ef60e5f7be53 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:49.760531 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad86676-6c9a-49f2-9057-eefc438cbd5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:49.763850 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad86676-6c9a-49f2-9057-eefc438cbd5f admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:49.763850 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad86676-6c9a-49f2-9057-eefc438cbd5f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:49.763850 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad86676-6c9a-49f2-9057-eefc438cbd5f admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:49.763850 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad86676-6c9a-49f2-9057-eefc438cbd5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:49.765670 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad86676-6c9a-49f2-9057-eefc438cbd5f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:49.783530 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e568e0d0-4187-4901-908a-af3e583c2c10 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:49.784795 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3546/7068] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:38:49 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:38:49.804864 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e568e0d0-4187-4901-908a-af3e583c2c10 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:49.819093 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dcd7e5-3c89-43aa-bcfe-b7955de99d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:49.819979 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dcd7e5-3c89-43aa-bcfe-b7955de99d1e admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:49.821206 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dcd7e5-3c89-43aa-bcfe-b7955de99d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:49.821206 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dcd7e5-3c89-43aa-bcfe-b7955de99d1e admin admin] PATH_INFO: `/v3/projects/968517a42a22436bb2e30b0cd4836fb5/users/4643b01ac25a4723b7482547ac946fb0/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:49.827318 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dcd7e5-3c89-43aa-bcfe-b7955de99d1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=968517a42a22436bb2e30b0cd4836fb5, user_id=4643b01ac25a4723b7482547ac946fb0, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:49.832773 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dcd7e5-3c89-43aa-bcfe-b7955de99d1e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:49.859222 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3523/7069] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:38:49 2022] PUT /identity/v3/projects/968517a42a22436bb2e30b0cd4836fb5/users/4643b01ac25a4723b7482547ac946fb0/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:38:49.869428 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe1784-fcda-441f-bae0-a1dc26d3ef66 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:49.870095 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe1784-fcda-441f-bae0-a1dc26d3ef66 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:49.870655 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe1784-fcda-441f-bae0-a1dc26d3ef66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:49.912701 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-03fe1784-fcda-441f-bae0-a1dc26d3ef66 None None] MFA Rules not processed for user `4643b01ac25a4723b7482547ac946fb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:38:49.917252 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-03fe1784-fcda-441f-bae0-a1dc26d3ef66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:50.107359 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3547/7070] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:38:49 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:38:50.117104 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dcd7e5-3c89-43aa-bcfe-b7955de99d1e admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:50.119065 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b1dcd7e5-3c89-43aa-bcfe-b7955de99d1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:50.278350 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dcd7e5-3c89-43aa-bcfe-b7955de99d1e admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:50.291355 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f853d32-210f-496c-b98c-5758cc457507 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198271d1c0d44cb58bace41a65f4b94c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:50.291355 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f853d32-210f-496c-b98c-5758cc457507 service cinder] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:50.291355 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f853d32-210f-496c-b98c-5758cc457507 service cinder] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:50.303563 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f853d32-210f-496c-b98c-5758cc457507 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:50.319713 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f853d32-210f-496c-b98c-5758cc457507 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:50.322862 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f853d32-210f-496c-b98c-5758cc457507 service cinder] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:50.347682 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3524/7071] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:38:50 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:38:50.430241 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fe1784-fcda-441f-bae0-a1dc26d3ef66 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:50.559193 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fe1784-fcda-441f-bae0-a1dc26d3ef66 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:50.566044 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c016557-3976-43c4-8cbb-5964a7cbe5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:50.567202 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c016557-3976-43c4-8cbb-5964a7cbe5b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:50.567775 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c016557-3976-43c4-8cbb-5964a7cbe5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:50.568207 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c016557-3976-43c4-8cbb-5964a7cbe5b3 admin admin] PATH_INFO: `/v3/users/87725a05720b4dcbb090f43be8b5c36f` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:50.569756 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c016557-3976-43c4-8cbb-5964a7cbe5b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87725a05720b4dcbb090f43be8b5c36f)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:50.572013 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c016557-3976-43c4-8cbb-5964a7cbe5b3 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:50.804663 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9c016557-3976-43c4-8cbb-5964a7cbe5b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87725a05720b4dcbb090f43be8b5c36f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:50.826852 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9c016557-3976-43c4-8cbb-5964a7cbe5b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87725a05720b4dcbb090f43be8b5c36f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:50.835764 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9c016557-3976-43c4-8cbb-5964a7cbe5b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87725a05720b4dcbb090f43be8b5c36f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:50.942389 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9c016557-3976-43c4-8cbb-5964a7cbe5b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87725a05720b4dcbb090f43be8b5c36f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:50.943790 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9c016557-3976-43c4-8cbb-5964a7cbe5b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87725a05720b4dcbb090f43be8b5c36f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:50.958886 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3548/7072] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:38:50 2022] DELETE /identity/v3/users/87725a05720b4dcbb090f43be8b5c36f => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:38:50.965743 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2676823-fdf6-4d47-813b-6c92aa3fc708 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:50.965743 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2676823-fdf6-4d47-813b-6c92aa3fc708 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:50.965743 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2676823-fdf6-4d47-813b-6c92aa3fc708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:51.009582 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-c2676823-fdf6-4d47-813b-6c92aa3fc708 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:38:51.011605 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c2676823-fdf6-4d47-813b-6c92aa3fc708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:51.134111 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3525/7073] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:38:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:38:51.165505 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c016557-3976-43c4-8cbb-5964a7cbe5b3 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:51.168750 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-9c016557-3976-43c4-8cbb-5964a7cbe5b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:51.292774 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c016557-3976-43c4-8cbb-5964a7cbe5b3 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:51.298634 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1479198-8340-4464-a26a-3976eabfb563 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:51.299991 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1479198-8340-4464-a26a-3976eabfb563 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:51.300544 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1479198-8340-4464-a26a-3976eabfb563 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:51.300987 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1479198-8340-4464-a26a-3976eabfb563 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:51.314531 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1479198-8340-4464-a26a-3976eabfb563 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:51.316408 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1479198-8340-4464-a26a-3976eabfb563 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:51.330505 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3549/7074] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:38:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:38:52.229646 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2676823-fdf6-4d47-813b-6c92aa3fc708 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:52.232501 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c2676823-fdf6-4d47-813b-6c92aa3fc708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:52.263197 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2676823-fdf6-4d47-813b-6c92aa3fc708 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:52.279424 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6731b-a3d8-4257-9c14-8a08cc410238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:52.280741 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6731b-a3d8-4257-9c14-8a08cc410238 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:52.281192 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6731b-a3d8-4257-9c14-8a08cc410238 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:52.281632 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6731b-a3d8-4257-9c14-8a08cc410238 admin admin] PATH_INFO: `/v3/projects/053ba9042deb4f0cab69f8aae86cf1fd` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:52.283079 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe6731b-a3d8-4257-9c14-8a08cc410238 admin admin] RBAC: Authorizing `identity:delete_project(project_id=053ba9042deb4f0cab69f8aae86cf1fd)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:52.285240 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe6731b-a3d8-4257-9c14-8a08cc410238 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:52.426974 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-efe6731b-a3d8-4257-9c14-8a08cc410238 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '053ba9042deb4f0cab69f8aae86cf1fd', 'request_id': 'req-efe6731b-a3d8-4257-9c14-8a08cc410238'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:52.434421 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-efe6731b-a3d8-4257-9c14-8a08cc410238 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '053ba9042deb4f0cab69f8aae86cf1fd', 'request_id': 'req-efe6731b-a3d8-4257-9c14-8a08cc410238'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:52.448989 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-efe6731b-a3d8-4257-9c14-8a08cc410238 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '053ba9042deb4f0cab69f8aae86cf1fd', 'request_id': 'req-efe6731b-a3d8-4257-9c14-8a08cc410238'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:52.462219 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1479198-8340-4464-a26a-3976eabfb563 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:52.464389 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d1479198-8340-4464-a26a-3976eabfb563 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:52.478148 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1479198-8340-4464-a26a-3976eabfb563 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:52.540727 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af20bd-e4c2-401a-a1d1-383f2f7b2f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:52.541612 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af20bd-e4c2-401a-a1d1-383f2f7b2f8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:52.542342 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af20bd-e4c2-401a-a1d1-383f2f7b2f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:52.542342 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af20bd-e4c2-401a-a1d1-383f2f7b2f8e admin admin] PATH_INFO: `/v3/users/2e84b773d7ed483882aab9492e9c597f` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:52.543702 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21af20bd-e4c2-401a-a1d1-383f2f7b2f8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e84b773d7ed483882aab9492e9c597f)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:52.549321 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21af20bd-e4c2-401a-a1d1-383f2f7b2f8e admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:52.568175 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-efe6731b-a3d8-4257-9c14-8a08cc410238 admin admin] The token cache is being invalidate because project 053ba9042deb4f0cab69f8aae86cf1fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:38:52.568524 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-efe6731b-a3d8-4257-9c14-8a08cc410238 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:52.570951 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-efe6731b-a3d8-4257-9c14-8a08cc410238 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:52.575696 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3526/7075] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:38:52 2022] DELETE /identity/v3/projects/053ba9042deb4f0cab69f8aae86cf1fd => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:38:52.578094 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6731b-a3d8-4257-9c14-8a08cc410238 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:52.581514 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-efe6731b-a3d8-4257-9c14-8a08cc410238 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:52.614594 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6731b-a3d8-4257-9c14-8a08cc410238 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:52.626702 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7664931-dec6-4227-b719-33e886131ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:52.627639 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7664931-dec6-4227-b719-33e886131ab3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:52.627927 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7664931-dec6-4227-b719-33e886131ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:52.628425 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7664931-dec6-4227-b719-33e886131ab3 admin admin] PATH_INFO: `/v3/users/4643b01ac25a4723b7482547ac946fb0` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:52.633167 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7664931-dec6-4227-b719-33e886131ab3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4643b01ac25a4723b7482547ac946fb0)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:52.635471 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7664931-dec6-4227-b719-33e886131ab3 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:52.813353 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-21af20bd-e4c2-401a-a1d1-383f2f7b2f8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e84b773d7ed483882aab9492e9c597f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:52.824839 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-21af20bd-e4c2-401a-a1d1-383f2f7b2f8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e84b773d7ed483882aab9492e9c597f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:52.832185 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-21af20bd-e4c2-401a-a1d1-383f2f7b2f8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e84b773d7ed483882aab9492e9c597f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:52.920096 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a7664931-dec6-4227-b719-33e886131ab3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4643b01ac25a4723b7482547ac946fb0'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:52.946297 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-21af20bd-e4c2-401a-a1d1-383f2f7b2f8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e84b773d7ed483882aab9492e9c597f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:52.947164 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-21af20bd-e4c2-401a-a1d1-383f2f7b2f8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e84b773d7ed483882aab9492e9c597f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:52.957980 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a7664931-dec6-4227-b719-33e886131ab3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4643b01ac25a4723b7482547ac946fb0'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:52.959407 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a7664931-dec6-4227-b719-33e886131ab3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4643b01ac25a4723b7482547ac946fb0'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:52.967317 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3550/7076] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:38:52 2022] DELETE /identity/v3/users/2e84b773d7ed483882aab9492e9c597f => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:38:52.967317 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af20bd-e4c2-401a-a1d1-383f2f7b2f8e admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:52.967317 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-21af20bd-e4c2-401a-a1d1-383f2f7b2f8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:53.056490 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af20bd-e4c2-401a-a1d1-383f2f7b2f8e admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:53.064327 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a8f2f2-6e40-40f7-8e80-60607097647f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:53.065615 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a8f2f2-6e40-40f7-8e80-60607097647f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:53.066094 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a8f2f2-6e40-40f7-8e80-60607097647f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:53.067418 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a8f2f2-6e40-40f7-8e80-60607097647f admin admin] PATH_INFO: `/v3/users/1096012950d645a0ab7050ea661826db` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:53.069095 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a8f2f2-6e40-40f7-8e80-60607097647f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1096012950d645a0ab7050ea661826db)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:53.071623 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a8f2f2-6e40-40f7-8e80-60607097647f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:53.123111 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a7664931-dec6-4227-b719-33e886131ab3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4643b01ac25a4723b7482547ac946fb0'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:53.139568 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a7664931-dec6-4227-b719-33e886131ab3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4643b01ac25a4723b7482547ac946fb0'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:53.149779 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3527/7077] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:38:52 2022] DELETE /identity/v3/users/4643b01ac25a4723b7482547ac946fb0 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:38:53.153280 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eeb989-e7ef-429c-90fa-760dc76a5458 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:53.155965 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eeb989-e7ef-429c-90fa-760dc76a5458 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:53.161310 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eeb989-e7ef-429c-90fa-760dc76a5458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:53.178368 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-15eeb989-e7ef-429c-90fa-760dc76a5458 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:38:53.180011 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-15eeb989-e7ef-429c-90fa-760dc76a5458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:53.248287 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3528/7078] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:38:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:38:53.249845 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eeb989-e7ef-429c-90fa-760dc76a5458 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:53.251302 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-15eeb989-e7ef-429c-90fa-760dc76a5458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:53.265137 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eeb989-e7ef-429c-90fa-760dc76a5458 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:53.270964 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95150ce8-a77c-4457-89e3-7c7d229ba23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:53.272206 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95150ce8-a77c-4457-89e3-7c7d229ba23d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:53.272495 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95150ce8-a77c-4457-89e3-7c7d229ba23d admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:53.272957 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95150ce8-a77c-4457-89e3-7c7d229ba23d admin admin] PATH_INFO: `/v3/users/1a893f84b21840d2852ae1e5c320f45e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:53.274194 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95150ce8-a77c-4457-89e3-7c7d229ba23d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a893f84b21840d2852ae1e5c320f45e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:53.276465 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95150ce8-a77c-4457-89e3-7c7d229ba23d admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:53.352576 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-25a8f2f2-6e40-40f7-8e80-60607097647f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1096012950d645a0ab7050ea661826db'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:53.368745 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-25a8f2f2-6e40-40f7-8e80-60607097647f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1096012950d645a0ab7050ea661826db'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:53.379634 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-25a8f2f2-6e40-40f7-8e80-60607097647f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1096012950d645a0ab7050ea661826db'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:53.487440 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-25a8f2f2-6e40-40f7-8e80-60607097647f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1096012950d645a0ab7050ea661826db'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:53.488858 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-25a8f2f2-6e40-40f7-8e80-60607097647f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1096012950d645a0ab7050ea661826db'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:53.499658 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3551/7079] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:38:52 2022] DELETE /identity/v3/users/1096012950d645a0ab7050ea661826db => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:38:53.504559 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a8f2f2-6e40-40f7-8e80-60607097647f admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:53.508466 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-25a8f2f2-6e40-40f7-8e80-60607097647f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:53.571329 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-95150ce8-a77c-4457-89e3-7c7d229ba23d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a893f84b21840d2852ae1e5c320f45e'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:53.589671 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-95150ce8-a77c-4457-89e3-7c7d229ba23d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a893f84b21840d2852ae1e5c320f45e'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:53.591542 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-95150ce8-a77c-4457-89e3-7c7d229ba23d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a893f84b21840d2852ae1e5c320f45e'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:53.622123 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a8f2f2-6e40-40f7-8e80-60607097647f admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:53.627915 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e9bcd4-3436-4613-9c3a-67c9ac6ac179 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:53.628833 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9bcd4-3436-4613-9c3a-67c9ac6ac179 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:53.629325 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9bcd4-3436-4613-9c3a-67c9ac6ac179 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:53.629762 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9bcd4-3436-4613-9c3a-67c9ac6ac179 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:53.632143 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b4e9bcd4-3436-4613-9c3a-67c9ac6ac179 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:53.705597 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-95150ce8-a77c-4457-89e3-7c7d229ba23d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a893f84b21840d2852ae1e5c320f45e'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:53.723846 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-95150ce8-a77c-4457-89e3-7c7d229ba23d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a893f84b21840d2852ae1e5c320f45e'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:53.753605 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3529/7080] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:38:53 2022] DELETE /identity/v3/users/1a893f84b21840d2852ae1e5c320f45e => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:38:53.758500 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e22d4-522e-4ab7-a2ef-d1b696f41169 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:53.758787 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e22d4-522e-4ab7-a2ef-d1b696f41169 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:53.760670 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e22d4-522e-4ab7-a2ef-d1b696f41169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:53.804366 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-ed8e22d4-522e-4ab7-a2ef-d1b696f41169 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:38:53.806140 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-ed8e22d4-522e-4ab7-a2ef-d1b696f41169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:53.876901 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e9bcd4-3436-4613-9c3a-67c9ac6ac179 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:53.878912 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e9bcd4-3436-4613-9c3a-67c9ac6ac179 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:53.891708 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3530/7081] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:38:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:38:53.896881 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8e22d4-522e-4ab7-a2ef-d1b696f41169 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:53.898807 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-ed8e22d4-522e-4ab7-a2ef-d1b696f41169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:53.900213 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3552/7082] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:38:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:38:53.905742 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e9bcd4-3436-4613-9c3a-67c9ac6ac179 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:53.909461 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b4e9bcd4-3436-4613-9c3a-67c9ac6ac179 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:53.921442 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8e22d4-522e-4ab7-a2ef-d1b696f41169 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:53.938358 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e9bcd4-3436-4613-9c3a-67c9ac6ac179 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:53.952102 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee670b-1c4d-4981-9c26-61d0f66ee944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:53.955897 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee670b-1c4d-4981-9c26-61d0f66ee944 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:53.955897 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee670b-1c4d-4981-9c26-61d0f66ee944 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:53.955897 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee670b-1c4d-4981-9c26-61d0f66ee944 admin admin] PATH_INFO: `/v3/projects/968517a42a22436bb2e30b0cd4836fb5` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:53.957827 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ee670b-1c4d-4981-9c26-61d0f66ee944 admin admin] RBAC: Authorizing `identity:delete_project(project_id=968517a42a22436bb2e30b0cd4836fb5)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:53.960954 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ee670b-1c4d-4981-9c26-61d0f66ee944 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:54.053659 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f013ab5-6277-4303-8baa-b06ab1f11638 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:54.054919 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f013ab5-6277-4303-8baa-b06ab1f11638 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:54.055210 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f013ab5-6277-4303-8baa-b06ab1f11638 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:54.055504 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f013ab5-6277-4303-8baa-b06ab1f11638 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:54.069888 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f013ab5-6277-4303-8baa-b06ab1f11638 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:54.071856 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f013ab5-6277-4303-8baa-b06ab1f11638 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:54.096529 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3553/7083] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:38:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:38:54.110149 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-00ee670b-1c4d-4981-9c26-61d0f66ee944 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '968517a42a22436bb2e30b0cd4836fb5', 'request_id': 'req-00ee670b-1c4d-4981-9c26-61d0f66ee944'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:54.118171 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-00ee670b-1c4d-4981-9c26-61d0f66ee944 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '968517a42a22436bb2e30b0cd4836fb5', 'request_id': 'req-00ee670b-1c4d-4981-9c26-61d0f66ee944'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:54.130436 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-00ee670b-1c4d-4981-9c26-61d0f66ee944 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '968517a42a22436bb2e30b0cd4836fb5', 'request_id': 'req-00ee670b-1c4d-4981-9c26-61d0f66ee944'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:54.282544 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-00ee670b-1c4d-4981-9c26-61d0f66ee944 admin admin] The token cache is being invalidate because project 968517a42a22436bb2e30b0cd4836fb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:38:54.288249 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-00ee670b-1c4d-4981-9c26-61d0f66ee944 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:54.289669 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-00ee670b-1c4d-4981-9c26-61d0f66ee944 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:54.291637 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3531/7084] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:38:53 2022] DELETE /identity/v3/projects/968517a42a22436bb2e30b0cd4836fb5 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:38:54.298983 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0867c9dc-e323-40c8-8e2d-5e4bda87e025 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:54.299562 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0867c9dc-e323-40c8-8e2d-5e4bda87e025 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:54.300086 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0867c9dc-e323-40c8-8e2d-5e4bda87e025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:54.345769 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee670b-1c4d-4981-9c26-61d0f66ee944 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:54.348372 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-00ee670b-1c4d-4981-9c26-61d0f66ee944 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:54.359176 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-0867c9dc-e323-40c8-8e2d-5e4bda87e025 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:38:54.360509 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-0867c9dc-e323-40c8-8e2d-5e4bda87e025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:54.492227 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3554/7085] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:38:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:38:54.497773 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c897a6-8eeb-47b9-81de-4909b2b99acc None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:54.497773 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c897a6-8eeb-47b9-81de-4909b2b99acc None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:54.497773 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c897a6-8eeb-47b9-81de-4909b2b99acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:54.505930 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee670b-1c4d-4981-9c26-61d0f66ee944 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:54.511359 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615961de-2538-461e-ae32-ebefd73a40b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:54.513146 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615961de-2538-461e-ae32-ebefd73a40b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:54.514235 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615961de-2538-461e-ae32-ebefd73a40b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:54.514799 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615961de-2538-461e-ae32-ebefd73a40b5 admin admin] PATH_INFO: `/v3/projects/37fb22eb2ef44be9a5bc66079c2ad71f` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:54.517455 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615961de-2538-461e-ae32-ebefd73a40b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37fb22eb2ef44be9a5bc66079c2ad71f)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:54.524992 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615961de-2538-461e-ae32-ebefd73a40b5 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:54.535563 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-b0c897a6-8eeb-47b9-81de-4909b2b99acc None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:38:54.537352 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b0c897a6-8eeb-47b9-81de-4909b2b99acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:54.551191 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3555/7086] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:38:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:38:54.563668 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c897a6-8eeb-47b9-81de-4909b2b99acc None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:54.583225 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c897a6-8eeb-47b9-81de-4909b2b99acc None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:54.589981 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388d336-1e2e-4a19-a6f2-87abaedaeee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:54.590686 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388d336-1e2e-4a19-a6f2-87abaedaeee0 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:54.591638 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388d336-1e2e-4a19-a6f2-87abaedaeee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:54.591907 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388d336-1e2e-4a19-a6f2-87abaedaeee0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:54.592763 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9388d336-1e2e-4a19-a6f2-87abaedaeee0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:38:54.593074 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9388d336-1e2e-4a19-a6f2-87abaedaeee0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:54.594884 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9388d336-1e2e-4a19-a6f2-87abaedaeee0 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:54.614579 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3556/7087] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:38:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:38:54.615871 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388d336-1e2e-4a19-a6f2-87abaedaeee0 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:54.630255 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388d336-1e2e-4a19-a6f2-87abaedaeee0 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:54.659747 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a3ac90-ef0f-485c-8d04-921f2f3caba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:54.660863 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3ac90-ef0f-485c-8d04-921f2f3caba5 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:54.663447 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3ac90-ef0f-485c-8d04-921f2f3caba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:54.665698 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3ac90-ef0f-485c-8d04-921f2f3caba5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:54.668228 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a3ac90-ef0f-485c-8d04-921f2f3caba5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:54.679340 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a3ac90-ef0f-485c-8d04-921f2f3caba5 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:54.686224 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-615961de-2538-461e-ae32-ebefd73a40b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37fb22eb2ef44be9a5bc66079c2ad71f', 'request_id': 'req-615961de-2538-461e-ae32-ebefd73a40b5'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:54.718883 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-615961de-2538-461e-ae32-ebefd73a40b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37fb22eb2ef44be9a5bc66079c2ad71f', 'request_id': 'req-615961de-2538-461e-ae32-ebefd73a40b5'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:54.729048 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-615961de-2538-461e-ae32-ebefd73a40b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37fb22eb2ef44be9a5bc66079c2ad71f', 'request_id': 'req-615961de-2538-461e-ae32-ebefd73a40b5'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:54.841169 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3557/7088] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:38:54 2022] POST /identity/v3/projects => generated 405 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:38:54.842537 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a3ac90-ef0f-485c-8d04-921f2f3caba5 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:54.931768 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a3ac90-ef0f-485c-8d04-921f2f3caba5 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:54.943228 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-615961de-2538-461e-ae32-ebefd73a40b5 admin admin] The token cache is being invalidate because project 37fb22eb2ef44be9a5bc66079c2ad71f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:38:54.943564 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-615961de-2538-461e-ae32-ebefd73a40b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:54.944253 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-615961de-2538-461e-ae32-ebefd73a40b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:54.947176 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3532/7089] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:38:54 2022] DELETE /identity/v3/projects/37fb22eb2ef44be9a5bc66079c2ad71f => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:38:54.948357 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a649174-b7b7-4285-86ad-27e4e053521c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:54.949258 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a649174-b7b7-4285-86ad-27e4e053521c admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:54.951238 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615961de-2538-461e-ae32-ebefd73a40b5 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:54.951401 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a649174-b7b7-4285-86ad-27e4e053521c admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:54.951401 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a649174-b7b7-4285-86ad-27e4e053521c admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:54.951691 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-615961de-2538-461e-ae32-ebefd73a40b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:54.952380 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a649174-b7b7-4285-86ad-27e4e053521c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:54.959989 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a649174-b7b7-4285-86ad-27e4e053521c admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:55.039038 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3558/7090] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:38:54 2022] POST /identity/v3/users => generated 303 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:38:55.049445 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a649174-b7b7-4285-86ad-27e4e053521c admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:55.049445 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-3a649174-b7b7-4285-86ad-27e4e053521c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:55.052419 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615961de-2538-461e-ae32-ebefd73a40b5 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:55.062675 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0463a77-a3aa-47f0-becf-5b1325de9a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:55.064395 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0463a77-a3aa-47f0-becf-5b1325de9a54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:55.064904 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0463a77-a3aa-47f0-becf-5b1325de9a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:55.065436 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0463a77-a3aa-47f0-becf-5b1325de9a54 admin admin] PATH_INFO: `/v3/projects/a9bd0567ddff48ac9abc5e0ae0494b38` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:55.067670 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0463a77-a3aa-47f0-becf-5b1325de9a54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9bd0567ddff48ac9abc5e0ae0494b38)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:55.072320 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0463a77-a3aa-47f0-becf-5b1325de9a54 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:55.086115 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a649174-b7b7-4285-86ad-27e4e053521c admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:55.097845 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a014a95-15a0-4139-9473-b1b410c59907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:55.098716 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a014a95-15a0-4139-9473-b1b410c59907 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:55.099000 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a014a95-15a0-4139-9473-b1b410c59907 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:55.099273 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a014a95-15a0-4139-9473-b1b410c59907 admin admin] PATH_INFO: `/v3/projects/1a15ad3303f64af7a8ec37d20e2fdf03` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:55.100504 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a014a95-15a0-4139-9473-b1b410c59907 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a15ad3303f64af7a8ec37d20e2fdf03)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:55.102672 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a014a95-15a0-4139-9473-b1b410c59907 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:55.247633 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c0463a77-a3aa-47f0-becf-5b1325de9a54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9bd0567ddff48ac9abc5e0ae0494b38', 'request_id': 'req-c0463a77-a3aa-47f0-becf-5b1325de9a54'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:55.254433 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c0463a77-a3aa-47f0-becf-5b1325de9a54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9bd0567ddff48ac9abc5e0ae0494b38', 'request_id': 'req-c0463a77-a3aa-47f0-becf-5b1325de9a54'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:55.261179 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c0463a77-a3aa-47f0-becf-5b1325de9a54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9bd0567ddff48ac9abc5e0ae0494b38', 'request_id': 'req-c0463a77-a3aa-47f0-becf-5b1325de9a54'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:55.289680 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0a014a95-15a0-4139-9473-b1b410c59907 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a15ad3303f64af7a8ec37d20e2fdf03', 'request_id': 'req-0a014a95-15a0-4139-9473-b1b410c59907'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:55.295517 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0a014a95-15a0-4139-9473-b1b410c59907 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a15ad3303f64af7a8ec37d20e2fdf03', 'request_id': 'req-0a014a95-15a0-4139-9473-b1b410c59907'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:55.402736 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c0463a77-a3aa-47f0-becf-5b1325de9a54 admin admin] The token cache is being invalidate because project a9bd0567ddff48ac9abc5e0ae0494b38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:38:55.403264 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c0463a77-a3aa-47f0-becf-5b1325de9a54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:55.403990 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c0463a77-a3aa-47f0-becf-5b1325de9a54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:55.405585 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3533/7091] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:38:54 2022] DELETE /identity/v3/projects/a9bd0567ddff48ac9abc5e0ae0494b38 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:38:55.408757 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e38c88-0c00-4786-91dc-6b456216dca6 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:55.408757 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e38c88-0c00-4786-91dc-6b456216dca6 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:55.408757 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e38c88-0c00-4786-91dc-6b456216dca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:55.427815 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-00e38c88-0c00-4786-91dc-6b456216dca6 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:38:55.429459 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-00e38c88-0c00-4786-91dc-6b456216dca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:55.489017 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3534/7092] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:38:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:38:55.489863 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e38c88-0c00-4786-91dc-6b456216dca6 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:55.491119 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-00e38c88-0c00-4786-91dc-6b456216dca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:55.505003 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e38c88-0c00-4786-91dc-6b456216dca6 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:55.508823 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e8c414-d612-4504-a97d-d17c9b3b481c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:55.509503 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8c414-d612-4504-a97d-d17c9b3b481c admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:55.509846 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8c414-d612-4504-a97d-d17c9b3b481c admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:55.510080 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8c414-d612-4504-a97d-d17c9b3b481c admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:55.510782 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e8c414-d612-4504-a97d-d17c9b3b481c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:55.512578 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e8c414-d612-4504-a97d-d17c9b3b481c admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:55.524500 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3535/7093] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:38:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:38:55.525561 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e8c414-d612-4504-a97d-d17c9b3b481c admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:55.528608 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-d2e8c414-d612-4504-a97d-d17c9b3b481c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:55.544332 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e8c414-d612-4504-a97d-d17c9b3b481c admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:55.547667 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0a014a95-15a0-4139-9473-b1b410c59907 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a15ad3303f64af7a8ec37d20e2fdf03', 'request_id': 'req-0a014a95-15a0-4139-9473-b1b410c59907'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:55.550348 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905e99d1-dfb5-42f5-9363-d9204b46c419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:55.551517 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e99d1-dfb5-42f5-9363-d9204b46c419 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:55.551975 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e99d1-dfb5-42f5-9363-d9204b46c419 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:55.552438 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e99d1-dfb5-42f5-9363-d9204b46c419 admin admin] PATH_INFO: `/v3/users/7b85fe91f94e4683aceeb5861ee7fad8` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:55.554115 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905e99d1-dfb5-42f5-9363-d9204b46c419 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b85fe91f94e4683aceeb5861ee7fad8)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:55.556410 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905e99d1-dfb5-42f5-9363-d9204b46c419 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:55.569509 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0a014a95-15a0-4139-9473-b1b410c59907 admin admin] The token cache is being invalidate because project 1a15ad3303f64af7a8ec37d20e2fdf03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:38:55.569907 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0a014a95-15a0-4139-9473-b1b410c59907 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:55.570660 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0a014a95-15a0-4139-9473-b1b410c59907 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:55.576569 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3559/7094] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:38:55 2022] DELETE /identity/v3/projects/1a15ad3303f64af7a8ec37d20e2fdf03 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:38:55.577943 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde3f16-96bc-427e-b35f-20b419fc12c6 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:55.578355 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde3f16-96bc-427e-b35f-20b419fc12c6 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:55.578739 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde3f16-96bc-427e-b35f-20b419fc12c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:55.607104 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-9dde3f16-96bc-427e-b35f-20b419fc12c6 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:38:55.608917 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-9dde3f16-96bc-427e-b35f-20b419fc12c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:55.618546 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3560/7095] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:38:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:38:55.625566 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dde3f16-96bc-427e-b35f-20b419fc12c6 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:55.625566 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-9dde3f16-96bc-427e-b35f-20b419fc12c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:55.634460 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dde3f16-96bc-427e-b35f-20b419fc12c6 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:55.640372 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ce7bc9-7c7d-4412-b82d-a128253e3674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:55.643435 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce7bc9-7c7d-4412-b82d-a128253e3674 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:55.644008 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce7bc9-7c7d-4412-b82d-a128253e3674 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:55.644384 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce7bc9-7c7d-4412-b82d-a128253e3674 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:55.645490 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ce7bc9-7c7d-4412-b82d-a128253e3674 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:55.647228 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ce7bc9-7c7d-4412-b82d-a128253e3674 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:55.659637 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3561/7096] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:38:55 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:38:55.661262 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c626ae2-997b-4486-9d24-be6478804498 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:55.661739 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c626ae2-997b-4486-9d24-be6478804498 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:55.662286 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c626ae2-997b-4486-9d24-be6478804498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:55.685278 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-0c626ae2-997b-4486-9d24-be6478804498 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:38:55.686923 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-0c626ae2-997b-4486-9d24-be6478804498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:55.696292 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3562/7097] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:38:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:38:55.697390 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c626ae2-997b-4486-9d24-be6478804498 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:55.710759 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c626ae2-997b-4486-9d24-be6478804498 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:55.716664 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ed458a-8adb-4154-8991-321295667ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:55.719768 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed458a-8adb-4154-8991-321295667ee8 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:55.719768 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed458a-8adb-4154-8991-321295667ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:55.719768 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed458a-8adb-4154-8991-321295667ee8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:55.719768 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ed458a-8adb-4154-8991-321295667ee8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:38:55.719768 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ed458a-8adb-4154-8991-321295667ee8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:55.720680 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ed458a-8adb-4154-8991-321295667ee8 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:55.738444 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3563/7098] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:38:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:38:55.738444 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ed458a-8adb-4154-8991-321295667ee8 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:55.748261 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ed458a-8adb-4154-8991-321295667ee8 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:55.754943 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468961b-a604-4ab2-975b-61c3879eb272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:55.754943 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468961b-a604-4ab2-975b-61c3879eb272 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:55.755407 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468961b-a604-4ab2-975b-61c3879eb272 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:55.756009 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468961b-a604-4ab2-975b-61c3879eb272 admin admin] PATH_INFO: `/v3/projects/3b15386d4c844f8095e31b707fc80d49/users/0ca3fcd6c8d5419e98ac85d9238208d0/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:55.790268 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8468961b-a604-4ab2-975b-61c3879eb272 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b15386d4c844f8095e31b707fc80d49, user_id=0ca3fcd6c8d5419e98ac85d9238208d0, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:55.795240 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8468961b-a604-4ab2-975b-61c3879eb272 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:55.799143 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-905e99d1-dfb5-42f5-9363-d9204b46c419 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b85fe91f94e4683aceeb5861ee7fad8'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:55.810014 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-905e99d1-dfb5-42f5-9363-d9204b46c419 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b85fe91f94e4683aceeb5861ee7fad8'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:55.811628 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-905e99d1-dfb5-42f5-9363-d9204b46c419 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b85fe91f94e4683aceeb5861ee7fad8'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:55.906029 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3564/7099] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:38:55 2022] PUT /identity/v3/projects/3b15386d4c844f8095e31b707fc80d49/users/0ca3fcd6c8d5419e98ac85d9238208d0/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:38:55.922944 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d4a0e-1bc4-4924-8567-5fa41f9e3e32 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:55.923248 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d4a0e-1bc4-4924-8567-5fa41f9e3e32 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:55.923555 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d4a0e-1bc4-4924-8567-5fa41f9e3e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:55.948703 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-905e99d1-dfb5-42f5-9363-d9204b46c419 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b85fe91f94e4683aceeb5861ee7fad8'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:55.952910 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-d92d4a0e-1bc4-4924-8567-5fa41f9e3e32 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:38:55.954248 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d92d4a0e-1bc4-4924-8567-5fa41f9e3e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:55.970221 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-905e99d1-dfb5-42f5-9363-d9204b46c419 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b85fe91f94e4683aceeb5861ee7fad8'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:55.986618 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3536/7100] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:38:55 2022] DELETE /identity/v3/users/7b85fe91f94e4683aceeb5861ee7fad8 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:38:55.987994 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905e99d1-dfb5-42f5-9363-d9204b46c419 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:55.994429 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-905e99d1-dfb5-42f5-9363-d9204b46c419 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:56.107922 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905e99d1-dfb5-42f5-9363-d9204b46c419 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:56.131278 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb11119-fae9-4b2c-b251-a162f4572bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:56.131278 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb11119-fae9-4b2c-b251-a162f4572bab admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:56.131278 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb11119-fae9-4b2c-b251-a162f4572bab admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:56.131278 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb11119-fae9-4b2c-b251-a162f4572bab admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:56.135759 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb11119-fae9-4b2c-b251-a162f4572bab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:56.136380 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3565/7101] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:38:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:38:56.137666 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c0fd0-dede-4c0f-9e46-39b4d920eadc None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:56.138527 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c0fd0-dede-4c0f-9e46-39b4d920eadc None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:56.138936 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c0fd0-dede-4c0f-9e46-39b4d920eadc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:56.143435 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb11119-fae9-4b2c-b251-a162f4572bab admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:56.229130 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-180c0fd0-dede-4c0f-9e46-39b4d920eadc None None] MFA Rules not processed for user `0ca3fcd6c8d5419e98ac85d9238208d0`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:38:56.230717 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-180c0fd0-dede-4c0f-9e46-39b4d920eadc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:56.290038 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3537/7102] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:38:55 2022] POST /identity/v3/projects => generated 377 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:38:56.291403 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb11119-fae9-4b2c-b251-a162f4572bab admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:56.389541 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb11119-fae9-4b2c-b251-a162f4572bab admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:56.399019 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910fd96e-eaa3-492d-b307-6deb9b45cbcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:56.400591 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910fd96e-eaa3-492d-b307-6deb9b45cbcb admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:56.401114 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910fd96e-eaa3-492d-b307-6deb9b45cbcb admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:56.403065 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910fd96e-eaa3-492d-b307-6deb9b45cbcb admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:56.404681 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910fd96e-eaa3-492d-b307-6deb9b45cbcb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:38:56.405375 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910fd96e-eaa3-492d-b307-6deb9b45cbcb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:56.405617 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3566/7103] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:38:56 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:38:56.406480 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180c0fd0-dede-4c0f-9e46-39b4d920eadc None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:56.407883 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910fd96e-eaa3-492d-b307-6deb9b45cbcb admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:56.425413 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180c0fd0-dede-4c0f-9e46-39b4d920eadc None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:56.426470 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3538/7104] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:38:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:38:56.427596 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910fd96e-eaa3-492d-b307-6deb9b45cbcb admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:56.433941 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-910fd96e-eaa3-492d-b307-6deb9b45cbcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:56.436680 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826a9f6f-48b5-4e99-a1b1-803c931bd912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:56.437770 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a9f6f-48b5-4e99-a1b1-803c931bd912 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:56.438299 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a9f6f-48b5-4e99-a1b1-803c931bd912 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:56.438769 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a9f6f-48b5-4e99-a1b1-803c931bd912 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:56.439698 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826a9f6f-48b5-4e99-a1b1-803c931bd912 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:56.442364 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826a9f6f-48b5-4e99-a1b1-803c931bd912 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:56.469551 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910fd96e-eaa3-492d-b307-6deb9b45cbcb admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:56.481054 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7feb94d-38c6-456b-8b40-4956de4ac980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:56.482564 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7feb94d-38c6-456b-8b40-4956de4ac980 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:56.489457 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7feb94d-38c6-456b-8b40-4956de4ac980 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:56.490002 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7feb94d-38c6-456b-8b40-4956de4ac980 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:56.490944 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7feb94d-38c6-456b-8b40-4956de4ac980 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:56.494725 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7feb94d-38c6-456b-8b40-4956de4ac980 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:56.568035 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3567/7105] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:38:56 2022] POST /identity/v3/users => generated 289 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:38:56.569796 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826a9f6f-48b5-4e99-a1b1-803c931bd912 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:56.589925 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826a9f6f-48b5-4e99-a1b1-803c931bd912 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:56.598472 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ae00e7-90f2-4bdc-b3fc-ed643cba3b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:56.600267 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae00e7-90f2-4bdc-b3fc-ed643cba3b7d admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:56.602706 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae00e7-90f2-4bdc-b3fc-ed643cba3b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:56.602706 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae00e7-90f2-4bdc-b3fc-ed643cba3b7d admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:56.602706 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ae00e7-90f2-4bdc-b3fc-ed643cba3b7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:56.605370 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3539/7106] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:38:56 2022] POST /identity/v3/projects => generated 409 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:38:56.605651 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ae00e7-90f2-4bdc-b3fc-ed643cba3b7d admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:56.607142 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7feb94d-38c6-456b-8b40-4956de4ac980 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:56.731706 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3568/7107] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:38:56 2022] POST /identity/v3/projects => generated 377 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:38:56.734575 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ae00e7-90f2-4bdc-b3fc-ed643cba3b7d admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:56.737568 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7feb94d-38c6-456b-8b40-4956de4ac980 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:56.812691 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de67b78f-f2cf-49a2-97a1-d1a97905012a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:56.813539 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de67b78f-f2cf-49a2-97a1-d1a97905012a admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:56.813901 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de67b78f-f2cf-49a2-97a1-d1a97905012a admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:56.814256 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de67b78f-f2cf-49a2-97a1-d1a97905012a admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:56.815047 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de67b78f-f2cf-49a2-97a1-d1a97905012a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:56.817046 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de67b78f-f2cf-49a2-97a1-d1a97905012a admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:56.829227 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3540/7108] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:38:56 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:38:56.830313 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de67b78f-f2cf-49a2-97a1-d1a97905012a admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:56.831015 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ae00e7-90f2-4bdc-b3fc-ed643cba3b7d admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:56.843328 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de67b78f-f2cf-49a2-97a1-d1a97905012a admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:56.853503 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc24dc70-f57b-455a-913c-3e9a08342156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:56.853503 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc24dc70-f57b-455a-913c-3e9a08342156 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:56.853503 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc24dc70-f57b-455a-913c-3e9a08342156 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:56.853503 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc24dc70-f57b-455a-913c-3e9a08342156 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:56.854114 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc24dc70-f57b-455a-913c-3e9a08342156 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:56.856584 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc24dc70-f57b-455a-913c-3e9a08342156 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:56.865258 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6383fd-4233-4f49-9b6e-3a48f3f1c9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:56.869786 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6383fd-4233-4f49-9b6e-3a48f3f1c9f6 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:56.869786 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6383fd-4233-4f49-9b6e-3a48f3f1c9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:56.869786 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6383fd-4233-4f49-9b6e-3a48f3f1c9f6 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:56.871049 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6383fd-4233-4f49-9b6e-3a48f3f1c9f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:56.875956 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6383fd-4233-4f49-9b6e-3a48f3f1c9f6 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:56.965024 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3541/7109] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:38:56 2022] POST /identity/v3/users => generated 289 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:38:56.966606 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc24dc70-f57b-455a-913c-3e9a08342156 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:56.983720 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc24dc70-f57b-455a-913c-3e9a08342156 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:56.988847 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3569/7110] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:38:56 2022] POST /identity/v3/users => generated 311 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:38:56.989877 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e082a4-d9fe-4ae2-8fed-9e8f7929fca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:56.990067 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6383fd-4233-4f49-9b6e-3a48f3f1c9f6 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:56.990703 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e082a4-d9fe-4ae2-8fed-9e8f7929fca9 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:57.306992 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e082a4-d9fe-4ae2-8fed-9e8f7929fca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:57.306992 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e082a4-d9fe-4ae2-8fed-9e8f7929fca9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:57.306992 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e082a4-d9fe-4ae2-8fed-9e8f7929fca9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:57.308805 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-bc6383fd-4233-4f49-9b6e-3a48f3f1c9f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:57.309412 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e082a4-d9fe-4ae2-8fed-9e8f7929fca9 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:57.309412 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3542/7111] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:38:56 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:38:57.309412 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e082a4-d9fe-4ae2-8fed-9e8f7929fca9 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:57.309902 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6383fd-4233-4f49-9b6e-3a48f3f1c9f6 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:57.310107 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e082a4-d9fe-4ae2-8fed-9e8f7929fca9 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:57.310239 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad971d5d-f2ba-4ab2-9763-e6dd3ab42eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:57.310239 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad971d5d-f2ba-4ab2-9763-e6dd3ab42eb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:57.310239 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad971d5d-f2ba-4ab2-9763-e6dd3ab42eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:57.310239 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad971d5d-f2ba-4ab2-9763-e6dd3ab42eb6 admin admin] PATH_INFO: `/v3/projects/029467e0e3c845f9bf7efaf2afea051f` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:57.310579 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c058bcf3-ad62-41a2-bd19-2307b3f0525b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:57.310980 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad971d5d-f2ba-4ab2-9763-e6dd3ab42eb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=029467e0e3c845f9bf7efaf2afea051f)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:57.310980 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad971d5d-f2ba-4ab2-9763-e6dd3ab42eb6 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:57.311220 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c058bcf3-ad62-41a2-bd19-2307b3f0525b admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:57.311220 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c058bcf3-ad62-41a2-bd19-2307b3f0525b admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:57.311220 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c058bcf3-ad62-41a2-bd19-2307b3f0525b admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:57.311220 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c058bcf3-ad62-41a2-bd19-2307b3f0525b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:57.311220 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c058bcf3-ad62-41a2-bd19-2307b3f0525b admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:57.311220 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3543/7112] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:38:57.312039 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c058bcf3-ad62-41a2-bd19-2307b3f0525b admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:57.312039 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c058bcf3-ad62-41a2-bd19-2307b3f0525b admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:57.312039 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6118336-519b-4c48-9b1a-b8c11cdd3cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:57.312039 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6118336-519b-4c48-9b1a-b8c11cdd3cdc admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:57.312309 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6118336-519b-4c48-9b1a-b8c11cdd3cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:57.312309 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6118336-519b-4c48-9b1a-b8c11cdd3cdc admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:57.312309 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6118336-519b-4c48-9b1a-b8c11cdd3cdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:57.312309 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6118336-519b-4c48-9b1a-b8c11cdd3cdc admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:57.312309 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3544/7113] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:38:57.312309 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6118336-519b-4c48-9b1a-b8c11cdd3cdc admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:57.312687 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6118336-519b-4c48-9b1a-b8c11cdd3cdc admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:57.312687 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4724561e-e065-4130-971e-c00a13203df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:57.312687 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724561e-e065-4130-971e-c00a13203df5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:57.312687 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724561e-e065-4130-971e-c00a13203df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:57.312946 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724561e-e065-4130-971e-c00a13203df5 admin admin] PATH_INFO: `/v3/projects/7f66f58506884bf29cc157ef4943b9fc/users/abe90f4c283040e3bfeca78955a01bd2/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:57.312946 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4724561e-e065-4130-971e-c00a13203df5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f66f58506884bf29cc157ef4943b9fc, user_id=abe90f4c283040e3bfeca78955a01bd2, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:57.313460 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ad971d5d-f2ba-4ab2-9763-e6dd3ab42eb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '029467e0e3c845f9bf7efaf2afea051f', 'request_id': 'req-ad971d5d-f2ba-4ab2-9763-e6dd3ab42eb6'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:57.313555 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4724561e-e065-4130-971e-c00a13203df5 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:57.313629 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ad971d5d-f2ba-4ab2-9763-e6dd3ab42eb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '029467e0e3c845f9bf7efaf2afea051f', 'request_id': 'req-ad971d5d-f2ba-4ab2-9763-e6dd3ab42eb6'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:57.467099 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ad971d5d-f2ba-4ab2-9763-e6dd3ab42eb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '029467e0e3c845f9bf7efaf2afea051f', 'request_id': 'req-ad971d5d-f2ba-4ab2-9763-e6dd3ab42eb6'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:57.474016 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3545/7114] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:38:57 2022] PUT /identity/v3/projects/7f66f58506884bf29cc157ef4943b9fc/users/abe90f4c283040e3bfeca78955a01bd2/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:38:57.474536 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4724561e-e065-4130-971e-c00a13203df5 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:57.480444 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ad971d5d-f2ba-4ab2-9763-e6dd3ab42eb6 admin admin] The token cache is being invalidate because project 029467e0e3c845f9bf7efaf2afea051f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:38:57.480737 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ad971d5d-f2ba-4ab2-9763-e6dd3ab42eb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:57.481402 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ad971d5d-f2ba-4ab2-9763-e6dd3ab42eb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:57.487892 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3570/7115] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:38:56 2022] DELETE /identity/v3/projects/029467e0e3c845f9bf7efaf2afea051f => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:38:57.487892 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad971d5d-f2ba-4ab2-9763-e6dd3ab42eb6 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:57.487892 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ad971d5d-f2ba-4ab2-9763-e6dd3ab42eb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:57.561755 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad971d5d-f2ba-4ab2-9763-e6dd3ab42eb6 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:57.582751 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4724561e-e065-4130-971e-c00a13203df5 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:57.588224 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d98b91-2ad4-4a57-accd-5cb1bdc5ad06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:57.588895 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d98b91-2ad4-4a57-accd-5cb1bdc5ad06 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:57.589178 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d98b91-2ad4-4a57-accd-5cb1bdc5ad06 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:57.589453 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d98b91-2ad4-4a57-accd-5cb1bdc5ad06 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:57.590203 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d98b91-2ad4-4a57-accd-5cb1bdc5ad06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:57.592042 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d98b91-2ad4-4a57-accd-5cb1bdc5ad06 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:57.602530 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3546/7116] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:38:57.605268 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029c90e-b734-44d3-8be3-88778dfd276e None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:57.605690 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029c90e-b734-44d3-8be3-88778dfd276e None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:57.606100 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029c90e-b734-44d3-8be3-88778dfd276e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:57.633378 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f39484-438a-4ac8-bcff-6689b717e104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:57.634540 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f39484-438a-4ac8-bcff-6689b717e104 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:57.634926 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f39484-438a-4ac8-bcff-6689b717e104 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:57.635062 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-e029c90e-b734-44d3-8be3-88778dfd276e None None] MFA Rules not processed for user `abe90f4c283040e3bfeca78955a01bd2`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:38:57.635393 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f39484-438a-4ac8-bcff-6689b717e104 admin admin] PATH_INFO: `/v3/projects/c9c1ef9171d440acbbc392a702621341/users/f696e3080988457a9bb7d3d6acc8771c/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:57.636534 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e029c90e-b734-44d3-8be3-88778dfd276e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:57.651724 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f39484-438a-4ac8-bcff-6689b717e104 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9c1ef9171d440acbbc392a702621341, user_id=f696e3080988457a9bb7d3d6acc8771c, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:57.655932 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f39484-438a-4ac8-bcff-6689b717e104 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:57.725059 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3547/7117] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:38:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:38:57.725059 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa02058-55ca-4bea-be6a-d74e7faeec8d None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:57.725059 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa02058-55ca-4bea-be6a-d74e7faeec8d None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:57.725059 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa02058-55ca-4bea-be6a-d74e7faeec8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:57.743036 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3571/7118] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:38:57 2022] PUT /identity/v3/projects/c9c1ef9171d440acbbc392a702621341/users/f696e3080988457a9bb7d3d6acc8771c/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:38:57.744141 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f39484-438a-4ac8-bcff-6689b717e104 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:57.746516 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-94f39484-438a-4ac8-bcff-6689b717e104 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:57.752819 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-7fa02058-55ca-4bea-be6a-d74e7faeec8d None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:38:57.756364 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-7fa02058-55ca-4bea-be6a-d74e7faeec8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:57.841812 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f39484-438a-4ac8-bcff-6689b717e104 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:57.843648 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3548/7119] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:38:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:38:57.845110 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2746f3d-16e1-4fba-a5da-f8ce90d49473 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:57.845407 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2746f3d-16e1-4fba-a5da-f8ce90d49473 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:57.845686 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2746f3d-16e1-4fba-a5da-f8ce90d49473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:57.851178 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a96993-e5d5-443e-a710-9b5a0d3ea063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:57.852280 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a96993-e5d5-443e-a710-9b5a0d3ea063 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:57.852628 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a96993-e5d5-443e-a710-9b5a0d3ea063 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:57.852966 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a96993-e5d5-443e-a710-9b5a0d3ea063 admin admin] PATH_INFO: `/v3/projects/2a28b6be80dd47e6b3bffe9fa943bd64/users/631c3fdee4a64431acc899f2eff66374/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:57.866576 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-f2746f3d-16e1-4fba-a5da-f8ce90d49473 None None] MFA Rules not processed for user `abe90f4c283040e3bfeca78955a01bd2`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:38:57.870458 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-f2746f3d-16e1-4fba-a5da-f8ce90d49473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:57.870566 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a96993-e5d5-443e-a710-9b5a0d3ea063 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a28b6be80dd47e6b3bffe9fa943bd64, user_id=631c3fdee4a64431acc899f2eff66374, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:57.871442 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a96993-e5d5-443e-a710-9b5a0d3ea063 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:57.923446 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3549/7120] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:38:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:38:57.924895 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2746f3d-16e1-4fba-a5da-f8ce90d49473 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:57.937860 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2746f3d-16e1-4fba-a5da-f8ce90d49473 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:57.945063 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd09a890-d91e-4c9b-95c0-b335c67dbe7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:57.945747 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd09a890-d91e-4c9b-95c0-b335c67dbe7c admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:57.946038 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd09a890-d91e-4c9b-95c0-b335c67dbe7c admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:57.946318 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd09a890-d91e-4c9b-95c0-b335c67dbe7c admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:57.947051 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd09a890-d91e-4c9b-95c0-b335c67dbe7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:57.948739 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd09a890-d91e-4c9b-95c0-b335c67dbe7c admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:57.959816 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3550/7121] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:38:57.961174 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a57796-9d13-44e1-86d8-4b15eb57cfd0 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:57.961468 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a57796-9d13-44e1-86d8-4b15eb57cfd0 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:57.961760 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a57796-9d13-44e1-86d8-4b15eb57cfd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:57.983916 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-30a57796-9d13-44e1-86d8-4b15eb57cfd0 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:38:57.985170 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-30a57796-9d13-44e1-86d8-4b15eb57cfd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:58.001718 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3572/7122] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:38:57 2022] PUT /identity/v3/projects/2a28b6be80dd47e6b3bffe9fa943bd64/users/631c3fdee4a64431acc899f2eff66374/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:38:58.004048 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a96993-e5d5-443e-a710-9b5a0d3ea063 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:58.006791 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-76a96993-e5d5-443e-a710-9b5a0d3ea063 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:58.087698 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3551/7123] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:38:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:38:58.087698 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a57796-9d13-44e1-86d8-4b15eb57cfd0 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:58.107417 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a57796-9d13-44e1-86d8-4b15eb57cfd0 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:58.113848 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4a1258-5ab2-4618-9b87-9fdb00827d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:58.116044 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a1258-5ab2-4618-9b87-9fdb00827d18 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:58.116906 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a1258-5ab2-4618-9b87-9fdb00827d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:58.117293 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a1258-5ab2-4618-9b87-9fdb00827d18 admin admin] PATH_INFO: `/v3/projects/c9c1ef9171d440acbbc392a702621341/users/f696e3080988457a9bb7d3d6acc8771c/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:58.120613 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4a1258-5ab2-4618-9b87-9fdb00827d18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9c1ef9171d440acbbc392a702621341, user_id=f696e3080988457a9bb7d3d6acc8771c, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:58.124629 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4a1258-5ab2-4618-9b87-9fdb00827d18 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:58.130120 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a96993-e5d5-443e-a710-9b5a0d3ea063 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:58.139325 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3552/7124] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:38:58 2022] PUT /identity/v3/projects/c9c1ef9171d440acbbc392a702621341/users/f696e3080988457a9bb7d3d6acc8771c/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:38:58.141004 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed965e2-0b36-4bcd-9d40-0d7acf91a393 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:58.141381 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed965e2-0b36-4bcd-9d40-0d7acf91a393 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:58.141728 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed965e2-0b36-4bcd-9d40-0d7acf91a393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:58.182464 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-3ed965e2-0b36-4bcd-9d40-0d7acf91a393 None None] MFA Rules not processed for user `631c3fdee4a64431acc899f2eff66374`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:38:58.184058 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-3ed965e2-0b36-4bcd-9d40-0d7acf91a393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:58.245362 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8cad1e-38bc-4eb0-bb9d-1f66efd8a41e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:58.246251 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8cad1e-38bc-4eb0-bb9d-1f66efd8a41e service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:58.246709 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8cad1e-38bc-4eb0-bb9d-1f66efd8a41e service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:58.247165 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8cad1e-38bc-4eb0-bb9d-1f66efd8a41e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:58.323424 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3553/7125] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:38:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:38:58.324849 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed965e2-0b36-4bcd-9d40-0d7acf91a393 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:58.349812 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8cad1e-38bc-4eb0-bb9d-1f66efd8a41e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:58.352316 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8cad1e-38bc-4eb0-bb9d-1f66efd8a41e service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:58.368362 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3573/7126] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:38:58 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:38:58.370016 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de0a47-c368-470a-ae2e-957602a4b582 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:58.370524 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de0a47-c368-470a-ae2e-957602a4b582 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:58.371208 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de0a47-c368-470a-ae2e-957602a4b582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:58.427073 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-05de0a47-c368-470a-ae2e-957602a4b582 None None] MFA Rules not processed for user `f696e3080988457a9bb7d3d6acc8771c`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:38:58.428596 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-05de0a47-c368-470a-ae2e-957602a4b582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:58.468248 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed965e2-0b36-4bcd-9d40-0d7acf91a393 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:58.473455 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144db698-78cf-480c-87d7-849be969511d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:58.474288 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144db698-78cf-480c-87d7-849be969511d admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:58.474849 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144db698-78cf-480c-87d7-849be969511d admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:58.475004 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144db698-78cf-480c-87d7-849be969511d admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:58.476837 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144db698-78cf-480c-87d7-849be969511d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:38:58.477153 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144db698-78cf-480c-87d7-849be969511d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:58.478959 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144db698-78cf-480c-87d7-849be969511d admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:58.499749 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3554/7127] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:38:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:38:58.499749 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144db698-78cf-480c-87d7-849be969511d admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:58.500608 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-144db698-78cf-480c-87d7-849be969511d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:58.526822 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3574/7128] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:38:58 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:38:58.527552 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05de0a47-c368-470a-ae2e-957602a4b582 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:58.548796 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05de0a47-c368-470a-ae2e-957602a4b582 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:58.554944 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6500093-52ef-4c9e-81bc-d8ca735f5b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:58.557585 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6500093-52ef-4c9e-81bc-d8ca735f5b97 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:58.557585 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6500093-52ef-4c9e-81bc-d8ca735f5b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:58.557585 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6500093-52ef-4c9e-81bc-d8ca735f5b97 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:58.558235 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6500093-52ef-4c9e-81bc-d8ca735f5b97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:58.560772 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6500093-52ef-4c9e-81bc-d8ca735f5b97 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:58.605060 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144db698-78cf-480c-87d7-849be969511d admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:58.610041 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef1d007-9d73-46e6-97b7-a9174afad1f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:58.611033 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef1d007-9d73-46e6-97b7-a9174afad1f3 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:58.611431 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef1d007-9d73-46e6-97b7-a9174afad1f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:58.611837 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef1d007-9d73-46e6-97b7-a9174afad1f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:58.621176 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef1d007-9d73-46e6-97b7-a9174afad1f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:58.623295 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef1d007-9d73-46e6-97b7-a9174afad1f3 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:58.633030 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3555/7129] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:38:58 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:38:58.633889 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef1d007-9d73-46e6-97b7-a9174afad1f3 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:58.635348 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-cef1d007-9d73-46e6-97b7-a9174afad1f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:58.729112 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef1d007-9d73-46e6-97b7-a9174afad1f3 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:58.747791 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c8503a-7b25-418e-9d00-c431e77562a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198271d1c0d44cb58bace41a65f4b94c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:58.748610 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8503a-7b25-418e-9d00-c431e77562a6 service cinder] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:58.748785 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8503a-7b25-418e-9d00-c431e77562a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:58.749105 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8503a-7b25-418e-9d00-c431e77562a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:58.752419 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3575/7130] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:38:58 2022] POST /identity/v3/projects => generated 377 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:38:58.759328 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6500093-52ef-4c9e-81bc-d8ca735f5b97 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:58.777923 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c8503a-7b25-418e-9d00-c431e77562a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:58.781489 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c8503a-7b25-418e-9d00-c431e77562a6 service cinder] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:58.807872 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3556/7131] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:38:58 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:38:58.811372 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c8503a-7b25-418e-9d00-c431e77562a6 service cinder] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:58.827421 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c8503a-7b25-418e-9d00-c431e77562a6 service cinder] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:58.910335 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6500093-52ef-4c9e-81bc-d8ca735f5b97 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:58.919180 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac3299-2f28-480d-ac05-ed5c4081a488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:58.919180 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac3299-2f28-480d-ac05-ed5c4081a488 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:58.919180 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac3299-2f28-480d-ac05-ed5c4081a488 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:58.919180 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac3299-2f28-480d-ac05-ed5c4081a488 admin admin] PATH_INFO: `/v3/users/631c3fdee4a64431acc899f2eff66374` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:58.919578 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ac3299-2f28-480d-ac05-ed5c4081a488 admin admin] RBAC: Authorizing `identity:delete_user(user_id=631c3fdee4a64431acc899f2eff66374)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:58.921895 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ac3299-2f28-480d-ac05-ed5c4081a488 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:59.005463 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74699558-4043-40ba-838b-1db19a9bcc86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:59.006553 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74699558-4043-40ba-838b-1db19a9bcc86 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:59.007047 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74699558-4043-40ba-838b-1db19a9bcc86 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:59.007593 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74699558-4043-40ba-838b-1db19a9bcc86 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:59.009586 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74699558-4043-40ba-838b-1db19a9bcc86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:59.011768 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74699558-4043-40ba-838b-1db19a9bcc86 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:59.164233 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3557/7132] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:38:58 2022] POST /identity/v3/users => generated 289 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:38:59.165131 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74699558-4043-40ba-838b-1db19a9bcc86 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:59.170462 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-74699558-4043-40ba-838b-1db19a9bcc86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:59.243763 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-52ac3299-2f28-480d-ac05-ed5c4081a488 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '631c3fdee4a64431acc899f2eff66374'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:59.290175 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-52ac3299-2f28-480d-ac05-ed5c4081a488 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '631c3fdee4a64431acc899f2eff66374'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:59.307195 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-52ac3299-2f28-480d-ac05-ed5c4081a488 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '631c3fdee4a64431acc899f2eff66374'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:59.355471 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74699558-4043-40ba-838b-1db19a9bcc86 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:59.365503 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca773f9-46bf-4521-a5dd-e4ce7da2a540 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:59.366199 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca773f9-46bf-4521-a5dd-e4ce7da2a540 service placement] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:59.366956 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca773f9-46bf-4521-a5dd-e4ce7da2a540 service placement] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:59.366956 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca773f9-46bf-4521-a5dd-e4ce7da2a540 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:59.374054 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-fca773f9-46bf-4521-a5dd-e4ce7da2a540 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:59.396930 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-52ac3299-2f28-480d-ac05-ed5c4081a488 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '631c3fdee4a64431acc899f2eff66374'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:59.396930 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-52ac3299-2f28-480d-ac05-ed5c4081a488 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '631c3fdee4a64431acc899f2eff66374'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:38:59.404628 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3576/7133] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:38:58 2022] DELETE /identity/v3/users/631c3fdee4a64431acc899f2eff66374 => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:38:59.408129 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac3299-2f28-480d-ac05-ed5c4081a488 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:59.408508 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca773f9-46bf-4521-a5dd-e4ce7da2a540 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:59.411502 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca773f9-46bf-4521-a5dd-e4ce7da2a540 service placement] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:59.416669 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-52ac3299-2f28-480d-ac05-ed5c4081a488 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:59.442381 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3558/7134] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:38:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:38:59.444098 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf65c9-651c-4e54-b317-657d354f23e6 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:59.444477 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf65c9-651c-4e54-b317-657d354f23e6 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:59.444765 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf65c9-651c-4e54-b317-657d354f23e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:59.507349 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-d5cf65c9-651c-4e54-b317-657d354f23e6 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:38:59.508664 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-d5cf65c9-651c-4e54-b317-657d354f23e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:59.593787 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac3299-2f28-480d-ac05-ed5c4081a488 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:59.610859 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaff561d-feb2-4834-9b9a-f1f1695c0802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:59.612307 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff561d-feb2-4834-9b9a-f1f1695c0802 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:59.614451 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff561d-feb2-4834-9b9a-f1f1695c0802 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:59.614740 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff561d-feb2-4834-9b9a-f1f1695c0802 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:59.617052 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaff561d-feb2-4834-9b9a-f1f1695c0802 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:59.623188 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaff561d-feb2-4834-9b9a-f1f1695c0802 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:59.655304 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3559/7135] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:38:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:38:59.655829 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3577/7136] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:38:59 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:38:59.659059 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cf65c9-651c-4e54-b317-657d354f23e6 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:59.659171 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaff561d-feb2-4834-9b9a-f1f1695c0802 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:59.660575 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-d5cf65c9-651c-4e54-b317-657d354f23e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:59.680063 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaff561d-feb2-4834-9b9a-f1f1695c0802 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:59.698522 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1659c3ce-901b-4f26-b37c-3cec3f71c1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:59.704963 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1659c3ce-901b-4f26-b37c-3cec3f71c1e3 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:59.705449 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1659c3ce-901b-4f26-b37c-3cec3f71c1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:59.705871 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1659c3ce-901b-4f26-b37c-3cec3f71c1e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:59.706756 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1659c3ce-901b-4f26-b37c-3cec3f71c1e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:59.708844 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1659c3ce-901b-4f26-b37c-3cec3f71c1e3 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:59.751580 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3578/7137] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:38:59 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:38:59.751580 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1659c3ce-901b-4f26-b37c-3cec3f71c1e3 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:59.755277 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-1659c3ce-901b-4f26-b37c-3cec3f71c1e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:59.803444 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cf65c9-651c-4e54-b317-657d354f23e6 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:59.817236 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d39c30-1c0f-4ead-b3cb-25187b01838e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198271d1c0d44cb58bace41a65f4b94c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:59.817925 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d39c30-1c0f-4ead-b3cb-25187b01838e service cinder] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:59.818215 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d39c30-1c0f-4ead-b3cb-25187b01838e service cinder] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:59.818497 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d39c30-1c0f-4ead-b3cb-25187b01838e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:59.823372 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e6d39c30-1c0f-4ead-b3cb-25187b01838e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:38:59.848721 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1659c3ce-901b-4f26-b37c-3cec3f71c1e3 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:59.855148 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4821d31-e1ac-48b7-be94-64089cc0d084 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:59.856167 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4821d31-e1ac-48b7-be94-64089cc0d084 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:59.857332 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4821d31-e1ac-48b7-be94-64089cc0d084 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:59.857824 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4821d31-e1ac-48b7-be94-64089cc0d084 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:59.880207 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4821d31-e1ac-48b7-be94-64089cc0d084 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:59.882471 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4821d31-e1ac-48b7-be94-64089cc0d084 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:59.900438 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3579/7138] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:38:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:38:59.901658 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4821d31-e1ac-48b7-be94-64089cc0d084 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:38:59.916623 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4821d31-e1ac-48b7-be94-64089cc0d084 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:38:59.927142 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a38bd0-00fb-463d-bcd6-837a70c4306b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:38:59.928369 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a38bd0-00fb-463d-bcd6-837a70c4306b admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:38:59.928833 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a38bd0-00fb-463d-bcd6-837a70c4306b admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:38:59.929386 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a38bd0-00fb-463d-bcd6-837a70c4306b admin admin] PATH_INFO: `/v3/projects/af9aa213a6aa4d6c87561c5d09263cd7/users/068a441a1b2e472fb43a8ae2021a35c4/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:38:59.957841 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a38bd0-00fb-463d-bcd6-837a70c4306b admin admin] RBAC: Authorizing `identity:create_grant(project_id=af9aa213a6aa4d6c87561c5d09263cd7, user_id=068a441a1b2e472fb43a8ae2021a35c4, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:59.961555 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a38bd0-00fb-463d-bcd6-837a70c4306b admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:38:59.986271 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d39c30-1c0f-4ead-b3cb-25187b01838e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:38:59.989553 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d39c30-1c0f-4ead-b3cb-25187b01838e service cinder] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:00.006728 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3560/7139] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:38:59 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:39:00.065606 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3580/7140] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:38:59 2022] PUT /identity/v3/projects/af9aa213a6aa4d6c87561c5d09263cd7/users/068a441a1b2e472fb43a8ae2021a35c4/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:00.078719 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd599b6-da8f-4a3a-ab52-5aa950779011 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:00.079067 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd599b6-da8f-4a3a-ab52-5aa950779011 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:00.079359 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd599b6-da8f-4a3a-ab52-5aa950779011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:00.199789 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-bbd599b6-da8f-4a3a-ab52-5aa950779011 None None] MFA Rules not processed for user `068a441a1b2e472fb43a8ae2021a35c4`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:00.202371 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-bbd599b6-da8f-4a3a-ab52-5aa950779011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:00.357906 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3561/7141] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:39:00.364608 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a38bd0-00fb-463d-bcd6-837a70c4306b admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:00.522946 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a38bd0-00fb-463d-bcd6-837a70c4306b admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:00.536774 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffe2721-74b1-407c-93f7-d2c65541edd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:00.538962 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe2721-74b1-407c-93f7-d2c65541edd1 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:00.539831 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe2721-74b1-407c-93f7-d2c65541edd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:00.541084 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe2721-74b1-407c-93f7-d2c65541edd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:00.542011 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffe2721-74b1-407c-93f7-d2c65541edd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:00.545635 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffe2721-74b1-407c-93f7-d2c65541edd1 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:00.672705 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3581/7142] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:39:00 2022] POST /identity/v3/projects => generated 377 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:39:00.675019 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd599b6-da8f-4a3a-ab52-5aa950779011 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:00.691217 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd599b6-da8f-4a3a-ab52-5aa950779011 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:00.826334 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5deb72f-9ebb-48b5-a081-e29a9a60266c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:00.827028 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5deb72f-9ebb-48b5-a081-e29a9a60266c admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:00.827339 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5deb72f-9ebb-48b5-a081-e29a9a60266c admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:00.827691 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5deb72f-9ebb-48b5-a081-e29a9a60266c admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:00.828471 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5deb72f-9ebb-48b5-a081-e29a9a60266c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:00.830428 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5deb72f-9ebb-48b5-a081-e29a9a60266c admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:00.968923 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3562/7143] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:39:00 2022] POST /identity/v3/users => generated 295 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:39:00.970163 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffe2721-74b1-407c-93f7-d2c65541edd1 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:00.985822 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffe2721-74b1-407c-93f7-d2c65541edd1 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:01.002458 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d3ba6-61ce-482f-8c43-dd0eef23c53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:01.003064 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d3ba6-61ce-482f-8c43-dd0eef23c53c admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:01.003341 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d3ba6-61ce-482f-8c43-dd0eef23c53c admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:01.003852 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d3ba6-61ce-482f-8c43-dd0eef23c53c admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:01.004600 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827d3ba6-61ce-482f-8c43-dd0eef23c53c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:01.007320 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827d3ba6-61ce-482f-8c43-dd0eef23c53c admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:01.024142 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3582/7144] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:39:00 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:39:01.027588 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5deb72f-9ebb-48b5-a081-e29a9a60266c admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:01.050609 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5deb72f-9ebb-48b5-a081-e29a9a60266c admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:01.052964 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2818ce01-636c-440a-bafe-c8ae5e8245e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:01.053877 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818ce01-636c-440a-bafe-c8ae5e8245e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:01.054163 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818ce01-636c-440a-bafe-c8ae5e8245e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:01.054502 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818ce01-636c-440a-bafe-c8ae5e8245e3 admin admin] PATH_INFO: `/v3/projects/2ef94d21909d4ad8a9f325b15d4b28b8/users/b02b297c807344d68a26dcd95cef3d49/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:01.108027 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2818ce01-636c-440a-bafe-c8ae5e8245e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ef94d21909d4ad8a9f325b15d4b28b8, user_id=b02b297c807344d68a26dcd95cef3d49, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:01.146541 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2818ce01-636c-440a-bafe-c8ae5e8245e3 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:01.267565 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3563/7145] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:39:01 2022] PUT /identity/v3/projects/2ef94d21909d4ad8a9f325b15d4b28b8/users/b02b297c807344d68a26dcd95cef3d49/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:39:01.269495 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d3ba6-61ce-482f-8c43-dd0eef23c53c admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:01.283314 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d3ba6-61ce-482f-8c43-dd0eef23c53c admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:01.299387 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2818ce01-636c-440a-bafe-c8ae5e8245e3 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:01.301252 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-2818ce01-636c-440a-bafe-c8ae5e8245e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:01.383357 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144a1bc4-d555-4ca5-af35-4cf5ee3a1b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:01.384713 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a1bc4-d555-4ca5-af35-4cf5ee3a1b41 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:01.385161 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a1bc4-d555-4ca5-af35-4cf5ee3a1b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:01.385696 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a1bc4-d555-4ca5-af35-4cf5ee3a1b41 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:01.386776 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144a1bc4-d555-4ca5-af35-4cf5ee3a1b41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:01.391121 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144a1bc4-d555-4ca5-af35-4cf5ee3a1b41 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:01.417836 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2818ce01-636c-440a-bafe-c8ae5e8245e3 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:01.420985 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3583/7146] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:39:01.422284 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144a1bc4-d555-4ca5-af35-4cf5ee3a1b41 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:01.424956 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-144a1bc4-d555-4ca5-af35-4cf5ee3a1b41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:01.426710 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcbb605-dfb5-46f4-af58-62fbccc679dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:01.427838 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcbb605-dfb5-46f4-af58-62fbccc679dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:01.429366 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcbb605-dfb5-46f4-af58-62fbccc679dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:01.429366 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcbb605-dfb5-46f4-af58-62fbccc679dd admin admin] PATH_INFO: `/v3/users/0e73e527bf1641afb2ffddd0dab69111` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:01.431897 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcbb605-dfb5-46f4-af58-62fbccc679dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e73e527bf1641afb2ffddd0dab69111)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:01.434005 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcbb605-dfb5-46f4-af58-62fbccc679dd admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:01.455141 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144a1bc4-d555-4ca5-af35-4cf5ee3a1b41 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:01.467155 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bcc908-37cb-4070-ac24-bb3af42c5040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:01.468087 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bcc908-37cb-4070-ac24-bb3af42c5040 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:01.471285 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bcc908-37cb-4070-ac24-bb3af42c5040 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:01.471285 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bcc908-37cb-4070-ac24-bb3af42c5040 admin admin] PATH_INFO: `/v3/projects/2a28b6be80dd47e6b3bffe9fa943bd64` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:01.471285 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bcc908-37cb-4070-ac24-bb3af42c5040 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a28b6be80dd47e6b3bffe9fa943bd64)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:01.472321 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bcc908-37cb-4070-ac24-bb3af42c5040 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:01.699847 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-19bcc908-37cb-4070-ac24-bb3af42c5040 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a28b6be80dd47e6b3bffe9fa943bd64', 'request_id': 'req-19bcc908-37cb-4070-ac24-bb3af42c5040'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:01.703366 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-bdcbb605-dfb5-46f4-af58-62fbccc679dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e73e527bf1641afb2ffddd0dab69111'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:01.706745 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-19bcc908-37cb-4070-ac24-bb3af42c5040 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a28b6be80dd47e6b3bffe9fa943bd64', 'request_id': 'req-19bcc908-37cb-4070-ac24-bb3af42c5040'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:01.713152 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-bdcbb605-dfb5-46f4-af58-62fbccc679dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e73e527bf1641afb2ffddd0dab69111'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:01.714093 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-bdcbb605-dfb5-46f4-af58-62fbccc679dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e73e527bf1641afb2ffddd0dab69111'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:01.765757 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-19bcc908-37cb-4070-ac24-bb3af42c5040 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a28b6be80dd47e6b3bffe9fa943bd64', 'request_id': 'req-19bcc908-37cb-4070-ac24-bb3af42c5040'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:01.779932 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-19bcc908-37cb-4070-ac24-bb3af42c5040 admin admin] The token cache is being invalidate because project 2a28b6be80dd47e6b3bffe9fa943bd64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:39:01.780460 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-19bcc908-37cb-4070-ac24-bb3af42c5040 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:01.781168 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-19bcc908-37cb-4070-ac24-bb3af42c5040 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:01.782808 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3584/7147] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:39:01 2022] DELETE /identity/v3/projects/2a28b6be80dd47e6b3bffe9fa943bd64 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:01.786933 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bcc908-37cb-4070-ac24-bb3af42c5040 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:01.790348 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-19bcc908-37cb-4070-ac24-bb3af42c5040 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:01.855886 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bcc908-37cb-4070-ac24-bb3af42c5040 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:01.859031 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-bdcbb605-dfb5-46f4-af58-62fbccc679dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e73e527bf1641afb2ffddd0dab69111'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:01.862654 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec57d53-7fab-44d3-bf72-b8636803dde0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:01.862999 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec57d53-7fab-44d3-bf72-b8636803dde0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:01.863292 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec57d53-7fab-44d3-bf72-b8636803dde0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:01.863608 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec57d53-7fab-44d3-bf72-b8636803dde0 admin admin] PATH_INFO: `/v3/projects/2ef94d21909d4ad8a9f325b15d4b28b8/users/b02b297c807344d68a26dcd95cef3d49/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:01.865725 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec57d53-7fab-44d3-bf72-b8636803dde0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ef94d21909d4ad8a9f325b15d4b28b8, user_id=b02b297c807344d68a26dcd95cef3d49, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:01.868641 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec57d53-7fab-44d3-bf72-b8636803dde0 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:01.872985 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-bdcbb605-dfb5-46f4-af58-62fbccc679dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e73e527bf1641afb2ffddd0dab69111'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:01.879762 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3564/7148] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:39:01 2022] DELETE /identity/v3/users/0e73e527bf1641afb2ffddd0dab69111 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:39:01.880422 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3585/7149] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:39:01 2022] PUT /identity/v3/projects/2ef94d21909d4ad8a9f325b15d4b28b8/users/b02b297c807344d68a26dcd95cef3d49/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:01.881279 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce64caf-6d06-446d-b740-6d36682df868 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:01.881577 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce64caf-6d06-446d-b740-6d36682df868 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:01.881987 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce64caf-6d06-446d-b740-6d36682df868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:01.885473 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3ffd0-41e3-4c2d-89a5-82187118256a None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:01.885473 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3ffd0-41e3-4c2d-89a5-82187118256a None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:01.885473 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3ffd0-41e3-4c2d-89a5-82187118256a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:01.904384 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-4de3ffd0-41e3-4c2d-89a5-82187118256a None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:01.905605 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-4de3ffd0-41e3-4c2d-89a5-82187118256a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:01.908929 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-2ce64caf-6d06-446d-b740-6d36682df868 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:01.908929 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-2ce64caf-6d06-446d-b740-6d36682df868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:01.983129 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3565/7150] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:39:01.996908 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4acb936-7fea-406f-b212-10f65f9b9902 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:01.996908 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4acb936-7fea-406f-b212-10f65f9b9902 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:01.996908 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4acb936-7fea-406f-b212-10f65f9b9902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:01.997726 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3586/7151] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:39:02.007531 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de3ffd0-41e3-4c2d-89a5-82187118256a None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:02.007531 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-4de3ffd0-41e3-4c2d-89a5-82187118256a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:02.047407 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-b4acb936-7fea-406f-b212-10f65f9b9902 None None] MFA Rules not processed for user `b02b297c807344d68a26dcd95cef3d49`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:02.048969 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b4acb936-7fea-406f-b212-10f65f9b9902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:02.154925 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de3ffd0-41e3-4c2d-89a5-82187118256a None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:02.168219 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646d4277-18d9-4552-911f-a100e9e5be85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:02.173434 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3566/7152] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:01 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:39:02.175234 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d72fa0-9fc4-4057-936f-da94e1e07fa9 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:02.175756 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d72fa0-9fc4-4057-936f-da94e1e07fa9 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:02.176263 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d72fa0-9fc4-4057-936f-da94e1e07fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:02.177221 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d4277-18d9-4552-911f-a100e9e5be85 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:02.177532 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d4277-18d9-4552-911f-a100e9e5be85 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:02.177881 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d4277-18d9-4552-911f-a100e9e5be85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:02.207124 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646d4277-18d9-4552-911f-a100e9e5be85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:02.210475 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646d4277-18d9-4552-911f-a100e9e5be85 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:02.240026 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3587/7153] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:39:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:39:02.241034 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-29d72fa0-9fc4-4057-936f-da94e1e07fa9 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:02.241359 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646d4277-18d9-4552-911f-a100e9e5be85 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:02.242742 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-29d72fa0-9fc4-4057-936f-da94e1e07fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:02.243353 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-646d4277-18d9-4552-911f-a100e9e5be85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:02.258707 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646d4277-18d9-4552-911f-a100e9e5be85 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:02.261980 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3567/7154] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:39:02.264175 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715cc900-1ecf-4149-baae-d6880c7ecf41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:02.265044 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715cc900-1ecf-4149-baae-d6880c7ecf41 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:02.265871 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715cc900-1ecf-4149-baae-d6880c7ecf41 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:02.266578 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715cc900-1ecf-4149-baae-d6880c7ecf41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:02.267235 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d72fa0-9fc4-4057-936f-da94e1e07fa9 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:02.280179 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715cc900-1ecf-4149-baae-d6880c7ecf41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:02.283351 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715cc900-1ecf-4149-baae-d6880c7ecf41 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:02.289335 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d72fa0-9fc4-4057-936f-da94e1e07fa9 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:02.302273 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810562c-bca2-460f-863d-f6f210ceab8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:02.304156 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3588/7155] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:39:02 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:39:02.308304 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810562c-bca2-460f-863d-f6f210ceab8b admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:02.308822 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810562c-bca2-460f-863d-f6f210ceab8b admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:02.309499 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810562c-bca2-460f-863d-f6f210ceab8b admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:02.311937 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4810562c-bca2-460f-863d-f6f210ceab8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:39:02.311937 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4810562c-bca2-460f-863d-f6f210ceab8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:02.312508 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4810562c-bca2-460f-863d-f6f210ceab8b admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:02.330385 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3568/7156] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:39:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:39:02.331979 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715cc900-1ecf-4149-baae-d6880c7ecf41 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:02.352457 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715cc900-1ecf-4149-baae-d6880c7ecf41 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:02.357833 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b3815-f60e-436b-ad23-9b1216fe6a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:02.358621 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b3815-f60e-436b-ad23-9b1216fe6a97 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:02.358909 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b3815-f60e-436b-ad23-9b1216fe6a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:02.359185 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b3815-f60e-436b-ad23-9b1216fe6a97 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:02.359972 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029b3815-f60e-436b-ad23-9b1216fe6a97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:02.362770 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029b3815-f60e-436b-ad23-9b1216fe6a97 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:02.455563 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3589/7157] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:39:02 2022] POST /identity/v3/projects => generated 373 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:39:02.458529 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810562c-bca2-460f-863d-f6f210ceab8b admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:02.470272 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810562c-bca2-460f-863d-f6f210ceab8b admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:02.552793 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e32b822-548a-4a1c-99b0-85e1d70bce78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:02.553749 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e32b822-548a-4a1c-99b0-85e1d70bce78 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:02.553749 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e32b822-548a-4a1c-99b0-85e1d70bce78 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:02.554038 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e32b822-548a-4a1c-99b0-85e1d70bce78 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:02.555173 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e32b822-548a-4a1c-99b0-85e1d70bce78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:02.560680 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e32b822-548a-4a1c-99b0-85e1d70bce78 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:02.591288 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b3815-f60e-436b-ad23-9b1216fe6a97 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:02.593534 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-029b3815-f60e-436b-ad23-9b1216fe6a97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:02.633554 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b3815-f60e-436b-ad23-9b1216fe6a97 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:02.643296 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36354a6b-bfc3-441a-82af-b69a3479394f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:02.645221 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36354a6b-bfc3-441a-82af-b69a3479394f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:02.645690 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36354a6b-bfc3-441a-82af-b69a3479394f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:02.646110 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36354a6b-bfc3-441a-82af-b69a3479394f admin admin] PATH_INFO: `/v3/projects/67c41a850dc04e9da422be7688c38925` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:02.648618 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36354a6b-bfc3-441a-82af-b69a3479394f admin admin] RBAC: Authorizing `identity:delete_project(project_id=67c41a850dc04e9da422be7688c38925)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:02.651437 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36354a6b-bfc3-441a-82af-b69a3479394f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:02.696065 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3569/7158] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:39:02 2022] POST /identity/v3/users => generated 287 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:39:02.699782 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e32b822-548a-4a1c-99b0-85e1d70bce78 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:02.712435 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e32b822-548a-4a1c-99b0-85e1d70bce78 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:02.718322 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a169f1cd-c5cd-4ecb-8f9b-5c61a20cf63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:02.719415 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a169f1cd-c5cd-4ecb-8f9b-5c61a20cf63e admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:02.719743 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a169f1cd-c5cd-4ecb-8f9b-5c61a20cf63e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:02.720255 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a169f1cd-c5cd-4ecb-8f9b-5c61a20cf63e admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:02.720982 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a169f1cd-c5cd-4ecb-8f9b-5c61a20cf63e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:02.722667 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a169f1cd-c5cd-4ecb-8f9b-5c61a20cf63e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:02.735550 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3570/7159] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:39:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:39:02.739697 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a169f1cd-c5cd-4ecb-8f9b-5c61a20cf63e admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:02.750483 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a169f1cd-c5cd-4ecb-8f9b-5c61a20cf63e admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:02.755452 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb4fba-7c83-4186-9b3b-f0d0422bce9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:02.756334 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb4fba-7c83-4186-9b3b-f0d0422bce9b admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:02.756785 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb4fba-7c83-4186-9b3b-f0d0422bce9b admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:02.757206 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb4fba-7c83-4186-9b3b-f0d0422bce9b admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:02.757929 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbb4fba-7c83-4186-9b3b-f0d0422bce9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:02.759547 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbb4fba-7c83-4186-9b3b-f0d0422bce9b admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:02.771141 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3571/7160] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:39:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:39:02.776886 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb4fba-7c83-4186-9b3b-f0d0422bce9b admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:02.787678 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb4fba-7c83-4186-9b3b-f0d0422bce9b admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:02.794304 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-36354a6b-bfc3-441a-82af-b69a3479394f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67c41a850dc04e9da422be7688c38925', 'request_id': 'req-36354a6b-bfc3-441a-82af-b69a3479394f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:02.816510 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-36354a6b-bfc3-441a-82af-b69a3479394f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67c41a850dc04e9da422be7688c38925', 'request_id': 'req-36354a6b-bfc3-441a-82af-b69a3479394f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:02.868438 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e4f0c0-f75e-4b4e-970e-c9d3fd3af3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:02.869391 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e4f0c0-f75e-4b4e-970e-c9d3fd3af3f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:02.869804 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e4f0c0-f75e-4b4e-970e-c9d3fd3af3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:02.870112 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e4f0c0-f75e-4b4e-970e-c9d3fd3af3f8 admin admin] PATH_INFO: `/v3/projects/7a037f5371734a5ea7990a70cf28a823/users/6594bfb5a8394826bdd4354dc1dfcd46/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:02.886226 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e4f0c0-f75e-4b4e-970e-c9d3fd3af3f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a037f5371734a5ea7990a70cf28a823, user_id=6594bfb5a8394826bdd4354dc1dfcd46, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:02.889624 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e4f0c0-f75e-4b4e-970e-c9d3fd3af3f8 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:02.914898 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-36354a6b-bfc3-441a-82af-b69a3479394f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67c41a850dc04e9da422be7688c38925', 'request_id': 'req-36354a6b-bfc3-441a-82af-b69a3479394f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:02.928405 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-36354a6b-bfc3-441a-82af-b69a3479394f admin admin] The token cache is being invalidate because project 67c41a850dc04e9da422be7688c38925 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:39:02.928969 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-36354a6b-bfc3-441a-82af-b69a3479394f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:02.929842 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-36354a6b-bfc3-441a-82af-b69a3479394f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:02.933304 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3590/7161] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:39:02 2022] DELETE /identity/v3/projects/67c41a850dc04e9da422be7688c38925 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:02.937854 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d158f-3985-4736-a3cb-9a231f2c35da None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:02.938155 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d158f-3985-4736-a3cb-9a231f2c35da None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:02.938553 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d158f-3985-4736-a3cb-9a231f2c35da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:02.945497 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3572/7162] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:39:02 2022] PUT /identity/v3/projects/7a037f5371734a5ea7990a70cf28a823/users/6594bfb5a8394826bdd4354dc1dfcd46/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:02.956617 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c99f5ec-d02f-4804-aad9-148d83789400 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:02.957765 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c99f5ec-d02f-4804-aad9-148d83789400 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:02.961318 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c99f5ec-d02f-4804-aad9-148d83789400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:02.961420 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-a73d158f-3985-4736-a3cb-9a231f2c35da None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:02.962097 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-a73d158f-3985-4736-a3cb-9a231f2c35da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:02.992395 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-8c99f5ec-d02f-4804-aad9-148d83789400 None None] MFA Rules not processed for user `6594bfb5a8394826bdd4354dc1dfcd46`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:02.994001 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8c99f5ec-d02f-4804-aad9-148d83789400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:03.034559 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3591/7163] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:39:03.044377 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a57233-1e44-422f-93cb-4c0764fa903b None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:03.058589 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a57233-1e44-422f-93cb-4c0764fa903b None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:03.058589 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a57233-1e44-422f-93cb-4c0764fa903b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:03.094846 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-18a57233-1e44-422f-93cb-4c0764fa903b None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:03.096114 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-18a57233-1e44-422f-93cb-4c0764fa903b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:03.099240 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3573/7164] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:39:03.109995 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3592/7165] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:39:03.112265 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c99f5ec-d02f-4804-aad9-148d83789400 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:03.114249 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a57233-1e44-422f-93cb-4c0764fa903b None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:03.115778 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8c99f5ec-d02f-4804-aad9-148d83789400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:03.125688 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a57233-1e44-422f-93cb-4c0764fa903b None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:03.131270 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f36cae-5b88-45ba-a830-beaec3ce65f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:03.132052 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f36cae-5b88-45ba-a830-beaec3ce65f4 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:03.132340 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f36cae-5b88-45ba-a830-beaec3ce65f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:03.132618 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f36cae-5b88-45ba-a830-beaec3ce65f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:03.133347 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f36cae-5b88-45ba-a830-beaec3ce65f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:39:03.133658 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f36cae-5b88-45ba-a830-beaec3ce65f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:03.135522 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f36cae-5b88-45ba-a830-beaec3ce65f4 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:03.154651 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3593/7166] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:39:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:39:03.155641 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f36cae-5b88-45ba-a830-beaec3ce65f4 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:03.166577 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f36cae-5b88-45ba-a830-beaec3ce65f4 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:03.173462 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203e591b-97f8-44a9-a3da-7329f72efb85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:03.174237 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e591b-97f8-44a9-a3da-7329f72efb85 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:03.174479 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e591b-97f8-44a9-a3da-7329f72efb85 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:03.174757 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e591b-97f8-44a9-a3da-7329f72efb85 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:03.179118 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203e591b-97f8-44a9-a3da-7329f72efb85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:03.179118 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203e591b-97f8-44a9-a3da-7329f72efb85 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:03.191361 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c99f5ec-d02f-4804-aad9-148d83789400 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:03.195089 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a495bd-6da2-4151-9be0-8c7918a52cf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:03.195799 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a495bd-6da2-4151-9be0-8c7918a52cf0 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:03.196098 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a495bd-6da2-4151-9be0-8c7918a52cf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:03.196374 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a495bd-6da2-4151-9be0-8c7918a52cf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:03.205781 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a495bd-6da2-4151-9be0-8c7918a52cf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:03.207213 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a495bd-6da2-4151-9be0-8c7918a52cf0 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:03.216654 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3574/7167] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:39:03 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:39:03.276979 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3594/7168] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:39:03 2022] POST /identity/v3/projects => generated 403 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:39:03.277762 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a495bd-6da2-4151-9be0-8c7918a52cf0 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:03.300518 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a495bd-6da2-4151-9be0-8c7918a52cf0 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:03.417418 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bbc2e2-2dd5-46e6-b2fd-809d4e3a685e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:03.418520 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bbc2e2-2dd5-46e6-b2fd-809d4e3a685e admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:03.418520 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bbc2e2-2dd5-46e6-b2fd-809d4e3a685e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:03.418779 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bbc2e2-2dd5-46e6-b2fd-809d4e3a685e admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:03.419436 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bbc2e2-2dd5-46e6-b2fd-809d4e3a685e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:03.421448 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bbc2e2-2dd5-46e6-b2fd-809d4e3a685e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:03.487738 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3575/7169] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:39:03 2022] POST /identity/v3/users => generated 302 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:39:03.491947 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203e591b-97f8-44a9-a3da-7329f72efb85 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:03.504124 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203e591b-97f8-44a9-a3da-7329f72efb85 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:03.508699 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc156d8-2cb6-4bfb-b73d-e1cb238efe82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:03.509359 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc156d8-2cb6-4bfb-b73d-e1cb238efe82 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:03.509642 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc156d8-2cb6-4bfb-b73d-e1cb238efe82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:03.509920 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc156d8-2cb6-4bfb-b73d-e1cb238efe82 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:03.510634 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc156d8-2cb6-4bfb-b73d-e1cb238efe82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:03.512284 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc156d8-2cb6-4bfb-b73d-e1cb238efe82 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:03.523949 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3595/7170] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:39:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:39:03.528088 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bbc2e2-2dd5-46e6-b2fd-809d4e3a685e admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:03.539229 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bbc2e2-2dd5-46e6-b2fd-809d4e3a685e admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:03.545116 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36aae4f-3aec-4c81-b036-2ef3a5ec066d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:03.545798 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36aae4f-3aec-4c81-b036-2ef3a5ec066d admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:03.546254 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36aae4f-3aec-4c81-b036-2ef3a5ec066d admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:03.546542 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36aae4f-3aec-4c81-b036-2ef3a5ec066d admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:03.547275 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36aae4f-3aec-4c81-b036-2ef3a5ec066d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:03.549435 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36aae4f-3aec-4c81-b036-2ef3a5ec066d admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:03.562687 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3576/7171] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:39:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:39:03.566641 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc156d8-2cb6-4bfb-b73d-e1cb238efe82 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:03.582160 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc156d8-2cb6-4bfb-b73d-e1cb238efe82 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:03.589784 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc01308f-5665-47d4-a6b9-d30d41e3d6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:03.590878 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01308f-5665-47d4-a6b9-d30d41e3d6f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:03.591132 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01308f-5665-47d4-a6b9-d30d41e3d6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:03.591419 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01308f-5665-47d4-a6b9-d30d41e3d6f1 admin admin] PATH_INFO: `/v3/projects/9350e2c35f4d4b61ad11c2c47d0463cc/users/91bd0268abac416cb1145af415f0586d/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:03.607843 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc01308f-5665-47d4-a6b9-d30d41e3d6f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9350e2c35f4d4b61ad11c2c47d0463cc, user_id=91bd0268abac416cb1145af415f0586d, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:03.610558 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc01308f-5665-47d4-a6b9-d30d41e3d6f1 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:03.681100 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3596/7172] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:39:03 2022] PUT /identity/v3/projects/9350e2c35f4d4b61ad11c2c47d0463cc/users/91bd0268abac416cb1145af415f0586d/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:39:03.692287 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b0364-f163-4db6-9fb1-690d71be72ca None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:03.692582 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b0364-f163-4db6-9fb1-690d71be72ca None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:03.692864 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b0364-f163-4db6-9fb1-690d71be72ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:03.751369 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-0d0b0364-f163-4db6-9fb1-690d71be72ca None None] MFA Rules not processed for user `91bd0268abac416cb1145af415f0586d`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:03.751369 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-0d0b0364-f163-4db6-9fb1-690d71be72ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:03.867532 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3577/7173] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:03 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:39:03.871059 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc01308f-5665-47d4-a6b9-d30d41e3d6f1 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:03.953230 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc01308f-5665-47d4-a6b9-d30d41e3d6f1 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:03.958501 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271f6fd4-0663-4b4d-a209-dd21b55d9e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:03.959202 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f6fd4-0663-4b4d-a209-dd21b55d9e8c admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:03.959580 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f6fd4-0663-4b4d-a209-dd21b55d9e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:03.959859 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f6fd4-0663-4b4d-a209-dd21b55d9e8c admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:03.960552 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271f6fd4-0663-4b4d-a209-dd21b55d9e8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:03.963945 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271f6fd4-0663-4b4d-a209-dd21b55d9e8c admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:04.070633 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3597/7174] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:39:03 2022] POST /identity/v3/projects => generated 405 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:39:04.076272 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b0364-f163-4db6-9fb1-690d71be72ca None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:04.103630 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b0364-f163-4db6-9fb1-690d71be72ca None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:04.210478 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca72bd9-780c-450d-b696-0bff95cc4cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:04.211163 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca72bd9-780c-450d-b696-0bff95cc4cf7 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:04.211452 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca72bd9-780c-450d-b696-0bff95cc4cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:04.211773 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca72bd9-780c-450d-b696-0bff95cc4cf7 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:04.212480 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca72bd9-780c-450d-b696-0bff95cc4cf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:04.214431 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca72bd9-780c-450d-b696-0bff95cc4cf7 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:04.344733 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3578/7175] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:39:04 2022] POST /identity/v3/users => generated 309 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:39:04.350081 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271f6fd4-0663-4b4d-a209-dd21b55d9e8c admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:04.362852 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271f6fd4-0663-4b4d-a209-dd21b55d9e8c admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:04.380686 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825ad86e-45f8-413b-ad0b-612a347ded32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:04.381022 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ad86e-45f8-413b-ad0b-612a347ded32 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:04.381313 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ad86e-45f8-413b-ad0b-612a347ded32 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:04.381594 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ad86e-45f8-413b-ad0b-612a347ded32 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:04.382755 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825ad86e-45f8-413b-ad0b-612a347ded32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:04.384213 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825ad86e-45f8-413b-ad0b-612a347ded32 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:04.400652 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3598/7176] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:39:04 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:39:04.404569 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca72bd9-780c-450d-b696-0bff95cc4cf7 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:04.426897 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca72bd9-780c-450d-b696-0bff95cc4cf7 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:04.433085 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5597076b-0cbe-4692-935c-2ec96eae3328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:04.434159 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5597076b-0cbe-4692-935c-2ec96eae3328 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:04.434488 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5597076b-0cbe-4692-935c-2ec96eae3328 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:04.435013 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5597076b-0cbe-4692-935c-2ec96eae3328 admin admin] PATH_INFO: `/v3/projects/4f4f3462818149bebc8e0d9b5217b123/users/812fb9ea8c5b4fc2be72f30f8c682ef6/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:04.451936 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5597076b-0cbe-4692-935c-2ec96eae3328 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f4f3462818149bebc8e0d9b5217b123, user_id=812fb9ea8c5b4fc2be72f30f8c682ef6, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:04.454836 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5597076b-0cbe-4692-935c-2ec96eae3328 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:04.486766 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825ad86e-45f8-413b-ad0b-612a347ded32 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:04.488582 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-825ad86e-45f8-413b-ad0b-612a347ded32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:04.507669 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825ad86e-45f8-413b-ad0b-612a347ded32 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:04.526794 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff63744e-07d0-4b51-8c0c-a93efe1885ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:04.526794 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff63744e-07d0-4b51-8c0c-a93efe1885ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:04.526794 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff63744e-07d0-4b51-8c0c-a93efe1885ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:04.526794 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff63744e-07d0-4b51-8c0c-a93efe1885ad admin admin] PATH_INFO: `/v3/users/6594bfb5a8394826bdd4354dc1dfcd46` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:04.527156 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff63744e-07d0-4b51-8c0c-a93efe1885ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=6594bfb5a8394826bdd4354dc1dfcd46)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:04.527156 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff63744e-07d0-4b51-8c0c-a93efe1885ad admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:04.616329 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3579/7177] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:39:04 2022] PUT /identity/v3/projects/4f4f3462818149bebc8e0d9b5217b123/users/812fb9ea8c5b4fc2be72f30f8c682ef6/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:04.617679 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5597076b-0cbe-4692-935c-2ec96eae3328 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:04.709976 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5597076b-0cbe-4692-935c-2ec96eae3328 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:04.717420 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a2dc81-689d-476d-8449-d2a703487842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:04.718115 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a2dc81-689d-476d-8449-d2a703487842 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:04.723241 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a2dc81-689d-476d-8449-d2a703487842 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:04.723241 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a2dc81-689d-476d-8449-d2a703487842 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:04.723241 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a2dc81-689d-476d-8449-d2a703487842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:04.723241 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a2dc81-689d-476d-8449-d2a703487842 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:04.733810 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3580/7178] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:39:04 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:39:04.737886 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a2dc81-689d-476d-8449-d2a703487842 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:04.748823 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a2dc81-689d-476d-8449-d2a703487842 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:04.760420 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4046c5a2-981a-491e-ab4b-be567abb8825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:04.763174 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4046c5a2-981a-491e-ab4b-be567abb8825 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:04.763801 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4046c5a2-981a-491e-ab4b-be567abb8825 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:04.764324 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4046c5a2-981a-491e-ab4b-be567abb8825 admin admin] PATH_INFO: `/v3/projects/4f4f3462818149bebc8e0d9b5217b123/users/812fb9ea8c5b4fc2be72f30f8c682ef6/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:04.767250 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4046c5a2-981a-491e-ab4b-be567abb8825 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f4f3462818149bebc8e0d9b5217b123, user_id=812fb9ea8c5b4fc2be72f30f8c682ef6, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:04.772869 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4046c5a2-981a-491e-ab4b-be567abb8825 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:04.802462 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ff63744e-07d0-4b51-8c0c-a93efe1885ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6594bfb5a8394826bdd4354dc1dfcd46'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:04.819814 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3581/7179] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:39:04 2022] PUT /identity/v3/projects/4f4f3462818149bebc8e0d9b5217b123/users/812fb9ea8c5b4fc2be72f30f8c682ef6/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:39:04.822297 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ff63744e-07d0-4b51-8c0c-a93efe1885ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6594bfb5a8394826bdd4354dc1dfcd46'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:04.830956 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ff63744e-07d0-4b51-8c0c-a93efe1885ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6594bfb5a8394826bdd4354dc1dfcd46'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:04.833310 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95630f4-69ce-4dbe-858b-71da76b73d2e None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:04.833622 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95630f4-69ce-4dbe-858b-71da76b73d2e None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:04.834052 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95630f4-69ce-4dbe-858b-71da76b73d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:04.870288 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-b95630f4-69ce-4dbe-858b-71da76b73d2e None None] MFA Rules not processed for user `812fb9ea8c5b4fc2be72f30f8c682ef6`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:04.871528 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b95630f4-69ce-4dbe-858b-71da76b73d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:04.953291 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ff63744e-07d0-4b51-8c0c-a93efe1885ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6594bfb5a8394826bdd4354dc1dfcd46'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:04.954331 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ff63744e-07d0-4b51-8c0c-a93efe1885ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6594bfb5a8394826bdd4354dc1dfcd46'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:04.964766 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3599/7180] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:39:04 2022] DELETE /identity/v3/users/6594bfb5a8394826bdd4354dc1dfcd46 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:39:04.970205 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1606f6-d2f9-4eab-b88d-208a51015e87 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:04.971373 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1606f6-d2f9-4eab-b88d-208a51015e87 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:04.972531 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1606f6-d2f9-4eab-b88d-208a51015e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:05.001036 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3582/7181] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:04 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:39:05.002461 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-4a1606f6-d2f9-4eab-b88d-208a51015e87 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:05.003914 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-4a1606f6-d2f9-4eab-b88d-208a51015e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:05.014110 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95630f4-69ce-4dbe-858b-71da76b73d2e None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:05.015950 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b95630f4-69ce-4dbe-858b-71da76b73d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:05.085140 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3600/7182] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:39:05.100072 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1606f6-d2f9-4eab-b88d-208a51015e87 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:05.101925 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-4a1606f6-d2f9-4eab-b88d-208a51015e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:05.130441 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95630f4-69ce-4dbe-858b-71da76b73d2e None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:05.213051 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6877573c-ec8b-43e0-bb0f-694771e06130 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198271d1c0d44cb58bace41a65f4b94c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:05.213704 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877573c-ec8b-43e0-bb0f-694771e06130 service cinder] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:05.214085 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877573c-ec8b-43e0-bb0f-694771e06130 service cinder] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:05.214370 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877573c-ec8b-43e0-bb0f-694771e06130 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:05.237910 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1606f6-d2f9-4eab-b88d-208a51015e87 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:05.242781 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e3dc0e-0f41-4d76-b5d6-71d4bcf9437a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:05.243448 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e3dc0e-0f41-4d76-b5d6-71d4bcf9437a service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:05.243832 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e3dc0e-0f41-4d76-b5d6-71d4bcf9437a service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:05.244576 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e3dc0e-0f41-4d76-b5d6-71d4bcf9437a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:05.258720 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e3dc0e-0f41-4d76-b5d6-71d4bcf9437a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:05.261440 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e3dc0e-0f41-4d76-b5d6-71d4bcf9437a service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:05.275192 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3601/7183] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:39:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:39:05.322728 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6877573c-ec8b-43e0-bb0f-694771e06130 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:05.324682 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6877573c-ec8b-43e0-bb0f-694771e06130 service cinder] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:05.336255 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3583/7184] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:39:05 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:39:05.436470 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e3dc0e-0f41-4d76-b5d6-71d4bcf9437a service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:05.438398 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-00e3dc0e-0f41-4d76-b5d6-71d4bcf9437a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:05.463283 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e3dc0e-0f41-4d76-b5d6-71d4bcf9437a service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:05.469706 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ead8b1-6804-469c-a9a7-4772daa271ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:05.470602 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ead8b1-6804-469c-a9a7-4772daa271ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:05.470888 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ead8b1-6804-469c-a9a7-4772daa271ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:05.471168 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ead8b1-6804-469c-a9a7-4772daa271ec admin admin] PATH_INFO: `/v3/users/068a441a1b2e472fb43a8ae2021a35c4` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:05.472477 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ead8b1-6804-469c-a9a7-4772daa271ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=068a441a1b2e472fb43a8ae2021a35c4)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:05.474497 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ead8b1-6804-469c-a9a7-4772daa271ec admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:05.514795 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6877573c-ec8b-43e0-bb0f-694771e06130 service cinder] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:05.516565 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-6877573c-ec8b-43e0-bb0f-694771e06130 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:05.532823 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6877573c-ec8b-43e0-bb0f-694771e06130 service cinder] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:05.537961 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46162f63-974f-44ec-92a5-a95ab1a4524d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:05.538859 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46162f63-974f-44ec-92a5-a95ab1a4524d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:05.539145 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46162f63-974f-44ec-92a5-a95ab1a4524d admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:05.539423 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46162f63-974f-44ec-92a5-a95ab1a4524d admin admin] PATH_INFO: `/v3/users/91bd0268abac416cb1145af415f0586d` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:05.540715 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46162f63-974f-44ec-92a5-a95ab1a4524d admin admin] RBAC: Authorizing `identity:delete_user(user_id=91bd0268abac416cb1145af415f0586d)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:05.542755 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46162f63-974f-44ec-92a5-a95ab1a4524d admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:05.631636 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e1ead8b1-6804-469c-a9a7-4772daa271ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '068a441a1b2e472fb43a8ae2021a35c4'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:05.650708 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e1ead8b1-6804-469c-a9a7-4772daa271ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '068a441a1b2e472fb43a8ae2021a35c4'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:05.659915 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e1ead8b1-6804-469c-a9a7-4772daa271ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '068a441a1b2e472fb43a8ae2021a35c4'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:05.782031 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e1ead8b1-6804-469c-a9a7-4772daa271ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '068a441a1b2e472fb43a8ae2021a35c4'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:05.782738 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e1ead8b1-6804-469c-a9a7-4772daa271ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '068a441a1b2e472fb43a8ae2021a35c4'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:05.792399 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3602/7185] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:39:05 2022] DELETE /identity/v3/users/068a441a1b2e472fb43a8ae2021a35c4 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:05.795343 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198571a2-1713-44a3-962c-2b2ed9b22138 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:05.795695 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198571a2-1713-44a3-962c-2b2ed9b22138 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:05.795979 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198571a2-1713-44a3-962c-2b2ed9b22138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:05.798052 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-46162f63-974f-44ec-92a5-a95ab1a4524d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91bd0268abac416cb1145af415f0586d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:05.810248 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-46162f63-974f-44ec-92a5-a95ab1a4524d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91bd0268abac416cb1145af415f0586d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:05.810248 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-46162f63-974f-44ec-92a5-a95ab1a4524d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91bd0268abac416cb1145af415f0586d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:05.814839 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-198571a2-1713-44a3-962c-2b2ed9b22138 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:05.816271 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-198571a2-1713-44a3-962c-2b2ed9b22138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:05.884564 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3603/7186] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:39:05.894335 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198571a2-1713-44a3-962c-2b2ed9b22138 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:05.896133 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-198571a2-1713-44a3-962c-2b2ed9b22138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:05.928808 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-46162f63-974f-44ec-92a5-a95ab1a4524d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91bd0268abac416cb1145af415f0586d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:05.952173 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-46162f63-974f-44ec-92a5-a95ab1a4524d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91bd0268abac416cb1145af415f0586d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:05.958738 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3584/7187] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:39:05 2022] DELETE /identity/v3/users/91bd0268abac416cb1145af415f0586d => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:05.960079 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46162f63-974f-44ec-92a5-a95ab1a4524d admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:05.961542 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-46162f63-974f-44ec-92a5-a95ab1a4524d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:05.967786 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198571a2-1713-44a3-962c-2b2ed9b22138 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:06.024214 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8895d8-c157-4ed3-bbf0-194e35be1400 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:06.024879 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8895d8-c157-4ed3-bbf0-194e35be1400 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:06.025364 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8895d8-c157-4ed3-bbf0-194e35be1400 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:06.026142 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8895d8-c157-4ed3-bbf0-194e35be1400 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:06.029367 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-9e8895d8-c157-4ed3-bbf0-194e35be1400 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:06.037691 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46162f63-974f-44ec-92a5-a95ab1a4524d admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:06.044188 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8895d8-c157-4ed3-bbf0-194e35be1400 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:06.044489 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df21896-203e-4037-99d5-16d8c084a38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:06.046188 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8895d8-c157-4ed3-bbf0-194e35be1400 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:06.047605 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df21896-203e-4037-99d5-16d8c084a38a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:06.048016 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df21896-203e-4037-99d5-16d8c084a38a admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:06.048384 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df21896-203e-4037-99d5-16d8c084a38a admin admin] PATH_INFO: `/v3/projects/7a037f5371734a5ea7990a70cf28a823` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:06.049814 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df21896-203e-4037-99d5-16d8c084a38a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a037f5371734a5ea7990a70cf28a823)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:06.052142 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df21896-203e-4037-99d5-16d8c084a38a admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:06.057471 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3604/7188] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:39:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:39:06.058884 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836ec1b-b724-4b2b-987a-29f05f562bea None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:06.061208 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836ec1b-b724-4b2b-987a-29f05f562bea None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:06.061507 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836ec1b-b724-4b2b-987a-29f05f562bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:06.081014 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-0836ec1b-b724-4b2b-987a-29f05f562bea None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:06.082450 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-0836ec1b-b724-4b2b-987a-29f05f562bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:06.094996 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3605/7189] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:39:06.102677 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0836ec1b-b724-4b2b-987a-29f05f562bea None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:06.104840 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-0836ec1b-b724-4b2b-987a-29f05f562bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:06.123595 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0836ec1b-b724-4b2b-987a-29f05f562bea None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:06.127673 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c7236a-08c3-40eb-bc9b-c85654fef949 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:06.128590 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7236a-08c3-40eb-bc9b-c85654fef949 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:06.128983 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7236a-08c3-40eb-bc9b-c85654fef949 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:06.129384 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7236a-08c3-40eb-bc9b-c85654fef949 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:06.143116 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c7236a-08c3-40eb-bc9b-c85654fef949 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:06.145033 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c7236a-08c3-40eb-bc9b-c85654fef949 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:06.175188 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3606/7190] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:39:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:39:06.242417 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0df21896-203e-4037-99d5-16d8c084a38a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a037f5371734a5ea7990a70cf28a823', 'request_id': 'req-0df21896-203e-4037-99d5-16d8c084a38a'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:06.261110 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0df21896-203e-4037-99d5-16d8c084a38a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a037f5371734a5ea7990a70cf28a823', 'request_id': 'req-0df21896-203e-4037-99d5-16d8c084a38a'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:06.276413 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0df21896-203e-4037-99d5-16d8c084a38a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a037f5371734a5ea7990a70cf28a823', 'request_id': 'req-0df21896-203e-4037-99d5-16d8c084a38a'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:06.424649 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0df21896-203e-4037-99d5-16d8c084a38a admin admin] The token cache is being invalidate because project 7a037f5371734a5ea7990a70cf28a823 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:39:06.424888 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0df21896-203e-4037-99d5-16d8c084a38a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:06.425568 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0df21896-203e-4037-99d5-16d8c084a38a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:06.430703 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3585/7191] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:39:05 2022] DELETE /identity/v3/projects/7a037f5371734a5ea7990a70cf28a823 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:06.432434 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2668c0a-0886-44f5-ae9e-8542ed362194 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:06.432725 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2668c0a-0886-44f5-ae9e-8542ed362194 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:06.433005 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2668c0a-0886-44f5-ae9e-8542ed362194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:06.473061 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-f2668c0a-0886-44f5-ae9e-8542ed362194 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:06.474302 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-f2668c0a-0886-44f5-ae9e-8542ed362194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:06.586181 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3607/7192] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:39:06.594093 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea905b95-f8c7-4567-a2cc-0f524c837afa None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:06.594382 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea905b95-f8c7-4567-a2cc-0f524c837afa None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:06.594661 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea905b95-f8c7-4567-a2cc-0f524c837afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:06.614694 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-ea905b95-f8c7-4567-a2cc-0f524c837afa None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:06.615956 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-ea905b95-f8c7-4567-a2cc-0f524c837afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:06.629145 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3586/7193] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:39:06.630488 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2668c0a-0886-44f5-ae9e-8542ed362194 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:06.641122 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2668c0a-0886-44f5-ae9e-8542ed362194 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:06.647747 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a39677-ac65-4b91-8540-727cee7ca7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:06.648798 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a39677-ac65-4b91-8540-727cee7ca7dc admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:06.649172 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a39677-ac65-4b91-8540-727cee7ca7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:06.653809 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a39677-ac65-4b91-8540-727cee7ca7dc admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:06.653809 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a39677-ac65-4b91-8540-727cee7ca7dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:39:06.653809 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a39677-ac65-4b91-8540-727cee7ca7dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:06.653809 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a39677-ac65-4b91-8540-727cee7ca7dc admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:06.672723 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3608/7194] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:39:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:39:06.673982 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea905b95-f8c7-4567-a2cc-0f524c837afa None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:06.685899 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea905b95-f8c7-4567-a2cc-0f524c837afa None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:06.690918 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ba191a-b6dd-46ef-8d99-f4ffcfd423f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:06.691629 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba191a-b6dd-46ef-8d99-f4ffcfd423f2 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:06.691918 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba191a-b6dd-46ef-8d99-f4ffcfd423f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:06.692195 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba191a-b6dd-46ef-8d99-f4ffcfd423f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:06.692891 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ba191a-b6dd-46ef-8d99-f4ffcfd423f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:06.694810 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ba191a-b6dd-46ef-8d99-f4ffcfd423f2 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:06.798098 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a39677-ac65-4b91-8540-727cee7ca7dc admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:06.800482 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-39a39677-ac65-4b91-8540-727cee7ca7dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:06.832502 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a39677-ac65-4b91-8540-727cee7ca7dc admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:06.837907 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9493e490-80b0-4abf-8f83-437079dce7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:06.838807 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493e490-80b0-4abf-8f83-437079dce7bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:06.839242 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493e490-80b0-4abf-8f83-437079dce7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:06.839546 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493e490-80b0-4abf-8f83-437079dce7bb admin admin] PATH_INFO: `/v3/projects/9350e2c35f4d4b61ad11c2c47d0463cc` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:06.841662 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9493e490-80b0-4abf-8f83-437079dce7bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=9350e2c35f4d4b61ad11c2c47d0463cc)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:06.843421 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9493e490-80b0-4abf-8f83-437079dce7bb admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:06.898131 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3587/7195] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:39:06 2022] POST /identity/v3/projects => generated 371 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:39:06.902357 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ba191a-b6dd-46ef-8d99-f4ffcfd423f2 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:06.978877 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ba191a-b6dd-46ef-8d99-f4ffcfd423f2 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:06.993795 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9493e490-80b0-4abf-8f83-437079dce7bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9350e2c35f4d4b61ad11c2c47d0463cc', 'request_id': 'req-9493e490-80b0-4abf-8f83-437079dce7bb'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:06.999840 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9493e490-80b0-4abf-8f83-437079dce7bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9350e2c35f4d4b61ad11c2c47d0463cc', 'request_id': 'req-9493e490-80b0-4abf-8f83-437079dce7bb'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:07.039534 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f990ee6c-cd5a-41b1-ba7e-3b915a076ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:07.040208 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f990ee6c-cd5a-41b1-ba7e-3b915a076ebf admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:07.040516 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f990ee6c-cd5a-41b1-ba7e-3b915a076ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:07.040799 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f990ee6c-cd5a-41b1-ba7e-3b915a076ebf admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:07.041484 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f990ee6c-cd5a-41b1-ba7e-3b915a076ebf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:07.044023 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f990ee6c-cd5a-41b1-ba7e-3b915a076ebf admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:07.094431 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9493e490-80b0-4abf-8f83-437079dce7bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9350e2c35f4d4b61ad11c2c47d0463cc', 'request_id': 'req-9493e490-80b0-4abf-8f83-437079dce7bb'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:07.099327 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9493e490-80b0-4abf-8f83-437079dce7bb admin admin] The token cache is being invalidate because project 9350e2c35f4d4b61ad11c2c47d0463cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:39:07.099939 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9493e490-80b0-4abf-8f83-437079dce7bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:07.100403 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9493e490-80b0-4abf-8f83-437079dce7bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:07.102143 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3609/7196] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:39:06 2022] DELETE /identity/v3/projects/9350e2c35f4d4b61ad11c2c47d0463cc => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:07.103114 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9493e490-80b0-4abf-8f83-437079dce7bb admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:07.105093 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-9493e490-80b0-4abf-8f83-437079dce7bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:07.118485 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9493e490-80b0-4abf-8f83-437079dce7bb admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:07.124427 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478289dc-c516-4de1-8a82-b8f5dc158b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:07.125291 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478289dc-c516-4de1-8a82-b8f5dc158b3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:07.125576 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478289dc-c516-4de1-8a82-b8f5dc158b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:07.125853 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478289dc-c516-4de1-8a82-b8f5dc158b3c admin admin] PATH_INFO: `/v3/projects/af9aa213a6aa4d6c87561c5d09263cd7` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:07.127051 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478289dc-c516-4de1-8a82-b8f5dc158b3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=af9aa213a6aa4d6c87561c5d09263cd7)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:07.129087 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478289dc-c516-4de1-8a82-b8f5dc158b3c admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:07.179771 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3588/7197] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:39:06 2022] POST /identity/v3/users => generated 286 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:39:07.180509 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f990ee6c-cd5a-41b1-ba7e-3b915a076ebf admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:07.184676 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-f990ee6c-cd5a-41b1-ba7e-3b915a076ebf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:07.201171 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f990ee6c-cd5a-41b1-ba7e-3b915a076ebf admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:07.208458 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e6ffed-96f7-4715-8b18-1c41101730a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:07.209347 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6ffed-96f7-4715-8b18-1c41101730a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:07.209627 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6ffed-96f7-4715-8b18-1c41101730a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:07.209903 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6ffed-96f7-4715-8b18-1c41101730a5 admin admin] PATH_INFO: `/v3/users/812fb9ea8c5b4fc2be72f30f8c682ef6` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:07.211112 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e6ffed-96f7-4715-8b18-1c41101730a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=812fb9ea8c5b4fc2be72f30f8c682ef6)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:07.213420 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e6ffed-96f7-4715-8b18-1c41101730a5 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:07.339053 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-478289dc-c516-4de1-8a82-b8f5dc158b3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af9aa213a6aa4d6c87561c5d09263cd7', 'request_id': 'req-478289dc-c516-4de1-8a82-b8f5dc158b3c'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:07.346801 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-478289dc-c516-4de1-8a82-b8f5dc158b3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af9aa213a6aa4d6c87561c5d09263cd7', 'request_id': 'req-478289dc-c516-4de1-8a82-b8f5dc158b3c'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:07.417699 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-478289dc-c516-4de1-8a82-b8f5dc158b3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af9aa213a6aa4d6c87561c5d09263cd7', 'request_id': 'req-478289dc-c516-4de1-8a82-b8f5dc158b3c'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:07.437643 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-478289dc-c516-4de1-8a82-b8f5dc158b3c admin admin] The token cache is being invalidate because project af9aa213a6aa4d6c87561c5d09263cd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:39:07.437935 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-478289dc-c516-4de1-8a82-b8f5dc158b3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:07.439929 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-478289dc-c516-4de1-8a82-b8f5dc158b3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:07.441576 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3610/7198] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:39:07 2022] DELETE /identity/v3/projects/af9aa213a6aa4d6c87561c5d09263cd7 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:07.442353 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478289dc-c516-4de1-8a82-b8f5dc158b3c admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:07.444414 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-478289dc-c516-4de1-8a82-b8f5dc158b3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:07.499168 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d1e6ffed-96f7-4715-8b18-1c41101730a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '812fb9ea8c5b4fc2be72f30f8c682ef6'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:07.526892 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d1e6ffed-96f7-4715-8b18-1c41101730a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '812fb9ea8c5b4fc2be72f30f8c682ef6'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:07.531083 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d1e6ffed-96f7-4715-8b18-1c41101730a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '812fb9ea8c5b4fc2be72f30f8c682ef6'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:07.557356 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478289dc-c516-4de1-8a82-b8f5dc158b3c admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:07.564684 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70476bc8-f49a-4ae6-a2e2-d98f4e66520e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:07.565382 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70476bc8-f49a-4ae6-a2e2-d98f4e66520e admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:07.565648 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70476bc8-f49a-4ae6-a2e2-d98f4e66520e admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:07.565914 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70476bc8-f49a-4ae6-a2e2-d98f4e66520e admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:07.566790 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70476bc8-f49a-4ae6-a2e2-d98f4e66520e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:07.569628 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70476bc8-f49a-4ae6-a2e2-d98f4e66520e admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:07.581553 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3611/7199] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:39:07 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:39:07.582466 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70476bc8-f49a-4ae6-a2e2-d98f4e66520e admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:07.584485 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-70476bc8-f49a-4ae6-a2e2-d98f4e66520e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:07.598728 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70476bc8-f49a-4ae6-a2e2-d98f4e66520e admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:07.605130 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22afa1e7-3db8-41cd-a180-77c99c9e0fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:07.606054 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22afa1e7-3db8-41cd-a180-77c99c9e0fed admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:07.606984 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22afa1e7-3db8-41cd-a180-77c99c9e0fed admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:07.607271 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22afa1e7-3db8-41cd-a180-77c99c9e0fed admin admin] PATH_INFO: `/v3/users/b02b297c807344d68a26dcd95cef3d49` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:07.608660 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22afa1e7-3db8-41cd-a180-77c99c9e0fed admin admin] RBAC: Authorizing `identity:delete_user(user_id=b02b297c807344d68a26dcd95cef3d49)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:07.609787 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d1e6ffed-96f7-4715-8b18-1c41101730a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '812fb9ea8c5b4fc2be72f30f8c682ef6'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:07.610619 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22afa1e7-3db8-41cd-a180-77c99c9e0fed admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:07.624864 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d1e6ffed-96f7-4715-8b18-1c41101730a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '812fb9ea8c5b4fc2be72f30f8c682ef6'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:07.636195 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3589/7200] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:39:07 2022] DELETE /identity/v3/users/812fb9ea8c5b4fc2be72f30f8c682ef6 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:07.638663 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e6ffed-96f7-4715-8b18-1c41101730a5 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:07.645406 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-d1e6ffed-96f7-4715-8b18-1c41101730a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:07.724657 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e6ffed-96f7-4715-8b18-1c41101730a5 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:07.729785 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95832672-f43a-4f17-b6fe-cf0aff80b388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:07.730497 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95832672-f43a-4f17-b6fe-cf0aff80b388 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:07.730779 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95832672-f43a-4f17-b6fe-cf0aff80b388 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:07.731660 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95832672-f43a-4f17-b6fe-cf0aff80b388 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:07.732399 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95832672-f43a-4f17-b6fe-cf0aff80b388 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:07.734068 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95832672-f43a-4f17-b6fe-cf0aff80b388 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:07.744570 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3590/7201] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:39:07 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:39:07.749324 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95832672-f43a-4f17-b6fe-cf0aff80b388 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:07.760537 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95832672-f43a-4f17-b6fe-cf0aff80b388 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:07.766418 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3854a2-3859-4179-995d-a2885f94124c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:07.770704 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3854a2-3859-4179-995d-a2885f94124c admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:07.770704 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3854a2-3859-4179-995d-a2885f94124c admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:07.770704 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3854a2-3859-4179-995d-a2885f94124c admin admin] PATH_INFO: `/v3/projects/f7e57d85912841ec87fa9d6cdf63b38c/users/01e8790ef51a4409a24d602504a495ea/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:07.785469 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3854a2-3859-4179-995d-a2885f94124c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7e57d85912841ec87fa9d6cdf63b38c, user_id=01e8790ef51a4409a24d602504a495ea, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:07.788989 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3854a2-3859-4179-995d-a2885f94124c admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:07.832262 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-22afa1e7-3db8-41cd-a180-77c99c9e0fed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b02b297c807344d68a26dcd95cef3d49'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:07.846961 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-22afa1e7-3db8-41cd-a180-77c99c9e0fed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b02b297c807344d68a26dcd95cef3d49'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:07.853844 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-22afa1e7-3db8-41cd-a180-77c99c9e0fed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b02b297c807344d68a26dcd95cef3d49'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:07.911541 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3591/7202] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:39:07 2022] PUT /identity/v3/projects/f7e57d85912841ec87fa9d6cdf63b38c/users/01e8790ef51a4409a24d602504a495ea/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:39:07.924508 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d4e02-e2ed-42f1-ad27-705e46668473 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:07.925027 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d4e02-e2ed-42f1-ad27-705e46668473 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:07.925293 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d4e02-e2ed-42f1-ad27-705e46668473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:07.934138 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-22afa1e7-3db8-41cd-a180-77c99c9e0fed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b02b297c807344d68a26dcd95cef3d49'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:07.935760 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-22afa1e7-3db8-41cd-a180-77c99c9e0fed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b02b297c807344d68a26dcd95cef3d49'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:07.944970 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3612/7203] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:39:07 2022] DELETE /identity/v3/users/b02b297c807344d68a26dcd95cef3d49 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:07.960906 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-ff7d4e02-e2ed-42f1-ad27-705e46668473 None None] MFA Rules not processed for user `01e8790ef51a4409a24d602504a495ea`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:07.962522 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-ff7d4e02-e2ed-42f1-ad27-705e46668473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:08.054707 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3592/7204] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:39:08.059316 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22afa1e7-3db8-41cd-a180-77c99c9e0fed admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:08.060944 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-22afa1e7-3db8-41cd-a180-77c99c9e0fed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:08.138397 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22afa1e7-3db8-41cd-a180-77c99c9e0fed admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:08.143516 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e86d65f-371d-4278-b8d5-817ada28ad22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:08.144322 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e86d65f-371d-4278-b8d5-817ada28ad22 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:08.144606 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e86d65f-371d-4278-b8d5-817ada28ad22 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:08.145149 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e86d65f-371d-4278-b8d5-817ada28ad22 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:08.145862 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e86d65f-371d-4278-b8d5-817ada28ad22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:08.147961 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e86d65f-371d-4278-b8d5-817ada28ad22 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:08.247795 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7d4e02-e2ed-42f1-ad27-705e46668473 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:08.249200 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-ff7d4e02-e2ed-42f1-ad27-705e46668473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:08.264838 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7d4e02-e2ed-42f1-ad27-705e46668473 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:08.269465 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f202d88c-b4aa-4421-871b-ee70a5b9492c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:08.270621 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f202d88c-b4aa-4421-871b-ee70a5b9492c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:08.270901 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f202d88c-b4aa-4421-871b-ee70a5b9492c admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:08.271329 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f202d88c-b4aa-4421-871b-ee70a5b9492c admin admin] PATH_INFO: `/v3/projects/4f4f3462818149bebc8e0d9b5217b123` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:08.272583 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f202d88c-b4aa-4421-871b-ee70a5b9492c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f4f3462818149bebc8e0d9b5217b123)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:08.274506 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f202d88c-b4aa-4421-871b-ee70a5b9492c admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:08.282938 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3613/7205] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:39:08 2022] POST /identity/v3/projects => generated 373 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:39:08.286875 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e86d65f-371d-4278-b8d5-817ada28ad22 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:08.370377 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e86d65f-371d-4278-b8d5-817ada28ad22 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:08.377155 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d45f7d-df49-4d28-a6f6-86bbde1fd8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:08.378173 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d45f7d-df49-4d28-a6f6-86bbde1fd8df admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:08.378623 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d45f7d-df49-4d28-a6f6-86bbde1fd8df admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:08.383610 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d45f7d-df49-4d28-a6f6-86bbde1fd8df admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:08.383610 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d45f7d-df49-4d28-a6f6-86bbde1fd8df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:08.383610 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d45f7d-df49-4d28-a6f6-86bbde1fd8df admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:08.397087 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f202d88c-b4aa-4421-871b-ee70a5b9492c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f4f3462818149bebc8e0d9b5217b123', 'request_id': 'req-f202d88c-b4aa-4421-871b-ee70a5b9492c'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:08.405831 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f202d88c-b4aa-4421-871b-ee70a5b9492c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f4f3462818149bebc8e0d9b5217b123', 'request_id': 'req-f202d88c-b4aa-4421-871b-ee70a5b9492c'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:08.424821 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f202d88c-b4aa-4421-871b-ee70a5b9492c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f4f3462818149bebc8e0d9b5217b123', 'request_id': 'req-f202d88c-b4aa-4421-871b-ee70a5b9492c'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:08.470749 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3614/7206] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:39:08 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:39:08.474703 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d45f7d-df49-4d28-a6f6-86bbde1fd8df admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:08.492622 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f202d88c-b4aa-4421-871b-ee70a5b9492c admin admin] The token cache is being invalidate because project 4f4f3462818149bebc8e0d9b5217b123 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:39:08.492917 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f202d88c-b4aa-4421-871b-ee70a5b9492c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:08.493687 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f202d88c-b4aa-4421-871b-ee70a5b9492c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:08.495666 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3593/7207] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:39:08 2022] DELETE /identity/v3/projects/4f4f3462818149bebc8e0d9b5217b123 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:39:08.496066 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d45f7d-df49-4d28-a6f6-86bbde1fd8df admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:08.503114 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d21a4ca-5ef6-4f4d-85a5-c518287932d1 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:08.503367 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d21a4ca-5ef6-4f4d-85a5-c518287932d1 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:08.503857 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d21a4ca-5ef6-4f4d-85a5-c518287932d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:08.535956 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-0d21a4ca-5ef6-4f4d-85a5-c518287932d1 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:08.535956 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-0d21a4ca-5ef6-4f4d-85a5-c518287932d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:08.572555 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa6d771-795f-4d6f-975f-62668de5e1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:08.573106 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa6d771-795f-4d6f-975f-62668de5e1f4 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:08.578843 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa6d771-795f-4d6f-975f-62668de5e1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:08.578843 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa6d771-795f-4d6f-975f-62668de5e1f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:08.578843 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa6d771-795f-4d6f-975f-62668de5e1f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:08.578843 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa6d771-795f-4d6f-975f-62668de5e1f4 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:08.591527 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3615/7208] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:39:08 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:39:08.592079 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa6d771-795f-4d6f-975f-62668de5e1f4 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:08.593810 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-5aa6d771-795f-4d6f-975f-62668de5e1f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:08.615020 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3594/7209] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:39:08.620807 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d21a4ca-5ef6-4f4d-85a5-c518287932d1 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:08.623770 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-0d21a4ca-5ef6-4f4d-85a5-c518287932d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:08.623966 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa6d771-795f-4d6f-975f-62668de5e1f4 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:08.628862 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe3f2c7-afce-493c-8a3c-e0ae583a030b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:08.629761 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe3f2c7-afce-493c-8a3c-e0ae583a030b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:08.630048 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe3f2c7-afce-493c-8a3c-e0ae583a030b admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:08.630324 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe3f2c7-afce-493c-8a3c-e0ae583a030b admin admin] PATH_INFO: `/v3/projects/2ef94d21909d4ad8a9f325b15d4b28b8` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:08.631666 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe3f2c7-afce-493c-8a3c-e0ae583a030b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ef94d21909d4ad8a9f325b15d4b28b8)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:08.633614 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe3f2c7-afce-493c-8a3c-e0ae583a030b admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:08.638494 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d21a4ca-5ef6-4f4d-85a5-c518287932d1 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:08.656457 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb94596-9e1e-4a4b-89a1-e3eff83318d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:08.657497 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb94596-9e1e-4a4b-89a1-e3eff83318d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:08.657883 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb94596-9e1e-4a4b-89a1-e3eff83318d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:08.658258 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb94596-9e1e-4a4b-89a1-e3eff83318d2 admin admin] PATH_INFO: `/v3/projects/fdee4f45db334af39847f852d7e17771/users/67e9097c0157484aaa96384a74ce12d7/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:08.681932 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb94596-9e1e-4a4b-89a1-e3eff83318d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdee4f45db334af39847f852d7e17771, user_id=67e9097c0157484aaa96384a74ce12d7, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:08.688182 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb94596-9e1e-4a4b-89a1-e3eff83318d2 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:08.789799 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3595/7210] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:39:08 2022] PUT /identity/v3/projects/fdee4f45db334af39847f852d7e17771/users/67e9097c0157484aaa96384a74ce12d7/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:08.792707 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc1286-1a63-4826-8de4-ed3875c45be3 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:08.792707 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc1286-1a63-4826-8de4-ed3875c45be3 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:08.795349 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc1286-1a63-4826-8de4-ed3875c45be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:08.801856 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6fe3f2c7-afce-493c-8a3c-e0ae583a030b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ef94d21909d4ad8a9f325b15d4b28b8', 'request_id': 'req-6fe3f2c7-afce-493c-8a3c-e0ae583a030b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:08.815171 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6fe3f2c7-afce-493c-8a3c-e0ae583a030b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ef94d21909d4ad8a9f325b15d4b28b8', 'request_id': 'req-6fe3f2c7-afce-493c-8a3c-e0ae583a030b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:08.833926 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-c4bc1286-1a63-4826-8de4-ed3875c45be3 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:08.835144 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c4bc1286-1a63-4826-8de4-ed3875c45be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:08.891993 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6fe3f2c7-afce-493c-8a3c-e0ae583a030b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ef94d21909d4ad8a9f325b15d4b28b8', 'request_id': 'req-6fe3f2c7-afce-493c-8a3c-e0ae583a030b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:08.901531 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3596/7211] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:39:08.901531 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bc1286-1a63-4826-8de4-ed3875c45be3 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:08.907246 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6fe3f2c7-afce-493c-8a3c-e0ae583a030b admin admin] The token cache is being invalidate because project 2ef94d21909d4ad8a9f325b15d4b28b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:39:08.907685 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6fe3f2c7-afce-493c-8a3c-e0ae583a030b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:08.908446 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6fe3f2c7-afce-493c-8a3c-e0ae583a030b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:08.910546 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3616/7212] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:39:08 2022] DELETE /identity/v3/projects/2ef94d21909d4ad8a9f325b15d4b28b8 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:08.911513 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe3f2c7-afce-493c-8a3c-e0ae583a030b admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:08.913046 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-6fe3f2c7-afce-493c-8a3c-e0ae583a030b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:08.914563 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bc1286-1a63-4826-8de4-ed3875c45be3 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:08.922286 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d09361f-3fef-40c1-ae2f-ba6eb4cb3eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:08.924098 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09361f-3fef-40c1-ae2f-ba6eb4cb3eb8 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:08.924577 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09361f-3fef-40c1-ae2f-ba6eb4cb3eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:08.925030 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09361f-3fef-40c1-ae2f-ba6eb4cb3eb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:08.926970 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d09361f-3fef-40c1-ae2f-ba6eb4cb3eb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:08.928710 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe3f2c7-afce-493c-8a3c-e0ae583a030b admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:08.933427 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d09361f-3fef-40c1-ae2f-ba6eb4cb3eb8 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:08.934079 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f38f03-918d-40c0-a961-1a0b3c18bb32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:08.935026 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f38f03-918d-40c0-a961-1a0b3c18bb32 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:08.935317 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f38f03-918d-40c0-a961-1a0b3c18bb32 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:08.935632 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f38f03-918d-40c0-a961-1a0b3c18bb32 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:08.936365 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f38f03-918d-40c0-a961-1a0b3c18bb32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:39:08.936675 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f38f03-918d-40c0-a961-1a0b3c18bb32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:08.938316 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f38f03-918d-40c0-a961-1a0b3c18bb32 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:08.946450 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3597/7213] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:39:08 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:39:08.946450 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c580ee8-1d61-4f4a-9f18-2f46c5e78279 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:08.946450 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c580ee8-1d61-4f4a-9f18-2f46c5e78279 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:08.946450 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c580ee8-1d61-4f4a-9f18-2f46c5e78279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:08.950972 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3617/7214] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:39:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:39:08.961290 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f38f03-918d-40c0-a961-1a0b3c18bb32 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:08.963992 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-16f38f03-918d-40c0-a961-1a0b3c18bb32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:08.979683 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-0c580ee8-1d61-4f4a-9f18-2f46c5e78279 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:08.980247 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f38f03-918d-40c0-a961-1a0b3c18bb32 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:08.983204 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-0c580ee8-1d61-4f4a-9f18-2f46c5e78279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:08.985945 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50521fd-3774-434d-8a62-db4014c1a1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:08.989523 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50521fd-3774-434d-8a62-db4014c1a1cf admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:08.989523 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50521fd-3774-434d-8a62-db4014c1a1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:08.989523 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50521fd-3774-434d-8a62-db4014c1a1cf admin admin] PATH_INFO: `/v3/projects/fdee4f45db334af39847f852d7e17771/users/67e9097c0157484aaa96384a74ce12d7/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:08.990850 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50521fd-3774-434d-8a62-db4014c1a1cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdee4f45db334af39847f852d7e17771, user_id=67e9097c0157484aaa96384a74ce12d7, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:08.992680 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50521fd-3774-434d-8a62-db4014c1a1cf admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:09.002931 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3598/7215] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:39:09.004455 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c580ee8-1d61-4f4a-9f18-2f46c5e78279 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:09.007005 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3618/7216] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:39:08 2022] PUT /identity/v3/projects/fdee4f45db334af39847f852d7e17771/users/67e9097c0157484aaa96384a74ce12d7/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:09.008429 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c8a310-6a39-48d6-832c-b6f546b61e4d None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:09.008750 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c8a310-6a39-48d6-832c-b6f546b61e4d None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:09.009031 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c8a310-6a39-48d6-832c-b6f546b61e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:09.018096 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c580ee8-1d61-4f4a-9f18-2f46c5e78279 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:09.029642 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-09c8a310-6a39-48d6-832c-b6f546b61e4d None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:09.030900 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-09c8a310-6a39-48d6-832c-b6f546b61e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:09.097703 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3619/7217] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:39:09.097874 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e144811e-ba65-4258-982f-c5e074e94d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:09.098713 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e144811e-ba65-4258-982f-c5e074e94d31 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:09.099000 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e424c-21a6-4940-8b3d-1d5128f1a0dc None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:09.099161 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e144811e-ba65-4258-982f-c5e074e94d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:09.099321 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e424c-21a6-4940-8b3d-1d5128f1a0dc None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:09.099643 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e144811e-ba65-4258-982f-c5e074e94d31 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:09.099740 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e424c-21a6-4940-8b3d-1d5128f1a0dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:09.100867 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e144811e-ba65-4258-982f-c5e074e94d31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:09.102728 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e144811e-ba65-4258-982f-c5e074e94d31 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:09.130537 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-2f6e424c-21a6-4940-8b3d-1d5128f1a0dc None None] MFA Rules not processed for user `67e9097c0157484aaa96384a74ce12d7`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:09.132903 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-2f6e424c-21a6-4940-8b3d-1d5128f1a0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:09.211048 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3620/7218] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:09 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:39:09.212824 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6e424c-21a6-4940-8b3d-1d5128f1a0dc None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:09.225419 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6e424c-21a6-4940-8b3d-1d5128f1a0dc None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:09.230169 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a050200-4016-44ea-977a-58d5523002c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:09.230827 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a050200-4016-44ea-977a-58d5523002c0 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:09.231733 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a050200-4016-44ea-977a-58d5523002c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:09.231994 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a050200-4016-44ea-977a-58d5523002c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:09.232712 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a050200-4016-44ea-977a-58d5523002c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:39:09.233033 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a050200-4016-44ea-977a-58d5523002c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:09.234705 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a050200-4016-44ea-977a-58d5523002c0 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:09.246135 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3621/7219] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:39:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:39:09.247034 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a050200-4016-44ea-977a-58d5523002c0 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:09.248683 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-0a050200-4016-44ea-977a-58d5523002c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:09.263160 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3599/7220] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:39:09 2022] POST /identity/v3/projects => generated 403 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:39:09.264123 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e144811e-ba65-4258-982f-c5e074e94d31 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:09.312937 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a050200-4016-44ea-977a-58d5523002c0 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:09.333237 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e144811e-ba65-4258-982f-c5e074e94d31 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:09.338574 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf79ef-c609-42bb-a968-38c3e0e9fe21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:09.339237 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf79ef-c609-42bb-a968-38c3e0e9fe21 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:09.339547 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf79ef-c609-42bb-a968-38c3e0e9fe21 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:09.339854 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf79ef-c609-42bb-a968-38c3e0e9fe21 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:09.340641 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adf79ef-c609-42bb-a968-38c3e0e9fe21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:09.342577 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adf79ef-c609-42bb-a968-38c3e0e9fe21 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:09.375338 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a6efbf-3052-4f08-8926-d227f8d6ad67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198271d1c0d44cb58bace41a65f4b94c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:09.376132 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a6efbf-3052-4f08-8926-d227f8d6ad67 service cinder] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:09.376510 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a6efbf-3052-4f08-8926-d227f8d6ad67 service cinder] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:09.376857 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a6efbf-3052-4f08-8926-d227f8d6ad67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:09.444605 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a6efbf-3052-4f08-8926-d227f8d6ad67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:09.446133 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a6efbf-3052-4f08-8926-d227f8d6ad67 service cinder] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:09.447433 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3600/7221] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:39:09 2022] POST /identity/v3/projects => generated 367 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:39:09.448342 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf79ef-c609-42bb-a968-38c3e0e9fe21 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:09.458199 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3622/7222] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:39:09 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:39:09.459032 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a6efbf-3052-4f08-8926-d227f8d6ad67 service cinder] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:09.470967 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a6efbf-3052-4f08-8926-d227f8d6ad67 service cinder] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:09.534798 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf79ef-c609-42bb-a968-38c3e0e9fe21 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:09.547170 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e855970-6f7b-4960-bee8-e9bef8a67560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:09.547851 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e855970-6f7b-4960-bee8-e9bef8a67560 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:09.548138 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e855970-6f7b-4960-bee8-e9bef8a67560 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:09.551677 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e855970-6f7b-4960-bee8-e9bef8a67560 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:09.554142 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e855970-6f7b-4960-bee8-e9bef8a67560 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:09.558823 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e855970-6f7b-4960-bee8-e9bef8a67560 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:09.565803 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0161dc12-9010-4c35-a38a-ccd3d65265fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:09.566914 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0161dc12-9010-4c35-a38a-ccd3d65265fa admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:09.567253 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0161dc12-9010-4c35-a38a-ccd3d65265fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:09.567661 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0161dc12-9010-4c35-a38a-ccd3d65265fa admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:09.568322 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0161dc12-9010-4c35-a38a-ccd3d65265fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:09.570420 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0161dc12-9010-4c35-a38a-ccd3d65265fa admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:09.664943 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3623/7223] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:39:09 2022] POST /identity/v3/users => generated 284 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:39:09.669646 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0161dc12-9010-4c35-a38a-ccd3d65265fa admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:09.697610 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3601/7224] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:39:09 2022] POST /identity/v3/users => generated 302 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:39:09.698734 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e855970-6f7b-4960-bee8-e9bef8a67560 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:09.708197 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0161dc12-9010-4c35-a38a-ccd3d65265fa admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:09.716516 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00168b8e-ef60-42c7-a2e4-428fcf2640b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:09.717215 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00168b8e-ef60-42c7-a2e4-428fcf2640b6 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:09.717505 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00168b8e-ef60-42c7-a2e4-428fcf2640b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:09.717789 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00168b8e-ef60-42c7-a2e4-428fcf2640b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:09.717918 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e855970-6f7b-4960-bee8-e9bef8a67560 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:09.718578 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00168b8e-ef60-42c7-a2e4-428fcf2640b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:09.721047 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00168b8e-ef60-42c7-a2e4-428fcf2640b6 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:09.730061 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8026099a-ef79-4661-b070-420b3c03249c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:09.730753 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8026099a-ef79-4661-b070-420b3c03249c admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:09.731793 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8026099a-ef79-4661-b070-420b3c03249c admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:09.732102 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8026099a-ef79-4661-b070-420b3c03249c admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:09.732839 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8026099a-ef79-4661-b070-420b3c03249c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:09.734479 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8026099a-ef79-4661-b070-420b3c03249c admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:09.735957 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3624/7225] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:39:09 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:39:09.736906 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00168b8e-ef60-42c7-a2e4-428fcf2640b6 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:09.747397 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3602/7226] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:39:09 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:39:09.752428 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8026099a-ef79-4661-b070-420b3c03249c admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:09.754936 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00168b8e-ef60-42c7-a2e4-428fcf2640b6 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:09.761172 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a706a7-1dbe-4110-8ac2-6be7821620e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:09.762967 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a706a7-1dbe-4110-8ac2-6be7821620e7 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:09.763556 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a706a7-1dbe-4110-8ac2-6be7821620e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:09.764476 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a706a7-1dbe-4110-8ac2-6be7821620e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:09.772270 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8026099a-ef79-4661-b070-420b3c03249c admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:09.776694 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a706a7-1dbe-4110-8ac2-6be7821620e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:09.780097 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a706a7-1dbe-4110-8ac2-6be7821620e7 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:09.782849 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f45e86-5bfd-4240-91be-dc26ad182c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:09.783580 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f45e86-5bfd-4240-91be-dc26ad182c91 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:09.783869 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f45e86-5bfd-4240-91be-dc26ad182c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:09.784147 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f45e86-5bfd-4240-91be-dc26ad182c91 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:09.784926 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f45e86-5bfd-4240-91be-dc26ad182c91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:09.790296 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f45e86-5bfd-4240-91be-dc26ad182c91 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:09.808212 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3603/7227] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:39:09 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:39:09.811972 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f45e86-5bfd-4240-91be-dc26ad182c91 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:09.818016 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3625/7228] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:39:09 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:39:09.818989 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a706a7-1dbe-4110-8ac2-6be7821620e7 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:09.840109 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f45e86-5bfd-4240-91be-dc26ad182c91 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:09.850723 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a706a7-1dbe-4110-8ac2-6be7821620e7 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:09.860253 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7875f158-4546-43d8-9919-1b7376b4dd05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:09.863035 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875f158-4546-43d8-9919-1b7376b4dd05 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:09.863676 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875f158-4546-43d8-9919-1b7376b4dd05 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:09.864086 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875f158-4546-43d8-9919-1b7376b4dd05 admin admin] PATH_INFO: `/v3/projects/4a127491ec1e4f5f8018a366d4617c86/users/79303a39c3af4a209a82042c1f1944d8/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:09.868612 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ca6bda-be2c-4a6a-9e18-2e4aef01b5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:09.869767 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca6bda-be2c-4a6a-9e18-2e4aef01b5dc admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:09.877388 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca6bda-be2c-4a6a-9e18-2e4aef01b5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:09.877388 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca6bda-be2c-4a6a-9e18-2e4aef01b5dc admin admin] PATH_INFO: `/v3/projects/272912a007ae474ba548b662282a84a6/users/3b9dfb17ef64477392044c26dcd75bfb/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:09.885056 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7875f158-4546-43d8-9919-1b7376b4dd05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a127491ec1e4f5f8018a366d4617c86, user_id=79303a39c3af4a209a82042c1f1944d8, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:09.888813 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7875f158-4546-43d8-9919-1b7376b4dd05 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:09.892893 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ca6bda-be2c-4a6a-9e18-2e4aef01b5dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=272912a007ae474ba548b662282a84a6, user_id=3b9dfb17ef64477392044c26dcd75bfb, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:09.899228 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ca6bda-be2c-4a6a-9e18-2e4aef01b5dc admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:10.061062 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3604/7229] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:39:09 2022] PUT /identity/v3/projects/4a127491ec1e4f5f8018a366d4617c86/users/79303a39c3af4a209a82042c1f1944d8/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:10.061573 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3626/7230] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:39:09 2022] PUT /identity/v3/projects/272912a007ae474ba548b662282a84a6/users/3b9dfb17ef64477392044c26dcd75bfb/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:10.066969 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f97aeb-e5bd-4407-b5dd-2f79356d6769 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:10.068892 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f97aeb-e5bd-4407-b5dd-2f79356d6769 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:10.069370 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f97aeb-e5bd-4407-b5dd-2f79356d6769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:10.074248 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8183e3d-46ed-4e68-a205-a2646281631b None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:10.078572 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8183e3d-46ed-4e68-a205-a2646281631b None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:10.078572 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8183e3d-46ed-4e68-a205-a2646281631b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:10.115932 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-23f97aeb-e5bd-4407-b5dd-2f79356d6769 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:10.117365 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-23f97aeb-e5bd-4407-b5dd-2f79356d6769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:10.145790 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-e8183e3d-46ed-4e68-a205-a2646281631b None None] MFA Rules not processed for user `3b9dfb17ef64477392044c26dcd75bfb`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:10.145790 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e8183e3d-46ed-4e68-a205-a2646281631b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:10.265100 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3605/7231] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:39:10.275870 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f97aeb-e5bd-4407-b5dd-2f79356d6769 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:10.286206 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3627/7232] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:10 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:39:10.287210 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8183e3d-46ed-4e68-a205-a2646281631b None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:10.289053 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e8183e3d-46ed-4e68-a205-a2646281631b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:10.302339 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f97aeb-e5bd-4407-b5dd-2f79356d6769 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:10.327599 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb1a08-ddba-47c7-93cb-d55a3c86a5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:10.328541 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb1a08-ddba-47c7-93cb-d55a3c86a5fd admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:10.328833 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb1a08-ddba-47c7-93cb-d55a3c86a5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:10.329175 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb1a08-ddba-47c7-93cb-d55a3c86a5fd admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:10.329931 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fb1a08-ddba-47c7-93cb-d55a3c86a5fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:10.332286 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fb1a08-ddba-47c7-93cb-d55a3c86a5fd admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:10.365997 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8183e3d-46ed-4e68-a205-a2646281631b None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:10.369966 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5255964d-6d1d-4c7b-b654-958bf1235cf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:10.370589 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5255964d-6d1d-4c7b-b654-958bf1235cf6 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:10.370882 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5255964d-6d1d-4c7b-b654-958bf1235cf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:10.371169 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5255964d-6d1d-4c7b-b654-958bf1235cf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:10.382378 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5255964d-6d1d-4c7b-b654-958bf1235cf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:10.383874 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5255964d-6d1d-4c7b-b654-958bf1235cf6 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:10.395191 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3628/7233] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:39:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:39:10.451586 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3606/7234] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:39:10 2022] POST /identity/v3/projects => generated 367 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:39:10.455386 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5255964d-6d1d-4c7b-b654-958bf1235cf6 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:10.469835 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5255964d-6d1d-4c7b-b654-958bf1235cf6 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:10.566880 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5dbb5-c3eb-400a-bf56-2f2a0c119f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:10.567854 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5dbb5-c3eb-400a-bf56-2f2a0c119f6d admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:10.568201 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5dbb5-c3eb-400a-bf56-2f2a0c119f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:10.572096 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5dbb5-c3eb-400a-bf56-2f2a0c119f6d admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:10.572096 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a5dbb5-c3eb-400a-bf56-2f2a0c119f6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:10.573727 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a5dbb5-c3eb-400a-bf56-2f2a0c119f6d admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:10.679375 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3629/7235] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:39:10 2022] POST /identity/v3/users => generated 290 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:39:10.680407 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb1a08-ddba-47c7-93cb-d55a3c86a5fd admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:10.692419 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb1a08-ddba-47c7-93cb-d55a3c86a5fd admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:10.697920 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d94216-065f-4be2-9141-e75ab7e60411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:10.698703 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d94216-065f-4be2-9141-e75ab7e60411 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:10.699366 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d94216-065f-4be2-9141-e75ab7e60411 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:10.699740 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d94216-065f-4be2-9141-e75ab7e60411 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:10.706270 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d94216-065f-4be2-9141-e75ab7e60411 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:10.706270 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d94216-065f-4be2-9141-e75ab7e60411 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:10.715516 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3607/7236] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:39:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:39:10.717714 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5dbb5-c3eb-400a-bf56-2f2a0c119f6d admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:10.728707 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5dbb5-c3eb-400a-bf56-2f2a0c119f6d admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:10.734698 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61d3b3d-b0ba-4324-b6ca-97f58b602bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:10.736021 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d3b3d-b0ba-4324-b6ca-97f58b602bae admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:10.736403 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d3b3d-b0ba-4324-b6ca-97f58b602bae admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:10.736836 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d3b3d-b0ba-4324-b6ca-97f58b602bae admin admin] PATH_INFO: `/v3/projects/0e340cdd735347b5b067a6861c828b68/users/7d9e2a2058384d82aa49a1a053b286fa/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:10.756979 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61d3b3d-b0ba-4324-b6ca-97f58b602bae admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e340cdd735347b5b067a6861c828b68, user_id=7d9e2a2058384d82aa49a1a053b286fa, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:10.759954 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61d3b3d-b0ba-4324-b6ca-97f58b602bae admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:10.862561 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3630/7237] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:39:10 2022] PUT /identity/v3/projects/0e340cdd735347b5b067a6861c828b68/users/7d9e2a2058384d82aa49a1a053b286fa/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:39:10.863404 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d94216-065f-4be2-9141-e75ab7e60411 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:10.874725 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d94216-065f-4be2-9141-e75ab7e60411 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:10.887907 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61d3b3d-b0ba-4324-b6ca-97f58b602bae admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:10.956795 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b73211-33ab-4878-88f1-ded33d60a5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:10.957611 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b73211-33ab-4878-88f1-ded33d60a5c9 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:10.957970 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b73211-33ab-4878-88f1-ded33d60a5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:10.958317 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b73211-33ab-4878-88f1-ded33d60a5c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:10.959123 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b73211-33ab-4878-88f1-ded33d60a5c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:10.960872 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b73211-33ab-4878-88f1-ded33d60a5c9 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:10.963928 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61d3b3d-b0ba-4324-b6ca-97f58b602bae admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:10.972089 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe77d94-8a3c-412e-b2d5-44e718ce3130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:10.972978 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe77d94-8a3c-412e-b2d5-44e718ce3130 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:10.973268 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe77d94-8a3c-412e-b2d5-44e718ce3130 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:10.973553 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe77d94-8a3c-412e-b2d5-44e718ce3130 admin admin] PATH_INFO: `/v3/users/01e8790ef51a4409a24d602504a495ea` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:10.974015 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3608/7238] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:39:10 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:39:10.976815 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe77d94-8a3c-412e-b2d5-44e718ce3130 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01e8790ef51a4409a24d602504a495ea)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:10.978189 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b73211-33ab-4878-88f1-ded33d60a5c9 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:10.981033 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe77d94-8a3c-412e-b2d5-44e718ce3130 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:10.999910 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b73211-33ab-4878-88f1-ded33d60a5c9 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:11.009816 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36e96c7-0c36-4b30-b20a-5b981da20309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:11.011134 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e96c7-0c36-4b30-b20a-5b981da20309 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:11.011648 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e96c7-0c36-4b30-b20a-5b981da20309 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:11.011936 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e96c7-0c36-4b30-b20a-5b981da20309 admin admin] PATH_INFO: `/v3/projects/0e340cdd735347b5b067a6861c828b68/users/7d9e2a2058384d82aa49a1a053b286fa/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:11.014168 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36e96c7-0c36-4b30-b20a-5b981da20309 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e340cdd735347b5b067a6861c828b68, user_id=7d9e2a2058384d82aa49a1a053b286fa, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:11.017570 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36e96c7-0c36-4b30-b20a-5b981da20309 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:11.033364 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3609/7239] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:39:10 2022] PUT /identity/v3/projects/0e340cdd735347b5b067a6861c828b68/users/7d9e2a2058384d82aa49a1a053b286fa/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:39:11.133260 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610a5ad-0490-43d6-a6a9-f54627e940ba None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:11.134268 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610a5ad-0490-43d6-a6a9-f54627e940ba None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:11.134700 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610a5ad-0490-43d6-a6a9-f54627e940ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:11.164919 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-f610a5ad-0490-43d6-a6a9-f54627e940ba None None] MFA Rules not processed for user `7d9e2a2058384d82aa49a1a053b286fa`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:11.166557 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-f610a5ad-0490-43d6-a6a9-f54627e940ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:11.200932 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-7fe77d94-8a3c-412e-b2d5-44e718ce3130 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01e8790ef51a4409a24d602504a495ea'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:11.219257 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-7fe77d94-8a3c-412e-b2d5-44e718ce3130 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01e8790ef51a4409a24d602504a495ea'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:11.236391 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-7fe77d94-8a3c-412e-b2d5-44e718ce3130 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01e8790ef51a4409a24d602504a495ea'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:11.264978 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3610/7240] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:11 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:39:11.276229 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f610a5ad-0490-43d6-a6a9-f54627e940ba None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:11.337475 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-7fe77d94-8a3c-412e-b2d5-44e718ce3130 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01e8790ef51a4409a24d602504a495ea'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:11.338669 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-7fe77d94-8a3c-412e-b2d5-44e718ce3130 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01e8790ef51a4409a24d602504a495ea'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:11.348466 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f610a5ad-0490-43d6-a6a9-f54627e940ba None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:11.348565 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3631/7241] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:39:10 2022] DELETE /identity/v3/users/01e8790ef51a4409a24d602504a495ea => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:39:11.354014 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d893dc-99ae-4fd3-be08-74b8d4fb83bf None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:11.354310 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d893dc-99ae-4fd3-be08-74b8d4fb83bf None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:11.357175 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d893dc-99ae-4fd3-be08-74b8d4fb83bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:11.395206 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-a9d893dc-99ae-4fd3-be08-74b8d4fb83bf None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:11.396519 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-a9d893dc-99ae-4fd3-be08-74b8d4fb83bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:11.432730 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52712991-03ed-43cd-bfbe-c9eff5c9c7be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:11.433424 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52712991-03ed-43cd-bfbe-c9eff5c9c7be service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:11.434103 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52712991-03ed-43cd-bfbe-c9eff5c9c7be service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:11.434477 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52712991-03ed-43cd-bfbe-c9eff5c9c7be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:11.437080 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-52712991-03ed-43cd-bfbe-c9eff5c9c7be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:11.486039 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3632/7242] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:39:11.487058 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d893dc-99ae-4fd3-be08-74b8d4fb83bf None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:11.488629 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-a9d893dc-99ae-4fd3-be08-74b8d4fb83bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:11.505266 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d893dc-99ae-4fd3-be08-74b8d4fb83bf None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:11.511801 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088bf7f6-f196-4589-9ce5-ff8277e5002f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:11.513305 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088bf7f6-f196-4589-9ce5-ff8277e5002f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:11.513601 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088bf7f6-f196-4589-9ce5-ff8277e5002f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:11.514150 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088bf7f6-f196-4589-9ce5-ff8277e5002f admin admin] PATH_INFO: `/v3/users/abe90f4c283040e3bfeca78955a01bd2` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:11.515136 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088bf7f6-f196-4589-9ce5-ff8277e5002f admin admin] RBAC: Authorizing `identity:delete_user(user_id=abe90f4c283040e3bfeca78955a01bd2)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:11.517574 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088bf7f6-f196-4589-9ce5-ff8277e5002f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:11.545660 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52712991-03ed-43cd-bfbe-c9eff5c9c7be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:11.549388 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52712991-03ed-43cd-bfbe-c9eff5c9c7be service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:11.561965 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3611/7243] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:39:11 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:39:11.562817 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52712991-03ed-43cd-bfbe-c9eff5c9c7be service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:11.564463 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-52712991-03ed-43cd-bfbe-c9eff5c9c7be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:11.580534 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52712991-03ed-43cd-bfbe-c9eff5c9c7be service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:11.586754 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe84cc49-20a4-4a92-99a5-be3983f89ded service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:11.587678 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe84cc49-20a4-4a92-99a5-be3983f89ded service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:11.588169 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe84cc49-20a4-4a92-99a5-be3983f89ded service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:11.588627 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe84cc49-20a4-4a92-99a5-be3983f89ded service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:11.599457 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe84cc49-20a4-4a92-99a5-be3983f89ded service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:11.601258 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe84cc49-20a4-4a92-99a5-be3983f89ded service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:11.612006 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3612/7244] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:39:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:39:11.733886 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-088bf7f6-f196-4589-9ce5-ff8277e5002f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abe90f4c283040e3bfeca78955a01bd2'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:11.755105 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-088bf7f6-f196-4589-9ce5-ff8277e5002f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abe90f4c283040e3bfeca78955a01bd2'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:11.763969 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-088bf7f6-f196-4589-9ce5-ff8277e5002f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abe90f4c283040e3bfeca78955a01bd2'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:11.879645 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-088bf7f6-f196-4589-9ce5-ff8277e5002f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abe90f4c283040e3bfeca78955a01bd2'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:11.880343 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-088bf7f6-f196-4589-9ce5-ff8277e5002f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abe90f4c283040e3bfeca78955a01bd2'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:11.888262 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3633/7245] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:39:11 2022] DELETE /identity/v3/users/abe90f4c283040e3bfeca78955a01bd2 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:11.892612 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389bea37-ce46-43e6-bea9-dbee448a0e2a None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:11.893004 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389bea37-ce46-43e6-bea9-dbee448a0e2a None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:11.893384 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389bea37-ce46-43e6-bea9-dbee448a0e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:11.911896 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-389bea37-ce46-43e6-bea9-dbee448a0e2a None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:11.913358 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-389bea37-ce46-43e6-bea9-dbee448a0e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:12.029456 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3613/7246] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:39:12.041786 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088bf7f6-f196-4589-9ce5-ff8277e5002f admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:12.043359 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-088bf7f6-f196-4589-9ce5-ff8277e5002f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:12.126936 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088bf7f6-f196-4589-9ce5-ff8277e5002f admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:12.133750 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcdf379-a5b4-426c-b14f-77eb0e3c90e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:12.137633 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcdf379-a5b4-426c-b14f-77eb0e3c90e7 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:12.137633 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcdf379-a5b4-426c-b14f-77eb0e3c90e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:12.137633 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcdf379-a5b4-426c-b14f-77eb0e3c90e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:12.157716 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcdf379-a5b4-426c-b14f-77eb0e3c90e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:12.159256 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcdf379-a5b4-426c-b14f-77eb0e3c90e7 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:12.189376 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3634/7247] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:39:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:39:12.221710 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561dbc28-2b86-4f96-a123-cc3dec0440a9 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:12.224474 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561dbc28-2b86-4f96-a123-cc3dec0440a9 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:12.224822 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561dbc28-2b86-4f96-a123-cc3dec0440a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:12.287438 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-561dbc28-2b86-4f96-a123-cc3dec0440a9 None None] MFA Rules not processed for user `79303a39c3af4a209a82042c1f1944d8`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:12.288738 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-561dbc28-2b86-4f96-a123-cc3dec0440a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:12.349259 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcdf379-a5b4-426c-b14f-77eb0e3c90e7 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:12.351928 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-3fcdf379-a5b4-426c-b14f-77eb0e3c90e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:12.389792 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcdf379-a5b4-426c-b14f-77eb0e3c90e7 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:12.402387 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979d286-0685-48ec-90b6-b38070ebe306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:12.403541 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979d286-0685-48ec-90b6-b38070ebe306 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:12.403829 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979d286-0685-48ec-90b6-b38070ebe306 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:12.407785 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979d286-0685-48ec-90b6-b38070ebe306 admin admin] PATH_INFO: `/v3/projects/f7e57d85912841ec87fa9d6cdf63b38c` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:12.409767 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5979d286-0685-48ec-90b6-b38070ebe306 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7e57d85912841ec87fa9d6cdf63b38c)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:12.419505 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5979d286-0685-48ec-90b6-b38070ebe306 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:12.424081 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3614/7248] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:12 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:39:12.428075 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561dbc28-2b86-4f96-a123-cc3dec0440a9 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:12.429724 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-561dbc28-2b86-4f96-a123-cc3dec0440a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:12.470066 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561dbc28-2b86-4f96-a123-cc3dec0440a9 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:12.489062 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200451b5-eb88-4125-bf92-c906fa4d15b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:12.489747 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200451b5-eb88-4125-bf92-c906fa4d15b7 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:12.490030 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200451b5-eb88-4125-bf92-c906fa4d15b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:12.490302 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200451b5-eb88-4125-bf92-c906fa4d15b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:12.491380 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200451b5-eb88-4125-bf92-c906fa4d15b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:12.493050 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200451b5-eb88-4125-bf92-c906fa4d15b7 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:12.642179 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5979d286-0685-48ec-90b6-b38070ebe306 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7e57d85912841ec87fa9d6cdf63b38c', 'request_id': 'req-5979d286-0685-48ec-90b6-b38070ebe306'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:12.651569 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5979d286-0685-48ec-90b6-b38070ebe306 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7e57d85912841ec87fa9d6cdf63b38c', 'request_id': 'req-5979d286-0685-48ec-90b6-b38070ebe306'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:12.700730 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3615/7249] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:39:12 2022] POST /identity/v3/projects => generated 405 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:39:12.704222 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200451b5-eb88-4125-bf92-c906fa4d15b7 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:12.779984 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5979d286-0685-48ec-90b6-b38070ebe306 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7e57d85912841ec87fa9d6cdf63b38c', 'request_id': 'req-5979d286-0685-48ec-90b6-b38070ebe306'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:12.795310 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5979d286-0685-48ec-90b6-b38070ebe306 admin admin] The token cache is being invalidate because project f7e57d85912841ec87fa9d6cdf63b38c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:39:12.795836 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5979d286-0685-48ec-90b6-b38070ebe306 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:12.796822 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5979d286-0685-48ec-90b6-b38070ebe306 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:12.799685 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3635/7250] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:39:12 2022] DELETE /identity/v3/projects/f7e57d85912841ec87fa9d6cdf63b38c => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:39:12.803649 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979d286-0685-48ec-90b6-b38070ebe306 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:12.807507 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-5979d286-0685-48ec-90b6-b38070ebe306 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:12.828669 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200451b5-eb88-4125-bf92-c906fa4d15b7 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:12.834741 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e6267c-5e12-42de-8741-16bfcda4d795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:12.834741 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e6267c-5e12-42de-8741-16bfcda4d795 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:12.835285 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e6267c-5e12-42de-8741-16bfcda4d795 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:12.835670 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e6267c-5e12-42de-8741-16bfcda4d795 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:12.836473 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e6267c-5e12-42de-8741-16bfcda4d795 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:12.838904 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e6267c-5e12-42de-8741-16bfcda4d795 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:12.906794 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979d286-0685-48ec-90b6-b38070ebe306 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:12.918202 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff94261-7e0e-4cfe-873d-2adac7afa868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:12.921505 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff94261-7e0e-4cfe-873d-2adac7afa868 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:12.929740 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff94261-7e0e-4cfe-873d-2adac7afa868 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:12.931469 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff94261-7e0e-4cfe-873d-2adac7afa868 admin admin] PATH_INFO: `/v3/users/67e9097c0157484aaa96384a74ce12d7` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:12.932109 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff94261-7e0e-4cfe-873d-2adac7afa868 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67e9097c0157484aaa96384a74ce12d7)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:12.934590 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff94261-7e0e-4cfe-873d-2adac7afa868 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:12.974125 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3616/7251] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:39:12 2022] POST /identity/v3/users => generated 309 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:39:12.974125 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e6267c-5e12-42de-8741-16bfcda4d795 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:12.980019 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-69e6267c-5e12-42de-8741-16bfcda4d795 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:13.006887 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e6267c-5e12-42de-8741-16bfcda4d795 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:13.013687 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1064c19-9174-4dfc-863c-3ed5a4e771f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:13.014651 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1064c19-9174-4dfc-863c-3ed5a4e771f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:13.022637 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1064c19-9174-4dfc-863c-3ed5a4e771f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:13.022978 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1064c19-9174-4dfc-863c-3ed5a4e771f5 admin admin] PATH_INFO: `/v3/projects/7f66f58506884bf29cc157ef4943b9fc` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:13.024435 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1064c19-9174-4dfc-863c-3ed5a4e771f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f66f58506884bf29cc157ef4943b9fc)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:13.027240 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1064c19-9174-4dfc-863c-3ed5a4e771f5 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:13.245916 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d1064c19-9174-4dfc-863c-3ed5a4e771f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f66f58506884bf29cc157ef4943b9fc', 'request_id': 'req-d1064c19-9174-4dfc-863c-3ed5a4e771f5'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:13.247782 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-bff94261-7e0e-4cfe-873d-2adac7afa868 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67e9097c0157484aaa96384a74ce12d7'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:13.252774 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d1064c19-9174-4dfc-863c-3ed5a4e771f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f66f58506884bf29cc157ef4943b9fc', 'request_id': 'req-d1064c19-9174-4dfc-863c-3ed5a4e771f5'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:13.261302 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-bff94261-7e0e-4cfe-873d-2adac7afa868 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67e9097c0157484aaa96384a74ce12d7'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:13.261490 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d1064c19-9174-4dfc-863c-3ed5a4e771f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f66f58506884bf29cc157ef4943b9fc', 'request_id': 'req-d1064c19-9174-4dfc-863c-3ed5a4e771f5'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:13.268653 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-bff94261-7e0e-4cfe-873d-2adac7afa868 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67e9097c0157484aaa96384a74ce12d7'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:13.353524 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d1064c19-9174-4dfc-863c-3ed5a4e771f5 admin admin] The token cache is being invalidate because project 7f66f58506884bf29cc157ef4943b9fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:39:13.353524 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d1064c19-9174-4dfc-863c-3ed5a4e771f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:13.354135 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d1064c19-9174-4dfc-863c-3ed5a4e771f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:13.357069 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3617/7252] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:39:12 2022] DELETE /identity/v3/projects/7f66f58506884bf29cc157ef4943b9fc => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:13.357951 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1064c19-9174-4dfc-863c-3ed5a4e771f5 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:13.359627 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-d1064c19-9174-4dfc-863c-3ed5a4e771f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:13.424086 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-bff94261-7e0e-4cfe-873d-2adac7afa868 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67e9097c0157484aaa96384a74ce12d7'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:13.425130 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-bff94261-7e0e-4cfe-873d-2adac7afa868 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67e9097c0157484aaa96384a74ce12d7'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:13.434014 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3636/7253] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:39:12 2022] DELETE /identity/v3/users/67e9097c0157484aaa96384a74ce12d7 => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:13.440663 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1064c19-9174-4dfc-863c-3ed5a4e771f5 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:13.449500 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7200ef-13c7-451c-a1c0-286942838f44 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:13.449874 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7200ef-13c7-451c-a1c0-286942838f44 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:13.450140 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7200ef-13c7-451c-a1c0-286942838f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:13.499315 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-0a7200ef-13c7-451c-a1c0-286942838f44 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:13.501172 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-0a7200ef-13c7-451c-a1c0-286942838f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:13.542202 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5da84f5-4c67-45b5-9b5e-3ccb0046d73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:13.542202 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da84f5-4c67-45b5-9b5e-3ccb0046d73f admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:13.542202 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da84f5-4c67-45b5-9b5e-3ccb0046d73f admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:13.542202 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da84f5-4c67-45b5-9b5e-3ccb0046d73f admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:13.542543 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5da84f5-4c67-45b5-9b5e-3ccb0046d73f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:13.546077 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5da84f5-4c67-45b5-9b5e-3ccb0046d73f admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:13.562433 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3618/7254] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:39:13 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:39:13.567666 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5da84f5-4c67-45b5-9b5e-3ccb0046d73f admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:13.570452 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-f5da84f5-4c67-45b5-9b5e-3ccb0046d73f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:13.592278 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5da84f5-4c67-45b5-9b5e-3ccb0046d73f admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:13.601211 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f809d20-c0e7-4c18-b5ac-57c726037611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:13.602113 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f809d20-c0e7-4c18-b5ac-57c726037611 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:13.602398 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f809d20-c0e7-4c18-b5ac-57c726037611 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:13.602679 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f809d20-c0e7-4c18-b5ac-57c726037611 admin admin] PATH_INFO: `/v3/projects/10146802122341f4bbfdb0e1f9cd60f5/users/fa1091b4c3c74c429256d992925e6add/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:13.627133 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3637/7255] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:39:13.635917 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a2b9e1-ce9c-4404-afd7-92a237e6670d None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:13.636245 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a2b9e1-ce9c-4404-afd7-92a237e6670d None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:13.636522 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a2b9e1-ce9c-4404-afd7-92a237e6670d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:13.653653 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f809d20-c0e7-4c18-b5ac-57c726037611 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10146802122341f4bbfdb0e1f9cd60f5, user_id=fa1091b4c3c74c429256d992925e6add, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:13.657028 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f809d20-c0e7-4c18-b5ac-57c726037611 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:13.662654 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-97a2b9e1-ce9c-4404-afd7-92a237e6670d None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:13.663940 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-97a2b9e1-ce9c-4404-afd7-92a237e6670d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:13.675537 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3638/7256] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:39:13.678346 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a2b9e1-ce9c-4404-afd7-92a237e6670d None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:13.691447 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a2b9e1-ce9c-4404-afd7-92a237e6670d None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:13.713201 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407020d1-609e-462d-a3d6-3348af42bba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:13.713933 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407020d1-609e-462d-a3d6-3348af42bba6 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:13.714216 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407020d1-609e-462d-a3d6-3348af42bba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:13.714495 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407020d1-609e-462d-a3d6-3348af42bba6 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:13.716330 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407020d1-609e-462d-a3d6-3348af42bba6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:39:13.716652 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407020d1-609e-462d-a3d6-3348af42bba6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:13.721775 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407020d1-609e-462d-a3d6-3348af42bba6 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:13.740097 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3619/7257] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:39:13 2022] PUT /identity/v3/projects/10146802122341f4bbfdb0e1f9cd60f5/users/fa1091b4c3c74c429256d992925e6add/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:13.742231 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f809d20-c0e7-4c18-b5ac-57c726037611 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:13.751536 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3639/7258] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:39:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:39:13.757336 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407020d1-609e-462d-a3d6-3348af42bba6 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:13.784258 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407020d1-609e-462d-a3d6-3348af42bba6 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:13.858684 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f809d20-c0e7-4c18-b5ac-57c726037611 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:13.865133 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a519293d-6c43-4fb6-bf32-a296070405ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:13.865795 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519293d-6c43-4fb6-bf32-a296070405ea admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:13.866082 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519293d-6c43-4fb6-bf32-a296070405ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:13.866363 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519293d-6c43-4fb6-bf32-a296070405ea admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:13.867351 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a519293d-6c43-4fb6-bf32-a296070405ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:13.870394 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a519293d-6c43-4fb6-bf32-a296070405ea admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:13.882709 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3620/7259] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:39:13 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:39:13.886606 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a519293d-6c43-4fb6-bf32-a296070405ea admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:13.900102 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a519293d-6c43-4fb6-bf32-a296070405ea admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:13.907281 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75deb791-1f29-4244-8e3d-fd87a6f6f89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:13.908772 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75deb791-1f29-4244-8e3d-fd87a6f6f89a admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:13.909163 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75deb791-1f29-4244-8e3d-fd87a6f6f89a admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:13.909545 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75deb791-1f29-4244-8e3d-fd87a6f6f89a admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:13.910887 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75deb791-1f29-4244-8e3d-fd87a6f6f89a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:13.911670 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db6575-651b-4766-8196-39d633e4f1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:13.912572 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db6575-651b-4766-8196-39d633e4f1d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:13.912852 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db6575-651b-4766-8196-39d633e4f1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:13.923450 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db6575-651b-4766-8196-39d633e4f1d0 admin admin] PATH_INFO: `/v3/projects/10146802122341f4bbfdb0e1f9cd60f5/users/fa1091b4c3c74c429256d992925e6add/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:13.923450 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77db6575-651b-4766-8196-39d633e4f1d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10146802122341f4bbfdb0e1f9cd60f5, user_id=fa1091b4c3c74c429256d992925e6add, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:13.923654 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75deb791-1f29-4244-8e3d-fd87a6f6f89a admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:13.923740 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77db6575-651b-4766-8196-39d633e4f1d0 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:13.939772 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3621/7260] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:39:13 2022] PUT /identity/v3/projects/10146802122341f4bbfdb0e1f9cd60f5/users/fa1091b4c3c74c429256d992925e6add/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:14.055750 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db6575-651b-4766-8196-39d633e4f1d0 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:14.058038 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-77db6575-651b-4766-8196-39d633e4f1d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:14.069103 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3640/7261] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:39:13 2022] POST /identity/v3/projects => generated 381 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:39:14.070641 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75deb791-1f29-4244-8e3d-fd87a6f6f89a admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:14.171331 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75deb791-1f29-4244-8e3d-fd87a6f6f89a admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:14.177260 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8553589-2571-40a8-887a-5ec7a239c283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:14.177945 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8553589-2571-40a8-887a-5ec7a239c283 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:14.178231 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8553589-2571-40a8-887a-5ec7a239c283 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:14.178608 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8553589-2571-40a8-887a-5ec7a239c283 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:14.179302 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8553589-2571-40a8-887a-5ec7a239c283 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:14.181531 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8553589-2571-40a8-887a-5ec7a239c283 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:14.192123 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db6575-651b-4766-8196-39d633e4f1d0 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:14.199193 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7289b86-5b5c-4e17-8ebf-cdc37ea239ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:14.200277 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7289b86-5b5c-4e17-8ebf-cdc37ea239ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:14.200557 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7289b86-5b5c-4e17-8ebf-cdc37ea239ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:14.200832 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7289b86-5b5c-4e17-8ebf-cdc37ea239ef admin admin] PATH_INFO: `/v3/projects/fdee4f45db334af39847f852d7e17771` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:14.202711 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7289b86-5b5c-4e17-8ebf-cdc37ea239ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdee4f45db334af39847f852d7e17771)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:14.206571 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7289b86-5b5c-4e17-8ebf-cdc37ea239ef admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:14.265411 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3641/7262] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:39:14 2022] POST /identity/v3/users => generated 291 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:39:14.270548 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8553589-2571-40a8-887a-5ec7a239c283 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:14.283863 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8553589-2571-40a8-887a-5ec7a239c283 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:14.290429 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b83bb7-254d-40eb-b898-aedf8ae0df7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:14.291124 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b83bb7-254d-40eb-b898-aedf8ae0df7c admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:14.295280 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b83bb7-254d-40eb-b898-aedf8ae0df7c admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:14.295280 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b83bb7-254d-40eb-b898-aedf8ae0df7c admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:14.295280 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b83bb7-254d-40eb-b898-aedf8ae0df7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:14.295542 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b83bb7-254d-40eb-b898-aedf8ae0df7c admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:14.307367 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3642/7263] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:39:14.312156 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b83bb7-254d-40eb-b898-aedf8ae0df7c admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:14.329472 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b83bb7-254d-40eb-b898-aedf8ae0df7c admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:14.338211 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d7289b86-5b5c-4e17-8ebf-cdc37ea239ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdee4f45db334af39847f852d7e17771', 'request_id': 'req-d7289b86-5b5c-4e17-8ebf-cdc37ea239ef'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:14.346945 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d7289b86-5b5c-4e17-8ebf-cdc37ea239ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdee4f45db334af39847f852d7e17771', 'request_id': 'req-d7289b86-5b5c-4e17-8ebf-cdc37ea239ef'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:14.354751 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d7289b86-5b5c-4e17-8ebf-cdc37ea239ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdee4f45db334af39847f852d7e17771', 'request_id': 'req-d7289b86-5b5c-4e17-8ebf-cdc37ea239ef'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:14.405436 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e6e54f-ea56-49c2-83b4-a31810c35f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:14.406439 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e6e54f-ea56-49c2-83b4-a31810c35f8b admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:14.406953 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e6e54f-ea56-49c2-83b4-a31810c35f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:14.408462 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e6e54f-ea56-49c2-83b4-a31810c35f8b admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:14.415471 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e6e54f-ea56-49c2-83b4-a31810c35f8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:14.415471 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e6e54f-ea56-49c2-83b4-a31810c35f8b admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:14.429676 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3643/7264] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:39:14.431580 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e6e54f-ea56-49c2-83b4-a31810c35f8b admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:14.446585 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e6e54f-ea56-49c2-83b4-a31810c35f8b admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:14.453171 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d635f2a-8cd9-4f34-a6e0-53bcf3ba3ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:14.454222 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d635f2a-8cd9-4f34-a6e0-53bcf3ba3ede admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:14.454532 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d635f2a-8cd9-4f34-a6e0-53bcf3ba3ede admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:14.455077 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d635f2a-8cd9-4f34-a6e0-53bcf3ba3ede admin admin] PATH_INFO: `/v3/projects/18722465cc2449ee96995dd0c487479c/users/6e6ed7d44e3d4b9bb6af16f20cb6ecae/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:14.478215 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d7289b86-5b5c-4e17-8ebf-cdc37ea239ef admin admin] The token cache is being invalidate because project fdee4f45db334af39847f852d7e17771 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:39:14.478648 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d7289b86-5b5c-4e17-8ebf-cdc37ea239ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:14.479522 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d7289b86-5b5c-4e17-8ebf-cdc37ea239ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:14.480591 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d635f2a-8cd9-4f34-a6e0-53bcf3ba3ede admin admin] RBAC: Authorizing `identity:create_grant(project_id=18722465cc2449ee96995dd0c487479c, user_id=6e6ed7d44e3d4b9bb6af16f20cb6ecae, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:14.486357 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d635f2a-8cd9-4f34-a6e0-53bcf3ba3ede admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:14.487575 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3622/7265] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:39:14 2022] DELETE /identity/v3/projects/fdee4f45db334af39847f852d7e17771 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:14.503173 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af903e-075b-4ec9-86a9-d0068390960d None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:14.504878 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af903e-075b-4ec9-86a9-d0068390960d None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:14.506257 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af903e-075b-4ec9-86a9-d0068390960d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:14.535280 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-97af903e-075b-4ec9-86a9-d0068390960d None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:14.536965 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-97af903e-075b-4ec9-86a9-d0068390960d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:14.558202 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3623/7266] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:39:14.567292 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2287f51-cc7a-433a-bec1-9c86da65d180 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:14.567661 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2287f51-cc7a-433a-bec1-9c86da65d180 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:14.567892 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2287f51-cc7a-433a-bec1-9c86da65d180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:14.589917 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-e2287f51-cc7a-433a-bec1-9c86da65d180 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:14.591956 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e2287f51-cc7a-433a-bec1-9c86da65d180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:14.600588 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3624/7267] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:39:14.604539 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2287f51-cc7a-433a-bec1-9c86da65d180 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:14.615103 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2287f51-cc7a-433a-bec1-9c86da65d180 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:14.622524 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb00b12-81e3-4242-8c5c-b626fa718dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:14.623262 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb00b12-81e3-4242-8c5c-b626fa718dd8 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:14.623590 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb00b12-81e3-4242-8c5c-b626fa718dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:14.623878 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb00b12-81e3-4242-8c5c-b626fa718dd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:14.624607 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb00b12-81e3-4242-8c5c-b626fa718dd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:39:14.624920 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb00b12-81e3-4242-8c5c-b626fa718dd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:14.626543 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb00b12-81e3-4242-8c5c-b626fa718dd8 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:14.627011 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3644/7268] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:39:14 2022] PUT /identity/v3/projects/18722465cc2449ee96995dd0c487479c/users/6e6ed7d44e3d4b9bb6af16f20cb6ecae/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:14.632037 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6398cdd-5c9c-4417-8cf3-dcd38fa13d66 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:14.632522 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6398cdd-5c9c-4417-8cf3-dcd38fa13d66 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:14.633035 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6398cdd-5c9c-4417-8cf3-dcd38fa13d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:14.639330 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3625/7269] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:39:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:39:14.646093 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb00b12-81e3-4242-8c5c-b626fa718dd8 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:14.654530 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-c6398cdd-5c9c-4417-8cf3-dcd38fa13d66 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:14.655967 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c6398cdd-5c9c-4417-8cf3-dcd38fa13d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:14.657941 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb00b12-81e3-4242-8c5c-b626fa718dd8 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:14.720150 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3645/7270] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:39:14.726377 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464bf2e7-130f-410c-95ec-4ce6598d6633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:14.727052 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464bf2e7-130f-410c-95ec-4ce6598d6633 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:14.727335 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464bf2e7-130f-410c-95ec-4ce6598d6633 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:14.727645 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464bf2e7-130f-410c-95ec-4ce6598d6633 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:14.728373 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464bf2e7-130f-410c-95ec-4ce6598d6633 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:14.730196 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6398cdd-5c9c-4417-8cf3-dcd38fa13d66 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:14.730333 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464bf2e7-130f-410c-95ec-4ce6598d6633 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:14.734888 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c6398cdd-5c9c-4417-8cf3-dcd38fa13d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:14.796275 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6398cdd-5c9c-4417-8cf3-dcd38fa13d66 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:14.800581 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6a4dbb-c20e-4390-97b3-1905bd86c358 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:14.801348 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a4dbb-c20e-4390-97b3-1905bd86c358 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:14.801742 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a4dbb-c20e-4390-97b3-1905bd86c358 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:14.802123 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a4dbb-c20e-4390-97b3-1905bd86c358 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:14.814053 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6a4dbb-c20e-4390-97b3-1905bd86c358 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:14.815828 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6a4dbb-c20e-4390-97b3-1905bd86c358 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:14.828201 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3646/7271] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:39:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:39:14.852002 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3626/7272] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:39:14 2022] POST /identity/v3/projects => generated 369 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:39:14.856007 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6a4dbb-c20e-4390-97b3-1905bd86c358 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:14.883734 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6a4dbb-c20e-4390-97b3-1905bd86c358 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:15.001693 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b56d577-cff4-4272-9d76-d91f75d78d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:15.002183 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b56d577-cff4-4272-9d76-d91f75d78d43 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:15.002631 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b56d577-cff4-4272-9d76-d91f75d78d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:15.002910 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b56d577-cff4-4272-9d76-d91f75d78d43 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:15.003666 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b56d577-cff4-4272-9d76-d91f75d78d43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:15.006260 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b56d577-cff4-4272-9d76-d91f75d78d43 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:15.163021 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3647/7273] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:39:14 2022] POST /identity/v3/users => generated 285 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:39:15.166675 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464bf2e7-130f-410c-95ec-4ce6598d6633 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:15.180548 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464bf2e7-130f-410c-95ec-4ce6598d6633 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:15.185589 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29368286-6462-4e03-9b0f-688443e5d614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:15.186742 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29368286-6462-4e03-9b0f-688443e5d614 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:15.186742 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29368286-6462-4e03-9b0f-688443e5d614 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:15.186914 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29368286-6462-4e03-9b0f-688443e5d614 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:15.187523 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29368286-6462-4e03-9b0f-688443e5d614 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:15.189150 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29368286-6462-4e03-9b0f-688443e5d614 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:15.218152 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3627/7274] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:39:15 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:39:15.219468 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b56d577-cff4-4272-9d76-d91f75d78d43 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:15.237143 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b56d577-cff4-4272-9d76-d91f75d78d43 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:15.242734 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b8b9df-8e32-4df9-9a0d-cac06fbae7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:15.243414 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b8b9df-8e32-4df9-9a0d-cac06fbae7a9 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:15.243726 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b8b9df-8e32-4df9-9a0d-cac06fbae7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:15.244415 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b8b9df-8e32-4df9-9a0d-cac06fbae7a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:15.245160 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b8b9df-8e32-4df9-9a0d-cac06fbae7a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:15.248430 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b8b9df-8e32-4df9-9a0d-cac06fbae7a9 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:15.260750 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3648/7275] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:39:15 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:39:15.265925 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29368286-6462-4e03-9b0f-688443e5d614 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:15.278745 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29368286-6462-4e03-9b0f-688443e5d614 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:15.284682 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e4ec83-6b84-479c-847e-5e616c06fb79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:15.287465 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e4ec83-6b84-479c-847e-5e616c06fb79 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:15.287775 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e4ec83-6b84-479c-847e-5e616c06fb79 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:15.288054 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e4ec83-6b84-479c-847e-5e616c06fb79 admin admin] PATH_INFO: `/v3/projects/e5d48ff84fbd4ab8a02d5a7625b46749/users/2d7de2da3d9b4ae6ae57e9748b8ec0eb/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:15.325019 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e4ec83-6b84-479c-847e-5e616c06fb79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5d48ff84fbd4ab8a02d5a7625b46749, user_id=2d7de2da3d9b4ae6ae57e9748b8ec0eb, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:15.328730 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e4ec83-6b84-479c-847e-5e616c06fb79 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:15.466052 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3628/7276] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:39:15 2022] PUT /identity/v3/projects/e5d48ff84fbd4ab8a02d5a7625b46749/users/2d7de2da3d9b4ae6ae57e9748b8ec0eb/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:15.476235 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19040b1e-fbb2-423d-87fb-d91c55742d8b None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:15.476865 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19040b1e-fbb2-423d-87fb-d91c55742d8b None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:15.476865 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19040b1e-fbb2-423d-87fb-d91c55742d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:15.520675 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-19040b1e-fbb2-423d-87fb-d91c55742d8b None None] MFA Rules not processed for user `2d7de2da3d9b4ae6ae57e9748b8ec0eb`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:15.522513 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-19040b1e-fbb2-423d-87fb-d91c55742d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:15.635907 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3649/7277] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:15 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:39:15.641772 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e4ec83-6b84-479c-847e-5e616c06fb79 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:15.733530 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e4ec83-6b84-479c-847e-5e616c06fb79 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:15.738996 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9f96d7-9941-4ef8-85f9-4c7e65a0458b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:15.740123 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f96d7-9941-4ef8-85f9-4c7e65a0458b admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:15.740583 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f96d7-9941-4ef8-85f9-4c7e65a0458b admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:15.741050 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f96d7-9941-4ef8-85f9-4c7e65a0458b admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:15.742088 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9f96d7-9941-4ef8-85f9-4c7e65a0458b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:15.744757 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9f96d7-9941-4ef8-85f9-4c7e65a0458b admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:15.886209 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3629/7278] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:39:15 2022] POST /identity/v3/projects => generated 367 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:39:15.898740 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19040b1e-fbb2-423d-87fb-d91c55742d8b None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:15.909255 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e08d1-ea51-4dc8-9ac2-9ce1ea5817d3 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:15.909544 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e08d1-ea51-4dc8-9ac2-9ce1ea5817d3 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:15.909820 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e08d1-ea51-4dc8-9ac2-9ce1ea5817d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:15.921527 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19040b1e-fbb2-423d-87fb-d91c55742d8b None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:15.973137 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-953e08d1-ea51-4dc8-9ac2-9ce1ea5817d3 None None] MFA Rules not processed for user `fa1091b4c3c74c429256d992925e6add`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:15.975958 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-953e08d1-ea51-4dc8-9ac2-9ce1ea5817d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:16.080766 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24629aa7-6144-467e-96f6-6cb53b578399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:16.082413 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24629aa7-6144-467e-96f6-6cb53b578399 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:16.083688 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24629aa7-6144-467e-96f6-6cb53b578399 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:16.085652 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24629aa7-6144-467e-96f6-6cb53b578399 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:16.085782 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24629aa7-6144-467e-96f6-6cb53b578399 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:16.093950 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24629aa7-6144-467e-96f6-6cb53b578399 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:16.167058 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3630/7279] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:15 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:39:16.237473 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3650/7280] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:39:15 2022] POST /identity/v3/users => generated 290 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:39:16.238699 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953e08d1-ea51-4dc8-9ac2-9ce1ea5817d3 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:16.267126 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953e08d1-ea51-4dc8-9ac2-9ce1ea5817d3 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:16.272272 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837dfc87-eca4-4342-89a6-eb53a60c45d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:16.272961 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837dfc87-eca4-4342-89a6-eb53a60c45d3 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:16.273241 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837dfc87-eca4-4342-89a6-eb53a60c45d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:16.273507 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837dfc87-eca4-4342-89a6-eb53a60c45d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:16.274224 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837dfc87-eca4-4342-89a6-eb53a60c45d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:16.276360 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837dfc87-eca4-4342-89a6-eb53a60c45d3 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:16.314201 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3631/7281] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:39:16 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:39:16.320190 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24629aa7-6144-467e-96f6-6cb53b578399 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:16.335250 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24629aa7-6144-467e-96f6-6cb53b578399 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:16.343132 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123381ef-db49-45a3-a0ca-33268a3dc2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:16.344191 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123381ef-db49-45a3-a0ca-33268a3dc2bc admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:16.344553 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123381ef-db49-45a3-a0ca-33268a3dc2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:16.344980 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123381ef-db49-45a3-a0ca-33268a3dc2bc admin admin] PATH_INFO: `/v3/projects/ab1bf1d2539f466380bc3034441cd2e5/users/dea32a55f941428a8352be49482b5891/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:16.367424 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123381ef-db49-45a3-a0ca-33268a3dc2bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab1bf1d2539f466380bc3034441cd2e5, user_id=dea32a55f941428a8352be49482b5891, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:16.374069 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123381ef-db49-45a3-a0ca-33268a3dc2bc admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:16.461309 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3651/7282] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:39:16 2022] PUT /identity/v3/projects/ab1bf1d2539f466380bc3034441cd2e5/users/dea32a55f941428a8352be49482b5891/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:16.467748 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837dfc87-eca4-4342-89a6-eb53a60c45d3 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:16.493215 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837dfc87-eca4-4342-89a6-eb53a60c45d3 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:16.610600 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74d8db1-2452-429e-bdc2-50c0dcf0b3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:16.611403 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d8db1-2452-429e-bdc2-50c0dcf0b3b7 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:16.611802 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d8db1-2452-429e-bdc2-50c0dcf0b3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:16.612188 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d8db1-2452-429e-bdc2-50c0dcf0b3b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:16.615119 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74d8db1-2452-429e-bdc2-50c0dcf0b3b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:16.616821 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74d8db1-2452-429e-bdc2-50c0dcf0b3b7 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:16.636679 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123381ef-db49-45a3-a0ca-33268a3dc2bc admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:16.637734 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3632/7283] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:39:16 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:39:16.650269 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123381ef-db49-45a3-a0ca-33268a3dc2bc admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:16.660058 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355401df-8bcb-46ee-97cc-391cd18345bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:16.661218 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355401df-8bcb-46ee-97cc-391cd18345bb admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:16.661542 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355401df-8bcb-46ee-97cc-391cd18345bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:16.663354 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355401df-8bcb-46ee-97cc-391cd18345bb admin admin] PATH_INFO: `/v3/projects/ab1bf1d2539f466380bc3034441cd2e5/users/dea32a55f941428a8352be49482b5891/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:16.664188 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355401df-8bcb-46ee-97cc-391cd18345bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab1bf1d2539f466380bc3034441cd2e5, user_id=dea32a55f941428a8352be49482b5891, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:16.667052 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355401df-8bcb-46ee-97cc-391cd18345bb admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:16.687619 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3652/7284] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:39:16 2022] PUT /identity/v3/projects/ab1bf1d2539f466380bc3034441cd2e5/users/dea32a55f941428a8352be49482b5891/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:16.692181 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0037b07-609f-4f6a-b0fb-a811c38fce7a None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:16.692699 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0037b07-609f-4f6a-b0fb-a811c38fce7a None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:16.693147 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0037b07-609f-4f6a-b0fb-a811c38fce7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:16.745617 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-e0037b07-609f-4f6a-b0fb-a811c38fce7a None None] MFA Rules not processed for user `dea32a55f941428a8352be49482b5891`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:16.747106 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e0037b07-609f-4f6a-b0fb-a811c38fce7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:16.880208 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3633/7285] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:16 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:39:16.889061 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355401df-8bcb-46ee-97cc-391cd18345bb admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:16.890912 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-355401df-8bcb-46ee-97cc-391cd18345bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:16.987105 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355401df-8bcb-46ee-97cc-391cd18345bb admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:16.993523 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f238fc-9b59-42df-8f5b-861e3b3c0e36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198271d1c0d44cb58bace41a65f4b94c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:16.994067 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f238fc-9b59-42df-8f5b-861e3b3c0e36 service cinder] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:16.994355 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f238fc-9b59-42df-8f5b-861e3b3c0e36 service cinder] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:16.994634 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f238fc-9b59-42df-8f5b-861e3b3c0e36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:17.007854 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f238fc-9b59-42df-8f5b-861e3b3c0e36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:17.009334 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f238fc-9b59-42df-8f5b-861e3b3c0e36 service cinder] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:17.024702 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3653/7286] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:39:16 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:39:17.487705 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a831e946-aa14-4fb4-ab53-a740168d4466 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:17.488236 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a831e946-aa14-4fb4-ab53-a740168d4466 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:17.488307 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a831e946-aa14-4fb4-ab53-a740168d4466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:17.551855 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-a831e946-aa14-4fb4-ab53-a740168d4466 None None] MFA Rules not processed for user `6e6ed7d44e3d4b9bb6af16f20cb6ecae`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:17.553100 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-a831e946-aa14-4fb4-ab53-a740168d4466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:17.720129 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3634/7287] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:39:17.728619 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e81222-a338-4e12-804e-8758b730cb87 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:17.730115 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e81222-a338-4e12-804e-8758b730cb87 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:17.730741 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e81222-a338-4e12-804e-8758b730cb87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:17.759408 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-58e81222-a338-4e12-804e-8758b730cb87 None None] MFA Rules not processed for user `6e6ed7d44e3d4b9bb6af16f20cb6ecae`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:17.760658 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-58e81222-a338-4e12-804e-8758b730cb87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:17.768375 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3654/7288] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:39:17.781342 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a831e946-aa14-4fb4-ab53-a740168d4466 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:17.782767 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-a831e946-aa14-4fb4-ab53-a740168d4466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:17.902009 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a831e946-aa14-4fb4-ab53-a740168d4466 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:17.911259 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7099ddff-d7f1-4d52-81ec-4862fa203fa6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:17.916228 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7099ddff-d7f1-4d52-81ec-4862fa203fa6 service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:17.917273 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7099ddff-d7f1-4d52-81ec-4862fa203fa6 service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:17.917566 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7099ddff-d7f1-4d52-81ec-4862fa203fa6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:17.945360 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7099ddff-d7f1-4d52-81ec-4862fa203fa6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:17.947107 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7099ddff-d7f1-4d52-81ec-4862fa203fa6 service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:17.957341 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3635/7289] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:39:17 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:39:19.171305 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e81222-a338-4e12-804e-8758b730cb87 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:19.173498 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-58e81222-a338-4e12-804e-8758b730cb87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:19.246897 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e81222-a338-4e12-804e-8758b730cb87 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:19.254672 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1588e3b3-1488-471e-8d5b-d0d7f8901799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:19.255514 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1588e3b3-1488-471e-8d5b-d0d7f8901799 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:19.255804 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1588e3b3-1488-471e-8d5b-d0d7f8901799 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:19.256083 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1588e3b3-1488-471e-8d5b-d0d7f8901799 admin admin] PATH_INFO: `/v3/users/bc369d055704435f803b20a9b8f16a8a` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:19.258604 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1588e3b3-1488-471e-8d5b-d0d7f8901799 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc369d055704435f803b20a9b8f16a8a)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:19.260765 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1588e3b3-1488-471e-8d5b-d0d7f8901799 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:19.291365 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7099ddff-d7f1-4d52-81ec-4862fa203fa6 service nova] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:19.294333 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-7099ddff-d7f1-4d52-81ec-4862fa203fa6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:19.320862 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7099ddff-d7f1-4d52-81ec-4862fa203fa6 service nova] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:19.339526 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6b7bd3-6c2a-4b7f-9cef-d3b6a269b3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:19.341123 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b7bd3-6c2a-4b7f-9cef-d3b6a269b3b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:19.341744 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b7bd3-6c2a-4b7f-9cef-d3b6a269b3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:19.342168 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b7bd3-6c2a-4b7f-9cef-d3b6a269b3b4 admin admin] PATH_INFO: `/v3/users/79303a39c3af4a209a82042c1f1944d8` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:19.343758 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6b7bd3-6c2a-4b7f-9cef-d3b6a269b3b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79303a39c3af4a209a82042c1f1944d8)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:19.345838 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6b7bd3-6c2a-4b7f-9cef-d3b6a269b3b4 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:19.541342 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-1588e3b3-1488-471e-8d5b-d0d7f8901799 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc369d055704435f803b20a9b8f16a8a'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:19.561929 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-1588e3b3-1488-471e-8d5b-d0d7f8901799 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc369d055704435f803b20a9b8f16a8a'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:19.577954 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-1588e3b3-1488-471e-8d5b-d0d7f8901799 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc369d055704435f803b20a9b8f16a8a'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:19.613186 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0c6b7bd3-6c2a-4b7f-9cef-d3b6a269b3b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79303a39c3af4a209a82042c1f1944d8'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:19.629760 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0c6b7bd3-6c2a-4b7f-9cef-d3b6a269b3b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79303a39c3af4a209a82042c1f1944d8'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:19.630699 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0c6b7bd3-6c2a-4b7f-9cef-d3b6a269b3b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79303a39c3af4a209a82042c1f1944d8'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:19.672860 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-1588e3b3-1488-471e-8d5b-d0d7f8901799 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc369d055704435f803b20a9b8f16a8a'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:19.675658 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-1588e3b3-1488-471e-8d5b-d0d7f8901799 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc369d055704435f803b20a9b8f16a8a'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:19.683167 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3655/7290] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:39:19 2022] DELETE /identity/v3/users/bc369d055704435f803b20a9b8f16a8a => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:19.688222 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bd9272-9f5e-4350-a48c-d206e4764d3b None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:19.689161 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bd9272-9f5e-4350-a48c-d206e4764d3b None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:19.689447 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bd9272-9f5e-4350-a48c-d206e4764d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:19.710094 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-d0bd9272-9f5e-4350-a48c-d206e4764d3b None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:19.711378 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d0bd9272-9f5e-4350-a48c-d206e4764d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:19.768034 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0c6b7bd3-6c2a-4b7f-9cef-d3b6a269b3b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79303a39c3af4a209a82042c1f1944d8'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:19.786361 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0c6b7bd3-6c2a-4b7f-9cef-d3b6a269b3b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79303a39c3af4a209a82042c1f1944d8'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:19.792891 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3656/7291] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:39:19.805351 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bd9272-9f5e-4350-a48c-d206e4764d3b None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:19.808511 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d0bd9272-9f5e-4350-a48c-d206e4764d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:19.811617 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3636/7292] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:39:19 2022] DELETE /identity/v3/users/79303a39c3af4a209a82042c1f1944d8 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:19.930681 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bd9272-9f5e-4350-a48c-d206e4764d3b None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:20.054613 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b813e309-408c-4854-b7ea-64ed8b45ec60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:20.055301 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b813e309-408c-4854-b7ea-64ed8b45ec60 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:20.055632 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b813e309-408c-4854-b7ea-64ed8b45ec60 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:20.056078 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b813e309-408c-4854-b7ea-64ed8b45ec60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:20.161879 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6b7bd3-6c2a-4b7f-9cef-d3b6a269b3b4 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:20.163777 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-0c6b7bd3-6c2a-4b7f-9cef-d3b6a269b3b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:20.169687 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b813e309-408c-4854-b7ea-64ed8b45ec60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:20.171165 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b813e309-408c-4854-b7ea-64ed8b45ec60 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:20.180606 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6b7bd3-6c2a-4b7f-9cef-d3b6a269b3b4 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:20.186593 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420e1636-ab5d-4273-9537-976858f88ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:20.187404 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e1636-ab5d-4273-9537-976858f88ec3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:20.187724 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e1636-ab5d-4273-9537-976858f88ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:20.188155 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e1636-ab5d-4273-9537-976858f88ec3 admin admin] PATH_INFO: `/v3/projects/4a127491ec1e4f5f8018a366d4617c86` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:20.189331 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420e1636-ab5d-4273-9537-976858f88ec3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a127491ec1e4f5f8018a366d4617c86)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:20.189958 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3657/7293] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:39:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:39:20.191263 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420e1636-ab5d-4273-9537-976858f88ec3 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:20.336701 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-420e1636-ab5d-4273-9537-976858f88ec3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a127491ec1e4f5f8018a366d4617c86', 'request_id': 'req-420e1636-ab5d-4273-9537-976858f88ec3'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:20.347738 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-420e1636-ab5d-4273-9537-976858f88ec3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a127491ec1e4f5f8018a366d4617c86', 'request_id': 'req-420e1636-ab5d-4273-9537-976858f88ec3'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:20.357933 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-420e1636-ab5d-4273-9537-976858f88ec3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a127491ec1e4f5f8018a366d4617c86', 'request_id': 'req-420e1636-ab5d-4273-9537-976858f88ec3'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:20.515073 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-420e1636-ab5d-4273-9537-976858f88ec3 admin admin] The token cache is being invalidate because project 4a127491ec1e4f5f8018a366d4617c86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:39:20.515372 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-420e1636-ab5d-4273-9537-976858f88ec3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:20.516562 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-420e1636-ab5d-4273-9537-976858f88ec3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:20.518275 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3637/7294] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:39:20 2022] DELETE /identity/v3/projects/4a127491ec1e4f5f8018a366d4617c86 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:39:20.522736 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b813e309-408c-4854-b7ea-64ed8b45ec60 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:20.536005 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b813e309-408c-4854-b7ea-64ed8b45ec60 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:20.554387 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420e1636-ab5d-4273-9537-976858f88ec3 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:20.560893 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-420e1636-ab5d-4273-9537-976858f88ec3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:20.664346 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa4925f-f104-41c2-ad6d-165077ab619f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:20.665703 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa4925f-f104-41c2-ad6d-165077ab619f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:20.666101 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa4925f-f104-41c2-ad6d-165077ab619f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:20.666390 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa4925f-f104-41c2-ad6d-165077ab619f admin admin] PATH_INFO: `/v3/users/fa1091b4c3c74c429256d992925e6add` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:20.667711 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa4925f-f104-41c2-ad6d-165077ab619f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa1091b4c3c74c429256d992925e6add)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:20.670601 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa4925f-f104-41c2-ad6d-165077ab619f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:20.678096 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420e1636-ab5d-4273-9537-976858f88ec3 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:20.688620 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad86929a-947a-4869-a3ec-318e96adad18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:20.689916 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad86929a-947a-4869-a3ec-318e96adad18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:20.700395 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad86929a-947a-4869-a3ec-318e96adad18 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:20.700395 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad86929a-947a-4869-a3ec-318e96adad18 admin admin] PATH_INFO: `/v3/projects/166828606cad42a9a9d59436584ad80f` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:20.700395 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad86929a-947a-4869-a3ec-318e96adad18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=166828606cad42a9a9d59436584ad80f)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:20.701506 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad86929a-947a-4869-a3ec-318e96adad18 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:20.905822 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0fa4925f-f104-41c2-ad6d-165077ab619f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa1091b4c3c74c429256d992925e6add'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:20.924404 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ad86929a-947a-4869-a3ec-318e96adad18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '166828606cad42a9a9d59436584ad80f', 'request_id': 'req-ad86929a-947a-4869-a3ec-318e96adad18'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:20.931191 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ad86929a-947a-4869-a3ec-318e96adad18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '166828606cad42a9a9d59436584ad80f', 'request_id': 'req-ad86929a-947a-4869-a3ec-318e96adad18'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:20.939966 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ad86929a-947a-4869-a3ec-318e96adad18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '166828606cad42a9a9d59436584ad80f', 'request_id': 'req-ad86929a-947a-4869-a3ec-318e96adad18'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:20.943845 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0fa4925f-f104-41c2-ad6d-165077ab619f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa1091b4c3c74c429256d992925e6add'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:20.952053 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0fa4925f-f104-41c2-ad6d-165077ab619f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa1091b4c3c74c429256d992925e6add'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:21.050044 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ad86929a-947a-4869-a3ec-318e96adad18 admin admin] The token cache is being invalidate because project 166828606cad42a9a9d59436584ad80f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:39:21.050459 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ad86929a-947a-4869-a3ec-318e96adad18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:21.051206 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ad86929a-947a-4869-a3ec-318e96adad18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:21.052919 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3638/7295] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:39:20 2022] DELETE /identity/v3/projects/166828606cad42a9a9d59436584ad80f => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:21.053843 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad86929a-947a-4869-a3ec-318e96adad18 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:21.055214 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-ad86929a-947a-4869-a3ec-318e96adad18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:21.137037 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad86929a-947a-4869-a3ec-318e96adad18 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:21.137728 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0fa4925f-f104-41c2-ad6d-165077ab619f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa1091b4c3c74c429256d992925e6add'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:21.138433 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0fa4925f-f104-41c2-ad6d-165077ab619f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa1091b4c3c74c429256d992925e6add'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:21.148873 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d367e-3cc7-4ff7-ac60-9a92cb8191ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:21.148873 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d367e-3cc7-4ff7-ac60-9a92cb8191ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:21.148873 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d367e-3cc7-4ff7-ac60-9a92cb8191ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:21.148873 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d367e-3cc7-4ff7-ac60-9a92cb8191ca admin admin] PATH_INFO: `/v3/users/2d7de2da3d9b4ae6ae57e9748b8ec0eb` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:21.149287 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379d367e-3cc7-4ff7-ac60-9a92cb8191ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d7de2da3d9b4ae6ae57e9748b8ec0eb)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:21.149802 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3658/7296] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:39:20 2022] DELETE /identity/v3/users/fa1091b4c3c74c429256d992925e6add => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:21.149905 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379d367e-3cc7-4ff7-ac60-9a92cb8191ca admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:21.157961 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394d790-3192-4cfb-a915-e616e2ab7be7 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:21.157961 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394d790-3192-4cfb-a915-e616e2ab7be7 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:21.158242 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394d790-3192-4cfb-a915-e616e2ab7be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:21.187211 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-7394d790-3192-4cfb-a915-e616e2ab7be7 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:21.188633 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-7394d790-3192-4cfb-a915-e616e2ab7be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:21.262641 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3659/7297] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:39:21.271255 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b854528-41c9-490a-a01c-dbe47952aade None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:21.271584 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b854528-41c9-490a-a01c-dbe47952aade None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:21.271872 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b854528-41c9-490a-a01c-dbe47952aade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:21.291029 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-3b854528-41c9-490a-a01c-dbe47952aade None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:21.292510 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-3b854528-41c9-490a-a01c-dbe47952aade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:21.302473 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3660/7298] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:39:21.306728 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b854528-41c9-490a-a01c-dbe47952aade None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:21.317808 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b854528-41c9-490a-a01c-dbe47952aade None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:21.324560 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d4046b-a153-432d-a1b7-7dd1644b1962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:21.325247 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d4046b-a153-432d-a1b7-7dd1644b1962 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:21.325531 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d4046b-a153-432d-a1b7-7dd1644b1962 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:21.325806 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d4046b-a153-432d-a1b7-7dd1644b1962 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:21.326545 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d4046b-a153-432d-a1b7-7dd1644b1962 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:39:21.327575 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d4046b-a153-432d-a1b7-7dd1644b1962 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:21.329297 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d4046b-a153-432d-a1b7-7dd1644b1962 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:21.343023 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3661/7299] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:39:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:39:21.347759 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d4046b-a153-432d-a1b7-7dd1644b1962 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:21.359754 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d4046b-a153-432d-a1b7-7dd1644b1962 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:21.364923 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd456df-f0b3-41f0-84f4-cd9aa8e3bed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:21.365753 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd456df-f0b3-41f0-84f4-cd9aa8e3bed8 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:21.366047 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd456df-f0b3-41f0-84f4-cd9aa8e3bed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:21.366322 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd456df-f0b3-41f0-84f4-cd9aa8e3bed8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:21.367014 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd456df-f0b3-41f0-84f4-cd9aa8e3bed8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:21.370128 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd456df-f0b3-41f0-84f4-cd9aa8e3bed8 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:21.446042 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-379d367e-3cc7-4ff7-ac60-9a92cb8191ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d7de2da3d9b4ae6ae57e9748b8ec0eb'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:21.456654 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-379d367e-3cc7-4ff7-ac60-9a92cb8191ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d7de2da3d9b4ae6ae57e9748b8ec0eb'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:21.457700 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-379d367e-3cc7-4ff7-ac60-9a92cb8191ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d7de2da3d9b4ae6ae57e9748b8ec0eb'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:21.477918 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3662/7300] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:39:21 2022] POST /identity/v3/projects => generated 375 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:39:21.482115 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd456df-f0b3-41f0-84f4-cd9aa8e3bed8 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:21.566040 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd456df-f0b3-41f0-84f4-cd9aa8e3bed8 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:21.571935 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb18d52c-3cd6-4736-a9a2-d1302c46b739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:21.572636 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb18d52c-3cd6-4736-a9a2-d1302c46b739 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:21.572920 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb18d52c-3cd6-4736-a9a2-d1302c46b739 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:21.573195 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb18d52c-3cd6-4736-a9a2-d1302c46b739 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:21.573890 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb18d52c-3cd6-4736-a9a2-d1302c46b739 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:21.576675 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb18d52c-3cd6-4736-a9a2-d1302c46b739 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:21.592811 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-379d367e-3cc7-4ff7-ac60-9a92cb8191ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d7de2da3d9b4ae6ae57e9748b8ec0eb'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:21.608195 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-379d367e-3cc7-4ff7-ac60-9a92cb8191ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d7de2da3d9b4ae6ae57e9748b8ec0eb'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:21.615247 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3639/7301] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:39:21 2022] DELETE /identity/v3/users/2d7de2da3d9b4ae6ae57e9748b8ec0eb => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:21.620082 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d509f9-5dd6-4305-8e65-c4f3c7ce9d36 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:21.620380 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d509f9-5dd6-4305-8e65-c4f3c7ce9d36 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:21.620675 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d509f9-5dd6-4305-8e65-c4f3c7ce9d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:21.639305 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-d7d509f9-5dd6-4305-8e65-c4f3c7ce9d36 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:21.640543 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-d7d509f9-5dd6-4305-8e65-c4f3c7ce9d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:21.687817 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3663/7302] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:39:21 2022] POST /identity/v3/users => generated 288 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:39:21.689531 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb18d52c-3cd6-4736-a9a2-d1302c46b739 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:21.693027 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-eb18d52c-3cd6-4736-a9a2-d1302c46b739 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:21.708518 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb18d52c-3cd6-4736-a9a2-d1302c46b739 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:21.809225 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3640/7303] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:39:21.810778 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d509f9-5dd6-4305-8e65-c4f3c7ce9d36 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:21.814818 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-d7d509f9-5dd6-4305-8e65-c4f3c7ce9d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:21.830092 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff42258-1a10-41ae-b285-8c40a8135bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:21.830092 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff42258-1a10-41ae-b285-8c40a8135bbb admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:21.830092 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff42258-1a10-41ae-b285-8c40a8135bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:21.830092 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff42258-1a10-41ae-b285-8c40a8135bbb admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:21.830374 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff42258-1a10-41ae-b285-8c40a8135bbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:21.836504 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d509f9-5dd6-4305-8e65-c4f3c7ce9d36 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:21.837871 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff42258-1a10-41ae-b285-8c40a8135bbb admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:21.842783 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d2f5d-2747-46b2-9bf2-ab620e82823c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:21.843679 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d2f5d-2747-46b2-9bf2-ab620e82823c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:21.843963 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d2f5d-2747-46b2-9bf2-ab620e82823c admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:21.844290 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d2f5d-2747-46b2-9bf2-ab620e82823c admin admin] PATH_INFO: `/v3/projects/10146802122341f4bbfdb0e1f9cd60f5` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:21.845661 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235d2f5d-2747-46b2-9bf2-ab620e82823c admin admin] RBAC: Authorizing `identity:delete_project(project_id=10146802122341f4bbfdb0e1f9cd60f5)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:21.847675 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235d2f5d-2747-46b2-9bf2-ab620e82823c admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:21.852962 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3664/7304] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:39:21 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:39:21.852962 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff42258-1a10-41ae-b285-8c40a8135bbb admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:21.854444 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-7ff42258-1a10-41ae-b285-8c40a8135bbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:21.872694 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff42258-1a10-41ae-b285-8c40a8135bbb admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:21.878845 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11365cc0-21ad-4e1a-97b2-7ac0a049d230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:21.880336 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11365cc0-21ad-4e1a-97b2-7ac0a049d230 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:21.880336 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11365cc0-21ad-4e1a-97b2-7ac0a049d230 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:21.880683 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11365cc0-21ad-4e1a-97b2-7ac0a049d230 admin admin] PATH_INFO: `/v3/users/0ca3fcd6c8d5419e98ac85d9238208d0` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:21.882165 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11365cc0-21ad-4e1a-97b2-7ac0a049d230 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ca3fcd6c8d5419e98ac85d9238208d0)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:21.884071 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11365cc0-21ad-4e1a-97b2-7ac0a049d230 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:21.971400 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-235d2f5d-2747-46b2-9bf2-ab620e82823c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10146802122341f4bbfdb0e1f9cd60f5', 'request_id': 'req-235d2f5d-2747-46b2-9bf2-ab620e82823c'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:21.977717 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-235d2f5d-2747-46b2-9bf2-ab620e82823c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10146802122341f4bbfdb0e1f9cd60f5', 'request_id': 'req-235d2f5d-2747-46b2-9bf2-ab620e82823c'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:21.984808 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-235d2f5d-2747-46b2-9bf2-ab620e82823c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10146802122341f4bbfdb0e1f9cd60f5', 'request_id': 'req-235d2f5d-2747-46b2-9bf2-ab620e82823c'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:22.084441 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-235d2f5d-2747-46b2-9bf2-ab620e82823c admin admin] The token cache is being invalidate because project 10146802122341f4bbfdb0e1f9cd60f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:39:22.084988 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-235d2f5d-2747-46b2-9bf2-ab620e82823c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:22.086210 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-235d2f5d-2747-46b2-9bf2-ab620e82823c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:22.091395 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3641/7305] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:39:21 2022] DELETE /identity/v3/projects/10146802122341f4bbfdb0e1f9cd60f5 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:22.091395 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d2f5d-2747-46b2-9bf2-ab620e82823c admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:22.092944 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-235d2f5d-2747-46b2-9bf2-ab620e82823c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:22.119635 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-11365cc0-21ad-4e1a-97b2-7ac0a049d230 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ca3fcd6c8d5419e98ac85d9238208d0'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:22.132042 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-11365cc0-21ad-4e1a-97b2-7ac0a049d230 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ca3fcd6c8d5419e98ac85d9238208d0'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:22.139425 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-11365cc0-21ad-4e1a-97b2-7ac0a049d230 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ca3fcd6c8d5419e98ac85d9238208d0'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:22.165263 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d2f5d-2747-46b2-9bf2-ab620e82823c admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:22.170222 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c725bf-f184-4d7a-a15d-b3c2a1363633 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:22.171050 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c725bf-f184-4d7a-a15d-b3c2a1363633 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:22.171436 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c725bf-f184-4d7a-a15d-b3c2a1363633 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:22.171899 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c725bf-f184-4d7a-a15d-b3c2a1363633 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:22.173978 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-56c725bf-f184-4d7a-a15d-b3c2a1363633 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:22.210422 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-11365cc0-21ad-4e1a-97b2-7ac0a049d230 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ca3fcd6c8d5419e98ac85d9238208d0'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:22.211587 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-11365cc0-21ad-4e1a-97b2-7ac0a049d230 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ca3fcd6c8d5419e98ac85d9238208d0'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:22.222925 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3665/7306] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:39:21 2022] DELETE /identity/v3/users/0ca3fcd6c8d5419e98ac85d9238208d0 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:22.222925 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11365cc0-21ad-4e1a-97b2-7ac0a049d230 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:22.224129 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-11365cc0-21ad-4e1a-97b2-7ac0a049d230 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:22.275318 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c725bf-f184-4d7a-a15d-b3c2a1363633 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:22.276843 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c725bf-f184-4d7a-a15d-b3c2a1363633 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:22.288084 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3642/7307] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:39:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:39:22.289380 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be71be1-6cfd-414d-a3e7-d309407502f3 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:22.289716 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be71be1-6cfd-414d-a3e7-d309407502f3 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:22.293776 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be71be1-6cfd-414d-a3e7-d309407502f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:22.317256 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-1be71be1-6cfd-414d-a3e7-d309407502f3 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:22.319433 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-1be71be1-6cfd-414d-a3e7-d309407502f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:22.352313 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11365cc0-21ad-4e1a-97b2-7ac0a049d230 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:22.357790 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d3b674-6035-44e5-b18d-1904575a3848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:22.358797 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3b674-6035-44e5-b18d-1904575a3848 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:22.359228 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3b674-6035-44e5-b18d-1904575a3848 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:22.359659 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3b674-6035-44e5-b18d-1904575a3848 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:22.360624 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d3b674-6035-44e5-b18d-1904575a3848 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:22.362346 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d3b674-6035-44e5-b18d-1904575a3848 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:22.378825 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3666/7308] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:39:22.380502 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97dec72-10af-48cf-8427-37812c9c4d1f None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:22.380900 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97dec72-10af-48cf-8427-37812c9c4d1f None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:22.381298 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97dec72-10af-48cf-8427-37812c9c4d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:22.401473 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3643/7309] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:39:22.404086 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be71be1-6cfd-414d-a3e7-d309407502f3 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:22.405448 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-1be71be1-6cfd-414d-a3e7-d309407502f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:22.421601 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-c97dec72-10af-48cf-8427-37812c9c4d1f None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:22.423586 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c97dec72-10af-48cf-8427-37812c9c4d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:22.442424 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3667/7310] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:39:22.445334 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97dec72-10af-48cf-8427-37812c9c4d1f None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:22.463092 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97dec72-10af-48cf-8427-37812c9c4d1f None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:22.475874 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b346ba1-d5f7-4e1d-ba30-54712a7e6707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:22.478799 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b346ba1-d5f7-4e1d-ba30-54712a7e6707 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:22.479230 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b346ba1-d5f7-4e1d-ba30-54712a7e6707 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:22.480518 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b346ba1-d5f7-4e1d-ba30-54712a7e6707 admin admin] PATH_INFO: `/v3/projects/adf6bd7cd9a040ff8723f40c96477b4c/users/982a918578d94fda9aeaa1109bb4e5c4/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:22.493791 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be71be1-6cfd-414d-a3e7-d309407502f3 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:22.500861 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73429229-b8d4-459d-933e-9cd39dd54aaf tempest-RoutersAdminTest-569830320 tempest-RoutersAdminTest-569830320-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d9e2a2058384d82aa49a1a053b286fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e340cdd735347b5b067a6861c828b68', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:22.503534 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73429229-b8d4-459d-933e-9cd39dd54aaf tempest-RoutersAdminTest-569830320 tempest-RoutersAdminTest-569830320-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:22.503534 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73429229-b8d4-459d-933e-9cd39dd54aaf tempest-RoutersAdminTest-569830320 tempest-RoutersAdminTest-569830320-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:22.503534 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73429229-b8d4-459d-933e-9cd39dd54aaf tempest-RoutersAdminTest-569830320 tempest-RoutersAdminTest-569830320-project-admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:22.503534 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73429229-b8d4-459d-933e-9cd39dd54aaf tempest-RoutersAdminTest-569830320 tempest-RoutersAdminTest-569830320-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:39:22.505671 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73429229-b8d4-459d-933e-9cd39dd54aaf tempest-RoutersAdminTest-569830320 tempest-RoutersAdminTest-569830320-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:22.506542 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73429229-b8d4-459d-933e-9cd39dd54aaf tempest-RoutersAdminTest-569830320 tempest-RoutersAdminTest-569830320-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:22.518518 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b346ba1-d5f7-4e1d-ba30-54712a7e6707 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adf6bd7cd9a040ff8723f40c96477b4c, user_id=982a918578d94fda9aeaa1109bb4e5c4, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:22.523236 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b346ba1-d5f7-4e1d-ba30-54712a7e6707 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:22.524793 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3644/7311] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:39:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:39:22.531317 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f21891-9fa3-455a-98c6-e09d2c45f3f4 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:22.532110 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f21891-9fa3-455a-98c6-e09d2c45f3f4 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:22.532403 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f21891-9fa3-455a-98c6-e09d2c45f3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:22.560852 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-21f21891-9fa3-455a-98c6-e09d2c45f3f4 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:22.562408 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-21f21891-9fa3-455a-98c6-e09d2c45f3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:22.580216 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3645/7312] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:39:22.581562 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f21891-9fa3-455a-98c6-e09d2c45f3f4 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:22.583110 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-21f21891-9fa3-455a-98c6-e09d2c45f3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:22.628800 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3668/7313] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:39:22 2022] PUT /identity/v3/projects/adf6bd7cd9a040ff8723f40c96477b4c/users/982a918578d94fda9aeaa1109bb4e5c4/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:22.629880 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b346ba1-d5f7-4e1d-ba30-54712a7e6707 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:22.674444 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f21891-9fa3-455a-98c6-e09d2c45f3f4 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:22.711106 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b346ba1-d5f7-4e1d-ba30-54712a7e6707 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:22.720550 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbe8abf-69f1-48cc-9108-9bfa28ec5df6 tempest-RoutersAdminTest-569830320 tempest-RoutersAdminTest-569830320-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d9e2a2058384d82aa49a1a053b286fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e340cdd735347b5b067a6861c828b68', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:22.721503 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe8abf-69f1-48cc-9108-9bfa28ec5df6 tempest-RoutersAdminTest-569830320 tempest-RoutersAdminTest-569830320-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:22.721913 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe8abf-69f1-48cc-9108-9bfa28ec5df6 tempest-RoutersAdminTest-569830320 tempest-RoutersAdminTest-569830320-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:22.722294 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe8abf-69f1-48cc-9108-9bfa28ec5df6 tempest-RoutersAdminTest-569830320 tempest-RoutersAdminTest-569830320-project-admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:22.723252 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbe8abf-69f1-48cc-9108-9bfa28ec5df6 tempest-RoutersAdminTest-569830320 tempest-RoutersAdminTest-569830320-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:22.729071 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbe8abf-69f1-48cc-9108-9bfa28ec5df6 tempest-RoutersAdminTest-569830320 tempest-RoutersAdminTest-569830320-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:22.739345 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7966070-4002-4c3d-8ae3-7b1604788005 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:22.744368 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7966070-4002-4c3d-8ae3-7b1604788005 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:22.744775 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7966070-4002-4c3d-8ae3-7b1604788005 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:22.745188 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7966070-4002-4c3d-8ae3-7b1604788005 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:22.845618 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3669/7314] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:39:22 2022] POST /identity/v3/projects => generated 348 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:39:22.846720 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbe8abf-69f1-48cc-9108-9bfa28ec5df6 tempest-RoutersAdminTest-569830320 tempest-RoutersAdminTest-569830320-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:22.853730 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7966070-4002-4c3d-8ae3-7b1604788005 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:22.857311 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7966070-4002-4c3d-8ae3-7b1604788005 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:22.881492 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3646/7315] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:39:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:39:22.883208 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5ff2f-69c9-4f80-aa12-a28a8b723162 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:22.887771 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5ff2f-69c9-4f80-aa12-a28a8b723162 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:22.888476 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5ff2f-69c9-4f80-aa12-a28a8b723162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:22.959880 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-abb5ff2f-69c9-4f80-aa12-a28a8b723162 None None] MFA Rules not processed for user `982a918578d94fda9aeaa1109bb4e5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:22.961484 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-abb5ff2f-69c9-4f80-aa12-a28a8b723162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:23.023694 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbe8abf-69f1-48cc-9108-9bfa28ec5df6 tempest-RoutersAdminTest-569830320 tempest-RoutersAdminTest-569830320-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:23.037959 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b019391b-f320-4e7b-90c2-1c8b36d5fd22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:23.040078 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b019391b-f320-4e7b-90c2-1c8b36d5fd22 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:23.040078 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b019391b-f320-4e7b-90c2-1c8b36d5fd22 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:23.040078 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b019391b-f320-4e7b-90c2-1c8b36d5fd22 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:23.040717 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b019391b-f320-4e7b-90c2-1c8b36d5fd22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:39:23.041032 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b019391b-f320-4e7b-90c2-1c8b36d5fd22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:23.042759 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b019391b-f320-4e7b-90c2-1c8b36d5fd22 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:23.064022 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3670/7316] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:39:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:39:23.064022 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b019391b-f320-4e7b-90c2-1c8b36d5fd22 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:23.070581 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3647/7317] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:39:23.076420 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb5ff2f-69c9-4f80-aa12-a28a8b723162 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:23.077813 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-abb5ff2f-69c9-4f80-aa12-a28a8b723162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:23.092207 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb5ff2f-69c9-4f80-aa12-a28a8b723162 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:23.098108 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de42b4e-f1f0-4669-8207-b1b417027e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:23.099011 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de42b4e-f1f0-4669-8207-b1b417027e51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:23.099283 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de42b4e-f1f0-4669-8207-b1b417027e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:23.099617 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de42b4e-f1f0-4669-8207-b1b417027e51 admin admin] PATH_INFO: `/v3/users/0fbfc456f35f40f7b068b0afbfb49633` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:23.100847 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de42b4e-f1f0-4669-8207-b1b417027e51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fbfc456f35f40f7b068b0afbfb49633)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:23.102800 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de42b4e-f1f0-4669-8207-b1b417027e51 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:23.156988 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b019391b-f320-4e7b-90c2-1c8b36d5fd22 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:23.173997 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1594fcfc-a8ca-45f6-8ddb-712cd8c1c608 tempest-RoutersAdminTest-569830320 tempest-RoutersAdminTest-569830320-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d9e2a2058384d82aa49a1a053b286fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e340cdd735347b5b067a6861c828b68', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:23.174814 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594fcfc-a8ca-45f6-8ddb-712cd8c1c608 tempest-RoutersAdminTest-569830320 tempest-RoutersAdminTest-569830320-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:23.175106 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594fcfc-a8ca-45f6-8ddb-712cd8c1c608 tempest-RoutersAdminTest-569830320 tempest-RoutersAdminTest-569830320-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:23.175526 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594fcfc-a8ca-45f6-8ddb-712cd8c1c608 tempest-RoutersAdminTest-569830320 tempest-RoutersAdminTest-569830320-project-admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:23.176193 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1594fcfc-a8ca-45f6-8ddb-712cd8c1c608 tempest-RoutersAdminTest-569830320 tempest-RoutersAdminTest-569830320-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:39:23.176548 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1594fcfc-a8ca-45f6-8ddb-712cd8c1c608 tempest-RoutersAdminTest-569830320 tempest-RoutersAdminTest-569830320-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:23.178259 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1594fcfc-a8ca-45f6-8ddb-712cd8c1c608 tempest-RoutersAdminTest-569830320 tempest-RoutersAdminTest-569830320-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:23.192114 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3671/7318] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:39:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:39:23.192981 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1594fcfc-a8ca-45f6-8ddb-712cd8c1c608 tempest-RoutersAdminTest-569830320 tempest-RoutersAdminTest-569830320-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:23.207381 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1594fcfc-a8ca-45f6-8ddb-712cd8c1c608 tempest-RoutersAdminTest-569830320 tempest-RoutersAdminTest-569830320-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:23.212496 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94889960-c137-4ae2-a243-add84d5afe34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:23.217295 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94889960-c137-4ae2-a243-add84d5afe34 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:23.217295 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94889960-c137-4ae2-a243-add84d5afe34 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:23.217295 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94889960-c137-4ae2-a243-add84d5afe34 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:23.217295 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94889960-c137-4ae2-a243-add84d5afe34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:23.217295 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94889960-c137-4ae2-a243-add84d5afe34 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:23.321711 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-1de42b4e-f1f0-4669-8207-b1b417027e51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fbfc456f35f40f7b068b0afbfb49633'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:23.331247 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-1de42b4e-f1f0-4669-8207-b1b417027e51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fbfc456f35f40f7b068b0afbfb49633'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:23.332067 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-1de42b4e-f1f0-4669-8207-b1b417027e51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fbfc456f35f40f7b068b0afbfb49633'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:23.354558 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3672/7319] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:39:23 2022] POST /identity/v3/projects => generated 365 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:39:23.356481 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94889960-c137-4ae2-a243-add84d5afe34 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:23.407535 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-1de42b4e-f1f0-4669-8207-b1b417027e51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fbfc456f35f40f7b068b0afbfb49633'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:23.430881 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-1de42b4e-f1f0-4669-8207-b1b417027e51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fbfc456f35f40f7b068b0afbfb49633'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:23.435385 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94889960-c137-4ae2-a243-add84d5afe34 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:23.439589 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa7df69-33fe-41cc-8be7-4f8797f94ec3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:23.440255 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa7df69-33fe-41cc-8be7-4f8797f94ec3 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:23.440386 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3648/7320] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:39:23 2022] DELETE /identity/v3/users/0fbfc456f35f40f7b068b0afbfb49633 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:23.441354 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de42b4e-f1f0-4669-8207-b1b417027e51 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:23.443235 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-1de42b4e-f1f0-4669-8207-b1b417027e51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:23.443511 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa7df69-33fe-41cc-8be7-4f8797f94ec3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:23.443866 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa7df69-33fe-41cc-8be7-4f8797f94ec3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:23.446256 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-cfa7df69-33fe-41cc-8be7-4f8797f94ec3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:23.523982 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa7df69-33fe-41cc-8be7-4f8797f94ec3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:23.525327 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa7df69-33fe-41cc-8be7-4f8797f94ec3 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:23.530115 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de42b4e-f1f0-4669-8207-b1b417027e51 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:23.535025 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf42e03-7992-401e-abe8-b37b6c5df19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:23.535168 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3673/7321] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:39:23 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:39:23.535934 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa7df69-33fe-41cc-8be7-4f8797f94ec3 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:23.536082 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf42e03-7992-401e-abe8-b37b6c5df19a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:23.536344 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf42e03-7992-401e-abe8-b37b6c5df19a admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:23.536592 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf42e03-7992-401e-abe8-b37b6c5df19a admin admin] PATH_INFO: `/v3/projects/e5d48ff84fbd4ab8a02d5a7625b46749` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:23.537229 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-cfa7df69-33fe-41cc-8be7-4f8797f94ec3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:23.538111 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf42e03-7992-401e-abe8-b37b6c5df19a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5d48ff84fbd4ab8a02d5a7625b46749)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:23.546563 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf42e03-7992-401e-abe8-b37b6c5df19a admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:23.618600 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa7df69-33fe-41cc-8be7-4f8797f94ec3 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:23.624857 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41635e2a-61e7-49f6-a594-98070faf5f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:23.625562 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41635e2a-61e7-49f6-a594-98070faf5f74 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:23.625836 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41635e2a-61e7-49f6-a594-98070faf5f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:23.626109 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41635e2a-61e7-49f6-a594-98070faf5f74 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:23.626789 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41635e2a-61e7-49f6-a594-98070faf5f74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:23.629008 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41635e2a-61e7-49f6-a594-98070faf5f74 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:23.688014 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-edf42e03-7992-401e-abe8-b37b6c5df19a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5d48ff84fbd4ab8a02d5a7625b46749', 'request_id': 'req-edf42e03-7992-401e-abe8-b37b6c5df19a'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:23.694501 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-edf42e03-7992-401e-abe8-b37b6c5df19a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5d48ff84fbd4ab8a02d5a7625b46749', 'request_id': 'req-edf42e03-7992-401e-abe8-b37b6c5df19a'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:23.703025 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-edf42e03-7992-401e-abe8-b37b6c5df19a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5d48ff84fbd4ab8a02d5a7625b46749', 'request_id': 'req-edf42e03-7992-401e-abe8-b37b6c5df19a'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:23.718020 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3674/7322] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:39:23 2022] POST /identity/v3/users => generated 283 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:39:23.719576 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411aee49-d28a-49dd-bafd-bd2db84c294d None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:23.719868 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411aee49-d28a-49dd-bafd-bd2db84c294d None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:23.720196 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411aee49-d28a-49dd-bafd-bd2db84c294d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:23.740836 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-411aee49-d28a-49dd-bafd-bd2db84c294d None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:23.742110 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-411aee49-d28a-49dd-bafd-bd2db84c294d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:23.800953 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-edf42e03-7992-401e-abe8-b37b6c5df19a admin admin] The token cache is being invalidate because project e5d48ff84fbd4ab8a02d5a7625b46749 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:39:23.801272 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-edf42e03-7992-401e-abe8-b37b6c5df19a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:23.802743 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-edf42e03-7992-401e-abe8-b37b6c5df19a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:23.807555 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3649/7323] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:39:23 2022] DELETE /identity/v3/projects/e5d48ff84fbd4ab8a02d5a7625b46749 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:23.807555 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf42e03-7992-401e-abe8-b37b6c5df19a admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:23.807555 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-edf42e03-7992-401e-abe8-b37b6c5df19a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:23.836767 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3675/7324] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:39:23.837694 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411aee49-d28a-49dd-bafd-bd2db84c294d None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:23.839735 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-411aee49-d28a-49dd-bafd-bd2db84c294d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:23.854189 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411aee49-d28a-49dd-bafd-bd2db84c294d None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:23.860540 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0a897c-714c-4ee4-986e-d5aa70aa2f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:23.861591 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a897c-714c-4ee4-986e-d5aa70aa2f5a admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:23.862013 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a897c-714c-4ee4-986e-d5aa70aa2f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:23.862434 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a897c-714c-4ee4-986e-d5aa70aa2f5a admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:23.863704 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0a897c-714c-4ee4-986e-d5aa70aa2f5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:23.865594 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0a897c-714c-4ee4-986e-d5aa70aa2f5a admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:23.891869 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3676/7325] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:39:23 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:39:23.891869 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0a897c-714c-4ee4-986e-d5aa70aa2f5a admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:23.892620 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-fd0a897c-714c-4ee4-986e-d5aa70aa2f5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:23.897420 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf42e03-7992-401e-abe8-b37b6c5df19a admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:23.904323 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc4eeee-7c91-4479-8587-4ced67865ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:23.905455 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4eeee-7c91-4479-8587-4ced67865ca2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:23.906189 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4eeee-7c91-4479-8587-4ced67865ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:23.906658 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4eeee-7c91-4479-8587-4ced67865ca2 admin admin] PATH_INFO: `/v3/projects/3b15386d4c844f8095e31b707fc80d49` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:23.908274 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc4eeee-7c91-4479-8587-4ced67865ca2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b15386d4c844f8095e31b707fc80d49)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:23.910603 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc4eeee-7c91-4479-8587-4ced67865ca2 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:23.913177 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0a897c-714c-4ee4-986e-d5aa70aa2f5a admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:23.919036 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89338d74-7e2e-43e9-ab1a-39848d116063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:23.920214 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89338d74-7e2e-43e9-ab1a-39848d116063 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:23.920556 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89338d74-7e2e-43e9-ab1a-39848d116063 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:23.921034 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89338d74-7e2e-43e9-ab1a-39848d116063 admin admin] PATH_INFO: `/v3/users/dea32a55f941428a8352be49482b5891` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:23.923124 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89338d74-7e2e-43e9-ab1a-39848d116063 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dea32a55f941428a8352be49482b5891)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:23.925006 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89338d74-7e2e-43e9-ab1a-39848d116063 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:24.042281 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-cdc4eeee-7c91-4479-8587-4ced67865ca2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b15386d4c844f8095e31b707fc80d49', 'request_id': 'req-cdc4eeee-7c91-4479-8587-4ced67865ca2'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:24.048700 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-cdc4eeee-7c91-4479-8587-4ced67865ca2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b15386d4c844f8095e31b707fc80d49', 'request_id': 'req-cdc4eeee-7c91-4479-8587-4ced67865ca2'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:24.055678 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-cdc4eeee-7c91-4479-8587-4ced67865ca2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b15386d4c844f8095e31b707fc80d49', 'request_id': 'req-cdc4eeee-7c91-4479-8587-4ced67865ca2'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:24.172695 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-cdc4eeee-7c91-4479-8587-4ced67865ca2 admin admin] The token cache is being invalidate because project 3b15386d4c844f8095e31b707fc80d49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:39:24.173209 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-cdc4eeee-7c91-4479-8587-4ced67865ca2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:24.174540 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-cdc4eeee-7c91-4479-8587-4ced67865ca2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:24.177509 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3650/7326] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:39:23 2022] DELETE /identity/v3/projects/3b15386d4c844f8095e31b707fc80d49 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:24.178580 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc4eeee-7c91-4479-8587-4ced67865ca2 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:24.191369 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-cdc4eeee-7c91-4479-8587-4ced67865ca2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:24.240638 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-89338d74-7e2e-43e9-ab1a-39848d116063 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dea32a55f941428a8352be49482b5891'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:24.257240 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-89338d74-7e2e-43e9-ab1a-39848d116063 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dea32a55f941428a8352be49482b5891'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:24.262779 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc4eeee-7c91-4479-8587-4ced67865ca2 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:24.266829 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fced8584-ca6b-41fb-8aea-46b1f3310f42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:24.267494 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fced8584-ca6b-41fb-8aea-46b1f3310f42 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:24.267897 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fced8584-ca6b-41fb-8aea-46b1f3310f42 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:24.268177 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fced8584-ca6b-41fb-8aea-46b1f3310f42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:24.269212 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-89338d74-7e2e-43e9-ab1a-39848d116063 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dea32a55f941428a8352be49482b5891'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:24.270601 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-fced8584-ca6b-41fb-8aea-46b1f3310f42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:24.335732 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-89338d74-7e2e-43e9-ab1a-39848d116063 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dea32a55f941428a8352be49482b5891'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:24.336399 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-89338d74-7e2e-43e9-ab1a-39848d116063 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dea32a55f941428a8352be49482b5891'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:24.342007 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fced8584-ca6b-41fb-8aea-46b1f3310f42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:24.343508 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fced8584-ca6b-41fb-8aea-46b1f3310f42 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:24.345230 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3677/7327] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:39:23 2022] DELETE /identity/v3/users/dea32a55f941428a8352be49482b5891 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:24.345955 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89338d74-7e2e-43e9-ab1a-39848d116063 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:24.347306 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-89338d74-7e2e-43e9-ab1a-39848d116063 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:24.358378 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3651/7328] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:39:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:39:24.359927 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fced8584-ca6b-41fb-8aea-46b1f3310f42 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:24.360646 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-fced8584-ca6b-41fb-8aea-46b1f3310f42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:24.431713 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89338d74-7e2e-43e9-ab1a-39848d116063 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:24.436231 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fced8584-ca6b-41fb-8aea-46b1f3310f42 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:24.438794 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21168bd7-5a56-47ea-a231-770fada8131d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:24.439304 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21168bd7-5a56-47ea-a231-770fada8131d admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:24.439702 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21168bd7-5a56-47ea-a231-770fada8131d admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:24.439992 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21168bd7-5a56-47ea-a231-770fada8131d admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:24.441162 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21168bd7-5a56-47ea-a231-770fada8131d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:24.443216 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21168bd7-5a56-47ea-a231-770fada8131d admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:24.457068 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3678/7329] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:39:24 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:39:24.458011 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21168bd7-5a56-47ea-a231-770fada8131d admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:24.460240 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-21168bd7-5a56-47ea-a231-770fada8131d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:24.478126 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21168bd7-5a56-47ea-a231-770fada8131d admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:24.484026 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603e0e4c-5300-4ad4-9b62-cff6c96016b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:24.484908 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e0e4c-5300-4ad4-9b62-cff6c96016b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:24.485398 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e0e4c-5300-4ad4-9b62-cff6c96016b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:24.485678 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e0e4c-5300-4ad4-9b62-cff6c96016b3 admin admin] PATH_INFO: `/v3/users/f696e3080988457a9bb7d3d6acc8771c` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:24.487184 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603e0e4c-5300-4ad4-9b62-cff6c96016b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f696e3080988457a9bb7d3d6acc8771c)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:24.489178 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603e0e4c-5300-4ad4-9b62-cff6c96016b3 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:24.502272 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862e16bd-ac0d-438e-b92d-8d03073c1c96 tempest-RoutersAdminTest-569830320 tempest-RoutersAdminTest-569830320-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d9e2a2058384d82aa49a1a053b286fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e340cdd735347b5b067a6861c828b68', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:24.503147 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e16bd-ac0d-438e-b92d-8d03073c1c96 tempest-RoutersAdminTest-569830320 tempest-RoutersAdminTest-569830320-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:24.503433 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e16bd-ac0d-438e-b92d-8d03073c1c96 tempest-RoutersAdminTest-569830320 tempest-RoutersAdminTest-569830320-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:24.503745 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e16bd-ac0d-438e-b92d-8d03073c1c96 tempest-RoutersAdminTest-569830320 tempest-RoutersAdminTest-569830320-project-admin] PATH_INFO: `/v3/projects/2e9fea6469c94f14a14f0b93f989148f` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:24.505009 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862e16bd-ac0d-438e-b92d-8d03073c1c96 tempest-RoutersAdminTest-569830320 tempest-RoutersAdminTest-569830320-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2e9fea6469c94f14a14f0b93f989148f)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:24.507112 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862e16bd-ac0d-438e-b92d-8d03073c1c96 tempest-RoutersAdminTest-569830320 tempest-RoutersAdminTest-569830320-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:24.645307 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-862e16bd-ac0d-438e-b92d-8d03073c1c96 tempest-RoutersAdminTest-569830320 tempest-RoutersAdminTest-569830320-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e9fea6469c94f14a14f0b93f989148f', 'request_id': 'req-862e16bd-ac0d-438e-b92d-8d03073c1c96'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:24.661257 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-862e16bd-ac0d-438e-b92d-8d03073c1c96 tempest-RoutersAdminTest-569830320 tempest-RoutersAdminTest-569830320-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e9fea6469c94f14a14f0b93f989148f', 'request_id': 'req-862e16bd-ac0d-438e-b92d-8d03073c1c96'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:24.668044 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-862e16bd-ac0d-438e-b92d-8d03073c1c96 tempest-RoutersAdminTest-569830320 tempest-RoutersAdminTest-569830320-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e9fea6469c94f14a14f0b93f989148f', 'request_id': 'req-862e16bd-ac0d-438e-b92d-8d03073c1c96'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:24.723870 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-603e0e4c-5300-4ad4-9b62-cff6c96016b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f696e3080988457a9bb7d3d6acc8771c'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:24.737094 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-603e0e4c-5300-4ad4-9b62-cff6c96016b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f696e3080988457a9bb7d3d6acc8771c'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:24.744261 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-603e0e4c-5300-4ad4-9b62-cff6c96016b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f696e3080988457a9bb7d3d6acc8771c'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:24.758036 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-862e16bd-ac0d-438e-b92d-8d03073c1c96 tempest-RoutersAdminTest-569830320 tempest-RoutersAdminTest-569830320-project-admin] The token cache is being invalidate because project 2e9fea6469c94f14a14f0b93f989148f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:39:24.758355 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-862e16bd-ac0d-438e-b92d-8d03073c1c96 tempest-RoutersAdminTest-569830320 tempest-RoutersAdminTest-569830320-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:24.759125 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-862e16bd-ac0d-438e-b92d-8d03073c1c96 tempest-RoutersAdminTest-569830320 tempest-RoutersAdminTest-569830320-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:24.760983 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3652/7330] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:39:24 2022] DELETE /identity/v3/projects/2e9fea6469c94f14a14f0b93f989148f => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:24.762084 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862e16bd-ac0d-438e-b92d-8d03073c1c96 tempest-RoutersAdminTest-569830320 tempest-RoutersAdminTest-569830320-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:24.765195 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-862e16bd-ac0d-438e-b92d-8d03073c1c96 tempest-RoutersAdminTest-569830320 tempest-RoutersAdminTest-569830320-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:24.810879 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-603e0e4c-5300-4ad4-9b62-cff6c96016b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f696e3080988457a9bb7d3d6acc8771c'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:24.813876 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-603e0e4c-5300-4ad4-9b62-cff6c96016b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f696e3080988457a9bb7d3d6acc8771c'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:24.823184 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3679/7331] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:39:24 2022] DELETE /identity/v3/users/f696e3080988457a9bb7d3d6acc8771c => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:24.825098 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603e0e4c-5300-4ad4-9b62-cff6c96016b3 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:24.827140 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-603e0e4c-5300-4ad4-9b62-cff6c96016b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:24.877943 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862e16bd-ac0d-438e-b92d-8d03073c1c96 tempest-RoutersAdminTest-569830320 tempest-RoutersAdminTest-569830320-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:24.931337 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603e0e4c-5300-4ad4-9b62-cff6c96016b3 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:24.936052 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b295b4-885d-4c87-9645-fdffd3f1a185 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:24.936869 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b295b4-885d-4c87-9645-fdffd3f1a185 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:24.937159 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b295b4-885d-4c87-9645-fdffd3f1a185 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:24.937434 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b295b4-885d-4c87-9645-fdffd3f1a185 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:24.940255 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-f9b295b4-885d-4c87-9645-fdffd3f1a185 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:24.960614 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a32f4a-043b-4b2c-8cc2-58d8d512572a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:24.961914 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a32f4a-043b-4b2c-8cc2-58d8d512572a admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:24.962602 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a32f4a-043b-4b2c-8cc2-58d8d512572a admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:24.963742 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a32f4a-043b-4b2c-8cc2-58d8d512572a admin admin] PATH_INFO: `/v3/projects/fc5e9af9c7e8412bb65f622d3a7c7469/users/47adf895a9d34d8a8293d07537b98c31/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:24.990706 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a32f4a-043b-4b2c-8cc2-58d8d512572a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc5e9af9c7e8412bb65f622d3a7c7469, user_id=47adf895a9d34d8a8293d07537b98c31, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:24.993502 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a32f4a-043b-4b2c-8cc2-58d8d512572a admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:25.012339 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b295b4-885d-4c87-9645-fdffd3f1a185 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:25.014086 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b295b4-885d-4c87-9645-fdffd3f1a185 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:25.025202 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3680/7332] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:39:24 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:39:25.025673 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b295b4-885d-4c87-9645-fdffd3f1a185 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:25.027824 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-f9b295b4-885d-4c87-9645-fdffd3f1a185 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:25.044774 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b295b4-885d-4c87-9645-fdffd3f1a185 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:25.062111 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2acf6c5-5f07-47a4-91ce-05e9dc03ca3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:25.062111 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2acf6c5-5f07-47a4-91ce-05e9dc03ca3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:25.062111 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2acf6c5-5f07-47a4-91ce-05e9dc03ca3d admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:25.062405 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2acf6c5-5f07-47a4-91ce-05e9dc03ca3d admin admin] PATH_INFO: `/v3/projects/ab1bf1d2539f466380bc3034441cd2e5` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:25.063794 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2acf6c5-5f07-47a4-91ce-05e9dc03ca3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab1bf1d2539f466380bc3034441cd2e5)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:25.067832 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2acf6c5-5f07-47a4-91ce-05e9dc03ca3d admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:25.089562 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3653/7333] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:39:24 2022] PUT /identity/v3/projects/fc5e9af9c7e8412bb65f622d3a7c7469/users/47adf895a9d34d8a8293d07537b98c31/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:25.100928 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a1de5-7866-4540-8863-ec722953a75d None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:25.101226 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a1de5-7866-4540-8863-ec722953a75d None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:25.101823 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a1de5-7866-4540-8863-ec722953a75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:25.134860 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-086a1de5-7866-4540-8863-ec722953a75d None None] MFA Rules not processed for user `47adf895a9d34d8a8293d07537b98c31`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:25.137142 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-086a1de5-7866-4540-8863-ec722953a75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:25.220554 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3654/7334] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:25 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:39:25.225472 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086a1de5-7866-4540-8863-ec722953a75d None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:25.227041 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-086a1de5-7866-4540-8863-ec722953a75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:25.255098 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e2acf6c5-5f07-47a4-91ce-05e9dc03ca3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab1bf1d2539f466380bc3034441cd2e5', 'request_id': 'req-e2acf6c5-5f07-47a4-91ce-05e9dc03ca3d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:25.265332 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e2acf6c5-5f07-47a4-91ce-05e9dc03ca3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab1bf1d2539f466380bc3034441cd2e5', 'request_id': 'req-e2acf6c5-5f07-47a4-91ce-05e9dc03ca3d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:25.303621 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086a1de5-7866-4540-8863-ec722953a75d None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:25.365861 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e2acf6c5-5f07-47a4-91ce-05e9dc03ca3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab1bf1d2539f466380bc3034441cd2e5', 'request_id': 'req-e2acf6c5-5f07-47a4-91ce-05e9dc03ca3d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:25.387216 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee2cd6-86f1-4078-bc2e-a1d3a0b88c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:25.389825 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee2cd6-86f1-4078-bc2e-a1d3a0b88c9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:25.392419 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee2cd6-86f1-4078-bc2e-a1d3a0b88c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:25.392829 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee2cd6-86f1-4078-bc2e-a1d3a0b88c9a admin admin] PATH_INFO: `/v3/projects/74928faf25b04ff1ad55aeed69b6d573` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:25.394402 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cee2cd6-86f1-4078-bc2e-a1d3a0b88c9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=74928faf25b04ff1ad55aeed69b6d573)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:25.400020 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e2acf6c5-5f07-47a4-91ce-05e9dc03ca3d admin admin] The token cache is being invalidate because project ab1bf1d2539f466380bc3034441cd2e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:39:25.400867 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cee2cd6-86f1-4078-bc2e-a1d3a0b88c9a admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:25.402978 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e2acf6c5-5f07-47a4-91ce-05e9dc03ca3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:25.405361 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e2acf6c5-5f07-47a4-91ce-05e9dc03ca3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:25.412501 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3681/7335] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:39:25 2022] DELETE /identity/v3/projects/ab1bf1d2539f466380bc3034441cd2e5 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:25.413584 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2acf6c5-5f07-47a4-91ce-05e9dc03ca3d admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:25.415984 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e2acf6c5-5f07-47a4-91ce-05e9dc03ca3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:25.433369 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2acf6c5-5f07-47a4-91ce-05e9dc03ca3d admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:25.449921 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0575e6a1-975e-4c8b-a465-07375c828890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:25.451552 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575e6a1-975e-4c8b-a465-07375c828890 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:25.451973 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575e6a1-975e-4c8b-a465-07375c828890 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:25.452332 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575e6a1-975e-4c8b-a465-07375c828890 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:25.455707 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0575e6a1-975e-4c8b-a465-07375c828890 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:25.455707 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0575e6a1-975e-4c8b-a465-07375c828890 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:25.540008 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4cee2cd6-86f1-4078-bc2e-a1d3a0b88c9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74928faf25b04ff1ad55aeed69b6d573', 'request_id': 'req-4cee2cd6-86f1-4078-bc2e-a1d3a0b88c9a'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:25.547721 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4cee2cd6-86f1-4078-bc2e-a1d3a0b88c9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74928faf25b04ff1ad55aeed69b6d573', 'request_id': 'req-4cee2cd6-86f1-4078-bc2e-a1d3a0b88c9a'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:25.563557 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4cee2cd6-86f1-4078-bc2e-a1d3a0b88c9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74928faf25b04ff1ad55aeed69b6d573', 'request_id': 'req-4cee2cd6-86f1-4078-bc2e-a1d3a0b88c9a'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:25.573065 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3682/7336] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:39:25 2022] POST /identity/v3/projects => generated 363 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:39:25.577657 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592bea73-a654-474f-90a9-2896ef59f8ad None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:25.577956 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592bea73-a654-474f-90a9-2896ef59f8ad None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:25.578255 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592bea73-a654-474f-90a9-2896ef59f8ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:25.597183 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-592bea73-a654-474f-90a9-2896ef59f8ad None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:25.598349 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-592bea73-a654-474f-90a9-2896ef59f8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:25.665340 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3683/7337] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:39:25.666179 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592bea73-a654-474f-90a9-2896ef59f8ad None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:25.675840 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4cee2cd6-86f1-4078-bc2e-a1d3a0b88c9a admin admin] The token cache is being invalidate because project 74928faf25b04ff1ad55aeed69b6d573 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:39:25.676358 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4cee2cd6-86f1-4078-bc2e-a1d3a0b88c9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:25.676909 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592bea73-a654-474f-90a9-2896ef59f8ad None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:25.677070 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4cee2cd6-86f1-4078-bc2e-a1d3a0b88c9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:25.678807 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3655/7338] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:39:25 2022] DELETE /identity/v3/projects/74928faf25b04ff1ad55aeed69b6d573 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:25.681153 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2490289-4a49-405e-85f8-cf9f1b3a6440 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:25.681510 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2490289-4a49-405e-85f8-cf9f1b3a6440 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:25.681814 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaa7254-18df-4bbd-b8aa-8ec2d7b4268e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:25.681956 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2490289-4a49-405e-85f8-cf9f1b3a6440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:25.682494 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa7254-18df-4bbd-b8aa-8ec2d7b4268e admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:25.682773 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa7254-18df-4bbd-b8aa-8ec2d7b4268e admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:25.683048 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa7254-18df-4bbd-b8aa-8ec2d7b4268e admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:25.684030 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaa7254-18df-4bbd-b8aa-8ec2d7b4268e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:25.685952 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaa7254-18df-4bbd-b8aa-8ec2d7b4268e admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:25.705139 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-f2490289-4a49-405e-85f8-cf9f1b3a6440 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:25.706574 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-f2490289-4a49-405e-85f8-cf9f1b3a6440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:25.715637 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3656/7339] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:39:25.716699 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae77baa-60b4-4498-b806-24f197647b27 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:25.716982 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae77baa-60b4-4498-b806-24f197647b27 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:25.717955 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae77baa-60b4-4498-b806-24f197647b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:25.735730 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-7ae77baa-60b4-4498-b806-24f197647b27 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:25.737912 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-7ae77baa-60b4-4498-b806-24f197647b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:25.755760 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3657/7340] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:39:25.755760 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae77baa-60b4-4498-b806-24f197647b27 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:25.764106 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae77baa-60b4-4498-b806-24f197647b27 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:25.778084 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e5a685-be7c-4629-bbb3-349c3158dcb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:25.778084 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5a685-be7c-4629-bbb3-349c3158dcb0 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:25.778084 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5a685-be7c-4629-bbb3-349c3158dcb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:25.778084 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5a685-be7c-4629-bbb3-349c3158dcb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:25.778376 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e5a685-be7c-4629-bbb3-349c3158dcb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:39:25.778376 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e5a685-be7c-4629-bbb3-349c3158dcb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:25.779882 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e5a685-be7c-4629-bbb3-349c3158dcb0 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:25.800123 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3658/7341] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:39:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:39:25.802016 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e3b6f-ecc3-42a8-9758-b9c5f255cf98 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:25.802447 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e3b6f-ecc3-42a8-9758-b9c5f255cf98 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:25.802867 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e3b6f-ecc3-42a8-9758-b9c5f255cf98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:25.820227 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3684/7342] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:39:25 2022] POST /identity/v3/users => generated 288 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:39:25.821796 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaa7254-18df-4bbd-b8aa-8ec2d7b4268e admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:25.825439 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-bbaa7254-18df-4bbd-b8aa-8ec2d7b4268e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:25.836554 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-c61e3b6f-ecc3-42a8-9758-b9c5f255cf98 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:25.838045 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c61e3b6f-ecc3-42a8-9758-b9c5f255cf98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:25.844488 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaa7254-18df-4bbd-b8aa-8ec2d7b4268e admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:25.852636 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3659/7343] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:39:25.852636 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61e3b6f-ecc3-42a8-9758-b9c5f255cf98 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:25.853979 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aec428-3087-493c-bf8b-e3626461f91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:25.855197 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aec428-3087-493c-bf8b-e3626461f91a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:25.855725 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aec428-3087-493c-bf8b-e3626461f91a admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:25.856152 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aec428-3087-493c-bf8b-e3626461f91a admin admin] PATH_INFO: `/v3/projects/c9c1ef9171d440acbbc392a702621341` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:25.859030 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aec428-3087-493c-bf8b-e3626461f91a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9c1ef9171d440acbbc392a702621341)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:25.862364 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aec428-3087-493c-bf8b-e3626461f91a admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:25.877434 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61e3b6f-ecc3-42a8-9758-b9c5f255cf98 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:25.883301 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb69bd7d-7517-4f4e-b442-7bcd38dacfb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:25.884305 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69bd7d-7517-4f4e-b442-7bcd38dacfb3 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:25.884695 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69bd7d-7517-4f4e-b442-7bcd38dacfb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:25.885225 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69bd7d-7517-4f4e-b442-7bcd38dacfb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:25.886024 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb69bd7d-7517-4f4e-b442-7bcd38dacfb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:25.888928 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb69bd7d-7517-4f4e-b442-7bcd38dacfb3 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:26.026205 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-40aec428-3087-493c-bf8b-e3626461f91a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9c1ef9171d440acbbc392a702621341', 'request_id': 'req-40aec428-3087-493c-bf8b-e3626461f91a'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:26.032043 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-40aec428-3087-493c-bf8b-e3626461f91a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9c1ef9171d440acbbc392a702621341', 'request_id': 'req-40aec428-3087-493c-bf8b-e3626461f91a'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:26.059699 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3660/7344] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:39:25 2022] POST /identity/v3/projects => generated 367 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:39:26.059699 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb69bd7d-7517-4f4e-b442-7bcd38dacfb3 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:26.061297 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-eb69bd7d-7517-4f4e-b442-7bcd38dacfb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:26.133190 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb69bd7d-7517-4f4e-b442-7bcd38dacfb3 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:26.140503 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf851d5-724f-4d09-9ef3-8fe83efc707b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:26.141193 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf851d5-724f-4d09-9ef3-8fe83efc707b admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:26.141482 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf851d5-724f-4d09-9ef3-8fe83efc707b admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:26.141757 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf851d5-724f-4d09-9ef3-8fe83efc707b admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:26.142594 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf851d5-724f-4d09-9ef3-8fe83efc707b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:26.144177 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf851d5-724f-4d09-9ef3-8fe83efc707b admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:26.157507 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3661/7345] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:39:26 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:39:26.158442 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf851d5-724f-4d09-9ef3-8fe83efc707b admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:26.172074 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf851d5-724f-4d09-9ef3-8fe83efc707b admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:26.176982 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b480316b-9113-4df4-b1b3-588b841a0390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:26.177770 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b480316b-9113-4df4-b1b3-588b841a0390 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:26.178128 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b480316b-9113-4df4-b1b3-588b841a0390 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:26.178757 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b480316b-9113-4df4-b1b3-588b841a0390 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:26.179264 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b480316b-9113-4df4-b1b3-588b841a0390 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:39:26.179673 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b480316b-9113-4df4-b1b3-588b841a0390 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:26.181767 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b480316b-9113-4df4-b1b3-588b841a0390 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:26.195599 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-40aec428-3087-493c-bf8b-e3626461f91a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9c1ef9171d440acbbc392a702621341', 'request_id': 'req-40aec428-3087-493c-bf8b-e3626461f91a'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:26.200065 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3662/7346] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:39:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:39:26.200065 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b480316b-9113-4df4-b1b3-588b841a0390 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:26.210242 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-40aec428-3087-493c-bf8b-e3626461f91a admin admin] The token cache is being invalidate because project c9c1ef9171d440acbbc392a702621341 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:39:26.210529 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-40aec428-3087-493c-bf8b-e3626461f91a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:26.210925 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b480316b-9113-4df4-b1b3-588b841a0390 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:26.211412 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-40aec428-3087-493c-bf8b-e3626461f91a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:26.213019 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3685/7347] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:39:25 2022] DELETE /identity/v3/projects/c9c1ef9171d440acbbc392a702621341 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:26.217087 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065ebe73-a83c-4912-b919-890db9e9c4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:26.217287 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aec428-3087-493c-bf8b-e3626461f91a admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:26.218002 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ebe73-a83c-4912-b919-890db9e9c4af admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:26.218381 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ebe73-a83c-4912-b919-890db9e9c4af admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:26.218477 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-40aec428-3087-493c-bf8b-e3626461f91a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:26.218858 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ebe73-a83c-4912-b919-890db9e9c4af admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:26.219720 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065ebe73-a83c-4912-b919-890db9e9c4af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:26.221846 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065ebe73-a83c-4912-b919-890db9e9c4af admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:26.282365 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aec428-3087-493c-bf8b-e3626461f91a admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:26.288180 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26fe15f-0786-468d-89d5-300b87629472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:26.289065 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26fe15f-0786-468d-89d5-300b87629472 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:26.289349 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26fe15f-0786-468d-89d5-300b87629472 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:26.289620 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26fe15f-0786-468d-89d5-300b87629472 admin admin] PATH_INFO: `/v3/projects/3047a5f96dc44abdaf97f9708e60797c/users/53fb22a9661647bda00663c742b186f1/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:26.305468 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3663/7348] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:39:26 2022] POST /identity/v3/users => generated 284 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:39:26.306646 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065ebe73-a83c-4912-b919-890db9e9c4af admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:26.308913 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-065ebe73-a83c-4912-b919-890db9e9c4af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:26.310864 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26fe15f-0786-468d-89d5-300b87629472 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3047a5f96dc44abdaf97f9708e60797c, user_id=53fb22a9661647bda00663c742b186f1, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:26.318291 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26fe15f-0786-468d-89d5-300b87629472 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:26.325785 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065ebe73-a83c-4912-b919-890db9e9c4af admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:26.329244 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f29f40-b00d-4d1f-b28c-4bc0fd53d228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:26.329918 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f29f40-b00d-4d1f-b28c-4bc0fd53d228 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:26.330201 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f29f40-b00d-4d1f-b28c-4bc0fd53d228 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:26.330480 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f29f40-b00d-4d1f-b28c-4bc0fd53d228 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:26.331196 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f29f40-b00d-4d1f-b28c-4bc0fd53d228 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:26.333123 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f29f40-b00d-4d1f-b28c-4bc0fd53d228 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:26.393824 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3686/7349] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:39:26 2022] PUT /identity/v3/projects/3047a5f96dc44abdaf97f9708e60797c/users/53fb22a9661647bda00663c742b186f1/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:26.395547 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602e9607-c559-4c94-b585-81e557102077 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:26.395838 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602e9607-c559-4c94-b585-81e557102077 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:26.396112 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602e9607-c559-4c94-b585-81e557102077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:26.417505 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-602e9607-c559-4c94-b585-81e557102077 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:26.419683 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-602e9607-c559-4c94-b585-81e557102077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:26.435511 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3664/7350] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:39:26 2022] POST /identity/v3/projects => generated 373 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:39:26.436820 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f29f40-b00d-4d1f-b28c-4bc0fd53d228 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:26.440344 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e8f29f40-b00d-4d1f-b28c-4bc0fd53d228 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:26.499077 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3687/7351] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:39:26.499980 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602e9607-c559-4c94-b585-81e557102077 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:26.511673 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602e9607-c559-4c94-b585-81e557102077 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:26.546434 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f29f40-b00d-4d1f-b28c-4bc0fd53d228 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:26.555286 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4096d428-4484-4977-bfe3-001c4d61d9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:26.555286 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096d428-4484-4977-bfe3-001c4d61d9a0 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:26.555286 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096d428-4484-4977-bfe3-001c4d61d9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:26.555286 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096d428-4484-4977-bfe3-001c4d61d9a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:26.556033 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4096d428-4484-4977-bfe3-001c4d61d9a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:26.557681 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4096d428-4484-4977-bfe3-001c4d61d9a0 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:26.571501 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3665/7352] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:39:26 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:39:26.571501 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4096d428-4484-4977-bfe3-001c4d61d9a0 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:26.583950 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd48c332-3505-41eb-a0a0-74986ff3372e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:26.584662 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd48c332-3505-41eb-a0a0-74986ff3372e admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:26.584946 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd48c332-3505-41eb-a0a0-74986ff3372e admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:26.585224 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd48c332-3505-41eb-a0a0-74986ff3372e admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:26.586455 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4096d428-4484-4977-bfe3-001c4d61d9a0 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:26.591718 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb14303-c6e3-4662-bc3c-336187a20ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:26.592042 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd48c332-3505-41eb-a0a0-74986ff3372e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:26.592442 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb14303-c6e3-4662-bc3c-336187a20ff5 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:26.592727 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb14303-c6e3-4662-bc3c-336187a20ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:26.593007 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb14303-c6e3-4662-bc3c-336187a20ff5 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:26.593685 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd48c332-3505-41eb-a0a0-74986ff3372e admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:26.593891 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb14303-c6e3-4662-bc3c-336187a20ff5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:26.595871 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb14303-c6e3-4662-bc3c-336187a20ff5 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:26.604486 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3688/7353] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:39:26 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:39:26.606745 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c97e4f5-7f7e-45e8-82b4-bf6e1dd651fb None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:26.607322 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c97e4f5-7f7e-45e8-82b4-bf6e1dd651fb None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:26.607839 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c97e4f5-7f7e-45e8-82b4-bf6e1dd651fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:26.628987 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-4c97e4f5-7f7e-45e8-82b4-bf6e1dd651fb None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:26.630164 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-4c97e4f5-7f7e-45e8-82b4-bf6e1dd651fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:26.640199 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3689/7354] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:39:26.641280 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c97e4f5-7f7e-45e8-82b4-bf6e1dd651fb None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:26.652768 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c97e4f5-7f7e-45e8-82b4-bf6e1dd651fb None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:26.657870 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163f45e4-dda8-4a30-83c8-3a82a0eabc52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:26.658603 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f45e4-dda8-4a30-83c8-3a82a0eabc52 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:26.658899 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f45e4-dda8-4a30-83c8-3a82a0eabc52 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:26.659405 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f45e4-dda8-4a30-83c8-3a82a0eabc52 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:26.659951 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163f45e4-dda8-4a30-83c8-3a82a0eabc52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:26.661569 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163f45e4-dda8-4a30-83c8-3a82a0eabc52 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:26.686529 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3690/7355] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:39:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:39:26.686529 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163f45e4-dda8-4a30-83c8-3a82a0eabc52 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:26.686529 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163f45e4-dda8-4a30-83c8-3a82a0eabc52 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:26.692105 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd632723-709e-4f7b-b911-7677238c137e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:26.700470 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd632723-709e-4f7b-b911-7677238c137e admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:26.704966 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3666/7356] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:39:26 2022] POST /identity/v3/users => generated 287 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:39:26.704966 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb14303-c6e3-4662-bc3c-336187a20ff5 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:26.708697 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd632723-709e-4f7b-b911-7677238c137e admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:26.711541 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd632723-709e-4f7b-b911-7677238c137e admin admin] PATH_INFO: `/v3/projects/3047a5f96dc44abdaf97f9708e60797c/users/53fb22a9661647bda00663c742b186f1/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:26.715218 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd632723-709e-4f7b-b911-7677238c137e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3047a5f96dc44abdaf97f9708e60797c, user_id=53fb22a9661647bda00663c742b186f1, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:26.720737 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd632723-709e-4f7b-b911-7677238c137e admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:26.722167 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb14303-c6e3-4662-bc3c-336187a20ff5 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:26.728770 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0250c4-f9eb-4b3f-be04-97fdf9521ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:26.730335 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0250c4-f9eb-4b3f-be04-97fdf9521ddb admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:26.730852 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0250c4-f9eb-4b3f-be04-97fdf9521ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:26.734682 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0250c4-f9eb-4b3f-be04-97fdf9521ddb admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:26.734682 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0250c4-f9eb-4b3f-be04-97fdf9521ddb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:39:26.734682 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0250c4-f9eb-4b3f-be04-97fdf9521ddb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:26.734682 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0250c4-f9eb-4b3f-be04-97fdf9521ddb admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:26.744539 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3691/7357] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:39:26 2022] PUT /identity/v3/projects/3047a5f96dc44abdaf97f9708e60797c/users/53fb22a9661647bda00663c742b186f1/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:26.744539 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd632723-709e-4f7b-b911-7677238c137e admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:26.769206 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3667/7358] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:39:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:39:26.770527 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0250c4-f9eb-4b3f-be04-97fdf9521ddb admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:26.784690 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0250c4-f9eb-4b3f-be04-97fdf9521ddb admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:26.830113 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd632723-709e-4f7b-b911-7677238c137e admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:26.836864 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2b8052-ea16-4dfc-89bc-617ff358ce59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:26.837862 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b8052-ea16-4dfc-89bc-617ff358ce59 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:26.838245 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b8052-ea16-4dfc-89bc-617ff358ce59 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:26.838623 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b8052-ea16-4dfc-89bc-617ff358ce59 admin admin] PATH_INFO: `/v3/projects/a451a66a82bd4ab2bb667e7de5419fa5/users/cec4d8de0f8b4f1483674c4df2360276/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:26.851919 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4271861-de94-4d9c-93bd-2e950a6c78c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:26.852598 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4271861-de94-4d9c-93bd-2e950a6c78c9 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:26.852901 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4271861-de94-4d9c-93bd-2e950a6c78c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:26.853180 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4271861-de94-4d9c-93bd-2e950a6c78c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:26.853918 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4271861-de94-4d9c-93bd-2e950a6c78c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:26.855661 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4271861-de94-4d9c-93bd-2e950a6c78c9 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:26.858472 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2b8052-ea16-4dfc-89bc-617ff358ce59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a451a66a82bd4ab2bb667e7de5419fa5, user_id=cec4d8de0f8b4f1483674c4df2360276, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:26.861530 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2b8052-ea16-4dfc-89bc-617ff358ce59 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:26.866280 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3668/7359] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:39:26 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:39:26.867679 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d8d2c-d480-47c8-8a28-b0f54f9e63d6 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:26.867975 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d8d2c-d480-47c8-8a28-b0f54f9e63d6 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:26.868260 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d8d2c-d480-47c8-8a28-b0f54f9e63d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:26.903204 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-8e1d8d2c-d480-47c8-8a28-b0f54f9e63d6 None None] MFA Rules not processed for user `53fb22a9661647bda00663c742b186f1`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:26.904380 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8e1d8d2c-d480-47c8-8a28-b0f54f9e63d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:26.977310 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3692/7360] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:39:26 2022] PUT /identity/v3/projects/a451a66a82bd4ab2bb667e7de5419fa5/users/cec4d8de0f8b4f1483674c4df2360276/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:26.978005 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2b8052-ea16-4dfc-89bc-617ff358ce59 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:26.983935 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3669/7361] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:26 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:39:26.988762 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d8d2c-d480-47c8-8a28-b0f54f9e63d6 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:27.002246 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d8d2c-d480-47c8-8a28-b0f54f9e63d6 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:27.058573 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2b8052-ea16-4dfc-89bc-617ff358ce59 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:27.073288 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7af108-a3a1-4e5b-b5cd-ee585135f86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:27.075212 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7af108-a3a1-4e5b-b5cd-ee585135f86e admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:27.076150 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7af108-a3a1-4e5b-b5cd-ee585135f86e admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:27.076150 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7af108-a3a1-4e5b-b5cd-ee585135f86e admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:27.077329 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7af108-a3a1-4e5b-b5cd-ee585135f86e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:27.079117 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7af108-a3a1-4e5b-b5cd-ee585135f86e admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:27.081927 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d128643-edda-4175-8ed6-f18763b51e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:27.082637 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d128643-edda-4175-8ed6-f18763b51e80 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:27.082927 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d128643-edda-4175-8ed6-f18763b51e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:27.083210 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d128643-edda-4175-8ed6-f18763b51e80 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:27.083977 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d128643-edda-4175-8ed6-f18763b51e80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:27.085592 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d128643-edda-4175-8ed6-f18763b51e80 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:27.101073 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3670/7362] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:39:26 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:39:27.102518 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f9a45-b707-4d2d-bfff-76bdcc0c682c None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:27.102788 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f9a45-b707-4d2d-bfff-76bdcc0c682c None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:27.103071 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f9a45-b707-4d2d-bfff-76bdcc0c682c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:27.133446 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-210f9a45-b707-4d2d-bfff-76bdcc0c682c None None] MFA Rules not processed for user `cec4d8de0f8b4f1483674c4df2360276`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:27.134734 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-210f9a45-b707-4d2d-bfff-76bdcc0c682c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:27.209912 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3693/7363] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:39:26 2022] POST /identity/v3/projects => generated 365 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:39:27.210869 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7af108-a3a1-4e5b-b5cd-ee585135f86e admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:27.212494 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-fd7af108-a3a1-4e5b-b5cd-ee585135f86e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:27.213968 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3671/7364] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:27 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:39:27.215016 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210f9a45-b707-4d2d-bfff-76bdcc0c682c None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:27.232906 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210f9a45-b707-4d2d-bfff-76bdcc0c682c None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:27.301200 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7af108-a3a1-4e5b-b5cd-ee585135f86e admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:27.306990 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838c6a08-0519-43fc-90ef-f577c55cced5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:27.307615 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b74102-d3dc-4646-8526-9ecc4da5b160 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198271d1c0d44cb58bace41a65f4b94c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:27.308184 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c6a08-0519-43fc-90ef-f577c55cced5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:27.308293 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b74102-d3dc-4646-8526-9ecc4da5b160 service cinder] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:27.309243 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c6a08-0519-43fc-90ef-f577c55cced5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:27.309341 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b74102-d3dc-4646-8526-9ecc4da5b160 service cinder] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:27.309577 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b74102-d3dc-4646-8526-9ecc4da5b160 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:27.309675 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c6a08-0519-43fc-90ef-f577c55cced5 admin admin] PATH_INFO: `/v3/projects/a5d1195cf21b4146ae0c49a9c95ab8fa/users/cab5a299e003422286f01bd44fda92bc/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:27.329469 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838c6a08-0519-43fc-90ef-f577c55cced5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5d1195cf21b4146ae0c49a9c95ab8fa, user_id=cab5a299e003422286f01bd44fda92bc, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:27.332414 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838c6a08-0519-43fc-90ef-f577c55cced5 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:27.396476 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b74102-d3dc-4646-8526-9ecc4da5b160 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:27.398036 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b74102-d3dc-4646-8526-9ecc4da5b160 service cinder] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:27.413757 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3694/7365] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:39:27 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:39:27.414777 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b74102-d3dc-4646-8526-9ecc4da5b160 service cinder] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:27.425417 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b74102-d3dc-4646-8526-9ecc4da5b160 service cinder] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:27.450010 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3672/7366] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:39:27 2022] PUT /identity/v3/projects/a5d1195cf21b4146ae0c49a9c95ab8fa/users/cab5a299e003422286f01bd44fda92bc/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:27.450679 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838c6a08-0519-43fc-90ef-f577c55cced5 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:27.499984 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99120291-debd-4221-8054-0305e17b54d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:27.500697 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99120291-debd-4221-8054-0305e17b54d0 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:27.500978 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99120291-debd-4221-8054-0305e17b54d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:27.501252 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99120291-debd-4221-8054-0305e17b54d0 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:27.501938 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99120291-debd-4221-8054-0305e17b54d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:27.503909 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99120291-debd-4221-8054-0305e17b54d0 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:27.516853 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838c6a08-0519-43fc-90ef-f577c55cced5 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:27.522376 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab0bb3-9dc5-4bad-a0f5-739672a8ace6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:27.523035 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab0bb3-9dc5-4bad-a0f5-739672a8ace6 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:27.523326 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab0bb3-9dc5-4bad-a0f5-739672a8ace6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:27.523635 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab0bb3-9dc5-4bad-a0f5-739672a8ace6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:27.524341 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ab0bb3-9dc5-4bad-a0f5-739672a8ace6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:27.526257 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ab0bb3-9dc5-4bad-a0f5-739672a8ace6 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:27.638649 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3695/7367] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:39:27 2022] POST /identity/v3/users => generated 283 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:39:27.640019 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279faaa-0329-42cf-9c69-d8de701fa555 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:27.640307 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279faaa-0329-42cf-9c69-d8de701fa555 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:27.640581 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279faaa-0329-42cf-9c69-d8de701fa555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:27.648305 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3673/7368] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:39:27 2022] POST /identity/v3/projects => generated 369 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:39:27.649961 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab0bb3-9dc5-4bad-a0f5-739672a8ace6 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:27.673684 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-6279faaa-0329-42cf-9c69-d8de701fa555 None None] MFA Rules not processed for user `cab5a299e003422286f01bd44fda92bc`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:27.674916 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-6279faaa-0329-42cf-9c69-d8de701fa555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:27.767605 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3696/7369] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:39:27.769300 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6279faaa-0329-42cf-9c69-d8de701fa555 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:27.773054 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab0bb3-9dc5-4bad-a0f5-739672a8ace6 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:27.785473 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b2a6b-4ad9-4cee-a4c2-085a3231bf70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:27.786310 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b2a6b-4ad9-4cee-a4c2-085a3231bf70 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:27.786485 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b2a6b-4ad9-4cee-a4c2-085a3231bf70 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:27.792070 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b2a6b-4ad9-4cee-a4c2-085a3231bf70 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:27.792070 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998b2a6b-4ad9-4cee-a4c2-085a3231bf70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:27.792274 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6279faaa-0329-42cf-9c69-d8de701fa555 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:27.792383 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998b2a6b-4ad9-4cee-a4c2-085a3231bf70 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:27.793733 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b96e90-07d4-4d8f-a7fb-5e1f414165f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:27.795588 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b96e90-07d4-4d8f-a7fb-5e1f414165f4 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:27.795990 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b96e90-07d4-4d8f-a7fb-5e1f414165f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:27.796339 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b96e90-07d4-4d8f-a7fb-5e1f414165f4 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:27.797114 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b96e90-07d4-4d8f-a7fb-5e1f414165f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:27.800927 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b96e90-07d4-4d8f-a7fb-5e1f414165f4 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:27.815868 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3674/7370] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:39:27 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:39:27.817360 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b2a6b-4ad9-4cee-a4c2-085a3231bf70 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:27.907711 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b2a6b-4ad9-4cee-a4c2-085a3231bf70 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:27.918496 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3697/7371] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:39:27 2022] POST /identity/v3/users => generated 291 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:39:27.918496 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b96e90-07d4-4d8f-a7fb-5e1f414165f4 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:27.921327 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c350cf-87de-4ae7-8191-b0486795a8be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198271d1c0d44cb58bace41a65f4b94c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:27.922184 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c350cf-87de-4ae7-8191-b0486795a8be service cinder] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:27.922478 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c350cf-87de-4ae7-8191-b0486795a8be service cinder] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:27.922761 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c350cf-87de-4ae7-8191-b0486795a8be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:27.928580 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-28c350cf-87de-4ae7-8191-b0486795a8be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:27.933147 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b96e90-07d4-4d8f-a7fb-5e1f414165f4 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:27.939087 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b830fa9-e16a-4ec8-8e3e-ee73206bc73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:27.939987 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b830fa9-e16a-4ec8-8e3e-ee73206bc73d admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:27.940254 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b830fa9-e16a-4ec8-8e3e-ee73206bc73d admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:27.940511 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b830fa9-e16a-4ec8-8e3e-ee73206bc73d admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:27.944725 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b830fa9-e16a-4ec8-8e3e-ee73206bc73d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:27.947427 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b830fa9-e16a-4ec8-8e3e-ee73206bc73d admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:28.013170 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c350cf-87de-4ae7-8191-b0486795a8be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:28.014267 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c350cf-87de-4ae7-8191-b0486795a8be service cinder] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:28.024243 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3675/7372] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:39:27 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:39:28.024987 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c350cf-87de-4ae7-8191-b0486795a8be service cinder] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:28.046891 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c350cf-87de-4ae7-8191-b0486795a8be service cinder] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:28.053347 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b508fd-9780-473d-b393-c75aadbb6858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:28.054372 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b508fd-9780-473d-b393-c75aadbb6858 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:28.054755 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b508fd-9780-473d-b393-c75aadbb6858 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:28.055113 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b508fd-9780-473d-b393-c75aadbb6858 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:28.056467 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b508fd-9780-473d-b393-c75aadbb6858 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:28.058235 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b508fd-9780-473d-b393-c75aadbb6858 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:28.066650 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3698/7373] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:39:27 2022] POST /identity/v3/projects => generated 373 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:39:28.067770 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b830fa9-e16a-4ec8-8e3e-ee73206bc73d admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:28.071898 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3676/7374] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:39:28 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:39:28.072973 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b508fd-9780-473d-b393-c75aadbb6858 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:28.087224 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b508fd-9780-473d-b393-c75aadbb6858 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:28.156785 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44151245-cff9-4bca-8592-991505e43644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:28.157848 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44151245-cff9-4bca-8592-991505e43644 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:28.158309 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44151245-cff9-4bca-8592-991505e43644 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:28.158732 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44151245-cff9-4bca-8592-991505e43644 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:28.159895 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44151245-cff9-4bca-8592-991505e43644 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:28.160129 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b830fa9-e16a-4ec8-8e3e-ee73206bc73d admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:28.162261 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44151245-cff9-4bca-8592-991505e43644 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:28.165524 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb19aa63-5b02-4a39-958c-fef85099600f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:28.166211 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb19aa63-5b02-4a39-958c-fef85099600f admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:28.166493 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb19aa63-5b02-4a39-958c-fef85099600f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:28.166771 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb19aa63-5b02-4a39-958c-fef85099600f admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:28.167522 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb19aa63-5b02-4a39-958c-fef85099600f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:28.169394 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb19aa63-5b02-4a39-958c-fef85099600f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:28.180647 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3699/7375] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:39:28 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:39:28.181547 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb19aa63-5b02-4a39-958c-fef85099600f admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:28.192564 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb19aa63-5b02-4a39-958c-fef85099600f admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:28.197496 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca13d8c6-32f4-4102-8afc-7d42bfaac102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:28.198395 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca13d8c6-32f4-4102-8afc-7d42bfaac102 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:28.198747 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca13d8c6-32f4-4102-8afc-7d42bfaac102 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:28.200468 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca13d8c6-32f4-4102-8afc-7d42bfaac102 admin admin] PATH_INFO: `/v3/projects/f9c0542095f84f98a91c9df1925426f4/users/e8c801f66f3e403cac2618dfeb7be51c/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:28.217739 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca13d8c6-32f4-4102-8afc-7d42bfaac102 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9c0542095f84f98a91c9df1925426f4, user_id=e8c801f66f3e403cac2618dfeb7be51c, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:28.220511 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca13d8c6-32f4-4102-8afc-7d42bfaac102 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:28.289773 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3677/7376] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:39:28 2022] POST /identity/v3/users => generated 293 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:39:28.289773 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44151245-cff9-4bca-8592-991505e43644 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:28.298621 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44151245-cff9-4bca-8592-991505e43644 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:28.304118 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f167543-a4cc-4298-8267-18febbbd4ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:28.305116 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f167543-a4cc-4298-8267-18febbbd4ff9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:28.305506 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f167543-a4cc-4298-8267-18febbbd4ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:28.305793 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f167543-a4cc-4298-8267-18febbbd4ff9 admin admin] PATH_INFO: `/v3/projects/4c77d67f97804c55aec467cdd9d39a88/users/8a734b6ca794434390ae1d03cbe81a09/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:28.326339 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f167543-a4cc-4298-8267-18febbbd4ff9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c77d67f97804c55aec467cdd9d39a88, user_id=8a734b6ca794434390ae1d03cbe81a09, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:28.329262 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f167543-a4cc-4298-8267-18febbbd4ff9 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:28.341043 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3700/7377] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:39:28 2022] PUT /identity/v3/projects/f9c0542095f84f98a91c9df1925426f4/users/e8c801f66f3e403cac2618dfeb7be51c/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:28.342004 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca13d8c6-32f4-4102-8afc-7d42bfaac102 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:28.406391 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3678/7378] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:39:28 2022] PUT /identity/v3/projects/4c77d67f97804c55aec467cdd9d39a88/users/8a734b6ca794434390ae1d03cbe81a09/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:28.408135 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12296969-c95b-4993-b1c4-a2f32d7d7687 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:28.408135 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12296969-c95b-4993-b1c4-a2f32d7d7687 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:28.408135 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12296969-c95b-4993-b1c4-a2f32d7d7687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:28.438794 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca13d8c6-32f4-4102-8afc-7d42bfaac102 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:28.448052 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-12296969-c95b-4993-b1c4-a2f32d7d7687 None None] MFA Rules not processed for user `e8c801f66f3e403cac2618dfeb7be51c`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:28.449668 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-12296969-c95b-4993-b1c4-a2f32d7d7687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:28.530471 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6631a9e6-2eb4-4790-af1a-f4855e3e4fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:28.531245 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631a9e6-2eb4-4790-af1a-f4855e3e4fe0 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:28.531539 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631a9e6-2eb4-4790-af1a-f4855e3e4fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:28.531830 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631a9e6-2eb4-4790-af1a-f4855e3e4fe0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:28.533402 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6631a9e6-2eb4-4790-af1a-f4855e3e4fe0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:28.535076 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6631a9e6-2eb4-4790-af1a-f4855e3e4fe0 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:28.545733 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3679/7379] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:28 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:39:28.545733 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12296969-c95b-4993-b1c4-a2f32d7d7687 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:28.551520 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3701/7380] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:39:28 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:39:28.553269 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6631a9e6-2eb4-4790-af1a-f4855e3e4fe0 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:28.555498 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-6631a9e6-2eb4-4790-af1a-f4855e3e4fe0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:28.561654 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12296969-c95b-4993-b1c4-a2f32d7d7687 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:28.567978 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f29f424-0ab2-4640-b990-9c63a7b5f5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:28.568742 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f29f424-0ab2-4640-b990-9c63a7b5f5f9 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:28.569092 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f29f424-0ab2-4640-b990-9c63a7b5f5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:28.569500 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f29f424-0ab2-4640-b990-9c63a7b5f5f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:28.570286 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f29f424-0ab2-4640-b990-9c63a7b5f5f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:28.573715 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f29f424-0ab2-4640-b990-9c63a7b5f5f9 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:28.591342 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3680/7381] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:39:28 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:39:28.595391 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f29f424-0ab2-4640-b990-9c63a7b5f5f9 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:28.609345 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f29f424-0ab2-4640-b990-9c63a7b5f5f9 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:28.615433 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913e3261-ae18-4af4-91b4-177d3c40bafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:28.616421 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913e3261-ae18-4af4-91b4-177d3c40bafc admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:28.616714 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913e3261-ae18-4af4-91b4-177d3c40bafc admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:28.616998 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913e3261-ae18-4af4-91b4-177d3c40bafc admin admin] PATH_INFO: `/v3/projects/9c980bbab3cc41cfbef038882a7a8e9a/users/678c26f0813e46feb85b6a8a6a1518e0/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:28.645970 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6631a9e6-2eb4-4790-af1a-f4855e3e4fe0 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:28.650455 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913e3261-ae18-4af4-91b4-177d3c40bafc admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c980bbab3cc41cfbef038882a7a8e9a, user_id=678c26f0813e46feb85b6a8a6a1518e0, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:28.650744 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14abf334-1398-455c-ad5c-2140914c72c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198271d1c0d44cb58bace41a65f4b94c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:28.655975 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14abf334-1398-455c-ad5c-2140914c72c7 service cinder] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:28.655975 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14abf334-1398-455c-ad5c-2140914c72c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:28.655975 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14abf334-1398-455c-ad5c-2140914c72c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:28.656211 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913e3261-ae18-4af4-91b4-177d3c40bafc admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:28.664687 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14abf334-1398-455c-ad5c-2140914c72c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:28.666315 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14abf334-1398-455c-ad5c-2140914c72c7 service cinder] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:28.678565 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3702/7382] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:39:28 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:39:28.679416 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14abf334-1398-455c-ad5c-2140914c72c7 service cinder] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:28.691298 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14abf334-1398-455c-ad5c-2140914c72c7 service cinder] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:28.699397 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4b6e58-24db-4d5c-920c-65c9212b51c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:28.701046 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b6e58-24db-4d5c-920c-65c9212b51c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:28.701348 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b6e58-24db-4d5c-920c-65c9212b51c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:28.701639 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b6e58-24db-4d5c-920c-65c9212b51c1 admin admin] PATH_INFO: `/v3/projects/4c77d67f97804c55aec467cdd9d39a88/users/8a734b6ca794434390ae1d03cbe81a09/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:28.703781 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4b6e58-24db-4d5c-920c-65c9212b51c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c77d67f97804c55aec467cdd9d39a88, user_id=8a734b6ca794434390ae1d03cbe81a09, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:28.706604 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4b6e58-24db-4d5c-920c-65c9212b51c1 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:28.734829 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3703/7383] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:39:28 2022] PUT /identity/v3/projects/4c77d67f97804c55aec467cdd9d39a88/users/8a734b6ca794434390ae1d03cbe81a09/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:28.754194 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294389a2-d1fb-4939-9573-5910ad22ca08 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:28.754502 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294389a2-d1fb-4939-9573-5910ad22ca08 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:28.754786 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294389a2-d1fb-4939-9573-5910ad22ca08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:28.757680 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3681/7384] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:39:28 2022] PUT /identity/v3/projects/9c980bbab3cc41cfbef038882a7a8e9a/users/678c26f0813e46feb85b6a8a6a1518e0/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:28.763826 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913e3261-ae18-4af4-91b4-177d3c40bafc admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:28.789473 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-294389a2-d1fb-4939-9573-5910ad22ca08 None None] MFA Rules not processed for user `8a734b6ca794434390ae1d03cbe81a09`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:28.790842 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-294389a2-d1fb-4939-9573-5910ad22ca08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:28.829546 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913e3261-ae18-4af4-91b4-177d3c40bafc admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:28.836572 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f6de2-2df9-4089-9239-fbdddd966d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:28.837408 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f6de2-2df9-4089-9239-fbdddd966d87 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:28.837785 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f6de2-2df9-4089-9239-fbdddd966d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:28.838168 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f6de2-2df9-4089-9239-fbdddd966d87 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:28.838957 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98f6de2-2df9-4089-9239-fbdddd966d87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:28.841248 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98f6de2-2df9-4089-9239-fbdddd966d87 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:28.852711 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3682/7385] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:39:28 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:39:28.857971 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f6de2-2df9-4089-9239-fbdddd966d87 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:28.872756 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f6de2-2df9-4089-9239-fbdddd966d87 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:28.879626 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4126aecc-7da6-4c33-b6d8-70bd735a6f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:28.879761 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3704/7386] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:28 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:39:28.880452 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4126aecc-7da6-4c33-b6d8-70bd735a6f82 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:28.880738 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4126aecc-7da6-4c33-b6d8-70bd735a6f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:28.881015 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4126aecc-7da6-4c33-b6d8-70bd735a6f82 admin admin] PATH_INFO: `/v3/projects/9c980bbab3cc41cfbef038882a7a8e9a/users/678c26f0813e46feb85b6a8a6a1518e0/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:28.883151 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4126aecc-7da6-4c33-b6d8-70bd735a6f82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c980bbab3cc41cfbef038882a7a8e9a, user_id=678c26f0813e46feb85b6a8a6a1518e0, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:28.886006 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4126aecc-7da6-4c33-b6d8-70bd735a6f82 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:28.892553 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294389a2-d1fb-4939-9573-5910ad22ca08 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:28.899006 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3683/7387] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:39:28 2022] PUT /identity/v3/projects/9c980bbab3cc41cfbef038882a7a8e9a/users/678c26f0813e46feb85b6a8a6a1518e0/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:39:28.909473 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d89bfe-b5ff-484d-93a2-08ec76b31e43 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:28.909789 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d89bfe-b5ff-484d-93a2-08ec76b31e43 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:28.910106 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d89bfe-b5ff-484d-93a2-08ec76b31e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:28.955399 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-f4d89bfe-b5ff-484d-93a2-08ec76b31e43 None None] MFA Rules not processed for user `678c26f0813e46feb85b6a8a6a1518e0`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:28.957965 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-f4d89bfe-b5ff-484d-93a2-08ec76b31e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:28.995520 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294389a2-d1fb-4939-9573-5910ad22ca08 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:29.050709 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3684/7388] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:28 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:39:29.058938 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d89bfe-b5ff-484d-93a2-08ec76b31e43 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:29.060404 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-f4d89bfe-b5ff-484d-93a2-08ec76b31e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:29.075735 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd4d947-0a3e-451f-94de-e8955d3df399 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198271d1c0d44cb58bace41a65f4b94c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:29.076968 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd4d947-0a3e-451f-94de-e8955d3df399 service cinder] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:29.076968 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd4d947-0a3e-451f-94de-e8955d3df399 service cinder] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:29.076968 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd4d947-0a3e-451f-94de-e8955d3df399 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:29.135343 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d89bfe-b5ff-484d-93a2-08ec76b31e43 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:29.139571 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e853e95-4af9-44c6-ba67-911582588cd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:29.140212 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e853e95-4af9-44c6-ba67-911582588cd9 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:29.140499 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e853e95-4af9-44c6-ba67-911582588cd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:29.142648 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e853e95-4af9-44c6-ba67-911582588cd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:29.144793 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd4d947-0a3e-451f-94de-e8955d3df399 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:29.146512 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd4d947-0a3e-451f-94de-e8955d3df399 service cinder] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:29.158116 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3705/7389] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:39:28 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:39:29.213159 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e853e95-4af9-44c6-ba67-911582588cd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:29.215201 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e853e95-4af9-44c6-ba67-911582588cd9 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:29.227814 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3685/7390] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:39:29 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:39:29.278062 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd4d947-0a3e-451f-94de-e8955d3df399 service cinder] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:29.292695 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd4d947-0a3e-451f-94de-e8955d3df399 service cinder] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:29.298829 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b01e6b5-cfff-4459-8adf-4ef9d42ccc0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198271d1c0d44cb58bace41a65f4b94c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:29.299503 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01e6b5-cfff-4459-8adf-4ef9d42ccc0a service cinder] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:29.300093 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01e6b5-cfff-4459-8adf-4ef9d42ccc0a service cinder] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:29.300768 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01e6b5-cfff-4459-8adf-4ef9d42ccc0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:29.380327 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b01e6b5-cfff-4459-8adf-4ef9d42ccc0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:29.381787 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b01e6b5-cfff-4459-8adf-4ef9d42ccc0a service cinder] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:29.392029 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3706/7391] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:39:29 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:39:29.482597 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e853e95-4af9-44c6-ba67-911582588cd9 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:29.486405 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-7e853e95-4af9-44c6-ba67-911582588cd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:29.631691 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e853e95-4af9-44c6-ba67-911582588cd9 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:29.639357 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0139bc5-f49a-4d00-a664-69ae29372f0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:29.640069 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0139bc5-f49a-4d00-a664-69ae29372f0a service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:29.640357 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0139bc5-f49a-4d00-a664-69ae29372f0a service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:29.640636 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0139bc5-f49a-4d00-a664-69ae29372f0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:29.643294 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-d0139bc5-f49a-4d00-a664-69ae29372f0a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:29.664402 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0139bc5-f49a-4d00-a664-69ae29372f0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:29.666534 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0139bc5-f49a-4d00-a664-69ae29372f0a service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:29.707078 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3686/7392] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:39:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:39:32.547993 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b01e6b5-cfff-4459-8adf-4ef9d42ccc0a service cinder] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:32.666946 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b01e6b5-cfff-4459-8adf-4ef9d42ccc0a service cinder] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:32.677269 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889ef439-1d59-4106-b9bc-dd630a4c6b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:32.677796 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ef439-1d59-4106-b9bc-dd630a4c6b6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:32.678270 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ef439-1d59-4106-b9bc-dd630a4c6b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:32.678747 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ef439-1d59-4106-b9bc-dd630a4c6b6e admin admin] PATH_INFO: `/v3/users/47adf895a9d34d8a8293d07537b98c31` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:32.680022 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889ef439-1d59-4106-b9bc-dd630a4c6b6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=47adf895a9d34d8a8293d07537b98c31)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:32.681959 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889ef439-1d59-4106-b9bc-dd630a4c6b6e admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:32.896698 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-889ef439-1d59-4106-b9bc-dd630a4c6b6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47adf895a9d34d8a8293d07537b98c31'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:32.909879 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-889ef439-1d59-4106-b9bc-dd630a4c6b6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47adf895a9d34d8a8293d07537b98c31'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:32.921682 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-889ef439-1d59-4106-b9bc-dd630a4c6b6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47adf895a9d34d8a8293d07537b98c31'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:33.078383 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-889ef439-1d59-4106-b9bc-dd630a4c6b6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47adf895a9d34d8a8293d07537b98c31'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:33.079122 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-889ef439-1d59-4106-b9bc-dd630a4c6b6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47adf895a9d34d8a8293d07537b98c31'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:33.085751 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3707/7393] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:39:32 2022] DELETE /identity/v3/users/47adf895a9d34d8a8293d07537b98c31 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:33.090439 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7288c7c0-b873-4df7-82dc-bd9ff4c428d2 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:33.090959 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7288c7c0-b873-4df7-82dc-bd9ff4c428d2 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:33.091059 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7288c7c0-b873-4df7-82dc-bd9ff4c428d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:33.108933 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-7288c7c0-b873-4df7-82dc-bd9ff4c428d2 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:33.110129 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-7288c7c0-b873-4df7-82dc-bd9ff4c428d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:33.180349 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3687/7394] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:39:33.190834 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889ef439-1d59-4106-b9bc-dd630a4c6b6e admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:33.192286 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-889ef439-1d59-4106-b9bc-dd630a4c6b6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:33.256141 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889ef439-1d59-4106-b9bc-dd630a4c6b6e admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:33.259896 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd8a22a-d675-4c77-86e0-3da528767b8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:33.260543 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd8a22a-d675-4c77-86e0-3da528767b8c service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:33.260822 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd8a22a-d675-4c77-86e0-3da528767b8c service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:33.261096 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd8a22a-d675-4c77-86e0-3da528767b8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:33.272322 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd8a22a-d675-4c77-86e0-3da528767b8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:33.273949 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd8a22a-d675-4c77-86e0-3da528767b8c service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:33.287677 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3708/7395] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:39:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:39:33.795189 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7288c7c0-b873-4df7-82dc-bd9ff4c428d2 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:33.796941 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-7288c7c0-b873-4df7-82dc-bd9ff4c428d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:33.822979 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7288c7c0-b873-4df7-82dc-bd9ff4c428d2 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:33.828972 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ef123a-caf2-42f8-8683-660c3577d561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:33.831504 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef123a-caf2-42f8-8683-660c3577d561 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:33.831504 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef123a-caf2-42f8-8683-660c3577d561 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:33.831504 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef123a-caf2-42f8-8683-660c3577d561 admin admin] PATH_INFO: `/v3/projects/fc5e9af9c7e8412bb65f622d3a7c7469` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:33.833999 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ef123a-caf2-42f8-8683-660c3577d561 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc5e9af9c7e8412bb65f622d3a7c7469)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:33.836064 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ef123a-caf2-42f8-8683-660c3577d561 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:34.045786 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c5ef123a-caf2-42f8-8683-660c3577d561 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc5e9af9c7e8412bb65f622d3a7c7469', 'request_id': 'req-c5ef123a-caf2-42f8-8683-660c3577d561'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:34.062644 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c5ef123a-caf2-42f8-8683-660c3577d561 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc5e9af9c7e8412bb65f622d3a7c7469', 'request_id': 'req-c5ef123a-caf2-42f8-8683-660c3577d561'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:34.077088 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c5ef123a-caf2-42f8-8683-660c3577d561 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc5e9af9c7e8412bb65f622d3a7c7469', 'request_id': 'req-c5ef123a-caf2-42f8-8683-660c3577d561'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:34.200944 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c5ef123a-caf2-42f8-8683-660c3577d561 admin admin] The token cache is being invalidate because project fc5e9af9c7e8412bb65f622d3a7c7469 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:39:34.202546 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c5ef123a-caf2-42f8-8683-660c3577d561 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:34.202984 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c5ef123a-caf2-42f8-8683-660c3577d561 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:34.213033 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3688/7396] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:39:33 2022] DELETE /identity/v3/projects/fc5e9af9c7e8412bb65f622d3a7c7469 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:34.217249 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd8a22a-d675-4c77-86e0-3da528767b8c service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:34.227967 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd8a22a-d675-4c77-86e0-3da528767b8c service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:34.256720 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ef123a-caf2-42f8-8683-660c3577d561 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:34.258489 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c5ef123a-caf2-42f8-8683-660c3577d561 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:34.373388 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2339228-e8f3-4d89-a755-8e7132ab897d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:34.374810 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2339228-e8f3-4d89-a755-8e7132ab897d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:34.375361 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2339228-e8f3-4d89-a755-8e7132ab897d admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:34.376035 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2339228-e8f3-4d89-a755-8e7132ab897d admin admin] PATH_INFO: `/v3/users/53fb22a9661647bda00663c742b186f1` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:34.377732 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2339228-e8f3-4d89-a755-8e7132ab897d admin admin] RBAC: Authorizing `identity:delete_user(user_id=53fb22a9661647bda00663c742b186f1)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:34.379413 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ef123a-caf2-42f8-8683-660c3577d561 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:34.381783 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2339228-e8f3-4d89-a755-8e7132ab897d admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:34.387915 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f35b9-1e3e-46dc-8766-0346a402b49d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:34.389020 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f35b9-1e3e-46dc-8766-0346a402b49d service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:34.389020 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f35b9-1e3e-46dc-8766-0346a402b49d service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:34.389290 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f35b9-1e3e-46dc-8766-0346a402b49d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:34.396119 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-812f35b9-1e3e-46dc-8766-0346a402b49d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:34.509205 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812f35b9-1e3e-46dc-8766-0346a402b49d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:34.510262 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812f35b9-1e3e-46dc-8766-0346a402b49d service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:34.522830 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3689/7397] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:39:34 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:39:34.658854 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c2339228-e8f3-4d89-a755-8e7132ab897d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53fb22a9661647bda00663c742b186f1'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:34.688417 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c2339228-e8f3-4d89-a755-8e7132ab897d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53fb22a9661647bda00663c742b186f1'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:34.698568 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c2339228-e8f3-4d89-a755-8e7132ab897d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53fb22a9661647bda00663c742b186f1'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:34.800471 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c2339228-e8f3-4d89-a755-8e7132ab897d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53fb22a9661647bda00663c742b186f1'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:34.801408 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c2339228-e8f3-4d89-a755-8e7132ab897d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53fb22a9661647bda00663c742b186f1'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:34.809408 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3709/7398] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:39:34 2022] DELETE /identity/v3/users/53fb22a9661647bda00663c742b186f1 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:35.330934 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f35b9-1e3e-46dc-8766-0346a402b49d service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:35.332620 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-812f35b9-1e3e-46dc-8766-0346a402b49d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:35.387529 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f35b9-1e3e-46dc-8766-0346a402b49d service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:35.508334 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fdc158-cb56-4149-a52a-528b8d632cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:35.534163 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fdc158-cb56-4149-a52a-528b8d632cfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:35.534163 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fdc158-cb56-4149-a52a-528b8d632cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:35.534163 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fdc158-cb56-4149-a52a-528b8d632cfc admin admin] PATH_INFO: `/v3/users/cec4d8de0f8b4f1483674c4df2360276` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:35.534163 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fdc158-cb56-4149-a52a-528b8d632cfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=cec4d8de0f8b4f1483674c4df2360276)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:35.534163 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fdc158-cb56-4149-a52a-528b8d632cfc admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:35.777959 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-35fdc158-cb56-4149-a52a-528b8d632cfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cec4d8de0f8b4f1483674c4df2360276'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:35.806666 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-35fdc158-cb56-4149-a52a-528b8d632cfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cec4d8de0f8b4f1483674c4df2360276'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:35.809439 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-35fdc158-cb56-4149-a52a-528b8d632cfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cec4d8de0f8b4f1483674c4df2360276'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:36.042626 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-35fdc158-cb56-4149-a52a-528b8d632cfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cec4d8de0f8b4f1483674c4df2360276'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:36.055176 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2339228-e8f3-4d89-a755-8e7132ab897d admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:36.062189 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c2339228-e8f3-4d89-a755-8e7132ab897d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:36.071108 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-35fdc158-cb56-4149-a52a-528b8d632cfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cec4d8de0f8b4f1483674c4df2360276'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:36.084335 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2339228-e8f3-4d89-a755-8e7132ab897d admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:36.088864 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3690/7399] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:39:35 2022] DELETE /identity/v3/users/cec4d8de0f8b4f1483674c4df2360276 => generated 0 bytes in 758 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:36.093648 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce0942-7671-4926-bb06-3bb658e1e400 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:36.099634 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce0942-7671-4926-bb06-3bb658e1e400 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:36.099634 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce0942-7671-4926-bb06-3bb658e1e400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:36.128751 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-3dce0942-7671-4926-bb06-3bb658e1e400 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:36.128751 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-3dce0942-7671-4926-bb06-3bb658e1e400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:36.207926 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fbb01d-af3c-4901-b132-ed69403ecab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:36.208817 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fbb01d-af3c-4901-b132-ed69403ecab3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:36.209106 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fbb01d-af3c-4901-b132-ed69403ecab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:36.209387 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fbb01d-af3c-4901-b132-ed69403ecab3 admin admin] PATH_INFO: `/v3/projects/3047a5f96dc44abdaf97f9708e60797c` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:36.215741 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fbb01d-af3c-4901-b132-ed69403ecab3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3047a5f96dc44abdaf97f9708e60797c)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:36.219680 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fbb01d-af3c-4901-b132-ed69403ecab3 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:36.297661 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3691/7400] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:39:36.319970 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dce0942-7671-4926-bb06-3bb658e1e400 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:36.321522 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-3dce0942-7671-4926-bb06-3bb658e1e400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:36.378062 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e1fbb01d-af3c-4901-b132-ed69403ecab3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3047a5f96dc44abdaf97f9708e60797c', 'request_id': 'req-e1fbb01d-af3c-4901-b132-ed69403ecab3'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:36.403386 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e1fbb01d-af3c-4901-b132-ed69403ecab3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3047a5f96dc44abdaf97f9708e60797c', 'request_id': 'req-e1fbb01d-af3c-4901-b132-ed69403ecab3'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:36.447798 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dce0942-7671-4926-bb06-3bb658e1e400 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:36.514774 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e1fbb01d-af3c-4901-b132-ed69403ecab3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3047a5f96dc44abdaf97f9708e60797c', 'request_id': 'req-e1fbb01d-af3c-4901-b132-ed69403ecab3'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:36.540263 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da84679-f2dd-4260-8cdc-572d1e87b0ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:36.541293 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da84679-f2dd-4260-8cdc-572d1e87b0ac service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:36.541425 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e1fbb01d-af3c-4901-b132-ed69403ecab3 admin admin] The token cache is being invalidate because project 3047a5f96dc44abdaf97f9708e60797c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:39:36.541707 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e1fbb01d-af3c-4901-b132-ed69403ecab3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:36.541982 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da84679-f2dd-4260-8cdc-572d1e87b0ac service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:36.543115 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da84679-f2dd-4260-8cdc-572d1e87b0ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:36.545316 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-0da84679-f2dd-4260-8cdc-572d1e87b0ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:36.546198 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e1fbb01d-af3c-4901-b132-ed69403ecab3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:36.548042 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3710/7401] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:39:36 2022] DELETE /identity/v3/projects/3047a5f96dc44abdaf97f9708e60797c => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:36.552911 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f34cb-6c12-4713-96ac-af6d4a199f7f None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:36.553209 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f34cb-6c12-4713-96ac-af6d4a199f7f None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:36.553494 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f34cb-6c12-4713-96ac-af6d4a199f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:36.609736 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-a77f34cb-6c12-4713-96ac-af6d4a199f7f None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:36.615848 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-a77f34cb-6c12-4713-96ac-af6d4a199f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:36.795674 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3711/7402] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:39:36.811270 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa1dbd-cd3b-47f0-b2dd-0c2ef30f816b None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:36.814410 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa1dbd-cd3b-47f0-b2dd-0c2ef30f816b None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:36.814702 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa1dbd-cd3b-47f0-b2dd-0c2ef30f816b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:36.826732 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da84679-f2dd-4260-8cdc-572d1e87b0ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:36.828422 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da84679-f2dd-4260-8cdc-572d1e87b0ac service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:36.857139 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3692/7403] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:39:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:39:36.858139 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da84679-f2dd-4260-8cdc-572d1e87b0ac service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:36.865210 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-0da84679-f2dd-4260-8cdc-572d1e87b0ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:36.874885 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-eefa1dbd-cd3b-47f0-b2dd-0c2ef30f816b None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:36.876572 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-eefa1dbd-cd3b-47f0-b2dd-0c2ef30f816b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:36.898020 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3712/7404] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:39:36.898216 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da84679-f2dd-4260-8cdc-572d1e87b0ac service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:36.899149 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefa1dbd-cd3b-47f0-b2dd-0c2ef30f816b None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:36.907156 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ad8b2-ecd3-4b74-a17e-aa0b4d8e4d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:36.908110 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ad8b2-ecd3-4b74-a17e-aa0b4d8e4d9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:36.908411 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ad8b2-ecd3-4b74-a17e-aa0b4d8e4d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:36.908688 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ad8b2-ecd3-4b74-a17e-aa0b4d8e4d9d admin admin] PATH_INFO: `/v3/users/982a918578d94fda9aeaa1109bb4e5c4` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:36.910067 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348ad8b2-ecd3-4b74-a17e-aa0b4d8e4d9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=982a918578d94fda9aeaa1109bb4e5c4)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:36.912127 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefa1dbd-cd3b-47f0-b2dd-0c2ef30f816b None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:36.912292 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348ad8b2-ecd3-4b74-a17e-aa0b4d8e4d9d admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:36.919012 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1f76db-e975-43d8-bf54-2dbf43e9dd64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:36.919964 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f76db-e975-43d8-bf54-2dbf43e9dd64 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:36.920397 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f76db-e975-43d8-bf54-2dbf43e9dd64 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:36.920920 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f76db-e975-43d8-bf54-2dbf43e9dd64 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:36.921808 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1f76db-e975-43d8-bf54-2dbf43e9dd64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:39:36.922270 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1f76db-e975-43d8-bf54-2dbf43e9dd64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:36.924642 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1f76db-e975-43d8-bf54-2dbf43e9dd64 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:36.947919 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3713/7405] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:39:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:39:36.950967 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1f76db-e975-43d8-bf54-2dbf43e9dd64 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:36.979336 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1f76db-e975-43d8-bf54-2dbf43e9dd64 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:36.993858 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f3143a-e212-4096-a3ee-51e72e8d6fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:36.996854 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3143a-e212-4096-a3ee-51e72e8d6fd4 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:36.996854 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3143a-e212-4096-a3ee-51e72e8d6fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:36.996854 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3143a-e212-4096-a3ee-51e72e8d6fd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:36.996854 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f3143a-e212-4096-a3ee-51e72e8d6fd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:36.998602 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f3143a-e212-4096-a3ee-51e72e8d6fd4 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:37.162374 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3714/7406] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:39:36 2022] POST /identity/v3/projects => generated 381 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:39:37.167086 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f3143a-e212-4096-a3ee-51e72e8d6fd4 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:37.229015 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-348ad8b2-ecd3-4b74-a17e-aa0b4d8e4d9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '982a918578d94fda9aeaa1109bb4e5c4'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:37.250684 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-348ad8b2-ecd3-4b74-a17e-aa0b4d8e4d9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '982a918578d94fda9aeaa1109bb4e5c4'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:37.252572 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-348ad8b2-ecd3-4b74-a17e-aa0b4d8e4d9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '982a918578d94fda9aeaa1109bb4e5c4'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:37.312803 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f3143a-e212-4096-a3ee-51e72e8d6fd4 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:37.327147 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c4c8d9-0c1b-4ba1-b5a6-b623cfd1c2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:37.328266 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c4c8d9-0c1b-4ba1-b5a6-b623cfd1c2a6 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:37.328747 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c4c8d9-0c1b-4ba1-b5a6-b623cfd1c2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:37.331422 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c4c8d9-0c1b-4ba1-b5a6-b623cfd1c2a6 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:37.331422 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c4c8d9-0c1b-4ba1-b5a6-b623cfd1c2a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:37.332321 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c4c8d9-0c1b-4ba1-b5a6-b623cfd1c2a6 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:37.378413 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-348ad8b2-ecd3-4b74-a17e-aa0b4d8e4d9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '982a918578d94fda9aeaa1109bb4e5c4'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:37.402333 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-348ad8b2-ecd3-4b74-a17e-aa0b4d8e4d9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '982a918578d94fda9aeaa1109bb4e5c4'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:37.414860 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3693/7407] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:39:36 2022] DELETE /identity/v3/users/982a918578d94fda9aeaa1109bb4e5c4 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:37.420069 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdd73a1-b246-456c-96d2-4e9a12449ae9 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:37.420369 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdd73a1-b246-456c-96d2-4e9a12449ae9 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:37.420660 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdd73a1-b246-456c-96d2-4e9a12449ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:37.459315 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3715/7408] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:39:37 2022] POST /identity/v3/users => generated 291 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:39:37.463557 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c4c8d9-0c1b-4ba1-b5a6-b623cfd1c2a6 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:37.466724 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-dfdd73a1-b246-456c-96d2-4e9a12449ae9 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:37.467867 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-dfdd73a1-b246-456c-96d2-4e9a12449ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:37.468141 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-78c4c8d9-0c1b-4ba1-b5a6-b623cfd1c2a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:37.503272 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c4c8d9-0c1b-4ba1-b5a6-b623cfd1c2a6 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:37.616789 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3694/7409] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:39:37.657763 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bd2429-3d85-4951-b784-e23df2f5619e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:37.658462 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd2429-3d85-4951-b784-e23df2f5619e admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:37.658740 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd2429-3d85-4951-b784-e23df2f5619e admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:37.659010 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd2429-3d85-4951-b784-e23df2f5619e admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:37.659868 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bd2429-3d85-4951-b784-e23df2f5619e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:37.661527 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bd2429-3d85-4951-b784-e23df2f5619e admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:37.676588 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdd73a1-b246-456c-96d2-4e9a12449ae9 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:37.679116 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-dfdd73a1-b246-456c-96d2-4e9a12449ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:37.692051 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3716/7410] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:39:37 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:39:37.701672 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bd2429-3d85-4951-b784-e23df2f5619e admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:37.754130 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bd2429-3d85-4951-b784-e23df2f5619e admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:37.774472 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93590bfa-1895-4d85-9e21-7bd1f6687815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:37.782447 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93590bfa-1895-4d85-9e21-7bd1f6687815 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:37.782447 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93590bfa-1895-4d85-9e21-7bd1f6687815 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:37.787134 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93590bfa-1895-4d85-9e21-7bd1f6687815 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:37.788125 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93590bfa-1895-4d85-9e21-7bd1f6687815 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:37.793044 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93590bfa-1895-4d85-9e21-7bd1f6687815 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:37.818264 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3717/7411] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:39:37 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:39:37.827423 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93590bfa-1895-4d85-9e21-7bd1f6687815 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:37.856186 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93590bfa-1895-4d85-9e21-7bd1f6687815 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:37.892059 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4374105-3ac9-4106-8402-1c4ea1c865b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:37.892972 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4374105-3ac9-4106-8402-1c4ea1c865b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:37.893258 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4374105-3ac9-4106-8402-1c4ea1c865b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:37.893868 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4374105-3ac9-4106-8402-1c4ea1c865b7 admin admin] PATH_INFO: `/v3/projects/75be348dedbd44a58d2be6ad8b4bedfc/users/2de3fe1026c7400193be7bd68ad6303a/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:37.906030 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdd73a1-b246-456c-96d2-4e9a12449ae9 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:37.920299 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e198fbb6-684c-42db-a5fb-13486f48d4e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:37.920988 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e198fbb6-684c-42db-a5fb-13486f48d4e6 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:37.921269 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e198fbb6-684c-42db-a5fb-13486f48d4e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:37.921536 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e198fbb6-684c-42db-a5fb-13486f48d4e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:37.952505 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4374105-3ac9-4106-8402-1c4ea1c865b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75be348dedbd44a58d2be6ad8b4bedfc, user_id=2de3fe1026c7400193be7bd68ad6303a, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:37.955376 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4374105-3ac9-4106-8402-1c4ea1c865b7 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:37.960599 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e198fbb6-684c-42db-a5fb-13486f48d4e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:37.962935 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e198fbb6-684c-42db-a5fb-13486f48d4e6 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:37.993855 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3695/7412] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:39:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:39:38.166008 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3718/7413] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:39:37 2022] PUT /identity/v3/projects/75be348dedbd44a58d2be6ad8b4bedfc/users/2de3fe1026c7400193be7bd68ad6303a/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:38.175891 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa729381-2985-49e3-be82-71ec0bb98bd1 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:38.176179 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa729381-2985-49e3-be82-71ec0bb98bd1 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:38.176458 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa729381-2985-49e3-be82-71ec0bb98bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:38.219876 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-fa729381-2985-49e3-be82-71ec0bb98bd1 None None] MFA Rules not processed for user `2de3fe1026c7400193be7bd68ad6303a`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:38.221417 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-fa729381-2985-49e3-be82-71ec0bb98bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:38.307982 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3696/7414] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:39:38.313759 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4374105-3ac9-4106-8402-1c4ea1c865b7 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:38.460814 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4374105-3ac9-4106-8402-1c4ea1c865b7 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:38.467572 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710c8247-22ed-4375-9067-749fe7495436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:38.474053 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c8247-22ed-4375-9067-749fe7495436 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:38.474569 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c8247-22ed-4375-9067-749fe7495436 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:38.475110 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c8247-22ed-4375-9067-749fe7495436 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:38.476218 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710c8247-22ed-4375-9067-749fe7495436 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:38.480616 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710c8247-22ed-4375-9067-749fe7495436 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:38.631605 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3719/7415] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:39:38 2022] POST /identity/v3/projects => generated 377 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:39:38.635802 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa729381-2985-49e3-be82-71ec0bb98bd1 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:38.663658 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa729381-2985-49e3-be82-71ec0bb98bd1 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:38.895750 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43876da-e493-457a-9cd9-5182199e0e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:38.899654 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43876da-e493-457a-9cd9-5182199e0e52 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:38.899654 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43876da-e493-457a-9cd9-5182199e0e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:38.899654 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43876da-e493-457a-9cd9-5182199e0e52 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:38.899654 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43876da-e493-457a-9cd9-5182199e0e52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:38.904330 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43876da-e493-457a-9cd9-5182199e0e52 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:38.905838 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710c8247-22ed-4375-9067-749fe7495436 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:38.909915 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-710c8247-22ed-4375-9067-749fe7495436 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:38.983110 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710c8247-22ed-4375-9067-749fe7495436 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:38.997897 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44709ba-0ea5-4f1c-af3b-dbf0e00ab9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:38.999521 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44709ba-0ea5-4f1c-af3b-dbf0e00ab9d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:39.000046 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44709ba-0ea5-4f1c-af3b-dbf0e00ab9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:39.000478 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44709ba-0ea5-4f1c-af3b-dbf0e00ab9d1 admin admin] PATH_INFO: `/v3/projects/adf6bd7cd9a040ff8723f40c96477b4c` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:39.004142 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44709ba-0ea5-4f1c-af3b-dbf0e00ab9d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=adf6bd7cd9a040ff8723f40c96477b4c)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:39.008718 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44709ba-0ea5-4f1c-af3b-dbf0e00ab9d1 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:39.076653 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3697/7416] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:39:38 2022] POST /identity/v3/users => generated 295 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:39:39.077875 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43876da-e493-457a-9cd9-5182199e0e52 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:39.118762 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43876da-e493-457a-9cd9-5182199e0e52 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:39.134845 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12cfd62-0e55-4e29-8b22-7394807e3bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:39.135898 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12cfd62-0e55-4e29-8b22-7394807e3bf1 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:39.141113 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12cfd62-0e55-4e29-8b22-7394807e3bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:39.141113 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12cfd62-0e55-4e29-8b22-7394807e3bf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:39.141113 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12cfd62-0e55-4e29-8b22-7394807e3bf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:39.148304 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12cfd62-0e55-4e29-8b22-7394807e3bf1 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:39.187036 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3698/7417] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:39:39 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:39:39.188138 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12cfd62-0e55-4e29-8b22-7394807e3bf1 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:39.210455 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12cfd62-0e55-4e29-8b22-7394807e3bf1 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:39.226467 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b44709ba-0ea5-4f1c-af3b-dbf0e00ab9d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adf6bd7cd9a040ff8723f40c96477b4c', 'request_id': 'req-b44709ba-0ea5-4f1c-af3b-dbf0e00ab9d1'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:39.242664 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b44709ba-0ea5-4f1c-af3b-dbf0e00ab9d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adf6bd7cd9a040ff8723f40c96477b4c', 'request_id': 'req-b44709ba-0ea5-4f1c-af3b-dbf0e00ab9d1'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:39.356095 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b44709ba-0ea5-4f1c-af3b-dbf0e00ab9d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adf6bd7cd9a040ff8723f40c96477b4c', 'request_id': 'req-b44709ba-0ea5-4f1c-af3b-dbf0e00ab9d1'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:39.370105 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ba4342-ec96-45e6-b809-bf223b7f7cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:39.372010 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba4342-ec96-45e6-b809-bf223b7f7cd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:39.372380 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba4342-ec96-45e6-b809-bf223b7f7cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:39.372736 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba4342-ec96-45e6-b809-bf223b7f7cd8 admin admin] PATH_INFO: `/v3/projects/deb6c0fb05664bdea18add458cb63c67/users/97242bad0b0c4764aa188aa5db2a58f1/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:39.379845 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b44709ba-0ea5-4f1c-af3b-dbf0e00ab9d1 admin admin] The token cache is being invalidate because project adf6bd7cd9a040ff8723f40c96477b4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:39:39.380468 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b44709ba-0ea5-4f1c-af3b-dbf0e00ab9d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:39.381493 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b44709ba-0ea5-4f1c-af3b-dbf0e00ab9d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:39.389317 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3720/7418] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:39:38 2022] DELETE /identity/v3/projects/adf6bd7cd9a040ff8723f40c96477b4c => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:39.390349 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44709ba-0ea5-4f1c-af3b-dbf0e00ab9d1 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:39.393770 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b44709ba-0ea5-4f1c-af3b-dbf0e00ab9d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:39.400965 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ba4342-ec96-45e6-b809-bf223b7f7cd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=deb6c0fb05664bdea18add458cb63c67, user_id=97242bad0b0c4764aa188aa5db2a58f1, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:39.408966 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ba4342-ec96-45e6-b809-bf223b7f7cd8 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:39.434150 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44709ba-0ea5-4f1c-af3b-dbf0e00ab9d1 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:39.441950 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43c8c72-d251-49b6-991a-79a7ce3d4266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:39.443410 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c8c72-d251-49b6-991a-79a7ce3d4266 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:39.443879 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c8c72-d251-49b6-991a-79a7ce3d4266 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:39.444396 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c8c72-d251-49b6-991a-79a7ce3d4266 admin admin] PATH_INFO: `/v3/projects/a451a66a82bd4ab2bb667e7de5419fa5` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:39.445901 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43c8c72-d251-49b6-991a-79a7ce3d4266 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a451a66a82bd4ab2bb667e7de5419fa5)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:39.448093 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43c8c72-d251-49b6-991a-79a7ce3d4266 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:39.523801 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3699/7419] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:39:39 2022] PUT /identity/v3/projects/deb6c0fb05664bdea18add458cb63c67/users/97242bad0b0c4764aa188aa5db2a58f1/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:39.527416 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c34d6-da45-4e16-b835-e275391173ac None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:39.529521 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c34d6-da45-4e16-b835-e275391173ac None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:39.529785 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c34d6-da45-4e16-b835-e275391173ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:39.563771 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-6d7c34d6-da45-4e16-b835-e275391173ac None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:39.565674 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-6d7c34d6-da45-4e16-b835-e275391173ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:39.624420 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b43c8c72-d251-49b6-991a-79a7ce3d4266 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a451a66a82bd4ab2bb667e7de5419fa5', 'request_id': 'req-b43c8c72-d251-49b6-991a-79a7ce3d4266'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:39.638096 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b43c8c72-d251-49b6-991a-79a7ce3d4266 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a451a66a82bd4ab2bb667e7de5419fa5', 'request_id': 'req-b43c8c72-d251-49b6-991a-79a7ce3d4266'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:39.675587 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3700/7420] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:39:39.675587 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7c34d6-da45-4e16-b835-e275391173ac None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:39.680019 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-6d7c34d6-da45-4e16-b835-e275391173ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:39.703174 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7c34d6-da45-4e16-b835-e275391173ac None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:39.725719 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b43c8c72-d251-49b6-991a-79a7ce3d4266 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a451a66a82bd4ab2bb667e7de5419fa5', 'request_id': 'req-b43c8c72-d251-49b6-991a-79a7ce3d4266'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:39.748021 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b43c8c72-d251-49b6-991a-79a7ce3d4266 admin admin] The token cache is being invalidate because project a451a66a82bd4ab2bb667e7de5419fa5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:39:39.748384 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b43c8c72-d251-49b6-991a-79a7ce3d4266 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:39.749119 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b43c8c72-d251-49b6-991a-79a7ce3d4266 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:39.751775 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3721/7421] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:39:39 2022] DELETE /identity/v3/projects/a451a66a82bd4ab2bb667e7de5419fa5 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:39.752600 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43c8c72-d251-49b6-991a-79a7ce3d4266 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:39.759104 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b43c8c72-d251-49b6-991a-79a7ce3d4266 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:39.783061 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca344d-36d3-4b70-8fbe-69b34af40994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:39.784382 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca344d-36d3-4b70-8fbe-69b34af40994 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:39.784894 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca344d-36d3-4b70-8fbe-69b34af40994 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:39.785376 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca344d-36d3-4b70-8fbe-69b34af40994 admin admin] PATH_INFO: `/v3/users/6e6ed7d44e3d4b9bb6af16f20cb6ecae` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:39.786910 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ca344d-36d3-4b70-8fbe-69b34af40994 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e6ed7d44e3d4b9bb6af16f20cb6ecae)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:39.794174 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ca344d-36d3-4b70-8fbe-69b34af40994 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:39.939059 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43c8c72-d251-49b6-991a-79a7ce3d4266 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:39.949549 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb04353a-e78f-4b3b-8fae-ba6674fe8ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:39.950512 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04353a-e78f-4b3b-8fae-ba6674fe8ee5 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:39.951340 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04353a-e78f-4b3b-8fae-ba6674fe8ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:39.952831 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04353a-e78f-4b3b-8fae-ba6674fe8ee5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:39.953196 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb04353a-e78f-4b3b-8fae-ba6674fe8ee5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:39.956058 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb04353a-e78f-4b3b-8fae-ba6674fe8ee5 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:39.970552 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3722/7422] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:39:39 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:39:39.972247 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151fb948-e04a-42e6-aaea-c213396e87d7 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:39.972643 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151fb948-e04a-42e6-aaea-c213396e87d7 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:39.973036 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151fb948-e04a-42e6-aaea-c213396e87d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:40.001463 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-50ca344d-36d3-4b70-8fbe-69b34af40994 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e6ed7d44e3d4b9bb6af16f20cb6ecae'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:40.023269 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-50ca344d-36d3-4b70-8fbe-69b34af40994 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e6ed7d44e3d4b9bb6af16f20cb6ecae'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:40.023424 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-151fb948-e04a-42e6-aaea-c213396e87d7 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:40.024962 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-50ca344d-36d3-4b70-8fbe-69b34af40994 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e6ed7d44e3d4b9bb6af16f20cb6ecae'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:40.025076 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-151fb948-e04a-42e6-aaea-c213396e87d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:40.086524 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3723/7423] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:39:40.087811 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151fb948-e04a-42e6-aaea-c213396e87d7 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:40.098002 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-151fb948-e04a-42e6-aaea-c213396e87d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:40.119261 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-50ca344d-36d3-4b70-8fbe-69b34af40994 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e6ed7d44e3d4b9bb6af16f20cb6ecae'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:40.149899 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-50ca344d-36d3-4b70-8fbe-69b34af40994 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e6ed7d44e3d4b9bb6af16f20cb6ecae'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:40.163886 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151fb948-e04a-42e6-aaea-c213396e87d7 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:40.177217 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3701/7424] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:39:39 2022] DELETE /identity/v3/users/6e6ed7d44e3d4b9bb6af16f20cb6ecae => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:40.178186 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca344d-36d3-4b70-8fbe-69b34af40994 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:40.182228 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2ce6dc-ee6e-40e4-94d1-e3082ddfe4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:40.186286 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-50ca344d-36d3-4b70-8fbe-69b34af40994 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:40.189938 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ce6dc-ee6e-40e4-94d1-e3082ddfe4ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:40.190247 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ce6dc-ee6e-40e4-94d1-e3082ddfe4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:40.190527 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ce6dc-ee6e-40e4-94d1-e3082ddfe4ec admin admin] PATH_INFO: `/v3/users/8a734b6ca794434390ae1d03cbe81a09` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:40.207884 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2ce6dc-ee6e-40e4-94d1-e3082ddfe4ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a734b6ca794434390ae1d03cbe81a09)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:40.228980 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2ce6dc-ee6e-40e4-94d1-e3082ddfe4ec admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:40.347683 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca344d-36d3-4b70-8fbe-69b34af40994 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:40.365955 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d805bb2b-c16b-484a-9a29-75abbf016e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:40.366870 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d805bb2b-c16b-484a-9a29-75abbf016e4d admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:40.367155 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d805bb2b-c16b-484a-9a29-75abbf016e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:40.367430 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d805bb2b-c16b-484a-9a29-75abbf016e4d admin admin] PATH_INFO: `/v3/projects/deb6c0fb05664bdea18add458cb63c67/users/97242bad0b0c4764aa188aa5db2a58f1/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:40.376840 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d805bb2b-c16b-484a-9a29-75abbf016e4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=deb6c0fb05664bdea18add458cb63c67, user_id=97242bad0b0c4764aa188aa5db2a58f1, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:40.380732 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d805bb2b-c16b-484a-9a29-75abbf016e4d admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:40.420661 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3702/7425] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:39:40 2022] PUT /identity/v3/projects/deb6c0fb05664bdea18add458cb63c67/users/97242bad0b0c4764aa188aa5db2a58f1/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:40.424182 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d805bb2b-c16b-484a-9a29-75abbf016e4d admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:40.431958 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-d805bb2b-c16b-484a-9a29-75abbf016e4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:40.618784 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3f2ce6dc-ee6e-40e4-94d1-e3082ddfe4ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a734b6ca794434390ae1d03cbe81a09'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:40.640009 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3f2ce6dc-ee6e-40e4-94d1-e3082ddfe4ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a734b6ca794434390ae1d03cbe81a09'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:40.663577 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3f2ce6dc-ee6e-40e4-94d1-e3082ddfe4ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a734b6ca794434390ae1d03cbe81a09'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:40.670246 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d805bb2b-c16b-484a-9a29-75abbf016e4d admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:40.678524 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ca9c6f-c6e5-4000-9838-016b7e66051d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:40.679372 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ca9c6f-c6e5-4000-9838-016b7e66051d admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:40.679920 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ca9c6f-c6e5-4000-9838-016b7e66051d admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:40.686732 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ca9c6f-c6e5-4000-9838-016b7e66051d admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:40.686732 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ca9c6f-c6e5-4000-9838-016b7e66051d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:39:40.686732 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ca9c6f-c6e5-4000-9838-016b7e66051d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:40.691118 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ca9c6f-c6e5-4000-9838-016b7e66051d admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:40.739744 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3703/7426] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:39:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:39:40.750311 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a8c513-92eb-4b84-a280-ab9d38d9bb4d None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:40.750932 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a8c513-92eb-4b84-a280-ab9d38d9bb4d None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:40.751460 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a8c513-92eb-4b84-a280-ab9d38d9bb4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:40.752519 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3f2ce6dc-ee6e-40e4-94d1-e3082ddfe4ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a734b6ca794434390ae1d03cbe81a09'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:40.753170 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3f2ce6dc-ee6e-40e4-94d1-e3082ddfe4ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a734b6ca794434390ae1d03cbe81a09'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:40.760573 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3724/7427] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:39:40 2022] DELETE /identity/v3/users/8a734b6ca794434390ae1d03cbe81a09 => generated 0 bytes in 673 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:40.764963 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2ce6dc-ee6e-40e4-94d1-e3082ddfe4ec admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:40.766382 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-3f2ce6dc-ee6e-40e4-94d1-e3082ddfe4ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:40.807544 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-c5a8c513-92eb-4b84-a280-ab9d38d9bb4d None None] MFA Rules not processed for user `97242bad0b0c4764aa188aa5db2a58f1`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:40.810662 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c5a8c513-92eb-4b84-a280-ab9d38d9bb4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:40.963211 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2ce6dc-ee6e-40e4-94d1-e3082ddfe4ec admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:40.963758 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3704/7428] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:40 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:39:40.965228 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a8c513-92eb-4b84-a280-ab9d38d9bb4d None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:40.967306 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c5a8c513-92eb-4b84-a280-ab9d38d9bb4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:40.987365 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a8c513-92eb-4b84-a280-ab9d38d9bb4d None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:40.991860 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43010f02-8657-43f7-b4dc-fa7445aaeb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:40.992557 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43010f02-8657-43f7-b4dc-fa7445aaeb9f admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:40.993047 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43010f02-8657-43f7-b4dc-fa7445aaeb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:40.993591 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd92e23-dffc-42a8-9d9e-57eec9f55472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:40.994636 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd92e23-dffc-42a8-9d9e-57eec9f55472 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:40.995099 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd92e23-dffc-42a8-9d9e-57eec9f55472 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:40.996070 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd92e23-dffc-42a8-9d9e-57eec9f55472 admin admin] PATH_INFO: `/v3/projects/18722465cc2449ee96995dd0c487479c` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:40.997753 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd92e23-dffc-42a8-9d9e-57eec9f55472 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18722465cc2449ee96995dd0c487479c)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:40.998127 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43010f02-8657-43f7-b4dc-fa7445aaeb9f admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:40.998913 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43010f02-8657-43f7-b4dc-fa7445aaeb9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:41.000915 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43010f02-8657-43f7-b4dc-fa7445aaeb9f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:41.002579 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd92e23-dffc-42a8-9d9e-57eec9f55472 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:41.155604 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3725/7429] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:39:40 2022] POST /identity/v3/projects => generated 353 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:39:41.156201 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43010f02-8657-43f7-b4dc-fa7445aaeb9f admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:41.161476 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-43010f02-8657-43f7-b4dc-fa7445aaeb9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:41.200486 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-fbd92e23-dffc-42a8-9d9e-57eec9f55472 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18722465cc2449ee96995dd0c487479c', 'request_id': 'req-fbd92e23-dffc-42a8-9d9e-57eec9f55472'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:41.222592 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-fbd92e23-dffc-42a8-9d9e-57eec9f55472 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18722465cc2449ee96995dd0c487479c', 'request_id': 'req-fbd92e23-dffc-42a8-9d9e-57eec9f55472'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:41.240021 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-fbd92e23-dffc-42a8-9d9e-57eec9f55472 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18722465cc2449ee96995dd0c487479c', 'request_id': 'req-fbd92e23-dffc-42a8-9d9e-57eec9f55472'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:41.383850 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-fbd92e23-dffc-42a8-9d9e-57eec9f55472 admin admin] The token cache is being invalidate because project 18722465cc2449ee96995dd0c487479c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:39:41.384474 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-fbd92e23-dffc-42a8-9d9e-57eec9f55472 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:41.385090 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43010f02-8657-43f7-b4dc-fa7445aaeb9f admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:41.386550 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-fbd92e23-dffc-42a8-9d9e-57eec9f55472 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:41.396323 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3705/7430] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:39:40 2022] DELETE /identity/v3/projects/18722465cc2449ee96995dd0c487479c => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:41.403510 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd92e23-dffc-42a8-9d9e-57eec9f55472 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:41.410894 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-fbd92e23-dffc-42a8-9d9e-57eec9f55472 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:41.486757 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ad14ad-62af-4c39-921e-4b65ed904394 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198271d1c0d44cb58bace41a65f4b94c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:41.487428 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad14ad-62af-4c39-921e-4b65ed904394 service cinder] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:41.488885 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad14ad-62af-4c39-921e-4b65ed904394 service cinder] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:41.489411 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad14ad-62af-4c39-921e-4b65ed904394 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:41.494636 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c4ad14ad-62af-4c39-921e-4b65ed904394 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:41.630256 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd92e23-dffc-42a8-9d9e-57eec9f55472 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:41.648438 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7247799c-74b1-4ad5-a1b4-5eb82c36f844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:41.657192 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247799c-74b1-4ad5-a1b4-5eb82c36f844 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:41.657511 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247799c-74b1-4ad5-a1b4-5eb82c36f844 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:41.657913 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247799c-74b1-4ad5-a1b4-5eb82c36f844 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:41.660737 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7247799c-74b1-4ad5-a1b4-5eb82c36f844 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:41.666369 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7247799c-74b1-4ad5-a1b4-5eb82c36f844 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:41.782078 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ad14ad-62af-4c39-921e-4b65ed904394 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:41.783890 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ad14ad-62af-4c39-921e-4b65ed904394 service cinder] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:41.800838 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3726/7431] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:39:41 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 647 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:39:41.804526 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7798445-74c7-467e-9244-d487c396792a None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:41.811003 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7798445-74c7-467e-9244-d487c396792a None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:41.811003 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7798445-74c7-467e-9244-d487c396792a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:41.830820 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-e7798445-74c7-467e-9244-d487c396792a None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:41.833868 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e7798445-74c7-467e-9244-d487c396792a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:41.849914 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3706/7432] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:39:41 2022] POST /identity/v3/users => generated 277 bytes in 452 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:39:41.852129 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7247799c-74b1-4ad5-a1b4-5eb82c36f844 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:41.875367 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7247799c-74b1-4ad5-a1b4-5eb82c36f844 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:41.890383 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3727/7433] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:39:41.919854 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98a390e-07d8-4320-a0e2-626d8e67ef9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:41.921380 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a390e-07d8-4320-a0e2-626d8e67ef9b admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:41.921870 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a390e-07d8-4320-a0e2-626d8e67ef9b admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:41.922390 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a390e-07d8-4320-a0e2-626d8e67ef9b admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:41.928509 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98a390e-07d8-4320-a0e2-626d8e67ef9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:41.935923 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98a390e-07d8-4320-a0e2-626d8e67ef9b admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:41.974678 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e378d80f-dd69-40ce-8493-a837bd4ca518 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:41.975905 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e378d80f-dd69-40ce-8493-a837bd4ca518 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:41.976361 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e378d80f-dd69-40ce-8493-a837bd4ca518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:41.978231 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3707/7434] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:39:41 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:39:41.985190 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98a390e-07d8-4320-a0e2-626d8e67ef9b admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:42.002123 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98a390e-07d8-4320-a0e2-626d8e67ef9b admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:42.005820 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-e378d80f-dd69-40ce-8493-a837bd4ca518 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:42.007399 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e378d80f-dd69-40ce-8493-a837bd4ca518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:42.012340 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29591fc9-9835-4446-a164-109828ecb705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:42.013266 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29591fc9-9835-4446-a164-109828ecb705 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:42.013616 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29591fc9-9835-4446-a164-109828ecb705 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:42.013966 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29591fc9-9835-4446-a164-109828ecb705 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:42.014750 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29591fc9-9835-4446-a164-109828ecb705 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:42.016663 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29591fc9-9835-4446-a164-109828ecb705 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:42.020563 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3728/7435] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:39:42.024553 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e378d80f-dd69-40ce-8493-a837bd4ca518 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:42.036433 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e378d80f-dd69-40ce-8493-a837bd4ca518 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:42.037591 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3708/7436] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:39:41 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:39:42.041290 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29591fc9-9835-4446-a164-109828ecb705 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:42.051592 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29591fc9-9835-4446-a164-109828ecb705 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:42.069527 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34603f98-541b-4e31-a46e-f95273534fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:42.071091 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bc1ec0-997d-4d6f-9f0b-3f041b10f88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:42.071239 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34603f98-541b-4e31-a46e-f95273534fc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:42.071551 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34603f98-541b-4e31-a46e-f95273534fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:42.071838 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34603f98-541b-4e31-a46e-f95273534fc8 admin admin] PATH_INFO: `/v3/projects/291cebe3076a45a4a01bb4b67f034f47/users/dd30758f5c8d4aa492f1adf2b0918b92/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:42.073022 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc1ec0-997d-4d6f-9f0b-3f041b10f88b admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:42.075225 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc1ec0-997d-4d6f-9f0b-3f041b10f88b admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:42.081748 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc1ec0-997d-4d6f-9f0b-3f041b10f88b admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:42.088621 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bc1ec0-997d-4d6f-9f0b-3f041b10f88b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:39:42.089107 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bc1ec0-997d-4d6f-9f0b-3f041b10f88b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:42.091340 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bc1ec0-997d-4d6f-9f0b-3f041b10f88b admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:42.091665 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34603f98-541b-4e31-a46e-f95273534fc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=291cebe3076a45a4a01bb4b67f034f47, user_id=dd30758f5c8d4aa492f1adf2b0918b92, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:42.094892 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34603f98-541b-4e31-a46e-f95273534fc8 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:42.117723 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3729/7437] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:39:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:39:42.118951 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bc1ec0-997d-4d6f-9f0b-3f041b10f88b admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:42.121403 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-25bc1ec0-997d-4d6f-9f0b-3f041b10f88b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:42.147892 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bc1ec0-997d-4d6f-9f0b-3f041b10f88b admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:42.153726 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c1ccb6-1e5c-4906-829a-a458e4deb353 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198271d1c0d44cb58bace41a65f4b94c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:42.154622 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c1ccb6-1e5c-4906-829a-a458e4deb353 service cinder] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:42.155058 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c1ccb6-1e5c-4906-829a-a458e4deb353 service cinder] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:42.155550 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c1ccb6-1e5c-4906-829a-a458e4deb353 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:42.157864 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-76c1ccb6-1e5c-4906-829a-a458e4deb353 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:42.244551 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3709/7438] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:39:42 2022] PUT /identity/v3/projects/291cebe3076a45a4a01bb4b67f034f47/users/dd30758f5c8d4aa492f1adf2b0918b92/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:42.254308 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c1ccb6-1e5c-4906-829a-a458e4deb353 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:42.256623 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c1ccb6-1e5c-4906-829a-a458e4deb353 service cinder] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:42.272784 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34603f98-541b-4e31-a46e-f95273534fc8 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:42.281510 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3730/7439] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:39:42 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:39:42.283783 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea21ae2-0101-41dd-8c40-21692b83e659 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:42.284414 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea21ae2-0101-41dd-8c40-21692b83e659 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:42.285096 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea21ae2-0101-41dd-8c40-21692b83e659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:42.377159 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-4ea21ae2-0101-41dd-8c40-21692b83e659 None None] MFA Rules not processed for user `dd30758f5c8d4aa492f1adf2b0918b92`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:42.382412 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-4ea21ae2-0101-41dd-8c40-21692b83e659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:42.420673 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34603f98-541b-4e31-a46e-f95273534fc8 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:42.427051 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06095002-0a87-48a3-8e4f-5e2e9b52367c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:42.428101 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06095002-0a87-48a3-8e4f-5e2e9b52367c admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:42.428841 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06095002-0a87-48a3-8e4f-5e2e9b52367c admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:42.429225 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06095002-0a87-48a3-8e4f-5e2e9b52367c admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:42.430031 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06095002-0a87-48a3-8e4f-5e2e9b52367c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:42.434181 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06095002-0a87-48a3-8e4f-5e2e9b52367c admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:42.536640 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3731/7440] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:42 2022] POST /identity/v3/auth/tokens => generated 3220 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:39:42.561552 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea21ae2-0101-41dd-8c40-21692b83e659 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:42.563472 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-4ea21ae2-0101-41dd-8c40-21692b83e659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:42.588612 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3710/7441] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:39:42 2022] POST /identity/v3/projects => generated 405 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:39:42.594715 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06095002-0a87-48a3-8e4f-5e2e9b52367c admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:42.725396 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea21ae2-0101-41dd-8c40-21692b83e659 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:42.765772 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06095002-0a87-48a3-8e4f-5e2e9b52367c admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:42.780191 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4898a196-bd07-4ec0-81ff-f557d62f16aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:42.786329 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898a196-bd07-4ec0-81ff-f557d62f16aa admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:42.786329 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898a196-bd07-4ec0-81ff-f557d62f16aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:42.786329 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898a196-bd07-4ec0-81ff-f557d62f16aa admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:42.786329 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4898a196-bd07-4ec0-81ff-f557d62f16aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:42.786329 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4898a196-bd07-4ec0-81ff-f557d62f16aa admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:42.789688 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9795411-3904-47c8-88f4-ce26508715c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:42.790356 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9795411-3904-47c8-88f4-ce26508715c3 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:42.790639 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9795411-3904-47c8-88f4-ce26508715c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:42.790920 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9795411-3904-47c8-88f4-ce26508715c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:42.859984 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9795411-3904-47c8-88f4-ce26508715c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:42.861874 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9795411-3904-47c8-88f4-ce26508715c3 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:42.881664 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3732/7442] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:39:42 2022] GET /identity/v3/auth/tokens => generated 3220 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:39:42.882813 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9795411-3904-47c8-88f4-ce26508715c3 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:42.884474 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-f9795411-3904-47c8-88f4-ce26508715c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:42.910155 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9795411-3904-47c8-88f4-ce26508715c3 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:42.922188 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3711/7443] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:39:42 2022] POST /identity/v3/users => generated 303 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:39:42.922188 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4898a196-bd07-4ec0-81ff-f557d62f16aa admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:42.936125 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f65a2d4-f600-4fbf-95a6-e3f5292f4cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:42.938230 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f65a2d4-f600-4fbf-95a6-e3f5292f4cf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:42.941409 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4898a196-bd07-4ec0-81ff-f557d62f16aa admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:42.946572 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f65a2d4-f600-4fbf-95a6-e3f5292f4cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:42.947076 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f65a2d4-f600-4fbf-95a6-e3f5292f4cf1 admin admin] PATH_INFO: `/v3/projects/4c77d67f97804c55aec467cdd9d39a88` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:42.949182 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f65a2d4-f600-4fbf-95a6-e3f5292f4cf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c77d67f97804c55aec467cdd9d39a88)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:42.951556 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f65a2d4-f600-4fbf-95a6-e3f5292f4cf1 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:42.954220 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02abe08-3733-4719-b8d8-d5211659f6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:42.955983 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02abe08-3733-4719-b8d8-d5211659f6b5 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:42.955983 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02abe08-3733-4719-b8d8-d5211659f6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:42.956275 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02abe08-3733-4719-b8d8-d5211659f6b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:42.963560 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02abe08-3733-4719-b8d8-d5211659f6b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:42.964695 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02abe08-3733-4719-b8d8-d5211659f6b5 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:42.991008 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3712/7444] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:39:42 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:39:43.002273 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02abe08-3733-4719-b8d8-d5211659f6b5 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:43.016536 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02abe08-3733-4719-b8d8-d5211659f6b5 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:43.038773 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be4b80-c2b8-471d-9107-c69f8bea1d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:43.040554 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be4b80-c2b8-471d-9107-c69f8bea1d2f admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:43.041087 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be4b80-c2b8-471d-9107-c69f8bea1d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:43.041442 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be4b80-c2b8-471d-9107-c69f8bea1d2f admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:43.042939 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1be4b80-c2b8-471d-9107-c69f8bea1d2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:43.044988 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1be4b80-c2b8-471d-9107-c69f8bea1d2f admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:43.087864 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3713/7445] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:39:43 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:39:43.091506 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be4b80-c2b8-471d-9107-c69f8bea1d2f admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:43.096098 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c1be4b80-c2b8-471d-9107-c69f8bea1d2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:43.143189 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be4b80-c2b8-471d-9107-c69f8bea1d2f admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:43.150223 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2f65a2d4-f600-4fbf-95a6-e3f5292f4cf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c77d67f97804c55aec467cdd9d39a88', 'request_id': 'req-2f65a2d4-f600-4fbf-95a6-e3f5292f4cf1'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:43.161635 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2f65a2d4-f600-4fbf-95a6-e3f5292f4cf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c77d67f97804c55aec467cdd9d39a88', 'request_id': 'req-2f65a2d4-f600-4fbf-95a6-e3f5292f4cf1'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:43.277979 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28effb4-85bb-4b9a-97e1-d636c3f200d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:43.280078 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28effb4-85bb-4b9a-97e1-d636c3f200d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:43.280078 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28effb4-85bb-4b9a-97e1-d636c3f200d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:43.280078 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28effb4-85bb-4b9a-97e1-d636c3f200d0 admin admin] PATH_INFO: `/v3/users/2de3fe1026c7400193be7bd68ad6303a` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:43.288516 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28effb4-85bb-4b9a-97e1-d636c3f200d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2de3fe1026c7400193be7bd68ad6303a)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:43.292543 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28effb4-85bb-4b9a-97e1-d636c3f200d0 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:43.303136 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2f65a2d4-f600-4fbf-95a6-e3f5292f4cf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c77d67f97804c55aec467cdd9d39a88', 'request_id': 'req-2f65a2d4-f600-4fbf-95a6-e3f5292f4cf1'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:43.326126 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2f65a2d4-f600-4fbf-95a6-e3f5292f4cf1 admin admin] The token cache is being invalidate because project 4c77d67f97804c55aec467cdd9d39a88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:39:43.326425 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2f65a2d4-f600-4fbf-95a6-e3f5292f4cf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:43.334309 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2f65a2d4-f600-4fbf-95a6-e3f5292f4cf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:43.343440 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3733/7446] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:39:42 2022] DELETE /identity/v3/projects/4c77d67f97804c55aec467cdd9d39a88 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:43.343440 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f65a2d4-f600-4fbf-95a6-e3f5292f4cf1 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:43.348216 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-2f65a2d4-f600-4fbf-95a6-e3f5292f4cf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:43.395892 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f65a2d4-f600-4fbf-95a6-e3f5292f4cf1 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:43.402628 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dd412a-c0c0-45c0-a1d6-72d9103406ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:43.403872 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd412a-c0c0-45c0-a1d6-72d9103406ed admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:43.404312 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd412a-c0c0-45c0-a1d6-72d9103406ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:43.404790 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd412a-c0c0-45c0-a1d6-72d9103406ed admin admin] PATH_INFO: `/v3/projects/882c775cc8694e0aab28c39b98827f8c/users/43b8ae7176574269b187ce6f4a3344ac/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:43.437766 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dd412a-c0c0-45c0-a1d6-72d9103406ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=882c775cc8694e0aab28c39b98827f8c, user_id=43b8ae7176574269b187ce6f4a3344ac, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:43.449068 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dd412a-c0c0-45c0-a1d6-72d9103406ed admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:43.578522 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d28effb4-85bb-4b9a-97e1-d636c3f200d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2de3fe1026c7400193be7bd68ad6303a'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:43.593078 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d28effb4-85bb-4b9a-97e1-d636c3f200d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2de3fe1026c7400193be7bd68ad6303a'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:43.593927 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d28effb4-85bb-4b9a-97e1-d636c3f200d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2de3fe1026c7400193be7bd68ad6303a'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:43.619036 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3734/7447] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:39:43 2022] PUT /identity/v3/projects/882c775cc8694e0aab28c39b98827f8c/users/43b8ae7176574269b187ce6f4a3344ac/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:43.624364 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa1426-8d7e-4cb8-926f-02e9f5467dca None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:43.624364 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa1426-8d7e-4cb8-926f-02e9f5467dca None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:43.624364 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa1426-8d7e-4cb8-926f-02e9f5467dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:43.643829 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-0cfa1426-8d7e-4cb8-926f-02e9f5467dca None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:43.645618 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-0cfa1426-8d7e-4cb8-926f-02e9f5467dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:43.713491 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d28effb4-85bb-4b9a-97e1-d636c3f200d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2de3fe1026c7400193be7bd68ad6303a'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:43.731295 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d28effb4-85bb-4b9a-97e1-d636c3f200d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2de3fe1026c7400193be7bd68ad6303a'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:43.738585 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3714/7448] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:39:43 2022] DELETE /identity/v3/users/2de3fe1026c7400193be7bd68ad6303a => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:43.740287 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bab59a-ea3b-4681-9870-a187c2589373 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:43.746109 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bab59a-ea3b-4681-9870-a187c2589373 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:43.746109 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bab59a-ea3b-4681-9870-a187c2589373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:43.767880 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-13bab59a-ea3b-4681-9870-a187c2589373 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:43.769107 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-13bab59a-ea3b-4681-9870-a187c2589373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:43.775562 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3735/7449] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:39:43.778972 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9866923d-30d5-4e16-90ec-18add32cbdff None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:43.779425 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9866923d-30d5-4e16-90ec-18add32cbdff None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:43.781929 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9866923d-30d5-4e16-90ec-18add32cbdff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:43.825077 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-9866923d-30d5-4e16-90ec-18add32cbdff None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:43.827029 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-9866923d-30d5-4e16-90ec-18add32cbdff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:43.903279 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3715/7450] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:39:43.906701 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7008bef6-b28a-4ebd-b05c-99eb40c5f3ac None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:43.906992 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7008bef6-b28a-4ebd-b05c-99eb40c5f3ac None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:43.907278 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7008bef6-b28a-4ebd-b05c-99eb40c5f3ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:43.955786 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-7008bef6-b28a-4ebd-b05c-99eb40c5f3ac None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:43.958749 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-7008bef6-b28a-4ebd-b05c-99eb40c5f3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:43.974637 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3736/7451] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:39:43.979953 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9866923d-30d5-4e16-90ec-18add32cbdff None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:43.980625 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3716/7452] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:39:43.996635 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9866923d-30d5-4e16-90ec-18add32cbdff None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:43.999789 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7008bef6-b28a-4ebd-b05c-99eb40c5f3ac None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:44.001354 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-7008bef6-b28a-4ebd-b05c-99eb40c5f3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:44.018172 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d7ea05-445a-4cc5-87e7-1faed1d957c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:44.021744 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d7ea05-445a-4cc5-87e7-1faed1d957c3 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:44.022185 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d7ea05-445a-4cc5-87e7-1faed1d957c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:44.022478 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d7ea05-445a-4cc5-87e7-1faed1d957c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:44.024339 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d7ea05-445a-4cc5-87e7-1faed1d957c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:39:44.024661 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d7ea05-445a-4cc5-87e7-1faed1d957c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:44.029718 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d7ea05-445a-4cc5-87e7-1faed1d957c3 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:44.051729 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3737/7453] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:39:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:39:44.052809 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d7ea05-445a-4cc5-87e7-1faed1d957c3 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:44.056269 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-76d7ea05-445a-4cc5-87e7-1faed1d957c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:44.137961 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7008bef6-b28a-4ebd-b05c-99eb40c5f3ac None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:44.144431 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41222997-0679-4a2e-8581-1a0d77528724 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:44.145375 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41222997-0679-4a2e-8581-1a0d77528724 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:44.146844 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41222997-0679-4a2e-8581-1a0d77528724 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:44.146844 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41222997-0679-4a2e-8581-1a0d77528724 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:44.155683 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d7ea05-445a-4cc5-87e7-1faed1d957c3 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:44.158611 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41222997-0679-4a2e-8581-1a0d77528724 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:44.160454 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e1e5d9-46a7-496c-bb80-83b3300623e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:44.160977 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41222997-0679-4a2e-8581-1a0d77528724 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:44.162107 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e1e5d9-46a7-496c-bb80-83b3300623e6 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:44.162669 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e1e5d9-46a7-496c-bb80-83b3300623e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:44.162868 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e1e5d9-46a7-496c-bb80-83b3300623e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:44.190377 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e1e5d9-46a7-496c-bb80-83b3300623e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:44.192879 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3717/7454] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:39:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:39:44.193496 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e1e5d9-46a7-496c-bb80-83b3300623e6 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:44.193855 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41222997-0679-4a2e-8581-1a0d77528724 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:44.220114 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41222997-0679-4a2e-8581-1a0d77528724 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:44.226848 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3738/7455] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:39:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:39:44.236040 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112f551-950d-4661-a797-c1b0d629e543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:44.239129 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112f551-950d-4661-a797-c1b0d629e543 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:44.240254 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112f551-950d-4661-a797-c1b0d629e543 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:44.240553 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112f551-950d-4661-a797-c1b0d629e543 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:44.241689 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6112f551-950d-4661-a797-c1b0d629e543 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:44.246346 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6112f551-950d-4661-a797-c1b0d629e543 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:44.439062 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3718/7456] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:39:44 2022] POST /identity/v3/projects => generated 385 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:39:44.443252 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e1e5d9-46a7-496c-bb80-83b3300623e6 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:44.459649 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e1e5d9-46a7-496c-bb80-83b3300623e6 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:44.594740 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0279f8a7-1c81-4bc7-b2e3-5417c2d2612d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:44.595609 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279f8a7-1c81-4bc7-b2e3-5417c2d2612d admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:44.596001 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279f8a7-1c81-4bc7-b2e3-5417c2d2612d admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:44.596394 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279f8a7-1c81-4bc7-b2e3-5417c2d2612d admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:44.597299 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0279f8a7-1c81-4bc7-b2e3-5417c2d2612d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:44.601289 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0279f8a7-1c81-4bc7-b2e3-5417c2d2612d admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:44.716621 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3739/7457] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:39:44 2022] POST /identity/v3/users => generated 293 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:39:44.721809 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112f551-950d-4661-a797-c1b0d629e543 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:44.739416 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112f551-950d-4661-a797-c1b0d629e543 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:44.752504 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df08b816-c9e9-498c-b0f8-855d26a499b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:44.753206 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df08b816-c9e9-498c-b0f8-855d26a499b3 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:44.753498 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df08b816-c9e9-498c-b0f8-855d26a499b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:44.753778 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df08b816-c9e9-498c-b0f8-855d26a499b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:44.754517 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df08b816-c9e9-498c-b0f8-855d26a499b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:44.756195 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df08b816-c9e9-498c-b0f8-855d26a499b3 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:44.796093 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3719/7458] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:39:44 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:39:44.797413 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0279f8a7-1c81-4bc7-b2e3-5417c2d2612d admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:44.822016 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0279f8a7-1c81-4bc7-b2e3-5417c2d2612d admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:44.842327 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c3a7a2-f8a0-4535-82d9-99db14593522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:44.843035 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c3a7a2-f8a0-4535-82d9-99db14593522 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:44.843326 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c3a7a2-f8a0-4535-82d9-99db14593522 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:44.843771 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c3a7a2-f8a0-4535-82d9-99db14593522 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:44.844911 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c3a7a2-f8a0-4535-82d9-99db14593522 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:44.846175 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c3a7a2-f8a0-4535-82d9-99db14593522 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:44.877611 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3740/7459] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:39:44 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:39:44.881764 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df08b816-c9e9-498c-b0f8-855d26a499b3 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:44.896740 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df08b816-c9e9-498c-b0f8-855d26a499b3 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:44.908233 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b8c860-1683-4eff-b6e3-0ecbec0f5c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:44.909155 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b8c860-1683-4eff-b6e3-0ecbec0f5c4e admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:44.909543 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b8c860-1683-4eff-b6e3-0ecbec0f5c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:44.909701 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b8c860-1683-4eff-b6e3-0ecbec0f5c4e admin admin] PATH_INFO: `/v3/projects/26300f67535247758fbda7e0000bec7a/users/1e691c70db224be383a5ba2458bdd400/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:44.991734 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b8c860-1683-4eff-b6e3-0ecbec0f5c4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=26300f67535247758fbda7e0000bec7a, user_id=1e691c70db224be383a5ba2458bdd400, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:44.994291 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b8c860-1683-4eff-b6e3-0ecbec0f5c4e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:45.115409 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3720/7460] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:39:44 2022] PUT /identity/v3/projects/26300f67535247758fbda7e0000bec7a/users/1e691c70db224be383a5ba2458bdd400/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:45.127619 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a3a72-8da0-4fbc-ae86-64ebd0b6219f None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:45.128273 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a3a72-8da0-4fbc-ae86-64ebd0b6219f None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:45.128422 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a3a72-8da0-4fbc-ae86-64ebd0b6219f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:45.189888 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-879a3a72-8da0-4fbc-ae86-64ebd0b6219f None None] MFA Rules not processed for user `1e691c70db224be383a5ba2458bdd400`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:45.191849 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-879a3a72-8da0-4fbc-ae86-64ebd0b6219f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:45.369882 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3741/7461] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:39:45.372919 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b8c860-1683-4eff-b6e3-0ecbec0f5c4e admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:45.389062 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879a3a72-8da0-4fbc-ae86-64ebd0b6219f None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:45.391687 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-879a3a72-8da0-4fbc-ae86-64ebd0b6219f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:45.509783 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b8c860-1683-4eff-b6e3-0ecbec0f5c4e admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:45.515601 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb1562-f422-40de-afe2-b65afa6f4f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:45.517478 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb1562-f422-40de-afe2-b65afa6f4f7e admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:45.518101 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb1562-f422-40de-afe2-b65afa6f4f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:45.518525 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb1562-f422-40de-afe2-b65afa6f4f7e admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:45.519401 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cb1562-f422-40de-afe2-b65afa6f4f7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:45.539993 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cb1562-f422-40de-afe2-b65afa6f4f7e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:45.587968 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879a3a72-8da0-4fbc-ae86-64ebd0b6219f None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:45.621111 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ba447-c536-4718-b3f2-02f61efce8b7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:45.622578 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ba447-c536-4718-b3f2-02f61efce8b7 service placement] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:45.623091 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ba447-c536-4718-b3f2-02f61efce8b7 service placement] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:45.623357 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ba447-c536-4718-b3f2-02f61efce8b7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:45.625419 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-9a1ba447-c536-4718-b3f2-02f61efce8b7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:45.643110 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1ba447-c536-4718-b3f2-02f61efce8b7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:45.652853 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1ba447-c536-4718-b3f2-02f61efce8b7 service placement] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:45.680819 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3721/7462] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:39:45 2022] POST /identity/v3/projects => generated 385 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:39:45.684987 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb1562-f422-40de-afe2-b65afa6f4f7e admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:45.692660 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3742/7463] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:39:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:39:45.778578 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb1562-f422-40de-afe2-b65afa6f4f7e admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:45.784201 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e395b7c4-cf88-4223-8598-f10d1e0af2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:45.785096 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395b7c4-cf88-4223-8598-f10d1e0af2f6 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:45.785584 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395b7c4-cf88-4223-8598-f10d1e0af2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:45.786125 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395b7c4-cf88-4223-8598-f10d1e0af2f6 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:45.786991 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e395b7c4-cf88-4223-8598-f10d1e0af2f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:45.789206 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e395b7c4-cf88-4223-8598-f10d1e0af2f6 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:45.935131 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ba447-c536-4718-b3f2-02f61efce8b7 service placement] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:45.937239 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-9a1ba447-c536-4718-b3f2-02f61efce8b7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:45.942280 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3722/7464] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:39:45 2022] POST /identity/v3/users => generated 293 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:39:45.943622 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e395b7c4-cf88-4223-8598-f10d1e0af2f6 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:45.959262 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e395b7c4-cf88-4223-8598-f10d1e0af2f6 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:45.967143 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ad3346-d971-46c6-94d0-9dc9f35b33eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:45.972290 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ba447-c536-4718-b3f2-02f61efce8b7 service placement] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:45.980233 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d051789-c52d-4ee1-b8cc-9be2fa9af4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:45.981926 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d051789-c52d-4ee1-b8cc-9be2fa9af4c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:45.982442 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d051789-c52d-4ee1-b8cc-9be2fa9af4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:45.982810 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad3346-d971-46c6-94d0-9dc9f35b33eb admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:45.983110 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d051789-c52d-4ee1-b8cc-9be2fa9af4c3 admin admin] PATH_INFO: `/v3/projects/75be348dedbd44a58d2be6ad8b4bedfc` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:45.984439 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad3346-d971-46c6-94d0-9dc9f35b33eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:45.984799 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad3346-d971-46c6-94d0-9dc9f35b33eb admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:45.986160 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ad3346-d971-46c6-94d0-9dc9f35b33eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:45.995208 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d051789-c52d-4ee1-b8cc-9be2fa9af4c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75be348dedbd44a58d2be6ad8b4bedfc)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:46.005903 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ad3346-d971-46c6-94d0-9dc9f35b33eb admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:46.006322 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d051789-c52d-4ee1-b8cc-9be2fa9af4c3 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:46.040094 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3723/7465] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:39:46.044813 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ad3346-d971-46c6-94d0-9dc9f35b33eb admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:46.069829 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ad3346-d971-46c6-94d0-9dc9f35b33eb admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:46.084472 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026aa28-9c4c-4ec8-8a10-1803a1b65f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:46.085446 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026aa28-9c4c-4ec8-8a10-1803a1b65f56 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:46.085984 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026aa28-9c4c-4ec8-8a10-1803a1b65f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:46.086432 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026aa28-9c4c-4ec8-8a10-1803a1b65f56 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:46.087368 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f026aa28-9c4c-4ec8-8a10-1803a1b65f56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:46.092153 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f026aa28-9c4c-4ec8-8a10-1803a1b65f56 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:46.123232 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3724/7466] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:39:46 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:39:46.128192 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026aa28-9c4c-4ec8-8a10-1803a1b65f56 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:46.164328 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026aa28-9c4c-4ec8-8a10-1803a1b65f56 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:46.173713 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4b774c-88a3-4431-9a25-501325768abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:46.174545 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4b774c-88a3-4431-9a25-501325768abc admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:46.174829 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4b774c-88a3-4431-9a25-501325768abc admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:46.175105 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4b774c-88a3-4431-9a25-501325768abc admin admin] PATH_INFO: `/v3/projects/979944a7425f41bf8cd3daa06d466200/users/cc508b9acb364b628a57ff2a2c783ecc/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:46.218595 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4b774c-88a3-4431-9a25-501325768abc admin admin] RBAC: Authorizing `identity:create_grant(project_id=979944a7425f41bf8cd3daa06d466200, user_id=cc508b9acb364b628a57ff2a2c783ecc, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:46.221673 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4b774c-88a3-4431-9a25-501325768abc admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:46.231437 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0d051789-c52d-4ee1-b8cc-9be2fa9af4c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75be348dedbd44a58d2be6ad8b4bedfc', 'request_id': 'req-0d051789-c52d-4ee1-b8cc-9be2fa9af4c3'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:46.246882 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0d051789-c52d-4ee1-b8cc-9be2fa9af4c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75be348dedbd44a58d2be6ad8b4bedfc', 'request_id': 'req-0d051789-c52d-4ee1-b8cc-9be2fa9af4c3'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:46.411534 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0d051789-c52d-4ee1-b8cc-9be2fa9af4c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75be348dedbd44a58d2be6ad8b4bedfc', 'request_id': 'req-0d051789-c52d-4ee1-b8cc-9be2fa9af4c3'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:46.425144 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3725/7467] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:39:46 2022] PUT /identity/v3/projects/979944a7425f41bf8cd3daa06d466200/users/cc508b9acb364b628a57ff2a2c783ecc/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:46.431340 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e886e31-b504-478f-a282-bc866fcdf0d1 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:46.431659 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e886e31-b504-478f-a282-bc866fcdf0d1 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:46.431941 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e886e31-b504-478f-a282-bc866fcdf0d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:46.438329 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0d051789-c52d-4ee1-b8cc-9be2fa9af4c3 admin admin] The token cache is being invalidate because project 75be348dedbd44a58d2be6ad8b4bedfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:39:46.438635 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0d051789-c52d-4ee1-b8cc-9be2fa9af4c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:46.440103 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0d051789-c52d-4ee1-b8cc-9be2fa9af4c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:46.444462 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3743/7468] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:39:45 2022] DELETE /identity/v3/projects/75be348dedbd44a58d2be6ad8b4bedfc => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:46.449405 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d051789-c52d-4ee1-b8cc-9be2fa9af4c3 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:46.454323 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-0d051789-c52d-4ee1-b8cc-9be2fa9af4c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:46.494397 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-7e886e31-b504-478f-a282-bc866fcdf0d1 None None] MFA Rules not processed for user `cc508b9acb364b628a57ff2a2c783ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:46.496821 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-7e886e31-b504-478f-a282-bc866fcdf0d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:46.598142 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d051789-c52d-4ee1-b8cc-9be2fa9af4c3 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:46.609304 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3726/7469] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:39:46.613778 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e886e31-b504-478f-a282-bc866fcdf0d1 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:46.615622 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-7e886e31-b504-478f-a282-bc866fcdf0d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:46.734441 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e886e31-b504-478f-a282-bc866fcdf0d1 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:46.745425 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce94ab3b-06fb-4939-bc9c-e260c7dcfcf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:46.747419 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94ab3b-06fb-4939-bc9c-e260c7dcfcf3 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:46.748231 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94ab3b-06fb-4939-bc9c-e260c7dcfcf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:46.752153 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94ab3b-06fb-4939-bc9c-e260c7dcfcf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:46.752153 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce94ab3b-06fb-4939-bc9c-e260c7dcfcf3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:46.753628 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce94ab3b-06fb-4939-bc9c-e260c7dcfcf3 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:46.777138 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cff6adc-1900-497e-b8a5-3b8c517c33a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:46.778439 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff6adc-1900-497e-b8a5-3b8c517c33a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:46.778918 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff6adc-1900-497e-b8a5-3b8c517c33a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:46.779214 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff6adc-1900-497e-b8a5-3b8c517c33a6 admin admin] PATH_INFO: `/v3/users/97242bad0b0c4764aa188aa5db2a58f1` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:46.781759 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cff6adc-1900-497e-b8a5-3b8c517c33a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97242bad0b0c4764aa188aa5db2a58f1)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:46.783327 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cff6adc-1900-497e-b8a5-3b8c517c33a6 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:46.906459 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3727/7470] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:39:46 2022] POST /identity/v3/projects => generated 387 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:39:46.911142 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce94ab3b-06fb-4939-bc9c-e260c7dcfcf3 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:47.035789 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce94ab3b-06fb-4939-bc9c-e260c7dcfcf3 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:47.041668 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471662fd-658b-4356-80d8-90f0ebd32f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:47.044499 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471662fd-658b-4356-80d8-90f0ebd32f69 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:47.044499 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471662fd-658b-4356-80d8-90f0ebd32f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:47.044499 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471662fd-658b-4356-80d8-90f0ebd32f69 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:47.044760 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471662fd-658b-4356-80d8-90f0ebd32f69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:47.048242 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471662fd-658b-4356-80d8-90f0ebd32f69 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:47.057201 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-1cff6adc-1900-497e-b8a5-3b8c517c33a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97242bad0b0c4764aa188aa5db2a58f1'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:47.073203 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-1cff6adc-1900-497e-b8a5-3b8c517c33a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97242bad0b0c4764aa188aa5db2a58f1'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:47.085295 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-1cff6adc-1900-497e-b8a5-3b8c517c33a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97242bad0b0c4764aa188aa5db2a58f1'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:47.152170 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-1cff6adc-1900-497e-b8a5-3b8c517c33a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97242bad0b0c4764aa188aa5db2a58f1'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:47.152170 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-1cff6adc-1900-497e-b8a5-3b8c517c33a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97242bad0b0c4764aa188aa5db2a58f1'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:47.163082 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3744/7471] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:39:46 2022] DELETE /identity/v3/users/97242bad0b0c4764aa188aa5db2a58f1 => generated 0 bytes in 714 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:47.166084 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3728/7472] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:39:46 2022] POST /identity/v3/users => generated 300 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:39:47.169837 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cff6adc-1900-497e-b8a5-3b8c517c33a6 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:47.184374 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-1cff6adc-1900-497e-b8a5-3b8c517c33a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:47.340600 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cff6adc-1900-497e-b8a5-3b8c517c33a6 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:47.346689 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e08df-4e56-4968-8b2c-ceaef64582d7 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:47.346982 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e08df-4e56-4968-8b2c-ceaef64582d7 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:47.347257 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e08df-4e56-4968-8b2c-ceaef64582d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:47.350901 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc3f682-0ea8-45f6-b306-f4cba1fd135b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:47.351623 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc3f682-0ea8-45f6-b306-f4cba1fd135b admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:47.351910 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc3f682-0ea8-45f6-b306-f4cba1fd135b admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:47.352186 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc3f682-0ea8-45f6-b306-f4cba1fd135b admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:47.354335 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc3f682-0ea8-45f6-b306-f4cba1fd135b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:47.359318 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc3f682-0ea8-45f6-b306-f4cba1fd135b admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:47.382133 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3745/7473] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:39:47.387111 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc3f682-0ea8-45f6-b306-f4cba1fd135b admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:47.406583 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc3f682-0ea8-45f6-b306-f4cba1fd135b admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:47.410250 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-4a6e08df-4e56-4968-8b2c-ceaef64582d7 None None] MFA Rules not processed for user `43b8ae7176574269b187ce6f4a3344ac`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:47.412096 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-4a6e08df-4e56-4968-8b2c-ceaef64582d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:47.412977 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aef9952-1462-42be-b3b1-1bf1d0e0c364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:47.413622 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef9952-1462-42be-b3b1-1bf1d0e0c364 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:47.414036 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef9952-1462-42be-b3b1-1bf1d0e0c364 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:47.414206 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef9952-1462-42be-b3b1-1bf1d0e0c364 admin admin] PATH_INFO: `/v3/projects/7f0a924a0b034805985dd5bd09a74631/users/b79266843a53421bbd768566686ba032/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:47.435941 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aef9952-1462-42be-b3b1-1bf1d0e0c364 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f0a924a0b034805985dd5bd09a74631, user_id=b79266843a53421bbd768566686ba032, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:47.440148 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aef9952-1462-42be-b3b1-1bf1d0e0c364 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:47.522242 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3746/7474] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:39:47 2022] PUT /identity/v3/projects/7f0a924a0b034805985dd5bd09a74631/users/b79266843a53421bbd768566686ba032/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:47.527459 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aef9952-1462-42be-b3b1-1bf1d0e0c364 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:47.528847 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3729/7475] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:47 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:39:47.532999 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e08df-4e56-4968-8b2c-ceaef64582d7 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:47.534402 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-4a6e08df-4e56-4968-8b2c-ceaef64582d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:47.549616 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e08df-4e56-4968-8b2c-ceaef64582d7 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:47.653491 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee6ae5-b07a-41a2-a96d-e54dfa7ca662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:47.654575 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee6ae5-b07a-41a2-a96d-e54dfa7ca662 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:47.654696 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee6ae5-b07a-41a2-a96d-e54dfa7ca662 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:47.654913 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee6ae5-b07a-41a2-a96d-e54dfa7ca662 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:47.655973 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ee6ae5-b07a-41a2-a96d-e54dfa7ca662 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:47.661489 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ee6ae5-b07a-41a2-a96d-e54dfa7ca662 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:47.693268 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aef9952-1462-42be-b3b1-1bf1d0e0c364 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:47.705273 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c32693-9d55-4974-a710-10c835ce46c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:47.706159 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c32693-9d55-4974-a710-10c835ce46c8 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:47.706308 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c32693-9d55-4974-a710-10c835ce46c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:47.706742 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c32693-9d55-4974-a710-10c835ce46c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:47.707515 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c32693-9d55-4974-a710-10c835ce46c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:47.709411 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c32693-9d55-4974-a710-10c835ce46c8 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:47.721932 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3747/7476] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:39:47.725694 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c32693-9d55-4974-a710-10c835ce46c8 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:47.737633 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c32693-9d55-4974-a710-10c835ce46c8 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:47.742915 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204b6c9f-b53d-4315-803b-852f71b25ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:47.751244 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b6c9f-b53d-4315-803b-852f71b25ae7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:47.751244 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b6c9f-b53d-4315-803b-852f71b25ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:47.751244 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b6c9f-b53d-4315-803b-852f71b25ae7 admin admin] PATH_INFO: `/v3/projects/7f0a924a0b034805985dd5bd09a74631/users/b79266843a53421bbd768566686ba032/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:47.751244 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204b6c9f-b53d-4315-803b-852f71b25ae7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f0a924a0b034805985dd5bd09a74631, user_id=b79266843a53421bbd768566686ba032, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:47.751244 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204b6c9f-b53d-4315-803b-852f71b25ae7 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:47.795259 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3730/7477] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:39:47 2022] POST /identity/v3/projects => generated 405 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:39:47.795259 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee6ae5-b07a-41a2-a96d-e54dfa7ca662 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:47.812177 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3748/7478] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:39:47 2022] PUT /identity/v3/projects/7f0a924a0b034805985dd5bd09a74631/users/b79266843a53421bbd768566686ba032/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:39:47.813844 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be7a23-8f11-4246-9ad2-99861ad4ee6d None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:47.814175 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be7a23-8f11-4246-9ad2-99861ad4ee6d None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:47.814468 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be7a23-8f11-4246-9ad2-99861ad4ee6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:47.855422 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-10be7a23-8f11-4246-9ad2-99861ad4ee6d None None] MFA Rules not processed for user `b79266843a53421bbd768566686ba032`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:47.857880 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-10be7a23-8f11-4246-9ad2-99861ad4ee6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:47.965598 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee6ae5-b07a-41a2-a96d-e54dfa7ca662 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:47.980598 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4bacb9-8ab3-4ca5-ae67-5b9552e9b4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:47.981291 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4bacb9-8ab3-4ca5-ae67-5b9552e9b4a4 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:47.981574 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4bacb9-8ab3-4ca5-ae67-5b9552e9b4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:47.981848 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4bacb9-8ab3-4ca5-ae67-5b9552e9b4a4 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:47.982542 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4bacb9-8ab3-4ca5-ae67-5b9552e9b4a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:47.984975 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4bacb9-8ab3-4ca5-ae67-5b9552e9b4a4 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:47.995515 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3749/7479] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:47 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:39:47.996865 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be7a23-8f11-4246-9ad2-99861ad4ee6d None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:47.998321 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-10be7a23-8f11-4246-9ad2-99861ad4ee6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:48.079816 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be7a23-8f11-4246-9ad2-99861ad4ee6d None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:48.085611 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb855f-344c-4d1e-8e31-5c54838ffe53 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:48.086279 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb855f-344c-4d1e-8e31-5c54838ffe53 service placement] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:48.086594 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb855f-344c-4d1e-8e31-5c54838ffe53 service placement] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:48.087015 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb855f-344c-4d1e-8e31-5c54838ffe53 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:48.088958 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d4bb855f-344c-4d1e-8e31-5c54838ffe53 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:48.115019 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3731/7480] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:39:47 2022] POST /identity/v3/users => generated 303 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:39:48.116560 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4bacb9-8ab3-4ca5-ae67-5b9552e9b4a4 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:48.122987 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-3d4bacb9-8ab3-4ca5-ae67-5b9552e9b4a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:48.125338 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bb855f-344c-4d1e-8e31-5c54838ffe53 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:48.127161 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bb855f-344c-4d1e-8e31-5c54838ffe53 service placement] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:48.153324 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3750/7481] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:39:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:39:48.154675 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb855f-344c-4d1e-8e31-5c54838ffe53 service placement] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:48.156657 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d4bb855f-344c-4d1e-8e31-5c54838ffe53 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:48.175167 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb855f-344c-4d1e-8e31-5c54838ffe53 service placement] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:48.180469 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e887c0e4-c366-4551-8676-4da7ad0f57ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:48.181384 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e887c0e4-c366-4551-8676-4da7ad0f57ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:48.181675 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e887c0e4-c366-4551-8676-4da7ad0f57ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:48.181967 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e887c0e4-c366-4551-8676-4da7ad0f57ae admin admin] PATH_INFO: `/v3/projects/deb6c0fb05664bdea18add458cb63c67` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:48.184914 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e887c0e4-c366-4551-8676-4da7ad0f57ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=deb6c0fb05664bdea18add458cb63c67)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:48.187545 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e887c0e4-c366-4551-8676-4da7ad0f57ae admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:48.232186 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4bacb9-8ab3-4ca5-ae67-5b9552e9b4a4 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:48.236005 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35064d7f-49e9-4e0c-b4de-f836f5b26eed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198271d1c0d44cb58bace41a65f4b94c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:48.236658 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35064d7f-49e9-4e0c-b4de-f836f5b26eed service cinder] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:48.236946 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35064d7f-49e9-4e0c-b4de-f836f5b26eed service cinder] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:48.237223 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35064d7f-49e9-4e0c-b4de-f836f5b26eed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:48.249588 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35064d7f-49e9-4e0c-b4de-f836f5b26eed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:48.251952 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35064d7f-49e9-4e0c-b4de-f836f5b26eed service cinder] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:48.263019 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3732/7482] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:39:48 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:39:48.263858 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35064d7f-49e9-4e0c-b4de-f836f5b26eed service cinder] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:48.275915 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35064d7f-49e9-4e0c-b4de-f836f5b26eed service cinder] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:48.281779 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a04521-b685-43f0-9029-685f9f23bb36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:48.282582 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a04521-b685-43f0-9029-685f9f23bb36 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:48.282855 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a04521-b685-43f0-9029-685f9f23bb36 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:48.283325 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a04521-b685-43f0-9029-685f9f23bb36 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:48.284087 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a04521-b685-43f0-9029-685f9f23bb36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:48.286008 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a04521-b685-43f0-9029-685f9f23bb36 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:48.312327 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3733/7483] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:39:48 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:39:48.312327 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a04521-b685-43f0-9029-685f9f23bb36 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:48.320373 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-d0a04521-b685-43f0-9029-685f9f23bb36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:48.351752 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a04521-b685-43f0-9029-685f9f23bb36 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:48.372227 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e887c0e4-c366-4551-8676-4da7ad0f57ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'deb6c0fb05664bdea18add458cb63c67', 'request_id': 'req-e887c0e4-c366-4551-8676-4da7ad0f57ae'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:48.399845 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e887c0e4-c366-4551-8676-4da7ad0f57ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'deb6c0fb05664bdea18add458cb63c67', 'request_id': 'req-e887c0e4-c366-4551-8676-4da7ad0f57ae'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:48.468912 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e887c0e4-c366-4551-8676-4da7ad0f57ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'deb6c0fb05664bdea18add458cb63c67', 'request_id': 'req-e887c0e4-c366-4551-8676-4da7ad0f57ae'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:48.484002 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e887c0e4-c366-4551-8676-4da7ad0f57ae admin admin] The token cache is being invalidate because project deb6c0fb05664bdea18add458cb63c67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:39:48.484621 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e887c0e4-c366-4551-8676-4da7ad0f57ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:48.485665 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e887c0e4-c366-4551-8676-4da7ad0f57ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:48.486533 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633ab9cc-cff3-4921-8dad-3486069aa171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:48.487576 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ab9cc-cff3-4921-8dad-3486069aa171 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:48.487968 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ab9cc-cff3-4921-8dad-3486069aa171 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:48.488389 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ab9cc-cff3-4921-8dad-3486069aa171 admin admin] PATH_INFO: `/v3/users/dd30758f5c8d4aa492f1adf2b0918b92` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:48.488516 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3751/7484] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:39:48 2022] DELETE /identity/v3/projects/deb6c0fb05664bdea18add458cb63c67 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:48.489540 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e887c0e4-c366-4551-8676-4da7ad0f57ae admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:48.490106 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633ab9cc-cff3-4921-8dad-3486069aa171 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd30758f5c8d4aa492f1adf2b0918b92)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:48.491228 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e887c0e4-c366-4551-8676-4da7ad0f57ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:48.492654 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633ab9cc-cff3-4921-8dad-3486069aa171 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:48.510388 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e887c0e4-c366-4551-8676-4da7ad0f57ae admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:48.521247 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b172eb87-62da-40c2-b6c8-a57b3587eba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:48.528516 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b172eb87-62da-40c2-b6c8-a57b3587eba8 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:48.528516 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b172eb87-62da-40c2-b6c8-a57b3587eba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:48.528516 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b172eb87-62da-40c2-b6c8-a57b3587eba8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:48.528516 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b172eb87-62da-40c2-b6c8-a57b3587eba8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:48.528516 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b172eb87-62da-40c2-b6c8-a57b3587eba8 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:48.536936 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3752/7485] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:39:48 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:39:48.538374 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f92af2-374a-413a-90fe-b0acbec3dc11 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:48.538671 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f92af2-374a-413a-90fe-b0acbec3dc11 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:48.539085 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f92af2-374a-413a-90fe-b0acbec3dc11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:48.568519 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-98f92af2-374a-413a-90fe-b0acbec3dc11 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:48.570101 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-98f92af2-374a-413a-90fe-b0acbec3dc11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:48.581044 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3753/7486] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:39:48.582173 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f92af2-374a-413a-90fe-b0acbec3dc11 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:48.597857 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f92af2-374a-413a-90fe-b0acbec3dc11 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:48.603232 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7d3381-a6fc-4556-a855-f86535b7ec6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:48.604167 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d3381-a6fc-4556-a855-f86535b7ec6c admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:48.605328 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d3381-a6fc-4556-a855-f86535b7ec6c admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:48.610795 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d3381-a6fc-4556-a855-f86535b7ec6c admin admin] PATH_INFO: `/v3/projects/61d01ae70a4f41fea28c0fcb35d9323f/users/ded1fd35ea4845e39ee1cbaba5afc7fa/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:48.627932 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7d3381-a6fc-4556-a855-f86535b7ec6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=61d01ae70a4f41fea28c0fcb35d9323f, user_id=ded1fd35ea4845e39ee1cbaba5afc7fa, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:48.630707 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7d3381-a6fc-4556-a855-f86535b7ec6c admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:48.753763 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-633ab9cc-cff3-4921-8dad-3486069aa171 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd30758f5c8d4aa492f1adf2b0918b92'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:48.762928 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-633ab9cc-cff3-4921-8dad-3486069aa171 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd30758f5c8d4aa492f1adf2b0918b92'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:48.764269 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-633ab9cc-cff3-4921-8dad-3486069aa171 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd30758f5c8d4aa492f1adf2b0918b92'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:48.829334 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3754/7487] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:39:48 2022] PUT /identity/v3/projects/61d01ae70a4f41fea28c0fcb35d9323f/users/ded1fd35ea4845e39ee1cbaba5afc7fa/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:48.830712 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c3dbf4-8a87-4bcd-9be8-f9380e7e6a54 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:48.831010 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c3dbf4-8a87-4bcd-9be8-f9380e7e6a54 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:48.831450 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c3dbf4-8a87-4bcd-9be8-f9380e7e6a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:48.849817 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-78c3dbf4-8a87-4bcd-9be8-f9380e7e6a54 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:48.851107 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-78c3dbf4-8a87-4bcd-9be8-f9380e7e6a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:48.883391 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-633ab9cc-cff3-4921-8dad-3486069aa171 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd30758f5c8d4aa492f1adf2b0918b92'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:48.897252 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-633ab9cc-cff3-4921-8dad-3486069aa171 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd30758f5c8d4aa492f1adf2b0918b92'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:48.903925 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3734/7488] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:39:48 2022] DELETE /identity/v3/users/dd30758f5c8d4aa492f1adf2b0918b92 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:48.908311 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90cec61-8e61-4633-abb2-75a6f2aeca46 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:48.908628 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90cec61-8e61-4633-abb2-75a6f2aeca46 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:48.909037 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90cec61-8e61-4633-abb2-75a6f2aeca46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:48.909874 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3755/7489] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:39:48.914033 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c3dbf4-8a87-4bcd-9be8-f9380e7e6a54 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:48.927360 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-b90cec61-8e61-4633-abb2-75a6f2aeca46 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:48.931592 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b90cec61-8e61-4633-abb2-75a6f2aeca46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:48.944786 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c3dbf4-8a87-4bcd-9be8-f9380e7e6a54 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:49.003426 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3735/7490] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:39:49.014001 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90cec61-8e61-4633-abb2-75a6f2aeca46 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:49.015583 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b90cec61-8e61-4633-abb2-75a6f2aeca46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:49.019815 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f6903d-c3f3-4dd8-ab4a-d4c92f666153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:49.020967 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f6903d-c3f3-4dd8-ab4a-d4c92f666153 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:49.021525 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f6903d-c3f3-4dd8-ab4a-d4c92f666153 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:49.021859 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f6903d-c3f3-4dd8-ab4a-d4c92f666153 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:49.022576 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f6903d-c3f3-4dd8-ab4a-d4c92f666153 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:39:49.022921 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f6903d-c3f3-4dd8-ab4a-d4c92f666153 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:49.024573 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f6903d-c3f3-4dd8-ab4a-d4c92f666153 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:49.043498 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3756/7491] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:39:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:39:49.044314 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f6903d-c3f3-4dd8-ab4a-d4c92f666153 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:49.055330 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f6903d-c3f3-4dd8-ab4a-d4c92f666153 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:49.071907 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b955e3-07b3-48ab-8935-e917e9fa0de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:49.071907 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b955e3-07b3-48ab-8935-e917e9fa0de3 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:49.071907 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b955e3-07b3-48ab-8935-e917e9fa0de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:49.071907 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b955e3-07b3-48ab-8935-e917e9fa0de3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:49.072289 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b955e3-07b3-48ab-8935-e917e9fa0de3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:49.077740 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b955e3-07b3-48ab-8935-e917e9fa0de3 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:49.101653 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90cec61-8e61-4633-abb2-75a6f2aeca46 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:49.107098 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a1d86c-0977-4109-a75e-b6a9be40acad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:49.107963 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a1d86c-0977-4109-a75e-b6a9be40acad service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:49.108253 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a1d86c-0977-4109-a75e-b6a9be40acad service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:49.108575 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a1d86c-0977-4109-a75e-b6a9be40acad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:49.120963 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a1d86c-0977-4109-a75e-b6a9be40acad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:49.122844 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a1d86c-0977-4109-a75e-b6a9be40acad service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:49.134719 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3736/7492] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:39:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:39:49.225232 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3757/7493] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:39:49 2022] POST /identity/v3/projects => generated 385 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:39:49.229845 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a1d86c-0977-4109-a75e-b6a9be40acad service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:49.241452 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a1d86c-0977-4109-a75e-b6a9be40acad service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:49.309642 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74404f9e-d14c-4c87-8d98-21351e694123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:49.310354 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74404f9e-d14c-4c87-8d98-21351e694123 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:49.310675 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74404f9e-d14c-4c87-8d98-21351e694123 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:49.310951 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74404f9e-d14c-4c87-8d98-21351e694123 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:49.311742 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74404f9e-d14c-4c87-8d98-21351e694123 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:49.313627 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74404f9e-d14c-4c87-8d98-21351e694123 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:49.424397 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3737/7494] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:39:49 2022] POST /identity/v3/users => generated 293 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:39:49.430621 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b955e3-07b3-48ab-8935-e917e9fa0de3 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:49.451756 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b955e3-07b3-48ab-8935-e917e9fa0de3 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:49.451756 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaacd2ce-8edd-4caa-a2a5-b8298254545c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:49.451756 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaacd2ce-8edd-4caa-a2a5-b8298254545c admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:49.452867 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaacd2ce-8edd-4caa-a2a5-b8298254545c admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:49.453273 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaacd2ce-8edd-4caa-a2a5-b8298254545c admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:49.454476 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaacd2ce-8edd-4caa-a2a5-b8298254545c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:49.456243 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaacd2ce-8edd-4caa-a2a5-b8298254545c admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:49.497231 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3758/7495] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:39:49 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:39:49.500815 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74404f9e-d14c-4c87-8d98-21351e694123 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:49.514478 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74404f9e-d14c-4c87-8d98-21351e694123 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:49.521169 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e66ac0-e80c-4059-9aaf-51a5877ceca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:49.522337 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e66ac0-e80c-4059-9aaf-51a5877ceca4 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:49.522907 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e66ac0-e80c-4059-9aaf-51a5877ceca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:49.523321 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e66ac0-e80c-4059-9aaf-51a5877ceca4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:49.524248 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e66ac0-e80c-4059-9aaf-51a5877ceca4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:49.526127 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e66ac0-e80c-4059-9aaf-51a5877ceca4 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:49.540530 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3738/7496] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:39:49 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:39:49.547779 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaacd2ce-8edd-4caa-a2a5-b8298254545c admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:49.567802 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaacd2ce-8edd-4caa-a2a5-b8298254545c admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:49.574506 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedb5203-89da-4f2c-b58b-4dec124de074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:49.575557 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb5203-89da-4f2c-b58b-4dec124de074 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:49.575903 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb5203-89da-4f2c-b58b-4dec124de074 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:49.576188 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb5203-89da-4f2c-b58b-4dec124de074 admin admin] PATH_INFO: `/v3/projects/1c8d88a4468a4423a15fc177f693d93d/users/0f7b1f92d6fd4692b9c2ca865e0a01ab/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:49.594034 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedb5203-89da-4f2c-b58b-4dec124de074 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c8d88a4468a4423a15fc177f693d93d, user_id=0f7b1f92d6fd4692b9c2ca865e0a01ab, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:49.597808 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedb5203-89da-4f2c-b58b-4dec124de074 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:49.632638 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e66ac0-e80c-4059-9aaf-51a5877ceca4 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:49.634701 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c5e66ac0-e80c-4059-9aaf-51a5877ceca4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:49.724110 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e66ac0-e80c-4059-9aaf-51a5877ceca4 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:49.733452 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3759/7497] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:39:49 2022] PUT /identity/v3/projects/1c8d88a4468a4423a15fc177f693d93d/users/0f7b1f92d6fd4692b9c2ca865e0a01ab/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:49.734269 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedb5203-89da-4f2c-b58b-4dec124de074 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:49.735258 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97918859-8b5f-4705-a8a8-4c22c363bc30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198271d1c0d44cb58bace41a65f4b94c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:49.736403 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97918859-8b5f-4705-a8a8-4c22c363bc30 service cinder] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:49.736684 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97918859-8b5f-4705-a8a8-4c22c363bc30 service cinder] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:49.736959 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97918859-8b5f-4705-a8a8-4c22c363bc30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:49.738429 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-cedb5203-89da-4f2c-b58b-4dec124de074 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:49.742152 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-97918859-8b5f-4705-a8a8-4c22c363bc30 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:49.837975 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedb5203-89da-4f2c-b58b-4dec124de074 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:49.844852 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8263016a-9491-489f-84df-b9ec6b113fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:49.845740 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8263016a-9491-489f-84df-b9ec6b113fcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:49.846024 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8263016a-9491-489f-84df-b9ec6b113fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:49.848162 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8263016a-9491-489f-84df-b9ec6b113fcd admin admin] PATH_INFO: `/v3/projects/291cebe3076a45a4a01bb4b67f034f47` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:49.848162 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8263016a-9491-489f-84df-b9ec6b113fcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=291cebe3076a45a4a01bb4b67f034f47)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:49.850306 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8263016a-9491-489f-84df-b9ec6b113fcd admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:49.883650 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97918859-8b5f-4705-a8a8-4c22c363bc30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:49.886258 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97918859-8b5f-4705-a8a8-4c22c363bc30 service cinder] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:49.896944 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3739/7498] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:39:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:39:49.907970 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da34eaec-b3d5-4ec4-abb9-a6fd8ba45fc9 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:49.908267 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da34eaec-b3d5-4ec4-abb9-a6fd8ba45fc9 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:49.908554 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da34eaec-b3d5-4ec4-abb9-a6fd8ba45fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:49.943333 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-da34eaec-b3d5-4ec4-abb9-a6fd8ba45fc9 None None] MFA Rules not processed for user `0f7b1f92d6fd4692b9c2ca865e0a01ab`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:49.945167 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-da34eaec-b3d5-4ec4-abb9-a6fd8ba45fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:50.007542 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8263016a-9491-489f-84df-b9ec6b113fcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '291cebe3076a45a4a01bb4b67f034f47', 'request_id': 'req-8263016a-9491-489f-84df-b9ec6b113fcd'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:50.028284 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8263016a-9491-489f-84df-b9ec6b113fcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '291cebe3076a45a4a01bb4b67f034f47', 'request_id': 'req-8263016a-9491-489f-84df-b9ec6b113fcd'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:50.060914 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3740/7499] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:39:50.069901 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da34eaec-b3d5-4ec4-abb9-a6fd8ba45fc9 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:50.072889 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-da34eaec-b3d5-4ec4-abb9-a6fd8ba45fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:50.155885 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8263016a-9491-489f-84df-b9ec6b113fcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '291cebe3076a45a4a01bb4b67f034f47', 'request_id': 'req-8263016a-9491-489f-84df-b9ec6b113fcd'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:50.164932 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da34eaec-b3d5-4ec4-abb9-a6fd8ba45fc9 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:50.178749 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8263016a-9491-489f-84df-b9ec6b113fcd admin admin] The token cache is being invalidate because project 291cebe3076a45a4a01bb4b67f034f47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:39:50.179037 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8263016a-9491-489f-84df-b9ec6b113fcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:50.179860 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8263016a-9491-489f-84df-b9ec6b113fcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:50.181654 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3760/7500] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:39:49 2022] DELETE /identity/v3/projects/291cebe3076a45a4a01bb4b67f034f47 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:50.187721 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f114f38-ec57-4620-a1e4-a16f7858e1fe None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:50.188023 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f114f38-ec57-4620-a1e4-a16f7858e1fe None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:50.188345 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f114f38-ec57-4620-a1e4-a16f7858e1fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:50.211669 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-4f114f38-ec57-4620-a1e4-a16f7858e1fe None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:50.213282 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-4f114f38-ec57-4620-a1e4-a16f7858e1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:50.227351 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811a8f1f-b6fe-42fc-bd00-0e310e751be4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198271d1c0d44cb58bace41a65f4b94c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:50.227917 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a8f1f-b6fe-42fc-bd00-0e310e751be4 service cinder] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:50.228204 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a8f1f-b6fe-42fc-bd00-0e310e751be4 service cinder] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:50.228485 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a8f1f-b6fe-42fc-bd00-0e310e751be4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:50.230996 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-811a8f1f-b6fe-42fc-bd00-0e310e751be4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:50.301469 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3761/7501] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:39:50.308527 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811a8f1f-b6fe-42fc-bd00-0e310e751be4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:50.310010 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811a8f1f-b6fe-42fc-bd00-0e310e751be4 service cinder] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:50.310257 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df9564-4250-477e-900b-169cd3d547f4 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:50.310630 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df9564-4250-477e-900b-169cd3d547f4 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:50.310982 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df9564-4250-477e-900b-169cd3d547f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:50.320538 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3741/7502] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:39:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:39:50.332644 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-47df9564-4250-477e-900b-169cd3d547f4 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:50.334129 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-47df9564-4250-477e-900b-169cd3d547f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:50.348046 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3762/7503] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:39:50.349229 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811a8f1f-b6fe-42fc-bd00-0e310e751be4 service cinder] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:50.364204 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811a8f1f-b6fe-42fc-bd00-0e310e751be4 service cinder] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:50.371029 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870fb812-8786-4607-a548-51b17daa8bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:50.372069 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870fb812-8786-4607-a548-51b17daa8bee admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:50.372358 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870fb812-8786-4607-a548-51b17daa8bee admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:50.372639 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870fb812-8786-4607-a548-51b17daa8bee admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:50.373737 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870fb812-8786-4607-a548-51b17daa8bee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:39:50.374002 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870fb812-8786-4607-a548-51b17daa8bee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:50.375695 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870fb812-8786-4607-a548-51b17daa8bee admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:50.389477 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3742/7504] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:39:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:39:50.394029 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47df9564-4250-477e-900b-169cd3d547f4 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:50.406747 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47df9564-4250-477e-900b-169cd3d547f4 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:50.412733 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6546cfaa-7c4f-4055-a29b-0cfdd1a8d0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:50.413597 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546cfaa-7c4f-4055-a29b-0cfdd1a8d0df admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:50.414082 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546cfaa-7c4f-4055-a29b-0cfdd1a8d0df admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:50.415053 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546cfaa-7c4f-4055-a29b-0cfdd1a8d0df admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:50.415970 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6546cfaa-7c4f-4055-a29b-0cfdd1a8d0df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:50.419002 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6546cfaa-7c4f-4055-a29b-0cfdd1a8d0df admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:50.555167 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3763/7505] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:39:50 2022] POST /identity/v3/projects => generated 375 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:39:50.559581 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870fb812-8786-4607-a548-51b17daa8bee admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:50.570578 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870fb812-8786-4607-a548-51b17daa8bee admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:50.636961 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3009c7-ae71-4073-8957-327ca6afe342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:50.640652 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3009c7-ae71-4073-8957-327ca6afe342 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:50.640652 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3009c7-ae71-4073-8957-327ca6afe342 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:50.640652 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3009c7-ae71-4073-8957-327ca6afe342 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:50.640652 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3009c7-ae71-4073-8957-327ca6afe342 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:50.641010 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3009c7-ae71-4073-8957-327ca6afe342 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:50.677471 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f7722-f80b-415a-ab46-784e43cf0ef9 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:50.677811 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f7722-f80b-415a-ab46-784e43cf0ef9 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:50.678125 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f7722-f80b-415a-ab46-784e43cf0ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:50.696849 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-a88f7722-f80b-415a-ab46-784e43cf0ef9 None None] MFA Rules not processed for user `cab5a299e003422286f01bd44fda92bc`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:50.698134 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-a88f7722-f80b-415a-ab46-784e43cf0ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:50.766474 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3743/7506] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:39:50 2022] POST /identity/v3/users => generated 288 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:39:50.767466 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3009c7-ae71-4073-8957-327ca6afe342 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:50.778233 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3764/7507] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:39:50.780828 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3009c7-ae71-4073-8957-327ca6afe342 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:50.787125 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8766fca1-9811-4dd9-9c6e-7af62a4814aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:50.788592 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8766fca1-9811-4dd9-9c6e-7af62a4814aa admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:50.788888 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8766fca1-9811-4dd9-9c6e-7af62a4814aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:50.789170 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8766fca1-9811-4dd9-9c6e-7af62a4814aa admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:50.789905 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8766fca1-9811-4dd9-9c6e-7af62a4814aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:50.791596 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8766fca1-9811-4dd9-9c6e-7af62a4814aa admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:50.803692 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3744/7508] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:39:50 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:39:50.808397 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f7722-f80b-415a-ab46-784e43cf0ef9 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:50.820900 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9424f38-0891-4354-b8ed-4bbf943c77d6 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:50.821198 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9424f38-0891-4354-b8ed-4bbf943c77d6 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:50.821834 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9424f38-0891-4354-b8ed-4bbf943c77d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:50.848625 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f7722-f80b-415a-ab46-784e43cf0ef9 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:50.897271 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bace4aec-29df-4dc0-b788-0ad4881307dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:50.898173 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace4aec-29df-4dc0-b788-0ad4881307dc admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:50.898837 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace4aec-29df-4dc0-b788-0ad4881307dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:50.900591 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace4aec-29df-4dc0-b788-0ad4881307dc admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:50.903260 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bace4aec-29df-4dc0-b788-0ad4881307dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:50.905120 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bace4aec-29df-4dc0-b788-0ad4881307dc admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:50.927002 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-e9424f38-0891-4354-b8ed-4bbf943c77d6 None None] MFA Rules not processed for user `ded1fd35ea4845e39ee1cbaba5afc7fa`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:50.930636 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e9424f38-0891-4354-b8ed-4bbf943c77d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:50.937565 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3765/7509] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:39:50 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:39:50.938619 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bace4aec-29df-4dc0-b788-0ad4881307dc admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:50.964366 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bace4aec-29df-4dc0-b788-0ad4881307dc admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:50.984525 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3589c601-adea-4ddd-9a38-eb2d4f3ab49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:50.984525 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589c601-adea-4ddd-9a38-eb2d4f3ab49d admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:50.984525 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589c601-adea-4ddd-9a38-eb2d4f3ab49d admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:50.984525 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589c601-adea-4ddd-9a38-eb2d4f3ab49d admin admin] PATH_INFO: `/v3/projects/fb963e70c31c4197b9b5563fb72e269e/users/7bb3a39959e64e2aa7217870e637e5eb/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:51.020963 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3589c601-adea-4ddd-9a38-eb2d4f3ab49d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb963e70c31c4197b9b5563fb72e269e, user_id=7bb3a39959e64e2aa7217870e637e5eb, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:51.023845 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3745/7510] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:50 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:39:51.025175 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3589c601-adea-4ddd-9a38-eb2d4f3ab49d admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:51.040203 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dbd4a4-6641-4739-8347-381e74f4e866 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:51.040489 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dbd4a4-6641-4739-8347-381e74f4e866 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:51.040770 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dbd4a4-6641-4739-8347-381e74f4e866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:51.070705 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-33dbd4a4-6641-4739-8347-381e74f4e866 None None] MFA Rules not processed for user `43b8ae7176574269b187ce6f4a3344ac`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:51.072213 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-33dbd4a4-6641-4739-8347-381e74f4e866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:51.162956 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3746/7511] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:51 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:39:51.175572 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dbd4a4-6641-4739-8347-381e74f4e866 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:51.176548 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3766/7512] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:39:50 2022] PUT /identity/v3/projects/fb963e70c31c4197b9b5563fb72e269e/users/7bb3a39959e64e2aa7217870e637e5eb/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:51.177221 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-33dbd4a4-6641-4739-8347-381e74f4e866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:51.190038 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a231b9-3361-467d-9f87-fec335c5a069 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:51.197607 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a231b9-3361-467d-9f87-fec335c5a069 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:51.202077 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a231b9-3361-467d-9f87-fec335c5a069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:51.279298 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-77a231b9-3361-467d-9f87-fec335c5a069 None None] MFA Rules not processed for user `7bb3a39959e64e2aa7217870e637e5eb`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:51.280528 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-77a231b9-3361-467d-9f87-fec335c5a069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:51.345061 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dbd4a4-6641-4739-8347-381e74f4e866 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:51.438089 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3767/7513] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:39:51.439339 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a231b9-3361-467d-9f87-fec335c5a069 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:51.441794 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-77a231b9-3361-467d-9f87-fec335c5a069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:51.465445 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b25787-2f1c-41f8-b262-c2b2b5ecc56d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:51.466451 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b25787-2f1c-41f8-b262-c2b2b5ecc56d service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:51.472141 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b25787-2f1c-41f8-b262-c2b2b5ecc56d service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:51.472621 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b25787-2f1c-41f8-b262-c2b2b5ecc56d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:51.475677 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b3b25787-2f1c-41f8-b262-c2b2b5ecc56d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:51.525022 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a231b9-3361-467d-9f87-fec335c5a069 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:51.529681 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01715e1-6fdb-40bb-acda-6c711cffbf71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:51.530289 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01715e1-6fdb-40bb-acda-6c711cffbf71 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:51.530569 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01715e1-6fdb-40bb-acda-6c711cffbf71 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:51.530839 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01715e1-6fdb-40bb-acda-6c711cffbf71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:51.532637 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-a01715e1-6fdb-40bb-acda-6c711cffbf71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:51.545367 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01715e1-6fdb-40bb-acda-6c711cffbf71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:51.549006 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01715e1-6fdb-40bb-acda-6c711cffbf71 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:51.557514 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b25787-2f1c-41f8-b262-c2b2b5ecc56d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:51.559569 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3768/7514] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:39:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:39:51.560106 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b25787-2f1c-41f8-b262-c2b2b5ecc56d service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:51.560836 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01715e1-6fdb-40bb-acda-6c711cffbf71 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:51.562348 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-a01715e1-6fdb-40bb-acda-6c711cffbf71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:51.574325 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3747/7515] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:39:51 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:39:51.577649 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01715e1-6fdb-40bb-acda-6c711cffbf71 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:51.583512 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc41635c-745f-4b47-9801-67b830297d65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:51.583512 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc41635c-745f-4b47-9801-67b830297d65 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:51.583512 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc41635c-745f-4b47-9801-67b830297d65 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:51.583512 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc41635c-745f-4b47-9801-67b830297d65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:51.593611 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc41635c-745f-4b47-9801-67b830297d65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:51.595233 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc41635c-745f-4b47-9801-67b830297d65 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:51.609227 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3769/7516] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:39:51 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:39:51.624776 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b25787-2f1c-41f8-b262-c2b2b5ecc56d service nova] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:51.706078 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b25787-2f1c-41f8-b262-c2b2b5ecc56d service nova] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:51.711516 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4d30d2-3590-406f-a5da-82216e0b15dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:51.712274 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d30d2-3590-406f-a5da-82216e0b15dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:51.712274 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d30d2-3590-406f-a5da-82216e0b15dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:51.712634 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d30d2-3590-406f-a5da-82216e0b15dd admin admin] PATH_INFO: `/v3/users/7bb3a39959e64e2aa7217870e637e5eb` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:51.714331 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4d30d2-3590-406f-a5da-82216e0b15dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bb3a39959e64e2aa7217870e637e5eb)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:51.716835 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4d30d2-3590-406f-a5da-82216e0b15dd admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:51.947097 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ef4d30d2-3590-406f-a5da-82216e0b15dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bb3a39959e64e2aa7217870e637e5eb'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:51.957057 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ef4d30d2-3590-406f-a5da-82216e0b15dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bb3a39959e64e2aa7217870e637e5eb'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:51.958355 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ef4d30d2-3590-406f-a5da-82216e0b15dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bb3a39959e64e2aa7217870e637e5eb'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:52.059288 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ef4d30d2-3590-406f-a5da-82216e0b15dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bb3a39959e64e2aa7217870e637e5eb'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:52.072893 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ef4d30d2-3590-406f-a5da-82216e0b15dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bb3a39959e64e2aa7217870e637e5eb'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:52.092374 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3748/7517] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:39:51 2022] DELETE /identity/v3/users/7bb3a39959e64e2aa7217870e637e5eb => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:52.097323 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49bf55c-d72e-44fe-9dfb-6a996f6d6f68 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:52.099134 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49bf55c-d72e-44fe-9dfb-6a996f6d6f68 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:52.099134 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49bf55c-d72e-44fe-9dfb-6a996f6d6f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:52.121996 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-e49bf55c-d72e-44fe-9dfb-6a996f6d6f68 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:52.123615 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e49bf55c-d72e-44fe-9dfb-6a996f6d6f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:52.218747 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3770/7518] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:39:52.231153 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4d30d2-3590-406f-a5da-82216e0b15dd admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:52.232782 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-ef4d30d2-3590-406f-a5da-82216e0b15dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:52.307435 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4d30d2-3590-406f-a5da-82216e0b15dd admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:52.312127 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d78adbd-5186-4a39-9f6f-af99c677e2c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:52.313088 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d78adbd-5186-4a39-9f6f-af99c677e2c7 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:52.313495 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d78adbd-5186-4a39-9f6f-af99c677e2c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:52.314002 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d78adbd-5186-4a39-9f6f-af99c677e2c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:52.328434 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d78adbd-5186-4a39-9f6f-af99c677e2c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:52.330294 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d78adbd-5186-4a39-9f6f-af99c677e2c7 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:52.342627 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3749/7519] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:39:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:39:52.986912 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49bf55c-d72e-44fe-9dfb-6a996f6d6f68 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:52.988384 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e49bf55c-d72e-44fe-9dfb-6a996f6d6f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:53.001380 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49bf55c-d72e-44fe-9dfb-6a996f6d6f68 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:53.006480 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e2424-503f-49b2-9022-d6332854bb19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:53.007344 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e2424-503f-49b2-9022-d6332854bb19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:53.007728 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e2424-503f-49b2-9022-d6332854bb19 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:53.007997 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e2424-503f-49b2-9022-d6332854bb19 admin admin] PATH_INFO: `/v3/projects/fb963e70c31c4197b9b5563fb72e269e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:53.009346 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55e2424-503f-49b2-9022-d6332854bb19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb963e70c31c4197b9b5563fb72e269e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:53.011527 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55e2424-503f-49b2-9022-d6332854bb19 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:53.134968 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f55e2424-503f-49b2-9022-d6332854bb19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb963e70c31c4197b9b5563fb72e269e', 'request_id': 'req-f55e2424-503f-49b2-9022-d6332854bb19'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:53.143506 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f55e2424-503f-49b2-9022-d6332854bb19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb963e70c31c4197b9b5563fb72e269e', 'request_id': 'req-f55e2424-503f-49b2-9022-d6332854bb19'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:53.217225 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f55e2424-503f-49b2-9022-d6332854bb19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb963e70c31c4197b9b5563fb72e269e', 'request_id': 'req-f55e2424-503f-49b2-9022-d6332854bb19'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:53.230489 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f55e2424-503f-49b2-9022-d6332854bb19 admin admin] The token cache is being invalidate because project fb963e70c31c4197b9b5563fb72e269e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:39:53.230780 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f55e2424-503f-49b2-9022-d6332854bb19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:53.231551 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f55e2424-503f-49b2-9022-d6332854bb19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:39:53.233060 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3771/7520] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:39:52 2022] DELETE /identity/v3/projects/fb963e70c31c4197b9b5563fb72e269e => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:53.238835 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3d9599-375e-430e-a555-3172dd5d651b None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:53.239315 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3d9599-375e-430e-a555-3172dd5d651b None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:53.239446 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3d9599-375e-430e-a555-3172dd5d651b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:53.258116 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-2a3d9599-375e-430e-a555-3172dd5d651b None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:53.259314 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-2a3d9599-375e-430e-a555-3172dd5d651b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:53.336576 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3750/7521] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:39:53.352905 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7f26b-11db-4e40-b392-63c435623448 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:53.353655 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7f26b-11db-4e40-b392-63c435623448 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:53.354137 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7f26b-11db-4e40-b392-63c435623448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:53.394279 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-b7d7f26b-11db-4e40-b392-63c435623448 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:53.396061 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b7d7f26b-11db-4e40-b392-63c435623448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:53.410510 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3772/7522] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:39:53.411765 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3d9599-375e-430e-a555-3172dd5d651b None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:53.434575 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3d9599-375e-430e-a555-3172dd5d651b None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:53.449241 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d5d03-ea07-4f24-992b-4315aa6496a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:53.450300 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d5d03-ea07-4f24-992b-4315aa6496a0 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:53.453559 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d5d03-ea07-4f24-992b-4315aa6496a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:53.453559 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d5d03-ea07-4f24-992b-4315aa6496a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:53.453559 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588d5d03-ea07-4f24-992b-4315aa6496a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:39:53.453559 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588d5d03-ea07-4f24-992b-4315aa6496a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:53.454190 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588d5d03-ea07-4f24-992b-4315aa6496a0 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:53.468881 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3751/7523] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:39:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:39:53.478730 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d7f26b-11db-4e40-b392-63c435623448 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:53.495750 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d7f26b-11db-4e40-b392-63c435623448 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:53.510081 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af9232e-65ef-4922-b97d-7bbf1b232860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:53.511267 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af9232e-65ef-4922-b97d-7bbf1b232860 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:53.511408 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af9232e-65ef-4922-b97d-7bbf1b232860 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:53.511892 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af9232e-65ef-4922-b97d-7bbf1b232860 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:53.512799 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af9232e-65ef-4922-b97d-7bbf1b232860 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:53.514715 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af9232e-65ef-4922-b97d-7bbf1b232860 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:53.628624 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3773/7524] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:39:53 2022] POST /identity/v3/projects => generated 391 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:39:53.632852 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d5d03-ea07-4f24-992b-4315aa6496a0 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:53.642967 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d5d03-ea07-4f24-992b-4315aa6496a0 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:53.699339 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6922c067-8450-42ca-852c-16f620e90ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:53.700036 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6922c067-8450-42ca-852c-16f620e90ddd admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:53.700325 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6922c067-8450-42ca-852c-16f620e90ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:53.700638 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6922c067-8450-42ca-852c-16f620e90ddd admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:53.701298 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6922c067-8450-42ca-852c-16f620e90ddd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:53.703245 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6922c067-8450-42ca-852c-16f620e90ddd admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:53.803988 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3752/7525] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:39:53 2022] POST /identity/v3/users => generated 296 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:39:53.805410 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af9232e-65ef-4922-b97d-7bbf1b232860 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:53.816439 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af9232e-65ef-4922-b97d-7bbf1b232860 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:53.821324 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae29326b-02ba-481e-94b7-4b75a30030e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:53.822002 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29326b-02ba-481e-94b7-4b75a30030e1 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:53.822273 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29326b-02ba-481e-94b7-4b75a30030e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:53.822550 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29326b-02ba-481e-94b7-4b75a30030e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:53.823547 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae29326b-02ba-481e-94b7-4b75a30030e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:53.825310 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae29326b-02ba-481e-94b7-4b75a30030e1 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:53.837095 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3774/7526] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:39:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:39:53.841745 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6922c067-8450-42ca-852c-16f620e90ddd admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:53.852236 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6922c067-8450-42ca-852c-16f620e90ddd admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:53.857677 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d2a37d-165a-473e-9b52-25bbadc1e0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:53.858339 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2a37d-165a-473e-9b52-25bbadc1e0a4 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:53.858656 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2a37d-165a-473e-9b52-25bbadc1e0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:53.858936 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2a37d-165a-473e-9b52-25bbadc1e0a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:53.859707 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d2a37d-165a-473e-9b52-25bbadc1e0a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:53.861386 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d2a37d-165a-473e-9b52-25bbadc1e0a4 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:53.872946 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3753/7527] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:39:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:39:53.877473 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae29326b-02ba-481e-94b7-4b75a30030e1 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:53.888171 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae29326b-02ba-481e-94b7-4b75a30030e1 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:53.892944 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2de3f86-f797-49b9-b408-f4a590ded179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:53.893854 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de3f86-f797-49b9-b408-f4a590ded179 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:53.894275 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de3f86-f797-49b9-b408-f4a590ded179 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:53.894569 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de3f86-f797-49b9-b408-f4a590ded179 admin admin] PATH_INFO: `/v3/projects/a4519a9d445e45bdb08a0015c0b825b8/users/d53d1ce6bd334ed1ba8cc768134da62a/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:53.922517 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2de3f86-f797-49b9-b408-f4a590ded179 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4519a9d445e45bdb08a0015c0b825b8, user_id=d53d1ce6bd334ed1ba8cc768134da62a, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:53.925485 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2de3f86-f797-49b9-b408-f4a590ded179 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:54.046709 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3775/7528] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:39:53 2022] PUT /identity/v3/projects/a4519a9d445e45bdb08a0015c0b825b8/users/d53d1ce6bd334ed1ba8cc768134da62a/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:39:54.058502 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b9fdf4-6cb9-4a97-94b3-ce0bd83a2be0 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:54.059427 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b9fdf4-6cb9-4a97-94b3-ce0bd83a2be0 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:54.059810 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b9fdf4-6cb9-4a97-94b3-ce0bd83a2be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:54.092366 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-e3b9fdf4-6cb9-4a97-94b3-ce0bd83a2be0 None None] MFA Rules not processed for user `d53d1ce6bd334ed1ba8cc768134da62a`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:54.093656 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e3b9fdf4-6cb9-4a97-94b3-ce0bd83a2be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:54.163931 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3754/7529] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:54 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:39:54.168652 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2de3f86-f797-49b9-b408-f4a590ded179 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:54.237581 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2de3f86-f797-49b9-b408-f4a590ded179 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:54.242389 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3a2cf7-b629-47ef-8baa-022d4b1af7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:54.243056 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a2cf7-b629-47ef-8baa-022d4b1af7fa admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:54.243341 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a2cf7-b629-47ef-8baa-022d4b1af7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:54.243660 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a2cf7-b629-47ef-8baa-022d4b1af7fa admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:54.244464 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3a2cf7-b629-47ef-8baa-022d4b1af7fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:54.247078 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3a2cf7-b629-47ef-8baa-022d4b1af7fa admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:54.362810 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3776/7530] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:39:54 2022] POST /identity/v3/projects => generated 393 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:39:54.368498 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b9fdf4-6cb9-4a97-94b3-ce0bd83a2be0 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:54.379956 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b9fdf4-6cb9-4a97-94b3-ce0bd83a2be0 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:54.471118 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f812cd-27d1-4d13-8ffc-5d37e996423f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:54.471945 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f812cd-27d1-4d13-8ffc-5d37e996423f admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:54.472405 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f812cd-27d1-4d13-8ffc-5d37e996423f admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:54.473086 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f812cd-27d1-4d13-8ffc-5d37e996423f admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:54.473865 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f812cd-27d1-4d13-8ffc-5d37e996423f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:54.476118 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f812cd-27d1-4d13-8ffc-5d37e996423f admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:54.605520 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3755/7531] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:39:54 2022] POST /identity/v3/users => generated 303 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:39:54.608480 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3a2cf7-b629-47ef-8baa-022d4b1af7fa admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:54.623004 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3a2cf7-b629-47ef-8baa-022d4b1af7fa admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:54.630569 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d8a37-a181-4578-af04-6122178975e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:54.631613 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d8a37-a181-4578-af04-6122178975e9 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:54.632068 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d8a37-a181-4578-af04-6122178975e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:54.632523 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d8a37-a181-4578-af04-6122178975e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:54.633456 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616d8a37-a181-4578-af04-6122178975e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:54.635253 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616d8a37-a181-4578-af04-6122178975e9 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:54.659461 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3777/7532] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:39:54.663321 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f812cd-27d1-4d13-8ffc-5d37e996423f admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:54.676453 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f812cd-27d1-4d13-8ffc-5d37e996423f admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:54.682219 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba8b1d1-ed88-4536-ad68-f5f6b58c59d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:54.684787 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8b1d1-ed88-4536-ad68-f5f6b58c59d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:54.685095 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8b1d1-ed88-4536-ad68-f5f6b58c59d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:54.685340 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8b1d1-ed88-4536-ad68-f5f6b58c59d8 admin admin] PATH_INFO: `/v3/projects/4c88cebde80d4f6ba499e0d4fb939de7/users/82ff5171bff844ab9993522e2d6c61d0/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:54.703737 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba8b1d1-ed88-4536-ad68-f5f6b58c59d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c88cebde80d4f6ba499e0d4fb939de7, user_id=82ff5171bff844ab9993522e2d6c61d0, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:54.706282 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba8b1d1-ed88-4536-ad68-f5f6b58c59d8 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:54.777928 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3756/7533] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:39:54 2022] PUT /identity/v3/projects/4c88cebde80d4f6ba499e0d4fb939de7/users/82ff5171bff844ab9993522e2d6c61d0/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:54.782077 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d8a37-a181-4578-af04-6122178975e9 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:54.799699 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d8a37-a181-4578-af04-6122178975e9 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:54.897601 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353fd789-f097-43e0-88b9-bd06ee986a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:54.898363 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353fd789-f097-43e0-88b9-bd06ee986a33 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:54.898648 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353fd789-f097-43e0-88b9-bd06ee986a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:54.898931 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353fd789-f097-43e0-88b9-bd06ee986a33 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:54.899724 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353fd789-f097-43e0-88b9-bd06ee986a33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:54.902134 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353fd789-f097-43e0-88b9-bd06ee986a33 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:54.913074 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3778/7534] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:39:54.918122 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba8b1d1-ed88-4536-ad68-f5f6b58c59d8 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:54.930480 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba8b1d1-ed88-4536-ad68-f5f6b58c59d8 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:54.938686 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878588cd-b303-4978-8947-93e94e1aa517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:54.939706 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878588cd-b303-4978-8947-93e94e1aa517 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:54.939993 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878588cd-b303-4978-8947-93e94e1aa517 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:54.940277 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878588cd-b303-4978-8947-93e94e1aa517 admin admin] PATH_INFO: `/v3/projects/4c88cebde80d4f6ba499e0d4fb939de7/users/82ff5171bff844ab9993522e2d6c61d0/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:54.942673 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878588cd-b303-4978-8947-93e94e1aa517 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c88cebde80d4f6ba499e0d4fb939de7, user_id=82ff5171bff844ab9993522e2d6c61d0, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:54.945447 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878588cd-b303-4978-8947-93e94e1aa517 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:54.960331 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3757/7535] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:39:54 2022] PUT /identity/v3/projects/4c88cebde80d4f6ba499e0d4fb939de7/users/82ff5171bff844ab9993522e2d6c61d0/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:39:54.971080 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a90ce-1a10-4dee-9457-c35613de0abf None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:54.971391 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a90ce-1a10-4dee-9457-c35613de0abf None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:54.971856 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a90ce-1a10-4dee-9457-c35613de0abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:55.014535 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-c71a90ce-1a10-4dee-9457-c35613de0abf None None] MFA Rules not processed for user `82ff5171bff844ab9993522e2d6c61d0`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:39:55.015960 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c71a90ce-1a10-4dee-9457-c35613de0abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:55.095897 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3779/7536] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:39:54 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:39:55.137744 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878588cd-b303-4978-8947-93e94e1aa517 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:55.144534 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-878588cd-b303-4978-8947-93e94e1aa517 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:55.225179 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878588cd-b303-4978-8947-93e94e1aa517 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:55.229575 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f424b60d-69da-4121-abd3-baeb39db63f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198271d1c0d44cb58bace41a65f4b94c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:55.230687 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f424b60d-69da-4121-abd3-baeb39db63f7 service cinder] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:55.230978 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f424b60d-69da-4121-abd3-baeb39db63f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:55.231864 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f424b60d-69da-4121-abd3-baeb39db63f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:55.241693 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f424b60d-69da-4121-abd3-baeb39db63f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:55.243238 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f424b60d-69da-4121-abd3-baeb39db63f7 service cinder] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:55.254556 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3758/7537] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:39:55 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:39:55.318665 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71a90ce-1a10-4dee-9457-c35613de0abf None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:39:55.320197 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c71a90ce-1a10-4dee-9457-c35613de0abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:39:55.340353 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71a90ce-1a10-4dee-9457-c35613de0abf None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:39:55.346661 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3d95cd-607d-453d-b3af-289373ef51c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198271d1c0d44cb58bace41a65f4b94c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:39:55.347557 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d95cd-607d-453d-b3af-289373ef51c1 service cinder] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:39:55.347941 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d95cd-607d-453d-b3af-289373ef51c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:39:55.348457 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d95cd-607d-453d-b3af-289373ef51c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:39:55.414158 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3d95cd-607d-453d-b3af-289373ef51c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:39:55.415961 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3d95cd-607d-453d-b3af-289373ef51c1 service cinder] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:39:55.431679 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3780/7538] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:39:55 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:40:05.141613 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f424b60d-69da-4121-abd3-baeb39db63f7 service cinder] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:05.154531 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f424b60d-69da-4121-abd3-baeb39db63f7 service cinder] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:05.158982 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e5fbde-c729-4f6b-9272-f3a0a5794d04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198271d1c0d44cb58bace41a65f4b94c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:05.159757 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5fbde-c729-4f6b-9272-f3a0a5794d04 service cinder] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:05.160106 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5fbde-c729-4f6b-9272-f3a0a5794d04 service cinder] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:05.160452 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5fbde-c729-4f6b-9272-f3a0a5794d04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:05.162504 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-a1e5fbde-c729-4f6b-9272-f3a0a5794d04 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:05.245511 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e5fbde-c729-4f6b-9272-f3a0a5794d04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:05.247401 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e5fbde-c729-4f6b-9272-f3a0a5794d04 service cinder] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:05.258406 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3759/7539] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:40:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:40:08.853854 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3d95cd-607d-453d-b3af-289373ef51c1 service cinder] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:08.855709 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ed3d95cd-607d-453d-b3af-289373ef51c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:08.933582 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3d95cd-607d-453d-b3af-289373ef51c1 service cinder] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:08.939773 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d5b453-c268-43c5-93cd-00d9aa9bedd1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:08.940467 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d5b453-c268-43c5-93cd-00d9aa9bedd1 service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:08.940834 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d5b453-c268-43c5-93cd-00d9aa9bedd1 service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:08.941114 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d5b453-c268-43c5-93cd-00d9aa9bedd1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:08.943171 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-64d5b453-c268-43c5-93cd-00d9aa9bedd1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:09.018509 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d5b453-c268-43c5-93cd-00d9aa9bedd1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:09.020179 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d5b453-c268-43c5-93cd-00d9aa9bedd1 service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:09.030005 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3781/7540] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:40:08 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:40:09.494892 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e5fbde-c729-4f6b-9272-f3a0a5794d04 service cinder] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:09.567170 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e5fbde-c729-4f6b-9272-f3a0a5794d04 service cinder] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:09.574858 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b6b725-7c54-455b-b962-a96b911c1e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:09.575977 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b6b725-7c54-455b-b962-a96b911c1e69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:09.576567 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b6b725-7c54-455b-b962-a96b911c1e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:09.576997 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b6b725-7c54-455b-b962-a96b911c1e69 admin admin] PATH_INFO: `/v3/users/d53d1ce6bd334ed1ba8cc768134da62a` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:09.578399 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b6b725-7c54-455b-b962-a96b911c1e69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d53d1ce6bd334ed1ba8cc768134da62a)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:09.584190 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b6b725-7c54-455b-b962-a96b911c1e69 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:09.886159 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-64b6b725-7c54-455b-b962-a96b911c1e69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd53d1ce6bd334ed1ba8cc768134da62a'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:09.896829 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-64b6b725-7c54-455b-b962-a96b911c1e69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd53d1ce6bd334ed1ba8cc768134da62a'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:09.897563 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-64b6b725-7c54-455b-b962-a96b911c1e69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd53d1ce6bd334ed1ba8cc768134da62a'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:10.016782 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-64b6b725-7c54-455b-b962-a96b911c1e69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd53d1ce6bd334ed1ba8cc768134da62a'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:10.033171 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-64b6b725-7c54-455b-b962-a96b911c1e69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd53d1ce6bd334ed1ba8cc768134da62a'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:10.040750 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3760/7541] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:40:09 2022] DELETE /identity/v3/users/d53d1ce6bd334ed1ba8cc768134da62a => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:40:10.046060 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427bb2d-d697-4d08-a3e4-a7feafdec018 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:10.046559 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427bb2d-d697-4d08-a3e4-a7feafdec018 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:10.047560 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427bb2d-d697-4d08-a3e4-a7feafdec018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:10.088021 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-2427bb2d-d697-4d08-a3e4-a7feafdec018 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:40:10.088021 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-2427bb2d-d697-4d08-a3e4-a7feafdec018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:10.164894 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3782/7542] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:40:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:40:10.507896 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b6b725-7c54-455b-b962-a96b911c1e69 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:10.509474 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-64b6b725-7c54-455b-b962-a96b911c1e69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:10.587702 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b6b725-7c54-455b-b962-a96b911c1e69 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:10.596530 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c1e0e8-0763-44a2-ae5a-92c5cb8728e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:10.597203 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c1e0e8-0763-44a2-ae5a-92c5cb8728e8 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:10.602661 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c1e0e8-0763-44a2-ae5a-92c5cb8728e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:10.602661 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c1e0e8-0763-44a2-ae5a-92c5cb8728e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:10.609445 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c1e0e8-0763-44a2-ae5a-92c5cb8728e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:10.610891 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c1e0e8-0763-44a2-ae5a-92c5cb8728e8 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:10.624021 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3761/7543] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:40:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:40:11.573942 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2427bb2d-d697-4d08-a3e4-a7feafdec018 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:11.576503 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-2427bb2d-d697-4d08-a3e4-a7feafdec018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:11.592369 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2427bb2d-d697-4d08-a3e4-a7feafdec018 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:11.598378 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c936d9-1827-4ed9-ac62-d2854a421c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:11.599552 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c936d9-1827-4ed9-ac62-d2854a421c5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:11.599899 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c936d9-1827-4ed9-ac62-d2854a421c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:11.600661 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c936d9-1827-4ed9-ac62-d2854a421c5d admin admin] PATH_INFO: `/v3/projects/a4519a9d445e45bdb08a0015c0b825b8` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:11.602086 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c936d9-1827-4ed9-ac62-d2854a421c5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4519a9d445e45bdb08a0015c0b825b8)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:11.605216 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c936d9-1827-4ed9-ac62-d2854a421c5d admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:11.793927 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-47c936d9-1827-4ed9-ac62-d2854a421c5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4519a9d445e45bdb08a0015c0b825b8', 'request_id': 'req-47c936d9-1827-4ed9-ac62-d2854a421c5d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:11.804495 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-47c936d9-1827-4ed9-ac62-d2854a421c5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4519a9d445e45bdb08a0015c0b825b8', 'request_id': 'req-47c936d9-1827-4ed9-ac62-d2854a421c5d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:11.940194 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-47c936d9-1827-4ed9-ac62-d2854a421c5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4519a9d445e45bdb08a0015c0b825b8', 'request_id': 'req-47c936d9-1827-4ed9-ac62-d2854a421c5d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:11.952372 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-47c936d9-1827-4ed9-ac62-d2854a421c5d admin admin] The token cache is being invalidate because project a4519a9d445e45bdb08a0015c0b825b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:40:11.952655 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-47c936d9-1827-4ed9-ac62-d2854a421c5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:11.953291 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-47c936d9-1827-4ed9-ac62-d2854a421c5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:11.954841 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3783/7544] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:40:11 2022] DELETE /identity/v3/projects/a4519a9d445e45bdb08a0015c0b825b8 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:40:11.958901 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c1e0e8-0763-44a2-ae5a-92c5cb8728e8 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:11.974855 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c1e0e8-0763-44a2-ae5a-92c5cb8728e8 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:12.040034 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d6fc26-4198-45dc-9834-8dc0ea05076e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:12.041480 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d6fc26-4198-45dc-9834-8dc0ea05076e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:12.041854 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d6fc26-4198-45dc-9834-8dc0ea05076e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:12.042136 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d6fc26-4198-45dc-9834-8dc0ea05076e admin admin] PATH_INFO: `/v3/users/82ff5171bff844ab9993522e2d6c61d0` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:12.043331 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d6fc26-4198-45dc-9834-8dc0ea05076e admin admin] RBAC: Authorizing `identity:delete_user(user_id=82ff5171bff844ab9993522e2d6c61d0)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:12.045294 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d6fc26-4198-45dc-9834-8dc0ea05076e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:12.333959 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-94d6fc26-4198-45dc-9834-8dc0ea05076e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82ff5171bff844ab9993522e2d6c61d0'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:12.351312 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-94d6fc26-4198-45dc-9834-8dc0ea05076e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82ff5171bff844ab9993522e2d6c61d0'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:12.351312 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-94d6fc26-4198-45dc-9834-8dc0ea05076e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82ff5171bff844ab9993522e2d6c61d0'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:12.442456 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-94d6fc26-4198-45dc-9834-8dc0ea05076e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82ff5171bff844ab9993522e2d6c61d0'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:12.483556 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-94d6fc26-4198-45dc-9834-8dc0ea05076e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82ff5171bff844ab9993522e2d6c61d0'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:12.493122 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3762/7545] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:40:11 2022] DELETE /identity/v3/users/82ff5171bff844ab9993522e2d6c61d0 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:40:12.578275 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c936d9-1827-4ed9-ac62-d2854a421c5d admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:12.579809 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-47c936d9-1827-4ed9-ac62-d2854a421c5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:12.595352 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c936d9-1827-4ed9-ac62-d2854a421c5d admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:12.661540 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd231ed-97bb-4103-9b39-a36572144398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:12.662422 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd231ed-97bb-4103-9b39-a36572144398 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:12.662711 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd231ed-97bb-4103-9b39-a36572144398 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:12.662999 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd231ed-97bb-4103-9b39-a36572144398 admin admin] PATH_INFO: `/v3/users/3b9dfb17ef64477392044c26dcd75bfb` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:12.664207 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd231ed-97bb-4103-9b39-a36572144398 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b9dfb17ef64477392044c26dcd75bfb)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:12.666269 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd231ed-97bb-4103-9b39-a36572144398 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:12.924436 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0cd231ed-97bb-4103-9b39-a36572144398 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b9dfb17ef64477392044c26dcd75bfb'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:12.940508 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0cd231ed-97bb-4103-9b39-a36572144398 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b9dfb17ef64477392044c26dcd75bfb'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:12.948747 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0cd231ed-97bb-4103-9b39-a36572144398 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b9dfb17ef64477392044c26dcd75bfb'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:13.055388 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0cd231ed-97bb-4103-9b39-a36572144398 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b9dfb17ef64477392044c26dcd75bfb'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:13.056116 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0cd231ed-97bb-4103-9b39-a36572144398 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b9dfb17ef64477392044c26dcd75bfb'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:13.064641 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3784/7546] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:40:12 2022] DELETE /identity/v3/users/3b9dfb17ef64477392044c26dcd75bfb => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:40:13.069586 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe440496-7824-4283-bdd3-fa082f38d5be None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:13.070098 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe440496-7824-4283-bdd3-fa082f38d5be None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:13.070205 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe440496-7824-4283-bdd3-fa082f38d5be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:13.089655 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-fe440496-7824-4283-bdd3-fa082f38d5be None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:40:13.091227 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-fe440496-7824-4283-bdd3-fa082f38d5be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:13.155951 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3763/7547] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:40:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:40:13.167355 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd231ed-97bb-4103-9b39-a36572144398 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:13.168928 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-0cd231ed-97bb-4103-9b39-a36572144398 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:13.238857 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd231ed-97bb-4103-9b39-a36572144398 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:13.244152 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ebbd2-19df-4829-8afb-685ee264575d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:13.246946 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ebbd2-19df-4829-8afb-685ee264575d service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:13.246946 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ebbd2-19df-4829-8afb-685ee264575d service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:13.246946 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ebbd2-19df-4829-8afb-685ee264575d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:13.255520 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727ebbd2-19df-4829-8afb-685ee264575d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:13.257134 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727ebbd2-19df-4829-8afb-685ee264575d service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:13.269414 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3785/7548] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:40:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:40:13.426526 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe440496-7824-4283-bdd3-fa082f38d5be None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:13.428008 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-fe440496-7824-4283-bdd3-fa082f38d5be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:13.441436 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe440496-7824-4283-bdd3-fa082f38d5be None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:13.455380 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a29f80-05d4-471e-b2ce-b3ff7f24a5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:13.456902 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a29f80-05d4-471e-b2ce-b3ff7f24a5fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:13.457188 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a29f80-05d4-471e-b2ce-b3ff7f24a5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:13.457468 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a29f80-05d4-471e-b2ce-b3ff7f24a5fc admin admin] PATH_INFO: `/v3/projects/4c88cebde80d4f6ba499e0d4fb939de7` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:13.458682 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a29f80-05d4-471e-b2ce-b3ff7f24a5fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c88cebde80d4f6ba499e0d4fb939de7)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:13.468055 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a29f80-05d4-471e-b2ce-b3ff7f24a5fc admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:13.624086 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-54a29f80-05d4-471e-b2ce-b3ff7f24a5fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c88cebde80d4f6ba499e0d4fb939de7', 'request_id': 'req-54a29f80-05d4-471e-b2ce-b3ff7f24a5fc'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:13.629448 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-54a29f80-05d4-471e-b2ce-b3ff7f24a5fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c88cebde80d4f6ba499e0d4fb939de7', 'request_id': 'req-54a29f80-05d4-471e-b2ce-b3ff7f24a5fc'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:13.637483 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-54a29f80-05d4-471e-b2ce-b3ff7f24a5fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c88cebde80d4f6ba499e0d4fb939de7', 'request_id': 'req-54a29f80-05d4-471e-b2ce-b3ff7f24a5fc'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:13.723890 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-54a29f80-05d4-471e-b2ce-b3ff7f24a5fc admin admin] The token cache is being invalidate because project 4c88cebde80d4f6ba499e0d4fb939de7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:40:13.724301 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-54a29f80-05d4-471e-b2ce-b3ff7f24a5fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:13.725007 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-54a29f80-05d4-471e-b2ce-b3ff7f24a5fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:13.726694 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3764/7549] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:40:13 2022] DELETE /identity/v3/projects/4c88cebde80d4f6ba499e0d4fb939de7 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:40:13.732427 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b462738-afb6-47da-81f8-ea3a1d18b0a2 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:13.732918 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b462738-afb6-47da-81f8-ea3a1d18b0a2 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:13.733043 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b462738-afb6-47da-81f8-ea3a1d18b0a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:13.756942 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-5b462738-afb6-47da-81f8-ea3a1d18b0a2 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:40:13.758153 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-5b462738-afb6-47da-81f8-ea3a1d18b0a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:13.803597 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a29f80-05d4-471e-b2ce-b3ff7f24a5fc admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:13.805252 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-54a29f80-05d4-471e-b2ce-b3ff7f24a5fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:13.876396 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3786/7550] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:40:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:40:13.878422 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f67bedd-d936-42f0-925f-e86a7f638b7e None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:13.883382 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f67bedd-d936-42f0-925f-e86a7f638b7e None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:13.883382 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f67bedd-d936-42f0-925f-e86a7f638b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:13.895952 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a29f80-05d4-471e-b2ce-b3ff7f24a5fc admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:13.907521 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-5f67bedd-d936-42f0-925f-e86a7f638b7e None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:40:13.908783 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-5f67bedd-d936-42f0-925f-e86a7f638b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:13.912454 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaba5b4-edf6-49b4-94fc-fe204ab77626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:13.913809 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaba5b4-edf6-49b4-94fc-fe204ab77626 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:13.914097 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaba5b4-edf6-49b4-94fc-fe204ab77626 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:13.914368 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaba5b4-edf6-49b4-94fc-fe204ab77626 admin admin] PATH_INFO: `/v3/projects/272912a007ae474ba548b662282a84a6` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:13.917721 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaba5b4-edf6-49b4-94fc-fe204ab77626 admin admin] RBAC: Authorizing `identity:delete_project(project_id=272912a007ae474ba548b662282a84a6)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:13.920383 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaba5b4-edf6-49b4-94fc-fe204ab77626 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:13.922603 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3787/7551] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:40:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:40:13.934367 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f67bedd-d936-42f0-925f-e86a7f638b7e None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:13.954337 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f67bedd-d936-42f0-925f-e86a7f638b7e None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:13.959899 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e395801-3862-4421-9ab8-05d8a5c26867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:13.960740 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e395801-3862-4421-9ab8-05d8a5c26867 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:13.961033 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e395801-3862-4421-9ab8-05d8a5c26867 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:13.961317 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e395801-3862-4421-9ab8-05d8a5c26867 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:13.962100 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e395801-3862-4421-9ab8-05d8a5c26867 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:40:13.962444 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e395801-3862-4421-9ab8-05d8a5c26867 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:13.964180 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e395801-3862-4421-9ab8-05d8a5c26867 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:13.977383 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3788/7552] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:40:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:40:13.982331 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e395801-3862-4421-9ab8-05d8a5c26867 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:13.993344 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e395801-3862-4421-9ab8-05d8a5c26867 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:13.999787 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b872f6-e5b9-4255-a82d-a6bd327c833a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:14.000548 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b872f6-e5b9-4255-a82d-a6bd327c833a admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:14.000916 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b872f6-e5b9-4255-a82d-a6bd327c833a admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:14.001258 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b872f6-e5b9-4255-a82d-a6bd327c833a admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:14.002093 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b872f6-e5b9-4255-a82d-a6bd327c833a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:14.004193 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b872f6-e5b9-4255-a82d-a6bd327c833a admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:14.055942 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-caaba5b4-edf6-49b4-94fc-fe204ab77626 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '272912a007ae474ba548b662282a84a6', 'request_id': 'req-caaba5b4-edf6-49b4-94fc-fe204ab77626'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:14.063857 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-caaba5b4-edf6-49b4-94fc-fe204ab77626 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '272912a007ae474ba548b662282a84a6', 'request_id': 'req-caaba5b4-edf6-49b4-94fc-fe204ab77626'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:14.070576 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-caaba5b4-edf6-49b4-94fc-fe204ab77626 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '272912a007ae474ba548b662282a84a6', 'request_id': 'req-caaba5b4-edf6-49b4-94fc-fe204ab77626'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:14.184330 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3789/7553] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:40:13 2022] POST /identity/v3/projects => generated 385 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:40:14.185687 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b872f6-e5b9-4255-a82d-a6bd327c833a admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:14.188282 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d1b872f6-e5b9-4255-a82d-a6bd327c833a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:14.248161 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-caaba5b4-edf6-49b4-94fc-fe204ab77626 admin admin] The token cache is being invalidate because project 272912a007ae474ba548b662282a84a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:40:14.249172 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-caaba5b4-edf6-49b4-94fc-fe204ab77626 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:14.251411 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-caaba5b4-edf6-49b4-94fc-fe204ab77626 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:14.253733 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3765/7554] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:40:13 2022] DELETE /identity/v3/projects/272912a007ae474ba548b662282a84a6 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:40:14.255607 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaba5b4-edf6-49b4-94fc-fe204ab77626 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:14.268440 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-caaba5b4-edf6-49b4-94fc-fe204ab77626 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:14.300350 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b872f6-e5b9-4255-a82d-a6bd327c833a admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:14.308239 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d6d544-8e55-4266-b79d-fd0e97dca061 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:14.309376 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d6d544-8e55-4266-b79d-fd0e97dca061 service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:14.309725 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d6d544-8e55-4266-b79d-fd0e97dca061 service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:14.310016 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d6d544-8e55-4266-b79d-fd0e97dca061 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:14.312277 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-01d6d544-8e55-4266-b79d-fd0e97dca061 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:14.332990 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d6d544-8e55-4266-b79d-fd0e97dca061 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:14.335948 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d6d544-8e55-4266-b79d-fd0e97dca061 service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:14.349216 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaba5b4-edf6-49b4-94fc-fe204ab77626 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:14.365885 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3790/7555] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:40:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:40:14.369141 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d6d544-8e55-4266-b79d-fd0e97dca061 service nova] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:14.372203 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-01d6d544-8e55-4266-b79d-fd0e97dca061 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:14.451775 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47fbf4e-a20d-4c11-abcb-9e7d0e4222b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:14.451775 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47fbf4e-a20d-4c11-abcb-9e7d0e4222b2 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:14.452253 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47fbf4e-a20d-4c11-abcb-9e7d0e4222b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:14.452627 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47fbf4e-a20d-4c11-abcb-9e7d0e4222b2 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:14.453351 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47fbf4e-a20d-4c11-abcb-9e7d0e4222b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:14.455521 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47fbf4e-a20d-4c11-abcb-9e7d0e4222b2 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:14.486296 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d6d544-8e55-4266-b79d-fd0e97dca061 service nova] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:14.491324 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4bfaaf-6ab7-431a-9078-1d38209cc443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:14.492434 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4bfaaf-6ab7-431a-9078-1d38209cc443 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:14.492863 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4bfaaf-6ab7-431a-9078-1d38209cc443 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:14.495014 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4bfaaf-6ab7-431a-9078-1d38209cc443 admin admin] PATH_INFO: `/v3/users/7d9e2a2058384d82aa49a1a053b286fa` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:14.497115 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4bfaaf-6ab7-431a-9078-1d38209cc443 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d9e2a2058384d82aa49a1a053b286fa)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:14.499737 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4bfaaf-6ab7-431a-9078-1d38209cc443 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:14.566887 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3766/7556] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:40:14 2022] POST /identity/v3/users => generated 293 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:40:14.568074 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47fbf4e-a20d-4c11-abcb-9e7d0e4222b2 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:14.579064 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47fbf4e-a20d-4c11-abcb-9e7d0e4222b2 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:14.584316 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d8afea-f447-4041-a562-9f15d1bfb4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:14.585183 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d8afea-f447-4041-a562-9f15d1bfb4f0 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:14.585630 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d8afea-f447-4041-a562-9f15d1bfb4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:14.586067 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d8afea-f447-4041-a562-9f15d1bfb4f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:14.587087 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d8afea-f447-4041-a562-9f15d1bfb4f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:14.589461 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d8afea-f447-4041-a562-9f15d1bfb4f0 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:14.602518 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3767/7557] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:40:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:40:14.616482 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d8afea-f447-4041-a562-9f15d1bfb4f0 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:14.627233 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d8afea-f447-4041-a562-9f15d1bfb4f0 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:14.632788 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f52f22-59d6-4e0d-9478-4d062cef6094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:14.633462 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f52f22-59d6-4e0d-9478-4d062cef6094 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:14.633757 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f52f22-59d6-4e0d-9478-4d062cef6094 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:14.634038 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f52f22-59d6-4e0d-9478-4d062cef6094 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:14.635988 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f52f22-59d6-4e0d-9478-4d062cef6094 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:14.637705 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f52f22-59d6-4e0d-9478-4d062cef6094 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:14.650555 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3768/7558] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:40:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:40:14.656008 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f52f22-59d6-4e0d-9478-4d062cef6094 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:14.666418 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f52f22-59d6-4e0d-9478-4d062cef6094 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:14.671570 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ac92c-6ce7-4700-9f98-8cb12455ebe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:14.675022 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ac92c-6ce7-4700-9f98-8cb12455ebe5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:14.675022 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ac92c-6ce7-4700-9f98-8cb12455ebe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:14.675022 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ac92c-6ce7-4700-9f98-8cb12455ebe5 admin admin] PATH_INFO: `/v3/projects/9885da9c3c9f4af7a7fc6749d4c386be/users/91961906cd784469a3b17fed71501949/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:14.689474 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066ac92c-6ce7-4700-9f98-8cb12455ebe5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9885da9c3c9f4af7a7fc6749d4c386be, user_id=91961906cd784469a3b17fed71501949, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:14.692310 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066ac92c-6ce7-4700-9f98-8cb12455ebe5 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:14.735976 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0f4bfaaf-6ab7-431a-9078-1d38209cc443 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d9e2a2058384d82aa49a1a053b286fa'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:14.754763 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0f4bfaaf-6ab7-431a-9078-1d38209cc443 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d9e2a2058384d82aa49a1a053b286fa'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:14.764246 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0f4bfaaf-6ab7-431a-9078-1d38209cc443 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d9e2a2058384d82aa49a1a053b286fa'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:14.787601 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3769/7559] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:40:14 2022] PUT /identity/v3/projects/9885da9c3c9f4af7a7fc6749d4c386be/users/91961906cd784469a3b17fed71501949/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:40:14.799709 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d4320-fade-4813-8a77-a0099028c7d7 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:14.800274 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d4320-fade-4813-8a77-a0099028c7d7 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:14.800838 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d4320-fade-4813-8a77-a0099028c7d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:14.842171 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-764d4320-fade-4813-8a77-a0099028c7d7 None None] MFA Rules not processed for user `91961906cd784469a3b17fed71501949`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:40:14.845719 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-764d4320-fade-4813-8a77-a0099028c7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:14.856122 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0f4bfaaf-6ab7-431a-9078-1d38209cc443 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d9e2a2058384d82aa49a1a053b286fa'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:14.856423 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0f4bfaaf-6ab7-431a-9078-1d38209cc443 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d9e2a2058384d82aa49a1a053b286fa'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:14.868609 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3791/7560] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:40:14 2022] DELETE /identity/v3/users/7d9e2a2058384d82aa49a1a053b286fa => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:40:14.976894 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3770/7561] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:40:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:40:14.982388 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4bfaaf-6ab7-431a-9078-1d38209cc443 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:14.984044 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-0f4bfaaf-6ab7-431a-9078-1d38209cc443 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:15.081256 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4bfaaf-6ab7-431a-9078-1d38209cc443 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:15.087398 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a85535-5c7c-4d02-bc97-ac007fca65a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:15.091882 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a85535-5c7c-4d02-bc97-ac007fca65a7 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:15.091882 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a85535-5c7c-4d02-bc97-ac007fca65a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:15.091882 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a85535-5c7c-4d02-bc97-ac007fca65a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:15.091882 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a85535-5c7c-4d02-bc97-ac007fca65a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:15.095988 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a85535-5c7c-4d02-bc97-ac007fca65a7 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:15.254980 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3792/7562] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:40:14 2022] POST /identity/v3/projects => generated 387 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:40:15.259269 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764d4320-fade-4813-8a77-a0099028c7d7 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:15.304277 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a85535-5c7c-4d02-bc97-ac007fca65a7 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:15.307429 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-90a85535-5c7c-4d02-bc97-ac007fca65a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:15.356353 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764d4320-fade-4813-8a77-a0099028c7d7 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:15.433145 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a85535-5c7c-4d02-bc97-ac007fca65a7 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:15.439656 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef13b863-7e4d-4ac8-888e-d54ad9b617bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:15.441466 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13b863-7e4d-4ac8-888e-d54ad9b617bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:15.441466 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13b863-7e4d-4ac8-888e-d54ad9b617bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:15.441767 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13b863-7e4d-4ac8-888e-d54ad9b617bf admin admin] PATH_INFO: `/v3/projects/0e340cdd735347b5b067a6861c828b68` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:15.443035 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef13b863-7e4d-4ac8-888e-d54ad9b617bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e340cdd735347b5b067a6861c828b68)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:15.446133 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef13b863-7e4d-4ac8-888e-d54ad9b617bf admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:15.466317 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377a164d-9124-4153-8a0f-9454bd2f435c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:15.467582 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a164d-9124-4153-8a0f-9454bd2f435c admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:15.467582 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a164d-9124-4153-8a0f-9454bd2f435c admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:15.467779 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a164d-9124-4153-8a0f-9454bd2f435c admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:15.468415 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377a164d-9124-4153-8a0f-9454bd2f435c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:15.470374 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377a164d-9124-4153-8a0f-9454bd2f435c admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:15.569553 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3771/7563] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:40:15 2022] POST /identity/v3/users => generated 300 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:40:15.573453 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377a164d-9124-4153-8a0f-9454bd2f435c admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:15.583172 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377a164d-9124-4153-8a0f-9454bd2f435c admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:15.588409 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ce7547-29d5-403c-b880-2e5989ea11ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:15.589057 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce7547-29d5-403c-b880-2e5989ea11ef admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:15.589339 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce7547-29d5-403c-b880-2e5989ea11ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:15.589644 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce7547-29d5-403c-b880-2e5989ea11ef admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:15.590357 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ce7547-29d5-403c-b880-2e5989ea11ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:15.591988 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ce7547-29d5-403c-b880-2e5989ea11ef admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:15.602868 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3772/7564] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:40:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:40:15.615446 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ce7547-29d5-403c-b880-2e5989ea11ef admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:15.617274 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-90ce7547-29d5-403c-b880-2e5989ea11ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:15.626120 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ef13b863-7e4d-4ac8-888e-d54ad9b617bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e340cdd735347b5b067a6861c828b68', 'request_id': 'req-ef13b863-7e4d-4ac8-888e-d54ad9b617bf'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:15.631318 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ce7547-29d5-403c-b880-2e5989ea11ef admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:15.633356 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ef13b863-7e4d-4ac8-888e-d54ad9b617bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e340cdd735347b5b067a6861c828b68', 'request_id': 'req-ef13b863-7e4d-4ac8-888e-d54ad9b617bf'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:15.689584 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87da0ef5-2d24-425a-862a-c7ff0efeec03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:15.690489 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da0ef5-2d24-425a-862a-c7ff0efeec03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:15.690770 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da0ef5-2d24-425a-862a-c7ff0efeec03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:15.691044 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da0ef5-2d24-425a-862a-c7ff0efeec03 admin admin] PATH_INFO: `/v3/users/43b8ae7176574269b187ce6f4a3344ac` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:15.692356 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87da0ef5-2d24-425a-862a-c7ff0efeec03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43b8ae7176574269b187ce6f4a3344ac)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:15.694339 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87da0ef5-2d24-425a-862a-c7ff0efeec03 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:15.751679 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ef13b863-7e4d-4ac8-888e-d54ad9b617bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e340cdd735347b5b067a6861c828b68', 'request_id': 'req-ef13b863-7e4d-4ac8-888e-d54ad9b617bf'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:15.764198 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ef13b863-7e4d-4ac8-888e-d54ad9b617bf admin admin] The token cache is being invalidate because project 0e340cdd735347b5b067a6861c828b68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:40:15.764529 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ef13b863-7e4d-4ac8-888e-d54ad9b617bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:15.765187 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ef13b863-7e4d-4ac8-888e-d54ad9b617bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:15.766822 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3793/7565] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:40:15 2022] DELETE /identity/v3/projects/0e340cdd735347b5b067a6861c828b68 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:40:15.767622 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef13b863-7e4d-4ac8-888e-d54ad9b617bf admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:15.768886 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ef13b863-7e4d-4ac8-888e-d54ad9b617bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:15.783261 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef13b863-7e4d-4ac8-888e-d54ad9b617bf admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:15.788013 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d970a-b72b-47eb-9b24-861fb6bbb835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:15.788852 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d970a-b72b-47eb-9b24-861fb6bbb835 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:15.789137 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d970a-b72b-47eb-9b24-861fb6bbb835 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:15.789417 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d970a-b72b-47eb-9b24-861fb6bbb835 admin admin] PATH_INFO: `/v3/projects/78dfdb0fcebc4e9bb9443dfc70971bf3/users/ed481cdb046042fab0dd06c56111a634/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:15.804931 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4d970a-b72b-47eb-9b24-861fb6bbb835 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78dfdb0fcebc4e9bb9443dfc70971bf3, user_id=ed481cdb046042fab0dd06c56111a634, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:15.807810 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4d970a-b72b-47eb-9b24-861fb6bbb835 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:15.911715 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-87da0ef5-2d24-425a-862a-c7ff0efeec03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43b8ae7176574269b187ce6f4a3344ac'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:15.913804 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3794/7566] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:40:15 2022] PUT /identity/v3/projects/78dfdb0fcebc4e9bb9443dfc70971bf3/users/ed481cdb046042fab0dd06c56111a634/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:40:15.922270 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b6ca06-4a47-41c3-9892-ee1fd3ae89e4 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:15.922646 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-87da0ef5-2d24-425a-862a-c7ff0efeec03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43b8ae7176574269b187ce6f4a3344ac'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:15.922772 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b6ca06-4a47-41c3-9892-ee1fd3ae89e4 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:15.923221 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b6ca06-4a47-41c3-9892-ee1fd3ae89e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:15.923643 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-87da0ef5-2d24-425a-862a-c7ff0efeec03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43b8ae7176574269b187ce6f4a3344ac'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:15.941127 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-03b6ca06-4a47-41c3-9892-ee1fd3ae89e4 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:40:15.942389 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-03b6ca06-4a47-41c3-9892-ee1fd3ae89e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:15.983385 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-87da0ef5-2d24-425a-862a-c7ff0efeec03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43b8ae7176574269b187ce6f4a3344ac'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:15.999397 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-87da0ef5-2d24-425a-862a-c7ff0efeec03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43b8ae7176574269b187ce6f4a3344ac'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:16.005810 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3773/7567] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:40:15 2022] DELETE /identity/v3/users/43b8ae7176574269b187ce6f4a3344ac => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:40:16.006855 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87da0ef5-2d24-425a-862a-c7ff0efeec03 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:16.008222 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-87da0ef5-2d24-425a-862a-c7ff0efeec03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:16.041463 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3795/7568] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:40:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:40:16.053483 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65411072-cd31-467a-be34-1db1fb73d24d None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:16.053483 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65411072-cd31-467a-be34-1db1fb73d24d None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:16.053483 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65411072-cd31-467a-be34-1db1fb73d24d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:16.074005 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-65411072-cd31-467a-be34-1db1fb73d24d None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:40:16.075160 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-65411072-cd31-467a-be34-1db1fb73d24d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:16.118341 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87da0ef5-2d24-425a-862a-c7ff0efeec03 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:16.124662 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18f5cf0-4fde-483c-8fbd-b58c84a43c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:16.125557 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f5cf0-4fde-483c-8fbd-b58c84a43c81 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:16.125911 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f5cf0-4fde-483c-8fbd-b58c84a43c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:16.126282 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f5cf0-4fde-483c-8fbd-b58c84a43c81 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:16.127118 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18f5cf0-4fde-483c-8fbd-b58c84a43c81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:16.128882 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18f5cf0-4fde-483c-8fbd-b58c84a43c81 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:16.141994 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3774/7569] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:40:16 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:40:16.146794 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18f5cf0-4fde-483c-8fbd-b58c84a43c81 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:16.147445 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3796/7570] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:40:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:40:16.148383 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65411072-cd31-467a-be34-1db1fb73d24d None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:16.158440 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65411072-cd31-467a-be34-1db1fb73d24d None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:16.163184 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18f5cf0-4fde-483c-8fbd-b58c84a43c81 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:16.163983 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c3baf-6f2d-4166-9ae8-cfed2326c9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:16.164737 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c3baf-6f2d-4166-9ae8-cfed2326c9ac admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:16.165037 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c3baf-6f2d-4166-9ae8-cfed2326c9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:16.165298 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c3baf-6f2d-4166-9ae8-cfed2326c9ac admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:16.166225 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262c3baf-6f2d-4166-9ae8-cfed2326c9ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:40:16.166699 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262c3baf-6f2d-4166-9ae8-cfed2326c9ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:16.168241 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262c3baf-6f2d-4166-9ae8-cfed2326c9ac admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:16.168559 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0236f51-91ca-4036-8223-fe9ff7f8c429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:16.169485 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0236f51-91ca-4036-8223-fe9ff7f8c429 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:16.169806 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0236f51-91ca-4036-8223-fe9ff7f8c429 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:16.170062 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0236f51-91ca-4036-8223-fe9ff7f8c429 admin admin] PATH_INFO: `/v3/projects/78dfdb0fcebc4e9bb9443dfc70971bf3/users/ed481cdb046042fab0dd06c56111a634/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:16.172154 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0236f51-91ca-4036-8223-fe9ff7f8c429 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78dfdb0fcebc4e9bb9443dfc70971bf3, user_id=ed481cdb046042fab0dd06c56111a634, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:16.174839 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0236f51-91ca-4036-8223-fe9ff7f8c429 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:16.180771 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3797/7571] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:40:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:40:16.186325 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c3baf-6f2d-4166-9ae8-cfed2326c9ac admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:16.189171 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3775/7572] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:40:16 2022] PUT /identity/v3/projects/78dfdb0fcebc4e9bb9443dfc70971bf3/users/ed481cdb046042fab0dd06c56111a634/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:40:16.198478 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c3baf-6f2d-4166-9ae8-cfed2326c9ac admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:16.199344 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c37a8-d72d-4f9c-8100-a2090a68558a None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:16.200072 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c37a8-d72d-4f9c-8100-a2090a68558a None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:16.200072 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c37a8-d72d-4f9c-8100-a2090a68558a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:16.233846 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-771c37a8-d72d-4f9c-8100-a2090a68558a None None] MFA Rules not processed for user `ed481cdb046042fab0dd06c56111a634`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:40:16.235093 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-771c37a8-d72d-4f9c-8100-a2090a68558a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:16.266541 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7610e285-bf48-447e-b0aa-2d6eb5e6e5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:16.267091 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610e285-bf48-447e-b0aa-2d6eb5e6e5b4 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:16.267376 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610e285-bf48-447e-b0aa-2d6eb5e6e5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:16.267687 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610e285-bf48-447e-b0aa-2d6eb5e6e5b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:16.268380 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7610e285-bf48-447e-b0aa-2d6eb5e6e5b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:16.270324 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7610e285-bf48-447e-b0aa-2d6eb5e6e5b4 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:16.306938 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3776/7573] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:40:16 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:40:16.318259 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771c37a8-d72d-4f9c-8100-a2090a68558a None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:16.319667 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-771c37a8-d72d-4f9c-8100-a2090a68558a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:16.387660 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771c37a8-d72d-4f9c-8100-a2090a68558a None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:16.391321 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fc3cbb-9fef-4ab7-9d93-c25399710753 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198271d1c0d44cb58bace41a65f4b94c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:16.392195 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc3cbb-9fef-4ab7-9d93-c25399710753 service cinder] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:16.392417 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc3cbb-9fef-4ab7-9d93-c25399710753 service cinder] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:16.392701 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc3cbb-9fef-4ab7-9d93-c25399710753 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:16.401375 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3798/7574] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:40:16 2022] POST /identity/v3/projects => generated 373 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:40:16.402260 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7610e285-bf48-447e-b0aa-2d6eb5e6e5b4 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:16.403219 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fc3cbb-9fef-4ab7-9d93-c25399710753 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:16.404721 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fc3cbb-9fef-4ab7-9d93-c25399710753 service cinder] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:16.406157 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-7610e285-bf48-447e-b0aa-2d6eb5e6e5b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:16.414731 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3777/7575] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:40:16 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:40:16.415325 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fc3cbb-9fef-4ab7-9d93-c25399710753 service cinder] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:16.426622 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fc3cbb-9fef-4ab7-9d93-c25399710753 service cinder] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:16.486779 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7610e285-bf48-447e-b0aa-2d6eb5e6e5b4 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:16.493510 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8590d748-b05b-4ed8-af04-e3997d4e6dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:16.495226 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590d748-b05b-4ed8-af04-e3997d4e6dda admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:16.495359 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2509fa4-e245-4898-85cd-c2338fdd1fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:16.495548 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590d748-b05b-4ed8-af04-e3997d4e6dda admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:16.495836 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590d748-b05b-4ed8-af04-e3997d4e6dda admin admin] PATH_INFO: `/v3/projects/882c775cc8694e0aab28c39b98827f8c` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:16.496223 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2509fa4-e245-4898-85cd-c2338fdd1fee admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:16.496576 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2509fa4-e245-4898-85cd-c2338fdd1fee admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:16.496917 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2509fa4-e245-4898-85cd-c2338fdd1fee admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:16.498131 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2509fa4-e245-4898-85cd-c2338fdd1fee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:16.498260 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8590d748-b05b-4ed8-af04-e3997d4e6dda admin admin] RBAC: Authorizing `identity:delete_project(project_id=882c775cc8694e0aab28c39b98827f8c)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:16.500180 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8590d748-b05b-4ed8-af04-e3997d4e6dda admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:16.500593 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2509fa4-e245-4898-85cd-c2338fdd1fee admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:16.654597 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3778/7576] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:40:16 2022] POST /identity/v3/users => generated 287 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:40:16.655786 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2509fa4-e245-4898-85cd-c2338fdd1fee admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:16.663663 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8590d748-b05b-4ed8-af04-e3997d4e6dda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '882c775cc8694e0aab28c39b98827f8c', 'request_id': 'req-8590d748-b05b-4ed8-af04-e3997d4e6dda'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:16.665432 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2509fa4-e245-4898-85cd-c2338fdd1fee admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:16.669813 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8590d748-b05b-4ed8-af04-e3997d4e6dda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '882c775cc8694e0aab28c39b98827f8c', 'request_id': 'req-8590d748-b05b-4ed8-af04-e3997d4e6dda'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:16.722445 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cb5e17-27b7-47ec-b495-2384e2376c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:16.723116 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb5e17-27b7-47ec-b495-2384e2376c37 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:16.723406 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb5e17-27b7-47ec-b495-2384e2376c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:16.723718 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb5e17-27b7-47ec-b495-2384e2376c37 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:16.724444 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cb5e17-27b7-47ec-b495-2384e2376c37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:16.726047 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cb5e17-27b7-47ec-b495-2384e2376c37 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:16.736567 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3779/7577] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:40:16 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:40:16.740608 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cb5e17-27b7-47ec-b495-2384e2376c37 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:16.752300 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cb5e17-27b7-47ec-b495-2384e2376c37 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:16.757409 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8802ccc-0982-43fd-bd89-a3cf2249c9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:16.757596 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8590d748-b05b-4ed8-af04-e3997d4e6dda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '882c775cc8694e0aab28c39b98827f8c', 'request_id': 'req-8590d748-b05b-4ed8-af04-e3997d4e6dda'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:16.758132 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8802ccc-0982-43fd-bd89-a3cf2249c9ec admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:16.758422 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8802ccc-0982-43fd-bd89-a3cf2249c9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:16.759455 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8802ccc-0982-43fd-bd89-a3cf2249c9ec admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:16.759714 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8802ccc-0982-43fd-bd89-a3cf2249c9ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:16.761563 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8802ccc-0982-43fd-bd89-a3cf2249c9ec admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:16.772425 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8590d748-b05b-4ed8-af04-e3997d4e6dda admin admin] The token cache is being invalidate because project 882c775cc8694e0aab28c39b98827f8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:40:16.772715 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8590d748-b05b-4ed8-af04-e3997d4e6dda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:16.773385 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8590d748-b05b-4ed8-af04-e3997d4e6dda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:16.773513 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3780/7578] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:40:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:40:16.777626 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8802ccc-0982-43fd-bd89-a3cf2249c9ec admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:16.779082 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3799/7579] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:40:16 2022] DELETE /identity/v3/projects/882c775cc8694e0aab28c39b98827f8c => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:40:16.781861 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-f8802ccc-0982-43fd-bd89-a3cf2249c9ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:16.782856 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8590d748-b05b-4ed8-af04-e3997d4e6dda admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:16.784532 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-8590d748-b05b-4ed8-af04-e3997d4e6dda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:16.799412 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8802ccc-0982-43fd-bd89-a3cf2249c9ec admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:16.801003 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8590d748-b05b-4ed8-af04-e3997d4e6dda admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:16.804568 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2341ecf7-8630-4421-856a-b9f9a5acb519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:16.805751 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2341ecf7-8630-4421-856a-b9f9a5acb519 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:16.806198 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2341ecf7-8630-4421-856a-b9f9a5acb519 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:16.807286 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926ec60d-15a7-40f8-bbb4-fbce4bd259f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:16.808039 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2341ecf7-8630-4421-856a-b9f9a5acb519 admin admin] PATH_INFO: `/v3/projects/f48b39c4a8ed40fabb1b35f02c8ba40a/users/28a1a13b27444ee8b351cc068b1c1938/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:16.808371 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ec60d-15a7-40f8-bbb4-fbce4bd259f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:16.808728 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ec60d-15a7-40f8-bbb4-fbce4bd259f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:16.809069 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ec60d-15a7-40f8-bbb4-fbce4bd259f2 admin admin] PATH_INFO: `/v3/users/ded1fd35ea4845e39ee1cbaba5afc7fa` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:16.810470 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926ec60d-15a7-40f8-bbb4-fbce4bd259f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ded1fd35ea4845e39ee1cbaba5afc7fa)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:16.812858 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926ec60d-15a7-40f8-bbb4-fbce4bd259f2 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:16.824525 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2341ecf7-8630-4421-856a-b9f9a5acb519 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f48b39c4a8ed40fabb1b35f02c8ba40a, user_id=28a1a13b27444ee8b351cc068b1c1938, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:16.827231 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2341ecf7-8630-4421-856a-b9f9a5acb519 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:16.945812 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3781/7580] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:40:16 2022] PUT /identity/v3/projects/f48b39c4a8ed40fabb1b35f02c8ba40a/users/28a1a13b27444ee8b351cc068b1c1938/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:40:16.959947 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb898d-d298-4987-a1b3-771273ccaf75 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:16.960152 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb898d-d298-4987-a1b3-771273ccaf75 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:16.960560 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb898d-d298-4987-a1b3-771273ccaf75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:16.989744 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-a1eb898d-d298-4987-a1b3-771273ccaf75 None None] MFA Rules not processed for user `28a1a13b27444ee8b351cc068b1c1938`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:40:16.990962 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-a1eb898d-d298-4987-a1b3-771273ccaf75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:17.026979 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-926ec60d-15a7-40f8-bbb4-fbce4bd259f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ded1fd35ea4845e39ee1cbaba5afc7fa'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:17.041503 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-926ec60d-15a7-40f8-bbb4-fbce4bd259f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ded1fd35ea4845e39ee1cbaba5afc7fa'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:17.052792 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-926ec60d-15a7-40f8-bbb4-fbce4bd259f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ded1fd35ea4845e39ee1cbaba5afc7fa'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:17.078798 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3782/7581] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:40:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:40:17.085734 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eb898d-d298-4987-a1b3-771273ccaf75 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:17.087103 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-a1eb898d-d298-4987-a1b3-771273ccaf75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:17.148291 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-926ec60d-15a7-40f8-bbb4-fbce4bd259f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ded1fd35ea4845e39ee1cbaba5afc7fa'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:17.148942 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-926ec60d-15a7-40f8-bbb4-fbce4bd259f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ded1fd35ea4845e39ee1cbaba5afc7fa'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:17.166272 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3800/7582] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:40:16 2022] DELETE /identity/v3/users/ded1fd35ea4845e39ee1cbaba5afc7fa => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:40:17.211124 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eb898d-d298-4987-a1b3-771273ccaf75 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:17.274323 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27012de9-2e80-47ff-bb7e-5d436d694e21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:17.275013 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27012de9-2e80-47ff-bb7e-5d436d694e21 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:17.275343 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27012de9-2e80-47ff-bb7e-5d436d694e21 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:17.275750 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27012de9-2e80-47ff-bb7e-5d436d694e21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:17.277498 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-27012de9-2e80-47ff-bb7e-5d436d694e21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:17.339067 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27012de9-2e80-47ff-bb7e-5d436d694e21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:17.340660 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27012de9-2e80-47ff-bb7e-5d436d694e21 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:17.350845 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3783/7583] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:40:17 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:40:17.435652 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926ec60d-15a7-40f8-bbb4-fbce4bd259f2 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:17.437108 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-926ec60d-15a7-40f8-bbb4-fbce4bd259f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:17.503831 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926ec60d-15a7-40f8-bbb4-fbce4bd259f2 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:17.508510 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d776ad01-ed3c-4286-adfb-623f30b3c659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:17.509371 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d776ad01-ed3c-4286-adfb-623f30b3c659 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:17.509786 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d776ad01-ed3c-4286-adfb-623f30b3c659 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:17.510131 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d776ad01-ed3c-4286-adfb-623f30b3c659 admin admin] PATH_INFO: `/v3/projects/61d01ae70a4f41fea28c0fcb35d9323f` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:17.511325 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d776ad01-ed3c-4286-adfb-623f30b3c659 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61d01ae70a4f41fea28c0fcb35d9323f)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:17.513311 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d776ad01-ed3c-4286-adfb-623f30b3c659 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:17.689329 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d776ad01-ed3c-4286-adfb-623f30b3c659 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61d01ae70a4f41fea28c0fcb35d9323f', 'request_id': 'req-d776ad01-ed3c-4286-adfb-623f30b3c659'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:17.694800 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d776ad01-ed3c-4286-adfb-623f30b3c659 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61d01ae70a4f41fea28c0fcb35d9323f', 'request_id': 'req-d776ad01-ed3c-4286-adfb-623f30b3c659'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:17.809206 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d776ad01-ed3c-4286-adfb-623f30b3c659 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61d01ae70a4f41fea28c0fcb35d9323f', 'request_id': 'req-d776ad01-ed3c-4286-adfb-623f30b3c659'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:17.823595 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d776ad01-ed3c-4286-adfb-623f30b3c659 admin admin] The token cache is being invalidate because project 61d01ae70a4f41fea28c0fcb35d9323f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:40:17.824233 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d776ad01-ed3c-4286-adfb-623f30b3c659 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:17.824972 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d776ad01-ed3c-4286-adfb-623f30b3c659 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:17.827182 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3801/7584] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:40:17 2022] DELETE /identity/v3/projects/61d01ae70a4f41fea28c0fcb35d9323f => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:40:17.832370 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6581002-66c9-4b85-bdb0-2b4b4a25b2ba None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:17.836029 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6581002-66c9-4b85-bdb0-2b4b4a25b2ba None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:17.836029 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6581002-66c9-4b85-bdb0-2b4b4a25b2ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:17.854320 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-b6581002-66c9-4b85-bdb0-2b4b4a25b2ba None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:40:17.858664 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b6581002-66c9-4b85-bdb0-2b4b4a25b2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:17.922758 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3784/7585] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:40:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:40:17.930856 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a620e3b-3375-46fc-a193-9f801a22c660 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:17.932056 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a620e3b-3375-46fc-a193-9f801a22c660 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:17.933117 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a620e3b-3375-46fc-a193-9f801a22c660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:17.952971 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-4a620e3b-3375-46fc-a193-9f801a22c660 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:40:17.954246 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-4a620e3b-3375-46fc-a193-9f801a22c660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:17.962281 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3802/7586] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:40:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:40:17.967176 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6581002-66c9-4b85-bdb0-2b4b4a25b2ba None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:17.977366 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6581002-66c9-4b85-bdb0-2b4b4a25b2ba None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:17.982167 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de201a27-eee1-4ae6-a38f-8500d007a556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:17.982857 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de201a27-eee1-4ae6-a38f-8500d007a556 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:17.983137 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de201a27-eee1-4ae6-a38f-8500d007a556 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:17.983413 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de201a27-eee1-4ae6-a38f-8500d007a556 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:17.984188 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de201a27-eee1-4ae6-a38f-8500d007a556 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:40:17.984490 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de201a27-eee1-4ae6-a38f-8500d007a556 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:17.986113 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de201a27-eee1-4ae6-a38f-8500d007a556 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:17.998845 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3785/7587] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:40:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:40:18.002773 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a620e3b-3375-46fc-a193-9f801a22c660 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:18.013708 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a620e3b-3375-46fc-a193-9f801a22c660 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:18.015935 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de201a27-eee1-4ae6-a38f-8500d007a556 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:18.022565 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-de201a27-eee1-4ae6-a38f-8500d007a556 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:18.022729 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd7a74a-6ac3-45f9-b243-c20972ce599a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:18.022729 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd7a74a-6ac3-45f9-b243-c20972ce599a admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:18.022729 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd7a74a-6ac3-45f9-b243-c20972ce599a admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:18.022729 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd7a74a-6ac3-45f9-b243-c20972ce599a admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:18.023050 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd7a74a-6ac3-45f9-b243-c20972ce599a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:18.023808 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd7a74a-6ac3-45f9-b243-c20972ce599a admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:18.031829 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de201a27-eee1-4ae6-a38f-8500d007a556 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:18.036802 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60349b5-d9ba-4400-8859-5c43d65e4067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:18.037736 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60349b5-d9ba-4400-8859-5c43d65e4067 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:18.038387 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60349b5-d9ba-4400-8859-5c43d65e4067 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:18.043797 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60349b5-d9ba-4400-8859-5c43d65e4067 admin admin] PATH_INFO: `/v3/users/91961906cd784469a3b17fed71501949` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:18.043797 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60349b5-d9ba-4400-8859-5c43d65e4067 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91961906cd784469a3b17fed71501949)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:18.043797 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60349b5-d9ba-4400-8859-5c43d65e4067 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:18.196239 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3803/7588] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:40:18 2022] POST /identity/v3/projects => generated 401 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:40:18.198238 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd7a74a-6ac3-45f9-b243-c20972ce599a admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:18.200193 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-dcd7a74a-6ac3-45f9-b243-c20972ce599a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:18.281796 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd7a74a-6ac3-45f9-b243-c20972ce599a admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:18.286580 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb894182-6c84-4817-8503-5bee562ffe86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:18.287538 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb894182-6c84-4817-8503-5bee562ffe86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:18.287826 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb894182-6c84-4817-8503-5bee562ffe86 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:18.288106 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb894182-6c84-4817-8503-5bee562ffe86 admin admin] PATH_INFO: `/v3/users/0f7b1f92d6fd4692b9c2ca865e0a01ab` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:18.289309 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb894182-6c84-4817-8503-5bee562ffe86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f7b1f92d6fd4692b9c2ca865e0a01ab)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:18.291347 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb894182-6c84-4817-8503-5bee562ffe86 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:18.338803 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d60349b5-d9ba-4400-8859-5c43d65e4067 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91961906cd784469a3b17fed71501949'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:18.345571 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d60349b5-d9ba-4400-8859-5c43d65e4067 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91961906cd784469a3b17fed71501949'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:18.346473 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d60349b5-d9ba-4400-8859-5c43d65e4067 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91961906cd784469a3b17fed71501949'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:18.496744 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d60349b5-d9ba-4400-8859-5c43d65e4067 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91961906cd784469a3b17fed71501949'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:18.510553 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d60349b5-d9ba-4400-8859-5c43d65e4067 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91961906cd784469a3b17fed71501949'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:18.516926 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3786/7589] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:40:18 2022] DELETE /identity/v3/users/91961906cd784469a3b17fed71501949 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:40:18.517777 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60349b5-d9ba-4400-8859-5c43d65e4067 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:18.519216 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-d60349b5-d9ba-4400-8859-5c43d65e4067 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:18.583760 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60349b5-d9ba-4400-8859-5c43d65e4067 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:18.588906 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd3ec90-f651-4b0d-9320-469bb55333c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:18.590269 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3ec90-f651-4b0d-9320-469bb55333c5 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:18.590269 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3ec90-f651-4b0d-9320-469bb55333c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:18.590269 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3ec90-f651-4b0d-9320-469bb55333c5 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:18.590847 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd3ec90-f651-4b0d-9320-469bb55333c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:18.592815 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd3ec90-f651-4b0d-9320-469bb55333c5 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:18.599845 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-fb894182-6c84-4817-8503-5bee562ffe86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f7b1f92d6fd4692b9c2ca865e0a01ab'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:18.611919 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-fb894182-6c84-4817-8503-5bee562ffe86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f7b1f92d6fd4692b9c2ca865e0a01ab'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:18.618579 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-fb894182-6c84-4817-8503-5bee562ffe86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f7b1f92d6fd4692b9c2ca865e0a01ab'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:18.697046 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3787/7590] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:40:18 2022] POST /identity/v3/users => generated 301 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:40:18.699196 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ffdb7-108e-450e-9c36-22dc33657bfe None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:18.699558 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ffdb7-108e-450e-9c36-22dc33657bfe None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:18.699975 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ffdb7-108e-450e-9c36-22dc33657bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:18.714344 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-fb894182-6c84-4817-8503-5bee562ffe86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f7b1f92d6fd4692b9c2ca865e0a01ab'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:18.717389 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-fb894182-6c84-4817-8503-5bee562ffe86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f7b1f92d6fd4692b9c2ca865e0a01ab'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:18.719723 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-638ffdb7-108e-450e-9c36-22dc33657bfe None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:40:18.721140 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-638ffdb7-108e-450e-9c36-22dc33657bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:18.721687 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3804/7591] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:40:18 2022] DELETE /identity/v3/users/0f7b1f92d6fd4692b9c2ca865e0a01ab => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:40:18.722636 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb894182-6c84-4817-8503-5bee562ffe86 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:18.724146 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-fb894182-6c84-4817-8503-5bee562ffe86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:18.784122 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3788/7592] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:40:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:40:18.785248 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c80dd2-795c-49cd-961a-dc5dcd36fecb None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:18.785534 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c80dd2-795c-49cd-961a-dc5dcd36fecb None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:18.785811 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c80dd2-795c-49cd-961a-dc5dcd36fecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:18.799037 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb894182-6c84-4817-8503-5bee562ffe86 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:18.803583 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e67909-a715-4cc0-82d9-7c2ca3ed86f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:18.804442 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e67909-a715-4cc0-82d9-7c2ca3ed86f0 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:18.808816 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e67909-a715-4cc0-82d9-7c2ca3ed86f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:18.808816 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e67909-a715-4cc0-82d9-7c2ca3ed86f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:18.808816 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e67909-a715-4cc0-82d9-7c2ca3ed86f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:18.809069 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-27c80dd2-795c-49cd-961a-dc5dcd36fecb None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:40:18.809159 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e67909-a715-4cc0-82d9-7c2ca3ed86f0 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:18.809252 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-27c80dd2-795c-49cd-961a-dc5dcd36fecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:18.820230 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3789/7593] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:40:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:40:18.820230 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c80dd2-795c-49cd-961a-dc5dcd36fecb None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:18.820515 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3805/7594] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:40:18.822610 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-27c80dd2-795c-49cd-961a-dc5dcd36fecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:18.824583 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e67909-a715-4cc0-82d9-7c2ca3ed86f0 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:18.835222 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e67909-a715-4cc0-82d9-7c2ca3ed86f0 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:18.841548 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b10e1-03c1-494e-aa34-05c29a58f6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:18.842277 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b10e1-03c1-494e-aa34-05c29a58f6e8 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:18.842554 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b10e1-03c1-494e-aa34-05c29a58f6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:18.842833 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b10e1-03c1-494e-aa34-05c29a58f6e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:18.843578 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76b10e1-03c1-494e-aa34-05c29a58f6e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:18.845171 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76b10e1-03c1-494e-aa34-05c29a58f6e8 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:18.855990 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3806/7595] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:40:18.856800 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b10e1-03c1-494e-aa34-05c29a58f6e8 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:18.858467 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e76b10e1-03c1-494e-aa34-05c29a58f6e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:18.887187 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c80dd2-795c-49cd-961a-dc5dcd36fecb None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:18.901841 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d9c3c3-98b6-49aa-895e-43dda4d0f91a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:18.902656 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9c3c3-98b6-49aa-895e-43dda4d0f91a service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:18.903965 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9c3c3-98b6-49aa-895e-43dda4d0f91a service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:18.904490 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9c3c3-98b6-49aa-895e-43dda4d0f91a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:18.917165 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d9c3c3-98b6-49aa-895e-43dda4d0f91a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:18.918630 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d9c3c3-98b6-49aa-895e-43dda4d0f91a service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:18.924738 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b10e1-03c1-494e-aa34-05c29a58f6e8 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:18.928751 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472953de-b57a-4c30-a762-e873084c745a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:18.929404 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472953de-b57a-4c30-a762-e873084c745a service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:18.929686 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472953de-b57a-4c30-a762-e873084c745a service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:18.929962 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472953de-b57a-4c30-a762-e873084c745a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:18.930479 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3790/7596] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:40:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:40:18.932290 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d9c3c3-98b6-49aa-895e-43dda4d0f91a service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:18.943697 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472953de-b57a-4c30-a762-e873084c745a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:18.946388 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472953de-b57a-4c30-a762-e873084c745a service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:18.947309 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d9c3c3-98b6-49aa-895e-43dda4d0f91a service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:18.952924 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b8d51b-6078-4cac-b547-90aef2fd3798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:18.954044 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b8d51b-6078-4cac-b547-90aef2fd3798 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:18.954448 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b8d51b-6078-4cac-b547-90aef2fd3798 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:18.955010 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b8d51b-6078-4cac-b547-90aef2fd3798 admin admin] PATH_INFO: `/v3/projects/742a9e0434ae49e4807cc4b057212c39/users/b3d32d7f77de4f2da091b56296c976ed/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:18.960102 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3807/7597] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:40:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:40:18.989358 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b8d51b-6078-4cac-b547-90aef2fd3798 admin admin] RBAC: Authorizing `identity:create_grant(project_id=742a9e0434ae49e4807cc4b057212c39, user_id=b3d32d7f77de4f2da091b56296c976ed, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:18.993642 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b8d51b-6078-4cac-b547-90aef2fd3798 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:19.042604 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472953de-b57a-4c30-a762-e873084c745a service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:19.048434 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-472953de-b57a-4c30-a762-e873084c745a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:19.066088 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472953de-b57a-4c30-a762-e873084c745a service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:19.075217 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1ee185-c467-4632-bf3b-afdd76b24a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:19.076169 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ee185-c467-4632-bf3b-afdd76b24a24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:19.076517 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ee185-c467-4632-bf3b-afdd76b24a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:19.077074 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ee185-c467-4632-bf3b-afdd76b24a24 admin admin] PATH_INFO: `/v3/users/1e691c70db224be383a5ba2458bdd400` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:19.078991 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1ee185-c467-4632-bf3b-afdd76b24a24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e691c70db224be383a5ba2458bdd400)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:19.082035 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1ee185-c467-4632-bf3b-afdd76b24a24 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:19.099863 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3791/7598] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:40:18 2022] PUT /identity/v3/projects/742a9e0434ae49e4807cc4b057212c39/users/b3d32d7f77de4f2da091b56296c976ed/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:40:19.126443 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e6b64e-b337-4a1e-9257-7f4790ba9445 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:19.130939 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e6b64e-b337-4a1e-9257-7f4790ba9445 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:19.130939 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e6b64e-b337-4a1e-9257-7f4790ba9445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:19.173731 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-38e6b64e-b337-4a1e-9257-7f4790ba9445 None None] MFA Rules not processed for user `b3d32d7f77de4f2da091b56296c976ed`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:40:19.175070 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-38e6b64e-b337-4a1e-9257-7f4790ba9445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:19.245858 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3792/7599] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:40:19 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:40:19.260576 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e6b64e-b337-4a1e-9257-7f4790ba9445 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:19.330553 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e6b64e-b337-4a1e-9257-7f4790ba9445 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:19.335219 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6ae051-fff8-4ae9-8da7-6c3ccd9019b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:19.336197 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ae051-fff8-4ae9-8da7-6c3ccd9019b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:19.336504 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ae051-fff8-4ae9-8da7-6c3ccd9019b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:19.336781 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ae051-fff8-4ae9-8da7-6c3ccd9019b4 admin admin] PATH_INFO: `/v3/users/b3d32d7f77de4f2da091b56296c976ed` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:19.339113 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6ae051-fff8-4ae9-8da7-6c3ccd9019b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3d32d7f77de4f2da091b56296c976ed)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:19.341147 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6ae051-fff8-4ae9-8da7-6c3ccd9019b4 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:19.359539 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5c1ee185-c467-4632-bf3b-afdd76b24a24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e691c70db224be383a5ba2458bdd400'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:19.380042 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5c1ee185-c467-4632-bf3b-afdd76b24a24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e691c70db224be383a5ba2458bdd400'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:19.388925 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5c1ee185-c467-4632-bf3b-afdd76b24a24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e691c70db224be383a5ba2458bdd400'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:19.471537 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5c1ee185-c467-4632-bf3b-afdd76b24a24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e691c70db224be383a5ba2458bdd400'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:19.472290 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5c1ee185-c467-4632-bf3b-afdd76b24a24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e691c70db224be383a5ba2458bdd400'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:19.479374 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3808/7600] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:40:19 2022] DELETE /identity/v3/users/1e691c70db224be383a5ba2458bdd400 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:40:19.484355 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b8fe4-fda0-4094-a57e-08bf00509278 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:19.484355 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b8fe4-fda0-4094-a57e-08bf00509278 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:19.484355 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b8fe4-fda0-4094-a57e-08bf00509278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:19.502320 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-e42b8fe4-fda0-4094-a57e-08bf00509278 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:40:19.503551 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e42b8fe4-fda0-4094-a57e-08bf00509278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:19.574571 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ad6ae051-fff8-4ae9-8da7-6c3ccd9019b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3d32d7f77de4f2da091b56296c976ed'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:19.577858 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3809/7601] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:40:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:40:19.578946 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42b8fe4-fda0-4094-a57e-08bf00509278 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:19.580447 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e42b8fe4-fda0-4094-a57e-08bf00509278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:19.592673 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ad6ae051-fff8-4ae9-8da7-6c3ccd9019b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3d32d7f77de4f2da091b56296c976ed'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:19.593474 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ad6ae051-fff8-4ae9-8da7-6c3ccd9019b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3d32d7f77de4f2da091b56296c976ed'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:19.599280 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42b8fe4-fda0-4094-a57e-08bf00509278 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:19.599280 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3c37a1-e26b-43f3-8b4e-6d424e641621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:19.600357 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c37a1-e26b-43f3-8b4e-6d424e641621 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:19.600634 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c37a1-e26b-43f3-8b4e-6d424e641621 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:19.600916 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c37a1-e26b-43f3-8b4e-6d424e641621 admin admin] PATH_INFO: `/v3/projects/9885da9c3c9f4af7a7fc6749d4c386be` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:19.602119 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3c37a1-e26b-43f3-8b4e-6d424e641621 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9885da9c3c9f4af7a7fc6749d4c386be)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:19.605055 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3c37a1-e26b-43f3-8b4e-6d424e641621 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:19.698174 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ad6ae051-fff8-4ae9-8da7-6c3ccd9019b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3d32d7f77de4f2da091b56296c976ed'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:19.712479 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ad6ae051-fff8-4ae9-8da7-6c3ccd9019b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3d32d7f77de4f2da091b56296c976ed'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:19.720221 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3793/7602] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:40:19 2022] DELETE /identity/v3/users/b3d32d7f77de4f2da091b56296c976ed => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:40:19.721246 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6ae051-fff8-4ae9-8da7-6c3ccd9019b4 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:19.722912 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-ad6ae051-fff8-4ae9-8da7-6c3ccd9019b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:19.725748 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5e3c37a1-e26b-43f3-8b4e-6d424e641621 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9885da9c3c9f4af7a7fc6749d4c386be', 'request_id': 'req-5e3c37a1-e26b-43f3-8b4e-6d424e641621'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:19.732756 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5e3c37a1-e26b-43f3-8b4e-6d424e641621 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9885da9c3c9f4af7a7fc6749d4c386be', 'request_id': 'req-5e3c37a1-e26b-43f3-8b4e-6d424e641621'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:19.790724 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6ae051-fff8-4ae9-8da7-6c3ccd9019b4 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:19.794553 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf8264a-6e6a-4f40-8fe3-566904d6d538 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:19.795238 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8264a-6e6a-4f40-8fe3-566904d6d538 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:19.795589 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8264a-6e6a-4f40-8fe3-566904d6d538 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:19.795872 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8264a-6e6a-4f40-8fe3-566904d6d538 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:19.797704 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-acf8264a-6e6a-4f40-8fe3-566904d6d538 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:19.810732 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5e3c37a1-e26b-43f3-8b4e-6d424e641621 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9885da9c3c9f4af7a7fc6749d4c386be', 'request_id': 'req-5e3c37a1-e26b-43f3-8b4e-6d424e641621'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:19.824182 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5e3c37a1-e26b-43f3-8b4e-6d424e641621 admin admin] The token cache is being invalidate because project 9885da9c3c9f4af7a7fc6749d4c386be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:40:19.824815 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5e3c37a1-e26b-43f3-8b4e-6d424e641621 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:19.825175 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5e3c37a1-e26b-43f3-8b4e-6d424e641621 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:19.827088 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3810/7603] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:40:19 2022] DELETE /identity/v3/projects/9885da9c3c9f4af7a7fc6749d4c386be => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:40:19.827768 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3c37a1-e26b-43f3-8b4e-6d424e641621 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:19.830847 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-5e3c37a1-e26b-43f3-8b4e-6d424e641621 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:19.868995 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf8264a-6e6a-4f40-8fe3-566904d6d538 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:19.873080 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf8264a-6e6a-4f40-8fe3-566904d6d538 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:19.883597 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3794/7604] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:40:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:40:19.885575 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7567b31-63f3-464d-88b7-31e71935989a None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:19.885924 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7567b31-63f3-464d-88b7-31e71935989a None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:19.886353 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7567b31-63f3-464d-88b7-31e71935989a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:19.901526 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3c37a1-e26b-43f3-8b4e-6d424e641621 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:19.906014 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-a7567b31-63f3-464d-88b7-31e71935989a None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:40:19.906916 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb4e77-ac3c-4f51-92e2-6f00e55ba43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:19.907293 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-a7567b31-63f3-464d-88b7-31e71935989a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:19.908254 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb4e77-ac3c-4f51-92e2-6f00e55ba43d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:19.908650 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb4e77-ac3c-4f51-92e2-6f00e55ba43d admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:19.909023 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb4e77-ac3c-4f51-92e2-6f00e55ba43d admin admin] PATH_INFO: `/v3/projects/1c8d88a4468a4423a15fc177f693d93d` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:19.910386 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbb4e77-ac3c-4f51-92e2-6f00e55ba43d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c8d88a4468a4423a15fc177f693d93d)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:19.912519 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbb4e77-ac3c-4f51-92e2-6f00e55ba43d admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:19.921798 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3795/7605] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:40:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:40:19.921798 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7567b31-63f3-464d-88b7-31e71935989a None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:19.921798 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-a7567b31-63f3-464d-88b7-31e71935989a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:19.945765 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7567b31-63f3-464d-88b7-31e71935989a None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:19.951089 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a148df-46a2-4097-a177-e86dea96c426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:19.952010 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a148df-46a2-4097-a177-e86dea96c426 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:19.952348 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a148df-46a2-4097-a177-e86dea96c426 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:19.954923 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a148df-46a2-4097-a177-e86dea96c426 admin admin] PATH_INFO: `/v3/users/ed481cdb046042fab0dd06c56111a634` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:19.954923 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a148df-46a2-4097-a177-e86dea96c426 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed481cdb046042fab0dd06c56111a634)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:19.956132 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a148df-46a2-4097-a177-e86dea96c426 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:20.078196 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6dbb4e77-ac3c-4f51-92e2-6f00e55ba43d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c8d88a4468a4423a15fc177f693d93d', 'request_id': 'req-6dbb4e77-ac3c-4f51-92e2-6f00e55ba43d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:20.083720 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6dbb4e77-ac3c-4f51-92e2-6f00e55ba43d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c8d88a4468a4423a15fc177f693d93d', 'request_id': 'req-6dbb4e77-ac3c-4f51-92e2-6f00e55ba43d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:20.186499 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6dbb4e77-ac3c-4f51-92e2-6f00e55ba43d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c8d88a4468a4423a15fc177f693d93d', 'request_id': 'req-6dbb4e77-ac3c-4f51-92e2-6f00e55ba43d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:20.201304 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6dbb4e77-ac3c-4f51-92e2-6f00e55ba43d admin admin] The token cache is being invalidate because project 1c8d88a4468a4423a15fc177f693d93d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:40:20.201600 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6dbb4e77-ac3c-4f51-92e2-6f00e55ba43d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:20.202285 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6dbb4e77-ac3c-4f51-92e2-6f00e55ba43d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:20.208335 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3811/7606] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:40:19 2022] DELETE /identity/v3/projects/1c8d88a4468a4423a15fc177f693d93d => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:40:20.208335 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb4e77-ac3c-4f51-92e2-6f00e55ba43d admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:20.209590 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-6dbb4e77-ac3c-4f51-92e2-6f00e55ba43d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:20.233383 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-95a148df-46a2-4097-a177-e86dea96c426 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed481cdb046042fab0dd06c56111a634'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:20.241511 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-95a148df-46a2-4097-a177-e86dea96c426 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed481cdb046042fab0dd06c56111a634'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:20.242322 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-95a148df-46a2-4097-a177-e86dea96c426 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed481cdb046042fab0dd06c56111a634'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:20.277429 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb4e77-ac3c-4f51-92e2-6f00e55ba43d admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:20.281207 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a6cb4e-a8ae-4cdf-8be7-802f033c3131 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:20.281857 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a6cb4e-a8ae-4cdf-8be7-802f033c3131 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:20.282170 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a6cb4e-a8ae-4cdf-8be7-802f033c3131 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:20.282448 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a6cb4e-a8ae-4cdf-8be7-802f033c3131 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:20.284353 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c1a6cb4e-a8ae-4cdf-8be7-802f033c3131 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:20.330534 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-95a148df-46a2-4097-a177-e86dea96c426 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed481cdb046042fab0dd06c56111a634'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:20.344666 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-95a148df-46a2-4097-a177-e86dea96c426 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed481cdb046042fab0dd06c56111a634'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:20.356002 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3796/7607] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:40:19 2022] DELETE /identity/v3/users/ed481cdb046042fab0dd06c56111a634 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:40:20.356181 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab7bf8-55ce-49ea-a63d-83f9f7d73d84 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:20.356538 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab7bf8-55ce-49ea-a63d-83f9f7d73d84 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:20.356929 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab7bf8-55ce-49ea-a63d-83f9f7d73d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:20.365302 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a6cb4e-a8ae-4cdf-8be7-802f033c3131 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:20.366887 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a6cb4e-a8ae-4cdf-8be7-802f033c3131 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:20.378691 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-baab7bf8-55ce-49ea-a63d-83f9f7d73d84 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:40:20.379974 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-baab7bf8-55ce-49ea-a63d-83f9f7d73d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:20.380972 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3812/7608] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:40:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:40:20.440537 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a6cb4e-a8ae-4cdf-8be7-802f033c3131 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:20.443339 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c1a6cb4e-a8ae-4cdf-8be7-802f033c3131 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:20.466377 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a6cb4e-a8ae-4cdf-8be7-802f033c3131 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:20.498853 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3797/7609] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:40:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:40:20.507135 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e38721f-50f7-46be-b276-ee80578eacb9 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:20.507428 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e38721f-50f7-46be-b276-ee80578eacb9 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:20.507745 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e38721f-50f7-46be-b276-ee80578eacb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:20.528787 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-3e38721f-50f7-46be-b276-ee80578eacb9 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:40:20.530000 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-3e38721f-50f7-46be-b276-ee80578eacb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:20.539468 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3798/7610] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:40:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:40:20.543883 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e38721f-50f7-46be-b276-ee80578eacb9 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:20.554575 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e38721f-50f7-46be-b276-ee80578eacb9 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:20.560518 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6cdca0-40ac-4675-aca9-5ae5e5e66786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:20.561188 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6cdca0-40ac-4675-aca9-5ae5e5e66786 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:20.561474 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6cdca0-40ac-4675-aca9-5ae5e5e66786 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:20.561754 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6cdca0-40ac-4675-aca9-5ae5e5e66786 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:20.562515 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6cdca0-40ac-4675-aca9-5ae5e5e66786 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:40:20.562742 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accdd496-df43-4c0b-a4d8-852123431c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:20.562873 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6cdca0-40ac-4675-aca9-5ae5e5e66786 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:20.563743 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accdd496-df43-4c0b-a4d8-852123431c78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:20.564036 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accdd496-df43-4c0b-a4d8-852123431c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:20.564326 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accdd496-df43-4c0b-a4d8-852123431c78 admin admin] PATH_INFO: `/v3/projects/26300f67535247758fbda7e0000bec7a` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:20.564478 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6cdca0-40ac-4675-aca9-5ae5e5e66786 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:20.565578 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accdd496-df43-4c0b-a4d8-852123431c78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26300f67535247758fbda7e0000bec7a)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:20.567570 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accdd496-df43-4c0b-a4d8-852123431c78 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:20.576913 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3799/7611] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:40:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:40:20.581254 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6cdca0-40ac-4675-aca9-5ae5e5e66786 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:20.592387 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6cdca0-40ac-4675-aca9-5ae5e5e66786 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:20.598193 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0723041-66a7-471b-a082-374161bb78d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:20.598920 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0723041-66a7-471b-a082-374161bb78d4 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:20.599209 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0723041-66a7-471b-a082-374161bb78d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:20.599704 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0723041-66a7-471b-a082-374161bb78d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:20.600393 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0723041-66a7-471b-a082-374161bb78d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:20.602302 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0723041-66a7-471b-a082-374161bb78d4 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:20.696265 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-accdd496-df43-4c0b-a4d8-852123431c78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26300f67535247758fbda7e0000bec7a', 'request_id': 'req-accdd496-df43-4c0b-a4d8-852123431c78'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:20.703301 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-accdd496-df43-4c0b-a4d8-852123431c78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26300f67535247758fbda7e0000bec7a', 'request_id': 'req-accdd496-df43-4c0b-a4d8-852123431c78'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:20.713213 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3800/7612] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:40:20 2022] POST /identity/v3/projects => generated 377 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:40:20.717897 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0723041-66a7-471b-a082-374161bb78d4 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:20.781098 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-accdd496-df43-4c0b-a4d8-852123431c78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26300f67535247758fbda7e0000bec7a', 'request_id': 'req-accdd496-df43-4c0b-a4d8-852123431c78'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:20.797924 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0723041-66a7-471b-a082-374161bb78d4 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:20.803208 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d199b5bb-a0e0-46b6-9052-7adca80b74bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:20.803680 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-accdd496-df43-4c0b-a4d8-852123431c78 admin admin] The token cache is being invalidate because project 26300f67535247758fbda7e0000bec7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:40:20.804134 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-accdd496-df43-4c0b-a4d8-852123431c78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:20.804604 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199b5bb-a0e0-46b6-9052-7adca80b74bb admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:20.805028 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199b5bb-a0e0-46b6-9052-7adca80b74bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:20.805325 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-accdd496-df43-4c0b-a4d8-852123431c78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:20.805455 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199b5bb-a0e0-46b6-9052-7adca80b74bb admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:20.806895 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d199b5bb-a0e0-46b6-9052-7adca80b74bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:20.809835 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3813/7613] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:40:20 2022] DELETE /identity/v3/projects/26300f67535247758fbda7e0000bec7a => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:40:20.809991 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d199b5bb-a0e0-46b6-9052-7adca80b74bb admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:20.813828 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accdd496-df43-4c0b-a4d8-852123431c78 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:20.815855 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-accdd496-df43-4c0b-a4d8-852123431c78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:20.899014 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accdd496-df43-4c0b-a4d8-852123431c78 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:20.905396 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd187bf4-d8b1-4845-a953-33860de3db0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:20.906339 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd187bf4-d8b1-4845-a953-33860de3db0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:20.906635 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd187bf4-d8b1-4845-a953-33860de3db0f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:20.906925 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd187bf4-d8b1-4845-a953-33860de3db0f admin admin] PATH_INFO: `/v3/users/cc508b9acb364b628a57ff2a2c783ecc` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:20.908299 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd187bf4-d8b1-4845-a953-33860de3db0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc508b9acb364b628a57ff2a2c783ecc)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:20.913536 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd187bf4-d8b1-4845-a953-33860de3db0f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:20.929755 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3801/7614] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:40:20 2022] POST /identity/v3/users => generated 289 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:40:20.934027 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d199b5bb-a0e0-46b6-9052-7adca80b74bb admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:20.935910 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-d199b5bb-a0e0-46b6-9052-7adca80b74bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:20.949144 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d199b5bb-a0e0-46b6-9052-7adca80b74bb admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:20.954362 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a56d7e-07d1-463f-a8d2-b6afb0106c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:20.954991 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a56d7e-07d1-463f-a8d2-b6afb0106c80 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:20.955284 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a56d7e-07d1-463f-a8d2-b6afb0106c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:20.955594 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a56d7e-07d1-463f-a8d2-b6afb0106c80 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:20.956317 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a56d7e-07d1-463f-a8d2-b6afb0106c80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:20.958072 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a56d7e-07d1-463f-a8d2-b6afb0106c80 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:20.971822 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3802/7615] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:40:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:40:20.973494 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a56d7e-07d1-463f-a8d2-b6afb0106c80 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:20.984213 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a56d7e-07d1-463f-a8d2-b6afb0106c80 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:20.989282 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5fa198-d942-42e9-b6f4-637e3cd3f4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:20.989961 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5fa198-d942-42e9-b6f4-637e3cd3f4d9 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:20.990244 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5fa198-d942-42e9-b6f4-637e3cd3f4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:20.990520 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5fa198-d942-42e9-b6f4-637e3cd3f4d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:20.991575 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5fa198-d942-42e9-b6f4-637e3cd3f4d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:20.992901 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5fa198-d942-42e9-b6f4-637e3cd3f4d9 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:21.005306 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3803/7616] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:40:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:40:21.010078 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5fa198-d942-42e9-b6f4-637e3cd3f4d9 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:21.019830 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5fa198-d942-42e9-b6f4-637e3cd3f4d9 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:21.024750 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184c1c36-be6c-4374-8fa0-608778103eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:21.034097 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c1c36-be6c-4374-8fa0-608778103eff admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:21.034097 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c1c36-be6c-4374-8fa0-608778103eff admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:21.034097 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c1c36-be6c-4374-8fa0-608778103eff admin admin] PATH_INFO: `/v3/projects/537c4ac112c846fcbbd4aa124542ab64/users/69c5e3ab4e494335839ffd7afb2b9c52/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:21.043888 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184c1c36-be6c-4374-8fa0-608778103eff admin admin] RBAC: Authorizing `identity:create_grant(project_id=537c4ac112c846fcbbd4aa124542ab64, user_id=69c5e3ab4e494335839ffd7afb2b9c52, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:21.049557 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184c1c36-be6c-4374-8fa0-608778103eff admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:21.115051 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3804/7617] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:40:21 2022] PUT /identity/v3/projects/537c4ac112c846fcbbd4aa124542ab64/users/69c5e3ab4e494335839ffd7afb2b9c52/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:40:21.115840 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184c1c36-be6c-4374-8fa0-608778103eff admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:21.118368 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-184c1c36-be6c-4374-8fa0-608778103eff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:21.140997 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-dd187bf4-d8b1-4845-a953-33860de3db0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc508b9acb364b628a57ff2a2c783ecc'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:21.158792 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-dd187bf4-d8b1-4845-a953-33860de3db0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc508b9acb364b628a57ff2a2c783ecc'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:21.170572 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-dd187bf4-d8b1-4845-a953-33860de3db0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc508b9acb364b628a57ff2a2c783ecc'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:21.193216 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184c1c36-be6c-4374-8fa0-608778103eff admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:21.199011 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdbbf46-5165-424b-a50a-625f94f133fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:21.199912 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdbbf46-5165-424b-a50a-625f94f133fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:21.200317 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdbbf46-5165-424b-a50a-625f94f133fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:21.200591 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdbbf46-5165-424b-a50a-625f94f133fa admin admin] PATH_INFO: `/v3/projects/78dfdb0fcebc4e9bb9443dfc70971bf3` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:21.201824 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdbbf46-5165-424b-a50a-625f94f133fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=78dfdb0fcebc4e9bb9443dfc70971bf3)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:21.203804 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdbbf46-5165-424b-a50a-625f94f133fa admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:21.216627 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-dd187bf4-d8b1-4845-a953-33860de3db0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc508b9acb364b628a57ff2a2c783ecc'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:21.217499 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-dd187bf4-d8b1-4845-a953-33860de3db0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc508b9acb364b628a57ff2a2c783ecc'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:21.224338 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3814/7618] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:40:20 2022] DELETE /identity/v3/users/cc508b9acb364b628a57ff2a2c783ecc => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:40:21.228195 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd187bf4-d8b1-4845-a953-33860de3db0f admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:21.228195 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-dd187bf4-d8b1-4845-a953-33860de3db0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:21.321372 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd187bf4-d8b1-4845-a953-33860de3db0f admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:21.334006 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dbdbbf46-5165-424b-a50a-625f94f133fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78dfdb0fcebc4e9bb9443dfc70971bf3', 'request_id': 'req-dbdbbf46-5165-424b-a50a-625f94f133fa'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:21.343582 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dbdbbf46-5165-424b-a50a-625f94f133fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78dfdb0fcebc4e9bb9443dfc70971bf3', 'request_id': 'req-dbdbbf46-5165-424b-a50a-625f94f133fa'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:21.352479 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dbdbbf46-5165-424b-a50a-625f94f133fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78dfdb0fcebc4e9bb9443dfc70971bf3', 'request_id': 'req-dbdbbf46-5165-424b-a50a-625f94f133fa'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:21.411774 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d061a25-f124-4cc3-981d-784f5ae7577c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:21.412541 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d061a25-f124-4cc3-981d-784f5ae7577c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:21.412887 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d061a25-f124-4cc3-981d-784f5ae7577c admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:21.413263 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d061a25-f124-4cc3-981d-784f5ae7577c admin admin] PATH_INFO: `/v3/projects/742a9e0434ae49e4807cc4b057212c39` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:21.414517 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d061a25-f124-4cc3-981d-784f5ae7577c admin admin] RBAC: Authorizing `identity:delete_project(project_id=742a9e0434ae49e4807cc4b057212c39)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:21.416721 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d061a25-f124-4cc3-981d-784f5ae7577c admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:21.450169 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dbdbbf46-5165-424b-a50a-625f94f133fa admin admin] The token cache is being invalidate because project 78dfdb0fcebc4e9bb9443dfc70971bf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:40:21.450918 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dbdbbf46-5165-424b-a50a-625f94f133fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:21.451918 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dbdbbf46-5165-424b-a50a-625f94f133fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:21.453815 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3805/7619] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:40:21 2022] DELETE /identity/v3/projects/78dfdb0fcebc4e9bb9443dfc70971bf3 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:40:21.456316 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f35fb88-c7c8-4114-9ae2-c14995ffb40d None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:21.456822 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f35fb88-c7c8-4114-9ae2-c14995ffb40d None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:21.457369 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f35fb88-c7c8-4114-9ae2-c14995ffb40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:21.499621 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-1f35fb88-c7c8-4114-9ae2-c14995ffb40d None None] MFA Rules not processed for user `69c5e3ab4e494335839ffd7afb2b9c52`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:40:21.499621 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-1f35fb88-c7c8-4114-9ae2-c14995ffb40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:21.581020 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3806/7620] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:40:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:40:21.582521 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78468a4-2615-4750-a856-d19f9cebeea4 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:21.582903 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78468a4-2615-4750-a856-d19f9cebeea4 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:21.583197 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78468a4-2615-4750-a856-d19f9cebeea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:21.608889 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-e78468a4-2615-4750-a856-d19f9cebeea4 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:40:21.610228 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e78468a4-2615-4750-a856-d19f9cebeea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:21.617248 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9d061a25-f124-4cc3-981d-784f5ae7577c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '742a9e0434ae49e4807cc4b057212c39', 'request_id': 'req-9d061a25-f124-4cc3-981d-784f5ae7577c'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:21.626692 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9d061a25-f124-4cc3-981d-784f5ae7577c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '742a9e0434ae49e4807cc4b057212c39', 'request_id': 'req-9d061a25-f124-4cc3-981d-784f5ae7577c'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:21.682305 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3807/7621] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:40:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:40:21.683726 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78468a4-2615-4750-a856-d19f9cebeea4 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:21.685150 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e78468a4-2615-4750-a856-d19f9cebeea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:21.691114 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9d061a25-f124-4cc3-981d-784f5ae7577c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '742a9e0434ae49e4807cc4b057212c39', 'request_id': 'req-9d061a25-f124-4cc3-981d-784f5ae7577c'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:21.714872 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9d061a25-f124-4cc3-981d-784f5ae7577c admin admin] The token cache is being invalidate because project 742a9e0434ae49e4807cc4b057212c39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:40:21.715230 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9d061a25-f124-4cc3-981d-784f5ae7577c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:21.716139 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9d061a25-f124-4cc3-981d-784f5ae7577c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:21.717981 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3815/7622] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:40:21 2022] DELETE /identity/v3/projects/742a9e0434ae49e4807cc4b057212c39 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:40:21.725398 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8559bd-9601-4ee6-bf6b-bc544f6afc4f None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:21.727527 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8559bd-9601-4ee6-bf6b-bc544f6afc4f None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:21.727671 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8559bd-9601-4ee6-bf6b-bc544f6afc4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:21.768957 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-bf8559bd-9601-4ee6-bf6b-bc544f6afc4f None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:40:21.771174 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-bf8559bd-9601-4ee6-bf6b-bc544f6afc4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:21.789900 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78468a4-2615-4750-a856-d19f9cebeea4 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:21.790323 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3816/7623] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:40:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:40:21.790323 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e0328-7ffd-4d28-9888-aea98f572799 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:21.790323 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e0328-7ffd-4d28-9888-aea98f572799 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:21.791185 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e0328-7ffd-4d28-9888-aea98f572799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:21.792439 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fdf34e-a59e-477e-bbfc-310666d1ef0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198271d1c0d44cb58bace41a65f4b94c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:21.793250 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fdf34e-a59e-477e-bbfc-310666d1ef0b service cinder] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:21.793635 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fdf34e-a59e-477e-bbfc-310666d1ef0b service cinder] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:21.794041 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fdf34e-a59e-477e-bbfc-310666d1ef0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:21.796400 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-00fdf34e-a59e-477e-bbfc-310666d1ef0b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:21.826783 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-375e0328-7ffd-4d28-9888-aea98f572799 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:40:21.828223 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-375e0328-7ffd-4d28-9888-aea98f572799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:21.838480 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3817/7624] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:40:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:40:21.841219 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4b41e-ccac-4f34-b4d1-55e717a77362 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:21.841852 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4b41e-ccac-4f34-b4d1-55e717a77362 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:21.843050 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4b41e-ccac-4f34-b4d1-55e717a77362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:21.865023 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-fee4b41e-ccac-4f34-b4d1-55e717a77362 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:40:21.866617 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-fee4b41e-ccac-4f34-b4d1-55e717a77362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:21.876167 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3818/7625] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:40:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:40:21.877304 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4b41e-ccac-4f34-b4d1-55e717a77362 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:21.881350 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fdf34e-a59e-477e-bbfc-310666d1ef0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:21.885068 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fdf34e-a59e-477e-bbfc-310666d1ef0b service cinder] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:21.888680 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4b41e-ccac-4f34-b4d1-55e717a77362 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:21.893853 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a159c7b9-f597-4339-b264-e2481da5dd09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:21.894577 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159c7b9-f597-4339-b264-e2481da5dd09 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:21.894868 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159c7b9-f597-4339-b264-e2481da5dd09 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:21.895149 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159c7b9-f597-4339-b264-e2481da5dd09 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:21.896080 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3808/7626] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:40:21 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:40:21.896891 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fdf34e-a59e-477e-bbfc-310666d1ef0b service cinder] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:21.897258 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a159c7b9-f597-4339-b264-e2481da5dd09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:40:21.897974 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a159c7b9-f597-4339-b264-e2481da5dd09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:21.899801 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a159c7b9-f597-4339-b264-e2481da5dd09 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:21.914914 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3819/7627] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:40:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:40:21.917261 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fdf34e-a59e-477e-bbfc-310666d1ef0b service cinder] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:21.925972 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a159c7b9-f597-4339-b264-e2481da5dd09 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:21.942143 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb15a31-9dee-4bdb-a57b-af8e4ec3e45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:21.942980 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb15a31-9dee-4bdb-a57b-af8e4ec3e45b admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:21.943759 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb15a31-9dee-4bdb-a57b-af8e4ec3e45b admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:21.944042 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb15a31-9dee-4bdb-a57b-af8e4ec3e45b admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:21.944713 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a159c7b9-f597-4339-b264-e2481da5dd09 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:21.947521 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb15a31-9dee-4bdb-a57b-af8e4ec3e45b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:40:21.954254 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb15a31-9dee-4bdb-a57b-af8e4ec3e45b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:21.954372 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b980c-b8fa-4a76-9b55-13ff95d259e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:21.954372 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b980c-b8fa-4a76-9b55-13ff95d259e3 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:21.954372 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b980c-b8fa-4a76-9b55-13ff95d259e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:21.954372 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b980c-b8fa-4a76-9b55-13ff95d259e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:21.954718 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb15a31-9dee-4bdb-a57b-af8e4ec3e45b admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:21.954801 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7b980c-b8fa-4a76-9b55-13ff95d259e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:21.955381 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7b980c-b8fa-4a76-9b55-13ff95d259e3 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:21.972412 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3809/7628] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:40:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:40:21.976550 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb15a31-9dee-4bdb-a57b-af8e4ec3e45b admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:21.988905 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb15a31-9dee-4bdb-a57b-af8e4ec3e45b admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:21.997027 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe705339-2100-400e-9781-c22695dbfe0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:21.997926 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe705339-2100-400e-9781-c22695dbfe0e admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:21.998387 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe705339-2100-400e-9781-c22695dbfe0e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:21.998582 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe705339-2100-400e-9781-c22695dbfe0e admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:21.999276 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe705339-2100-400e-9781-c22695dbfe0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:22.001446 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe705339-2100-400e-9781-c22695dbfe0e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:22.065401 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3820/7629] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:40:21 2022] POST /identity/v3/projects => generated 375 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:40:22.066567 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b980c-b8fa-4a76-9b55-13ff95d259e3 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:22.068181 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-3b7b980c-b8fa-4a76-9b55-13ff95d259e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:22.136498 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b980c-b8fa-4a76-9b55-13ff95d259e3 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:22.142572 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba5ed0-fc05-4b5c-a68c-d76e3ce287e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:22.143398 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba5ed0-fc05-4b5c-a68c-d76e3ce287e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:22.143711 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba5ed0-fc05-4b5c-a68c-d76e3ce287e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:22.144038 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba5ed0-fc05-4b5c-a68c-d76e3ce287e8 admin admin] PATH_INFO: `/v3/projects/979944a7425f41bf8cd3daa06d466200` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:22.145239 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ba5ed0-fc05-4b5c-a68c-d76e3ce287e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=979944a7425f41bf8cd3daa06d466200)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:22.147541 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ba5ed0-fc05-4b5c-a68c-d76e3ce287e8 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:22.207802 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3810/7630] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:40:21 2022] POST /identity/v3/projects => generated 387 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:40:22.207802 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe705339-2100-400e-9781-c22695dbfe0e admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:22.338913 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b1ba5ed0-fc05-4b5c-a68c-d76e3ce287e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '979944a7425f41bf8cd3daa06d466200', 'request_id': 'req-b1ba5ed0-fc05-4b5c-a68c-d76e3ce287e8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:22.343013 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe705339-2100-400e-9781-c22695dbfe0e admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:22.350576 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b1ba5ed0-fc05-4b5c-a68c-d76e3ce287e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '979944a7425f41bf8cd3daa06d466200', 'request_id': 'req-b1ba5ed0-fc05-4b5c-a68c-d76e3ce287e8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:22.420218 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc8999-5056-443e-82db-77d91d719276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:22.421038 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc8999-5056-443e-82db-77d91d719276 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:22.421389 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc8999-5056-443e-82db-77d91d719276 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:22.421763 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc8999-5056-443e-82db-77d91d719276 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:22.423790 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbc8999-5056-443e-82db-77d91d719276 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:22.425703 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbc8999-5056-443e-82db-77d91d719276 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:22.487668 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b1ba5ed0-fc05-4b5c-a68c-d76e3ce287e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '979944a7425f41bf8cd3daa06d466200', 'request_id': 'req-b1ba5ed0-fc05-4b5c-a68c-d76e3ce287e8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:22.499674 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b1ba5ed0-fc05-4b5c-a68c-d76e3ce287e8 admin admin] The token cache is being invalidate because project 979944a7425f41bf8cd3daa06d466200 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:40:22.499960 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b1ba5ed0-fc05-4b5c-a68c-d76e3ce287e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:22.501117 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b1ba5ed0-fc05-4b5c-a68c-d76e3ce287e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:22.502664 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3821/7631] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:40:22 2022] DELETE /identity/v3/projects/979944a7425f41bf8cd3daa06d466200 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:40:22.505180 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba5ed0-fc05-4b5c-a68c-d76e3ce287e8 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:22.507537 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b1ba5ed0-fc05-4b5c-a68c-d76e3ce287e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:22.521671 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba5ed0-fc05-4b5c-a68c-d76e3ce287e8 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:22.530186 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3811/7632] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:40:22 2022] POST /identity/v3/users => generated 288 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:40:22.530186 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc8999-5056-443e-82db-77d91d719276 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:22.530816 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3990a453-42c9-435c-8875-65b5fc34f0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:22.531433 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3990a453-42c9-435c-8875-65b5fc34f0e9 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:22.531813 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3990a453-42c9-435c-8875-65b5fc34f0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:22.532051 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3990a453-42c9-435c-8875-65b5fc34f0e9 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:22.532741 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3990a453-42c9-435c-8875-65b5fc34f0e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:22.532850 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-bfbc8999-5056-443e-82db-77d91d719276 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:22.534844 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3990a453-42c9-435c-8875-65b5fc34f0e9 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:22.557596 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc8999-5056-443e-82db-77d91d719276 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:22.565264 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a87025-cdb7-4c0b-94e3-2c7849a9ce10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:22.566174 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a87025-cdb7-4c0b-94e3-2c7849a9ce10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:22.566468 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a87025-cdb7-4c0b-94e3-2c7849a9ce10 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:22.566934 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a87025-cdb7-4c0b-94e3-2c7849a9ce10 admin admin] PATH_INFO: `/v3/users/b79266843a53421bbd768566686ba032` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:22.568662 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a87025-cdb7-4c0b-94e3-2c7849a9ce10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b79266843a53421bbd768566686ba032)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:22.570648 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a87025-cdb7-4c0b-94e3-2c7849a9ce10 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:22.638355 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3822/7633] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:40:22 2022] POST /identity/v3/users => generated 294 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:40:22.642604 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3990a453-42c9-435c-8875-65b5fc34f0e9 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:22.644485 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-3990a453-42c9-435c-8875-65b5fc34f0e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:22.658806 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3990a453-42c9-435c-8875-65b5fc34f0e9 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:22.664444 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a74be8-e58c-447d-8acc-846e94a3d61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:22.665964 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a74be8-e58c-447d-8acc-846e94a3d61e admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:22.666287 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a74be8-e58c-447d-8acc-846e94a3d61e admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:22.666582 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a74be8-e58c-447d-8acc-846e94a3d61e admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:22.667578 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a74be8-e58c-447d-8acc-846e94a3d61e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:22.669746 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a74be8-e58c-447d-8acc-846e94a3d61e admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:22.685229 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3823/7634] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:40:22 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:40:22.688744 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a74be8-e58c-447d-8acc-846e94a3d61e admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:22.704458 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a74be8-e58c-447d-8acc-846e94a3d61e admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:22.715709 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668b0e79-6810-4be6-9d3a-52d8328e1dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:22.724406 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668b0e79-6810-4be6-9d3a-52d8328e1dd9 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:22.728149 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668b0e79-6810-4be6-9d3a-52d8328e1dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:22.728149 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668b0e79-6810-4be6-9d3a-52d8328e1dd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:22.728149 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668b0e79-6810-4be6-9d3a-52d8328e1dd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:22.728149 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668b0e79-6810-4be6-9d3a-52d8328e1dd9 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:22.744743 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3824/7635] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:40:22 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:40:22.744743 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668b0e79-6810-4be6-9d3a-52d8328e1dd9 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:22.759028 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668b0e79-6810-4be6-9d3a-52d8328e1dd9 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:22.762171 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69349dc0-8f0a-48b2-a147-0129f923974f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:22.763254 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69349dc0-8f0a-48b2-a147-0129f923974f admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:22.763638 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69349dc0-8f0a-48b2-a147-0129f923974f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:22.763925 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69349dc0-8f0a-48b2-a147-0129f923974f admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:22.764826 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69349dc0-8f0a-48b2-a147-0129f923974f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:22.766521 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69349dc0-8f0a-48b2-a147-0129f923974f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:22.786122 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3825/7636] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:40:22 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:40:22.791338 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69349dc0-8f0a-48b2-a147-0129f923974f admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:22.806075 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69349dc0-8f0a-48b2-a147-0129f923974f admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:22.810785 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf8d845-b6aa-4a49-8b9d-f00c411fe623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:22.811565 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf8d845-b6aa-4a49-8b9d-f00c411fe623 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:22.812526 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf8d845-b6aa-4a49-8b9d-f00c411fe623 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:22.812526 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf8d845-b6aa-4a49-8b9d-f00c411fe623 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:22.813110 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf8d845-b6aa-4a49-8b9d-f00c411fe623 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:22.814781 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf8d845-b6aa-4a49-8b9d-f00c411fe623 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:22.824810 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-69a87025-cdb7-4c0b-94e3-2c7849a9ce10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b79266843a53421bbd768566686ba032'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:22.827820 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3826/7637] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:40:22 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:40:22.829191 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf8d845-b6aa-4a49-8b9d-f00c411fe623 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:22.832650 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-69a87025-cdb7-4c0b-94e3-2c7849a9ce10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b79266843a53421bbd768566686ba032'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:22.833459 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-69a87025-cdb7-4c0b-94e3-2c7849a9ce10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b79266843a53421bbd768566686ba032'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:22.845251 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf8d845-b6aa-4a49-8b9d-f00c411fe623 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:22.853420 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfed4ba-4a23-4d75-805a-0edd964004d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:22.854711 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfed4ba-4a23-4d75-805a-0edd964004d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:22.855215 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfed4ba-4a23-4d75-805a-0edd964004d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:22.855586 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfed4ba-4a23-4d75-805a-0edd964004d5 admin admin] PATH_INFO: `/v3/projects/d8db1a4b246e4ae1aa99962f35e65510/users/0397fa67544d46d6acbbe6d59a21b5eb/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:22.870853 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfed4ba-4a23-4d75-805a-0edd964004d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8db1a4b246e4ae1aa99962f35e65510, user_id=0397fa67544d46d6acbbe6d59a21b5eb, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:22.873557 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfed4ba-4a23-4d75-805a-0edd964004d5 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:22.911769 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-69a87025-cdb7-4c0b-94e3-2c7849a9ce10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b79266843a53421bbd768566686ba032'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:22.940854 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-69a87025-cdb7-4c0b-94e3-2c7849a9ce10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b79266843a53421bbd768566686ba032'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:22.955683 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3812/7638] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:40:22 2022] DELETE /identity/v3/users/b79266843a53421bbd768566686ba032 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:40:22.955683 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a87025-cdb7-4c0b-94e3-2c7849a9ce10 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:22.955683 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-69a87025-cdb7-4c0b-94e3-2c7849a9ce10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:23.031708 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3827/7639] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:40:22 2022] PUT /identity/v3/projects/d8db1a4b246e4ae1aa99962f35e65510/users/0397fa67544d46d6acbbe6d59a21b5eb/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:40:23.032225 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a87025-cdb7-4c0b-94e3-2c7849a9ce10 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:23.040180 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d503c3d9-273c-4a5e-910e-5bd51bb1267f None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:23.040568 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d503c3d9-273c-4a5e-910e-5bd51bb1267f None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:23.041101 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d503c3d9-273c-4a5e-910e-5bd51bb1267f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:23.072479 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-d503c3d9-273c-4a5e-910e-5bd51bb1267f None None] MFA Rules not processed for user `0397fa67544d46d6acbbe6d59a21b5eb`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:40:23.075020 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d503c3d9-273c-4a5e-910e-5bd51bb1267f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:23.098065 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6b6d09-13d5-4459-afba-fdc457062403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:23.098954 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b6d09-13d5-4459-afba-fdc457062403 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:23.099241 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b6d09-13d5-4459-afba-fdc457062403 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:23.099590 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b6d09-13d5-4459-afba-fdc457062403 admin admin] PATH_INFO: `/v3/projects/8d9a98a0b9094e28a62cb3b2f58f7c98/users/02a0280dbc4c4442a34f9178f7c5f557/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:23.115359 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6b6d09-13d5-4459-afba-fdc457062403 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d9a98a0b9094e28a62cb3b2f58f7c98, user_id=02a0280dbc4c4442a34f9178f7c5f557, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:23.118178 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6b6d09-13d5-4459-afba-fdc457062403 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:23.145839 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3828/7640] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:40:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:40:23.151056 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d503c3d9-273c-4a5e-910e-5bd51bb1267f None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:23.152341 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d503c3d9-273c-4a5e-910e-5bd51bb1267f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:23.165202 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d503c3d9-273c-4a5e-910e-5bd51bb1267f None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:23.170638 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd533d2d-03cb-42f8-afaf-3e18713cdc66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:23.171300 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd533d2d-03cb-42f8-afaf-3e18713cdc66 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:23.171614 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd533d2d-03cb-42f8-afaf-3e18713cdc66 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:23.171902 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd533d2d-03cb-42f8-afaf-3e18713cdc66 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:23.172737 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd533d2d-03cb-42f8-afaf-3e18713cdc66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:23.174692 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd533d2d-03cb-42f8-afaf-3e18713cdc66 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:23.211391 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3813/7641] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:40:22 2022] PUT /identity/v3/projects/8d9a98a0b9094e28a62cb3b2f58f7c98/users/02a0280dbc4c4442a34f9178f7c5f557/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:40:23.217540 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f65be-b9dd-40eb-bba0-e727f558d7f1 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:23.217846 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f65be-b9dd-40eb-bba0-e727f558d7f1 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:23.218312 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f65be-b9dd-40eb-bba0-e727f558d7f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:23.245950 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-257f65be-b9dd-40eb-bba0-e727f558d7f1 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:40:23.247693 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-257f65be-b9dd-40eb-bba0-e727f558d7f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:23.312556 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3829/7642] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:40:23 2022] POST /identity/v3/projects => generated 375 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:40:23.313910 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd533d2d-03cb-42f8-afaf-3e18713cdc66 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:23.324850 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3814/7643] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:40:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:40:23.342525 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f65be-b9dd-40eb-bba0-e727f558d7f1 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:23.344403 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-257f65be-b9dd-40eb-bba0-e727f558d7f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:23.416514 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd533d2d-03cb-42f8-afaf-3e18713cdc66 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:23.416741 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f65be-b9dd-40eb-bba0-e727f558d7f1 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:23.422077 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de728eb7-6ca4-4c45-8f73-382525da23fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:23.422753 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de728eb7-6ca4-4c45-8f73-382525da23fa admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:23.423038 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de728eb7-6ca4-4c45-8f73-382525da23fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:23.423313 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de728eb7-6ca4-4c45-8f73-382525da23fa admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:23.424065 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de728eb7-6ca4-4c45-8f73-382525da23fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:23.426000 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de728eb7-6ca4-4c45-8f73-382525da23fa admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:23.481661 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3afe55-1d95-4ae5-af5e-249216955801 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:23.482400 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3afe55-1d95-4ae5-af5e-249216955801 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:23.482609 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3afe55-1d95-4ae5-af5e-249216955801 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:23.482885 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3afe55-1d95-4ae5-af5e-249216955801 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:23.496629 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3afe55-1d95-4ae5-af5e-249216955801 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:23.498107 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3afe55-1d95-4ae5-af5e-249216955801 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:23.508291 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3815/7644] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:40:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:40:23.509122 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3afe55-1d95-4ae5-af5e-249216955801 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:23.510663 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-2e3afe55-1d95-4ae5-af5e-249216955801 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:23.523512 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3afe55-1d95-4ae5-af5e-249216955801 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:23.530189 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5480515-b504-4c2b-a77f-7bf2d5075db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:23.531737 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5480515-b504-4c2b-a77f-7bf2d5075db4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:23.532054 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5480515-b504-4c2b-a77f-7bf2d5075db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:23.532338 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5480515-b504-4c2b-a77f-7bf2d5075db4 admin admin] PATH_INFO: `/v3/projects/7f0a924a0b034805985dd5bd09a74631` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:23.533614 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5480515-b504-4c2b-a77f-7bf2d5075db4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f0a924a0b034805985dd5bd09a74631)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:23.535604 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5480515-b504-4c2b-a77f-7bf2d5075db4 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:23.559825 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3830/7645] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:40:23 2022] POST /identity/v3/users => generated 294 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:40:23.564018 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de728eb7-6ca4-4c45-8f73-382525da23fa admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:23.573780 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de728eb7-6ca4-4c45-8f73-382525da23fa admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:23.578797 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c219464-ea4b-43d4-8d36-efc3f4455495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:23.579504 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c219464-ea4b-43d4-8d36-efc3f4455495 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:23.579800 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c219464-ea4b-43d4-8d36-efc3f4455495 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:23.580080 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c219464-ea4b-43d4-8d36-efc3f4455495 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:23.580926 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c219464-ea4b-43d4-8d36-efc3f4455495 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:23.582519 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c219464-ea4b-43d4-8d36-efc3f4455495 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:23.592801 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3831/7646] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:40:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:40:23.597300 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c219464-ea4b-43d4-8d36-efc3f4455495 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:23.607443 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c219464-ea4b-43d4-8d36-efc3f4455495 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:23.612285 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e63eaa-9420-4cd3-b459-4cfd84fee700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:23.613144 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e63eaa-9420-4cd3-b459-4cfd84fee700 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:23.613430 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e63eaa-9420-4cd3-b459-4cfd84fee700 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:23.613738 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e63eaa-9420-4cd3-b459-4cfd84fee700 admin admin] PATH_INFO: `/v3/projects/72799d441835453f8b45e81a4b96892d/users/28589d4455c44911baf0df885094a1c2/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:23.630245 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e63eaa-9420-4cd3-b459-4cfd84fee700 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72799d441835453f8b45e81a4b96892d, user_id=28589d4455c44911baf0df885094a1c2, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:23.633057 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e63eaa-9420-4cd3-b459-4cfd84fee700 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:23.654874 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f5480515-b504-4c2b-a77f-7bf2d5075db4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f0a924a0b034805985dd5bd09a74631', 'request_id': 'req-f5480515-b504-4c2b-a77f-7bf2d5075db4'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:23.661600 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f5480515-b504-4c2b-a77f-7bf2d5075db4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f0a924a0b034805985dd5bd09a74631', 'request_id': 'req-f5480515-b504-4c2b-a77f-7bf2d5075db4'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:23.670848 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f5480515-b504-4c2b-a77f-7bf2d5075db4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f0a924a0b034805985dd5bd09a74631', 'request_id': 'req-f5480515-b504-4c2b-a77f-7bf2d5075db4'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:23.732675 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3832/7647] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:40:23 2022] PUT /identity/v3/projects/72799d441835453f8b45e81a4b96892d/users/28589d4455c44911baf0df885094a1c2/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:40:23.736630 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e63eaa-9420-4cd3-b459-4cfd84fee700 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:23.764858 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f5480515-b504-4c2b-a77f-7bf2d5075db4 admin admin] The token cache is being invalidate because project 7f0a924a0b034805985dd5bd09a74631 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:40:23.765402 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f5480515-b504-4c2b-a77f-7bf2d5075db4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:23.766168 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f5480515-b504-4c2b-a77f-7bf2d5075db4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:23.767995 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3816/7648] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:40:23 2022] DELETE /identity/v3/projects/7f0a924a0b034805985dd5bd09a74631 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:40:23.775764 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8cb73f-3432-4506-93ae-b1d5e60993dc None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:23.776288 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8cb73f-3432-4506-93ae-b1d5e60993dc None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:23.776288 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8cb73f-3432-4506-93ae-b1d5e60993dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:23.803704 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-dc8cb73f-3432-4506-93ae-b1d5e60993dc None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:40:23.805331 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-dc8cb73f-3432-4506-93ae-b1d5e60993dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:23.833622 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e63eaa-9420-4cd3-b459-4cfd84fee700 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:23.841537 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbff62d-5f53-4665-9276-4c6bb5e32f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:23.842806 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbff62d-5f53-4665-9276-4c6bb5e32f41 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:23.843426 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbff62d-5f53-4665-9276-4c6bb5e32f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:23.844501 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbff62d-5f53-4665-9276-4c6bb5e32f41 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:23.845350 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbff62d-5f53-4665-9276-4c6bb5e32f41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:23.847182 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbff62d-5f53-4665-9276-4c6bb5e32f41 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:23.864325 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3833/7649] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:40:23 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:40:23.865589 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbff62d-5f53-4665-9276-4c6bb5e32f41 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:23.868081 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-6cbff62d-5f53-4665-9276-4c6bb5e32f41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:23.883407 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbff62d-5f53-4665-9276-4c6bb5e32f41 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:23.890395 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60fbe8-efa6-48f3-a94f-282dbb3fcb31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:23.892156 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60fbe8-efa6-48f3-a94f-282dbb3fcb31 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:23.892536 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60fbe8-efa6-48f3-a94f-282dbb3fcb31 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:23.892982 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60fbe8-efa6-48f3-a94f-282dbb3fcb31 admin admin] PATH_INFO: `/v3/projects/72799d441835453f8b45e81a4b96892d/users/28589d4455c44911baf0df885094a1c2/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:23.902236 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3817/7650] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:40:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:40:23.906860 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c60fbe8-efa6-48f3-a94f-282dbb3fcb31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72799d441835453f8b45e81a4b96892d, user_id=28589d4455c44911baf0df885094a1c2, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:23.906860 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c60fbe8-efa6-48f3-a94f-282dbb3fcb31 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:23.907148 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad459f2-e0b7-4d36-ab51-d796fc3ad3f7 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:23.907148 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad459f2-e0b7-4d36-ab51-d796fc3ad3f7 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:23.907148 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad459f2-e0b7-4d36-ab51-d796fc3ad3f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:23.927896 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-3ad459f2-e0b7-4d36-ab51-d796fc3ad3f7 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:40:23.929421 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-3ad459f2-e0b7-4d36-ab51-d796fc3ad3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:23.947872 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3834/7651] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:40:23 2022] PUT /identity/v3/projects/72799d441835453f8b45e81a4b96892d/users/28589d4455c44911baf0df885094a1c2/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:40:23.949385 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92c0dc-c8cc-419f-b834-967751578de7 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:23.949666 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92c0dc-c8cc-419f-b834-967751578de7 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:23.949939 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92c0dc-c8cc-419f-b834-967751578de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:23.992103 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-bf92c0dc-c8cc-419f-b834-967751578de7 None None] MFA Rules not processed for user `28589d4455c44911baf0df885094a1c2`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:40:23.994841 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-bf92c0dc-c8cc-419f-b834-967751578de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:24.023312 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3818/7652] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:40:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:40:24.028517 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad459f2-e0b7-4d36-ab51-d796fc3ad3f7 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:24.037675 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad459f2-e0b7-4d36-ab51-d796fc3ad3f7 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:24.043632 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89d62d7-2d6d-4eec-9dff-af5579097708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:24.044302 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d62d7-2d6d-4eec-9dff-af5579097708 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:24.044614 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d62d7-2d6d-4eec-9dff-af5579097708 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:24.044888 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d62d7-2d6d-4eec-9dff-af5579097708 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:24.045609 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89d62d7-2d6d-4eec-9dff-af5579097708 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:40:24.045917 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89d62d7-2d6d-4eec-9dff-af5579097708 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:24.047546 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89d62d7-2d6d-4eec-9dff-af5579097708 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:24.064905 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3819/7653] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:40:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:40:24.066495 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89d62d7-2d6d-4eec-9dff-af5579097708 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:24.074660 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3835/7654] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:40:23 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:40:24.076643 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89d62d7-2d6d-4eec-9dff-af5579097708 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:24.083213 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67accd63-b9e4-4ee8-873c-fb81d863fdf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:24.083931 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67accd63-b9e4-4ee8-873c-fb81d863fdf7 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:24.084217 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67accd63-b9e4-4ee8-873c-fb81d863fdf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:24.084492 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67accd63-b9e4-4ee8-873c-fb81d863fdf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:24.085612 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67accd63-b9e4-4ee8-873c-fb81d863fdf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:24.086756 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf92c0dc-c8cc-419f-b834-967751578de7 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:24.088510 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67accd63-b9e4-4ee8-873c-fb81d863fdf7 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:24.088810 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-bf92c0dc-c8cc-419f-b834-967751578de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:24.158158 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf92c0dc-c8cc-419f-b834-967751578de7 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:24.162443 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b664466f-bb47-4293-bdf8-37e15911a603 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198271d1c0d44cb58bace41a65f4b94c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:24.163257 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b664466f-bb47-4293-bdf8-37e15911a603 service cinder] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:24.163431 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b664466f-bb47-4293-bdf8-37e15911a603 service cinder] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:24.163780 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b664466f-bb47-4293-bdf8-37e15911a603 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:24.166418 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b664466f-bb47-4293-bdf8-37e15911a603 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:24.194610 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3820/7655] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:40:24 2022] POST /identity/v3/projects => generated 399 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:40:24.195612 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67accd63-b9e4-4ee8-873c-fb81d863fdf7 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:24.268060 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b664466f-bb47-4293-bdf8-37e15911a603 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:24.268809 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67accd63-b9e4-4ee8-873c-fb81d863fdf7 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:24.269710 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b664466f-bb47-4293-bdf8-37e15911a603 service cinder] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:24.274048 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d4e4ce-e248-43a6-9628-895b3e8183a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:24.275286 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d4e4ce-e248-43a6-9628-895b3e8183a8 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:24.275286 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d4e4ce-e248-43a6-9628-895b3e8183a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:24.279655 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d4e4ce-e248-43a6-9628-895b3e8183a8 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:24.279655 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d4e4ce-e248-43a6-9628-895b3e8183a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:24.279655 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d4e4ce-e248-43a6-9628-895b3e8183a8 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:24.283211 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3836/7656] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:40:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:40:24.284928 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad8e71f-ab4b-4319-8ed5-e1724f5cca0a None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:24.286107 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad8e71f-ab4b-4319-8ed5-e1724f5cca0a None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:24.286107 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad8e71f-ab4b-4319-8ed5-e1724f5cca0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:24.323934 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-cad8e71f-ab4b-4319-8ed5-e1724f5cca0a None None] MFA Rules not processed for user `02a0280dbc4c4442a34f9178f7c5f557`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:40:24.325908 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-cad8e71f-ab4b-4319-8ed5-e1724f5cca0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:24.377164 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3821/7657] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:40:24 2022] POST /identity/v3/users => generated 300 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:40:24.378178 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d4e4ce-e248-43a6-9628-895b3e8183a8 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:24.395032 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d4e4ce-e248-43a6-9628-895b3e8183a8 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:24.401332 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72213ac7-4b11-4012-8445-a6444f61a7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:24.402019 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72213ac7-4b11-4012-8445-a6444f61a7d5 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:24.402302 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72213ac7-4b11-4012-8445-a6444f61a7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:24.402577 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72213ac7-4b11-4012-8445-a6444f61a7d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:24.403692 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72213ac7-4b11-4012-8445-a6444f61a7d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:24.405335 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72213ac7-4b11-4012-8445-a6444f61a7d5 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:24.417158 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3822/7658] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:40:24 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:40:24.420590 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72213ac7-4b11-4012-8445-a6444f61a7d5 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:24.422995 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3837/7659] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:40:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:40:24.430867 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72213ac7-4b11-4012-8445-a6444f61a7d5 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:24.434765 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6eb43d-8c74-46fe-ad95-d017de0c68dc None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:24.435056 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6eb43d-8c74-46fe-ad95-d017de0c68dc None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:24.435341 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6eb43d-8c74-46fe-ad95-d017de0c68dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:24.438345 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e76a678-0de4-45fb-a0ee-938018885383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:24.439278 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e76a678-0de4-45fb-a0ee-938018885383 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:24.440136 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e76a678-0de4-45fb-a0ee-938018885383 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:24.440136 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e76a678-0de4-45fb-a0ee-938018885383 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:24.441349 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e76a678-0de4-45fb-a0ee-938018885383 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:24.443431 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e76a678-0de4-45fb-a0ee-938018885383 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:24.455891 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3823/7660] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:40:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:40:24.460592 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e76a678-0de4-45fb-a0ee-938018885383 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:24.469120 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-9e6eb43d-8c74-46fe-ad95-d017de0c68dc None None] MFA Rules not processed for user `02a0280dbc4c4442a34f9178f7c5f557`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:40:24.470356 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-9e6eb43d-8c74-46fe-ad95-d017de0c68dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:24.478472 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e76a678-0de4-45fb-a0ee-938018885383 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:24.484482 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3838/7661] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:40:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:40:24.484859 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e436b019-0902-4254-a670-1a607356caca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:24.486354 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e436b019-0902-4254-a670-1a607356caca admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:24.486637 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e436b019-0902-4254-a670-1a607356caca admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:24.487153 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e436b019-0902-4254-a670-1a607356caca admin admin] PATH_INFO: `/v3/projects/12839e8098d74d729bceddeda4fa1acb/users/3bfc2374351c422ca49f5ef479322e3e/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:24.500822 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6eb43d-8c74-46fe-ad95-d017de0c68dc None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:24.502778 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-9e6eb43d-8c74-46fe-ad95-d017de0c68dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:24.506857 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e436b019-0902-4254-a670-1a607356caca admin admin] RBAC: Authorizing `identity:create_grant(project_id=12839e8098d74d729bceddeda4fa1acb, user_id=3bfc2374351c422ca49f5ef479322e3e, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:24.510222 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e436b019-0902-4254-a670-1a607356caca admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:24.590336 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3824/7662] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:40:24 2022] PUT /identity/v3/projects/12839e8098d74d729bceddeda4fa1acb/users/3bfc2374351c422ca49f5ef479322e3e/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:40:24.600050 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5c7fc-771a-4f1a-a251-e6080ef635c0 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:24.600339 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5c7fc-771a-4f1a-a251-e6080ef635c0 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:24.600617 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5c7fc-771a-4f1a-a251-e6080ef635c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:24.610261 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6eb43d-8c74-46fe-ad95-d017de0c68dc None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:24.641273 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-b9b5c7fc-771a-4f1a-a251-e6080ef635c0 None None] MFA Rules not processed for user `3bfc2374351c422ca49f5ef479322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:40:24.645134 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b9b5c7fc-771a-4f1a-a251-e6080ef635c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:24.703607 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dff3f41-2e89-41c1-9559-047b91adb0b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:24.706351 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff3f41-2e89-41c1-9559-047b91adb0b8 service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:24.706649 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff3f41-2e89-41c1-9559-047b91adb0b8 service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:24.706967 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff3f41-2e89-41c1-9559-047b91adb0b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:24.759014 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3825/7663] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:40:24 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:40:24.760875 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b5c7fc-771a-4f1a-a251-e6080ef635c0 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:24.790961 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dff3f41-2e89-41c1-9559-047b91adb0b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:24.793410 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dff3f41-2e89-41c1-9559-047b91adb0b8 service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:24.805496 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3839/7664] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:40:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:40:24.839832 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b5c7fc-771a-4f1a-a251-e6080ef635c0 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:24.847642 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf71b4-ed36-462a-b6ae-f70ced26146a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:24.848969 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf71b4-ed36-462a-b6ae-f70ced26146a admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:24.848969 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf71b4-ed36-462a-b6ae-f70ced26146a admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:24.849389 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf71b4-ed36-462a-b6ae-f70ced26146a admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:24.850181 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbf71b4-ed36-462a-b6ae-f70ced26146a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:24.852536 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbf71b4-ed36-462a-b6ae-f70ced26146a admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:24.984641 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3826/7665] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:40:24 2022] POST /identity/v3/projects => generated 401 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:40:24.988472 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dff3f41-2e89-41c1-9559-047b91adb0b8 service nova] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:25.000767 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dff3f41-2e89-41c1-9559-047b91adb0b8 service nova] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:25.094605 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db02b4af-63fd-4044-a958-36c0e4788a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:25.095290 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db02b4af-63fd-4044-a958-36c0e4788a97 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:25.095589 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db02b4af-63fd-4044-a958-36c0e4788a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:25.095868 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db02b4af-63fd-4044-a958-36c0e4788a97 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:25.096614 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db02b4af-63fd-4044-a958-36c0e4788a97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:25.098772 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db02b4af-63fd-4044-a958-36c0e4788a97 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:25.197085 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3840/7666] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:40:24 2022] POST /identity/v3/users => generated 307 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:40:25.202298 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf71b4-ed36-462a-b6ae-f70ced26146a admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:25.218790 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf71b4-ed36-462a-b6ae-f70ced26146a admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:25.226914 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1087e1c8-3036-458e-aa91-88bdcd9a6688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:25.228779 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1087e1c8-3036-458e-aa91-88bdcd9a6688 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:25.229257 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1087e1c8-3036-458e-aa91-88bdcd9a6688 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:25.229551 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1087e1c8-3036-458e-aa91-88bdcd9a6688 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:25.230381 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1087e1c8-3036-458e-aa91-88bdcd9a6688 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:25.233262 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1087e1c8-3036-458e-aa91-88bdcd9a6688 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:25.254089 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3827/7667] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:40:25 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:40:25.254191 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db02b4af-63fd-4044-a958-36c0e4788a97 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:25.264740 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db02b4af-63fd-4044-a958-36c0e4788a97 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:25.273243 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9598a5-e9c4-4c10-bf1c-881fb9548d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:25.274103 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9598a5-e9c4-4c10-bf1c-881fb9548d11 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:25.274391 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9598a5-e9c4-4c10-bf1c-881fb9548d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:25.274671 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9598a5-e9c4-4c10-bf1c-881fb9548d11 admin admin] PATH_INFO: `/v3/projects/3aee008ab961445e8240d2318e0d73bb/users/ce2e0ff013904d229dfc76b577abb8e9/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:25.309786 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9598a5-e9c4-4c10-bf1c-881fb9548d11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3aee008ab961445e8240d2318e0d73bb, user_id=ce2e0ff013904d229dfc76b577abb8e9, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:25.313298 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9598a5-e9c4-4c10-bf1c-881fb9548d11 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:25.391075 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3841/7668] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:40:25 2022] PUT /identity/v3/projects/3aee008ab961445e8240d2318e0d73bb/users/ce2e0ff013904d229dfc76b577abb8e9/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:40:25.395104 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1087e1c8-3036-458e-aa91-88bdcd9a6688 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:25.407466 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1087e1c8-3036-458e-aa91-88bdcd9a6688 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:25.473333 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4dac03-5fd2-463a-a8fe-ba940ef277d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:25.474033 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4dac03-5fd2-463a-a8fe-ba940ef277d5 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:25.474449 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4dac03-5fd2-463a-a8fe-ba940ef277d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:25.474650 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4dac03-5fd2-463a-a8fe-ba940ef277d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:25.475415 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4dac03-5fd2-463a-a8fe-ba940ef277d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:25.477155 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4dac03-5fd2-463a-a8fe-ba940ef277d5 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:25.497361 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3828/7669] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:40:25 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:40:25.501957 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9598a5-e9c4-4c10-bf1c-881fb9548d11 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:25.521744 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9598a5-e9c4-4c10-bf1c-881fb9548d11 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:25.531017 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c0b21b-3317-486f-8740-6b0aea3bb09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:25.532366 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c0b21b-3317-486f-8740-6b0aea3bb09e admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:25.533824 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c0b21b-3317-486f-8740-6b0aea3bb09e admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:25.534357 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c0b21b-3317-486f-8740-6b0aea3bb09e admin admin] PATH_INFO: `/v3/projects/3aee008ab961445e8240d2318e0d73bb/users/ce2e0ff013904d229dfc76b577abb8e9/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:25.536734 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c0b21b-3317-486f-8740-6b0aea3bb09e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3aee008ab961445e8240d2318e0d73bb, user_id=ce2e0ff013904d229dfc76b577abb8e9, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:25.539746 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c0b21b-3317-486f-8740-6b0aea3bb09e admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:25.560144 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3842/7670] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:40:25 2022] PUT /identity/v3/projects/3aee008ab961445e8240d2318e0d73bb/users/ce2e0ff013904d229dfc76b577abb8e9/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:40:25.570440 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f9fe3-a1b6-4092-b84e-1f9783a696ca None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:25.572184 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f9fe3-a1b6-4092-b84e-1f9783a696ca None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:25.572694 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f9fe3-a1b6-4092-b84e-1f9783a696ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:25.601167 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-9d2f9fe3-a1b6-4092-b84e-1f9783a696ca None None] MFA Rules not processed for user `ce2e0ff013904d229dfc76b577abb8e9`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:40:25.602431 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-9d2f9fe3-a1b6-4092-b84e-1f9783a696ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:25.622864 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c0b21b-3317-486f-8740-6b0aea3bb09e admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:25.624881 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-60c0b21b-3317-486f-8740-6b0aea3bb09e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:25.706943 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3829/7671] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:40:25 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:40:25.718314 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2f9fe3-a1b6-4092-b84e-1f9783a696ca None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:25.719878 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-9d2f9fe3-a1b6-4092-b84e-1f9783a696ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:25.723399 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c0b21b-3317-486f-8740-6b0aea3bb09e admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:25.729161 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1823f7-a749-44f9-9766-c89754b03728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:25.730164 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1823f7-a749-44f9-9766-c89754b03728 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:25.730505 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1823f7-a749-44f9-9766-c89754b03728 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:25.730791 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1823f7-a749-44f9-9766-c89754b03728 admin admin] PATH_INFO: `/v3/users/02a0280dbc4c4442a34f9178f7c5f557` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:25.732782 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1823f7-a749-44f9-9766-c89754b03728 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02a0280dbc4c4442a34f9178f7c5f557)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:25.734770 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1823f7-a749-44f9-9766-c89754b03728 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:25.804875 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2f9fe3-a1b6-4092-b84e-1f9783a696ca None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:25.809487 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08fd347-e809-4c9e-90fc-dec266d891a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198271d1c0d44cb58bace41a65f4b94c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:25.810175 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08fd347-e809-4c9e-90fc-dec266d891a9 service cinder] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:25.810463 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08fd347-e809-4c9e-90fc-dec266d891a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:25.810745 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08fd347-e809-4c9e-90fc-dec266d891a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:25.830352 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08fd347-e809-4c9e-90fc-dec266d891a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:25.831948 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08fd347-e809-4c9e-90fc-dec266d891a9 service cinder] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:25.843617 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3830/7672] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:40:25 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:40:25.971645 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-fa1823f7-a749-44f9-9766-c89754b03728 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02a0280dbc4c4442a34f9178f7c5f557'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:25.989081 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-fa1823f7-a749-44f9-9766-c89754b03728 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02a0280dbc4c4442a34f9178f7c5f557'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:26.000095 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-fa1823f7-a749-44f9-9766-c89754b03728 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02a0280dbc4c4442a34f9178f7c5f557'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:26.148128 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-fa1823f7-a749-44f9-9766-c89754b03728 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02a0280dbc4c4442a34f9178f7c5f557'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:26.148792 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-fa1823f7-a749-44f9-9766-c89754b03728 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02a0280dbc4c4442a34f9178f7c5f557'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:26.156646 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3843/7673] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:40:25 2022] DELETE /identity/v3/users/02a0280dbc4c4442a34f9178f7c5f557 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:40:26.244199 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08fd347-e809-4c9e-90fc-dec266d891a9 service cinder] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:26.255748 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08fd347-e809-4c9e-90fc-dec266d891a9 service cinder] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:26.309850 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182d3f64-c3bc-4b1c-913b-b29b0745eb66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198271d1c0d44cb58bace41a65f4b94c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:26.310557 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d3f64-c3bc-4b1c-913b-b29b0745eb66 service cinder] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:26.310841 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d3f64-c3bc-4b1c-913b-b29b0745eb66 service cinder] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:26.311116 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d3f64-c3bc-4b1c-913b-b29b0745eb66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:26.313160 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-182d3f64-c3bc-4b1c-913b-b29b0745eb66 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:26.380922 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182d3f64-c3bc-4b1c-913b-b29b0745eb66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:26.382635 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182d3f64-c3bc-4b1c-913b-b29b0745eb66 service cinder] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:26.392930 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3831/7674] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:40:26 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:40:26.466952 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1823f7-a749-44f9-9766-c89754b03728 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:26.468648 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-fa1823f7-a749-44f9-9766-c89754b03728 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:26.570228 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1823f7-a749-44f9-9766-c89754b03728 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:26.576090 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ffdf12-3072-418f-84c9-f3f164a26fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:26.577193 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ffdf12-3072-418f-84c9-f3f164a26fa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:26.577569 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ffdf12-3072-418f-84c9-f3f164a26fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:26.577903 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ffdf12-3072-418f-84c9-f3f164a26fa8 admin admin] PATH_INFO: `/v3/projects/8d9a98a0b9094e28a62cb3b2f58f7c98` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:26.579193 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ffdf12-3072-418f-84c9-f3f164a26fa8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d9a98a0b9094e28a62cb3b2f58f7c98)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:26.581299 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ffdf12-3072-418f-84c9-f3f164a26fa8 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:26.704213 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-20ffdf12-3072-418f-84c9-f3f164a26fa8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d9a98a0b9094e28a62cb3b2f58f7c98', 'request_id': 'req-20ffdf12-3072-418f-84c9-f3f164a26fa8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:26.710295 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-20ffdf12-3072-418f-84c9-f3f164a26fa8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d9a98a0b9094e28a62cb3b2f58f7c98', 'request_id': 'req-20ffdf12-3072-418f-84c9-f3f164a26fa8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:26.814758 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-20ffdf12-3072-418f-84c9-f3f164a26fa8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d9a98a0b9094e28a62cb3b2f58f7c98', 'request_id': 'req-20ffdf12-3072-418f-84c9-f3f164a26fa8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:26.828473 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-20ffdf12-3072-418f-84c9-f3f164a26fa8 admin admin] The token cache is being invalidate because project 8d9a98a0b9094e28a62cb3b2f58f7c98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:40:26.828765 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-20ffdf12-3072-418f-84c9-f3f164a26fa8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:26.829436 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-20ffdf12-3072-418f-84c9-f3f164a26fa8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:26.831349 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3844/7675] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:40:26 2022] DELETE /identity/v3/projects/8d9a98a0b9094e28a62cb3b2f58f7c98 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:40:26.836111 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1f5e1-0597-468e-81cc-bcb2e0515877 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:26.836400 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1f5e1-0597-468e-81cc-bcb2e0515877 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:26.836673 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1f5e1-0597-468e-81cc-bcb2e0515877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:26.863574 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-59b1f5e1-0597-468e-81cc-bcb2e0515877 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:40:26.864915 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-59b1f5e1-0597-468e-81cc-bcb2e0515877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:26.964716 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3832/7676] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:40:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:40:26.966210 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93044a01-323c-4b93-bd34-bd2ad8723c32 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:26.967671 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93044a01-323c-4b93-bd34-bd2ad8723c32 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:26.967964 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93044a01-323c-4b93-bd34-bd2ad8723c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:27.005522 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-93044a01-323c-4b93-bd34-bd2ad8723c32 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:40:27.018687 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-93044a01-323c-4b93-bd34-bd2ad8723c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:27.042329 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3845/7677] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:40:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:40:27.047083 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b1f5e1-0597-468e-81cc-bcb2e0515877 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:27.062515 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b1f5e1-0597-468e-81cc-bcb2e0515877 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:27.071919 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d3b24e-e58a-4b41-a70b-8b4ce3c12dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:27.072853 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d3b24e-e58a-4b41-a70b-8b4ce3c12dad admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:27.073141 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d3b24e-e58a-4b41-a70b-8b4ce3c12dad admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:27.073415 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d3b24e-e58a-4b41-a70b-8b4ce3c12dad admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:27.074144 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d3b24e-e58a-4b41-a70b-8b4ce3c12dad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:40:27.074451 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d3b24e-e58a-4b41-a70b-8b4ce3c12dad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:27.076164 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d3b24e-e58a-4b41-a70b-8b4ce3c12dad admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:27.095933 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3833/7678] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:40:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:40:27.097913 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93044a01-323c-4b93-bd34-bd2ad8723c32 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:27.109011 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93044a01-323c-4b93-bd34-bd2ad8723c32 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:27.132394 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc9d2b9-06d4-487f-87d3-3b06e692277c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:27.133025 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc9d2b9-06d4-487f-87d3-3b06e692277c admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:27.133318 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc9d2b9-06d4-487f-87d3-3b06e692277c admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:27.133597 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc9d2b9-06d4-487f-87d3-3b06e692277c admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:27.134793 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc9d2b9-06d4-487f-87d3-3b06e692277c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:27.136762 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc9d2b9-06d4-487f-87d3-3b06e692277c admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:27.252005 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3846/7679] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:40:27 2022] POST /identity/v3/projects => generated 373 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:40:27.253302 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d3b24e-e58a-4b41-a70b-8b4ce3c12dad admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:27.264182 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d3b24e-e58a-4b41-a70b-8b4ce3c12dad admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:27.329315 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65768f59-db7f-4123-bc57-85d8cb1ec6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:27.330115 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65768f59-db7f-4123-bc57-85d8cb1ec6c3 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:27.330407 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65768f59-db7f-4123-bc57-85d8cb1ec6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:27.330685 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65768f59-db7f-4123-bc57-85d8cb1ec6c3 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:27.331394 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65768f59-db7f-4123-bc57-85d8cb1ec6c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:27.333639 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65768f59-db7f-4123-bc57-85d8cb1ec6c3 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:27.457387 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3834/7680] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:40:27 2022] POST /identity/v3/users => generated 287 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:40:27.461049 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc9d2b9-06d4-487f-87d3-3b06e692277c admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:27.472631 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc9d2b9-06d4-487f-87d3-3b06e692277c admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:27.478709 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ea2842-90a6-4d39-ae46-9f71795cf726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:27.479454 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea2842-90a6-4d39-ae46-9f71795cf726 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:27.479777 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea2842-90a6-4d39-ae46-9f71795cf726 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:27.480054 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea2842-90a6-4d39-ae46-9f71795cf726 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:27.480893 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ea2842-90a6-4d39-ae46-9f71795cf726 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:27.482403 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ea2842-90a6-4d39-ae46-9f71795cf726 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:27.502565 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65768f59-db7f-4123-bc57-85d8cb1ec6c3 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:27.509152 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3847/7681] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:40:27 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:40:27.513873 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65768f59-db7f-4123-bc57-85d8cb1ec6c3 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:27.519273 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af106566-7b04-4650-b025-1fde8e205a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:27.520124 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af106566-7b04-4650-b025-1fde8e205a78 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:27.520721 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af106566-7b04-4650-b025-1fde8e205a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:27.521061 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af106566-7b04-4650-b025-1fde8e205a78 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:27.521977 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af106566-7b04-4650-b025-1fde8e205a78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:27.523978 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af106566-7b04-4650-b025-1fde8e205a78 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:27.540516 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ea2842-90a6-4d39-ae46-9f71795cf726 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:27.541802 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3835/7682] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:40:27 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:40:27.553685 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ea2842-90a6-4d39-ae46-9f71795cf726 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:27.560713 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e8262-6821-41e8-a1fa-109c560492fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:27.561702 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e8262-6821-41e8-a1fa-109c560492fe admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:27.561990 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e8262-6821-41e8-a1fa-109c560492fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:27.562446 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e8262-6821-41e8-a1fa-109c560492fe admin admin] PATH_INFO: `/v3/projects/ea1927109a494e6a9c8edae7c8ea87cd/users/49d724c1b2454a1c988e4c8b5d361b35/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:27.589128 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156e8262-6821-41e8-a1fa-109c560492fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea1927109a494e6a9c8edae7c8ea87cd, user_id=49d724c1b2454a1c988e4c8b5d361b35, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:27.592754 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156e8262-6821-41e8-a1fa-109c560492fe admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:27.738153 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3848/7683] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:40:27 2022] PUT /identity/v3/projects/ea1927109a494e6a9c8edae7c8ea87cd/users/49d724c1b2454a1c988e4c8b5d361b35/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:40:27.750350 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2052a2-9d50-48cd-8200-19ae57355ccd None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:27.756032 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2052a2-9d50-48cd-8200-19ae57355ccd None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:27.756576 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2052a2-9d50-48cd-8200-19ae57355ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:27.798978 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-ab2052a2-9d50-48cd-8200-19ae57355ccd None None] MFA Rules not processed for user `49d724c1b2454a1c988e4c8b5d361b35`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:40:27.800371 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-ab2052a2-9d50-48cd-8200-19ae57355ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:27.895139 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3836/7684] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:40:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:40:27.907914 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e8262-6821-41e8-a1fa-109c560492fe admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:27.909867 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-156e8262-6821-41e8-a1fa-109c560492fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:28.006273 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e8262-6821-41e8-a1fa-109c560492fe admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:28.012613 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575336c3-a522-47cc-960a-7609e67613d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:28.013259 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575336c3-a522-47cc-960a-7609e67613d8 service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:28.013540 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575336c3-a522-47cc-960a-7609e67613d8 service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:28.013817 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575336c3-a522-47cc-960a-7609e67613d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:28.021874 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575336c3-a522-47cc-960a-7609e67613d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:28.023452 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575336c3-a522-47cc-960a-7609e67613d8 service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:28.032948 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3849/7685] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:40:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:40:37.175302 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2052a2-9d50-48cd-8200-19ae57355ccd None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:37.176776 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-ab2052a2-9d50-48cd-8200-19ae57355ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:37.240157 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2052a2-9d50-48cd-8200-19ae57355ccd None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:37.244754 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526abf99-95b7-4f27-a1bf-0818e25f5e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:37.245619 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526abf99-95b7-4f27-a1bf-0818e25f5e74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:37.245908 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526abf99-95b7-4f27-a1bf-0818e25f5e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:37.246191 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526abf99-95b7-4f27-a1bf-0818e25f5e74 admin admin] PATH_INFO: `/v3/users/0397fa67544d46d6acbbe6d59a21b5eb` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:37.247380 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526abf99-95b7-4f27-a1bf-0818e25f5e74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0397fa67544d46d6acbbe6d59a21b5eb)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:37.249387 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526abf99-95b7-4f27-a1bf-0818e25f5e74 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:37.424421 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-526abf99-95b7-4f27-a1bf-0818e25f5e74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0397fa67544d46d6acbbe6d59a21b5eb'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:37.431731 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-526abf99-95b7-4f27-a1bf-0818e25f5e74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0397fa67544d46d6acbbe6d59a21b5eb'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:37.432482 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-526abf99-95b7-4f27-a1bf-0818e25f5e74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0397fa67544d46d6acbbe6d59a21b5eb'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:37.490802 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-526abf99-95b7-4f27-a1bf-0818e25f5e74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0397fa67544d46d6acbbe6d59a21b5eb'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:37.503924 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-526abf99-95b7-4f27-a1bf-0818e25f5e74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0397fa67544d46d6acbbe6d59a21b5eb'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:37.510668 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3837/7686] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:40:37 2022] DELETE /identity/v3/users/0397fa67544d46d6acbbe6d59a21b5eb => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:40:37.518448 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ea0f2-8813-4920-83f8-57348812dbfc None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:37.518448 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ea0f2-8813-4920-83f8-57348812dbfc None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:37.518448 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ea0f2-8813-4920-83f8-57348812dbfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:37.540219 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-3b6ea0f2-8813-4920-83f8-57348812dbfc None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:40:37.541807 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-3b6ea0f2-8813-4920-83f8-57348812dbfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:37.608093 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3850/7687] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:40:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:40:37.619440 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526abf99-95b7-4f27-a1bf-0818e25f5e74 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:37.621144 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-526abf99-95b7-4f27-a1bf-0818e25f5e74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:37.684355 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526abf99-95b7-4f27-a1bf-0818e25f5e74 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:37.688512 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df088b7-274f-40ac-a7a9-481c6bcdeb0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:37.689177 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df088b7-274f-40ac-a7a9-481c6bcdeb0e service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:37.689461 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df088b7-274f-40ac-a7a9-481c6bcdeb0e service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:37.689733 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df088b7-274f-40ac-a7a9-481c6bcdeb0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:37.705818 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df088b7-274f-40ac-a7a9-481c6bcdeb0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:37.705818 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df088b7-274f-40ac-a7a9-481c6bcdeb0e service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:37.714620 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3838/7688] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:40:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:40:38.292617 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ea0f2-8813-4920-83f8-57348812dbfc None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:38.294173 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-3b6ea0f2-8813-4920-83f8-57348812dbfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:38.307571 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ea0f2-8813-4920-83f8-57348812dbfc None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:38.328242 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43c0f9e-1ba6-4b3a-b5d4-20491e9415d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:38.328242 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c0f9e-1ba6-4b3a-b5d4-20491e9415d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:38.328242 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c0f9e-1ba6-4b3a-b5d4-20491e9415d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:38.328242 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c0f9e-1ba6-4b3a-b5d4-20491e9415d0 admin admin] PATH_INFO: `/v3/projects/d8db1a4b246e4ae1aa99962f35e65510` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:38.328623 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43c0f9e-1ba6-4b3a-b5d4-20491e9415d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8db1a4b246e4ae1aa99962f35e65510)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:38.328623 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43c0f9e-1ba6-4b3a-b5d4-20491e9415d0 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:38.546881 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b43c0f9e-1ba6-4b3a-b5d4-20491e9415d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8db1a4b246e4ae1aa99962f35e65510', 'request_id': 'req-b43c0f9e-1ba6-4b3a-b5d4-20491e9415d0'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:38.555033 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b43c0f9e-1ba6-4b3a-b5d4-20491e9415d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8db1a4b246e4ae1aa99962f35e65510', 'request_id': 'req-b43c0f9e-1ba6-4b3a-b5d4-20491e9415d0'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:38.644527 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b43c0f9e-1ba6-4b3a-b5d4-20491e9415d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8db1a4b246e4ae1aa99962f35e65510', 'request_id': 'req-b43c0f9e-1ba6-4b3a-b5d4-20491e9415d0'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:38.657568 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b43c0f9e-1ba6-4b3a-b5d4-20491e9415d0 admin admin] The token cache is being invalidate because project d8db1a4b246e4ae1aa99962f35e65510 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:40:38.657854 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b43c0f9e-1ba6-4b3a-b5d4-20491e9415d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:38.658518 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b43c0f9e-1ba6-4b3a-b5d4-20491e9415d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:38.663113 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3851/7689] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:40:38 2022] DELETE /identity/v3/projects/d8db1a4b246e4ae1aa99962f35e65510 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:40:38.665846 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df088b7-274f-40ac-a7a9-481c6bcdeb0e service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:38.676749 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df088b7-274f-40ac-a7a9-481c6bcdeb0e service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:38.738543 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae23c8-5d85-4ad1-a83e-3f245f11be15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:38.739543 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae23c8-5d85-4ad1-a83e-3f245f11be15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:38.739993 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae23c8-5d85-4ad1-a83e-3f245f11be15 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:38.740282 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae23c8-5d85-4ad1-a83e-3f245f11be15 admin admin] PATH_INFO: `/v3/users/28589d4455c44911baf0df885094a1c2` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:38.741789 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ae23c8-5d85-4ad1-a83e-3f245f11be15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28589d4455c44911baf0df885094a1c2)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:38.744929 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ae23c8-5d85-4ad1-a83e-3f245f11be15 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:38.925045 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-33ae23c8-5d85-4ad1-a83e-3f245f11be15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28589d4455c44911baf0df885094a1c2'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:38.936034 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-33ae23c8-5d85-4ad1-a83e-3f245f11be15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28589d4455c44911baf0df885094a1c2'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:38.937521 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-33ae23c8-5d85-4ad1-a83e-3f245f11be15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28589d4455c44911baf0df885094a1c2'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:39.016315 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-33ae23c8-5d85-4ad1-a83e-3f245f11be15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28589d4455c44911baf0df885094a1c2'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:39.029924 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-33ae23c8-5d85-4ad1-a83e-3f245f11be15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28589d4455c44911baf0df885094a1c2'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:39.036145 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3839/7690] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:40:38 2022] DELETE /identity/v3/users/28589d4455c44911baf0df885094a1c2 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:40:39.480495 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43c0f9e-1ba6-4b3a-b5d4-20491e9415d0 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:39.483336 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b43c0f9e-1ba6-4b3a-b5d4-20491e9415d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:39.497789 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43c0f9e-1ba6-4b3a-b5d4-20491e9415d0 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:39.570811 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d23d3b5-e4ce-49c8-acb4-5ec29e102265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:39.572970 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23d3b5-e4ce-49c8-acb4-5ec29e102265 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:39.573259 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23d3b5-e4ce-49c8-acb4-5ec29e102265 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:39.573551 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23d3b5-e4ce-49c8-acb4-5ec29e102265 admin admin] PATH_INFO: `/v3/projects/72799d441835453f8b45e81a4b96892d` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:39.574920 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d23d3b5-e4ce-49c8-acb4-5ec29e102265 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72799d441835453f8b45e81a4b96892d)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:39.576896 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d23d3b5-e4ce-49c8-acb4-5ec29e102265 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:39.701937 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3d23d3b5-e4ce-49c8-acb4-5ec29e102265 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72799d441835453f8b45e81a4b96892d', 'request_id': 'req-3d23d3b5-e4ce-49c8-acb4-5ec29e102265'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:39.707198 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3d23d3b5-e4ce-49c8-acb4-5ec29e102265 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72799d441835453f8b45e81a4b96892d', 'request_id': 'req-3d23d3b5-e4ce-49c8-acb4-5ec29e102265'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:39.787437 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3d23d3b5-e4ce-49c8-acb4-5ec29e102265 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72799d441835453f8b45e81a4b96892d', 'request_id': 'req-3d23d3b5-e4ce-49c8-acb4-5ec29e102265'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:39.801307 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3d23d3b5-e4ce-49c8-acb4-5ec29e102265 admin admin] The token cache is being invalidate because project 72799d441835453f8b45e81a4b96892d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:40:39.801730 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3d23d3b5-e4ce-49c8-acb4-5ec29e102265 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:39.802393 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-3d23d3b5-e4ce-49c8-acb4-5ec29e102265 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:39.804752 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3852/7691] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:40:39 2022] DELETE /identity/v3/projects/72799d441835453f8b45e81a4b96892d => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:40:39.810079 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75696417-b74a-4e1b-8ba2-fca02452138e None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:39.810583 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75696417-b74a-4e1b-8ba2-fca02452138e None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:39.810686 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75696417-b74a-4e1b-8ba2-fca02452138e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:39.829919 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-75696417-b74a-4e1b-8ba2-fca02452138e None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:40:39.831124 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-75696417-b74a-4e1b-8ba2-fca02452138e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:39.893233 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3840/7692] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:40:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:40:39.902004 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e179d729-3aab-4a26-b946-47aa009f8167 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:39.902293 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e179d729-3aab-4a26-b946-47aa009f8167 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:39.902604 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e179d729-3aab-4a26-b946-47aa009f8167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:39.921775 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-e179d729-3aab-4a26-b946-47aa009f8167 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:40:39.923064 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e179d729-3aab-4a26-b946-47aa009f8167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:39.936757 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3853/7693] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:40:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:40:39.937467 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75696417-b74a-4e1b-8ba2-fca02452138e None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:39.948439 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75696417-b74a-4e1b-8ba2-fca02452138e None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:39.953122 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381873dd-cbcb-4aba-b6a2-21e3dc55f105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:39.953786 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381873dd-cbcb-4aba-b6a2-21e3dc55f105 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:39.954066 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381873dd-cbcb-4aba-b6a2-21e3dc55f105 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:39.954340 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381873dd-cbcb-4aba-b6a2-21e3dc55f105 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:39.955085 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381873dd-cbcb-4aba-b6a2-21e3dc55f105 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:40:39.955388 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381873dd-cbcb-4aba-b6a2-21e3dc55f105 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:39.957031 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381873dd-cbcb-4aba-b6a2-21e3dc55f105 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:39.971935 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3841/7694] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:40:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:40:39.976457 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e179d729-3aab-4a26-b946-47aa009f8167 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:39.985954 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e179d729-3aab-4a26-b946-47aa009f8167 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:39.991122 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4543ff22-e56c-497d-8673-ab878450f3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:39.991906 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4543ff22-e56c-497d-8673-ab878450f3da admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:39.992167 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4543ff22-e56c-497d-8673-ab878450f3da admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:39.992496 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4543ff22-e56c-497d-8673-ab878450f3da admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:39.993256 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4543ff22-e56c-497d-8673-ab878450f3da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:39.995372 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4543ff22-e56c-497d-8673-ab878450f3da admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:40.094352 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3854/7695] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:40:39 2022] POST /identity/v3/projects => generated 373 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:40:40.095734 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381873dd-cbcb-4aba-b6a2-21e3dc55f105 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:40.106090 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381873dd-cbcb-4aba-b6a2-21e3dc55f105 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:40.164572 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6296f4e4-fad2-4324-88fe-53b7ab4cc944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:40.165803 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296f4e4-fad2-4324-88fe-53b7ab4cc944 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:40.166085 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296f4e4-fad2-4324-88fe-53b7ab4cc944 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:40.166361 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296f4e4-fad2-4324-88fe-53b7ab4cc944 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:40.167044 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6296f4e4-fad2-4324-88fe-53b7ab4cc944 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:40.169090 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6296f4e4-fad2-4324-88fe-53b7ab4cc944 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:40.262820 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3842/7696] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:40:40 2022] POST /identity/v3/users => generated 287 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:40:40.267082 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4543ff22-e56c-497d-8673-ab878450f3da admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:40.281048 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4543ff22-e56c-497d-8673-ab878450f3da admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:40.289072 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bab844-d984-4552-9e55-efb6c234395f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:40.295572 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bab844-d984-4552-9e55-efb6c234395f admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:40.295572 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bab844-d984-4552-9e55-efb6c234395f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:40.295572 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bab844-d984-4552-9e55-efb6c234395f admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:40.295572 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bab844-d984-4552-9e55-efb6c234395f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:40.295572 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bab844-d984-4552-9e55-efb6c234395f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:40.305379 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3855/7697] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:40:40 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:40:40.310051 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6296f4e4-fad2-4324-88fe-53b7ab4cc944 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:40.320402 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6296f4e4-fad2-4324-88fe-53b7ab4cc944 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:40.325827 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa83a9-d363-44cb-8edd-5e22cb19e65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:40.326497 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa83a9-d363-44cb-8edd-5e22cb19e65e admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:40.326779 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa83a9-d363-44cb-8edd-5e22cb19e65e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:40.327053 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa83a9-d363-44cb-8edd-5e22cb19e65e admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:40.327835 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaa83a9-d363-44cb-8edd-5e22cb19e65e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:40.329518 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaa83a9-d363-44cb-8edd-5e22cb19e65e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:40.343086 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3843/7698] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:40:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:40:40.347186 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bab844-d984-4552-9e55-efb6c234395f admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:40.357697 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bab844-d984-4552-9e55-efb6c234395f admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:40.362465 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d14f42-78ff-4f4d-b423-950d3601d844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:40.363421 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d14f42-78ff-4f4d-b423-950d3601d844 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:40.363725 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d14f42-78ff-4f4d-b423-950d3601d844 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:40.364004 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d14f42-78ff-4f4d-b423-950d3601d844 admin admin] PATH_INFO: `/v3/projects/9ef324a7ffd642f08d0c23153a225daa/users/5745c928a98f441d9000ff599dfdc274/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:40.380008 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d14f42-78ff-4f4d-b423-950d3601d844 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ef324a7ffd642f08d0c23153a225daa, user_id=5745c928a98f441d9000ff599dfdc274, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:40.382734 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d14f42-78ff-4f4d-b423-950d3601d844 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:40.480611 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3856/7699] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:40:40 2022] PUT /identity/v3/projects/9ef324a7ffd642f08d0c23153a225daa/users/5745c928a98f441d9000ff599dfdc274/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:40:40.490892 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d76e16-5826-4e2d-b10f-19b3a32b9fe6 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:40.491187 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d76e16-5826-4e2d-b10f-19b3a32b9fe6 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:40.491509 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d76e16-5826-4e2d-b10f-19b3a32b9fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:40.522135 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-30d76e16-5826-4e2d-b10f-19b3a32b9fe6 None None] MFA Rules not processed for user `5745c928a98f441d9000ff599dfdc274`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:40:40.523830 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-30d76e16-5826-4e2d-b10f-19b3a32b9fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:40.615524 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3844/7700] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:40:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:40:40.626795 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d14f42-78ff-4f4d-b423-950d3601d844 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:40.628888 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-f4d14f42-78ff-4f4d-b423-950d3601d844 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:40.727132 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d14f42-78ff-4f4d-b423-950d3601d844 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:40.733755 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7032c79d-b85c-48fc-b7ad-b314845624d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198271d1c0d44cb58bace41a65f4b94c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:40.736148 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7032c79d-b85c-48fc-b7ad-b314845624d9 service cinder] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:40.736677 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7032c79d-b85c-48fc-b7ad-b314845624d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:40.737444 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7032c79d-b85c-48fc-b7ad-b314845624d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:40.754554 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7032c79d-b85c-48fc-b7ad-b314845624d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:40.756243 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7032c79d-b85c-48fc-b7ad-b314845624d9 service cinder] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:40.770174 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3857/7701] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:40:40 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:40:41.262468 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d76e16-5826-4e2d-b10f-19b3a32b9fe6 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:41.265748 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-30d76e16-5826-4e2d-b10f-19b3a32b9fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:41.367702 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d76e16-5826-4e2d-b10f-19b3a32b9fe6 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:41.374141 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d38a0f-e633-428b-a285-e2b48c1943e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:41.375218 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d38a0f-e633-428b-a285-e2b48c1943e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:41.375596 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d38a0f-e633-428b-a285-e2b48c1943e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:41.375878 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d38a0f-e633-428b-a285-e2b48c1943e3 admin admin] PATH_INFO: `/v3/users/3bfc2374351c422ca49f5ef479322e3e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:41.377242 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d38a0f-e633-428b-a285-e2b48c1943e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bfc2374351c422ca49f5ef479322e3e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:41.379227 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d38a0f-e633-428b-a285-e2b48c1943e3 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:41.608080 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b4d38a0f-e633-428b-a285-e2b48c1943e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bfc2374351c422ca49f5ef479322e3e'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:41.616096 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b4d38a0f-e633-428b-a285-e2b48c1943e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bfc2374351c422ca49f5ef479322e3e'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:41.616957 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b4d38a0f-e633-428b-a285-e2b48c1943e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bfc2374351c422ca49f5ef479322e3e'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:41.752982 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b4d38a0f-e633-428b-a285-e2b48c1943e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bfc2374351c422ca49f5ef479322e3e'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:41.773555 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b4d38a0f-e633-428b-a285-e2b48c1943e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bfc2374351c422ca49f5ef479322e3e'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:41.782254 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3845/7702] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:40:41 2022] DELETE /identity/v3/users/3bfc2374351c422ca49f5ef479322e3e => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:40:41.787288 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a077a9-21e5-4694-990b-dd8841d76b75 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:41.787815 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a077a9-21e5-4694-990b-dd8841d76b75 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:41.787894 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a077a9-21e5-4694-990b-dd8841d76b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:41.810134 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-74a077a9-21e5-4694-990b-dd8841d76b75 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:40:41.811526 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-74a077a9-21e5-4694-990b-dd8841d76b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:41.873360 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3858/7703] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:40:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:40:41.883216 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d38a0f-e633-428b-a285-e2b48c1943e3 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:41.885488 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b4d38a0f-e633-428b-a285-e2b48c1943e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:41.951537 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d38a0f-e633-428b-a285-e2b48c1943e3 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:41.955745 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5062aed2-a832-409a-a20f-a6eda185208b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:41.959498 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062aed2-a832-409a-a20f-a6eda185208b service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:41.959789 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062aed2-a832-409a-a20f-a6eda185208b service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:41.960074 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062aed2-a832-409a-a20f-a6eda185208b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:41.970340 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5062aed2-a832-409a-a20f-a6eda185208b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:41.971775 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5062aed2-a832-409a-a20f-a6eda185208b service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:41.982805 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3846/7704] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:40:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:40:42.289542 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a077a9-21e5-4694-990b-dd8841d76b75 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:42.290810 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-74a077a9-21e5-4694-990b-dd8841d76b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:42.308137 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a077a9-21e5-4694-990b-dd8841d76b75 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:42.313838 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9495f36f-04e9-4469-ba05-4261a49d097b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:42.314922 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495f36f-04e9-4469-ba05-4261a49d097b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:42.315197 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495f36f-04e9-4469-ba05-4261a49d097b admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:42.315691 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495f36f-04e9-4469-ba05-4261a49d097b admin admin] PATH_INFO: `/v3/users/49d724c1b2454a1c988e4c8b5d361b35` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:42.316997 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9495f36f-04e9-4469-ba05-4261a49d097b admin admin] RBAC: Authorizing `identity:delete_user(user_id=49d724c1b2454a1c988e4c8b5d361b35)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:42.318835 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9495f36f-04e9-4469-ba05-4261a49d097b admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:42.657200 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5062aed2-a832-409a-a20f-a6eda185208b service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:42.660139 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-5062aed2-a832-409a-a20f-a6eda185208b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:42.681191 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5062aed2-a832-409a-a20f-a6eda185208b service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:42.682937 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9495f36f-04e9-4469-ba05-4261a49d097b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49d724c1b2454a1c988e4c8b5d361b35'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:42.686218 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcba7e0-2e21-49b8-8307-f0aa08e3988d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:42.687300 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcba7e0-2e21-49b8-8307-f0aa08e3988d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:42.693413 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcba7e0-2e21-49b8-8307-f0aa08e3988d admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:42.693413 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcba7e0-2e21-49b8-8307-f0aa08e3988d admin admin] PATH_INFO: `/v3/projects/12839e8098d74d729bceddeda4fa1acb` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:42.693413 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcba7e0-2e21-49b8-8307-f0aa08e3988d admin admin] RBAC: Authorizing `identity:delete_project(project_id=12839e8098d74d729bceddeda4fa1acb)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:42.693413 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcba7e0-2e21-49b8-8307-f0aa08e3988d admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:42.713631 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9495f36f-04e9-4469-ba05-4261a49d097b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49d724c1b2454a1c988e4c8b5d361b35'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:42.722011 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9495f36f-04e9-4469-ba05-4261a49d097b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49d724c1b2454a1c988e4c8b5d361b35'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:42.805172 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-efcba7e0-2e21-49b8-8307-f0aa08e3988d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12839e8098d74d729bceddeda4fa1acb', 'request_id': 'req-efcba7e0-2e21-49b8-8307-f0aa08e3988d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:42.812637 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-efcba7e0-2e21-49b8-8307-f0aa08e3988d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12839e8098d74d729bceddeda4fa1acb', 'request_id': 'req-efcba7e0-2e21-49b8-8307-f0aa08e3988d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:42.815051 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9495f36f-04e9-4469-ba05-4261a49d097b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49d724c1b2454a1c988e4c8b5d361b35'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:42.816549 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9495f36f-04e9-4469-ba05-4261a49d097b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49d724c1b2454a1c988e4c8b5d361b35'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:42.819493 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-efcba7e0-2e21-49b8-8307-f0aa08e3988d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12839e8098d74d729bceddeda4fa1acb', 'request_id': 'req-efcba7e0-2e21-49b8-8307-f0aa08e3988d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:42.824750 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3859/7705] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:40:42 2022] DELETE /identity/v3/users/49d724c1b2454a1c988e4c8b5d361b35 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:40:42.829259 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d9c1d-12d5-4e0f-a051-67e44fdf3f5b None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:42.829549 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d9c1d-12d5-4e0f-a051-67e44fdf3f5b None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:42.829826 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d9c1d-12d5-4e0f-a051-67e44fdf3f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:42.851138 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-101d9c1d-12d5-4e0f-a051-67e44fdf3f5b None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:40:42.852430 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-101d9c1d-12d5-4e0f-a051-67e44fdf3f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:42.915982 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3860/7706] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:40:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:40:42.918340 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-efcba7e0-2e21-49b8-8307-f0aa08e3988d admin admin] The token cache is being invalidate because project 12839e8098d74d729bceddeda4fa1acb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:40:42.925369 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101d9c1d-12d5-4e0f-a051-67e44fdf3f5b None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:42.926762 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-101d9c1d-12d5-4e0f-a051-67e44fdf3f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:42.934771 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-efcba7e0-2e21-49b8-8307-f0aa08e3988d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:42.935649 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-efcba7e0-2e21-49b8-8307-f0aa08e3988d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:42.939142 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3847/7707] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:40:42 2022] DELETE /identity/v3/projects/12839e8098d74d729bceddeda4fa1acb => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:40:42.941908 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcba7e0-2e21-49b8-8307-f0aa08e3988d admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:42.943394 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-efcba7e0-2e21-49b8-8307-f0aa08e3988d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:42.995323 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101d9c1d-12d5-4e0f-a051-67e44fdf3f5b None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:42.999857 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9f160e-d2d7-4b73-9de5-cf1d8559890d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:43.000507 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f160e-d2d7-4b73-9de5-cf1d8559890d service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:43.000969 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f160e-d2d7-4b73-9de5-cf1d8559890d service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:43.001301 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f160e-d2d7-4b73-9de5-cf1d8559890d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:43.003325 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-1f9f160e-d2d7-4b73-9de5-cf1d8559890d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:43.016552 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9f160e-d2d7-4b73-9de5-cf1d8559890d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:43.017983 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9f160e-d2d7-4b73-9de5-cf1d8559890d service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:43.018093 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcba7e0-2e21-49b8-8307-f0aa08e3988d admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:43.026038 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c7423b-e60c-4dff-8391-3b3d121cc7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:43.026038 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c7423b-e60c-4dff-8391-3b3d121cc7d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:43.026038 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c7423b-e60c-4dff-8391-3b3d121cc7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:43.031295 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c7423b-e60c-4dff-8391-3b3d121cc7d7 admin admin] PATH_INFO: `/v3/users/ce2e0ff013904d229dfc76b577abb8e9` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:43.031295 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c7423b-e60c-4dff-8391-3b3d121cc7d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce2e0ff013904d229dfc76b577abb8e9)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:43.031425 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3861/7708] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:40:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:40:43.031548 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c7423b-e60c-4dff-8391-3b3d121cc7d7 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:43.266703 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-07c7423b-e60c-4dff-8391-3b3d121cc7d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce2e0ff013904d229dfc76b577abb8e9'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:43.275194 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-07c7423b-e60c-4dff-8391-3b3d121cc7d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce2e0ff013904d229dfc76b577abb8e9'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:43.275935 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-07c7423b-e60c-4dff-8391-3b3d121cc7d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce2e0ff013904d229dfc76b577abb8e9'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:43.370308 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-07c7423b-e60c-4dff-8391-3b3d121cc7d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce2e0ff013904d229dfc76b577abb8e9'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:43.388973 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-07c7423b-e60c-4dff-8391-3b3d121cc7d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce2e0ff013904d229dfc76b577abb8e9'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:43.397146 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3848/7709] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:40:42 2022] DELETE /identity/v3/users/ce2e0ff013904d229dfc76b577abb8e9 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:40:43.600436 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9f160e-d2d7-4b73-9de5-cf1d8559890d service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:43.602068 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-1f9f160e-d2d7-4b73-9de5-cf1d8559890d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:43.615383 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9f160e-d2d7-4b73-9de5-cf1d8559890d service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:43.693756 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e73477a-00e5-47e7-92b0-d0cabdf514e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:43.694627 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73477a-00e5-47e7-92b0-d0cabdf514e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:43.694957 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73477a-00e5-47e7-92b0-d0cabdf514e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:43.695180 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73477a-00e5-47e7-92b0-d0cabdf514e2 admin admin] PATH_INFO: `/v3/projects/ea1927109a494e6a9c8edae7c8ea87cd` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:43.696728 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e73477a-00e5-47e7-92b0-d0cabdf514e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea1927109a494e6a9c8edae7c8ea87cd)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:43.698805 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e73477a-00e5-47e7-92b0-d0cabdf514e2 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:43.871007 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0e73477a-00e5-47e7-92b0-d0cabdf514e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea1927109a494e6a9c8edae7c8ea87cd', 'request_id': 'req-0e73477a-00e5-47e7-92b0-d0cabdf514e2'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:43.881445 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0e73477a-00e5-47e7-92b0-d0cabdf514e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea1927109a494e6a9c8edae7c8ea87cd', 'request_id': 'req-0e73477a-00e5-47e7-92b0-d0cabdf514e2'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:43.953096 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0e73477a-00e5-47e7-92b0-d0cabdf514e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea1927109a494e6a9c8edae7c8ea87cd', 'request_id': 'req-0e73477a-00e5-47e7-92b0-d0cabdf514e2'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:43.965683 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0e73477a-00e5-47e7-92b0-d0cabdf514e2 admin admin] The token cache is being invalidate because project ea1927109a494e6a9c8edae7c8ea87cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:40:43.965974 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0e73477a-00e5-47e7-92b0-d0cabdf514e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:43.966688 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0e73477a-00e5-47e7-92b0-d0cabdf514e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:43.968232 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3862/7710] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:40:43 2022] DELETE /identity/v3/projects/ea1927109a494e6a9c8edae7c8ea87cd => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:40:43.973276 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4765d936-f8eb-4225-9b0b-731f40f3d0fb None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:43.973821 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4765d936-f8eb-4225-9b0b-731f40f3d0fb None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:43.973821 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4765d936-f8eb-4225-9b0b-731f40f3d0fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:43.993390 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-4765d936-f8eb-4225-9b0b-731f40f3d0fb None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:40:43.994783 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-4765d936-f8eb-4225-9b0b-731f40f3d0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:44.056988 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3849/7711] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:40:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:40:44.065483 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d73c0-8b24-4ce0-a615-b3266c5b13ca None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:44.065774 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d73c0-8b24-4ce0-a615-b3266c5b13ca None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:44.066053 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d73c0-8b24-4ce0-a615-b3266c5b13ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:44.085061 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-653d73c0-8b24-4ce0-a615-b3266c5b13ca None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:40:44.086254 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-653d73c0-8b24-4ce0-a615-b3266c5b13ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:44.093209 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4765d936-f8eb-4225-9b0b-731f40f3d0fb None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:44.094598 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-4765d936-f8eb-4225-9b0b-731f40f3d0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:44.100045 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3863/7712] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:40:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:40:44.105143 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653d73c0-8b24-4ce0-a615-b3266c5b13ca None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:44.116736 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4765d936-f8eb-4225-9b0b-731f40f3d0fb None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:44.122930 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653d73c0-8b24-4ce0-a615-b3266c5b13ca None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:44.128163 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc476121-a8a3-4107-b95c-a440c2c122f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:44.128694 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc476121-a8a3-4107-b95c-a440c2c122f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:44.134614 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc476121-a8a3-4107-b95c-a440c2c122f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:44.134614 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc476121-a8a3-4107-b95c-a440c2c122f6 admin admin] PATH_INFO: `/v3/projects/3aee008ab961445e8240d2318e0d73bb` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:44.134614 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc476121-a8a3-4107-b95c-a440c2c122f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3aee008ab961445e8240d2318e0d73bb)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:44.134614 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc476121-a8a3-4107-b95c-a440c2c122f6 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:44.135430 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba141295-9fc2-4afe-993d-95a6f486a00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:44.135430 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba141295-9fc2-4afe-993d-95a6f486a00b admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:44.135430 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba141295-9fc2-4afe-993d-95a6f486a00b admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:44.135430 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba141295-9fc2-4afe-993d-95a6f486a00b admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:44.136195 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba141295-9fc2-4afe-993d-95a6f486a00b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:40:44.136195 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba141295-9fc2-4afe-993d-95a6f486a00b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:44.136921 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba141295-9fc2-4afe-993d-95a6f486a00b admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:44.150561 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3864/7713] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:40:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:40:44.156437 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba141295-9fc2-4afe-993d-95a6f486a00b admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:44.173692 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba141295-9fc2-4afe-993d-95a6f486a00b admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:44.179088 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f659f9c4-831b-4124-a433-1b7d0b0c1203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:44.179932 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f659f9c4-831b-4124-a433-1b7d0b0c1203 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:44.180881 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f659f9c4-831b-4124-a433-1b7d0b0c1203 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:44.182944 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f659f9c4-831b-4124-a433-1b7d0b0c1203 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:44.182944 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f659f9c4-831b-4124-a433-1b7d0b0c1203 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:44.184783 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f659f9c4-831b-4124-a433-1b7d0b0c1203 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:44.269624 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-fc476121-a8a3-4107-b95c-a440c2c122f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3aee008ab961445e8240d2318e0d73bb', 'request_id': 'req-fc476121-a8a3-4107-b95c-a440c2c122f6'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:44.276434 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-fc476121-a8a3-4107-b95c-a440c2c122f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3aee008ab961445e8240d2318e0d73bb', 'request_id': 'req-fc476121-a8a3-4107-b95c-a440c2c122f6'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:44.282598 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-fc476121-a8a3-4107-b95c-a440c2c122f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3aee008ab961445e8240d2318e0d73bb', 'request_id': 'req-fc476121-a8a3-4107-b95c-a440c2c122f6'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:44.305036 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3865/7714] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:40:44 2022] POST /identity/v3/projects => generated 367 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:40:44.306162 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f659f9c4-831b-4124-a433-1b7d0b0c1203 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:44.374181 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f659f9c4-831b-4124-a433-1b7d0b0c1203 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:44.378844 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64d6a69-bcfb-4556-969a-f36a76158087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:44.379543 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d6a69-bcfb-4556-969a-f36a76158087 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:44.379829 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d6a69-bcfb-4556-969a-f36a76158087 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:44.380103 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d6a69-bcfb-4556-969a-f36a76158087 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:44.380780 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64d6a69-bcfb-4556-969a-f36a76158087 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:44.382707 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64d6a69-bcfb-4556-969a-f36a76158087 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:44.466928 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-fc476121-a8a3-4107-b95c-a440c2c122f6 admin admin] The token cache is being invalidate because project 3aee008ab961445e8240d2318e0d73bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:40:44.467218 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-fc476121-a8a3-4107-b95c-a440c2c122f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:44.468003 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-fc476121-a8a3-4107-b95c-a440c2c122f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:44.469558 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3850/7715] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:40:44 2022] DELETE /identity/v3/projects/3aee008ab961445e8240d2318e0d73bb => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:40:44.476707 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8411d9-a6a1-4622-b477-ec0418052ca3 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:44.477073 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8411d9-a6a1-4622-b477-ec0418052ca3 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:44.478061 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8411d9-a6a1-4622-b477-ec0418052ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:44.503128 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-ea8411d9-a6a1-4622-b477-ec0418052ca3 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:40:44.504366 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-ea8411d9-a6a1-4622-b477-ec0418052ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:44.513454 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3851/7716] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:40:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:40:44.518504 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3866/7717] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:40:44 2022] POST /identity/v3/users => generated 284 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:40:44.519282 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8411d9-a6a1-4622-b477-ec0418052ca3 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:44.521022 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-ea8411d9-a6a1-4622-b477-ec0418052ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:44.521697 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1497b-4110-4a6d-99b2-14f2431f3172 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:44.522094 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1497b-4110-4a6d-99b2-14f2431f3172 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:44.522506 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1497b-4110-4a6d-99b2-14f2431f3172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:44.535350 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8411d9-a6a1-4622-b477-ec0418052ca3 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:44.542591 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6b7a6c-b840-403a-bce6-51d3785ae316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:44.543670 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b7a6c-b840-403a-bce6-51d3785ae316 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:44.543888 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b7a6c-b840-403a-bce6-51d3785ae316 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:44.544168 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b7a6c-b840-403a-bce6-51d3785ae316 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:44.544898 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6b7a6c-b840-403a-bce6-51d3785ae316 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:44.546773 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-41f1497b-4110-4a6d-99b2-14f2431f3172 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:40:44.546903 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6b7a6c-b840-403a-bce6-51d3785ae316 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:44.548482 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-41f1497b-4110-4a6d-99b2-14f2431f3172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:44.564254 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3867/7718] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:40:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:40:44.564676 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3852/7719] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:40:44 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:40:44.565698 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f1497b-4110-4a6d-99b2-14f2431f3172 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:44.568738 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6b7a6c-b840-403a-bce6-51d3785ae316 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:44.576898 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f1497b-4110-4a6d-99b2-14f2431f3172 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:44.582116 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1fe110-137a-46c6-9a6d-bea19499a781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:44.582787 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1fe110-137a-46c6-9a6d-bea19499a781 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:44.583069 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1fe110-137a-46c6-9a6d-bea19499a781 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:44.583344 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1fe110-137a-46c6-9a6d-bea19499a781 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:44.584393 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1fe110-137a-46c6-9a6d-bea19499a781 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:40:44.584705 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1fe110-137a-46c6-9a6d-bea19499a781 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:44.586512 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1fe110-137a-46c6-9a6d-bea19499a781 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:44.593320 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6b7a6c-b840-403a-bce6-51d3785ae316 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:44.599911 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3868/7720] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:40:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:40:44.604737 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312f1d89-91cd-4807-b311-1a8fd263f6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:44.605794 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1fe110-137a-46c6-9a6d-bea19499a781 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:44.606905 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f1d89-91cd-4807-b311-1a8fd263f6f4 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:44.607792 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f1d89-91cd-4807-b311-1a8fd263f6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:44.608245 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f1d89-91cd-4807-b311-1a8fd263f6f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:44.611262 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312f1d89-91cd-4807-b311-1a8fd263f6f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:44.613361 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312f1d89-91cd-4807-b311-1a8fd263f6f4 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:44.621655 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1fe110-137a-46c6-9a6d-bea19499a781 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:44.628006 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f56d5-83df-4124-b7ce-f656caad397b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:44.628260 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f56d5-83df-4124-b7ce-f656caad397b admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:44.628453 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3853/7721] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:40:44 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:40:44.628553 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f56d5-83df-4124-b7ce-f656caad397b admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:44.628807 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f56d5-83df-4124-b7ce-f656caad397b admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:44.629549 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6f56d5-83df-4124-b7ce-f656caad397b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:44.632561 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312f1d89-91cd-4807-b311-1a8fd263f6f4 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:44.636535 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6f56d5-83df-4124-b7ce-f656caad397b admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:44.646917 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312f1d89-91cd-4807-b311-1a8fd263f6f4 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:44.654667 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759ef75c-00bf-42da-bf51-b4f7b0929630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:44.656239 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ef75c-00bf-42da-bf51-b4f7b0929630 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:44.656239 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ef75c-00bf-42da-bf51-b4f7b0929630 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:44.656948 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ef75c-00bf-42da-bf51-b4f7b0929630 admin admin] PATH_INFO: `/v3/projects/a646ef9c31fd4125ad0c8196768a072e/users/ac7356d0eff7427d873ded6b8dff90c5/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:44.673930 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759ef75c-00bf-42da-bf51-b4f7b0929630 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a646ef9c31fd4125ad0c8196768a072e, user_id=ac7356d0eff7427d873ded6b8dff90c5, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:44.676633 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759ef75c-00bf-42da-bf51-b4f7b0929630 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:44.725818 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3869/7722] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:40:44 2022] POST /identity/v3/projects => generated 375 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:40:44.730191 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f56d5-83df-4124-b7ce-f656caad397b admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:44.752452 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3854/7723] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:40:44 2022] PUT /identity/v3/projects/a646ef9c31fd4125ad0c8196768a072e/users/ac7356d0eff7427d873ded6b8dff90c5/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:40:44.764268 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aae828-541a-4224-bf54-2f5661544a46 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:44.764609 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aae828-541a-4224-bf54-2f5661544a46 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:44.767343 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aae828-541a-4224-bf54-2f5661544a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:44.794355 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-22aae828-541a-4224-bf54-2f5661544a46 None None] MFA Rules not processed for user `ac7356d0eff7427d873ded6b8dff90c5`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:40:44.795748 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-22aae828-541a-4224-bf54-2f5661544a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:44.818016 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f56d5-83df-4124-b7ce-f656caad397b admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:44.869886 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3855/7724] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:40:44 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:40:44.881532 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aae828-541a-4224-bf54-2f5661544a46 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:44.883022 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-22aae828-541a-4224-bf54-2f5661544a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:44.885010 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f639c8ae-18eb-4491-bef2-453c90860a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:44.885995 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f639c8ae-18eb-4491-bef2-453c90860a67 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:44.886407 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f639c8ae-18eb-4491-bef2-453c90860a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:44.886728 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f639c8ae-18eb-4491-bef2-453c90860a67 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:44.887487 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f639c8ae-18eb-4491-bef2-453c90860a67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:44.889999 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f639c8ae-18eb-4491-bef2-453c90860a67 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:44.965392 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aae828-541a-4224-bf54-2f5661544a46 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:44.970611 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e174d-a113-47cb-bd16-677fd00cdf98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198271d1c0d44cb58bace41a65f4b94c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:44.974282 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e174d-a113-47cb-bd16-677fd00cdf98 service cinder] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:44.974282 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e174d-a113-47cb-bd16-677fd00cdf98 service cinder] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:44.974282 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e174d-a113-47cb-bd16-677fd00cdf98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:44.982959 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e174d-a113-47cb-bd16-677fd00cdf98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:44.984445 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e174d-a113-47cb-bd16-677fd00cdf98 service cinder] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:44.993880 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3856/7725] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:40:44 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:40:45.031572 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3870/7726] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:40:44 2022] POST /identity/v3/users => generated 288 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:40:45.033001 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e174d-a113-47cb-bd16-677fd00cdf98 service cinder] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:45.045197 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e174d-a113-47cb-bd16-677fd00cdf98 service cinder] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:45.050663 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448697e6-d9d8-49bb-97ba-f99fc57d6494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:45.051549 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448697e6-d9d8-49bb-97ba-f99fc57d6494 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:45.052021 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448697e6-d9d8-49bb-97ba-f99fc57d6494 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:45.052536 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448697e6-d9d8-49bb-97ba-f99fc57d6494 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:45.053406 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448697e6-d9d8-49bb-97ba-f99fc57d6494 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:45.056106 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448697e6-d9d8-49bb-97ba-f99fc57d6494 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:45.068191 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3857/7727] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:40:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:40:45.073032 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f639c8ae-18eb-4491-bef2-453c90860a67 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:45.084742 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f639c8ae-18eb-4491-bef2-453c90860a67 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:45.096630 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb41efb-6c8d-4884-a7ba-fe4fa3f61fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:45.097447 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb41efb-6c8d-4884-a7ba-fe4fa3f61fa1 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:45.098279 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb41efb-6c8d-4884-a7ba-fe4fa3f61fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:45.098279 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb41efb-6c8d-4884-a7ba-fe4fa3f61fa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:45.098975 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb41efb-6c8d-4884-a7ba-fe4fa3f61fa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:45.100939 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb41efb-6c8d-4884-a7ba-fe4fa3f61fa1 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:45.114536 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3871/7728] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:40:45 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:40:45.119420 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448697e6-d9d8-49bb-97ba-f99fc57d6494 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:45.132125 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448697e6-d9d8-49bb-97ba-f99fc57d6494 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:45.140091 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f9ec8f-451c-447c-b899-b5edcabbda41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:45.143102 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f9ec8f-451c-447c-b899-b5edcabbda41 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:45.143952 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f9ec8f-451c-447c-b899-b5edcabbda41 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:45.144729 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f9ec8f-451c-447c-b899-b5edcabbda41 admin admin] PATH_INFO: `/v3/projects/eaa012bd5cf0437f9a1d0a524871726f/users/1b8033dfa10f4a638f4136ed3449eea0/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:45.163789 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f9ec8f-451c-447c-b899-b5edcabbda41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eaa012bd5cf0437f9a1d0a524871726f, user_id=1b8033dfa10f4a638f4136ed3449eea0, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:45.167144 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f9ec8f-451c-447c-b899-b5edcabbda41 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:45.287169 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3858/7729] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:40:45 2022] PUT /identity/v3/projects/eaa012bd5cf0437f9a1d0a524871726f/users/1b8033dfa10f4a638f4136ed3449eea0/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:40:45.297634 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2ada99-23a3-41dd-a087-00b10a43949e None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:45.297925 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2ada99-23a3-41dd-a087-00b10a43949e None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:45.298214 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2ada99-23a3-41dd-a087-00b10a43949e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:45.331890 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-ce2ada99-23a3-41dd-a087-00b10a43949e None None] MFA Rules not processed for user `1b8033dfa10f4a638f4136ed3449eea0`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:40:45.333205 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ce2ada99-23a3-41dd-a087-00b10a43949e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:45.417858 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3872/7730] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:40:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:40:45.429803 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f9ec8f-451c-447c-b899-b5edcabbda41 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:45.432301 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-83f9ec8f-451c-447c-b899-b5edcabbda41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:45.514549 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f9ec8f-451c-447c-b899-b5edcabbda41 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:45.519027 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33056a0a-d601-4ed6-ac37-3b7e55017653 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198271d1c0d44cb58bace41a65f4b94c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:45.519939 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33056a0a-d601-4ed6-ac37-3b7e55017653 service cinder] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:45.520239 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33056a0a-d601-4ed6-ac37-3b7e55017653 service cinder] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:45.520520 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33056a0a-d601-4ed6-ac37-3b7e55017653 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:45.534664 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33056a0a-d601-4ed6-ac37-3b7e55017653 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:45.536116 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33056a0a-d601-4ed6-ac37-3b7e55017653 service cinder] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:45.546240 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3859/7731] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:40:45 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:40:52.308849 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baaccc8-b284-4708-824d-32f2a3ede4ac None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:52.309372 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baaccc8-b284-4708-824d-32f2a3ede4ac None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:52.309482 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baaccc8-b284-4708-824d-32f2a3ede4ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:52.327138 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-5baaccc8-b284-4708-824d-32f2a3ede4ac None None] MFA Rules not processed for user `cab5a299e003422286f01bd44fda92bc`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:40:52.328877 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-5baaccc8-b284-4708-824d-32f2a3ede4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:52.386720 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3873/7732] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:40:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:40:59.111688 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33056a0a-d601-4ed6-ac37-3b7e55017653 service cinder] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:59.114186 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-33056a0a-d601-4ed6-ac37-3b7e55017653 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:59.202627 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33056a0a-d601-4ed6-ac37-3b7e55017653 service cinder] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:59.208681 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a812e0-e70c-4ae0-86e8-3736dd49d89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:59.209571 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a812e0-e70c-4ae0-86e8-3736dd49d89e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:59.210017 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a812e0-e70c-4ae0-86e8-3736dd49d89e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:59.211580 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a812e0-e70c-4ae0-86e8-3736dd49d89e admin admin] PATH_INFO: `/v3/users/5745c928a98f441d9000ff599dfdc274` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:59.213049 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a812e0-e70c-4ae0-86e8-3736dd49d89e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5745c928a98f441d9000ff599dfdc274)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:59.215346 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a812e0-e70c-4ae0-86e8-3736dd49d89e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:59.429624 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e1a812e0-e70c-4ae0-86e8-3736dd49d89e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5745c928a98f441d9000ff599dfdc274'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:59.441304 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e1a812e0-e70c-4ae0-86e8-3736dd49d89e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5745c928a98f441d9000ff599dfdc274'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:59.442052 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e1a812e0-e70c-4ae0-86e8-3736dd49d89e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5745c928a98f441d9000ff599dfdc274'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:59.536071 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e1a812e0-e70c-4ae0-86e8-3736dd49d89e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5745c928a98f441d9000ff599dfdc274'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:59.552438 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e1a812e0-e70c-4ae0-86e8-3736dd49d89e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5745c928a98f441d9000ff599dfdc274'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:40:59.561415 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3860/7733] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:40:59 2022] DELETE /identity/v3/users/5745c928a98f441d9000ff599dfdc274 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:40:59.566105 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0928fa-39fd-4347-a737-1609e145e440 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:59.566570 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0928fa-39fd-4347-a737-1609e145e440 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:59.571093 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0928fa-39fd-4347-a737-1609e145e440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:59.599147 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-ea0928fa-39fd-4347-a737-1609e145e440 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:40:59.605594 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ea0928fa-39fd-4347-a737-1609e145e440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:59.715155 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3874/7734] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:40:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:40:59.724895 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a812e0-e70c-4ae0-86e8-3736dd49d89e admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:59.727225 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e1a812e0-e70c-4ae0-86e8-3736dd49d89e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:59.802149 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a812e0-e70c-4ae0-86e8-3736dd49d89e admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:59.807049 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac9da6-3224-44d4-a5ca-44129df1baf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:59.808110 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac9da6-3224-44d4-a5ca-44129df1baf7 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:59.808396 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac9da6-3224-44d4-a5ca-44129df1baf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:59.808721 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac9da6-3224-44d4-a5ca-44129df1baf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:59.819278 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ac9da6-3224-44d4-a5ca-44129df1baf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:59.820945 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ac9da6-3224-44d4-a5ca-44129df1baf7 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:40:59.841472 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3861/7735] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:40:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:40:59.884359 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0928fa-39fd-4347-a737-1609e145e440 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:40:59.885977 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ea0928fa-39fd-4347-a737-1609e145e440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:40:59.905928 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0928fa-39fd-4347-a737-1609e145e440 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:40:59.920463 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6138ea-1cee-4ca4-b39a-a649fcbd14ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:40:59.921660 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6138ea-1cee-4ca4-b39a-a649fcbd14ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:40:59.922228 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6138ea-1cee-4ca4-b39a-a649fcbd14ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:40:59.922733 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6138ea-1cee-4ca4-b39a-a649fcbd14ff admin admin] PATH_INFO: `/v3/users/69c5e3ab4e494335839ffd7afb2b9c52` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:40:59.925397 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6138ea-1cee-4ca4-b39a-a649fcbd14ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=69c5e3ab4e494335839ffd7afb2b9c52)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:40:59.927639 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6138ea-1cee-4ca4-b39a-a649fcbd14ff admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:00.249917 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-be6138ea-1cee-4ca4-b39a-a649fcbd14ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69c5e3ab4e494335839ffd7afb2b9c52'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:00.265516 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-be6138ea-1cee-4ca4-b39a-a649fcbd14ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69c5e3ab4e494335839ffd7afb2b9c52'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:00.274118 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-be6138ea-1cee-4ca4-b39a-a649fcbd14ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69c5e3ab4e494335839ffd7afb2b9c52'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:00.427183 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-be6138ea-1cee-4ca4-b39a-a649fcbd14ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69c5e3ab4e494335839ffd7afb2b9c52'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:00.428129 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-be6138ea-1cee-4ca4-b39a-a649fcbd14ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69c5e3ab4e494335839ffd7afb2b9c52'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:00.437729 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3875/7736] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:40:59 2022] DELETE /identity/v3/users/69c5e3ab4e494335839ffd7afb2b9c52 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:41:00.441842 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e1fae0-c034-43c4-83c6-31aab695be92 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:00.442315 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e1fae0-c034-43c4-83c6-31aab695be92 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:00.442603 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e1fae0-c034-43c4-83c6-31aab695be92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:00.464405 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-23e1fae0-c034-43c4-83c6-31aab695be92 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:41:00.466008 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-23e1fae0-c034-43c4-83c6-31aab695be92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:00.529228 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6138ea-1cee-4ca4-b39a-a649fcbd14ff admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:00.531507 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-be6138ea-1cee-4ca4-b39a-a649fcbd14ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:00.546225 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3862/7737] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:41:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:41:00.556668 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e1fae0-c034-43c4-83c6-31aab695be92 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:00.558218 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-23e1fae0-c034-43c4-83c6-31aab695be92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:00.623025 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6138ea-1cee-4ca4-b39a-a649fcbd14ff admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:00.629097 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217c76f-f733-4051-bcec-887114a69cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:00.629390 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e1fae0-c034-43c4-83c6-31aab695be92 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:00.629977 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217c76f-f733-4051-bcec-887114a69cf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:00.630266 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217c76f-f733-4051-bcec-887114a69cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:00.630578 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217c76f-f733-4051-bcec-887114a69cf7 admin admin] PATH_INFO: `/v3/projects/9ef324a7ffd642f08d0c23153a225daa` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:00.632237 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8217c76f-f733-4051-bcec-887114a69cf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ef324a7ffd642f08d0c23153a225daa)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:00.634414 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8217c76f-f733-4051-bcec-887114a69cf7 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:00.634938 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c17c050-9d30-4646-8ae7-5bc93a790690 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:00.635639 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17c050-9d30-4646-8ae7-5bc93a790690 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:00.635934 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17c050-9d30-4646-8ae7-5bc93a790690 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:00.636204 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17c050-9d30-4646-8ae7-5bc93a790690 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:00.651253 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c17c050-9d30-4646-8ae7-5bc93a790690 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:00.652677 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c17c050-9d30-4646-8ae7-5bc93a790690 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:00.667869 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3863/7738] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:41:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:41:00.733705 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8217c76f-f733-4051-bcec-887114a69cf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ef324a7ffd642f08d0c23153a225daa', 'request_id': 'req-8217c76f-f733-4051-bcec-887114a69cf7'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:00.739711 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8217c76f-f733-4051-bcec-887114a69cf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ef324a7ffd642f08d0c23153a225daa', 'request_id': 'req-8217c76f-f733-4051-bcec-887114a69cf7'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:00.815898 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8217c76f-f733-4051-bcec-887114a69cf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ef324a7ffd642f08d0c23153a225daa', 'request_id': 'req-8217c76f-f733-4051-bcec-887114a69cf7'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:00.829349 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8217c76f-f733-4051-bcec-887114a69cf7 admin admin] The token cache is being invalidate because project 9ef324a7ffd642f08d0c23153a225daa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:41:00.829698 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8217c76f-f733-4051-bcec-887114a69cf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:00.830395 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8217c76f-f733-4051-bcec-887114a69cf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:00.832079 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3876/7739] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:41:00 2022] DELETE /identity/v3/projects/9ef324a7ffd642f08d0c23153a225daa => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:41:00.837342 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbbcbcf-4f68-4885-86ad-a9598f99d275 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:00.837734 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbbcbcf-4f68-4885-86ad-a9598f99d275 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:00.838028 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbbcbcf-4f68-4885-86ad-a9598f99d275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:00.872035 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-7fbbcbcf-4f68-4885-86ad-a9598f99d275 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:41:00.873314 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-7fbbcbcf-4f68-4885-86ad-a9598f99d275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:00.955039 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3864/7740] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:41:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:41:00.959897 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08249b4-08b0-4d52-9754-68fb1e7f34b1 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:00.960433 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08249b4-08b0-4d52-9754-68fb1e7f34b1 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:00.960994 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08249b4-08b0-4d52-9754-68fb1e7f34b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:00.985477 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-b08249b4-08b0-4d52-9754-68fb1e7f34b1 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:41:00.987857 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b08249b4-08b0-4d52-9754-68fb1e7f34b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:00.997681 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3877/7741] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:41:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:41:01.004195 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbbcbcf-4f68-4885-86ad-a9598f99d275 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:01.019229 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbbcbcf-4f68-4885-86ad-a9598f99d275 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:01.026531 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aa7363-79e8-4ec4-89ed-f6852304670f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:01.029051 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa7363-79e8-4ec4-89ed-f6852304670f admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:01.029695 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa7363-79e8-4ec4-89ed-f6852304670f admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:01.030347 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa7363-79e8-4ec4-89ed-f6852304670f admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:01.032657 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aa7363-79e8-4ec4-89ed-f6852304670f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:41:01.033218 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aa7363-79e8-4ec4-89ed-f6852304670f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:01.036013 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aa7363-79e8-4ec4-89ed-f6852304670f admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:01.063551 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3865/7742] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:41:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:41:01.067588 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08249b4-08b0-4d52-9754-68fb1e7f34b1 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:01.079097 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08249b4-08b0-4d52-9754-68fb1e7f34b1 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:01.084289 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc44f061-2a3c-40c3-aeb4-5bc07c09f2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:01.085062 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc44f061-2a3c-40c3-aeb4-5bc07c09f2af admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:01.085242 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc44f061-2a3c-40c3-aeb4-5bc07c09f2af admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:01.085645 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc44f061-2a3c-40c3-aeb4-5bc07c09f2af admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:01.087114 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc44f061-2a3c-40c3-aeb4-5bc07c09f2af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:01.089211 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc44f061-2a3c-40c3-aeb4-5bc07c09f2af admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:01.190724 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aa7363-79e8-4ec4-89ed-f6852304670f admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:01.192707 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-99aa7363-79e8-4ec4-89ed-f6852304670f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:01.227430 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aa7363-79e8-4ec4-89ed-f6852304670f admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:01.229960 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3878/7743] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:41:01 2022] POST /identity/v3/projects => generated 373 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:41:01.234607 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc44f061-2a3c-40c3-aeb4-5bc07c09f2af admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:01.322320 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d1c57a-5c74-4861-a1b6-535d235820a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:01.323339 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1c57a-5c74-4861-a1b6-535d235820a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:01.323798 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1c57a-5c74-4861-a1b6-535d235820a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:01.324320 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1c57a-5c74-4861-a1b6-535d235820a8 admin admin] PATH_INFO: `/v3/projects/537c4ac112c846fcbbd4aa124542ab64` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:01.326287 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d1c57a-5c74-4861-a1b6-535d235820a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=537c4ac112c846fcbbd4aa124542ab64)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:01.329142 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d1c57a-5c74-4861-a1b6-535d235820a8 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:01.330668 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc44f061-2a3c-40c3-aeb4-5bc07c09f2af admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:01.336863 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57981039-5950-4a87-a879-b1770fa721fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:01.337565 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57981039-5950-4a87-a879-b1770fa721fa admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:01.337902 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57981039-5950-4a87-a879-b1770fa721fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:01.338200 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57981039-5950-4a87-a879-b1770fa721fa admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:01.338883 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57981039-5950-4a87-a879-b1770fa721fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:01.341084 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57981039-5950-4a87-a879-b1770fa721fa admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:01.407526 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3879/7744] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:41:01 2022] POST /identity/v3/users => generated 287 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:41:01.410800 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57981039-5950-4a87-a879-b1770fa721fa admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:01.428432 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57981039-5950-4a87-a879-b1770fa721fa admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:01.428432 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d53f75f-7a62-4d2e-8e60-a737252b624f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:01.428432 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53f75f-7a62-4d2e-8e60-a737252b624f admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:01.428432 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53f75f-7a62-4d2e-8e60-a737252b624f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:01.428882 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53f75f-7a62-4d2e-8e60-a737252b624f admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:01.429370 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d53f75f-7a62-4d2e-8e60-a737252b624f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:01.431713 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d53f75f-7a62-4d2e-8e60-a737252b624f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:01.444930 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3880/7745] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:41:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:41:01.446341 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d53f75f-7a62-4d2e-8e60-a737252b624f admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:01.460680 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d53f75f-7a62-4d2e-8e60-a737252b624f admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:01.466702 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dfd6da-cc65-44d1-917b-14e03baf5122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:01.467403 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dfd6da-cc65-44d1-917b-14e03baf5122 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:01.467922 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dfd6da-cc65-44d1-917b-14e03baf5122 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:01.468148 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dfd6da-cc65-44d1-917b-14e03baf5122 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:01.468929 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dfd6da-cc65-44d1-917b-14e03baf5122 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:01.476736 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dfd6da-cc65-44d1-917b-14e03baf5122 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:01.503054 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3881/7746] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:41:01 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:41:01.504482 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dfd6da-cc65-44d1-917b-14e03baf5122 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:01.513133 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c1d1c57a-5c74-4861-a1b6-535d235820a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '537c4ac112c846fcbbd4aa124542ab64', 'request_id': 'req-c1d1c57a-5c74-4861-a1b6-535d235820a8'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:01.521029 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c1d1c57a-5c74-4861-a1b6-535d235820a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '537c4ac112c846fcbbd4aa124542ab64', 'request_id': 'req-c1d1c57a-5c74-4861-a1b6-535d235820a8'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:01.523040 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dfd6da-cc65-44d1-917b-14e03baf5122 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:01.529814 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c1d1c57a-5c74-4861-a1b6-535d235820a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '537c4ac112c846fcbbd4aa124542ab64', 'request_id': 'req-c1d1c57a-5c74-4861-a1b6-535d235820a8'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:01.598552 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312d630f-1687-4b0a-948e-d3ca9e2c399b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:01.599511 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d630f-1687-4b0a-948e-d3ca9e2c399b admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:01.599814 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d630f-1687-4b0a-948e-d3ca9e2c399b admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:01.600090 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d630f-1687-4b0a-948e-d3ca9e2c399b admin admin] PATH_INFO: `/v3/projects/5f29dab7e48a4a9bba08ffffacbe5c8a/users/b61e5fd331864e21b5c6aa52dde37bec/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:01.618452 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c1d1c57a-5c74-4861-a1b6-535d235820a8 admin admin] The token cache is being invalidate because project 537c4ac112c846fcbbd4aa124542ab64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:41:01.618588 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312d630f-1687-4b0a-948e-d3ca9e2c399b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f29dab7e48a4a9bba08ffffacbe5c8a, user_id=b61e5fd331864e21b5c6aa52dde37bec, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:01.618746 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c1d1c57a-5c74-4861-a1b6-535d235820a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:01.619620 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c1d1c57a-5c74-4861-a1b6-535d235820a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:01.629076 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312d630f-1687-4b0a-948e-d3ca9e2c399b admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:01.629584 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3866/7747] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:41:01 2022] DELETE /identity/v3/projects/537c4ac112c846fcbbd4aa124542ab64 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:41:01.633790 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679bd84a-0a7a-458c-9e14-bddf4eaab919 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:01.634426 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679bd84a-0a7a-458c-9e14-bddf4eaab919 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:01.635665 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679bd84a-0a7a-458c-9e14-bddf4eaab919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:01.659206 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-679bd84a-0a7a-458c-9e14-bddf4eaab919 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:41:01.660582 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-679bd84a-0a7a-458c-9e14-bddf4eaab919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:01.670474 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3867/7748] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:41:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:41:01.678625 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d45dc-4660-4f5b-bd9e-802844079a18 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:01.679121 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d45dc-4660-4f5b-bd9e-802844079a18 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:01.679625 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d45dc-4660-4f5b-bd9e-802844079a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:01.699524 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-b66d45dc-4660-4f5b-bd9e-802844079a18 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:41:01.701024 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b66d45dc-4660-4f5b-bd9e-802844079a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:01.710116 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3868/7749] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:41:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:41:01.716425 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d45dc-4660-4f5b-bd9e-802844079a18 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:01.732487 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d45dc-4660-4f5b-bd9e-802844079a18 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:01.742220 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3882/7750] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:41:01 2022] PUT /identity/v3/projects/5f29dab7e48a4a9bba08ffffacbe5c8a/users/b61e5fd331864e21b5c6aa52dde37bec/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:41:01.746568 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c5a4b4-6ea7-49e6-8e5a-b67942a86f72 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:01.746568 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c5a4b4-6ea7-49e6-8e5a-b67942a86f72 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:01.746568 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c5a4b4-6ea7-49e6-8e5a-b67942a86f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:01.787201 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-89c5a4b4-6ea7-49e6-8e5a-b67942a86f72 None None] MFA Rules not processed for user `b61e5fd331864e21b5c6aa52dde37bec`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:41:01.788468 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-89c5a4b4-6ea7-49e6-8e5a-b67942a86f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:01.821099 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f789cd1e-21d7-4438-b2f9-669b82c4e1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:01.822046 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789cd1e-21d7-4438-b2f9-669b82c4e1b2 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:01.822330 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789cd1e-21d7-4438-b2f9-669b82c4e1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:01.822603 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789cd1e-21d7-4438-b2f9-669b82c4e1b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:01.823322 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f789cd1e-21d7-4438-b2f9-669b82c4e1b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:41:01.823659 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f789cd1e-21d7-4438-b2f9-669b82c4e1b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:01.825349 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f789cd1e-21d7-4438-b2f9-669b82c4e1b2 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:01.838416 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3869/7751] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:41:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:41:01.843611 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f789cd1e-21d7-4438-b2f9-669b82c4e1b2 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:01.857723 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f789cd1e-21d7-4438-b2f9-669b82c4e1b2 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:01.863901 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d82cd66-b602-4cba-99f5-0659664aba9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:01.864704 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82cd66-b602-4cba-99f5-0659664aba9e admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:01.865130 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82cd66-b602-4cba-99f5-0659664aba9e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:01.865569 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82cd66-b602-4cba-99f5-0659664aba9e admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:01.866350 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d82cd66-b602-4cba-99f5-0659664aba9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:01.868922 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d82cd66-b602-4cba-99f5-0659664aba9e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:01.929522 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3883/7752] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:41:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:41:01.945368 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c5a4b4-6ea7-49e6-8e5a-b67942a86f72 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:01.947371 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-89c5a4b4-6ea7-49e6-8e5a-b67942a86f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:01.994004 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3870/7753] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:41:01 2022] POST /identity/v3/projects => generated 397 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:41:01.995508 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d82cd66-b602-4cba-99f5-0659664aba9e admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:02.055169 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c5a4b4-6ea7-49e6-8e5a-b67942a86f72 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:02.120793 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d82cd66-b602-4cba-99f5-0659664aba9e admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:02.126792 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa19bb-3a70-41ec-8f7f-d802eebd75cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198271d1c0d44cb58bace41a65f4b94c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:02.127628 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa19bb-3a70-41ec-8f7f-d802eebd75cc service cinder] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:02.128071 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa19bb-3a70-41ec-8f7f-d802eebd75cc service cinder] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:02.130758 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa19bb-3a70-41ec-8f7f-d802eebd75cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:02.137278 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12475416-de06-4c49-8b33-c977141f04a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:02.138054 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12475416-de06-4c49-8b33-c977141f04a6 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:02.138321 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12475416-de06-4c49-8b33-c977141f04a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:02.138601 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12475416-de06-4c49-8b33-c977141f04a6 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:02.139319 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12475416-de06-4c49-8b33-c977141f04a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:02.141324 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12475416-de06-4c49-8b33-c977141f04a6 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:02.258822 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3871/7754] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:41:01 2022] POST /identity/v3/users => generated 299 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:41:02.263295 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aa19bb-3a70-41ec-8f7f-d802eebd75cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:02.264355 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12475416-de06-4c49-8b33-c977141f04a6 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:02.264957 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aa19bb-3a70-41ec-8f7f-d802eebd75cc service cinder] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:02.281394 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3884/7755] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:41:01 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:41:02.283715 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12475416-de06-4c49-8b33-c977141f04a6 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:02.291401 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40047d5a-f54b-4bb7-9bff-f75e4192926b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:02.292283 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40047d5a-f54b-4bb7-9bff-f75e4192926b admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:02.292568 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40047d5a-f54b-4bb7-9bff-f75e4192926b admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:02.292842 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40047d5a-f54b-4bb7-9bff-f75e4192926b admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:02.293569 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40047d5a-f54b-4bb7-9bff-f75e4192926b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:02.295246 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40047d5a-f54b-4bb7-9bff-f75e4192926b admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:02.315067 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3872/7756] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:41:02 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:41:02.319080 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa19bb-3a70-41ec-8f7f-d802eebd75cc service cinder] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:02.331288 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa19bb-3a70-41ec-8f7f-d802eebd75cc service cinder] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:02.338704 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b271eaf-a543-4366-95c6-479cd22eb9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:02.339539 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b271eaf-a543-4366-95c6-479cd22eb9d4 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:02.339833 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b271eaf-a543-4366-95c6-479cd22eb9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:02.340251 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b271eaf-a543-4366-95c6-479cd22eb9d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:02.341046 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b271eaf-a543-4366-95c6-479cd22eb9d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:02.342811 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b271eaf-a543-4366-95c6-479cd22eb9d4 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:02.358608 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3885/7757] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:41:02 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:41:02.359823 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40047d5a-f54b-4bb7-9bff-f75e4192926b admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:02.373610 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40047d5a-f54b-4bb7-9bff-f75e4192926b admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:02.380380 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d3c007-2603-4482-86ce-54f4d1ce2347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:02.382343 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3c007-2603-4482-86ce-54f4d1ce2347 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:02.383393 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3c007-2603-4482-86ce-54f4d1ce2347 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:02.384808 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3c007-2603-4482-86ce-54f4d1ce2347 admin admin] PATH_INFO: `/v3/projects/c4f2af00e6df44ca8d789add57208278/users/836726f056a74d80ab7a04cb60268d9d/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:02.406211 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d3c007-2603-4482-86ce-54f4d1ce2347 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4f2af00e6df44ca8d789add57208278, user_id=836726f056a74d80ab7a04cb60268d9d, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:02.409583 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d3c007-2603-4482-86ce-54f4d1ce2347 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:02.500429 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3873/7758] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:41:02 2022] PUT /identity/v3/projects/c4f2af00e6df44ca8d789add57208278/users/836726f056a74d80ab7a04cb60268d9d/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:41:02.512782 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb7b511-9820-489c-b1a4-6d54a9ca5bce None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:02.513054 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb7b511-9820-489c-b1a4-6d54a9ca5bce None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:02.513334 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb7b511-9820-489c-b1a4-6d54a9ca5bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:02.546313 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-1bb7b511-9820-489c-b1a4-6d54a9ca5bce None None] MFA Rules not processed for user `836726f056a74d80ab7a04cb60268d9d`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:41:02.560513 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-1bb7b511-9820-489c-b1a4-6d54a9ca5bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:02.615505 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3886/7759] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:41:02 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:41:02.680561 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d3c007-2603-4482-86ce-54f4d1ce2347 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:02.680561 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-99d3c007-2603-4482-86ce-54f4d1ce2347 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:02.739966 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d3c007-2603-4482-86ce-54f4d1ce2347 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:02.744502 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a564ca-fe86-40d6-b2d0-e815b0238d12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198271d1c0d44cb58bace41a65f4b94c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:02.745153 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a564ca-fe86-40d6-b2d0-e815b0238d12 service cinder] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:02.745436 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a564ca-fe86-40d6-b2d0-e815b0238d12 service cinder] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:02.745713 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a564ca-fe86-40d6-b2d0-e815b0238d12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:02.754287 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a564ca-fe86-40d6-b2d0-e815b0238d12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:02.755787 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a564ca-fe86-40d6-b2d0-e815b0238d12 service cinder] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:02.769294 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3874/7760] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:41:02 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:41:05.298823 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe5f97-c8b6-4b21-bfcf-a2cc81e0c3b6 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:05.299378 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe5f97-c8b6-4b21-bfcf-a2cc81e0c3b6 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:05.299650 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe5f97-c8b6-4b21-bfcf-a2cc81e0c3b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:05.318719 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-dbfe5f97-c8b6-4b21-bfcf-a2cc81e0c3b6 None None] MFA Rules not processed for user `b61e5fd331864e21b5c6aa52dde37bec`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:41:05.319967 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-dbfe5f97-c8b6-4b21-bfcf-a2cc81e0c3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:05.414922 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3887/7761] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:41:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:41:07.514106 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a564ca-fe86-40d6-b2d0-e815b0238d12 service cinder] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:07.515793 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-35a564ca-fe86-40d6-b2d0-e815b0238d12 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:07.621797 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a564ca-fe86-40d6-b2d0-e815b0238d12 service cinder] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:07.629014 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65175807-49de-4e76-a0a8-ba591b2d2b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:07.630284 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65175807-49de-4e76-a0a8-ba591b2d2b9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:07.630727 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65175807-49de-4e76-a0a8-ba591b2d2b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:07.633889 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65175807-49de-4e76-a0a8-ba591b2d2b9f admin admin] PATH_INFO: `/v3/users/e8c801f66f3e403cac2618dfeb7be51c` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:07.633889 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65175807-49de-4e76-a0a8-ba591b2d2b9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8c801f66f3e403cac2618dfeb7be51c)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:07.636351 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65175807-49de-4e76-a0a8-ba591b2d2b9f admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:07.963964 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-65175807-49de-4e76-a0a8-ba591b2d2b9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8c801f66f3e403cac2618dfeb7be51c'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:07.976030 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-65175807-49de-4e76-a0a8-ba591b2d2b9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8c801f66f3e403cac2618dfeb7be51c'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:07.977666 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-65175807-49de-4e76-a0a8-ba591b2d2b9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8c801f66f3e403cac2618dfeb7be51c'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:08.068621 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-65175807-49de-4e76-a0a8-ba591b2d2b9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8c801f66f3e403cac2618dfeb7be51c'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:08.103809 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-65175807-49de-4e76-a0a8-ba591b2d2b9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8c801f66f3e403cac2618dfeb7be51c'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:08.121596 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3875/7762] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:41:07 2022] DELETE /identity/v3/users/e8c801f66f3e403cac2618dfeb7be51c => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:41:08.125994 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e03c60e-6a73-464b-82c2-8e6815594ebd None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:08.126494 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e03c60e-6a73-464b-82c2-8e6815594ebd None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:08.126833 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e03c60e-6a73-464b-82c2-8e6815594ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:08.150231 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-9e03c60e-6a73-464b-82c2-8e6815594ebd None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:41:08.151695 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-9e03c60e-6a73-464b-82c2-8e6815594ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:08.231071 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3888/7763] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:41:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:41:08.247512 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65175807-49de-4e76-a0a8-ba591b2d2b9f admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:08.249088 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-65175807-49de-4e76-a0a8-ba591b2d2b9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:08.321072 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65175807-49de-4e76-a0a8-ba591b2d2b9f admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:08.325061 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cf5dfc-980a-4630-8a84-885b449ac721 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:08.325714 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf5dfc-980a-4630-8a84-885b449ac721 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:08.325999 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf5dfc-980a-4630-8a84-885b449ac721 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:08.326275 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf5dfc-980a-4630-8a84-885b449ac721 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:08.336656 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cf5dfc-980a-4630-8a84-885b449ac721 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:08.338092 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cf5dfc-980a-4630-8a84-885b449ac721 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:08.348201 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3876/7764] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:41:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:41:09.614819 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e03c60e-6a73-464b-82c2-8e6815594ebd None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:09.617540 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-9e03c60e-6a73-464b-82c2-8e6815594ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:09.644653 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e03c60e-6a73-464b-82c2-8e6815594ebd None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:09.661597 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f5b8e9-796d-42a7-946e-fa3138f3d0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:09.662937 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f5b8e9-796d-42a7-946e-fa3138f3d0b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:09.663375 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f5b8e9-796d-42a7-946e-fa3138f3d0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:09.663773 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f5b8e9-796d-42a7-946e-fa3138f3d0b4 admin admin] PATH_INFO: `/v3/projects/f9c0542095f84f98a91c9df1925426f4` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:09.666113 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f5b8e9-796d-42a7-946e-fa3138f3d0b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9c0542095f84f98a91c9df1925426f4)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:09.668206 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f5b8e9-796d-42a7-946e-fa3138f3d0b4 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:09.820447 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b8f5b8e9-796d-42a7-946e-fa3138f3d0b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9c0542095f84f98a91c9df1925426f4', 'request_id': 'req-b8f5b8e9-796d-42a7-946e-fa3138f3d0b4'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:09.828799 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b8f5b8e9-796d-42a7-946e-fa3138f3d0b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9c0542095f84f98a91c9df1925426f4', 'request_id': 'req-b8f5b8e9-796d-42a7-946e-fa3138f3d0b4'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:09.968075 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b8f5b8e9-796d-42a7-946e-fa3138f3d0b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9c0542095f84f98a91c9df1925426f4', 'request_id': 'req-b8f5b8e9-796d-42a7-946e-fa3138f3d0b4'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:09.984570 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b8f5b8e9-796d-42a7-946e-fa3138f3d0b4 admin admin] The token cache is being invalidate because project f9c0542095f84f98a91c9df1925426f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:41:09.984870 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b8f5b8e9-796d-42a7-946e-fa3138f3d0b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:09.985642 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b8f5b8e9-796d-42a7-946e-fa3138f3d0b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:09.988613 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3889/7765] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:41:09 2022] DELETE /identity/v3/projects/f9c0542095f84f98a91c9df1925426f4 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:41:16.274509 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cf5dfc-980a-4630-8a84-885b449ac721 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:16.276005 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-32cf5dfc-980a-4630-8a84-885b449ac721 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:16.290725 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cf5dfc-980a-4630-8a84-885b449ac721 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:16.346120 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe4e251-1526-4fa2-b062-6c622c8053ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:16.346988 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe4e251-1526-4fa2-b062-6c622c8053ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:16.347271 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe4e251-1526-4fa2-b062-6c622c8053ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:16.347590 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe4e251-1526-4fa2-b062-6c622c8053ae admin admin] PATH_INFO: `/v3/users/28a1a13b27444ee8b351cc068b1c1938` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:16.348811 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe4e251-1526-4fa2-b062-6c622c8053ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=28a1a13b27444ee8b351cc068b1c1938)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:16.350777 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe4e251-1526-4fa2-b062-6c622c8053ae admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:16.566353 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-efe4e251-1526-4fa2-b062-6c622c8053ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28a1a13b27444ee8b351cc068b1c1938'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:16.573353 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-efe4e251-1526-4fa2-b062-6c622c8053ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28a1a13b27444ee8b351cc068b1c1938'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:16.574092 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-efe4e251-1526-4fa2-b062-6c622c8053ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28a1a13b27444ee8b351cc068b1c1938'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:16.655114 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-efe4e251-1526-4fa2-b062-6c622c8053ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28a1a13b27444ee8b351cc068b1c1938'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:16.668067 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-efe4e251-1526-4fa2-b062-6c622c8053ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28a1a13b27444ee8b351cc068b1c1938'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:16.674005 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3877/7766] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:41:16 2022] DELETE /identity/v3/users/28a1a13b27444ee8b351cc068b1c1938 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:41:16.679047 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558cc721-7cfe-4c16-9ac8-8ce86bbb683f None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:16.679548 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558cc721-7cfe-4c16-9ac8-8ce86bbb683f None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:16.679643 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558cc721-7cfe-4c16-9ac8-8ce86bbb683f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:16.698493 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-558cc721-7cfe-4c16-9ac8-8ce86bbb683f None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:41:16.699716 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-558cc721-7cfe-4c16-9ac8-8ce86bbb683f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:16.763311 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3890/7767] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:41:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:41:16.773424 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe4e251-1526-4fa2-b062-6c622c8053ae admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:16.775117 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-efe4e251-1526-4fa2-b062-6c622c8053ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:16.836549 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe4e251-1526-4fa2-b062-6c622c8053ae admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:16.840410 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c75386-96dd-431d-82fb-5adb30459f84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:16.841118 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c75386-96dd-431d-82fb-5adb30459f84 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:16.841404 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c75386-96dd-431d-82fb-5adb30459f84 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:16.841677 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c75386-96dd-431d-82fb-5adb30459f84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:16.851002 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c75386-96dd-431d-82fb-5adb30459f84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:16.853187 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c75386-96dd-431d-82fb-5adb30459f84 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:16.863246 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3878/7768] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:41:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:41:17.131275 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558cc721-7cfe-4c16-9ac8-8ce86bbb683f None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:17.132824 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-558cc721-7cfe-4c16-9ac8-8ce86bbb683f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:17.145687 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558cc721-7cfe-4c16-9ac8-8ce86bbb683f None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:17.151823 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331ff63f-8558-4c67-8395-74f6063d53de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:17.152746 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ff63f-8558-4c67-8395-74f6063d53de admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:17.153027 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ff63f-8558-4c67-8395-74f6063d53de admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:17.153300 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ff63f-8558-4c67-8395-74f6063d53de admin admin] PATH_INFO: `/v3/projects/f48b39c4a8ed40fabb1b35f02c8ba40a` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:17.154499 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331ff63f-8558-4c67-8395-74f6063d53de admin admin] RBAC: Authorizing `identity:delete_project(project_id=f48b39c4a8ed40fabb1b35f02c8ba40a)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:17.160300 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331ff63f-8558-4c67-8395-74f6063d53de admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:17.296222 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-331ff63f-8558-4c67-8395-74f6063d53de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f48b39c4a8ed40fabb1b35f02c8ba40a', 'request_id': 'req-331ff63f-8558-4c67-8395-74f6063d53de'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:17.302243 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-331ff63f-8558-4c67-8395-74f6063d53de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f48b39c4a8ed40fabb1b35f02c8ba40a', 'request_id': 'req-331ff63f-8558-4c67-8395-74f6063d53de'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:17.404494 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-331ff63f-8558-4c67-8395-74f6063d53de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f48b39c4a8ed40fabb1b35f02c8ba40a', 'request_id': 'req-331ff63f-8558-4c67-8395-74f6063d53de'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:17.418849 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-331ff63f-8558-4c67-8395-74f6063d53de admin admin] The token cache is being invalidate because project f48b39c4a8ed40fabb1b35f02c8ba40a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:41:17.419143 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-331ff63f-8558-4c67-8395-74f6063d53de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:17.419937 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-331ff63f-8558-4c67-8395-74f6063d53de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:17.421522 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3891/7769] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:41:17 2022] DELETE /identity/v3/projects/f48b39c4a8ed40fabb1b35f02c8ba40a => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:41:17.426686 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece586bd-ea16-4e21-87fa-97f3679a74fd None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:17.427184 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece586bd-ea16-4e21-87fa-97f3679a74fd None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:17.431176 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece586bd-ea16-4e21-87fa-97f3679a74fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:17.453234 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-ece586bd-ea16-4e21-87fa-97f3679a74fd None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:41:17.453234 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-ece586bd-ea16-4e21-87fa-97f3679a74fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:17.521969 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3879/7770] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:41:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:41:17.523877 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e851e-4d6f-49be-90be-487d908ec970 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:17.525219 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e851e-4d6f-49be-90be-487d908ec970 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:17.525698 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e851e-4d6f-49be-90be-487d908ec970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:17.545193 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-fb5e851e-4d6f-49be-90be-487d908ec970 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:41:17.546517 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-fb5e851e-4d6f-49be-90be-487d908ec970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:17.558954 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3892/7771] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:41:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:41:17.561858 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece586bd-ea16-4e21-87fa-97f3679a74fd None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:17.570901 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece586bd-ea16-4e21-87fa-97f3679a74fd None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:17.576459 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb60dc2-1e78-44de-aabf-4d0f94152aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:17.577129 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb60dc2-1e78-44de-aabf-4d0f94152aab admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:17.577420 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb60dc2-1e78-44de-aabf-4d0f94152aab admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:17.577716 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb60dc2-1e78-44de-aabf-4d0f94152aab admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:17.578446 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb60dc2-1e78-44de-aabf-4d0f94152aab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:41:17.578757 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb60dc2-1e78-44de-aabf-4d0f94152aab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:17.580404 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb60dc2-1e78-44de-aabf-4d0f94152aab admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:17.592652 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3880/7772] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:41:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:41:17.597198 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5e851e-4d6f-49be-90be-487d908ec970 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:17.607988 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5e851e-4d6f-49be-90be-487d908ec970 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:17.618887 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d8982-c860-4f56-bec1-c43aff737c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:17.619597 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d8982-c860-4f56-bec1-c43aff737c31 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:17.619951 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d8982-c860-4f56-bec1-c43aff737c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:17.620232 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d8982-c860-4f56-bec1-c43aff737c31 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:17.620934 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81d8982-c860-4f56-bec1-c43aff737c31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:17.622854 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81d8982-c860-4f56-bec1-c43aff737c31 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:17.742237 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3893/7773] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:41:17 2022] POST /identity/v3/projects => generated 377 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:41:17.743323 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb60dc2-1e78-44de-aabf-4d0f94152aab admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:17.753294 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb60dc2-1e78-44de-aabf-4d0f94152aab admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:17.810019 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8447847e-3a99-4c4b-89ef-d690ca5704e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:17.810680 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8447847e-3a99-4c4b-89ef-d690ca5704e7 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:17.810963 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8447847e-3a99-4c4b-89ef-d690ca5704e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:17.811234 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8447847e-3a99-4c4b-89ef-d690ca5704e7 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:17.812004 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8447847e-3a99-4c4b-89ef-d690ca5704e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:17.813956 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8447847e-3a99-4c4b-89ef-d690ca5704e7 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:17.919761 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3881/7774] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:41:17 2022] POST /identity/v3/users => generated 289 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:41:17.921449 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d8982-c860-4f56-bec1-c43aff737c31 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:17.933115 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d8982-c860-4f56-bec1-c43aff737c31 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:17.938401 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663ac6af-7211-4f06-8eac-72bf9f02e572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:17.939210 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ac6af-7211-4f06-8eac-72bf9f02e572 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:17.939518 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ac6af-7211-4f06-8eac-72bf9f02e572 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:17.939814 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ac6af-7211-4f06-8eac-72bf9f02e572 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:17.940596 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663ac6af-7211-4f06-8eac-72bf9f02e572 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:17.942223 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663ac6af-7211-4f06-8eac-72bf9f02e572 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:17.954901 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3894/7775] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:41:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:41:17.958021 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8447847e-3a99-4c4b-89ef-d690ca5704e7 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:17.970600 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8447847e-3a99-4c4b-89ef-d690ca5704e7 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:17.976313 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe112d-7a80-4351-a4ea-96c1fc519af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:17.977092 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe112d-7a80-4351-a4ea-96c1fc519af0 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:17.978143 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe112d-7a80-4351-a4ea-96c1fc519af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:17.978654 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe112d-7a80-4351-a4ea-96c1fc519af0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:17.979526 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffe112d-7a80-4351-a4ea-96c1fc519af0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:17.981211 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffe112d-7a80-4351-a4ea-96c1fc519af0 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:17.998424 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3882/7776] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:41:17 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:41:17.998545 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663ac6af-7211-4f06-8eac-72bf9f02e572 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:18.008424 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663ac6af-7211-4f06-8eac-72bf9f02e572 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:18.014149 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d3823a-82a2-480b-b3c2-1f7cc405f394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:18.015078 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3823a-82a2-480b-b3c2-1f7cc405f394 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:18.021216 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3823a-82a2-480b-b3c2-1f7cc405f394 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:18.021216 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3823a-82a2-480b-b3c2-1f7cc405f394 admin admin] PATH_INFO: `/v3/projects/d9b3a6ae879b49f78c0a843d27856796/users/8ba91edb19ff44749b3a1dc6dcb73e2f/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:18.031787 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d3823a-82a2-480b-b3c2-1f7cc405f394 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9b3a6ae879b49f78c0a843d27856796, user_id=8ba91edb19ff44749b3a1dc6dcb73e2f, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:18.034484 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d3823a-82a2-480b-b3c2-1f7cc405f394 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:18.130203 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3895/7777] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:41:17 2022] PUT /identity/v3/projects/d9b3a6ae879b49f78c0a843d27856796/users/8ba91edb19ff44749b3a1dc6dcb73e2f/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:41:18.141095 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf5b45-93ba-4a1b-b38d-2ca9a67913f7 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:18.141385 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf5b45-93ba-4a1b-b38d-2ca9a67913f7 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:18.141665 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf5b45-93ba-4a1b-b38d-2ca9a67913f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:18.170138 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-1fdf5b45-93ba-4a1b-b38d-2ca9a67913f7 None None] MFA Rules not processed for user `8ba91edb19ff44749b3a1dc6dcb73e2f`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:41:18.171347 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-1fdf5b45-93ba-4a1b-b38d-2ca9a67913f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:18.235373 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3883/7778] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:41:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:41:18.246186 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d3823a-82a2-480b-b3c2-1f7cc405f394 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:18.247956 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-32d3823a-82a2-480b-b3c2-1f7cc405f394 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:18.322045 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d3823a-82a2-480b-b3c2-1f7cc405f394 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:18.326602 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96acd37-bc3f-4662-b19c-c8585a91d8ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:18.327259 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96acd37-bc3f-4662-b19c-c8585a91d8ab service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:18.327579 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96acd37-bc3f-4662-b19c-c8585a91d8ab service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:18.328007 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96acd37-bc3f-4662-b19c-c8585a91d8ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:18.337222 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96acd37-bc3f-4662-b19c-c8585a91d8ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:18.338743 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96acd37-bc3f-4662-b19c-c8585a91d8ab service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:18.348070 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3896/7779] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:41:18 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:41:22.846361 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdf5b45-93ba-4a1b-b38d-2ca9a67913f7 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:22.847977 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-1fdf5b45-93ba-4a1b-b38d-2ca9a67913f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:22.920669 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdf5b45-93ba-4a1b-b38d-2ca9a67913f7 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:22.926558 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2175f921-8486-48b4-877f-305e1a004346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:22.927441 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2175f921-8486-48b4-877f-305e1a004346 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:22.927825 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2175f921-8486-48b4-877f-305e1a004346 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:22.928103 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2175f921-8486-48b4-877f-305e1a004346 admin admin] PATH_INFO: `/v3/users/1b8033dfa10f4a638f4136ed3449eea0` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:22.929512 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2175f921-8486-48b4-877f-305e1a004346 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b8033dfa10f4a638f4136ed3449eea0)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:22.931691 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2175f921-8486-48b4-877f-305e1a004346 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:23.223882 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-2175f921-8486-48b4-877f-305e1a004346 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b8033dfa10f4a638f4136ed3449eea0'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:23.233760 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-2175f921-8486-48b4-877f-305e1a004346 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b8033dfa10f4a638f4136ed3449eea0'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:23.235185 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-2175f921-8486-48b4-877f-305e1a004346 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b8033dfa10f4a638f4136ed3449eea0'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:23.295624 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-2175f921-8486-48b4-877f-305e1a004346 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b8033dfa10f4a638f4136ed3449eea0'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:23.308700 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-2175f921-8486-48b4-877f-305e1a004346 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b8033dfa10f4a638f4136ed3449eea0'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:23.314805 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3884/7780] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:41:22 2022] DELETE /identity/v3/users/1b8033dfa10f4a638f4136ed3449eea0 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:41:23.319592 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc5fab-e80c-4acb-99bd-dc105568e051 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:23.320114 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc5fab-e80c-4acb-99bd-dc105568e051 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:23.320241 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc5fab-e80c-4acb-99bd-dc105568e051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:23.340819 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-d9dc5fab-e80c-4acb-99bd-dc105568e051 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:41:23.342325 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d9dc5fab-e80c-4acb-99bd-dc105568e051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:23.436843 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3897/7781] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:41:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:41:23.448202 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2175f921-8486-48b4-877f-305e1a004346 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:23.449759 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-2175f921-8486-48b4-877f-305e1a004346 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:23.527941 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2175f921-8486-48b4-877f-305e1a004346 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:23.532245 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67288a94-01d9-417a-bcc9-70fea2e9849c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:23.532912 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67288a94-01d9-417a-bcc9-70fea2e9849c service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:23.539439 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67288a94-01d9-417a-bcc9-70fea2e9849c service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:23.539439 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67288a94-01d9-417a-bcc9-70fea2e9849c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:23.549380 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67288a94-01d9-417a-bcc9-70fea2e9849c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:23.551446 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67288a94-01d9-417a-bcc9-70fea2e9849c service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:23.564983 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3885/7782] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:41:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:41:24.312635 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dc5fab-e80c-4acb-99bd-dc105568e051 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:24.315316 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d9dc5fab-e80c-4acb-99bd-dc105568e051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:24.341871 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dc5fab-e80c-4acb-99bd-dc105568e051 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:24.354811 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce847d-d413-4f97-851b-dc67ce0acc35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:24.366727 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce847d-d413-4f97-851b-dc67ce0acc35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:24.369030 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce847d-d413-4f97-851b-dc67ce0acc35 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:24.372740 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce847d-d413-4f97-851b-dc67ce0acc35 admin admin] PATH_INFO: `/v3/projects/eaa012bd5cf0437f9a1d0a524871726f` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:24.374184 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ce847d-d413-4f97-851b-dc67ce0acc35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eaa012bd5cf0437f9a1d0a524871726f)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:24.376541 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ce847d-d413-4f97-851b-dc67ce0acc35 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:24.601761 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f4ce847d-d413-4f97-851b-dc67ce0acc35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eaa012bd5cf0437f9a1d0a524871726f', 'request_id': 'req-f4ce847d-d413-4f97-851b-dc67ce0acc35'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:24.609765 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f4ce847d-d413-4f97-851b-dc67ce0acc35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eaa012bd5cf0437f9a1d0a524871726f', 'request_id': 'req-f4ce847d-d413-4f97-851b-dc67ce0acc35'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:24.682758 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f4ce847d-d413-4f97-851b-dc67ce0acc35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eaa012bd5cf0437f9a1d0a524871726f', 'request_id': 'req-f4ce847d-d413-4f97-851b-dc67ce0acc35'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:24.698207 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f4ce847d-d413-4f97-851b-dc67ce0acc35 admin admin] The token cache is being invalidate because project eaa012bd5cf0437f9a1d0a524871726f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:41:24.698535 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f4ce847d-d413-4f97-851b-dc67ce0acc35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:24.699980 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f4ce847d-d413-4f97-851b-dc67ce0acc35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:24.702427 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3898/7783] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:41:24 2022] DELETE /identity/v3/projects/eaa012bd5cf0437f9a1d0a524871726f => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:41:24.707690 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb299684-914d-41d9-8916-41632279f1cc None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:24.708199 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb299684-914d-41d9-8916-41632279f1cc None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:24.708294 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb299684-914d-41d9-8916-41632279f1cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:24.728265 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-cb299684-914d-41d9-8916-41632279f1cc None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:41:24.729777 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-cb299684-914d-41d9-8916-41632279f1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:24.801422 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3886/7784] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:41:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:41:24.810227 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ba301-de8c-4e89-8571-7a6cce41ba6c None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:24.810601 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ba301-de8c-4e89-8571-7a6cce41ba6c None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:24.810966 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ba301-de8c-4e89-8571-7a6cce41ba6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:24.830552 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-436ba301-de8c-4e89-8571-7a6cce41ba6c None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:41:24.831891 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-436ba301-de8c-4e89-8571-7a6cce41ba6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:24.840255 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3899/7785] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:41:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:41:24.856392 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb299684-914d-41d9-8916-41632279f1cc None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:24.868352 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb299684-914d-41d9-8916-41632279f1cc None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:24.874332 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3929d48f-4440-4b52-b026-55b54a9eaeee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:24.875054 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929d48f-4440-4b52-b026-55b54a9eaeee admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:24.875341 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929d48f-4440-4b52-b026-55b54a9eaeee admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:24.875695 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929d48f-4440-4b52-b026-55b54a9eaeee admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:24.876420 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3929d48f-4440-4b52-b026-55b54a9eaeee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:41:24.876775 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3929d48f-4440-4b52-b026-55b54a9eaeee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:24.878501 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3929d48f-4440-4b52-b026-55b54a9eaeee admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:24.892470 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3887/7786] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:41:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:41:24.902766 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ba301-de8c-4e89-8571-7a6cce41ba6c None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:24.911156 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ba301-de8c-4e89-8571-7a6cce41ba6c None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:24.920080 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac01d766-2b40-4e51-8d13-b981d44b0c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:24.922094 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01d766-2b40-4e51-8d13-b981d44b0c1f admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:24.922570 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01d766-2b40-4e51-8d13-b981d44b0c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:24.923003 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01d766-2b40-4e51-8d13-b981d44b0c1f admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:24.924086 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac01d766-2b40-4e51-8d13-b981d44b0c1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:24.926236 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac01d766-2b40-4e51-8d13-b981d44b0c1f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:25.024934 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3900/7787] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:41:24 2022] POST /identity/v3/projects => generated 373 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:41:25.029244 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3929d48f-4440-4b52-b026-55b54a9eaeee admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:25.039430 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3929d48f-4440-4b52-b026-55b54a9eaeee admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:25.107458 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b82222-9969-4588-b2a1-45d766d96ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:25.114619 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b82222-9969-4588-b2a1-45d766d96ada admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:25.114619 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b82222-9969-4588-b2a1-45d766d96ada admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:25.114619 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b82222-9969-4588-b2a1-45d766d96ada admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:25.114619 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b82222-9969-4588-b2a1-45d766d96ada admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:25.114619 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b82222-9969-4588-b2a1-45d766d96ada admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:25.217467 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3888/7788] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:41:25 2022] POST /identity/v3/users => generated 287 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:41:25.224579 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac01d766-2b40-4e51-8d13-b981d44b0c1f admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:25.245168 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac01d766-2b40-4e51-8d13-b981d44b0c1f admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:25.251025 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d06c16-9f6c-418c-8450-ec7ca180e96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:25.252070 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d06c16-9f6c-418c-8450-ec7ca180e96b admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:25.252456 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d06c16-9f6c-418c-8450-ec7ca180e96b admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:25.252832 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d06c16-9f6c-418c-8450-ec7ca180e96b admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:25.254006 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d06c16-9f6c-418c-8450-ec7ca180e96b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:25.256107 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d06c16-9f6c-418c-8450-ec7ca180e96b admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:25.270704 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3901/7789] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:41:25 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:41:25.276430 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b82222-9969-4588-b2a1-45d766d96ada admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:25.305654 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b82222-9969-4588-b2a1-45d766d96ada admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:25.320039 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8b43b1-c755-41c6-929c-d6cb9398cfa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:25.329150 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b43b1-c755-41c6-929c-d6cb9398cfa7 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:25.329618 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b43b1-c755-41c6-929c-d6cb9398cfa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:25.329978 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b43b1-c755-41c6-929c-d6cb9398cfa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:25.330854 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8b43b1-c755-41c6-929c-d6cb9398cfa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:25.333180 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8b43b1-c755-41c6-929c-d6cb9398cfa7 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:25.358249 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3889/7790] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:41:25 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:41:25.362285 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d06c16-9f6c-418c-8450-ec7ca180e96b admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:25.376375 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d06c16-9f6c-418c-8450-ec7ca180e96b admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:25.382541 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc63913-9c4c-4c15-8dfa-c53791965f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:25.383999 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc63913-9c4c-4c15-8dfa-c53791965f97 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:25.384454 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc63913-9c4c-4c15-8dfa-c53791965f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:25.384700 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc63913-9c4c-4c15-8dfa-c53791965f97 admin admin] PATH_INFO: `/v3/projects/02f7a491fa1c45c896f1af07217a303a/users/9b156d4dd0064d63b2809fa6327ed8aa/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:25.403831 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc63913-9c4c-4c15-8dfa-c53791965f97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02f7a491fa1c45c896f1af07217a303a, user_id=9b156d4dd0064d63b2809fa6327ed8aa, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:25.407197 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc63913-9c4c-4c15-8dfa-c53791965f97 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:25.556367 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3902/7791] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:41:25 2022] PUT /identity/v3/projects/02f7a491fa1c45c896f1af07217a303a/users/9b156d4dd0064d63b2809fa6327ed8aa/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:41:25.559122 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b782c8d-a74a-473d-96ab-4d5515638a04 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:25.559415 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b782c8d-a74a-473d-96ab-4d5515638a04 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:25.559732 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b782c8d-a74a-473d-96ab-4d5515638a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:25.586179 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-8b782c8d-a74a-473d-96ab-4d5515638a04 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:41:25.586179 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8b782c8d-a74a-473d-96ab-4d5515638a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:25.648580 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3890/7792] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:41:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:41:25.666517 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc63913-9c4c-4c15-8dfa-c53791965f97 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:25.668862 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-9bc63913-9c4c-4c15-8dfa-c53791965f97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:25.736844 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc63913-9c4c-4c15-8dfa-c53791965f97 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:25.740680 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c1dbfb-c8b7-4755-bdac-ae3a63f62616 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:25.741338 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c1dbfb-c8b7-4755-bdac-ae3a63f62616 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:25.741647 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c1dbfb-c8b7-4755-bdac-ae3a63f62616 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:25.741926 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c1dbfb-c8b7-4755-bdac-ae3a63f62616 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:25.752079 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c1dbfb-c8b7-4755-bdac-ae3a63f62616 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:25.753634 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c1dbfb-c8b7-4755-bdac-ae3a63f62616 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:25.764450 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3903/7793] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:41:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:41:26.322772 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f7f2a-53ff-48b7-b485-52bc467c2027 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:26.330552 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f7f2a-53ff-48b7-b485-52bc467c2027 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:26.330552 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f7f2a-53ff-48b7-b485-52bc467c2027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:26.344007 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-071f7f2a-53ff-48b7-b485-52bc467c2027 None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:41:26.345370 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-071f7f2a-53ff-48b7-b485-52bc467c2027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:26.418242 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3891/7794] 10.222.0.52 () {58 vars in 1009 bytes} [Sat May 14 21:41:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:41:26.607973 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c1dbfb-c8b7-4755-bdac-ae3a63f62616 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:26.610876 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-28c1dbfb-c8b7-4755-bdac-ae3a63f62616 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:26.817782 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c1dbfb-c8b7-4755-bdac-ae3a63f62616 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:26.817782 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b271a2-01bd-4725-a2ac-662f9cf977ed service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:26.817782 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b271a2-01bd-4725-a2ac-662f9cf977ed service swift] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:26.818109 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b271a2-01bd-4725-a2ac-662f9cf977ed service swift] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:26.818235 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b271a2-01bd-4725-a2ac-662f9cf977ed service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:26.827500 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b271a2-01bd-4725-a2ac-662f9cf977ed service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:26.829205 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b271a2-01bd-4725-a2ac-662f9cf977ed service swift] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:26.843082 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3904/7795] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 21:41:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 21:41:27.076006 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f7f2a-53ff-48b7-b485-52bc467c2027 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:27.077616 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-071f7f2a-53ff-48b7-b485-52bc467c2027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:27.093952 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f7f2a-53ff-48b7-b485-52bc467c2027 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:27.098551 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809224a9-59dc-4315-865c-79411182c4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:27.099445 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809224a9-59dc-4315-865c-79411182c4f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:27.104884 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809224a9-59dc-4315-865c-79411182c4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:27.104884 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809224a9-59dc-4315-865c-79411182c4f4 admin admin] PATH_INFO: `/v3/users/836726f056a74d80ab7a04cb60268d9d` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:27.104884 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809224a9-59dc-4315-865c-79411182c4f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=836726f056a74d80ab7a04cb60268d9d)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:27.107130 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809224a9-59dc-4315-865c-79411182c4f4 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:27.378089 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-809224a9-59dc-4315-865c-79411182c4f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '836726f056a74d80ab7a04cb60268d9d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:27.411866 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-809224a9-59dc-4315-865c-79411182c4f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '836726f056a74d80ab7a04cb60268d9d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:27.412828 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-809224a9-59dc-4315-865c-79411182c4f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '836726f056a74d80ab7a04cb60268d9d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:27.519376 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c22e9-af6a-42e9-8f86-13b5dcc6f7a4 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:27.520003 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c22e9-af6a-42e9-8f86-13b5dcc6f7a4 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:27.520188 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c22e9-af6a-42e9-8f86-13b5dcc6f7a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:27.535951 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-809224a9-59dc-4315-865c-79411182c4f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '836726f056a74d80ab7a04cb60268d9d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:27.586218 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-809224a9-59dc-4315-865c-79411182c4f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '836726f056a74d80ab7a04cb60268d9d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:27.620434 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3892/7796] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:41:27 2022] DELETE /identity/v3/users/836726f056a74d80ab7a04cb60268d9d => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:41:27.628647 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-d03c22e9-af6a-42e9-8f86-13b5dcc6f7a4 None None] MFA Rules not processed for user `9b156d4dd0064d63b2809fa6327ed8aa`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:41:27.629236 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c49d522-7e4a-4260-b9c5-86555871f25a None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:27.629236 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c49d522-7e4a-4260-b9c5-86555871f25a None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:27.629451 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c49d522-7e4a-4260-b9c5-86555871f25a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:27.631993 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d03c22e9-af6a-42e9-8f86-13b5dcc6f7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:27.720285 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-1c49d522-7e4a-4260-b9c5-86555871f25a None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:41:27.721556 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-1c49d522-7e4a-4260-b9c5-86555871f25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:27.802770 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3905/7797] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:41:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:41:27.812480 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03c22e9-af6a-42e9-8f86-13b5dcc6f7a4 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:27.820529 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d03c22e9-af6a-42e9-8f86-13b5dcc6f7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:27.955359 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3893/7798] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:41:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:41:27.957203 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c49d522-7e4a-4260-b9c5-86555871f25a None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:27.962274 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-1c49d522-7e4a-4260-b9c5-86555871f25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:28.016533 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03c22e9-af6a-42e9-8f86-13b5dcc6f7a4 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:28.022229 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7553f7ff-61bb-4cb0-8d5a-742080f0e422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:28.023673 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553f7ff-61bb-4cb0-8d5a-742080f0e422 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:28.024770 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553f7ff-61bb-4cb0-8d5a-742080f0e422 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:28.025631 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553f7ff-61bb-4cb0-8d5a-742080f0e422 admin admin] PATH_INFO: `/v3/users/ac7356d0eff7427d873ded6b8dff90c5` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:28.027648 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7553f7ff-61bb-4cb0-8d5a-742080f0e422 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac7356d0eff7427d873ded6b8dff90c5)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:28.031281 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7553f7ff-61bb-4cb0-8d5a-742080f0e422 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:28.103330 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c49d522-7e4a-4260-b9c5-86555871f25a None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:28.109924 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40238283-79de-4b42-b2cd-6f3ea31766d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198271d1c0d44cb58bace41a65f4b94c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:28.111459 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40238283-79de-4b42-b2cd-6f3ea31766d6 service cinder] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:28.112478 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40238283-79de-4b42-b2cd-6f3ea31766d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:28.112782 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40238283-79de-4b42-b2cd-6f3ea31766d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:28.126891 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40238283-79de-4b42-b2cd-6f3ea31766d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:28.128529 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40238283-79de-4b42-b2cd-6f3ea31766d6 service cinder] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:28.140034 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3894/7799] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:41:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:41:28.140906 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40238283-79de-4b42-b2cd-6f3ea31766d6 service cinder] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:28.142354 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-40238283-79de-4b42-b2cd-6f3ea31766d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:28.226652 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40238283-79de-4b42-b2cd-6f3ea31766d6 service cinder] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:28.233354 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d4dbdb-433c-402b-99de-88ca1396fb82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:28.237569 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d4dbdb-433c-402b-99de-88ca1396fb82 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:28.238319 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d4dbdb-433c-402b-99de-88ca1396fb82 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:28.238818 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d4dbdb-433c-402b-99de-88ca1396fb82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:28.271815 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d4dbdb-433c-402b-99de-88ca1396fb82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:28.273829 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d4dbdb-433c-402b-99de-88ca1396fb82 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:28.287826 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3895/7800] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:41:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:41:28.290206 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8154f712-dcf9-4442-875c-8bfcd22139ce None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:28.290770 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8154f712-dcf9-4442-875c-8bfcd22139ce None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:28.291211 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8154f712-dcf9-4442-875c-8bfcd22139ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:28.319257 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-8154f712-dcf9-4442-875c-8bfcd22139ce None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:41:28.322294 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8154f712-dcf9-4442-875c-8bfcd22139ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:28.324287 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-7553f7ff-61bb-4cb0-8d5a-742080f0e422 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac7356d0eff7427d873ded6b8dff90c5'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:28.353278 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-7553f7ff-61bb-4cb0-8d5a-742080f0e422 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac7356d0eff7427d873ded6b8dff90c5'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:28.383335 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-7553f7ff-61bb-4cb0-8d5a-742080f0e422 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac7356d0eff7427d873ded6b8dff90c5'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:28.419203 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3896/7801] 10.222.0.52 () {58 vars in 967 bytes} [Sat May 14 21:41:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:41:28.433057 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8154f712-dcf9-4442-875c-8bfcd22139ce None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:28.434992 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8154f712-dcf9-4442-875c-8bfcd22139ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:28.466585 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-7553f7ff-61bb-4cb0-8d5a-742080f0e422 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac7356d0eff7427d873ded6b8dff90c5'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:28.467303 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-7553f7ff-61bb-4cb0-8d5a-742080f0e422 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac7356d0eff7427d873ded6b8dff90c5'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:28.476743 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3906/7802] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:41:27 2022] DELETE /identity/v3/users/ac7356d0eff7427d873ded6b8dff90c5 => generated 0 bytes in 665 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:41:28.482710 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c0f3b-1c31-4df0-97b3-68fba88987fe None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:28.484462 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c0f3b-1c31-4df0-97b3-68fba88987fe None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:28.484822 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c0f3b-1c31-4df0-97b3-68fba88987fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:28.529025 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-e87c0f3b-1c31-4df0-97b3-68fba88987fe None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:41:28.530872 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e87c0f3b-1c31-4df0-97b3-68fba88987fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:28.602692 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8154f712-dcf9-4442-875c-8bfcd22139ce None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:28.632167 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3907/7803] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:41:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:41:28.650830 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87c0f3b-1c31-4df0-97b3-68fba88987fe None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:28.652331 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e87c0f3b-1c31-4df0-97b3-68fba88987fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:28.748436 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d083c6fe-6f45-4ada-9736-82de0e2b0981 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:28.749118 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d083c6fe-6f45-4ada-9736-82de0e2b0981 service swift] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:28.749401 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d083c6fe-6f45-4ada-9736-82de0e2b0981 service swift] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:28.749670 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d083c6fe-6f45-4ada-9736-82de0e2b0981 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:28.752119 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-d083c6fe-6f45-4ada-9736-82de0e2b0981 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:28.754285 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87c0f3b-1c31-4df0-97b3-68fba88987fe None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:28.759049 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f215a3-01d7-4e30-9a7f-b7bca183542a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:28.759736 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f215a3-01d7-4e30-9a7f-b7bca183542a service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:28.760274 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f215a3-01d7-4e30-9a7f-b7bca183542a service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:28.760756 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f215a3-01d7-4e30-9a7f-b7bca183542a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:28.773725 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f215a3-01d7-4e30-9a7f-b7bca183542a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:28.775464 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f215a3-01d7-4e30-9a7f-b7bca183542a service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:28.798586 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3908/7804] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:41:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:41:28.828587 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d083c6fe-6f45-4ada-9736-82de0e2b0981 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:28.830744 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d083c6fe-6f45-4ada-9736-82de0e2b0981 service swift] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:28.843507 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3897/7805] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 21:41:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 21:41:29.286794 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f215a3-01d7-4e30-9a7f-b7bca183542a service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:29.288260 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-97f215a3-01d7-4e30-9a7f-b7bca183542a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:29.305637 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f215a3-01d7-4e30-9a7f-b7bca183542a service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:29.310940 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f4276-8c61-491a-9d48-f871d7514ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:29.312008 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f4276-8c61-491a-9d48-f871d7514ef9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:29.312296 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f4276-8c61-491a-9d48-f871d7514ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:29.312579 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f4276-8c61-491a-9d48-f871d7514ef9 admin admin] PATH_INFO: `/v3/projects/c4f2af00e6df44ca8d789add57208278` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:29.313814 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784f4276-8c61-491a-9d48-f871d7514ef9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4f2af00e6df44ca8d789add57208278)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:29.316441 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784f4276-8c61-491a-9d48-f871d7514ef9 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:29.482705 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-784f4276-8c61-491a-9d48-f871d7514ef9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4f2af00e6df44ca8d789add57208278', 'request_id': 'req-784f4276-8c61-491a-9d48-f871d7514ef9'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:29.491827 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-784f4276-8c61-491a-9d48-f871d7514ef9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4f2af00e6df44ca8d789add57208278', 'request_id': 'req-784f4276-8c61-491a-9d48-f871d7514ef9'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:29.632526 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-784f4276-8c61-491a-9d48-f871d7514ef9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4f2af00e6df44ca8d789add57208278', 'request_id': 'req-784f4276-8c61-491a-9d48-f871d7514ef9'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:29.665666 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-784f4276-8c61-491a-9d48-f871d7514ef9 admin admin] The token cache is being invalidate because project c4f2af00e6df44ca8d789add57208278 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:41:29.668527 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-784f4276-8c61-491a-9d48-f871d7514ef9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:29.671006 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-784f4276-8c61-491a-9d48-f871d7514ef9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:29.683580 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05846703-0dc1-446d-9672-f187d62b8514 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:29.683580 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05846703-0dc1-446d-9672-f187d62b8514 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:29.683580 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05846703-0dc1-446d-9672-f187d62b8514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:29.686031 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3909/7806] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:41:29 2022] DELETE /identity/v3/projects/c4f2af00e6df44ca8d789add57208278 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:41:29.714807 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-05846703-0dc1-446d-9672-f187d62b8514 None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:41:29.716130 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-05846703-0dc1-446d-9672-f187d62b8514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:29.749837 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f4276-8c61-491a-9d48-f871d7514ef9 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:29.752640 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-784f4276-8c61-491a-9d48-f871d7514ef9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:29.927737 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3898/7807] 10.222.0.52 () {58 vars in 1009 bytes} [Sat May 14 21:41:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:41:29.929005 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05846703-0dc1-446d-9672-f187d62b8514 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:29.942143 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-05846703-0dc1-446d-9672-f187d62b8514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:29.959305 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f4276-8c61-491a-9d48-f871d7514ef9 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:29.972625 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9b3dbc-7d34-4f23-a86f-d5c63de3384a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:29.974161 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b3dbc-7d34-4f23-a86f-d5c63de3384a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:29.975846 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b3dbc-7d34-4f23-a86f-d5c63de3384a admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:29.976392 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b3dbc-7d34-4f23-a86f-d5c63de3384a admin admin] PATH_INFO: `/v3/projects/a646ef9c31fd4125ad0c8196768a072e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:29.980627 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9b3dbc-7d34-4f23-a86f-d5c63de3384a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a646ef9c31fd4125ad0c8196768a072e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:29.984695 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9b3dbc-7d34-4f23-a86f-d5c63de3384a admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:30.199911 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-fa9b3dbc-7d34-4f23-a86f-d5c63de3384a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a646ef9c31fd4125ad0c8196768a072e', 'request_id': 'req-fa9b3dbc-7d34-4f23-a86f-d5c63de3384a'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:30.214916 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05846703-0dc1-446d-9672-f187d62b8514 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:30.218233 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-fa9b3dbc-7d34-4f23-a86f-d5c63de3384a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a646ef9c31fd4125ad0c8196768a072e', 'request_id': 'req-fa9b3dbc-7d34-4f23-a86f-d5c63de3384a'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:30.273348 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-fa9b3dbc-7d34-4f23-a86f-d5c63de3384a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a646ef9c31fd4125ad0c8196768a072e', 'request_id': 'req-fa9b3dbc-7d34-4f23-a86f-d5c63de3384a'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:30.290030 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-fa9b3dbc-7d34-4f23-a86f-d5c63de3384a admin admin] The token cache is being invalidate because project a646ef9c31fd4125ad0c8196768a072e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:41:30.290567 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-fa9b3dbc-7d34-4f23-a86f-d5c63de3384a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:30.291444 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-fa9b3dbc-7d34-4f23-a86f-d5c63de3384a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:30.294470 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3910/7808] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:41:29 2022] DELETE /identity/v3/projects/a646ef9c31fd4125ad0c8196768a072e => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:41:30.299183 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b90b8e-f7d6-4cc1-9e9b-1556e5032496 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:30.302814 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b90b8e-f7d6-4cc1-9e9b-1556e5032496 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:30.303211 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b90b8e-f7d6-4cc1-9e9b-1556e5032496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:30.312795 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61167bac-8ad4-4663-b70b-743af35ecd2f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:30.315467 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61167bac-8ad4-4663-b70b-743af35ecd2f service swift] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:30.315965 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61167bac-8ad4-4663-b70b-743af35ecd2f service swift] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:30.316401 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61167bac-8ad4-4663-b70b-743af35ecd2f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:30.321276 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-61167bac-8ad4-4663-b70b-743af35ecd2f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:30.342135 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-f7b90b8e-f7d6-4cc1-9e9b-1556e5032496 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:41:30.344069 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-f7b90b8e-f7d6-4cc1-9e9b-1556e5032496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:30.407518 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61167bac-8ad4-4663-b70b-743af35ecd2f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:30.409013 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61167bac-8ad4-4663-b70b-743af35ecd2f service swift] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:30.419734 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3899/7809] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 21:41:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 21:41:30.425718 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3911/7810] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:41:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:41:30.434442 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc91314-96f8-4c8b-9045-dcd006d1fb97 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:30.434758 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc91314-96f8-4c8b-9045-dcd006d1fb97 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:30.435071 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc91314-96f8-4c8b-9045-dcd006d1fb97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:30.453712 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-4bc91314-96f8-4c8b-9045-dcd006d1fb97 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:41:30.454936 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-4bc91314-96f8-4c8b-9045-dcd006d1fb97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:30.464798 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3900/7811] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:41:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:41:30.468699 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b90b8e-f7d6-4cc1-9e9b-1556e5032496 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:30.479568 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b90b8e-f7d6-4cc1-9e9b-1556e5032496 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:30.484371 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8903222c-e5d3-4592-aa73-34f196268e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:30.485039 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8903222c-e5d3-4592-aa73-34f196268e4d admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:30.485336 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8903222c-e5d3-4592-aa73-34f196268e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:30.485619 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8903222c-e5d3-4592-aa73-34f196268e4d admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:30.486350 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8903222c-e5d3-4592-aa73-34f196268e4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:41:30.486665 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8903222c-e5d3-4592-aa73-34f196268e4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:30.488316 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8903222c-e5d3-4592-aa73-34f196268e4d admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:30.504490 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3912/7812] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:41:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:41:30.505590 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc91314-96f8-4c8b-9045-dcd006d1fb97 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:30.515552 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc91314-96f8-4c8b-9045-dcd006d1fb97 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:30.520775 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26618705-08d2-47ef-9ba6-ab237d4fefb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:30.521754 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26618705-08d2-47ef-9ba6-ab237d4fefb1 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:30.522040 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26618705-08d2-47ef-9ba6-ab237d4fefb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:30.522315 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26618705-08d2-47ef-9ba6-ab237d4fefb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:30.523007 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26618705-08d2-47ef-9ba6-ab237d4fefb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:30.525985 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26618705-08d2-47ef-9ba6-ab237d4fefb1 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:30.659032 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3901/7813] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:41:30 2022] POST /identity/v3/projects => generated 371 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:41:30.662880 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8903222c-e5d3-4592-aa73-34f196268e4d admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:30.674937 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8903222c-e5d3-4592-aa73-34f196268e4d admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:30.778255 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59e9cad-272b-41d4-80ba-9ade97d169de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:30.780776 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e9cad-272b-41d4-80ba-9ade97d169de admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:30.780776 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e9cad-272b-41d4-80ba-9ade97d169de admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:30.780776 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e9cad-272b-41d4-80ba-9ade97d169de admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:30.780776 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59e9cad-272b-41d4-80ba-9ade97d169de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:30.782354 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59e9cad-272b-41d4-80ba-9ade97d169de admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:30.902559 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3913/7814] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:41:30 2022] POST /identity/v3/users => generated 286 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:41:30.911670 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26618705-08d2-47ef-9ba6-ab237d4fefb1 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:30.938176 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26618705-08d2-47ef-9ba6-ab237d4fefb1 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:30.953121 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f742335d-7c66-47fb-b027-3eee468002ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:30.953993 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742335d-7c66-47fb-b027-3eee468002ed admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:30.954430 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742335d-7c66-47fb-b027-3eee468002ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:30.955413 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742335d-7c66-47fb-b027-3eee468002ed admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:30.957213 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f742335d-7c66-47fb-b027-3eee468002ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:30.959770 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f742335d-7c66-47fb-b027-3eee468002ed admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:30.973280 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3902/7815] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:41:30 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:41:30.977304 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59e9cad-272b-41d4-80ba-9ade97d169de admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:30.990039 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59e9cad-272b-41d4-80ba-9ade97d169de admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:30.996313 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfa724b-2adb-4945-b657-1ab5f593b9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:30.997606 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa724b-2adb-4945-b657-1ab5f593b9d4 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:30.998116 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa724b-2adb-4945-b657-1ab5f593b9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:30.998609 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa724b-2adb-4945-b657-1ab5f593b9d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:30.999663 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfa724b-2adb-4945-b657-1ab5f593b9d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:31.001982 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfa724b-2adb-4945-b657-1ab5f593b9d4 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:31.020569 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3914/7816] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:41:30 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:41:31.022157 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f742335d-7c66-47fb-b027-3eee468002ed admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:31.049807 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f742335d-7c66-47fb-b027-3eee468002ed admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:31.066840 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad6b3ac-4cac-4ccf-a5be-f5451a15887d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:31.068026 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6b3ac-4cac-4ccf-a5be-f5451a15887d admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:31.069824 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6b3ac-4cac-4ccf-a5be-f5451a15887d admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:31.070176 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6b3ac-4cac-4ccf-a5be-f5451a15887d admin admin] PATH_INFO: `/v3/projects/89652ca7af0b40a7bea9c596343a0a2e/users/817c75d1fa3243b2af48f6926f347867/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:31.113291 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad6b3ac-4cac-4ccf-a5be-f5451a15887d admin admin] RBAC: Authorizing `identity:create_grant(project_id=89652ca7af0b40a7bea9c596343a0a2e, user_id=817c75d1fa3243b2af48f6926f347867, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:31.116189 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad6b3ac-4cac-4ccf-a5be-f5451a15887d admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:31.225823 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3903/7817] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:41:31 2022] PUT /identity/v3/projects/89652ca7af0b40a7bea9c596343a0a2e/users/817c75d1fa3243b2af48f6926f347867/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:41:31.238103 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa40571-c126-4735-ad8a-58f816d5505f None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:31.238488 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa40571-c126-4735-ad8a-58f816d5505f None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:31.238757 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa40571-c126-4735-ad8a-58f816d5505f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:31.246651 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed51c5-31dd-4538-9698-4ceda2787d6c None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:31.246946 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed51c5-31dd-4538-9698-4ceda2787d6c None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:31.247232 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed51c5-31dd-4538-9698-4ceda2787d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:31.282462 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-e9ed51c5-31dd-4538-9698-4ceda2787d6c None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:41:31.283736 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e9ed51c5-31dd-4538-9698-4ceda2787d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:31.306562 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-9aa40571-c126-4735-ad8a-58f816d5505f None None] MFA Rules not processed for user `817c75d1fa3243b2af48f6926f347867`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:41:31.309300 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-9aa40571-c126-4735-ad8a-58f816d5505f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:31.428169 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3904/7818] 10.222.0.52 () {58 vars in 967 bytes} [Sat May 14 21:41:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:41:31.447577 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1106d105-960b-44ad-819f-7dc701bed36f None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:31.447577 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1106d105-960b-44ad-819f-7dc701bed36f None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:31.447834 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1106d105-960b-44ad-819f-7dc701bed36f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:31.486908 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-1106d105-960b-44ad-819f-7dc701bed36f None None] MFA Rules not processed for user `9b156d4dd0064d63b2809fa6327ed8aa`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:41:31.488839 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-1106d105-960b-44ad-819f-7dc701bed36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:31.489758 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3915/7819] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:41:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:41:31.490802 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa40571-c126-4735-ad8a-58f816d5505f None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:31.492338 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-9aa40571-c126-4735-ad8a-58f816d5505f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:31.569122 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3905/7820] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:41:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:41:31.569865 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1106d105-960b-44ad-819f-7dc701bed36f None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:31.571812 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-1106d105-960b-44ad-819f-7dc701bed36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:31.622353 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa40571-c126-4735-ad8a-58f816d5505f None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:31.635046 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d5f7c7-4f72-4f7a-8eb6-47e308bcc6fb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:31.635774 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5f7c7-4f72-4f7a-8eb6-47e308bcc6fb service swift] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:31.638528 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5f7c7-4f72-4f7a-8eb6-47e308bcc6fb service swift] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:31.638528 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5f7c7-4f72-4f7a-8eb6-47e308bcc6fb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:31.650894 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d5f7c7-4f72-4f7a-8eb6-47e308bcc6fb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:31.652538 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d5f7c7-4f72-4f7a-8eb6-47e308bcc6fb service swift] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:31.673705 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3916/7821] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 21:41:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 21:41:31.714169 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1106d105-960b-44ad-819f-7dc701bed36f None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:31.728580 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b716c21f-5b63-4526-af5b-1e51dbf89200 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:31.729568 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716c21f-5b63-4526-af5b-1e51dbf89200 service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:31.729861 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716c21f-5b63-4526-af5b-1e51dbf89200 service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:31.730146 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716c21f-5b63-4526-af5b-1e51dbf89200 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:31.743991 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b716c21f-5b63-4526-af5b-1e51dbf89200 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:31.746170 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b716c21f-5b63-4526-af5b-1e51dbf89200 service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:31.757886 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3906/7822] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:41:31 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:41:32.070498 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d5f7c7-4f72-4f7a-8eb6-47e308bcc6fb service swift] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:32.242255 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d5f7c7-4f72-4f7a-8eb6-47e308bcc6fb service swift] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:32.259233 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9276cf41-5bc4-4233-bf81-ef690d5954ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:32.260998 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9276cf41-5bc4-4233-bf81-ef690d5954ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:32.261327 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9276cf41-5bc4-4233-bf81-ef690d5954ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:32.261587 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9276cf41-5bc4-4233-bf81-ef690d5954ff admin admin] PATH_INFO: `/v3/users/817c75d1fa3243b2af48f6926f347867` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:32.263295 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9276cf41-5bc4-4233-bf81-ef690d5954ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=817c75d1fa3243b2af48f6926f347867)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:32.267803 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9276cf41-5bc4-4233-bf81-ef690d5954ff admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:32.528248 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9276cf41-5bc4-4233-bf81-ef690d5954ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '817c75d1fa3243b2af48f6926f347867'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:32.573233 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9276cf41-5bc4-4233-bf81-ef690d5954ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '817c75d1fa3243b2af48f6926f347867'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:32.604075 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9276cf41-5bc4-4233-bf81-ef690d5954ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '817c75d1fa3243b2af48f6926f347867'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:32.677631 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9276cf41-5bc4-4233-bf81-ef690d5954ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '817c75d1fa3243b2af48f6926f347867'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:32.678346 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9276cf41-5bc4-4233-bf81-ef690d5954ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '817c75d1fa3243b2af48f6926f347867'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:32.688627 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3917/7823] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:41:32 2022] DELETE /identity/v3/users/817c75d1fa3243b2af48f6926f347867 => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:41:32.693391 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe861e5a-37ce-43e7-84ad-d6873810dc86 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:32.693974 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe861e5a-37ce-43e7-84ad-d6873810dc86 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:32.693974 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe861e5a-37ce-43e7-84ad-d6873810dc86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:32.725280 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-fe861e5a-37ce-43e7-84ad-d6873810dc86 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:41:32.729085 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-fe861e5a-37ce-43e7-84ad-d6873810dc86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:32.871114 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3907/7824] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:41:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:41:32.910393 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9276cf41-5bc4-4233-bf81-ef690d5954ff admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:32.912001 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-9276cf41-5bc4-4233-bf81-ef690d5954ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:33.078343 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9276cf41-5bc4-4233-bf81-ef690d5954ff admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:33.083176 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3cc980-151b-43d7-a56a-5856b46a6b13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:33.084878 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3cc980-151b-43d7-a56a-5856b46a6b13 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:33.085306 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3cc980-151b-43d7-a56a-5856b46a6b13 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:33.085791 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3cc980-151b-43d7-a56a-5856b46a6b13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:33.100174 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3cc980-151b-43d7-a56a-5856b46a6b13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:33.103533 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3cc980-151b-43d7-a56a-5856b46a6b13 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:33.118386 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3918/7825] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:41:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:41:34.076881 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe861e5a-37ce-43e7-84ad-d6873810dc86 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:34.078507 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-fe861e5a-37ce-43e7-84ad-d6873810dc86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:34.109709 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe861e5a-37ce-43e7-84ad-d6873810dc86 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:34.123549 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8edb6f-b417-49e3-98c7-76045cdf5045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:34.151604 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8edb6f-b417-49e3-98c7-76045cdf5045 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:34.151875 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8edb6f-b417-49e3-98c7-76045cdf5045 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:34.152215 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8edb6f-b417-49e3-98c7-76045cdf5045 admin admin] PATH_INFO: `/v3/projects/89652ca7af0b40a7bea9c596343a0a2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:34.154258 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8edb6f-b417-49e3-98c7-76045cdf5045 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89652ca7af0b40a7bea9c596343a0a2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:34.156203 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8edb6f-b417-49e3-98c7-76045cdf5045 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:34.357856 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4f8edb6f-b417-49e3-98c7-76045cdf5045 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89652ca7af0b40a7bea9c596343a0a2e', 'request_id': 'req-4f8edb6f-b417-49e3-98c7-76045cdf5045'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:34.363752 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4f8edb6f-b417-49e3-98c7-76045cdf5045 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89652ca7af0b40a7bea9c596343a0a2e', 'request_id': 'req-4f8edb6f-b417-49e3-98c7-76045cdf5045'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:34.370875 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4f8edb6f-b417-49e3-98c7-76045cdf5045 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89652ca7af0b40a7bea9c596343a0a2e', 'request_id': 'req-4f8edb6f-b417-49e3-98c7-76045cdf5045'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:34.448543 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4f8edb6f-b417-49e3-98c7-76045cdf5045 admin admin] The token cache is being invalidate because project 89652ca7af0b40a7bea9c596343a0a2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:41:34.448993 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4f8edb6f-b417-49e3-98c7-76045cdf5045 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:34.449750 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4f8edb6f-b417-49e3-98c7-76045cdf5045 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:34.451425 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3908/7826] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:41:34 2022] DELETE /identity/v3/projects/89652ca7af0b40a7bea9c596343a0a2e => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:41:34.457304 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938cac23-8931-4b7f-acbf-2c4f920b9c4c None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:34.458569 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938cac23-8931-4b7f-acbf-2c4f920b9c4c None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:34.459231 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938cac23-8931-4b7f-acbf-2c4f920b9c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:34.482057 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-938cac23-8931-4b7f-acbf-2c4f920b9c4c None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:41:34.483650 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-938cac23-8931-4b7f-acbf-2c4f920b9c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:34.562057 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3919/7827] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:41:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:41:34.576544 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46859472-4100-46d4-a642-5033e6b4f93d None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:34.577221 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46859472-4100-46d4-a642-5033e6b4f93d None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:34.578240 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46859472-4100-46d4-a642-5033e6b4f93d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:34.603440 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-46859472-4100-46d4-a642-5033e6b4f93d None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:41:34.604899 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-46859472-4100-46d4-a642-5033e6b4f93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:34.614753 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3909/7828] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:41:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:41:34.619801 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938cac23-8931-4b7f-acbf-2c4f920b9c4c None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:34.630038 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938cac23-8931-4b7f-acbf-2c4f920b9c4c None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:34.635092 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0023a2e-b1c9-4004-8fb6-960fcef2a882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:34.635862 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0023a2e-b1c9-4004-8fb6-960fcef2a882 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:34.636162 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0023a2e-b1c9-4004-8fb6-960fcef2a882 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:34.639239 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0023a2e-b1c9-4004-8fb6-960fcef2a882 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:34.640162 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0023a2e-b1c9-4004-8fb6-960fcef2a882 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:41:34.640367 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0023a2e-b1c9-4004-8fb6-960fcef2a882 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:34.641960 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0023a2e-b1c9-4004-8fb6-960fcef2a882 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:34.654747 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3920/7829] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:41:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:41:34.659198 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46859472-4100-46d4-a642-5033e6b4f93d None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:34.670289 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46859472-4100-46d4-a642-5033e6b4f93d None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:34.676313 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf22ece-86db-405a-97d4-f21ec9e72006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:34.677206 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf22ece-86db-405a-97d4-f21ec9e72006 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:34.677744 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf22ece-86db-405a-97d4-f21ec9e72006 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:34.678198 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf22ece-86db-405a-97d4-f21ec9e72006 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:34.678906 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf22ece-86db-405a-97d4-f21ec9e72006 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:34.681787 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf22ece-86db-405a-97d4-f21ec9e72006 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:34.787990 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3910/7830] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:41:34 2022] POST /identity/v3/projects => generated 389 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:41:34.792886 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0023a2e-b1c9-4004-8fb6-960fcef2a882 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:34.803136 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0023a2e-b1c9-4004-8fb6-960fcef2a882 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:34.862322 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d146f86-954f-4063-8de3-66931fc12c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:34.863027 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d146f86-954f-4063-8de3-66931fc12c14 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:34.863331 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d146f86-954f-4063-8de3-66931fc12c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:34.863651 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d146f86-954f-4063-8de3-66931fc12c14 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:34.864361 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d146f86-954f-4063-8de3-66931fc12c14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:34.866679 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d146f86-954f-4063-8de3-66931fc12c14 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:35.089720 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3921/7831] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:41:34 2022] POST /identity/v3/users => generated 295 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:41:35.089840 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf22ece-86db-405a-97d4-f21ec9e72006 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:35.123800 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf22ece-86db-405a-97d4-f21ec9e72006 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:35.128339 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a25a06-1ae3-491c-bd1c-3dd652e39ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:35.129354 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a25a06-1ae3-491c-bd1c-3dd652e39ea9 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:35.129644 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a25a06-1ae3-491c-bd1c-3dd652e39ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:35.129921 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a25a06-1ae3-491c-bd1c-3dd652e39ea9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:35.130634 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a25a06-1ae3-491c-bd1c-3dd652e39ea9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:35.132274 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a25a06-1ae3-491c-bd1c-3dd652e39ea9 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:35.142407 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3911/7832] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:41:35 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:41:35.152723 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d146f86-954f-4063-8de3-66931fc12c14 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:35.218625 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d146f86-954f-4063-8de3-66931fc12c14 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:35.226788 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5c0aac-fcde-4588-9b77-078e6027047f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:35.227999 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c0aac-fcde-4588-9b77-078e6027047f admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:35.228294 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c0aac-fcde-4588-9b77-078e6027047f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:35.228571 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c0aac-fcde-4588-9b77-078e6027047f admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:35.229616 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5c0aac-fcde-4588-9b77-078e6027047f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:35.234116 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5c0aac-fcde-4588-9b77-078e6027047f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:35.248788 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3922/7833] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:41:35 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:41:35.252838 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a25a06-1ae3-491c-bd1c-3dd652e39ea9 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:35.266832 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a25a06-1ae3-491c-bd1c-3dd652e39ea9 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:35.273012 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5a3523-4a36-45e1-a587-92d459120ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:35.274111 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a3523-4a36-45e1-a587-92d459120ba8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:35.274688 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a3523-4a36-45e1-a587-92d459120ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:35.275781 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a3523-4a36-45e1-a587-92d459120ba8 admin admin] PATH_INFO: `/v3/projects/c1872be895764b7cbc60eb343be34b8d/users/3fb6fc72e62f4faf8c53e55e51113b88/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:35.299790 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5a3523-4a36-45e1-a587-92d459120ba8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1872be895764b7cbc60eb343be34b8d, user_id=3fb6fc72e62f4faf8c53e55e51113b88, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:35.302598 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5a3523-4a36-45e1-a587-92d459120ba8 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:35.404556 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3912/7834] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:41:35 2022] PUT /identity/v3/projects/c1872be895764b7cbc60eb343be34b8d/users/3fb6fc72e62f4faf8c53e55e51113b88/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:41:35.419002 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ba8e5-8873-4f71-af8e-7de069407bf6 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:35.419002 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ba8e5-8873-4f71-af8e-7de069407bf6 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:35.419002 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ba8e5-8873-4f71-af8e-7de069407bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:35.468908 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-c94ba8e5-8873-4f71-af8e-7de069407bf6 None None] MFA Rules not processed for user `3fb6fc72e62f4faf8c53e55e51113b88`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:41:35.470239 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c94ba8e5-8873-4f71-af8e-7de069407bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:35.554222 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3923/7835] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:41:35 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:41:35.558889 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5a3523-4a36-45e1-a587-92d459120ba8 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:35.648756 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5a3523-4a36-45e1-a587-92d459120ba8 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:35.653987 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a5f945-c43d-456e-bdf2-1771efff95c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:35.654536 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a5f945-c43d-456e-bdf2-1771efff95c6 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:35.654832 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a5f945-c43d-456e-bdf2-1771efff95c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:35.655246 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a5f945-c43d-456e-bdf2-1771efff95c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:35.655994 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a5f945-c43d-456e-bdf2-1771efff95c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:35.657927 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a5f945-c43d-456e-bdf2-1771efff95c6 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:35.785678 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3913/7836] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:41:35 2022] POST /identity/v3/projects => generated 391 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:41:35.787201 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94ba8e5-8873-4f71-af8e-7de069407bf6 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:35.799243 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94ba8e5-8873-4f71-af8e-7de069407bf6 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:35.868705 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc4f298-39a7-4cb5-bae8-00cb2171c95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:35.869999 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc4f298-39a7-4cb5-bae8-00cb2171c95d admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:35.870300 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc4f298-39a7-4cb5-bae8-00cb2171c95d admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:35.870653 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc4f298-39a7-4cb5-bae8-00cb2171c95d admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:35.871383 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc4f298-39a7-4cb5-bae8-00cb2171c95d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:35.873608 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc4f298-39a7-4cb5-bae8-00cb2171c95d admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:35.971280 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3924/7837] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:41:35 2022] POST /identity/v3/users => generated 302 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:41:35.972544 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a5f945-c43d-456e-bdf2-1771efff95c6 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:35.984532 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a5f945-c43d-456e-bdf2-1771efff95c6 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:35.989413 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a1cb2d-fdde-4f6d-9e05-e5171da421db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:35.990240 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1cb2d-fdde-4f6d-9e05-e5171da421db admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:35.990766 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1cb2d-fdde-4f6d-9e05-e5171da421db admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:35.991112 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1cb2d-fdde-4f6d-9e05-e5171da421db admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:35.991956 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a1cb2d-fdde-4f6d-9e05-e5171da421db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:35.993826 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a1cb2d-fdde-4f6d-9e05-e5171da421db admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:36.006737 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3914/7838] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:41:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:41:36.011879 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc4f298-39a7-4cb5-bae8-00cb2171c95d admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:36.022300 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc4f298-39a7-4cb5-bae8-00cb2171c95d admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:36.027776 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a56ee08-3ed6-4b16-9add-6143ddd5c532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:36.028711 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a56ee08-3ed6-4b16-9add-6143ddd5c532 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:36.029051 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a56ee08-3ed6-4b16-9add-6143ddd5c532 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:36.029251 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a56ee08-3ed6-4b16-9add-6143ddd5c532 admin admin] PATH_INFO: `/v3/projects/6c3d5ec501144474ba425c22654c9f7f/users/71a9906e1b1d474697931074e7e00f54/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:36.045049 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a56ee08-3ed6-4b16-9add-6143ddd5c532 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c3d5ec501144474ba425c22654c9f7f, user_id=71a9906e1b1d474697931074e7e00f54, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:36.048379 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a56ee08-3ed6-4b16-9add-6143ddd5c532 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:36.158071 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3925/7839] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:41:36 2022] PUT /identity/v3/projects/6c3d5ec501144474ba425c22654c9f7f/users/71a9906e1b1d474697931074e7e00f54/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:41:36.161949 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a1cb2d-fdde-4f6d-9e05-e5171da421db admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:36.172406 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a1cb2d-fdde-4f6d-9e05-e5171da421db admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:36.231684 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49572239-07d0-4732-b673-7ac41e21e374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:36.232356 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49572239-07d0-4732-b673-7ac41e21e374 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:36.232645 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49572239-07d0-4732-b673-7ac41e21e374 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:36.232925 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49572239-07d0-4732-b673-7ac41e21e374 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:36.233652 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49572239-07d0-4732-b673-7ac41e21e374 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:36.235260 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49572239-07d0-4732-b673-7ac41e21e374 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:36.246177 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3915/7840] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:41:36 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:41:36.250298 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a56ee08-3ed6-4b16-9add-6143ddd5c532 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:36.261986 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a56ee08-3ed6-4b16-9add-6143ddd5c532 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:36.267030 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63104e30-ea57-43f7-ace2-1b198693a666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:36.268156 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63104e30-ea57-43f7-ace2-1b198693a666 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:36.268742 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63104e30-ea57-43f7-ace2-1b198693a666 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:36.269372 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63104e30-ea57-43f7-ace2-1b198693a666 admin admin] PATH_INFO: `/v3/projects/6c3d5ec501144474ba425c22654c9f7f/users/71a9906e1b1d474697931074e7e00f54/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:36.273102 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63104e30-ea57-43f7-ace2-1b198693a666 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c3d5ec501144474ba425c22654c9f7f, user_id=71a9906e1b1d474697931074e7e00f54, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:36.276491 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63104e30-ea57-43f7-ace2-1b198693a666 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:36.298235 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3926/7841] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:41:36 2022] PUT /identity/v3/projects/6c3d5ec501144474ba425c22654c9f7f/users/71a9906e1b1d474697931074e7e00f54/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:41:36.309283 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb058df1-582c-4df4-a9b4-b89c24951dd5 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:36.309683 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb058df1-582c-4df4-a9b4-b89c24951dd5 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:36.310385 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb058df1-582c-4df4-a9b4-b89c24951dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:36.351340 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-bb058df1-582c-4df4-a9b4-b89c24951dd5 None None] MFA Rules not processed for user `71a9906e1b1d474697931074e7e00f54`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:41:36.352793 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-bb058df1-582c-4df4-a9b4-b89c24951dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:36.423193 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3916/7842] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:41:36 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:41:36.428241 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63104e30-ea57-43f7-ace2-1b198693a666 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:36.440574 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63104e30-ea57-43f7-ace2-1b198693a666 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:36.446417 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53637a0b-e4e7-442c-8f69-4b255c1ef6e3 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:36.447122 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53637a0b-e4e7-442c-8f69-4b255c1ef6e3 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:36.447410 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53637a0b-e4e7-442c-8f69-4b255c1ef6e3 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:36.447724 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53637a0b-e4e7-442c-8f69-4b255c1ef6e3 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:36.448651 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53637a0b-e4e7-442c-8f69-4b255c1ef6e3 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:36.450255 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53637a0b-e4e7-442c-8f69-4b255c1ef6e3 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:36.524540 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3927/7843] 10.222.0.52 () {60 vars in 1148 bytes} [Sat May 14 21:41:36 2022] POST /identity/v3/domains => generated 277 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:41:36.528632 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb058df1-582c-4df4-a9b4-b89c24951dd5 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:36.543966 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb058df1-582c-4df4-a9b4-b89c24951dd5 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:36.663328 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb89763-2fe4-4e42-b2fc-2eb80886e6c6 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:36.665122 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb89763-2fe4-4e42-b2fc-2eb80886e6c6 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:36.665122 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb89763-2fe4-4e42-b2fc-2eb80886e6c6 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:36.665741 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb89763-2fe4-4e42-b2fc-2eb80886e6c6 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/5237db225e51444b8648aa76992c65ac/config` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:36.666475 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb89763-2fe4-4e42-b2fc-2eb80886e6c6 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=5237db225e51444b8648aa76992c65ac)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:36.667846 ncdv-master-1 devstack@keystone.service[91107]: WARNING py.warnings [None req-ceb89763-2fe4-4e42-b2fc-2eb80886e6c6 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:41:36.667846 ncdv-master-1 devstack@keystone.service[91107]: warnings.warn(msg) May 14 21:41:36.667846 ncdv-master-1 devstack@keystone.service[91107]: May 14 21:41:36.668753 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb89763-2fe4-4e42-b2fc-2eb80886e6c6 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:36.820081 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3917/7844] 10.222.0.52 () {60 vars in 1268 bytes} [Sat May 14 21:41:36 2022] PUT /identity/v3/domains/5237db225e51444b8648aa76992c65ac/config => generated 138 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:41:36.825021 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53637a0b-e4e7-442c-8f69-4b255c1ef6e3 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:36.838176 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53637a0b-e4e7-442c-8f69-4b255c1ef6e3 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:36.844872 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb995d1-b2c0-4cd4-9e19-6db38fc757f7 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:36.845451 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb995d1-b2c0-4cd4-9e19-6db38fc757f7 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:36.845785 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb995d1-b2c0-4cd4-9e19-6db38fc757f7 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:36.846052 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb995d1-b2c0-4cd4-9e19-6db38fc757f7 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/5237db225e51444b8648aa76992c65ac/config/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:36.849265 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb995d1-b2c0-4cd4-9e19-6db38fc757f7 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=5237db225e51444b8648aa76992c65ac, group=identity)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:36.850845 ncdv-master-1 devstack@keystone.service[91106]: WARNING py.warnings [None req-9cb995d1-b2c0-4cd4-9e19-6db38fc757f7 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:41:36.850845 ncdv-master-1 devstack@keystone.service[91106]: warnings.warn(msg) May 14 21:41:36.850845 ncdv-master-1 devstack@keystone.service[91106]: May 14 21:41:36.852690 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb995d1-b2c0-4cd4-9e19-6db38fc757f7 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:36.866189 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb89763-2fe4-4e42-b2fc-2eb80886e6c6 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:36.867075 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3928/7845] 10.222.0.52 () {58 vars in 1274 bytes} [Sat May 14 21:41:36 2022] GET /identity/v3/domains/5237db225e51444b8648aa76992c65ac/config/identity => generated 45 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 14 21:41:36.877294 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb89763-2fe4-4e42-b2fc-2eb80886e6c6 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:36.884597 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c4f0c-1644-4020-a93d-e4a684f121e7 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:36.885787 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c4f0c-1644-4020-a93d-e4a684f121e7 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:36.888003 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c4f0c-1644-4020-a93d-e4a684f121e7 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:36.888003 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c4f0c-1644-4020-a93d-e4a684f121e7 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/5237db225e51444b8648aa76992c65ac/config/identity/driver` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:36.888003 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974c4f0c-1644-4020-a93d-e4a684f121e7 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=5237db225e51444b8648aa76992c65ac, group=identity, option=driver)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:36.889438 ncdv-master-1 devstack@keystone.service[91107]: WARNING py.warnings [None req-974c4f0c-1644-4020-a93d-e4a684f121e7 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:41:36.889438 ncdv-master-1 devstack@keystone.service[91107]: warnings.warn(msg) May 14 21:41:36.889438 ncdv-master-1 devstack@keystone.service[91107]: May 14 21:41:36.890758 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974c4f0c-1644-4020-a93d-e4a684f121e7 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:36.903967 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3918/7846] 10.222.0.52 () {58 vars in 1295 bytes} [Sat May 14 21:41:36 2022] GET /identity/v3/domains/5237db225e51444b8648aa76992c65ac/config/identity/driver => generated 31 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 14 21:41:36.905909 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb995d1-b2c0-4cd4-9e19-6db38fc757f7 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:36.917309 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb995d1-b2c0-4cd4-9e19-6db38fc757f7 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:36.929965 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7508da2-e2ac-4739-94b4-ae47f40c4072 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:36.931367 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7508da2-e2ac-4739-94b4-ae47f40c4072 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:36.933411 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7508da2-e2ac-4739-94b4-ae47f40c4072 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:36.933713 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7508da2-e2ac-4739-94b4-ae47f40c4072 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/5237db225e51444b8648aa76992c65ac/config/ldap` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:36.935066 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7508da2-e2ac-4739-94b4-ae47f40c4072 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=5237db225e51444b8648aa76992c65ac, group=ldap)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:36.936941 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7508da2-e2ac-4739-94b4-ae47f40c4072 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:36.951408 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3929/7847] 10.222.0.52 () {58 vars in 1262 bytes} [Sat May 14 21:41:36 2022] GET /identity/v3/domains/5237db225e51444b8648aa76992c65ac/config/ldap => generated 106 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:41:36.951625 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c4f0c-1644-4020-a93d-e4a684f121e7 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:36.959026 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c4f0c-1644-4020-a93d-e4a684f121e7 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:36.966038 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e61244-49e3-4d62-aecc-6375afbc1b53 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:36.966915 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e61244-49e3-4d62-aecc-6375afbc1b53 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:36.967202 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e61244-49e3-4d62-aecc-6375afbc1b53 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:36.968655 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e61244-49e3-4d62-aecc-6375afbc1b53 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/5237db225e51444b8648aa76992c65ac/config/ldap/url` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:36.970447 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e61244-49e3-4d62-aecc-6375afbc1b53 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=5237db225e51444b8648aa76992c65ac, group=ldap, option=url)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:36.973975 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e61244-49e3-4d62-aecc-6375afbc1b53 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:36.981175 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3919/7848] 10.222.0.52 () {58 vars in 1274 bytes} [Sat May 14 21:41:36 2022] GET /identity/v3/domains/5237db225e51444b8648aa76992c65ac/config/ldap/url => generated 46 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) May 14 21:41:36.985996 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7508da2-e2ac-4739-94b4-ae47f40c4072 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:36.996850 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7508da2-e2ac-4739-94b4-ae47f40c4072 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:37.001890 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4ea18d-1e4d-4749-a898-ffab0efd62fb tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:37.004080 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ea18d-1e4d-4749-a898-ffab0efd62fb tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:37.004777 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ea18d-1e4d-4749-a898-ffab0efd62fb tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:37.005171 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ea18d-1e4d-4749-a898-ffab0efd62fb tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/5237db225e51444b8648aa76992c65ac/config/ldap/user_tree_dn` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:37.009737 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4ea18d-1e4d-4749-a898-ffab0efd62fb tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=5237db225e51444b8648aa76992c65ac, group=ldap, option=user_tree_dn)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:37.014899 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4ea18d-1e4d-4749-a898-ffab0efd62fb tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:37.022954 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3930/7849] 10.222.0.52 () {58 vars in 1301 bytes} [Sat May 14 21:41:36 2022] GET /identity/v3/domains/5237db225e51444b8648aa76992c65ac/config/ldap/user_tree_dn => generated 63 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) May 14 21:41:37.027013 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e61244-49e3-4d62-aecc-6375afbc1b53 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:37.037962 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e61244-49e3-4d62-aecc-6375afbc1b53 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:37.056147 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aef05d-ec3e-419c-bd08-c8ad5c67a924 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:37.058004 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aef05d-ec3e-419c-bd08-c8ad5c67a924 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:37.059017 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aef05d-ec3e-419c-bd08-c8ad5c67a924 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:37.065189 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aef05d-ec3e-419c-bd08-c8ad5c67a924 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/5237db225e51444b8648aa76992c65ac/config` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:37.065189 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aef05d-ec3e-419c-bd08-c8ad5c67a924 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=5237db225e51444b8648aa76992c65ac)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:37.066090 ncdv-master-1 devstack@keystone.service[91107]: WARNING py.warnings [None req-83aef05d-ec3e-419c-bd08-c8ad5c67a924 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:41:37.066090 ncdv-master-1 devstack@keystone.service[91107]: warnings.warn(msg) May 14 21:41:37.066090 ncdv-master-1 devstack@keystone.service[91107]: May 14 21:41:37.067025 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aef05d-ec3e-419c-bd08-c8ad5c67a924 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:37.165838 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3920/7850] 10.222.0.52 () {58 vars in 1250 bytes} [Sat May 14 21:41:37 2022] DELETE /identity/v3/domains/5237db225e51444b8648aa76992c65ac/config => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:41:37.170662 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4ea18d-1e4d-4749-a898-ffab0efd62fb tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:37.181846 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4ea18d-1e4d-4749-a898-ffab0efd62fb tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:37.187635 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b656eb19-e466-4d85-b291-1dbe4eccde3e tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:37.188746 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656eb19-e466-4d85-b291-1dbe4eccde3e tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:37.189020 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656eb19-e466-4d85-b291-1dbe4eccde3e tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:37.191188 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656eb19-e466-4d85-b291-1dbe4eccde3e tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/5237db225e51444b8648aa76992c65ac` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:37.191188 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b656eb19-e466-4d85-b291-1dbe4eccde3e tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=5237db225e51444b8648aa76992c65ac)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:37.192489 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b656eb19-e466-4d85-b291-1dbe4eccde3e tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:37.219915 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b656eb19-e466-4d85-b291-1dbe4eccde3e tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '5237db225e51444b8648aa76992c65ac'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:37.220859 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b656eb19-e466-4d85-b291-1dbe4eccde3e tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '5237db225e51444b8648aa76992c65ac'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:37.365056 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b656eb19-e466-4d85-b291-1dbe4eccde3e tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '5237db225e51444b8648aa76992c65ac'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:37.365808 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b656eb19-e466-4d85-b291-1dbe4eccde3e tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '5237db225e51444b8648aa76992c65ac'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:37.369036 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3931/7851] 10.222.0.52 () {60 vars in 1248 bytes} [Sat May 14 21:41:37 2022] PATCH /identity/v3/domains/5237db225e51444b8648aa76992c65ac => generated 278 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:41:37.373350 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aef05d-ec3e-419c-bd08-c8ad5c67a924 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:37.375247 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-83aef05d-ec3e-419c-bd08-c8ad5c67a924 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:37.400299 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aef05d-ec3e-419c-bd08-c8ad5c67a924 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:37.460224 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6738e71-7e52-4c0f-9247-4981f76a8e78 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:37.461789 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6738e71-7e52-4c0f-9247-4981f76a8e78 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:37.462145 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6738e71-7e52-4c0f-9247-4981f76a8e78 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:37.462493 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6738e71-7e52-4c0f-9247-4981f76a8e78 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/5237db225e51444b8648aa76992c65ac` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:37.474373 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6738e71-7e52-4c0f-9247-4981f76a8e78 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=5237db225e51444b8648aa76992c65ac)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:37.476026 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6738e71-7e52-4c0f-9247-4981f76a8e78 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:37.498248 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e6738e71-7e52-4c0f-9247-4981f76a8e78 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '5237db225e51444b8648aa76992c65ac'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:37.507734 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e6738e71-7e52-4c0f-9247-4981f76a8e78 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '5237db225e51444b8648aa76992c65ac'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:37.663548 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e6738e71-7e52-4c0f-9247-4981f76a8e78 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5237db225e51444b8648aa76992c65ac', 'request_id': 'req-e6738e71-7e52-4c0f-9247-4981f76a8e78'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:37.673536 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e6738e71-7e52-4c0f-9247-4981f76a8e78 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5237db225e51444b8648aa76992c65ac', 'request_id': 'req-e6738e71-7e52-4c0f-9247-4981f76a8e78'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:37.689171 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e6738e71-7e52-4c0f-9247-4981f76a8e78 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5237db225e51444b8648aa76992c65ac', 'request_id': 'req-e6738e71-7e52-4c0f-9247-4981f76a8e78'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:37.767824 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e6738e71-7e52-4c0f-9247-4981f76a8e78 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] The token cache is being invalidate because project 5237db225e51444b8648aa76992c65ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:41:37.768161 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e6738e71-7e52-4c0f-9247-4981f76a8e78 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:37.768803 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e6738e71-7e52-4c0f-9247-4981f76a8e78 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:37.779096 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e6738e71-7e52-4c0f-9247-4981f76a8e78 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '5237db225e51444b8648aa76992c65ac', 'request_id': 'req-e6738e71-7e52-4c0f-9247-4981f76a8e78'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:37.780187 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e6738e71-7e52-4c0f-9247-4981f76a8e78 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '5237db225e51444b8648aa76992c65ac', 'request_id': 'req-e6738e71-7e52-4c0f-9247-4981f76a8e78'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:37.784441 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e6738e71-7e52-4c0f-9247-4981f76a8e78 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '5237db225e51444b8648aa76992c65ac', 'request_id': 'req-e6738e71-7e52-4c0f-9247-4981f76a8e78'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:37.792041 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3921/7852] 10.222.0.52 () {58 vars in 1229 bytes} [Sat May 14 21:41:37 2022] DELETE /identity/v3/domains/5237db225e51444b8648aa76992c65ac => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:41:37.797447 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b656eb19-e466-4d85-b291-1dbe4eccde3e tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:37.810148 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b656eb19-e466-4d85-b291-1dbe4eccde3e tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:37.901829 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56509f04-c852-4558-9db1-18008c2c8c96 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:37.902734 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56509f04-c852-4558-9db1-18008c2c8c96 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:37.903130 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56509f04-c852-4558-9db1-18008c2c8c96 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:37.903546 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56509f04-c852-4558-9db1-18008c2c8c96 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:37.904887 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56509f04-c852-4558-9db1-18008c2c8c96 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:37.906693 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56509f04-c852-4558-9db1-18008c2c8c96 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:38.005187 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3932/7853] 10.222.0.52 () {60 vars in 1148 bytes} [Sat May 14 21:41:37 2022] POST /identity/v3/domains => generated 276 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:41:38.009782 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6738e71-7e52-4c0f-9247-4981f76a8e78 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:38.011430 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e6738e71-7e52-4c0f-9247-4981f76a8e78 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:38.026495 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6738e71-7e52-4c0f-9247-4981f76a8e78 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:38.086695 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb9898a-d164-475b-ba59-2363923e5b24 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:38.087580 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb9898a-d164-475b-ba59-2363923e5b24 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:38.088011 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb9898a-d164-475b-ba59-2363923e5b24 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:38.088301 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb9898a-d164-475b-ba59-2363923e5b24 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/37ec8cfd173a46cf80e3f8a370090dff/config` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:38.089202 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb9898a-d164-475b-ba59-2363923e5b24 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=37ec8cfd173a46cf80e3f8a370090dff)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:38.091039 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb9898a-d164-475b-ba59-2363923e5b24 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:38.187043 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3922/7854] 10.222.0.52 () {60 vars in 1268 bytes} [Sat May 14 21:41:38 2022] PUT /identity/v3/domains/37ec8cfd173a46cf80e3f8a370090dff/config => generated 138 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:41:38.191150 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56509f04-c852-4558-9db1-18008c2c8c96 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:38.202048 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56509f04-c852-4558-9db1-18008c2c8c96 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:38.207366 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5e3070-b7c3-406a-8fec-499e1b0c195c tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:38.208550 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e3070-b7c3-406a-8fec-499e1b0c195c tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:38.209078 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e3070-b7c3-406a-8fec-499e1b0c195c tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:38.209615 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e3070-b7c3-406a-8fec-499e1b0c195c tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/37ec8cfd173a46cf80e3f8a370090dff/config` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:38.210469 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5e3070-b7c3-406a-8fec-499e1b0c195c tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=37ec8cfd173a46cf80e3f8a370090dff)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:38.212379 ncdv-master-1 devstack@keystone.service[91106]: WARNING py.warnings [None req-da5e3070-b7c3-406a-8fec-499e1b0c195c tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:41:38.212379 ncdv-master-1 devstack@keystone.service[91106]: warnings.warn(msg) May 14 21:41:38.212379 ncdv-master-1 devstack@keystone.service[91106]: May 14 21:41:38.213735 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5e3070-b7c3-406a-8fec-499e1b0c195c tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:38.303822 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3933/7855] 10.222.0.52 () {60 vars in 1270 bytes} [Sat May 14 21:41:38 2022] PATCH /identity/v3/domains/37ec8cfd173a46cf80e3f8a370090dff/config => generated 141 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:41:38.308663 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb9898a-d164-475b-ba59-2363923e5b24 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:38.319557 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb9898a-d164-475b-ba59-2363923e5b24 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:38.324481 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78199666-961b-48cf-8d18-905e827b443a tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:38.325325 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78199666-961b-48cf-8d18-905e827b443a tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:38.325615 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78199666-961b-48cf-8d18-905e827b443a tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:38.325896 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78199666-961b-48cf-8d18-905e827b443a tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/37ec8cfd173a46cf80e3f8a370090dff/config` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:38.327300 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78199666-961b-48cf-8d18-905e827b443a tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=37ec8cfd173a46cf80e3f8a370090dff)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:38.328964 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78199666-961b-48cf-8d18-905e827b443a tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:38.333845 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3923/7856] 10.222.0.52 () {58 vars in 1247 bytes} [Sat May 14 21:41:38 2022] GET /identity/v3/domains/37ec8cfd173a46cf80e3f8a370090dff/config => generated 141 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:41:38.338141 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5e3070-b7c3-406a-8fec-499e1b0c195c tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:38.348073 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5e3070-b7c3-406a-8fec-499e1b0c195c tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:38.353636 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa27fb-68aa-4db9-b32e-f52851179a56 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:38.354461 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa27fb-68aa-4db9-b32e-f52851179a56 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:38.354936 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa27fb-68aa-4db9-b32e-f52851179a56 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:38.355217 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa27fb-68aa-4db9-b32e-f52851179a56 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/37ec8cfd173a46cf80e3f8a370090dff/config` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:38.355912 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fa27fb-68aa-4db9-b32e-f52851179a56 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=37ec8cfd173a46cf80e3f8a370090dff)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:38.356919 ncdv-master-1 devstack@keystone.service[91106]: WARNING py.warnings [None req-f0fa27fb-68aa-4db9-b32e-f52851179a56 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:41:38.356919 ncdv-master-1 devstack@keystone.service[91106]: warnings.warn(msg) May 14 21:41:38.356919 ncdv-master-1 devstack@keystone.service[91106]: May 14 21:41:38.357814 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fa27fb-68aa-4db9-b32e-f52851179a56 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:38.451127 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3934/7857] 10.222.0.52 () {58 vars in 1250 bytes} [Sat May 14 21:41:38 2022] DELETE /identity/v3/domains/37ec8cfd173a46cf80e3f8a370090dff/config => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:41:38.455125 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78199666-961b-48cf-8d18-905e827b443a tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:38.466676 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78199666-961b-48cf-8d18-905e827b443a tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:38.481138 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e8e51c-fd7f-480a-a584-432c9596bf50 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:38.482052 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8e51c-fd7f-480a-a584-432c9596bf50 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:38.482342 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8e51c-fd7f-480a-a584-432c9596bf50 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:38.482626 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8e51c-fd7f-480a-a584-432c9596bf50 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/37ec8cfd173a46cf80e3f8a370090dff/config` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:38.484054 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e8e51c-fd7f-480a-a584-432c9596bf50 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=37ec8cfd173a46cf80e3f8a370090dff)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:38.486145 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e8e51c-fd7f-480a-a584-432c9596bf50 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:38.500049 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-94e8e51c-fd7f-480a-a584-432c9596bf50 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Could not find any options in domain configuration for domain 37ec8cfd173a46cf80e3f8a370090dff.: keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain 37ec8cfd173a46cf80e3f8a370090dff. May 14 21:41:38.500049 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:41:38.500049 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 21:41:38.500049 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 21:41:38.500049 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 21:41:38.500049 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 21:41:38.500049 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 21:41:38.500049 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 21:41:38.500049 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 21:41:38.500049 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 21:41:38.500049 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 21:41:38.500049 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 21:41:38.500049 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get May 14 21:41:38.501045 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) May 14 21:41:38.501045 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config May 14 21:41:38.501045 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( May 14 21:41:38.501045 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 21:41:38.501045 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 21:41:38.501045 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config May 14 21:41:38.501045 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( May 14 21:41:38.501045 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain 37ec8cfd173a46cf80e3f8a370090dff. May 14 21:41:38.501045 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:41:38.503405 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3924/7858] 10.222.0.52 () {58 vars in 1247 bytes} [Sat May 14 21:41:38 2022] GET /identity/v3/domains/37ec8cfd173a46cf80e3f8a370090dff/config => generated 151 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 14 21:41:38.507295 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa27fb-68aa-4db9-b32e-f52851179a56 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:38.518504 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa27fb-68aa-4db9-b32e-f52851179a56 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:38.524122 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0633f3d-bd97-40ac-a85c-4ecc7f6fcb46 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:38.525203 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0633f3d-bd97-40ac-a85c-4ecc7f6fcb46 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:38.525555 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0633f3d-bd97-40ac-a85c-4ecc7f6fcb46 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:38.525949 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0633f3d-bd97-40ac-a85c-4ecc7f6fcb46 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/37ec8cfd173a46cf80e3f8a370090dff/config` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:38.526705 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0633f3d-bd97-40ac-a85c-4ecc7f6fcb46 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=37ec8cfd173a46cf80e3f8a370090dff)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:38.529329 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0633f3d-bd97-40ac-a85c-4ecc7f6fcb46 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:38.537458 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3935/7859] 10.222.0.52 () {58 vars in 1250 bytes} [Sat May 14 21:41:38 2022] DELETE /identity/v3/domains/37ec8cfd173a46cf80e3f8a370090dff/config => generated 0 bytes in 29 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:41:38.540662 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e8e51c-fd7f-480a-a584-432c9596bf50 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:38.550978 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e8e51c-fd7f-480a-a584-432c9596bf50 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:38.556483 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec8793-648d-4cc2-90c6-7bfb772844ab tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:38.557489 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec8793-648d-4cc2-90c6-7bfb772844ab tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:38.557775 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec8793-648d-4cc2-90c6-7bfb772844ab tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:38.558053 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec8793-648d-4cc2-90c6-7bfb772844ab tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/37ec8cfd173a46cf80e3f8a370090dff` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:38.559367 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cec8793-648d-4cc2-90c6-7bfb772844ab tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=37ec8cfd173a46cf80e3f8a370090dff)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:38.560994 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cec8793-648d-4cc2-90c6-7bfb772844ab tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:38.583289 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0cec8793-648d-4cc2-90c6-7bfb772844ab tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '37ec8cfd173a46cf80e3f8a370090dff'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:38.584058 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0cec8793-648d-4cc2-90c6-7bfb772844ab tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '37ec8cfd173a46cf80e3f8a370090dff'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:38.815416 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0cec8793-648d-4cc2-90c6-7bfb772844ab tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '37ec8cfd173a46cf80e3f8a370090dff'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:38.817108 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0cec8793-648d-4cc2-90c6-7bfb772844ab tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '37ec8cfd173a46cf80e3f8a370090dff'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:38.823432 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3925/7860] 10.222.0.52 () {60 vars in 1248 bytes} [Sat May 14 21:41:38 2022] PATCH /identity/v3/domains/37ec8cfd173a46cf80e3f8a370090dff => generated 277 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:41:38.824829 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0633f3d-bd97-40ac-a85c-4ecc7f6fcb46 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:38.826715 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-f0633f3d-bd97-40ac-a85c-4ecc7f6fcb46 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:38.840418 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0633f3d-bd97-40ac-a85c-4ecc7f6fcb46 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:38.911509 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c6961-9931-455d-be26-f279ae67511e tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:38.912629 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c6961-9931-455d-be26-f279ae67511e tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:38.913657 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c6961-9931-455d-be26-f279ae67511e tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:38.914227 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c6961-9931-455d-be26-f279ae67511e tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/37ec8cfd173a46cf80e3f8a370090dff` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:38.938798 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39c6961-9931-455d-be26-f279ae67511e tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=37ec8cfd173a46cf80e3f8a370090dff)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:38.945252 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39c6961-9931-455d-be26-f279ae67511e tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:38.969137 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e39c6961-9931-455d-be26-f279ae67511e tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '37ec8cfd173a46cf80e3f8a370090dff'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:38.972752 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e39c6961-9931-455d-be26-f279ae67511e tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '37ec8cfd173a46cf80e3f8a370090dff'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:39.098676 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e39c6961-9931-455d-be26-f279ae67511e tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37ec8cfd173a46cf80e3f8a370090dff', 'request_id': 'req-e39c6961-9931-455d-be26-f279ae67511e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:39.105471 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e39c6961-9931-455d-be26-f279ae67511e tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37ec8cfd173a46cf80e3f8a370090dff', 'request_id': 'req-e39c6961-9931-455d-be26-f279ae67511e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:39.196380 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e39c6961-9931-455d-be26-f279ae67511e tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37ec8cfd173a46cf80e3f8a370090dff', 'request_id': 'req-e39c6961-9931-455d-be26-f279ae67511e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:39.213391 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e39c6961-9931-455d-be26-f279ae67511e tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] The token cache is being invalidate because project 37ec8cfd173a46cf80e3f8a370090dff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:41:39.213915 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e39c6961-9931-455d-be26-f279ae67511e tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:39.215235 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e39c6961-9931-455d-be26-f279ae67511e tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:39.228335 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e39c6961-9931-455d-be26-f279ae67511e tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '37ec8cfd173a46cf80e3f8a370090dff', 'request_id': 'req-e39c6961-9931-455d-be26-f279ae67511e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:39.229487 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e39c6961-9931-455d-be26-f279ae67511e tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '37ec8cfd173a46cf80e3f8a370090dff', 'request_id': 'req-e39c6961-9931-455d-be26-f279ae67511e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:39.233912 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e39c6961-9931-455d-be26-f279ae67511e tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '37ec8cfd173a46cf80e3f8a370090dff', 'request_id': 'req-e39c6961-9931-455d-be26-f279ae67511e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:39.246036 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3936/7861] 10.222.0.52 () {58 vars in 1229 bytes} [Sat May 14 21:41:38 2022] DELETE /identity/v3/domains/37ec8cfd173a46cf80e3f8a370090dff => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:41:39.251307 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec8793-648d-4cc2-90c6-7bfb772844ab tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:39.262428 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec8793-648d-4cc2-90c6-7bfb772844ab tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:39.336262 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc14b94-3920-4645-a69e-3c48c7df5114 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:39.337387 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc14b94-3920-4645-a69e-3c48c7df5114 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:39.337975 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc14b94-3920-4645-a69e-3c48c7df5114 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:39.338406 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc14b94-3920-4645-a69e-3c48c7df5114 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:39.339948 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc14b94-3920-4645-a69e-3c48c7df5114 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:39.341818 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc14b94-3920-4645-a69e-3c48c7df5114 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:39.445047 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c6961-9931-455d-be26-f279ae67511e tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:39.448490 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e39c6961-9931-455d-be26-f279ae67511e tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:39.463577 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3926/7862] 10.222.0.52 () {60 vars in 1148 bytes} [Sat May 14 21:41:39 2022] POST /identity/v3/domains => generated 275 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:41:39.478472 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc14b94-3920-4645-a69e-3c48c7df5114 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:39.481894 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-4cc14b94-3920-4645-a69e-3c48c7df5114 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:39.483233 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c6961-9931-455d-be26-f279ae67511e tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:39.561738 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc14b94-3920-4645-a69e-3c48c7df5114 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:39.566881 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0894e583-31be-4439-ad28-1eda2c4956c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:39.569314 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0894e583-31be-4439-ad28-1eda2c4956c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:39.569788 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0894e583-31be-4439-ad28-1eda2c4956c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:39.570248 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0894e583-31be-4439-ad28-1eda2c4956c1 admin admin] PATH_INFO: `/v3/users/b61e5fd331864e21b5c6aa52dde37bec` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:39.572742 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0894e583-31be-4439-ad28-1eda2c4956c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b61e5fd331864e21b5c6aa52dde37bec)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:39.575199 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0894e583-31be-4439-ad28-1eda2c4956c1 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:39.597843 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae4c9b9-2daa-415a-b76d-9d7b98a9e318 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:39.599423 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae4c9b9-2daa-415a-b76d-9d7b98a9e318 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:39.599868 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae4c9b9-2daa-415a-b76d-9d7b98a9e318 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:39.600438 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae4c9b9-2daa-415a-b76d-9d7b98a9e318 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/d1f784d9e502475f8ac6607358efa9ca/config` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:39.601184 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae4c9b9-2daa-415a-b76d-9d7b98a9e318 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=d1f784d9e502475f8ac6607358efa9ca)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:39.603155 ncdv-master-1 devstack@keystone.service[91106]: WARNING py.warnings [None req-8ae4c9b9-2daa-415a-b76d-9d7b98a9e318 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:41:39.603155 ncdv-master-1 devstack@keystone.service[91106]: warnings.warn(msg) May 14 21:41:39.603155 ncdv-master-1 devstack@keystone.service[91106]: May 14 21:41:39.604522 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae4c9b9-2daa-415a-b76d-9d7b98a9e318 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:39.739548 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3937/7863] 10.222.0.52 () {60 vars in 1268 bytes} [Sat May 14 21:41:39 2022] PUT /identity/v3/domains/d1f784d9e502475f8ac6607358efa9ca/config => generated 138 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:41:39.741368 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae4c9b9-2daa-415a-b76d-9d7b98a9e318 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:39.754244 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae4c9b9-2daa-415a-b76d-9d7b98a9e318 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:39.760103 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ef8db-b653-421f-b907-4ddd6c67ecb9 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:39.761032 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ef8db-b653-421f-b907-4ddd6c67ecb9 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:39.763675 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ef8db-b653-421f-b907-4ddd6c67ecb9 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:39.763675 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ef8db-b653-421f-b907-4ddd6c67ecb9 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/d1f784d9e502475f8ac6607358efa9ca/config/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:39.763675 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0ef8db-b653-421f-b907-4ddd6c67ecb9 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=d1f784d9e502475f8ac6607358efa9ca, group=identity)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:39.764047 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0ef8db-b653-421f-b907-4ddd6c67ecb9 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:39.835221 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0894e583-31be-4439-ad28-1eda2c4956c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b61e5fd331864e21b5c6aa52dde37bec'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:39.847596 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0894e583-31be-4439-ad28-1eda2c4956c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b61e5fd331864e21b5c6aa52dde37bec'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:39.848552 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0894e583-31be-4439-ad28-1eda2c4956c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b61e5fd331864e21b5c6aa52dde37bec'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:39.894194 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3938/7864] 10.222.0.52 () {60 vars in 1296 bytes} [Sat May 14 21:41:39 2022] PATCH /identity/v3/domains/d1f784d9e502475f8ac6607358efa9ca/config/identity => generated 176 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:41:39.899212 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ef8db-b653-421f-b907-4ddd6c67ecb9 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:39.920739 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ef8db-b653-421f-b907-4ddd6c67ecb9 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:39.931448 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4f8d36-b321-408d-b75a-c181deaeddcf tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:39.932730 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f8d36-b321-408d-b75a-c181deaeddcf tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:39.933118 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f8d36-b321-408d-b75a-c181deaeddcf tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:39.933477 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f8d36-b321-408d-b75a-c181deaeddcf tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/d1f784d9e502475f8ac6607358efa9ca/config/identity/driver` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:39.934799 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4f8d36-b321-408d-b75a-c181deaeddcf tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=d1f784d9e502475f8ac6607358efa9ca, group=identity, option=driver)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:39.941069 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4f8d36-b321-408d-b75a-c181deaeddcf tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:39.989266 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0894e583-31be-4439-ad28-1eda2c4956c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b61e5fd331864e21b5c6aa52dde37bec'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:40.004188 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0894e583-31be-4439-ad28-1eda2c4956c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b61e5fd331864e21b5c6aa52dde37bec'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:40.011462 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3927/7865] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:41:39 2022] DELETE /identity/v3/users/b61e5fd331864e21b5c6aa52dde37bec => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:41:40.017440 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a5d6b-5fba-4ebb-9ae8-bea4c2b3f8f3 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:40.020540 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a5d6b-5fba-4ebb-9ae8-bea4c2b3f8f3 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:40.020540 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a5d6b-5fba-4ebb-9ae8-bea4c2b3f8f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:40.066545 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-d59a5d6b-5fba-4ebb-9ae8-bea4c2b3f8f3 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:41:40.070131 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-d59a5d6b-5fba-4ebb-9ae8-bea4c2b3f8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:40.119403 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3939/7866] 10.222.0.52 () {60 vars in 1317 bytes} [Sat May 14 21:41:39 2022] PATCH /identity/v3/domains/d1f784d9e502475f8ac6607358efa9ca/config/identity/driver => generated 175 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:41:40.139049 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4f8d36-b321-408d-b75a-c181deaeddcf tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:40.146635 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ef4f8d36-b321-408d-b75a-c181deaeddcf tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:40.167948 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3928/7867] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:41:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:41:40.174923 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59a5d6b-5fba-4ebb-9ae8-bea4c2b3f8f3 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:40.177712 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-d59a5d6b-5fba-4ebb-9ae8-bea4c2b3f8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:40.181106 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4f8d36-b321-408d-b75a-c181deaeddcf tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:40.327500 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59a5d6b-5fba-4ebb-9ae8-bea4c2b3f8f3 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:40.335831 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be2807-2ddf-4790-bc8c-233f44a96ff0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:40.335831 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be2807-2ddf-4790-bc8c-233f44a96ff0 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:40.335831 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be2807-2ddf-4790-bc8c-233f44a96ff0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:40.335831 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be2807-2ddf-4790-bc8c-233f44a96ff0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:40.345935 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be2807-2ddf-4790-bc8c-233f44a96ff0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:40.348263 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be2807-2ddf-4790-bc8c-233f44a96ff0 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:40.351627 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1ea504-6a90-4f3e-bd79-b5615825bdf7 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:40.352546 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ea504-6a90-4f3e-bd79-b5615825bdf7 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:40.352832 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ea504-6a90-4f3e-bd79-b5615825bdf7 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:40.353111 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ea504-6a90-4f3e-bd79-b5615825bdf7 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/d1f784d9e502475f8ac6607358efa9ca/config/identity/driver` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:40.353792 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1ea504-6a90-4f3e-bd79-b5615825bdf7 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=d1f784d9e502475f8ac6607358efa9ca, group=identity, option=driver)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:40.358117 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1ea504-6a90-4f3e-bd79-b5615825bdf7 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:40.361160 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3929/7868] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:41:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:41:40.471181 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3940/7869] 10.222.0.52 () {58 vars in 1298 bytes} [Sat May 14 21:41:40 2022] DELETE /identity/v3/domains/d1f784d9e502475f8ac6607358efa9ca/config/identity/driver => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:41:40.477257 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1ea504-6a90-4f3e-bd79-b5615825bdf7 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:40.478222 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be2807-2ddf-4790-bc8c-233f44a96ff0 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:40.499941 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be2807-2ddf-4790-bc8c-233f44a96ff0 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:40.504361 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1ea504-6a90-4f3e-bd79-b5615825bdf7 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:40.512176 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64606b-c34d-44e7-94a2-ecb2d2cbcbbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:40.513458 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64606b-c34d-44e7-94a2-ecb2d2cbcbbc service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:40.513745 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64606b-c34d-44e7-94a2-ecb2d2cbcbbc service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:40.514023 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64606b-c34d-44e7-94a2-ecb2d2cbcbbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:40.516345 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44aed92-8b67-45fa-9470-2816e481f8a7 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:40.517233 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44aed92-8b67-45fa-9470-2816e481f8a7 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:40.517513 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44aed92-8b67-45fa-9470-2816e481f8a7 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:40.518036 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44aed92-8b67-45fa-9470-2816e481f8a7 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/d1f784d9e502475f8ac6607358efa9ca/config/identity/driver` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:40.519293 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-9b64606b-c34d-44e7-94a2-ecb2d2cbcbbc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:40.521554 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44aed92-8b67-45fa-9470-2816e481f8a7 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=d1f784d9e502475f8ac6607358efa9ca, group=identity, option=driver)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:40.525208 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44aed92-8b67-45fa-9470-2816e481f8a7 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:40.549057 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-b44aed92-8b67-45fa-9470-2816e481f8a7 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Could not find option driver in group identity in domain configuration for domain d1f784d9e502475f8ac6607358efa9ca.: keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain d1f784d9e502475f8ac6607358efa9ca. May 14 21:41:40.549057 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:41:40.549057 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 21:41:40.549057 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 21:41:40.549057 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 21:41:40.549057 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 21:41:40.549057 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 21:41:40.549057 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 21:41:40.549057 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 21:41:40.549057 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 21:41:40.549057 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 21:41:40.549057 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 21:41:40.549057 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get May 14 21:41:40.550160 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) May 14 21:41:40.550160 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config May 14 21:41:40.550160 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( May 14 21:41:40.550160 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 21:41:40.550160 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 21:41:40.550160 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config May 14 21:41:40.550160 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( May 14 21:41:40.550160 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain d1f784d9e502475f8ac6607358efa9ca. May 14 21:41:40.550160 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:41:40.554078 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3930/7870] 10.222.0.52 () {58 vars in 1295 bytes} [Sat May 14 21:41:40 2022] GET /identity/v3/domains/d1f784d9e502475f8ac6607358efa9ca/config/identity/driver => generated 171 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 14 21:41:40.556704 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44aed92-8b67-45fa-9470-2816e481f8a7 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:40.569029 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44aed92-8b67-45fa-9470-2816e481f8a7 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:40.575547 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01004519-3cc5-402b-91a9-dfa007891097 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:40.576747 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01004519-3cc5-402b-91a9-dfa007891097 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:40.576998 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01004519-3cc5-402b-91a9-dfa007891097 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:40.577282 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01004519-3cc5-402b-91a9-dfa007891097 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/d1f784d9e502475f8ac6607358efa9ca/config/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:40.578130 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01004519-3cc5-402b-91a9-dfa007891097 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=d1f784d9e502475f8ac6607358efa9ca, group=identity)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:40.580010 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01004519-3cc5-402b-91a9-dfa007891097 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:40.675150 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b64606b-c34d-44e7-94a2-ecb2d2cbcbbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:40.676918 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b64606b-c34d-44e7-94a2-ecb2d2cbcbbc service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:40.709016 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3931/7871] 10.222.0.52 () {58 vars in 1277 bytes} [Sat May 14 21:41:40 2022] DELETE /identity/v3/domains/d1f784d9e502475f8ac6607358efa9ca/config/identity => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:41:40.709985 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01004519-3cc5-402b-91a9-dfa007891097 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:40.715463 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3941/7872] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:41:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:41:40.734638 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01004519-3cc5-402b-91a9-dfa007891097 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:40.745205 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0e6451-04f6-4cc3-ba0b-97e79724f867 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:40.745205 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e6451-04f6-4cc3-ba0b-97e79724f867 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:40.745205 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e6451-04f6-4cc3-ba0b-97e79724f867 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:40.745517 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e6451-04f6-4cc3-ba0b-97e79724f867 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/d1f784d9e502475f8ac6607358efa9ca/config/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:40.745517 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0e6451-04f6-4cc3-ba0b-97e79724f867 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=d1f784d9e502475f8ac6607358efa9ca, group=identity)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:40.747066 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0e6451-04f6-4cc3-ba0b-97e79724f867 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:40.769136 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application [None req-2e0e6451-04f6-4cc3-ba0b-97e79724f867 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Could not find group identity in domain configuration for domain d1f784d9e502475f8ac6607358efa9ca.: keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain d1f784d9e502475f8ac6607358efa9ca. May 14 21:41:40.769136 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:41:40.769136 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 21:41:40.769136 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 21:41:40.769136 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 21:41:40.769136 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 21:41:40.769136 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 21:41:40.769136 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 21:41:40.769136 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 21:41:40.769136 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 21:41:40.769136 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 21:41:40.769136 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 21:41:40.769136 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get May 14 21:41:40.774924 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) May 14 21:41:40.774924 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config May 14 21:41:40.774924 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( May 14 21:41:40.774924 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 21:41:40.774924 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 21:41:40.774924 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config May 14 21:41:40.774924 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( May 14 21:41:40.774924 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain d1f784d9e502475f8ac6607358efa9ca. May 14 21:41:40.774924 ncdv-master-1 devstack@keystone.service[91107]: ERROR keystone.server.flask.application May 14 21:41:40.774924 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3932/7873] 10.222.0.52 () {58 vars in 1274 bytes} [Sat May 14 21:41:40 2022] GET /identity/v3/domains/d1f784d9e502475f8ac6607358efa9ca/config/identity => generated 154 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 14 21:41:40.776999 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64606b-c34d-44e7-94a2-ecb2d2cbcbbc service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:40.779448 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0e6451-04f6-4cc3-ba0b-97e79724f867 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:40.781463 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-2e0e6451-04f6-4cc3-ba0b-97e79724f867 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:40.796463 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64606b-c34d-44e7-94a2-ecb2d2cbcbbc service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:40.800891 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0e6451-04f6-4cc3-ba0b-97e79724f867 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:40.805500 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be73972-f246-47f0-998a-0aeb9bde8d60 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:40.806506 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be73972-f246-47f0-998a-0aeb9bde8d60 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:40.806931 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be73972-f246-47f0-998a-0aeb9bde8d60 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:40.807377 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be73972-f246-47f0-998a-0aeb9bde8d60 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/d1f784d9e502475f8ac6607358efa9ca/config` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:40.808153 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be73972-f246-47f0-998a-0aeb9bde8d60 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=d1f784d9e502475f8ac6607358efa9ca)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:40.814431 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edb4b67-8f3d-4407-aad4-c8dd7a6d62d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:40.815685 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb4b67-8f3d-4407-aad4-c8dd7a6d62d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:40.816152 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb4b67-8f3d-4407-aad4-c8dd7a6d62d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:40.816627 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb4b67-8f3d-4407-aad4-c8dd7a6d62d6 admin admin] PATH_INFO: `/v3/projects/5f29dab7e48a4a9bba08ffffacbe5c8a` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:40.817602 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be73972-f246-47f0-998a-0aeb9bde8d60 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:40.818586 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edb4b67-8f3d-4407-aad4-c8dd7a6d62d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f29dab7e48a4a9bba08ffffacbe5c8a)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:40.822269 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edb4b67-8f3d-4407-aad4-c8dd7a6d62d6 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:40.901485 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3942/7874] 10.222.0.52 () {58 vars in 1250 bytes} [Sat May 14 21:41:40 2022] DELETE /identity/v3/domains/d1f784d9e502475f8ac6607358efa9ca/config => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:41:40.906615 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be73972-f246-47f0-998a-0aeb9bde8d60 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:40.919129 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be73972-f246-47f0-998a-0aeb9bde8d60 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:40.931427 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e74b34d-7e87-48cf-9625-4900c043757e tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:40.931427 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e74b34d-7e87-48cf-9625-4900c043757e tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:40.931427 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e74b34d-7e87-48cf-9625-4900c043757e tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:40.932055 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e74b34d-7e87-48cf-9625-4900c043757e tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/d1f784d9e502475f8ac6607358efa9ca` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:40.932055 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e74b34d-7e87-48cf-9625-4900c043757e tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=d1f784d9e502475f8ac6607358efa9ca)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:40.932055 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e74b34d-7e87-48cf-9625-4900c043757e tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:40.955949 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8e74b34d-7e87-48cf-9625-4900c043757e tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'd1f784d9e502475f8ac6607358efa9ca'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:40.956986 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8e74b34d-7e87-48cf-9625-4900c043757e tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'd1f784d9e502475f8ac6607358efa9ca'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:40.997204 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-8edb4b67-8f3d-4407-aad4-c8dd7a6d62d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f29dab7e48a4a9bba08ffffacbe5c8a', 'request_id': 'req-8edb4b67-8f3d-4407-aad4-c8dd7a6d62d6'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:41.006135 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-8edb4b67-8f3d-4407-aad4-c8dd7a6d62d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f29dab7e48a4a9bba08ffffacbe5c8a', 'request_id': 'req-8edb4b67-8f3d-4407-aad4-c8dd7a6d62d6'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:41.018239 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-8edb4b67-8f3d-4407-aad4-c8dd7a6d62d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f29dab7e48a4a9bba08ffffacbe5c8a', 'request_id': 'req-8edb4b67-8f3d-4407-aad4-c8dd7a6d62d6'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:41.092996 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8e74b34d-7e87-48cf-9625-4900c043757e tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'd1f784d9e502475f8ac6607358efa9ca'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:41.093732 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8e74b34d-7e87-48cf-9625-4900c043757e tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'd1f784d9e502475f8ac6607358efa9ca'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:41.097421 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3943/7875] 10.222.0.52 () {60 vars in 1248 bytes} [Sat May 14 21:41:40 2022] PATCH /identity/v3/domains/d1f784d9e502475f8ac6607358efa9ca => generated 276 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:41:41.104712 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e74b34d-7e87-48cf-9625-4900c043757e tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:41.115950 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-8e74b34d-7e87-48cf-9625-4900c043757e tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:41.116108 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-8edb4b67-8f3d-4407-aad4-c8dd7a6d62d6 admin admin] The token cache is being invalidate because project 5f29dab7e48a4a9bba08ffffacbe5c8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:41:41.116108 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-8edb4b67-8f3d-4407-aad4-c8dd7a6d62d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:41.116108 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-8edb4b67-8f3d-4407-aad4-c8dd7a6d62d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:41.116108 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3933/7876] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:41:40 2022] DELETE /identity/v3/projects/5f29dab7e48a4a9bba08ffffacbe5c8a => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:41:41.119759 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7415d84-0db1-4006-bd48-57b4701accfb None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:41.120592 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7415d84-0db1-4006-bd48-57b4701accfb None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:41.121111 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7415d84-0db1-4006-bd48-57b4701accfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:41.191594 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-f7415d84-0db1-4006-bd48-57b4701accfb None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:41:41.192996 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-f7415d84-0db1-4006-bd48-57b4701accfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:41.194271 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e74b34d-7e87-48cf-9625-4900c043757e tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:41.278422 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3934/7877] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:41:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:41:41.298314 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533fd22-1d3a-4a2b-9722-4d847e1590ba None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:41.298880 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533fd22-1d3a-4a2b-9722-4d847e1590ba None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:41.299339 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533fd22-1d3a-4a2b-9722-4d847e1590ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:41.307817 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5908caa7-1e98-42f6-8ec5-4db7722eb623 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:41.308716 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5908caa7-1e98-42f6-8ec5-4db7722eb623 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:41.309415 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5908caa7-1e98-42f6-8ec5-4db7722eb623 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:41.309415 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5908caa7-1e98-42f6-8ec5-4db7722eb623 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/d1f784d9e502475f8ac6607358efa9ca` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:41.324596 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5908caa7-1e98-42f6-8ec5-4db7722eb623 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=d1f784d9e502475f8ac6607358efa9ca)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:41.326445 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5908caa7-1e98-42f6-8ec5-4db7722eb623 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:41.335689 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-6533fd22-1d3a-4a2b-9722-4d847e1590ba None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:41:41.338389 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-6533fd22-1d3a-4a2b-9722-4d847e1590ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:41.353686 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3935/7878] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:41:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:41:41.358596 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6533fd22-1d3a-4a2b-9722-4d847e1590ba None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:41.358741 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5908caa7-1e98-42f6-8ec5-4db7722eb623 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'd1f784d9e502475f8ac6607358efa9ca'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:41.364705 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5908caa7-1e98-42f6-8ec5-4db7722eb623 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'd1f784d9e502475f8ac6607358efa9ca'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:41.375001 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6533fd22-1d3a-4a2b-9722-4d847e1590ba None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:41.386791 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c3ae60-63f3-44c7-ada2-a49a6868f9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:41.387505 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c3ae60-63f3-44c7-ada2-a49a6868f9da admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:41.387781 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c3ae60-63f3-44c7-ada2-a49a6868f9da admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:41.388221 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c3ae60-63f3-44c7-ada2-a49a6868f9da admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:41.391792 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c3ae60-63f3-44c7-ada2-a49a6868f9da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:41:41.404732 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c3ae60-63f3-44c7-ada2-a49a6868f9da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:41.407361 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c3ae60-63f3-44c7-ada2-a49a6868f9da admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:41.431599 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3936/7879] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:41:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:41:41.437366 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c3ae60-63f3-44c7-ada2-a49a6868f9da admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:41.451138 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c3ae60-63f3-44c7-ada2-a49a6868f9da admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:41.458730 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7450a8c3-b6e5-430f-873b-a9504d0bc086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:41.459420 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7450a8c3-b6e5-430f-873b-a9504d0bc086 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:41.459853 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7450a8c3-b6e5-430f-873b-a9504d0bc086 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:41.460087 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7450a8c3-b6e5-430f-873b-a9504d0bc086 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:41.460880 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7450a8c3-b6e5-430f-873b-a9504d0bc086 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:41.462915 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7450a8c3-b6e5-430f-873b-a9504d0bc086 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:41.494786 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5908caa7-1e98-42f6-8ec5-4db7722eb623 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1f784d9e502475f8ac6607358efa9ca', 'request_id': 'req-5908caa7-1e98-42f6-8ec5-4db7722eb623'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:41.505240 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5908caa7-1e98-42f6-8ec5-4db7722eb623 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1f784d9e502475f8ac6607358efa9ca', 'request_id': 'req-5908caa7-1e98-42f6-8ec5-4db7722eb623'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:41.560311 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3937/7880] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:41:41 2022] POST /identity/v3/projects => generated 379 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:41:41.565637 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7450a8c3-b6e5-430f-873b-a9504d0bc086 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:41.604579 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5908caa7-1e98-42f6-8ec5-4db7722eb623 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1f784d9e502475f8ac6607358efa9ca', 'request_id': 'req-5908caa7-1e98-42f6-8ec5-4db7722eb623'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:41.619617 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5908caa7-1e98-42f6-8ec5-4db7722eb623 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] The token cache is being invalidate because project d1f784d9e502475f8ac6607358efa9ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:41:41.619919 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5908caa7-1e98-42f6-8ec5-4db7722eb623 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:41.620593 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5908caa7-1e98-42f6-8ec5-4db7722eb623 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:41.631609 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5908caa7-1e98-42f6-8ec5-4db7722eb623 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'd1f784d9e502475f8ac6607358efa9ca', 'request_id': 'req-5908caa7-1e98-42f6-8ec5-4db7722eb623'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:41.632408 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5908caa7-1e98-42f6-8ec5-4db7722eb623 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'd1f784d9e502475f8ac6607358efa9ca', 'request_id': 'req-5908caa7-1e98-42f6-8ec5-4db7722eb623'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:41.636086 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5908caa7-1e98-42f6-8ec5-4db7722eb623 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'd1f784d9e502475f8ac6607358efa9ca', 'request_id': 'req-5908caa7-1e98-42f6-8ec5-4db7722eb623'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:41.645595 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3944/7881] 10.222.0.52 () {58 vars in 1229 bytes} [Sat May 14 21:41:41 2022] DELETE /identity/v3/domains/d1f784d9e502475f8ac6607358efa9ca => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:41:41.652237 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5908caa7-1e98-42f6-8ec5-4db7722eb623 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:41.654471 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-5908caa7-1e98-42f6-8ec5-4db7722eb623 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:41.671145 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7450a8c3-b6e5-430f-873b-a9504d0bc086 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:41.686764 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d92faed-0538-471f-ae97-5ef72e806039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:41.687512 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92faed-0538-471f-ae97-5ef72e806039 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:41.687805 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92faed-0538-471f-ae97-5ef72e806039 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:41.688082 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92faed-0538-471f-ae97-5ef72e806039 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:41.688795 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d92faed-0538-471f-ae97-5ef72e806039 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:41.690925 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d92faed-0538-471f-ae97-5ef72e806039 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:41.781819 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3938/7882] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:41:41 2022] POST /identity/v3/users => generated 290 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:41:41.784182 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d92faed-0538-471f-ae97-5ef72e806039 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:41.786810 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-6d92faed-0538-471f-ae97-5ef72e806039 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:41.809313 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5908caa7-1e98-42f6-8ec5-4db7722eb623 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:41.821802 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d92faed-0538-471f-ae97-5ef72e806039 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:41.831425 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f7f812-098e-4fe7-949d-5147ecd202fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:41.833458 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f7f812-098e-4fe7-949d-5147ecd202fe admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:41.836376 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f7f812-098e-4fe7-949d-5147ecd202fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:41.836721 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f7f812-098e-4fe7-949d-5147ecd202fe admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:41.837492 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f7f812-098e-4fe7-949d-5147ecd202fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:41.839219 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f7f812-098e-4fe7-949d-5147ecd202fe admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:41.880222 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3939/7883] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:41:41 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:41:41.881713 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f7f812-098e-4fe7-949d-5147ecd202fe admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:41.896508 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de345ca0-e8f4-4159-9a66-13ae05e814d3 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:41.897486 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de345ca0-e8f4-4159-9a66-13ae05e814d3 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:41.897878 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de345ca0-e8f4-4159-9a66-13ae05e814d3 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:41.899534 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f7f812-098e-4fe7-949d-5147ecd202fe admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:41.900039 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de345ca0-e8f4-4159-9a66-13ae05e814d3 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/config/default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:41.906627 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de345ca0-e8f4-4159-9a66-13ae05e814d3 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:get_domain_config_default()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:41.906627 ncdv-master-1 devstack@keystone.service[91106]: WARNING py.warnings [None req-de345ca0-e8f4-4159-9a66-13ae05e814d3 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:41:41.906627 ncdv-master-1 devstack@keystone.service[91106]: warnings.warn(msg) May 14 21:41:41.906627 ncdv-master-1 devstack@keystone.service[91106]: May 14 21:41:41.906627 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de345ca0-e8f4-4159-9a66-13ae05e814d3 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:41.912113 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3945/7884] 10.222.0.52 () {58 vars in 1172 bytes} [Sat May 14 21:41:41 2022] GET /identity/v3/domains/config/default => generated 1527 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:41:41.923776 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96e6a4a-93df-42e4-986f-796efab6f862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:41.927695 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e6a4a-93df-42e4-986f-796efab6f862 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:41.928203 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e6a4a-93df-42e4-986f-796efab6f862 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:41.928684 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e6a4a-93df-42e4-986f-796efab6f862 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:41.932381 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96e6a4a-93df-42e4-986f-796efab6f862 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:41.933184 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de345ca0-e8f4-4159-9a66-13ae05e814d3 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:41.937818 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96e6a4a-93df-42e4-986f-796efab6f862 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:41.955412 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3940/7885] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:41:41 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:41:41.968152 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96e6a4a-93df-42e4-986f-796efab6f862 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:41.969605 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de345ca0-e8f4-4159-9a66-13ae05e814d3 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:41.987121 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37a1d7c-2af4-4569-8b91-3e32f5a7db50 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:41.987937 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a1d7c-2af4-4569-8b91-3e32f5a7db50 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:41.988276 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a1d7c-2af4-4569-8b91-3e32f5a7db50 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:41.988556 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a1d7c-2af4-4569-8b91-3e32f5a7db50 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/config/identity/default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:41.989221 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37a1d7c-2af4-4569-8b91-3e32f5a7db50 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:41.991151 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37a1d7c-2af4-4569-8b91-3e32f5a7db50 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:41.994722 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3946/7886] 10.222.0.52 () {58 vars in 1199 bytes} [Sat May 14 21:41:41 2022] GET /identity/v3/domains/config/identity/default => generated 64 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 14 21:41:42.000004 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37a1d7c-2af4-4569-8b91-3e32f5a7db50 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:42.007300 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96e6a4a-93df-42e4-986f-796efab6f862 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:42.016837 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37a1d7c-2af4-4569-8b91-3e32f5a7db50 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:42.026469 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fbb22a-4c77-4ec8-bbf5-2ac41a196fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:42.026700 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7048e69-1553-466e-9322-f01f4460cc4d tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:42.026906 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fbb22a-4c77-4ec8-bbf5-2ac41a196fea admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:42.027075 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7048e69-1553-466e-9322-f01f4460cc4d tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:42.027234 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fbb22a-4c77-4ec8-bbf5-2ac41a196fea admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:42.027412 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7048e69-1553-466e-9322-f01f4460cc4d tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:42.027412 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7048e69-1553-466e-9322-f01f4460cc4d tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/config/identity/driver/default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:42.027700 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fbb22a-4c77-4ec8-bbf5-2ac41a196fea admin admin] PATH_INFO: `/v3/projects/54cdf3ac339f4e8a944bef073452c3ab/users/a84f5da000e5493a8b246eb1d7867dea/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:42.027863 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7048e69-1553-466e-9322-f01f4460cc4d tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=driver)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:42.028138 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7048e69-1553-466e-9322-f01f4460cc4d tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:42.029903 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3947/7887] 10.222.0.52 () {58 vars in 1220 bytes} [Sat May 14 21:41:41 2022] GET /identity/v3/domains/config/identity/driver/default => generated 30 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) May 14 21:41:42.035527 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7048e69-1553-466e-9322-f01f4460cc4d tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:42.054287 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7048e69-1553-466e-9322-f01f4460cc4d tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:42.061198 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83d3917-0530-4db8-a7e2-83626b427ff6 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:42.062451 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d3917-0530-4db8-a7e2-83626b427ff6 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:42.062815 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d3917-0530-4db8-a7e2-83626b427ff6 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:42.063177 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d3917-0530-4db8-a7e2-83626b427ff6 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/config/identity/list_limit/default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:42.064114 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83d3917-0530-4db8-a7e2-83626b427ff6 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=list_limit)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:42.064826 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fbb22a-4c77-4ec8-bbf5-2ac41a196fea admin admin] RBAC: Authorizing `identity:create_grant(project_id=54cdf3ac339f4e8a944bef073452c3ab, user_id=a84f5da000e5493a8b246eb1d7867dea, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:42.065787 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83d3917-0530-4db8-a7e2-83626b427ff6 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:42.067563 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3948/7888] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:41:42 2022] GET /identity/v3/domains/config/identity/list_limit/default => generated 33 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 14 21:41:42.069644 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fbb22a-4c77-4ec8-bbf5-2ac41a196fea admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:42.073878 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83d3917-0530-4db8-a7e2-83626b427ff6 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:42.087898 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83d3917-0530-4db8-a7e2-83626b427ff6 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:42.093999 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e17e8ac-0be1-4611-9e03-4ffa4a2a8ee5 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:42.094832 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e17e8ac-0be1-4611-9e03-4ffa4a2a8ee5 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:42.095196 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e17e8ac-0be1-4611-9e03-4ffa4a2a8ee5 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:42.095629 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e17e8ac-0be1-4611-9e03-4ffa4a2a8ee5 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/config/ldap/default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:42.096413 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e17e8ac-0be1-4611-9e03-4ffa4a2a8ee5 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:42.099155 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e17e8ac-0be1-4611-9e03-4ffa4a2a8ee5 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:42.101435 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3949/7889] 10.222.0.52 () {58 vars in 1187 bytes} [Sat May 14 21:41:42 2022] GET /identity/v3/domains/config/ldap/default => generated 1476 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:41:42.105654 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e17e8ac-0be1-4611-9e03-4ffa4a2a8ee5 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:42.121740 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e17e8ac-0be1-4611-9e03-4ffa4a2a8ee5 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:42.129615 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e904f8-d194-42dc-a8e2-d4a562aa34cc tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:42.132116 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e904f8-d194-42dc-a8e2-d4a562aa34cc tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:42.132479 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e904f8-d194-42dc-a8e2-d4a562aa34cc tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:42.133501 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e904f8-d194-42dc-a8e2-d4a562aa34cc tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/config/ldap/url/default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:42.134416 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e904f8-d194-42dc-a8e2-d4a562aa34cc tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=url)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:42.136255 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e904f8-d194-42dc-a8e2-d4a562aa34cc tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:42.137949 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3950/7890] 10.222.0.52 () {58 vars in 1199 bytes} [Sat May 14 21:41:42 2022] GET /identity/v3/domains/config/ldap/url/default => generated 40 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) May 14 21:41:42.142439 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e904f8-d194-42dc-a8e2-d4a562aa34cc tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:42.149236 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3941/7891] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:41:41 2022] PUT /identity/v3/projects/54cdf3ac339f4e8a944bef073452c3ab/users/a84f5da000e5493a8b246eb1d7867dea/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:41:42.155327 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e904f8-d194-42dc-a8e2-d4a562aa34cc tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:42.158066 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff6edc-5bca-4254-b93f-eea5e07c3a96 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:42.159131 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff6edc-5bca-4254-b93f-eea5e07c3a96 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:42.159669 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff6edc-5bca-4254-b93f-eea5e07c3a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:42.192646 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-0dff6edc-5bca-4254-b93f-eea5e07c3a96 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:41:42.194218 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-0dff6edc-5bca-4254-b93f-eea5e07c3a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:42.256087 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae675e19-f5a9-45e4-981b-90ed2849bc5e tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:42.256927 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae675e19-f5a9-45e4-981b-90ed2849bc5e tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:42.257215 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae675e19-f5a9-45e4-981b-90ed2849bc5e tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:42.257490 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae675e19-f5a9-45e4-981b-90ed2849bc5e tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/config/ldap/user/default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:42.258449 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae675e19-f5a9-45e4-981b-90ed2849bc5e tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:42.260313 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae675e19-f5a9-45e4-981b-90ed2849bc5e tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:42.261923 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3951/7892] 10.222.0.52 () {58 vars in 1202 bytes} [Sat May 14 21:41:42 2022] GET /identity/v3/domains/config/ldap/user/default => generated 27 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 14 21:41:42.266185 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae675e19-f5a9-45e4-981b-90ed2849bc5e tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:42.277724 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae675e19-f5a9-45e4-981b-90ed2849bc5e tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:42.284742 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff2fa08-b79b-43b8-8774-f6858e46649d tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:42.285935 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2fa08-b79b-43b8-8774-f6858e46649d tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:42.286290 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2fa08-b79b-43b8-8774-f6858e46649d tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:42.286634 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2fa08-b79b-43b8-8774-f6858e46649d tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/config/ldap/suffix/default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:42.287381 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff2fa08-b79b-43b8-8774-f6858e46649d tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=suffix)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:42.290255 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff2fa08-b79b-43b8-8774-f6858e46649d tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:42.290418 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3942/7893] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:41:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:41:42.294937 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3952/7894] 10.222.0.52 () {58 vars in 1208 bytes} [Sat May 14 21:41:42 2022] GET /identity/v3/domains/config/ldap/suffix/default => generated 44 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 14 21:41:42.296642 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dff6edc-5bca-4254-b93f-eea5e07c3a96 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:42.310503 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dff6edc-5bca-4254-b93f-eea5e07c3a96 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:42.321515 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7af79fd-7d96-454a-9360-95a3f2bf6b00 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:42.322607 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af79fd-7d96-454a-9360-95a3f2bf6b00 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:42.322898 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af79fd-7d96-454a-9360-95a3f2bf6b00 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:42.323226 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af79fd-7d96-454a-9360-95a3f2bf6b00 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/config/ldap/query_scope/default` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:42.324815 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7af79fd-7d96-454a-9360-95a3f2bf6b00 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=query_scope)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:42.325394 ncdv-master-1 devstack@keystone.service[91107]: WARNING py.warnings [None req-a7af79fd-7d96-454a-9360-95a3f2bf6b00 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:41:42.325394 ncdv-master-1 devstack@keystone.service[91107]: warnings.warn(msg) May 14 21:41:42.325394 ncdv-master-1 devstack@keystone.service[91107]: May 14 21:41:42.326348 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7af79fd-7d96-454a-9360-95a3f2bf6b00 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:42.328042 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3943/7895] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:41:42 2022] GET /identity/v3/domains/config/ldap/query_scope/default => generated 35 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 14 21:41:42.332456 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7af79fd-7d96-454a-9360-95a3f2bf6b00 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:42.334066 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff2fa08-b79b-43b8-8774-f6858e46649d tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:42.335515 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-a7af79fd-7d96-454a-9360-95a3f2bf6b00 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:42.351000 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff2fa08-b79b-43b8-8774-f6858e46649d tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:42.360950 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a514494-19d5-4709-b5c5-c4336a72bf18 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:42.361790 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a514494-19d5-4709-b5c5-c4336a72bf18 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:42.362204 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a514494-19d5-4709-b5c5-c4336a72bf18 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:42.362492 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a514494-19d5-4709-b5c5-c4336a72bf18 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/config/ldap/page_size/default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:42.367613 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a514494-19d5-4709-b5c5-c4336a72bf18 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=page_size)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:42.368749 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a514494-19d5-4709-b5c5-c4336a72bf18 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:42.374743 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3953/7896] 10.222.0.52 () {58 vars in 1217 bytes} [Sat May 14 21:41:42 2022] GET /identity/v3/domains/config/ldap/page_size/default => generated 29 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 14 21:41:42.377628 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a514494-19d5-4709-b5c5-c4336a72bf18 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:42.394463 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a514494-19d5-4709-b5c5-c4336a72bf18 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:42.403757 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70390d20-2e41-4547-aebb-5c5afce70d62 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:42.403992 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70390d20-2e41-4547-aebb-5c5afce70d62 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:42.404251 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70390d20-2e41-4547-aebb-5c5afce70d62 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:42.404529 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70390d20-2e41-4547-aebb-5c5afce70d62 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/config/ldap/alias_dereferencing/default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:42.405920 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70390d20-2e41-4547-aebb-5c5afce70d62 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=alias_dereferencing)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:42.408546 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70390d20-2e41-4547-aebb-5c5afce70d62 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:42.411086 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3954/7897] 10.222.0.52 () {58 vars in 1247 bytes} [Sat May 14 21:41:42 2022] GET /identity/v3/domains/config/ldap/alias_dereferencing/default => generated 47 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 14 21:41:42.414204 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70390d20-2e41-4547-aebb-5c5afce70d62 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:42.424699 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7af79fd-7d96-454a-9360-95a3f2bf6b00 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:42.426405 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70390d20-2e41-4547-aebb-5c5afce70d62 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:42.428819 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb5c235-b383-4314-8ede-1f99d7cc33a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:42.430495 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb5c235-b383-4314-8ede-1f99d7cc33a2 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:42.430908 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb5c235-b383-4314-8ede-1f99d7cc33a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:42.431286 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb5c235-b383-4314-8ede-1f99d7cc33a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:42.435262 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca78f269-bb52-4a90-af2d-601f44d3371f tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:42.436290 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78f269-bb52-4a90-af2d-601f44d3371f tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:42.436722 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78f269-bb52-4a90-af2d-601f44d3371f tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:42.437813 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78f269-bb52-4a90-af2d-601f44d3371f tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/config/ldap/debug_level/default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:42.442919 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca78f269-bb52-4a90-af2d-601f44d3371f tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=debug_level)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:42.442919 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca78f269-bb52-4a90-af2d-601f44d3371f tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:42.444280 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3955/7898] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:41:42 2022] GET /identity/v3/domains/config/ldap/debug_level/default => generated 34 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 14 21:41:42.450100 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca78f269-bb52-4a90-af2d-601f44d3371f tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:42.458466 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb5c235-b383-4314-8ede-1f99d7cc33a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:42.462695 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb5c235-b383-4314-8ede-1f99d7cc33a2 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:42.464454 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca78f269-bb52-4a90-af2d-601f44d3371f tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:42.477669 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3944/7899] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:41:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:41:42.480019 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ff36e6-822a-4cdf-bc22-b2baddef5dcf tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:42.481124 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff36e6-822a-4cdf-bc22-b2baddef5dcf tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:42.482023 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff36e6-822a-4cdf-bc22-b2baddef5dcf tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:42.482438 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff36e6-822a-4cdf-bc22-b2baddef5dcf tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/config/ldap/chase_referrals/default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:42.483308 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ff36e6-822a-4cdf-bc22-b2baddef5dcf tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=chase_referrals)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:42.485247 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ff36e6-822a-4cdf-bc22-b2baddef5dcf tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:42.489828 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3956/7900] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:41:42 2022] GET /identity/v3/domains/config/ldap/chase_referrals/default => generated 38 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 14 21:41:42.491235 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb5c235-b383-4314-8ede-1f99d7cc33a2 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:42.505172 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb5c235-b383-4314-8ede-1f99d7cc33a2 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:42.511592 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a734b6-6ef2-477b-9b25-f2f58a16cd36 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:42.512843 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a734b6-6ef2-477b-9b25-f2f58a16cd36 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:42.513137 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a734b6-6ef2-477b-9b25-f2f58a16cd36 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:42.513420 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a734b6-6ef2-477b-9b25-f2f58a16cd36 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_tree_dn/default` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:42.514253 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a734b6-6ef2-477b-9b25-f2f58a16cd36 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_tree_dn)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:42.516203 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a734b6-6ef2-477b-9b25-f2f58a16cd36 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:42.517614 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3945/7901] 10.222.0.52 () {58 vars in 1226 bytes} [Sat May 14 21:41:42 2022] GET /identity/v3/domains/config/ldap/user_tree_dn/default => generated 35 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 14 21:41:42.521701 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ff36e6-822a-4cdf-bc22-b2baddef5dcf tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:42.537051 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ff36e6-822a-4cdf-bc22-b2baddef5dcf tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:42.543102 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f533b598-273e-49f1-a9b6-ff9bde5c81d6 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:42.543102 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533b598-273e-49f1-a9b6-ff9bde5c81d6 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:42.543370 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533b598-273e-49f1-a9b6-ff9bde5c81d6 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:42.543663 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533b598-273e-49f1-a9b6-ff9bde5c81d6 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_filter/default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:42.544319 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f533b598-273e-49f1-a9b6-ff9bde5c81d6 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_filter)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:42.545923 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f533b598-273e-49f1-a9b6-ff9bde5c81d6 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:42.547087 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3957/7902] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:41:42 2022] GET /identity/v3/domains/config/ldap/user_filter/default => generated 34 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 14 21:41:42.551091 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a734b6-6ef2-477b-9b25-f2f58a16cd36 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:42.565483 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a734b6-6ef2-477b-9b25-f2f58a16cd36 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:42.571722 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd31b5cd-ac8c-4550-a3f9-68bde9ecabfa tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:42.572523 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd31b5cd-ac8c-4550-a3f9-68bde9ecabfa tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:42.572806 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd31b5cd-ac8c-4550-a3f9-68bde9ecabfa tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:42.573080 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd31b5cd-ac8c-4550-a3f9-68bde9ecabfa tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_objectclass/default` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:42.574912 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd31b5cd-ac8c-4550-a3f9-68bde9ecabfa tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_objectclass)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:42.575716 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd31b5cd-ac8c-4550-a3f9-68bde9ecabfa tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:42.576993 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3946/7903] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:41:42 2022] GET /identity/v3/domains/config/ldap/user_objectclass/default => generated 50 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 14 21:41:42.581478 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f533b598-273e-49f1-a9b6-ff9bde5c81d6 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:42.592962 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f533b598-273e-49f1-a9b6-ff9bde5c81d6 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:42.598572 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eaf2da-45d4-481f-b778-428ce8fc9b73 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:42.599429 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eaf2da-45d4-481f-b778-428ce8fc9b73 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:42.599980 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eaf2da-45d4-481f-b778-428ce8fc9b73 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:42.600330 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eaf2da-45d4-481f-b778-428ce8fc9b73 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_id_attribute/default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:42.601055 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eaf2da-45d4-481f-b778-428ce8fc9b73 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_id_attribute)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:42.603241 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eaf2da-45d4-481f-b778-428ce8fc9b73 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:42.609362 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3958/7904] 10.222.0.52 () {58 vars in 1241 bytes} [Sat May 14 21:41:42 2022] GET /identity/v3/domains/config/ldap/user_id_attribute/default => generated 40 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) May 14 21:41:42.612308 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd31b5cd-ac8c-4550-a3f9-68bde9ecabfa tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:42.624118 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd31b5cd-ac8c-4550-a3f9-68bde9ecabfa tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:42.629342 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc63a97e-ae30-4fe4-82f6-fd7a78286878 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:42.630505 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc63a97e-ae30-4fe4-82f6-fd7a78286878 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:42.630624 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc63a97e-ae30-4fe4-82f6-fd7a78286878 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:42.630914 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc63a97e-ae30-4fe4-82f6-fd7a78286878 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_name_attribute/default` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:42.631617 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc63a97e-ae30-4fe4-82f6-fd7a78286878 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_name_attribute)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:42.633816 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc63a97e-ae30-4fe4-82f6-fd7a78286878 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:42.637963 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3947/7905] 10.222.0.52 () {58 vars in 1247 bytes} [Sat May 14 21:41:42 2022] GET /identity/v3/domains/config/ldap/user_name_attribute/default => generated 42 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 14 21:41:42.639718 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eaf2da-45d4-481f-b778-428ce8fc9b73 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:42.651288 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eaf2da-45d4-481f-b778-428ce8fc9b73 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:42.658128 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d32a65-f1ef-4354-850b-e08a7dc48dc0 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:42.658931 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d32a65-f1ef-4354-850b-e08a7dc48dc0 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:42.659234 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d32a65-f1ef-4354-850b-e08a7dc48dc0 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:42.659543 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d32a65-f1ef-4354-850b-e08a7dc48dc0 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_mail_attribute/default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:42.660204 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d32a65-f1ef-4354-850b-e08a7dc48dc0 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_mail_attribute)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:42.661920 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d32a65-f1ef-4354-850b-e08a7dc48dc0 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:42.664265 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3959/7906] 10.222.0.52 () {58 vars in 1247 bytes} [Sat May 14 21:41:42 2022] GET /identity/v3/domains/config/ldap/user_mail_attribute/default => generated 44 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 14 21:41:42.677688 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc63a97e-ae30-4fe4-82f6-fd7a78286878 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:42.688809 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc63a97e-ae30-4fe4-82f6-fd7a78286878 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:42.693825 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8492d42-ff58-4383-bff7-028ca76508ae tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:42.694933 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8492d42-ff58-4383-bff7-028ca76508ae tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:42.694933 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8492d42-ff58-4383-bff7-028ca76508ae tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:42.695251 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8492d42-ff58-4383-bff7-028ca76508ae tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_description_attribute/default` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:42.696813 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8492d42-ff58-4383-bff7-028ca76508ae tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_description_attribute)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:42.698448 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8492d42-ff58-4383-bff7-028ca76508ae tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:42.699796 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3948/7907] 10.222.0.52 () {58 vars in 1268 bytes} [Sat May 14 21:41:42 2022] GET /identity/v3/domains/config/ldap/user_description_attribute/default => generated 58 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 14 21:41:42.708568 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d32a65-f1ef-4354-850b-e08a7dc48dc0 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:42.719117 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d32a65-f1ef-4354-850b-e08a7dc48dc0 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:42.724057 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c482642-5555-4d80-9671-2e5fcde71694 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:42.724852 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c482642-5555-4d80-9671-2e5fcde71694 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:42.725134 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c482642-5555-4d80-9671-2e5fcde71694 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:42.725413 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c482642-5555-4d80-9671-2e5fcde71694 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_pass_attribute/default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:42.726999 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c482642-5555-4d80-9671-2e5fcde71694 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_pass_attribute)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:42.728966 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c482642-5555-4d80-9671-2e5fcde71694 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:42.730291 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3960/7908] 10.222.0.52 () {58 vars in 1247 bytes} [Sat May 14 21:41:42 2022] GET /identity/v3/domains/config/ldap/user_pass_attribute/default => generated 52 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) May 14 21:41:42.734120 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8492d42-ff58-4383-bff7-028ca76508ae tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:42.745365 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8492d42-ff58-4383-bff7-028ca76508ae tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:42.750542 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39baffc7-9b17-433a-87b4-e47d18dbb24f tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:42.751736 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39baffc7-9b17-433a-87b4-e47d18dbb24f tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:42.752005 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39baffc7-9b17-433a-87b4-e47d18dbb24f tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:42.752278 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39baffc7-9b17-433a-87b4-e47d18dbb24f tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_attribute/default` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:42.752929 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39baffc7-9b17-433a-87b4-e47d18dbb24f tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_attribute)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:42.758880 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39baffc7-9b17-433a-87b4-e47d18dbb24f tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:42.758880 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3949/7909] 10.222.0.52 () {58 vars in 1256 bytes} [Sat May 14 21:41:42 2022] GET /identity/v3/domains/config/ldap/user_enabled_attribute/default => generated 50 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 14 21:41:42.760438 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c482642-5555-4d80-9671-2e5fcde71694 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:42.771776 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c482642-5555-4d80-9671-2e5fcde71694 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:42.778160 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954fa5a1-ed5a-4a4e-88a7-d96578937c2e tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:42.779230 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954fa5a1-ed5a-4a4e-88a7-d96578937c2e tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:42.779573 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954fa5a1-ed5a-4a4e-88a7-d96578937c2e tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:42.780351 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954fa5a1-ed5a-4a4e-88a7-d96578937c2e tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_invert/default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:42.780881 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954fa5a1-ed5a-4a4e-88a7-d96578937c2e tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_invert)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:42.782794 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954fa5a1-ed5a-4a4e-88a7-d96578937c2e tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:42.783915 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3961/7910] 10.222.0.52 () {58 vars in 1247 bytes} [Sat May 14 21:41:42 2022] GET /identity/v3/domains/config/ldap/user_enabled_invert/default => generated 43 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 14 21:41:42.787955 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39baffc7-9b17-433a-87b4-e47d18dbb24f tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:42.800893 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39baffc7-9b17-433a-87b4-e47d18dbb24f tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:42.806540 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6196010-e116-4a88-9704-330ad4ce2f3c tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:42.807593 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6196010-e116-4a88-9704-330ad4ce2f3c tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:42.807730 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6196010-e116-4a88-9704-330ad4ce2f3c tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:42.807975 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6196010-e116-4a88-9704-330ad4ce2f3c tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_mask/default` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:42.808628 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6196010-e116-4a88-9704-330ad4ce2f3c tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_mask)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:42.810244 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6196010-e116-4a88-9704-330ad4ce2f3c tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:42.814318 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3950/7911] 10.222.0.52 () {58 vars in 1241 bytes} [Sat May 14 21:41:42 2022] GET /identity/v3/domains/config/ldap/user_enabled_mask/default => generated 37 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 14 21:41:42.819801 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954fa5a1-ed5a-4a4e-88a7-d96578937c2e tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:42.826398 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954fa5a1-ed5a-4a4e-88a7-d96578937c2e tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:42.831134 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c238ef92-a3ca-4900-935f-ea2e68c41dfc tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:42.831957 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c238ef92-a3ca-4900-935f-ea2e68c41dfc tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:42.832238 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c238ef92-a3ca-4900-935f-ea2e68c41dfc tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:42.832513 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c238ef92-a3ca-4900-935f-ea2e68c41dfc tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_default/default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:42.833192 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c238ef92-a3ca-4900-935f-ea2e68c41dfc tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_default)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:42.834780 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c238ef92-a3ca-4900-935f-ea2e68c41dfc tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:42.836410 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3962/7912] 10.222.0.52 () {58 vars in 1250 bytes} [Sat May 14 21:41:42 2022] GET /identity/v3/domains/config/ldap/user_enabled_default/default => generated 45 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 14 21:41:42.840338 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6196010-e116-4a88-9704-330ad4ce2f3c tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:42.851289 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6196010-e116-4a88-9704-330ad4ce2f3c tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:42.857705 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d7b83f-2afb-4925-9176-f20bd3f0796a tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:42.858552 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d7b83f-2afb-4925-9176-f20bd3f0796a tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:42.858833 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d7b83f-2afb-4925-9176-f20bd3f0796a tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:42.859111 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d7b83f-2afb-4925-9176-f20bd3f0796a tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_attribute_ignore/default` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:42.859794 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d7b83f-2afb-4925-9176-f20bd3f0796a tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_attribute_ignore)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:42.861460 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d7b83f-2afb-4925-9176-f20bd3f0796a tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:42.862885 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3951/7913] 10.222.0.52 () {58 vars in 1253 bytes} [Sat May 14 21:41:42 2022] GET /identity/v3/domains/config/ldap/user_attribute_ignore/default => generated 62 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 14 21:41:42.866989 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c238ef92-a3ca-4900-935f-ea2e68c41dfc tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:42.879141 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c238ef92-a3ca-4900-935f-ea2e68c41dfc tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:42.885034 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455d451e-edf1-4ea3-b970-7b97b5b5b94b tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:42.885949 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d451e-edf1-4ea3-b970-7b97b5b5b94b tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:42.886490 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d451e-edf1-4ea3-b970-7b97b5b5b94b tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:42.886595 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d451e-edf1-4ea3-b970-7b97b5b5b94b tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_default_project_id_attribute/default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:42.887699 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455d451e-edf1-4ea3-b970-7b97b5b5b94b tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_default_project_id_attribute)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:42.889406 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455d451e-edf1-4ea3-b970-7b97b5b5b94b tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:42.890630 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3963/7914] 10.222.0.52 () {58 vars in 1289 bytes} [Sat May 14 21:41:42 2022] GET /identity/v3/domains/config/ldap/user_default_project_id_attribute/default => generated 56 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 14 21:41:42.894747 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d7b83f-2afb-4925-9176-f20bd3f0796a tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:42.906526 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d7b83f-2afb-4925-9176-f20bd3f0796a tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:42.911691 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3682ffc9-7c7b-4dce-9c3d-a6068114ed88 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:42.912588 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3682ffc9-7c7b-4dce-9c3d-a6068114ed88 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:42.912881 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3682ffc9-7c7b-4dce-9c3d-a6068114ed88 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:42.913165 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3682ffc9-7c7b-4dce-9c3d-a6068114ed88 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation/default` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:42.913862 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3682ffc9-7c7b-4dce-9c3d-a6068114ed88 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:42.915683 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3682ffc9-7c7b-4dce-9c3d-a6068114ed88 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:42.916946 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3952/7915] 10.222.0.52 () {58 vars in 1256 bytes} [Sat May 14 21:41:42 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation/default => generated 46 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 14 21:41:42.923911 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455d451e-edf1-4ea3-b970-7b97b5b5b94b tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:42.941541 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455d451e-edf1-4ea3-b970-7b97b5b5b94b tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:42.941541 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a3319a-a033-4f8b-ab10-939fc3091d87 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:42.942077 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a3319a-a033-4f8b-ab10-939fc3091d87 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:42.942433 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a3319a-a033-4f8b-ab10-939fc3091d87 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:42.942798 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a3319a-a033-4f8b-ab10-939fc3091d87 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_dn/default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:42.943576 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a3319a-a033-4f8b-ab10-939fc3091d87 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_dn)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:42.945834 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a3319a-a033-4f8b-ab10-939fc3091d87 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:42.952533 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3964/7916] 10.222.0.52 () {58 vars in 1265 bytes} [Sat May 14 21:41:42 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_dn/default => generated 48 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 14 21:41:42.953559 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3682ffc9-7c7b-4dce-9c3d-a6068114ed88 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:42.962671 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3682ffc9-7c7b-4dce-9c3d-a6068114ed88 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:42.968072 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35a0fb3-3284-4e5f-8f9b-5632acac3b62 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:42.970913 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a0fb3-3284-4e5f-8f9b-5632acac3b62 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:42.970913 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a0fb3-3284-4e5f-8f9b-5632acac3b62 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:42.970913 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a0fb3-3284-4e5f-8f9b-5632acac3b62 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:42.970913 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35a0fb3-3284-4e5f-8f9b-5632acac3b62 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_use_group_config)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:42.971968 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35a0fb3-3284-4e5f-8f9b-5632acac3b62 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:42.973535 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3953/7917] 10.222.0.52 () {58 vars in 1307 bytes} [Sat May 14 21:41:42 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default => generated 63 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 14 21:41:42.978423 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a3319a-a033-4f8b-ab10-939fc3091d87 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:42.989372 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a3319a-a033-4f8b-ab10-939fc3091d87 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:42.994897 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451df02a-9b92-4044-8436-fc45fef9e1cd tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:42.995780 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451df02a-9b92-4044-8436-fc45fef9e1cd tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:42.996097 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451df02a-9b92-4044-8436-fc45fef9e1cd tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:42.996397 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451df02a-9b92-4044-8436-fc45fef9e1cd tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_additional_attribute_mapping/default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:42.997049 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451df02a-9b92-4044-8436-fc45fef9e1cd tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_additional_attribute_mapping)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:42.998782 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451df02a-9b92-4044-8436-fc45fef9e1cd tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:42.999979 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3965/7918] 10.222.0.52 () {58 vars in 1289 bytes} [Sat May 14 21:41:42 2022] GET /identity/v3/domains/config/ldap/user_additional_attribute_mapping/default => generated 54 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 14 21:41:43.004131 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35a0fb3-3284-4e5f-8f9b-5632acac3b62 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:43.015948 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35a0fb3-3284-4e5f-8f9b-5632acac3b62 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:43.022079 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea0c9f7-3ec4-45c9-b9ac-021b6d4520ed tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:43.023021 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea0c9f7-3ec4-45c9-b9ac-021b6d4520ed tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:43.023403 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea0c9f7-3ec4-45c9-b9ac-021b6d4520ed tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:43.024223 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea0c9f7-3ec4-45c9-b9ac-021b6d4520ed tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_tree_dn/default` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:43.024909 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea0c9f7-3ec4-45c9-b9ac-021b6d4520ed tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_tree_dn)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:43.026541 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea0c9f7-3ec4-45c9-b9ac-021b6d4520ed tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:43.027794 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3954/7919] 10.222.0.52 () {58 vars in 1229 bytes} [Sat May 14 21:41:43 2022] GET /identity/v3/domains/config/ldap/group_tree_dn/default => generated 36 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 14 21:41:43.031816 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451df02a-9b92-4044-8436-fc45fef9e1cd tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:43.042305 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451df02a-9b92-4044-8436-fc45fef9e1cd tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:43.047465 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726987ea-e849-448f-9d07-b10ebc747791 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:43.047998 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726987ea-e849-448f-9d07-b10ebc747791 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:43.048286 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726987ea-e849-448f-9d07-b10ebc747791 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:43.048565 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726987ea-e849-448f-9d07-b10ebc747791 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_filter/default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:43.049368 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726987ea-e849-448f-9d07-b10ebc747791 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_filter)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:43.050973 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726987ea-e849-448f-9d07-b10ebc747791 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:43.052170 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3966/7920] 10.222.0.52 () {58 vars in 1226 bytes} [Sat May 14 21:41:43 2022] GET /identity/v3/domains/config/ldap/group_filter/default => generated 35 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) May 14 21:41:43.056448 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea0c9f7-3ec4-45c9-b9ac-021b6d4520ed tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:43.067019 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea0c9f7-3ec4-45c9-b9ac-021b6d4520ed tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:43.072851 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dff4c5-89af-40ae-92b9-e142cc555e95 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:43.080713 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dff4c5-89af-40ae-92b9-e142cc555e95 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:43.080713 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dff4c5-89af-40ae-92b9-e142cc555e95 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:43.080713 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dff4c5-89af-40ae-92b9-e142cc555e95 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_objectclass/default` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:43.080713 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dff4c5-89af-40ae-92b9-e142cc555e95 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_objectclass)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:43.081108 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dff4c5-89af-40ae-92b9-e142cc555e95 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:43.081108 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3955/7921] 10.222.0.52 () {58 vars in 1241 bytes} [Sat May 14 21:41:43 2022] GET /identity/v3/domains/config/ldap/group_objectclass/default => generated 50 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) May 14 21:41:43.083161 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726987ea-e849-448f-9d07-b10ebc747791 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:43.093819 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726987ea-e849-448f-9d07-b10ebc747791 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:43.098792 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd67386b-7510-4bd8-af37-777aaf68b3af tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:43.099548 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd67386b-7510-4bd8-af37-777aaf68b3af tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:43.099883 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd67386b-7510-4bd8-af37-777aaf68b3af tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:43.100162 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd67386b-7510-4bd8-af37-777aaf68b3af tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_id_attribute/default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:43.100820 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd67386b-7510-4bd8-af37-777aaf68b3af tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_id_attribute)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:43.103258 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd67386b-7510-4bd8-af37-777aaf68b3af tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:43.104627 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3967/7922] 10.222.0.52 () {58 vars in 1244 bytes} [Sat May 14 21:41:43 2022] GET /identity/v3/domains/config/ldap/group_id_attribute/default => generated 41 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) May 14 21:41:43.108581 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dff4c5-89af-40ae-92b9-e142cc555e95 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:43.119820 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dff4c5-89af-40ae-92b9-e142cc555e95 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:43.124586 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d1f6ae-4734-4225-9df6-3dda0c989f5b tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:43.125387 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d1f6ae-4734-4225-9df6-3dda0c989f5b tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:43.125678 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d1f6ae-4734-4225-9df6-3dda0c989f5b tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:43.125956 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d1f6ae-4734-4225-9df6-3dda0c989f5b tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_name_attribute/default` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:43.126608 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d1f6ae-4734-4225-9df6-3dda0c989f5b tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_name_attribute)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:43.128301 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d1f6ae-4734-4225-9df6-3dda0c989f5b tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:43.129740 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3956/7923] 10.222.0.52 () {58 vars in 1250 bytes} [Sat May 14 21:41:43 2022] GET /identity/v3/domains/config/ldap/group_name_attribute/default => generated 43 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 14 21:41:43.133716 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd67386b-7510-4bd8-af37-777aaf68b3af tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:43.144284 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd67386b-7510-4bd8-af37-777aaf68b3af tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:43.150808 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76799c1e-af25-4461-9165-24411bb2c925 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:43.151670 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76799c1e-af25-4461-9165-24411bb2c925 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:43.151956 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76799c1e-af25-4461-9165-24411bb2c925 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:43.152233 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76799c1e-af25-4461-9165-24411bb2c925 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_members_are_ids/default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:43.152878 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76799c1e-af25-4461-9165-24411bb2c925 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_members_are_ids)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:43.154453 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76799c1e-af25-4461-9165-24411bb2c925 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:43.155603 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3968/7924] 10.222.0.52 () {58 vars in 1253 bytes} [Sat May 14 21:41:43 2022] GET /identity/v3/domains/config/ldap/group_members_are_ids/default => generated 45 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 14 21:41:43.159725 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d1f6ae-4734-4225-9df6-3dda0c989f5b tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:43.171631 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d1f6ae-4734-4225-9df6-3dda0c989f5b tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:43.177443 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d462705-bb4e-459c-ae86-2b33b2e8a4db tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:43.178187 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d462705-bb4e-459c-ae86-2b33b2e8a4db tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:43.178469 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d462705-bb4e-459c-ae86-2b33b2e8a4db tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:43.178741 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d462705-bb4e-459c-ae86-2b33b2e8a4db tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_member_attribute/default` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:43.179390 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d462705-bb4e-459c-ae86-2b33b2e8a4db tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_member_attribute)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:43.181456 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d462705-bb4e-459c-ae86-2b33b2e8a4db tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:43.182768 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3957/7925] 10.222.0.52 () {58 vars in 1256 bytes} [Sat May 14 21:41:43 2022] GET /identity/v3/domains/config/ldap/group_member_attribute/default => generated 49 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 14 21:41:43.186966 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76799c1e-af25-4461-9165-24411bb2c925 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:43.197545 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76799c1e-af25-4461-9165-24411bb2c925 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:43.205913 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec6da46-5a46-4f6f-97a5-1ac0868cb2f5 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:43.206840 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec6da46-5a46-4f6f-97a5-1ac0868cb2f5 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:43.207147 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec6da46-5a46-4f6f-97a5-1ac0868cb2f5 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:43.207452 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec6da46-5a46-4f6f-97a5-1ac0868cb2f5 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_desc_attribute/default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:43.208136 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec6da46-5a46-4f6f-97a5-1ac0868cb2f5 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_desc_attribute)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:43.209757 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec6da46-5a46-4f6f-97a5-1ac0868cb2f5 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:43.214505 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3969/7926] 10.222.0.52 () {58 vars in 1250 bytes} [Sat May 14 21:41:43 2022] GET /identity/v3/domains/config/ldap/group_desc_attribute/default => generated 52 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 14 21:41:43.215863 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d462705-bb4e-459c-ae86-2b33b2e8a4db tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:43.225983 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d462705-bb4e-459c-ae86-2b33b2e8a4db tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:43.231711 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e18747-a677-489d-854a-3a1a8e170a2d tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:43.232589 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e18747-a677-489d-854a-3a1a8e170a2d tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:43.234858 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e18747-a677-489d-854a-3a1a8e170a2d tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:43.234858 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e18747-a677-489d-854a-3a1a8e170a2d tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_attribute_ignore/default` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:43.234858 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e18747-a677-489d-854a-3a1a8e170a2d tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_attribute_ignore)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:43.235557 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e18747-a677-489d-854a-3a1a8e170a2d tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:43.240662 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3958/7927] 10.222.0.52 () {58 vars in 1256 bytes} [Sat May 14 21:41:43 2022] GET /identity/v3/domains/config/ldap/group_attribute_ignore/default => generated 43 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 14 21:41:43.245992 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec6da46-5a46-4f6f-97a5-1ac0868cb2f5 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:43.257576 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec6da46-5a46-4f6f-97a5-1ac0868cb2f5 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:43.264715 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b1ee1-12e8-4b5a-9246-8996440b7b58 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:43.265652 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b1ee1-12e8-4b5a-9246-8996440b7b58 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:43.266034 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b1ee1-12e8-4b5a-9246-8996440b7b58 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:43.266348 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b1ee1-12e8-4b5a-9246-8996440b7b58 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_additional_attribute_mapping/default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:43.267077 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911b1ee1-12e8-4b5a-9246-8996440b7b58 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_additional_attribute_mapping)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:43.268841 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911b1ee1-12e8-4b5a-9246-8996440b7b58 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:43.274651 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3970/7928] 10.222.0.52 () {58 vars in 1292 bytes} [Sat May 14 21:41:43 2022] GET /identity/v3/domains/config/ldap/group_additional_attribute_mapping/default => generated 55 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 14 21:41:43.275766 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e18747-a677-489d-854a-3a1a8e170a2d tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:43.293314 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e18747-a677-489d-854a-3a1a8e170a2d tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:43.298426 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370a455-90dd-4802-ae1a-b0652ea9264b tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:43.299365 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370a455-90dd-4802-ae1a-b0652ea9264b tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:43.299804 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370a455-90dd-4802-ae1a-b0652ea9264b tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:43.300208 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370a455-90dd-4802-ae1a-b0652ea9264b tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertfile/default` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:43.300932 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4370a455-90dd-4802-ae1a-b0652ea9264b tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertfile)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:43.302666 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4370a455-90dd-4802-ae1a-b0652ea9264b tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:43.304033 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3959/7929] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:41:43 2022] GET /identity/v3/domains/config/ldap/tls_cacertfile/default => generated 37 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) May 14 21:41:43.308234 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b1ee1-12e8-4b5a-9246-8996440b7b58 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:43.318965 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b1ee1-12e8-4b5a-9246-8996440b7b58 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:43.324180 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d0a753-edb7-4d77-b367-c34e86c733ee tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:43.324975 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d0a753-edb7-4d77-b367-c34e86c733ee tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:43.325550 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d0a753-edb7-4d77-b367-c34e86c733ee tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:43.325808 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d0a753-edb7-4d77-b367-c34e86c733ee tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertdir/default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:43.326448 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d0a753-edb7-4d77-b367-c34e86c733ee tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertdir)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:43.328073 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d0a753-edb7-4d77-b367-c34e86c733ee tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:43.329348 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3971/7930] 10.222.0.52 () {58 vars in 1229 bytes} [Sat May 14 21:41:43 2022] GET /identity/v3/domains/config/ldap/tls_cacertdir/default => generated 36 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 14 21:41:43.333125 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370a455-90dd-4802-ae1a-b0652ea9264b tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:43.348841 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370a455-90dd-4802-ae1a-b0652ea9264b tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:43.352967 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9281ddf3-da75-4404-afb5-cc24c36fab69 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:43.354007 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9281ddf3-da75-4404-afb5-cc24c36fab69 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:43.354672 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9281ddf3-da75-4404-afb5-cc24c36fab69 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:43.355280 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9281ddf3-da75-4404-afb5-cc24c36fab69 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_tls/default` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:43.356443 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9281ddf3-da75-4404-afb5-cc24c36fab69 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_tls)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:43.358416 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9281ddf3-da75-4404-afb5-cc24c36fab69 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:43.360251 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3960/7931] 10.222.0.52 () {58 vars in 1211 bytes} [Sat May 14 21:41:43 2022] GET /identity/v3/domains/config/ldap/use_tls/default => generated 31 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 14 21:41:43.364707 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d0a753-edb7-4d77-b367-c34e86c733ee tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:43.379464 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d0a753-edb7-4d77-b367-c34e86c733ee tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:43.387807 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3924b7b3-d933-4b3b-83d0-295d55d0bd87 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:43.388711 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3924b7b3-d933-4b3b-83d0-295d55d0bd87 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:43.389080 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3924b7b3-d933-4b3b-83d0-295d55d0bd87 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:43.389422 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3924b7b3-d933-4b3b-83d0-295d55d0bd87 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_req_cert/default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:43.390778 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3924b7b3-d933-4b3b-83d0-295d55d0bd87 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_req_cert)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:43.392661 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3924b7b3-d933-4b3b-83d0-295d55d0bd87 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:43.397860 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3972/7932] 10.222.0.52 () {58 vars in 1226 bytes} [Sat May 14 21:41:43 2022] GET /identity/v3/domains/config/ldap/tls_req_cert/default => generated 39 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 14 21:41:43.399777 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9281ddf3-da75-4404-afb5-cc24c36fab69 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:43.415666 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9281ddf3-da75-4404-afb5-cc24c36fab69 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:43.422228 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2613117-45b6-4db0-a5c2-a296de439f7a tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:43.423521 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2613117-45b6-4db0-a5c2-a296de439f7a tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:43.424037 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2613117-45b6-4db0-a5c2-a296de439f7a tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:43.424600 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2613117-45b6-4db0-a5c2-a296de439f7a tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_pool/default` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:43.425475 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2613117-45b6-4db0-a5c2-a296de439f7a tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_pool)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:43.428448 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2613117-45b6-4db0-a5c2-a296de439f7a tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:43.436593 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3961/7933] 10.222.0.52 () {58 vars in 1214 bytes} [Sat May 14 21:41:43 2022] GET /identity/v3/domains/config/ldap/use_pool/default => generated 31 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 14 21:41:43.436891 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3924b7b3-d933-4b3b-83d0-295d55d0bd87 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:43.448791 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3924b7b3-d933-4b3b-83d0-295d55d0bd87 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:43.457727 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7392300-8e0b-4b9c-8a9a-e56ffb861070 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:43.458535 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7392300-8e0b-4b9c-8a9a-e56ffb861070 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:43.458821 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7392300-8e0b-4b9c-8a9a-e56ffb861070 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:43.459102 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7392300-8e0b-4b9c-8a9a-e56ffb861070 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_size/default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:43.460254 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7392300-8e0b-4b9c-8a9a-e56ffb861070 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_size)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:43.462802 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7392300-8e0b-4b9c-8a9a-e56ffb861070 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:43.464095 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3973/7934] 10.222.0.52 () {58 vars in 1217 bytes} [Sat May 14 21:41:43 2022] GET /identity/v3/domains/config/ldap/pool_size/default => generated 30 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 14 21:41:43.468924 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2613117-45b6-4db0-a5c2-a296de439f7a tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:43.499524 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2613117-45b6-4db0-a5c2-a296de439f7a tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:43.521820 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5eb9c3-adad-456f-a2f2-3dfe037f1ad1 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:43.522921 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5eb9c3-adad-456f-a2f2-3dfe037f1ad1 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:43.523212 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5eb9c3-adad-456f-a2f2-3dfe037f1ad1 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:43.524143 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5eb9c3-adad-456f-a2f2-3dfe037f1ad1 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_max/default` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:43.525002 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5eb9c3-adad-456f-a2f2-3dfe037f1ad1 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_max)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:43.526663 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5eb9c3-adad-456f-a2f2-3dfe037f1ad1 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:43.529138 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3962/7935] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:41:43 2022] GET /identity/v3/domains/config/ldap/pool_retry_max/default => generated 34 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 14 21:41:43.532896 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7392300-8e0b-4b9c-8a9a-e56ffb861070 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:43.545982 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7392300-8e0b-4b9c-8a9a-e56ffb861070 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:43.551336 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d730b1-d188-4fe8-9f67-6f37b9e9b3e3 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:43.552589 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d730b1-d188-4fe8-9f67-6f37b9e9b3e3 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:43.553863 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d730b1-d188-4fe8-9f67-6f37b9e9b3e3 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:43.554372 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d730b1-d188-4fe8-9f67-6f37b9e9b3e3 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_delay/default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:43.555225 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d730b1-d188-4fe8-9f67-6f37b9e9b3e3 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_delay)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:43.557184 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d730b1-d188-4fe8-9f67-6f37b9e9b3e3 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:43.562878 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5eb9c3-adad-456f-a2f2-3dfe037f1ad1 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:43.564030 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3974/7936] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:41:43 2022] GET /identity/v3/domains/config/ldap/pool_retry_delay/default => generated 38 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) May 14 21:41:43.580517 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5eb9c3-adad-456f-a2f2-3dfe037f1ad1 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:43.585240 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f28353-3372-42a8-b3f0-63f426251d63 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:43.586764 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f28353-3372-42a8-b3f0-63f426251d63 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:43.587762 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f28353-3372-42a8-b3f0-63f426251d63 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:43.588018 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f28353-3372-42a8-b3f0-63f426251d63 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_timeout/default` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:43.588690 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f28353-3372-42a8-b3f0-63f426251d63 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_timeout)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:43.590496 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f28353-3372-42a8-b3f0-63f426251d63 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:43.594773 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3963/7937] 10.222.0.52 () {58 vars in 1259 bytes} [Sat May 14 21:41:43 2022] GET /identity/v3/domains/config/ldap/pool_connection_timeout/default => generated 44 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) May 14 21:41:43.595972 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d730b1-d188-4fe8-9f67-6f37b9e9b3e3 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:43.597788 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f28353-3372-42a8-b3f0-63f426251d63 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:43.608468 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d730b1-d188-4fe8-9f67-6f37b9e9b3e3 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:43.617493 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82011754-9d08-4b04-86af-645fe0efe212 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:43.618897 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82011754-9d08-4b04-86af-645fe0efe212 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:43.619194 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82011754-9d08-4b04-86af-645fe0efe212 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:43.619493 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82011754-9d08-4b04-86af-645fe0efe212 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_lifetime/default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:43.620167 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82011754-9d08-4b04-86af-645fe0efe212 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_lifetime)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:43.621802 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82011754-9d08-4b04-86af-645fe0efe212 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:43.623114 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3975/7938] 10.222.0.52 () {58 vars in 1262 bytes} [Sat May 14 21:41:43 2022] GET /identity/v3/domains/config/ldap/pool_connection_lifetime/default => generated 46 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) May 14 21:41:43.634126 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82011754-9d08-4b04-86af-645fe0efe212 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:43.642222 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f28353-3372-42a8-b3f0-63f426251d63 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:43.647965 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b88b4a3-b75f-45ed-93eb-decab11db51b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:43.650721 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b88b4a3-b75f-45ed-93eb-decab11db51b service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:43.651282 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b88b4a3-b75f-45ed-93eb-decab11db51b service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:43.651813 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b88b4a3-b75f-45ed-93eb-decab11db51b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:43.654492 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82011754-9d08-4b04-86af-645fe0efe212 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:43.656317 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-3b88b4a3-b75f-45ed-93eb-decab11db51b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:43.660064 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069566d4-282e-42c7-8a82-53706b6af216 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:43.661765 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069566d4-282e-42c7-8a82-53706b6af216 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:43.662057 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069566d4-282e-42c7-8a82-53706b6af216 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:43.662341 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069566d4-282e-42c7-8a82-53706b6af216 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_auth_pool/default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:43.663647 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069566d4-282e-42c7-8a82-53706b6af216 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_auth_pool)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:43.665623 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069566d4-282e-42c7-8a82-53706b6af216 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:43.668225 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3976/7939] 10.222.0.52 () {58 vars in 1229 bytes} [Sat May 14 21:41:43 2022] GET /identity/v3/domains/config/ldap/use_auth_pool/default => generated 36 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 14 21:41:43.671045 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069566d4-282e-42c7-8a82-53706b6af216 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:43.692447 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069566d4-282e-42c7-8a82-53706b6af216 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:43.698643 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e873425e-0fa2-475d-a29d-0fa873eafab4 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:43.700187 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e873425e-0fa2-475d-a29d-0fa873eafab4 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:43.700468 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e873425e-0fa2-475d-a29d-0fa873eafab4 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:43.700758 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e873425e-0fa2-475d-a29d-0fa873eafab4 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_size/default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:43.702008 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e873425e-0fa2-475d-a29d-0fa873eafab4 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_size)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:43.703830 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e873425e-0fa2-475d-a29d-0fa873eafab4 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:43.707985 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3977/7940] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:41:43 2022] GET /identity/v3/domains/config/ldap/auth_pool_size/default => generated 36 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 14 21:41:43.709995 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e873425e-0fa2-475d-a29d-0fa873eafab4 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:43.724090 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e873425e-0fa2-475d-a29d-0fa873eafab4 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:43.730563 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f57df9-b193-4498-b17f-487f120c67c1 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:43.731409 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f57df9-b193-4498-b17f-487f120c67c1 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:43.731766 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f57df9-b193-4498-b17f-487f120c67c1 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:43.732049 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f57df9-b193-4498-b17f-487f120c67c1 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_connection_lifetime/default` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:43.732710 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f57df9-b193-4498-b17f-487f120c67c1 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_connection_lifetime)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:43.734460 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f57df9-b193-4498-b17f-487f120c67c1 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:43.735970 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3978/7941] 10.222.0.52 () {58 vars in 1277 bytes} [Sat May 14 21:41:43 2022] GET /identity/v3/domains/config/ldap/auth_pool_connection_lifetime/default => generated 50 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 14 21:41:43.744128 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f57df9-b193-4498-b17f-487f120c67c1 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:43.756276 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f57df9-b193-4498-b17f-487f120c67c1 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:43.765216 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c778a6fd-a51a-4bb9-9c26-6e271bae9028 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:43.767128 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c778a6fd-a51a-4bb9-9c26-6e271bae9028 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:43.767559 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c778a6fd-a51a-4bb9-9c26-6e271bae9028 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:43.769752 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c778a6fd-a51a-4bb9-9c26-6e271bae9028 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/d1f784d9e502475f8ac6607358efa9ca` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:43.788317 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c778a6fd-a51a-4bb9-9c26-6e271bae9028 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 21:41:43.814537 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b88b4a3-b75f-45ed-93eb-decab11db51b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:43.818174 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-c778a6fd-a51a-4bb9-9c26-6e271bae9028 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Could not find domain: d1f784d9e502475f8ac6607358efa9ca.: keystone.exception.DomainNotFound: Could not find domain: d1f784d9e502475f8ac6607358efa9ca. May 14 21:41:43.818174 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:41:43.818174 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 14 21:41:43.818174 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 14 21:41:43.818174 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 21:41:43.818174 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 21:41:43.818174 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 21:41:43.818174 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 21:41:43.818174 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: d1f784d9e502475f8ac6607358efa9ca. May 14 21:41:43.818174 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:41:43.818174 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 21:41:43.818174 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:41:43.818174 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:41:43.818174 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 21:41:43.818174 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 21:41:43.819158 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 21:41:43.819158 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 21:41:43.819158 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 21:41:43.819158 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 21:41:43.819158 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 21:41:43.819158 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 21:41:43.819158 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 21:41:43.819158 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 21:41:43.819158 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch May 14 21:41:43.819158 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') May 14 21:41:43.819158 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 21:41:43.819158 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 21:41:43.819158 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 21:41:43.819158 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 21:41:43.819158 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 21:41:43.819158 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 21:41:43.824053 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 21:41:43.824053 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 21:41:43.824053 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 21:41:43.824053 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 21:41:43.824053 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 21:41:43.824053 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 21:41:43.824053 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 21:41:43.824053 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 21:41:43.824053 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 21:41:43.824053 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 21:41:43.824053 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 21:41:43.824053 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 21:41:43.824053 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 21:41:43.824053 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 21:41:43.824053 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 14 21:41:43.824053 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 21:41:43.824053 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: d1f784d9e502475f8ac6607358efa9ca. May 14 21:41:43.825632 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:41:43.825707 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b88b4a3-b75f-45ed-93eb-decab11db51b service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:43.825785 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3979/7942] 10.222.0.52 () {60 vars in 1248 bytes} [Sat May 14 21:41:43 2022] PATCH /identity/v3/domains/d1f784d9e502475f8ac6607358efa9ca => generated 112 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 14 21:41:43.828464 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c778a6fd-a51a-4bb9-9c26-6e271bae9028 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:43.844090 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c778a6fd-a51a-4bb9-9c26-6e271bae9028 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:43.850142 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e70b16-acde-422c-87f6-a54296f0b707 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:43.852010 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e70b16-acde-422c-87f6-a54296f0b707 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:43.852010 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e70b16-acde-422c-87f6-a54296f0b707 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:43.852341 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e70b16-acde-422c-87f6-a54296f0b707 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/37ec8cfd173a46cf80e3f8a370090dff` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:43.861392 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e70b16-acde-422c-87f6-a54296f0b707 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 21:41:43.873614 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-75e70b16-acde-422c-87f6-a54296f0b707 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Could not find domain: 37ec8cfd173a46cf80e3f8a370090dff.: keystone.exception.DomainNotFound: Could not find domain: 37ec8cfd173a46cf80e3f8a370090dff. May 14 21:41:43.873614 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:41:43.873614 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 14 21:41:43.873614 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 14 21:41:43.873614 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 21:41:43.873614 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 21:41:43.873614 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 21:41:43.873614 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 21:41:43.873614 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 37ec8cfd173a46cf80e3f8a370090dff. May 14 21:41:43.873614 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:41:43.873614 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 21:41:43.873614 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:41:43.873614 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:41:43.873614 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 21:41:43.873614 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 21:41:43.874845 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 21:41:43.874845 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 21:41:43.874845 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 21:41:43.874845 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 21:41:43.874845 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 21:41:43.874845 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 21:41:43.874845 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 21:41:43.874845 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 21:41:43.874845 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch May 14 21:41:43.874845 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') May 14 21:41:43.874845 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 21:41:43.874845 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 21:41:43.874845 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 21:41:43.874845 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 21:41:43.874845 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 21:41:43.874845 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 21:41:43.876055 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 21:41:43.876055 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 21:41:43.876055 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 21:41:43.876055 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 21:41:43.876055 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 21:41:43.876055 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 21:41:43.876055 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 21:41:43.876055 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 21:41:43.876055 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 21:41:43.876055 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 21:41:43.876055 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 21:41:43.876055 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 21:41:43.876055 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 21:41:43.876055 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 21:41:43.876055 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 14 21:41:43.876055 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 21:41:43.876055 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 37ec8cfd173a46cf80e3f8a370090dff. May 14 21:41:43.877232 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:41:43.878184 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3980/7943] 10.222.0.52 () {60 vars in 1248 bytes} [Sat May 14 21:41:43 2022] PATCH /identity/v3/domains/37ec8cfd173a46cf80e3f8a370090dff => generated 112 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 14 21:41:43.879068 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e70b16-acde-422c-87f6-a54296f0b707 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:43.883420 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3964/7944] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:41:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:41:43.909745 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e70b16-acde-422c-87f6-a54296f0b707 tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:43.920498 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed1a07f-589a-4346-b58b-1b96748d078d tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71a9906e1b1d474697931074e7e00f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c3d5ec501144474ba425c22654c9f7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:43.923758 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed1a07f-589a-4346-b58b-1b96748d078d tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:43.924058 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed1a07f-589a-4346-b58b-1b96748d078d tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:43.925128 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed1a07f-589a-4346-b58b-1b96748d078d tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] PATH_INFO: `/v3/domains/5237db225e51444b8648aa76992c65ac` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:43.940892 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed1a07f-589a-4346-b58b-1b96748d078d tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 21:41:43.953782 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-4ed1a07f-589a-4346-b58b-1b96748d078d tempest-DomainConfigurationTestJSON-1224984274 tempest-DomainConfigurationTestJSON-1224984274-project-admin] Could not find domain: 5237db225e51444b8648aa76992c65ac.: keystone.exception.DomainNotFound: Could not find domain: 5237db225e51444b8648aa76992c65ac. May 14 21:41:43.953782 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:41:43.953782 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 14 21:41:43.953782 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 14 21:41:43.953782 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 21:41:43.953782 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 21:41:43.953782 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 21:41:43.953782 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 21:41:43.953782 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 5237db225e51444b8648aa76992c65ac. May 14 21:41:43.953782 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:41:43.953782 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 21:41:43.953782 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:41:43.953782 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:41:43.953782 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 21:41:43.953782 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 21:41:43.954908 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 21:41:43.954908 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 21:41:43.954908 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 21:41:43.954908 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 21:41:43.954908 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 21:41:43.954908 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 21:41:43.954908 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 21:41:43.954908 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 21:41:43.954908 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch May 14 21:41:43.954908 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') May 14 21:41:43.954908 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 21:41:43.954908 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 21:41:43.954908 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 21:41:43.954908 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 21:41:43.954908 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 21:41:43.954908 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 21:41:43.956062 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 21:41:43.956062 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 21:41:43.956062 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 21:41:43.956062 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 21:41:43.956062 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 21:41:43.956062 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 21:41:43.956062 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 21:41:43.956062 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 21:41:43.956062 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 21:41:43.956062 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 21:41:43.956062 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 21:41:43.956062 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 21:41:43.956062 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 21:41:43.956062 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 21:41:43.956062 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 14 21:41:43.956062 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 21:41:43.956062 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 5237db225e51444b8648aa76992c65ac. May 14 21:41:43.957186 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:41:43.958811 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3981/7945] 10.222.0.52 () {60 vars in 1248 bytes} [Sat May 14 21:41:43 2022] PATCH /identity/v3/domains/5237db225e51444b8648aa76992c65ac => generated 112 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 14 21:41:43.963862 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b88b4a3-b75f-45ed-93eb-decab11db51b service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:43.966002 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-3b88b4a3-b75f-45ed-93eb-decab11db51b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:43.982987 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b88b4a3-b75f-45ed-93eb-decab11db51b service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:43.988095 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6a694e-853e-4f03-ad82-4ba7220ef881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:43.989292 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a694e-853e-4f03-ad82-4ba7220ef881 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:43.989675 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a694e-853e-4f03-ad82-4ba7220ef881 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:43.990018 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a694e-853e-4f03-ad82-4ba7220ef881 admin admin] PATH_INFO: `/v3/users/3fb6fc72e62f4faf8c53e55e51113b88` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:43.994882 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6a694e-853e-4f03-ad82-4ba7220ef881 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fb6fc72e62f4faf8c53e55e51113b88)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:43.995159 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6a694e-853e-4f03-ad82-4ba7220ef881 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:44.310773 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-fd6a694e-853e-4f03-ad82-4ba7220ef881 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fb6fc72e62f4faf8c53e55e51113b88'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:44.317988 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-fd6a694e-853e-4f03-ad82-4ba7220ef881 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fb6fc72e62f4faf8c53e55e51113b88'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:44.319000 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-fd6a694e-853e-4f03-ad82-4ba7220ef881 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fb6fc72e62f4faf8c53e55e51113b88'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:44.416636 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-fd6a694e-853e-4f03-ad82-4ba7220ef881 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fb6fc72e62f4faf8c53e55e51113b88'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:44.435471 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-fd6a694e-853e-4f03-ad82-4ba7220ef881 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fb6fc72e62f4faf8c53e55e51113b88'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:44.445561 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3965/7946] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:41:43 2022] DELETE /identity/v3/users/3fb6fc72e62f4faf8c53e55e51113b88 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:41:44.449773 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c658d25-4d3a-409b-b591-7686c845517d None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:44.451731 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c658d25-4d3a-409b-b591-7686c845517d None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:44.452245 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c658d25-4d3a-409b-b591-7686c845517d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:44.478764 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-6c658d25-4d3a-409b-b591-7686c845517d None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:41:44.480300 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-6c658d25-4d3a-409b-b591-7686c845517d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:44.556153 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3982/7947] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:41:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:41:44.575701 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6a694e-853e-4f03-ad82-4ba7220ef881 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:44.577232 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-fd6a694e-853e-4f03-ad82-4ba7220ef881 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:44.666651 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6a694e-853e-4f03-ad82-4ba7220ef881 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:44.671098 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9e9e5d-fa35-4945-8565-19b05b85001a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:44.671797 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e9e5d-fa35-4945-8565-19b05b85001a service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:44.672084 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e9e5d-fa35-4945-8565-19b05b85001a service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:44.672364 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e9e5d-fa35-4945-8565-19b05b85001a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:44.687780 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9e9e5d-fa35-4945-8565-19b05b85001a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:44.689875 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9e9e5d-fa35-4945-8565-19b05b85001a service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:44.703669 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3966/7948] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:41:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:41:45.418038 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c658d25-4d3a-409b-b591-7686c845517d None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:45.419515 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-6c658d25-4d3a-409b-b591-7686c845517d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:45.440328 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c658d25-4d3a-409b-b591-7686c845517d None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:45.457386 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e392e99c-3407-4043-a4b4-283be1df4004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:45.458272 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e392e99c-3407-4043-a4b4-283be1df4004 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:45.458557 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e392e99c-3407-4043-a4b4-283be1df4004 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:45.458831 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e392e99c-3407-4043-a4b4-283be1df4004 admin admin] PATH_INFO: `/v3/projects/c1872be895764b7cbc60eb343be34b8d` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:45.463716 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e392e99c-3407-4043-a4b4-283be1df4004 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1872be895764b7cbc60eb343be34b8d)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:45.466737 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e392e99c-3407-4043-a4b4-283be1df4004 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:45.645211 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e392e99c-3407-4043-a4b4-283be1df4004 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1872be895764b7cbc60eb343be34b8d', 'request_id': 'req-e392e99c-3407-4043-a4b4-283be1df4004'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:45.660252 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e392e99c-3407-4043-a4b4-283be1df4004 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1872be895764b7cbc60eb343be34b8d', 'request_id': 'req-e392e99c-3407-4043-a4b4-283be1df4004'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:45.764469 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e392e99c-3407-4043-a4b4-283be1df4004 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1872be895764b7cbc60eb343be34b8d', 'request_id': 'req-e392e99c-3407-4043-a4b4-283be1df4004'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:45.793032 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e392e99c-3407-4043-a4b4-283be1df4004 admin admin] The token cache is being invalidate because project c1872be895764b7cbc60eb343be34b8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:41:45.793398 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e392e99c-3407-4043-a4b4-283be1df4004 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:45.794058 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e392e99c-3407-4043-a4b4-283be1df4004 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:45.799845 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9e9e5d-fa35-4945-8565-19b05b85001a service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:45.803419 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3983/7949] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:41:45 2022] DELETE /identity/v3/projects/c1872be895764b7cbc60eb343be34b8d => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:41:45.810255 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9e9e5d-fa35-4945-8565-19b05b85001a service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:45.975392 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adc7af0-031c-432e-8159-01119e22064c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:45.977476 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc7af0-031c-432e-8159-01119e22064c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:45.977857 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc7af0-031c-432e-8159-01119e22064c admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:45.981360 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc7af0-031c-432e-8159-01119e22064c admin admin] PATH_INFO: `/v3/users/71a9906e1b1d474697931074e7e00f54` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:45.982680 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adc7af0-031c-432e-8159-01119e22064c admin admin] RBAC: Authorizing `identity:delete_user(user_id=71a9906e1b1d474697931074e7e00f54)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:45.997110 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adc7af0-031c-432e-8159-01119e22064c admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:46.319063 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3adc7af0-031c-432e-8159-01119e22064c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71a9906e1b1d474697931074e7e00f54'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:46.330642 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3adc7af0-031c-432e-8159-01119e22064c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71a9906e1b1d474697931074e7e00f54'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:46.331898 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3adc7af0-031c-432e-8159-01119e22064c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71a9906e1b1d474697931074e7e00f54'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:46.437605 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3adc7af0-031c-432e-8159-01119e22064c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71a9906e1b1d474697931074e7e00f54'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:46.466652 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3adc7af0-031c-432e-8159-01119e22064c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71a9906e1b1d474697931074e7e00f54'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:46.481916 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3967/7950] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:41:45 2022] DELETE /identity/v3/users/71a9906e1b1d474697931074e7e00f54 => generated 0 bytes in 682 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:41:47.369712 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e392e99c-3407-4043-a4b4-283be1df4004 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:47.373036 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e392e99c-3407-4043-a4b4-283be1df4004 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:47.404713 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e392e99c-3407-4043-a4b4-283be1df4004 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:47.520599 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d020f6df-5446-465f-a00d-f62ec7c14beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:47.522391 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020f6df-5446-465f-a00d-f62ec7c14beb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:47.525104 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020f6df-5446-465f-a00d-f62ec7c14beb admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:47.525673 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020f6df-5446-465f-a00d-f62ec7c14beb admin admin] PATH_INFO: `/v3/projects/6c3d5ec501144474ba425c22654c9f7f` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:47.527273 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d020f6df-5446-465f-a00d-f62ec7c14beb admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c3d5ec501144474ba425c22654c9f7f)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:47.529845 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d020f6df-5446-465f-a00d-f62ec7c14beb admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:47.653197 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d020f6df-5446-465f-a00d-f62ec7c14beb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c3d5ec501144474ba425c22654c9f7f', 'request_id': 'req-d020f6df-5446-465f-a00d-f62ec7c14beb'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:47.658667 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d020f6df-5446-465f-a00d-f62ec7c14beb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c3d5ec501144474ba425c22654c9f7f', 'request_id': 'req-d020f6df-5446-465f-a00d-f62ec7c14beb'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:47.745170 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d020f6df-5446-465f-a00d-f62ec7c14beb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c3d5ec501144474ba425c22654c9f7f', 'request_id': 'req-d020f6df-5446-465f-a00d-f62ec7c14beb'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:47.762058 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d020f6df-5446-465f-a00d-f62ec7c14beb admin admin] The token cache is being invalidate because project 6c3d5ec501144474ba425c22654c9f7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:41:47.762058 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d020f6df-5446-465f-a00d-f62ec7c14beb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:47.763192 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d020f6df-5446-465f-a00d-f62ec7c14beb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:47.767569 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3984/7951] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:41:47 2022] DELETE /identity/v3/projects/6c3d5ec501144474ba425c22654c9f7f => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:41:47.771667 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e8c319-6d74-480d-b95d-ec1dcd16e03c None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:47.772163 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e8c319-6d74-480d-b95d-ec1dcd16e03c None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:47.772527 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e8c319-6d74-480d-b95d-ec1dcd16e03c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:47.794063 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-12e8c319-6d74-480d-b95d-ec1dcd16e03c None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:41:47.796500 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-12e8c319-6d74-480d-b95d-ec1dcd16e03c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:47.883880 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3968/7952] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:41:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:41:47.890319 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f59ae6-71b2-4753-8760-c97b0136dc2f None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:47.890666 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f59ae6-71b2-4753-8760-c97b0136dc2f None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:47.890954 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f59ae6-71b2-4753-8760-c97b0136dc2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:47.919974 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-c2f59ae6-71b2-4753-8760-c97b0136dc2f None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:41:47.921162 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c2f59ae6-71b2-4753-8760-c97b0136dc2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:47.934676 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3985/7953] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:41:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:41:47.950026 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e8c319-6d74-480d-b95d-ec1dcd16e03c None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:47.959666 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e8c319-6d74-480d-b95d-ec1dcd16e03c None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:47.966167 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3328b62e-e120-469b-b6f1-e6feff6684b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:47.966889 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3328b62e-e120-469b-b6f1-e6feff6684b3 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:47.967304 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3328b62e-e120-469b-b6f1-e6feff6684b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:47.967799 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3328b62e-e120-469b-b6f1-e6feff6684b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:47.968669 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3328b62e-e120-469b-b6f1-e6feff6684b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:41:47.969138 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3328b62e-e120-469b-b6f1-e6feff6684b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:47.971185 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3328b62e-e120-469b-b6f1-e6feff6684b3 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:47.990170 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3969/7954] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:41:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:41:47.990261 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f59ae6-71b2-4753-8760-c97b0136dc2f None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:48.000339 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f59ae6-71b2-4753-8760-c97b0136dc2f None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:48.005690 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865d59a1-6f3c-4909-b35c-df9cb1c56c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:48.006357 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d59a1-6f3c-4909-b35c-df9cb1c56c1f admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:48.006665 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d59a1-6f3c-4909-b35c-df9cb1c56c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:48.007052 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d59a1-6f3c-4909-b35c-df9cb1c56c1f admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:48.008184 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865d59a1-6f3c-4909-b35c-df9cb1c56c1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:48.010253 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865d59a1-6f3c-4909-b35c-df9cb1c56c1f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:48.116480 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3986/7955] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:41:47 2022] POST /identity/v3/projects => generated 371 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:41:48.118536 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3328b62e-e120-469b-b6f1-e6feff6684b3 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:48.130520 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3328b62e-e120-469b-b6f1-e6feff6684b3 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:48.220550 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c86dc-db86-4438-9e0d-3f5b869886c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:48.221144 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c86dc-db86-4438-9e0d-3f5b869886c4 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:48.221446 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c86dc-db86-4438-9e0d-3f5b869886c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:48.221680 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c86dc-db86-4438-9e0d-3f5b869886c4 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:48.223765 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5c86dc-db86-4438-9e0d-3f5b869886c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:48.229126 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5c86dc-db86-4438-9e0d-3f5b869886c4 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:48.369088 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3970/7956] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:41:48 2022] POST /identity/v3/users => generated 286 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:41:48.370301 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865d59a1-6f3c-4909-b35c-df9cb1c56c1f admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:48.381241 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865d59a1-6f3c-4909-b35c-df9cb1c56c1f admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:48.386095 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cff3b05-e7fd-4e3b-958d-684cb60bcc27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:48.386760 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff3b05-e7fd-4e3b-958d-684cb60bcc27 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:48.387037 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff3b05-e7fd-4e3b-958d-684cb60bcc27 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:48.387310 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff3b05-e7fd-4e3b-958d-684cb60bcc27 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:48.390058 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cff3b05-e7fd-4e3b-958d-684cb60bcc27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:48.390058 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cff3b05-e7fd-4e3b-958d-684cb60bcc27 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:48.407348 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3987/7957] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:41:48.408797 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c86dc-db86-4438-9e0d-3f5b869886c4 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:48.420146 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c86dc-db86-4438-9e0d-3f5b869886c4 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:48.424858 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b62250-08d4-4509-a2b3-ae1a0733135b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:48.425530 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b62250-08d4-4509-a2b3-ae1a0733135b admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:48.425809 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b62250-08d4-4509-a2b3-ae1a0733135b admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:48.426083 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b62250-08d4-4509-a2b3-ae1a0733135b admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:48.426799 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b62250-08d4-4509-a2b3-ae1a0733135b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:48.428447 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b62250-08d4-4509-a2b3-ae1a0733135b admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:48.444761 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3971/7958] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:41:48.450675 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cff3b05-e7fd-4e3b-958d-684cb60bcc27 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:48.465282 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cff3b05-e7fd-4e3b-958d-684cb60bcc27 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:48.476020 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3397c4-c6bf-414e-a69a-ebd3d72762e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:48.477668 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3397c4-c6bf-414e-a69a-ebd3d72762e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:48.478076 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3397c4-c6bf-414e-a69a-ebd3d72762e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:48.478456 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3397c4-c6bf-414e-a69a-ebd3d72762e5 admin admin] PATH_INFO: `/v3/projects/369da4f08c7644edab37c621ac1497cb/users/da8beebb0b7a40c28bd482e587aeb0f0/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:48.498306 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3397c4-c6bf-414e-a69a-ebd3d72762e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=369da4f08c7644edab37c621ac1497cb, user_id=da8beebb0b7a40c28bd482e587aeb0f0, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:48.502150 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3397c4-c6bf-414e-a69a-ebd3d72762e5 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:48.588334 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3988/7959] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:41:48 2022] PUT /identity/v3/projects/369da4f08c7644edab37c621ac1497cb/users/da8beebb0b7a40c28bd482e587aeb0f0/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:41:48.590537 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4af1245-cfdf-4fd8-9d66-5c0e913d5181 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:48.590826 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4af1245-cfdf-4fd8-9d66-5c0e913d5181 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:48.591105 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4af1245-cfdf-4fd8-9d66-5c0e913d5181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:48.621603 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-e4af1245-cfdf-4fd8-9d66-5c0e913d5181 None None] MFA Rules not processed for user `da8beebb0b7a40c28bd482e587aeb0f0`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:41:48.622835 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e4af1245-cfdf-4fd8-9d66-5c0e913d5181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:48.696802 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3972/7960] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:41:48 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:41:48.701742 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3397c4-c6bf-414e-a69a-ebd3d72762e5 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:48.716974 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3397c4-c6bf-414e-a69a-ebd3d72762e5 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:48.721058 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf40b12-1e5f-44c6-8b55-1e1f5fc96684 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da8beebb0b7a40c28bd482e587aeb0f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '369da4f08c7644edab37c621ac1497cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:48.721891 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf40b12-1e5f-44c6-8b55-1e1f5fc96684 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:48.722175 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf40b12-1e5f-44c6-8b55-1e1f5fc96684 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:48.722458 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf40b12-1e5f-44c6-8b55-1e1f5fc96684 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] PATH_INFO: `/v3/users/da8beebb0b7a40c28bd482e587aeb0f0/credentials/OS-EC2` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:48.723277 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf40b12-1e5f-44c6-8b55-1e1f5fc96684 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=da8beebb0b7a40c28bd482e587aeb0f0)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:48.724818 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf40b12-1e5f-44c6-8b55-1e1f5fc96684 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:48.848207 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3989/7961] 10.222.0.52 () {60 vars in 1298 bytes} [Sat May 14 21:41:48 2022] POST /identity/v3/users/da8beebb0b7a40c28bd482e587aeb0f0/credentials/OS-EC2 => generated 367 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:41:48.852470 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4af1245-cfdf-4fd8-9d66-5c0e913d5181 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:48.869559 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4af1245-cfdf-4fd8-9d66-5c0e913d5181 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:48.903143 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db414681-e60d-487a-a69c-771f58cac3bf tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da8beebb0b7a40c28bd482e587aeb0f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '369da4f08c7644edab37c621ac1497cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:48.903143 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db414681-e60d-487a-a69c-771f58cac3bf tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:48.903143 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db414681-e60d-487a-a69c-771f58cac3bf tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:48.903553 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db414681-e60d-487a-a69c-771f58cac3bf tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] PATH_INFO: `/v3/users/da8beebb0b7a40c28bd482e587aeb0f0/credentials/OS-EC2/e9162248db474ee5bf25d6664e1a5f09` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:48.906045 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db414681-e60d-487a-a69c-771f58cac3bf tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=da8beebb0b7a40c28bd482e587aeb0f0, credential_id=e9162248db474ee5bf25d6664e1a5f09)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:48.907088 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db414681-e60d-487a-a69c-771f58cac3bf tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:49.014452 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3973/7962] 10.222.0.52 () {58 vars in 1379 bytes} [Sat May 14 21:41:48 2022] DELETE /identity/v3/users/da8beebb0b7a40c28bd482e587aeb0f0/credentials/OS-EC2/e9162248db474ee5bf25d6664e1a5f09 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:41:49.020089 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf40b12-1e5f-44c6-8b55-1e1f5fc96684 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:49.041090 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf40b12-1e5f-44c6-8b55-1e1f5fc96684 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:49.056945 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbcc4dd-dabc-412a-aad8-0f14098b5f85 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da8beebb0b7a40c28bd482e587aeb0f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '369da4f08c7644edab37c621ac1497cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:49.057794 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbcc4dd-dabc-412a-aad8-0f14098b5f85 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:49.060659 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbcc4dd-dabc-412a-aad8-0f14098b5f85 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:49.060659 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbcc4dd-dabc-412a-aad8-0f14098b5f85 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] PATH_INFO: `/v3/users/da8beebb0b7a40c28bd482e587aeb0f0/credentials/OS-EC2` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:49.060659 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbcc4dd-dabc-412a-aad8-0f14098b5f85 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=da8beebb0b7a40c28bd482e587aeb0f0)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:49.060659 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbcc4dd-dabc-412a-aad8-0f14098b5f85 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:49.215328 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3990/7963] 10.222.0.52 () {60 vars in 1298 bytes} [Sat May 14 21:41:49 2022] POST /identity/v3/users/da8beebb0b7a40c28bd482e587aeb0f0/credentials/OS-EC2 => generated 367 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:41:49.219185 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db414681-e60d-487a-a69c-771f58cac3bf tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:49.230994 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db414681-e60d-487a-a69c-771f58cac3bf tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:49.236254 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18296ae3-b8c4-4760-ba75-ea511dfbe966 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da8beebb0b7a40c28bd482e587aeb0f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '369da4f08c7644edab37c621ac1497cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:49.237533 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18296ae3-b8c4-4760-ba75-ea511dfbe966 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:49.240086 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18296ae3-b8c4-4760-ba75-ea511dfbe966 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:49.240086 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18296ae3-b8c4-4760-ba75-ea511dfbe966 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] PATH_INFO: `/v3/users/da8beebb0b7a40c28bd482e587aeb0f0/credentials/OS-EC2/a51f287f32764646a480385909987921` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:49.240813 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18296ae3-b8c4-4760-ba75-ea511dfbe966 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=da8beebb0b7a40c28bd482e587aeb0f0, credential_id=a51f287f32764646a480385909987921)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:49.243207 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18296ae3-b8c4-4760-ba75-ea511dfbe966 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:49.346014 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3974/7964] 10.222.0.52 () {58 vars in 1379 bytes} [Sat May 14 21:41:49 2022] DELETE /identity/v3/users/da8beebb0b7a40c28bd482e587aeb0f0/credentials/OS-EC2/a51f287f32764646a480385909987921 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:41:49.350578 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbcc4dd-dabc-412a-aad8-0f14098b5f85 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:49.365685 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbcc4dd-dabc-412a-aad8-0f14098b5f85 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:49.378480 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa5a9ab-e6b5-48aa-a48b-863196438b25 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da8beebb0b7a40c28bd482e587aeb0f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '369da4f08c7644edab37c621ac1497cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:49.379699 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5a9ab-e6b5-48aa-a48b-863196438b25 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:49.379991 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5a9ab-e6b5-48aa-a48b-863196438b25 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:49.381904 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5a9ab-e6b5-48aa-a48b-863196438b25 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] PATH_INFO: `/v3/users/da8beebb0b7a40c28bd482e587aeb0f0/credentials/OS-EC2/a51f287f32764646a480385909987921` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:49.447274 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-7fa5a9ab-e6b5-48aa-a48b-863196438b25 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] Could not find credential: 26940b5a79593aa7996cb333d441e646c1e42a8e133e41a366a943f14d6c2ac4.: keystone.exception.CredentialNotFound: Could not find credential: 26940b5a79593aa7996cb333d441e646c1e42a8e133e41a366a943f14d6c2ac4. May 14 21:41:49.447274 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:41:49.447274 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 21:41:49.447274 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 21:41:49.447274 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 21:41:49.447274 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 21:41:49.447274 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 21:41:49.447274 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 21:41:49.447274 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 21:41:49.447274 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 21:41:49.447274 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 21:41:49.447274 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 21:41:49.447274 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 426, in get May 14 21:41:49.447274 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ENFORCER.enforce_call( May 14 21:41:49.448438 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call May 14 21:41:49.448438 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() May 14 21:41:49.448438 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 119, in _build_enforcer_target_data_owner_and_user_id_match May 14 21:41:49.448438 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application ref['credential'] = PROVIDERS.credential_api.get_credential( May 14 21:41:49.448438 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 21:41:49.448438 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 21:41:49.448438 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 119, in get_credential May 14 21:41:49.448438 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application credential = self._get_credential(credential_id) May 14 21:41:49.448438 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 21:41:49.448438 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 21:41:49.448438 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 21:41:49.448438 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.get_or_create( May 14 21:41:49.448438 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 21:41:49.448438 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application with Lock( May 14 21:41:49.448438 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 21:41:49.448438 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._enter() May 14 21:41:49.453500 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 21:41:49.453500 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 21:41:49.453500 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 21:41:49.453500 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.creator() May 14 21:41:49.453500 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 21:41:49.453500 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application created_value = creator( May 14 21:41:49.453500 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 124, in _get_credential May 14 21:41:49.453500 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.get_credential(credential_id) May 14 21:41:49.453500 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 88, in get_credential May 14 21:41:49.453500 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_credential(session, credential_id).to_dict() May 14 21:41:49.453500 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 83, in _get_credential May 14 21:41:49.453500 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.CredentialNotFound(credential_id=credential_id) May 14 21:41:49.453500 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.CredentialNotFound: Could not find credential: 26940b5a79593aa7996cb333d441e646c1e42a8e133e41a366a943f14d6c2ac4. May 14 21:41:49.453500 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:41:49.453500 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3991/7965] 10.222.0.52 () {58 vars in 1376 bytes} [Sat May 14 21:41:49 2022] GET /identity/v3/users/da8beebb0b7a40c28bd482e587aeb0f0/credentials/OS-EC2/a51f287f32764646a480385909987921 => generated 148 bytes in 99 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 14 21:41:49.455529 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18296ae3-b8c4-4760-ba75-ea511dfbe966 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:49.468777 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18296ae3-b8c4-4760-ba75-ea511dfbe966 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:49.474536 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5118435e-a556-4e9c-893b-46ad7765f22b tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da8beebb0b7a40c28bd482e587aeb0f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '369da4f08c7644edab37c621ac1497cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:49.475582 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5118435e-a556-4e9c-893b-46ad7765f22b tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:49.475974 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5118435e-a556-4e9c-893b-46ad7765f22b tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:49.476447 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5118435e-a556-4e9c-893b-46ad7765f22b tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] PATH_INFO: `/v3/users/da8beebb0b7a40c28bd482e587aeb0f0/credentials/OS-EC2` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:49.477273 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5118435e-a556-4e9c-893b-46ad7765f22b tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=da8beebb0b7a40c28bd482e587aeb0f0)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:49.478946 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5118435e-a556-4e9c-893b-46ad7765f22b tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:49.575006 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3975/7966] 10.222.0.52 () {60 vars in 1298 bytes} [Sat May 14 21:41:49 2022] POST /identity/v3/users/da8beebb0b7a40c28bd482e587aeb0f0/credentials/OS-EC2 => generated 367 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:41:49.579182 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa5a9ab-e6b5-48aa-a48b-863196438b25 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:49.589559 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa5a9ab-e6b5-48aa-a48b-863196438b25 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:49.594496 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37383024-0a37-4a71-b898-ae562c56c986 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da8beebb0b7a40c28bd482e587aeb0f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '369da4f08c7644edab37c621ac1497cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:49.595726 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37383024-0a37-4a71-b898-ae562c56c986 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:49.596356 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37383024-0a37-4a71-b898-ae562c56c986 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:49.596851 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37383024-0a37-4a71-b898-ae562c56c986 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] PATH_INFO: `/v3/users/da8beebb0b7a40c28bd482e587aeb0f0/credentials/OS-EC2` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:49.597769 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37383024-0a37-4a71-b898-ae562c56c986 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=da8beebb0b7a40c28bd482e587aeb0f0)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:49.599565 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37383024-0a37-4a71-b898-ae562c56c986 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:49.691643 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3992/7967] 10.222.0.52 () {60 vars in 1298 bytes} [Sat May 14 21:41:49 2022] POST /identity/v3/users/da8beebb0b7a40c28bd482e587aeb0f0/credentials/OS-EC2 => generated 367 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:41:49.695055 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5118435e-a556-4e9c-893b-46ad7765f22b tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:49.705987 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5118435e-a556-4e9c-893b-46ad7765f22b tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:49.719408 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c76eb-b4cd-4dc6-9126-d18b52dfb520 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da8beebb0b7a40c28bd482e587aeb0f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '369da4f08c7644edab37c621ac1497cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:49.721919 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c76eb-b4cd-4dc6-9126-d18b52dfb520 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:49.721919 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c76eb-b4cd-4dc6-9126-d18b52dfb520 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:49.721919 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c76eb-b4cd-4dc6-9126-d18b52dfb520 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] PATH_INFO: `/v3/users/da8beebb0b7a40c28bd482e587aeb0f0/credentials/OS-EC2` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:49.721919 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088c76eb-b4cd-4dc6-9126-d18b52dfb520 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] RBAC: Authorizing `identity:ec2_list_credentials(user_id=da8beebb0b7a40c28bd482e587aeb0f0)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:49.725409 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088c76eb-b4cd-4dc6-9126-d18b52dfb520 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:49.746993 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3976/7968] 10.222.0.52 () {58 vars in 1277 bytes} [Sat May 14 21:41:49 2022] GET /identity/v3/users/da8beebb0b7a40c28bd482e587aeb0f0/credentials/OS-EC2 => generated 865 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:41:49.750749 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37383024-0a37-4a71-b898-ae562c56c986 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:49.762909 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37383024-0a37-4a71-b898-ae562c56c986 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:49.768544 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c3446-1635-493a-a3ec-ad73607e5624 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da8beebb0b7a40c28bd482e587aeb0f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '369da4f08c7644edab37c621ac1497cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:49.769666 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c3446-1635-493a-a3ec-ad73607e5624 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:49.769924 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c3446-1635-493a-a3ec-ad73607e5624 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:49.770199 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c3446-1635-493a-a3ec-ad73607e5624 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] PATH_INFO: `/v3/users/da8beebb0b7a40c28bd482e587aeb0f0/credentials/OS-EC2/f13403a3e77f447e9615c4bf7205fef3` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:49.774262 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5c3446-1635-493a-a3ec-ad73607e5624 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=da8beebb0b7a40c28bd482e587aeb0f0, credential_id=f13403a3e77f447e9615c4bf7205fef3)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:49.775818 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5c3446-1635-493a-a3ec-ad73607e5624 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:49.887717 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3993/7969] 10.222.0.52 () {58 vars in 1379 bytes} [Sat May 14 21:41:49 2022] DELETE /identity/v3/users/da8beebb0b7a40c28bd482e587aeb0f0/credentials/OS-EC2/f13403a3e77f447e9615c4bf7205fef3 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:41:49.889965 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c76eb-b4cd-4dc6-9126-d18b52dfb520 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:49.906121 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c76eb-b4cd-4dc6-9126-d18b52dfb520 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:49.924341 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dd0a53-3707-49a9-b2e0-be23c534dea8 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da8beebb0b7a40c28bd482e587aeb0f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '369da4f08c7644edab37c621ac1497cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:49.932619 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd0a53-3707-49a9-b2e0-be23c534dea8 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:49.932906 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd0a53-3707-49a9-b2e0-be23c534dea8 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:49.933533 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd0a53-3707-49a9-b2e0-be23c534dea8 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] PATH_INFO: `/v3/users/da8beebb0b7a40c28bd482e587aeb0f0/credentials/OS-EC2/775e9d93d2044dfaa0efae9bb32a65a1` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:49.939281 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dd0a53-3707-49a9-b2e0-be23c534dea8 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=da8beebb0b7a40c28bd482e587aeb0f0, credential_id=775e9d93d2044dfaa0efae9bb32a65a1)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:49.942700 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dd0a53-3707-49a9-b2e0-be23c534dea8 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:50.041991 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3977/7970] 10.222.0.52 () {58 vars in 1379 bytes} [Sat May 14 21:41:49 2022] DELETE /identity/v3/users/da8beebb0b7a40c28bd482e587aeb0f0/credentials/OS-EC2/775e9d93d2044dfaa0efae9bb32a65a1 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:41:50.047368 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c3446-1635-493a-a3ec-ad73607e5624 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:50.059596 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c3446-1635-493a-a3ec-ad73607e5624 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:50.065356 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63bac2e-db96-4130-af99-7f3010444113 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da8beebb0b7a40c28bd482e587aeb0f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '369da4f08c7644edab37c621ac1497cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:50.066550 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63bac2e-db96-4130-af99-7f3010444113 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:50.067113 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63bac2e-db96-4130-af99-7f3010444113 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:50.067590 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63bac2e-db96-4130-af99-7f3010444113 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] PATH_INFO: `/v3/users/da8beebb0b7a40c28bd482e587aeb0f0/credentials/OS-EC2` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:50.068495 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63bac2e-db96-4130-af99-7f3010444113 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=da8beebb0b7a40c28bd482e587aeb0f0)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:50.069995 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63bac2e-db96-4130-af99-7f3010444113 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:50.182662 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3994/7971] 10.222.0.52 () {60 vars in 1298 bytes} [Sat May 14 21:41:50 2022] POST /identity/v3/users/da8beebb0b7a40c28bd482e587aeb0f0/credentials/OS-EC2 => generated 367 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:41:50.186887 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dd0a53-3707-49a9-b2e0-be23c534dea8 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:50.199183 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dd0a53-3707-49a9-b2e0-be23c534dea8 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:50.205699 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5205434f-9c86-4fcd-94a1-421083b8d775 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da8beebb0b7a40c28bd482e587aeb0f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '369da4f08c7644edab37c621ac1497cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:50.207205 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205434f-9c86-4fcd-94a1-421083b8d775 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:50.207205 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205434f-9c86-4fcd-94a1-421083b8d775 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:50.207205 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205434f-9c86-4fcd-94a1-421083b8d775 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] PATH_INFO: `/v3/users/da8beebb0b7a40c28bd482e587aeb0f0/credentials/OS-EC2/59ec0a3c8d62421ab05c5463b6ca8b50` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:50.214365 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5205434f-9c86-4fcd-94a1-421083b8d775 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] RBAC: Authorizing `identity:ec2_get_credential(user_id=da8beebb0b7a40c28bd482e587aeb0f0, credential_id=59ec0a3c8d62421ab05c5463b6ca8b50)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:50.216271 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5205434f-9c86-4fcd-94a1-421083b8d775 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:50.221313 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3978/7972] 10.222.0.52 () {58 vars in 1376 bytes} [Sat May 14 21:41:50 2022] GET /identity/v3/users/da8beebb0b7a40c28bd482e587aeb0f0/credentials/OS-EC2/59ec0a3c8d62421ab05c5463b6ca8b50 => generated 367 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:41:50.224935 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63bac2e-db96-4130-af99-7f3010444113 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:50.238305 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63bac2e-db96-4130-af99-7f3010444113 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:50.246878 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41982974-7fa7-4a4f-9116-93b878c0eec2 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da8beebb0b7a40c28bd482e587aeb0f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '369da4f08c7644edab37c621ac1497cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:50.249470 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41982974-7fa7-4a4f-9116-93b878c0eec2 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:50.249769 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41982974-7fa7-4a4f-9116-93b878c0eec2 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:50.250116 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41982974-7fa7-4a4f-9116-93b878c0eec2 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] PATH_INFO: `/v3/users/da8beebb0b7a40c28bd482e587aeb0f0/credentials/OS-EC2/59ec0a3c8d62421ab05c5463b6ca8b50` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:50.253116 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41982974-7fa7-4a4f-9116-93b878c0eec2 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=da8beebb0b7a40c28bd482e587aeb0f0, credential_id=59ec0a3c8d62421ab05c5463b6ca8b50)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:50.255510 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41982974-7fa7-4a4f-9116-93b878c0eec2 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:50.376040 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3995/7973] 10.222.0.52 () {58 vars in 1379 bytes} [Sat May 14 21:41:50 2022] DELETE /identity/v3/users/da8beebb0b7a40c28bd482e587aeb0f0/credentials/OS-EC2/59ec0a3c8d62421ab05c5463b6ca8b50 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:41:50.377107 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5205434f-9c86-4fcd-94a1-421083b8d775 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:50.498606 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5205434f-9c86-4fcd-94a1-421083b8d775 tempest-EC2CredentialsTest-749623922 tempest-EC2CredentialsTest-749623922-project] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:50.507059 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd1d56d-f7b1-428c-abb6-a77bb3f175ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:50.508961 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd1d56d-f7b1-428c-abb6-a77bb3f175ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:50.509535 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd1d56d-f7b1-428c-abb6-a77bb3f175ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:50.510004 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd1d56d-f7b1-428c-abb6-a77bb3f175ac admin admin] PATH_INFO: `/v3/users/da8beebb0b7a40c28bd482e587aeb0f0` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:50.511366 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd1d56d-f7b1-428c-abb6-a77bb3f175ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=da8beebb0b7a40c28bd482e587aeb0f0)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:50.514538 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd1d56d-f7b1-428c-abb6-a77bb3f175ac admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:50.718622 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-fdd1d56d-f7b1-428c-abb6-a77bb3f175ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da8beebb0b7a40c28bd482e587aeb0f0'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:50.728371 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-fdd1d56d-f7b1-428c-abb6-a77bb3f175ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da8beebb0b7a40c28bd482e587aeb0f0'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:50.729861 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-fdd1d56d-f7b1-428c-abb6-a77bb3f175ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da8beebb0b7a40c28bd482e587aeb0f0'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:50.814939 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-fdd1d56d-f7b1-428c-abb6-a77bb3f175ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da8beebb0b7a40c28bd482e587aeb0f0'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:50.848133 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-fdd1d56d-f7b1-428c-abb6-a77bb3f175ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da8beebb0b7a40c28bd482e587aeb0f0'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:50.873901 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3979/7974] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:41:50 2022] DELETE /identity/v3/users/da8beebb0b7a40c28bd482e587aeb0f0 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:41:50.878722 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a20832-97ed-4113-b77a-d32b0304641d None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:50.879296 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a20832-97ed-4113-b77a-d32b0304641d None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:50.879296 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a20832-97ed-4113-b77a-d32b0304641d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:50.916304 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-62a20832-97ed-4113-b77a-d32b0304641d None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:41:50.917455 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-62a20832-97ed-4113-b77a-d32b0304641d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:51.137347 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3996/7975] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:41:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:41:51.166228 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd1d56d-f7b1-428c-abb6-a77bb3f175ac admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:51.168604 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-fdd1d56d-f7b1-428c-abb6-a77bb3f175ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:51.337715 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd1d56d-f7b1-428c-abb6-a77bb3f175ac admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:51.347522 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5e4944-6e2b-494e-bc2f-bd961d70b162 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:51.348599 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5e4944-6e2b-494e-bc2f-bd961d70b162 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:51.349145 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5e4944-6e2b-494e-bc2f-bd961d70b162 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:51.349570 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5e4944-6e2b-494e-bc2f-bd961d70b162 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:51.378235 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5e4944-6e2b-494e-bc2f-bd961d70b162 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:51.383511 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5e4944-6e2b-494e-bc2f-bd961d70b162 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:51.420767 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3980/7976] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:41:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:41:52.656754 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a20832-97ed-4113-b77a-d32b0304641d None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:52.658221 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-62a20832-97ed-4113-b77a-d32b0304641d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:52.677573 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a20832-97ed-4113-b77a-d32b0304641d None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:52.682246 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd773844-0a58-44b5-a662-e13a1c34af5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:52.685008 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd773844-0a58-44b5-a662-e13a1c34af5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:52.685524 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd773844-0a58-44b5-a662-e13a1c34af5c admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:52.685901 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd773844-0a58-44b5-a662-e13a1c34af5c admin admin] PATH_INFO: `/v3/projects/369da4f08c7644edab37c621ac1497cb` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:52.689462 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd773844-0a58-44b5-a662-e13a1c34af5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=369da4f08c7644edab37c621ac1497cb)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:52.692091 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd773844-0a58-44b5-a662-e13a1c34af5c admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:52.733947 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5e4944-6e2b-494e-bc2f-bd961d70b162 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:52.736240 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-9d5e4944-6e2b-494e-bc2f-bd961d70b162 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:52.757127 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5e4944-6e2b-494e-bc2f-bd961d70b162 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:52.763575 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d5db00-f12a-4383-9374-ccf9d6cec051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:52.764608 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5db00-f12a-4383-9374-ccf9d6cec051 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:52.765747 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5db00-f12a-4383-9374-ccf9d6cec051 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:52.766045 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5db00-f12a-4383-9374-ccf9d6cec051 admin admin] PATH_INFO: `/v3/users/8ba91edb19ff44749b3a1dc6dcb73e2f` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:52.768245 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d5db00-f12a-4383-9374-ccf9d6cec051 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ba91edb19ff44749b3a1dc6dcb73e2f)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:52.770634 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d5db00-f12a-4383-9374-ccf9d6cec051 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:52.874548 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-cd773844-0a58-44b5-a662-e13a1c34af5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '369da4f08c7644edab37c621ac1497cb', 'request_id': 'req-cd773844-0a58-44b5-a662-e13a1c34af5c'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:52.884668 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-cd773844-0a58-44b5-a662-e13a1c34af5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '369da4f08c7644edab37c621ac1497cb', 'request_id': 'req-cd773844-0a58-44b5-a662-e13a1c34af5c'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:52.957297 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-cd773844-0a58-44b5-a662-e13a1c34af5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '369da4f08c7644edab37c621ac1497cb', 'request_id': 'req-cd773844-0a58-44b5-a662-e13a1c34af5c'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:52.971713 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-cd773844-0a58-44b5-a662-e13a1c34af5c admin admin] The token cache is being invalidate because project 369da4f08c7644edab37c621ac1497cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:41:52.972002 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-cd773844-0a58-44b5-a662-e13a1c34af5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:52.972939 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-cd773844-0a58-44b5-a662-e13a1c34af5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:52.975292 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3997/7977] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:41:52 2022] DELETE /identity/v3/projects/369da4f08c7644edab37c621ac1497cb => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:41:52.982275 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6461c7e0-fd7f-40c8-abb1-a640fbac5acc None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:52.982773 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6461c7e0-fd7f-40c8-abb1-a640fbac5acc None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:52.983063 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6461c7e0-fd7f-40c8-abb1-a640fbac5acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:53.002048 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-6461c7e0-fd7f-40c8-abb1-a640fbac5acc None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:41:53.003245 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-6461c7e0-fd7f-40c8-abb1-a640fbac5acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:53.107237 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-41d5db00-f12a-4383-9374-ccf9d6cec051 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ba91edb19ff44749b3a1dc6dcb73e2f'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:53.121576 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-41d5db00-f12a-4383-9374-ccf9d6cec051 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ba91edb19ff44749b3a1dc6dcb73e2f'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:53.122775 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-41d5db00-f12a-4383-9374-ccf9d6cec051 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ba91edb19ff44749b3a1dc6dcb73e2f'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:53.135545 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3998/7978] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:41:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:41:53.135545 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683239e7-b86a-4699-913a-a75118efbc6e None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:53.135545 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683239e7-b86a-4699-913a-a75118efbc6e None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:53.135545 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683239e7-b86a-4699-913a-a75118efbc6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:53.164497 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-683239e7-b86a-4699-913a-a75118efbc6e None None] MFA Rules not processed for user `a84f5da000e5493a8b246eb1d7867dea`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:41:53.165724 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-683239e7-b86a-4699-913a-a75118efbc6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:53.211900 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-41d5db00-f12a-4383-9374-ccf9d6cec051 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ba91edb19ff44749b3a1dc6dcb73e2f'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:53.236117 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-41d5db00-f12a-4383-9374-ccf9d6cec051 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ba91edb19ff44749b3a1dc6dcb73e2f'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:53.252940 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3981/7979] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:41:52 2022] DELETE /identity/v3/users/8ba91edb19ff44749b3a1dc6dcb73e2f => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:41:53.254480 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa1aa0-5b7d-4ba5-b226-2d464bc78834 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:53.254826 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa1aa0-5b7d-4ba5-b226-2d464bc78834 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:53.255247 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa1aa0-5b7d-4ba5-b226-2d464bc78834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:53.275793 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 3999/7980] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:41:53 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:41:53.277120 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3773afd-e11a-421e-a4db-8635cd5a292c None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:53.277405 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3773afd-e11a-421e-a4db-8635cd5a292c None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:53.278008 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3773afd-e11a-421e-a4db-8635cd5a292c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:53.284630 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-41fa1aa0-5b7d-4ba5-b226-2d464bc78834 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:41:53.286472 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-41fa1aa0-5b7d-4ba5-b226-2d464bc78834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:53.305757 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-e3773afd-e11a-421e-a4db-8635cd5a292c None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:41:53.307334 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e3773afd-e11a-421e-a4db-8635cd5a292c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:53.383009 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3982/7981] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:41:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:41:53.385625 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa1aa0-5b7d-4ba5-b226-2d464bc78834 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:53.389171 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-41fa1aa0-5b7d-4ba5-b226-2d464bc78834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:53.412187 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4000/7982] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:41:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:41:53.413459 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3773afd-e11a-421e-a4db-8635cd5a292c None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:53.417052 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa1aa0-5b7d-4ba5-b226-2d464bc78834 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:53.427862 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3773afd-e11a-421e-a4db-8635cd5a292c None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:53.433476 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be751e30-96d5-4a7c-897d-ec4140d1f367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:53.434305 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be751e30-96d5-4a7c-897d-ec4140d1f367 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:53.434534 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ba858-b65c-4baa-b5a4-b5f082cf27ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:53.434680 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be751e30-96d5-4a7c-897d-ec4140d1f367 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:53.434841 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be751e30-96d5-4a7c-897d-ec4140d1f367 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:53.435652 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be751e30-96d5-4a7c-897d-ec4140d1f367 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:41:53.435826 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ba858-b65c-4baa-b5a4-b5f082cf27ae admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:53.435935 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be751e30-96d5-4a7c-897d-ec4140d1f367 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:53.436368 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ba858-b65c-4baa-b5a4-b5f082cf27ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:53.436798 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ba858-b65c-4baa-b5a4-b5f082cf27ae admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:53.437607 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be751e30-96d5-4a7c-897d-ec4140d1f367 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:53.439152 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76ba858-b65c-4baa-b5a4-b5f082cf27ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:53.445975 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76ba858-b65c-4baa-b5a4-b5f082cf27ae admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:53.455382 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4001/7983] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:41:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:41:53.456307 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be751e30-96d5-4a7c-897d-ec4140d1f367 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:53.458357 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-be751e30-96d5-4a7c-897d-ec4140d1f367 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:53.541874 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be751e30-96d5-4a7c-897d-ec4140d1f367 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:53.544705 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3983/7984] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:41:53 2022] POST /identity/v3/projects => generated 379 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:41:53.546824 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ba858-b65c-4baa-b5a4-b5f082cf27ae admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:53.631984 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7311bc-8dc4-4745-8057-c2857e002879 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:53.632736 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7311bc-8dc4-4745-8057-c2857e002879 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:53.633982 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7311bc-8dc4-4745-8057-c2857e002879 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:53.634269 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7311bc-8dc4-4745-8057-c2857e002879 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:53.645556 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7311bc-8dc4-4745-8057-c2857e002879 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:53.647355 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7311bc-8dc4-4745-8057-c2857e002879 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:53.649783 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ba858-b65c-4baa-b5a4-b5f082cf27ae admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:53.656463 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61d62d8-11bf-4d18-a060-e68b62d6c1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:53.657746 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d62d8-11bf-4d18-a060-e68b62d6c1c0 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:53.658430 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d62d8-11bf-4d18-a060-e68b62d6c1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:53.659327 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4002/7985] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:41:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:41:53.660202 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7311bc-8dc4-4745-8057-c2857e002879 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:53.660808 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d62d8-11bf-4d18-a060-e68b62d6c1c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:53.661910 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61d62d8-11bf-4d18-a060-e68b62d6c1c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:53.664689 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61d62d8-11bf-4d18-a060-e68b62d6c1c0 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:53.671368 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7311bc-8dc4-4745-8057-c2857e002879 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:53.677629 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34672351-e504-4f92-800c-dfb21525a287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:53.683722 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34672351-e504-4f92-800c-dfb21525a287 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:53.683722 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34672351-e504-4f92-800c-dfb21525a287 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:53.683722 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34672351-e504-4f92-800c-dfb21525a287 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:53.683722 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34672351-e504-4f92-800c-dfb21525a287 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:53.683722 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34672351-e504-4f92-800c-dfb21525a287 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:53.778554 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4003/7986] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:41:53 2022] POST /identity/v3/users => generated 296 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:41:53.782571 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34672351-e504-4f92-800c-dfb21525a287 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:53.794496 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34672351-e504-4f92-800c-dfb21525a287 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:53.802653 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0c803e-9001-495c-b614-1e0ecc013590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:53.804034 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0c803e-9001-495c-b614-1e0ecc013590 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:53.805231 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0c803e-9001-495c-b614-1e0ecc013590 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:53.805646 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0c803e-9001-495c-b614-1e0ecc013590 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:53.806524 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0c803e-9001-495c-b614-1e0ecc013590 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:53.808433 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0c803e-9001-495c-b614-1e0ecc013590 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:53.813790 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3984/7987] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:41:53 2022] POST /identity/v3/projects => generated 385 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:41:53.819508 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61d62d8-11bf-4d18-a060-e68b62d6c1c0 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:53.823644 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4004/7988] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:41:53 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:41:53.826163 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0c803e-9001-495c-b614-1e0ecc013590 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:53.840095 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0c803e-9001-495c-b614-1e0ecc013590 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:53.942621 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61d62d8-11bf-4d18-a060-e68b62d6c1c0 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:53.948464 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976dc9fa-17f8-4861-8d82-cee73d3d6e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:53.949204 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976dc9fa-17f8-4861-8d82-cee73d3d6e3c admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:53.949485 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976dc9fa-17f8-4861-8d82-cee73d3d6e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:53.949808 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976dc9fa-17f8-4861-8d82-cee73d3d6e3c admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:53.950505 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976dc9fa-17f8-4861-8d82-cee73d3d6e3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:53.953075 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976dc9fa-17f8-4861-8d82-cee73d3d6e3c admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:53.964899 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98183a1-7cbe-4065-8ce4-bf962073d62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:53.966206 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98183a1-7cbe-4065-8ce4-bf962073d62e admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:53.966592 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98183a1-7cbe-4065-8ce4-bf962073d62e admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:53.966974 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98183a1-7cbe-4065-8ce4-bf962073d62e admin admin] PATH_INFO: `/v3/projects/c50ab00f71a644cebac2e4fe046612d4/users/cc437aa51d5641a38a1bbbeb203bbb8d/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:53.986940 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98183a1-7cbe-4065-8ce4-bf962073d62e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c50ab00f71a644cebac2e4fe046612d4, user_id=cc437aa51d5641a38a1bbbeb203bbb8d, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:53.990804 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98183a1-7cbe-4065-8ce4-bf962073d62e admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:54.062807 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3985/7989] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:41:53 2022] POST /identity/v3/users => generated 299 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:41:54.062807 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976dc9fa-17f8-4861-8d82-cee73d3d6e3c admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:54.062807 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-976dc9fa-17f8-4861-8d82-cee73d3d6e3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:54.076285 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976dc9fa-17f8-4861-8d82-cee73d3d6e3c admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:54.081317 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e58870f-dc6e-4a3a-8d78-ecef7b352ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:54.082245 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e58870f-dc6e-4a3a-8d78-ecef7b352ac7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:54.082736 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e58870f-dc6e-4a3a-8d78-ecef7b352ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:54.083103 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e58870f-dc6e-4a3a-8d78-ecef7b352ac7 admin admin] PATH_INFO: `/v3/projects/d9b3a6ae879b49f78c0a843d27856796` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:54.084404 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e58870f-dc6e-4a3a-8d78-ecef7b352ac7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9b3a6ae879b49f78c0a843d27856796)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:54.086588 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e58870f-dc6e-4a3a-8d78-ecef7b352ac7 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:54.157770 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4005/7990] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:41:53 2022] PUT /identity/v3/projects/c50ab00f71a644cebac2e4fe046612d4/users/cc437aa51d5641a38a1bbbeb203bbb8d/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:41:54.161444 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98183a1-7cbe-4065-8ce4-bf962073d62e admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:54.228664 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0e58870f-dc6e-4a3a-8d78-ecef7b352ac7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9b3a6ae879b49f78c0a843d27856796', 'request_id': 'req-0e58870f-dc6e-4a3a-8d78-ecef7b352ac7'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:54.230365 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98183a1-7cbe-4065-8ce4-bf962073d62e admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:54.243500 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0e58870f-dc6e-4a3a-8d78-ecef7b352ac7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9b3a6ae879b49f78c0a843d27856796', 'request_id': 'req-0e58870f-dc6e-4a3a-8d78-ecef7b352ac7'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:54.253445 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0e58870f-dc6e-4a3a-8d78-ecef7b352ac7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9b3a6ae879b49f78c0a843d27856796', 'request_id': 'req-0e58870f-dc6e-4a3a-8d78-ecef7b352ac7'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:54.295858 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a97e43-8f86-402b-b15d-e5291da18a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:54.296836 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a97e43-8f86-402b-b15d-e5291da18a2d admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:54.297120 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a97e43-8f86-402b-b15d-e5291da18a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:54.297779 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a97e43-8f86-402b-b15d-e5291da18a2d admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:54.298183 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a97e43-8f86-402b-b15d-e5291da18a2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:54.300365 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a97e43-8f86-402b-b15d-e5291da18a2d admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:54.311235 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4006/7991] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:41:54 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:41:54.311940 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a97e43-8f86-402b-b15d-e5291da18a2d admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:54.326193 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a97e43-8f86-402b-b15d-e5291da18a2d admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:54.335253 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd8deb2-5da0-4a2d-8ae9-49c5855e829d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:54.337641 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd8deb2-5da0-4a2d-8ae9-49c5855e829d admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:54.338301 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd8deb2-5da0-4a2d-8ae9-49c5855e829d admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:54.338529 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0e58870f-dc6e-4a3a-8d78-ecef7b352ac7 admin admin] The token cache is being invalidate because project d9b3a6ae879b49f78c0a843d27856796 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:41:54.338859 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0e58870f-dc6e-4a3a-8d78-ecef7b352ac7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:54.339249 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd8deb2-5da0-4a2d-8ae9-49c5855e829d admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:54.339465 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0e58870f-dc6e-4a3a-8d78-ecef7b352ac7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:54.340051 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd8deb2-5da0-4a2d-8ae9-49c5855e829d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:54.341317 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3986/7992] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:41:54 2022] DELETE /identity/v3/projects/d9b3a6ae879b49f78c0a843d27856796 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:41:54.342042 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd8deb2-5da0-4a2d-8ae9-49c5855e829d admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:54.345830 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e58870f-dc6e-4a3a-8d78-ecef7b352ac7 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:54.347492 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-0e58870f-dc6e-4a3a-8d78-ecef7b352ac7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:54.356385 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4007/7993] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:41:54 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:41:54.356385 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20bfba-29c1-48b6-91db-2c23a22549a7 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:54.356385 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20bfba-29c1-48b6-91db-2c23a22549a7 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:54.356385 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20bfba-29c1-48b6-91db-2c23a22549a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:54.365822 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e58870f-dc6e-4a3a-8d78-ecef7b352ac7 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:54.371844 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617dfb5f-7e28-492f-a6fe-7d96904b9f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:54.372889 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617dfb5f-7e28-492f-a6fe-7d96904b9f93 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:54.373515 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617dfb5f-7e28-492f-a6fe-7d96904b9f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:54.373515 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617dfb5f-7e28-492f-a6fe-7d96904b9f93 admin admin] PATH_INFO: `/v3/projects/b06af3303963466fabd3e3c6883eb99f/users/76ae71b87f9341c798677e7a6f82c6f6/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:54.379681 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-5e20bfba-29c1-48b6-91db-2c23a22549a7 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:41:54.381007 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-5e20bfba-29c1-48b6-91db-2c23a22549a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:54.390947 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4008/7994] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:41:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:41:54.392065 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e20bfba-29c1-48b6-91db-2c23a22549a7 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:54.393623 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-5e20bfba-29c1-48b6-91db-2c23a22549a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:54.399236 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617dfb5f-7e28-492f-a6fe-7d96904b9f93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b06af3303963466fabd3e3c6883eb99f, user_id=76ae71b87f9341c798677e7a6f82c6f6, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:54.402889 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617dfb5f-7e28-492f-a6fe-7d96904b9f93 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:54.408373 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e20bfba-29c1-48b6-91db-2c23a22549a7 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:54.420496 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c23cfb-3b13-4121-bd0d-74c2992daf6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:54.420496 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c23cfb-3b13-4121-bd0d-74c2992daf6a admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:54.420496 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c23cfb-3b13-4121-bd0d-74c2992daf6a admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:54.420496 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c23cfb-3b13-4121-bd0d-74c2992daf6a admin admin] PATH_INFO: `/v3/projects/c50ab00f71a644cebac2e4fe046612d4/users/cc437aa51d5641a38a1bbbeb203bbb8d/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:54.422635 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c23cfb-3b13-4121-bd0d-74c2992daf6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c50ab00f71a644cebac2e4fe046612d4, user_id=cc437aa51d5641a38a1bbbeb203bbb8d, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:54.425867 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c23cfb-3b13-4121-bd0d-74c2992daf6a admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:54.442843 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4009/7995] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:41:54 2022] PUT /identity/v3/projects/c50ab00f71a644cebac2e4fe046612d4/users/cc437aa51d5641a38a1bbbeb203bbb8d/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:41:54.453291 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c1d28-7123-4b1f-906d-0200056298aa None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:54.453703 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c1d28-7123-4b1f-906d-0200056298aa None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:54.454086 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c1d28-7123-4b1f-906d-0200056298aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:54.480478 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-425c1d28-7123-4b1f-906d-0200056298aa None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:41:54.481939 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-425c1d28-7123-4b1f-906d-0200056298aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:54.512377 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3987/7996] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:41:54 2022] PUT /identity/v3/projects/b06af3303963466fabd3e3c6883eb99f/users/76ae71b87f9341c798677e7a6f82c6f6/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:41:54.516523 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617dfb5f-7e28-492f-a6fe-7d96904b9f93 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:54.602872 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4010/7997] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:41:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:41:54.607414 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c1d28-7123-4b1f-906d-0200056298aa None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:54.629813 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617dfb5f-7e28-492f-a6fe-7d96904b9f93 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:54.632111 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c1d28-7123-4b1f-906d-0200056298aa None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:54.641905 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8324011-e8db-4012-92ec-76bcb0f80a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:54.643573 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8324011-e8db-4012-92ec-76bcb0f80a19 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:54.644476 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0055a7-6d25-4bce-8669-8f07f6ed60d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:54.645044 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8324011-e8db-4012-92ec-76bcb0f80a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:54.646513 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0055a7-6d25-4bce-8669-8f07f6ed60d0 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:54.647652 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8324011-e8db-4012-92ec-76bcb0f80a19 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:54.648890 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8324011-e8db-4012-92ec-76bcb0f80a19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:54.649915 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0055a7-6d25-4bce-8669-8f07f6ed60d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:54.650220 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0055a7-6d25-4bce-8669-8f07f6ed60d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:54.651047 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0055a7-6d25-4bce-8669-8f07f6ed60d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:41:54.651363 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0055a7-6d25-4bce-8669-8f07f6ed60d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:54.651787 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8324011-e8db-4012-92ec-76bcb0f80a19 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:54.655504 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0055a7-6d25-4bce-8669-8f07f6ed60d0 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:54.665268 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3988/7998] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:41:54 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:41:54.670130 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8324011-e8db-4012-92ec-76bcb0f80a19 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:54.678258 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4011/7999] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:41:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:41:54.682961 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0055a7-6d25-4bce-8669-8f07f6ed60d0 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:54.685429 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8324011-e8db-4012-92ec-76bcb0f80a19 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:54.690772 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c25b99c-850c-490f-a15a-e17adcc3e36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:54.691975 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c25b99c-850c-490f-a15a-e17adcc3e36c admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:54.692404 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c25b99c-850c-490f-a15a-e17adcc3e36c admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:54.693287 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c25b99c-850c-490f-a15a-e17adcc3e36c admin admin] PATH_INFO: `/v3/projects/b06af3303963466fabd3e3c6883eb99f/users/76ae71b87f9341c798677e7a6f82c6f6/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:54.695259 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c25b99c-850c-490f-a15a-e17adcc3e36c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b06af3303963466fabd3e3c6883eb99f, user_id=76ae71b87f9341c798677e7a6f82c6f6, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:54.698072 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0055a7-6d25-4bce-8669-8f07f6ed60d0 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:54.698338 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c25b99c-850c-490f-a15a-e17adcc3e36c admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:54.704723 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d8ad6-24b8-4bfd-9d2b-5d139d46d49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:54.705618 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d8ad6-24b8-4bfd-9d2b-5d139d46d49a admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:54.705907 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d8ad6-24b8-4bfd-9d2b-5d139d46d49a admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:54.706185 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d8ad6-24b8-4bfd-9d2b-5d139d46d49a admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:54.706869 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231d8ad6-24b8-4bfd-9d2b-5d139d46d49a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:54.708809 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231d8ad6-24b8-4bfd-9d2b-5d139d46d49a admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:54.719546 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3989/8000] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:41:54 2022] PUT /identity/v3/projects/b06af3303963466fabd3e3c6883eb99f/users/76ae71b87f9341c798677e7a6f82c6f6/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:41:54.724736 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f41d0-0140-4007-9480-d79cbfcc61c7 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:54.726632 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f41d0-0140-4007-9480-d79cbfcc61c7 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:54.726632 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f41d0-0140-4007-9480-d79cbfcc61c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:54.753795 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-6b9f41d0-0140-4007-9480-d79cbfcc61c7 None None] MFA Rules not processed for user `76ae71b87f9341c798677e7a6f82c6f6`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:41:54.755297 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-6b9f41d0-0140-4007-9480-d79cbfcc61c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:54.819499 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4012/8001] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:41:54 2022] POST /identity/v3/projects => generated 373 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:41:54.821120 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d8ad6-24b8-4bfd-9d2b-5d139d46d49a admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:54.847999 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3990/8002] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:41:54 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:41:54.852271 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9f41d0-0140-4007-9480-d79cbfcc61c7 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:54.909289 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d8ad6-24b8-4bfd-9d2b-5d139d46d49a admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:54.921024 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fd4953-8dc5-47ef-83d9-124639d82650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:54.921024 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd4953-8dc5-47ef-83d9-124639d82650 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:54.921024 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd4953-8dc5-47ef-83d9-124639d82650 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:54.921024 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd4953-8dc5-47ef-83d9-124639d82650 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:54.928828 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fd4953-8dc5-47ef-83d9-124639d82650 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:54.928828 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fd4953-8dc5-47ef-83d9-124639d82650 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:54.971426 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9f41d0-0140-4007-9480-d79cbfcc61c7 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:54.976485 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7b0985-cb04-4e03-b572-0a3c99469bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:54.977259 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b0985-cb04-4e03-b572-0a3c99469bb5 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:54.977567 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b0985-cb04-4e03-b572-0a3c99469bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:54.977856 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b0985-cb04-4e03-b572-0a3c99469bb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:54.978498 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7b0985-cb04-4e03-b572-0a3c99469bb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:54.980941 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7b0985-cb04-4e03-b572-0a3c99469bb5 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:55.056157 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4013/8003] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:41:54 2022] POST /identity/v3/users => generated 287 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:41:55.057158 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fd4953-8dc5-47ef-83d9-124639d82650 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:55.074053 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fd4953-8dc5-47ef-83d9-124639d82650 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:55.080188 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3991/8004] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:41:54 2022] POST /identity/v3/projects => generated 387 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:41:55.083786 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69edf48-f0ba-4b5f-9c2c-0d89f4cad396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:55.084595 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7b0985-cb04-4e03-b572-0a3c99469bb5 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:55.084816 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69edf48-f0ba-4b5f-9c2c-0d89f4cad396 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:55.085235 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69edf48-f0ba-4b5f-9c2c-0d89f4cad396 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:55.085645 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69edf48-f0ba-4b5f-9c2c-0d89f4cad396 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:55.086595 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69edf48-f0ba-4b5f-9c2c-0d89f4cad396 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:55.088406 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69edf48-f0ba-4b5f-9c2c-0d89f4cad396 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:55.109812 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4014/8005] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:41:55 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:41:55.111211 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69edf48-f0ba-4b5f-9c2c-0d89f4cad396 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:55.127204 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69edf48-f0ba-4b5f-9c2c-0d89f4cad396 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:55.211405 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7b0985-cb04-4e03-b572-0a3c99469bb5 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:55.221711 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29cce61-b52b-4857-a724-c57878308de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:55.224159 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29cce61-b52b-4857-a724-c57878308de9 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:55.224384 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29cce61-b52b-4857-a724-c57878308de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:55.224676 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29cce61-b52b-4857-a724-c57878308de9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:55.225478 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29cce61-b52b-4857-a724-c57878308de9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:55.231119 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29cce61-b52b-4857-a724-c57878308de9 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:55.239622 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a913f35a-9727-418d-828e-3275b5f13c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:55.240326 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913f35a-9727-418d-828e-3275b5f13c21 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:55.246165 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913f35a-9727-418d-828e-3275b5f13c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:55.246165 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913f35a-9727-418d-828e-3275b5f13c21 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:55.246165 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a913f35a-9727-418d-828e-3275b5f13c21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:55.246165 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a913f35a-9727-418d-828e-3275b5f13c21 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:55.250196 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4015/8006] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:41:55 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:41:55.251121 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29cce61-b52b-4857-a724-c57878308de9 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:55.262596 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29cce61-b52b-4857-a724-c57878308de9 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:55.272237 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a52f23-3888-4132-b40d-5a9a1d9b1bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:55.272237 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a52f23-3888-4132-b40d-5a9a1d9b1bf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:55.272237 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a52f23-3888-4132-b40d-5a9a1d9b1bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:55.272237 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a52f23-3888-4132-b40d-5a9a1d9b1bf4 admin admin] PATH_INFO: `/v3/projects/0166571316634a7185b9768add179654/users/a3f0269a87fb4a8fa8dbc1b84c134fe7/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:55.291615 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a52f23-3888-4132-b40d-5a9a1d9b1bf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0166571316634a7185b9768add179654, user_id=a3f0269a87fb4a8fa8dbc1b84c134fe7, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:55.294427 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a52f23-3888-4132-b40d-5a9a1d9b1bf4 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:55.392834 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3992/8007] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:41:55 2022] POST /identity/v3/users => generated 294 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:41:55.394276 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4016/8008] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:41:55 2022] PUT /identity/v3/projects/0166571316634a7185b9768add179654/users/a3f0269a87fb4a8fa8dbc1b84c134fe7/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:41:55.396858 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a913f35a-9727-418d-828e-3275b5f13c21 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:55.400408 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de4825-b868-43f0-9778-5255c2215dd9 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:55.400850 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de4825-b868-43f0-9778-5255c2215dd9 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:55.401257 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de4825-b868-43f0-9778-5255c2215dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:55.422567 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a913f35a-9727-418d-828e-3275b5f13c21 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:55.425026 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-20de4825-b868-43f0-9778-5255c2215dd9 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:41:55.428342 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-20de4825-b868-43f0-9778-5255c2215dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:55.535342 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d910871-86e5-473e-9f8e-593f4dd5f529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:55.536018 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d910871-86e5-473e-9f8e-593f4dd5f529 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:55.536205 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d910871-86e5-473e-9f8e-593f4dd5f529 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:55.536486 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d910871-86e5-473e-9f8e-593f4dd5f529 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:55.537219 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d910871-86e5-473e-9f8e-593f4dd5f529 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:55.539455 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d910871-86e5-473e-9f8e-593f4dd5f529 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:55.566710 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3993/8009] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:41:55 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:41:55.567812 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d910871-86e5-473e-9f8e-593f4dd5f529 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:55.575061 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4017/8010] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:41:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:41:55.576154 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20de4825-b868-43f0-9778-5255c2215dd9 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:55.578229 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-20de4825-b868-43f0-9778-5255c2215dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:55.588398 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d910871-86e5-473e-9f8e-593f4dd5f529 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:55.593896 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36405c4-a50b-4f72-a648-09e51f3056d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:55.594578 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36405c4-a50b-4f72-a648-09e51f3056d2 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:55.594864 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36405c4-a50b-4f72-a648-09e51f3056d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:55.595147 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36405c4-a50b-4f72-a648-09e51f3056d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:55.595982 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36405c4-a50b-4f72-a648-09e51f3056d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:55.604612 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36405c4-a50b-4f72-a648-09e51f3056d2 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:55.623365 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3994/8011] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:41:55 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:41:55.628622 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36405c4-a50b-4f72-a648-09e51f3056d2 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:55.649945 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36405c4-a50b-4f72-a648-09e51f3056d2 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:55.657534 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f83efc-c5ba-4684-9a28-9948d7ed2d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:55.659185 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f83efc-c5ba-4684-9a28-9948d7ed2d79 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:55.659500 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f83efc-c5ba-4684-9a28-9948d7ed2d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:55.659866 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f83efc-c5ba-4684-9a28-9948d7ed2d79 admin admin] PATH_INFO: `/v3/projects/b28053eb26bb4c6ca7b79a781004a0b3/users/797660f390b34e68a2c371620edaabc0/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:55.682300 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f83efc-c5ba-4684-9a28-9948d7ed2d79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b28053eb26bb4c6ca7b79a781004a0b3, user_id=797660f390b34e68a2c371620edaabc0, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:55.684552 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f83efc-c5ba-4684-9a28-9948d7ed2d79 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:55.728412 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20de4825-b868-43f0-9778-5255c2215dd9 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:55.734763 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd0653-0c1c-4130-a87c-93fad696ca71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:55.735619 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd0653-0c1c-4130-a87c-93fad696ca71 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:55.735956 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd0653-0c1c-4130-a87c-93fad696ca71 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:55.736240 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd0653-0c1c-4130-a87c-93fad696ca71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:55.753498 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcd0653-0c1c-4130-a87c-93fad696ca71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:55.755953 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcd0653-0c1c-4130-a87c-93fad696ca71 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:55.767317 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3995/8012] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:41:55 2022] PUT /identity/v3/projects/b28053eb26bb4c6ca7b79a781004a0b3/users/797660f390b34e68a2c371620edaabc0/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:41:55.770951 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e7b86b-4c70-4481-a66d-22ba7d4506d1 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:55.772031 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e7b86b-4c70-4481-a66d-22ba7d4506d1 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:55.773048 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e7b86b-4c70-4481-a66d-22ba7d4506d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:55.798472 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4018/8013] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:41:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:41:55.811338 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-b6e7b86b-4c70-4481-a66d-22ba7d4506d1 None None] MFA Rules not processed for user `797660f390b34e68a2c371620edaabc0`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:41:55.813227 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b6e7b86b-4c70-4481-a66d-22ba7d4506d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:55.929033 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3996/8014] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:41:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:41:55.940287 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd0653-0c1c-4130-a87c-93fad696ca71 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:55.941927 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ffcd0653-0c1c-4130-a87c-93fad696ca71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:56.038235 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd0653-0c1c-4130-a87c-93fad696ca71 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:56.112590 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba8ebe1-148f-418e-b088-9fb5bc21b145 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b5cb86f190f4fcfb06d66cb8f14643f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:56.113737 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8ebe1-148f-418e-b088-9fb5bc21b145 service glance] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:56.114278 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8ebe1-148f-418e-b088-9fb5bc21b145 service glance] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:56.114732 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8ebe1-148f-418e-b088-9fb5bc21b145 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:56.198810 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba8ebe1-148f-418e-b088-9fb5bc21b145 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:56.200876 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba8ebe1-148f-418e-b088-9fb5bc21b145 service glance] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:56.227055 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4019/8015] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:41:55 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:41:56.816740 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e7b86b-4c70-4481-a66d-22ba7d4506d1 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:56.927293 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e7b86b-4c70-4481-a66d-22ba7d4506d1 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:56.936831 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9524b400-5a4b-47bc-a8bd-de8f43e9bf3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:56.938156 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9524b400-5a4b-47bc-a8bd-de8f43e9bf3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:56.938493 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9524b400-5a4b-47bc-a8bd-de8f43e9bf3d admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:56.938781 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9524b400-5a4b-47bc-a8bd-de8f43e9bf3d admin admin] PATH_INFO: `/v3/users/76ae71b87f9341c798677e7a6f82c6f6` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:56.940708 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9524b400-5a4b-47bc-a8bd-de8f43e9bf3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=76ae71b87f9341c798677e7a6f82c6f6)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:56.947329 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9524b400-5a4b-47bc-a8bd-de8f43e9bf3d admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:57.046568 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377032d-19f6-48e2-b7ad-3a96eedd07e0 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:57.047048 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377032d-19f6-48e2-b7ad-3a96eedd07e0 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:57.047228 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377032d-19f6-48e2-b7ad-3a96eedd07e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:57.077066 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-a377032d-19f6-48e2-b7ad-3a96eedd07e0 None None] MFA Rules not processed for user `9b156d4dd0064d63b2809fa6327ed8aa`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:41:57.079279 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-a377032d-19f6-48e2-b7ad-3a96eedd07e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:57.171649 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4020/8016] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:41:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:41:57.207142 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9524b400-5a4b-47bc-a8bd-de8f43e9bf3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76ae71b87f9341c798677e7a6f82c6f6'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:57.218833 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9524b400-5a4b-47bc-a8bd-de8f43e9bf3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76ae71b87f9341c798677e7a6f82c6f6'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:57.220479 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9524b400-5a4b-47bc-a8bd-de8f43e9bf3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76ae71b87f9341c798677e7a6f82c6f6'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:57.307231 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9524b400-5a4b-47bc-a8bd-de8f43e9bf3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76ae71b87f9341c798677e7a6f82c6f6'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:57.343936 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9524b400-5a4b-47bc-a8bd-de8f43e9bf3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76ae71b87f9341c798677e7a6f82c6f6'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:57.361820 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3997/8017] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:41:56 2022] DELETE /identity/v3/users/76ae71b87f9341c798677e7a6f82c6f6 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:41:57.366542 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9afa648-79dd-4082-94bf-e775d10fbf73 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:57.367547 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9afa648-79dd-4082-94bf-e775d10fbf73 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:57.367810 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9afa648-79dd-4082-94bf-e775d10fbf73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:57.414206 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-e9afa648-79dd-4082-94bf-e775d10fbf73 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:41:57.415593 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e9afa648-79dd-4082-94bf-e775d10fbf73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:57.539782 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4021/8018] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:41:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:41:57.550122 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9524b400-5a4b-47bc-a8bd-de8f43e9bf3d admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:57.553111 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-9524b400-5a4b-47bc-a8bd-de8f43e9bf3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:57.668117 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9524b400-5a4b-47bc-a8bd-de8f43e9bf3d admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:57.671501 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9258811d-9d67-474d-9c22-75d2c297b01b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:57.672252 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9258811d-9d67-474d-9c22-75d2c297b01b service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:57.672537 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9258811d-9d67-474d-9c22-75d2c297b01b service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:57.672863 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9258811d-9d67-474d-9c22-75d2c297b01b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:57.693172 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9258811d-9d67-474d-9c22-75d2c297b01b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:57.694912 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9258811d-9d67-474d-9c22-75d2c297b01b service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:57.707808 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3998/8019] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:41:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:41:58.871880 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9afa648-79dd-4082-94bf-e775d10fbf73 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:58.873683 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e9afa648-79dd-4082-94bf-e775d10fbf73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:58.896601 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9afa648-79dd-4082-94bf-e775d10fbf73 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:58.909611 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216607ef-c1f2-471d-959b-d2577f4a37b4 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:58.910571 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216607ef-c1f2-471d-959b-d2577f4a37b4 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:58.912144 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216607ef-c1f2-471d-959b-d2577f4a37b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:58.923381 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8ff008-d619-4896-a17d-1ee048b2aed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:58.934604 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ff008-d619-4896-a17d-1ee048b2aed2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:58.934604 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ff008-d619-4896-a17d-1ee048b2aed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:58.934604 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ff008-d619-4896-a17d-1ee048b2aed2 admin admin] PATH_INFO: `/v3/projects/b06af3303963466fabd3e3c6883eb99f` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:58.934604 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8ff008-d619-4896-a17d-1ee048b2aed2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b06af3303963466fabd3e3c6883eb99f)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:58.938175 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8ff008-d619-4896-a17d-1ee048b2aed2 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:58.961026 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-216607ef-c1f2-471d-959b-d2577f4a37b4 None None] MFA Rules not processed for user `a3f0269a87fb4a8fa8dbc1b84c134fe7`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:41:58.962525 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-216607ef-c1f2-471d-959b-d2577f4a37b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:59.094949 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 3999/8020] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:41:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:41:59.099922 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216607ef-c1f2-471d-959b-d2577f4a37b4 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:59.105906 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-216607ef-c1f2-471d-959b-d2577f4a37b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:59.143510 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216607ef-c1f2-471d-959b-d2577f4a37b4 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:59.145430 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9a8ff008-d619-4896-a17d-1ee048b2aed2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b06af3303963466fabd3e3c6883eb99f', 'request_id': 'req-9a8ff008-d619-4896-a17d-1ee048b2aed2'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:59.165961 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9a8ff008-d619-4896-a17d-1ee048b2aed2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b06af3303963466fabd3e3c6883eb99f', 'request_id': 'req-9a8ff008-d619-4896-a17d-1ee048b2aed2'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:59.243569 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bdea46-d1d5-4253-860a-1b4eaa37bfa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:59.244745 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bdea46-d1d5-4253-860a-1b4eaa37bfa9 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:59.245245 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bdea46-d1d5-4253-860a-1b4eaa37bfa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:59.245932 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bdea46-d1d5-4253-860a-1b4eaa37bfa9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:59.247432 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bdea46-d1d5-4253-860a-1b4eaa37bfa9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:59.249733 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bdea46-d1d5-4253-860a-1b4eaa37bfa9 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:59.260414 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9a8ff008-d619-4896-a17d-1ee048b2aed2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b06af3303963466fabd3e3c6883eb99f', 'request_id': 'req-9a8ff008-d619-4896-a17d-1ee048b2aed2'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:59.279155 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9a8ff008-d619-4896-a17d-1ee048b2aed2 admin admin] The token cache is being invalidate because project b06af3303963466fabd3e3c6883eb99f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:41:59.279517 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9a8ff008-d619-4896-a17d-1ee048b2aed2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:59.281611 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9a8ff008-d619-4896-a17d-1ee048b2aed2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:59.286755 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4022/8021] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:41:58 2022] DELETE /identity/v3/projects/b06af3303963466fabd3e3c6883eb99f => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:41:59.287815 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8ff008-d619-4896-a17d-1ee048b2aed2 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:59.292131 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-9a8ff008-d619-4896-a17d-1ee048b2aed2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:59.315934 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8ff008-d619-4896-a17d-1ee048b2aed2 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:59.325660 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d680ee3-f7a1-4196-be79-59f828beb479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:59.326830 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d680ee3-f7a1-4196-be79-59f828beb479 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:59.327272 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d680ee3-f7a1-4196-be79-59f828beb479 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:59.331835 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d680ee3-f7a1-4196-be79-59f828beb479 admin admin] PATH_INFO: `/v3/users/797660f390b34e68a2c371620edaabc0` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:59.331835 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d680ee3-f7a1-4196-be79-59f828beb479 admin admin] RBAC: Authorizing `identity:delete_user(user_id=797660f390b34e68a2c371620edaabc0)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:59.333425 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d680ee3-f7a1-4196-be79-59f828beb479 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:59.390221 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4000/8022] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:41:59 2022] POST /identity/v3/projects => generated 373 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:41:59.397136 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bdea46-d1d5-4253-860a-1b4eaa37bfa9 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:59.399733 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-79bdea46-d1d5-4253-860a-1b4eaa37bfa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:41:59.522030 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bdea46-d1d5-4253-860a-1b4eaa37bfa9 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:59.534707 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584bfa01-cd62-46df-b39f-99981a99ba1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:59.535664 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584bfa01-cd62-46df-b39f-99981a99ba1f admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:59.540616 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584bfa01-cd62-46df-b39f-99981a99ba1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:59.543145 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584bfa01-cd62-46df-b39f-99981a99ba1f admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:59.544764 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584bfa01-cd62-46df-b39f-99981a99ba1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:59.551923 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584bfa01-cd62-46df-b39f-99981a99ba1f admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:59.657985 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-1d680ee3-f7a1-4196-be79-59f828beb479 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '797660f390b34e68a2c371620edaabc0'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:59.685982 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4001/8023] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:41:59 2022] POST /identity/v3/users => generated 293 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:41:59.687651 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584bfa01-cd62-46df-b39f-99981a99ba1f admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:59.702596 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-1d680ee3-f7a1-4196-be79-59f828beb479 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '797660f390b34e68a2c371620edaabc0'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:59.716280 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584bfa01-cd62-46df-b39f-99981a99ba1f admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:59.728062 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-1d680ee3-f7a1-4196-be79-59f828beb479 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '797660f390b34e68a2c371620edaabc0'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:59.734127 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eafb1e-dc56-473d-83f5-c15669348338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:59.735206 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eafb1e-dc56-473d-83f5-c15669348338 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:59.737203 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eafb1e-dc56-473d-83f5-c15669348338 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:59.737839 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eafb1e-dc56-473d-83f5-c15669348338 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:59.739026 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eafb1e-dc56-473d-83f5-c15669348338 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:59.741258 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eafb1e-dc56-473d-83f5-c15669348338 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:59.758601 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4002/8024] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:41:59 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:41:59.760193 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eafb1e-dc56-473d-83f5-c15669348338 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:59.774480 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eafb1e-dc56-473d-83f5-c15669348338 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:41:59.781636 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8ae7b6-01e2-4f4b-a8c1-847c8c169c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:41:59.782846 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ae7b6-01e2-4f4b-a8c1-847c8c169c08 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:41:59.783467 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ae7b6-01e2-4f4b-a8c1-847c8c169c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:41:59.784144 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ae7b6-01e2-4f4b-a8c1-847c8c169c08 admin admin] PATH_INFO: `/v3/projects/fbe285e734924d40b0968ac56e83e45c/users/80ccc5504ec741cfb7a4f0d6f9a556a3/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:41:59.814147 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8ae7b6-01e2-4f4b-a8c1-847c8c169c08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbe285e734924d40b0968ac56e83e45c, user_id=80ccc5504ec741cfb7a4f0d6f9a556a3, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:41:59.818021 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8ae7b6-01e2-4f4b-a8c1-847c8c169c08 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:41:59.824496 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-1d680ee3-f7a1-4196-be79-59f828beb479 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '797660f390b34e68a2c371620edaabc0'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:59.829130 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-1d680ee3-f7a1-4196-be79-59f828beb479 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '797660f390b34e68a2c371620edaabc0'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:41:59.834805 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4023/8025] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:41:59 2022] DELETE /identity/v3/users/797660f390b34e68a2c371620edaabc0 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:41:59.938851 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4003/8026] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:41:59 2022] PUT /identity/v3/projects/fbe285e734924d40b0968ac56e83e45c/users/80ccc5504ec741cfb7a4f0d6f9a556a3/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:41:59.943966 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d680ee3-f7a1-4196-be79-59f828beb479 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:41:59.945315 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-1d680ee3-f7a1-4196-be79-59f828beb479 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:42:00.101989 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d680ee3-f7a1-4196-be79-59f828beb479 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:42:00.218779 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6ade85-85a6-4545-92f0-d261a69380f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:42:00.219738 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6ade85-85a6-4545-92f0-d261a69380f9 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:00.220022 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6ade85-85a6-4545-92f0-d261a69380f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:00.220778 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6ade85-85a6-4545-92f0-d261a69380f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:00.221020 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6ade85-85a6-4545-92f0-d261a69380f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:42:00.222655 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6ade85-85a6-4545-92f0-d261a69380f9 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:42:00.242525 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4024/8027] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:41:59 2022] GET /identity/v3/roles => generated 1420 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:42:00.247006 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8ae7b6-01e2-4f4b-a8c1-847c8c169c08 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:42:00.264824 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8ae7b6-01e2-4f4b-a8c1-847c8c169c08 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:42:00.277400 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a94dd4-5f95-474e-a4f2-ec279ea73163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:42:00.278826 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a94dd4-5f95-474e-a4f2-ec279ea73163 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:00.279200 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a94dd4-5f95-474e-a4f2-ec279ea73163 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:00.279604 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a94dd4-5f95-474e-a4f2-ec279ea73163 admin admin] PATH_INFO: `/v3/projects/fbe285e734924d40b0968ac56e83e45c/users/80ccc5504ec741cfb7a4f0d6f9a556a3/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:00.282877 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a94dd4-5f95-474e-a4f2-ec279ea73163 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbe285e734924d40b0968ac56e83e45c, user_id=80ccc5504ec741cfb7a4f0d6f9a556a3, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:42:00.299565 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a94dd4-5f95-474e-a4f2-ec279ea73163 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:42:00.387830 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4004/8028] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:42:00 2022] PUT /identity/v3/projects/fbe285e734924d40b0968ac56e83e45c/users/80ccc5504ec741cfb7a4f0d6f9a556a3/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:42:01.792019 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6ade85-85a6-4545-92f0-d261a69380f9 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:42:01.795452 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-5e6ade85-85a6-4545-92f0-d261a69380f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:42:01.822247 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6ade85-85a6-4545-92f0-d261a69380f9 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:42:01.952633 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc25429-cae9-4bf1-b153-719ef5a47855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:42:01.953798 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc25429-cae9-4bf1-b153-719ef5a47855 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:01.954236 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc25429-cae9-4bf1-b153-719ef5a47855 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:01.954664 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc25429-cae9-4bf1-b153-719ef5a47855 admin admin] PATH_INFO: `/v3/projects/b28053eb26bb4c6ca7b79a781004a0b3` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:01.958258 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc25429-cae9-4bf1-b153-719ef5a47855 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b28053eb26bb4c6ca7b79a781004a0b3)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:42:01.964455 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc25429-cae9-4bf1-b153-719ef5a47855 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:42:02.113835 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-cdc25429-cae9-4bf1-b153-719ef5a47855 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b28053eb26bb4c6ca7b79a781004a0b3', 'request_id': 'req-cdc25429-cae9-4bf1-b153-719ef5a47855'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:42:02.120895 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-cdc25429-cae9-4bf1-b153-719ef5a47855 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b28053eb26bb4c6ca7b79a781004a0b3', 'request_id': 'req-cdc25429-cae9-4bf1-b153-719ef5a47855'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:42:02.196057 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-cdc25429-cae9-4bf1-b153-719ef5a47855 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b28053eb26bb4c6ca7b79a781004a0b3', 'request_id': 'req-cdc25429-cae9-4bf1-b153-719ef5a47855'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:42:02.216272 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-cdc25429-cae9-4bf1-b153-719ef5a47855 admin admin] The token cache is being invalidate because project b28053eb26bb4c6ca7b79a781004a0b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:42:02.216811 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-cdc25429-cae9-4bf1-b153-719ef5a47855 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:42:02.217635 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-cdc25429-cae9-4bf1-b153-719ef5a47855 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:42:02.220098 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4025/8029] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:42:01 2022] DELETE /identity/v3/projects/b28053eb26bb4c6ca7b79a781004a0b3 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:42:02.225932 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c0efb-06fc-44d9-923d-133444156968 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:02.228596 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c0efb-06fc-44d9-923d-133444156968 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:02.229568 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c0efb-06fc-44d9-923d-133444156968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:02.266867 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-393c0efb-06fc-44d9-923d-133444156968 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:42:02.274826 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-393c0efb-06fc-44d9-923d-133444156968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:42:02.410118 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4005/8030] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:42:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:42:02.419180 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf43180-21bd-40d9-a824-146a3b1face4 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:02.421412 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf43180-21bd-40d9-a824-146a3b1face4 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:02.421725 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf43180-21bd-40d9-a824-146a3b1face4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:02.460081 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-6bf43180-21bd-40d9-a824-146a3b1face4 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:42:02.463180 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-6bf43180-21bd-40d9-a824-146a3b1face4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:42:02.482218 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4026/8031] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:42:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:42:02.482546 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393c0efb-06fc-44d9-923d-133444156968 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:42:02.497653 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393c0efb-06fc-44d9-923d-133444156968 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:42:02.503639 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699d6da3-80dd-48a5-8253-cda6f0903ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:42:02.504529 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d6da3-80dd-48a5-8253-cda6f0903ad0 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:02.504996 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d6da3-80dd-48a5-8253-cda6f0903ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:02.505489 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d6da3-80dd-48a5-8253-cda6f0903ad0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:02.506432 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699d6da3-80dd-48a5-8253-cda6f0903ad0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:42:02.507042 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699d6da3-80dd-48a5-8253-cda6f0903ad0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:42:02.514806 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699d6da3-80dd-48a5-8253-cda6f0903ad0 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:42:02.537961 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4006/8032] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:42:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:42:02.544102 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf43180-21bd-40d9-a824-146a3b1face4 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:42:02.557409 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf43180-21bd-40d9-a824-146a3b1face4 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:42:02.567914 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df4a99c-de06-49d7-b52b-9c2482e20903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:42:02.568662 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df4a99c-de06-49d7-b52b-9c2482e20903 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:02.568951 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df4a99c-de06-49d7-b52b-9c2482e20903 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:02.569229 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df4a99c-de06-49d7-b52b-9c2482e20903 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:02.572936 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df4a99c-de06-49d7-b52b-9c2482e20903 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:42:02.574961 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df4a99c-de06-49d7-b52b-9c2482e20903 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:42:02.695229 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4027/8033] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:42:02 2022] POST /identity/v3/projects => generated 391 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:42:02.700092 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699d6da3-80dd-48a5-8253-cda6f0903ad0 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:42:02.718227 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699d6da3-80dd-48a5-8253-cda6f0903ad0 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:42:02.850703 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c45d034-b763-4589-ad7c-2f61654184b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:42:02.851574 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45d034-b763-4589-ad7c-2f61654184b5 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:02.851889 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45d034-b763-4589-ad7c-2f61654184b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:02.852383 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45d034-b763-4589-ad7c-2f61654184b5 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:02.853147 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c45d034-b763-4589-ad7c-2f61654184b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:42:02.855359 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c45d034-b763-4589-ad7c-2f61654184b5 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:42:02.948426 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4007/8034] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:42:02 2022] POST /identity/v3/users => generated 296 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:42:02.952742 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df4a99c-de06-49d7-b52b-9c2482e20903 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:42:02.980956 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df4a99c-de06-49d7-b52b-9c2482e20903 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:42:03.002861 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3342fabc-dcec-4497-8777-dfce8d70571a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:42:03.003607 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3342fabc-dcec-4497-8777-dfce8d70571a admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:03.005781 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3342fabc-dcec-4497-8777-dfce8d70571a admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:03.006227 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3342fabc-dcec-4497-8777-dfce8d70571a admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:03.012631 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3342fabc-dcec-4497-8777-dfce8d70571a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:42:03.016540 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3342fabc-dcec-4497-8777-dfce8d70571a admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:42:03.052350 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4028/8035] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:42:02 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:42:03.052491 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c45d034-b763-4589-ad7c-2f61654184b5 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:42:03.070519 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c45d034-b763-4589-ad7c-2f61654184b5 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:42:03.080461 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c7e00-bc38-4e26-88df-fa7522ae9173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:42:03.085234 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c7e00-bc38-4e26-88df-fa7522ae9173 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:03.086093 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c7e00-bc38-4e26-88df-fa7522ae9173 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:03.086384 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c7e00-bc38-4e26-88df-fa7522ae9173 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:03.089563 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6c7e00-bc38-4e26-88df-fa7522ae9173 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:42:03.091344 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6c7e00-bc38-4e26-88df-fa7522ae9173 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:42:03.121499 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4008/8036] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:42:03 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:42:03.126432 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3342fabc-dcec-4497-8777-dfce8d70571a admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:42:03.146517 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3342fabc-dcec-4497-8777-dfce8d70571a admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:42:03.177642 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c9ac28-8ca1-4c14-b7a3-967361f5ab8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:42:03.181263 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c9ac28-8ca1-4c14-b7a3-967361f5ab8d admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:03.186759 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c9ac28-8ca1-4c14-b7a3-967361f5ab8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:03.186759 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c9ac28-8ca1-4c14-b7a3-967361f5ab8d admin admin] PATH_INFO: `/v3/projects/18b304c51cc247f793b9feaf58f6f876/users/8c89680f9f38460ba97bc60030226783/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:03.210350 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c9ac28-8ca1-4c14-b7a3-967361f5ab8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=18b304c51cc247f793b9feaf58f6f876, user_id=8c89680f9f38460ba97bc60030226783, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:42:03.213926 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c9ac28-8ca1-4c14-b7a3-967361f5ab8d admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:42:03.292424 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4029/8037] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:42:03 2022] PUT /identity/v3/projects/18b304c51cc247f793b9feaf58f6f876/users/8c89680f9f38460ba97bc60030226783/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:42:03.304373 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459aa5d5-dade-4522-9382-4b50d41f1d3d None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:03.305253 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459aa5d5-dade-4522-9382-4b50d41f1d3d None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:03.305535 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459aa5d5-dade-4522-9382-4b50d41f1d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:03.384866 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-459aa5d5-dade-4522-9382-4b50d41f1d3d None None] MFA Rules not processed for user `8c89680f9f38460ba97bc60030226783`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:42:03.386432 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-459aa5d5-dade-4522-9382-4b50d41f1d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:42:03.518584 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4009/8038] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:42:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:42:03.523682 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c9ac28-8ca1-4c14-b7a3-967361f5ab8d admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:42:03.666314 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c9ac28-8ca1-4c14-b7a3-967361f5ab8d admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:42:03.677964 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af2aea4-014b-49ab-af03-aaa9298ca006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:42:03.678655 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af2aea4-014b-49ab-af03-aaa9298ca006 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:03.679610 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af2aea4-014b-49ab-af03-aaa9298ca006 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:03.680089 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af2aea4-014b-49ab-af03-aaa9298ca006 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:03.680955 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af2aea4-014b-49ab-af03-aaa9298ca006 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:42:03.682912 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af2aea4-014b-49ab-af03-aaa9298ca006 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:42:03.797675 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4030/8039] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:42:03 2022] POST /identity/v3/projects => generated 393 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:42:03.801867 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459aa5d5-dade-4522-9382-4b50d41f1d3d None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:42:03.834820 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459aa5d5-dade-4522-9382-4b50d41f1d3d None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:42:03.952400 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ce665-a432-49af-a97c-c897f271857a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:42:03.954787 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ce665-a432-49af-a97c-c897f271857a admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:03.955152 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ce665-a432-49af-a97c-c897f271857a admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:03.967528 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ce665-a432-49af-a97c-c897f271857a admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:03.969085 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83ce665-a432-49af-a97c-c897f271857a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:42:03.972041 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83ce665-a432-49af-a97c-c897f271857a admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:42:04.085821 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4010/8040] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:42:03 2022] POST /identity/v3/users => generated 303 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:42:04.090162 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af2aea4-014b-49ab-af03-aaa9298ca006 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:42:04.114015 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af2aea4-014b-49ab-af03-aaa9298ca006 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:42:04.119265 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c2586f-3758-4723-b0dc-2ec5d0cdb898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:42:04.119984 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2586f-3758-4723-b0dc-2ec5d0cdb898 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:04.120272 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2586f-3758-4723-b0dc-2ec5d0cdb898 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:04.120559 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2586f-3758-4723-b0dc-2ec5d0cdb898 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:04.121417 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c2586f-3758-4723-b0dc-2ec5d0cdb898 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:42:04.123000 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c2586f-3758-4723-b0dc-2ec5d0cdb898 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:42:04.150875 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4031/8041] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:42:04 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:42:04.156098 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ce665-a432-49af-a97c-c897f271857a admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:42:04.170712 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ce665-a432-49af-a97c-c897f271857a admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:42:04.178064 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d49ec-e07f-4fb8-947c-06f752c8fd62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:42:04.180477 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d49ec-e07f-4fb8-947c-06f752c8fd62 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:04.180990 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d49ec-e07f-4fb8-947c-06f752c8fd62 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:04.181502 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d49ec-e07f-4fb8-947c-06f752c8fd62 admin admin] PATH_INFO: `/v3/projects/8972ea3ac7eb434c9c0561e98e49bc95/users/1ed886411e0e47d0b583cc2ca2000754/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:04.209579 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379d49ec-e07f-4fb8-947c-06f752c8fd62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8972ea3ac7eb434c9c0561e98e49bc95, user_id=1ed886411e0e47d0b583cc2ca2000754, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:42:04.282565 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379d49ec-e07f-4fb8-947c-06f752c8fd62 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:42:04.348878 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4011/8042] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:42:04 2022] PUT /identity/v3/projects/8972ea3ac7eb434c9c0561e98e49bc95/users/1ed886411e0e47d0b583cc2ca2000754/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:42:04.353413 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c2586f-3758-4723-b0dc-2ec5d0cdb898 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:42:04.364506 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c2586f-3758-4723-b0dc-2ec5d0cdb898 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:42:04.426760 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b39e75-70d4-4337-a7ec-ed770eba01a2 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:04.427251 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b39e75-70d4-4337-a7ec-ed770eba01a2 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:04.427562 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b39e75-70d4-4337-a7ec-ed770eba01a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:04.434715 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5381688b-b4e8-43ec-b38d-1da6f02792cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:42:04.435804 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5381688b-b4e8-43ec-b38d-1da6f02792cf admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:04.441737 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5381688b-b4e8-43ec-b38d-1da6f02792cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:04.441737 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5381688b-b4e8-43ec-b38d-1da6f02792cf admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:04.441737 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5381688b-b4e8-43ec-b38d-1da6f02792cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:42:04.441737 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5381688b-b4e8-43ec-b38d-1da6f02792cf admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:42:04.453074 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4032/8043] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:42:04 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:42:04.456837 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5381688b-b4e8-43ec-b38d-1da6f02792cf admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:42:04.469892 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5381688b-b4e8-43ec-b38d-1da6f02792cf admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:42:04.476264 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc59451-d3fc-49cb-b077-a762c4d3bc32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:42:04.477581 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc59451-d3fc-49cb-b077-a762c4d3bc32 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:04.478108 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc59451-d3fc-49cb-b077-a762c4d3bc32 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:04.478621 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc59451-d3fc-49cb-b077-a762c4d3bc32 admin admin] PATH_INFO: `/v3/projects/8972ea3ac7eb434c9c0561e98e49bc95/users/1ed886411e0e47d0b583cc2ca2000754/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:04.481833 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc59451-d3fc-49cb-b077-a762c4d3bc32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8972ea3ac7eb434c9c0561e98e49bc95, user_id=1ed886411e0e47d0b583cc2ca2000754, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:42:04.484490 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-d1b39e75-70d4-4337-a7ec-ed770eba01a2 None None] MFA Rules not processed for user `80ccc5504ec741cfb7a4f0d6f9a556a3`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:42:04.486010 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc59451-d3fc-49cb-b077-a762c4d3bc32 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:42:04.487153 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-d1b39e75-70d4-4337-a7ec-ed770eba01a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:42:04.499415 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4033/8044] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:42:04 2022] PUT /identity/v3/projects/8972ea3ac7eb434c9c0561e98e49bc95/users/1ed886411e0e47d0b583cc2ca2000754/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:42:04.510992 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04e59db-fdb6-47cd-bf2c-6f68b97b3d63 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:04.511664 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04e59db-fdb6-47cd-bf2c-6f68b97b3d63 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:04.512195 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04e59db-fdb6-47cd-bf2c-6f68b97b3d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:04.553274 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-f04e59db-fdb6-47cd-bf2c-6f68b97b3d63 None None] MFA Rules not processed for user `1ed886411e0e47d0b583cc2ca2000754`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:42:04.556575 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-f04e59db-fdb6-47cd-bf2c-6f68b97b3d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:42:04.670029 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4012/8045] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:42:04 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:42:04.681914 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765692c2-1bbc-4fef-b0a0-7f7aa354a6b4 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:04.682522 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765692c2-1bbc-4fef-b0a0-7f7aa354a6b4 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:04.682970 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765692c2-1bbc-4fef-b0a0-7f7aa354a6b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:04.713901 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-765692c2-1bbc-4fef-b0a0-7f7aa354a6b4 None None] MFA Rules not processed for user `a3f0269a87fb4a8fa8dbc1b84c134fe7`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:42:04.720394 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4034/8046] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:42:04 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:42:04.720828 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-765692c2-1bbc-4fef-b0a0-7f7aa354a6b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:42:04.728448 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04e59db-fdb6-47cd-bf2c-6f68b97b3d63 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:42:04.730074 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-f04e59db-fdb6-47cd-bf2c-6f68b97b3d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:42:04.816933 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4013/8047] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:42:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:42:04.832366 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765692c2-1bbc-4fef-b0a0-7f7aa354a6b4 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:42:04.834140 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-765692c2-1bbc-4fef-b0a0-7f7aa354a6b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:42:04.864166 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04e59db-fdb6-47cd-bf2c-6f68b97b3d63 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:42:04.869213 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513d4803-89bb-4143-b506-e014da4d1b2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:42:04.870233 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d4803-89bb-4143-b506-e014da4d1b2a service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:04.870233 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d4803-89bb-4143-b506-e014da4d1b2a service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:04.870466 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d4803-89bb-4143-b506-e014da4d1b2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:04.884485 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513d4803-89bb-4143-b506-e014da4d1b2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:42:04.885935 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513d4803-89bb-4143-b506-e014da4d1b2a service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:42:04.945862 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4035/8048] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:42:04 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:42:05.023251 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765692c2-1bbc-4fef-b0a0-7f7aa354a6b4 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:42:05.030378 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10a06b2-d79d-48d3-9a04-a39a5fbbb7f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:42:05.031252 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a06b2-d79d-48d3-9a04-a39a5fbbb7f7 service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:05.031700 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a06b2-d79d-48d3-9a04-a39a5fbbb7f7 service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:05.031874 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a06b2-d79d-48d3-9a04-a39a5fbbb7f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:05.034489 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-d10a06b2-d79d-48d3-9a04-a39a5fbbb7f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:42:05.047545 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10a06b2-d79d-48d3-9a04-a39a5fbbb7f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:42:05.049728 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10a06b2-d79d-48d3-9a04-a39a5fbbb7f7 service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:42:05.067267 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4014/8049] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:42:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:42:05.273255 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48e68a-b84b-4b3d-9f14-615f135686bf None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:05.273718 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48e68a-b84b-4b3d-9f14-615f135686bf None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:05.273977 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48e68a-b84b-4b3d-9f14-615f135686bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:05.334423 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-bd48e68a-b84b-4b3d-9f14-615f135686bf None None] MFA Rules not processed for user `cc437aa51d5641a38a1bbbeb203bbb8d`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:42:05.336539 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-bd48e68a-b84b-4b3d-9f14-615f135686bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:42:05.500367 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4036/8050] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:42:05 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:42:05.828596 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10a06b2-d79d-48d3-9a04-a39a5fbbb7f7 service nova] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:42:05.830208 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-d10a06b2-d79d-48d3-9a04-a39a5fbbb7f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:42:05.901705 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10a06b2-d79d-48d3-9a04-a39a5fbbb7f7 service nova] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:42:05.908099 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff34d939-1935-473a-98b6-36615aeff1b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:42:05.908990 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff34d939-1935-473a-98b6-36615aeff1b6 service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:05.909452 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff34d939-1935-473a-98b6-36615aeff1b6 service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:05.909917 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff34d939-1935-473a-98b6-36615aeff1b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:05.919829 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff34d939-1935-473a-98b6-36615aeff1b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:42:05.921694 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff34d939-1935-473a-98b6-36615aeff1b6 service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:42:05.941121 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4015/8051] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:42:05 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:42:06.477206 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd48e68a-b84b-4b3d-9f14-615f135686bf None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:42:06.478930 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-bd48e68a-b84b-4b3d-9f14-615f135686bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:42:06.578788 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd48e68a-b84b-4b3d-9f14-615f135686bf None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:42:06.587212 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee39837-20ad-4b2b-9aa4-731c27553385 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:42:06.590573 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee39837-20ad-4b2b-9aa4-731c27553385 service placement] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:06.590966 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee39837-20ad-4b2b-9aa4-731c27553385 service placement] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:06.591370 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee39837-20ad-4b2b-9aa4-731c27553385 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:06.596068 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-0ee39837-20ad-4b2b-9aa4-731c27553385 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:42:06.620611 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee39837-20ad-4b2b-9aa4-731c27553385 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:42:06.623280 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee39837-20ad-4b2b-9aa4-731c27553385 service placement] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:42:06.657816 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4037/8052] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:42:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:42:07.715883 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff34d939-1935-473a-98b6-36615aeff1b6 service nova] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:42:07.737885 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff34d939-1935-473a-98b6-36615aeff1b6 service nova] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:42:07.748885 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0916c913-ce77-4485-8abf-70ecc66a0ada service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:42:07.749566 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916c913-ce77-4485-8abf-70ecc66a0ada service placement] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:07.749854 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916c913-ce77-4485-8abf-70ecc66a0ada service placement] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:07.750333 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916c913-ce77-4485-8abf-70ecc66a0ada service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:07.755111 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-0916c913-ce77-4485-8abf-70ecc66a0ada service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:42:07.793858 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0916c913-ce77-4485-8abf-70ecc66a0ada service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:42:07.796201 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0916c913-ce77-4485-8abf-70ecc66a0ada service placement] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:42:07.814116 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4016/8053] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:42:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:42:10.142577 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee39837-20ad-4b2b-9aa4-731c27553385 service placement] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:42:10.253810 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee39837-20ad-4b2b-9aa4-731c27553385 service placement] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:42:10.259438 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847e0975-d6e2-42f6-acf4-643ae73571dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:42:10.260396 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e0975-d6e2-42f6-acf4-643ae73571dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:10.260886 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e0975-d6e2-42f6-acf4-643ae73571dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:10.261369 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e0975-d6e2-42f6-acf4-643ae73571dc admin admin] PATH_INFO: `/v3/users/8c89680f9f38460ba97bc60030226783` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:10.262767 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847e0975-d6e2-42f6-acf4-643ae73571dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c89680f9f38460ba97bc60030226783)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:42:10.265350 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847e0975-d6e2-42f6-acf4-643ae73571dc admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:42:10.545652 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-847e0975-d6e2-42f6-acf4-643ae73571dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c89680f9f38460ba97bc60030226783'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:42:10.563113 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-847e0975-d6e2-42f6-acf4-643ae73571dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c89680f9f38460ba97bc60030226783'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:42:10.591864 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-847e0975-d6e2-42f6-acf4-643ae73571dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c89680f9f38460ba97bc60030226783'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:42:10.678982 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-847e0975-d6e2-42f6-acf4-643ae73571dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c89680f9f38460ba97bc60030226783'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:42:10.680067 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-847e0975-d6e2-42f6-acf4-643ae73571dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c89680f9f38460ba97bc60030226783'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:42:10.689494 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4038/8054] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:42:10 2022] DELETE /identity/v3/users/8c89680f9f38460ba97bc60030226783 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:42:10.693792 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2bf3bb-06bc-4b35-948a-05c5c4d0c746 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:10.694875 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2bf3bb-06bc-4b35-948a-05c5c4d0c746 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:10.695146 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2bf3bb-06bc-4b35-948a-05c5c4d0c746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:10.722848 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-7a2bf3bb-06bc-4b35-948a-05c5c4d0c746 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:42:10.722848 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-7a2bf3bb-06bc-4b35-948a-05c5c4d0c746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:42:10.811769 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4017/8055] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:42:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:42:10.830168 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847e0975-d6e2-42f6-acf4-643ae73571dc admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:42:10.831906 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-847e0975-d6e2-42f6-acf4-643ae73571dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:42:10.959538 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847e0975-d6e2-42f6-acf4-643ae73571dc admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:42:10.965608 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34723451-2683-4793-9b26-74e160760b04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:42:10.967406 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34723451-2683-4793-9b26-74e160760b04 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:10.967406 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34723451-2683-4793-9b26-74e160760b04 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:10.967406 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34723451-2683-4793-9b26-74e160760b04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:10.979451 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34723451-2683-4793-9b26-74e160760b04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:42:10.981033 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34723451-2683-4793-9b26-74e160760b04 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:42:11.020017 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4039/8056] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:42:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:42:11.694136 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed047d8b-2626-4f83-95a7-38ee399c4212 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:11.694904 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed047d8b-2626-4f83-95a7-38ee399c4212 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:11.694904 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed047d8b-2626-4f83-95a7-38ee399c4212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:11.715556 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-ed047d8b-2626-4f83-95a7-38ee399c4212 None None] MFA Rules not processed for user `cab5a299e003422286f01bd44fda92bc`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:42:11.717058 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-ed047d8b-2626-4f83-95a7-38ee399c4212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:42:11.812724 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4018/8057] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:42:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:42:12.240555 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34723451-2683-4793-9b26-74e160760b04 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:42:12.243955 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-34723451-2683-4793-9b26-74e160760b04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:42:12.269742 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34723451-2683-4793-9b26-74e160760b04 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:42:12.283922 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360f001b-8027-440f-90e6-787f245a5b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:42:12.285105 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360f001b-8027-440f-90e6-787f245a5b1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:12.285397 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360f001b-8027-440f-90e6-787f245a5b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:12.285674 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360f001b-8027-440f-90e6-787f245a5b1c admin admin] PATH_INFO: `/v3/projects/18b304c51cc247f793b9feaf58f6f876` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:12.287447 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360f001b-8027-440f-90e6-787f245a5b1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=18b304c51cc247f793b9feaf58f6f876)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:42:12.289972 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360f001b-8027-440f-90e6-787f245a5b1c admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:42:12.477072 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-360f001b-8027-440f-90e6-787f245a5b1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18b304c51cc247f793b9feaf58f6f876', 'request_id': 'req-360f001b-8027-440f-90e6-787f245a5b1c'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:42:12.496622 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-360f001b-8027-440f-90e6-787f245a5b1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18b304c51cc247f793b9feaf58f6f876', 'request_id': 'req-360f001b-8027-440f-90e6-787f245a5b1c'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:42:12.608644 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-360f001b-8027-440f-90e6-787f245a5b1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18b304c51cc247f793b9feaf58f6f876', 'request_id': 'req-360f001b-8027-440f-90e6-787f245a5b1c'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:42:12.625931 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-360f001b-8027-440f-90e6-787f245a5b1c admin admin] The token cache is being invalidate because project 18b304c51cc247f793b9feaf58f6f876 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:42:12.626234 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-360f001b-8027-440f-90e6-787f245a5b1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:42:12.629115 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-360f001b-8027-440f-90e6-787f245a5b1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:42:12.632359 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4040/8058] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:42:12 2022] DELETE /identity/v3/projects/18b304c51cc247f793b9feaf58f6f876 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:42:12.636473 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed047d8b-2626-4f83-95a7-38ee399c4212 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:42:12.660866 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed047d8b-2626-4f83-95a7-38ee399c4212 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:42:12.856593 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6666d6f1-85a9-470d-b37f-0770b46d917a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:42:12.857498 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666d6f1-85a9-470d-b37f-0770b46d917a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:12.857816 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666d6f1-85a9-470d-b37f-0770b46d917a admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:12.858481 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666d6f1-85a9-470d-b37f-0770b46d917a admin admin] PATH_INFO: `/v3/users/1ed886411e0e47d0b583cc2ca2000754` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:12.860207 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6666d6f1-85a9-470d-b37f-0770b46d917a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ed886411e0e47d0b583cc2ca2000754)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:42:12.862185 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6666d6f1-85a9-470d-b37f-0770b46d917a admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:42:13.220004 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-6666d6f1-85a9-470d-b37f-0770b46d917a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ed886411e0e47d0b583cc2ca2000754'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:42:13.248580 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-6666d6f1-85a9-470d-b37f-0770b46d917a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ed886411e0e47d0b583cc2ca2000754'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:42:13.251944 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-6666d6f1-85a9-470d-b37f-0770b46d917a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ed886411e0e47d0b583cc2ca2000754'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:42:13.391160 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-6666d6f1-85a9-470d-b37f-0770b46d917a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ed886411e0e47d0b583cc2ca2000754'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:42:13.420944 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-6666d6f1-85a9-470d-b37f-0770b46d917a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ed886411e0e47d0b583cc2ca2000754'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:42:13.441200 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4019/8059] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:42:12 2022] DELETE /identity/v3/users/1ed886411e0e47d0b583cc2ca2000754 => generated 0 bytes in 805 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:42:13.872978 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360f001b-8027-440f-90e6-787f245a5b1c admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:42:13.880009 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-360f001b-8027-440f-90e6-787f245a5b1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:42:13.895254 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360f001b-8027-440f-90e6-787f245a5b1c admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:42:14.005505 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f31bf4-c639-4a84-aee1-f63e8a39e8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:42:14.007697 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f31bf4-c639-4a84-aee1-f63e8a39e8ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:14.008074 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f31bf4-c639-4a84-aee1-f63e8a39e8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:14.008448 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f31bf4-c639-4a84-aee1-f63e8a39e8ea admin admin] PATH_INFO: `/v3/projects/8972ea3ac7eb434c9c0561e98e49bc95` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:14.010291 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f31bf4-c639-4a84-aee1-f63e8a39e8ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=8972ea3ac7eb434c9c0561e98e49bc95)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:42:14.012634 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f31bf4-c639-4a84-aee1-f63e8a39e8ea admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:42:14.264049 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-06f31bf4-c639-4a84-aee1-f63e8a39e8ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8972ea3ac7eb434c9c0561e98e49bc95', 'request_id': 'req-06f31bf4-c639-4a84-aee1-f63e8a39e8ea'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:42:14.271761 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-06f31bf4-c639-4a84-aee1-f63e8a39e8ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8972ea3ac7eb434c9c0561e98e49bc95', 'request_id': 'req-06f31bf4-c639-4a84-aee1-f63e8a39e8ea'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:42:14.404039 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-06f31bf4-c639-4a84-aee1-f63e8a39e8ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8972ea3ac7eb434c9c0561e98e49bc95', 'request_id': 'req-06f31bf4-c639-4a84-aee1-f63e8a39e8ea'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:42:14.416805 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-06f31bf4-c639-4a84-aee1-f63e8a39e8ea admin admin] The token cache is being invalidate because project 8972ea3ac7eb434c9c0561e98e49bc95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:42:14.417107 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-06f31bf4-c639-4a84-aee1-f63e8a39e8ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:42:14.417791 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-06f31bf4-c639-4a84-aee1-f63e8a39e8ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:42:14.420309 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4041/8060] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:42:13 2022] DELETE /identity/v3/projects/8972ea3ac7eb434c9c0561e98e49bc95 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:42:14.424804 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed79cdc-eb0f-424d-8187-1dc57781bf36 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:14.425307 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed79cdc-eb0f-424d-8187-1dc57781bf36 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:14.425412 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed79cdc-eb0f-424d-8187-1dc57781bf36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:14.445084 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-eed79cdc-eb0f-424d-8187-1dc57781bf36 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:42:14.450447 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-eed79cdc-eb0f-424d-8187-1dc57781bf36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:42:14.523074 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4020/8061] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:42:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:42:14.533309 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff9bdf-1694-4b77-859a-b3354594b708 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:14.533858 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff9bdf-1694-4b77-859a-b3354594b708 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:14.535345 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff9bdf-1694-4b77-859a-b3354594b708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:14.560143 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-9aff9bdf-1694-4b77-859a-b3354594b708 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:42:14.561368 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-9aff9bdf-1694-4b77-859a-b3354594b708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:42:14.574719 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4042/8062] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:42:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:42:14.576380 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed79cdc-eb0f-424d-8187-1dc57781bf36 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:42:14.613776 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed79cdc-eb0f-424d-8187-1dc57781bf36 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:42:14.624753 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17304725-5269-4fef-b61c-19e7adb76a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:42:14.628009 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17304725-5269-4fef-b61c-19e7adb76a1a admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:14.629197 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17304725-5269-4fef-b61c-19e7adb76a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:14.630904 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17304725-5269-4fef-b61c-19e7adb76a1a admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:14.632267 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17304725-5269-4fef-b61c-19e7adb76a1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:42:14.635443 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17304725-5269-4fef-b61c-19e7adb76a1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:42:14.635443 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17304725-5269-4fef-b61c-19e7adb76a1a admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:42:14.651339 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4021/8063] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:42:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:42:14.655413 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aff9bdf-1694-4b77-859a-b3354594b708 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:42:14.665912 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aff9bdf-1694-4b77-859a-b3354594b708 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:42:14.671197 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50d485d-176e-4dca-8409-04235beda6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:42:14.671896 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d485d-176e-4dca-8409-04235beda6b9 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:14.672424 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d485d-176e-4dca-8409-04235beda6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:14.672778 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d485d-176e-4dca-8409-04235beda6b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:14.673557 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50d485d-176e-4dca-8409-04235beda6b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:42:14.675628 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50d485d-176e-4dca-8409-04235beda6b9 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:42:14.764864 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4043/8064] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:42:14 2022] POST /identity/v3/projects => generated 383 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:42:14.769167 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17304725-5269-4fef-b61c-19e7adb76a1a admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:42:14.781006 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17304725-5269-4fef-b61c-19e7adb76a1a admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:42:14.857815 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b67e19-547b-40e1-b7f5-6e7e38ad99d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:42:14.858431 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b67e19-547b-40e1-b7f5-6e7e38ad99d6 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:14.858717 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b67e19-547b-40e1-b7f5-6e7e38ad99d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:14.858997 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b67e19-547b-40e1-b7f5-6e7e38ad99d6 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:14.859998 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b67e19-547b-40e1-b7f5-6e7e38ad99d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:42:14.861944 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b67e19-547b-40e1-b7f5-6e7e38ad99d6 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:42:14.945585 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4022/8065] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:42:14 2022] POST /identity/v3/users => generated 292 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:42:14.949962 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50d485d-176e-4dca-8409-04235beda6b9 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:42:14.962948 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50d485d-176e-4dca-8409-04235beda6b9 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:42:14.972003 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a2b60-ce15-4fd6-8481-a63792b46c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:42:14.980828 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a2b60-ce15-4fd6-8481-a63792b46c9c admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:14.981727 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a2b60-ce15-4fd6-8481-a63792b46c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:14.982161 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a2b60-ce15-4fd6-8481-a63792b46c9c admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:14.988779 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4a2b60-ce15-4fd6-8481-a63792b46c9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:42:14.992594 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4a2b60-ce15-4fd6-8481-a63792b46c9c admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:42:15.010226 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4044/8066] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:42:14 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:42:15.014592 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b67e19-547b-40e1-b7f5-6e7e38ad99d6 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:42:15.027013 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b67e19-547b-40e1-b7f5-6e7e38ad99d6 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:42:15.034364 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f75e6-1d4b-433c-9b0e-683da392d822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:42:15.035684 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f75e6-1d4b-433c-9b0e-683da392d822 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:15.035979 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f75e6-1d4b-433c-9b0e-683da392d822 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:15.036290 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f75e6-1d4b-433c-9b0e-683da392d822 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:15.037340 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2f75e6-1d4b-433c-9b0e-683da392d822 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:42:15.039353 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2f75e6-1d4b-433c-9b0e-683da392d822 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:42:15.059510 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a2b60-ce15-4fd6-8481-a63792b46c9c admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:42:15.061477 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4023/8067] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:42:15 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:42:15.071872 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a2b60-ce15-4fd6-8481-a63792b46c9c admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:42:15.077670 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2744b8d4-f2c0-4c67-a1ec-e155d6638e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:42:15.078857 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744b8d4-f2c0-4c67-a1ec-e155d6638e2a admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:15.079293 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744b8d4-f2c0-4c67-a1ec-e155d6638e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:15.079780 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744b8d4-f2c0-4c67-a1ec-e155d6638e2a admin admin] PATH_INFO: `/v3/projects/3d5a119d451047e7abd17defb447a87b/users/bc82341328844294849cdf641e76235e/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:15.098049 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2744b8d4-f2c0-4c67-a1ec-e155d6638e2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d5a119d451047e7abd17defb447a87b, user_id=bc82341328844294849cdf641e76235e, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:42:15.101202 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2744b8d4-f2c0-4c67-a1ec-e155d6638e2a admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:42:15.191301 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4045/8068] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:42:15 2022] PUT /identity/v3/projects/3d5a119d451047e7abd17defb447a87b/users/bc82341328844294849cdf641e76235e/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:42:15.203892 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f55647-ad54-471d-b6d4-b63f0b22fdc1 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:15.204187 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f55647-ad54-471d-b6d4-b63f0b22fdc1 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:15.204470 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f55647-ad54-471d-b6d4-b63f0b22fdc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:15.255383 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-a8f55647-ad54-471d-b6d4-b63f0b22fdc1 None None] MFA Rules not processed for user `bc82341328844294849cdf641e76235e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:42:15.262307 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-a8f55647-ad54-471d-b6d4-b63f0b22fdc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:42:15.352412 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4024/8069] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:42:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:42:15.362821 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2744b8d4-f2c0-4c67-a1ec-e155d6638e2a admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:42:15.364665 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-2744b8d4-f2c0-4c67-a1ec-e155d6638e2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:42:15.441296 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2744b8d4-f2c0-4c67-a1ec-e155d6638e2a admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:42:15.446006 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a05097-1e2c-49e9-bfcb-fa38d6e4f189 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:42:15.447348 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a05097-1e2c-49e9-bfcb-fa38d6e4f189 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:15.447931 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a05097-1e2c-49e9-bfcb-fa38d6e4f189 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:15.448454 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a05097-1e2c-49e9-bfcb-fa38d6e4f189 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:15.460661 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a05097-1e2c-49e9-bfcb-fa38d6e4f189 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:42:15.462709 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a05097-1e2c-49e9-bfcb-fa38d6e4f189 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:42:15.484967 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4046/8070] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:42:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:42:24.109571 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f55647-ad54-471d-b6d4-b63f0b22fdc1 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:42:24.114568 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-a8f55647-ad54-471d-b6d4-b63f0b22fdc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:42:24.266158 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f55647-ad54-471d-b6d4-b63f0b22fdc1 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:42:24.276343 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024a5205-c409-4138-a38f-2779a1c8059a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:42:24.277240 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a5205-c409-4138-a38f-2779a1c8059a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:24.277529 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a5205-c409-4138-a38f-2779a1c8059a admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:24.277809 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a5205-c409-4138-a38f-2779a1c8059a admin admin] PATH_INFO: `/v3/users/a84f5da000e5493a8b246eb1d7867dea` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:24.281868 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024a5205-c409-4138-a38f-2779a1c8059a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a84f5da000e5493a8b246eb1d7867dea)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:42:24.286959 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024a5205-c409-4138-a38f-2779a1c8059a admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:42:24.372561 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab886c57-295e-494f-afdd-fe4b5180a5d7 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:24.379641 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab886c57-295e-494f-afdd-fe4b5180a5d7 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:24.379641 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab886c57-295e-494f-afdd-fe4b5180a5d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:24.408822 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-ab886c57-295e-494f-afdd-fe4b5180a5d7 None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:42:24.409711 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ab886c57-295e-494f-afdd-fe4b5180a5d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:42:24.478804 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4047/8071] 10.222.0.52 () {58 vars in 1009 bytes} [Sat May 14 21:42:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:42:24.493726 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab886c57-295e-494f-afdd-fe4b5180a5d7 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:42:24.497659 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ab886c57-295e-494f-afdd-fe4b5180a5d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:42:24.524310 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-024a5205-c409-4138-a38f-2779a1c8059a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a84f5da000e5493a8b246eb1d7867dea'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:42:24.541260 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-024a5205-c409-4138-a38f-2779a1c8059a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a84f5da000e5493a8b246eb1d7867dea'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:42:24.541927 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-024a5205-c409-4138-a38f-2779a1c8059a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a84f5da000e5493a8b246eb1d7867dea'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:42:24.635082 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab886c57-295e-494f-afdd-fe4b5180a5d7 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:42:24.638345 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-024a5205-c409-4138-a38f-2779a1c8059a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a84f5da000e5493a8b246eb1d7867dea'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:42:24.641462 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09167d17-16ab-455a-802f-125571807fe8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:42:24.642365 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09167d17-16ab-455a-802f-125571807fe8 service swift] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:24.642837 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09167d17-16ab-455a-802f-125571807fe8 service swift] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:24.644261 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09167d17-16ab-455a-802f-125571807fe8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:24.664316 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-024a5205-c409-4138-a38f-2779a1c8059a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a84f5da000e5493a8b246eb1d7867dea'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:42:24.671014 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09167d17-16ab-455a-802f-125571807fe8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:42:24.672962 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09167d17-16ab-455a-802f-125571807fe8 service swift] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:42:24.685327 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4025/8072] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:42:24 2022] DELETE /identity/v3/users/a84f5da000e5493a8b246eb1d7867dea => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:42:24.703898 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4048/8073] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 21:42:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 14 21:42:25.224990 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024a5205-c409-4138-a38f-2779a1c8059a admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:42:25.228206 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-024a5205-c409-4138-a38f-2779a1c8059a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:42:25.515641 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024a5205-c409-4138-a38f-2779a1c8059a admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:42:25.526190 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b52a91d-16f1-4de6-8ecc-843f22c27861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:42:25.529922 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b52a91d-16f1-4de6-8ecc-843f22c27861 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:25.530504 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b52a91d-16f1-4de6-8ecc-843f22c27861 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:25.531574 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b52a91d-16f1-4de6-8ecc-843f22c27861 admin admin] PATH_INFO: `/v3/projects/54cdf3ac339f4e8a944bef073452c3ab` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:25.535543 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b52a91d-16f1-4de6-8ecc-843f22c27861 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54cdf3ac339f4e8a944bef073452c3ab)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:42:25.539261 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b52a91d-16f1-4de6-8ecc-843f22c27861 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:42:25.812800 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9b52a91d-16f1-4de6-8ecc-843f22c27861 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54cdf3ac339f4e8a944bef073452c3ab', 'request_id': 'req-9b52a91d-16f1-4de6-8ecc-843f22c27861'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:42:25.828476 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9b52a91d-16f1-4de6-8ecc-843f22c27861 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54cdf3ac339f4e8a944bef073452c3ab', 'request_id': 'req-9b52a91d-16f1-4de6-8ecc-843f22c27861'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:42:25.864814 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9b52a91d-16f1-4de6-8ecc-843f22c27861 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54cdf3ac339f4e8a944bef073452c3ab', 'request_id': 'req-9b52a91d-16f1-4de6-8ecc-843f22c27861'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:42:25.974036 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9b52a91d-16f1-4de6-8ecc-843f22c27861 admin admin] The token cache is being invalidate because project 54cdf3ac339f4e8a944bef073452c3ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:42:25.974036 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9b52a91d-16f1-4de6-8ecc-843f22c27861 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:42:25.974245 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9b52a91d-16f1-4de6-8ecc-843f22c27861 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:42:25.982231 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4026/8074] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:42:25 2022] DELETE /identity/v3/projects/54cdf3ac339f4e8a944bef073452c3ab => generated 0 bytes in 756 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:42:25.983577 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09167d17-16ab-455a-802f-125571807fe8 service swift] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:42:26.036644 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09167d17-16ab-455a-802f-125571807fe8 service swift] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:42:26.223671 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4566e332-53bc-4e52-98f3-d3f50a2132ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:42:26.224579 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566e332-53bc-4e52-98f3-d3f50a2132ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:26.225284 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566e332-53bc-4e52-98f3-d3f50a2132ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:26.225678 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566e332-53bc-4e52-98f3-d3f50a2132ac admin admin] PATH_INFO: `/v3/users/cc437aa51d5641a38a1bbbeb203bbb8d` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:26.230321 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4566e332-53bc-4e52-98f3-d3f50a2132ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc437aa51d5641a38a1bbbeb203bbb8d)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:42:26.232359 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4566e332-53bc-4e52-98f3-d3f50a2132ac admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:42:26.485001 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-4566e332-53bc-4e52-98f3-d3f50a2132ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc437aa51d5641a38a1bbbeb203bbb8d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:42:26.530395 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-4566e332-53bc-4e52-98f3-d3f50a2132ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc437aa51d5641a38a1bbbeb203bbb8d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:42:26.547122 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-4566e332-53bc-4e52-98f3-d3f50a2132ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc437aa51d5641a38a1bbbeb203bbb8d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:42:26.665665 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-4566e332-53bc-4e52-98f3-d3f50a2132ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc437aa51d5641a38a1bbbeb203bbb8d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:42:26.666414 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-4566e332-53bc-4e52-98f3-d3f50a2132ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc437aa51d5641a38a1bbbeb203bbb8d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:42:26.674597 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4049/8075] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:42:25 2022] DELETE /identity/v3/users/cc437aa51d5641a38a1bbbeb203bbb8d => generated 0 bytes in 692 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:42:27.107820 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b52a91d-16f1-4de6-8ecc-843f22c27861 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:42:27.111357 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-9b52a91d-16f1-4de6-8ecc-843f22c27861 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:42:27.167039 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b52a91d-16f1-4de6-8ecc-843f22c27861 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:42:27.375695 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd4e179-a8f1-4e9c-984f-7fdfa58e6871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:42:27.381331 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd4e179-a8f1-4e9c-984f-7fdfa58e6871 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:27.381331 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd4e179-a8f1-4e9c-984f-7fdfa58e6871 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:27.381331 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd4e179-a8f1-4e9c-984f-7fdfa58e6871 admin admin] PATH_INFO: `/v3/projects/c50ab00f71a644cebac2e4fe046612d4` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:27.381331 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd4e179-a8f1-4e9c-984f-7fdfa58e6871 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c50ab00f71a644cebac2e4fe046612d4)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:42:27.385283 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd4e179-a8f1-4e9c-984f-7fdfa58e6871 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:42:27.587210 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-bfd4e179-a8f1-4e9c-984f-7fdfa58e6871 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c50ab00f71a644cebac2e4fe046612d4', 'request_id': 'req-bfd4e179-a8f1-4e9c-984f-7fdfa58e6871'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:42:27.593404 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-bfd4e179-a8f1-4e9c-984f-7fdfa58e6871 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c50ab00f71a644cebac2e4fe046612d4', 'request_id': 'req-bfd4e179-a8f1-4e9c-984f-7fdfa58e6871'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:42:27.613391 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-bfd4e179-a8f1-4e9c-984f-7fdfa58e6871 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c50ab00f71a644cebac2e4fe046612d4', 'request_id': 'req-bfd4e179-a8f1-4e9c-984f-7fdfa58e6871'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:42:27.757307 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-bfd4e179-a8f1-4e9c-984f-7fdfa58e6871 admin admin] The token cache is being invalidate because project c50ab00f71a644cebac2e4fe046612d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:42:27.757849 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-bfd4e179-a8f1-4e9c-984f-7fdfa58e6871 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:42:27.758674 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-bfd4e179-a8f1-4e9c-984f-7fdfa58e6871 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:42:27.761152 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4027/8076] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:42:27 2022] DELETE /identity/v3/projects/c50ab00f71a644cebac2e4fe046612d4 => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:42:27.765781 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c155f227-c7dc-49ce-96cf-84b72d503625 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:27.766307 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c155f227-c7dc-49ce-96cf-84b72d503625 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:27.767153 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c155f227-c7dc-49ce-96cf-84b72d503625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:27.794992 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-c155f227-c7dc-49ce-96cf-84b72d503625 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:42:27.797216 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c155f227-c7dc-49ce-96cf-84b72d503625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:42:27.964671 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4050/8077] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:42:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:42:28.011254 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb8ff7-fd4f-4732-87ff-cf32844d0b7e None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:28.011657 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb8ff7-fd4f-4732-87ff-cf32844d0b7e None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:28.011943 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb8ff7-fd4f-4732-87ff-cf32844d0b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:28.112201 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-3abb8ff7-fd4f-4732-87ff-cf32844d0b7e None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:42:28.120135 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-3abb8ff7-fd4f-4732-87ff-cf32844d0b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:42:28.159532 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4028/8078] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:42:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:42:28.165600 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c155f227-c7dc-49ce-96cf-84b72d503625 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:42:28.206829 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c155f227-c7dc-49ce-96cf-84b72d503625 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:42:28.215555 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f61eb37-7e8d-4bb2-b0b7-7c4f9c382103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:42:28.216697 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f61eb37-7e8d-4bb2-b0b7-7c4f9c382103 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:28.222501 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f61eb37-7e8d-4bb2-b0b7-7c4f9c382103 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:28.223334 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f61eb37-7e8d-4bb2-b0b7-7c4f9c382103 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:28.224250 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f61eb37-7e8d-4bb2-b0b7-7c4f9c382103 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:42:28.226145 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f61eb37-7e8d-4bb2-b0b7-7c4f9c382103 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:42:28.231883 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f61eb37-7e8d-4bb2-b0b7-7c4f9c382103 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:42:28.282450 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4051/8079] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:42:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:42:28.284911 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb8ff7-fd4f-4732-87ff-cf32844d0b7e None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:42:28.351751 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb8ff7-fd4f-4732-87ff-cf32844d0b7e None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:42:28.367974 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58adbab-10ff-449b-933a-db669aed179c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:42:28.368952 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58adbab-10ff-449b-933a-db669aed179c admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:28.369396 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58adbab-10ff-449b-933a-db669aed179c admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:28.369837 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58adbab-10ff-449b-933a-db669aed179c admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:28.370692 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58adbab-10ff-449b-933a-db669aed179c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:42:28.372873 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58adbab-10ff-449b-933a-db669aed179c admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:42:28.495165 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4029/8080] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:42:28 2022] POST /identity/v3/projects => generated 377 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:42:28.499632 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f61eb37-7e8d-4bb2-b0b7-7c4f9c382103 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:42:28.545784 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f61eb37-7e8d-4bb2-b0b7-7c4f9c382103 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:42:28.671738 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc763cd-1a11-4752-aff4-6c3fe5ee818c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:42:28.672555 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc763cd-1a11-4752-aff4-6c3fe5ee818c admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:28.673785 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc763cd-1a11-4752-aff4-6c3fe5ee818c admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:28.674200 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc763cd-1a11-4752-aff4-6c3fe5ee818c admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:28.675651 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc763cd-1a11-4752-aff4-6c3fe5ee818c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:42:28.678579 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc763cd-1a11-4752-aff4-6c3fe5ee818c admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:42:28.798917 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4052/8081] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:42:28 2022] POST /identity/v3/users => generated 289 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:42:28.804211 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58adbab-10ff-449b-933a-db669aed179c admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:42:28.825881 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58adbab-10ff-449b-933a-db669aed179c admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:42:28.838715 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c61fc0-ba70-493a-976a-59ca315d1519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:42:28.840533 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c61fc0-ba70-493a-976a-59ca315d1519 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:28.841342 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c61fc0-ba70-493a-976a-59ca315d1519 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:28.842158 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c61fc0-ba70-493a-976a-59ca315d1519 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:28.843984 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c61fc0-ba70-493a-976a-59ca315d1519 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:42:28.847323 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c61fc0-ba70-493a-976a-59ca315d1519 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:42:28.869413 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4030/8082] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:42:28 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:42:28.873418 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc763cd-1a11-4752-aff4-6c3fe5ee818c admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:42:28.888819 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc763cd-1a11-4752-aff4-6c3fe5ee818c admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:42:28.894532 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4388b5df-a12e-46e6-ba90-c3f412ead7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:42:28.895736 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388b5df-a12e-46e6-ba90-c3f412ead7c8 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:28.897774 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388b5df-a12e-46e6-ba90-c3f412ead7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:28.898475 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388b5df-a12e-46e6-ba90-c3f412ead7c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:28.909746 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4388b5df-a12e-46e6-ba90-c3f412ead7c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:42:28.911682 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4388b5df-a12e-46e6-ba90-c3f412ead7c8 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:42:28.931700 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c61fc0-ba70-493a-976a-59ca315d1519 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:42:28.938386 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4053/8083] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:42:28 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:42:28.944836 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c61fc0-ba70-493a-976a-59ca315d1519 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:42:28.952493 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee512674-6f57-4e61-a6eb-a57044e77862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:42:28.953692 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee512674-6f57-4e61-a6eb-a57044e77862 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:28.954145 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee512674-6f57-4e61-a6eb-a57044e77862 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:28.954574 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee512674-6f57-4e61-a6eb-a57044e77862 admin admin] PATH_INFO: `/v3/projects/ab48666810d04a19acf601f7f0be7231/users/05c848f818574d218be610bd709f733f/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:28.984243 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee512674-6f57-4e61-a6eb-a57044e77862 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab48666810d04a19acf601f7f0be7231, user_id=05c848f818574d218be610bd709f733f, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:42:28.984243 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee512674-6f57-4e61-a6eb-a57044e77862 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:42:29.092348 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4031/8084] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:42:28 2022] PUT /identity/v3/projects/ab48666810d04a19acf601f7f0be7231/users/05c848f818574d218be610bd709f733f/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:42:29.097680 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665cc69c-ab92-4e75-9bee-3772b7fe47c0 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:29.097959 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665cc69c-ab92-4e75-9bee-3772b7fe47c0 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:29.101291 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665cc69c-ab92-4e75-9bee-3772b7fe47c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:29.132864 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-665cc69c-ab92-4e75-9bee-3772b7fe47c0 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:42:29.139136 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-665cc69c-ab92-4e75-9bee-3772b7fe47c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:42:29.212563 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4054/8085] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:42:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:42:29.226798 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee512674-6f57-4e61-a6eb-a57044e77862 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:42:29.228476 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-ee512674-6f57-4e61-a6eb-a57044e77862 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:42:29.301929 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665cc69c-ab92-4e75-9bee-3772b7fe47c0 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:42:29.304065 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-665cc69c-ab92-4e75-9bee-3772b7fe47c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:42:29.351133 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee512674-6f57-4e61-a6eb-a57044e77862 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:42:29.355515 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea03709-4e67-4dac-9e24-e77d8af8c96a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:42:29.356264 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea03709-4e67-4dac-9e24-e77d8af8c96a service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:29.356603 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea03709-4e67-4dac-9e24-e77d8af8c96a service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:29.356908 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea03709-4e67-4dac-9e24-e77d8af8c96a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:29.368344 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea03709-4e67-4dac-9e24-e77d8af8c96a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:42:29.369750 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea03709-4e67-4dac-9e24-e77d8af8c96a service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:42:29.390157 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4032/8086] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:42:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:42:29.451379 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665cc69c-ab92-4e75-9bee-3772b7fe47c0 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:42:29.455529 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b32ec9-439a-474e-8dfb-b1387fd39813 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198271d1c0d44cb58bace41a65f4b94c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:42:29.456607 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b32ec9-439a-474e-8dfb-b1387fd39813 service cinder] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:29.456995 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b32ec9-439a-474e-8dfb-b1387fd39813 service cinder] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:29.457365 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b32ec9-439a-474e-8dfb-b1387fd39813 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:29.460627 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-64b32ec9-439a-474e-8dfb-b1387fd39813 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:42:29.565646 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b32ec9-439a-474e-8dfb-b1387fd39813 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:42:29.567574 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b32ec9-439a-474e-8dfb-b1387fd39813 service cinder] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:42:29.590433 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4055/8087] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:42:29 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:42:31.696761 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e1050-3ae8-4d6d-8489-5bee19eb9fe2 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:31.706407 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e1050-3ae8-4d6d-8489-5bee19eb9fe2 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:31.707018 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e1050-3ae8-4d6d-8489-5bee19eb9fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:31.773714 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-622e1050-3ae8-4d6d-8489-5bee19eb9fe2 None None] MFA Rules not processed for user `05c848f818574d218be610bd709f733f`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:42:31.775092 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-622e1050-3ae8-4d6d-8489-5bee19eb9fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:42:31.884945 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4033/8088] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:42:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:42:31.891733 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b32ec9-439a-474e-8dfb-b1387fd39813 service cinder] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:42:31.906825 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b32ec9-439a-474e-8dfb-b1387fd39813 service cinder] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:42:31.943821 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5060a5-5e88-4222-869f-7d5eccf2e019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:42:31.945818 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5060a5-5e88-4222-869f-7d5eccf2e019 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:31.948604 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5060a5-5e88-4222-869f-7d5eccf2e019 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:31.949637 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5060a5-5e88-4222-869f-7d5eccf2e019 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:31.951674 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5060a5-5e88-4222-869f-7d5eccf2e019 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:42:31.961583 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5060a5-5e88-4222-869f-7d5eccf2e019 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:42:32.069166 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4056/8089] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:42:31 2022] POST /identity/v3/projects => generated 377 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:42:32.073109 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e1050-3ae8-4d6d-8489-5bee19eb9fe2 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:42:32.085405 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e1050-3ae8-4d6d-8489-5bee19eb9fe2 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:42:32.166447 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a593559-d9e3-4338-bd85-6b038871555c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:42:32.167833 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a593559-d9e3-4338-bd85-6b038871555c admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:32.168348 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a593559-d9e3-4338-bd85-6b038871555c admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:32.168961 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a593559-d9e3-4338-bd85-6b038871555c admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:32.170040 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a593559-d9e3-4338-bd85-6b038871555c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:42:32.172392 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a593559-d9e3-4338-bd85-6b038871555c admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:42:32.289517 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5060a5-5e88-4222-869f-7d5eccf2e019 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:42:32.297265 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4034/8090] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:42:32 2022] POST /identity/v3/users => generated 295 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:42:32.306213 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5060a5-5e88-4222-869f-7d5eccf2e019 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:42:32.333900 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63740c41-95b2-4f97-a774-999d6a625218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:42:32.335842 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63740c41-95b2-4f97-a774-999d6a625218 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:32.336128 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63740c41-95b2-4f97-a774-999d6a625218 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:32.336440 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63740c41-95b2-4f97-a774-999d6a625218 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:32.337219 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63740c41-95b2-4f97-a774-999d6a625218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:42:32.338845 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63740c41-95b2-4f97-a774-999d6a625218 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:42:32.381533 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a593559-d9e3-4338-bd85-6b038871555c admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:42:32.392451 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4057/8091] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:42:32 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:42:32.399101 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a593559-d9e3-4338-bd85-6b038871555c admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:42:32.423016 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba09781-e681-4dca-b796-ae3f133ab7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:42:32.423969 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba09781-e681-4dca-b796-ae3f133ab7c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:32.424254 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba09781-e681-4dca-b796-ae3f133ab7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:32.424535 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba09781-e681-4dca-b796-ae3f133ab7c3 admin admin] PATH_INFO: `/v3/projects/cfb4b04c831a47d698d7ac39bbc21e71/users/bbc413c5f606474b94fc0bf97e4b9c7d/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:32.460709 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba09781-e681-4dca-b796-ae3f133ab7c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfb4b04c831a47d698d7ac39bbc21e71, user_id=bbc413c5f606474b94fc0bf97e4b9c7d, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:42:32.469541 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba09781-e681-4dca-b796-ae3f133ab7c3 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:42:32.581246 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63740c41-95b2-4f97-a774-999d6a625218 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:42:32.587381 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4035/8092] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:42:32 2022] PUT /identity/v3/projects/cfb4b04c831a47d698d7ac39bbc21e71/users/bbc413c5f606474b94fc0bf97e4b9c7d/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:42:32.597435 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63740c41-95b2-4f97-a774-999d6a625218 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:42:32.770848 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa8379c-8d74-4b57-8bb9-b4c4193063e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:42:32.771913 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa8379c-8d74-4b57-8bb9-b4c4193063e7 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:32.775814 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa8379c-8d74-4b57-8bb9-b4c4193063e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:32.776140 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa8379c-8d74-4b57-8bb9-b4c4193063e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:32.776929 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa8379c-8d74-4b57-8bb9-b4c4193063e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:42:32.782439 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa8379c-8d74-4b57-8bb9-b4c4193063e7 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:42:32.816479 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4058/8093] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:42:32 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:42:32.821744 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba09781-e681-4dca-b796-ae3f133ab7c3 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:42:32.842029 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba09781-e681-4dca-b796-ae3f133ab7c3 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:42:32.864452 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0400e4-320e-480a-adc3-4559bdb52582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:42:32.865924 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0400e4-320e-480a-adc3-4559bdb52582 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:32.866209 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0400e4-320e-480a-adc3-4559bdb52582 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:32.866477 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0400e4-320e-480a-adc3-4559bdb52582 admin admin] PATH_INFO: `/v3/projects/cfb4b04c831a47d698d7ac39bbc21e71/users/bbc413c5f606474b94fc0bf97e4b9c7d/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:32.881680 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0400e4-320e-480a-adc3-4559bdb52582 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfb4b04c831a47d698d7ac39bbc21e71, user_id=bbc413c5f606474b94fc0bf97e4b9c7d, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:42:32.887651 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0400e4-320e-480a-adc3-4559bdb52582 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:42:32.912089 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4036/8094] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:42:32 2022] PUT /identity/v3/projects/cfb4b04c831a47d698d7ac39bbc21e71/users/bbc413c5f606474b94fc0bf97e4b9c7d/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:42:35.560184 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa8379c-8d74-4b57-8bb9-b4c4193063e7 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:42:35.563659 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-caa8379c-8d74-4b57-8bb9-b4c4193063e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:42:35.755147 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa8379c-8d74-4b57-8bb9-b4c4193063e7 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:42:35.960849 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e117853-e84d-4c07-a464-92f6799b267f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:42:35.961425 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e117853-e84d-4c07-a464-92f6799b267f service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:35.962867 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e117853-e84d-4c07-a464-92f6799b267f service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:35.962867 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e117853-e84d-4c07-a464-92f6799b267f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:35.966707 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-5e117853-e84d-4c07-a464-92f6799b267f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:42:36.002034 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e117853-e84d-4c07-a464-92f6799b267f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:42:36.015031 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e117853-e84d-4c07-a464-92f6799b267f service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:42:36.018498 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15065e21-8dee-4964-a272-0a8b4b1ecf83 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:36.018498 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15065e21-8dee-4964-a272-0a8b4b1ecf83 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:36.018498 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15065e21-8dee-4964-a272-0a8b4b1ecf83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:36.073142 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4059/8095] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:42:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:42:36.092895 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-15065e21-8dee-4964-a272-0a8b4b1ecf83 None None] MFA Rules not processed for user `bbc413c5f606474b94fc0bf97e4b9c7d`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:42:36.094215 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-15065e21-8dee-4964-a272-0a8b4b1ecf83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:42:36.275623 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4037/8096] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:42:36 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:42:36.288295 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf5139-d1fc-4d83-baf9-bca8a7a7d197 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:36.288629 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf5139-d1fc-4d83-baf9-bca8a7a7d197 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:36.288850 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf5139-d1fc-4d83-baf9-bca8a7a7d197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:36.345210 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-68cf5139-d1fc-4d83-baf9-bca8a7a7d197 None None] MFA Rules not processed for user `05c848f818574d218be610bd709f733f`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:42:36.351262 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-68cf5139-d1fc-4d83-baf9-bca8a7a7d197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:42:36.479526 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4060/8097] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:42:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:42:36.488617 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15065e21-8dee-4964-a272-0a8b4b1ecf83 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:42:36.491331 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-15065e21-8dee-4964-a272-0a8b4b1ecf83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:42:36.522624 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15065e21-8dee-4964-a272-0a8b4b1ecf83 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:42:36.543303 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fdb0d8-9dd4-4634-9773-f46063cdbee2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:42:36.544018 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fdb0d8-9dd4-4634-9773-f46063cdbee2 service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:36.544306 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fdb0d8-9dd4-4634-9773-f46063cdbee2 service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:36.544587 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fdb0d8-9dd4-4634-9773-f46063cdbee2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:36.572133 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fdb0d8-9dd4-4634-9773-f46063cdbee2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:42:36.572133 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fdb0d8-9dd4-4634-9773-f46063cdbee2 service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:42:36.600669 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4038/8098] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:42:36 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:42:37.185566 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cf5139-d1fc-4d83-baf9-bca8a7a7d197 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:42:37.187846 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-68cf5139-d1fc-4d83-baf9-bca8a7a7d197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:42:37.319940 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cf5139-d1fc-4d83-baf9-bca8a7a7d197 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:42:37.338947 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f37647-021d-4bde-8fc6-df2d0d1c346e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:42:37.339698 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f37647-021d-4bde-8fc6-df2d0d1c346e service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:37.339993 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f37647-021d-4bde-8fc6-df2d0d1c346e service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:37.340433 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f37647-021d-4bde-8fc6-df2d0d1c346e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:37.343003 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-41f37647-021d-4bde-8fc6-df2d0d1c346e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:42:37.377096 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f37647-021d-4bde-8fc6-df2d0d1c346e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:42:37.378470 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f37647-021d-4bde-8fc6-df2d0d1c346e service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:42:37.403887 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4061/8099] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:42:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:42:42.704517 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fdb0d8-9dd4-4634-9773-f46063cdbee2 service nova] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:42:42.721116 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fdb0d8-9dd4-4634-9773-f46063cdbee2 service nova] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:42:42.726292 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e675f97-d7e0-41f0-91a4-6cf039e3555b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:42:42.727513 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e675f97-d7e0-41f0-91a4-6cf039e3555b service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:42.728020 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e675f97-d7e0-41f0-91a4-6cf039e3555b service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:42.728509 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e675f97-d7e0-41f0-91a4-6cf039e3555b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:42.730811 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-1e675f97-d7e0-41f0-91a4-6cf039e3555b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:42:42.749987 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e675f97-d7e0-41f0-91a4-6cf039e3555b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:42:42.751667 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e675f97-d7e0-41f0-91a4-6cf039e3555b service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:42:42.766649 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4039/8100] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:42:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:42:50.316524 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f37647-021d-4bde-8fc6-df2d0d1c346e service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:42:50.316524 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-41f37647-021d-4bde-8fc6-df2d0d1c346e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:42:50.436830 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f37647-021d-4bde-8fc6-df2d0d1c346e service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:42:50.445018 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b222c9-c4a1-44a5-acc6-9c800d7f9af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:42:50.446108 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b222c9-c4a1-44a5-acc6-9c800d7f9af2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:50.446658 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b222c9-c4a1-44a5-acc6-9c800d7f9af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:50.447127 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b222c9-c4a1-44a5-acc6-9c800d7f9af2 admin admin] PATH_INFO: `/v3/users/bc82341328844294849cdf641e76235e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:50.448510 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b222c9-c4a1-44a5-acc6-9c800d7f9af2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc82341328844294849cdf641e76235e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:42:50.450890 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b222c9-c4a1-44a5-acc6-9c800d7f9af2 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:42:50.654356 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d2b222c9-c4a1-44a5-acc6-9c800d7f9af2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc82341328844294849cdf641e76235e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:42:50.690215 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d2b222c9-c4a1-44a5-acc6-9c800d7f9af2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc82341328844294849cdf641e76235e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:42:50.701836 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d2b222c9-c4a1-44a5-acc6-9c800d7f9af2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc82341328844294849cdf641e76235e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:42:50.808940 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d2b222c9-c4a1-44a5-acc6-9c800d7f9af2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc82341328844294849cdf641e76235e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:42:50.809878 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d2b222c9-c4a1-44a5-acc6-9c800d7f9af2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc82341328844294849cdf641e76235e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:42:50.831698 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4062/8101] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:42:50 2022] DELETE /identity/v3/users/bc82341328844294849cdf641e76235e => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:42:50.835680 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0d216-6d0f-4390-836e-9ae19a3e5c60 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:50.836769 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0d216-6d0f-4390-836e-9ae19a3e5c60 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:50.837277 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0d216-6d0f-4390-836e-9ae19a3e5c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:50.876770 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-9ad0d216-6d0f-4390-836e-9ae19a3e5c60 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:42:50.878827 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-9ad0d216-6d0f-4390-836e-9ae19a3e5c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:42:50.975709 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4040/8102] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:42:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:42:50.981202 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b222c9-c4a1-44a5-acc6-9c800d7f9af2 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:42:50.983942 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d2b222c9-c4a1-44a5-acc6-9c800d7f9af2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:42:51.078978 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b222c9-c4a1-44a5-acc6-9c800d7f9af2 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:42:51.089042 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e82c2-bd71-46b2-badf-6a55f86b4e43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:42:51.089877 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e82c2-bd71-46b2-badf-6a55f86b4e43 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:51.090243 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e82c2-bd71-46b2-badf-6a55f86b4e43 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:51.090529 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e82c2-bd71-46b2-badf-6a55f86b4e43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:51.107653 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7e82c2-bd71-46b2-badf-6a55f86b4e43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:42:51.109132 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7e82c2-bd71-46b2-badf-6a55f86b4e43 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:42:51.122863 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4063/8103] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:42:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:42:51.478448 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0d216-6d0f-4390-836e-9ae19a3e5c60 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:42:51.483802 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-9ad0d216-6d0f-4390-836e-9ae19a3e5c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:42:51.493938 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0d216-6d0f-4390-836e-9ae19a3e5c60 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:42:51.498613 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc34896-54fa-4390-bd5d-6b3d04dd2916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:42:51.499543 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc34896-54fa-4390-bd5d-6b3d04dd2916 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:51.499922 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc34896-54fa-4390-bd5d-6b3d04dd2916 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:51.500202 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc34896-54fa-4390-bd5d-6b3d04dd2916 admin admin] PATH_INFO: `/v3/projects/3d5a119d451047e7abd17defb447a87b` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:51.501752 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc34896-54fa-4390-bd5d-6b3d04dd2916 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d5a119d451047e7abd17defb447a87b)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:42:51.503405 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc34896-54fa-4390-bd5d-6b3d04dd2916 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:42:51.631764 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7dc34896-54fa-4390-bd5d-6b3d04dd2916 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d5a119d451047e7abd17defb447a87b', 'request_id': 'req-7dc34896-54fa-4390-bd5d-6b3d04dd2916'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:42:51.647471 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7dc34896-54fa-4390-bd5d-6b3d04dd2916 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d5a119d451047e7abd17defb447a87b', 'request_id': 'req-7dc34896-54fa-4390-bd5d-6b3d04dd2916'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:42:51.657184 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7dc34896-54fa-4390-bd5d-6b3d04dd2916 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d5a119d451047e7abd17defb447a87b', 'request_id': 'req-7dc34896-54fa-4390-bd5d-6b3d04dd2916'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:42:51.768601 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7dc34896-54fa-4390-bd5d-6b3d04dd2916 admin admin] The token cache is being invalidate because project 3d5a119d451047e7abd17defb447a87b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:42:51.769049 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7dc34896-54fa-4390-bd5d-6b3d04dd2916 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:42:51.770146 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-7dc34896-54fa-4390-bd5d-6b3d04dd2916 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:42:51.774125 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4041/8104] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:42:51 2022] DELETE /identity/v3/projects/3d5a119d451047e7abd17defb447a87b => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:42:51.778578 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ababe68d-0a65-4ff6-8b56-bff8a2186809 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:51.782083 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ababe68d-0a65-4ff6-8b56-bff8a2186809 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:51.782083 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ababe68d-0a65-4ff6-8b56-bff8a2186809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:51.805676 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-ababe68d-0a65-4ff6-8b56-bff8a2186809 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:42:51.807793 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ababe68d-0a65-4ff6-8b56-bff8a2186809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:42:51.899317 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4064/8105] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:42:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:42:51.907205 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1900cca2-6caf-423f-8c09-b9b25f7375b4 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:51.907787 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1900cca2-6caf-423f-8c09-b9b25f7375b4 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:51.907970 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1900cca2-6caf-423f-8c09-b9b25f7375b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:51.936866 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-1900cca2-6caf-423f-8c09-b9b25f7375b4 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:42:51.940374 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-1900cca2-6caf-423f-8c09-b9b25f7375b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:42:51.952317 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4042/8106] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:42:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:42:51.956814 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ababe68d-0a65-4ff6-8b56-bff8a2186809 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:42:51.969062 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ababe68d-0a65-4ff6-8b56-bff8a2186809 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:42:51.985592 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703c4fc4-f489-4b2f-9654-c8bae7d53e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:42:51.986274 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c4fc4-f489-4b2f-9654-c8bae7d53e25 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:51.986558 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c4fc4-f489-4b2f-9654-c8bae7d53e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:51.986835 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c4fc4-f489-4b2f-9654-c8bae7d53e25 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:51.987631 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703c4fc4-f489-4b2f-9654-c8bae7d53e25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:42:51.987946 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703c4fc4-f489-4b2f-9654-c8bae7d53e25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:42:51.989861 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703c4fc4-f489-4b2f-9654-c8bae7d53e25 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:42:52.011039 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4065/8107] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:42:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:42:52.011265 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1900cca2-6caf-423f-8c09-b9b25f7375b4 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:42:52.022662 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1900cca2-6caf-423f-8c09-b9b25f7375b4 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:42:52.028429 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6e1dc3-c24b-4f5c-acd0-b8b93a930554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:42:52.030732 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e1dc3-c24b-4f5c-acd0-b8b93a930554 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:52.030732 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e1dc3-c24b-4f5c-acd0-b8b93a930554 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:52.030732 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e1dc3-c24b-4f5c-acd0-b8b93a930554 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:52.030732 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6e1dc3-c24b-4f5c-acd0-b8b93a930554 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:42:52.034001 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6e1dc3-c24b-4f5c-acd0-b8b93a930554 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:42:52.155252 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4043/8108] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:42:52 2022] POST /identity/v3/projects => generated 371 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:42:52.156085 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703c4fc4-f489-4b2f-9654-c8bae7d53e25 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:42:52.172451 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703c4fc4-f489-4b2f-9654-c8bae7d53e25 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:42:52.235946 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a843faa-b3b0-40e1-aee3-c15cd84b3e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:42:52.236896 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a843faa-b3b0-40e1-aee3-c15cd84b3e47 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:52.237374 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a843faa-b3b0-40e1-aee3-c15cd84b3e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:52.237654 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a843faa-b3b0-40e1-aee3-c15cd84b3e47 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:52.238340 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a843faa-b3b0-40e1-aee3-c15cd84b3e47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:42:52.240876 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a843faa-b3b0-40e1-aee3-c15cd84b3e47 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:42:52.351784 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4066/8109] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:42:52 2022] POST /identity/v3/users => generated 286 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:42:52.355904 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6e1dc3-c24b-4f5c-acd0-b8b93a930554 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:42:52.367628 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6e1dc3-c24b-4f5c-acd0-b8b93a930554 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:42:52.372824 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28339c3-6765-4e80-98a7-c73859e27e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:42:52.373541 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28339c3-6765-4e80-98a7-c73859e27e9f admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:52.373830 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28339c3-6765-4e80-98a7-c73859e27e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:52.374139 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28339c3-6765-4e80-98a7-c73859e27e9f admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:52.374850 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28339c3-6765-4e80-98a7-c73859e27e9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:42:52.376529 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28339c3-6765-4e80-98a7-c73859e27e9f admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:42:52.392117 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4044/8110] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:42:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:42:52.393160 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a843faa-b3b0-40e1-aee3-c15cd84b3e47 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:42:52.403538 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a843faa-b3b0-40e1-aee3-c15cd84b3e47 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:42:52.408431 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d3c2e-c37c-4c65-85b0-b76ad9f0456a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:42:52.409154 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d3c2e-c37c-4c65-85b0-b76ad9f0456a admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:52.409439 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d3c2e-c37c-4c65-85b0-b76ad9f0456a admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:52.409750 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d3c2e-c37c-4c65-85b0-b76ad9f0456a admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:52.410714 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03d3c2e-c37c-4c65-85b0-b76ad9f0456a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:42:52.412529 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03d3c2e-c37c-4c65-85b0-b76ad9f0456a admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:42:52.426441 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4067/8111] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:42:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:42:52.431096 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28339c3-6765-4e80-98a7-c73859e27e9f admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:42:52.445156 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28339c3-6765-4e80-98a7-c73859e27e9f admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:42:52.453166 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faccf61-02aa-4959-9357-e11e736beab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:42:52.454331 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faccf61-02aa-4959-9357-e11e736beab7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:52.454682 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faccf61-02aa-4959-9357-e11e736beab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:52.454967 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faccf61-02aa-4959-9357-e11e736beab7 admin admin] PATH_INFO: `/v3/projects/8a79a55f6b2f46ae89036ef9bb98639c/users/16ffd497e45e4683971ebee0eaebb975/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:52.471310 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faccf61-02aa-4959-9357-e11e736beab7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a79a55f6b2f46ae89036ef9bb98639c, user_id=16ffd497e45e4683971ebee0eaebb975, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:42:52.475034 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faccf61-02aa-4959-9357-e11e736beab7 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:42:52.586491 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4045/8112] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:42:52 2022] PUT /identity/v3/projects/8a79a55f6b2f46ae89036ef9bb98639c/users/16ffd497e45e4683971ebee0eaebb975/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:42:52.596819 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a3953-13f8-4302-ae13-50181bf8b767 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:52.597112 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a3953-13f8-4302-ae13-50181bf8b767 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:52.597398 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a3953-13f8-4302-ae13-50181bf8b767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:52.625980 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-f81a3953-13f8-4302-ae13-50181bf8b767 None None] MFA Rules not processed for user `16ffd497e45e4683971ebee0eaebb975`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:42:52.627271 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-f81a3953-13f8-4302-ae13-50181bf8b767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:42:52.713034 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4068/8113] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:42:52 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:42:52.721723 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faccf61-02aa-4959-9357-e11e736beab7 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:42:52.786518 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faccf61-02aa-4959-9357-e11e736beab7 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:42:52.791274 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8add2b-2686-4df0-8a7e-4223d28c2dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:42:52.791956 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8add2b-2686-4df0-8a7e-4223d28c2dbb admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:52.792240 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8add2b-2686-4df0-8a7e-4223d28c2dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:52.792510 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8add2b-2686-4df0-8a7e-4223d28c2dbb admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:52.793194 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8add2b-2686-4df0-8a7e-4223d28c2dbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:42:52.795162 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8add2b-2686-4df0-8a7e-4223d28c2dbb admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:42:52.891962 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4046/8114] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:42:52 2022] POST /identity/v3/projects => generated 373 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:42:52.896547 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81a3953-13f8-4302-ae13-50181bf8b767 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:42:52.911067 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81a3953-13f8-4302-ae13-50181bf8b767 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:42:52.982341 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e43dbe-2869-4224-a9ab-4f77bb3ad9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:42:52.983093 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e43dbe-2869-4224-a9ab-4f77bb3ad9f0 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:52.983378 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e43dbe-2869-4224-a9ab-4f77bb3ad9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:52.983999 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e43dbe-2869-4224-a9ab-4f77bb3ad9f0 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:52.984563 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e43dbe-2869-4224-a9ab-4f77bb3ad9f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:42:52.990181 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e43dbe-2869-4224-a9ab-4f77bb3ad9f0 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:42:53.159577 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4069/8115] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:42:52 2022] POST /identity/v3/users => generated 293 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:42:53.160896 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8add2b-2686-4df0-8a7e-4223d28c2dbb admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:42:53.171747 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8add2b-2686-4df0-8a7e-4223d28c2dbb admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:42:53.177513 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b702016-c89b-4969-a8ac-4903a169c768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:42:53.178394 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b702016-c89b-4969-a8ac-4903a169c768 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:53.178394 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b702016-c89b-4969-a8ac-4903a169c768 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:53.178571 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b702016-c89b-4969-a8ac-4903a169c768 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:53.179203 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b702016-c89b-4969-a8ac-4903a169c768 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:42:53.180845 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b702016-c89b-4969-a8ac-4903a169c768 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:42:53.191825 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4047/8116] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:42:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:42:53.196968 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e43dbe-2869-4224-a9ab-4f77bb3ad9f0 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:42:53.207362 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e43dbe-2869-4224-a9ab-4f77bb3ad9f0 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:42:53.212201 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da3b82e-41c0-4a9e-8b31-fb20f5d80afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:42:53.213071 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3b82e-41c0-4a9e-8b31-fb20f5d80afa admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:53.213375 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3b82e-41c0-4a9e-8b31-fb20f5d80afa admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:53.213647 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3b82e-41c0-4a9e-8b31-fb20f5d80afa admin admin] PATH_INFO: `/v3/projects/3e07c5295d2f485d99b3ecb7372e3eb4/users/77e7a5dd3ff2484f97cdd943744ec1aa/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:53.229014 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da3b82e-41c0-4a9e-8b31-fb20f5d80afa admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e07c5295d2f485d99b3ecb7372e3eb4, user_id=77e7a5dd3ff2484f97cdd943744ec1aa, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:42:53.231718 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da3b82e-41c0-4a9e-8b31-fb20f5d80afa admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:42:53.316533 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4070/8117] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:42:53 2022] PUT /identity/v3/projects/3e07c5295d2f485d99b3ecb7372e3eb4/users/77e7a5dd3ff2484f97cdd943744ec1aa/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:42:53.320584 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b702016-c89b-4969-a8ac-4903a169c768 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:42:53.330941 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b702016-c89b-4969-a8ac-4903a169c768 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:42:53.393503 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cffb805-e9c0-49c7-8aa0-8d9fbeb26921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:42:53.394334 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cffb805-e9c0-49c7-8aa0-8d9fbeb26921 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:53.394692 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cffb805-e9c0-49c7-8aa0-8d9fbeb26921 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:53.394976 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cffb805-e9c0-49c7-8aa0-8d9fbeb26921 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:53.395829 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cffb805-e9c0-49c7-8aa0-8d9fbeb26921 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:42:53.397718 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cffb805-e9c0-49c7-8aa0-8d9fbeb26921 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:42:53.411883 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4048/8118] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:42:53 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:42:53.415542 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da3b82e-41c0-4a9e-8b31-fb20f5d80afa admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:42:53.426287 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da3b82e-41c0-4a9e-8b31-fb20f5d80afa admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:42:53.432545 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa329a-6c64-4ba2-8b6b-d7882c55c2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:42:53.433537 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa329a-6c64-4ba2-8b6b-d7882c55c2b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:53.433825 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa329a-6c64-4ba2-8b6b-d7882c55c2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:53.434105 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa329a-6c64-4ba2-8b6b-d7882c55c2b3 admin admin] PATH_INFO: `/v3/projects/3e07c5295d2f485d99b3ecb7372e3eb4/users/77e7a5dd3ff2484f97cdd943744ec1aa/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:53.434881 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e954476-49e2-4126-bb3f-478fa175578f None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:53.435173 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e954476-49e2-4126-bb3f-478fa175578f None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:53.435449 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e954476-49e2-4126-bb3f-478fa175578f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:53.436393 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fa329a-6c64-4ba2-8b6b-d7882c55c2b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e07c5295d2f485d99b3ecb7372e3eb4, user_id=77e7a5dd3ff2484f97cdd943744ec1aa, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:42:53.439598 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fa329a-6c64-4ba2-8b6b-d7882c55c2b3 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:42:53.450933 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4071/8119] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:42:53 2022] PUT /identity/v3/projects/3e07c5295d2f485d99b3ecb7372e3eb4/users/77e7a5dd3ff2484f97cdd943744ec1aa/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:42:53.454085 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-4e954476-49e2-4126-bb3f-478fa175578f None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:42:53.455287 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-4e954476-49e2-4126-bb3f-478fa175578f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:42:53.519356 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4049/8120] 10.222.0.52 () {58 vars in 967 bytes} [Sat May 14 21:42:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:42:53.536748 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa329a-6c64-4ba2-8b6b-d7882c55c2b3 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:42:53.538848 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-88fa329a-6c64-4ba2-8b6b-d7882c55c2b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:42:53.541365 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa83c1af-f612-4a14-8d0c-1b02dcb0d6f8 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:53.541652 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa83c1af-f612-4a14-8d0c-1b02dcb0d6f8 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:53.541932 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa83c1af-f612-4a14-8d0c-1b02dcb0d6f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:53.572093 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-fa83c1af-f612-4a14-8d0c-1b02dcb0d6f8 None None] MFA Rules not processed for user `77e7a5dd3ff2484f97cdd943744ec1aa`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:42:53.573509 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-fa83c1af-f612-4a14-8d0c-1b02dcb0d6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:42:53.620388 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa329a-6c64-4ba2-8b6b-d7882c55c2b3 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:42:53.626628 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cd5685-adc6-4180-85b5-b2dd293edc34 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:42:53.627375 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd5685-adc6-4180-85b5-b2dd293edc34 service swift] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:53.627753 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd5685-adc6-4180-85b5-b2dd293edc34 service swift] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:53.628099 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd5685-adc6-4180-85b5-b2dd293edc34 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:53.638143 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cd5685-adc6-4180-85b5-b2dd293edc34 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:42:53.639771 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cd5685-adc6-4180-85b5-b2dd293edc34 service swift] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:42:53.649451 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4072/8121] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 21:42:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 21:42:53.654170 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4050/8122] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:42:53 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:42:53.666354 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa83c1af-f612-4a14-8d0c-1b02dcb0d6f8 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:42:53.667926 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-fa83c1af-f612-4a14-8d0c-1b02dcb0d6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:42:53.883368 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa83c1af-f612-4a14-8d0c-1b02dcb0d6f8 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:42:53.887517 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d94d90c-ea58-431f-8126-e473f22ce56f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198271d1c0d44cb58bace41a65f4b94c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:42:53.888310 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d94d90c-ea58-431f-8126-e473f22ce56f service cinder] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:53.893296 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d94d90c-ea58-431f-8126-e473f22ce56f service cinder] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:53.893296 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d94d90c-ea58-431f-8126-e473f22ce56f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:53.899109 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d94d90c-ea58-431f-8126-e473f22ce56f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:42:53.900574 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d94d90c-ea58-431f-8126-e473f22ce56f service cinder] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:42:53.910340 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4051/8123] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:42:53 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:42:54.232321 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cd5685-adc6-4180-85b5-b2dd293edc34 service swift] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:42:54.247173 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cd5685-adc6-4180-85b5-b2dd293edc34 service swift] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:42:54.251086 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99da7949-5d14-47e4-916c-bfc0e729b607 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198271d1c0d44cb58bace41a65f4b94c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:42:54.251797 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da7949-5d14-47e4-916c-bfc0e729b607 service cinder] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:42:54.252084 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da7949-5d14-47e4-916c-bfc0e729b607 service cinder] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:42:54.252361 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da7949-5d14-47e4-916c-bfc0e729b607 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:42:54.312996 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99da7949-5d14-47e4-916c-bfc0e729b607 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:42:54.314562 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99da7949-5d14-47e4-916c-bfc0e729b607 service cinder] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:42:54.324280 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4073/8124] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:42:54 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:43:03.587670 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d94d90c-ea58-431f-8126-e473f22ce56f service cinder] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:43:03.589411 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-3d94d90c-ea58-431f-8126-e473f22ce56f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:43:03.654786 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d94d90c-ea58-431f-8126-e473f22ce56f service cinder] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:43:03.659694 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4e95e9-2dc0-45ff-9c3c-c8abbec66430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:43:03.660569 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e95e9-2dc0-45ff-9c3c-c8abbec66430 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:43:03.660849 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e95e9-2dc0-45ff-9c3c-c8abbec66430 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:43:03.661120 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e95e9-2dc0-45ff-9c3c-c8abbec66430 admin admin] PATH_INFO: `/v3/users/9b156d4dd0064d63b2809fa6327ed8aa` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:43:03.662898 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4e95e9-2dc0-45ff-9c3c-c8abbec66430 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b156d4dd0064d63b2809fa6327ed8aa)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:43:03.664854 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4e95e9-2dc0-45ff-9c3c-c8abbec66430 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:43:03.930096 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0f4e95e9-2dc0-45ff-9c3c-c8abbec66430 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b156d4dd0064d63b2809fa6327ed8aa'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:43:03.939402 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0f4e95e9-2dc0-45ff-9c3c-c8abbec66430 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b156d4dd0064d63b2809fa6327ed8aa'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:43:03.940234 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0f4e95e9-2dc0-45ff-9c3c-c8abbec66430 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b156d4dd0064d63b2809fa6327ed8aa'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:43:04.058628 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0f4e95e9-2dc0-45ff-9c3c-c8abbec66430 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b156d4dd0064d63b2809fa6327ed8aa'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:43:04.071307 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-0f4e95e9-2dc0-45ff-9c3c-c8abbec66430 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b156d4dd0064d63b2809fa6327ed8aa'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:43:04.077339 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4052/8125] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:43:03 2022] DELETE /identity/v3/users/9b156d4dd0064d63b2809fa6327ed8aa => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:43:04.307415 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99da7949-5d14-47e4-916c-bfc0e729b607 service cinder] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:43:04.319263 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99da7949-5d14-47e4-916c-bfc0e729b607 service cinder] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:43:04.379033 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79699c80-b07d-4204-919c-676025b538a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:43:04.380050 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79699c80-b07d-4204-919c-676025b538a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:43:04.380180 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79699c80-b07d-4204-919c-676025b538a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:43:04.381169 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79699c80-b07d-4204-919c-676025b538a6 admin admin] PATH_INFO: `/v3/projects/02f7a491fa1c45c896f1af07217a303a` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:43:04.382802 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79699c80-b07d-4204-919c-676025b538a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02f7a491fa1c45c896f1af07217a303a)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:43:04.387371 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79699c80-b07d-4204-919c-676025b538a6 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:43:04.551450 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-79699c80-b07d-4204-919c-676025b538a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02f7a491fa1c45c896f1af07217a303a', 'request_id': 'req-79699c80-b07d-4204-919c-676025b538a6'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:43:04.558873 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-79699c80-b07d-4204-919c-676025b538a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02f7a491fa1c45c896f1af07217a303a', 'request_id': 'req-79699c80-b07d-4204-919c-676025b538a6'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:43:04.607339 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-79699c80-b07d-4204-919c-676025b538a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02f7a491fa1c45c896f1af07217a303a', 'request_id': 'req-79699c80-b07d-4204-919c-676025b538a6'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:43:04.620595 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-79699c80-b07d-4204-919c-676025b538a6 admin admin] The token cache is being invalidate because project 02f7a491fa1c45c896f1af07217a303a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:43:04.621083 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-79699c80-b07d-4204-919c-676025b538a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:43:04.621757 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-79699c80-b07d-4204-919c-676025b538a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:43:04.623471 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4074/8126] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:43:04 2022] DELETE /identity/v3/projects/02f7a491fa1c45c896f1af07217a303a => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:43:04.628481 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b25979-4c72-43e2-9714-bce3a82e4e85 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:43:04.628951 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b25979-4c72-43e2-9714-bce3a82e4e85 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:43:04.629080 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b25979-4c72-43e2-9714-bce3a82e4e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:43:04.652120 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-92b25979-4c72-43e2-9714-bce3a82e4e85 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:43:04.653503 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-92b25979-4c72-43e2-9714-bce3a82e4e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:43:04.737604 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4053/8127] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:43:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:43:04.746232 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3d329-6a02-4560-971f-4dae4337ead3 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:43:04.746542 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3d329-6a02-4560-971f-4dae4337ead3 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:43:04.746821 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3d329-6a02-4560-971f-4dae4337ead3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:43:04.765918 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-21b3d329-6a02-4560-971f-4dae4337ead3 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:43:04.767043 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-21b3d329-6a02-4560-971f-4dae4337ead3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:43:04.775748 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4075/8128] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:43:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:43:04.780229 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b25979-4c72-43e2-9714-bce3a82e4e85 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:43:04.790851 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b25979-4c72-43e2-9714-bce3a82e4e85 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:43:04.795427 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b71740-8920-47d7-b038-04a3b5de3594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:43:04.796116 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b71740-8920-47d7-b038-04a3b5de3594 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:43:04.796399 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b71740-8920-47d7-b038-04a3b5de3594 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:43:04.796678 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b71740-8920-47d7-b038-04a3b5de3594 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:43:04.797400 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b71740-8920-47d7-b038-04a3b5de3594 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:43:04.797846 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b71740-8920-47d7-b038-04a3b5de3594 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:43:04.799448 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b71740-8920-47d7-b038-04a3b5de3594 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:43:04.810739 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4054/8129] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:43:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:43:04.815013 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b3d329-6a02-4560-971f-4dae4337ead3 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:43:04.824903 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b3d329-6a02-4560-971f-4dae4337ead3 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:43:04.829545 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed5b32c-8be8-4a7d-8d09-2e05497f854e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:43:04.834175 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed5b32c-8be8-4a7d-8d09-2e05497f854e admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:43:04.834175 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed5b32c-8be8-4a7d-8d09-2e05497f854e admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:43:04.834175 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed5b32c-8be8-4a7d-8d09-2e05497f854e admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:43:04.834175 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed5b32c-8be8-4a7d-8d09-2e05497f854e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:43:04.834175 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed5b32c-8be8-4a7d-8d09-2e05497f854e admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:43:04.911900 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4076/8130] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:43:04 2022] POST /identity/v3/projects => generated 373 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:43:04.918367 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b71740-8920-47d7-b038-04a3b5de3594 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:43:04.930522 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b71740-8920-47d7-b038-04a3b5de3594 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:43:04.987418 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d36fdd-6d23-49a2-bdc9-d7b13bd40dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:43:04.988174 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d36fdd-6d23-49a2-bdc9-d7b13bd40dd2 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:43:04.988460 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d36fdd-6d23-49a2-bdc9-d7b13bd40dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:43:04.988975 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d36fdd-6d23-49a2-bdc9-d7b13bd40dd2 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:43:04.989537 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d36fdd-6d23-49a2-bdc9-d7b13bd40dd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:43:04.992001 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d36fdd-6d23-49a2-bdc9-d7b13bd40dd2 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:43:05.105338 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4055/8131] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:43:04 2022] POST /identity/v3/users => generated 287 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:43:05.109490 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed5b32c-8be8-4a7d-8d09-2e05497f854e admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:43:05.120541 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed5b32c-8be8-4a7d-8d09-2e05497f854e admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:43:05.125901 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d949a7-ad52-450a-afda-c85655b4a511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:43:05.126528 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d949a7-ad52-450a-afda-c85655b4a511 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:43:05.134214 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d949a7-ad52-450a-afda-c85655b4a511 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:43:05.134214 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d949a7-ad52-450a-afda-c85655b4a511 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:43:05.134214 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d949a7-ad52-450a-afda-c85655b4a511 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:43:05.134214 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d949a7-ad52-450a-afda-c85655b4a511 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:43:05.141142 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4077/8132] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:43:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:43:05.145314 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d36fdd-6d23-49a2-bdc9-d7b13bd40dd2 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:43:05.156245 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d36fdd-6d23-49a2-bdc9-d7b13bd40dd2 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:43:05.162792 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d9690b-15ea-4e92-860b-ac3c63e9733f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:43:05.164507 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d9690b-15ea-4e92-860b-ac3c63e9733f admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:43:05.164507 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d9690b-15ea-4e92-860b-ac3c63e9733f admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:43:05.164507 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d9690b-15ea-4e92-860b-ac3c63e9733f admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:43:05.165022 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d9690b-15ea-4e92-860b-ac3c63e9733f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:43:05.166838 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d9690b-15ea-4e92-860b-ac3c63e9733f admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:43:05.178744 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4056/8133] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:43:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:43:05.182868 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d949a7-ad52-450a-afda-c85655b4a511 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:43:05.194328 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d949a7-ad52-450a-afda-c85655b4a511 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:43:05.199027 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2ae356-f51c-4338-9a0d-df248babc0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:43:05.199973 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ae356-f51c-4338-9a0d-df248babc0f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:43:05.200266 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ae356-f51c-4338-9a0d-df248babc0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:43:05.200541 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ae356-f51c-4338-9a0d-df248babc0f0 admin admin] PATH_INFO: `/v3/projects/8526cad5fef54772a988df44138c90fe/users/80f409708620474aa128bf8412fa54be/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:43:05.216075 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2ae356-f51c-4338-9a0d-df248babc0f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8526cad5fef54772a988df44138c90fe, user_id=80f409708620474aa128bf8412fa54be, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:43:05.218909 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2ae356-f51c-4338-9a0d-df248babc0f0 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:43:05.288126 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4078/8134] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:43:05 2022] PUT /identity/v3/projects/8526cad5fef54772a988df44138c90fe/users/80f409708620474aa128bf8412fa54be/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:43:05.298684 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b283d-0062-4049-a43e-c8e851b2314b None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:43:05.298983 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b283d-0062-4049-a43e-c8e851b2314b None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:43:05.299269 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b283d-0062-4049-a43e-c8e851b2314b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:43:05.326506 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-c15b283d-0062-4049-a43e-c8e851b2314b None None] MFA Rules not processed for user `80f409708620474aa128bf8412fa54be`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:43:05.327776 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c15b283d-0062-4049-a43e-c8e851b2314b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:43:05.393218 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4057/8135] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:43:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:43:05.405473 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2ae356-f51c-4338-9a0d-df248babc0f0 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:43:05.408025 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-2c2ae356-f51c-4338-9a0d-df248babc0f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:43:05.468800 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2ae356-f51c-4338-9a0d-df248babc0f0 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:43:05.472689 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a809f70b-31fe-49d2-b29e-dd04c2b9f112 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198271d1c0d44cb58bace41a65f4b94c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:43:05.473334 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a809f70b-31fe-49d2-b29e-dd04c2b9f112 service cinder] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:43:05.473615 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a809f70b-31fe-49d2-b29e-dd04c2b9f112 service cinder] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:43:05.473892 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a809f70b-31fe-49d2-b29e-dd04c2b9f112 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:43:05.483201 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a809f70b-31fe-49d2-b29e-dd04c2b9f112 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:43:05.484672 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a809f70b-31fe-49d2-b29e-dd04c2b9f112 service cinder] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:43:05.494078 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4079/8136] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:43:05 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:43:08.348322 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a8a99-b813-4d41-a4ff-62c9d4c4ab19 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:43:08.353656 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a8a99-b813-4d41-a4ff-62c9d4c4ab19 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:43:08.353656 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a8a99-b813-4d41-a4ff-62c9d4c4ab19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:43:08.369106 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-eb8a8a99-b813-4d41-a4ff-62c9d4c4ab19 None None] MFA Rules not processed for user `80f409708620474aa128bf8412fa54be`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:43:08.370610 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-eb8a8a99-b813-4d41-a4ff-62c9d4c4ab19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:43:08.381643 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4058/8137] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:43:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:43:09.535367 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a809f70b-31fe-49d2-b29e-dd04c2b9f112 service cinder] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:43:09.538540 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-a809f70b-31fe-49d2-b29e-dd04c2b9f112 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:43:09.628731 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a809f70b-31fe-49d2-b29e-dd04c2b9f112 service cinder] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:43:09.634993 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef989a7-838a-4b5a-b32a-e0159fb3abac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:43:09.636008 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef989a7-838a-4b5a-b32a-e0159fb3abac admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:43:09.636496 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef989a7-838a-4b5a-b32a-e0159fb3abac admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:43:09.637099 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef989a7-838a-4b5a-b32a-e0159fb3abac admin admin] PATH_INFO: `/v3/users/05c848f818574d218be610bd709f733f` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:43:09.639315 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef989a7-838a-4b5a-b32a-e0159fb3abac admin admin] RBAC: Authorizing `identity:delete_user(user_id=05c848f818574d218be610bd709f733f)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:43:09.641916 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef989a7-838a-4b5a-b32a-e0159fb3abac admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:43:09.850526 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-bef989a7-838a-4b5a-b32a-e0159fb3abac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05c848f818574d218be610bd709f733f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:43:09.862639 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-bef989a7-838a-4b5a-b32a-e0159fb3abac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05c848f818574d218be610bd709f733f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:43:09.870542 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-bef989a7-838a-4b5a-b32a-e0159fb3abac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05c848f818574d218be610bd709f733f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:43:09.932432 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-bef989a7-838a-4b5a-b32a-e0159fb3abac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05c848f818574d218be610bd709f733f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:43:09.933080 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-bef989a7-838a-4b5a-b32a-e0159fb3abac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05c848f818574d218be610bd709f733f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:43:09.939917 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4080/8138] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:43:09 2022] DELETE /identity/v3/users/05c848f818574d218be610bd709f733f => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:43:09.986713 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a8a99-b813-4d41-a4ff-62c9d4c4ab19 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:43:09.988115 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-eb8a8a99-b813-4d41-a4ff-62c9d4c4ab19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:43:10.054697 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a8a99-b813-4d41-a4ff-62c9d4c4ab19 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:43:10.103711 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e66d085-69dc-434b-8b7f-993ebc8f8e0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:43:10.104358 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e66d085-69dc-434b-8b7f-993ebc8f8e0b service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:43:10.104639 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e66d085-69dc-434b-8b7f-993ebc8f8e0b service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:43:10.104922 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e66d085-69dc-434b-8b7f-993ebc8f8e0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:43:10.106707 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8e66d085-69dc-434b-8b7f-993ebc8f8e0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:43:10.118789 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e66d085-69dc-434b-8b7f-993ebc8f8e0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:43:10.120273 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e66d085-69dc-434b-8b7f-993ebc8f8e0b service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:43:10.130567 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4059/8139] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:43:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:43:10.216682 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef989a7-838a-4b5a-b32a-e0159fb3abac admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:43:10.219696 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-bef989a7-838a-4b5a-b32a-e0159fb3abac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:43:10.333390 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef989a7-838a-4b5a-b32a-e0159fb3abac admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:43:10.338395 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e1170b-fabf-462a-b5e3-4e55c7b9e02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:43:10.339261 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e1170b-fabf-462a-b5e3-4e55c7b9e02a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:43:10.339576 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e1170b-fabf-462a-b5e3-4e55c7b9e02a admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:43:10.339882 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e1170b-fabf-462a-b5e3-4e55c7b9e02a admin admin] PATH_INFO: `/v3/projects/ab48666810d04a19acf601f7f0be7231` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:43:10.341078 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e1170b-fabf-462a-b5e3-4e55c7b9e02a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab48666810d04a19acf601f7f0be7231)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:43:10.343067 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e1170b-fabf-462a-b5e3-4e55c7b9e02a admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:43:10.478458 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-86e1170b-fabf-462a-b5e3-4e55c7b9e02a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab48666810d04a19acf601f7f0be7231', 'request_id': 'req-86e1170b-fabf-462a-b5e3-4e55c7b9e02a'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:43:10.486724 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-86e1170b-fabf-462a-b5e3-4e55c7b9e02a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab48666810d04a19acf601f7f0be7231', 'request_id': 'req-86e1170b-fabf-462a-b5e3-4e55c7b9e02a'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:43:10.590774 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-86e1170b-fabf-462a-b5e3-4e55c7b9e02a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab48666810d04a19acf601f7f0be7231', 'request_id': 'req-86e1170b-fabf-462a-b5e3-4e55c7b9e02a'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:43:10.608614 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-86e1170b-fabf-462a-b5e3-4e55c7b9e02a admin admin] The token cache is being invalidate because project ab48666810d04a19acf601f7f0be7231 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:43:10.609018 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-86e1170b-fabf-462a-b5e3-4e55c7b9e02a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:43:10.609882 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-86e1170b-fabf-462a-b5e3-4e55c7b9e02a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:43:10.612662 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4081/8140] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:43:10 2022] DELETE /identity/v3/projects/ab48666810d04a19acf601f7f0be7231 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:43:10.618189 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e66d085-69dc-434b-8b7f-993ebc8f8e0b service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:43:10.631775 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e66d085-69dc-434b-8b7f-993ebc8f8e0b service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:43:10.750925 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be21e7-2792-4a24-9c21-d85d481f1117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:43:10.751898 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be21e7-2792-4a24-9c21-d85d481f1117 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:43:10.752352 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be21e7-2792-4a24-9c21-d85d481f1117 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:43:10.752803 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be21e7-2792-4a24-9c21-d85d481f1117 admin admin] PATH_INFO: `/v3/users/bbc413c5f606474b94fc0bf97e4b9c7d` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:43:10.754495 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45be21e7-2792-4a24-9c21-d85d481f1117 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbc413c5f606474b94fc0bf97e4b9c7d)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:43:10.759341 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45be21e7-2792-4a24-9c21-d85d481f1117 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:43:10.960926 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-45be21e7-2792-4a24-9c21-d85d481f1117 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbc413c5f606474b94fc0bf97e4b9c7d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:43:10.967757 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-45be21e7-2792-4a24-9c21-d85d481f1117 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbc413c5f606474b94fc0bf97e4b9c7d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:43:10.968443 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-45be21e7-2792-4a24-9c21-d85d481f1117 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbc413c5f606474b94fc0bf97e4b9c7d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:43:11.075744 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-45be21e7-2792-4a24-9c21-d85d481f1117 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbc413c5f606474b94fc0bf97e4b9c7d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:43:11.089875 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-45be21e7-2792-4a24-9c21-d85d481f1117 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbc413c5f606474b94fc0bf97e4b9c7d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:43:11.095877 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4060/8141] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:43:10 2022] DELETE /identity/v3/users/bbc413c5f606474b94fc0bf97e4b9c7d => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:43:11.376677 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e1170b-fabf-462a-b5e3-4e55c7b9e02a admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:43:11.379049 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-86e1170b-fabf-462a-b5e3-4e55c7b9e02a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:43:11.406245 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e1170b-fabf-462a-b5e3-4e55c7b9e02a admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:43:11.478270 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a702b58-9475-41f9-bc8c-fb364330e28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:43:11.479314 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a702b58-9475-41f9-bc8c-fb364330e28b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:43:11.479455 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a702b58-9475-41f9-bc8c-fb364330e28b admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:43:11.479749 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a702b58-9475-41f9-bc8c-fb364330e28b admin admin] PATH_INFO: `/v3/projects/cfb4b04c831a47d698d7ac39bbc21e71` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:43:11.482189 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a702b58-9475-41f9-bc8c-fb364330e28b admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfb4b04c831a47d698d7ac39bbc21e71)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:43:11.484207 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a702b58-9475-41f9-bc8c-fb364330e28b admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:43:11.612443 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5a702b58-9475-41f9-bc8c-fb364330e28b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfb4b04c831a47d698d7ac39bbc21e71', 'request_id': 'req-5a702b58-9475-41f9-bc8c-fb364330e28b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:43:11.622189 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5a702b58-9475-41f9-bc8c-fb364330e28b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfb4b04c831a47d698d7ac39bbc21e71', 'request_id': 'req-5a702b58-9475-41f9-bc8c-fb364330e28b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:43:11.698496 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5a702b58-9475-41f9-bc8c-fb364330e28b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfb4b04c831a47d698d7ac39bbc21e71', 'request_id': 'req-5a702b58-9475-41f9-bc8c-fb364330e28b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:43:11.722092 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5a702b58-9475-41f9-bc8c-fb364330e28b admin admin] The token cache is being invalidate because project cfb4b04c831a47d698d7ac39bbc21e71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:43:11.726106 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5a702b58-9475-41f9-bc8c-fb364330e28b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:43:11.732908 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5a702b58-9475-41f9-bc8c-fb364330e28b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:43:11.732908 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4082/8142] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:43:11 2022] DELETE /identity/v3/projects/cfb4b04c831a47d698d7ac39bbc21e71 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:43:17.101873 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be21e7-2792-4a24-9c21-d85d481f1117 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:43:17.103584 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-45be21e7-2792-4a24-9c21-d85d481f1117 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:43:17.120372 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be21e7-2792-4a24-9c21-d85d481f1117 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:43:17.180424 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bf87ff-537f-4914-8b47-6bdd0714861d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:43:17.181223 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf87ff-537f-4914-8b47-6bdd0714861d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:43:17.181534 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf87ff-537f-4914-8b47-6bdd0714861d admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:43:17.181884 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf87ff-537f-4914-8b47-6bdd0714861d admin admin] PATH_INFO: `/v3/users/cab5a299e003422286f01bd44fda92bc` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:43:17.182997 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bf87ff-537f-4914-8b47-6bdd0714861d admin admin] RBAC: Authorizing `identity:delete_user(user_id=cab5a299e003422286f01bd44fda92bc)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:43:17.184959 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bf87ff-537f-4914-8b47-6bdd0714861d admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:43:17.370178 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-33bf87ff-537f-4914-8b47-6bdd0714861d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cab5a299e003422286f01bd44fda92bc'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:43:17.376767 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-33bf87ff-537f-4914-8b47-6bdd0714861d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cab5a299e003422286f01bd44fda92bc'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:43:17.377496 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-33bf87ff-537f-4914-8b47-6bdd0714861d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cab5a299e003422286f01bd44fda92bc'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:43:17.435620 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-33bf87ff-537f-4914-8b47-6bdd0714861d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cab5a299e003422286f01bd44fda92bc'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:43:17.447847 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-33bf87ff-537f-4914-8b47-6bdd0714861d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cab5a299e003422286f01bd44fda92bc'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:43:17.453850 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4061/8143] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:43:17 2022] DELETE /identity/v3/users/cab5a299e003422286f01bd44fda92bc => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:43:17.458554 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05123766-1f15-4983-b3af-8dabba98716b None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:43:17.459294 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05123766-1f15-4983-b3af-8dabba98716b None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:43:17.459625 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05123766-1f15-4983-b3af-8dabba98716b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:43:17.477639 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-05123766-1f15-4983-b3af-8dabba98716b None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:43:17.478812 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-05123766-1f15-4983-b3af-8dabba98716b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:43:17.540041 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4083/8144] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:43:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:43:17.550041 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bf87ff-537f-4914-8b47-6bdd0714861d admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:43:17.551458 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-33bf87ff-537f-4914-8b47-6bdd0714861d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:43:17.611526 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bf87ff-537f-4914-8b47-6bdd0714861d admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:43:17.615394 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274d459d-c3f4-4dbd-8f7d-c6d557597cf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:43:17.616248 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d459d-c3f4-4dbd-8f7d-c6d557597cf6 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:43:17.616529 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d459d-c3f4-4dbd-8f7d-c6d557597cf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:43:17.616804 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d459d-c3f4-4dbd-8f7d-c6d557597cf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:43:17.626093 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274d459d-c3f4-4dbd-8f7d-c6d557597cf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:43:17.627458 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274d459d-c3f4-4dbd-8f7d-c6d557597cf6 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:43:17.637185 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4062/8145] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:43:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:43:17.855828 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05123766-1f15-4983-b3af-8dabba98716b None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:43:17.857295 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-05123766-1f15-4983-b3af-8dabba98716b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:43:17.869915 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05123766-1f15-4983-b3af-8dabba98716b None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:43:17.875102 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ccf468-8f7b-44ea-b1af-3dcb924ee03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:43:17.876190 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ccf468-8f7b-44ea-b1af-3dcb924ee03f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:43:17.876759 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ccf468-8f7b-44ea-b1af-3dcb924ee03f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:43:17.877149 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ccf468-8f7b-44ea-b1af-3dcb924ee03f admin admin] PATH_INFO: `/v3/projects/a5d1195cf21b4146ae0c49a9c95ab8fa` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:43:17.878446 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ccf468-8f7b-44ea-b1af-3dcb924ee03f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5d1195cf21b4146ae0c49a9c95ab8fa)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:43:17.880530 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ccf468-8f7b-44ea-b1af-3dcb924ee03f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:43:18.003063 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-15ccf468-8f7b-44ea-b1af-3dcb924ee03f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5d1195cf21b4146ae0c49a9c95ab8fa', 'request_id': 'req-15ccf468-8f7b-44ea-b1af-3dcb924ee03f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:43:18.009554 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-15ccf468-8f7b-44ea-b1af-3dcb924ee03f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5d1195cf21b4146ae0c49a9c95ab8fa', 'request_id': 'req-15ccf468-8f7b-44ea-b1af-3dcb924ee03f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:43:18.092743 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-15ccf468-8f7b-44ea-b1af-3dcb924ee03f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5d1195cf21b4146ae0c49a9c95ab8fa', 'request_id': 'req-15ccf468-8f7b-44ea-b1af-3dcb924ee03f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:43:18.104340 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-15ccf468-8f7b-44ea-b1af-3dcb924ee03f admin admin] The token cache is being invalidate because project a5d1195cf21b4146ae0c49a9c95ab8fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:43:18.104635 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-15ccf468-8f7b-44ea-b1af-3dcb924ee03f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:43:18.105288 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-15ccf468-8f7b-44ea-b1af-3dcb924ee03f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:43:18.106884 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4084/8146] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:43:17 2022] DELETE /identity/v3/projects/a5d1195cf21b4146ae0c49a9c95ab8fa => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:43:18.110937 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274d459d-c3f4-4dbd-8f7d-c6d557597cf6 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:43:18.121367 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274d459d-c3f4-4dbd-8f7d-c6d557597cf6 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:43:18.176768 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770e1c68-9616-4b77-834d-fd260fd731fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:43:18.177597 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e1c68-9616-4b77-834d-fd260fd731fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:43:18.177953 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e1c68-9616-4b77-834d-fd260fd731fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:43:18.178359 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e1c68-9616-4b77-834d-fd260fd731fd admin admin] PATH_INFO: `/v3/users/678c26f0813e46feb85b6a8a6a1518e0` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:43:18.179610 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770e1c68-9616-4b77-834d-fd260fd731fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=678c26f0813e46feb85b6a8a6a1518e0)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:43:18.181540 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770e1c68-9616-4b77-834d-fd260fd731fd admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:43:18.377829 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-770e1c68-9616-4b77-834d-fd260fd731fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '678c26f0813e46feb85b6a8a6a1518e0'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:43:18.387173 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-770e1c68-9616-4b77-834d-fd260fd731fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '678c26f0813e46feb85b6a8a6a1518e0'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:43:18.388238 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-770e1c68-9616-4b77-834d-fd260fd731fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '678c26f0813e46feb85b6a8a6a1518e0'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:43:18.429971 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-770e1c68-9616-4b77-834d-fd260fd731fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '678c26f0813e46feb85b6a8a6a1518e0'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:43:18.444657 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-770e1c68-9616-4b77-834d-fd260fd731fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '678c26f0813e46feb85b6a8a6a1518e0'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:43:18.453830 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4063/8147] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:43:18 2022] DELETE /identity/v3/users/678c26f0813e46feb85b6a8a6a1518e0 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:43:18.872754 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ccf468-8f7b-44ea-b1af-3dcb924ee03f admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:43:18.875083 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-15ccf468-8f7b-44ea-b1af-3dcb924ee03f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:43:18.894099 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ccf468-8f7b-44ea-b1af-3dcb924ee03f admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:43:18.961931 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c053f-fdc5-4914-bf2c-71601bfc4538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:43:18.962865 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c053f-fdc5-4914-bf2c-71601bfc4538 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:43:18.963210 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c053f-fdc5-4914-bf2c-71601bfc4538 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:43:18.963949 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c053f-fdc5-4914-bf2c-71601bfc4538 admin admin] PATH_INFO: `/v3/projects/9c980bbab3cc41cfbef038882a7a8e9a` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:43:18.965766 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019c053f-fdc5-4914-bf2c-71601bfc4538 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c980bbab3cc41cfbef038882a7a8e9a)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:43:18.967982 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019c053f-fdc5-4914-bf2c-71601bfc4538 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:43:19.088421 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-019c053f-fdc5-4914-bf2c-71601bfc4538 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c980bbab3cc41cfbef038882a7a8e9a', 'request_id': 'req-019c053f-fdc5-4914-bf2c-71601bfc4538'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:43:19.094033 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-019c053f-fdc5-4914-bf2c-71601bfc4538 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c980bbab3cc41cfbef038882a7a8e9a', 'request_id': 'req-019c053f-fdc5-4914-bf2c-71601bfc4538'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:43:19.177367 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-019c053f-fdc5-4914-bf2c-71601bfc4538 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c980bbab3cc41cfbef038882a7a8e9a', 'request_id': 'req-019c053f-fdc5-4914-bf2c-71601bfc4538'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:43:19.190227 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-019c053f-fdc5-4914-bf2c-71601bfc4538 admin admin] The token cache is being invalidate because project 9c980bbab3cc41cfbef038882a7a8e9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:43:19.190522 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-019c053f-fdc5-4914-bf2c-71601bfc4538 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:43:19.191178 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-019c053f-fdc5-4914-bf2c-71601bfc4538 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:43:19.192954 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4085/8148] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:43:18 2022] DELETE /identity/v3/projects/9c980bbab3cc41cfbef038882a7a8e9a => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:43:19.199004 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2eb181-a172-421e-bd6e-96f701f2edb8 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:43:19.199541 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2eb181-a172-421e-bd6e-96f701f2edb8 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:43:19.199719 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2eb181-a172-421e-bd6e-96f701f2edb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:43:19.218045 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-3f2eb181-a172-421e-bd6e-96f701f2edb8 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:43:19.219250 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-3f2eb181-a172-421e-bd6e-96f701f2edb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:43:19.276922 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4064/8149] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:43:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:43:19.285234 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de739e-46ec-420a-ba84-0892124186d1 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:43:19.285555 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de739e-46ec-420a-ba84-0892124186d1 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:43:19.285848 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de739e-46ec-420a-ba84-0892124186d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:43:19.304416 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-96de739e-46ec-420a-ba84-0892124186d1 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:43:19.305655 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-96de739e-46ec-420a-ba84-0892124186d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:43:19.315347 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4086/8150] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:43:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:43:19.320832 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2eb181-a172-421e-bd6e-96f701f2edb8 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:43:19.330837 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2eb181-a172-421e-bd6e-96f701f2edb8 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:43:19.335873 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354851f9-a843-405d-9f32-2de1f028e87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:43:19.336536 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354851f9-a843-405d-9f32-2de1f028e87b admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:43:19.336822 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354851f9-a843-405d-9f32-2de1f028e87b admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:43:19.337120 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354851f9-a843-405d-9f32-2de1f028e87b admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:43:19.337838 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354851f9-a843-405d-9f32-2de1f028e87b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:43:19.338143 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354851f9-a843-405d-9f32-2de1f028e87b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:43:19.339771 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354851f9-a843-405d-9f32-2de1f028e87b admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:43:19.351372 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4065/8151] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:43:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:43:19.356060 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de739e-46ec-420a-ba84-0892124186d1 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:43:19.366413 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de739e-46ec-420a-ba84-0892124186d1 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:43:19.371212 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1db70ed-7cbc-4b00-9e44-0bd083f82746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:43:19.371922 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db70ed-7cbc-4b00-9e44-0bd083f82746 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:43:19.372204 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db70ed-7cbc-4b00-9e44-0bd083f82746 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:43:19.372478 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db70ed-7cbc-4b00-9e44-0bd083f82746 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:43:19.373155 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1db70ed-7cbc-4b00-9e44-0bd083f82746 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:43:19.375040 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1db70ed-7cbc-4b00-9e44-0bd083f82746 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:43:19.454981 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4087/8152] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:43:19 2022] POST /identity/v3/projects => generated 387 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:43:19.459701 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354851f9-a843-405d-9f32-2de1f028e87b admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:43:19.469671 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354851f9-a843-405d-9f32-2de1f028e87b admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:43:19.528227 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78068f0-e85d-4c74-8c72-1ae904c250b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:43:19.528927 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78068f0-e85d-4c74-8c72-1ae904c250b7 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:43:19.529207 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78068f0-e85d-4c74-8c72-1ae904c250b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:43:19.529478 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78068f0-e85d-4c74-8c72-1ae904c250b7 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:43:19.532018 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78068f0-e85d-4c74-8c72-1ae904c250b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:43:19.533981 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78068f0-e85d-4c74-8c72-1ae904c250b7 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:43:19.627776 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4066/8153] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:43:19 2022] POST /identity/v3/users => generated 294 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:43:19.629084 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1db70ed-7cbc-4b00-9e44-0bd083f82746 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:43:19.643522 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1db70ed-7cbc-4b00-9e44-0bd083f82746 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:43:19.648702 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7fad67-fb59-400c-b5a9-47c2e5278a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:43:19.649376 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7fad67-fb59-400c-b5a9-47c2e5278a57 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:43:19.649662 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7fad67-fb59-400c-b5a9-47c2e5278a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:43:19.649941 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7fad67-fb59-400c-b5a9-47c2e5278a57 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:43:19.650665 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7fad67-fb59-400c-b5a9-47c2e5278a57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:43:19.652307 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7fad67-fb59-400c-b5a9-47c2e5278a57 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:43:19.664506 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4088/8154] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:43:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:43:19.668575 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78068f0-e85d-4c74-8c72-1ae904c250b7 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:43:19.679876 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78068f0-e85d-4c74-8c72-1ae904c250b7 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:43:19.685024 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208e37f8-7cec-4f59-bd0e-9a91a42265b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:43:19.687123 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e37f8-7cec-4f59-bd0e-9a91a42265b8 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:43:19.687123 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e37f8-7cec-4f59-bd0e-9a91a42265b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:43:19.687123 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e37f8-7cec-4f59-bd0e-9a91a42265b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:43:19.687123 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208e37f8-7cec-4f59-bd0e-9a91a42265b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:43:19.688687 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208e37f8-7cec-4f59-bd0e-9a91a42265b8 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:43:19.703079 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4067/8155] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:43:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:43:19.704294 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7fad67-fb59-400c-b5a9-47c2e5278a57 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:43:19.714521 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7fad67-fb59-400c-b5a9-47c2e5278a57 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:43:19.719976 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b14bb1-fdaf-41d5-9a79-92ba59df33f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:43:19.720994 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b14bb1-fdaf-41d5-9a79-92ba59df33f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:43:19.721373 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b14bb1-fdaf-41d5-9a79-92ba59df33f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:43:19.721859 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b14bb1-fdaf-41d5-9a79-92ba59df33f5 admin admin] PATH_INFO: `/v3/projects/72ef6fbeb65948a3b9cbd45229a26bec/users/139d42d8881949b3befd8e4412c64800/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:43:19.738856 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b14bb1-fdaf-41d5-9a79-92ba59df33f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72ef6fbeb65948a3b9cbd45229a26bec, user_id=139d42d8881949b3befd8e4412c64800, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:43:19.742590 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b14bb1-fdaf-41d5-9a79-92ba59df33f5 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:43:19.847541 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4089/8156] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:43:19 2022] PUT /identity/v3/projects/72ef6fbeb65948a3b9cbd45229a26bec/users/139d42d8881949b3befd8e4412c64800/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:43:19.859786 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d019aad7-b0f4-43ff-9729-02bb8755d5e4 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:43:19.860080 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d019aad7-b0f4-43ff-9729-02bb8755d5e4 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:43:19.860359 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d019aad7-b0f4-43ff-9729-02bb8755d5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:43:19.888482 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-d019aad7-b0f4-43ff-9729-02bb8755d5e4 None None] MFA Rules not processed for user `139d42d8881949b3befd8e4412c64800`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:43:19.889875 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-d019aad7-b0f4-43ff-9729-02bb8755d5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:43:19.960531 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4068/8157] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:43:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:43:19.968036 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b14bb1-fdaf-41d5-9a79-92ba59df33f5 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:43:20.034108 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b14bb1-fdaf-41d5-9a79-92ba59df33f5 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:43:20.039574 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bac3e6-a7bc-43bb-b02e-4e250589ad1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:43:20.040317 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bac3e6-a7bc-43bb-b02e-4e250589ad1c admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:43:20.040724 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bac3e6-a7bc-43bb-b02e-4e250589ad1c admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:43:20.041015 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bac3e6-a7bc-43bb-b02e-4e250589ad1c admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:43:20.041700 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bac3e6-a7bc-43bb-b02e-4e250589ad1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:43:20.044081 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bac3e6-a7bc-43bb-b02e-4e250589ad1c admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:43:20.122843 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4090/8158] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:43:19 2022] POST /identity/v3/projects => generated 387 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:43:20.126873 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d019aad7-b0f4-43ff-9729-02bb8755d5e4 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:43:20.137726 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d019aad7-b0f4-43ff-9729-02bb8755d5e4 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:43:20.204243 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e352291b-5f61-4bf6-8106-0f1942aa7f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:43:20.205018 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352291b-5f61-4bf6-8106-0f1942aa7f90 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:43:20.205390 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352291b-5f61-4bf6-8106-0f1942aa7f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:43:20.205729 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352291b-5f61-4bf6-8106-0f1942aa7f90 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:43:20.206488 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e352291b-5f61-4bf6-8106-0f1942aa7f90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:43:20.213239 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e352291b-5f61-4bf6-8106-0f1942aa7f90 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:43:20.321411 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4069/8159] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:43:20 2022] POST /identity/v3/users => generated 294 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:43:20.325544 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bac3e6-a7bc-43bb-b02e-4e250589ad1c admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:43:20.338636 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bac3e6-a7bc-43bb-b02e-4e250589ad1c admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:43:20.348037 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8e22dd-3095-4448-b78e-549997096127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:43:20.348793 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e22dd-3095-4448-b78e-549997096127 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:43:20.349157 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e22dd-3095-4448-b78e-549997096127 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:43:20.349624 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e22dd-3095-4448-b78e-549997096127 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:43:20.350472 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8e22dd-3095-4448-b78e-549997096127 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:43:20.352209 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8e22dd-3095-4448-b78e-549997096127 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:43:20.363241 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4091/8160] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:43:20 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:43:20.367513 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e352291b-5f61-4bf6-8106-0f1942aa7f90 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:43:20.378129 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e352291b-5f61-4bf6-8106-0f1942aa7f90 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:43:20.383690 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20241655-ddba-4a6b-92a6-b1a5f57e9a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:43:20.384363 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20241655-ddba-4a6b-92a6-b1a5f57e9a60 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:43:20.384651 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20241655-ddba-4a6b-92a6-b1a5f57e9a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:43:20.384929 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20241655-ddba-4a6b-92a6-b1a5f57e9a60 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:43:20.385680 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20241655-ddba-4a6b-92a6-b1a5f57e9a60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:43:20.387285 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20241655-ddba-4a6b-92a6-b1a5f57e9a60 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:43:20.401831 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4070/8161] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:43:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:43:20.403224 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8e22dd-3095-4448-b78e-549997096127 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:43:20.413456 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8e22dd-3095-4448-b78e-549997096127 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:43:20.418091 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896c18d0-4afa-401c-af25-fe8e0c2792e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:43:20.418984 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c18d0-4afa-401c-af25-fe8e0c2792e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:43:20.419272 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c18d0-4afa-401c-af25-fe8e0c2792e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:43:20.419583 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c18d0-4afa-401c-af25-fe8e0c2792e8 admin admin] PATH_INFO: `/v3/projects/4181a82dd2f947b2b018a9400c8a8703/users/79a1d6cbdce3493db1e445880d32a1a2/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:43:20.434549 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896c18d0-4afa-401c-af25-fe8e0c2792e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4181a82dd2f947b2b018a9400c8a8703, user_id=79a1d6cbdce3493db1e445880d32a1a2, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:43:20.438092 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896c18d0-4afa-401c-af25-fe8e0c2792e8 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:43:20.527761 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4092/8162] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:43:20 2022] PUT /identity/v3/projects/4181a82dd2f947b2b018a9400c8a8703/users/79a1d6cbdce3493db1e445880d32a1a2/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:43:20.539162 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44db9a-c338-4317-a84c-8fedde7079a7 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:43:20.539449 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44db9a-c338-4317-a84c-8fedde7079a7 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:43:20.539764 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44db9a-c338-4317-a84c-8fedde7079a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:43:20.568388 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-0f44db9a-c338-4317-a84c-8fedde7079a7 None None] MFA Rules not processed for user `79a1d6cbdce3493db1e445880d32a1a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:43:20.569683 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-0f44db9a-c338-4317-a84c-8fedde7079a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:43:20.650892 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4071/8163] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:43:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:43:20.655567 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896c18d0-4afa-401c-af25-fe8e0c2792e8 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:43:20.716853 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896c18d0-4afa-401c-af25-fe8e0c2792e8 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:43:20.721514 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0513a43-02d4-475d-9c35-396e90ff670c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:43:20.722166 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0513a43-02d4-475d-9c35-396e90ff670c admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:43:20.722449 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0513a43-02d4-475d-9c35-396e90ff670c admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:43:20.722734 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0513a43-02d4-475d-9c35-396e90ff670c admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:43:20.723420 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0513a43-02d4-475d-9c35-396e90ff670c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:43:20.725623 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0513a43-02d4-475d-9c35-396e90ff670c admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:43:20.803031 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4093/8164] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:43:20 2022] POST /identity/v3/projects => generated 389 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:43:20.807124 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f44db9a-c338-4317-a84c-8fedde7079a7 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:43:20.819201 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f44db9a-c338-4317-a84c-8fedde7079a7 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:43:20.874348 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d0fe82-c6b8-4cd1-a609-e13bc89f7d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:43:20.875018 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d0fe82-c6b8-4cd1-a609-e13bc89f7d33 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:43:20.875300 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d0fe82-c6b8-4cd1-a609-e13bc89f7d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:43:20.875609 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d0fe82-c6b8-4cd1-a609-e13bc89f7d33 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:43:20.876314 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d0fe82-c6b8-4cd1-a609-e13bc89f7d33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:43:20.878216 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d0fe82-c6b8-4cd1-a609-e13bc89f7d33 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:43:20.978723 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4072/8165] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:43:20 2022] POST /identity/v3/users => generated 301 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:43:20.982702 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0513a43-02d4-475d-9c35-396e90ff670c admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:43:20.993906 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0513a43-02d4-475d-9c35-396e90ff670c admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:43:20.998563 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871446d4-d702-42a7-a9c9-ae794be9a439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:43:20.999222 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871446d4-d702-42a7-a9c9-ae794be9a439 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:43:20.999537 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871446d4-d702-42a7-a9c9-ae794be9a439 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:43:20.999846 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871446d4-d702-42a7-a9c9-ae794be9a439 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:43:21.000563 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871446d4-d702-42a7-a9c9-ae794be9a439 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:43:21.002161 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871446d4-d702-42a7-a9c9-ae794be9a439 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:43:21.012721 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4094/8166] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:43:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:43:21.016923 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d0fe82-c6b8-4cd1-a609-e13bc89f7d33 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:43:21.028712 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d0fe82-c6b8-4cd1-a609-e13bc89f7d33 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:43:21.034714 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a65263-23d5-487a-8053-5818282e4f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:43:21.035939 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a65263-23d5-487a-8053-5818282e4f08 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:43:21.036228 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a65263-23d5-487a-8053-5818282e4f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:43:21.036511 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a65263-23d5-487a-8053-5818282e4f08 admin admin] PATH_INFO: `/v3/projects/1f84eb93054a44f0a3caf821474491fa/users/88238757b9474640ab3bffd8a858572e/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:43:21.054855 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a65263-23d5-487a-8053-5818282e4f08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f84eb93054a44f0a3caf821474491fa, user_id=88238757b9474640ab3bffd8a858572e, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:43:21.057713 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a65263-23d5-487a-8053-5818282e4f08 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:43:21.139094 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4073/8167] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:43:21 2022] PUT /identity/v3/projects/1f84eb93054a44f0a3caf821474491fa/users/88238757b9474640ab3bffd8a858572e/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:43:21.143107 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871446d4-d702-42a7-a9c9-ae794be9a439 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:43:21.153603 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871446d4-d702-42a7-a9c9-ae794be9a439 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:43:21.209414 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c867156-2db0-4c7b-9141-ba54cba6e9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:43:21.210097 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c867156-2db0-4c7b-9141-ba54cba6e9f1 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:43:21.210381 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c867156-2db0-4c7b-9141-ba54cba6e9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:43:21.210654 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c867156-2db0-4c7b-9141-ba54cba6e9f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:43:21.211411 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c867156-2db0-4c7b-9141-ba54cba6e9f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:43:21.213029 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c867156-2db0-4c7b-9141-ba54cba6e9f1 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:43:21.222492 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4095/8168] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:43:21 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:43:21.227354 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a65263-23d5-487a-8053-5818282e4f08 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:43:21.237676 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a65263-23d5-487a-8053-5818282e4f08 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:43:21.243082 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0789ab5a-c926-4742-9de3-085ec308226b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:43:21.244026 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0789ab5a-c926-4742-9de3-085ec308226b admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:43:21.244309 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0789ab5a-c926-4742-9de3-085ec308226b admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:43:21.244594 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0789ab5a-c926-4742-9de3-085ec308226b admin admin] PATH_INFO: `/v3/projects/1f84eb93054a44f0a3caf821474491fa/users/88238757b9474640ab3bffd8a858572e/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:43:21.246572 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0789ab5a-c926-4742-9de3-085ec308226b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f84eb93054a44f0a3caf821474491fa, user_id=88238757b9474640ab3bffd8a858572e, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:43:21.249250 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0789ab5a-c926-4742-9de3-085ec308226b admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:43:21.259283 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4074/8169] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:43:21 2022] PUT /identity/v3/projects/1f84eb93054a44f0a3caf821474491fa/users/88238757b9474640ab3bffd8a858572e/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:43:21.269624 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d89c13b-ffbc-4a80-b60a-c01af359f04c None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:43:21.269922 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d89c13b-ffbc-4a80-b60a-c01af359f04c None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:43:21.270211 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d89c13b-ffbc-4a80-b60a-c01af359f04c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:43:21.298216 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-8d89c13b-ffbc-4a80-b60a-c01af359f04c None None] MFA Rules not processed for user `88238757b9474640ab3bffd8a858572e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:43:21.299432 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-8d89c13b-ffbc-4a80-b60a-c01af359f04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:43:21.370797 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4096/8170] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:43:21 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:43:21.386167 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0789ab5a-c926-4742-9de3-085ec308226b admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:43:21.388091 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-0789ab5a-c926-4742-9de3-085ec308226b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:43:21.465730 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0789ab5a-c926-4742-9de3-085ec308226b admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:43:21.471900 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddf50a4-113c-4488-b4fc-951d9ad57b5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:43:21.472557 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf50a4-113c-4488-b4fc-951d9ad57b5b service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:43:21.472835 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf50a4-113c-4488-b4fc-951d9ad57b5b service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:43:21.473107 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf50a4-113c-4488-b4fc-951d9ad57b5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:43:21.530669 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddf50a4-113c-4488-b4fc-951d9ad57b5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:43:21.532297 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddf50a4-113c-4488-b4fc-951d9ad57b5b service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:43:21.541785 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4075/8171] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:43:21 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:43:24.855127 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d89c13b-ffbc-4a80-b60a-c01af359f04c None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:43:24.856699 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-8d89c13b-ffbc-4a80-b60a-c01af359f04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:43:24.924370 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d89c13b-ffbc-4a80-b60a-c01af359f04c None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:43:24.929039 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8954c474-c387-492a-831c-c1671d1f8d72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:43:24.929897 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954c474-c387-492a-831c-c1671d1f8d72 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:43:24.930268 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954c474-c387-492a-831c-c1671d1f8d72 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:43:24.930613 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954c474-c387-492a-831c-c1671d1f8d72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:43:24.941034 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8954c474-c387-492a-831c-c1671d1f8d72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:43:24.943709 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8954c474-c387-492a-831c-c1671d1f8d72 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:43:24.953363 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4097/8172] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:43:24 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:43:30.176820 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf73c4d-fb12-4276-9e91-b30a4a5e7b87 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:43:30.177931 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf73c4d-fb12-4276-9e91-b30a4a5e7b87 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:43:30.178045 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf73c4d-fb12-4276-9e91-b30a4a5e7b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:43:30.197529 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-2cf73c4d-fb12-4276-9e91-b30a4a5e7b87 None None] MFA Rules not processed for user `139d42d8881949b3befd8e4412c64800`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:43:30.198760 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-2cf73c4d-fb12-4276-9e91-b30a4a5e7b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:43:30.211909 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4076/8173] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:43:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:43:34.453970 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8954c474-c387-492a-831c-c1671d1f8d72 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:43:34.456777 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-8954c474-c387-492a-831c-c1671d1f8d72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:43:34.550051 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8954c474-c387-492a-831c-c1671d1f8d72 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:43:34.555923 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a264b-022e-43a3-af97-8acda8be7651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:43:34.557084 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a264b-022e-43a3-af97-8acda8be7651 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:43:34.557374 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a264b-022e-43a3-af97-8acda8be7651 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:43:34.557650 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a264b-022e-43a3-af97-8acda8be7651 admin admin] PATH_INFO: `/v3/users/a3f0269a87fb4a8fa8dbc1b84c134fe7` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:43:34.558880 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675a264b-022e-43a3-af97-8acda8be7651 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3f0269a87fb4a8fa8dbc1b84c134fe7)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:43:34.560899 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675a264b-022e-43a3-af97-8acda8be7651 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:43:34.761782 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-675a264b-022e-43a3-af97-8acda8be7651 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3f0269a87fb4a8fa8dbc1b84c134fe7'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:43:34.776461 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-675a264b-022e-43a3-af97-8acda8be7651 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3f0269a87fb4a8fa8dbc1b84c134fe7'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:43:34.794868 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-675a264b-022e-43a3-af97-8acda8be7651 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3f0269a87fb4a8fa8dbc1b84c134fe7'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:43:34.865059 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-675a264b-022e-43a3-af97-8acda8be7651 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3f0269a87fb4a8fa8dbc1b84c134fe7'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:43:34.865776 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-675a264b-022e-43a3-af97-8acda8be7651 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3f0269a87fb4a8fa8dbc1b84c134fe7'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:43:34.873789 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4098/8174] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:43:34 2022] DELETE /identity/v3/users/a3f0269a87fb4a8fa8dbc1b84c134fe7 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:43:35.168539 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf73c4d-fb12-4276-9e91-b30a4a5e7b87 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:43:35.180439 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf73c4d-fb12-4276-9e91-b30a4a5e7b87 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:43:35.243168 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796be293-664c-4bd3-b9a3-a3632d4c7a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:43:35.244198 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796be293-664c-4bd3-b9a3-a3632d4c7a86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:43:35.244491 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796be293-664c-4bd3-b9a3-a3632d4c7a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:43:35.244900 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796be293-664c-4bd3-b9a3-a3632d4c7a86 admin admin] PATH_INFO: `/v3/projects/0166571316634a7185b9768add179654` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:43:35.246192 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796be293-664c-4bd3-b9a3-a3632d4c7a86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0166571316634a7185b9768add179654)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:43:35.251566 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796be293-664c-4bd3-b9a3-a3632d4c7a86 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:43:35.385985 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-796be293-664c-4bd3-b9a3-a3632d4c7a86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0166571316634a7185b9768add179654', 'request_id': 'req-796be293-664c-4bd3-b9a3-a3632d4c7a86'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:43:35.392231 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-796be293-664c-4bd3-b9a3-a3632d4c7a86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0166571316634a7185b9768add179654', 'request_id': 'req-796be293-664c-4bd3-b9a3-a3632d4c7a86'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:43:35.400690 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-796be293-664c-4bd3-b9a3-a3632d4c7a86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0166571316634a7185b9768add179654', 'request_id': 'req-796be293-664c-4bd3-b9a3-a3632d4c7a86'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:43:35.508626 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-796be293-664c-4bd3-b9a3-a3632d4c7a86 admin admin] The token cache is being invalidate because project 0166571316634a7185b9768add179654 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:43:35.509151 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-796be293-664c-4bd3-b9a3-a3632d4c7a86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:43:35.509764 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-796be293-664c-4bd3-b9a3-a3632d4c7a86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:43:35.511315 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4077/8175] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:43:35 2022] DELETE /identity/v3/projects/0166571316634a7185b9768add179654 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:43:35.515305 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a264b-022e-43a3-af97-8acda8be7651 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:43:35.516892 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-675a264b-022e-43a3-af97-8acda8be7651 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:43:35.530600 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a264b-022e-43a3-af97-8acda8be7651 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:43:35.607647 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8a333a-a7db-4c7e-b526-dcbe9250c22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:43:35.608537 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a333a-a7db-4c7e-b526-dcbe9250c22a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:43:35.608996 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a333a-a7db-4c7e-b526-dcbe9250c22a admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:43:35.609444 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a333a-a7db-4c7e-b526-dcbe9250c22a admin admin] PATH_INFO: `/v3/users/80ccc5504ec741cfb7a4f0d6f9a556a3` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:43:35.611987 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8a333a-a7db-4c7e-b526-dcbe9250c22a admin admin] RBAC: Authorizing `identity:delete_user(user_id=80ccc5504ec741cfb7a4f0d6f9a556a3)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:43:35.613946 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8a333a-a7db-4c7e-b526-dcbe9250c22a admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:43:35.826392 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-fc8a333a-a7db-4c7e-b526-dcbe9250c22a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80ccc5504ec741cfb7a4f0d6f9a556a3'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:43:35.844510 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-fc8a333a-a7db-4c7e-b526-dcbe9250c22a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80ccc5504ec741cfb7a4f0d6f9a556a3'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:43:35.850182 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-fc8a333a-a7db-4c7e-b526-dcbe9250c22a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80ccc5504ec741cfb7a4f0d6f9a556a3'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:43:35.927042 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-fc8a333a-a7db-4c7e-b526-dcbe9250c22a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80ccc5504ec741cfb7a4f0d6f9a556a3'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:43:35.929380 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-fc8a333a-a7db-4c7e-b526-dcbe9250c22a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80ccc5504ec741cfb7a4f0d6f9a556a3'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:43:35.941373 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4099/8176] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:43:35 2022] DELETE /identity/v3/users/80ccc5504ec741cfb7a4f0d6f9a556a3 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:43:36.227234 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796be293-664c-4bd3-b9a3-a3632d4c7a86 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:43:36.231293 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-796be293-664c-4bd3-b9a3-a3632d4c7a86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:43:36.245818 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796be293-664c-4bd3-b9a3-a3632d4c7a86 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:43:36.306363 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77f9d3d-0fb1-41d7-9f5a-4c8350fd0e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:43:36.307226 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f9d3d-0fb1-41d7-9f5a-4c8350fd0e36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:43:36.307533 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f9d3d-0fb1-41d7-9f5a-4c8350fd0e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:43:36.307815 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f9d3d-0fb1-41d7-9f5a-4c8350fd0e36 admin admin] PATH_INFO: `/v3/projects/fbe285e734924d40b0968ac56e83e45c` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:43:36.309051 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77f9d3d-0fb1-41d7-9f5a-4c8350fd0e36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbe285e734924d40b0968ac56e83e45c)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:43:36.310974 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77f9d3d-0fb1-41d7-9f5a-4c8350fd0e36 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:43:36.430754 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c77f9d3d-0fb1-41d7-9f5a-4c8350fd0e36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbe285e734924d40b0968ac56e83e45c', 'request_id': 'req-c77f9d3d-0fb1-41d7-9f5a-4c8350fd0e36'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:43:36.436064 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c77f9d3d-0fb1-41d7-9f5a-4c8350fd0e36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbe285e734924d40b0968ac56e83e45c', 'request_id': 'req-c77f9d3d-0fb1-41d7-9f5a-4c8350fd0e36'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:43:36.442171 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c77f9d3d-0fb1-41d7-9f5a-4c8350fd0e36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbe285e734924d40b0968ac56e83e45c', 'request_id': 'req-c77f9d3d-0fb1-41d7-9f5a-4c8350fd0e36'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:43:36.521276 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c77f9d3d-0fb1-41d7-9f5a-4c8350fd0e36 admin admin] The token cache is being invalidate because project fbe285e734924d40b0968ac56e83e45c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:43:36.521577 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c77f9d3d-0fb1-41d7-9f5a-4c8350fd0e36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:43:36.522430 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c77f9d3d-0fb1-41d7-9f5a-4c8350fd0e36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:43:36.524063 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4078/8177] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:43:36 2022] DELETE /identity/v3/projects/fbe285e734924d40b0968ac56e83e45c => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:43:36.528986 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d715ee-298d-4786-9d15-1591323c57e9 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:43:36.529483 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d715ee-298d-4786-9d15-1591323c57e9 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:43:36.529677 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d715ee-298d-4786-9d15-1591323c57e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:43:36.548211 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-31d715ee-298d-4786-9d15-1591323c57e9 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:43:36.549418 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-31d715ee-298d-4786-9d15-1591323c57e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:43:36.606718 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4100/8178] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:43:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:43:36.614477 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f784c90-5269-418d-a21f-faedfad0b221 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:43:36.614765 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f784c90-5269-418d-a21f-faedfad0b221 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:43:36.615137 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f784c90-5269-418d-a21f-faedfad0b221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:43:36.633957 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-3f784c90-5269-418d-a21f-faedfad0b221 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:43:36.635186 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-3f784c90-5269-418d-a21f-faedfad0b221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:43:36.643996 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4079/8179] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:43:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:43:36.649373 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d715ee-298d-4786-9d15-1591323c57e9 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:43:36.662536 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d715ee-298d-4786-9d15-1591323c57e9 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:43:36.667228 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2805a14e-2c92-4223-8397-4240fa4bdbcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:43:36.667926 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2805a14e-2c92-4223-8397-4240fa4bdbcd admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:43:36.668212 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2805a14e-2c92-4223-8397-4240fa4bdbcd admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:43:36.668519 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2805a14e-2c92-4223-8397-4240fa4bdbcd admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:43:36.669244 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2805a14e-2c92-4223-8397-4240fa4bdbcd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:43:36.669551 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2805a14e-2c92-4223-8397-4240fa4bdbcd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:43:36.671154 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2805a14e-2c92-4223-8397-4240fa4bdbcd admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:43:36.682836 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4101/8180] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:43:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:43:36.687431 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f784c90-5269-418d-a21f-faedfad0b221 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:43:36.697465 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f784c90-5269-418d-a21f-faedfad0b221 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:43:36.702118 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b141d62e-d3cf-4808-b6de-a5c5eb922cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:43:36.702759 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141d62e-d3cf-4808-b6de-a5c5eb922cdb admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:43:36.703040 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141d62e-d3cf-4808-b6de-a5c5eb922cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:43:36.703308 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141d62e-d3cf-4808-b6de-a5c5eb922cdb admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:43:36.704018 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b141d62e-d3cf-4808-b6de-a5c5eb922cdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:43:36.705906 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b141d62e-d3cf-4808-b6de-a5c5eb922cdb admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:43:36.785457 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4080/8181] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:43:36 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:43:36.790358 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2805a14e-2c92-4223-8397-4240fa4bdbcd admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:43:36.800665 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2805a14e-2c92-4223-8397-4240fa4bdbcd admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:43:36.857155 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba643a75-1a0b-4111-8c7c-f448e3f12930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:43:36.857858 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba643a75-1a0b-4111-8c7c-f448e3f12930 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:43:36.858144 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba643a75-1a0b-4111-8c7c-f448e3f12930 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:43:36.858423 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba643a75-1a0b-4111-8c7c-f448e3f12930 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:43:36.859105 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba643a75-1a0b-4111-8c7c-f448e3f12930 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:43:36.861211 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba643a75-1a0b-4111-8c7c-f448e3f12930 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:43:36.961556 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4102/8182] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:43:36 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:43:36.965828 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b141d62e-d3cf-4808-b6de-a5c5eb922cdb admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:43:36.977230 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b141d62e-d3cf-4808-b6de-a5c5eb922cdb admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:43:36.984434 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca5c3a3-765e-4968-989d-4e034f60011e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:43:36.984434 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca5c3a3-765e-4968-989d-4e034f60011e admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:43:36.984434 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca5c3a3-765e-4968-989d-4e034f60011e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:43:36.984434 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca5c3a3-765e-4968-989d-4e034f60011e admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:43:36.984838 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca5c3a3-765e-4968-989d-4e034f60011e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:43:36.985479 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca5c3a3-765e-4968-989d-4e034f60011e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:43:36.996463 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4081/8183] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:43:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:43:37.000591 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba643a75-1a0b-4111-8c7c-f448e3f12930 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:43:37.012018 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba643a75-1a0b-4111-8c7c-f448e3f12930 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:43:37.017435 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80098720-03ef-40fa-88f8-e28108a60901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:43:37.022519 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80098720-03ef-40fa-88f8-e28108a60901 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:43:37.022519 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80098720-03ef-40fa-88f8-e28108a60901 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:43:37.022519 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80098720-03ef-40fa-88f8-e28108a60901 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:43:37.022519 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80098720-03ef-40fa-88f8-e28108a60901 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:43:37.022519 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80098720-03ef-40fa-88f8-e28108a60901 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:43:37.039787 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4103/8184] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:43:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:43:37.040131 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca5c3a3-765e-4968-989d-4e034f60011e admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:43:37.051047 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca5c3a3-765e-4968-989d-4e034f60011e admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:43:37.063022 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb51f3-212a-45f9-9191-7b92e38e4b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:43:37.063964 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb51f3-212a-45f9-9191-7b92e38e4b44 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:43:37.064449 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb51f3-212a-45f9-9191-7b92e38e4b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:43:37.064823 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb51f3-212a-45f9-9191-7b92e38e4b44 admin admin] PATH_INFO: `/v3/projects/fae4cdc60e2f46bf8189dce15ab62978/users/33e0486e4f744523949c71263aca0893/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:43:37.110712 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cb51f3-212a-45f9-9191-7b92e38e4b44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fae4cdc60e2f46bf8189dce15ab62978, user_id=33e0486e4f744523949c71263aca0893, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:43:37.113881 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cb51f3-212a-45f9-9191-7b92e38e4b44 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:43:37.237295 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4082/8185] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:43:37 2022] PUT /identity/v3/projects/fae4cdc60e2f46bf8189dce15ab62978/users/33e0486e4f744523949c71263aca0893/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:43:37.247930 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ddcec-38cc-48ab-a996-a8348ee9c4a1 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:43:37.251637 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ddcec-38cc-48ab-a996-a8348ee9c4a1 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:43:37.251637 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ddcec-38cc-48ab-a996-a8348ee9c4a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:43:37.276739 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-e76ddcec-38cc-48ab-a996-a8348ee9c4a1 None None] MFA Rules not processed for user `33e0486e4f744523949c71263aca0893`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:43:37.277941 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e76ddcec-38cc-48ab-a996-a8348ee9c4a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:43:37.342071 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4104/8186] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:43:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:43:37.346606 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb51f3-212a-45f9-9191-7b92e38e4b44 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:43:37.407970 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb51f3-212a-45f9-9191-7b92e38e4b44 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:43:37.413499 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f8c70e-ecc6-4136-b98d-14e37e93d9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:43:37.417285 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8c70e-ecc6-4136-b98d-14e37e93d9e2 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:43:37.417285 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8c70e-ecc6-4136-b98d-14e37e93d9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:43:37.417285 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8c70e-ecc6-4136-b98d-14e37e93d9e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:43:37.417285 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f8c70e-ecc6-4136-b98d-14e37e93d9e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:43:37.417676 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f8c70e-ecc6-4136-b98d-14e37e93d9e2 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:43:37.487959 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4083/8187] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:43:37 2022] POST /identity/v3/projects => generated 383 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:43:37.492571 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76ddcec-38cc-48ab-a996-a8348ee9c4a1 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:43:37.503200 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76ddcec-38cc-48ab-a996-a8348ee9c4a1 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:43:37.706430 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11255b73-5105-492b-9775-f4892001f35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:43:37.707096 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11255b73-5105-492b-9775-f4892001f35f admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:43:37.707374 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11255b73-5105-492b-9775-f4892001f35f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:43:37.707681 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11255b73-5105-492b-9775-f4892001f35f admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:43:37.708384 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11255b73-5105-492b-9775-f4892001f35f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:43:37.710275 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11255b73-5105-492b-9775-f4892001f35f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:43:37.807687 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4105/8188] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:43:37 2022] POST /identity/v3/users => generated 298 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:43:37.902446 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f8c70e-ecc6-4136-b98d-14e37e93d9e2 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:43:37.902446 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f8c70e-ecc6-4136-b98d-14e37e93d9e2 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:43:37.902446 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313ee34e-8a67-4358-a7e6-6d06371f0d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:43:37.902446 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ee34e-8a67-4358-a7e6-6d06371f0d6a admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:43:37.902919 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ee34e-8a67-4358-a7e6-6d06371f0d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:43:37.902919 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ee34e-8a67-4358-a7e6-6d06371f0d6a admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:43:37.902919 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313ee34e-8a67-4358-a7e6-6d06371f0d6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:43:37.902919 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313ee34e-8a67-4358-a7e6-6d06371f0d6a admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:43:37.902919 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4084/8189] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:43:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:43:37.903341 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11255b73-5105-492b-9775-f4892001f35f admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:43:37.903341 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11255b73-5105-492b-9775-f4892001f35f admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:43:37.903341 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5535d221-c412-4144-816c-2494ea168058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:43:37.903341 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5535d221-c412-4144-816c-2494ea168058 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:43:37.903741 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5535d221-c412-4144-816c-2494ea168058 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:43:37.903741 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5535d221-c412-4144-816c-2494ea168058 admin admin] PATH_INFO: `/v3/projects/e35ecebc92d248d684e05ad6ea30c8da/users/35585104b2d04fdf9d447e2f34360122/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:43:37.903741 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5535d221-c412-4144-816c-2494ea168058 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e35ecebc92d248d684e05ad6ea30c8da, user_id=35585104b2d04fdf9d447e2f34360122, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:43:37.903741 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5535d221-c412-4144-816c-2494ea168058 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:43:37.979191 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4106/8190] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:43:37 2022] PUT /identity/v3/projects/e35ecebc92d248d684e05ad6ea30c8da/users/35585104b2d04fdf9d447e2f34360122/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:43:37.983189 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313ee34e-8a67-4358-a7e6-6d06371f0d6a admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:43:37.993302 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313ee34e-8a67-4358-a7e6-6d06371f0d6a admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:43:38.048243 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b08d78-ca85-40e8-b69b-dce3566829d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:43:38.048903 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b08d78-ca85-40e8-b69b-dce3566829d6 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:43:38.049189 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b08d78-ca85-40e8-b69b-dce3566829d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:43:38.049466 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b08d78-ca85-40e8-b69b-dce3566829d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:43:38.050180 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b08d78-ca85-40e8-b69b-dce3566829d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:43:38.051844 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b08d78-ca85-40e8-b69b-dce3566829d6 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:43:38.061582 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4085/8191] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:43:37 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:43:38.065633 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5535d221-c412-4144-816c-2494ea168058 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:43:38.076370 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5535d221-c412-4144-816c-2494ea168058 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:43:38.081245 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d97c280-429f-4060-8d29-a3b6fc4fa54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:43:38.082359 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d97c280-429f-4060-8d29-a3b6fc4fa54d admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:43:38.082638 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d97c280-429f-4060-8d29-a3b6fc4fa54d admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:43:38.082909 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d97c280-429f-4060-8d29-a3b6fc4fa54d admin admin] PATH_INFO: `/v3/projects/e35ecebc92d248d684e05ad6ea30c8da/users/35585104b2d04fdf9d447e2f34360122/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:43:38.085526 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d97c280-429f-4060-8d29-a3b6fc4fa54d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e35ecebc92d248d684e05ad6ea30c8da, user_id=35585104b2d04fdf9d447e2f34360122, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:43:38.088510 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d97c280-429f-4060-8d29-a3b6fc4fa54d admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:43:38.100184 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4107/8192] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:43:38 2022] PUT /identity/v3/projects/e35ecebc92d248d684e05ad6ea30c8da/users/35585104b2d04fdf9d447e2f34360122/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:43:38.109964 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e90bde-bf3a-46f6-8692-6e5fefc99369 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:43:38.110252 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e90bde-bf3a-46f6-8692-6e5fefc99369 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:43:38.110525 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e90bde-bf3a-46f6-8692-6e5fefc99369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:43:38.140053 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-41e90bde-bf3a-46f6-8692-6e5fefc99369 None None] MFA Rules not processed for user `35585104b2d04fdf9d447e2f34360122`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:43:38.149538 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-41e90bde-bf3a-46f6-8692-6e5fefc99369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:43:38.209194 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4086/8193] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:43:38 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:43:38.219827 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d97c280-429f-4060-8d29-a3b6fc4fa54d admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:43:38.221473 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-6d97c280-429f-4060-8d29-a3b6fc4fa54d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:43:38.294676 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d97c280-429f-4060-8d29-a3b6fc4fa54d admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:43:38.299089 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b802e9-1c60-4b09-8e4e-5d8a711b293b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198271d1c0d44cb58bace41a65f4b94c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:43:38.299776 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b802e9-1c60-4b09-8e4e-5d8a711b293b service cinder] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:43:38.300059 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b802e9-1c60-4b09-8e4e-5d8a711b293b service cinder] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:43:38.300344 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b802e9-1c60-4b09-8e4e-5d8a711b293b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:43:38.367651 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b802e9-1c60-4b09-8e4e-5d8a711b293b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:43:38.369649 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b802e9-1c60-4b09-8e4e-5d8a711b293b service cinder] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:43:38.379275 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4108/8194] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:43:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:43:46.608394 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e90bde-bf3a-46f6-8692-6e5fefc99369 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:43:46.621654 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e90bde-bf3a-46f6-8692-6e5fefc99369 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:43:46.625634 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8be9702-1440-4b7b-8155-5d47805f16a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198271d1c0d44cb58bace41a65f4b94c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:43:46.626288 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be9702-1440-4b7b-8155-5d47805f16a7 service cinder] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:43:46.626680 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be9702-1440-4b7b-8155-5d47805f16a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:43:46.626988 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be9702-1440-4b7b-8155-5d47805f16a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:43:46.637973 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8be9702-1440-4b7b-8155-5d47805f16a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:43:46.639506 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8be9702-1440-4b7b-8155-5d47805f16a7 service cinder] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:43:46.654587 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4087/8195] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:43:46 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:44:13.708711 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b802e9-1c60-4b09-8e4e-5d8a711b293b service cinder] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:44:13.769074 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b802e9-1c60-4b09-8e4e-5d8a711b293b service cinder] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:44:13.774021 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c440a705-03e8-40a2-b1c0-27a2a909dadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:44:13.774888 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440a705-03e8-40a2-b1c0-27a2a909dadd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:13.775218 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440a705-03e8-40a2-b1c0-27a2a909dadd admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:13.775451 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440a705-03e8-40a2-b1c0-27a2a909dadd admin admin] PATH_INFO: `/v3/users/33e0486e4f744523949c71263aca0893` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:13.776715 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c440a705-03e8-40a2-b1c0-27a2a909dadd admin admin] RBAC: Authorizing `identity:delete_user(user_id=33e0486e4f744523949c71263aca0893)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:44:13.778660 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c440a705-03e8-40a2-b1c0-27a2a909dadd admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:44:14.049455 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c440a705-03e8-40a2-b1c0-27a2a909dadd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33e0486e4f744523949c71263aca0893'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:14.061519 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c440a705-03e8-40a2-b1c0-27a2a909dadd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33e0486e4f744523949c71263aca0893'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:14.068837 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c440a705-03e8-40a2-b1c0-27a2a909dadd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33e0486e4f744523949c71263aca0893'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:14.148971 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c440a705-03e8-40a2-b1c0-27a2a909dadd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33e0486e4f744523949c71263aca0893'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:14.149529 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c440a705-03e8-40a2-b1c0-27a2a909dadd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33e0486e4f744523949c71263aca0893'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:14.156775 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4109/8196] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:44:13 2022] DELETE /identity/v3/users/33e0486e4f744523949c71263aca0893 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:44:14.161488 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29509824-9b4a-4a13-875e-83e8568788a4 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:14.161971 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29509824-9b4a-4a13-875e-83e8568788a4 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:14.162068 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29509824-9b4a-4a13-875e-83e8568788a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:14.180161 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-29509824-9b4a-4a13-875e-83e8568788a4 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:44:14.181372 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-29509824-9b4a-4a13-875e-83e8568788a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:44:14.238496 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4088/8197] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:44:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:44:14.248347 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c440a705-03e8-40a2-b1c0-27a2a909dadd admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:44:14.250040 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c440a705-03e8-40a2-b1c0-27a2a909dadd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:44:14.311975 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c440a705-03e8-40a2-b1c0-27a2a909dadd admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:44:14.315780 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc710ba-ea9a-4682-89f3-0a85e1dbe1e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:44:14.319884 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc710ba-ea9a-4682-89f3-0a85e1dbe1e1 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:14.319884 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc710ba-ea9a-4682-89f3-0a85e1dbe1e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:14.319884 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc710ba-ea9a-4682-89f3-0a85e1dbe1e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:14.326257 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc710ba-ea9a-4682-89f3-0a85e1dbe1e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:44:14.328319 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc710ba-ea9a-4682-89f3-0a85e1dbe1e1 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:44:14.337619 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4110/8198] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:44:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:44:14.762136 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29509824-9b4a-4a13-875e-83e8568788a4 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:44:14.763582 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-29509824-9b4a-4a13-875e-83e8568788a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:44:14.781583 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29509824-9b4a-4a13-875e-83e8568788a4 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:44:14.782395 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890f36a7-d701-49e1-8c88-986bb0c50be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:44:14.783323 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f36a7-d701-49e1-8c88-986bb0c50be2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:14.783640 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f36a7-d701-49e1-8c88-986bb0c50be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:14.783922 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f36a7-d701-49e1-8c88-986bb0c50be2 admin admin] PATH_INFO: `/v3/projects/fae4cdc60e2f46bf8189dce15ab62978` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:14.793644 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890f36a7-d701-49e1-8c88-986bb0c50be2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fae4cdc60e2f46bf8189dce15ab62978)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:44:14.796964 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890f36a7-d701-49e1-8c88-986bb0c50be2 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:44:14.900232 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-890f36a7-d701-49e1-8c88-986bb0c50be2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fae4cdc60e2f46bf8189dce15ab62978', 'request_id': 'req-890f36a7-d701-49e1-8c88-986bb0c50be2'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:14.905789 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-890f36a7-d701-49e1-8c88-986bb0c50be2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fae4cdc60e2f46bf8189dce15ab62978', 'request_id': 'req-890f36a7-d701-49e1-8c88-986bb0c50be2'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:14.912556 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-890f36a7-d701-49e1-8c88-986bb0c50be2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fae4cdc60e2f46bf8189dce15ab62978', 'request_id': 'req-890f36a7-d701-49e1-8c88-986bb0c50be2'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:15.011471 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-890f36a7-d701-49e1-8c88-986bb0c50be2 admin admin] The token cache is being invalidate because project fae4cdc60e2f46bf8189dce15ab62978 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:44:15.015297 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-890f36a7-d701-49e1-8c88-986bb0c50be2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:15.015297 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-890f36a7-d701-49e1-8c88-986bb0c50be2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:15.015297 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4089/8199] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:44:14 2022] DELETE /identity/v3/projects/fae4cdc60e2f46bf8189dce15ab62978 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:44:15.018650 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc710ba-ea9a-4682-89f3-0a85e1dbe1e1 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:44:15.029863 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc710ba-ea9a-4682-89f3-0a85e1dbe1e1 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:44:15.091602 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16553ca-9e76-4cc0-acbd-5379cd6cb733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:44:15.092516 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16553ca-9e76-4cc0-acbd-5379cd6cb733 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:15.092795 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16553ca-9e76-4cc0-acbd-5379cd6cb733 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:15.093071 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16553ca-9e76-4cc0-acbd-5379cd6cb733 admin admin] PATH_INFO: `/v3/users/35585104b2d04fdf9d447e2f34360122` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:15.095753 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16553ca-9e76-4cc0-acbd-5379cd6cb733 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35585104b2d04fdf9d447e2f34360122)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:44:15.097684 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16553ca-9e76-4cc0-acbd-5379cd6cb733 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:44:15.353995 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a16553ca-9e76-4cc0-acbd-5379cd6cb733 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35585104b2d04fdf9d447e2f34360122'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:15.366357 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a16553ca-9e76-4cc0-acbd-5379cd6cb733 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35585104b2d04fdf9d447e2f34360122'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:15.373509 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a16553ca-9e76-4cc0-acbd-5379cd6cb733 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35585104b2d04fdf9d447e2f34360122'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:15.428969 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a16553ca-9e76-4cc0-acbd-5379cd6cb733 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35585104b2d04fdf9d447e2f34360122'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:15.435088 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a16553ca-9e76-4cc0-acbd-5379cd6cb733 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35585104b2d04fdf9d447e2f34360122'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:15.435891 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4111/8200] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:44:15 2022] DELETE /identity/v3/users/35585104b2d04fdf9d447e2f34360122 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:44:15.865217 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890f36a7-d701-49e1-8c88-986bb0c50be2 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:44:15.866800 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-890f36a7-d701-49e1-8c88-986bb0c50be2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:44:15.880097 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890f36a7-d701-49e1-8c88-986bb0c50be2 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:44:15.951236 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e38eb2b-e8cd-4b0d-9685-8bf0c68b39bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:44:15.952134 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38eb2b-e8cd-4b0d-9685-8bf0c68b39bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:15.952414 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38eb2b-e8cd-4b0d-9685-8bf0c68b39bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:15.952735 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38eb2b-e8cd-4b0d-9685-8bf0c68b39bc admin admin] PATH_INFO: `/v3/projects/e35ecebc92d248d684e05ad6ea30c8da` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:15.953997 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e38eb2b-e8cd-4b0d-9685-8bf0c68b39bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=e35ecebc92d248d684e05ad6ea30c8da)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:44:15.955956 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e38eb2b-e8cd-4b0d-9685-8bf0c68b39bc admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:44:16.131620 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9e38eb2b-e8cd-4b0d-9685-8bf0c68b39bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e35ecebc92d248d684e05ad6ea30c8da', 'request_id': 'req-9e38eb2b-e8cd-4b0d-9685-8bf0c68b39bc'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:16.136798 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9e38eb2b-e8cd-4b0d-9685-8bf0c68b39bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e35ecebc92d248d684e05ad6ea30c8da', 'request_id': 'req-9e38eb2b-e8cd-4b0d-9685-8bf0c68b39bc'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:16.143729 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9e38eb2b-e8cd-4b0d-9685-8bf0c68b39bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e35ecebc92d248d684e05ad6ea30c8da', 'request_id': 'req-9e38eb2b-e8cd-4b0d-9685-8bf0c68b39bc'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:16.228106 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9e38eb2b-e8cd-4b0d-9685-8bf0c68b39bc admin admin] The token cache is being invalidate because project e35ecebc92d248d684e05ad6ea30c8da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:44:16.228394 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9e38eb2b-e8cd-4b0d-9685-8bf0c68b39bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:16.229057 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9e38eb2b-e8cd-4b0d-9685-8bf0c68b39bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:16.230612 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4090/8201] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:44:15 2022] DELETE /identity/v3/projects/e35ecebc92d248d684e05ad6ea30c8da => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:44:16.237016 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b5d89-a35e-4530-afae-85afcba88c51 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:16.237532 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b5d89-a35e-4530-afae-85afcba88c51 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:16.237625 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b5d89-a35e-4530-afae-85afcba88c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:16.256570 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-dc9b5d89-a35e-4530-afae-85afcba88c51 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:44:16.257982 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-dc9b5d89-a35e-4530-afae-85afcba88c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:44:16.316844 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4112/8202] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:44:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:44:16.325883 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f097d664-92cd-4c13-88b3-81507f7b66c4 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:16.326165 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f097d664-92cd-4c13-88b3-81507f7b66c4 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:16.326461 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f097d664-92cd-4c13-88b3-81507f7b66c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:16.347084 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-f097d664-92cd-4c13-88b3-81507f7b66c4 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:44:16.347202 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-f097d664-92cd-4c13-88b3-81507f7b66c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:44:16.355155 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4091/8203] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:44:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:44:16.363268 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9b5d89-a35e-4530-afae-85afcba88c51 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:44:16.372976 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9b5d89-a35e-4530-afae-85afcba88c51 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:44:16.377695 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a24ec-b550-4df7-b95a-07841b5ce2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:44:16.378342 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a24ec-b550-4df7-b95a-07841b5ce2ba admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:16.378623 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a24ec-b550-4df7-b95a-07841b5ce2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:16.378898 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a24ec-b550-4df7-b95a-07841b5ce2ba admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:16.379657 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834a24ec-b550-4df7-b95a-07841b5ce2ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:44:16.379958 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834a24ec-b550-4df7-b95a-07841b5ce2ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:44:16.381689 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834a24ec-b550-4df7-b95a-07841b5ce2ba admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:44:16.394100 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4113/8204] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:44:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:44:16.398717 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f097d664-92cd-4c13-88b3-81507f7b66c4 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:44:16.408369 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f097d664-92cd-4c13-88b3-81507f7b66c4 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:44:16.413215 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea581d2e-56ad-40e4-acae-11d24b60285e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:44:16.413869 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea581d2e-56ad-40e4-acae-11d24b60285e admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:16.414152 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea581d2e-56ad-40e4-acae-11d24b60285e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:16.414426 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea581d2e-56ad-40e4-acae-11d24b60285e admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:16.415112 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea581d2e-56ad-40e4-acae-11d24b60285e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:44:16.417039 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea581d2e-56ad-40e4-acae-11d24b60285e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:44:16.498601 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4092/8205] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:44:16 2022] POST /identity/v3/projects => generated 375 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:44:16.503116 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a24ec-b550-4df7-b95a-07841b5ce2ba admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:44:16.513274 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a24ec-b550-4df7-b95a-07841b5ce2ba admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:44:16.569595 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f44c9c-6bac-4b88-9b97-b04019dfde59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:44:16.570262 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f44c9c-6bac-4b88-9b97-b04019dfde59 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:16.570543 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f44c9c-6bac-4b88-9b97-b04019dfde59 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:16.570820 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f44c9c-6bac-4b88-9b97-b04019dfde59 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:16.571536 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f44c9c-6bac-4b88-9b97-b04019dfde59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:44:16.573433 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f44c9c-6bac-4b88-9b97-b04019dfde59 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:44:16.680390 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4114/8206] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:44:16 2022] POST /identity/v3/users => generated 288 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:44:16.684737 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea581d2e-56ad-40e4-acae-11d24b60285e admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:44:16.695746 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea581d2e-56ad-40e4-acae-11d24b60285e admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:44:16.703276 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd33f6-909e-4b56-9cdb-1643348a9d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:44:16.704016 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd33f6-909e-4b56-9cdb-1643348a9d24 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:16.704390 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd33f6-909e-4b56-9cdb-1643348a9d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:16.704703 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd33f6-909e-4b56-9cdb-1643348a9d24 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:16.705443 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcd33f6-909e-4b56-9cdb-1643348a9d24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:44:16.707093 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcd33f6-909e-4b56-9cdb-1643348a9d24 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:44:16.725596 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4093/8207] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:44:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:44:16.725711 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f44c9c-6bac-4b88-9b97-b04019dfde59 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:44:16.736712 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f44c9c-6bac-4b88-9b97-b04019dfde59 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:44:16.741689 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b995207-494d-4965-aa4f-c915b7e27077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:44:16.742352 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b995207-494d-4965-aa4f-c915b7e27077 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:16.742706 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b995207-494d-4965-aa4f-c915b7e27077 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:16.742959 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b995207-494d-4965-aa4f-c915b7e27077 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:16.743977 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b995207-494d-4965-aa4f-c915b7e27077 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:44:16.750631 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b995207-494d-4965-aa4f-c915b7e27077 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:44:16.758091 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4115/8208] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:44:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:44:16.762165 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd33f6-909e-4b56-9cdb-1643348a9d24 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:44:16.774648 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd33f6-909e-4b56-9cdb-1643348a9d24 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:44:16.783078 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c94851-fe1f-4ad6-b649-1d577246c9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:44:16.783078 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c94851-fe1f-4ad6-b649-1d577246c9f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:16.783078 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c94851-fe1f-4ad6-b649-1d577246c9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:16.783078 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c94851-fe1f-4ad6-b649-1d577246c9f2 admin admin] PATH_INFO: `/v3/projects/d625ce83e9114cfaae698d73b917709d/users/0860ddc4bdec438aba103113979deb07/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:16.798102 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c94851-fe1f-4ad6-b649-1d577246c9f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d625ce83e9114cfaae698d73b917709d, user_id=0860ddc4bdec438aba103113979deb07, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:44:16.800972 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c94851-fe1f-4ad6-b649-1d577246c9f2 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:44:16.875794 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4094/8209] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:44:16 2022] PUT /identity/v3/projects/d625ce83e9114cfaae698d73b917709d/users/0860ddc4bdec438aba103113979deb07/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:44:16.886721 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2edb0-894d-4994-8616-d834e0cd5a05 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:16.887012 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2edb0-894d-4994-8616-d834e0cd5a05 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:16.887294 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2edb0-894d-4994-8616-d834e0cd5a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:16.915074 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-2af2edb0-894d-4994-8616-d834e0cd5a05 None None] MFA Rules not processed for user `0860ddc4bdec438aba103113979deb07`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:44:16.916265 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-2af2edb0-894d-4994-8616-d834e0cd5a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:44:16.981123 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4116/8210] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:44:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:44:16.986557 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c94851-fe1f-4ad6-b649-1d577246c9f2 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:44:17.053726 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c94851-fe1f-4ad6-b649-1d577246c9f2 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:44:17.058471 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902ce24a-6f96-4f15-9615-94b643fc2ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:44:17.059126 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ce24a-6f96-4f15-9615-94b643fc2ec6 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:17.059410 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ce24a-6f96-4f15-9615-94b643fc2ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:17.059721 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ce24a-6f96-4f15-9615-94b643fc2ec6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:17.060398 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902ce24a-6f96-4f15-9615-94b643fc2ec6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:44:17.062458 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902ce24a-6f96-4f15-9615-94b643fc2ec6 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:44:17.173769 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4095/8211] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:44:16 2022] POST /identity/v3/projects => generated 377 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:44:17.177941 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af2edb0-894d-4994-8616-d834e0cd5a05 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:44:17.190234 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af2edb0-894d-4994-8616-d834e0cd5a05 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:44:17.248656 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9caefa7-59a4-4740-ad74-53113bf135da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:44:17.249402 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9caefa7-59a4-4740-ad74-53113bf135da admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:17.250017 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9caefa7-59a4-4740-ad74-53113bf135da admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:17.250440 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9caefa7-59a4-4740-ad74-53113bf135da admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:17.251136 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9caefa7-59a4-4740-ad74-53113bf135da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:44:17.253087 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9caefa7-59a4-4740-ad74-53113bf135da admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:44:17.385466 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4117/8212] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:44:17 2022] POST /identity/v3/users => generated 289 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:44:17.389410 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902ce24a-6f96-4f15-9615-94b643fc2ec6 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:44:17.400789 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902ce24a-6f96-4f15-9615-94b643fc2ec6 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:44:17.405395 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcfc0c6-4306-4bc4-92f4-5ccec836821f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:44:17.406049 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcfc0c6-4306-4bc4-92f4-5ccec836821f admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:17.406331 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcfc0c6-4306-4bc4-92f4-5ccec836821f admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:17.406610 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcfc0c6-4306-4bc4-92f4-5ccec836821f admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:17.407332 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcfc0c6-4306-4bc4-92f4-5ccec836821f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:44:17.408969 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcfc0c6-4306-4bc4-92f4-5ccec836821f admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:44:17.419201 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4096/8213] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:44:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:44:17.423354 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9caefa7-59a4-4740-ad74-53113bf135da admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:44:17.433338 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9caefa7-59a4-4740-ad74-53113bf135da admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:44:17.438748 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9ee544-2253-4ca4-932b-db463fb6199f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:44:17.444870 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ee544-2253-4ca4-932b-db463fb6199f admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:17.444870 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ee544-2253-4ca4-932b-db463fb6199f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:17.444870 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ee544-2253-4ca4-932b-db463fb6199f admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:17.444870 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9ee544-2253-4ca4-932b-db463fb6199f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:44:17.444870 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9ee544-2253-4ca4-932b-db463fb6199f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:44:17.453895 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4118/8214] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:44:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:44:17.458296 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcfc0c6-4306-4bc4-92f4-5ccec836821f admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:44:17.468526 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcfc0c6-4306-4bc4-92f4-5ccec836821f admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:44:17.473273 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2181d49-d002-43ae-b746-cdfaf5dca5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:44:17.474324 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2181d49-d002-43ae-b746-cdfaf5dca5a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:17.474618 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2181d49-d002-43ae-b746-cdfaf5dca5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:17.474899 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2181d49-d002-43ae-b746-cdfaf5dca5a5 admin admin] PATH_INFO: `/v3/projects/8ff83d15abe94bab825c8b23b3e4a49f/users/2531da8082b14d95ad1f2a89e8e76e04/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:17.495931 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2181d49-d002-43ae-b746-cdfaf5dca5a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ff83d15abe94bab825c8b23b3e4a49f, user_id=2531da8082b14d95ad1f2a89e8e76e04, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:44:17.498677 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2181d49-d002-43ae-b746-cdfaf5dca5a5 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:44:17.595309 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4097/8215] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:44:17 2022] PUT /identity/v3/projects/8ff83d15abe94bab825c8b23b3e4a49f/users/2531da8082b14d95ad1f2a89e8e76e04/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:44:17.605301 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26aa781-4534-4b8d-9184-1e9ad4d10199 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:17.605597 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26aa781-4534-4b8d-9184-1e9ad4d10199 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:17.605877 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26aa781-4534-4b8d-9184-1e9ad4d10199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:17.634607 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-d26aa781-4534-4b8d-9184-1e9ad4d10199 None None] MFA Rules not processed for user `2531da8082b14d95ad1f2a89e8e76e04`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:44:17.635876 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d26aa781-4534-4b8d-9184-1e9ad4d10199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:44:17.701189 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4119/8216] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:44:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:44:17.706472 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2181d49-d002-43ae-b746-cdfaf5dca5a5 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:44:17.771463 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2181d49-d002-43ae-b746-cdfaf5dca5a5 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:44:17.777794 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c656a2e-5aa0-4614-865c-d38248dec5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:44:17.778467 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c656a2e-5aa0-4614-865c-d38248dec5d2 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:17.778815 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c656a2e-5aa0-4614-865c-d38248dec5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:17.779102 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c656a2e-5aa0-4614-865c-d38248dec5d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:17.779841 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c656a2e-5aa0-4614-865c-d38248dec5d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:44:17.782419 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c656a2e-5aa0-4614-865c-d38248dec5d2 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:44:17.870598 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4098/8217] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:44:17 2022] POST /identity/v3/projects => generated 373 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:44:17.874852 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26aa781-4534-4b8d-9184-1e9ad4d10199 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:44:17.887645 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26aa781-4534-4b8d-9184-1e9ad4d10199 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:44:17.947108 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e61f5d1-680e-4c02-b337-0fda7bd350e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:44:17.947821 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e61f5d1-680e-4c02-b337-0fda7bd350e5 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:17.948108 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e61f5d1-680e-4c02-b337-0fda7bd350e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:17.948385 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e61f5d1-680e-4c02-b337-0fda7bd350e5 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:17.949080 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e61f5d1-680e-4c02-b337-0fda7bd350e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:44:17.950984 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e61f5d1-680e-4c02-b337-0fda7bd350e5 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:44:18.045663 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4120/8218] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:44:17 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:44:18.049891 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c656a2e-5aa0-4614-865c-d38248dec5d2 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:44:18.060321 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c656a2e-5aa0-4614-865c-d38248dec5d2 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:44:18.065730 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5cf361-5d9b-429c-8247-862fc9ebf813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:44:18.066390 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5cf361-5d9b-429c-8247-862fc9ebf813 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:18.066677 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5cf361-5d9b-429c-8247-862fc9ebf813 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:18.066957 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5cf361-5d9b-429c-8247-862fc9ebf813 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:18.067714 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5cf361-5d9b-429c-8247-862fc9ebf813 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:44:18.069339 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5cf361-5d9b-429c-8247-862fc9ebf813 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:44:18.084154 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4099/8219] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:44:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:44:18.085844 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e61f5d1-680e-4c02-b337-0fda7bd350e5 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:44:18.100430 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e61f5d1-680e-4c02-b337-0fda7bd350e5 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:44:18.105356 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bb5ed6-de55-4994-9cae-b90fb593fca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:44:18.106253 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb5ed6-de55-4994-9cae-b90fb593fca6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:18.106535 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb5ed6-de55-4994-9cae-b90fb593fca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:18.106808 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb5ed6-de55-4994-9cae-b90fb593fca6 admin admin] PATH_INFO: `/v3/projects/2f4a5f4c90b64e8e972be1f2bd39a365/users/401f962f10ba42cb92a42758199e5866/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:18.121187 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bb5ed6-de55-4994-9cae-b90fb593fca6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f4a5f4c90b64e8e972be1f2bd39a365, user_id=401f962f10ba42cb92a42758199e5866, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:44:18.123934 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bb5ed6-de55-4994-9cae-b90fb593fca6 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:44:18.211628 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4121/8220] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:44:18 2022] PUT /identity/v3/projects/2f4a5f4c90b64e8e972be1f2bd39a365/users/401f962f10ba42cb92a42758199e5866/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:44:18.215756 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5cf361-5d9b-429c-8247-862fc9ebf813 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:44:18.225955 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5cf361-5d9b-429c-8247-862fc9ebf813 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:44:18.281690 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66023db5-200a-4950-ba53-490263d6123c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:44:18.282355 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66023db5-200a-4950-ba53-490263d6123c admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:18.282648 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66023db5-200a-4950-ba53-490263d6123c admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:18.282949 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66023db5-200a-4950-ba53-490263d6123c admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:18.283722 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66023db5-200a-4950-ba53-490263d6123c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:44:18.285332 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66023db5-200a-4950-ba53-490263d6123c admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:44:18.295415 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4100/8221] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:44:18 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:44:18.299774 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bb5ed6-de55-4994-9cae-b90fb593fca6 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:44:18.310065 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bb5ed6-de55-4994-9cae-b90fb593fca6 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:44:18.315631 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2917200-d524-4082-827a-8e4f11c6cf93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:44:18.316514 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2917200-d524-4082-827a-8e4f11c6cf93 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:18.316825 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2917200-d524-4082-827a-8e4f11c6cf93 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:18.317102 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2917200-d524-4082-827a-8e4f11c6cf93 admin admin] PATH_INFO: `/v3/projects/2f4a5f4c90b64e8e972be1f2bd39a365/users/401f962f10ba42cb92a42758199e5866/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:18.319075 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2917200-d524-4082-827a-8e4f11c6cf93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f4a5f4c90b64e8e972be1f2bd39a365, user_id=401f962f10ba42cb92a42758199e5866, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:44:18.321750 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2917200-d524-4082-827a-8e4f11c6cf93 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:44:18.332567 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4122/8222] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:44:18 2022] PUT /identity/v3/projects/2f4a5f4c90b64e8e972be1f2bd39a365/users/401f962f10ba42cb92a42758199e5866/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:44:18.343141 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2107b-682c-45e4-a40e-f47bfe04b0fd None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:18.343674 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2107b-682c-45e4-a40e-f47bfe04b0fd None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:18.343961 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2107b-682c-45e4-a40e-f47bfe04b0fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:18.370870 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-38a2107b-682c-45e4-a40e-f47bfe04b0fd None None] MFA Rules not processed for user `401f962f10ba42cb92a42758199e5866`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:44:18.372105 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-38a2107b-682c-45e4-a40e-f47bfe04b0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:44:18.444205 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4101/8223] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:44:18 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:44:18.460667 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2917200-d524-4082-827a-8e4f11c6cf93 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:44:18.462345 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b2917200-d524-4082-827a-8e4f11c6cf93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:44:18.525401 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2917200-d524-4082-827a-8e4f11c6cf93 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:44:18.529507 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53e9ef8-1e75-4535-97bf-f8357d64d895 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198271d1c0d44cb58bace41a65f4b94c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:44:18.530618 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e9ef8-1e75-4535-97bf-f8357d64d895 service cinder] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:18.530949 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e9ef8-1e75-4535-97bf-f8357d64d895 service cinder] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:18.531285 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e9ef8-1e75-4535-97bf-f8357d64d895 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:18.591751 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53e9ef8-1e75-4535-97bf-f8357d64d895 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:44:18.593670 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53e9ef8-1e75-4535-97bf-f8357d64d895 service cinder] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:44:18.603638 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4123/8224] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:44:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:44:21.817927 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a2107b-682c-45e4-a40e-f47bfe04b0fd None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:44:21.830394 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a2107b-682c-45e4-a40e-f47bfe04b0fd None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:44:21.834223 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dc21ef-bb5a-42fd-b52a-07976739b477 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198271d1c0d44cb58bace41a65f4b94c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:44:21.834877 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc21ef-bb5a-42fd-b52a-07976739b477 service cinder] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:21.835163 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc21ef-bb5a-42fd-b52a-07976739b477 service cinder] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:21.835447 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc21ef-bb5a-42fd-b52a-07976739b477 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:21.891384 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dc21ef-bb5a-42fd-b52a-07976739b477 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:44:21.893025 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dc21ef-bb5a-42fd-b52a-07976739b477 service cinder] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:44:21.903221 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4102/8225] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:44:21 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:44:23.512395 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53e9ef8-1e75-4535-97bf-f8357d64d895 service cinder] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:44:23.525030 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53e9ef8-1e75-4535-97bf-f8357d64d895 service cinder] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:44:23.530727 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb2a2c2-db47-4f2b-81be-b43875e65b33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198271d1c0d44cb58bace41a65f4b94c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:44:23.531842 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb2a2c2-db47-4f2b-81be-b43875e65b33 service cinder] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:23.532464 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb2a2c2-db47-4f2b-81be-b43875e65b33 service cinder] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:23.532464 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb2a2c2-db47-4f2b-81be-b43875e65b33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:23.554079 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb2a2c2-db47-4f2b-81be-b43875e65b33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:44:23.554079 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb2a2c2-db47-4f2b-81be-b43875e65b33 service cinder] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:44:23.565422 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4124/8226] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:44:23 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:44:28.405495 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a7671e-a977-4822-bb27-a51e4da1a06b None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:28.406002 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a7671e-a977-4822-bb27-a51e4da1a06b None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:28.406094 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a7671e-a977-4822-bb27-a51e4da1a06b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:28.428228 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-46a7671e-a977-4822-bb27-a51e4da1a06b None None] MFA Rules not processed for user `139d42d8881949b3befd8e4412c64800`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:44:28.429544 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-46a7671e-a977-4822-bb27-a51e4da1a06b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:44:28.498153 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4103/8227] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:44:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:44:29.346894 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb2a2c2-db47-4f2b-81be-b43875e65b33 service cinder] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:44:29.348405 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ffb2a2c2-db47-4f2b-81be-b43875e65b33 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:44:29.465677 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb2a2c2-db47-4f2b-81be-b43875e65b33 service cinder] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:44:29.472898 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eedc116-afec-4fd4-9920-377b92999593 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:44:29.475668 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eedc116-afec-4fd4-9920-377b92999593 service placement] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:29.475997 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eedc116-afec-4fd4-9920-377b92999593 service placement] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:29.476285 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eedc116-afec-4fd4-9920-377b92999593 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:29.480596 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-6eedc116-afec-4fd4-9920-377b92999593 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:44:29.503473 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eedc116-afec-4fd4-9920-377b92999593 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:44:29.505168 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eedc116-afec-4fd4-9920-377b92999593 service placement] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:44:29.525542 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4125/8228] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:44:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:44:38.888709 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a7671e-a977-4822-bb27-a51e4da1a06b None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:44:38.890132 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-46a7671e-a977-4822-bb27-a51e4da1a06b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:44:38.973007 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a7671e-a977-4822-bb27-a51e4da1a06b None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:44:38.979225 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36507fe-ad56-4179-9dbf-877ebc6020aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:44:38.980002 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36507fe-ad56-4179-9dbf-877ebc6020aa service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:38.980353 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36507fe-ad56-4179-9dbf-877ebc6020aa service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:38.980772 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36507fe-ad56-4179-9dbf-877ebc6020aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:38.982845 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-d36507fe-ad56-4179-9dbf-877ebc6020aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:44:39.001877 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36507fe-ad56-4179-9dbf-877ebc6020aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:44:39.003580 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36507fe-ad56-4179-9dbf-877ebc6020aa service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:44:39.021749 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4104/8229] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:44:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:44:49.449496 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eedc116-afec-4fd4-9920-377b92999593 service placement] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:44:49.450956 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-6eedc116-afec-4fd4-9920-377b92999593 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:44:49.527845 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eedc116-afec-4fd4-9920-377b92999593 service placement] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:44:49.534166 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092ea628-6756-4a48-b76e-6b14dbbc1d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:44:49.535221 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ea628-6756-4a48-b76e-6b14dbbc1d73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:49.535666 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ea628-6756-4a48-b76e-6b14dbbc1d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:49.536045 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ea628-6756-4a48-b76e-6b14dbbc1d73 admin admin] PATH_INFO: `/v3/users/16ffd497e45e4683971ebee0eaebb975` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:49.537644 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092ea628-6756-4a48-b76e-6b14dbbc1d73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16ffd497e45e4683971ebee0eaebb975)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:44:49.540186 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092ea628-6756-4a48-b76e-6b14dbbc1d73 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:44:49.746972 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-092ea628-6756-4a48-b76e-6b14dbbc1d73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16ffd497e45e4683971ebee0eaebb975'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:49.760382 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-092ea628-6756-4a48-b76e-6b14dbbc1d73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16ffd497e45e4683971ebee0eaebb975'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:49.767169 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-092ea628-6756-4a48-b76e-6b14dbbc1d73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16ffd497e45e4683971ebee0eaebb975'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:49.914424 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-092ea628-6756-4a48-b76e-6b14dbbc1d73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16ffd497e45e4683971ebee0eaebb975'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:49.915170 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-092ea628-6756-4a48-b76e-6b14dbbc1d73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16ffd497e45e4683971ebee0eaebb975'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:49.922828 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4126/8230] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:44:49 2022] DELETE /identity/v3/users/16ffd497e45e4683971ebee0eaebb975 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:44:49.928679 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5339d7f8-76ab-47bc-8eca-a5b6082d28d2 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:49.929942 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5339d7f8-76ab-47bc-8eca-a5b6082d28d2 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:49.930474 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5339d7f8-76ab-47bc-8eca-a5b6082d28d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:49.960225 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-5339d7f8-76ab-47bc-8eca-a5b6082d28d2 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:44:49.961445 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-5339d7f8-76ab-47bc-8eca-a5b6082d28d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:44:50.028039 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4105/8231] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:44:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:44:50.039753 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092ea628-6756-4a48-b76e-6b14dbbc1d73 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:44:50.041377 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-092ea628-6756-4a48-b76e-6b14dbbc1d73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:44:50.103924 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092ea628-6756-4a48-b76e-6b14dbbc1d73 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:44:50.107735 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3260cc-c583-4be3-a9f7-dc591b69fcea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:44:50.110417 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3260cc-c583-4be3-a9f7-dc591b69fcea service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:50.110417 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3260cc-c583-4be3-a9f7-dc591b69fcea service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:50.110417 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3260cc-c583-4be3-a9f7-dc591b69fcea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:50.119017 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3260cc-c583-4be3-a9f7-dc591b69fcea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:44:50.120473 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3260cc-c583-4be3-a9f7-dc591b69fcea service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:44:50.130753 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4127/8232] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:44:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:44:50.636459 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5339d7f8-76ab-47bc-8eca-a5b6082d28d2 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:44:50.638568 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-5339d7f8-76ab-47bc-8eca-a5b6082d28d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:44:50.693887 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5339d7f8-76ab-47bc-8eca-a5b6082d28d2 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:44:50.708502 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f8cdad-50cd-431a-bf72-0edfc1974f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:44:50.709469 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f8cdad-50cd-431a-bf72-0edfc1974f0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:50.711175 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f8cdad-50cd-431a-bf72-0edfc1974f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:50.711583 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f8cdad-50cd-431a-bf72-0edfc1974f0d admin admin] PATH_INFO: `/v3/projects/8a79a55f6b2f46ae89036ef9bb98639c` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:50.713377 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f8cdad-50cd-431a-bf72-0edfc1974f0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a79a55f6b2f46ae89036ef9bb98639c)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:44:50.715324 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f8cdad-50cd-431a-bf72-0edfc1974f0d admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:44:50.875974 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a0f8cdad-50cd-431a-bf72-0edfc1974f0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a79a55f6b2f46ae89036ef9bb98639c', 'request_id': 'req-a0f8cdad-50cd-431a-bf72-0edfc1974f0d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:50.882247 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a0f8cdad-50cd-431a-bf72-0edfc1974f0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a79a55f6b2f46ae89036ef9bb98639c', 'request_id': 'req-a0f8cdad-50cd-431a-bf72-0edfc1974f0d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:50.888898 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a0f8cdad-50cd-431a-bf72-0edfc1974f0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a79a55f6b2f46ae89036ef9bb98639c', 'request_id': 'req-a0f8cdad-50cd-431a-bf72-0edfc1974f0d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:51.012191 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a0f8cdad-50cd-431a-bf72-0edfc1974f0d admin admin] The token cache is being invalidate because project 8a79a55f6b2f46ae89036ef9bb98639c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:44:51.012885 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a0f8cdad-50cd-431a-bf72-0edfc1974f0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:51.013617 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a0f8cdad-50cd-431a-bf72-0edfc1974f0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:51.015205 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4106/8233] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:44:50 2022] DELETE /identity/v3/projects/8a79a55f6b2f46ae89036ef9bb98639c => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:44:51.019968 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3260cc-c583-4be3-a9f7-dc591b69fcea service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:44:51.035033 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3260cc-c583-4be3-a9f7-dc591b69fcea service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:44:51.114751 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09082b4e-3bc9-42ae-ac3e-013fc963c9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:44:51.116021 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09082b4e-3bc9-42ae-ac3e-013fc963c9dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:51.116364 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09082b4e-3bc9-42ae-ac3e-013fc963c9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:51.116748 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09082b4e-3bc9-42ae-ac3e-013fc963c9dd admin admin] PATH_INFO: `/v3/users/77e7a5dd3ff2484f97cdd943744ec1aa` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:51.118158 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09082b4e-3bc9-42ae-ac3e-013fc963c9dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=77e7a5dd3ff2484f97cdd943744ec1aa)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:44:51.120215 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09082b4e-3bc9-42ae-ac3e-013fc963c9dd admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:44:51.414817 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-09082b4e-3bc9-42ae-ac3e-013fc963c9dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77e7a5dd3ff2484f97cdd943744ec1aa'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:51.428964 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-09082b4e-3bc9-42ae-ac3e-013fc963c9dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77e7a5dd3ff2484f97cdd943744ec1aa'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:51.439986 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-09082b4e-3bc9-42ae-ac3e-013fc963c9dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77e7a5dd3ff2484f97cdd943744ec1aa'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:51.508796 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-09082b4e-3bc9-42ae-ac3e-013fc963c9dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77e7a5dd3ff2484f97cdd943744ec1aa'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:51.509431 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-09082b4e-3bc9-42ae-ac3e-013fc963c9dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77e7a5dd3ff2484f97cdd943744ec1aa'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:51.516468 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4128/8234] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:44:51 2022] DELETE /identity/v3/users/77e7a5dd3ff2484f97cdd943744ec1aa => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:44:51.962886 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f8cdad-50cd-431a-bf72-0edfc1974f0d admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:44:51.967104 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-a0f8cdad-50cd-431a-bf72-0edfc1974f0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:44:51.980706 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f8cdad-50cd-431a-bf72-0edfc1974f0d admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:44:52.040381 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c53d8c-e5a0-4d36-a4b6-198dffa99995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:44:52.041245 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c53d8c-e5a0-4d36-a4b6-198dffa99995 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:52.041531 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c53d8c-e5a0-4d36-a4b6-198dffa99995 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:52.041809 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c53d8c-e5a0-4d36-a4b6-198dffa99995 admin admin] PATH_INFO: `/v3/projects/3e07c5295d2f485d99b3ecb7372e3eb4` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:52.043004 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c53d8c-e5a0-4d36-a4b6-198dffa99995 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e07c5295d2f485d99b3ecb7372e3eb4)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:44:52.045025 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c53d8c-e5a0-4d36-a4b6-198dffa99995 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:44:52.167191 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a4c53d8c-e5a0-4d36-a4b6-198dffa99995 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e07c5295d2f485d99b3ecb7372e3eb4', 'request_id': 'req-a4c53d8c-e5a0-4d36-a4b6-198dffa99995'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:52.173026 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a4c53d8c-e5a0-4d36-a4b6-198dffa99995 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e07c5295d2f485d99b3ecb7372e3eb4', 'request_id': 'req-a4c53d8c-e5a0-4d36-a4b6-198dffa99995'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:52.181905 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a4c53d8c-e5a0-4d36-a4b6-198dffa99995 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e07c5295d2f485d99b3ecb7372e3eb4', 'request_id': 'req-a4c53d8c-e5a0-4d36-a4b6-198dffa99995'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:52.240286 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a4c53d8c-e5a0-4d36-a4b6-198dffa99995 admin admin] The token cache is being invalidate because project 3e07c5295d2f485d99b3ecb7372e3eb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:44:52.240511 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a4c53d8c-e5a0-4d36-a4b6-198dffa99995 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:52.240984 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a4c53d8c-e5a0-4d36-a4b6-198dffa99995 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:52.242512 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4107/8235] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:44:51 2022] DELETE /identity/v3/projects/3e07c5295d2f485d99b3ecb7372e3eb4 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:44:52.247818 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b77194-ac6f-4d44-bb00-4575e19c7ad0 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:52.248326 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b77194-ac6f-4d44-bb00-4575e19c7ad0 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:52.248439 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b77194-ac6f-4d44-bb00-4575e19c7ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:52.267015 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-60b77194-ac6f-4d44-bb00-4575e19c7ad0 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:44:52.268298 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-60b77194-ac6f-4d44-bb00-4575e19c7ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:44:52.331761 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4129/8236] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:44:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:44:52.339425 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71149c4e-99cb-4ad8-9e5a-51b1cc7532bf None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:52.339754 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71149c4e-99cb-4ad8-9e5a-51b1cc7532bf None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:52.340039 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71149c4e-99cb-4ad8-9e5a-51b1cc7532bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:52.360049 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-71149c4e-99cb-4ad8-9e5a-51b1cc7532bf None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:44:52.360745 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-71149c4e-99cb-4ad8-9e5a-51b1cc7532bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:44:52.374503 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4108/8237] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:44:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:44:52.375756 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b77194-ac6f-4d44-bb00-4575e19c7ad0 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:44:52.386819 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b77194-ac6f-4d44-bb00-4575e19c7ad0 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:44:52.397300 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fcf08d-0d9c-4478-abe5-880e8cac012a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:44:52.402543 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fcf08d-0d9c-4478-abe5-880e8cac012a admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:52.402543 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fcf08d-0d9c-4478-abe5-880e8cac012a admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:52.402543 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fcf08d-0d9c-4478-abe5-880e8cac012a admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:52.402543 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fcf08d-0d9c-4478-abe5-880e8cac012a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:44:52.402543 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fcf08d-0d9c-4478-abe5-880e8cac012a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:44:52.402543 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fcf08d-0d9c-4478-abe5-880e8cac012a admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:44:52.417467 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4130/8238] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:44:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:44:52.419565 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71149c4e-99cb-4ad8-9e5a-51b1cc7532bf None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:44:52.429875 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71149c4e-99cb-4ad8-9e5a-51b1cc7532bf None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:44:52.435369 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8daf89b-c91b-4a11-9cf7-2dfc3529ba07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:44:52.436573 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8daf89b-c91b-4a11-9cf7-2dfc3529ba07 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:52.436708 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8daf89b-c91b-4a11-9cf7-2dfc3529ba07 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:52.436920 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8daf89b-c91b-4a11-9cf7-2dfc3529ba07 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:52.437682 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8daf89b-c91b-4a11-9cf7-2dfc3529ba07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:44:52.439739 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8daf89b-c91b-4a11-9cf7-2dfc3529ba07 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:44:52.468634 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fcf08d-0d9c-4478-abe5-880e8cac012a admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:44:52.471550 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-44fcf08d-0d9c-4478-abe5-880e8cac012a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:44:52.553647 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fcf08d-0d9c-4478-abe5-880e8cac012a admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:44:52.559723 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c5a1a-00e7-402d-8095-6e43c5a64e43 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:44:52.560627 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c5a1a-00e7-402d-8095-6e43c5a64e43 service placement] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:52.560825 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c5a1a-00e7-402d-8095-6e43c5a64e43 service placement] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:52.561232 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c5a1a-00e7-402d-8095-6e43c5a64e43 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:52.563299 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-825c5a1a-00e7-402d-8095-6e43c5a64e43 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:44:52.578560 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825c5a1a-00e7-402d-8095-6e43c5a64e43 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:44:52.580553 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825c5a1a-00e7-402d-8095-6e43c5a64e43 service placement] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:44:52.598802 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4131/8239] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:44:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:44:52.614520 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4109/8240] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:44:52 2022] POST /identity/v3/projects => generated 365 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:44:52.615744 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c5a1a-00e7-402d-8095-6e43c5a64e43 service placement] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:44:52.631106 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c5a1a-00e7-402d-8095-6e43c5a64e43 service placement] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:44:52.691180 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5879c7-03ef-4952-be2a-650b3110f43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:44:52.691878 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5879c7-03ef-4952-be2a-650b3110f43f admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:52.692162 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5879c7-03ef-4952-be2a-650b3110f43f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:52.692440 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5879c7-03ef-4952-be2a-650b3110f43f admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:52.693126 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5879c7-03ef-4952-be2a-650b3110f43f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:44:52.695151 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5879c7-03ef-4952-be2a-650b3110f43f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:44:52.823000 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4132/8241] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:44:52 2022] POST /identity/v3/users => generated 283 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:44:52.826926 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8daf89b-c91b-4a11-9cf7-2dfc3529ba07 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:44:52.838282 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8daf89b-c91b-4a11-9cf7-2dfc3529ba07 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:44:52.843036 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3313971-c3ef-4a52-ba26-d35c1f0b4bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:44:52.843753 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3313971-c3ef-4a52-ba26-d35c1f0b4bd5 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:52.844033 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3313971-c3ef-4a52-ba26-d35c1f0b4bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:52.844483 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3313971-c3ef-4a52-ba26-d35c1f0b4bd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:52.845439 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3313971-c3ef-4a52-ba26-d35c1f0b4bd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:44:52.847200 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3313971-c3ef-4a52-ba26-d35c1f0b4bd5 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:44:52.858245 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4110/8242] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:44:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:44:52.863318 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5879c7-03ef-4952-be2a-650b3110f43f admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:44:52.874850 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5879c7-03ef-4952-be2a-650b3110f43f admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:44:52.880862 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a210c4f3-e8c0-4ee9-8042-e9fa252fd108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:44:52.881642 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210c4f3-e8c0-4ee9-8042-e9fa252fd108 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:52.882053 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210c4f3-e8c0-4ee9-8042-e9fa252fd108 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:52.882337 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210c4f3-e8c0-4ee9-8042-e9fa252fd108 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:52.883061 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a210c4f3-e8c0-4ee9-8042-e9fa252fd108 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:44:52.884727 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a210c4f3-e8c0-4ee9-8042-e9fa252fd108 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:44:52.895320 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4133/8243] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:44:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:44:52.899829 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3313971-c3ef-4a52-ba26-d35c1f0b4bd5 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:44:52.910353 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3313971-c3ef-4a52-ba26-d35c1f0b4bd5 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:44:52.916205 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf50c43c-4fbe-4741-b3b5-7413a1f9c2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:44:52.917105 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf50c43c-4fbe-4741-b3b5-7413a1f9c2ca admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:52.917580 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf50c43c-4fbe-4741-b3b5-7413a1f9c2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:52.917868 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf50c43c-4fbe-4741-b3b5-7413a1f9c2ca admin admin] PATH_INFO: `/v3/projects/f3dee1ebf6e5429b99b7009de82ad532/users/d819211dc81042859d54dd6c3a1507a2/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:52.946356 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf50c43c-4fbe-4741-b3b5-7413a1f9c2ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3dee1ebf6e5429b99b7009de82ad532, user_id=d819211dc81042859d54dd6c3a1507a2, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:44:52.951660 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf50c43c-4fbe-4741-b3b5-7413a1f9c2ca admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:44:53.092043 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4111/8244] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:44:52 2022] PUT /identity/v3/projects/f3dee1ebf6e5429b99b7009de82ad532/users/d819211dc81042859d54dd6c3a1507a2/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:44:53.103412 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5128e-6f85-469d-9749-35c02c75155f None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:53.103756 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5128e-6f85-469d-9749-35c02c75155f None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:53.104041 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5128e-6f85-469d-9749-35c02c75155f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:53.133714 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-23e5128e-6f85-469d-9749-35c02c75155f None None] MFA Rules not processed for user `d819211dc81042859d54dd6c3a1507a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:44:53.134918 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-23e5128e-6f85-469d-9749-35c02c75155f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:44:53.213409 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4134/8245] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:44:53 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:44:53.218126 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf50c43c-4fbe-4741-b3b5-7413a1f9c2ca admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:44:53.281957 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf50c43c-4fbe-4741-b3b5-7413a1f9c2ca admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:44:53.287604 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1c9470-f9cc-420c-8157-846540eb8cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:44:53.288269 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c9470-f9cc-420c-8157-846540eb8cdb admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:53.288559 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c9470-f9cc-420c-8157-846540eb8cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:53.288817 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c9470-f9cc-420c-8157-846540eb8cdb admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:53.289503 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1c9470-f9cc-420c-8157-846540eb8cdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:44:53.291424 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1c9470-f9cc-420c-8157-846540eb8cdb admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:44:53.378198 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4112/8246] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:44:53 2022] POST /identity/v3/projects => generated 365 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:44:53.382322 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e5128e-6f85-469d-9749-35c02c75155f None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:44:53.393440 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e5128e-6f85-469d-9749-35c02c75155f None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:44:53.456370 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3161d5c5-d05d-4f40-8df0-59ea84858db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:44:53.457443 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3161d5c5-d05d-4f40-8df0-59ea84858db1 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:53.457821 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3161d5c5-d05d-4f40-8df0-59ea84858db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:53.458104 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3161d5c5-d05d-4f40-8df0-59ea84858db1 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:53.458849 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3161d5c5-d05d-4f40-8df0-59ea84858db1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:44:53.460842 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3161d5c5-d05d-4f40-8df0-59ea84858db1 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:44:53.591524 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4135/8247] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:44:53 2022] POST /identity/v3/users => generated 289 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:44:53.608307 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1c9470-f9cc-420c-8157-846540eb8cdb admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:44:53.608307 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1c9470-f9cc-420c-8157-846540eb8cdb admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:44:53.610308 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed36dad-d168-4102-acb1-9cead70823bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:44:53.611545 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed36dad-d168-4102-acb1-9cead70823bf admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:53.611957 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed36dad-d168-4102-acb1-9cead70823bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:53.612238 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed36dad-d168-4102-acb1-9cead70823bf admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:53.612963 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed36dad-d168-4102-acb1-9cead70823bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:44:53.614781 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed36dad-d168-4102-acb1-9cead70823bf admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:44:53.626542 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4113/8248] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:44:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:44:53.632158 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3161d5c5-d05d-4f40-8df0-59ea84858db1 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:44:53.642620 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3161d5c5-d05d-4f40-8df0-59ea84858db1 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:44:53.649292 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82ca3f0-7849-4c0f-aa55-48bbe4d3ee71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:44:53.649736 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ca3f0-7849-4c0f-aa55-48bbe4d3ee71 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:53.650052 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ca3f0-7849-4c0f-aa55-48bbe4d3ee71 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:53.650328 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ca3f0-7849-4c0f-aa55-48bbe4d3ee71 admin admin] PATH_INFO: `/v3/projects/e65d9a259531497e868aa6b55559ccc3/users/c1d83e261dc946ac8edb7f207b40605a/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:53.669256 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82ca3f0-7849-4c0f-aa55-48bbe4d3ee71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e65d9a259531497e868aa6b55559ccc3, user_id=c1d83e261dc946ac8edb7f207b40605a, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:44:53.672042 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82ca3f0-7849-4c0f-aa55-48bbe4d3ee71 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:44:53.744032 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4136/8249] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:44:53 2022] PUT /identity/v3/projects/e65d9a259531497e868aa6b55559ccc3/users/c1d83e261dc946ac8edb7f207b40605a/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:44:53.748254 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed36dad-d168-4102-acb1-9cead70823bf admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:44:53.761952 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed36dad-d168-4102-acb1-9cead70823bf admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:44:53.823747 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaf6418-3961-454a-9e05-b800bfdc282b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:44:53.824462 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf6418-3961-454a-9e05-b800bfdc282b admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:53.824737 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf6418-3961-454a-9e05-b800bfdc282b admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:53.825039 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf6418-3961-454a-9e05-b800bfdc282b admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:53.825781 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaf6418-3961-454a-9e05-b800bfdc282b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:44:53.827447 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaf6418-3961-454a-9e05-b800bfdc282b admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:44:53.838239 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4114/8250] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:44:53 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:44:53.846090 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82ca3f0-7849-4c0f-aa55-48bbe4d3ee71 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:44:53.846837 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaf6418-3961-454a-9e05-b800bfdc282b admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:44:53.848619 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-cbaf6418-3961-454a-9e05-b800bfdc282b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:44:53.858248 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82ca3f0-7849-4c0f-aa55-48bbe4d3ee71 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:44:53.862850 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaf6418-3961-454a-9e05-b800bfdc282b admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:44:53.866839 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f4a58-f67c-4e38-a4bf-ea1490a3196e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:44:53.867802 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f4a58-f67c-4e38-a4bf-ea1490a3196e admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:53.868080 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f4a58-f67c-4e38-a4bf-ea1490a3196e admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:53.868352 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f4a58-f67c-4e38-a4bf-ea1490a3196e admin admin] PATH_INFO: `/v3/projects/e65d9a259531497e868aa6b55559ccc3/users/c1d83e261dc946ac8edb7f207b40605a/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:53.868467 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a285f-bb1e-471e-bf05-0ca01bb43be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:44:53.869388 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a285f-bb1e-471e-bf05-0ca01bb43be6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:53.869644 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a285f-bb1e-471e-bf05-0ca01bb43be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:53.869910 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a285f-bb1e-471e-bf05-0ca01bb43be6 admin admin] PATH_INFO: `/v3/users/0860ddc4bdec438aba103113979deb07` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:53.870557 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048f4a58-f67c-4e38-a4bf-ea1490a3196e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e65d9a259531497e868aa6b55559ccc3, user_id=c1d83e261dc946ac8edb7f207b40605a, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:44:53.871147 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619a285f-bb1e-471e-bf05-0ca01bb43be6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0860ddc4bdec438aba103113979deb07)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:44:53.873175 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619a285f-bb1e-471e-bf05-0ca01bb43be6 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:44:53.873305 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048f4a58-f67c-4e38-a4bf-ea1490a3196e admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:44:53.884577 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4137/8251] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:44:53 2022] PUT /identity/v3/projects/e65d9a259531497e868aa6b55559ccc3/users/c1d83e261dc946ac8edb7f207b40605a/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:44:53.896742 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795aa96-5a1b-4ac1-879a-376f2f6968f5 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:53.897989 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795aa96-5a1b-4ac1-879a-376f2f6968f5 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:53.897989 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795aa96-5a1b-4ac1-879a-376f2f6968f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:53.930863 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-c795aa96-5a1b-4ac1-879a-376f2f6968f5 None None] MFA Rules not processed for user `c1d83e261dc946ac8edb7f207b40605a`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:44:53.932241 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c795aa96-5a1b-4ac1-879a-376f2f6968f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:44:54.028391 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4138/8252] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:44:53 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:44:54.041105 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c795aa96-5a1b-4ac1-879a-376f2f6968f5 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:44:54.042460 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c795aa96-5a1b-4ac1-879a-376f2f6968f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:44:54.103175 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c795aa96-5a1b-4ac1-879a-376f2f6968f5 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:44:54.106981 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61a91ef-44b2-4e57-b305-3a5b6b5c3b3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198271d1c0d44cb58bace41a65f4b94c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:44:54.107715 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a91ef-44b2-4e57-b305-3a5b6b5c3b3e service cinder] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:54.107997 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a91ef-44b2-4e57-b305-3a5b6b5c3b3e service cinder] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:54.108330 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a91ef-44b2-4e57-b305-3a5b6b5c3b3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:54.118795 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61a91ef-44b2-4e57-b305-3a5b6b5c3b3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:44:54.120272 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61a91ef-44b2-4e57-b305-3a5b6b5c3b3e service cinder] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:44:54.129504 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4139/8253] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:44:54 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:44:54.201269 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-619a285f-bb1e-471e-bf05-0ca01bb43be6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0860ddc4bdec438aba103113979deb07'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:54.209971 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-619a285f-bb1e-471e-bf05-0ca01bb43be6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0860ddc4bdec438aba103113979deb07'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:54.210747 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-619a285f-bb1e-471e-bf05-0ca01bb43be6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0860ddc4bdec438aba103113979deb07'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:54.291278 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-619a285f-bb1e-471e-bf05-0ca01bb43be6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0860ddc4bdec438aba103113979deb07'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:54.304702 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-619a285f-bb1e-471e-bf05-0ca01bb43be6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0860ddc4bdec438aba103113979deb07'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:54.310530 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4115/8254] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:44:53 2022] DELETE /identity/v3/users/0860ddc4bdec438aba103113979deb07 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:44:54.315646 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22693103-d9d7-4a69-8dc7-f01f26c9842e None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:54.315934 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22693103-d9d7-4a69-8dc7-f01f26c9842e None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:54.316206 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22693103-d9d7-4a69-8dc7-f01f26c9842e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:54.334230 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-22693103-d9d7-4a69-8dc7-f01f26c9842e None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:44:54.335409 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-22693103-d9d7-4a69-8dc7-f01f26c9842e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:44:54.393630 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4140/8255] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:44:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:44:54.403256 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a285f-bb1e-471e-bf05-0ca01bb43be6 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:44:54.404771 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-619a285f-bb1e-471e-bf05-0ca01bb43be6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:44:54.466577 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a285f-bb1e-471e-bf05-0ca01bb43be6 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:44:54.470292 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397eaf40-786b-42f9-838f-45c0312cbeb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:44:54.471538 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397eaf40-786b-42f9-838f-45c0312cbeb2 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:54.471826 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397eaf40-786b-42f9-838f-45c0312cbeb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:54.472122 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397eaf40-786b-42f9-838f-45c0312cbeb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:54.482317 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397eaf40-786b-42f9-838f-45c0312cbeb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:44:54.485929 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397eaf40-786b-42f9-838f-45c0312cbeb2 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:44:54.494121 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4116/8256] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:44:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:44:54.762737 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22693103-d9d7-4a69-8dc7-f01f26c9842e None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:44:54.764258 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-22693103-d9d7-4a69-8dc7-f01f26c9842e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:44:54.861717 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22693103-d9d7-4a69-8dc7-f01f26c9842e None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:44:54.868031 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c9efea-f111-4a18-bd12-4f76d237dcbe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:44:54.868586 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c9efea-f111-4a18-bd12-4f76d237dcbe service placement] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:54.868949 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c9efea-f111-4a18-bd12-4f76d237dcbe service placement] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:54.869302 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c9efea-f111-4a18-bd12-4f76d237dcbe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:54.871712 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-51c9efea-f111-4a18-bd12-4f76d237dcbe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:44:54.891321 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c9efea-f111-4a18-bd12-4f76d237dcbe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:44:54.893494 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c9efea-f111-4a18-bd12-4f76d237dcbe service placement] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:44:54.912669 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4141/8257] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:44:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:44:55.036479 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397eaf40-786b-42f9-838f-45c0312cbeb2 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:44:55.042815 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-397eaf40-786b-42f9-838f-45c0312cbeb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:44:55.058213 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397eaf40-786b-42f9-838f-45c0312cbeb2 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:44:55.065828 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce19b55-08ef-4a8d-b37b-f95ecada13d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:44:55.066739 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce19b55-08ef-4a8d-b37b-f95ecada13d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:55.067382 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce19b55-08ef-4a8d-b37b-f95ecada13d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:55.067918 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce19b55-08ef-4a8d-b37b-f95ecada13d4 admin admin] PATH_INFO: `/v3/projects/d625ce83e9114cfaae698d73b917709d` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:55.074530 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce19b55-08ef-4a8d-b37b-f95ecada13d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d625ce83e9114cfaae698d73b917709d)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:44:55.074530 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce19b55-08ef-4a8d-b37b-f95ecada13d4 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:44:55.108490 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c9efea-f111-4a18-bd12-4f76d237dcbe service placement] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:44:55.112350 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-51c9efea-f111-4a18-bd12-4f76d237dcbe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:44:55.127795 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c9efea-f111-4a18-bd12-4f76d237dcbe service placement] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:44:55.133751 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df9740d-1c5e-482d-8d96-889d89424efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:44:55.137962 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df9740d-1c5e-482d-8d96-889d89424efd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:55.137962 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df9740d-1c5e-482d-8d96-889d89424efd admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:55.137962 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df9740d-1c5e-482d-8d96-889d89424efd admin admin] PATH_INFO: `/v3/users/d819211dc81042859d54dd6c3a1507a2` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:55.137962 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df9740d-1c5e-482d-8d96-889d89424efd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d819211dc81042859d54dd6c3a1507a2)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:44:55.139100 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df9740d-1c5e-482d-8d96-889d89424efd admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:44:55.200028 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3ce19b55-08ef-4a8d-b37b-f95ecada13d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd625ce83e9114cfaae698d73b917709d', 'request_id': 'req-3ce19b55-08ef-4a8d-b37b-f95ecada13d4'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:55.207161 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3ce19b55-08ef-4a8d-b37b-f95ecada13d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd625ce83e9114cfaae698d73b917709d', 'request_id': 'req-3ce19b55-08ef-4a8d-b37b-f95ecada13d4'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:55.214024 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3ce19b55-08ef-4a8d-b37b-f95ecada13d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd625ce83e9114cfaae698d73b917709d', 'request_id': 'req-3ce19b55-08ef-4a8d-b37b-f95ecada13d4'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:55.279373 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3ce19b55-08ef-4a8d-b37b-f95ecada13d4 admin admin] The token cache is being invalidate because project d625ce83e9114cfaae698d73b917709d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:44:55.279693 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3ce19b55-08ef-4a8d-b37b-f95ecada13d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:55.280318 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3ce19b55-08ef-4a8d-b37b-f95ecada13d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:55.281964 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4117/8258] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:44:55 2022] DELETE /identity/v3/projects/d625ce83e9114cfaae698d73b917709d => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:44:55.285730 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce19b55-08ef-4a8d-b37b-f95ecada13d4 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:44:55.287027 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-3ce19b55-08ef-4a8d-b37b-f95ecada13d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:44:55.345392 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2df9740d-1c5e-482d-8d96-889d89424efd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd819211dc81042859d54dd6c3a1507a2'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:55.358156 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce19b55-08ef-4a8d-b37b-f95ecada13d4 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:44:55.364928 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2df9740d-1c5e-482d-8d96-889d89424efd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd819211dc81042859d54dd6c3a1507a2'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:55.365554 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7aabcc-d1ca-4796-85b8-039f8f60551d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:44:55.366590 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7aabcc-d1ca-4796-85b8-039f8f60551d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:55.366726 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7aabcc-d1ca-4796-85b8-039f8f60551d admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:55.366993 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7aabcc-d1ca-4796-85b8-039f8f60551d admin admin] PATH_INFO: `/v3/users/2531da8082b14d95ad1f2a89e8e76e04` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:55.368246 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7aabcc-d1ca-4796-85b8-039f8f60551d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2531da8082b14d95ad1f2a89e8e76e04)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:44:55.370229 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7aabcc-d1ca-4796-85b8-039f8f60551d admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:44:55.374214 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2df9740d-1c5e-482d-8d96-889d89424efd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd819211dc81042859d54dd6c3a1507a2'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:55.451217 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2df9740d-1c5e-482d-8d96-889d89424efd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd819211dc81042859d54dd6c3a1507a2'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:55.452064 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2df9740d-1c5e-482d-8d96-889d89424efd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd819211dc81042859d54dd6c3a1507a2'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:55.459379 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4142/8259] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:44:55 2022] DELETE /identity/v3/users/d819211dc81042859d54dd6c3a1507a2 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:44:55.464441 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a43b1de-6bd6-4faf-869b-9c61785623b6 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:55.466195 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a43b1de-6bd6-4faf-869b-9c61785623b6 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:55.466195 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a43b1de-6bd6-4faf-869b-9c61785623b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:55.485160 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-9a43b1de-6bd6-4faf-869b-9c61785623b6 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:44:55.487975 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-9a43b1de-6bd6-4faf-869b-9c61785623b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:44:55.561097 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4143/8260] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:44:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:44:55.566555 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a43b1de-6bd6-4faf-869b-9c61785623b6 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:44:55.568414 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-9a43b1de-6bd6-4faf-869b-9c61785623b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:44:55.600180 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-8e7aabcc-d1ca-4796-85b8-039f8f60551d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2531da8082b14d95ad1f2a89e8e76e04'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:55.607516 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-8e7aabcc-d1ca-4796-85b8-039f8f60551d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2531da8082b14d95ad1f2a89e8e76e04'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:55.608636 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-8e7aabcc-d1ca-4796-85b8-039f8f60551d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2531da8082b14d95ad1f2a89e8e76e04'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:55.631500 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a43b1de-6bd6-4faf-869b-9c61785623b6 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:44:55.635234 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e811bd3-f062-4388-86a7-b246d5e5a579 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:44:55.635926 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e811bd3-f062-4388-86a7-b246d5e5a579 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:55.636206 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e811bd3-f062-4388-86a7-b246d5e5a579 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:55.636482 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e811bd3-f062-4388-86a7-b246d5e5a579 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:55.646249 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e811bd3-f062-4388-86a7-b246d5e5a579 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:44:55.647981 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e811bd3-f062-4388-86a7-b246d5e5a579 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:44:55.658279 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4144/8261] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:44:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:44:55.690950 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-8e7aabcc-d1ca-4796-85b8-039f8f60551d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2531da8082b14d95ad1f2a89e8e76e04'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:55.706179 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-8e7aabcc-d1ca-4796-85b8-039f8f60551d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2531da8082b14d95ad1f2a89e8e76e04'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:55.711222 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4118/8262] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:44:55 2022] DELETE /identity/v3/users/2531da8082b14d95ad1f2a89e8e76e04 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:44:56.163148 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e811bd3-f062-4388-86a7-b246d5e5a579 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:44:56.164903 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-8e811bd3-f062-4388-86a7-b246d5e5a579 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:44:56.178500 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e811bd3-f062-4388-86a7-b246d5e5a579 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:44:56.246581 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7aabcc-d1ca-4796-85b8-039f8f60551d admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:44:56.248815 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a1fe90-5a7f-4c8c-8c34-25f6ab72e0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:44:56.249165 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8e7aabcc-d1ca-4796-85b8-039f8f60551d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:44:56.249713 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a1fe90-5a7f-4c8c-8c34-25f6ab72e0dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:56.250324 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a1fe90-5a7f-4c8c-8c34-25f6ab72e0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:56.250607 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a1fe90-5a7f-4c8c-8c34-25f6ab72e0dd admin admin] PATH_INFO: `/v3/projects/8ff83d15abe94bab825c8b23b3e4a49f` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:56.253885 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a1fe90-5a7f-4c8c-8c34-25f6ab72e0dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ff83d15abe94bab825c8b23b3e4a49f)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:44:56.257031 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a1fe90-5a7f-4c8c-8c34-25f6ab72e0dd admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:44:56.270183 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7aabcc-d1ca-4796-85b8-039f8f60551d admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:44:56.278425 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0d7073-7518-429b-8a51-32730332ae7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:44:56.280527 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d7073-7518-429b-8a51-32730332ae7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:56.281163 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d7073-7518-429b-8a51-32730332ae7b admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:56.281750 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d7073-7518-429b-8a51-32730332ae7b admin admin] PATH_INFO: `/v3/projects/f3dee1ebf6e5429b99b7009de82ad532` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:56.283226 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0d7073-7518-429b-8a51-32730332ae7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3dee1ebf6e5429b99b7009de82ad532)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:44:56.285582 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0d7073-7518-429b-8a51-32730332ae7b admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:44:56.365542 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-17a1fe90-5a7f-4c8c-8c34-25f6ab72e0dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ff83d15abe94bab825c8b23b3e4a49f', 'request_id': 'req-17a1fe90-5a7f-4c8c-8c34-25f6ab72e0dd'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:56.371225 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-17a1fe90-5a7f-4c8c-8c34-25f6ab72e0dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ff83d15abe94bab825c8b23b3e4a49f', 'request_id': 'req-17a1fe90-5a7f-4c8c-8c34-25f6ab72e0dd'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:56.389770 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-fa0d7073-7518-429b-8a51-32730332ae7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3dee1ebf6e5429b99b7009de82ad532', 'request_id': 'req-fa0d7073-7518-429b-8a51-32730332ae7b'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:56.396218 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-fa0d7073-7518-429b-8a51-32730332ae7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3dee1ebf6e5429b99b7009de82ad532', 'request_id': 'req-fa0d7073-7518-429b-8a51-32730332ae7b'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:56.403577 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-fa0d7073-7518-429b-8a51-32730332ae7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3dee1ebf6e5429b99b7009de82ad532', 'request_id': 'req-fa0d7073-7518-429b-8a51-32730332ae7b'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:56.519541 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-17a1fe90-5a7f-4c8c-8c34-25f6ab72e0dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ff83d15abe94bab825c8b23b3e4a49f', 'request_id': 'req-17a1fe90-5a7f-4c8c-8c34-25f6ab72e0dd'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:56.531202 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-17a1fe90-5a7f-4c8c-8c34-25f6ab72e0dd admin admin] The token cache is being invalidate because project 8ff83d15abe94bab825c8b23b3e4a49f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:44:56.531502 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-17a1fe90-5a7f-4c8c-8c34-25f6ab72e0dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:56.532133 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-17a1fe90-5a7f-4c8c-8c34-25f6ab72e0dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:56.533830 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4145/8263] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:44:56 2022] DELETE /identity/v3/projects/8ff83d15abe94bab825c8b23b3e4a49f => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:44:56.537585 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a1fe90-5a7f-4c8c-8c34-25f6ab72e0dd admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:44:56.538860 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-17a1fe90-5a7f-4c8c-8c34-25f6ab72e0dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:44:56.583248 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-fa0d7073-7518-429b-8a51-32730332ae7b admin admin] The token cache is being invalidate because project f3dee1ebf6e5429b99b7009de82ad532 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:44:56.583574 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-fa0d7073-7518-429b-8a51-32730332ae7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:56.584358 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-fa0d7073-7518-429b-8a51-32730332ae7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:56.586300 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4119/8264] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:44:56 2022] DELETE /identity/v3/projects/f3dee1ebf6e5429b99b7009de82ad532 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:44:56.591080 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0d7073-7518-429b-8a51-32730332ae7b admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:44:56.592955 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-fa0d7073-7518-429b-8a51-32730332ae7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:44:56.628905 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a1fe90-5a7f-4c8c-8c34-25f6ab72e0dd admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:44:56.695858 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0d7073-7518-429b-8a51-32730332ae7b admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:44:56.711896 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e88653-aefd-44c4-a0e3-046fc2caa0fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:44:56.714168 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e88653-aefd-44c4-a0e3-046fc2caa0fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:56.715085 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e88653-aefd-44c4-a0e3-046fc2caa0fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:56.715561 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e88653-aefd-44c4-a0e3-046fc2caa0fc admin admin] PATH_INFO: `/v3/users/c1d83e261dc946ac8edb7f207b40605a` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:56.717100 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e88653-aefd-44c4-a0e3-046fc2caa0fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1d83e261dc946ac8edb7f207b40605a)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:44:56.718881 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a810e7e4-97cd-41b9-8867-9552db6a3e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:44:56.719991 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810e7e4-97cd-41b9-8867-9552db6a3e2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:56.720891 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810e7e4-97cd-41b9-8867-9552db6a3e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:56.721095 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e88653-aefd-44c4-a0e3-046fc2caa0fc admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:44:56.721593 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810e7e4-97cd-41b9-8867-9552db6a3e2f admin admin] PATH_INFO: `/v3/users/401f962f10ba42cb92a42758199e5866` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:56.723173 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a810e7e4-97cd-41b9-8867-9552db6a3e2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=401f962f10ba42cb92a42758199e5866)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:44:56.735373 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a810e7e4-97cd-41b9-8867-9552db6a3e2f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:44:56.982996 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c3e88653-aefd-44c4-a0e3-046fc2caa0fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1d83e261dc946ac8edb7f207b40605a'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:56.993299 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c3e88653-aefd-44c4-a0e3-046fc2caa0fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1d83e261dc946ac8edb7f207b40605a'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:56.993299 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c3e88653-aefd-44c4-a0e3-046fc2caa0fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1d83e261dc946ac8edb7f207b40605a'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:57.010551 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a810e7e4-97cd-41b9-8867-9552db6a3e2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '401f962f10ba42cb92a42758199e5866'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:57.031173 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a810e7e4-97cd-41b9-8867-9552db6a3e2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '401f962f10ba42cb92a42758199e5866'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:57.041846 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a810e7e4-97cd-41b9-8867-9552db6a3e2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '401f962f10ba42cb92a42758199e5866'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:57.068747 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c3e88653-aefd-44c4-a0e3-046fc2caa0fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1d83e261dc946ac8edb7f207b40605a'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:57.085062 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c3e88653-aefd-44c4-a0e3-046fc2caa0fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1d83e261dc946ac8edb7f207b40605a'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:57.105015 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4120/8265] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:44:56 2022] DELETE /identity/v3/users/c1d83e261dc946ac8edb7f207b40605a => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:44:57.131180 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a810e7e4-97cd-41b9-8867-9552db6a3e2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '401f962f10ba42cb92a42758199e5866'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:57.133817 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a810e7e4-97cd-41b9-8867-9552db6a3e2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '401f962f10ba42cb92a42758199e5866'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:57.139114 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4146/8266] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:44:56 2022] DELETE /identity/v3/users/401f962f10ba42cb92a42758199e5866 => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:44:57.556844 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e88653-aefd-44c4-a0e3-046fc2caa0fc admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:44:57.560615 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c3e88653-aefd-44c4-a0e3-046fc2caa0fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:44:57.664250 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e88653-aefd-44c4-a0e3-046fc2caa0fc admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:44:57.734646 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6097dd52-037f-4f97-85d8-320cd72820a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:44:57.735541 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097dd52-037f-4f97-85d8-320cd72820a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:57.736695 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097dd52-037f-4f97-85d8-320cd72820a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:57.737383 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097dd52-037f-4f97-85d8-320cd72820a8 admin admin] PATH_INFO: `/v3/projects/2f4a5f4c90b64e8e972be1f2bd39a365` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:57.738324 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6097dd52-037f-4f97-85d8-320cd72820a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f4a5f4c90b64e8e972be1f2bd39a365)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:44:57.740634 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6097dd52-037f-4f97-85d8-320cd72820a8 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:44:57.778714 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a810e7e4-97cd-41b9-8867-9552db6a3e2f admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:44:57.779895 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-a810e7e4-97cd-41b9-8867-9552db6a3e2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:44:57.796901 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a810e7e4-97cd-41b9-8867-9552db6a3e2f admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:44:57.803368 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b4e851-82f0-4e49-b668-0f873f66c35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:44:57.804737 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b4e851-82f0-4e49-b668-0f873f66c35d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:57.805178 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b4e851-82f0-4e49-b668-0f873f66c35d admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:57.805779 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b4e851-82f0-4e49-b668-0f873f66c35d admin admin] PATH_INFO: `/v3/projects/e65d9a259531497e868aa6b55559ccc3` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:57.807314 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b4e851-82f0-4e49-b668-0f873f66c35d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e65d9a259531497e868aa6b55559ccc3)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:44:57.810583 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b4e851-82f0-4e49-b668-0f873f66c35d admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:44:57.875067 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-6097dd52-037f-4f97-85d8-320cd72820a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f4a5f4c90b64e8e972be1f2bd39a365', 'request_id': 'req-6097dd52-037f-4f97-85d8-320cd72820a8'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:57.881398 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-6097dd52-037f-4f97-85d8-320cd72820a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f4a5f4c90b64e8e972be1f2bd39a365', 'request_id': 'req-6097dd52-037f-4f97-85d8-320cd72820a8'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:57.887803 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-6097dd52-037f-4f97-85d8-320cd72820a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f4a5f4c90b64e8e972be1f2bd39a365', 'request_id': 'req-6097dd52-037f-4f97-85d8-320cd72820a8'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:57.966291 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c1b4e851-82f0-4e49-b668-0f873f66c35d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e65d9a259531497e868aa6b55559ccc3', 'request_id': 'req-c1b4e851-82f0-4e49-b668-0f873f66c35d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:57.972447 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c1b4e851-82f0-4e49-b668-0f873f66c35d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e65d9a259531497e868aa6b55559ccc3', 'request_id': 'req-c1b4e851-82f0-4e49-b668-0f873f66c35d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:57.976607 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-6097dd52-037f-4f97-85d8-320cd72820a8 admin admin] The token cache is being invalidate because project 2f4a5f4c90b64e8e972be1f2bd39a365 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:44:57.976852 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-6097dd52-037f-4f97-85d8-320cd72820a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:57.977544 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-6097dd52-037f-4f97-85d8-320cd72820a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:57.979123 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4121/8267] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:44:57 2022] DELETE /identity/v3/projects/2f4a5f4c90b64e8e972be1f2bd39a365 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:44:57.984150 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09849bd-fef2-4e24-8c15-e3756a39055d None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:57.984442 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09849bd-fef2-4e24-8c15-e3756a39055d None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:57.984721 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09849bd-fef2-4e24-8c15-e3756a39055d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:58.004090 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-e09849bd-fef2-4e24-8c15-e3756a39055d None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:44:58.005311 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e09849bd-fef2-4e24-8c15-e3756a39055d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:44:58.056923 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c1b4e851-82f0-4e49-b668-0f873f66c35d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e65d9a259531497e868aa6b55559ccc3', 'request_id': 'req-c1b4e851-82f0-4e49-b668-0f873f66c35d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:58.071071 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4122/8268] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:44:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:44:58.079306 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a4ff3-ee2b-4f10-803e-1fd688d63748 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:58.081314 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a4ff3-ee2b-4f10-803e-1fd688d63748 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:58.081768 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a4ff3-ee2b-4f10-803e-1fd688d63748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:58.085957 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c1b4e851-82f0-4e49-b668-0f873f66c35d admin admin] The token cache is being invalidate because project e65d9a259531497e868aa6b55559ccc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:44:58.085957 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c1b4e851-82f0-4e49-b668-0f873f66c35d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:58.086752 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c1b4e851-82f0-4e49-b668-0f873f66c35d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:44:58.100720 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4147/8269] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:44:57 2022] DELETE /identity/v3/projects/e65d9a259531497e868aa6b55559ccc3 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:44:58.105965 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aec0ea-2174-4e12-99ac-d39eeef4dbe8 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:58.106394 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aec0ea-2174-4e12-99ac-d39eeef4dbe8 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:58.106954 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aec0ea-2174-4e12-99ac-d39eeef4dbe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:58.117418 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-5e3a4ff3-ee2b-4f10-803e-1fd688d63748 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:44:58.119228 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-5e3a4ff3-ee2b-4f10-803e-1fd688d63748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:44:58.130617 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4123/8270] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:44:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:44:58.135269 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3a4ff3-ee2b-4f10-803e-1fd688d63748 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:44:58.153223 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-71aec0ea-2174-4e12-99ac-d39eeef4dbe8 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:44:58.156672 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-71aec0ea-2174-4e12-99ac-d39eeef4dbe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:44:58.159899 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3a4ff3-ee2b-4f10-803e-1fd688d63748 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:44:58.175932 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6b3b60-b8e2-4d16-aef0-47eaa2340ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:44:58.178900 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4148/8271] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:44:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:44:58.180006 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b3b60-b8e2-4d16-aef0-47eaa2340ada admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:58.180504 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b3b60-b8e2-4d16-aef0-47eaa2340ada admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:58.180973 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b3b60-b8e2-4d16-aef0-47eaa2340ada admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:58.181938 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6b3b60-b8e2-4d16-aef0-47eaa2340ada admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:44:58.182483 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6b3b60-b8e2-4d16-aef0-47eaa2340ada admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:44:58.188209 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6b3b60-b8e2-4d16-aef0-47eaa2340ada admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:44:58.190667 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c686f66-5724-462f-bc47-17ea7e9781db None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:58.190964 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c686f66-5724-462f-bc47-17ea7e9781db None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:58.191241 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c686f66-5724-462f-bc47-17ea7e9781db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:58.219469 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4124/8272] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:44:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:44:58.219974 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-8c686f66-5724-462f-bc47-17ea7e9781db None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:44:58.221575 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-8c686f66-5724-462f-bc47-17ea7e9781db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:44:58.223960 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6b3b60-b8e2-4d16-aef0-47eaa2340ada admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:44:58.234497 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4149/8273] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:44:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:44:58.236576 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c686f66-5724-462f-bc47-17ea7e9781db None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:44:58.241057 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6b3b60-b8e2-4d16-aef0-47eaa2340ada admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:44:58.252316 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c686f66-5724-462f-bc47-17ea7e9781db None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:44:58.254686 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de47c066-1c29-4722-a6b5-5dc03f9ff0fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:44:58.255660 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de47c066-1c29-4722-a6b5-5dc03f9ff0fc admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:58.256190 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de47c066-1c29-4722-a6b5-5dc03f9ff0fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:58.256530 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de47c066-1c29-4722-a6b5-5dc03f9ff0fc admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:58.257284 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e72ae9-32a1-4222-8e6e-0bc6f95b164d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:44:58.257437 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de47c066-1c29-4722-a6b5-5dc03f9ff0fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:44:58.258522 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e72ae9-32a1-4222-8e6e-0bc6f95b164d admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:58.258522 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e72ae9-32a1-4222-8e6e-0bc6f95b164d admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:58.258522 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e72ae9-32a1-4222-8e6e-0bc6f95b164d admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:58.259243 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e72ae9-32a1-4222-8e6e-0bc6f95b164d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:44:58.259588 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e72ae9-32a1-4222-8e6e-0bc6f95b164d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:44:58.260013 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de47c066-1c29-4722-a6b5-5dc03f9ff0fc admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:44:58.261387 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e72ae9-32a1-4222-8e6e-0bc6f95b164d admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:44:58.285663 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4150/8274] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:44:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:44:58.290723 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e72ae9-32a1-4222-8e6e-0bc6f95b164d admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:44:58.311263 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e72ae9-32a1-4222-8e6e-0bc6f95b164d admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:44:58.314926 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc446a-b510-4b68-ba2f-18969f059668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:44:58.315754 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc446a-b510-4b68-ba2f-18969f059668 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:58.316191 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc446a-b510-4b68-ba2f-18969f059668 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:58.316540 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc446a-b510-4b68-ba2f-18969f059668 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:58.317358 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fc446a-b510-4b68-ba2f-18969f059668 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:44:58.319358 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fc446a-b510-4b68-ba2f-18969f059668 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:44:58.400042 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4125/8275] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:44:58 2022] POST /identity/v3/projects => generated 371 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:44:58.401000 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de47c066-1c29-4722-a6b5-5dc03f9ff0fc admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:44:58.433399 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4151/8276] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:44:58 2022] POST /identity/v3/projects => generated 357 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:44:58.437321 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc446a-b510-4b68-ba2f-18969f059668 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:44:58.483900 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de47c066-1c29-4722-a6b5-5dc03f9ff0fc admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:44:58.527841 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc446a-b510-4b68-ba2f-18969f059668 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:44:58.536166 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba62fed-214c-43b0-8ed1-39d0645718d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:44:58.538714 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba62fed-214c-43b0-8ed1-39d0645718d3 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:58.539403 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba62fed-214c-43b0-8ed1-39d0645718d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:58.539835 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba62fed-214c-43b0-8ed1-39d0645718d3 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:58.541823 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba62fed-214c-43b0-8ed1-39d0645718d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:44:58.544034 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba62fed-214c-43b0-8ed1-39d0645718d3 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:44:58.568327 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e64d08-0559-47f9-af35-6327c8746570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:44:58.570201 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e64d08-0559-47f9-af35-6327c8746570 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:58.570201 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e64d08-0559-47f9-af35-6327c8746570 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:58.570201 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e64d08-0559-47f9-af35-6327c8746570 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:58.570488 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e64d08-0559-47f9-af35-6327c8746570 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:44:58.572242 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e64d08-0559-47f9-af35-6327c8746570 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:44:58.671186 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4152/8277] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:44:58 2022] POST /identity/v3/users => generated 279 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:44:58.674469 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba62fed-214c-43b0-8ed1-39d0645718d3 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:44:58.688656 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba62fed-214c-43b0-8ed1-39d0645718d3 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:44:58.695099 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b55fe9-a1cd-4845-91cf-245c81c12a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:44:58.695796 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b55fe9-a1cd-4845-91cf-245c81c12a1c admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:58.696082 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b55fe9-a1cd-4845-91cf-245c81c12a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:58.696412 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b55fe9-a1cd-4845-91cf-245c81c12a1c admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:58.697166 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b55fe9-a1cd-4845-91cf-245c81c12a1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:44:58.698767 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b55fe9-a1cd-4845-91cf-245c81c12a1c admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:44:58.714827 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4153/8278] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:44:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:44:58.715737 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b55fe9-a1cd-4845-91cf-245c81c12a1c admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:44:58.718557 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4126/8279] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:44:58 2022] POST /identity/v3/users => generated 286 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:44:58.722794 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e64d08-0559-47f9-af35-6327c8746570 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:44:58.731137 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b55fe9-a1cd-4845-91cf-245c81c12a1c admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:44:58.736090 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f567f1e-08c9-42b9-8af7-2e0c92dde4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:44:58.737086 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f567f1e-08c9-42b9-8af7-2e0c92dde4d1 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:58.737497 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f567f1e-08c9-42b9-8af7-2e0c92dde4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:58.737783 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f567f1e-08c9-42b9-8af7-2e0c92dde4d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:58.738323 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e64d08-0559-47f9-af35-6327c8746570 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:44:58.738686 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f567f1e-08c9-42b9-8af7-2e0c92dde4d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:44:58.741427 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f567f1e-08c9-42b9-8af7-2e0c92dde4d1 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:44:58.748966 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702fe425-0ea9-46f0-b439-135e338f8f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:44:58.749963 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702fe425-0ea9-46f0-b439-135e338f8f02 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:58.751007 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702fe425-0ea9-46f0-b439-135e338f8f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:58.752659 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702fe425-0ea9-46f0-b439-135e338f8f02 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:58.753617 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702fe425-0ea9-46f0-b439-135e338f8f02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:44:58.757946 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4154/8280] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:44:58 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:44:58.762775 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702fe425-0ea9-46f0-b439-135e338f8f02 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:44:58.763400 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f567f1e-08c9-42b9-8af7-2e0c92dde4d1 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:44:58.773353 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4127/8281] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:44:58 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:44:58.776298 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f567f1e-08c9-42b9-8af7-2e0c92dde4d1 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:44:58.777088 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702fe425-0ea9-46f0-b439-135e338f8f02 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:44:58.782312 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f113262b-b65b-47c5-bad3-395ec5c32414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:44:58.784414 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f113262b-b65b-47c5-bad3-395ec5c32414 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:58.785186 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f113262b-b65b-47c5-bad3-395ec5c32414 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:58.785657 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f113262b-b65b-47c5-bad3-395ec5c32414 admin admin] PATH_INFO: `/v3/projects/70d62c44e62f4f908188af21b5653cc7/users/c18d326a4dd84ac3aa1cabb4ea37a644/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:58.787059 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702fe425-0ea9-46f0-b439-135e338f8f02 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:44:58.792198 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d882ded-d8d8-4c28-9997-09301c70801f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:44:58.792863 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d882ded-d8d8-4c28-9997-09301c70801f admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:58.793147 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d882ded-d8d8-4c28-9997-09301c70801f admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:58.793567 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d882ded-d8d8-4c28-9997-09301c70801f admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:58.794291 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d882ded-d8d8-4c28-9997-09301c70801f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:44:58.795965 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d882ded-d8d8-4c28-9997-09301c70801f admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:44:58.805344 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f113262b-b65b-47c5-bad3-395ec5c32414 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70d62c44e62f4f908188af21b5653cc7, user_id=c18d326a4dd84ac3aa1cabb4ea37a644, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:44:58.807792 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4128/8282] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:44:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:44:58.808382 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f113262b-b65b-47c5-bad3-395ec5c32414 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:44:58.811911 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d882ded-d8d8-4c28-9997-09301c70801f admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:44:58.822160 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d882ded-d8d8-4c28-9997-09301c70801f admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:44:58.826900 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de94dd4f-06be-4042-a0ed-ad6e70c730bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:44:58.827830 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94dd4f-06be-4042-a0ed-ad6e70c730bc admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:58.828114 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94dd4f-06be-4042-a0ed-ad6e70c730bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:58.828388 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94dd4f-06be-4042-a0ed-ad6e70c730bc admin admin] PATH_INFO: `/v3/projects/5ea54abe27dd44beb76e2876a4cb53fd/users/8c023bd546014ceda5e43ba1c93ca7b1/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:58.843707 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de94dd4f-06be-4042-a0ed-ad6e70c730bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ea54abe27dd44beb76e2876a4cb53fd, user_id=8c023bd546014ceda5e43ba1c93ca7b1, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:44:58.847006 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de94dd4f-06be-4042-a0ed-ad6e70c730bc admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:44:58.858493 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4155/8283] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:44:58 2022] PUT /identity/v3/projects/70d62c44e62f4f908188af21b5653cc7/users/c18d326a4dd84ac3aa1cabb4ea37a644/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:44:58.869017 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a94d26-cab4-4f18-961a-ac837800e718 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:58.869299 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a94d26-cab4-4f18-961a-ac837800e718 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:58.874535 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a94d26-cab4-4f18-961a-ac837800e718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:58.896331 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-a4a94d26-cab4-4f18-961a-ac837800e718 None None] MFA Rules not processed for user `c18d326a4dd84ac3aa1cabb4ea37a644`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:44:58.897972 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-a4a94d26-cab4-4f18-961a-ac837800e718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:44:58.954143 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4129/8284] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:44:58 2022] PUT /identity/v3/projects/5ea54abe27dd44beb76e2876a4cb53fd/users/8c023bd546014ceda5e43ba1c93ca7b1/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:44:58.956297 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e48c1-e10a-460e-88e2-a325bc611bca None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:58.956665 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e48c1-e10a-460e-88e2-a325bc611bca None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:58.957185 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e48c1-e10a-460e-88e2-a325bc611bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:59.013257 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-278e48c1-e10a-460e-88e2-a325bc611bca None None] MFA Rules not processed for user `8c023bd546014ceda5e43ba1c93ca7b1`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:44:59.015397 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-278e48c1-e10a-460e-88e2-a325bc611bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:44:59.019222 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4156/8285] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:44:58 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:44:59.025657 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a94d26-cab4-4f18-961a-ac837800e718 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:44:59.140410 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4130/8286] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:44:58 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:44:59.140835 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a94d26-cab4-4f18-961a-ac837800e718 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:44:59.167557 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278e48c1-e10a-460e-88e2-a325bc611bca None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:44:59.169061 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-278e48c1-e10a-460e-88e2-a325bc611bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:44:59.231068 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbb41f1-03f2-4b45-8ee5-0a0d8dc03fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:44:59.231924 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb41f1-03f2-4b45-8ee5-0a0d8dc03fbf admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:59.232209 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb41f1-03f2-4b45-8ee5-0a0d8dc03fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:59.232481 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb41f1-03f2-4b45-8ee5-0a0d8dc03fbf admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:59.233172 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbb41f1-03f2-4b45-8ee5-0a0d8dc03fbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:44:59.235833 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbb41f1-03f2-4b45-8ee5-0a0d8dc03fbf admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:44:59.295326 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278e48c1-e10a-460e-88e2-a325bc611bca None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:44:59.300842 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fd4347-55e1-4a46-8d63-f82bf6dd0f90 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b5cb86f190f4fcfb06d66cb8f14643f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:44:59.301527 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd4347-55e1-4a46-8d63-f82bf6dd0f90 service glance] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:59.301812 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd4347-55e1-4a46-8d63-f82bf6dd0f90 service glance] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:59.302242 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd4347-55e1-4a46-8d63-f82bf6dd0f90 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:59.315859 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fd4347-55e1-4a46-8d63-f82bf6dd0f90 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:44:59.317405 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fd4347-55e1-4a46-8d63-f82bf6dd0f90 service glance] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:44:59.332454 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4131/8287] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:44:59 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:44:59.358609 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4157/8288] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:44:59 2022] POST /identity/v3/projects => generated 357 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:44:59.364549 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fd4347-55e1-4a46-8d63-f82bf6dd0f90 service glance] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:44:59.378733 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fd4347-55e1-4a46-8d63-f82bf6dd0f90 service glance] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:44:59.461461 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed725061-57d5-4406-a0ee-2ca25032e4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:44:59.462462 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed725061-57d5-4406-a0ee-2ca25032e4a0 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:59.462846 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed725061-57d5-4406-a0ee-2ca25032e4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:59.463286 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed725061-57d5-4406-a0ee-2ca25032e4a0 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:59.464532 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed725061-57d5-4406-a0ee-2ca25032e4a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:44:59.467094 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed725061-57d5-4406-a0ee-2ca25032e4a0 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:44:59.556070 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4132/8289] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:44:59 2022] POST /identity/v3/users => generated 285 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:44:59.560421 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbb41f1-03f2-4b45-8ee5-0a0d8dc03fbf admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:44:59.576298 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbb41f1-03f2-4b45-8ee5-0a0d8dc03fbf admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:44:59.586989 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f59ce39-6c3d-4539-a23f-123640399136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:44:59.588332 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59ce39-6c3d-4539-a23f-123640399136 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:59.589402 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59ce39-6c3d-4539-a23f-123640399136 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:59.589643 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59ce39-6c3d-4539-a23f-123640399136 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:59.590748 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f59ce39-6c3d-4539-a23f-123640399136 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:44:59.592420 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f59ce39-6c3d-4539-a23f-123640399136 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:44:59.610387 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4158/8290] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:44:59 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:44:59.615599 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed725061-57d5-4406-a0ee-2ca25032e4a0 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:44:59.627526 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed725061-57d5-4406-a0ee-2ca25032e4a0 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:44:59.638315 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4b43d6-d5fa-41f7-8320-45bd7a876f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:44:59.639613 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b43d6-d5fa-41f7-8320-45bd7a876f8e admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:59.642376 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b43d6-d5fa-41f7-8320-45bd7a876f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:59.642376 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b43d6-d5fa-41f7-8320-45bd7a876f8e admin admin] PATH_INFO: `/v3/projects/b371f62e1925484dbf9f3baf943aefdd/users/49bd9db298e24a7eb351f29a646d6713/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:59.662370 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4b43d6-d5fa-41f7-8320-45bd7a876f8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b371f62e1925484dbf9f3baf943aefdd, user_id=49bd9db298e24a7eb351f29a646d6713, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:44:59.665736 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4b43d6-d5fa-41f7-8320-45bd7a876f8e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:44:59.787027 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4133/8291] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:44:59 2022] PUT /identity/v3/projects/b371f62e1925484dbf9f3baf943aefdd/users/49bd9db298e24a7eb351f29a646d6713/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:44:59.797735 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f59ce39-6c3d-4539-a23f-123640399136 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:44:59.802430 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f59ce39-6c3d-4539-a23f-123640399136 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:44:59.862439 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f8470a-a00e-48c7-a3e5-2a5741225385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:44:59.863134 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8470a-a00e-48c7-a3e5-2a5741225385 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:59.863413 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8470a-a00e-48c7-a3e5-2a5741225385 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:59.863726 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8470a-a00e-48c7-a3e5-2a5741225385 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:59.864436 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f8470a-a00e-48c7-a3e5-2a5741225385 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:44:59.866042 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f8470a-a00e-48c7-a3e5-2a5741225385 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:44:59.875926 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4159/8292] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:44:59 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:44:59.886545 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4b43d6-d5fa-41f7-8320-45bd7a876f8e admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:44:59.898060 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4b43d6-d5fa-41f7-8320-45bd7a876f8e admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:44:59.903444 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf54e89-ae4b-4204-9897-cf20264d8577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:44:59.904360 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf54e89-ae4b-4204-9897-cf20264d8577 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:59.906797 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf54e89-ae4b-4204-9897-cf20264d8577 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:59.906797 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf54e89-ae4b-4204-9897-cf20264d8577 admin admin] PATH_INFO: `/v3/projects/b371f62e1925484dbf9f3baf943aefdd/users/49bd9db298e24a7eb351f29a646d6713/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:59.907024 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf54e89-ae4b-4204-9897-cf20264d8577 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b371f62e1925484dbf9f3baf943aefdd, user_id=49bd9db298e24a7eb351f29a646d6713, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:44:59.910283 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf54e89-ae4b-4204-9897-cf20264d8577 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:44:59.920749 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4134/8293] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:44:59 2022] PUT /identity/v3/projects/b371f62e1925484dbf9f3baf943aefdd/users/49bd9db298e24a7eb351f29a646d6713/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:44:59.932637 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0963646c-9849-4d54-9ed9-c161b6108a00 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:44:59.932930 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0963646c-9849-4d54-9ed9-c161b6108a00 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:44:59.933218 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0963646c-9849-4d54-9ed9-c161b6108a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:44:59.960245 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-0963646c-9849-4d54-9ed9-c161b6108a00 None None] MFA Rules not processed for user `49bd9db298e24a7eb351f29a646d6713`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:44:59.961396 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-0963646c-9849-4d54-9ed9-c161b6108a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:45:00.042240 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4160/8294] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:44:59 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:45:00.055358 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf54e89-ae4b-4204-9897-cf20264d8577 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:45:00.057147 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-dbf54e89-ae4b-4204-9897-cf20264d8577 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:45:00.125736 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf54e89-ae4b-4204-9897-cf20264d8577 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:45:00.130643 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9481bb77-1704-4069-80f8-b69e29006e2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198271d1c0d44cb58bace41a65f4b94c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:45:00.131309 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481bb77-1704-4069-80f8-b69e29006e2f service cinder] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:45:00.131636 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481bb77-1704-4069-80f8-b69e29006e2f service cinder] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:45:00.131917 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481bb77-1704-4069-80f8-b69e29006e2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:45:00.141567 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9481bb77-1704-4069-80f8-b69e29006e2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:45:00.143400 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9481bb77-1704-4069-80f8-b69e29006e2f service cinder] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:45:00.156749 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4135/8295] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:45:00 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:45:00.166252 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0963646c-9849-4d54-9ed9-c161b6108a00 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:45:00.168525 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-0963646c-9849-4d54-9ed9-c161b6108a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:45:00.237405 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0963646c-9849-4d54-9ed9-c161b6108a00 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:45:00.241992 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d0cfd8-3bac-422b-9af9-cf3d4a3384e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:45:00.242856 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d0cfd8-3bac-422b-9af9-cf3d4a3384e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:45:00.243137 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d0cfd8-3bac-422b-9af9-cf3d4a3384e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:45:00.243411 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d0cfd8-3bac-422b-9af9-cf3d4a3384e1 admin admin] PATH_INFO: `/v3/users/139d42d8881949b3befd8e4412c64800` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:45:00.244633 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d0cfd8-3bac-422b-9af9-cf3d4a3384e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=139d42d8881949b3befd8e4412c64800)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:45:00.246558 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d0cfd8-3bac-422b-9af9-cf3d4a3384e1 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:45:00.379123 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9481bb77-1704-4069-80f8-b69e29006e2f service cinder] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:45:00.380861 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-9481bb77-1704-4069-80f8-b69e29006e2f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:45:00.396593 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9481bb77-1704-4069-80f8-b69e29006e2f service cinder] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:45:00.400684 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abd211c-52d9-4128-b153-f4ead8942c5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198271d1c0d44cb58bace41a65f4b94c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:45:00.401328 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abd211c-52d9-4128-b153-f4ead8942c5a service cinder] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:45:00.401606 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abd211c-52d9-4128-b153-f4ead8942c5a service cinder] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:45:00.401883 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abd211c-52d9-4128-b153-f4ead8942c5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:45:00.427185 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d6d0cfd8-3bac-422b-9af9-cf3d4a3384e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '139d42d8881949b3befd8e4412c64800'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:45:00.440048 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d6d0cfd8-3bac-422b-9af9-cf3d4a3384e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '139d42d8881949b3befd8e4412c64800'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:45:00.446907 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d6d0cfd8-3bac-422b-9af9-cf3d4a3384e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '139d42d8881949b3befd8e4412c64800'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:45:00.464088 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abd211c-52d9-4128-b153-f4ead8942c5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:45:00.465533 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abd211c-52d9-4128-b153-f4ead8942c5a service cinder] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:45:00.474759 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4136/8296] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:45:00 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:45:00.503358 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d6d0cfd8-3bac-422b-9af9-cf3d4a3384e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '139d42d8881949b3befd8e4412c64800'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:45:00.504121 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-d6d0cfd8-3bac-422b-9af9-cf3d4a3384e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '139d42d8881949b3befd8e4412c64800'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:45:00.518875 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4161/8297] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:45:00 2022] DELETE /identity/v3/users/139d42d8881949b3befd8e4412c64800 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:45:00.523857 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b5da88-7280-4b29-8d91-1f054e943716 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:45:00.524148 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b5da88-7280-4b29-8d91-1f054e943716 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:45:00.524427 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b5da88-7280-4b29-8d91-1f054e943716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:45:00.541649 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-f5b5da88-7280-4b29-8d91-1f054e943716 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:45:00.548862 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-f5b5da88-7280-4b29-8d91-1f054e943716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:45:00.601252 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4137/8298] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:45:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:45:00.611989 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d0cfd8-3bac-422b-9af9-cf3d4a3384e1 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:45:00.613826 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d6d0cfd8-3bac-422b-9af9-cf3d4a3384e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:45:00.675121 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d0cfd8-3bac-422b-9af9-cf3d4a3384e1 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:45:00.686845 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b5ac6-d444-4348-aa6c-3a774497f144 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:45:00.686845 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b5ac6-d444-4348-aa6c-3a774497f144 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:45:00.686845 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b5ac6-d444-4348-aa6c-3a774497f144 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:45:00.686845 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b5ac6-d444-4348-aa6c-3a774497f144 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:45:00.690989 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635b5ac6-d444-4348-aa6c-3a774497f144 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:45:00.692549 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635b5ac6-d444-4348-aa6c-3a774497f144 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:45:00.703057 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4162/8299] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:45:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:45:01.013740 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b5da88-7280-4b29-8d91-1f054e943716 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:45:01.015199 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-f5b5da88-7280-4b29-8d91-1f054e943716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:45:01.032155 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b5da88-7280-4b29-8d91-1f054e943716 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:45:01.039106 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e384970-f741-4aba-aa76-9259a840f042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:45:01.040440 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e384970-f741-4aba-aa76-9259a840f042 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:45:01.040709 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e384970-f741-4aba-aa76-9259a840f042 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:45:01.041061 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e384970-f741-4aba-aa76-9259a840f042 admin admin] PATH_INFO: `/v3/projects/72ef6fbeb65948a3b9cbd45229a26bec` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:45:01.042540 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e384970-f741-4aba-aa76-9259a840f042 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72ef6fbeb65948a3b9cbd45229a26bec)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:45:01.044831 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e384970-f741-4aba-aa76-9259a840f042 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:45:01.149785 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-1e384970-f741-4aba-aa76-9259a840f042 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72ef6fbeb65948a3b9cbd45229a26bec', 'request_id': 'req-1e384970-f741-4aba-aa76-9259a840f042'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:45:01.155361 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-1e384970-f741-4aba-aa76-9259a840f042 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72ef6fbeb65948a3b9cbd45229a26bec', 'request_id': 'req-1e384970-f741-4aba-aa76-9259a840f042'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:45:01.162903 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-1e384970-f741-4aba-aa76-9259a840f042 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72ef6fbeb65948a3b9cbd45229a26bec', 'request_id': 'req-1e384970-f741-4aba-aa76-9259a840f042'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:45:01.279425 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-1e384970-f741-4aba-aa76-9259a840f042 admin admin] The token cache is being invalidate because project 72ef6fbeb65948a3b9cbd45229a26bec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:45:01.279670 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-1e384970-f741-4aba-aa76-9259a840f042 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:45:01.280275 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-1e384970-f741-4aba-aa76-9259a840f042 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:45:01.281830 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4138/8300] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:45:01 2022] DELETE /identity/v3/projects/72ef6fbeb65948a3b9cbd45229a26bec => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:45:01.286557 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b5ac6-d444-4348-aa6c-3a774497f144 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:45:01.296335 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b5ac6-d444-4348-aa6c-3a774497f144 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:45:01.353609 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730fe75f-2f5e-489f-be89-a0897db6212b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:45:01.354477 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730fe75f-2f5e-489f-be89-a0897db6212b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:45:01.354757 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730fe75f-2f5e-489f-be89-a0897db6212b admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:45:01.355060 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730fe75f-2f5e-489f-be89-a0897db6212b admin admin] PATH_INFO: `/v3/users/79a1d6cbdce3493db1e445880d32a1a2` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:45:01.356297 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730fe75f-2f5e-489f-be89-a0897db6212b admin admin] RBAC: Authorizing `identity:delete_user(user_id=79a1d6cbdce3493db1e445880d32a1a2)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:45:01.358255 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730fe75f-2f5e-489f-be89-a0897db6212b admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:45:01.510048 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-730fe75f-2f5e-489f-be89-a0897db6212b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79a1d6cbdce3493db1e445880d32a1a2'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:45:01.522983 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-730fe75f-2f5e-489f-be89-a0897db6212b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79a1d6cbdce3493db1e445880d32a1a2'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:45:01.529728 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-730fe75f-2f5e-489f-be89-a0897db6212b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79a1d6cbdce3493db1e445880d32a1a2'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:45:01.582054 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-730fe75f-2f5e-489f-be89-a0897db6212b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79a1d6cbdce3493db1e445880d32a1a2'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:45:01.582719 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-730fe75f-2f5e-489f-be89-a0897db6212b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79a1d6cbdce3493db1e445880d32a1a2'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:45:01.589073 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4163/8301] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:45:01 2022] DELETE /identity/v3/users/79a1d6cbdce3493db1e445880d32a1a2 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:45:02.000826 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e384970-f741-4aba-aa76-9259a840f042 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:45:02.002421 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-1e384970-f741-4aba-aa76-9259a840f042 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:45:02.024942 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e384970-f741-4aba-aa76-9259a840f042 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:45:02.087554 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c10476-0790-4807-b7c7-73fdc5c8f61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:45:02.088414 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c10476-0790-4807-b7c7-73fdc5c8f61d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:45:02.088720 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c10476-0790-4807-b7c7-73fdc5c8f61d admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:45:02.089111 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c10476-0790-4807-b7c7-73fdc5c8f61d admin admin] PATH_INFO: `/v3/projects/4181a82dd2f947b2b018a9400c8a8703` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:45:02.090205 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c10476-0790-4807-b7c7-73fdc5c8f61d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4181a82dd2f947b2b018a9400c8a8703)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:45:02.092230 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c10476-0790-4807-b7c7-73fdc5c8f61d admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:45:02.221784 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e5c10476-0790-4807-b7c7-73fdc5c8f61d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4181a82dd2f947b2b018a9400c8a8703', 'request_id': 'req-e5c10476-0790-4807-b7c7-73fdc5c8f61d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:45:02.227143 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e5c10476-0790-4807-b7c7-73fdc5c8f61d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4181a82dd2f947b2b018a9400c8a8703', 'request_id': 'req-e5c10476-0790-4807-b7c7-73fdc5c8f61d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:45:02.233214 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e5c10476-0790-4807-b7c7-73fdc5c8f61d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4181a82dd2f947b2b018a9400c8a8703', 'request_id': 'req-e5c10476-0790-4807-b7c7-73fdc5c8f61d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:45:02.312602 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e5c10476-0790-4807-b7c7-73fdc5c8f61d admin admin] The token cache is being invalidate because project 4181a82dd2f947b2b018a9400c8a8703 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:45:02.312819 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e5c10476-0790-4807-b7c7-73fdc5c8f61d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:45:02.313460 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-e5c10476-0790-4807-b7c7-73fdc5c8f61d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:45:02.315779 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4139/8302] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:45:01 2022] DELETE /identity/v3/projects/4181a82dd2f947b2b018a9400c8a8703 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:45:02.319752 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730fe75f-2f5e-489f-be89-a0897db6212b admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:45:02.321168 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-730fe75f-2f5e-489f-be89-a0897db6212b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:45:02.334475 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730fe75f-2f5e-489f-be89-a0897db6212b admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:45:02.391500 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2385bc93-141c-4e36-b641-a854da571d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:45:02.393185 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385bc93-141c-4e36-b641-a854da571d9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:45:02.393464 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385bc93-141c-4e36-b641-a854da571d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:45:02.393735 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385bc93-141c-4e36-b641-a854da571d9b admin admin] PATH_INFO: `/v3/users/88238757b9474640ab3bffd8a858572e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:45:02.394933 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2385bc93-141c-4e36-b641-a854da571d9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=88238757b9474640ab3bffd8a858572e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:45:02.396888 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2385bc93-141c-4e36-b641-a854da571d9b admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:45:02.543715 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2385bc93-141c-4e36-b641-a854da571d9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88238757b9474640ab3bffd8a858572e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:45:02.555588 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2385bc93-141c-4e36-b641-a854da571d9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88238757b9474640ab3bffd8a858572e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:45:02.562729 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2385bc93-141c-4e36-b641-a854da571d9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88238757b9474640ab3bffd8a858572e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:45:02.628430 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2385bc93-141c-4e36-b641-a854da571d9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88238757b9474640ab3bffd8a858572e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:45:02.629098 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2385bc93-141c-4e36-b641-a854da571d9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88238757b9474640ab3bffd8a858572e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:45:02.635344 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4164/8303] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:45:02 2022] DELETE /identity/v3/users/88238757b9474640ab3bffd8a858572e => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:45:02.858372 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c10476-0790-4807-b7c7-73fdc5c8f61d admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:45:02.859875 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e5c10476-0790-4807-b7c7-73fdc5c8f61d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:45:02.878617 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c10476-0790-4807-b7c7-73fdc5c8f61d admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:45:02.937257 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785c7a79-9722-41bf-8d9d-aba0ac840b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:45:02.938126 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c7a79-9722-41bf-8d9d-aba0ac840b15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:45:02.938413 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c7a79-9722-41bf-8d9d-aba0ac840b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:45:02.939213 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c7a79-9722-41bf-8d9d-aba0ac840b15 admin admin] PATH_INFO: `/v3/projects/1f84eb93054a44f0a3caf821474491fa` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:45:02.940599 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785c7a79-9722-41bf-8d9d-aba0ac840b15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f84eb93054a44f0a3caf821474491fa)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:45:02.942530 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785c7a79-9722-41bf-8d9d-aba0ac840b15 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:45:03.045499 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-785c7a79-9722-41bf-8d9d-aba0ac840b15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f84eb93054a44f0a3caf821474491fa', 'request_id': 'req-785c7a79-9722-41bf-8d9d-aba0ac840b15'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:45:03.051960 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-785c7a79-9722-41bf-8d9d-aba0ac840b15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f84eb93054a44f0a3caf821474491fa', 'request_id': 'req-785c7a79-9722-41bf-8d9d-aba0ac840b15'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:45:03.059388 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-785c7a79-9722-41bf-8d9d-aba0ac840b15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f84eb93054a44f0a3caf821474491fa', 'request_id': 'req-785c7a79-9722-41bf-8d9d-aba0ac840b15'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:45:03.118820 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-785c7a79-9722-41bf-8d9d-aba0ac840b15 admin admin] The token cache is being invalidate because project 1f84eb93054a44f0a3caf821474491fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:45:03.119043 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-785c7a79-9722-41bf-8d9d-aba0ac840b15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:45:03.119692 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-785c7a79-9722-41bf-8d9d-aba0ac840b15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:45:03.121236 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4140/8304] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:45:02 2022] DELETE /identity/v3/projects/1f84eb93054a44f0a3caf821474491fa => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:45:03.126394 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec07d84-3c6b-49d6-ba4f-e1ed5ad9a2bd None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:45:03.126685 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec07d84-3c6b-49d6-ba4f-e1ed5ad9a2bd None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:45:03.126964 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec07d84-3c6b-49d6-ba4f-e1ed5ad9a2bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:45:03.145081 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-8ec07d84-3c6b-49d6-ba4f-e1ed5ad9a2bd None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:45:03.146283 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-8ec07d84-3c6b-49d6-ba4f-e1ed5ad9a2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:45:03.207273 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4165/8305] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:45:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:45:03.215528 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00401764-0a35-4a98-a9ae-36bdd6197bcc None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:45:03.215819 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00401764-0a35-4a98-a9ae-36bdd6197bcc None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:45:03.216098 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00401764-0a35-4a98-a9ae-36bdd6197bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:45:03.236425 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-00401764-0a35-4a98-a9ae-36bdd6197bcc None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:45:03.237602 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-00401764-0a35-4a98-a9ae-36bdd6197bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:45:03.245384 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4141/8306] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:45:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:45:03.249649 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec07d84-3c6b-49d6-ba4f-e1ed5ad9a2bd None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:45:03.260009 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec07d84-3c6b-49d6-ba4f-e1ed5ad9a2bd None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:45:03.264628 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53cc81c-1b83-4d66-a3c6-91b8e5e28e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:45:03.265335 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53cc81c-1b83-4d66-a3c6-91b8e5e28e9d admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:45:03.265620 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53cc81c-1b83-4d66-a3c6-91b8e5e28e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:45:03.265896 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53cc81c-1b83-4d66-a3c6-91b8e5e28e9d admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:45:03.266611 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53cc81c-1b83-4d66-a3c6-91b8e5e28e9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:45:03.266944 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53cc81c-1b83-4d66-a3c6-91b8e5e28e9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:45:03.268565 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53cc81c-1b83-4d66-a3c6-91b8e5e28e9d admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:45:03.280536 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4166/8307] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:45:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:45:03.285677 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00401764-0a35-4a98-a9ae-36bdd6197bcc None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:45:03.294732 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00401764-0a35-4a98-a9ae-36bdd6197bcc None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:45:03.300090 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53a408c-3b2c-4cf4-83c2-c05e34dbcf89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:45:03.300740 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a408c-3b2c-4cf4-83c2-c05e34dbcf89 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:45:03.301017 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a408c-3b2c-4cf4-83c2-c05e34dbcf89 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:45:03.301290 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a408c-3b2c-4cf4-83c2-c05e34dbcf89 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:45:03.301969 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53a408c-3b2c-4cf4-83c2-c05e34dbcf89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:45:03.303893 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53a408c-3b2c-4cf4-83c2-c05e34dbcf89 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:45:03.412931 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4142/8308] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:45:03 2022] POST /identity/v3/projects => generated 361 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:45:03.417074 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53cc81c-1b83-4d66-a3c6-91b8e5e28e9d admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:45:03.427316 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53cc81c-1b83-4d66-a3c6-91b8e5e28e9d admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:45:03.499000 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5929c205-77b2-4682-b0b7-bd776533f2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:45:03.499698 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929c205-77b2-4682-b0b7-bd776533f2ac admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:45:03.499980 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929c205-77b2-4682-b0b7-bd776533f2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:45:03.500254 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929c205-77b2-4682-b0b7-bd776533f2ac admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:45:03.501113 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5929c205-77b2-4682-b0b7-bd776533f2ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:45:03.503350 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5929c205-77b2-4682-b0b7-bd776533f2ac admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:45:03.593729 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4167/8309] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:45:03 2022] POST /identity/v3/users => generated 281 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:45:03.598131 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53a408c-3b2c-4cf4-83c2-c05e34dbcf89 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:45:03.608621 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53a408c-3b2c-4cf4-83c2-c05e34dbcf89 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:45:03.613968 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9673db8-ca24-4d0b-ad8c-a4b32242bcc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:45:03.614629 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9673db8-ca24-4d0b-ad8c-a4b32242bcc4 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:45:03.614929 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9673db8-ca24-4d0b-ad8c-a4b32242bcc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:45:03.615207 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9673db8-ca24-4d0b-ad8c-a4b32242bcc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:45:03.615961 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9673db8-ca24-4d0b-ad8c-a4b32242bcc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:45:03.618494 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9673db8-ca24-4d0b-ad8c-a4b32242bcc4 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:45:03.629224 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4143/8310] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:45:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:45:03.633375 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5929c205-77b2-4682-b0b7-bd776533f2ac admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:45:03.643398 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5929c205-77b2-4682-b0b7-bd776533f2ac admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:45:03.648276 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae2caa8-3186-47a5-b5a1-3e47b1ca9334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:45:03.648926 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae2caa8-3186-47a5-b5a1-3e47b1ca9334 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:45:03.649208 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae2caa8-3186-47a5-b5a1-3e47b1ca9334 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:45:03.649527 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae2caa8-3186-47a5-b5a1-3e47b1ca9334 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:45:03.650262 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae2caa8-3186-47a5-b5a1-3e47b1ca9334 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:45:03.651884 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae2caa8-3186-47a5-b5a1-3e47b1ca9334 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:45:03.661926 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4168/8311] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:45:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:45:03.667511 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9673db8-ca24-4d0b-ad8c-a4b32242bcc4 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:45:03.676966 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9673db8-ca24-4d0b-ad8c-a4b32242bcc4 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:45:03.681583 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9700e65f-63a5-4c71-af45-bdfaecccf4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:45:03.682452 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700e65f-63a5-4c71-af45-bdfaecccf4f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:45:03.682783 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700e65f-63a5-4c71-af45-bdfaecccf4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:45:03.683060 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700e65f-63a5-4c71-af45-bdfaecccf4f2 admin admin] PATH_INFO: `/v3/projects/d53d2979e3c6436898a504f9a5b09819/users/02766e41f4514ee5a306727f7a3c22e3/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:45:03.698370 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9700e65f-63a5-4c71-af45-bdfaecccf4f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d53d2979e3c6436898a504f9a5b09819, user_id=02766e41f4514ee5a306727f7a3c22e3, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:45:03.701249 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9700e65f-63a5-4c71-af45-bdfaecccf4f2 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:45:03.799495 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4144/8312] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:45:03 2022] PUT /identity/v3/projects/d53d2979e3c6436898a504f9a5b09819/users/02766e41f4514ee5a306727f7a3c22e3/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:45:03.804551 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a50b98-3cd4-41f3-89e2-e9643becf392 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:45:03.804847 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a50b98-3cd4-41f3-89e2-e9643becf392 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:45:03.805152 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a50b98-3cd4-41f3-89e2-e9643becf392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:45:03.824314 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-07a50b98-3cd4-41f3-89e2-e9643becf392 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:45:03.825615 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-07a50b98-3cd4-41f3-89e2-e9643becf392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:45:03.886610 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4169/8313] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:45:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:45:03.896729 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9700e65f-63a5-4c71-af45-bdfaecccf4f2 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:45:03.899021 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-9700e65f-63a5-4c71-af45-bdfaecccf4f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:45:03.963972 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9700e65f-63a5-4c71-af45-bdfaecccf4f2 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:45:03.967936 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335953ba-accc-4556-a487-fd79818f6bd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:45:03.969667 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335953ba-accc-4556-a487-fd79818f6bd7 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:45:03.969667 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335953ba-accc-4556-a487-fd79818f6bd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:45:03.969667 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335953ba-accc-4556-a487-fd79818f6bd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:45:03.979543 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335953ba-accc-4556-a487-fd79818f6bd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:45:03.981055 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335953ba-accc-4556-a487-fd79818f6bd7 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:45:03.991340 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4145/8314] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:45:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:45:10.436975 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e1809c-1e43-4c3a-b1c1-613f3fb2eaee None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:45:10.437680 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e1809c-1e43-4c3a-b1c1-613f3fb2eaee None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:45:10.437680 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e1809c-1e43-4c3a-b1c1-613f3fb2eaee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:45:10.468499 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-92e1809c-1e43-4c3a-b1c1-613f3fb2eaee None None] MFA Rules not processed for user `02766e41f4514ee5a306727f7a3c22e3`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:45:10.469755 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-92e1809c-1e43-4c3a-b1c1-613f3fb2eaee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:45:10.538816 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4170/8315] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:45:10 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:45:10.544268 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335953ba-accc-4556-a487-fd79818f6bd7 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:45:10.554642 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335953ba-accc-4556-a487-fd79818f6bd7 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:45:10.559572 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0342e46f-7629-4a2e-a9b5-6fe2ab4e1cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:45:10.560280 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0342e46f-7629-4a2e-a9b5-6fe2ab4e1cde admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:45:10.560564 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0342e46f-7629-4a2e-a9b5-6fe2ab4e1cde admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:45:10.560864 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0342e46f-7629-4a2e-a9b5-6fe2ab4e1cde admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:45:10.561599 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0342e46f-7629-4a2e-a9b5-6fe2ab4e1cde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:45:10.564083 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0342e46f-7629-4a2e-a9b5-6fe2ab4e1cde admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:45:10.679524 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4146/8316] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:45:10 2022] POST /identity/v3/users => generated 286 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:45:10.683538 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e1809c-1e43-4c3a-b1c1-613f3fb2eaee None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:45:10.694924 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e1809c-1e43-4c3a-b1c1-613f3fb2eaee None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:45:10.701163 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f97e2-6e3e-410f-97de-0967eaac3cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:45:10.702876 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f97e2-6e3e-410f-97de-0967eaac3cfa admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:45:10.702876 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f97e2-6e3e-410f-97de-0967eaac3cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:45:10.702876 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f97e2-6e3e-410f-97de-0967eaac3cfa admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:45:10.703355 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5f97e2-6e3e-410f-97de-0967eaac3cfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:45:10.705937 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5f97e2-6e3e-410f-97de-0967eaac3cfa admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:45:10.718690 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4171/8317] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:45:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:45:10.723160 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0342e46f-7629-4a2e-a9b5-6fe2ab4e1cde admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:45:10.742994 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0342e46f-7629-4a2e-a9b5-6fe2ab4e1cde admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:45:10.768552 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7525d3-5cc7-49f0-bd0f-0762517770bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:45:10.771873 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7525d3-5cc7-49f0-bd0f-0762517770bd admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:45:10.772159 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7525d3-5cc7-49f0-bd0f-0762517770bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:45:10.773121 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7525d3-5cc7-49f0-bd0f-0762517770bd admin admin] PATH_INFO: `/v3/system/users/8ad3120613b045fab8e5ea8a167ddb9a/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:45:10.790747 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7525d3-5cc7-49f0-bd0f-0762517770bd admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8ad3120613b045fab8e5ea8a167ddb9a, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:45:10.792885 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7525d3-5cc7-49f0-bd0f-0762517770bd admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:45:10.885188 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4147/8318] 10.222.0.52 () {60 vars in 1377 bytes} [Sat May 14 21:45:10 2022] PUT /identity/v3/system/users/8ad3120613b045fab8e5ea8a167ddb9a/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:45:10.895734 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1ae04-2fc3-4b72-98fc-fca8b031e961 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:45:10.896036 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1ae04-2fc3-4b72-98fc-fca8b031e961 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:45:10.896322 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1ae04-2fc3-4b72-98fc-fca8b031e961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:45:10.926326 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-f5c1ae04-2fc3-4b72-98fc-fca8b031e961 None None] MFA Rules not processed for user `8ad3120613b045fab8e5ea8a167ddb9a`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:45:10.927666 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-f5c1ae04-2fc3-4b72-98fc-fca8b031e961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:45:11.030722 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4172/8319] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:45:10 2022] POST /identity/v3/auth/tokens => generated 2403 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 21:45:11.035235 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7525d3-5cc7-49f0-bd0f-0762517770bd admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:45:11.161323 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7525d3-5cc7-49f0-bd0f-0762517770bd admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:45:11.198928 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b3a601-5f55-4b2a-b02e-9ad391dd5431 None tempest-ImageQuotaTest-79795326-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ad3120613b045fab8e5ea8a167ddb9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:45:11.199622 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3a601-5f55-4b2a-b02e-9ad391dd5431 None tempest-ImageQuotaTest-79795326-system-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:45:11.199907 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3a601-5f55-4b2a-b02e-9ad391dd5431 None tempest-ImageQuotaTest-79795326-system-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:45:11.200184 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3a601-5f55-4b2a-b02e-9ad391dd5431 None tempest-ImageQuotaTest-79795326-system-admin] PATH_INFO: `/v3/services` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:45:11.200867 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b3a601-5f55-4b2a-b02e-9ad391dd5431 None tempest-ImageQuotaTest-79795326-system-admin] RBAC: Authorizing `identity:list_services()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:45:11.202234 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b3a601-5f55-4b2a-b02e-9ad391dd5431 None tempest-ImageQuotaTest-79795326-system-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:45:11.209665 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4148/8320] 10.222.0.52 () {58 vars in 1109 bytes} [Sat May 14 21:45:11 2022] GET /identity/v3/services => generated 2191 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:45:11.214081 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c1ae04-2fc3-4b72-98fc-fca8b031e961 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:45:11.324610 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c1ae04-2fc3-4b72-98fc-fca8b031e961 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:45:11.360449 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebd8bf7-54e0-4411-8b61-b1410ae6f707 None tempest-ImageQuotaTest-79795326-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ad3120613b045fab8e5ea8a167ddb9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:45:11.361389 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd8bf7-54e0-4411-8b61-b1410ae6f707 None tempest-ImageQuotaTest-79795326-system-admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:45:11.363556 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd8bf7-54e0-4411-8b61-b1410ae6f707 None tempest-ImageQuotaTest-79795326-system-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:45:11.363556 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd8bf7-54e0-4411-8b61-b1410ae6f707 None tempest-ImageQuotaTest-79795326-system-admin] PATH_INFO: `/v3/limits` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:45:11.363556 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebd8bf7-54e0-4411-8b61-b1410ae6f707 None tempest-ImageQuotaTest-79795326-system-admin] RBAC: Authorizing `identity:create_limits()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:45:11.364083 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebd8bf7-54e0-4411-8b61-b1410ae6f707 None tempest-ImageQuotaTest-79795326-system-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:45:11.395738 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-7ebd8bf7-54e0-4411-8b61-b1410ae6f707 None tempest-ImageQuotaTest-79795326-system-admin] Unable to create a limit that has no corresponding registered limit.: keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. May 14 21:45:11.395738 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:45:11.395738 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 21:45:11.395738 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 21:45:11.395738 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 21:45:11.395738 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 21:45:11.395738 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 21:45:11.395738 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 21:45:11.395738 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 21:45:11.395738 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 21:45:11.395738 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 21:45:11.395738 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 21:45:11.395738 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/limits.py", line 110, in post May 14 21:45:11.395738 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application refs = PROVIDERS.unified_limit_api.create_limits(limits) May 14 21:45:11.397033 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 21:45:11.397033 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 21:45:11.397033 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/core.py", line 116, in create_limits May 14 21:45:11.397033 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.driver.create_limits(limits) May 14 21:45:11.397033 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 14 21:45:11.397033 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 14 21:45:11.397033 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 260, in create_limits May 14 21:45:11.397033 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application target = self._check_and_fill_registered_limit_id(limit) May 14 21:45:11.397033 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 249, in _check_and_fill_registered_limit_id May 14 21:45:11.397033 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.NoLimitReference May 14 21:45:11.397033 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. May 14 21:45:11.397033 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:45:11.398266 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4173/8321] 10.222.0.52 () {60 vars in 1125 bytes} [Sat May 14 21:45:11 2022] POST /identity/v3/limits => generated 124 bytes in 184 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) May 14 21:45:11.402257 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b3a601-5f55-4b2a-b02e-9ad391dd5431 None tempest-ImageQuotaTest-79795326-system-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:45:11.522162 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b3a601-5f55-4b2a-b02e-9ad391dd5431 None tempest-ImageQuotaTest-79795326-system-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:45:11.560201 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38279ba5-34e9-4a73-9f2e-4b2cd6630904 None tempest-ImageQuotaTest-79795326-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ad3120613b045fab8e5ea8a167ddb9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:45:11.560842 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38279ba5-34e9-4a73-9f2e-4b2cd6630904 None tempest-ImageQuotaTest-79795326-system-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:45:11.561199 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38279ba5-34e9-4a73-9f2e-4b2cd6630904 None tempest-ImageQuotaTest-79795326-system-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:45:11.561660 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38279ba5-34e9-4a73-9f2e-4b2cd6630904 None tempest-ImageQuotaTest-79795326-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:45:11.562953 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38279ba5-34e9-4a73-9f2e-4b2cd6630904 None tempest-ImageQuotaTest-79795326-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:45:11.564695 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38279ba5-34e9-4a73-9f2e-4b2cd6630904 None tempest-ImageQuotaTest-79795326-system-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:45:11.578128 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4149/8322] 10.222.0.52 () {58 vars in 1136 bytes} [Sat May 14 21:45:11 2022] GET /identity/v3/registered_limits => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:45:11.583725 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebd8bf7-54e0-4411-8b61-b1410ae6f707 None tempest-ImageQuotaTest-79795326-system-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:45:11.703232 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebd8bf7-54e0-4411-8b61-b1410ae6f707 None tempest-ImageQuotaTest-79795326-system-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:45:11.743135 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0c028c-a3a8-4ebb-9aba-fb176e56f4a7 None tempest-ImageQuotaTest-79795326-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ad3120613b045fab8e5ea8a167ddb9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:45:11.743829 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c028c-a3a8-4ebb-9aba-fb176e56f4a7 None tempest-ImageQuotaTest-79795326-system-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:45:11.744111 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c028c-a3a8-4ebb-9aba-fb176e56f4a7 None tempest-ImageQuotaTest-79795326-system-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:45:11.744382 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c028c-a3a8-4ebb-9aba-fb176e56f4a7 None tempest-ImageQuotaTest-79795326-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:45:11.745073 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0c028c-a3a8-4ebb-9aba-fb176e56f4a7 None tempest-ImageQuotaTest-79795326-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:45:11.746139 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0c028c-a3a8-4ebb-9aba-fb176e56f4a7 None tempest-ImageQuotaTest-79795326-system-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:45:11.752052 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4174/8323] 10.222.0.52 () {58 vars in 1136 bytes} [Sat May 14 21:45:11 2022] GET /identity/v3/registered_limits => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:45:15.639280 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38279ba5-34e9-4a73-9f2e-4b2cd6630904 None tempest-ImageQuotaTest-79795326-system-admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:45:15.654923 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38279ba5-34e9-4a73-9f2e-4b2cd6630904 None tempest-ImageQuotaTest-79795326-system-admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:45:15.660326 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b48f9e1-a6bd-4ba2-b119-1a700f4b00df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:45:15.661213 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b48f9e1-a6bd-4ba2-b119-1a700f4b00df admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:45:15.661493 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b48f9e1-a6bd-4ba2-b119-1a700f4b00df admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:45:15.661769 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b48f9e1-a6bd-4ba2-b119-1a700f4b00df admin admin] PATH_INFO: `/v3/users/02766e41f4514ee5a306727f7a3c22e3` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:45:15.662990 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b48f9e1-a6bd-4ba2-b119-1a700f4b00df admin admin] RBAC: Authorizing `identity:delete_user(user_id=02766e41f4514ee5a306727f7a3c22e3)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:45:15.664962 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b48f9e1-a6bd-4ba2-b119-1a700f4b00df admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:45:15.860709 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-1b48f9e1-a6bd-4ba2-b119-1a700f4b00df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02766e41f4514ee5a306727f7a3c22e3'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:45:15.868886 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-1b48f9e1-a6bd-4ba2-b119-1a700f4b00df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02766e41f4514ee5a306727f7a3c22e3'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:45:15.869678 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-1b48f9e1-a6bd-4ba2-b119-1a700f4b00df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02766e41f4514ee5a306727f7a3c22e3'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:45:16.004309 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-1b48f9e1-a6bd-4ba2-b119-1a700f4b00df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02766e41f4514ee5a306727f7a3c22e3'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:45:16.017202 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-1b48f9e1-a6bd-4ba2-b119-1a700f4b00df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02766e41f4514ee5a306727f7a3c22e3'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:45:16.023594 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4150/8324] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:45:15 2022] DELETE /identity/v3/users/02766e41f4514ee5a306727f7a3c22e3 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:45:16.281052 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0c028c-a3a8-4ebb-9aba-fb176e56f4a7 None tempest-ImageQuotaTest-79795326-system-admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:45:16.283606 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-8e0c028c-a3a8-4ebb-9aba-fb176e56f4a7 None tempest-ImageQuotaTest-79795326-system-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:45:16.355448 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0c028c-a3a8-4ebb-9aba-fb176e56f4a7 None tempest-ImageQuotaTest-79795326-system-admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:45:16.360252 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a997d88-8ef9-49fb-b7d8-2ef077a41cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:45:16.361110 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a997d88-8ef9-49fb-b7d8-2ef077a41cbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:45:16.361395 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a997d88-8ef9-49fb-b7d8-2ef077a41cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:45:16.361674 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a997d88-8ef9-49fb-b7d8-2ef077a41cbd admin admin] PATH_INFO: `/v3/projects/d53d2979e3c6436898a504f9a5b09819` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:45:16.362872 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a997d88-8ef9-49fb-b7d8-2ef077a41cbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=d53d2979e3c6436898a504f9a5b09819)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:45:16.364870 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a997d88-8ef9-49fb-b7d8-2ef077a41cbd admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:45:16.513461 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0a997d88-8ef9-49fb-b7d8-2ef077a41cbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd53d2979e3c6436898a504f9a5b09819', 'request_id': 'req-0a997d88-8ef9-49fb-b7d8-2ef077a41cbd'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:45:16.519292 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0a997d88-8ef9-49fb-b7d8-2ef077a41cbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd53d2979e3c6436898a504f9a5b09819', 'request_id': 'req-0a997d88-8ef9-49fb-b7d8-2ef077a41cbd'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:45:16.593119 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0a997d88-8ef9-49fb-b7d8-2ef077a41cbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd53d2979e3c6436898a504f9a5b09819', 'request_id': 'req-0a997d88-8ef9-49fb-b7d8-2ef077a41cbd'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:45:16.604806 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0a997d88-8ef9-49fb-b7d8-2ef077a41cbd admin admin] The token cache is being invalidate because project d53d2979e3c6436898a504f9a5b09819 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:45:16.605123 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0a997d88-8ef9-49fb-b7d8-2ef077a41cbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:45:16.605771 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0a997d88-8ef9-49fb-b7d8-2ef077a41cbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:45:16.607307 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4175/8325] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:45:16 2022] DELETE /identity/v3/projects/d53d2979e3c6436898a504f9a5b09819 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:45:16.612004 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b48f9e1-a6bd-4ba2-b119-1a700f4b00df admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:45:16.622372 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b48f9e1-a6bd-4ba2-b119-1a700f4b00df admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:45:16.678853 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d457ab5-2fc9-4d6c-bdb0-1d66d3f5af5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:45:16.679811 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d457ab5-2fc9-4d6c-bdb0-1d66d3f5af5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:45:16.680035 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d457ab5-2fc9-4d6c-bdb0-1d66d3f5af5b admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:45:16.680307 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d457ab5-2fc9-4d6c-bdb0-1d66d3f5af5b admin admin] PATH_INFO: `/v3/users/8ad3120613b045fab8e5ea8a167ddb9a` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:45:16.681480 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d457ab5-2fc9-4d6c-bdb0-1d66d3f5af5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ad3120613b045fab8e5ea8a167ddb9a)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:45:16.683444 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d457ab5-2fc9-4d6c-bdb0-1d66d3f5af5b admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:45:16.936863 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4d457ab5-2fc9-4d6c-bdb0-1d66d3f5af5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ad3120613b045fab8e5ea8a167ddb9a'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:45:16.944261 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4d457ab5-2fc9-4d6c-bdb0-1d66d3f5af5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ad3120613b045fab8e5ea8a167ddb9a'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:45:16.945070 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4d457ab5-2fc9-4d6c-bdb0-1d66d3f5af5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ad3120613b045fab8e5ea8a167ddb9a'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:45:17.034145 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4d457ab5-2fc9-4d6c-bdb0-1d66d3f5af5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ad3120613b045fab8e5ea8a167ddb9a'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:45:17.046345 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4d457ab5-2fc9-4d6c-bdb0-1d66d3f5af5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ad3120613b045fab8e5ea8a167ddb9a'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:45:17.052636 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4151/8326] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:45:16 2022] DELETE /identity/v3/users/8ad3120613b045fab8e5ea8a167ddb9a => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:45:17.489439 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a997d88-8ef9-49fb-b7d8-2ef077a41cbd admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:45:17.491791 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-0a997d88-8ef9-49fb-b7d8-2ef077a41cbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:45:17.507062 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a997d88-8ef9-49fb-b7d8-2ef077a41cbd admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:45:17.572513 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c6430a-6e35-4dfd-8832-da2c3513bf9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:45:17.573318 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6430a-6e35-4dfd-8832-da2c3513bf9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:45:17.573618 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6430a-6e35-4dfd-8832-da2c3513bf9f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:45:17.573934 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6430a-6e35-4dfd-8832-da2c3513bf9f admin admin] PATH_INFO: `/v3/projects/None` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:45:17.581900 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c6430a-6e35-4dfd-8832-da2c3513bf9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=None)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:45:17.583878 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c6430a-6e35-4dfd-8832-da2c3513bf9f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:45:17.598137 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application [None req-46c6430a-6e35-4dfd-8832-da2c3513bf9f admin admin] Could not find project: None.: keystone.exception.ProjectNotFound: Could not find project: None. May 14 21:45:17.598137 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 21:45:17.598137 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 21:45:17.598137 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 21:45:17.598137 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 21:45:17.598137 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 21:45:17.598137 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 21:45:17.598137 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 21:45:17.598137 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 21:45:17.598137 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 21:45:17.598137 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 21:45:17.598137 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 21:45:17.598137 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete May 14 21:45:17.598137 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( May 14 21:45:17.598137 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 21:45:17.598137 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 21:45:17.618673 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project May 14 21:45:17.618673 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) May 14 21:45:17.618673 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 21:45:17.618673 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 21:45:17.618673 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 21:45:17.618673 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 21:45:17.618673 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: None. May 14 21:45:17.618673 ncdv-master-1 devstack@keystone.service[91106]: ERROR keystone.server.flask.application May 14 21:45:17.618673 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4176/8327] 10.222.0.52 () {58 vars in 1148 bytes} [Sat May 14 21:45:17 2022] DELETE /identity/v3/projects/None => generated 85 bytes in 111 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 21:45:53.011441 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d457ab5-2fc9-4d6c-bdb0-1d66d3f5af5b admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:45:53.012382 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-4d457ab5-2fc9-4d6c-bdb0-1d66d3f5af5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:45:53.026729 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d457ab5-2fc9-4d6c-bdb0-1d66d3f5af5b admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:45:53.031978 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a20c5-f149-4545-a802-58f84a120f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:45:53.039831 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a20c5-f149-4545-a802-58f84a120f65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:45:53.039831 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a20c5-f149-4545-a802-58f84a120f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:45:53.039831 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a20c5-f149-4545-a802-58f84a120f65 admin admin] PATH_INFO: `/v3/users/8c023bd546014ceda5e43ba1c93ca7b1` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:45:53.039831 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6a20c5-f149-4545-a802-58f84a120f65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c023bd546014ceda5e43ba1c93ca7b1)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:45:53.039831 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6a20c5-f149-4545-a802-58f84a120f65 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:45:53.240949 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3a6a20c5-f149-4545-a802-58f84a120f65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c023bd546014ceda5e43ba1c93ca7b1'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:45:53.248434 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3a6a20c5-f149-4545-a802-58f84a120f65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c023bd546014ceda5e43ba1c93ca7b1'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:45:53.249116 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3a6a20c5-f149-4545-a802-58f84a120f65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c023bd546014ceda5e43ba1c93ca7b1'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:45:53.312354 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3a6a20c5-f149-4545-a802-58f84a120f65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c023bd546014ceda5e43ba1c93ca7b1'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:45:53.325932 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3a6a20c5-f149-4545-a802-58f84a120f65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c023bd546014ceda5e43ba1c93ca7b1'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:45:53.332350 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4152/8328] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:45:53 2022] DELETE /identity/v3/users/8c023bd546014ceda5e43ba1c93ca7b1 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:45:53.337068 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f42ce44-6bc8-4b1e-a5b1-03a24e2c801f None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:45:53.337646 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f42ce44-6bc8-4b1e-a5b1-03a24e2c801f None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:45:53.337646 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f42ce44-6bc8-4b1e-a5b1-03a24e2c801f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:45:53.355340 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-5f42ce44-6bc8-4b1e-a5b1-03a24e2c801f None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:45:53.356646 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-5f42ce44-6bc8-4b1e-a5b1-03a24e2c801f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:45:53.430701 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4177/8329] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:45:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:45:53.445003 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a20c5-f149-4545-a802-58f84a120f65 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:45:53.446696 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-3a6a20c5-f149-4545-a802-58f84a120f65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:45:53.507069 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a20c5-f149-4545-a802-58f84a120f65 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:45:53.510646 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42609735-3caf-473b-999a-cf3fbd4af08c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:45:53.511368 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42609735-3caf-473b-999a-cf3fbd4af08c service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:45:53.511673 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42609735-3caf-473b-999a-cf3fbd4af08c service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:45:53.511947 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42609735-3caf-473b-999a-cf3fbd4af08c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:45:53.520908 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42609735-3caf-473b-999a-cf3fbd4af08c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:45:53.522333 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42609735-3caf-473b-999a-cf3fbd4af08c service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:45:53.535661 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4153/8330] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:45:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:45:53.972410 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f42ce44-6bc8-4b1e-a5b1-03a24e2c801f None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:45:53.974537 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-5f42ce44-6bc8-4b1e-a5b1-03a24e2c801f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:45:53.987604 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f42ce44-6bc8-4b1e-a5b1-03a24e2c801f None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:45:53.994726 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679586c4-38ad-486c-9ae1-c741985a8634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:45:53.995717 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679586c4-38ad-486c-9ae1-c741985a8634 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:45:53.996006 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679586c4-38ad-486c-9ae1-c741985a8634 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:45:53.996290 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679586c4-38ad-486c-9ae1-c741985a8634 admin admin] PATH_INFO: `/v3/projects/5ea54abe27dd44beb76e2876a4cb53fd` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:45:53.997522 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679586c4-38ad-486c-9ae1-c741985a8634 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ea54abe27dd44beb76e2876a4cb53fd)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:45:53.999448 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679586c4-38ad-486c-9ae1-c741985a8634 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:45:54.095693 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-679586c4-38ad-486c-9ae1-c741985a8634 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ea54abe27dd44beb76e2876a4cb53fd', 'request_id': 'req-679586c4-38ad-486c-9ae1-c741985a8634'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:45:54.101188 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-679586c4-38ad-486c-9ae1-c741985a8634 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ea54abe27dd44beb76e2876a4cb53fd', 'request_id': 'req-679586c4-38ad-486c-9ae1-c741985a8634'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:45:54.169879 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-679586c4-38ad-486c-9ae1-c741985a8634 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ea54abe27dd44beb76e2876a4cb53fd', 'request_id': 'req-679586c4-38ad-486c-9ae1-c741985a8634'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:45:54.182473 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-679586c4-38ad-486c-9ae1-c741985a8634 admin admin] The token cache is being invalidate because project 5ea54abe27dd44beb76e2876a4cb53fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:45:54.182801 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-679586c4-38ad-486c-9ae1-c741985a8634 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:45:54.183582 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-679586c4-38ad-486c-9ae1-c741985a8634 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:45:54.185159 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4178/8331] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:45:53 2022] DELETE /identity/v3/projects/5ea54abe27dd44beb76e2876a4cb53fd => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:45:54.190218 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e9533-50c4-40f9-8183-81fbe09a9869 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:45:54.190702 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e9533-50c4-40f9-8183-81fbe09a9869 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:45:54.190809 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e9533-50c4-40f9-8183-81fbe09a9869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:45:54.208669 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-541e9533-50c4-40f9-8183-81fbe09a9869 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:45:54.209864 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-541e9533-50c4-40f9-8183-81fbe09a9869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:45:54.276506 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4154/8332] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:45:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:45:54.284178 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373cd41-63b8-45e4-8fb2-4c7db0cbf1e2 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:45:54.284554 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373cd41-63b8-45e4-8fb2-4c7db0cbf1e2 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:45:54.284937 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373cd41-63b8-45e4-8fb2-4c7db0cbf1e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:45:54.305308 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-0373cd41-63b8-45e4-8fb2-4c7db0cbf1e2 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:45:54.306798 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-0373cd41-63b8-45e4-8fb2-4c7db0cbf1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:45:54.314868 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4179/8333] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:45:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:45:54.319107 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541e9533-50c4-40f9-8183-81fbe09a9869 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:45:54.328981 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541e9533-50c4-40f9-8183-81fbe09a9869 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:45:54.333584 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d83d6c4-dfa0-4101-b2a8-146a6ebb0a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:45:54.334263 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83d6c4-dfa0-4101-b2a8-146a6ebb0a77 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:45:54.334546 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83d6c4-dfa0-4101-b2a8-146a6ebb0a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:45:54.334825 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83d6c4-dfa0-4101-b2a8-146a6ebb0a77 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:45:54.335816 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d83d6c4-dfa0-4101-b2a8-146a6ebb0a77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:45:54.339691 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d83d6c4-dfa0-4101-b2a8-146a6ebb0a77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:45:54.339691 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d83d6c4-dfa0-4101-b2a8-146a6ebb0a77 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:45:54.349180 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4155/8334] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:45:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:45:54.359826 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0373cd41-63b8-45e4-8fb2-4c7db0cbf1e2 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:45:54.370196 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0373cd41-63b8-45e4-8fb2-4c7db0cbf1e2 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:45:54.375007 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8286f33-d2c9-4084-b275-d9699637f308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:45:54.375679 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8286f33-d2c9-4084-b275-d9699637f308 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:45:54.379929 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8286f33-d2c9-4084-b275-d9699637f308 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:45:54.379929 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8286f33-d2c9-4084-b275-d9699637f308 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:45:54.379929 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8286f33-d2c9-4084-b275-d9699637f308 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:45:54.379929 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8286f33-d2c9-4084-b275-d9699637f308 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:45:54.480311 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4180/8335] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:45:54 2022] POST /identity/v3/projects => generated 371 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:45:54.484686 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d83d6c4-dfa0-4101-b2a8-146a6ebb0a77 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:45:54.498316 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d83d6c4-dfa0-4101-b2a8-146a6ebb0a77 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:45:54.557665 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06388b8a-d053-46c4-b989-33784b6449fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:45:54.558336 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06388b8a-d053-46c4-b989-33784b6449fe admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:45:54.558620 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06388b8a-d053-46c4-b989-33784b6449fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:45:54.558893 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06388b8a-d053-46c4-b989-33784b6449fe admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:45:54.559639 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06388b8a-d053-46c4-b989-33784b6449fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:45:54.561564 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06388b8a-d053-46c4-b989-33784b6449fe admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:45:54.644692 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4156/8336] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:45:54 2022] POST /identity/v3/users => generated 286 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:45:54.649673 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8286f33-d2c9-4084-b275-d9699637f308 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:45:54.660192 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8286f33-d2c9-4084-b275-d9699637f308 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:45:54.665570 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3541701-780d-47de-8930-c1cd64557cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:45:54.671160 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3541701-780d-47de-8930-c1cd64557cee admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:45:54.671160 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3541701-780d-47de-8930-c1cd64557cee admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:45:54.671160 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3541701-780d-47de-8930-c1cd64557cee admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:45:54.671160 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3541701-780d-47de-8930-c1cd64557cee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:45:54.671160 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3541701-780d-47de-8930-c1cd64557cee admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:45:54.680943 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4181/8337] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:45:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:45:54.684924 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06388b8a-d053-46c4-b989-33784b6449fe admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:45:54.695067 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06388b8a-d053-46c4-b989-33784b6449fe admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:45:54.699893 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701faec6-d6f3-4019-b488-55e9ac508460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:45:54.700398 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701faec6-d6f3-4019-b488-55e9ac508460 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:45:54.700683 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701faec6-d6f3-4019-b488-55e9ac508460 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:45:54.700962 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701faec6-d6f3-4019-b488-55e9ac508460 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:45:54.701674 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701faec6-d6f3-4019-b488-55e9ac508460 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:45:54.703270 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701faec6-d6f3-4019-b488-55e9ac508460 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:45:54.713692 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4157/8338] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:45:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:45:54.718111 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3541701-780d-47de-8930-c1cd64557cee admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:45:54.728681 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3541701-780d-47de-8930-c1cd64557cee admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:45:54.733381 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ef4aa4-be04-4f83-9716-c9fc4c437b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:45:54.734257 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ef4aa4-be04-4f83-9716-c9fc4c437b23 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:45:54.734558 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ef4aa4-be04-4f83-9716-c9fc4c437b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:45:54.734835 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ef4aa4-be04-4f83-9716-c9fc4c437b23 admin admin] PATH_INFO: `/v3/projects/233de55e2a38457bb1837da8374b7b54/users/2c025653d74848899a26c661400279cf/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:45:54.749560 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ef4aa4-be04-4f83-9716-c9fc4c437b23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=233de55e2a38457bb1837da8374b7b54, user_id=2c025653d74848899a26c661400279cf, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:45:54.752349 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ef4aa4-be04-4f83-9716-c9fc4c437b23 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:45:54.867593 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4182/8339] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:45:54 2022] PUT /identity/v3/projects/233de55e2a38457bb1837da8374b7b54/users/2c025653d74848899a26c661400279cf/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:45:54.872864 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c233403-fa0e-42ae-ae68-00a076dfe18e None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:45:54.873228 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c233403-fa0e-42ae-ae68-00a076dfe18e None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:45:54.873513 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c233403-fa0e-42ae-ae68-00a076dfe18e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:45:54.891956 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-0c233403-fa0e-42ae-ae68-00a076dfe18e None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:45:54.893237 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-0c233403-fa0e-42ae-ae68-00a076dfe18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:45:54.951753 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4158/8340] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:45:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:45:54.962145 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ef4aa4-be04-4f83-9716-c9fc4c437b23 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:45:54.964102 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-92ef4aa4-be04-4f83-9716-c9fc4c437b23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:45:55.030625 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ef4aa4-be04-4f83-9716-c9fc4c437b23 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:45:55.034362 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd079ee-b725-42b2-8055-f1a8fd3f09ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:45:55.035026 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd079ee-b725-42b2-8055-f1a8fd3f09ac service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:45:55.035295 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd079ee-b725-42b2-8055-f1a8fd3f09ac service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:45:55.035601 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd079ee-b725-42b2-8055-f1a8fd3f09ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:45:55.046279 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd079ee-b725-42b2-8055-f1a8fd3f09ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:45:55.049754 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd079ee-b725-42b2-8055-f1a8fd3f09ac service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:45:55.058088 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4183/8341] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:45:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:45:55.322166 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c233403-fa0e-42ae-ae68-00a076dfe18e None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:45:55.323777 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-0c233403-fa0e-42ae-ae68-00a076dfe18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:45:55.335866 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c233403-fa0e-42ae-ae68-00a076dfe18e None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:45:55.340464 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e547636-7145-4616-af06-2516c2fb0746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:45:55.341335 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e547636-7145-4616-af06-2516c2fb0746 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:45:55.341618 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e547636-7145-4616-af06-2516c2fb0746 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:45:55.341893 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e547636-7145-4616-af06-2516c2fb0746 admin admin] PATH_INFO: `/v3/users/c18d326a4dd84ac3aa1cabb4ea37a644` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:45:55.343075 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e547636-7145-4616-af06-2516c2fb0746 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c18d326a4dd84ac3aa1cabb4ea37a644)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:45:55.345022 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e547636-7145-4616-af06-2516c2fb0746 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:45:55.521165 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-5e547636-7145-4616-af06-2516c2fb0746 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c18d326a4dd84ac3aa1cabb4ea37a644'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:45:55.528904 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-5e547636-7145-4616-af06-2516c2fb0746 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c18d326a4dd84ac3aa1cabb4ea37a644'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:45:55.529601 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-5e547636-7145-4616-af06-2516c2fb0746 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c18d326a4dd84ac3aa1cabb4ea37a644'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:45:55.601612 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-5e547636-7145-4616-af06-2516c2fb0746 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c18d326a4dd84ac3aa1cabb4ea37a644'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:45:55.624521 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-5e547636-7145-4616-af06-2516c2fb0746 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c18d326a4dd84ac3aa1cabb4ea37a644'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:45:55.630637 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4159/8342] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:45:55 2022] DELETE /identity/v3/users/c18d326a4dd84ac3aa1cabb4ea37a644 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:45:55.635933 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2bf7dd-1e53-4db6-8ba6-3933f609de59 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:45:55.636554 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2bf7dd-1e53-4db6-8ba6-3933f609de59 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:45:55.636554 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2bf7dd-1e53-4db6-8ba6-3933f609de59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:45:55.653946 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-5c2bf7dd-1e53-4db6-8ba6-3933f609de59 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:45:55.655177 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-5c2bf7dd-1e53-4db6-8ba6-3933f609de59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:45:55.718116 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4184/8343] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:45:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:45:55.730310 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e547636-7145-4616-af06-2516c2fb0746 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:45:55.731760 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-5e547636-7145-4616-af06-2516c2fb0746 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:45:55.800604 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e547636-7145-4616-af06-2516c2fb0746 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:45:55.804756 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99bf973-dcc5-4eba-b040-f47235f5d73e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:45:55.805428 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99bf973-dcc5-4eba-b040-f47235f5d73e service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:45:55.805708 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99bf973-dcc5-4eba-b040-f47235f5d73e service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:45:55.805975 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99bf973-dcc5-4eba-b040-f47235f5d73e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:45:55.815783 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99bf973-dcc5-4eba-b040-f47235f5d73e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:45:55.817269 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99bf973-dcc5-4eba-b040-f47235f5d73e service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:45:55.828188 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4160/8344] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:45:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:45:56.285456 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2bf7dd-1e53-4db6-8ba6-3933f609de59 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:45:56.286983 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-5c2bf7dd-1e53-4db6-8ba6-3933f609de59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:45:56.302643 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2bf7dd-1e53-4db6-8ba6-3933f609de59 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:45:56.308252 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c23930-8a0a-4daf-a484-85059fbbc341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:45:56.309145 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c23930-8a0a-4daf-a484-85059fbbc341 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:45:56.309490 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c23930-8a0a-4daf-a484-85059fbbc341 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:45:56.309770 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c23930-8a0a-4daf-a484-85059fbbc341 admin admin] PATH_INFO: `/v3/projects/70d62c44e62f4f908188af21b5653cc7` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:45:56.310949 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c23930-8a0a-4daf-a484-85059fbbc341 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70d62c44e62f4f908188af21b5653cc7)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:45:56.312886 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c23930-8a0a-4daf-a484-85059fbbc341 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:45:56.439325 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b5c23930-8a0a-4daf-a484-85059fbbc341 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70d62c44e62f4f908188af21b5653cc7', 'request_id': 'req-b5c23930-8a0a-4daf-a484-85059fbbc341'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:45:56.446076 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b5c23930-8a0a-4daf-a484-85059fbbc341 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70d62c44e62f4f908188af21b5653cc7', 'request_id': 'req-b5c23930-8a0a-4daf-a484-85059fbbc341'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:45:56.525637 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b5c23930-8a0a-4daf-a484-85059fbbc341 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70d62c44e62f4f908188af21b5653cc7', 'request_id': 'req-b5c23930-8a0a-4daf-a484-85059fbbc341'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:45:56.537567 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b5c23930-8a0a-4daf-a484-85059fbbc341 admin admin] The token cache is being invalidate because project 70d62c44e62f4f908188af21b5653cc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:45:56.537856 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b5c23930-8a0a-4daf-a484-85059fbbc341 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:45:56.539167 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-b5c23930-8a0a-4daf-a484-85059fbbc341 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:45:56.543500 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4185/8345] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:45:56 2022] DELETE /identity/v3/projects/70d62c44e62f4f908188af21b5653cc7 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:45:56.544753 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99bf973-dcc5-4eba-b040-f47235f5d73e service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:45:56.555413 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99bf973-dcc5-4eba-b040-f47235f5d73e service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:45:56.615742 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583dc983-190d-44ed-b64d-ed8cc4756cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:45:56.616917 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583dc983-190d-44ed-b64d-ed8cc4756cef admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:45:56.617198 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583dc983-190d-44ed-b64d-ed8cc4756cef admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:45:56.617490 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583dc983-190d-44ed-b64d-ed8cc4756cef admin admin] PATH_INFO: `/v3/users/49bd9db298e24a7eb351f29a646d6713` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:45:56.618704 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583dc983-190d-44ed-b64d-ed8cc4756cef admin admin] RBAC: Authorizing `identity:delete_user(user_id=49bd9db298e24a7eb351f29a646d6713)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:45:56.621401 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583dc983-190d-44ed-b64d-ed8cc4756cef admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:45:56.867094 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-583dc983-190d-44ed-b64d-ed8cc4756cef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49bd9db298e24a7eb351f29a646d6713'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:45:56.875179 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-583dc983-190d-44ed-b64d-ed8cc4756cef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49bd9db298e24a7eb351f29a646d6713'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:45:56.876046 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-583dc983-190d-44ed-b64d-ed8cc4756cef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49bd9db298e24a7eb351f29a646d6713'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:45:56.964080 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-583dc983-190d-44ed-b64d-ed8cc4756cef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49bd9db298e24a7eb351f29a646d6713'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:45:56.977688 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-583dc983-190d-44ed-b64d-ed8cc4756cef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49bd9db298e24a7eb351f29a646d6713'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:45:56.983975 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4161/8346] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:45:56 2022] DELETE /identity/v3/users/49bd9db298e24a7eb351f29a646d6713 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:45:57.499955 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c23930-8a0a-4daf-a484-85059fbbc341 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:45:57.502102 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b5c23930-8a0a-4daf-a484-85059fbbc341 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:45:57.526432 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c23930-8a0a-4daf-a484-85059fbbc341 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:45:57.597812 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c677a5-6085-4787-967a-e314b3ed4411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:45:57.598814 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c677a5-6085-4787-967a-e314b3ed4411 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:45:57.599167 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c677a5-6085-4787-967a-e314b3ed4411 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:45:57.599716 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c677a5-6085-4787-967a-e314b3ed4411 admin admin] PATH_INFO: `/v3/projects/b371f62e1925484dbf9f3baf943aefdd` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:45:57.601724 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c677a5-6085-4787-967a-e314b3ed4411 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b371f62e1925484dbf9f3baf943aefdd)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:45:57.603720 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c677a5-6085-4787-967a-e314b3ed4411 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:45:57.762216 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-16c677a5-6085-4787-967a-e314b3ed4411 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b371f62e1925484dbf9f3baf943aefdd', 'request_id': 'req-16c677a5-6085-4787-967a-e314b3ed4411'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:45:57.770025 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-16c677a5-6085-4787-967a-e314b3ed4411 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b371f62e1925484dbf9f3baf943aefdd', 'request_id': 'req-16c677a5-6085-4787-967a-e314b3ed4411'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:45:57.855566 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-16c677a5-6085-4787-967a-e314b3ed4411 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b371f62e1925484dbf9f3baf943aefdd', 'request_id': 'req-16c677a5-6085-4787-967a-e314b3ed4411'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:45:57.868557 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-16c677a5-6085-4787-967a-e314b3ed4411 admin admin] The token cache is being invalidate because project b371f62e1925484dbf9f3baf943aefdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:45:57.870016 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-16c677a5-6085-4787-967a-e314b3ed4411 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:45:57.870016 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-16c677a5-6085-4787-967a-e314b3ed4411 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:45:57.871381 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4186/8347] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:45:57 2022] DELETE /identity/v3/projects/b371f62e1925484dbf9f3baf943aefdd => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:45:57.876316 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7916f1-a6ec-46e2-bb17-ed8c7edf0289 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:45:57.877253 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7916f1-a6ec-46e2-bb17-ed8c7edf0289 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:45:57.877930 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7916f1-a6ec-46e2-bb17-ed8c7edf0289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:45:57.899180 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-bb7916f1-a6ec-46e2-bb17-ed8c7edf0289 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:45:57.900628 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-bb7916f1-a6ec-46e2-bb17-ed8c7edf0289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:45:57.972887 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4162/8348] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:45:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:45:57.981886 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61088342-916e-454a-ae79-e5cf3a668032 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:45:57.982175 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61088342-916e-454a-ae79-e5cf3a668032 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:45:57.982457 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61088342-916e-454a-ae79-e5cf3a668032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:45:58.002642 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-61088342-916e-454a-ae79-e5cf3a668032 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:45:58.004148 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-61088342-916e-454a-ae79-e5cf3a668032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:45:58.012402 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4187/8349] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:45:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:45:58.016723 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7916f1-a6ec-46e2-bb17-ed8c7edf0289 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:45:58.027448 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7916f1-a6ec-46e2-bb17-ed8c7edf0289 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:45:58.032459 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a974717f-a14f-4e56-82af-2c41b1973f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:45:58.033204 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974717f-a14f-4e56-82af-2c41b1973f77 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:45:58.033555 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974717f-a14f-4e56-82af-2c41b1973f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:45:58.033898 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974717f-a14f-4e56-82af-2c41b1973f77 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:45:58.034814 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a974717f-a14f-4e56-82af-2c41b1973f77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:45:58.035191 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a974717f-a14f-4e56-82af-2c41b1973f77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:45:58.037109 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a974717f-a14f-4e56-82af-2c41b1973f77 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:45:58.052692 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4163/8350] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:45:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:45:58.056703 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61088342-916e-454a-ae79-e5cf3a668032 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:45:58.066380 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61088342-916e-454a-ae79-e5cf3a668032 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:45:58.080492 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724855d4-359d-4967-a845-9fbdfe226d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:45:58.080492 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724855d4-359d-4967-a845-9fbdfe226d74 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:45:58.080492 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724855d4-359d-4967-a845-9fbdfe226d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:45:58.080492 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724855d4-359d-4967-a845-9fbdfe226d74 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:45:58.081014 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724855d4-359d-4967-a845-9fbdfe226d74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:45:58.081014 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724855d4-359d-4967-a845-9fbdfe226d74 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:45:58.181849 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4188/8351] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:45:58 2022] POST /identity/v3/projects => generated 365 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:45:58.182663 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a974717f-a14f-4e56-82af-2c41b1973f77 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:45:58.196525 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a974717f-a14f-4e56-82af-2c41b1973f77 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:45:58.271338 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4153e7-c46c-4468-af20-c5cbfa336b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:45:58.272056 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4153e7-c46c-4468-af20-c5cbfa336b1b admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:45:58.272605 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4153e7-c46c-4468-af20-c5cbfa336b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:45:58.272883 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4153e7-c46c-4468-af20-c5cbfa336b1b admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:45:58.274012 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4153e7-c46c-4468-af20-c5cbfa336b1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:45:58.276151 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4153e7-c46c-4468-af20-c5cbfa336b1b admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:45:58.387458 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724855d4-359d-4967-a845-9fbdfe226d74 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:45:58.395623 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4164/8352] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:45:58 2022] POST /identity/v3/users => generated 283 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:45:58.403561 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724855d4-359d-4967-a845-9fbdfe226d74 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:45:58.408441 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deed1f66-2c77-48d5-9cc6-6c39ee9fe535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:45:58.409142 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed1f66-2c77-48d5-9cc6-6c39ee9fe535 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:45:58.409428 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed1f66-2c77-48d5-9cc6-6c39ee9fe535 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:45:58.409708 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed1f66-2c77-48d5-9cc6-6c39ee9fe535 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:45:58.410448 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deed1f66-2c77-48d5-9cc6-6c39ee9fe535 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:45:58.412181 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deed1f66-2c77-48d5-9cc6-6c39ee9fe535 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:45:58.430732 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4153e7-c46c-4468-af20-c5cbfa336b1b admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:45:58.442006 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4153e7-c46c-4468-af20-c5cbfa336b1b admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:45:58.442661 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4189/8353] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:45:58 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:45:58.452808 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce527e3-0787-4098-8cba-9421c56e6704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:45:58.453600 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce527e3-0787-4098-8cba-9421c56e6704 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:45:58.453991 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce527e3-0787-4098-8cba-9421c56e6704 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:45:58.454342 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce527e3-0787-4098-8cba-9421c56e6704 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:45:58.455151 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce527e3-0787-4098-8cba-9421c56e6704 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:45:58.456957 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce527e3-0787-4098-8cba-9421c56e6704 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:45:58.469411 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4165/8354] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:45:58 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:45:58.473793 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deed1f66-2c77-48d5-9cc6-6c39ee9fe535 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:45:58.485105 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deed1f66-2c77-48d5-9cc6-6c39ee9fe535 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:45:58.491614 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa4c0d4-7fe1-472d-9a4f-5f8233e8670a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:45:58.495373 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa4c0d4-7fe1-472d-9a4f-5f8233e8670a admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:45:58.495373 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa4c0d4-7fe1-472d-9a4f-5f8233e8670a admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:45:58.495373 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa4c0d4-7fe1-472d-9a4f-5f8233e8670a admin admin] PATH_INFO: `/v3/projects/c2dae5c88af44b098436964aef153169/users/a29e5f84202745cb8bd8f0fc78c5ced7/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:45:58.509573 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa4c0d4-7fe1-472d-9a4f-5f8233e8670a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2dae5c88af44b098436964aef153169, user_id=a29e5f84202745cb8bd8f0fc78c5ced7, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:45:58.512487 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa4c0d4-7fe1-472d-9a4f-5f8233e8670a admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:45:58.598738 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4190/8355] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:45:58 2022] PUT /identity/v3/projects/c2dae5c88af44b098436964aef153169/users/a29e5f84202745cb8bd8f0fc78c5ced7/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:45:58.610007 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46649ac5-8f14-409e-ab49-dab2aace6f44 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:45:58.610378 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46649ac5-8f14-409e-ab49-dab2aace6f44 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:45:58.610660 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46649ac5-8f14-409e-ab49-dab2aace6f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:45:58.639225 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-46649ac5-8f14-409e-ab49-dab2aace6f44 None None] MFA Rules not processed for user `a29e5f84202745cb8bd8f0fc78c5ced7`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:45:58.640393 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-46649ac5-8f14-409e-ab49-dab2aace6f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:45:58.709392 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4166/8356] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:45:58 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:45:58.713888 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa4c0d4-7fe1-472d-9a4f-5f8233e8670a admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:45:58.792017 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa4c0d4-7fe1-472d-9a4f-5f8233e8670a admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:45:58.798488 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9ba5b1-e985-4b46-a5f9-1361dcff7e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:45:58.799262 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9ba5b1-e985-4b46-a5f9-1361dcff7e8b admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:45:58.799579 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9ba5b1-e985-4b46-a5f9-1361dcff7e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:45:58.799920 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9ba5b1-e985-4b46-a5f9-1361dcff7e8b admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:45:58.800621 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9ba5b1-e985-4b46-a5f9-1361dcff7e8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:45:58.802828 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9ba5b1-e985-4b46-a5f9-1361dcff7e8b admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:45:58.935541 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4191/8357] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:45:58 2022] POST /identity/v3/projects => generated 363 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:45:58.939581 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46649ac5-8f14-409e-ab49-dab2aace6f44 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:45:58.952429 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46649ac5-8f14-409e-ab49-dab2aace6f44 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:45:59.023831 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1d5778-9c0f-4359-8a51-3e23e51d2c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:45:59.024907 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d5778-9c0f-4359-8a51-3e23e51d2c62 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:45:59.025918 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d5778-9c0f-4359-8a51-3e23e51d2c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:45:59.026377 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d5778-9c0f-4359-8a51-3e23e51d2c62 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:45:59.027252 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1d5778-9c0f-4359-8a51-3e23e51d2c62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:45:59.029607 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1d5778-9c0f-4359-8a51-3e23e51d2c62 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:45:59.098152 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4167/8358] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:45:58 2022] POST /identity/v3/users => generated 288 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:45:59.102231 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9ba5b1-e985-4b46-a5f9-1361dcff7e8b admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:45:59.112679 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9ba5b1-e985-4b46-a5f9-1361dcff7e8b admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:45:59.121534 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1979967a-0b06-4e5b-b563-b9609ea4079f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:45:59.122070 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979967a-0b06-4e5b-b563-b9609ea4079f admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:45:59.122356 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979967a-0b06-4e5b-b563-b9609ea4079f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:45:59.122679 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979967a-0b06-4e5b-b563-b9609ea4079f admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:45:59.123419 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1979967a-0b06-4e5b-b563-b9609ea4079f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:45:59.125071 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1979967a-0b06-4e5b-b563-b9609ea4079f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:45:59.140525 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4192/8359] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:45:59 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:45:59.141920 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1d5778-9c0f-4359-8a51-3e23e51d2c62 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:45:59.156258 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1d5778-9c0f-4359-8a51-3e23e51d2c62 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:45:59.162967 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a093f09e-0908-4398-a531-cdd784e06f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:45:59.164481 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a093f09e-0908-4398-a531-cdd784e06f3a admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:45:59.164761 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a093f09e-0908-4398-a531-cdd784e06f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:45:59.165284 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a093f09e-0908-4398-a531-cdd784e06f3a admin admin] PATH_INFO: `/v3/projects/695936950f1a4bc69abb994479eff7ec/users/79d2e22c84e74b9ca605500edc6e790e/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:45:59.186313 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a093f09e-0908-4398-a531-cdd784e06f3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=695936950f1a4bc69abb994479eff7ec, user_id=79d2e22c84e74b9ca605500edc6e790e, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:45:59.189127 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a093f09e-0908-4398-a531-cdd784e06f3a admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:45:59.312970 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4168/8360] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:45:59 2022] PUT /identity/v3/projects/695936950f1a4bc69abb994479eff7ec/users/79d2e22c84e74b9ca605500edc6e790e/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:45:59.317264 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1979967a-0b06-4e5b-b563-b9609ea4079f admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:45:59.329773 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1979967a-0b06-4e5b-b563-b9609ea4079f admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:45:59.390589 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dde578-1f4c-4e3a-9b02-e2b7a0f60d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:45:59.391734 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dde578-1f4c-4e3a-9b02-e2b7a0f60d26 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:45:59.391734 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dde578-1f4c-4e3a-9b02-e2b7a0f60d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:45:59.392991 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dde578-1f4c-4e3a-9b02-e2b7a0f60d26 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:45:59.392991 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dde578-1f4c-4e3a-9b02-e2b7a0f60d26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:45:59.394624 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dde578-1f4c-4e3a-9b02-e2b7a0f60d26 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:45:59.407850 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4193/8361] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:45:59 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:45:59.411986 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a093f09e-0908-4398-a531-cdd784e06f3a admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:45:59.425615 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a093f09e-0908-4398-a531-cdd784e06f3a admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:45:59.431240 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41488b1c-16a2-446b-b898-3f882355679c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:45:59.432179 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41488b1c-16a2-446b-b898-3f882355679c admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:45:59.432457 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41488b1c-16a2-446b-b898-3f882355679c admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:45:59.432728 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41488b1c-16a2-446b-b898-3f882355679c admin admin] PATH_INFO: `/v3/projects/695936950f1a4bc69abb994479eff7ec/users/79d2e22c84e74b9ca605500edc6e790e/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:45:59.435719 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41488b1c-16a2-446b-b898-3f882355679c admin admin] RBAC: Authorizing `identity:create_grant(project_id=695936950f1a4bc69abb994479eff7ec, user_id=79d2e22c84e74b9ca605500edc6e790e, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:45:59.438453 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41488b1c-16a2-446b-b898-3f882355679c admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:45:59.450198 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4169/8362] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:45:59 2022] PUT /identity/v3/projects/695936950f1a4bc69abb994479eff7ec/users/79d2e22c84e74b9ca605500edc6e790e/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:45:59.461452 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d188985c-28ce-4578-aa16-cb894231b09e None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:45:59.461734 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d188985c-28ce-4578-aa16-cb894231b09e None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:45:59.462013 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d188985c-28ce-4578-aa16-cb894231b09e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:45:59.497286 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-d188985c-28ce-4578-aa16-cb894231b09e None None] MFA Rules not processed for user `79d2e22c84e74b9ca605500edc6e790e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:45:59.498738 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d188985c-28ce-4578-aa16-cb894231b09e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:45:59.570978 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4194/8363] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:45:59 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:45:59.582511 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41488b1c-16a2-446b-b898-3f882355679c admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:45:59.584449 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-41488b1c-16a2-446b-b898-3f882355679c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:45:59.664936 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41488b1c-16a2-446b-b898-3f882355679c admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:45:59.669166 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36152c8-6d2d-4365-806e-54997030e808 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198271d1c0d44cb58bace41a65f4b94c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:45:59.669848 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36152c8-6d2d-4365-806e-54997030e808 service cinder] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:45:59.670138 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36152c8-6d2d-4365-806e-54997030e808 service cinder] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:45:59.670408 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36152c8-6d2d-4365-806e-54997030e808 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:45:59.681439 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36152c8-6d2d-4365-806e-54997030e808 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:45:59.682931 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36152c8-6d2d-4365-806e-54997030e808 service cinder] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:45:59.695894 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4170/8364] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:45:59 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:45:59.969604 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d188985c-28ce-4578-aa16-cb894231b09e None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:45:59.973791 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d188985c-28ce-4578-aa16-cb894231b09e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:45:59.995108 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d188985c-28ce-4578-aa16-cb894231b09e None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:00.004675 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157c27b1-5aa1-4a67-beea-306d4a276e64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198271d1c0d44cb58bace41a65f4b94c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:00.005723 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c27b1-5aa1-4a67-beea-306d4a276e64 service cinder] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:00.006522 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c27b1-5aa1-4a67-beea-306d4a276e64 service cinder] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:00.007363 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c27b1-5aa1-4a67-beea-306d4a276e64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:00.077664 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157c27b1-5aa1-4a67-beea-306d4a276e64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:00.079316 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157c27b1-5aa1-4a67-beea-306d4a276e64 service cinder] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:00.090479 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4195/8365] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:45:59 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:46:00.996687 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cabc8c1-271f-47ec-9686-9ec91996582b None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:00.997236 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cabc8c1-271f-47ec-9686-9ec91996582b None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:00.997502 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cabc8c1-271f-47ec-9686-9ec91996582b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:01.032607 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-1cabc8c1-271f-47ec-9686-9ec91996582b None None] MFA Rules not processed for user `2c025653d74848899a26c661400279cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:46:01.033876 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-1cabc8c1-271f-47ec-9686-9ec91996582b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:46:01.121831 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4171/8366] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:46:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:46:01.126058 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157c27b1-5aa1-4a67-beea-306d4a276e64 service cinder] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:01.129036 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-157c27b1-5aa1-4a67-beea-306d4a276e64 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:46:01.208529 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157c27b1-5aa1-4a67-beea-306d4a276e64 service cinder] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:01.213974 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95624d8-1646-49ef-9a35-c3d0f2303e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:01.214644 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95624d8-1646-49ef-9a35-c3d0f2303e2d admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:01.214909 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95624d8-1646-49ef-9a35-c3d0f2303e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:01.215175 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95624d8-1646-49ef-9a35-c3d0f2303e2d admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:01.215880 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95624d8-1646-49ef-9a35-c3d0f2303e2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:01.217790 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95624d8-1646-49ef-9a35-c3d0f2303e2d admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:01.281152 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4196/8367] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:46:01 2022] POST /identity/v3/projects => generated 371 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:46:01.284985 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cabc8c1-271f-47ec-9686-9ec91996582b None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:01.297034 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cabc8c1-271f-47ec-9686-9ec91996582b None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:01.352888 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e297ea9-ec9d-458e-ac09-231d3835bf5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:01.353560 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e297ea9-ec9d-458e-ac09-231d3835bf5d admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:01.353849 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e297ea9-ec9d-458e-ac09-231d3835bf5d admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:01.354127 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e297ea9-ec9d-458e-ac09-231d3835bf5d admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:01.354828 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e297ea9-ec9d-458e-ac09-231d3835bf5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:01.356779 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e297ea9-ec9d-458e-ac09-231d3835bf5d admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:01.446816 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4172/8368] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:46:01 2022] POST /identity/v3/users => generated 292 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:46:01.448642 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95624d8-1646-49ef-9a35-c3d0f2303e2d admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:01.460660 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95624d8-1646-49ef-9a35-c3d0f2303e2d admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:01.465512 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30edc6b0-dd4c-4696-9c9c-56d318be71e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:01.466174 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30edc6b0-dd4c-4696-9c9c-56d318be71e9 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:01.466455 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30edc6b0-dd4c-4696-9c9c-56d318be71e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:01.466727 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30edc6b0-dd4c-4696-9c9c-56d318be71e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:01.467460 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30edc6b0-dd4c-4696-9c9c-56d318be71e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:01.469170 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30edc6b0-dd4c-4696-9c9c-56d318be71e9 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:01.481001 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4197/8369] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:46:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:46:01.485258 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e297ea9-ec9d-458e-ac09-231d3835bf5d admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:01.496253 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e297ea9-ec9d-458e-ac09-231d3835bf5d admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:01.500856 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f41d5f-613d-4ba1-89b1-bf5b6fd921ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:01.501743 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f41d5f-613d-4ba1-89b1-bf5b6fd921ef admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:01.502131 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f41d5f-613d-4ba1-89b1-bf5b6fd921ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:01.502814 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f41d5f-613d-4ba1-89b1-bf5b6fd921ef admin admin] PATH_INFO: `/v3/projects/7f6c8f9c935949279017bfea2c70ba05/users/93cbfa892fac40ca9defc688ef831a62/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:01.517857 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f41d5f-613d-4ba1-89b1-bf5b6fd921ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f6c8f9c935949279017bfea2c70ba05, user_id=93cbfa892fac40ca9defc688ef831a62, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:01.520718 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f41d5f-613d-4ba1-89b1-bf5b6fd921ef admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:01.640310 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4173/8370] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:46:01 2022] PUT /identity/v3/projects/7f6c8f9c935949279017bfea2c70ba05/users/93cbfa892fac40ca9defc688ef831a62/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:46:01.644275 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30edc6b0-dd4c-4696-9c9c-56d318be71e9 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:01.656751 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30edc6b0-dd4c-4696-9c9c-56d318be71e9 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:01.727390 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97c7c39-bc70-479c-b80a-a777ac57fc29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:01.728132 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c7c39-bc70-479c-b80a-a777ac57fc29 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:01.728569 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c7c39-bc70-479c-b80a-a777ac57fc29 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:01.728836 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c7c39-bc70-479c-b80a-a777ac57fc29 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:01.729580 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97c7c39-bc70-479c-b80a-a777ac57fc29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:01.731207 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97c7c39-bc70-479c-b80a-a777ac57fc29 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:01.741911 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4198/8371] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:46:01 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:46:01.746157 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f41d5f-613d-4ba1-89b1-bf5b6fd921ef admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:01.758143 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f41d5f-613d-4ba1-89b1-bf5b6fd921ef admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:01.763215 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840a1115-2024-4a4f-99f1-a7c3da6ee610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:01.764135 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a1115-2024-4a4f-99f1-a7c3da6ee610 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:01.764417 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a1115-2024-4a4f-99f1-a7c3da6ee610 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:01.764687 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a1115-2024-4a4f-99f1-a7c3da6ee610 admin admin] PATH_INFO: `/v3/projects/7f6c8f9c935949279017bfea2c70ba05/users/93cbfa892fac40ca9defc688ef831a62/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:01.766646 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840a1115-2024-4a4f-99f1-a7c3da6ee610 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f6c8f9c935949279017bfea2c70ba05, user_id=93cbfa892fac40ca9defc688ef831a62, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:01.769428 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840a1115-2024-4a4f-99f1-a7c3da6ee610 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:01.781495 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4174/8372] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:46:01 2022] PUT /identity/v3/projects/7f6c8f9c935949279017bfea2c70ba05/users/93cbfa892fac40ca9defc688ef831a62/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:46:07.860003 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5109508-25a2-4f30-ad62-4d12ac9e79eb None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:07.860555 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5109508-25a2-4f30-ad62-4d12ac9e79eb None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:07.860555 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5109508-25a2-4f30-ad62-4d12ac9e79eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:07.889992 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-c5109508-25a2-4f30-ad62-4d12ac9e79eb None None] MFA Rules not processed for user `93cbfa892fac40ca9defc688ef831a62`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:46:07.891268 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c5109508-25a2-4f30-ad62-4d12ac9e79eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:46:07.973171 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4199/8373] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:46:07 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:46:07.989032 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840a1115-2024-4a4f-99f1-a7c3da6ee610 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:07.991828 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-840a1115-2024-4a4f-99f1-a7c3da6ee610 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:46:08.072869 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840a1115-2024-4a4f-99f1-a7c3da6ee610 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:08.078494 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e433c32-41cc-4384-bbb1-be79ac4804ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:08.079157 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e433c32-41cc-4384-bbb1-be79ac4804ac service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:08.079435 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e433c32-41cc-4384-bbb1-be79ac4804ac service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:08.079731 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e433c32-41cc-4384-bbb1-be79ac4804ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:08.155966 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e433c32-41cc-4384-bbb1-be79ac4804ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:08.158282 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e433c32-41cc-4384-bbb1-be79ac4804ac service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:08.180316 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4175/8374] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:46:07 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:46:11.942902 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2722f4-d2e7-430f-a198-3922449fb960 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:11.943927 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2722f4-d2e7-430f-a198-3922449fb960 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:11.944420 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2722f4-d2e7-430f-a198-3922449fb960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:11.965758 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-ba2722f4-d2e7-430f-a198-3922449fb960 None None] MFA Rules not processed for user `2c025653d74848899a26c661400279cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:46:11.967069 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ba2722f4-d2e7-430f-a198-3922449fb960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:46:11.988204 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4200/8375] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:46:11 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:46:22.111873 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e433c32-41cc-4384-bbb1-be79ac4804ac service nova] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:22.139064 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e433c32-41cc-4384-bbb1-be79ac4804ac service nova] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:22.145211 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9bee6d-8981-408a-bf07-d712eb502169 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:22.145876 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9bee6d-8981-408a-bf07-d712eb502169 service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:22.146162 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9bee6d-8981-408a-bf07-d712eb502169 service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:22.146437 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9bee6d-8981-408a-bf07-d712eb502169 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:22.148574 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-7a9bee6d-8981-408a-bf07-d712eb502169 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:46:22.165725 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9bee6d-8981-408a-bf07-d712eb502169 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:22.168036 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9bee6d-8981-408a-bf07-d712eb502169 service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:22.183639 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4176/8376] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:46:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:46:29.570402 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2722f4-d2e7-430f-a198-3922449fb960 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:29.572385 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ba2722f4-d2e7-430f-a198-3922449fb960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:46:29.637491 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2722f4-d2e7-430f-a198-3922449fb960 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:29.641988 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a487d-4614-4876-ae6e-9a00f24453b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:29.642889 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a487d-4614-4876-ae6e-9a00f24453b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:29.643175 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a487d-4614-4876-ae6e-9a00f24453b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:29.643452 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a487d-4614-4876-ae6e-9a00f24453b6 admin admin] PATH_INFO: `/v3/users/80f409708620474aa128bf8412fa54be` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:29.644685 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a487d-4614-4876-ae6e-9a00f24453b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80f409708620474aa128bf8412fa54be)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:29.646614 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a487d-4614-4876-ae6e-9a00f24453b6 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:29.806651 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-de5a487d-4614-4876-ae6e-9a00f24453b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80f409708620474aa128bf8412fa54be'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:46:29.823729 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-de5a487d-4614-4876-ae6e-9a00f24453b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80f409708620474aa128bf8412fa54be'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:46:29.830658 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-de5a487d-4614-4876-ae6e-9a00f24453b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80f409708620474aa128bf8412fa54be'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:46:29.917766 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-de5a487d-4614-4876-ae6e-9a00f24453b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80f409708620474aa128bf8412fa54be'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:46:29.918538 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-de5a487d-4614-4876-ae6e-9a00f24453b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80f409708620474aa128bf8412fa54be'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:46:29.929463 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4201/8377] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:46:29 2022] DELETE /identity/v3/users/80f409708620474aa128bf8412fa54be => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:46:29.934567 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7516dd9-3c8e-4c01-90cc-b7f2bffad567 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:29.935004 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7516dd9-3c8e-4c01-90cc-b7f2bffad567 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:29.935307 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7516dd9-3c8e-4c01-90cc-b7f2bffad567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:29.953718 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-e7516dd9-3c8e-4c01-90cc-b7f2bffad567 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:46:29.954957 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e7516dd9-3c8e-4c01-90cc-b7f2bffad567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:46:30.013898 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4177/8378] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:46:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:46:30.023692 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a487d-4614-4876-ae6e-9a00f24453b6 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:30.025677 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-de5a487d-4614-4876-ae6e-9a00f24453b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:46:30.088472 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a487d-4614-4876-ae6e-9a00f24453b6 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:30.092195 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb09fcc-a99c-4d38-abcb-fb7f4f5fcfae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:30.092845 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb09fcc-a99c-4d38-abcb-fb7f4f5fcfae service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:30.093228 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb09fcc-a99c-4d38-abcb-fb7f4f5fcfae service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:30.093484 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb09fcc-a99c-4d38-abcb-fb7f4f5fcfae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:30.103792 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb09fcc-a99c-4d38-abcb-fb7f4f5fcfae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:30.105827 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb09fcc-a99c-4d38-abcb-fb7f4f5fcfae service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:30.116072 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4202/8379] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:46:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:46:30.222602 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7516dd9-3c8e-4c01-90cc-b7f2bffad567 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:30.224209 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e7516dd9-3c8e-4c01-90cc-b7f2bffad567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:46:30.240400 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7516dd9-3c8e-4c01-90cc-b7f2bffad567 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:30.245173 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a73c0c-1816-4c73-a477-a604c8f634e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:30.245824 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a73c0c-1816-4c73-a477-a604c8f634e2 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:30.246288 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a73c0c-1816-4c73-a477-a604c8f634e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:30.246565 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a73c0c-1816-4c73-a477-a604c8f634e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:30.248530 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-94a73c0c-1816-4c73-a477-a604c8f634e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:46:30.318694 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a73c0c-1816-4c73-a477-a604c8f634e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:30.320097 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a73c0c-1816-4c73-a477-a604c8f634e2 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:30.329617 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4178/8380] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:46:30 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:46:30.372218 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb09fcc-a99c-4d38-abcb-fb7f4f5fcfae service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:30.373844 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-9cb09fcc-a99c-4d38-abcb-fb7f4f5fcfae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:46:30.391095 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb09fcc-a99c-4d38-abcb-fb7f4f5fcfae service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:30.397384 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61b44af-12fe-4988-bd16-bfca15e52081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:30.399902 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b44af-12fe-4988-bd16-bfca15e52081 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:30.400255 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b44af-12fe-4988-bd16-bfca15e52081 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:30.400562 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b44af-12fe-4988-bd16-bfca15e52081 admin admin] PATH_INFO: `/v3/projects/8526cad5fef54772a988df44138c90fe` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:30.401798 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61b44af-12fe-4988-bd16-bfca15e52081 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8526cad5fef54772a988df44138c90fe)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:30.403776 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61b44af-12fe-4988-bd16-bfca15e52081 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:30.508024 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f61b44af-12fe-4988-bd16-bfca15e52081 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8526cad5fef54772a988df44138c90fe', 'request_id': 'req-f61b44af-12fe-4988-bd16-bfca15e52081'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:46:30.513747 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f61b44af-12fe-4988-bd16-bfca15e52081 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8526cad5fef54772a988df44138c90fe', 'request_id': 'req-f61b44af-12fe-4988-bd16-bfca15e52081'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:46:30.598732 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f61b44af-12fe-4988-bd16-bfca15e52081 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8526cad5fef54772a988df44138c90fe', 'request_id': 'req-f61b44af-12fe-4988-bd16-bfca15e52081'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:46:30.611489 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f61b44af-12fe-4988-bd16-bfca15e52081 admin admin] The token cache is being invalidate because project 8526cad5fef54772a988df44138c90fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:46:30.611805 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f61b44af-12fe-4988-bd16-bfca15e52081 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:46:30.612463 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f61b44af-12fe-4988-bd16-bfca15e52081 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:46:30.614014 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4203/8381] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:46:30 2022] DELETE /identity/v3/projects/8526cad5fef54772a988df44138c90fe => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:46:30.629720 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ea9b6-deb0-4237-b3e3-70adbc437a0f None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:30.629720 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ea9b6-deb0-4237-b3e3-70adbc437a0f None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:30.629720 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ea9b6-deb0-4237-b3e3-70adbc437a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:30.639554 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-772ea9b6-deb0-4237-b3e3-70adbc437a0f None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:46:30.640759 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-772ea9b6-deb0-4237-b3e3-70adbc437a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:46:30.700360 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4179/8382] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:46:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:46:30.708407 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6a4d3-14d0-47aa-936c-aa5626c13a8c None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:30.708792 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6a4d3-14d0-47aa-936c-aa5626c13a8c None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:30.709475 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6a4d3-14d0-47aa-936c-aa5626c13a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:30.728844 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-25c6a4d3-14d0-47aa-936c-aa5626c13a8c None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:46:30.730043 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-25c6a4d3-14d0-47aa-936c-aa5626c13a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:46:30.738373 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4204/8383] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:46:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:46:30.742605 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772ea9b6-deb0-4237-b3e3-70adbc437a0f None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:30.753834 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772ea9b6-deb0-4237-b3e3-70adbc437a0f None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:30.758750 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889c442b-08d9-468b-9845-56b6725f3178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:30.759701 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c442b-08d9-468b-9845-56b6725f3178 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:30.759988 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c442b-08d9-468b-9845-56b6725f3178 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:30.760268 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c442b-08d9-468b-9845-56b6725f3178 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:30.761006 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889c442b-08d9-468b-9845-56b6725f3178 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:46:30.761347 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889c442b-08d9-468b-9845-56b6725f3178 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:30.763048 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889c442b-08d9-468b-9845-56b6725f3178 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:30.776268 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4180/8384] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:46:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:46:30.780684 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c6a4d3-14d0-47aa-936c-aa5626c13a8c None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:30.790780 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c6a4d3-14d0-47aa-936c-aa5626c13a8c None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:30.796018 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd600af-bf8e-49fb-a52c-325f85cbadfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:30.796674 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd600af-bf8e-49fb-a52c-325f85cbadfc admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:30.796956 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd600af-bf8e-49fb-a52c-325f85cbadfc admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:30.797228 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd600af-bf8e-49fb-a52c-325f85cbadfc admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:30.797909 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd600af-bf8e-49fb-a52c-325f85cbadfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:30.799856 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd600af-bf8e-49fb-a52c-325f85cbadfc admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:30.905706 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4205/8385] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:46:30 2022] POST /identity/v3/projects => generated 387 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:46:30.907148 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889c442b-08d9-468b-9845-56b6725f3178 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:30.918784 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889c442b-08d9-468b-9845-56b6725f3178 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:30.977521 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa226c7-bb3a-4ab4-8711-b9a210d1e56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:30.978862 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa226c7-bb3a-4ab4-8711-b9a210d1e56e admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:30.979149 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa226c7-bb3a-4ab4-8711-b9a210d1e56e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:30.979428 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa226c7-bb3a-4ab4-8711-b9a210d1e56e admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:30.980236 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa226c7-bb3a-4ab4-8711-b9a210d1e56e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:30.982260 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa226c7-bb3a-4ab4-8711-b9a210d1e56e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:31.090259 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4181/8386] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:46:30 2022] POST /identity/v3/users => generated 294 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:46:31.094435 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd600af-bf8e-49fb-a52c-325f85cbadfc admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:31.105962 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd600af-bf8e-49fb-a52c-325f85cbadfc admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:31.111015 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcba5dc6-008d-4041-b093-50d27f9f27cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:31.111817 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba5dc6-008d-4041-b093-50d27f9f27cf admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:31.112237 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba5dc6-008d-4041-b093-50d27f9f27cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:31.112592 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba5dc6-008d-4041-b093-50d27f9f27cf admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:31.113394 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcba5dc6-008d-4041-b093-50d27f9f27cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:31.115747 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcba5dc6-008d-4041-b093-50d27f9f27cf admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:31.132926 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4206/8387] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:46:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:46:31.133159 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa226c7-bb3a-4ab4-8711-b9a210d1e56e admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:31.141426 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa226c7-bb3a-4ab4-8711-b9a210d1e56e admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:31.146094 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d021f0d-1a4b-40e8-9584-028dc2cccd0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:31.146758 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d021f0d-1a4b-40e8-9584-028dc2cccd0f admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:31.147051 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d021f0d-1a4b-40e8-9584-028dc2cccd0f admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:31.147328 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d021f0d-1a4b-40e8-9584-028dc2cccd0f admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:31.148089 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d021f0d-1a4b-40e8-9584-028dc2cccd0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:31.150044 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d021f0d-1a4b-40e8-9584-028dc2cccd0f admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:31.160313 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4182/8388] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:46:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:46:31.164353 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcba5dc6-008d-4041-b093-50d27f9f27cf admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:31.174969 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcba5dc6-008d-4041-b093-50d27f9f27cf admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:31.179662 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311de62c-fd28-47ad-a19c-731004b7ce8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:31.180545 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311de62c-fd28-47ad-a19c-731004b7ce8d admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:31.180831 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311de62c-fd28-47ad-a19c-731004b7ce8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:31.181190 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311de62c-fd28-47ad-a19c-731004b7ce8d admin admin] PATH_INFO: `/v3/projects/9d47cde4b8ee4dbc9ad64de4084690a9/users/e9982f39ae394932a2fb8c9e4d456d8d/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:31.196911 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311de62c-fd28-47ad-a19c-731004b7ce8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d47cde4b8ee4dbc9ad64de4084690a9, user_id=e9982f39ae394932a2fb8c9e4d456d8d, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:31.199741 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311de62c-fd28-47ad-a19c-731004b7ce8d admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:31.283751 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4207/8389] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:46:31 2022] PUT /identity/v3/projects/9d47cde4b8ee4dbc9ad64de4084690a9/users/e9982f39ae394932a2fb8c9e4d456d8d/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:46:31.294866 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad826b7-a4a7-44f4-85cf-5ce8b4df1248 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:31.295251 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad826b7-a4a7-44f4-85cf-5ce8b4df1248 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:31.295547 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad826b7-a4a7-44f4-85cf-5ce8b4df1248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:31.323217 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-6ad826b7-a4a7-44f4-85cf-5ce8b4df1248 None None] MFA Rules not processed for user `e9982f39ae394932a2fb8c9e4d456d8d`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:46:31.324986 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-6ad826b7-a4a7-44f4-85cf-5ce8b4df1248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:46:31.392531 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4183/8390] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:46:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:46:31.396919 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311de62c-fd28-47ad-a19c-731004b7ce8d admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:31.458289 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311de62c-fd28-47ad-a19c-731004b7ce8d admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:31.463706 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e248305f-a7a7-4e92-8740-b55c8d99f7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:31.464371 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248305f-a7a7-4e92-8740-b55c8d99f7e6 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:31.464738 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248305f-a7a7-4e92-8740-b55c8d99f7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:31.465005 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248305f-a7a7-4e92-8740-b55c8d99f7e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:31.465691 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e248305f-a7a7-4e92-8740-b55c8d99f7e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:31.467662 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e248305f-a7a7-4e92-8740-b55c8d99f7e6 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:31.593514 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4208/8391] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:46:31 2022] POST /identity/v3/projects => generated 389 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:46:31.597567 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad826b7-a4a7-44f4-85cf-5ce8b4df1248 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:31.612653 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad826b7-a4a7-44f4-85cf-5ce8b4df1248 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:31.674827 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27803b54-f6d5-431e-b7d6-1dbee968315c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:31.675534 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27803b54-f6d5-431e-b7d6-1dbee968315c admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:31.675826 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27803b54-f6d5-431e-b7d6-1dbee968315c admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:31.676151 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27803b54-f6d5-431e-b7d6-1dbee968315c admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:31.676790 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27803b54-f6d5-431e-b7d6-1dbee968315c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:31.678714 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27803b54-f6d5-431e-b7d6-1dbee968315c admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:31.764192 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4184/8392] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:46:31 2022] POST /identity/v3/users => generated 301 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:46:31.768062 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e248305f-a7a7-4e92-8740-b55c8d99f7e6 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:31.779885 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e248305f-a7a7-4e92-8740-b55c8d99f7e6 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:31.784815 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcb4b38-9a5b-4f83-b73d-92e6b0fdd844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:31.785429 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb4b38-9a5b-4f83-b73d-92e6b0fdd844 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:31.785640 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb4b38-9a5b-4f83-b73d-92e6b0fdd844 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:31.785934 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb4b38-9a5b-4f83-b73d-92e6b0fdd844 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:31.786638 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcb4b38-9a5b-4f83-b73d-92e6b0fdd844 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:31.788353 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcb4b38-9a5b-4f83-b73d-92e6b0fdd844 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:31.801055 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4209/8393] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:46:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:46:31.805324 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27803b54-f6d5-431e-b7d6-1dbee968315c admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:31.818726 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27803b54-f6d5-431e-b7d6-1dbee968315c admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:31.824458 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be258ca6-eb93-47df-bd79-68de13c0ff0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:31.825664 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be258ca6-eb93-47df-bd79-68de13c0ff0c admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:31.825949 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be258ca6-eb93-47df-bd79-68de13c0ff0c admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:31.826227 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be258ca6-eb93-47df-bd79-68de13c0ff0c admin admin] PATH_INFO: `/v3/projects/4c8d288bc5c1457bba2b72854fd2d328/users/f2ffdc7ae79e469e9bf232ffb1d5ff3b/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:31.842610 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be258ca6-eb93-47df-bd79-68de13c0ff0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c8d288bc5c1457bba2b72854fd2d328, user_id=f2ffdc7ae79e469e9bf232ffb1d5ff3b, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:31.845308 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be258ca6-eb93-47df-bd79-68de13c0ff0c admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:31.902987 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4185/8394] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:46:31 2022] PUT /identity/v3/projects/4c8d288bc5c1457bba2b72854fd2d328/users/f2ffdc7ae79e469e9bf232ffb1d5ff3b/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:46:31.907113 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcb4b38-9a5b-4f83-b73d-92e6b0fdd844 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:31.922619 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcb4b38-9a5b-4f83-b73d-92e6b0fdd844 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:31.988498 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61d852c-4e78-4b56-9313-f493382559a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:31.989205 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d852c-4e78-4b56-9313-f493382559a8 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:31.989485 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d852c-4e78-4b56-9313-f493382559a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:31.989761 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d852c-4e78-4b56-9313-f493382559a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:31.990468 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61d852c-4e78-4b56-9313-f493382559a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:31.992131 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61d852c-4e78-4b56-9313-f493382559a8 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:32.003027 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4210/8395] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:46:31 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:46:32.007310 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be258ca6-eb93-47df-bd79-68de13c0ff0c admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:32.018125 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be258ca6-eb93-47df-bd79-68de13c0ff0c admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:32.022842 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed85ef7-0668-4253-a8c7-16fe73976660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:32.024036 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed85ef7-0668-4253-a8c7-16fe73976660 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:32.026414 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed85ef7-0668-4253-a8c7-16fe73976660 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:32.026414 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed85ef7-0668-4253-a8c7-16fe73976660 admin admin] PATH_INFO: `/v3/projects/4c8d288bc5c1457bba2b72854fd2d328/users/f2ffdc7ae79e469e9bf232ffb1d5ff3b/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:32.027173 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed85ef7-0668-4253-a8c7-16fe73976660 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c8d288bc5c1457bba2b72854fd2d328, user_id=f2ffdc7ae79e469e9bf232ffb1d5ff3b, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:32.029904 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed85ef7-0668-4253-a8c7-16fe73976660 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:32.041424 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4186/8396] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:46:32 2022] PUT /identity/v3/projects/4c8d288bc5c1457bba2b72854fd2d328/users/f2ffdc7ae79e469e9bf232ffb1d5ff3b/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:46:32.052056 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf36b93-1ac9-4e46-a89f-26ed945c1e33 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:32.052346 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf36b93-1ac9-4e46-a89f-26ed945c1e33 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:32.052621 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf36b93-1ac9-4e46-a89f-26ed945c1e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:32.081269 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-edf36b93-1ac9-4e46-a89f-26ed945c1e33 None None] MFA Rules not processed for user `f2ffdc7ae79e469e9bf232ffb1d5ff3b`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:46:32.082637 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-edf36b93-1ac9-4e46-a89f-26ed945c1e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:46:32.153804 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4211/8397] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:46:32 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:46:32.168383 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed85ef7-0668-4253-a8c7-16fe73976660 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:32.170182 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-2ed85ef7-0668-4253-a8c7-16fe73976660 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:46:32.257491 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed85ef7-0668-4253-a8c7-16fe73976660 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:32.266905 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca353f15-f706-4d91-b079-11a3e8c17787 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:32.268047 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca353f15-f706-4d91-b079-11a3e8c17787 service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:32.268542 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca353f15-f706-4d91-b079-11a3e8c17787 service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:32.269026 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca353f15-f706-4d91-b079-11a3e8c17787 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:32.334549 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca353f15-f706-4d91-b079-11a3e8c17787 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:32.336215 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca353f15-f706-4d91-b079-11a3e8c17787 service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:32.346147 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4187/8398] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:46:32 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:46:33.014109 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf36b93-1ac9-4e46-a89f-26ed945c1e33 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:33.019110 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-edf36b93-1ac9-4e46-a89f-26ed945c1e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:46:33.090789 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf36b93-1ac9-4e46-a89f-26ed945c1e33 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:33.095578 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20d6779-fcf2-4096-8eea-8fe93260f60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:33.096453 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d6779-fcf2-4096-8eea-8fe93260f60c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:33.096731 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d6779-fcf2-4096-8eea-8fe93260f60c admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:33.097003 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d6779-fcf2-4096-8eea-8fe93260f60c admin admin] PATH_INFO: `/v3/users/a29e5f84202745cb8bd8f0fc78c5ced7` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:33.098184 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20d6779-fcf2-4096-8eea-8fe93260f60c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a29e5f84202745cb8bd8f0fc78c5ced7)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:33.100152 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20d6779-fcf2-4096-8eea-8fe93260f60c admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:33.267119 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c20d6779-fcf2-4096-8eea-8fe93260f60c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a29e5f84202745cb8bd8f0fc78c5ced7'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:46:33.281305 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c20d6779-fcf2-4096-8eea-8fe93260f60c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a29e5f84202745cb8bd8f0fc78c5ced7'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:46:33.288072 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c20d6779-fcf2-4096-8eea-8fe93260f60c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a29e5f84202745cb8bd8f0fc78c5ced7'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:46:33.369589 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c20d6779-fcf2-4096-8eea-8fe93260f60c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a29e5f84202745cb8bd8f0fc78c5ced7'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:46:33.370378 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-c20d6779-fcf2-4096-8eea-8fe93260f60c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a29e5f84202745cb8bd8f0fc78c5ced7'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:46:33.377295 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4212/8399] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:46:33 2022] DELETE /identity/v3/users/a29e5f84202745cb8bd8f0fc78c5ced7 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:46:33.382515 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b10895-3c8a-48b4-8781-d29a15f50fee None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:33.383014 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b10895-3c8a-48b4-8781-d29a15f50fee None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:33.383390 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b10895-3c8a-48b4-8781-d29a15f50fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:33.403401 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-c8b10895-3c8a-48b4-8781-d29a15f50fee None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:46:33.404806 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c8b10895-3c8a-48b4-8781-d29a15f50fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:46:33.474431 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4188/8400] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:46:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:46:33.484801 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20d6779-fcf2-4096-8eea-8fe93260f60c admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:33.486269 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c20d6779-fcf2-4096-8eea-8fe93260f60c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:46:33.553272 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20d6779-fcf2-4096-8eea-8fe93260f60c admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:33.557893 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed43534-147b-4fee-aa9d-0d1ed8f668c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:33.563001 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed43534-147b-4fee-aa9d-0d1ed8f668c2 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:33.563001 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed43534-147b-4fee-aa9d-0d1ed8f668c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:33.563001 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed43534-147b-4fee-aa9d-0d1ed8f668c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:33.568978 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed43534-147b-4fee-aa9d-0d1ed8f668c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:33.570522 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed43534-147b-4fee-aa9d-0d1ed8f668c2 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:33.581934 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4213/8401] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:46:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:46:34.351239 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b10895-3c8a-48b4-8781-d29a15f50fee None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:34.351239 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c8b10895-3c8a-48b4-8781-d29a15f50fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:46:34.366454 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b10895-3c8a-48b4-8781-d29a15f50fee None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:34.372749 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2427be6-a863-4e5c-a3e5-d0e57e7390d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:34.373672 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2427be6-a863-4e5c-a3e5-d0e57e7390d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:34.374073 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2427be6-a863-4e5c-a3e5-d0e57e7390d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:34.374283 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2427be6-a863-4e5c-a3e5-d0e57e7390d0 admin admin] PATH_INFO: `/v3/projects/c2dae5c88af44b098436964aef153169` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:34.375423 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2427be6-a863-4e5c-a3e5-d0e57e7390d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2dae5c88af44b098436964aef153169)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:34.377678 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2427be6-a863-4e5c-a3e5-d0e57e7390d0 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:34.485425 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c2427be6-a863-4e5c-a3e5-d0e57e7390d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2dae5c88af44b098436964aef153169', 'request_id': 'req-c2427be6-a863-4e5c-a3e5-d0e57e7390d0'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:46:34.491932 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c2427be6-a863-4e5c-a3e5-d0e57e7390d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2dae5c88af44b098436964aef153169', 'request_id': 'req-c2427be6-a863-4e5c-a3e5-d0e57e7390d0'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:46:34.498909 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c2427be6-a863-4e5c-a3e5-d0e57e7390d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2dae5c88af44b098436964aef153169', 'request_id': 'req-c2427be6-a863-4e5c-a3e5-d0e57e7390d0'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:46:34.568599 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c2427be6-a863-4e5c-a3e5-d0e57e7390d0 admin admin] The token cache is being invalidate because project c2dae5c88af44b098436964aef153169 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:46:34.568887 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c2427be6-a863-4e5c-a3e5-d0e57e7390d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:46:34.569608 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-c2427be6-a863-4e5c-a3e5-d0e57e7390d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:46:34.571206 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4189/8402] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:46:34 2022] DELETE /identity/v3/projects/c2dae5c88af44b098436964aef153169 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:46:34.575913 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed43534-147b-4fee-aa9d-0d1ed8f668c2 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:34.586348 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed43534-147b-4fee-aa9d-0d1ed8f668c2 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:34.647200 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e969efe6-b956-4629-b282-51f7abd7d5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:34.648130 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e969efe6-b956-4629-b282-51f7abd7d5d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:34.648673 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e969efe6-b956-4629-b282-51f7abd7d5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:34.648947 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e969efe6-b956-4629-b282-51f7abd7d5d7 admin admin] PATH_INFO: `/v3/users/79d2e22c84e74b9ca605500edc6e790e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:34.651879 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e969efe6-b956-4629-b282-51f7abd7d5d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79d2e22c84e74b9ca605500edc6e790e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:34.653969 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e969efe6-b956-4629-b282-51f7abd7d5d7 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:34.822914 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e969efe6-b956-4629-b282-51f7abd7d5d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79d2e22c84e74b9ca605500edc6e790e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:46:34.834423 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e969efe6-b956-4629-b282-51f7abd7d5d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79d2e22c84e74b9ca605500edc6e790e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:46:34.841199 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e969efe6-b956-4629-b282-51f7abd7d5d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79d2e22c84e74b9ca605500edc6e790e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:46:34.900863 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e969efe6-b956-4629-b282-51f7abd7d5d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79d2e22c84e74b9ca605500edc6e790e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:46:34.901528 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e969efe6-b956-4629-b282-51f7abd7d5d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79d2e22c84e74b9ca605500edc6e790e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:46:34.908402 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4214/8403] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:46:34 2022] DELETE /identity/v3/users/79d2e22c84e74b9ca605500edc6e790e => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:46:35.478875 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2427be6-a863-4e5c-a3e5-d0e57e7390d0 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:35.480539 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c2427be6-a863-4e5c-a3e5-d0e57e7390d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:46:35.498296 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2427be6-a863-4e5c-a3e5-d0e57e7390d0 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:35.569220 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f92062-7c98-4083-83f6-477bcf515563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:35.571885 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f92062-7c98-4083-83f6-477bcf515563 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:35.572687 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f92062-7c98-4083-83f6-477bcf515563 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:35.573173 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f92062-7c98-4083-83f6-477bcf515563 admin admin] PATH_INFO: `/v3/projects/695936950f1a4bc69abb994479eff7ec` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:35.575189 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f92062-7c98-4083-83f6-477bcf515563 admin admin] RBAC: Authorizing `identity:delete_project(project_id=695936950f1a4bc69abb994479eff7ec)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:35.577743 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f92062-7c98-4083-83f6-477bcf515563 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:35.700507 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-23f92062-7c98-4083-83f6-477bcf515563 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '695936950f1a4bc69abb994479eff7ec', 'request_id': 'req-23f92062-7c98-4083-83f6-477bcf515563'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:46:35.705796 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-23f92062-7c98-4083-83f6-477bcf515563 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '695936950f1a4bc69abb994479eff7ec', 'request_id': 'req-23f92062-7c98-4083-83f6-477bcf515563'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:46:35.712712 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-23f92062-7c98-4083-83f6-477bcf515563 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '695936950f1a4bc69abb994479eff7ec', 'request_id': 'req-23f92062-7c98-4083-83f6-477bcf515563'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:46:35.774344 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-23f92062-7c98-4083-83f6-477bcf515563 admin admin] The token cache is being invalidate because project 695936950f1a4bc69abb994479eff7ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:46:35.775176 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-23f92062-7c98-4083-83f6-477bcf515563 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:46:35.775785 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-23f92062-7c98-4083-83f6-477bcf515563 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:46:35.777461 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4190/8404] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:46:35 2022] DELETE /identity/v3/projects/695936950f1a4bc69abb994479eff7ec => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:46:35.782482 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c324782-d8da-470e-92bd-9c983e749346 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:35.782971 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c324782-d8da-470e-92bd-9c983e749346 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:35.783171 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c324782-d8da-470e-92bd-9c983e749346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:35.803506 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-6c324782-d8da-470e-92bd-9c983e749346 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:46:35.804716 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-6c324782-d8da-470e-92bd-9c983e749346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:46:35.865467 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4215/8405] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:46:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:46:35.874551 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758d9ea-f9b7-4497-8528-fbb26bee22d1 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:35.874846 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758d9ea-f9b7-4497-8528-fbb26bee22d1 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:35.880478 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758d9ea-f9b7-4497-8528-fbb26bee22d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:35.900482 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-7758d9ea-f9b7-4497-8528-fbb26bee22d1 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:46:35.901727 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-7758d9ea-f9b7-4497-8528-fbb26bee22d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:46:35.910918 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4191/8406] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:46:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:46:35.919387 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c324782-d8da-470e-92bd-9c983e749346 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:35.927035 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c324782-d8da-470e-92bd-9c983e749346 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:35.939715 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc570a8c-a7fb-406c-8748-97224c5074d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:35.939715 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc570a8c-a7fb-406c-8748-97224c5074d2 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:35.939715 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc570a8c-a7fb-406c-8748-97224c5074d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:35.939715 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc570a8c-a7fb-406c-8748-97224c5074d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:35.940189 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc570a8c-a7fb-406c-8748-97224c5074d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:46:35.940189 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc570a8c-a7fb-406c-8748-97224c5074d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:35.940189 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc570a8c-a7fb-406c-8748-97224c5074d2 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:35.955309 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4216/8407] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:46:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:46:35.959899 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7758d9ea-f9b7-4497-8528-fbb26bee22d1 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:35.971004 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7758d9ea-f9b7-4497-8528-fbb26bee22d1 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:35.976825 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f467369-3ea5-4c5a-9b87-99764acccacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:35.979801 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f467369-3ea5-4c5a-9b87-99764acccacb admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:35.979801 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f467369-3ea5-4c5a-9b87-99764acccacb admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:35.979801 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f467369-3ea5-4c5a-9b87-99764acccacb admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:35.979801 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f467369-3ea5-4c5a-9b87-99764acccacb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:35.981516 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f467369-3ea5-4c5a-9b87-99764acccacb admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:36.075225 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4192/8408] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:46:35 2022] POST /identity/v3/projects => generated 377 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:46:36.079302 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc570a8c-a7fb-406c-8748-97224c5074d2 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:36.090102 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc570a8c-a7fb-406c-8748-97224c5074d2 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:36.146005 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0076208-ed99-4ac9-ad38-13c766c057f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:36.146772 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0076208-ed99-4ac9-ad38-13c766c057f2 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:36.147300 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0076208-ed99-4ac9-ad38-13c766c057f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:36.147630 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0076208-ed99-4ac9-ad38-13c766c057f2 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:36.148609 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0076208-ed99-4ac9-ad38-13c766c057f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:36.151361 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0076208-ed99-4ac9-ad38-13c766c057f2 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:36.221127 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4217/8409] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:46:36 2022] POST /identity/v3/users => generated 289 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:46:36.225434 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f467369-3ea5-4c5a-9b87-99764acccacb admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:36.237083 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f467369-3ea5-4c5a-9b87-99764acccacb admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:36.242070 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe8ad0d-4f09-4acc-b569-713c17b846f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:36.242751 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8ad0d-4f09-4acc-b569-713c17b846f0 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:36.243058 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8ad0d-4f09-4acc-b569-713c17b846f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:36.243407 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8ad0d-4f09-4acc-b569-713c17b846f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:36.244260 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe8ad0d-4f09-4acc-b569-713c17b846f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:36.245880 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe8ad0d-4f09-4acc-b569-713c17b846f0 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:36.257409 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4193/8410] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:46:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:46:36.262263 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0076208-ed99-4ac9-ad38-13c766c057f2 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:36.273094 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0076208-ed99-4ac9-ad38-13c766c057f2 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:36.278989 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d54c72-0a96-4875-be86-8de47407da8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:36.279763 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d54c72-0a96-4875-be86-8de47407da8e admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:36.279993 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d54c72-0a96-4875-be86-8de47407da8e admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:36.280271 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d54c72-0a96-4875-be86-8de47407da8e admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:36.280994 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d54c72-0a96-4875-be86-8de47407da8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:36.282631 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d54c72-0a96-4875-be86-8de47407da8e admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:36.293682 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4218/8411] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:46:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:46:36.297945 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe8ad0d-4f09-4acc-b569-713c17b846f0 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:36.308988 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe8ad0d-4f09-4acc-b569-713c17b846f0 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:36.313781 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30547ff6-a9c6-45b1-aab5-b3f7c10ce159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:36.314695 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30547ff6-a9c6-45b1-aab5-b3f7c10ce159 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:36.314980 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30547ff6-a9c6-45b1-aab5-b3f7c10ce159 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:36.315257 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30547ff6-a9c6-45b1-aab5-b3f7c10ce159 admin admin] PATH_INFO: `/v3/projects/82fb6149894440c1b5f3a8a8a2f5690f/users/46d03236b7c340f898f432bb5fb28f1b/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:36.331999 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30547ff6-a9c6-45b1-aab5-b3f7c10ce159 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82fb6149894440c1b5f3a8a8a2f5690f, user_id=46d03236b7c340f898f432bb5fb28f1b, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:36.334735 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30547ff6-a9c6-45b1-aab5-b3f7c10ce159 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:36.409483 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4194/8412] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:46:36 2022] PUT /identity/v3/projects/82fb6149894440c1b5f3a8a8a2f5690f/users/46d03236b7c340f898f432bb5fb28f1b/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:46:36.420738 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0d154-0559-491b-b341-1054a3c9c426 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:36.421102 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0d154-0559-491b-b341-1054a3c9c426 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:36.421455 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0d154-0559-491b-b341-1054a3c9c426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:36.450024 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-d8a0d154-0559-491b-b341-1054a3c9c426 None None] MFA Rules not processed for user `46d03236b7c340f898f432bb5fb28f1b`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:46:36.451248 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d8a0d154-0559-491b-b341-1054a3c9c426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:46:36.519015 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4219/8413] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:46:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:46:36.523940 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30547ff6-a9c6-45b1-aab5-b3f7c10ce159 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:36.585251 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30547ff6-a9c6-45b1-aab5-b3f7c10ce159 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:36.590933 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82202f4-bf3b-4f0d-9f8e-fea11d21c679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:36.591621 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82202f4-bf3b-4f0d-9f8e-fea11d21c679 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:36.591908 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82202f4-bf3b-4f0d-9f8e-fea11d21c679 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:36.592186 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82202f4-bf3b-4f0d-9f8e-fea11d21c679 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:36.592874 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82202f4-bf3b-4f0d-9f8e-fea11d21c679 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:36.594788 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82202f4-bf3b-4f0d-9f8e-fea11d21c679 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:36.708330 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4195/8414] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:46:36 2022] POST /identity/v3/projects => generated 377 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:46:36.712497 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a0d154-0559-491b-b341-1054a3c9c426 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:36.723792 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a0d154-0559-491b-b341-1054a3c9c426 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:36.784741 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd24157-660a-4a94-ae30-f048f2e0e1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:36.785452 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd24157-660a-4a94-ae30-f048f2e0e1b9 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:36.785739 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd24157-660a-4a94-ae30-f048f2e0e1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:36.786020 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd24157-660a-4a94-ae30-f048f2e0e1b9 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:36.786743 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd24157-660a-4a94-ae30-f048f2e0e1b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:36.788704 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd24157-660a-4a94-ae30-f048f2e0e1b9 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:36.860952 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4220/8415] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:46:36 2022] POST /identity/v3/users => generated 289 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:46:36.865226 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82202f4-bf3b-4f0d-9f8e-fea11d21c679 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:36.875714 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82202f4-bf3b-4f0d-9f8e-fea11d21c679 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:36.880364 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd370996-cb76-4efa-ac2d-c88e9a1280aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:36.881026 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd370996-cb76-4efa-ac2d-c88e9a1280aa admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:36.881307 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd370996-cb76-4efa-ac2d-c88e9a1280aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:36.881584 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd370996-cb76-4efa-ac2d-c88e9a1280aa admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:36.882297 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd370996-cb76-4efa-ac2d-c88e9a1280aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:36.884451 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd370996-cb76-4efa-ac2d-c88e9a1280aa admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:36.894893 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4196/8416] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:46:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:46:36.899189 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd24157-660a-4a94-ae30-f048f2e0e1b9 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:36.909883 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd24157-660a-4a94-ae30-f048f2e0e1b9 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:36.914504 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abde80d5-c468-4df4-800a-aa1cb93c199d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:36.915204 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde80d5-c468-4df4-800a-aa1cb93c199d admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:36.915723 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde80d5-c468-4df4-800a-aa1cb93c199d admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:36.916006 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde80d5-c468-4df4-800a-aa1cb93c199d admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:36.916724 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abde80d5-c468-4df4-800a-aa1cb93c199d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:36.918331 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abde80d5-c468-4df4-800a-aa1cb93c199d admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:36.928410 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4221/8417] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:46:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:46:36.932750 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd370996-cb76-4efa-ac2d-c88e9a1280aa admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:36.943353 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd370996-cb76-4efa-ac2d-c88e9a1280aa admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:36.948381 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d467da3d-8a9c-4dba-a899-c01f3a13328d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:36.949422 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467da3d-8a9c-4dba-a899-c01f3a13328d admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:36.949751 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467da3d-8a9c-4dba-a899-c01f3a13328d admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:36.949982 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467da3d-8a9c-4dba-a899-c01f3a13328d admin admin] PATH_INFO: `/v3/projects/712a6aaa8e214f489b006581dc8a027c/users/a4dad8fe1b9d4594bff08dc15bb8ba03/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:36.965471 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d467da3d-8a9c-4dba-a899-c01f3a13328d admin admin] RBAC: Authorizing `identity:create_grant(project_id=712a6aaa8e214f489b006581dc8a027c, user_id=a4dad8fe1b9d4594bff08dc15bb8ba03, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:36.968195 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d467da3d-8a9c-4dba-a899-c01f3a13328d admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:37.049627 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4197/8418] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:46:36 2022] PUT /identity/v3/projects/712a6aaa8e214f489b006581dc8a027c/users/a4dad8fe1b9d4594bff08dc15bb8ba03/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:46:37.060308 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7322cc-7ac5-4683-93ef-e6d6e6a6f93a None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:37.060816 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7322cc-7ac5-4683-93ef-e6d6e6a6f93a None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:37.061103 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7322cc-7ac5-4683-93ef-e6d6e6a6f93a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:37.089002 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-fb7322cc-7ac5-4683-93ef-e6d6e6a6f93a None None] MFA Rules not processed for user `a4dad8fe1b9d4594bff08dc15bb8ba03`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:46:37.090146 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-fb7322cc-7ac5-4683-93ef-e6d6e6a6f93a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:46:37.161199 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4222/8419] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:46:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:46:37.166129 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d467da3d-8a9c-4dba-a899-c01f3a13328d admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:37.226024 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d467da3d-8a9c-4dba-a899-c01f3a13328d admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:37.231037 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd7ca14-7910-486e-8edc-5100bc95f5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:37.231793 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd7ca14-7910-486e-8edc-5100bc95f5d5 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:37.232080 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd7ca14-7910-486e-8edc-5100bc95f5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:37.232355 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd7ca14-7910-486e-8edc-5100bc95f5d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:37.233134 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd7ca14-7910-486e-8edc-5100bc95f5d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:37.235064 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd7ca14-7910-486e-8edc-5100bc95f5d5 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:37.325491 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4198/8420] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:46:37 2022] POST /identity/v3/projects => generated 379 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:46:37.329669 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7322cc-7ac5-4683-93ef-e6d6e6a6f93a None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:37.340740 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7322cc-7ac5-4683-93ef-e6d6e6a6f93a None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:37.397155 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2087e51d-dfd3-47a1-818f-166ced0ce175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:37.397833 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2087e51d-dfd3-47a1-818f-166ced0ce175 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:37.398126 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2087e51d-dfd3-47a1-818f-166ced0ce175 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:37.398670 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2087e51d-dfd3-47a1-818f-166ced0ce175 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:37.399359 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2087e51d-dfd3-47a1-818f-166ced0ce175 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:37.402870 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2087e51d-dfd3-47a1-818f-166ced0ce175 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:37.484196 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4223/8421] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:46:37 2022] POST /identity/v3/users => generated 296 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:46:37.488141 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd7ca14-7910-486e-8edc-5100bc95f5d5 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:37.499235 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd7ca14-7910-486e-8edc-5100bc95f5d5 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:37.504565 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97b7273-6049-4a80-a646-aedab7964183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:37.505353 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b7273-6049-4a80-a646-aedab7964183 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:37.505713 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b7273-6049-4a80-a646-aedab7964183 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:37.506018 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b7273-6049-4a80-a646-aedab7964183 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:37.506962 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97b7273-6049-4a80-a646-aedab7964183 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:37.508622 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97b7273-6049-4a80-a646-aedab7964183 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:37.520972 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4199/8422] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:46:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:46:37.525867 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2087e51d-dfd3-47a1-818f-166ced0ce175 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:37.536054 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2087e51d-dfd3-47a1-818f-166ced0ce175 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:37.541415 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6b9f3-c5a0-4e34-a781-ef83586d1fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:37.542294 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6b9f3-c5a0-4e34-a781-ef83586d1fe5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:37.542576 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6b9f3-c5a0-4e34-a781-ef83586d1fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:37.542849 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6b9f3-c5a0-4e34-a781-ef83586d1fe5 admin admin] PATH_INFO: `/v3/projects/7a920e81f88a4fe884168c5bb093da73/users/f1a3aff4296f4cdfab6e5b19a20490b1/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:37.558902 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f6b9f3-c5a0-4e34-a781-ef83586d1fe5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a920e81f88a4fe884168c5bb093da73, user_id=f1a3aff4296f4cdfab6e5b19a20490b1, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:37.561831 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f6b9f3-c5a0-4e34-a781-ef83586d1fe5 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:37.678019 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4224/8423] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:46:37 2022] PUT /identity/v3/projects/7a920e81f88a4fe884168c5bb093da73/users/f1a3aff4296f4cdfab6e5b19a20490b1/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:46:37.682203 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97b7273-6049-4a80-a646-aedab7964183 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:37.692215 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97b7273-6049-4a80-a646-aedab7964183 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:37.746596 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cce586a-a938-4c57-8b86-1925a37807ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:37.747274 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cce586a-a938-4c57-8b86-1925a37807ca admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:37.747689 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cce586a-a938-4c57-8b86-1925a37807ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:37.748101 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cce586a-a938-4c57-8b86-1925a37807ca admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:37.748984 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cce586a-a938-4c57-8b86-1925a37807ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:37.750761 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cce586a-a938-4c57-8b86-1925a37807ca admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:37.761784 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4200/8424] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:46:37 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:46:37.765914 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6b9f3-c5a0-4e34-a781-ef83586d1fe5 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:37.777491 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6b9f3-c5a0-4e34-a781-ef83586d1fe5 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:37.782314 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b78daa-0384-4bd9-af07-12de7c64e34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:37.783199 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b78daa-0384-4bd9-af07-12de7c64e34b admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:37.783500 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b78daa-0384-4bd9-af07-12de7c64e34b admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:37.784446 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b78daa-0384-4bd9-af07-12de7c64e34b admin admin] PATH_INFO: `/v3/projects/7a920e81f88a4fe884168c5bb093da73/users/f1a3aff4296f4cdfab6e5b19a20490b1/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:37.786504 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b78daa-0384-4bd9-af07-12de7c64e34b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a920e81f88a4fe884168c5bb093da73, user_id=f1a3aff4296f4cdfab6e5b19a20490b1, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:37.789205 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b78daa-0384-4bd9-af07-12de7c64e34b admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:37.799707 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4225/8425] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:46:37 2022] PUT /identity/v3/projects/7a920e81f88a4fe884168c5bb093da73/users/f1a3aff4296f4cdfab6e5b19a20490b1/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:46:37.810642 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6bbc64-67ca-4f73-a3d1-241a3cee1c6b None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:37.810932 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6bbc64-67ca-4f73-a3d1-241a3cee1c6b None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:37.811213 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6bbc64-67ca-4f73-a3d1-241a3cee1c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:37.838462 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-4b6bbc64-67ca-4f73-a3d1-241a3cee1c6b None None] MFA Rules not processed for user `f1a3aff4296f4cdfab6e5b19a20490b1`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:46:37.839724 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-4b6bbc64-67ca-4f73-a3d1-241a3cee1c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:46:37.918890 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4201/8426] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:46:37 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:46:37.934290 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b78daa-0384-4bd9-af07-12de7c64e34b admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:37.934290 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-35b78daa-0384-4bd9-af07-12de7c64e34b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:46:37.967113 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6bbc64-67ca-4f73-a3d1-241a3cee1c6b None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:37.968789 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-4b6bbc64-67ca-4f73-a3d1-241a3cee1c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:46:37.999147 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b78daa-0384-4bd9-af07-12de7c64e34b admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:38.004690 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3476604e-9d3e-4c14-8d31-656fc75bc612 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198271d1c0d44cb58bace41a65f4b94c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:38.005438 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3476604e-9d3e-4c14-8d31-656fc75bc612 service cinder] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:38.005807 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3476604e-9d3e-4c14-8d31-656fc75bc612 service cinder] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:38.006168 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3476604e-9d3e-4c14-8d31-656fc75bc612 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:38.016679 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3476604e-9d3e-4c14-8d31-656fc75bc612 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:38.018262 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3476604e-9d3e-4c14-8d31-656fc75bc612 service cinder] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:38.028880 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4226/8427] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:46:37 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:46:38.034469 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6bbc64-67ca-4f73-a3d1-241a3cee1c6b None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:38.038414 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b813d90-cba8-48c5-b84a-8b1ddf32b9c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:38.039180 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b813d90-cba8-48c5-b84a-8b1ddf32b9c2 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:38.039610 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b813d90-cba8-48c5-b84a-8b1ddf32b9c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:38.040010 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b813d90-cba8-48c5-b84a-8b1ddf32b9c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:38.041998 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-3b813d90-cba8-48c5-b84a-8b1ddf32b9c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:46:38.105577 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b813d90-cba8-48c5-b84a-8b1ddf32b9c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:38.107025 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b813d90-cba8-48c5-b84a-8b1ddf32b9c2 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:38.116857 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4202/8428] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:46:37 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:46:38.159359 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3476604e-9d3e-4c14-8d31-656fc75bc612 service cinder] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:38.161516 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-3476604e-9d3e-4c14-8d31-656fc75bc612 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:46:38.177150 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3476604e-9d3e-4c14-8d31-656fc75bc612 service cinder] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:38.181631 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d230fb1-f05c-4d9c-bf1d-a8f93f2c0761 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198271d1c0d44cb58bace41a65f4b94c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:38.182611 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d230fb1-f05c-4d9c-bf1d-a8f93f2c0761 service cinder] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:38.182896 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d230fb1-f05c-4d9c-bf1d-a8f93f2c0761 service cinder] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:38.183169 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d230fb1-f05c-4d9c-bf1d-a8f93f2c0761 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:38.249110 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d230fb1-f05c-4d9c-bf1d-a8f93f2c0761 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:38.250236 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d230fb1-f05c-4d9c-bf1d-a8f93f2c0761 service cinder] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:38.264015 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4227/8429] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:46:38 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:46:41.431202 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f062d3aa-a764-445c-b12b-d75b5a1b6c5a None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:41.431712 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f062d3aa-a764-445c-b12b-d75b5a1b6c5a None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:41.431799 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f062d3aa-a764-445c-b12b-d75b5a1b6c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:41.466001 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-f062d3aa-a764-445c-b12b-d75b5a1b6c5a None None] MFA Rules not processed for user `e9982f39ae394932a2fb8c9e4d456d8d`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:46:41.467627 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-f062d3aa-a764-445c-b12b-d75b5a1b6c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:46:41.534020 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4203/8430] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:46:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:46:41.572636 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d230fb1-f05c-4d9c-bf1d-a8f93f2c0761 service cinder] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:41.574274 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-8d230fb1-f05c-4d9c-bf1d-a8f93f2c0761 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:46:41.652091 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d230fb1-f05c-4d9c-bf1d-a8f93f2c0761 service cinder] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:41.656207 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783bbc3a-7e6d-4a5e-8491-5801e668739b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b5cb86f190f4fcfb06d66cb8f14643f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:41.656865 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783bbc3a-7e6d-4a5e-8491-5801e668739b service glance] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:41.657175 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783bbc3a-7e6d-4a5e-8491-5801e668739b service glance] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:41.657470 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783bbc3a-7e6d-4a5e-8491-5801e668739b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:41.659243 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-783bbc3a-7e6d-4a5e-8491-5801e668739b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:46:41.739927 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783bbc3a-7e6d-4a5e-8491-5801e668739b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:41.741374 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783bbc3a-7e6d-4a5e-8491-5801e668739b service glance] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:41.755238 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4228/8431] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:46:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:46:42.095553 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f062d3aa-a764-445c-b12b-d75b5a1b6c5a None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:42.110665 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f062d3aa-a764-445c-b12b-d75b5a1b6c5a None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:42.115633 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ed923a-8c89-4968-a440-89bb775f860e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:42.117141 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ed923a-8c89-4968-a440-89bb775f860e service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:42.117508 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ed923a-8c89-4968-a440-89bb775f860e service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:42.118302 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ed923a-8c89-4968-a440-89bb775f860e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:42.120940 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-a3ed923a-8c89-4968-a440-89bb775f860e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:46:42.137176 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ed923a-8c89-4968-a440-89bb775f860e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:42.138851 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ed923a-8c89-4968-a440-89bb775f860e service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:42.165726 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4204/8432] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:46:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:46:42.650050 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783bbc3a-7e6d-4a5e-8491-5801e668739b service glance] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:42.652732 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-783bbc3a-7e6d-4a5e-8491-5801e668739b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:46:42.668484 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783bbc3a-7e6d-4a5e-8491-5801e668739b service glance] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:42.672705 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec22244d-037b-487e-b3b9-9a0085d68308 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:42.673360 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec22244d-037b-487e-b3b9-9a0085d68308 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:42.673646 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec22244d-037b-487e-b3b9-9a0085d68308 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:42.673933 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec22244d-037b-487e-b3b9-9a0085d68308 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:42.675790 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ec22244d-037b-487e-b3b9-9a0085d68308 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:46:42.694445 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec22244d-037b-487e-b3b9-9a0085d68308 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:42.695958 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec22244d-037b-487e-b3b9-9a0085d68308 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:42.712428 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4229/8433] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:46:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:46:46.559036 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ed923a-8c89-4968-a440-89bb775f860e service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:46.630273 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ed923a-8c89-4968-a440-89bb775f860e service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:46.635768 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f52838-128b-4780-937d-d685a13b0a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:46.636770 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f52838-128b-4780-937d-d685a13b0a9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:46.636926 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f52838-128b-4780-937d-d685a13b0a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:46.637206 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f52838-128b-4780-937d-d685a13b0a9f admin admin] PATH_INFO: `/v3/users/46d03236b7c340f898f432bb5fb28f1b` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:46.638425 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f52838-128b-4780-937d-d685a13b0a9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=46d03236b7c340f898f432bb5fb28f1b)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:46.640783 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f52838-128b-4780-937d-d685a13b0a9f admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:46.877289 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-00f52838-128b-4780-937d-d685a13b0a9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46d03236b7c340f898f432bb5fb28f1b'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:46:46.884823 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-00f52838-128b-4780-937d-d685a13b0a9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46d03236b7c340f898f432bb5fb28f1b'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:46:46.885699 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-00f52838-128b-4780-937d-d685a13b0a9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46d03236b7c340f898f432bb5fb28f1b'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:46:46.940465 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-00f52838-128b-4780-937d-d685a13b0a9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46d03236b7c340f898f432bb5fb28f1b'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:46:46.955691 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-00f52838-128b-4780-937d-d685a13b0a9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46d03236b7c340f898f432bb5fb28f1b'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:46:46.963078 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4205/8434] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:46:46 2022] DELETE /identity/v3/users/46d03236b7c340f898f432bb5fb28f1b => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:46:46.968267 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2eba57-54c4-4e82-9482-42da70ab2c1b None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:46.968786 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2eba57-54c4-4e82-9482-42da70ab2c1b None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:46.968885 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2eba57-54c4-4e82-9482-42da70ab2c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:46.987053 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-dd2eba57-54c4-4e82-9482-42da70ab2c1b None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:46:46.988381 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-dd2eba57-54c4-4e82-9482-42da70ab2c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:46:47.053749 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4230/8435] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:46:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:46:47.063623 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f52838-128b-4780-937d-d685a13b0a9f admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:47.065169 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-00f52838-128b-4780-937d-d685a13b0a9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:46:47.125840 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f52838-128b-4780-937d-d685a13b0a9f admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:47.129620 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae73604c-d593-48f0-a978-d77ba904dcf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:47.130284 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae73604c-d593-48f0-a978-d77ba904dcf6 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:47.130566 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae73604c-d593-48f0-a978-d77ba904dcf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:47.130837 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae73604c-d593-48f0-a978-d77ba904dcf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:47.141015 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae73604c-d593-48f0-a978-d77ba904dcf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:47.142386 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae73604c-d593-48f0-a978-d77ba904dcf6 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:47.154115 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4206/8436] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:46:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:46:47.862839 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2eba57-54c4-4e82-9482-42da70ab2c1b None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:47.864416 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-dd2eba57-54c4-4e82-9482-42da70ab2c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:46:47.876997 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2eba57-54c4-4e82-9482-42da70ab2c1b None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:47.884968 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461aeb9b-931f-442b-b8c8-26743da132bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:47.886617 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461aeb9b-931f-442b-b8c8-26743da132bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:47.887455 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461aeb9b-931f-442b-b8c8-26743da132bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:47.887455 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461aeb9b-931f-442b-b8c8-26743da132bd admin admin] PATH_INFO: `/v3/projects/82fb6149894440c1b5f3a8a8a2f5690f` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:47.888642 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461aeb9b-931f-442b-b8c8-26743da132bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=82fb6149894440c1b5f3a8a8a2f5690f)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:47.890580 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461aeb9b-931f-442b-b8c8-26743da132bd admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:47.992634 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-461aeb9b-931f-442b-b8c8-26743da132bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82fb6149894440c1b5f3a8a8a2f5690f', 'request_id': 'req-461aeb9b-931f-442b-b8c8-26743da132bd'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:46:47.998584 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-461aeb9b-931f-442b-b8c8-26743da132bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82fb6149894440c1b5f3a8a8a2f5690f', 'request_id': 'req-461aeb9b-931f-442b-b8c8-26743da132bd'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:46:48.054036 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-461aeb9b-931f-442b-b8c8-26743da132bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82fb6149894440c1b5f3a8a8a2f5690f', 'request_id': 'req-461aeb9b-931f-442b-b8c8-26743da132bd'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:46:48.065741 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-461aeb9b-931f-442b-b8c8-26743da132bd admin admin] The token cache is being invalidate because project 82fb6149894440c1b5f3a8a8a2f5690f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:46:48.067434 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-461aeb9b-931f-442b-b8c8-26743da132bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:46:48.067434 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-461aeb9b-931f-442b-b8c8-26743da132bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:46:48.068206 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4231/8437] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:46:47 2022] DELETE /identity/v3/projects/82fb6149894440c1b5f3a8a8a2f5690f => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:46:48.072130 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae73604c-d593-48f0-a978-d77ba904dcf6 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:48.082366 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae73604c-d593-48f0-a978-d77ba904dcf6 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:48.138941 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3a1389-5190-485a-ba7e-d5b2ae93eac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:48.139863 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a1389-5190-485a-ba7e-d5b2ae93eac4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:48.140142 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a1389-5190-485a-ba7e-d5b2ae93eac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:48.140416 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a1389-5190-485a-ba7e-d5b2ae93eac4 admin admin] PATH_INFO: `/v3/users/a4dad8fe1b9d4594bff08dc15bb8ba03` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:48.141587 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3a1389-5190-485a-ba7e-d5b2ae93eac4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4dad8fe1b9d4594bff08dc15bb8ba03)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:48.143536 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3a1389-5190-485a-ba7e-d5b2ae93eac4 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:48.296783 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4b3a1389-5190-485a-ba7e-d5b2ae93eac4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4dad8fe1b9d4594bff08dc15bb8ba03'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:46:48.303770 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4b3a1389-5190-485a-ba7e-d5b2ae93eac4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4dad8fe1b9d4594bff08dc15bb8ba03'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:46:48.304535 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4b3a1389-5190-485a-ba7e-d5b2ae93eac4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4dad8fe1b9d4594bff08dc15bb8ba03'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:46:48.362424 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4b3a1389-5190-485a-ba7e-d5b2ae93eac4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4dad8fe1b9d4594bff08dc15bb8ba03'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:46:48.375326 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4b3a1389-5190-485a-ba7e-d5b2ae93eac4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4dad8fe1b9d4594bff08dc15bb8ba03'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:46:48.381716 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4207/8438] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:46:48 2022] DELETE /identity/v3/users/a4dad8fe1b9d4594bff08dc15bb8ba03 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:46:48.873026 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461aeb9b-931f-442b-b8c8-26743da132bd admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:48.874483 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-461aeb9b-931f-442b-b8c8-26743da132bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:46:48.889627 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461aeb9b-931f-442b-b8c8-26743da132bd admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:48.948515 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2df9fd-f03e-4e27-ab4b-8916302e615d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:48.949379 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2df9fd-f03e-4e27-ab4b-8916302e615d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:48.949658 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2df9fd-f03e-4e27-ab4b-8916302e615d admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:48.949928 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2df9fd-f03e-4e27-ab4b-8916302e615d admin admin] PATH_INFO: `/v3/projects/712a6aaa8e214f489b006581dc8a027c` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:48.951107 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2df9fd-f03e-4e27-ab4b-8916302e615d admin admin] RBAC: Authorizing `identity:delete_project(project_id=712a6aaa8e214f489b006581dc8a027c)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:48.953058 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2df9fd-f03e-4e27-ab4b-8916302e615d admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:49.060029 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9a2df9fd-f03e-4e27-ab4b-8916302e615d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '712a6aaa8e214f489b006581dc8a027c', 'request_id': 'req-9a2df9fd-f03e-4e27-ab4b-8916302e615d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:46:49.065728 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9a2df9fd-f03e-4e27-ab4b-8916302e615d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '712a6aaa8e214f489b006581dc8a027c', 'request_id': 'req-9a2df9fd-f03e-4e27-ab4b-8916302e615d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:46:49.151628 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9a2df9fd-f03e-4e27-ab4b-8916302e615d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '712a6aaa8e214f489b006581dc8a027c', 'request_id': 'req-9a2df9fd-f03e-4e27-ab4b-8916302e615d'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:46:49.162949 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9a2df9fd-f03e-4e27-ab4b-8916302e615d admin admin] The token cache is being invalidate because project 712a6aaa8e214f489b006581dc8a027c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:46:49.163234 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9a2df9fd-f03e-4e27-ab4b-8916302e615d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:46:49.163884 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-9a2df9fd-f03e-4e27-ab4b-8916302e615d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:46:49.165417 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4232/8439] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:46:48 2022] DELETE /identity/v3/projects/712a6aaa8e214f489b006581dc8a027c => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:46:49.169397 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3a1389-5190-485a-ba7e-d5b2ae93eac4 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:49.170838 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-4b3a1389-5190-485a-ba7e-d5b2ae93eac4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:46:49.184278 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3a1389-5190-485a-ba7e-d5b2ae93eac4 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:49.239917 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60102f0a-0dc0-4774-abc1-61e0c9697305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:49.240783 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60102f0a-0dc0-4774-abc1-61e0c9697305 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:49.241065 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60102f0a-0dc0-4774-abc1-61e0c9697305 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:49.241343 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60102f0a-0dc0-4774-abc1-61e0c9697305 admin admin] PATH_INFO: `/v3/users/f1a3aff4296f4cdfab6e5b19a20490b1` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:49.242548 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60102f0a-0dc0-4774-abc1-61e0c9697305 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1a3aff4296f4cdfab6e5b19a20490b1)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:49.245047 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60102f0a-0dc0-4774-abc1-61e0c9697305 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:49.412775 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-60102f0a-0dc0-4774-abc1-61e0c9697305 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1a3aff4296f4cdfab6e5b19a20490b1'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:46:49.420488 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-60102f0a-0dc0-4774-abc1-61e0c9697305 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1a3aff4296f4cdfab6e5b19a20490b1'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:46:49.421192 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-60102f0a-0dc0-4774-abc1-61e0c9697305 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1a3aff4296f4cdfab6e5b19a20490b1'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:46:49.495363 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-60102f0a-0dc0-4774-abc1-61e0c9697305 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1a3aff4296f4cdfab6e5b19a20490b1'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:46:49.514205 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-60102f0a-0dc0-4774-abc1-61e0c9697305 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1a3aff4296f4cdfab6e5b19a20490b1'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:46:49.520757 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4208/8440] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:46:49 2022] DELETE /identity/v3/users/f1a3aff4296f4cdfab6e5b19a20490b1 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:46:49.954666 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2df9fd-f03e-4e27-ab4b-8916302e615d admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:49.959365 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-9a2df9fd-f03e-4e27-ab4b-8916302e615d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:46:49.971283 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2df9fd-f03e-4e27-ab4b-8916302e615d admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:50.038962 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4fc542-96e2-4ade-b746-fbe7f2a0d883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:50.040047 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4fc542-96e2-4ade-b746-fbe7f2a0d883 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:50.040341 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4fc542-96e2-4ade-b746-fbe7f2a0d883 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:50.040623 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4fc542-96e2-4ade-b746-fbe7f2a0d883 admin admin] PATH_INFO: `/v3/projects/7a920e81f88a4fe884168c5bb093da73` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:50.042865 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4fc542-96e2-4ade-b746-fbe7f2a0d883 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a920e81f88a4fe884168c5bb093da73)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:50.045421 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4fc542-96e2-4ade-b746-fbe7f2a0d883 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:50.147314 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ad4fc542-96e2-4ade-b746-fbe7f2a0d883 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a920e81f88a4fe884168c5bb093da73', 'request_id': 'req-ad4fc542-96e2-4ade-b746-fbe7f2a0d883'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:46:50.154323 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ad4fc542-96e2-4ade-b746-fbe7f2a0d883 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a920e81f88a4fe884168c5bb093da73', 'request_id': 'req-ad4fc542-96e2-4ade-b746-fbe7f2a0d883'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:46:50.220834 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ad4fc542-96e2-4ade-b746-fbe7f2a0d883 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a920e81f88a4fe884168c5bb093da73', 'request_id': 'req-ad4fc542-96e2-4ade-b746-fbe7f2a0d883'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:46:50.237060 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ad4fc542-96e2-4ade-b746-fbe7f2a0d883 admin admin] The token cache is being invalidate because project 7a920e81f88a4fe884168c5bb093da73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:46:50.237590 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ad4fc542-96e2-4ade-b746-fbe7f2a0d883 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:46:50.238954 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ad4fc542-96e2-4ade-b746-fbe7f2a0d883 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:46:50.240620 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4233/8441] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:46:49 2022] DELETE /identity/v3/projects/7a920e81f88a4fe884168c5bb093da73 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:46:50.247930 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a10aaf-b960-4b63-9539-1fcbcd9d960f None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:50.248511 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a10aaf-b960-4b63-9539-1fcbcd9d960f None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:50.248511 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a10aaf-b960-4b63-9539-1fcbcd9d960f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:50.268877 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-c4a10aaf-b960-4b63-9539-1fcbcd9d960f None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:46:50.270103 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c4a10aaf-b960-4b63-9539-1fcbcd9d960f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:46:50.330556 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4209/8442] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:46:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:46:50.339512 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6111b211-3d60-4922-afbc-46fd31816358 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:50.339884 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6111b211-3d60-4922-afbc-46fd31816358 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:50.340187 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6111b211-3d60-4922-afbc-46fd31816358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:50.358628 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-6111b211-3d60-4922-afbc-46fd31816358 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:46:50.359882 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-6111b211-3d60-4922-afbc-46fd31816358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:46:50.368455 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4234/8443] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:46:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:46:50.372195 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a10aaf-b960-4b63-9539-1fcbcd9d960f None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:50.382142 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a10aaf-b960-4b63-9539-1fcbcd9d960f None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:50.387498 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f0ed49-4953-40cd-8e87-d2680921d206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:50.388183 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f0ed49-4953-40cd-8e87-d2680921d206 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:50.388467 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f0ed49-4953-40cd-8e87-d2680921d206 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:50.388741 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f0ed49-4953-40cd-8e87-d2680921d206 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:50.389450 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f0ed49-4953-40cd-8e87-d2680921d206 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:46:50.389782 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f0ed49-4953-40cd-8e87-d2680921d206 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:50.391363 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f0ed49-4953-40cd-8e87-d2680921d206 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:50.403980 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4210/8444] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:46:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:46:50.408390 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6111b211-3d60-4922-afbc-46fd31816358 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:50.417657 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6111b211-3d60-4922-afbc-46fd31816358 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:50.422302 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232a16a9-5e5f-4199-9d12-0e6f4a734a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:50.422946 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a16a9-5e5f-4199-9d12-0e6f4a734a5e admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:50.423227 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a16a9-5e5f-4199-9d12-0e6f4a734a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:50.423530 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a16a9-5e5f-4199-9d12-0e6f4a734a5e admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:50.424218 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232a16a9-5e5f-4199-9d12-0e6f4a734a5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:50.426116 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232a16a9-5e5f-4199-9d12-0e6f4a734a5e admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:50.541664 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4235/8445] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:46:50 2022] POST /identity/v3/projects => generated 379 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:46:50.546018 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f0ed49-4953-40cd-8e87-d2680921d206 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:50.556233 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f0ed49-4953-40cd-8e87-d2680921d206 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:50.613001 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea86a53e-9490-4265-8590-5fc63954e704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:50.613675 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86a53e-9490-4265-8590-5fc63954e704 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:50.613959 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86a53e-9490-4265-8590-5fc63954e704 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:50.614236 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86a53e-9490-4265-8590-5fc63954e704 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:50.614922 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea86a53e-9490-4265-8590-5fc63954e704 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:50.616890 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea86a53e-9490-4265-8590-5fc63954e704 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:50.689858 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4211/8446] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:46:50 2022] POST /identity/v3/users => generated 290 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:46:50.693760 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232a16a9-5e5f-4199-9d12-0e6f4a734a5e admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:50.704581 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232a16a9-5e5f-4199-9d12-0e6f4a734a5e admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:50.712986 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83677d2d-0058-4006-9483-2c74a99bab1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:50.712986 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83677d2d-0058-4006-9483-2c74a99bab1d admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:50.712986 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83677d2d-0058-4006-9483-2c74a99bab1d admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:50.712986 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83677d2d-0058-4006-9483-2c74a99bab1d admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:50.713406 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83677d2d-0058-4006-9483-2c74a99bab1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:50.713406 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83677d2d-0058-4006-9483-2c74a99bab1d admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:50.722654 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4236/8447] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:46:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:46:50.726531 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea86a53e-9490-4265-8590-5fc63954e704 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:50.736677 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea86a53e-9490-4265-8590-5fc63954e704 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:50.741200 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71fe98c-698b-479c-860e-49d505d127c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:50.741855 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71fe98c-698b-479c-860e-49d505d127c7 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:50.742141 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71fe98c-698b-479c-860e-49d505d127c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:50.742420 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71fe98c-698b-479c-860e-49d505d127c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:50.743165 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71fe98c-698b-479c-860e-49d505d127c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:50.745550 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71fe98c-698b-479c-860e-49d505d127c7 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:50.755428 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4212/8448] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:46:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:46:50.759501 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83677d2d-0058-4006-9483-2c74a99bab1d admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:50.770166 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83677d2d-0058-4006-9483-2c74a99bab1d admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:50.775045 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a8c92-146d-45fe-b367-bdcfc659d00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:50.776084 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a8c92-146d-45fe-b367-bdcfc659d00a admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:50.776369 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a8c92-146d-45fe-b367-bdcfc659d00a admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:50.776648 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a8c92-146d-45fe-b367-bdcfc659d00a admin admin] PATH_INFO: `/v3/projects/53ff0d90c25e43219453b3c11c4bcc20/users/052dc4697f8e4081b188be83a4b7ab25/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:50.790911 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5a8c92-146d-45fe-b367-bdcfc659d00a admin admin] RBAC: Authorizing `identity:create_grant(project_id=53ff0d90c25e43219453b3c11c4bcc20, user_id=052dc4697f8e4081b188be83a4b7ab25, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:50.794059 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5a8c92-146d-45fe-b367-bdcfc659d00a admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:50.848825 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4237/8449] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:46:50 2022] PUT /identity/v3/projects/53ff0d90c25e43219453b3c11c4bcc20/users/052dc4697f8e4081b188be83a4b7ab25/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:46:50.866074 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1207f6-4297-4a5f-bf7e-5a2449e4b29d None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:50.866399 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1207f6-4297-4a5f-bf7e-5a2449e4b29d None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:50.866684 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1207f6-4297-4a5f-bf7e-5a2449e4b29d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:50.895762 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-5b1207f6-4297-4a5f-bf7e-5a2449e4b29d None None] MFA Rules not processed for user `052dc4697f8e4081b188be83a4b7ab25`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:46:50.896985 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-5b1207f6-4297-4a5f-bf7e-5a2449e4b29d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:46:50.966152 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4213/8450] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:46:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:46:50.970484 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a8c92-146d-45fe-b367-bdcfc659d00a admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:51.032639 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a8c92-146d-45fe-b367-bdcfc659d00a admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:51.037184 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1580041-09d5-4795-89c2-f9beb3d6a75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:51.037836 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1580041-09d5-4795-89c2-f9beb3d6a75c admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:51.038120 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1580041-09d5-4795-89c2-f9beb3d6a75c admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:51.038391 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1580041-09d5-4795-89c2-f9beb3d6a75c admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:51.039069 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1580041-09d5-4795-89c2-f9beb3d6a75c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:51.040990 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1580041-09d5-4795-89c2-f9beb3d6a75c admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:51.153657 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4238/8451] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:46:50 2022] POST /identity/v3/projects => generated 381 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:46:51.157774 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1207f6-4297-4a5f-bf7e-5a2449e4b29d None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:51.169678 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1207f6-4297-4a5f-bf7e-5a2449e4b29d None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:51.227217 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f86699-4ba9-47c9-a756-737d7584e2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:51.227925 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f86699-4ba9-47c9-a756-737d7584e2b8 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:51.228209 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f86699-4ba9-47c9-a756-737d7584e2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:51.228484 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f86699-4ba9-47c9-a756-737d7584e2b8 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:51.230272 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f86699-4ba9-47c9-a756-737d7584e2b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:51.232225 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f86699-4ba9-47c9-a756-737d7584e2b8 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:51.306767 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4214/8452] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:46:51 2022] POST /identity/v3/users => generated 297 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:46:51.310718 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1580041-09d5-4795-89c2-f9beb3d6a75c admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:51.321280 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1580041-09d5-4795-89c2-f9beb3d6a75c admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:51.326085 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c5ab6c-3689-4324-8a20-0ca4788be1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:51.326746 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c5ab6c-3689-4324-8a20-0ca4788be1f1 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:51.327027 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c5ab6c-3689-4324-8a20-0ca4788be1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:51.327304 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c5ab6c-3689-4324-8a20-0ca4788be1f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:51.328054 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c5ab6c-3689-4324-8a20-0ca4788be1f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:51.329655 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c5ab6c-3689-4324-8a20-0ca4788be1f1 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:51.340139 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4239/8453] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:46:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 21:46:51.344398 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f86699-4ba9-47c9-a756-737d7584e2b8 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:51.355096 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f86699-4ba9-47c9-a756-737d7584e2b8 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:51.361481 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcea635-18be-43b6-9b6c-4a19ff4c054a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:51.362441 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcea635-18be-43b6-9b6c-4a19ff4c054a admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:51.362712 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcea635-18be-43b6-9b6c-4a19ff4c054a admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:51.362960 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcea635-18be-43b6-9b6c-4a19ff4c054a admin admin] PATH_INFO: `/v3/projects/204a4cdef570466096397cb2473b61ad/users/9ebe1e26df32481ab521d2b9e25e2be8/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:51.379106 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcea635-18be-43b6-9b6c-4a19ff4c054a admin admin] RBAC: Authorizing `identity:create_grant(project_id=204a4cdef570466096397cb2473b61ad, user_id=9ebe1e26df32481ab521d2b9e25e2be8, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:51.381845 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcea635-18be-43b6-9b6c-4a19ff4c054a admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:51.449183 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4215/8454] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:46:51 2022] PUT /identity/v3/projects/204a4cdef570466096397cb2473b61ad/users/9ebe1e26df32481ab521d2b9e25e2be8/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:46:51.453131 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c5ab6c-3689-4324-8a20-0ca4788be1f1 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:51.463750 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c5ab6c-3689-4324-8a20-0ca4788be1f1 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:51.520601 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8653e1-a573-43e5-b938-c6e974331585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:51.521274 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8653e1-a573-43e5-b938-c6e974331585 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:51.521559 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8653e1-a573-43e5-b938-c6e974331585 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:51.521839 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8653e1-a573-43e5-b938-c6e974331585 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:51.522555 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8653e1-a573-43e5-b938-c6e974331585 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:51.524465 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8653e1-a573-43e5-b938-c6e974331585 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:51.534786 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4240/8455] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:46:51 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:46:51.538936 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcea635-18be-43b6-9b6c-4a19ff4c054a admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:51.550426 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcea635-18be-43b6-9b6c-4a19ff4c054a admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:51.555360 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416abf4b-eb84-41e4-a350-af83a7902d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:51.556216 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416abf4b-eb84-41e4-a350-af83a7902d7b admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:51.556497 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416abf4b-eb84-41e4-a350-af83a7902d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:51.556770 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416abf4b-eb84-41e4-a350-af83a7902d7b admin admin] PATH_INFO: `/v3/projects/204a4cdef570466096397cb2473b61ad/users/9ebe1e26df32481ab521d2b9e25e2be8/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:51.559692 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416abf4b-eb84-41e4-a350-af83a7902d7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=204a4cdef570466096397cb2473b61ad, user_id=9ebe1e26df32481ab521d2b9e25e2be8, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:51.562355 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416abf4b-eb84-41e4-a350-af83a7902d7b admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:51.573514 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4216/8456] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:46:51 2022] PUT /identity/v3/projects/204a4cdef570466096397cb2473b61ad/users/9ebe1e26df32481ab521d2b9e25e2be8/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:46:51.583924 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720bf355-b42d-403a-89ff-c71ffe0aeec3 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:51.584216 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720bf355-b42d-403a-89ff-c71ffe0aeec3 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:51.586178 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720bf355-b42d-403a-89ff-c71ffe0aeec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:51.616729 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-720bf355-b42d-403a-89ff-c71ffe0aeec3 None None] MFA Rules not processed for user `9ebe1e26df32481ab521d2b9e25e2be8`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:46:51.617964 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-720bf355-b42d-403a-89ff-c71ffe0aeec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:46:51.686571 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4241/8457] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:46:51 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:46:51.697593 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416abf4b-eb84-41e4-a350-af83a7902d7b admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:51.699390 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-416abf4b-eb84-41e4-a350-af83a7902d7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:46:51.761261 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416abf4b-eb84-41e4-a350-af83a7902d7b admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:51.765123 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1b9661-7195-46e8-8b71-657974011f26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198271d1c0d44cb58bace41a65f4b94c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:51.765770 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b9661-7195-46e8-8b71-657974011f26 service cinder] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:51.766049 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b9661-7195-46e8-8b71-657974011f26 service cinder] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:51.766347 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b9661-7195-46e8-8b71-657974011f26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:51.777113 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1b9661-7195-46e8-8b71-657974011f26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:51.778574 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1b9661-7195-46e8-8b71-657974011f26 service cinder] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:51.789759 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4217/8458] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:46:51 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:46:52.268664 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720bf355-b42d-403a-89ff-c71ffe0aeec3 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:52.337963 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720bf355-b42d-403a-89ff-c71ffe0aeec3 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:52.343027 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2085b18b-e7ba-41f2-82c2-5c9c5d84fceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:52.346314 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2085b18b-e7ba-41f2-82c2-5c9c5d84fceb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:52.346314 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2085b18b-e7ba-41f2-82c2-5c9c5d84fceb admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:52.346314 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2085b18b-e7ba-41f2-82c2-5c9c5d84fceb admin admin] PATH_INFO: `/v3/users/052dc4697f8e4081b188be83a4b7ab25` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:52.346314 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2085b18b-e7ba-41f2-82c2-5c9c5d84fceb admin admin] RBAC: Authorizing `identity:delete_user(user_id=052dc4697f8e4081b188be83a4b7ab25)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:52.347765 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2085b18b-e7ba-41f2-82c2-5c9c5d84fceb admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:52.513744 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2085b18b-e7ba-41f2-82c2-5c9c5d84fceb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '052dc4697f8e4081b188be83a4b7ab25'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:46:52.525340 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2085b18b-e7ba-41f2-82c2-5c9c5d84fceb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '052dc4697f8e4081b188be83a4b7ab25'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:46:52.532089 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2085b18b-e7ba-41f2-82c2-5c9c5d84fceb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '052dc4697f8e4081b188be83a4b7ab25'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:46:52.579538 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2085b18b-e7ba-41f2-82c2-5c9c5d84fceb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '052dc4697f8e4081b188be83a4b7ab25'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:46:52.580189 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2085b18b-e7ba-41f2-82c2-5c9c5d84fceb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '052dc4697f8e4081b188be83a4b7ab25'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:46:52.586399 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4242/8459] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:46:52 2022] DELETE /identity/v3/users/052dc4697f8e4081b188be83a4b7ab25 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:46:52.590859 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba84fc-289b-4469-8e59-295139565ef0 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:52.591343 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba84fc-289b-4469-8e59-295139565ef0 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:52.591491 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba84fc-289b-4469-8e59-295139565ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:52.609545 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-21ba84fc-289b-4469-8e59-295139565ef0 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:46:52.610743 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-21ba84fc-289b-4469-8e59-295139565ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:46:52.668210 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4218/8460] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:46:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:46:52.677860 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2085b18b-e7ba-41f2-82c2-5c9c5d84fceb admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:52.679305 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-2085b18b-e7ba-41f2-82c2-5c9c5d84fceb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:46:52.737760 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2085b18b-e7ba-41f2-82c2-5c9c5d84fceb admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:52.741419 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d19e33-ac25-4cde-af7f-79a0496150bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:52.742058 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d19e33-ac25-4cde-af7f-79a0496150bd service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:52.742343 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d19e33-ac25-4cde-af7f-79a0496150bd service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:52.742622 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d19e33-ac25-4cde-af7f-79a0496150bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:52.752514 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d19e33-ac25-4cde-af7f-79a0496150bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:52.753942 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d19e33-ac25-4cde-af7f-79a0496150bd service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:52.763445 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4243/8461] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:46:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:46:53.107921 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ba84fc-289b-4469-8e59-295139565ef0 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:53.109353 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-21ba84fc-289b-4469-8e59-295139565ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:46:53.123986 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ba84fc-289b-4469-8e59-295139565ef0 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:53.128989 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5413d1-d757-49e4-abb9-494843876438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:53.132040 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5413d1-d757-49e4-abb9-494843876438 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:53.132670 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5413d1-d757-49e4-abb9-494843876438 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:53.132670 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5413d1-d757-49e4-abb9-494843876438 admin admin] PATH_INFO: `/v3/projects/53ff0d90c25e43219453b3c11c4bcc20` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:53.133840 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5413d1-d757-49e4-abb9-494843876438 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53ff0d90c25e43219453b3c11c4bcc20)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:53.136269 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5413d1-d757-49e4-abb9-494843876438 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:53.262795 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9a5413d1-d757-49e4-abb9-494843876438 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53ff0d90c25e43219453b3c11c4bcc20', 'request_id': 'req-9a5413d1-d757-49e4-abb9-494843876438'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:46:53.269052 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9a5413d1-d757-49e4-abb9-494843876438 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53ff0d90c25e43219453b3c11c4bcc20', 'request_id': 'req-9a5413d1-d757-49e4-abb9-494843876438'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:46:53.280066 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9a5413d1-d757-49e4-abb9-494843876438 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53ff0d90c25e43219453b3c11c4bcc20', 'request_id': 'req-9a5413d1-d757-49e4-abb9-494843876438'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:46:53.352286 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9a5413d1-d757-49e4-abb9-494843876438 admin admin] The token cache is being invalidate because project 53ff0d90c25e43219453b3c11c4bcc20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:46:53.352514 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9a5413d1-d757-49e4-abb9-494843876438 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:46:53.353163 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9a5413d1-d757-49e4-abb9-494843876438 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:46:53.355369 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4219/8462] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:46:53 2022] DELETE /identity/v3/projects/53ff0d90c25e43219453b3c11c4bcc20 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:46:53.364530 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d19e33-ac25-4cde-af7f-79a0496150bd service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:53.375271 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d19e33-ac25-4cde-af7f-79a0496150bd service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:53.438185 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b068f9-9275-49b9-a4ec-680abfb79fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:53.439127 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b068f9-9275-49b9-a4ec-680abfb79fd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:53.439420 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b068f9-9275-49b9-a4ec-680abfb79fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:53.439778 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b068f9-9275-49b9-a4ec-680abfb79fd9 admin admin] PATH_INFO: `/v3/users/9ebe1e26df32481ab521d2b9e25e2be8` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:53.441044 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b068f9-9275-49b9-a4ec-680abfb79fd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ebe1e26df32481ab521d2b9e25e2be8)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:53.443026 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b068f9-9275-49b9-a4ec-680abfb79fd9 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:53.657508 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-89b068f9-9275-49b9-a4ec-680abfb79fd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ebe1e26df32481ab521d2b9e25e2be8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:46:53.669649 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-89b068f9-9275-49b9-a4ec-680abfb79fd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ebe1e26df32481ab521d2b9e25e2be8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:46:53.676548 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-89b068f9-9275-49b9-a4ec-680abfb79fd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ebe1e26df32481ab521d2b9e25e2be8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:46:53.751289 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-89b068f9-9275-49b9-a4ec-680abfb79fd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ebe1e26df32481ab521d2b9e25e2be8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:46:53.751947 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-89b068f9-9275-49b9-a4ec-680abfb79fd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ebe1e26df32481ab521d2b9e25e2be8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:46:53.758212 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4244/8463] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:46:53 2022] DELETE /identity/v3/users/9ebe1e26df32481ab521d2b9e25e2be8 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:46:54.153432 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5413d1-d757-49e4-abb9-494843876438 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:54.154909 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-9a5413d1-d757-49e4-abb9-494843876438 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:46:54.168249 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5413d1-d757-49e4-abb9-494843876438 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:54.230638 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba6527-64da-4177-a191-5854d1917d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:54.231537 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba6527-64da-4177-a191-5854d1917d35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:54.231845 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba6527-64da-4177-a191-5854d1917d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:54.232114 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba6527-64da-4177-a191-5854d1917d35 admin admin] PATH_INFO: `/v3/projects/204a4cdef570466096397cb2473b61ad` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:54.233280 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcba6527-64da-4177-a191-5854d1917d35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=204a4cdef570466096397cb2473b61ad)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:54.235199 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcba6527-64da-4177-a191-5854d1917d35 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:54.391780 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dcba6527-64da-4177-a191-5854d1917d35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '204a4cdef570466096397cb2473b61ad', 'request_id': 'req-dcba6527-64da-4177-a191-5854d1917d35'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:46:54.397326 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dcba6527-64da-4177-a191-5854d1917d35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '204a4cdef570466096397cb2473b61ad', 'request_id': 'req-dcba6527-64da-4177-a191-5854d1917d35'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:46:54.404254 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dcba6527-64da-4177-a191-5854d1917d35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '204a4cdef570466096397cb2473b61ad', 'request_id': 'req-dcba6527-64da-4177-a191-5854d1917d35'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:46:54.476507 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dcba6527-64da-4177-a191-5854d1917d35 admin admin] The token cache is being invalidate because project 204a4cdef570466096397cb2473b61ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:46:54.476825 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dcba6527-64da-4177-a191-5854d1917d35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:46:54.477451 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dcba6527-64da-4177-a191-5854d1917d35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:46:54.479096 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4220/8464] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:46:54 2022] DELETE /identity/v3/projects/204a4cdef570466096397cb2473b61ad => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:46:54.484190 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff75c8fa-8cbd-4f6a-807e-524bb7d8afcc None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:54.484677 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff75c8fa-8cbd-4f6a-807e-524bb7d8afcc None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:54.484871 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff75c8fa-8cbd-4f6a-807e-524bb7d8afcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:54.505655 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-ff75c8fa-8cbd-4f6a-807e-524bb7d8afcc None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:46:54.506842 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ff75c8fa-8cbd-4f6a-807e-524bb7d8afcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:46:54.568634 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4245/8465] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:46:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:46:54.577289 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ddeabf-e26d-40e1-8f2e-269cbc37c458 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:54.577578 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ddeabf-e26d-40e1-8f2e-269cbc37c458 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:54.577858 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ddeabf-e26d-40e1-8f2e-269cbc37c458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:54.596918 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-d8ddeabf-e26d-40e1-8f2e-269cbc37c458 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:46:54.598131 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-d8ddeabf-e26d-40e1-8f2e-269cbc37c458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:46:54.606525 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4221/8466] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:46:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:46:54.610718 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff75c8fa-8cbd-4f6a-807e-524bb7d8afcc None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:54.620946 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff75c8fa-8cbd-4f6a-807e-524bb7d8afcc None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:54.625892 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d956152-0a19-435e-b0c3-00b598a3b14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:54.626583 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d956152-0a19-435e-b0c3-00b598a3b14d admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:54.626865 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d956152-0a19-435e-b0c3-00b598a3b14d admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:54.627884 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d956152-0a19-435e-b0c3-00b598a3b14d admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:54.627984 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d956152-0a19-435e-b0c3-00b598a3b14d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:46:54.628478 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d956152-0a19-435e-b0c3-00b598a3b14d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:54.631412 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d956152-0a19-435e-b0c3-00b598a3b14d admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:54.644763 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4246/8467] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:46:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 21:46:54.649427 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ddeabf-e26d-40e1-8f2e-269cbc37c458 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:54.659740 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ddeabf-e26d-40e1-8f2e-269cbc37c458 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:54.664402 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec731a-277b-4fa6-896d-819bec9c2c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:54.665057 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec731a-277b-4fa6-896d-819bec9c2c29 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:54.665335 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec731a-277b-4fa6-896d-819bec9c2c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:54.665607 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec731a-277b-4fa6-896d-819bec9c2c29 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:54.666283 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ec731a-277b-4fa6-896d-819bec9c2c29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:54.668226 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ec731a-277b-4fa6-896d-819bec9c2c29 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:54.753537 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4222/8468] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:46:54 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:46:54.757590 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d956152-0a19-435e-b0c3-00b598a3b14d admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:54.768419 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d956152-0a19-435e-b0c3-00b598a3b14d admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:54.826537 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22859a85-0068-4aaf-9760-a2fc3fc2b6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:54.827206 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22859a85-0068-4aaf-9760-a2fc3fc2b6c4 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:54.827527 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22859a85-0068-4aaf-9760-a2fc3fc2b6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:54.827874 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22859a85-0068-4aaf-9760-a2fc3fc2b6c4 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:54.828598 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22859a85-0068-4aaf-9760-a2fc3fc2b6c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:54.830648 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22859a85-0068-4aaf-9760-a2fc3fc2b6c4 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:54.969521 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4247/8469] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:46:54 2022] POST /identity/v3/users => generated 292 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:46:54.973815 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec731a-277b-4fa6-896d-819bec9c2c29 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:54.985015 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec731a-277b-4fa6-896d-819bec9c2c29 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:54.989499 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd7980a-e7e8-491c-a97d-4739786e213c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:54.990360 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd7980a-e7e8-491c-a97d-4739786e213c admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:54.990636 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd7980a-e7e8-491c-a97d-4739786e213c admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:54.990907 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd7980a-e7e8-491c-a97d-4739786e213c admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:54.991680 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd7980a-e7e8-491c-a97d-4739786e213c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:54.993298 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd7980a-e7e8-491c-a97d-4739786e213c admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:55.004443 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4223/8470] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:46:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:46:55.008392 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22859a85-0068-4aaf-9760-a2fc3fc2b6c4 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:55.019580 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22859a85-0068-4aaf-9760-a2fc3fc2b6c4 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:55.024622 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53152566-f70e-450b-a565-d25a7f2cea11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:55.025279 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53152566-f70e-450b-a565-d25a7f2cea11 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:55.026227 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53152566-f70e-450b-a565-d25a7f2cea11 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:55.026471 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53152566-f70e-450b-a565-d25a7f2cea11 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:55.027243 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53152566-f70e-450b-a565-d25a7f2cea11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:55.028892 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53152566-f70e-450b-a565-d25a7f2cea11 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:55.038994 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4248/8471] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:46:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:46:55.043334 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd7980a-e7e8-491c-a97d-4739786e213c admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:55.053481 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd7980a-e7e8-491c-a97d-4739786e213c admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:55.058333 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1de1de9-1365-420e-95c3-802318e3298f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:55.059236 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de1de9-1365-420e-95c3-802318e3298f admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:55.059561 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de1de9-1365-420e-95c3-802318e3298f admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:55.059842 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de1de9-1365-420e-95c3-802318e3298f admin admin] PATH_INFO: `/v3/projects/70f3e8ff1b404e28aa96706c849a21e4/users/7ca5af3c599842d39df5edf9876c892a/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:55.074614 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1de1de9-1365-420e-95c3-802318e3298f admin admin] RBAC: Authorizing `identity:create_grant(project_id=70f3e8ff1b404e28aa96706c849a21e4, user_id=7ca5af3c599842d39df5edf9876c892a, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:55.077335 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1de1de9-1365-420e-95c3-802318e3298f admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:55.128102 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4224/8472] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:46:55 2022] PUT /identity/v3/projects/70f3e8ff1b404e28aa96706c849a21e4/users/7ca5af3c599842d39df5edf9876c892a/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:46:55.139322 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e595b9-f8d2-4a95-a5c2-67d773babe6e None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:55.139760 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e595b9-f8d2-4a95-a5c2-67d773babe6e None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:55.140141 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e595b9-f8d2-4a95-a5c2-67d773babe6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:55.168578 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-a8e595b9-f8d2-4a95-a5c2-67d773babe6e None None] MFA Rules not processed for user `7ca5af3c599842d39df5edf9876c892a`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:46:55.169746 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-a8e595b9-f8d2-4a95-a5c2-67d773babe6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:46:55.232857 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4249/8473] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:46:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:46:55.237395 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1de1de9-1365-420e-95c3-802318e3298f admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:55.298285 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1de1de9-1365-420e-95c3-802318e3298f admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:55.303023 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47084d11-d5bc-4696-bcec-02ec5f970348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:55.303706 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47084d11-d5bc-4696-bcec-02ec5f970348 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:55.303988 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47084d11-d5bc-4696-bcec-02ec5f970348 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:55.304359 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47084d11-d5bc-4696-bcec-02ec5f970348 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:55.305027 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47084d11-d5bc-4696-bcec-02ec5f970348 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:55.306964 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47084d11-d5bc-4696-bcec-02ec5f970348 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:55.426566 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4225/8474] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:46:55 2022] POST /identity/v3/projects => generated 383 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:46:55.430603 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e595b9-f8d2-4a95-a5c2-67d773babe6e None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:55.442048 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e595b9-f8d2-4a95-a5c2-67d773babe6e None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:55.498538 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7e403-5aa1-4464-879a-d88973e5d153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:55.499220 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7e403-5aa1-4464-879a-d88973e5d153 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:55.499528 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7e403-5aa1-4464-879a-d88973e5d153 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:55.499815 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7e403-5aa1-4464-879a-d88973e5d153 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:55.500501 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb7e403-5aa1-4464-879a-d88973e5d153 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:55.502463 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb7e403-5aa1-4464-879a-d88973e5d153 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:55.587100 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4250/8475] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:46:55 2022] POST /identity/v3/users => generated 298 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:46:55.591743 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47084d11-d5bc-4696-bcec-02ec5f970348 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:55.604076 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47084d11-d5bc-4696-bcec-02ec5f970348 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:55.608621 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa933184-1c1f-4f70-b03b-ad18b143d48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:55.609380 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa933184-1c1f-4f70-b03b-ad18b143d48e admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:55.609668 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa933184-1c1f-4f70-b03b-ad18b143d48e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:55.609943 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa933184-1c1f-4f70-b03b-ad18b143d48e admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:55.610659 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa933184-1c1f-4f70-b03b-ad18b143d48e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:55.612361 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa933184-1c1f-4f70-b03b-ad18b143d48e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:55.623807 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4226/8476] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:46:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:46:55.627942 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7e403-5aa1-4464-879a-d88973e5d153 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:55.638760 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7e403-5aa1-4464-879a-d88973e5d153 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:55.643437 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462df7ac-2ee9-4092-851f-5b407a398622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:55.644387 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462df7ac-2ee9-4092-851f-5b407a398622 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:55.644674 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462df7ac-2ee9-4092-851f-5b407a398622 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:55.644954 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462df7ac-2ee9-4092-851f-5b407a398622 admin admin] PATH_INFO: `/v3/projects/cf9f687c9f3e4af5aee8680d7524710d/users/4d8fdd2bb1274373b1ee9e7d069e6681/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:55.661444 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462df7ac-2ee9-4092-851f-5b407a398622 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf9f687c9f3e4af5aee8680d7524710d, user_id=4d8fdd2bb1274373b1ee9e7d069e6681, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:55.664143 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462df7ac-2ee9-4092-851f-5b407a398622 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:55.751527 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4251/8477] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:46:55 2022] PUT /identity/v3/projects/cf9f687c9f3e4af5aee8680d7524710d/users/4d8fdd2bb1274373b1ee9e7d069e6681/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:46:55.755915 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa933184-1c1f-4f70-b03b-ad18b143d48e admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:55.767140 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa933184-1c1f-4f70-b03b-ad18b143d48e admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:55.824984 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feac46f-04fb-4338-8c28-833a5ee22524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:55.825576 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feac46f-04fb-4338-8c28-833a5ee22524 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:55.825862 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feac46f-04fb-4338-8c28-833a5ee22524 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:55.826142 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feac46f-04fb-4338-8c28-833a5ee22524 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:55.826865 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feac46f-04fb-4338-8c28-833a5ee22524 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:55.828515 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feac46f-04fb-4338-8c28-833a5ee22524 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:55.839437 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4227/8478] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:46:55 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:46:55.843366 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462df7ac-2ee9-4092-851f-5b407a398622 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:55.854115 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462df7ac-2ee9-4092-851f-5b407a398622 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:55.859168 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1538962-a279-41c3-aeeb-3e122510030f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:55.860782 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1538962-a279-41c3-aeeb-3e122510030f admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:55.861074 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1538962-a279-41c3-aeeb-3e122510030f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:55.861356 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1538962-a279-41c3-aeeb-3e122510030f admin admin] PATH_INFO: `/v3/projects/cf9f687c9f3e4af5aee8680d7524710d/users/4d8fdd2bb1274373b1ee9e7d069e6681/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:55.863510 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1538962-a279-41c3-aeeb-3e122510030f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf9f687c9f3e4af5aee8680d7524710d, user_id=4d8fdd2bb1274373b1ee9e7d069e6681, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:55.866183 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1538962-a279-41c3-aeeb-3e122510030f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:55.877666 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4252/8479] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:46:55 2022] PUT /identity/v3/projects/cf9f687c9f3e4af5aee8680d7524710d/users/4d8fdd2bb1274373b1ee9e7d069e6681/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:46:55.888112 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125da50-d01e-4321-ab0e-496f13bfd494 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:55.888386 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125da50-d01e-4321-ab0e-496f13bfd494 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:55.888665 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125da50-d01e-4321-ab0e-496f13bfd494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:55.916009 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-3125da50-d01e-4321-ab0e-496f13bfd494 None None] MFA Rules not processed for user `4d8fdd2bb1274373b1ee9e7d069e6681`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:46:55.917303 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-3125da50-d01e-4321-ab0e-496f13bfd494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:46:55.986597 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4228/8480] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:46:55 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:46:55.998152 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1538962-a279-41c3-aeeb-3e122510030f admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:46:55.999859 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c1538962-a279-41c3-aeeb-3e122510030f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:46:56.061636 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1538962-a279-41c3-aeeb-3e122510030f admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:46:56.065579 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32865527-c217-49f4-9d24-42864a823939 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198271d1c0d44cb58bace41a65f4b94c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:46:56.066339 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32865527-c217-49f4-9d24-42864a823939 service cinder] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:46:56.066726 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32865527-c217-49f4-9d24-42864a823939 service cinder] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:46:56.067103 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32865527-c217-49f4-9d24-42864a823939 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:46:56.124269 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32865527-c217-49f4-9d24-42864a823939 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:46:56.125743 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32865527-c217-49f4-9d24-42864a823939 service cinder] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:46:56.134960 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4253/8481] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:46:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:47:04.636302 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3125da50-d01e-4321-ab0e-496f13bfd494 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:47:04.648500 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3125da50-d01e-4321-ab0e-496f13bfd494 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:47:04.652406 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155fb6af-6583-4dd4-ae68-ef40f25b46ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198271d1c0d44cb58bace41a65f4b94c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:47:04.653046 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155fb6af-6583-4dd4-ae68-ef40f25b46ba service cinder] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:47:04.653361 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155fb6af-6583-4dd4-ae68-ef40f25b46ba service cinder] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:47:04.653641 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155fb6af-6583-4dd4-ae68-ef40f25b46ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:47:04.662568 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155fb6af-6583-4dd4-ae68-ef40f25b46ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:47:04.664078 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155fb6af-6583-4dd4-ae68-ef40f25b46ba service cinder] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:47:04.674053 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4229/8482] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:47:04 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:47:06.726625 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057d3493-3f2c-4e64-bc38-e078abb3772f None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:47:06.727164 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057d3493-3f2c-4e64-bc38-e078abb3772f None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:47:06.727164 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057d3493-3f2c-4e64-bc38-e078abb3772f None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:47:06.728720 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4254/8483] 10.222.0.52 () {54 vars in 912 bytes} [Sat May 14 21:47:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 14 21:47:06.735908 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d117cb0-7466-4b63-a0aa-62e97eecbad8 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:47:06.736347 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d117cb0-7466-4b63-a0aa-62e97eecbad8 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:47:06.736690 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d117cb0-7466-4b63-a0aa-62e97eecbad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:47:06.772909 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-6d117cb0-7466-4b63-a0aa-62e97eecbad8 None None] MFA Rules not processed for user `99ed32a6d699453bb7e088540e8fc980`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:47:06.774364 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-6d117cb0-7466-4b63-a0aa-62e97eecbad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:47:06.826841 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4230/8484] 10.222.0.52 () {58 vars in 1009 bytes} [Sat May 14 21:47:06 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:47:06.839764 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057d3493-3f2c-4e64-bc38-e078abb3772f None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:47:06.841604 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-057d3493-3f2c-4e64-bc38-e078abb3772f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:47:06.858413 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057d3493-3f2c-4e64-bc38-e078abb3772f None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:47:06.862304 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20128e4-ac6d-4985-861e-d03c8614f59d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:47:06.863025 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20128e4-ac6d-4985-861e-d03c8614f59d service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:47:06.863391 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20128e4-ac6d-4985-861e-d03c8614f59d service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:47:06.863867 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20128e4-ac6d-4985-861e-d03c8614f59d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:47:06.872512 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20128e4-ac6d-4985-861e-d03c8614f59d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:47:06.874068 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20128e4-ac6d-4985-861e-d03c8614f59d service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:47:06.882643 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4255/8485] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:47:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:47:27.041121 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d117cb0-7466-4b63-a0aa-62e97eecbad8 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:47:27.042551 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-6d117cb0-7466-4b63-a0aa-62e97eecbad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:47:27.114183 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d117cb0-7466-4b63-a0aa-62e97eecbad8 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:47:27.119227 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886318da-b8ed-417f-9fd8-7219a9b6a9b2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:47:27.119903 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886318da-b8ed-417f-9fd8-7219a9b6a9b2 service placement] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:47:27.120194 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886318da-b8ed-417f-9fd8-7219a9b6a9b2 service placement] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:47:27.120468 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886318da-b8ed-417f-9fd8-7219a9b6a9b2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:47:27.122210 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-886318da-b8ed-417f-9fd8-7219a9b6a9b2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:47:27.135998 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886318da-b8ed-417f-9fd8-7219a9b6a9b2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:47:27.137579 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886318da-b8ed-417f-9fd8-7219a9b6a9b2 service placement] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:47:27.150899 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4231/8486] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:47:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:47:27.499439 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20128e4-ac6d-4985-861e-d03c8614f59d service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:47:27.510824 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20128e4-ac6d-4985-861e-d03c8614f59d service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:47:27.515655 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae67082-2da5-4ab4-ba51-aa169b1f95c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:47:27.515655 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae67082-2da5-4ab4-ba51-aa169b1f95c4 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:47:27.515893 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae67082-2da5-4ab4-ba51-aa169b1f95c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:47:27.516102 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae67082-2da5-4ab4-ba51-aa169b1f95c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:47:27.517881 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-6ae67082-2da5-4ab4-ba51-aa169b1f95c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:47:27.530936 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae67082-2da5-4ab4-ba51-aa169b1f95c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:47:27.532489 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae67082-2da5-4ab4-ba51-aa169b1f95c4 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:47:27.543085 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4256/8487] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:47:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:47:27.719276 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae586984-935a-4543-a781-8c205ae021ac None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:47:27.719591 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae586984-935a-4543-a781-8c205ae021ac None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:47:27.719867 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae586984-935a-4543-a781-8c205ae021ac None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:47:27.721555 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4232/8488] 10.222.0.52 () {54 vars in 921 bytes} [Sat May 14 21:47:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:47:27.726628 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbfdd18-e0bd-4c2c-b645-03c3f1b4a15d None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:47:27.727974 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbfdd18-e0bd-4c2c-b645-03c3f1b4a15d None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:47:27.727974 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbfdd18-e0bd-4c2c-b645-03c3f1b4a15d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:47:27.763443 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-fcbfdd18-e0bd-4c2c-b645-03c3f1b4a15d None None] MFA Rules not processed for user `0812ae67e44d483baf2dbb1a5332a1d7`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:47:27.765225 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-fcbfdd18-e0bd-4c2c-b645-03c3f1b4a15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:47:27.774617 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4257/8489] 10.222.0.52 () {58 vars in 1018 bytes} [Sat May 14 21:47:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:47:27.803053 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae586984-935a-4543-a781-8c205ae021ac None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:47:27.813512 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae586984-935a-4543-a781-8c205ae021ac None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:47:27.818705 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c03c51-2d96-4f15-9c26-a266a4476921 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:47:27.821759 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c03c51-2d96-4f15-9c26-a266a4476921 service placement] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:47:27.821759 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c03c51-2d96-4f15-9c26-a266a4476921 service placement] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:47:27.821759 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c03c51-2d96-4f15-9c26-a266a4476921 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:47:27.829078 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c03c51-2d96-4f15-9c26-a266a4476921 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:47:27.840309 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c03c51-2d96-4f15-9c26-a266a4476921 service placement] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:47:27.840979 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4233/8490] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:47:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:47:28.132832 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbfdd18-e0bd-4c2c-b645-03c3f1b4a15d None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:47:28.133949 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-fcbfdd18-e0bd-4c2c-b645-03c3f1b4a15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:47:28.149145 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbfdd18-e0bd-4c2c-b645-03c3f1b4a15d None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:47:28.152683 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c901b0c-013e-499c-bb02-76812e5821ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:47:28.153310 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c901b0c-013e-499c-bb02-76812e5821ef service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:47:28.153592 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c901b0c-013e-499c-bb02-76812e5821ef service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:47:28.153868 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c901b0c-013e-499c-bb02-76812e5821ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:47:28.156125 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-8c901b0c-013e-499c-bb02-76812e5821ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:47:28.228794 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c901b0c-013e-499c-bb02-76812e5821ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:47:28.230264 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c901b0c-013e-499c-bb02-76812e5821ef service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:47:28.243728 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4258/8491] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:47:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:47:45.253194 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c03c51-2d96-4f15-9c26-a266a4476921 service placement] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:47:45.266129 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c03c51-2d96-4f15-9c26-a266a4476921 service placement] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:47:45.270069 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d8e580-be93-4f7c-89bd-9620eb5f6d51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:47:45.271034 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8e580-be93-4f7c-89bd-9620eb5f6d51 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:47:45.271034 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8e580-be93-4f7c-89bd-9620eb5f6d51 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:47:45.271312 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8e580-be93-4f7c-89bd-9620eb5f6d51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:47:45.273163 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-32d8e580-be93-4f7c-89bd-9620eb5f6d51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:47:45.286460 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d8e580-be93-4f7c-89bd-9620eb5f6d51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:47:45.288053 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d8e580-be93-4f7c-89bd-9620eb5f6d51 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:47:45.299329 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4234/8492] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:47:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:47:48.147998 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c901b0c-013e-499c-bb02-76812e5821ef service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:47:48.210806 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c901b0c-013e-499c-bb02-76812e5821ef service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:47:48.215375 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce9095a-77f7-4122-82e2-5949c0fd208b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:47:48.216309 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce9095a-77f7-4122-82e2-5949c0fd208b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:47:48.216597 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce9095a-77f7-4122-82e2-5949c0fd208b admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:47:48.216930 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce9095a-77f7-4122-82e2-5949c0fd208b admin admin] PATH_INFO: `/v3/users/7ca5af3c599842d39df5edf9876c892a` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:47:48.218117 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce9095a-77f7-4122-82e2-5949c0fd208b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ca5af3c599842d39df5edf9876c892a)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:47:48.220132 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce9095a-77f7-4122-82e2-5949c0fd208b admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:47:48.354265 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-4ce9095a-77f7-4122-82e2-5949c0fd208b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ca5af3c599842d39df5edf9876c892a'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:47:48.367256 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-4ce9095a-77f7-4122-82e2-5949c0fd208b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ca5af3c599842d39df5edf9876c892a'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:47:48.374152 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-4ce9095a-77f7-4122-82e2-5949c0fd208b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ca5af3c599842d39df5edf9876c892a'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:47:48.437244 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-4ce9095a-77f7-4122-82e2-5949c0fd208b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ca5af3c599842d39df5edf9876c892a'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:47:48.437868 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-4ce9095a-77f7-4122-82e2-5949c0fd208b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ca5af3c599842d39df5edf9876c892a'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:47:48.444239 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4259/8493] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:47:48 2022] DELETE /identity/v3/users/7ca5af3c599842d39df5edf9876c892a => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:47:48.448792 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65cf7e4-2abe-41f3-973e-82a540095c20 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:47:48.449276 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65cf7e4-2abe-41f3-973e-82a540095c20 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:47:48.449377 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65cf7e4-2abe-41f3-973e-82a540095c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:47:48.467725 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-f65cf7e4-2abe-41f3-973e-82a540095c20 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:47:48.468865 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-f65cf7e4-2abe-41f3-973e-82a540095c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:47:48.526510 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4235/8494] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:47:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:47:48.537019 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce9095a-77f7-4122-82e2-5949c0fd208b admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:47:48.538481 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-4ce9095a-77f7-4122-82e2-5949c0fd208b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:47:48.598239 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce9095a-77f7-4122-82e2-5949c0fd208b admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:47:48.601894 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba935be5-d539-489a-851f-bdea20f29eed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:47:48.602529 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba935be5-d539-489a-851f-bdea20f29eed service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:47:48.602813 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba935be5-d539-489a-851f-bdea20f29eed service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:47:48.603091 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba935be5-d539-489a-851f-bdea20f29eed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:47:48.612134 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba935be5-d539-489a-851f-bdea20f29eed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:47:48.613556 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba935be5-d539-489a-851f-bdea20f29eed service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:47:48.623135 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4260/8495] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:47:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:47:49.021547 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65cf7e4-2abe-41f3-973e-82a540095c20 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:47:49.021547 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-f65cf7e4-2abe-41f3-973e-82a540095c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:47:49.029794 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65cf7e4-2abe-41f3-973e-82a540095c20 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:47:49.034898 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6fe870-944a-49e2-8a45-6b49915f0ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:47:49.035898 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6fe870-944a-49e2-8a45-6b49915f0ef7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:47:49.036188 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6fe870-944a-49e2-8a45-6b49915f0ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:47:49.036337 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6fe870-944a-49e2-8a45-6b49915f0ef7 admin admin] PATH_INFO: `/v3/projects/70f3e8ff1b404e28aa96706c849a21e4` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:47:49.037562 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6fe870-944a-49e2-8a45-6b49915f0ef7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70f3e8ff1b404e28aa96706c849a21e4)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:47:49.039534 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6fe870-944a-49e2-8a45-6b49915f0ef7 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:47:49.284026 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9b6fe870-944a-49e2-8a45-6b49915f0ef7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70f3e8ff1b404e28aa96706c849a21e4', 'request_id': 'req-9b6fe870-944a-49e2-8a45-6b49915f0ef7'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:47:49.289669 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9b6fe870-944a-49e2-8a45-6b49915f0ef7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70f3e8ff1b404e28aa96706c849a21e4', 'request_id': 'req-9b6fe870-944a-49e2-8a45-6b49915f0ef7'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:47:49.296851 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9b6fe870-944a-49e2-8a45-6b49915f0ef7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70f3e8ff1b404e28aa96706c849a21e4', 'request_id': 'req-9b6fe870-944a-49e2-8a45-6b49915f0ef7'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:47:49.402014 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9b6fe870-944a-49e2-8a45-6b49915f0ef7 admin admin] The token cache is being invalidate because project 70f3e8ff1b404e28aa96706c849a21e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:47:49.402308 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9b6fe870-944a-49e2-8a45-6b49915f0ef7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:47:49.402942 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9b6fe870-944a-49e2-8a45-6b49915f0ef7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:47:49.405172 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4236/8496] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:47:49 2022] DELETE /identity/v3/projects/70f3e8ff1b404e28aa96706c849a21e4 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:47:49.409127 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba935be5-d539-489a-851f-bdea20f29eed service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:47:49.419325 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba935be5-d539-489a-851f-bdea20f29eed service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:47:49.478315 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a5dbab-3348-4ab8-b675-1572a813bf56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:47:49.485001 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5dbab-3348-4ab8-b675-1572a813bf56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:47:49.485001 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5dbab-3348-4ab8-b675-1572a813bf56 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:47:49.485001 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5dbab-3348-4ab8-b675-1572a813bf56 admin admin] PATH_INFO: `/v3/users/4d8fdd2bb1274373b1ee9e7d069e6681` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:47:49.485001 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a5dbab-3348-4ab8-b675-1572a813bf56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d8fdd2bb1274373b1ee9e7d069e6681)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:47:49.485001 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a5dbab-3348-4ab8-b675-1572a813bf56 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:47:49.661478 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e3a5dbab-3348-4ab8-b675-1572a813bf56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d8fdd2bb1274373b1ee9e7d069e6681'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:47:49.672947 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e3a5dbab-3348-4ab8-b675-1572a813bf56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d8fdd2bb1274373b1ee9e7d069e6681'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:47:49.679701 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e3a5dbab-3348-4ab8-b675-1572a813bf56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d8fdd2bb1274373b1ee9e7d069e6681'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:47:49.756326 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e3a5dbab-3348-4ab8-b675-1572a813bf56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d8fdd2bb1274373b1ee9e7d069e6681'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:47:49.756958 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e3a5dbab-3348-4ab8-b675-1572a813bf56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d8fdd2bb1274373b1ee9e7d069e6681'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:47:49.763258 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4261/8497] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:47:49 2022] DELETE /identity/v3/users/4d8fdd2bb1274373b1ee9e7d069e6681 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:47:50.157603 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6fe870-944a-49e2-8a45-6b49915f0ef7 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:47:50.159071 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-9b6fe870-944a-49e2-8a45-6b49915f0ef7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:47:50.173808 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6fe870-944a-49e2-8a45-6b49915f0ef7 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:47:50.233278 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc20b582-ddae-4ba9-82aa-ee2a1ff16900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:47:50.234132 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc20b582-ddae-4ba9-82aa-ee2a1ff16900 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:47:50.234414 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc20b582-ddae-4ba9-82aa-ee2a1ff16900 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:47:50.234690 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc20b582-ddae-4ba9-82aa-ee2a1ff16900 admin admin] PATH_INFO: `/v3/projects/cf9f687c9f3e4af5aee8680d7524710d` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:47:50.235895 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc20b582-ddae-4ba9-82aa-ee2a1ff16900 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf9f687c9f3e4af5aee8680d7524710d)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:47:50.237806 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc20b582-ddae-4ba9-82aa-ee2a1ff16900 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:47:50.351985 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-bc20b582-ddae-4ba9-82aa-ee2a1ff16900 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf9f687c9f3e4af5aee8680d7524710d', 'request_id': 'req-bc20b582-ddae-4ba9-82aa-ee2a1ff16900'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:47:50.358212 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-bc20b582-ddae-4ba9-82aa-ee2a1ff16900 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf9f687c9f3e4af5aee8680d7524710d', 'request_id': 'req-bc20b582-ddae-4ba9-82aa-ee2a1ff16900'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:47:50.364784 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-bc20b582-ddae-4ba9-82aa-ee2a1ff16900 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf9f687c9f3e4af5aee8680d7524710d', 'request_id': 'req-bc20b582-ddae-4ba9-82aa-ee2a1ff16900'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:47:50.447132 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-bc20b582-ddae-4ba9-82aa-ee2a1ff16900 admin admin] The token cache is being invalidate because project cf9f687c9f3e4af5aee8680d7524710d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:47:50.451107 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-bc20b582-ddae-4ba9-82aa-ee2a1ff16900 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:47:50.451107 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-bc20b582-ddae-4ba9-82aa-ee2a1ff16900 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:47:50.451107 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4237/8498] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:47:50 2022] DELETE /identity/v3/projects/cf9f687c9f3e4af5aee8680d7524710d => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:47:50.454641 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a101135-89c5-4363-a562-683957bb2ec7 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:47:50.455140 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a101135-89c5-4363-a562-683957bb2ec7 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:47:50.455248 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a101135-89c5-4363-a562-683957bb2ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:47:50.473636 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-4a101135-89c5-4363-a562-683957bb2ec7 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:47:50.474840 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-4a101135-89c5-4363-a562-683957bb2ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:47:50.534560 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4262/8499] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:47:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:47:50.543389 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fcaec7-ee17-4e1f-b29f-99e06e78eb0e None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:47:50.548596 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fcaec7-ee17-4e1f-b29f-99e06e78eb0e None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:47:50.548596 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fcaec7-ee17-4e1f-b29f-99e06e78eb0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:47:50.562658 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-26fcaec7-ee17-4e1f-b29f-99e06e78eb0e None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:47:50.563887 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-26fcaec7-ee17-4e1f-b29f-99e06e78eb0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:47:50.572066 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4238/8500] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:47:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:47:50.576299 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a101135-89c5-4363-a562-683957bb2ec7 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:47:50.586075 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a101135-89c5-4363-a562-683957bb2ec7 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:47:50.590755 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c45666-c68b-4298-bc36-88592ebf5cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:47:50.591410 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c45666-c68b-4298-bc36-88592ebf5cae admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:47:50.594536 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c45666-c68b-4298-bc36-88592ebf5cae admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:47:50.594536 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c45666-c68b-4298-bc36-88592ebf5cae admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:47:50.594536 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c45666-c68b-4298-bc36-88592ebf5cae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:47:50.594536 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c45666-c68b-4298-bc36-88592ebf5cae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:47:50.595223 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c45666-c68b-4298-bc36-88592ebf5cae admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:47:50.606860 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4263/8501] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:47:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:47:50.611754 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fcaec7-ee17-4e1f-b29f-99e06e78eb0e None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:47:50.620927 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fcaec7-ee17-4e1f-b29f-99e06e78eb0e None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:47:50.625635 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa8eda-b128-40cc-9a71-f5d71eb70e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:47:50.626283 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa8eda-b128-40cc-9a71-f5d71eb70e4c admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:47:50.626568 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa8eda-b128-40cc-9a71-f5d71eb70e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:47:50.626847 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa8eda-b128-40cc-9a71-f5d71eb70e4c admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:47:50.627555 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aa8eda-b128-40cc-9a71-f5d71eb70e4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:47:50.629513 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aa8eda-b128-40cc-9a71-f5d71eb70e4c admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:47:50.758290 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4239/8502] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:47:50 2022] POST /identity/v3/projects => generated 375 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:47:50.762550 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c45666-c68b-4298-bc36-88592ebf5cae admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:47:50.772886 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c45666-c68b-4298-bc36-88592ebf5cae admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:47:50.829226 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8deb12c-c8b4-49c6-acfa-3cb8e45c4f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:47:50.834781 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8deb12c-c8b4-49c6-acfa-3cb8e45c4f06 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:47:50.834781 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8deb12c-c8b4-49c6-acfa-3cb8e45c4f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:47:50.834781 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8deb12c-c8b4-49c6-acfa-3cb8e45c4f06 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:47:50.834781 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8deb12c-c8b4-49c6-acfa-3cb8e45c4f06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:47:50.834781 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8deb12c-c8b4-49c6-acfa-3cb8e45c4f06 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:47:50.952296 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4264/8503] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:47:50 2022] POST /identity/v3/users => generated 288 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:47:50.956625 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa8eda-b128-40cc-9a71-f5d71eb70e4c admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:47:50.967867 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa8eda-b128-40cc-9a71-f5d71eb70e4c admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:47:50.972507 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8f5215-3bac-4b10-92c6-a722d55130fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:47:50.973177 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f5215-3bac-4b10-92c6-a722d55130fb admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:47:50.973438 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f5215-3bac-4b10-92c6-a722d55130fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:47:50.973710 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f5215-3bac-4b10-92c6-a722d55130fb admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:47:50.974422 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8f5215-3bac-4b10-92c6-a722d55130fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:47:50.976055 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8f5215-3bac-4b10-92c6-a722d55130fb admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:47:50.986753 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4240/8504] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:47:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:47:50.990953 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8deb12c-c8b4-49c6-acfa-3cb8e45c4f06 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:47:51.001539 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8deb12c-c8b4-49c6-acfa-3cb8e45c4f06 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:47:51.006238 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e348d0c0-3e11-4b8b-96ad-221a0bceb46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:47:51.006882 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e348d0c0-3e11-4b8b-96ad-221a0bceb46f admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:47:51.007164 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e348d0c0-3e11-4b8b-96ad-221a0bceb46f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:47:51.007438 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e348d0c0-3e11-4b8b-96ad-221a0bceb46f admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:47:51.008178 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e348d0c0-3e11-4b8b-96ad-221a0bceb46f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:47:51.009819 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e348d0c0-3e11-4b8b-96ad-221a0bceb46f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:47:51.021092 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4265/8505] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:47:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:47:51.025468 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8f5215-3bac-4b10-92c6-a722d55130fb admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:47:51.036230 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8f5215-3bac-4b10-92c6-a722d55130fb admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:47:51.040753 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ec701f-0087-431f-b945-f1a1b53cf9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:47:51.041623 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec701f-0087-431f-b945-f1a1b53cf9c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:47:51.041913 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec701f-0087-431f-b945-f1a1b53cf9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:47:51.042187 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec701f-0087-431f-b945-f1a1b53cf9c4 admin admin] PATH_INFO: `/v3/projects/a190ad103a11415991ae90d3aacbc330/users/084b9518b50f44d99983915a32c3d9e6/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:47:51.056897 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ec701f-0087-431f-b945-f1a1b53cf9c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a190ad103a11415991ae90d3aacbc330, user_id=084b9518b50f44d99983915a32c3d9e6, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:47:51.059614 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ec701f-0087-431f-b945-f1a1b53cf9c4 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:47:51.127797 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4241/8506] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:47:51 2022] PUT /identity/v3/projects/a190ad103a11415991ae90d3aacbc330/users/084b9518b50f44d99983915a32c3d9e6/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:47:51.138065 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a43e7-1b1f-4f73-a91b-69ea0dfd9b66 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:47:51.138357 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a43e7-1b1f-4f73-a91b-69ea0dfd9b66 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:47:51.139139 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a43e7-1b1f-4f73-a91b-69ea0dfd9b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:47:51.165962 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-350a43e7-1b1f-4f73-a91b-69ea0dfd9b66 None None] MFA Rules not processed for user `084b9518b50f44d99983915a32c3d9e6`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:47:51.167160 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-350a43e7-1b1f-4f73-a91b-69ea0dfd9b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:47:51.228871 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4266/8507] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:47:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:47:51.239957 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ec701f-0087-431f-b945-f1a1b53cf9c4 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:47:51.241658 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c3ec701f-0087-431f-b945-f1a1b53cf9c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:47:51.299925 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ec701f-0087-431f-b945-f1a1b53cf9c4 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:47:51.303528 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f938d36-00bc-4583-b9f7-f83960d2062e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b5cb86f190f4fcfb06d66cb8f14643f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:47:51.304201 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f938d36-00bc-4583-b9f7-f83960d2062e service glance] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:47:51.304488 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f938d36-00bc-4583-b9f7-f83960d2062e service glance] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:47:51.304768 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f938d36-00bc-4583-b9f7-f83960d2062e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:47:51.313739 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f938d36-00bc-4583-b9f7-f83960d2062e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:47:51.315166 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f938d36-00bc-4583-b9f7-f83960d2062e service glance] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:47:51.323970 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4242/8508] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:47:51 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:48:02.129215 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350a43e7-1b1f-4f73-a91b-69ea0dfd9b66 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:48:02.189420 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350a43e7-1b1f-4f73-a91b-69ea0dfd9b66 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:48:02.193827 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddb294a-2e42-40d0-9315-c032136e938c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:48:02.194684 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddb294a-2e42-40d0-9315-c032136e938c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:48:02.194966 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddb294a-2e42-40d0-9315-c032136e938c admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:48:02.195239 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddb294a-2e42-40d0-9315-c032136e938c admin admin] PATH_INFO: `/v3/users/084b9518b50f44d99983915a32c3d9e6` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:48:02.196436 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddb294a-2e42-40d0-9315-c032136e938c admin admin] RBAC: Authorizing `identity:delete_user(user_id=084b9518b50f44d99983915a32c3d9e6)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:48:02.198338 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddb294a-2e42-40d0-9315-c032136e938c admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:48:02.376639 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-eddb294a-2e42-40d0-9315-c032136e938c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '084b9518b50f44d99983915a32c3d9e6'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:48:02.388234 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-eddb294a-2e42-40d0-9315-c032136e938c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '084b9518b50f44d99983915a32c3d9e6'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:48:02.394946 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-eddb294a-2e42-40d0-9315-c032136e938c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '084b9518b50f44d99983915a32c3d9e6'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:48:02.481624 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-eddb294a-2e42-40d0-9315-c032136e938c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '084b9518b50f44d99983915a32c3d9e6'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:48:02.482200 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-eddb294a-2e42-40d0-9315-c032136e938c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '084b9518b50f44d99983915a32c3d9e6'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:48:02.489074 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4267/8509] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:48:02 2022] DELETE /identity/v3/users/084b9518b50f44d99983915a32c3d9e6 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:48:02.493686 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1037c3-f363-4a01-9025-760512c03c84 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:48:02.494154 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1037c3-f363-4a01-9025-760512c03c84 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:48:02.499774 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1037c3-f363-4a01-9025-760512c03c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:48:02.511243 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-5f1037c3-f363-4a01-9025-760512c03c84 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:48:02.512483 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-5f1037c3-f363-4a01-9025-760512c03c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:48:02.570921 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4243/8510] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:48:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:48:02.580627 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddb294a-2e42-40d0-9315-c032136e938c admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:48:02.582004 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-eddb294a-2e42-40d0-9315-c032136e938c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:48:02.641834 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddb294a-2e42-40d0-9315-c032136e938c admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:48:02.645498 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09552eac-6ea7-4e35-aecf-a464aa8438d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:48:02.646141 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09552eac-6ea7-4e35-aecf-a464aa8438d4 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:48:02.646418 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09552eac-6ea7-4e35-aecf-a464aa8438d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:48:02.646689 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09552eac-6ea7-4e35-aecf-a464aa8438d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:48:02.655860 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09552eac-6ea7-4e35-aecf-a464aa8438d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:48:02.657531 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09552eac-6ea7-4e35-aecf-a464aa8438d4 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:48:02.666755 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4268/8511] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:48:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:48:03.066515 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1037c3-f363-4a01-9025-760512c03c84 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:48:03.068063 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-5f1037c3-f363-4a01-9025-760512c03c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:48:03.081413 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1037c3-f363-4a01-9025-760512c03c84 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:48:03.086171 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccc02bb-4c16-4610-8f0a-f05c55296883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:48:03.087147 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc02bb-4c16-4610-8f0a-f05c55296883 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:48:03.087558 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc02bb-4c16-4610-8f0a-f05c55296883 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:48:03.087890 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc02bb-4c16-4610-8f0a-f05c55296883 admin admin] PATH_INFO: `/v3/projects/a190ad103a11415991ae90d3aacbc330` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:48:03.089208 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccc02bb-4c16-4610-8f0a-f05c55296883 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a190ad103a11415991ae90d3aacbc330)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:48:03.091217 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccc02bb-4c16-4610-8f0a-f05c55296883 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:48:03.184284 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3ccc02bb-4c16-4610-8f0a-f05c55296883 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a190ad103a11415991ae90d3aacbc330', 'request_id': 'req-3ccc02bb-4c16-4610-8f0a-f05c55296883'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:48:03.190492 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3ccc02bb-4c16-4610-8f0a-f05c55296883 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a190ad103a11415991ae90d3aacbc330', 'request_id': 'req-3ccc02bb-4c16-4610-8f0a-f05c55296883'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:48:03.196531 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3ccc02bb-4c16-4610-8f0a-f05c55296883 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a190ad103a11415991ae90d3aacbc330', 'request_id': 'req-3ccc02bb-4c16-4610-8f0a-f05c55296883'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:48:03.298107 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3ccc02bb-4c16-4610-8f0a-f05c55296883 admin admin] The token cache is being invalidate because project a190ad103a11415991ae90d3aacbc330 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:48:03.298414 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3ccc02bb-4c16-4610-8f0a-f05c55296883 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:48:03.299058 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-3ccc02bb-4c16-4610-8f0a-f05c55296883 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:48:03.300673 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4244/8512] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:48:03 2022] DELETE /identity/v3/projects/a190ad103a11415991ae90d3aacbc330 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:48:03.305526 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3fac2-a939-4921-8925-f8f556fe81a7 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:48:03.305994 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3fac2-a939-4921-8925-f8f556fe81a7 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:48:03.306110 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3fac2-a939-4921-8925-f8f556fe81a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:48:03.324110 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-67d3fac2-a939-4921-8925-f8f556fe81a7 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:48:03.325238 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-67d3fac2-a939-4921-8925-f8f556fe81a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:48:03.384225 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4269/8513] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:48:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:48:03.393504 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b62b03-e143-49d9-b3b3-49118c016757 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:48:03.393823 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b62b03-e143-49d9-b3b3-49118c016757 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:48:03.394105 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b62b03-e143-49d9-b3b3-49118c016757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:48:03.415040 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-97b62b03-e143-49d9-b3b3-49118c016757 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:48:03.416305 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-97b62b03-e143-49d9-b3b3-49118c016757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:48:03.424556 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4245/8514] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:48:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:48:03.428750 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d3fac2-a939-4921-8925-f8f556fe81a7 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:48:03.438938 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d3fac2-a939-4921-8925-f8f556fe81a7 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:48:03.443678 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d38ae02-ce80-4cb7-8c4b-2c9701b6f74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:48:03.444326 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d38ae02-ce80-4cb7-8c4b-2c9701b6f74b admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:48:03.444609 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d38ae02-ce80-4cb7-8c4b-2c9701b6f74b admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:48:03.444914 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d38ae02-ce80-4cb7-8c4b-2c9701b6f74b admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:48:03.445622 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d38ae02-ce80-4cb7-8c4b-2c9701b6f74b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:48:03.445970 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d38ae02-ce80-4cb7-8c4b-2c9701b6f74b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:48:03.447584 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d38ae02-ce80-4cb7-8c4b-2c9701b6f74b admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:48:03.459459 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4270/8515] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:48:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:48:03.463617 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b62b03-e143-49d9-b3b3-49118c016757 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:48:03.472973 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b62b03-e143-49d9-b3b3-49118c016757 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:48:03.477605 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c0ac09-1d0d-4751-9237-df7dda0b147e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:48:03.478249 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0ac09-1d0d-4751-9237-df7dda0b147e admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:48:03.478542 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0ac09-1d0d-4751-9237-df7dda0b147e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:48:03.478850 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0ac09-1d0d-4751-9237-df7dda0b147e admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:48:03.479563 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c0ac09-1d0d-4751-9237-df7dda0b147e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:48:03.481456 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c0ac09-1d0d-4751-9237-df7dda0b147e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:48:03.569816 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4246/8516] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:48:03 2022] POST /identity/v3/projects => generated 361 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:48:03.573964 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d38ae02-ce80-4cb7-8c4b-2c9701b6f74b admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:48:03.585011 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d38ae02-ce80-4cb7-8c4b-2c9701b6f74b admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:48:03.640881 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4421611b-7019-45f0-a31b-f31fbb201947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:48:03.641604 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421611b-7019-45f0-a31b-f31fbb201947 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:48:03.641890 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421611b-7019-45f0-a31b-f31fbb201947 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:48:03.642174 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421611b-7019-45f0-a31b-f31fbb201947 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:48:03.642856 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4421611b-7019-45f0-a31b-f31fbb201947 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:48:03.644809 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4421611b-7019-45f0-a31b-f31fbb201947 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:48:03.698392 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4271/8517] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:48:03 2022] POST /identity/v3/users => generated 281 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:48:03.702856 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c0ac09-1d0d-4751-9237-df7dda0b147e admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:48:03.723337 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c0ac09-1d0d-4751-9237-df7dda0b147e admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:48:03.728058 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92afac53-eba5-42ec-8c5e-75a3fa5447a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:48:03.728719 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92afac53-eba5-42ec-8c5e-75a3fa5447a0 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:48:03.729019 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92afac53-eba5-42ec-8c5e-75a3fa5447a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:48:03.729283 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92afac53-eba5-42ec-8c5e-75a3fa5447a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:48:03.729996 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92afac53-eba5-42ec-8c5e-75a3fa5447a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:48:03.731617 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92afac53-eba5-42ec-8c5e-75a3fa5447a0 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:48:03.741919 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4247/8518] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:48:03 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:48:03.745876 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4421611b-7019-45f0-a31b-f31fbb201947 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:48:03.769911 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4421611b-7019-45f0-a31b-f31fbb201947 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:48:03.774941 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a298939c-47e6-4ffc-8df7-51ca27fb0fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:48:03.775645 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a298939c-47e6-4ffc-8df7-51ca27fb0fa7 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:48:03.775934 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a298939c-47e6-4ffc-8df7-51ca27fb0fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:48:03.776216 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a298939c-47e6-4ffc-8df7-51ca27fb0fa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:48:03.776935 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a298939c-47e6-4ffc-8df7-51ca27fb0fa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:48:03.778552 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a298939c-47e6-4ffc-8df7-51ca27fb0fa7 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:48:03.788432 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4272/8519] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:48:03 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:48:03.792555 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92afac53-eba5-42ec-8c5e-75a3fa5447a0 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:48:03.803341 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92afac53-eba5-42ec-8c5e-75a3fa5447a0 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:48:03.808018 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6bb538-8719-4d16-a66c-5ec6dc4a2880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:48:03.808889 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6bb538-8719-4d16-a66c-5ec6dc4a2880 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:48:03.809173 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6bb538-8719-4d16-a66c-5ec6dc4a2880 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:48:03.809450 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6bb538-8719-4d16-a66c-5ec6dc4a2880 admin admin] PATH_INFO: `/v3/projects/c7206d24686e428085d5f0f6901152c8/users/eaa5bb74ae734d7cb580d857d8dfd5b9/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:48:03.824591 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6bb538-8719-4d16-a66c-5ec6dc4a2880 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7206d24686e428085d5f0f6901152c8, user_id=eaa5bb74ae734d7cb580d857d8dfd5b9, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:48:03.827280 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6bb538-8719-4d16-a66c-5ec6dc4a2880 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:48:03.940228 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4248/8520] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:48:03 2022] PUT /identity/v3/projects/c7206d24686e428085d5f0f6901152c8/users/eaa5bb74ae734d7cb580d857d8dfd5b9/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:48:03.950380 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b13e5d-0349-4667-8c99-5d323980bff0 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:48:03.950730 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b13e5d-0349-4667-8c99-5d323980bff0 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:48:03.950949 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b13e5d-0349-4667-8c99-5d323980bff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:48:03.977909 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-29b13e5d-0349-4667-8c99-5d323980bff0 None None] MFA Rules not processed for user `eaa5bb74ae734d7cb580d857d8dfd5b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:48:03.979098 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-29b13e5d-0349-4667-8c99-5d323980bff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:48:04.040938 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4273/8521] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:48:03 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:48:04.072049 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6bb538-8719-4d16-a66c-5ec6dc4a2880 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:48:04.073866 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-6e6bb538-8719-4d16-a66c-5ec6dc4a2880 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:48:04.132570 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6bb538-8719-4d16-a66c-5ec6dc4a2880 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:48:04.136343 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c333d360-8749-47bc-8f85-2e8501e139b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198271d1c0d44cb58bace41a65f4b94c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:48:04.136992 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c333d360-8749-47bc-8f85-2e8501e139b3 service cinder] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:48:04.137276 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c333d360-8749-47bc-8f85-2e8501e139b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:48:04.137555 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c333d360-8749-47bc-8f85-2e8501e139b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:48:04.146623 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c333d360-8749-47bc-8f85-2e8501e139b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:48:04.148090 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c333d360-8749-47bc-8f85-2e8501e139b3 service cinder] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:48:04.157041 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4249/8522] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:48:04 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:48:04.170688 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b13e5d-0349-4667-8c99-5d323980bff0 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:48:04.232208 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b13e5d-0349-4667-8c99-5d323980bff0 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:48:04.236954 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b9e15-0038-4169-bab6-491952f0ceb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:48:04.237829 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b9e15-0038-4169-bab6-491952f0ceb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:48:04.238113 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b9e15-0038-4169-bab6-491952f0ceb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:48:04.238391 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b9e15-0038-4169-bab6-491952f0ceb0 admin admin] PATH_INFO: `/v3/users/eaa5bb74ae734d7cb580d857d8dfd5b9` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:48:04.239604 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14b9e15-0038-4169-bab6-491952f0ceb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eaa5bb74ae734d7cb580d857d8dfd5b9)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:48:04.241522 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14b9e15-0038-4169-bab6-491952f0ceb0 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:48:04.415928 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f14b9e15-0038-4169-bab6-491952f0ceb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eaa5bb74ae734d7cb580d857d8dfd5b9'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:48:04.427788 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f14b9e15-0038-4169-bab6-491952f0ceb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eaa5bb74ae734d7cb580d857d8dfd5b9'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:48:04.434504 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f14b9e15-0038-4169-bab6-491952f0ceb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eaa5bb74ae734d7cb580d857d8dfd5b9'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:48:04.498591 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f14b9e15-0038-4169-bab6-491952f0ceb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eaa5bb74ae734d7cb580d857d8dfd5b9'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:48:04.499222 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f14b9e15-0038-4169-bab6-491952f0ceb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eaa5bb74ae734d7cb580d857d8dfd5b9'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:48:04.505618 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4274/8523] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:48:04 2022] DELETE /identity/v3/users/eaa5bb74ae734d7cb580d857d8dfd5b9 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:48:04.510424 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a51a4a-7999-45df-9ab8-682f9febd39b None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:48:04.513626 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a51a4a-7999-45df-9ab8-682f9febd39b None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:48:04.513626 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a51a4a-7999-45df-9ab8-682f9febd39b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:48:04.529055 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-f8a51a4a-7999-45df-9ab8-682f9febd39b None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:48:04.530250 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-f8a51a4a-7999-45df-9ab8-682f9febd39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:48:04.586935 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4250/8524] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:48:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:48:04.597564 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b9e15-0038-4169-bab6-491952f0ceb0 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:48:04.598978 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-f14b9e15-0038-4169-bab6-491952f0ceb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:48:04.665910 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b9e15-0038-4169-bab6-491952f0ceb0 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:48:04.669613 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0d430c-6887-4c22-aa0e-8f39aeaa519f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:48:04.670186 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d430c-6887-4c22-aa0e-8f39aeaa519f service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:48:04.670463 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d430c-6887-4c22-aa0e-8f39aeaa519f service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:48:04.670733 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d430c-6887-4c22-aa0e-8f39aeaa519f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:48:04.679672 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0d430c-6887-4c22-aa0e-8f39aeaa519f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:48:04.681123 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0d430c-6887-4c22-aa0e-8f39aeaa519f service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:48:04.690854 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4275/8525] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:48:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:48:05.082948 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a51a4a-7999-45df-9ab8-682f9febd39b None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:48:05.082948 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-f8a51a4a-7999-45df-9ab8-682f9febd39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:48:05.094010 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a51a4a-7999-45df-9ab8-682f9febd39b None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:48:05.098833 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c4af9-9119-4106-9596-9d1bf00838f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:48:05.099961 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c4af9-9119-4106-9596-9d1bf00838f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:48:05.100245 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c4af9-9119-4106-9596-9d1bf00838f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:48:05.100519 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c4af9-9119-4106-9596-9d1bf00838f7 admin admin] PATH_INFO: `/v3/projects/c7206d24686e428085d5f0f6901152c8` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:48:05.101790 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778c4af9-9119-4106-9596-9d1bf00838f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7206d24686e428085d5f0f6901152c8)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:48:05.103745 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778c4af9-9119-4106-9596-9d1bf00838f7 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:48:05.207106 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-778c4af9-9119-4106-9596-9d1bf00838f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7206d24686e428085d5f0f6901152c8', 'request_id': 'req-778c4af9-9119-4106-9596-9d1bf00838f7'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:48:05.212418 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-778c4af9-9119-4106-9596-9d1bf00838f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7206d24686e428085d5f0f6901152c8', 'request_id': 'req-778c4af9-9119-4106-9596-9d1bf00838f7'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:48:05.218410 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-778c4af9-9119-4106-9596-9d1bf00838f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7206d24686e428085d5f0f6901152c8', 'request_id': 'req-778c4af9-9119-4106-9596-9d1bf00838f7'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:48:05.309987 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-778c4af9-9119-4106-9596-9d1bf00838f7 admin admin] The token cache is being invalidate because project c7206d24686e428085d5f0f6901152c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:48:05.310267 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-778c4af9-9119-4106-9596-9d1bf00838f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:48:05.310894 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-778c4af9-9119-4106-9596-9d1bf00838f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:48:05.313084 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4251/8526] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:48:05 2022] DELETE /identity/v3/projects/c7206d24686e428085d5f0f6901152c8 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:48:05.318053 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72683972-b17d-4adb-bdc5-cf51a98bc7f1 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:48:05.318336 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72683972-b17d-4adb-bdc5-cf51a98bc7f1 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:48:05.318638 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72683972-b17d-4adb-bdc5-cf51a98bc7f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:48:05.335977 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-72683972-b17d-4adb-bdc5-cf51a98bc7f1 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:48:05.337193 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-72683972-b17d-4adb-bdc5-cf51a98bc7f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:48:05.395253 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4276/8527] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:48:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:48:05.403256 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f1648d-e708-4711-b419-67a6a0d838c7 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:48:05.403586 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f1648d-e708-4711-b419-67a6a0d838c7 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:48:05.403873 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f1648d-e708-4711-b419-67a6a0d838c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:48:05.424301 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-d3f1648d-e708-4711-b419-67a6a0d838c7 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:48:05.425511 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-d3f1648d-e708-4711-b419-67a6a0d838c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:48:05.433447 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4252/8528] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:48:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:48:05.438352 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72683972-b17d-4adb-bdc5-cf51a98bc7f1 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:48:05.448353 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72683972-b17d-4adb-bdc5-cf51a98bc7f1 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:48:05.452917 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd6f7f8-a1b9-44b5-ada1-51b6ade2d83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:48:05.453566 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6f7f8-a1b9-44b5-ada1-51b6ade2d83e admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:48:05.453855 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6f7f8-a1b9-44b5-ada1-51b6ade2d83e admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:48:05.454136 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6f7f8-a1b9-44b5-ada1-51b6ade2d83e admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:48:05.454854 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd6f7f8-a1b9-44b5-ada1-51b6ade2d83e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:48:05.455190 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd6f7f8-a1b9-44b5-ada1-51b6ade2d83e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:48:05.456847 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd6f7f8-a1b9-44b5-ada1-51b6ade2d83e admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:48:05.469999 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4277/8529] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:48:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:48:05.473644 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f1648d-e708-4711-b419-67a6a0d838c7 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:48:05.483111 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f1648d-e708-4711-b419-67a6a0d838c7 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:48:05.488488 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d995d73-c14f-4abb-9a12-28204470f806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:48:05.489142 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d995d73-c14f-4abb-9a12-28204470f806 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:48:05.489422 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d995d73-c14f-4abb-9a12-28204470f806 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:48:05.489742 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d995d73-c14f-4abb-9a12-28204470f806 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:48:05.490420 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d995d73-c14f-4abb-9a12-28204470f806 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:48:05.492358 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d995d73-c14f-4abb-9a12-28204470f806 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:48:05.564067 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4253/8530] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:48:05 2022] POST /identity/v3/projects => generated 385 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:48:05.568070 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd6f7f8-a1b9-44b5-ada1-51b6ade2d83e admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:48:05.578221 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd6f7f8-a1b9-44b5-ada1-51b6ade2d83e admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:48:05.633095 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5781aa91-9ee6-4346-98a7-bda392ba10c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:48:05.633758 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781aa91-9ee6-4346-98a7-bda392ba10c9 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:48:05.634046 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781aa91-9ee6-4346-98a7-bda392ba10c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:48:05.634326 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781aa91-9ee6-4346-98a7-bda392ba10c9 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:48:05.635013 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5781aa91-9ee6-4346-98a7-bda392ba10c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:48:05.636975 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5781aa91-9ee6-4346-98a7-bda392ba10c9 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:48:05.722405 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4278/8531] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:48:05 2022] POST /identity/v3/users => generated 293 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:48:05.726240 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d995d73-c14f-4abb-9a12-28204470f806 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:48:05.737353 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d995d73-c14f-4abb-9a12-28204470f806 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:48:05.741866 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cefb43f-4447-4fe4-b4bc-db459bae0821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:48:05.742513 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cefb43f-4447-4fe4-b4bc-db459bae0821 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:48:05.742793 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cefb43f-4447-4fe4-b4bc-db459bae0821 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:48:05.743068 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cefb43f-4447-4fe4-b4bc-db459bae0821 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:48:05.743808 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cefb43f-4447-4fe4-b4bc-db459bae0821 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:48:05.745400 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cefb43f-4447-4fe4-b4bc-db459bae0821 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:48:05.755845 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4254/8532] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:48:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:48:05.759648 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5781aa91-9ee6-4346-98a7-bda392ba10c9 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:48:05.773412 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5781aa91-9ee6-4346-98a7-bda392ba10c9 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:48:05.778779 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7dfc34-08b9-4244-a39c-56e48eecd231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:48:05.779446 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7dfc34-08b9-4244-a39c-56e48eecd231 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:48:05.779902 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7dfc34-08b9-4244-a39c-56e48eecd231 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:48:05.780357 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7dfc34-08b9-4244-a39c-56e48eecd231 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:48:05.781954 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7dfc34-08b9-4244-a39c-56e48eecd231 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:48:05.783593 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7dfc34-08b9-4244-a39c-56e48eecd231 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:48:05.793797 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4279/8533] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:48:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:48:05.798996 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cefb43f-4447-4fe4-b4bc-db459bae0821 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:48:05.809251 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cefb43f-4447-4fe4-b4bc-db459bae0821 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:48:05.814040 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fffa50d-f5bc-4ca4-9305-07c5f289ed14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:48:05.814908 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fffa50d-f5bc-4ca4-9305-07c5f289ed14 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:48:05.815187 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fffa50d-f5bc-4ca4-9305-07c5f289ed14 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:48:05.815461 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fffa50d-f5bc-4ca4-9305-07c5f289ed14 admin admin] PATH_INFO: `/v3/projects/c9e643695d5540ce8147baa9a32dcd60/users/54b3dc463aee4f19aac40890135a7c2c/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:48:05.830279 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fffa50d-f5bc-4ca4-9305-07c5f289ed14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9e643695d5540ce8147baa9a32dcd60, user_id=54b3dc463aee4f19aac40890135a7c2c, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:48:05.832969 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fffa50d-f5bc-4ca4-9305-07c5f289ed14 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:48:05.875846 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4255/8534] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:48:05 2022] PUT /identity/v3/projects/c9e643695d5540ce8147baa9a32dcd60/users/54b3dc463aee4f19aac40890135a7c2c/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:48:05.978326 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd88731-e501-4027-bbe6-0b513f3e771e None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:48:05.978547 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd88731-e501-4027-bbe6-0b513f3e771e None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:48:05.978821 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd88731-e501-4027-bbe6-0b513f3e771e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:48:06.005549 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-2dd88731-e501-4027-bbe6-0b513f3e771e None None] MFA Rules not processed for user `54b3dc463aee4f19aac40890135a7c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:48:06.006751 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-2dd88731-e501-4027-bbe6-0b513f3e771e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:48:06.070516 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4280/8535] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:48:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:48:06.082509 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fffa50d-f5bc-4ca4-9305-07c5f289ed14 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:48:06.084218 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-1fffa50d-f5bc-4ca4-9305-07c5f289ed14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:48:06.142253 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fffa50d-f5bc-4ca4-9305-07c5f289ed14 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:48:06.145865 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d2a3d-8912-42e7-a512-fe00b75b8d6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198271d1c0d44cb58bace41a65f4b94c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:48:06.146506 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d2a3d-8912-42e7-a512-fe00b75b8d6f service cinder] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:48:06.146782 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d2a3d-8912-42e7-a512-fe00b75b8d6f service cinder] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:48:06.147052 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d2a3d-8912-42e7-a512-fe00b75b8d6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:48:06.155411 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31d2a3d-8912-42e7-a512-fe00b75b8d6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:48:06.158104 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31d2a3d-8912-42e7-a512-fe00b75b8d6f service cinder] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:48:06.166943 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4256/8536] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:48:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:48:11.206699 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd88731-e501-4027-bbe6-0b513f3e771e None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:48:11.279310 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd88731-e501-4027-bbe6-0b513f3e771e None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:48:11.283963 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7636503e-dd4c-4d88-9e2c-45a1cc6c7610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:48:11.284998 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636503e-dd4c-4d88-9e2c-45a1cc6c7610 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:48:11.285284 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636503e-dd4c-4d88-9e2c-45a1cc6c7610 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:48:11.285558 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636503e-dd4c-4d88-9e2c-45a1cc6c7610 admin admin] PATH_INFO: `/v3/users/54b3dc463aee4f19aac40890135a7c2c` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:48:11.286720 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7636503e-dd4c-4d88-9e2c-45a1cc6c7610 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54b3dc463aee4f19aac40890135a7c2c)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:48:11.288681 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7636503e-dd4c-4d88-9e2c-45a1cc6c7610 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:48:11.488431 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-7636503e-dd4c-4d88-9e2c-45a1cc6c7610 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54b3dc463aee4f19aac40890135a7c2c'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:48:11.501394 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-7636503e-dd4c-4d88-9e2c-45a1cc6c7610 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54b3dc463aee4f19aac40890135a7c2c'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:48:11.508383 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-7636503e-dd4c-4d88-9e2c-45a1cc6c7610 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54b3dc463aee4f19aac40890135a7c2c'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:48:11.590586 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-7636503e-dd4c-4d88-9e2c-45a1cc6c7610 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54b3dc463aee4f19aac40890135a7c2c'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:48:11.591402 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-7636503e-dd4c-4d88-9e2c-45a1cc6c7610 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54b3dc463aee4f19aac40890135a7c2c'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:48:11.599951 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4281/8537] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:48:11 2022] DELETE /identity/v3/users/54b3dc463aee4f19aac40890135a7c2c => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:48:11.606814 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d95039a-a302-47d2-a211-5e02cd0c17ac None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:48:11.618307 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d95039a-a302-47d2-a211-5e02cd0c17ac None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:48:11.618307 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d95039a-a302-47d2-a211-5e02cd0c17ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:48:11.627180 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-7d95039a-a302-47d2-a211-5e02cd0c17ac None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:48:11.628625 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-7d95039a-a302-47d2-a211-5e02cd0c17ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:48:11.686484 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4257/8538] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:48:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:48:11.696196 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7636503e-dd4c-4d88-9e2c-45a1cc6c7610 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:48:11.697576 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-7636503e-dd4c-4d88-9e2c-45a1cc6c7610 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:48:11.757716 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7636503e-dd4c-4d88-9e2c-45a1cc6c7610 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:48:11.761250 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d210dae0-b559-4095-ad1a-4b92768d6f0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:48:11.761884 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210dae0-b559-4095-ad1a-4b92768d6f0e service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:48:11.762167 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210dae0-b559-4095-ad1a-4b92768d6f0e service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:48:11.762445 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210dae0-b559-4095-ad1a-4b92768d6f0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:48:11.772479 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d210dae0-b559-4095-ad1a-4b92768d6f0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:48:11.773927 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d210dae0-b559-4095-ad1a-4b92768d6f0e service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:48:11.783718 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4282/8539] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:48:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:48:12.146730 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d95039a-a302-47d2-a211-5e02cd0c17ac None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:48:12.148223 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-7d95039a-a302-47d2-a211-5e02cd0c17ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:48:12.160465 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d95039a-a302-47d2-a211-5e02cd0c17ac None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:48:12.165855 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd88a2-c832-4022-b3f8-0f2a8867680d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:48:12.166765 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd88a2-c832-4022-b3f8-0f2a8867680d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:48:12.167037 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd88a2-c832-4022-b3f8-0f2a8867680d admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:48:12.167314 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd88a2-c832-4022-b3f8-0f2a8867680d admin admin] PATH_INFO: `/v3/projects/c9e643695d5540ce8147baa9a32dcd60` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:48:12.168672 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfd88a2-c832-4022-b3f8-0f2a8867680d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9e643695d5540ce8147baa9a32dcd60)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:48:12.170602 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfd88a2-c832-4022-b3f8-0f2a8867680d admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:48:12.253150 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-abfd88a2-c832-4022-b3f8-0f2a8867680d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9e643695d5540ce8147baa9a32dcd60', 'request_id': 'req-abfd88a2-c832-4022-b3f8-0f2a8867680d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:48:12.259087 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-abfd88a2-c832-4022-b3f8-0f2a8867680d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9e643695d5540ce8147baa9a32dcd60', 'request_id': 'req-abfd88a2-c832-4022-b3f8-0f2a8867680d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:48:12.265846 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-abfd88a2-c832-4022-b3f8-0f2a8867680d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9e643695d5540ce8147baa9a32dcd60', 'request_id': 'req-abfd88a2-c832-4022-b3f8-0f2a8867680d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:48:12.327364 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-abfd88a2-c832-4022-b3f8-0f2a8867680d admin admin] The token cache is being invalidate because project c9e643695d5540ce8147baa9a32dcd60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:48:12.327786 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-abfd88a2-c832-4022-b3f8-0f2a8867680d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:48:12.328760 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-abfd88a2-c832-4022-b3f8-0f2a8867680d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:48:12.332042 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4258/8540] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:48:12 2022] DELETE /identity/v3/projects/c9e643695d5540ce8147baa9a32dcd60 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:48:12.337833 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda82b8-f637-49f1-b84a-6c5c545215ed None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:48:12.338416 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda82b8-f637-49f1-b84a-6c5c545215ed None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:48:12.338416 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda82b8-f637-49f1-b84a-6c5c545215ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:48:12.355689 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-ddda82b8-f637-49f1-b84a-6c5c545215ed None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:48:12.356878 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ddda82b8-f637-49f1-b84a-6c5c545215ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:48:12.413651 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4283/8541] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:48:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:48:12.421357 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0263a-d672-47bd-afd0-62a8d0c9c1b2 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:48:12.421651 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0263a-d672-47bd-afd0-62a8d0c9c1b2 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:48:12.421933 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0263a-d672-47bd-afd0-62a8d0c9c1b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:48:12.442886 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-18c0263a-d672-47bd-afd0-62a8d0c9c1b2 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:48:12.444136 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-18c0263a-d672-47bd-afd0-62a8d0c9c1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:48:12.452152 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4259/8542] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:48:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:48:12.457045 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda82b8-f637-49f1-b84a-6c5c545215ed None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:48:12.466638 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda82b8-f637-49f1-b84a-6c5c545215ed None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:48:12.471258 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4690715-d1c5-45eb-abe6-7c42edc7281b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:48:12.472326 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4690715-d1c5-45eb-abe6-7c42edc7281b admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:48:12.472616 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4690715-d1c5-45eb-abe6-7c42edc7281b admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:48:12.472900 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4690715-d1c5-45eb-abe6-7c42edc7281b admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:48:12.473625 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4690715-d1c5-45eb-abe6-7c42edc7281b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:48:12.473936 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4690715-d1c5-45eb-abe6-7c42edc7281b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:48:12.475558 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4690715-d1c5-45eb-abe6-7c42edc7281b admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:48:12.486757 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4284/8543] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:48:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:48:12.491734 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c0263a-d672-47bd-afd0-62a8d0c9c1b2 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:48:12.500894 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c0263a-d672-47bd-afd0-62a8d0c9c1b2 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:48:12.506233 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23076191-7fd6-4098-a1e2-4b13e23b2929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:48:12.506874 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23076191-7fd6-4098-a1e2-4b13e23b2929 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:48:12.507158 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23076191-7fd6-4098-a1e2-4b13e23b2929 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:48:12.507432 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23076191-7fd6-4098-a1e2-4b13e23b2929 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:48:12.508150 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23076191-7fd6-4098-a1e2-4b13e23b2929 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:48:12.510046 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23076191-7fd6-4098-a1e2-4b13e23b2929 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:48:12.591888 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4260/8544] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:48:12 2022] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:48:12.595994 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4690715-d1c5-45eb-abe6-7c42edc7281b admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:48:12.606497 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4690715-d1c5-45eb-abe6-7c42edc7281b admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:48:12.668260 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557a38d0-1db3-4f78-9e15-6a792494bd74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:48:12.668936 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a38d0-1db3-4f78-9e15-6a792494bd74 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:48:12.669219 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a38d0-1db3-4f78-9e15-6a792494bd74 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:48:12.669495 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a38d0-1db3-4f78-9e15-6a792494bd74 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:48:12.670180 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557a38d0-1db3-4f78-9e15-6a792494bd74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:48:12.672131 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557a38d0-1db3-4f78-9e15-6a792494bd74 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:48:12.739281 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4285/8545] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:48:12 2022] POST /identity/v3/users => generated 292 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:48:12.743504 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23076191-7fd6-4098-a1e2-4b13e23b2929 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:48:12.754853 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23076191-7fd6-4098-a1e2-4b13e23b2929 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:48:12.759648 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3280f53b-1e54-4254-9095-2f54f92ad7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:48:12.760308 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280f53b-1e54-4254-9095-2f54f92ad7b9 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:48:12.760595 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280f53b-1e54-4254-9095-2f54f92ad7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:48:12.760870 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280f53b-1e54-4254-9095-2f54f92ad7b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:48:12.761585 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3280f53b-1e54-4254-9095-2f54f92ad7b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:48:12.763182 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3280f53b-1e54-4254-9095-2f54f92ad7b9 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:48:12.773685 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4261/8546] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:48:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:48:12.777998 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557a38d0-1db3-4f78-9e15-6a792494bd74 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:48:12.788110 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557a38d0-1db3-4f78-9e15-6a792494bd74 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:48:12.792813 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b945c4-a4c7-4c59-bada-02358f2efa78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:48:12.793473 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b945c4-a4c7-4c59-bada-02358f2efa78 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:48:12.793761 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b945c4-a4c7-4c59-bada-02358f2efa78 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:48:12.794036 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b945c4-a4c7-4c59-bada-02358f2efa78 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:48:12.794749 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b945c4-a4c7-4c59-bada-02358f2efa78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:48:12.796390 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b945c4-a4c7-4c59-bada-02358f2efa78 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:48:12.807117 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4286/8547] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:48:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:48:12.811328 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3280f53b-1e54-4254-9095-2f54f92ad7b9 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:48:12.822266 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3280f53b-1e54-4254-9095-2f54f92ad7b9 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:48:12.826993 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79878d1-62cc-4b09-ac80-59185f7359be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:48:12.827905 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79878d1-62cc-4b09-ac80-59185f7359be admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:48:12.828194 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79878d1-62cc-4b09-ac80-59185f7359be admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:48:12.828471 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79878d1-62cc-4b09-ac80-59185f7359be admin admin] PATH_INFO: `/v3/projects/fbd6e36a563a4245acae34e00437ca87/users/1b51720c7970425abf4a26b2406893b7/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:48:12.843513 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79878d1-62cc-4b09-ac80-59185f7359be admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbd6e36a563a4245acae34e00437ca87, user_id=1b51720c7970425abf4a26b2406893b7, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:48:12.846146 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79878d1-62cc-4b09-ac80-59185f7359be admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:48:12.916578 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4262/8548] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:48:12 2022] PUT /identity/v3/projects/fbd6e36a563a4245acae34e00437ca87/users/1b51720c7970425abf4a26b2406893b7/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:48:12.921691 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a6479-02ea-4e84-b26d-fab1bf53a281 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:48:12.922164 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a6479-02ea-4e84-b26d-fab1bf53a281 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:48:12.922450 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a6479-02ea-4e84-b26d-fab1bf53a281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:48:12.948122 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-d02a6479-02ea-4e84-b26d-fab1bf53a281 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:48:12.949805 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d02a6479-02ea-4e84-b26d-fab1bf53a281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:48:13.019263 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4287/8549] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:48:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:48:13.029030 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79878d1-62cc-4b09-ac80-59185f7359be admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:48:13.030773 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b79878d1-62cc-4b09-ac80-59185f7359be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:48:13.089511 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79878d1-62cc-4b09-ac80-59185f7359be admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:48:13.093242 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f1c6d7-a6b6-4060-970d-9f108007c4b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:48:13.093945 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1c6d7-a6b6-4060-970d-9f108007c4b0 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:48:13.094170 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1c6d7-a6b6-4060-970d-9f108007c4b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:48:13.094445 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1c6d7-a6b6-4060-970d-9f108007c4b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:48:13.103937 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f1c6d7-a6b6-4060-970d-9f108007c4b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:48:13.105383 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f1c6d7-a6b6-4060-970d-9f108007c4b0 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:48:13.115327 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4263/8550] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:48:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:48:18.310356 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f2600-be81-42a4-9882-180e1f5f456e None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:48:18.310865 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f2600-be81-42a4-9882-180e1f5f456e None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:48:18.310951 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f2600-be81-42a4-9882-180e1f5f456e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:48:18.340798 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-6a3f2600-be81-42a4-9882-180e1f5f456e None None] MFA Rules not processed for user `1b51720c7970425abf4a26b2406893b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:48:18.343449 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-6a3f2600-be81-42a4-9882-180e1f5f456e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:48:18.432239 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4288/8551] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:48:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:48:18.437220 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f1c6d7-a6b6-4060-970d-9f108007c4b0 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:48:18.450981 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f1c6d7-a6b6-4060-970d-9f108007c4b0 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:48:18.464006 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4bbe2e-e585-4b64-98e8-085d4a86855d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:48:18.464006 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4bbe2e-e585-4b64-98e8-085d4a86855d admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:48:18.464006 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4bbe2e-e585-4b64-98e8-085d4a86855d admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:48:18.464006 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4bbe2e-e585-4b64-98e8-085d4a86855d admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:48:18.464507 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4bbe2e-e585-4b64-98e8-085d4a86855d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:48:18.466040 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4bbe2e-e585-4b64-98e8-085d4a86855d admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:48:18.605336 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4264/8552] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:48:18 2022] POST /identity/v3/projects => generated 381 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:48:18.609787 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3f2600-be81-42a4-9882-180e1f5f456e None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:48:18.621598 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3f2600-be81-42a4-9882-180e1f5f456e None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:48:18.689791 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b036a9b-504a-4589-99cc-baf9ce1243ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:48:18.691347 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b036a9b-504a-4589-99cc-baf9ce1243ec admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:48:18.691750 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b036a9b-504a-4589-99cc-baf9ce1243ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:48:18.692029 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b036a9b-504a-4589-99cc-baf9ce1243ec admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:48:18.692733 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b036a9b-504a-4589-99cc-baf9ce1243ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:48:18.694786 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b036a9b-504a-4589-99cc-baf9ce1243ec admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:48:18.786408 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4289/8553] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:48:18 2022] POST /identity/v3/users => generated 297 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:48:18.791054 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4bbe2e-e585-4b64-98e8-085d4a86855d admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:48:18.802926 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4bbe2e-e585-4b64-98e8-085d4a86855d admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:48:18.808498 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470415f5-ff02-4d62-ab3e-a31f091f1f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:48:18.809734 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470415f5-ff02-4d62-ab3e-a31f091f1f16 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:48:18.809734 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470415f5-ff02-4d62-ab3e-a31f091f1f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:48:18.809947 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470415f5-ff02-4d62-ab3e-a31f091f1f16 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:48:18.810639 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470415f5-ff02-4d62-ab3e-a31f091f1f16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:48:18.812354 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470415f5-ff02-4d62-ab3e-a31f091f1f16 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:48:18.827657 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4265/8554] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:48:18 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:48:18.829334 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b036a9b-504a-4589-99cc-baf9ce1243ec admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:48:18.854112 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b036a9b-504a-4589-99cc-baf9ce1243ec admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:48:18.859380 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79d60b5-3d40-477a-92b8-20c3d0024042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:48:18.860572 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d60b5-3d40-477a-92b8-20c3d0024042 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:48:18.860865 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d60b5-3d40-477a-92b8-20c3d0024042 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:48:18.861146 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d60b5-3d40-477a-92b8-20c3d0024042 admin admin] PATH_INFO: `/v3/projects/1cc3e53234794cbe8c230fbd3ae26869/users/aaced6289b2e4af195f764b93773c9b5/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:48:18.882793 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79d60b5-3d40-477a-92b8-20c3d0024042 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cc3e53234794cbe8c230fbd3ae26869, user_id=aaced6289b2e4af195f764b93773c9b5, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:48:18.885788 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79d60b5-3d40-477a-92b8-20c3d0024042 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:48:18.962638 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4290/8555] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:48:18 2022] PUT /identity/v3/projects/1cc3e53234794cbe8c230fbd3ae26869/users/aaced6289b2e4af195f764b93773c9b5/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 21:48:18.966607 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470415f5-ff02-4d62-ab3e-a31f091f1f16 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:48:18.979436 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470415f5-ff02-4d62-ab3e-a31f091f1f16 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:48:19.050858 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1517ca5-2ce9-4dc4-80af-0db06d26ad57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:48:19.051684 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1517ca5-2ce9-4dc4-80af-0db06d26ad57 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:48:19.052043 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1517ca5-2ce9-4dc4-80af-0db06d26ad57 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:48:19.052398 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1517ca5-2ce9-4dc4-80af-0db06d26ad57 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:48:19.053206 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1517ca5-2ce9-4dc4-80af-0db06d26ad57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:48:19.054926 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1517ca5-2ce9-4dc4-80af-0db06d26ad57 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:48:19.067821 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4266/8556] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:48:18 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:48:19.072095 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79d60b5-3d40-477a-92b8-20c3d0024042 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:48:19.084292 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79d60b5-3d40-477a-92b8-20c3d0024042 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:48:19.089225 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0788e617-9794-4955-9ecd-82c3badf64b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:48:19.090156 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0788e617-9794-4955-9ecd-82c3badf64b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:48:19.090441 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0788e617-9794-4955-9ecd-82c3badf64b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:48:19.090716 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0788e617-9794-4955-9ecd-82c3badf64b0 admin admin] PATH_INFO: `/v3/projects/1cc3e53234794cbe8c230fbd3ae26869/users/aaced6289b2e4af195f764b93773c9b5/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:48:19.092782 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0788e617-9794-4955-9ecd-82c3badf64b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cc3e53234794cbe8c230fbd3ae26869, user_id=aaced6289b2e4af195f764b93773c9b5, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:48:19.096736 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0788e617-9794-4955-9ecd-82c3badf64b0 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:48:19.107994 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4291/8557] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:48:19 2022] PUT /identity/v3/projects/1cc3e53234794cbe8c230fbd3ae26869/users/aaced6289b2e4af195f764b93773c9b5/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:48:19.457223 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1517ca5-2ce9-4dc4-80af-0db06d26ad57 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:48:19.460362 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-f1517ca5-2ce9-4dc4-80af-0db06d26ad57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:48:19.553166 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1517ca5-2ce9-4dc4-80af-0db06d26ad57 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:48:19.621170 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc887dc4-3226-431c-a5d8-dab7673ef12b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:48:19.621830 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc887dc4-3226-431c-a5d8-dab7673ef12b service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:48:19.622110 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc887dc4-3226-431c-a5d8-dab7673ef12b service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:48:19.622385 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc887dc4-3226-431c-a5d8-dab7673ef12b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:48:19.624220 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-dc887dc4-3226-431c-a5d8-dab7673ef12b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:48:19.638586 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc887dc4-3226-431c-a5d8-dab7673ef12b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:48:19.640367 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc887dc4-3226-431c-a5d8-dab7673ef12b service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:48:19.654630 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4267/8558] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:48:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:48:21.948171 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0788e617-9794-4955-9ecd-82c3badf64b0 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:48:21.955450 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-0788e617-9794-4955-9ecd-82c3badf64b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:48:22.075324 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0788e617-9794-4955-9ecd-82c3badf64b0 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:48:22.082445 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36b900c-67b1-4dd4-a3dc-01bf41a373f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:48:22.083683 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b900c-67b1-4dd4-a3dc-01bf41a373f7 service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:48:22.084141 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b900c-67b1-4dd4-a3dc-01bf41a373f7 service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:48:22.084588 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b900c-67b1-4dd4-a3dc-01bf41a373f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:48:22.086713 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d36b900c-67b1-4dd4-a3dc-01bf41a373f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:48:22.116264 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36b900c-67b1-4dd4-a3dc-01bf41a373f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:48:22.117924 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36b900c-67b1-4dd4-a3dc-01bf41a373f7 service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:48:22.145247 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4292/8559] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:48:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:48:27.098864 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e4472-9be2-4752-8c02-2967e655e251 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:48:27.099390 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e4472-9be2-4752-8c02-2967e655e251 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:48:27.099528 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e4472-9be2-4752-8c02-2967e655e251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:48:27.130397 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-be0e4472-9be2-4752-8c02-2967e655e251 None None] MFA Rules not processed for user `aaced6289b2e4af195f764b93773c9b5`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:48:27.131954 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-be0e4472-9be2-4752-8c02-2967e655e251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:48:27.217825 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4268/8560] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:48:27 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:48:27.224604 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36b900c-67b1-4dd4-a3dc-01bf41a373f7 service nova] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:48:27.226065 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d36b900c-67b1-4dd4-a3dc-01bf41a373f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:48:27.300667 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36b900c-67b1-4dd4-a3dc-01bf41a373f7 service nova] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:48:27.306891 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e3ea4-55b7-4121-bbca-4bb9d514e37c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b5cb86f190f4fcfb06d66cb8f14643f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:48:27.307620 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e3ea4-55b7-4121-bbca-4bb9d514e37c service glance] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:48:27.307908 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e3ea4-55b7-4121-bbca-4bb9d514e37c service glance] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:48:27.308185 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e3ea4-55b7-4121-bbca-4bb9d514e37c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:48:27.375809 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26e3ea4-55b7-4121-bbca-4bb9d514e37c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:48:27.377516 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26e3ea4-55b7-4121-bbca-4bb9d514e37c service glance] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:48:27.398419 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4293/8561] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:48:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:48:38.820371 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d1ab5-316f-46b7-8fe5-25733202c7d9 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:48:38.820919 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d1ab5-316f-46b7-8fe5-25733202c7d9 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:48:38.820919 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d1ab5-316f-46b7-8fe5-25733202c7d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:48:38.844908 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-b61d1ab5-316f-46b7-8fe5-25733202c7d9 None None] MFA Rules not processed for user `e9982f39ae394932a2fb8c9e4d456d8d`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:48:38.846153 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b61d1ab5-316f-46b7-8fe5-25733202c7d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:48:38.916616 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4269/8562] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:48:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:49:27.155970 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e3ea4-55b7-4121-bbca-4bb9d514e37c service glance] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:49:27.170085 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e3ea4-55b7-4121-bbca-4bb9d514e37c service glance] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:49:27.173748 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7f36d-9cce-46cb-9b95-4ff0586991f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:49:27.174382 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7f36d-9cce-46cb-9b95-4ff0586991f6 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:49:27.174666 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7f36d-9cce-46cb-9b95-4ff0586991f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:49:27.174944 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7f36d-9cce-46cb-9b95-4ff0586991f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:49:27.177414 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-8fc7f36d-9cce-46cb-9b95-4ff0586991f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:49:27.189312 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc7f36d-9cce-46cb-9b95-4ff0586991f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:49:27.190767 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc7f36d-9cce-46cb-9b95-4ff0586991f6 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:49:27.202164 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4294/8563] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:49:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:49:27.233432 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61d1ab5-316f-46b7-8fe5-25733202c7d9 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:49:27.234827 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b61d1ab5-316f-46b7-8fe5-25733202c7d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:49:27.321173 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61d1ab5-316f-46b7-8fe5-25733202c7d9 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:49:27.326748 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742a1d4a-aa55-412e-8951-62109d88cd48 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:49:27.327426 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a1d4a-aa55-412e-8951-62109d88cd48 service placement] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:49:27.327741 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a1d4a-aa55-412e-8951-62109d88cd48 service placement] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:49:27.328045 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a1d4a-aa55-412e-8951-62109d88cd48 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:49:27.330095 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-742a1d4a-aa55-412e-8951-62109d88cd48 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:49:27.345270 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742a1d4a-aa55-412e-8951-62109d88cd48 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:49:27.346858 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742a1d4a-aa55-412e-8951-62109d88cd48 service placement] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:49:27.360057 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4270/8564] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:49:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:49:27.889704 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb31029-f10f-4022-9349-8fc914a8c94f None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:49:27.889986 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb31029-f10f-4022-9349-8fc914a8c94f None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:49:27.890270 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb31029-f10f-4022-9349-8fc914a8c94f None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:49:27.891743 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4295/8565] 10.222.0.52 () {54 vars in 921 bytes} [Sat May 14 21:49:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:49:27.896894 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca36475-7188-47f8-9485-2f6393cf5d7a None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:49:27.897201 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca36475-7188-47f8-9485-2f6393cf5d7a None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:49:27.897503 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca36475-7188-47f8-9485-2f6393cf5d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:49:27.918870 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-fca36475-7188-47f8-9485-2f6393cf5d7a None None] MFA Rules not processed for user `0812ae67e44d483baf2dbb1a5332a1d7`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:49:27.920272 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-fca36475-7188-47f8-9485-2f6393cf5d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:49:27.936483 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4271/8566] 10.222.0.52 () {58 vars in 1018 bytes} [Sat May 14 21:49:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:49:27.956855 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb31029-f10f-4022-9349-8fc914a8c94f None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:49:27.973335 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb31029-f10f-4022-9349-8fc914a8c94f None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:49:27.978772 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c1de3f-1629-46fd-9fa6-0801a8bf6dd3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:49:27.979437 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c1de3f-1629-46fd-9fa6-0801a8bf6dd3 service placement] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:49:27.979756 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c1de3f-1629-46fd-9fa6-0801a8bf6dd3 service placement] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:49:27.980040 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c1de3f-1629-46fd-9fa6-0801a8bf6dd3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:49:27.989836 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c1de3f-1629-46fd-9fa6-0801a8bf6dd3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:49:27.991681 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c1de3f-1629-46fd-9fa6-0801a8bf6dd3 service placement] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:49:28.001794 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4296/8567] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:49:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:49:50.088168 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca36475-7188-47f8-9485-2f6393cf5d7a None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:49:50.116383 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca36475-7188-47f8-9485-2f6393cf5d7a None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:49:50.123867 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8156e79c-6aed-437a-9c69-86a19c442f5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:49:50.125013 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8156e79c-6aed-437a-9c69-86a19c442f5d service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:49:50.125534 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8156e79c-6aed-437a-9c69-86a19c442f5d service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:49:50.126019 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8156e79c-6aed-437a-9c69-86a19c442f5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:49:50.127976 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8156e79c-6aed-437a-9c69-86a19c442f5d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:49:50.143998 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8156e79c-6aed-437a-9c69-86a19c442f5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:49:50.145753 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8156e79c-6aed-437a-9c69-86a19c442f5d service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:49:50.160091 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4272/8568] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:49:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:49:55.383322 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c1de3f-1629-46fd-9fa6-0801a8bf6dd3 service placement] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:49:55.386726 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-49c1de3f-1629-46fd-9fa6-0801a8bf6dd3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:49:55.405847 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c1de3f-1629-46fd-9fa6-0801a8bf6dd3 service placement] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:49:55.411885 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e23f55-4292-4c43-a95d-c3067e2f14e4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:49:55.412677 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e23f55-4292-4c43-a95d-c3067e2f14e4 service placement] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:49:55.412820 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e23f55-4292-4c43-a95d-c3067e2f14e4 service placement] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:49:55.413409 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e23f55-4292-4c43-a95d-c3067e2f14e4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:49:55.415199 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-81e23f55-4292-4c43-a95d-c3067e2f14e4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:49:55.435350 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e23f55-4292-4c43-a95d-c3067e2f14e4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:49:55.437037 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e23f55-4292-4c43-a95d-c3067e2f14e4 service placement] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:49:55.451434 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4297/8569] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:49:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:49:58.801053 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8156e79c-6aed-437a-9c69-86a19c442f5d service nova] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:49:58.815404 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8156e79c-6aed-437a-9c69-86a19c442f5d service nova] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:49:58.820398 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b213f8-7ebf-4a3e-a7df-a1cbc210de3b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:49:58.821032 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b213f8-7ebf-4a3e-a7df-a1cbc210de3b service placement] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:49:58.821312 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b213f8-7ebf-4a3e-a7df-a1cbc210de3b service placement] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:49:58.821586 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b213f8-7ebf-4a3e-a7df-a1cbc210de3b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:49:58.823421 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c2b213f8-7ebf-4a3e-a7df-a1cbc210de3b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:49:58.837544 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b213f8-7ebf-4a3e-a7df-a1cbc210de3b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:49:58.839292 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b213f8-7ebf-4a3e-a7df-a1cbc210de3b service placement] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:49:58.852339 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4273/8570] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:49:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:50:06.761749 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f534b48-e249-431b-bcb2-2b0710258d71 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:50:06.762308 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f534b48-e249-431b-bcb2-2b0710258d71 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:50:06.762308 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f534b48-e249-431b-bcb2-2b0710258d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:50:06.780823 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-5f534b48-e249-431b-bcb2-2b0710258d71 None None] MFA Rules not processed for user `1b51720c7970425abf4a26b2406893b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:50:06.782010 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-5f534b48-e249-431b-bcb2-2b0710258d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:50:06.789049 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4298/8571] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:50:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:50:07.764852 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b213f8-7ebf-4a3e-a7df-a1cbc210de3b service placement] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:50:07.779076 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b213f8-7ebf-4a3e-a7df-a1cbc210de3b service placement] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:50:07.784354 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3995feaf-c145-414c-a1b1-6361f2fc0ec5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:50:07.785007 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995feaf-c145-414c-a1b1-6361f2fc0ec5 service placement] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:50:07.785290 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995feaf-c145-414c-a1b1-6361f2fc0ec5 service placement] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:50:07.785567 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995feaf-c145-414c-a1b1-6361f2fc0ec5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:50:07.787327 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-3995feaf-c145-414c-a1b1-6361f2fc0ec5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:50:07.802829 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3995feaf-c145-414c-a1b1-6361f2fc0ec5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:50:07.809485 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3995feaf-c145-414c-a1b1-6361f2fc0ec5 service placement] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:50:07.817738 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4274/8572] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:50:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:50:20.767167 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f534b48-e249-431b-bcb2-2b0710258d71 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:50:20.779414 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f534b48-e249-431b-bcb2-2b0710258d71 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:50:20.783854 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382c0475-293b-4813-8b4a-417053e76224 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:50:20.784483 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c0475-293b-4813-8b4a-417053e76224 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:50:20.784761 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c0475-293b-4813-8b4a-417053e76224 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:50:20.785030 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c0475-293b-4813-8b4a-417053e76224 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:50:20.793774 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382c0475-293b-4813-8b4a-417053e76224 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:50:20.795179 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382c0475-293b-4813-8b4a-417053e76224 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:50:20.805040 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4299/8573] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:50:20 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:50:44.450748 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32f9d8-1c52-4e25-90cf-f7f3c18c6ea2 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:50:44.457683 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32f9d8-1c52-4e25-90cf-f7f3c18c6ea2 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:50:44.457683 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32f9d8-1c52-4e25-90cf-f7f3c18c6ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:50:44.471731 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-1e32f9d8-1c52-4e25-90cf-f7f3c18c6ea2 None None] MFA Rules not processed for user `e9982f39ae394932a2fb8c9e4d456d8d`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:50:44.473227 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-1e32f9d8-1c52-4e25-90cf-f7f3c18c6ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:50:44.480531 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4275/8574] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:50:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:51:11.319837 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382c0475-293b-4813-8b4a-417053e76224 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:51:11.335135 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382c0475-293b-4813-8b4a-417053e76224 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:51:11.340772 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a01de7-aca2-4724-bb95-0501583582fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:51:11.341403 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a01de7-aca2-4724-bb95-0501583582fa service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:51:11.341686 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a01de7-aca2-4724-bb95-0501583582fa service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:51:11.341961 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a01de7-aca2-4724-bb95-0501583582fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:51:11.343825 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-67a01de7-aca2-4724-bb95-0501583582fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:51:11.403739 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a01de7-aca2-4724-bb95-0501583582fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:51:11.405361 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a01de7-aca2-4724-bb95-0501583582fa service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:51:11.414539 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4300/8575] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:51:11 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:51:16.236236 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e32f9d8-1c52-4e25-90cf-f7f3c18c6ea2 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:51:16.248636 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e32f9d8-1c52-4e25-90cf-f7f3c18c6ea2 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:51:16.256521 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f843b467-5f2d-44be-ac10-50b829ba0cbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:51:16.256521 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f843b467-5f2d-44be-ac10-50b829ba0cbe service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:51:16.256521 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f843b467-5f2d-44be-ac10-50b829ba0cbe service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:51:16.256521 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f843b467-5f2d-44be-ac10-50b829ba0cbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:51:16.257022 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-f843b467-5f2d-44be-ac10-50b829ba0cbe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:51:16.320894 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f843b467-5f2d-44be-ac10-50b829ba0cbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:51:16.322384 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f843b467-5f2d-44be-ac10-50b829ba0cbe service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:51:16.332257 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4276/8576] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:51:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 21:51:24.346859 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a01de7-aca2-4724-bb95-0501583582fa service nova] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:51:24.348416 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-67a01de7-aca2-4724-bb95-0501583582fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:51:24.362657 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a01de7-aca2-4724-bb95-0501583582fa service nova] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:51:24.367330 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b17b12-e928-4315-b195-af0bfe1ee406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:51:24.368817 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b17b12-e928-4315-b195-af0bfe1ee406 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:51:24.369281 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b17b12-e928-4315-b195-af0bfe1ee406 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:51:24.369565 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b17b12-e928-4315-b195-af0bfe1ee406 admin admin] PATH_INFO: `/v3/users/2c025653d74848899a26c661400279cf` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:51:24.370756 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b17b12-e928-4315-b195-af0bfe1ee406 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c025653d74848899a26c661400279cf)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:51:24.372706 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b17b12-e928-4315-b195-af0bfe1ee406 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:51:24.582989 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-00b17b12-e928-4315-b195-af0bfe1ee406 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c025653d74848899a26c661400279cf'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:51:24.594912 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-00b17b12-e928-4315-b195-af0bfe1ee406 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c025653d74848899a26c661400279cf'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:51:24.602480 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-00b17b12-e928-4315-b195-af0bfe1ee406 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c025653d74848899a26c661400279cf'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:51:24.740824 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-00b17b12-e928-4315-b195-af0bfe1ee406 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c025653d74848899a26c661400279cf'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:51:24.741451 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-00b17b12-e928-4315-b195-af0bfe1ee406 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c025653d74848899a26c661400279cf'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:51:24.748686 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4301/8577] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:51:24 2022] DELETE /identity/v3/users/2c025653d74848899a26c661400279cf => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:51:24.999639 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f843b467-5f2d-44be-ac10-50b829ba0cbe service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:51:25.014998 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f843b467-5f2d-44be-ac10-50b829ba0cbe service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:51:25.074039 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaab8dc-80a2-44a1-bb79-829aa917e71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:51:25.074898 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaab8dc-80a2-44a1-bb79-829aa917e71f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:51:25.075181 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaab8dc-80a2-44a1-bb79-829aa917e71f admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:51:25.075458 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaab8dc-80a2-44a1-bb79-829aa917e71f admin admin] PATH_INFO: `/v3/projects/233de55e2a38457bb1837da8374b7b54` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:51:25.076777 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaab8dc-80a2-44a1-bb79-829aa917e71f admin admin] RBAC: Authorizing `identity:delete_project(project_id=233de55e2a38457bb1837da8374b7b54)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:51:25.078683 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaab8dc-80a2-44a1-bb79-829aa917e71f admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:51:25.203168 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-8aaab8dc-80a2-44a1-bb79-829aa917e71f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '233de55e2a38457bb1837da8374b7b54', 'request_id': 'req-8aaab8dc-80a2-44a1-bb79-829aa917e71f'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:51:25.208450 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-8aaab8dc-80a2-44a1-bb79-829aa917e71f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '233de55e2a38457bb1837da8374b7b54', 'request_id': 'req-8aaab8dc-80a2-44a1-bb79-829aa917e71f'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:51:25.215139 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-8aaab8dc-80a2-44a1-bb79-829aa917e71f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '233de55e2a38457bb1837da8374b7b54', 'request_id': 'req-8aaab8dc-80a2-44a1-bb79-829aa917e71f'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:51:25.289339 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-8aaab8dc-80a2-44a1-bb79-829aa917e71f admin admin] The token cache is being invalidate because project 233de55e2a38457bb1837da8374b7b54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:51:25.289647 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-8aaab8dc-80a2-44a1-bb79-829aa917e71f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:51:25.290903 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-8aaab8dc-80a2-44a1-bb79-829aa917e71f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:51:25.292650 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4277/8578] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:51:24 2022] DELETE /identity/v3/projects/233de55e2a38457bb1837da8374b7b54 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:51:25.296941 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b17b12-e928-4315-b195-af0bfe1ee406 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:51:25.298356 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-00b17b12-e928-4315-b195-af0bfe1ee406 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:51:25.311666 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b17b12-e928-4315-b195-af0bfe1ee406 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:51:25.366813 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f812b2-bbc3-48b9-9b97-d3868327ef83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:51:25.367706 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f812b2-bbc3-48b9-9b97-d3868327ef83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:51:25.367992 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f812b2-bbc3-48b9-9b97-d3868327ef83 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:51:25.368319 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f812b2-bbc3-48b9-9b97-d3868327ef83 admin admin] PATH_INFO: `/v3/users/93cbfa892fac40ca9defc688ef831a62` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:51:25.369641 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f812b2-bbc3-48b9-9b97-d3868327ef83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93cbfa892fac40ca9defc688ef831a62)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:51:25.371601 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f812b2-bbc3-48b9-9b97-d3868327ef83 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:51:25.579081 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-17f812b2-bbc3-48b9-9b97-d3868327ef83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93cbfa892fac40ca9defc688ef831a62'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:51:25.591101 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-17f812b2-bbc3-48b9-9b97-d3868327ef83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93cbfa892fac40ca9defc688ef831a62'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:51:25.598136 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-17f812b2-bbc3-48b9-9b97-d3868327ef83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93cbfa892fac40ca9defc688ef831a62'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:51:25.667275 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-17f812b2-bbc3-48b9-9b97-d3868327ef83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93cbfa892fac40ca9defc688ef831a62'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:51:25.667949 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-17f812b2-bbc3-48b9-9b97-d3868327ef83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93cbfa892fac40ca9defc688ef831a62'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:51:25.674468 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4302/8579] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:51:25 2022] DELETE /identity/v3/users/93cbfa892fac40ca9defc688ef831a62 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:51:25.932530 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaab8dc-80a2-44a1-bb79-829aa917e71f admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:51:25.934050 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8aaab8dc-80a2-44a1-bb79-829aa917e71f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:51:25.949315 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaab8dc-80a2-44a1-bb79-829aa917e71f admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:51:26.013351 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58418178-7fa8-4b1d-8dad-c42b73ee6ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:51:26.014208 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58418178-7fa8-4b1d-8dad-c42b73ee6ba5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:51:26.014581 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58418178-7fa8-4b1d-8dad-c42b73ee6ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:51:26.014755 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58418178-7fa8-4b1d-8dad-c42b73ee6ba5 admin admin] PATH_INFO: `/v3/projects/7f6c8f9c935949279017bfea2c70ba05` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:51:26.016268 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58418178-7fa8-4b1d-8dad-c42b73ee6ba5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f6c8f9c935949279017bfea2c70ba05)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:51:26.018304 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58418178-7fa8-4b1d-8dad-c42b73ee6ba5 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:51:26.103596 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-58418178-7fa8-4b1d-8dad-c42b73ee6ba5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f6c8f9c935949279017bfea2c70ba05', 'request_id': 'req-58418178-7fa8-4b1d-8dad-c42b73ee6ba5'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:51:26.109576 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-58418178-7fa8-4b1d-8dad-c42b73ee6ba5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f6c8f9c935949279017bfea2c70ba05', 'request_id': 'req-58418178-7fa8-4b1d-8dad-c42b73ee6ba5'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:51:26.116305 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-58418178-7fa8-4b1d-8dad-c42b73ee6ba5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f6c8f9c935949279017bfea2c70ba05', 'request_id': 'req-58418178-7fa8-4b1d-8dad-c42b73ee6ba5'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:51:26.164753 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-58418178-7fa8-4b1d-8dad-c42b73ee6ba5 admin admin] The token cache is being invalidate because project 7f6c8f9c935949279017bfea2c70ba05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:51:26.165048 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-58418178-7fa8-4b1d-8dad-c42b73ee6ba5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:51:26.166258 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-58418178-7fa8-4b1d-8dad-c42b73ee6ba5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:51:26.167978 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4278/8580] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:51:25 2022] DELETE /identity/v3/projects/7f6c8f9c935949279017bfea2c70ba05 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:51:32.841891 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1129e6af-ac3b-4706-be0c-219a0cae35a1 None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:51:32.842471 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1129e6af-ac3b-4706-be0c-219a0cae35a1 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:51:32.842471 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1129e6af-ac3b-4706-be0c-219a0cae35a1 None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:51:32.843807 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4303/8581] 10.222.0.52 () {54 vars in 921 bytes} [Sat May 14 21:51:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 21:51:32.849122 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d947399-c35b-41a9-95a0-560f4a03c76e None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:51:32.849606 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d947399-c35b-41a9-95a0-560f4a03c76e None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:51:32.849720 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d947399-c35b-41a9-95a0-560f4a03c76e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:51:32.877143 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-6d947399-c35b-41a9-95a0-560f4a03c76e None None] MFA Rules not processed for user `0812ae67e44d483baf2dbb1a5332a1d7`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:51:32.878362 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-6d947399-c35b-41a9-95a0-560f4a03c76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:51:32.941421 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4279/8582] 10.222.0.52 () {58 vars in 1018 bytes} [Sat May 14 21:51:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:51:32.961636 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1129e6af-ac3b-4706-be0c-219a0cae35a1 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:51:32.963365 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-1129e6af-ac3b-4706-be0c-219a0cae35a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:51:32.983033 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1129e6af-ac3b-4706-be0c-219a0cae35a1 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:51:32.988428 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6ba1c6-66ab-4904-80f7-91b5002c9239 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:51:32.989066 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6ba1c6-66ab-4904-80f7-91b5002c9239 service placement] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:51:32.989352 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6ba1c6-66ab-4904-80f7-91b5002c9239 service placement] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:51:32.989629 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6ba1c6-66ab-4904-80f7-91b5002c9239 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:51:32.998510 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6ba1c6-66ab-4904-80f7-91b5002c9239 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:51:33.000174 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6ba1c6-66ab-4904-80f7-91b5002c9239 service placement] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:51:33.010861 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4304/8583] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:51:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:51:33.332903 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d947399-c35b-41a9-95a0-560f4a03c76e None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:51:33.334316 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-6d947399-c35b-41a9-95a0-560f4a03c76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:51:33.399038 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d947399-c35b-41a9-95a0-560f4a03c76e None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:51:33.404869 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed370bbf-8b43-4942-ba89-eaabce3e33dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:51:33.406030 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed370bbf-8b43-4942-ba89-eaabce3e33dc service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:51:33.406542 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed370bbf-8b43-4942-ba89-eaabce3e33dc service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:51:33.407036 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed370bbf-8b43-4942-ba89-eaabce3e33dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:51:33.409561 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-ed370bbf-8b43-4942-ba89-eaabce3e33dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:51:33.426070 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed370bbf-8b43-4942-ba89-eaabce3e33dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:51:33.427566 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed370bbf-8b43-4942-ba89-eaabce3e33dc service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:51:33.439193 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4280/8584] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:51:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:51:33.524167 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6ba1c6-66ab-4904-80f7-91b5002c9239 service placement] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:51:33.536495 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6ba1c6-66ab-4904-80f7-91b5002c9239 service placement] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:51:33.540061 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e0fa91-2620-47c4-8d70-dbf9d8461a3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:51:33.540693 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e0fa91-2620-47c4-8d70-dbf9d8461a3d service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:51:33.541071 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e0fa91-2620-47c4-8d70-dbf9d8461a3d service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:51:33.541354 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e0fa91-2620-47c4-8d70-dbf9d8461a3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:51:33.543787 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-13e0fa91-2620-47c4-8d70-dbf9d8461a3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:51:33.616516 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e0fa91-2620-47c4-8d70-dbf9d8461a3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:51:33.617948 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e0fa91-2620-47c4-8d70-dbf9d8461a3d service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:51:33.632214 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4305/8585] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:51:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:51:35.088107 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed370bbf-8b43-4942-ba89-eaabce3e33dc service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:51:35.089564 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-ed370bbf-8b43-4942-ba89-eaabce3e33dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:51:35.109551 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed370bbf-8b43-4942-ba89-eaabce3e33dc service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:51:35.115163 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227026db-a977-4cb9-a6b5-7d56a852edb6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:51:35.120234 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227026db-a977-4cb9-a6b5-7d56a852edb6 service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:51:35.120234 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227026db-a977-4cb9-a6b5-7d56a852edb6 service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:51:35.120234 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227026db-a977-4cb9-a6b5-7d56a852edb6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:51:35.120234 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-227026db-a977-4cb9-a6b5-7d56a852edb6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:51:35.187979 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227026db-a977-4cb9-a6b5-7d56a852edb6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:51:35.189714 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227026db-a977-4cb9-a6b5-7d56a852edb6 service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:51:35.206840 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4281/8586] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:51:35 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:51:43.211981 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e0fa91-2620-47c4-8d70-dbf9d8461a3d service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:51:43.234216 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e0fa91-2620-47c4-8d70-dbf9d8461a3d service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:51:43.238035 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf6d5a4-6cfa-4448-9e0d-fed3f267eef9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:51:43.238681 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf6d5a4-6cfa-4448-9e0d-fed3f267eef9 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:51:43.238968 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf6d5a4-6cfa-4448-9e0d-fed3f267eef9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:51:43.239246 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf6d5a4-6cfa-4448-9e0d-fed3f267eef9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:51:43.241068 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-faf6d5a4-6cfa-4448-9e0d-fed3f267eef9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:51:43.321746 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf6d5a4-6cfa-4448-9e0d-fed3f267eef9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:51:43.323210 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf6d5a4-6cfa-4448-9e0d-fed3f267eef9 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:51:43.332916 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4306/8587] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:51:43 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:51:43.953826 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227026db-a977-4cb9-a6b5-7d56a852edb6 service nova] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:51:43.955408 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-227026db-a977-4cb9-a6b5-7d56a852edb6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:51:44.010932 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227026db-a977-4cb9-a6b5-7d56a852edb6 service nova] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:51:44.015022 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d14bf08-c2fa-48f3-aec3-3d1f44bee902 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:51:44.015712 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d14bf08-c2fa-48f3-aec3-3d1f44bee902 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:51:44.015990 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d14bf08-c2fa-48f3-aec3-3d1f44bee902 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:51:44.016261 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d14bf08-c2fa-48f3-aec3-3d1f44bee902 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:51:44.018002 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-4d14bf08-c2fa-48f3-aec3-3d1f44bee902 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:51:44.034635 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d14bf08-c2fa-48f3-aec3-3d1f44bee902 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:51:44.036128 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d14bf08-c2fa-48f3-aec3-3d1f44bee902 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:51:44.050695 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4282/8588] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:51:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:51:45.236173 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf6d5a4-6cfa-4448-9e0d-fed3f267eef9 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:51:45.248542 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf6d5a4-6cfa-4448-9e0d-fed3f267eef9 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:51:45.252471 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da313caa-8c2f-4306-9dac-559876263570 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:51:45.253117 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da313caa-8c2f-4306-9dac-559876263570 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:51:45.253401 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da313caa-8c2f-4306-9dac-559876263570 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:51:45.253680 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da313caa-8c2f-4306-9dac-559876263570 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:51:45.255460 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-da313caa-8c2f-4306-9dac-559876263570 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:51:45.272442 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da313caa-8c2f-4306-9dac-559876263570 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:51:45.273906 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da313caa-8c2f-4306-9dac-559876263570 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:51:45.288020 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4307/8589] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:51:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:51:48.990439 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d14bf08-c2fa-48f3-aec3-3d1f44bee902 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:51:48.992927 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-4d14bf08-c2fa-48f3-aec3-3d1f44bee902 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:51:49.012054 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d14bf08-c2fa-48f3-aec3-3d1f44bee902 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:51:49.019890 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2204aa-76b7-4a91-83b8-b2f486410709 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:51:49.021525 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2204aa-76b7-4a91-83b8-b2f486410709 service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:51:49.021815 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2204aa-76b7-4a91-83b8-b2f486410709 service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:51:49.026137 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2204aa-76b7-4a91-83b8-b2f486410709 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:51:49.026137 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-ba2204aa-76b7-4a91-83b8-b2f486410709 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:51:49.041070 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2204aa-76b7-4a91-83b8-b2f486410709 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:51:49.042791 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2204aa-76b7-4a91-83b8-b2f486410709 service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:51:49.057437 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4283/8590] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:51:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:52:04.265991 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08ba37-d7ca-4014-b133-7036949145c9 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:52:04.266552 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08ba37-d7ca-4014-b133-7036949145c9 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:52:04.266552 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08ba37-d7ca-4014-b133-7036949145c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:52:04.284278 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-ed08ba37-d7ca-4014-b133-7036949145c9 None None] MFA Rules not processed for user `e9982f39ae394932a2fb8c9e4d456d8d`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:52:04.293315 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ed08ba37-d7ca-4014-b133-7036949145c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:52:04.297761 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4308/8591] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:52:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:52:04.629936 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2204aa-76b7-4a91-83b8-b2f486410709 service nova] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:52:04.642179 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2204aa-76b7-4a91-83b8-b2f486410709 service nova] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:52:04.646105 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd35a9-f808-402f-848a-3d96b3eb2164 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:52:04.647930 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd35a9-f808-402f-848a-3d96b3eb2164 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:52:04.647930 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd35a9-f808-402f-848a-3d96b3eb2164 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:52:04.647930 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd35a9-f808-402f-848a-3d96b3eb2164 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:52:04.649492 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-f5dd35a9-f808-402f-848a-3d96b3eb2164 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:52:04.663098 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dd35a9-f808-402f-848a-3d96b3eb2164 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:52:04.664651 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dd35a9-f808-402f-848a-3d96b3eb2164 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:52:04.676317 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4284/8592] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:52:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:52:48.500082 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed08ba37-d7ca-4014-b133-7036949145c9 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:52:48.513091 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed08ba37-d7ca-4014-b133-7036949145c9 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:52:48.516850 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6e2919-8fa6-4bfa-9637-e4b3b5fdce4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:52:48.517433 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e2919-8fa6-4bfa-9637-e4b3b5fdce4d service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:52:48.517719 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e2919-8fa6-4bfa-9637-e4b3b5fdce4d service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:52:48.517999 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e2919-8fa6-4bfa-9637-e4b3b5fdce4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:52:48.519865 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-7f6e2919-8fa6-4bfa-9637-e4b3b5fdce4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:52:48.532913 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6e2919-8fa6-4bfa-9637-e4b3b5fdce4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:52:48.534372 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6e2919-8fa6-4bfa-9637-e4b3b5fdce4d service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:52:48.545036 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4309/8593] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:52:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:53:38.102255 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd35a9-f808-402f-848a-3d96b3eb2164 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:53:38.113948 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd35a9-f808-402f-848a-3d96b3eb2164 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:53:38.117952 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18396ff6-1d06-4caa-a43f-88815d54dcf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:53:38.118581 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18396ff6-1d06-4caa-a43f-88815d54dcf2 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:53:38.118859 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18396ff6-1d06-4caa-a43f-88815d54dcf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:53:38.119129 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18396ff6-1d06-4caa-a43f-88815d54dcf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:53:38.120911 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-18396ff6-1d06-4caa-a43f-88815d54dcf2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:53:38.133557 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18396ff6-1d06-4caa-a43f-88815d54dcf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:53:38.135130 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18396ff6-1d06-4caa-a43f-88815d54dcf2 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:53:38.145547 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4285/8594] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:53:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:53:46.244499 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6e2919-8fa6-4bfa-9637-e4b3b5fdce4d service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:53:46.267422 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6e2919-8fa6-4bfa-9637-e4b3b5fdce4d service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:53:46.274231 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d90575c-5eac-41bd-b31d-892e54a2c1c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:53:46.275033 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d90575c-5eac-41bd-b31d-892e54a2c1c1 service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:53:46.275319 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d90575c-5eac-41bd-b31d-892e54a2c1c1 service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:53:46.275642 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d90575c-5eac-41bd-b31d-892e54a2c1c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:53:46.277672 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-5d90575c-5eac-41bd-b31d-892e54a2c1c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:53:46.307638 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d90575c-5eac-41bd-b31d-892e54a2c1c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:53:46.309242 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d90575c-5eac-41bd-b31d-892e54a2c1c1 service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:53:46.322965 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4310/8595] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:53:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:53:51.782185 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18396ff6-1d06-4caa-a43f-88815d54dcf2 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:53:51.783604 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-18396ff6-1d06-4caa-a43f-88815d54dcf2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:53:51.869709 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18396ff6-1d06-4caa-a43f-88815d54dcf2 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:53:51.874367 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea7283e-7d0b-456d-be93-47fc2305bae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:53:51.875240 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7283e-7d0b-456d-be93-47fc2305bae9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:53:51.875581 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7283e-7d0b-456d-be93-47fc2305bae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:53:51.877668 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7283e-7d0b-456d-be93-47fc2305bae9 admin admin] PATH_INFO: `/v3/users/e9982f39ae394932a2fb8c9e4d456d8d` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:53:51.877668 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea7283e-7d0b-456d-be93-47fc2305bae9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9982f39ae394932a2fb8c9e4d456d8d)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:53:51.879004 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea7283e-7d0b-456d-be93-47fc2305bae9 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:53:52.100517 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9ea7283e-7d0b-456d-be93-47fc2305bae9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9982f39ae394932a2fb8c9e4d456d8d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:53:52.107778 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9ea7283e-7d0b-456d-be93-47fc2305bae9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9982f39ae394932a2fb8c9e4d456d8d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:53:52.108467 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9ea7283e-7d0b-456d-be93-47fc2305bae9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9982f39ae394932a2fb8c9e4d456d8d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:53:52.179570 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9ea7283e-7d0b-456d-be93-47fc2305bae9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9982f39ae394932a2fb8c9e4d456d8d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:53:52.191718 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-9ea7283e-7d0b-456d-be93-47fc2305bae9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9982f39ae394932a2fb8c9e4d456d8d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:53:52.198434 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4286/8596] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:53:51 2022] DELETE /identity/v3/users/e9982f39ae394932a2fb8c9e4d456d8d => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:53:52.203106 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b46dd5-562f-4a02-9193-974f82bf4688 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:53:52.203631 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b46dd5-562f-4a02-9193-974f82bf4688 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:53:52.203811 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b46dd5-562f-4a02-9193-974f82bf4688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:53:52.232359 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-a6b46dd5-562f-4a02-9193-974f82bf4688 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:53:52.233691 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-a6b46dd5-562f-4a02-9193-974f82bf4688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:53:52.291963 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4311/8597] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:53:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:53:52.301729 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea7283e-7d0b-456d-be93-47fc2305bae9 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:53:52.303319 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-9ea7283e-7d0b-456d-be93-47fc2305bae9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:53:52.363431 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea7283e-7d0b-456d-be93-47fc2305bae9 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:53:52.367171 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cc1cc8-d8f2-4486-898d-7d92448bc5a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:53:52.367851 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc1cc8-d8f2-4486-898d-7d92448bc5a3 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:53:52.368137 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc1cc8-d8f2-4486-898d-7d92448bc5a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:53:52.368415 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc1cc8-d8f2-4486-898d-7d92448bc5a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:53:52.377419 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cc1cc8-d8f2-4486-898d-7d92448bc5a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:53:52.378890 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cc1cc8-d8f2-4486-898d-7d92448bc5a3 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:53:52.389181 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4287/8598] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:53:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:53:52.631423 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b46dd5-562f-4a02-9193-974f82bf4688 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:53:52.633039 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-a6b46dd5-562f-4a02-9193-974f82bf4688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:53:52.647721 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b46dd5-562f-4a02-9193-974f82bf4688 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:53:52.653207 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0daf939-8a83-4fa8-bbde-bb60ec7b6ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:53:52.655143 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0daf939-8a83-4fa8-bbde-bb60ec7b6ea6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:53:52.655431 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0daf939-8a83-4fa8-bbde-bb60ec7b6ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:53:52.655745 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0daf939-8a83-4fa8-bbde-bb60ec7b6ea6 admin admin] PATH_INFO: `/v3/projects/9d47cde4b8ee4dbc9ad64de4084690a9` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:53:52.657007 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0daf939-8a83-4fa8-bbde-bb60ec7b6ea6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d47cde4b8ee4dbc9ad64de4084690a9)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:53:52.658883 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0daf939-8a83-4fa8-bbde-bb60ec7b6ea6 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:53:52.761599 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a0daf939-8a83-4fa8-bbde-bb60ec7b6ea6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d47cde4b8ee4dbc9ad64de4084690a9', 'request_id': 'req-a0daf939-8a83-4fa8-bbde-bb60ec7b6ea6'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:53:52.767185 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a0daf939-8a83-4fa8-bbde-bb60ec7b6ea6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d47cde4b8ee4dbc9ad64de4084690a9', 'request_id': 'req-a0daf939-8a83-4fa8-bbde-bb60ec7b6ea6'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:53:52.863351 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a0daf939-8a83-4fa8-bbde-bb60ec7b6ea6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d47cde4b8ee4dbc9ad64de4084690a9', 'request_id': 'req-a0daf939-8a83-4fa8-bbde-bb60ec7b6ea6'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:53:52.876841 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a0daf939-8a83-4fa8-bbde-bb60ec7b6ea6 admin admin] The token cache is being invalidate because project 9d47cde4b8ee4dbc9ad64de4084690a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:53:52.877053 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a0daf939-8a83-4fa8-bbde-bb60ec7b6ea6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:53:52.877693 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a0daf939-8a83-4fa8-bbde-bb60ec7b6ea6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:53:52.879400 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4312/8599] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:53:52 2022] DELETE /identity/v3/projects/9d47cde4b8ee4dbc9ad64de4084690a9 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:53:52.884253 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cc1cc8-d8f2-4486-898d-7d92448bc5a3 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:53:52.894133 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cc1cc8-d8f2-4486-898d-7d92448bc5a3 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:53:52.951875 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de33630-4c54-4395-bb4b-ac2037bfe07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:53:52.952753 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de33630-4c54-4395-bb4b-ac2037bfe07e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:53:52.953039 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de33630-4c54-4395-bb4b-ac2037bfe07e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:53:52.953316 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de33630-4c54-4395-bb4b-ac2037bfe07e admin admin] PATH_INFO: `/v3/users/f2ffdc7ae79e469e9bf232ffb1d5ff3b` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:53:52.954617 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de33630-4c54-4395-bb4b-ac2037bfe07e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2ffdc7ae79e469e9bf232ffb1d5ff3b)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:53:52.956667 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de33630-4c54-4395-bb4b-ac2037bfe07e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:53:53.181571 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-1de33630-4c54-4395-bb4b-ac2037bfe07e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2ffdc7ae79e469e9bf232ffb1d5ff3b'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:53:53.188420 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-1de33630-4c54-4395-bb4b-ac2037bfe07e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2ffdc7ae79e469e9bf232ffb1d5ff3b'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:53:53.189165 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-1de33630-4c54-4395-bb4b-ac2037bfe07e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2ffdc7ae79e469e9bf232ffb1d5ff3b'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:53:53.269625 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-1de33630-4c54-4395-bb4b-ac2037bfe07e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2ffdc7ae79e469e9bf232ffb1d5ff3b'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:53:53.283585 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-1de33630-4c54-4395-bb4b-ac2037bfe07e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2ffdc7ae79e469e9bf232ffb1d5ff3b'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:53:53.289684 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4288/8600] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:53:52 2022] DELETE /identity/v3/users/f2ffdc7ae79e469e9bf232ffb1d5ff3b => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:53:53.551438 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0daf939-8a83-4fa8-bbde-bb60ec7b6ea6 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:53:53.553577 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-a0daf939-8a83-4fa8-bbde-bb60ec7b6ea6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:53:53.566849 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0daf939-8a83-4fa8-bbde-bb60ec7b6ea6 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:53:53.623016 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f923c830-fcc6-49b1-8d2a-31fad00809d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:53:53.623915 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f923c830-fcc6-49b1-8d2a-31fad00809d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:53:53.624199 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f923c830-fcc6-49b1-8d2a-31fad00809d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:53:53.624476 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f923c830-fcc6-49b1-8d2a-31fad00809d3 admin admin] PATH_INFO: `/v3/projects/4c8d288bc5c1457bba2b72854fd2d328` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:53:53.625645 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f923c830-fcc6-49b1-8d2a-31fad00809d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c8d288bc5c1457bba2b72854fd2d328)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:53:53.627582 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f923c830-fcc6-49b1-8d2a-31fad00809d3 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:53:53.758428 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f923c830-fcc6-49b1-8d2a-31fad00809d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c8d288bc5c1457bba2b72854fd2d328', 'request_id': 'req-f923c830-fcc6-49b1-8d2a-31fad00809d3'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:53:53.763867 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f923c830-fcc6-49b1-8d2a-31fad00809d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c8d288bc5c1457bba2b72854fd2d328', 'request_id': 'req-f923c830-fcc6-49b1-8d2a-31fad00809d3'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:53:53.859809 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f923c830-fcc6-49b1-8d2a-31fad00809d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c8d288bc5c1457bba2b72854fd2d328', 'request_id': 'req-f923c830-fcc6-49b1-8d2a-31fad00809d3'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:53:53.871952 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f923c830-fcc6-49b1-8d2a-31fad00809d3 admin admin] The token cache is being invalidate because project 4c8d288bc5c1457bba2b72854fd2d328 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:53:53.872243 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f923c830-fcc6-49b1-8d2a-31fad00809d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:53:53.872955 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f923c830-fcc6-49b1-8d2a-31fad00809d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:53:53.874557 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4313/8601] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:53:53 2022] DELETE /identity/v3/projects/4c8d288bc5c1457bba2b72854fd2d328 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:53:53.882065 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de9b4b-0f93-469a-a4d4-372cbd93b8f8 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:53:53.882356 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de9b4b-0f93-469a-a4d4-372cbd93b8f8 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:53:53.882638 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de9b4b-0f93-469a-a4d4-372cbd93b8f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:53:53.930905 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-44de9b4b-0f93-469a-a4d4-372cbd93b8f8 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:53:53.932228 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-44de9b4b-0f93-469a-a4d4-372cbd93b8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:53:53.992555 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4289/8602] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:53:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:53:54.001044 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d087766-8fdd-4413-b34f-ca7eec2de956 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:53:54.001329 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d087766-8fdd-4413-b34f-ca7eec2de956 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:53:54.001607 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d087766-8fdd-4413-b34f-ca7eec2de956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:53:54.021462 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-5d087766-8fdd-4413-b34f-ca7eec2de956 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:53:54.022744 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-5d087766-8fdd-4413-b34f-ca7eec2de956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:53:54.030933 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4314/8603] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:53:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:53:54.035091 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44de9b4b-0f93-469a-a4d4-372cbd93b8f8 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:53:54.045244 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44de9b4b-0f93-469a-a4d4-372cbd93b8f8 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:53:54.050178 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3998954-a50e-4b0e-b99c-305c9ede30a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:53:54.050838 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3998954-a50e-4b0e-b99c-305c9ede30a1 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:53:54.051125 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3998954-a50e-4b0e-b99c-305c9ede30a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:53:54.051463 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3998954-a50e-4b0e-b99c-305c9ede30a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:53:54.056011 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3998954-a50e-4b0e-b99c-305c9ede30a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:53:54.056011 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3998954-a50e-4b0e-b99c-305c9ede30a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:53:54.056011 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3998954-a50e-4b0e-b99c-305c9ede30a1 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:53:54.065871 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4290/8604] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:53:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:53:54.071055 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d087766-8fdd-4413-b34f-ca7eec2de956 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:53:54.080484 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d087766-8fdd-4413-b34f-ca7eec2de956 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:53:54.086170 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af4821e-41b7-40b4-a971-692761b9a8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:53:54.086877 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af4821e-41b7-40b4-a971-692761b9a8c1 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:53:54.087162 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af4821e-41b7-40b4-a971-692761b9a8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:53:54.087437 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af4821e-41b7-40b4-a971-692761b9a8c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:53:54.088164 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af4821e-41b7-40b4-a971-692761b9a8c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:53:54.090211 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af4821e-41b7-40b4-a971-692761b9a8c1 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:53:54.262768 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4315/8605] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:53:54 2022] POST /identity/v3/projects => generated 375 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:53:54.264011 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3998954-a50e-4b0e-b99c-305c9ede30a1 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:53:54.274988 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3998954-a50e-4b0e-b99c-305c9ede30a1 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:53:54.330530 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fc81a1-0e1f-4f06-9ae7-f9b4ae755ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:53:54.331192 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc81a1-0e1f-4f06-9ae7-f9b4ae755ecb admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:53:54.331494 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc81a1-0e1f-4f06-9ae7-f9b4ae755ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:53:54.331793 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc81a1-0e1f-4f06-9ae7-f9b4ae755ecb admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:53:54.332481 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fc81a1-0e1f-4f06-9ae7-f9b4ae755ecb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:53:54.334904 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fc81a1-0e1f-4f06-9ae7-f9b4ae755ecb admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:53:54.448900 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4291/8606] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:53:54 2022] POST /identity/v3/users => generated 288 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:53:54.452856 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af4821e-41b7-40b4-a971-692761b9a8c1 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:53:54.464130 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af4821e-41b7-40b4-a971-692761b9a8c1 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:53:54.468660 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e6376b-64d6-49b7-a5e4-23834438040b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:53:54.469312 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6376b-64d6-49b7-a5e4-23834438040b admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:53:54.469623 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6376b-64d6-49b7-a5e4-23834438040b admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:53:54.469904 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6376b-64d6-49b7-a5e4-23834438040b admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:53:54.470760 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e6376b-64d6-49b7-a5e4-23834438040b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:53:54.472378 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e6376b-64d6-49b7-a5e4-23834438040b admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:53:54.486651 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4316/8607] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:53:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:53:54.491602 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fc81a1-0e1f-4f06-9ae7-f9b4ae755ecb admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:53:54.502020 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fc81a1-0e1f-4f06-9ae7-f9b4ae755ecb admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:53:54.506965 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d04d55e-7e7f-4ddf-82c5-ae8ff011504b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:53:54.507744 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d04d55e-7e7f-4ddf-82c5-ae8ff011504b admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:53:54.508034 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d04d55e-7e7f-4ddf-82c5-ae8ff011504b admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:53:54.508407 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d04d55e-7e7f-4ddf-82c5-ae8ff011504b admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:53:54.510530 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d04d55e-7e7f-4ddf-82c5-ae8ff011504b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:53:54.512311 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d04d55e-7e7f-4ddf-82c5-ae8ff011504b admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:53:54.528841 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4292/8608] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:53:54 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:53:54.533612 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e6376b-64d6-49b7-a5e4-23834438040b admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:53:54.545772 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e6376b-64d6-49b7-a5e4-23834438040b admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:53:54.550545 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4a1f96-35cf-4f7e-a7c5-76cbe8040efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:53:54.551436 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a1f96-35cf-4f7e-a7c5-76cbe8040efa admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:53:54.551955 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a1f96-35cf-4f7e-a7c5-76cbe8040efa admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:53:54.552671 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a1f96-35cf-4f7e-a7c5-76cbe8040efa admin admin] PATH_INFO: `/v3/projects/ffdb9c0b09694b93b1343adbad43920b/users/2626a7421f6f41c8971a7fdd8e79795a/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:53:54.574646 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4a1f96-35cf-4f7e-a7c5-76cbe8040efa admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffdb9c0b09694b93b1343adbad43920b, user_id=2626a7421f6f41c8971a7fdd8e79795a, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:53:54.578547 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4a1f96-35cf-4f7e-a7c5-76cbe8040efa admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:53:54.703873 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4317/8609] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:53:54 2022] PUT /identity/v3/projects/ffdb9c0b09694b93b1343adbad43920b/users/2626a7421f6f41c8971a7fdd8e79795a/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:53:54.710014 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de915150-e92c-4afd-adc8-da187413e99f None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:53:54.710304 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de915150-e92c-4afd-adc8-da187413e99f None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:53:54.710605 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de915150-e92c-4afd-adc8-da187413e99f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:53:54.729765 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-de915150-e92c-4afd-adc8-da187413e99f None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:53:54.731772 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-de915150-e92c-4afd-adc8-da187413e99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:53:54.804314 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4293/8610] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:53:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:53:54.815231 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4a1f96-35cf-4f7e-a7c5-76cbe8040efa admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:53:54.817086 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-bb4a1f96-35cf-4f7e-a7c5-76cbe8040efa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:53:54.885609 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4a1f96-35cf-4f7e-a7c5-76cbe8040efa admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:53:54.889425 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e879c3b4-9ba1-4139-a3f7-b7cdcc6eb47f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:53:54.890118 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e879c3b4-9ba1-4139-a3f7-b7cdcc6eb47f service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:53:54.890400 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e879c3b4-9ba1-4139-a3f7-b7cdcc6eb47f service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:53:54.890671 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e879c3b4-9ba1-4139-a3f7-b7cdcc6eb47f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:53:54.901699 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e879c3b4-9ba1-4139-a3f7-b7cdcc6eb47f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:53:54.903498 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e879c3b4-9ba1-4139-a3f7-b7cdcc6eb47f service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:53:54.914324 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4318/8611] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:53:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:54:00.166506 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb27165-d33b-4fac-9fb4-7f0114a74879 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:54:00.166506 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb27165-d33b-4fac-9fb4-7f0114a74879 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:54:00.166506 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb27165-d33b-4fac-9fb4-7f0114a74879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:54:00.213267 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-1bb27165-d33b-4fac-9fb4-7f0114a74879 None None] MFA Rules not processed for user `2626a7421f6f41c8971a7fdd8e79795a`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:54:00.215727 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-1bb27165-d33b-4fac-9fb4-7f0114a74879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:54:00.288681 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4294/8612] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:54:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:54:00.293257 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e879c3b4-9ba1-4139-a3f7-b7cdcc6eb47f service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:54:00.304758 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e879c3b4-9ba1-4139-a3f7-b7cdcc6eb47f service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:54:00.312664 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af2595-41e3-4fa5-a9a4-41a682908d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:54:00.313484 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af2595-41e3-4fa5-a9a4-41a682908d65 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:54:00.313781 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af2595-41e3-4fa5-a9a4-41a682908d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:54:00.314066 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af2595-41e3-4fa5-a9a4-41a682908d65 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:54:00.314776 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53af2595-41e3-4fa5-a9a4-41a682908d65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:54:00.316909 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53af2595-41e3-4fa5-a9a4-41a682908d65 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:54:00.433754 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4319/8613] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:54:00 2022] POST /identity/v3/projects => generated 375 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:54:00.437868 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb27165-d33b-4fac-9fb4-7f0114a74879 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:54:00.450061 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb27165-d33b-4fac-9fb4-7f0114a74879 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:54:00.510187 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c64ca1-4520-460c-bb82-233a78b1ecac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:54:00.510875 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c64ca1-4520-460c-bb82-233a78b1ecac admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:54:00.511196 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c64ca1-4520-460c-bb82-233a78b1ecac admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:54:00.511505 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c64ca1-4520-460c-bb82-233a78b1ecac admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:54:00.512204 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c64ca1-4520-460c-bb82-233a78b1ecac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:54:00.514181 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c64ca1-4520-460c-bb82-233a78b1ecac admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:54:00.615240 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4295/8614] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:54:00 2022] POST /identity/v3/users => generated 294 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:54:00.616731 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af2595-41e3-4fa5-a9a4-41a682908d65 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:54:00.627996 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af2595-41e3-4fa5-a9a4-41a682908d65 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:54:00.641933 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea89ffb-2fe5-4fcc-826e-685863a1f459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:54:00.645994 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea89ffb-2fe5-4fcc-826e-685863a1f459 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:54:00.645994 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea89ffb-2fe5-4fcc-826e-685863a1f459 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:54:00.645994 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea89ffb-2fe5-4fcc-826e-685863a1f459 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:54:00.645994 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea89ffb-2fe5-4fcc-826e-685863a1f459 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:54:00.647691 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea89ffb-2fe5-4fcc-826e-685863a1f459 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:54:00.665796 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4320/8615] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:54:00 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:54:00.669941 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c64ca1-4520-460c-bb82-233a78b1ecac admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:54:00.680350 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c64ca1-4520-460c-bb82-233a78b1ecac admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:54:00.685119 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d687df-f48c-4ef2-b23e-f4b428e6115c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:54:00.686042 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d687df-f48c-4ef2-b23e-f4b428e6115c admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:54:00.686417 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d687df-f48c-4ef2-b23e-f4b428e6115c admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:54:00.686695 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d687df-f48c-4ef2-b23e-f4b428e6115c admin admin] PATH_INFO: `/v3/projects/83be614a11e44c29b6444b41ce0a20d8/users/562a60622af84fd383158e44f8b51ad9/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:54:00.708684 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d687df-f48c-4ef2-b23e-f4b428e6115c admin admin] RBAC: Authorizing `identity:create_grant(project_id=83be614a11e44c29b6444b41ce0a20d8, user_id=562a60622af84fd383158e44f8b51ad9, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:54:00.711723 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d687df-f48c-4ef2-b23e-f4b428e6115c admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:54:00.804212 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4296/8616] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:54:00 2022] PUT /identity/v3/projects/83be614a11e44c29b6444b41ce0a20d8/users/562a60622af84fd383158e44f8b51ad9/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:54:00.808526 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea89ffb-2fe5-4fcc-826e-685863a1f459 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:54:00.819075 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea89ffb-2fe5-4fcc-826e-685863a1f459 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:54:00.887123 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7efa1c-3a80-4ae1-b957-7dcae12639f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:54:00.887965 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7efa1c-3a80-4ae1-b957-7dcae12639f6 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:54:00.888328 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7efa1c-3a80-4ae1-b957-7dcae12639f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:54:00.888672 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7efa1c-3a80-4ae1-b957-7dcae12639f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:54:00.889473 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7efa1c-3a80-4ae1-b957-7dcae12639f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:54:00.896771 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7efa1c-3a80-4ae1-b957-7dcae12639f6 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:54:00.902380 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4321/8617] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:54:00 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:54:00.906681 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d687df-f48c-4ef2-b23e-f4b428e6115c admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:54:00.918974 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d687df-f48c-4ef2-b23e-f4b428e6115c admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:54:00.924297 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab59d84-2bd3-4abd-86e0-f6a38f8aadd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:54:00.929079 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab59d84-2bd3-4abd-86e0-f6a38f8aadd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:54:00.929079 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab59d84-2bd3-4abd-86e0-f6a38f8aadd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:54:00.929079 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab59d84-2bd3-4abd-86e0-f6a38f8aadd7 admin admin] PATH_INFO: `/v3/projects/83be614a11e44c29b6444b41ce0a20d8/users/562a60622af84fd383158e44f8b51ad9/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:54:00.929079 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab59d84-2bd3-4abd-86e0-f6a38f8aadd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83be614a11e44c29b6444b41ce0a20d8, user_id=562a60622af84fd383158e44f8b51ad9, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:54:00.932214 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab59d84-2bd3-4abd-86e0-f6a38f8aadd7 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:54:00.943808 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4297/8618] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:54:00 2022] PUT /identity/v3/projects/83be614a11e44c29b6444b41ce0a20d8/users/562a60622af84fd383158e44f8b51ad9/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:54:06.971042 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e640740-22b6-48e7-93f7-c482fe601a50 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:54:06.971586 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e640740-22b6-48e7-93f7-c482fe601a50 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:54:06.971706 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e640740-22b6-48e7-93f7-c482fe601a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:54:07.005905 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-5e640740-22b6-48e7-93f7-c482fe601a50 None None] MFA Rules not processed for user `562a60622af84fd383158e44f8b51ad9`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:54:07.007145 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-5e640740-22b6-48e7-93f7-c482fe601a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:54:07.088682 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4322/8619] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:54:06 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:54:07.101305 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab59d84-2bd3-4abd-86e0-f6a38f8aadd7 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:54:07.103148 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-4ab59d84-2bd3-4abd-86e0-f6a38f8aadd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:54:07.191251 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab59d84-2bd3-4abd-86e0-f6a38f8aadd7 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:54:07.211879 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03941e4e-588a-409e-a09b-c7545bb828ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:54:07.212694 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03941e4e-588a-409e-a09b-c7545bb828ec service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:54:07.212978 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03941e4e-588a-409e-a09b-c7545bb828ec service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:54:07.213256 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03941e4e-588a-409e-a09b-c7545bb828ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:54:07.233312 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03941e4e-588a-409e-a09b-c7545bb828ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:54:07.234989 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03941e4e-588a-409e-a09b-c7545bb828ec service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:54:07.252740 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4298/8620] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:54:07 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:54:07.302732 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da636544-6923-4730-af44-2fe0e21b7b21 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:54:07.303115 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da636544-6923-4730-af44-2fe0e21b7b21 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:54:07.303396 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da636544-6923-4730-af44-2fe0e21b7b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:54:07.322562 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-da636544-6923-4730-af44-2fe0e21b7b21 None None] MFA Rules not processed for user `2626a7421f6f41c8971a7fdd8e79795a`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:54:07.323805 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-da636544-6923-4730-af44-2fe0e21b7b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:54:07.382703 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4323/8621] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:54:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:54:21.358340 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a80d1a-7739-48b7-b702-3acbb27d139d None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:54:21.358903 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a80d1a-7739-48b7-b702-3acbb27d139d None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:54:21.358903 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a80d1a-7739-48b7-b702-3acbb27d139d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:54:21.376537 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-29a80d1a-7739-48b7-b702-3acbb27d139d None None] MFA Rules not processed for user `2626a7421f6f41c8971a7fdd8e79795a`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:54:21.377769 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-29a80d1a-7739-48b7-b702-3acbb27d139d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:54:21.385724 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4299/8622] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:54:21 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:54:51.682116 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da636544-6923-4730-af44-2fe0e21b7b21 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:54:51.746185 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da636544-6923-4730-af44-2fe0e21b7b21 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:54:51.750704 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008d02d1-bd1a-46c3-9ccc-a3993f49e5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:54:51.751603 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d02d1-bd1a-46c3-9ccc-a3993f49e5ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:54:51.751888 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d02d1-bd1a-46c3-9ccc-a3993f49e5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:54:51.752160 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d02d1-bd1a-46c3-9ccc-a3993f49e5ad admin admin] PATH_INFO: `/v3/users/2626a7421f6f41c8971a7fdd8e79795a` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:54:51.753323 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008d02d1-bd1a-46c3-9ccc-a3993f49e5ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=2626a7421f6f41c8971a7fdd8e79795a)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:54:51.755267 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008d02d1-bd1a-46c3-9ccc-a3993f49e5ad admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:54:51.987560 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-008d02d1-bd1a-46c3-9ccc-a3993f49e5ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2626a7421f6f41c8971a7fdd8e79795a'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:54:51.999642 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-008d02d1-bd1a-46c3-9ccc-a3993f49e5ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2626a7421f6f41c8971a7fdd8e79795a'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:54:52.006392 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-008d02d1-bd1a-46c3-9ccc-a3993f49e5ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2626a7421f6f41c8971a7fdd8e79795a'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:54:52.081961 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-008d02d1-bd1a-46c3-9ccc-a3993f49e5ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2626a7421f6f41c8971a7fdd8e79795a'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:54:52.082606 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-008d02d1-bd1a-46c3-9ccc-a3993f49e5ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2626a7421f6f41c8971a7fdd8e79795a'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:54:52.090077 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4324/8623] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:54:51 2022] DELETE /identity/v3/users/2626a7421f6f41c8971a7fdd8e79795a => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:54:52.338705 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a80d1a-7739-48b7-b702-3acbb27d139d None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:54:52.350019 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a80d1a-7739-48b7-b702-3acbb27d139d None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:54:52.408769 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d544951a-4b98-45a4-884a-50052e96d920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:54:52.409661 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544951a-4b98-45a4-884a-50052e96d920 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:54:52.409942 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544951a-4b98-45a4-884a-50052e96d920 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:54:52.410215 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544951a-4b98-45a4-884a-50052e96d920 admin admin] PATH_INFO: `/v3/projects/ffdb9c0b09694b93b1343adbad43920b` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:54:52.411460 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d544951a-4b98-45a4-884a-50052e96d920 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffdb9c0b09694b93b1343adbad43920b)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:54:52.413553 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d544951a-4b98-45a4-884a-50052e96d920 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:54:52.565514 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d544951a-4b98-45a4-884a-50052e96d920 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffdb9c0b09694b93b1343adbad43920b', 'request_id': 'req-d544951a-4b98-45a4-884a-50052e96d920'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:54:52.571226 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d544951a-4b98-45a4-884a-50052e96d920 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffdb9c0b09694b93b1343adbad43920b', 'request_id': 'req-d544951a-4b98-45a4-884a-50052e96d920'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:54:52.577477 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d544951a-4b98-45a4-884a-50052e96d920 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffdb9c0b09694b93b1343adbad43920b', 'request_id': 'req-d544951a-4b98-45a4-884a-50052e96d920'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:54:52.664571 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d544951a-4b98-45a4-884a-50052e96d920 admin admin] The token cache is being invalidate because project ffdb9c0b09694b93b1343adbad43920b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:54:52.665352 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d544951a-4b98-45a4-884a-50052e96d920 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:54:52.666094 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-d544951a-4b98-45a4-884a-50052e96d920 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:54:52.667804 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4300/8624] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:54:52 2022] DELETE /identity/v3/projects/ffdb9c0b09694b93b1343adbad43920b => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:54:52.671790 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008d02d1-bd1a-46c3-9ccc-a3993f49e5ad admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:54:52.673165 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-008d02d1-bd1a-46c3-9ccc-a3993f49e5ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:54:52.687457 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008d02d1-bd1a-46c3-9ccc-a3993f49e5ad admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:54:52.744055 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb409c2-b1d0-4728-9905-d998a959dd9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:54:52.744929 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb409c2-b1d0-4728-9905-d998a959dd9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:54:52.745219 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb409c2-b1d0-4728-9905-d998a959dd9a admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:54:52.745502 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb409c2-b1d0-4728-9905-d998a959dd9a admin admin] PATH_INFO: `/v3/users/562a60622af84fd383158e44f8b51ad9` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:54:52.746791 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb409c2-b1d0-4728-9905-d998a959dd9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=562a60622af84fd383158e44f8b51ad9)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:54:52.748874 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb409c2-b1d0-4728-9905-d998a959dd9a admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:54:52.937556 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-bbb409c2-b1d0-4728-9905-d998a959dd9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '562a60622af84fd383158e44f8b51ad9'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:54:52.949496 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-bbb409c2-b1d0-4728-9905-d998a959dd9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '562a60622af84fd383158e44f8b51ad9'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:54:52.956400 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-bbb409c2-b1d0-4728-9905-d998a959dd9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '562a60622af84fd383158e44f8b51ad9'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:54:53.016428 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-bbb409c2-b1d0-4728-9905-d998a959dd9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '562a60622af84fd383158e44f8b51ad9'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:54:53.017042 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-bbb409c2-b1d0-4728-9905-d998a959dd9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '562a60622af84fd383158e44f8b51ad9'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:54:53.023054 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4325/8625] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:54:52 2022] DELETE /identity/v3/users/562a60622af84fd383158e44f8b51ad9 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:54:53.266489 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d544951a-4b98-45a4-884a-50052e96d920 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:54:53.267933 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-d544951a-4b98-45a4-884a-50052e96d920 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:54:53.283922 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d544951a-4b98-45a4-884a-50052e96d920 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:54:53.342789 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51ffa57-c423-4aa0-ac0a-1232979fccb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:54:53.351261 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ffa57-c423-4aa0-ac0a-1232979fccb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:54:53.351261 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ffa57-c423-4aa0-ac0a-1232979fccb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:54:53.351261 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ffa57-c423-4aa0-ac0a-1232979fccb2 admin admin] PATH_INFO: `/v3/projects/83be614a11e44c29b6444b41ce0a20d8` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:54:53.351261 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51ffa57-c423-4aa0-ac0a-1232979fccb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83be614a11e44c29b6444b41ce0a20d8)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:54:53.351261 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51ffa57-c423-4aa0-ac0a-1232979fccb2 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:54:53.457578 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f51ffa57-c423-4aa0-ac0a-1232979fccb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83be614a11e44c29b6444b41ce0a20d8', 'request_id': 'req-f51ffa57-c423-4aa0-ac0a-1232979fccb2'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:54:53.463917 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f51ffa57-c423-4aa0-ac0a-1232979fccb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83be614a11e44c29b6444b41ce0a20d8', 'request_id': 'req-f51ffa57-c423-4aa0-ac0a-1232979fccb2'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:54:53.470350 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f51ffa57-c423-4aa0-ac0a-1232979fccb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83be614a11e44c29b6444b41ce0a20d8', 'request_id': 'req-f51ffa57-c423-4aa0-ac0a-1232979fccb2'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:54:53.553331 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f51ffa57-c423-4aa0-ac0a-1232979fccb2 admin admin] The token cache is being invalidate because project 83be614a11e44c29b6444b41ce0a20d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:54:53.553555 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f51ffa57-c423-4aa0-ac0a-1232979fccb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:54:53.554155 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f51ffa57-c423-4aa0-ac0a-1232979fccb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:54:53.556023 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4301/8626] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:54:53 2022] DELETE /identity/v3/projects/83be614a11e44c29b6444b41ce0a20d8 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:55:00.326610 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb409c2-b1d0-4728-9905-d998a959dd9a admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:55:00.328042 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-bbb409c2-b1d0-4728-9905-d998a959dd9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:55:00.411006 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb409c2-b1d0-4728-9905-d998a959dd9a admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:55:00.470928 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1188445b-9e38-4651-b10f-153fc594eb42 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:55:00.471625 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1188445b-9e38-4651-b10f-153fc594eb42 service placement] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:55:00.471916 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1188445b-9e38-4651-b10f-153fc594eb42 service placement] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:55:00.472284 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1188445b-9e38-4651-b10f-153fc594eb42 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:55:00.474054 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-1188445b-9e38-4651-b10f-153fc594eb42 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:55:00.488830 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1188445b-9e38-4651-b10f-153fc594eb42 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:55:00.490510 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1188445b-9e38-4651-b10f-153fc594eb42 service placement] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:55:00.503215 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4326/8627] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:55:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:55:03.165331 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51ffa57-c423-4aa0-ac0a-1232979fccb2 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:55:03.166803 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-f51ffa57-c423-4aa0-ac0a-1232979fccb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:55:03.185189 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51ffa57-c423-4aa0-ac0a-1232979fccb2 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:55:03.190032 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72330da4-9fd4-48b7-805f-6da844a825a4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:55:03.190983 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72330da4-9fd4-48b7-805f-6da844a825a4 service placement] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:55:03.191274 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72330da4-9fd4-48b7-805f-6da844a825a4 service placement] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:55:03.191588 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72330da4-9fd4-48b7-805f-6da844a825a4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:55:03.193386 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-72330da4-9fd4-48b7-805f-6da844a825a4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:55:03.207530 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72330da4-9fd4-48b7-805f-6da844a825a4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:55:03.211552 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72330da4-9fd4-48b7-805f-6da844a825a4 service placement] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:55:03.222240 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4302/8628] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:55:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:55:41.154300 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1188445b-9e38-4651-b10f-153fc594eb42 service placement] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:55:41.155760 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-1188445b-9e38-4651-b10f-153fc594eb42 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:55:41.214135 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1188445b-9e38-4651-b10f-153fc594eb42 service placement] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:55:41.218361 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd40b286-64db-4090-a32d-31aeded6cab9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:55:41.219003 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40b286-64db-4090-a32d-31aeded6cab9 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:55:41.219284 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40b286-64db-4090-a32d-31aeded6cab9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:55:41.219588 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40b286-64db-4090-a32d-31aeded6cab9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:55:41.221307 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-fd40b286-64db-4090-a32d-31aeded6cab9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:55:41.279605 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd40b286-64db-4090-a32d-31aeded6cab9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:55:41.281039 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd40b286-64db-4090-a32d-31aeded6cab9 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:55:41.290009 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4327/8629] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:55:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:56:05.086126 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72330da4-9fd4-48b7-805f-6da844a825a4 service placement] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:56:05.098907 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72330da4-9fd4-48b7-805f-6da844a825a4 service placement] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:56:05.102545 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d5f37d-3a37-4a22-8f4c-1906849b7062 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:56:05.103183 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5f37d-3a37-4a22-8f4c-1906849b7062 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:56:05.103465 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5f37d-3a37-4a22-8f4c-1906849b7062 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:56:05.103769 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5f37d-3a37-4a22-8f4c-1906849b7062 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:56:05.105515 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-41d5f37d-3a37-4a22-8f4c-1906849b7062 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:56:05.166935 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d5f37d-3a37-4a22-8f4c-1906849b7062 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:56:05.168408 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d5f37d-3a37-4a22-8f4c-1906849b7062 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:56:05.178394 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4303/8630] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:56:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:56:12.570052 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd40b286-64db-4090-a32d-31aeded6cab9 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:56:12.573722 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-fd40b286-64db-4090-a32d-31aeded6cab9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:56:12.586645 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd40b286-64db-4090-a32d-31aeded6cab9 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:56:12.591315 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c1f23e-c04f-455d-adbf-da1ccaf032fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:56:12.592238 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c1f23e-c04f-455d-adbf-da1ccaf032fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:56:12.592523 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c1f23e-c04f-455d-adbf-da1ccaf032fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:56:12.592795 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c1f23e-c04f-455d-adbf-da1ccaf032fd admin admin] PATH_INFO: `/v3/users/1b51720c7970425abf4a26b2406893b7` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:56:12.594192 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c1f23e-c04f-455d-adbf-da1ccaf032fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b51720c7970425abf4a26b2406893b7)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:56:12.596175 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c1f23e-c04f-455d-adbf-da1ccaf032fd admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:56:12.776777 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-32c1f23e-c04f-455d-adbf-da1ccaf032fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b51720c7970425abf4a26b2406893b7'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:56:12.795751 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-32c1f23e-c04f-455d-adbf-da1ccaf032fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b51720c7970425abf4a26b2406893b7'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:56:12.806143 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-32c1f23e-c04f-455d-adbf-da1ccaf032fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b51720c7970425abf4a26b2406893b7'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:56:12.932081 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-32c1f23e-c04f-455d-adbf-da1ccaf032fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b51720c7970425abf4a26b2406893b7'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:56:12.935447 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-32c1f23e-c04f-455d-adbf-da1ccaf032fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b51720c7970425abf4a26b2406893b7'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:56:12.940328 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4328/8631] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:56:12 2022] DELETE /identity/v3/users/1b51720c7970425abf4a26b2406893b7 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:56:13.206159 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d5f37d-3a37-4a22-8f4c-1906849b7062 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:56:13.217731 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d5f37d-3a37-4a22-8f4c-1906849b7062 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:56:13.275159 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c424bf-6123-469f-8033-f56e09a3016a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:56:13.276214 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c424bf-6123-469f-8033-f56e09a3016a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:56:13.276504 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c424bf-6123-469f-8033-f56e09a3016a admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:56:13.276849 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c424bf-6123-469f-8033-f56e09a3016a admin admin] PATH_INFO: `/v3/projects/fbd6e36a563a4245acae34e00437ca87` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:56:13.278457 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c424bf-6123-469f-8033-f56e09a3016a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbd6e36a563a4245acae34e00437ca87)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:56:13.280625 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c424bf-6123-469f-8033-f56e09a3016a admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:56:13.397904 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-80c424bf-6123-469f-8033-f56e09a3016a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbd6e36a563a4245acae34e00437ca87', 'request_id': 'req-80c424bf-6123-469f-8033-f56e09a3016a'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:56:13.403640 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-80c424bf-6123-469f-8033-f56e09a3016a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbd6e36a563a4245acae34e00437ca87', 'request_id': 'req-80c424bf-6123-469f-8033-f56e09a3016a'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:56:13.410651 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-80c424bf-6123-469f-8033-f56e09a3016a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbd6e36a563a4245acae34e00437ca87', 'request_id': 'req-80c424bf-6123-469f-8033-f56e09a3016a'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:56:13.486316 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-80c424bf-6123-469f-8033-f56e09a3016a admin admin] The token cache is being invalidate because project fbd6e36a563a4245acae34e00437ca87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:56:13.486606 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-80c424bf-6123-469f-8033-f56e09a3016a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:56:13.487244 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-80c424bf-6123-469f-8033-f56e09a3016a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:56:13.488835 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4304/8632] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:56:13 2022] DELETE /identity/v3/projects/fbd6e36a563a4245acae34e00437ca87 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:56:13.492861 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c1f23e-c04f-455d-adbf-da1ccaf032fd admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:56:13.494397 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-32c1f23e-c04f-455d-adbf-da1ccaf032fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:56:13.508564 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c1f23e-c04f-455d-adbf-da1ccaf032fd admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:56:13.570358 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40a1dc-f1de-4bb9-9d1e-8f5bd0989513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:56:13.571242 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40a1dc-f1de-4bb9-9d1e-8f5bd0989513 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:56:13.571559 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40a1dc-f1de-4bb9-9d1e-8f5bd0989513 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:56:13.571839 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40a1dc-f1de-4bb9-9d1e-8f5bd0989513 admin admin] PATH_INFO: `/v3/users/aaced6289b2e4af195f764b93773c9b5` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:56:13.573279 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed40a1dc-f1de-4bb9-9d1e-8f5bd0989513 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aaced6289b2e4af195f764b93773c9b5)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:56:13.575222 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed40a1dc-f1de-4bb9-9d1e-8f5bd0989513 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:56:13.866488 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ed40a1dc-f1de-4bb9-9d1e-8f5bd0989513 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aaced6289b2e4af195f764b93773c9b5'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:56:13.878385 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ed40a1dc-f1de-4bb9-9d1e-8f5bd0989513 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aaced6289b2e4af195f764b93773c9b5'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:56:13.885429 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ed40a1dc-f1de-4bb9-9d1e-8f5bd0989513 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aaced6289b2e4af195f764b93773c9b5'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:56:13.970065 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ed40a1dc-f1de-4bb9-9d1e-8f5bd0989513 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aaced6289b2e4af195f764b93773c9b5'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:56:13.970683 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-ed40a1dc-f1de-4bb9-9d1e-8f5bd0989513 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aaced6289b2e4af195f764b93773c9b5'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:56:13.977114 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4329/8633] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:56:13 2022] DELETE /identity/v3/users/aaced6289b2e4af195f764b93773c9b5 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:56:14.242455 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c424bf-6123-469f-8033-f56e09a3016a admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:56:14.245881 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-80c424bf-6123-469f-8033-f56e09a3016a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:56:14.259600 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c424bf-6123-469f-8033-f56e09a3016a admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:56:14.318027 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfe98fa-ba5a-4a26-b027-6d0d52f72751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:56:14.318888 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe98fa-ba5a-4a26-b027-6d0d52f72751 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:56:14.319174 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe98fa-ba5a-4a26-b027-6d0d52f72751 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:56:14.319453 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe98fa-ba5a-4a26-b027-6d0d52f72751 admin admin] PATH_INFO: `/v3/projects/1cc3e53234794cbe8c230fbd3ae26869` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:56:14.320651 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfe98fa-ba5a-4a26-b027-6d0d52f72751 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cc3e53234794cbe8c230fbd3ae26869)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:56:14.322617 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfe98fa-ba5a-4a26-b027-6d0d52f72751 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:56:14.464011 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-2bfe98fa-ba5a-4a26-b027-6d0d52f72751 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cc3e53234794cbe8c230fbd3ae26869', 'request_id': 'req-2bfe98fa-ba5a-4a26-b027-6d0d52f72751'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:56:14.470055 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-2bfe98fa-ba5a-4a26-b027-6d0d52f72751 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cc3e53234794cbe8c230fbd3ae26869', 'request_id': 'req-2bfe98fa-ba5a-4a26-b027-6d0d52f72751'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:56:14.477385 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-2bfe98fa-ba5a-4a26-b027-6d0d52f72751 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cc3e53234794cbe8c230fbd3ae26869', 'request_id': 'req-2bfe98fa-ba5a-4a26-b027-6d0d52f72751'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:56:14.560004 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-2bfe98fa-ba5a-4a26-b027-6d0d52f72751 admin admin] The token cache is being invalidate because project 1cc3e53234794cbe8c230fbd3ae26869 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 21:56:14.560219 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-2bfe98fa-ba5a-4a26-b027-6d0d52f72751 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:56:14.560836 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-2bfe98fa-ba5a-4a26-b027-6d0d52f72751 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 21:56:14.562929 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4305/8634] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:56:14 2022] DELETE /identity/v3/projects/1cc3e53234794cbe8c230fbd3ae26869 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:56:14.568110 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8b4c4-a8ad-43fd-b59e-403d1400d379 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:56:14.568380 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8b4c4-a8ad-43fd-b59e-403d1400d379 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:56:14.568655 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8b4c4-a8ad-43fd-b59e-403d1400d379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:56:14.587617 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-b3b8b4c4-a8ad-43fd-b59e-403d1400d379 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:56:14.588903 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b3b8b4c4-a8ad-43fd-b59e-403d1400d379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:56:14.647241 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4330/8635] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:56:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:56:14.655703 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6d52c-7427-4013-8da1-60c67869e229 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:56:14.656036 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6d52c-7427-4013-8da1-60c67869e229 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:56:14.656505 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6d52c-7427-4013-8da1-60c67869e229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:56:14.674468 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-66d6d52c-7427-4013-8da1-60c67869e229 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:56:14.675700 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-66d6d52c-7427-4013-8da1-60c67869e229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:56:14.683586 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4306/8636] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:56:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:56:14.688200 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b8b4c4-a8ad-43fd-b59e-403d1400d379 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:56:14.697915 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b8b4c4-a8ad-43fd-b59e-403d1400d379 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:56:14.702803 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e45c3d-2581-4ac8-bb5e-181f5b431f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:56:14.703449 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e45c3d-2581-4ac8-bb5e-181f5b431f62 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:56:14.703766 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e45c3d-2581-4ac8-bb5e-181f5b431f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:56:14.704043 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e45c3d-2581-4ac8-bb5e-181f5b431f62 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:56:14.704784 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e45c3d-2581-4ac8-bb5e-181f5b431f62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 21:56:14.705089 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e45c3d-2581-4ac8-bb5e-181f5b431f62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:56:14.706681 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e45c3d-2581-4ac8-bb5e-181f5b431f62 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:56:14.717959 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4331/8637] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 21:56:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 21:56:14.723173 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d6d52c-7427-4013-8da1-60c67869e229 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:56:14.732388 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d6d52c-7427-4013-8da1-60c67869e229 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:56:14.737768 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072c210f-929e-45f5-8ea9-fe32d9e0b573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:56:14.738480 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c210f-929e-45f5-8ea9-fe32d9e0b573 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:56:14.738768 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c210f-929e-45f5-8ea9-fe32d9e0b573 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:56:14.739044 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c210f-929e-45f5-8ea9-fe32d9e0b573 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:56:14.739761 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072c210f-929e-45f5-8ea9-fe32d9e0b573 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:56:14.741657 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072c210f-929e-45f5-8ea9-fe32d9e0b573 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:56:14.850855 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4307/8638] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:56:14 2022] POST /identity/v3/projects => generated 379 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:56:14.855031 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e45c3d-2581-4ac8-bb5e-181f5b431f62 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:56:14.865662 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e45c3d-2581-4ac8-bb5e-181f5b431f62 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:56:14.921107 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46df88b2-6482-42dd-aa33-b1c02ea9b593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:56:14.922646 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df88b2-6482-42dd-aa33-b1c02ea9b593 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:56:14.922926 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df88b2-6482-42dd-aa33-b1c02ea9b593 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:56:14.923207 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df88b2-6482-42dd-aa33-b1c02ea9b593 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:56:14.923941 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46df88b2-6482-42dd-aa33-b1c02ea9b593 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:56:14.925915 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46df88b2-6482-42dd-aa33-b1c02ea9b593 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:56:15.017715 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4332/8639] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:56:14 2022] POST /identity/v3/users => generated 290 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:56:15.022047 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072c210f-929e-45f5-8ea9-fe32d9e0b573 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:56:15.032924 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072c210f-929e-45f5-8ea9-fe32d9e0b573 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:56:15.039422 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b11ba-6919-471f-9f0f-299fc3b1be82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:56:15.040144 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b11ba-6919-471f-9f0f-299fc3b1be82 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:56:15.040431 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b11ba-6919-471f-9f0f-299fc3b1be82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:56:15.040713 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b11ba-6919-471f-9f0f-299fc3b1be82 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:56:15.041434 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8b11ba-6919-471f-9f0f-299fc3b1be82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:56:15.043040 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8b11ba-6919-471f-9f0f-299fc3b1be82 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:56:15.054881 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4308/8640] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:56:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:56:15.058891 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46df88b2-6482-42dd-aa33-b1c02ea9b593 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:56:15.069844 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46df88b2-6482-42dd-aa33-b1c02ea9b593 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:56:15.074769 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111553e6-012f-43de-9085-c93cb3843f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:56:15.075429 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111553e6-012f-43de-9085-c93cb3843f01 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:56:15.075752 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111553e6-012f-43de-9085-c93cb3843f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:56:15.076034 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111553e6-012f-43de-9085-c93cb3843f01 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:56:15.076753 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111553e6-012f-43de-9085-c93cb3843f01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:56:15.078468 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111553e6-012f-43de-9085-c93cb3843f01 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:56:15.088404 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4333/8641] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:56:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:56:15.092420 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b11ba-6919-471f-9f0f-299fc3b1be82 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:56:15.102587 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b11ba-6919-471f-9f0f-299fc3b1be82 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:56:15.107144 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28341be-8cbf-4d1a-a636-3e3cec7d13fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:56:15.108068 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28341be-8cbf-4d1a-a636-3e3cec7d13fe admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:56:15.108347 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28341be-8cbf-4d1a-a636-3e3cec7d13fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:56:15.108618 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28341be-8cbf-4d1a-a636-3e3cec7d13fe admin admin] PATH_INFO: `/v3/projects/9f801df18eb74b818c7ef4d2e10c576f/users/47332c347cf04b58b5857052c6468e6d/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:56:15.123469 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28341be-8cbf-4d1a-a636-3e3cec7d13fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f801df18eb74b818c7ef4d2e10c576f, user_id=47332c347cf04b58b5857052c6468e6d, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:56:15.127065 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28341be-8cbf-4d1a-a636-3e3cec7d13fe admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:56:15.206227 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4309/8642] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:56:15 2022] PUT /identity/v3/projects/9f801df18eb74b818c7ef4d2e10c576f/users/47332c347cf04b58b5857052c6468e6d/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:56:15.211416 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616e5d5-5cfb-426f-9b23-a912055a6901 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:56:15.211735 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616e5d5-5cfb-426f-9b23-a912055a6901 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:56:15.212018 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616e5d5-5cfb-426f-9b23-a912055a6901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:56:15.230049 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-c616e5d5-5cfb-426f-9b23-a912055a6901 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:56:15.233058 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c616e5d5-5cfb-426f-9b23-a912055a6901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:56:15.289246 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4334/8643] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:56:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:56:15.299898 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28341be-8cbf-4d1a-a636-3e3cec7d13fe admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:56:15.301660 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e28341be-8cbf-4d1a-a636-3e3cec7d13fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:56:15.359909 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28341be-8cbf-4d1a-a636-3e3cec7d13fe admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:56:15.363695 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abce5db-2ecc-4246-a3e6-742fe0bf8b44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:56:15.364371 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abce5db-2ecc-4246-a3e6-742fe0bf8b44 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:56:15.364655 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abce5db-2ecc-4246-a3e6-742fe0bf8b44 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:56:15.364932 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abce5db-2ecc-4246-a3e6-742fe0bf8b44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:56:15.373970 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abce5db-2ecc-4246-a3e6-742fe0bf8b44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:56:15.375626 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abce5db-2ecc-4246-a3e6-742fe0bf8b44 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:56:15.385157 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4310/8644] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:56:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:56:20.872179 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ea650-c457-4b3e-a2e4-3aed721ab0fa None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:56:20.872710 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ea650-c457-4b3e-a2e4-3aed721ab0fa None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:56:20.872843 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ea650-c457-4b3e-a2e4-3aed721ab0fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:56:20.901826 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-258ea650-c457-4b3e-a2e4-3aed721ab0fa None None] MFA Rules not processed for user `47332c347cf04b58b5857052c6468e6d`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:56:20.903416 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-258ea650-c457-4b3e-a2e4-3aed721ab0fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:56:20.976118 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4335/8645] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:56:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:56:20.980872 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abce5db-2ecc-4246-a3e6-742fe0bf8b44 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:56:20.991845 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abce5db-2ecc-4246-a3e6-742fe0bf8b44 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:56:20.996710 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd3300b-ad72-4e31-94fc-b5812be1986d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:56:20.997322 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd3300b-ad72-4e31-94fc-b5812be1986d admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:56:20.997607 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd3300b-ad72-4e31-94fc-b5812be1986d admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:56:20.998033 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd3300b-ad72-4e31-94fc-b5812be1986d admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:56:20.998809 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd3300b-ad72-4e31-94fc-b5812be1986d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:56:21.001386 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd3300b-ad72-4e31-94fc-b5812be1986d admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:56:21.115906 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4311/8646] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 21:56:20 2022] POST /identity/v3/projects => generated 379 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 21:56:21.117030 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258ea650-c457-4b3e-a2e4-3aed721ab0fa None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:56:21.128613 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258ea650-c457-4b3e-a2e4-3aed721ab0fa None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:56:21.214093 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7f7fab-74ff-436f-8c20-ab6d18d248a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:56:21.215121 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f7fab-74ff-436f-8c20-ab6d18d248a7 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:56:21.215528 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f7fab-74ff-436f-8c20-ab6d18d248a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:56:21.215878 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f7fab-74ff-436f-8c20-ab6d18d248a7 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:56:21.216977 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7f7fab-74ff-436f-8c20-ab6d18d248a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:56:21.220748 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7f7fab-74ff-436f-8c20-ab6d18d248a7 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:56:21.350554 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4336/8647] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 21:56:21 2022] POST /identity/v3/users => generated 296 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 21:56:21.354777 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd3300b-ad72-4e31-94fc-b5812be1986d admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:56:21.366492 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd3300b-ad72-4e31-94fc-b5812be1986d admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:56:21.371413 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0665a786-127a-4366-a7f9-0789ebbe076d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:56:21.372124 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0665a786-127a-4366-a7f9-0789ebbe076d admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:56:21.372412 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0665a786-127a-4366-a7f9-0789ebbe076d admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:56:21.372689 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0665a786-127a-4366-a7f9-0789ebbe076d admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:56:21.373473 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0665a786-127a-4366-a7f9-0789ebbe076d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:56:21.375691 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0665a786-127a-4366-a7f9-0789ebbe076d admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:56:21.387124 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4312/8648] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:56:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:56:21.392317 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7f7fab-74ff-436f-8c20-ab6d18d248a7 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:56:21.403016 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7f7fab-74ff-436f-8c20-ab6d18d248a7 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:56:21.408628 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a619e462-a38b-40c3-b8e9-b8765a3f50ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:56:21.409526 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a619e462-a38b-40c3-b8e9-b8765a3f50ec admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:56:21.409811 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a619e462-a38b-40c3-b8e9-b8765a3f50ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:56:21.410087 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a619e462-a38b-40c3-b8e9-b8765a3f50ec admin admin] PATH_INFO: `/v3/projects/321c9cab4b514acbbf4f85e413b9e4ae/users/13a9f1f9ff4748b79e17d59182a56761/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:56:21.426348 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a619e462-a38b-40c3-b8e9-b8765a3f50ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=321c9cab4b514acbbf4f85e413b9e4ae, user_id=13a9f1f9ff4748b79e17d59182a56761, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:56:21.429193 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a619e462-a38b-40c3-b8e9-b8765a3f50ec admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:56:21.522928 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4337/8649] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:56:21 2022] PUT /identity/v3/projects/321c9cab4b514acbbf4f85e413b9e4ae/users/13a9f1f9ff4748b79e17d59182a56761/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:56:21.526856 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0665a786-127a-4366-a7f9-0789ebbe076d admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:56:21.538133 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0665a786-127a-4366-a7f9-0789ebbe076d admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:56:21.598871 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad62aa3-f000-401c-8ce9-e5146ad8f079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:56:21.599590 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad62aa3-f000-401c-8ce9-e5146ad8f079 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:56:21.599882 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad62aa3-f000-401c-8ce9-e5146ad8f079 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:56:21.600157 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad62aa3-f000-401c-8ce9-e5146ad8f079 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:56:21.600885 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad62aa3-f000-401c-8ce9-e5146ad8f079 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:56:21.602501 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad62aa3-f000-401c-8ce9-e5146ad8f079 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:56:21.613814 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4313/8650] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:56:21 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 21:56:21.617876 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a619e462-a38b-40c3-b8e9-b8765a3f50ec admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:56:21.628947 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a619e462-a38b-40c3-b8e9-b8765a3f50ec admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:56:21.633885 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6122b632-00be-4b36-9c70-e6ae9424a084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:56:21.634790 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6122b632-00be-4b36-9c70-e6ae9424a084 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:56:21.635077 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6122b632-00be-4b36-9c70-e6ae9424a084 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:56:21.635359 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6122b632-00be-4b36-9c70-e6ae9424a084 admin admin] PATH_INFO: `/v3/projects/321c9cab4b514acbbf4f85e413b9e4ae/users/13a9f1f9ff4748b79e17d59182a56761/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:56:21.637403 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6122b632-00be-4b36-9c70-e6ae9424a084 admin admin] RBAC: Authorizing `identity:create_grant(project_id=321c9cab4b514acbbf4f85e413b9e4ae, user_id=13a9f1f9ff4748b79e17d59182a56761, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:56:21.640792 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6122b632-00be-4b36-9c70-e6ae9424a084 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:56:21.651844 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4338/8651] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 21:56:21 2022] PUT /identity/v3/projects/321c9cab4b514acbbf4f85e413b9e4ae/users/13a9f1f9ff4748b79e17d59182a56761/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 21:56:27.578823 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f6b16-f0dd-4eae-aa5f-c31e90622f40 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:56:27.579351 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f6b16-f0dd-4eae-aa5f-c31e90622f40 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:56:27.579547 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f6b16-f0dd-4eae-aa5f-c31e90622f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:56:27.609291 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-115f6b16-f0dd-4eae-aa5f-c31e90622f40 None None] MFA Rules not processed for user `13a9f1f9ff4748b79e17d59182a56761`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:56:27.610624 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-115f6b16-f0dd-4eae-aa5f-c31e90622f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:56:27.687398 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4314/8652] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:56:27 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:56:27.699603 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6122b632-00be-4b36-9c70-e6ae9424a084 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:56:27.701367 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-6122b632-00be-4b36-9c70-e6ae9424a084 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:56:27.817451 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6122b632-00be-4b36-9c70-e6ae9424a084 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:56:27.821411 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1ecd22-798e-4298-8842-d7f5b6983a19 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b5cb86f190f4fcfb06d66cb8f14643f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:56:27.822064 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ecd22-798e-4298-8842-d7f5b6983a19 service glance] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:56:27.822351 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ecd22-798e-4298-8842-d7f5b6983a19 service glance] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:56:27.822624 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ecd22-798e-4298-8842-d7f5b6983a19 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:56:27.883899 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1ecd22-798e-4298-8842-d7f5b6983a19 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:56:27.885904 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1ecd22-798e-4298-8842-d7f5b6983a19 service glance] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:56:27.896702 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4339/8653] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:56:27 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:56:36.658243 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9167da-7a30-4871-84cb-09eb13db10e9 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:56:36.658771 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9167da-7a30-4871-84cb-09eb13db10e9 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:56:36.658897 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9167da-7a30-4871-84cb-09eb13db10e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:56:36.676715 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-ec9167da-7a30-4871-84cb-09eb13db10e9 None None] MFA Rules not processed for user `47332c347cf04b58b5857052c6468e6d`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:56:36.677906 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-ec9167da-7a30-4871-84cb-09eb13db10e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:56:36.684825 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4315/8654] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:56:36 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:56:36.963563 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1ecd22-798e-4298-8842-d7f5b6983a19 service glance] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:56:37.021072 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1ecd22-798e-4298-8842-d7f5b6983a19 service glance] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:56:37.024644 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dd8e3e-a1fa-4bf6-bafe-d89575117f8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:56:37.025292 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dd8e3e-a1fa-4bf6-bafe-d89575117f8a service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:56:37.025579 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dd8e3e-a1fa-4bf6-bafe-d89575117f8a service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:56:37.025859 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dd8e3e-a1fa-4bf6-bafe-d89575117f8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:56:37.027652 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-16dd8e3e-a1fa-4bf6-bafe-d89575117f8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:56:37.039869 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dd8e3e-a1fa-4bf6-bafe-d89575117f8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:56:37.041290 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dd8e3e-a1fa-4bf6-bafe-d89575117f8a service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:56:37.051824 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4340/8655] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:56:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:56:39.848227 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9167da-7a30-4871-84cb-09eb13db10e9 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:56:39.849681 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-ec9167da-7a30-4871-84cb-09eb13db10e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:56:39.925145 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9167da-7a30-4871-84cb-09eb13db10e9 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:56:39.930868 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae0b391-4828-450b-9a76-716ca3047827 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:56:39.931261 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0b391-4828-450b-9a76-716ca3047827 service placement] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:56:39.931573 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0b391-4828-450b-9a76-716ca3047827 service placement] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:56:39.931849 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0b391-4828-450b-9a76-716ca3047827 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:56:39.933659 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-dae0b391-4828-450b-9a76-716ca3047827 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:56:39.949238 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae0b391-4828-450b-9a76-716ca3047827 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:56:39.950835 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae0b391-4828-450b-9a76-716ca3047827 service placement] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:56:39.964740 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4316/8656] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:56:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:56:55.794124 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dd8e3e-a1fa-4bf6-bafe-d89575117f8a service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:56:55.795678 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-16dd8e3e-a1fa-4bf6-bafe-d89575117f8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:56:55.870211 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dd8e3e-a1fa-4bf6-bafe-d89575117f8a service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:56:55.876301 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83036954-472a-4576-a7ba-6072d6608782 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:56:55.876954 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83036954-472a-4576-a7ba-6072d6608782 service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:56:55.877238 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83036954-472a-4576-a7ba-6072d6608782 service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:56:55.877515 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83036954-472a-4576-a7ba-6072d6608782 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:56:55.879298 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-83036954-472a-4576-a7ba-6072d6608782 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:56:55.900618 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83036954-472a-4576-a7ba-6072d6608782 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:56:55.903902 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83036954-472a-4576-a7ba-6072d6608782 service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:56:55.919249 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4341/8657] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:56:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:57:41.087414 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae0b391-4828-450b-9a76-716ca3047827 service placement] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:57:41.099586 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae0b391-4828-450b-9a76-716ca3047827 service placement] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:57:41.103390 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ec16a2-40d9-4245-81b9-24824f0f0e72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:57:41.104116 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec16a2-40d9-4245-81b9-24824f0f0e72 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:57:41.104400 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec16a2-40d9-4245-81b9-24824f0f0e72 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:57:41.104672 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec16a2-40d9-4245-81b9-24824f0f0e72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:57:41.107129 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-d7ec16a2-40d9-4245-81b9-24824f0f0e72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:57:41.124012 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ec16a2-40d9-4245-81b9-24824f0f0e72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:57:41.125430 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ec16a2-40d9-4245-81b9-24824f0f0e72 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:57:41.139069 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4317/8658] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:57:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:58:05.507783 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b57d9d-c867-433b-80ba-84dfa7114409 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:58:05.508363 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b57d9d-c867-433b-80ba-84dfa7114409 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:58:05.508363 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b57d9d-c867-433b-80ba-84dfa7114409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:58:05.525528 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-d0b57d9d-c867-433b-80ba-84dfa7114409 None None] MFA Rules not processed for user `47332c347cf04b58b5857052c6468e6d`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:58:05.527874 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d0b57d9d-c867-433b-80ba-84dfa7114409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:58:05.534061 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4342/8659] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:58:05 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 21:58:19.477970 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64858621-f9fb-4a5a-b7e3-67cc82988eef None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:58:19.478445 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64858621-f9fb-4a5a-b7e3-67cc82988eef None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:58:19.478563 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64858621-f9fb-4a5a-b7e3-67cc82988eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:58:19.536449 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-64858621-f9fb-4a5a-b7e3-67cc82988eef None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:58:19.537660 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-64858621-f9fb-4a5a-b7e3-67cc82988eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:58:19.599905 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4318/8660] 10.222.0.52 () {58 vars in 1009 bytes} [Sat May 14 21:58:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:58:19.741396 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b57d9d-c867-433b-80ba-84dfa7114409 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:58:19.742914 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d0b57d9d-c867-433b-80ba-84dfa7114409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:58:19.838552 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b57d9d-c867-433b-80ba-84dfa7114409 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:58:19.843778 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a4cf52-fe4a-4ff2-8c37-a1f0caaab089 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:58:19.844422 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a4cf52-fe4a-4ff2-8c37-a1f0caaab089 service swift] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:58:19.844708 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a4cf52-fe4a-4ff2-8c37-a1f0caaab089 service swift] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:58:19.844987 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a4cf52-fe4a-4ff2-8c37-a1f0caaab089 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:58:19.853075 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a4cf52-fe4a-4ff2-8c37-a1f0caaab089 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:58:19.854661 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a4cf52-fe4a-4ff2-8c37-a1f0caaab089 service swift] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:58:19.863382 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4343/8661] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 21:58:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 21:58:21.309241 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331aa0d-bccf-4a7b-bb8a-16c42cc1ad67 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:58:21.309754 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331aa0d-bccf-4a7b-bb8a-16c42cc1ad67 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:58:21.309862 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331aa0d-bccf-4a7b-bb8a-16c42cc1ad67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:58:21.327209 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-7331aa0d-bccf-4a7b-bb8a-16c42cc1ad67 None None] MFA Rules not processed for user `47332c347cf04b58b5857052c6468e6d`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:58:21.328925 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-7331aa0d-bccf-4a7b-bb8a-16c42cc1ad67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:58:21.335748 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4319/8662] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:58:21 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:58:24.836432 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a4cf52-fe4a-4ff2-8c37-a1f0caaab089 service swift] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:58:24.860742 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a4cf52-fe4a-4ff2-8c37-a1f0caaab089 service swift] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:58:24.864716 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5ca2b1-0a00-4c48-91be-fa62d8eb3900 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:58:24.865356 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5ca2b1-0a00-4c48-91be-fa62d8eb3900 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:58:24.865636 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5ca2b1-0a00-4c48-91be-fa62d8eb3900 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:58:24.865908 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5ca2b1-0a00-4c48-91be-fa62d8eb3900 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:58:24.867779 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ad5ca2b1-0a00-4c48-91be-fa62d8eb3900 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:58:24.880846 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5ca2b1-0a00-4c48-91be-fa62d8eb3900 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:58:24.882346 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5ca2b1-0a00-4c48-91be-fa62d8eb3900 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:58:24.894587 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4344/8663] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:58:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:58:44.082270 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bcc701-0d89-419a-96a2-11df69c74bc2 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:58:44.082844 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bcc701-0d89-419a-96a2-11df69c74bc2 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:58:44.082844 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bcc701-0d89-419a-96a2-11df69c74bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:58:44.119366 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-12bcc701-0d89-419a-96a2-11df69c74bc2 None None] MFA Rules not processed for user `99ed32a6d699453bb7e088540e8fc980`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:58:44.120756 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-12bcc701-0d89-419a-96a2-11df69c74bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:58:44.127997 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4320/8664] 10.222.0.52 () {58 vars in 1061 bytes} [Sat May 14 21:58:44 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:58:44.134031 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5ca2b1-0a00-4c48-91be-fa62d8eb3900 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:58:44.143243 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5ca2b1-0a00-4c48-91be-fa62d8eb3900 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:58:44.147242 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b97b4-2793-41df-95eb-5406484605f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:58:44.147902 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b97b4-2793-41df-95eb-5406484605f7 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:58:44.148189 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b97b4-2793-41df-95eb-5406484605f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:58:44.148468 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b97b4-2793-41df-95eb-5406484605f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:58:44.150214 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-c42b97b4-2793-41df-95eb-5406484605f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:58:44.163040 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42b97b4-2793-41df-95eb-5406484605f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:58:44.164565 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42b97b4-2793-41df-95eb-5406484605f7 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:58:44.175911 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4345/8665] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:58:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:59:25.166097 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bcc701-0d89-419a-96a2-11df69c74bc2 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:59:25.183576 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bcc701-0d89-419a-96a2-11df69c74bc2 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:59:25.189391 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f69aa93-2d08-40a6-aaa3-3e252b53f8c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:59:25.190090 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69aa93-2d08-40a6-aaa3-3e252b53f8c3 service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:59:25.190376 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69aa93-2d08-40a6-aaa3-3e252b53f8c3 service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:59:25.190653 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69aa93-2d08-40a6-aaa3-3e252b53f8c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:59:25.192506 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-4f69aa93-2d08-40a6-aaa3-3e252b53f8c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:59:25.208161 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f69aa93-2d08-40a6-aaa3-3e252b53f8c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:59:25.209765 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f69aa93-2d08-40a6-aaa3-3e252b53f8c3 service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:59:25.223570 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4321/8666] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:59:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:59:32.727618 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe2492-d9ee-4f39-9ea8-4a066fc4cd13 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:59:32.728141 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe2492-d9ee-4f39-9ea8-4a066fc4cd13 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:59:32.728256 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe2492-d9ee-4f39-9ea8-4a066fc4cd13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:59:32.745463 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-fbbe2492-d9ee-4f39-9ea8-4a066fc4cd13 None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:59:32.746636 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-fbbe2492-d9ee-4f39-9ea8-4a066fc4cd13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:59:32.753667 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4346/8667] 10.222.0.52 () {58 vars in 967 bytes} [Sat May 14 21:59:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:59:32.927953 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f69aa93-2d08-40a6-aaa3-3e252b53f8c3 service nova] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:59:32.941924 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f69aa93-2d08-40a6-aaa3-3e252b53f8c3 service nova] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:59:32.947870 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3fee52-8993-4b00-9faa-3f735e75661d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:59:32.948515 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3fee52-8993-4b00-9faa-3f735e75661d service swift] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:59:32.948801 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3fee52-8993-4b00-9faa-3f735e75661d service swift] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:59:32.949077 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3fee52-8993-4b00-9faa-3f735e75661d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:59:32.957455 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3fee52-8993-4b00-9faa-3f735e75661d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:59:32.959077 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3fee52-8993-4b00-9faa-3f735e75661d service swift] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:59:32.967975 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4322/8668] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 21:59:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 21:59:40.840433 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a682781-809a-472b-9fb3-7f88b8a07f4d None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:59:40.840960 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a682781-809a-472b-9fb3-7f88b8a07f4d None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:59:40.841076 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a682781-809a-472b-9fb3-7f88b8a07f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:59:40.858419 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-4a682781-809a-472b-9fb3-7f88b8a07f4d None None] MFA Rules not processed for user `47332c347cf04b58b5857052c6468e6d`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:59:40.864036 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-4a682781-809a-472b-9fb3-7f88b8a07f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:59:40.867085 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4347/8669] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 21:59:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:59:41.861936 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa14099-1362-4b4d-a507-d4588938a473 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:59:41.862383 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa14099-1362-4b4d-a507-d4588938a473 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:59:41.862507 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa14099-1362-4b4d-a507-d4588938a473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:59:41.899734 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-aaa14099-1362-4b4d-a507-d4588938a473 None None] MFA Rules not processed for user `0812ae67e44d483baf2dbb1a5332a1d7`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 21:59:41.900969 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-aaa14099-1362-4b4d-a507-d4588938a473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:59:41.921470 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4323/8670] 10.222.0.52 () {58 vars in 1018 bytes} [Sat May 14 21:59:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 21:59:41.933530 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a682781-809a-472b-9fb3-7f88b8a07f4d None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:59:41.934917 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-4a682781-809a-472b-9fb3-7f88b8a07f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 21:59:41.952870 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a682781-809a-472b-9fb3-7f88b8a07f4d None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:59:41.958184 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933bcd88-70ff-4d33-9f02-58915d9c58e7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:59:41.963438 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933bcd88-70ff-4d33-9f02-58915d9c58e7 service placement] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:59:41.963438 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933bcd88-70ff-4d33-9f02-58915d9c58e7 service placement] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:59:41.963438 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933bcd88-70ff-4d33-9f02-58915d9c58e7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:59:41.969361 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933bcd88-70ff-4d33-9f02-58915d9c58e7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:59:41.970924 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933bcd88-70ff-4d33-9f02-58915d9c58e7 service placement] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:59:41.981048 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4348/8671] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:59:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 21:59:55.088450 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa14099-1362-4b4d-a507-d4588938a473 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 21:59:55.097539 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa14099-1362-4b4d-a507-d4588938a473 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 21:59:55.101632 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba0eca0-0c07-4de0-a346-cf0fdf51d507 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 21:59:55.102298 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba0eca0-0c07-4de0-a346-cf0fdf51d507 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 21:59:55.102585 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba0eca0-0c07-4de0-a346-cf0fdf51d507 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 21:59:55.102867 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba0eca0-0c07-4de0-a346-cf0fdf51d507 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 21:59:55.111954 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba0eca0-0c07-4de0-a346-cf0fdf51d507 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 21:59:55.113390 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba0eca0-0c07-4de0-a346-cf0fdf51d507 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 21:59:55.123307 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4324/8672] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 21:59:55 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:00:05.121966 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933bcd88-70ff-4d33-9f02-58915d9c58e7 service placement] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:00:05.139381 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933bcd88-70ff-4d33-9f02-58915d9c58e7 service placement] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:00:05.147225 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3406dc61-0cf9-46e3-a559-2f6288113266 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:00:05.147941 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406dc61-0cf9-46e3-a559-2f6288113266 service placement] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:00:05.148221 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406dc61-0cf9-46e3-a559-2f6288113266 service placement] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:00:05.148493 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406dc61-0cf9-46e3-a559-2f6288113266 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:00:05.150506 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-3406dc61-0cf9-46e3-a559-2f6288113266 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:00:05.168053 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3406dc61-0cf9-46e3-a559-2f6288113266 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:00:05.169686 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3406dc61-0cf9-46e3-a559-2f6288113266 service placement] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:00:05.185310 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4349/8673] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:00:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:00:05.793843 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba0eca0-0c07-4de0-a346-cf0fdf51d507 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:00:05.809540 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba0eca0-0c07-4de0-a346-cf0fdf51d507 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:00:05.814842 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f971dcb-d7f5-4530-a936-f86e87c890f3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:00:05.815554 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f971dcb-d7f5-4530-a936-f86e87c890f3 service placement] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:00:05.815840 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f971dcb-d7f5-4530-a936-f86e87c890f3 service placement] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:00:05.816119 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f971dcb-d7f5-4530-a936-f86e87c890f3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:00:05.818055 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-2f971dcb-d7f5-4530-a936-f86e87c890f3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:00:05.832372 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f971dcb-d7f5-4530-a936-f86e87c890f3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:00:05.834452 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f971dcb-d7f5-4530-a936-f86e87c890f3 service placement] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:00:05.847383 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4325/8674] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:00:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:03:15.143041 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3406dc61-0cf9-46e3-a559-2f6288113266 service placement] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:03:15.205814 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3406dc61-0cf9-46e3-a559-2f6288113266 service placement] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:03:15.211683 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a1f79e-9689-4fca-bd43-3b13cf85a59b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:03:15.212353 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1f79e-9689-4fca-bd43-3b13cf85a59b service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:03:15.212623 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1f79e-9689-4fca-bd43-3b13cf85a59b service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:03:15.212905 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1f79e-9689-4fca-bd43-3b13cf85a59b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:03:15.220916 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a1f79e-9689-4fca-bd43-3b13cf85a59b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:03:15.222505 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a1f79e-9689-4fca-bd43-3b13cf85a59b service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:03:15.231370 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4350/8675] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:03:15 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:03:17.411887 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f971dcb-d7f5-4530-a936-f86e87c890f3 service placement] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:03:17.460179 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f971dcb-d7f5-4530-a936-f86e87c890f3 service placement] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:03:17.465995 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb26a761-fb73-41dd-9eb4-6729bbf81a7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:03:17.466665 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb26a761-fb73-41dd-9eb4-6729bbf81a7b service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:03:17.467698 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb26a761-fb73-41dd-9eb4-6729bbf81a7b service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:03:17.467983 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb26a761-fb73-41dd-9eb4-6729bbf81a7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:03:17.470005 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-cb26a761-fb73-41dd-9eb4-6729bbf81a7b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:03:17.495969 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb26a761-fb73-41dd-9eb4-6729bbf81a7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:03:17.497521 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb26a761-fb73-41dd-9eb4-6729bbf81a7b service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:03:17.515167 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4326/8676] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:03:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:03:17.603957 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a1f79e-9689-4fca-bd43-3b13cf85a59b service nova] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:03:17.613952 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a1f79e-9689-4fca-bd43-3b13cf85a59b service nova] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:03:17.619116 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f257a5b-0780-4da1-a092-a06598137504 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:03:17.619116 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f257a5b-0780-4da1-a092-a06598137504 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:03:17.619431 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f257a5b-0780-4da1-a092-a06598137504 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:03:17.619567 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f257a5b-0780-4da1-a092-a06598137504 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:03:17.633576 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f257a5b-0780-4da1-a092-a06598137504 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:03:17.635048 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f257a5b-0780-4da1-a092-a06598137504 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:03:17.649740 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4351/8677] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:03:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:03:29.252015 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c422662-3254-4c10-9eb4-01635fdff4ce None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:03:29.252826 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c422662-3254-4c10-9eb4-01635fdff4ce None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:03:29.252826 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c422662-3254-4c10-9eb4-01635fdff4ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:03:29.283891 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-7c422662-3254-4c10-9eb4-01635fdff4ce None None] MFA Rules not processed for user `99ed32a6d699453bb7e088540e8fc980`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:03:29.285086 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-7c422662-3254-4c10-9eb4-01635fdff4ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:03:29.291691 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4327/8678] 10.222.0.52 () {58 vars in 1061 bytes} [Sat May 14 22:03:29 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:03:29.297968 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f257a5b-0780-4da1-a092-a06598137504 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:03:29.307137 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f257a5b-0780-4da1-a092-a06598137504 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:03:29.311282 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cd3b34-382f-4266-9fb9-dcf17f4c06e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:03:29.311954 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd3b34-382f-4266-9fb9-dcf17f4c06e2 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:03:29.312238 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd3b34-382f-4266-9fb9-dcf17f4c06e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:03:29.312516 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd3b34-382f-4266-9fb9-dcf17f4c06e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:03:29.374073 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cd3b34-382f-4266-9fb9-dcf17f4c06e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:03:29.375595 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cd3b34-382f-4266-9fb9-dcf17f4c06e2 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:03:29.394824 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4352/8679] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:03:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:03:36.780260 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c422662-3254-4c10-9eb4-01635fdff4ce None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:03:36.793695 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c422662-3254-4c10-9eb4-01635fdff4ce None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:03:36.797207 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433bb6b2-3e20-4ad1-8ef5-1115badc2a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:03:36.798075 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433bb6b2-3e20-4ad1-8ef5-1115badc2a51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:03:36.798361 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433bb6b2-3e20-4ad1-8ef5-1115badc2a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:03:36.799884 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433bb6b2-3e20-4ad1-8ef5-1115badc2a51 admin admin] PATH_INFO: `/v3/users/47332c347cf04b58b5857052c6468e6d` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:03:36.800917 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433bb6b2-3e20-4ad1-8ef5-1115badc2a51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47332c347cf04b58b5857052c6468e6d)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:03:36.802860 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433bb6b2-3e20-4ad1-8ef5-1115badc2a51 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:03:36.986898 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-433bb6b2-3e20-4ad1-8ef5-1115badc2a51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47332c347cf04b58b5857052c6468e6d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:03:36.993737 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-433bb6b2-3e20-4ad1-8ef5-1115badc2a51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47332c347cf04b58b5857052c6468e6d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:03:36.994417 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-433bb6b2-3e20-4ad1-8ef5-1115badc2a51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47332c347cf04b58b5857052c6468e6d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:03:37.075626 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-433bb6b2-3e20-4ad1-8ef5-1115badc2a51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47332c347cf04b58b5857052c6468e6d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:03:37.088099 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-433bb6b2-3e20-4ad1-8ef5-1115badc2a51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47332c347cf04b58b5857052c6468e6d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:03:37.093971 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4328/8680] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 22:03:36 2022] DELETE /identity/v3/users/47332c347cf04b58b5857052c6468e6d => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 22:03:37.317847 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cd3b34-382f-4266-9fb9-dcf17f4c06e2 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:03:37.328372 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cd3b34-382f-4266-9fb9-dcf17f4c06e2 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:03:37.391424 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c67db6-29a9-4c3f-9dff-9bb856fd3da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:03:37.392891 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c67db6-29a9-4c3f-9dff-9bb856fd3da4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:03:37.393183 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c67db6-29a9-4c3f-9dff-9bb856fd3da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:03:37.393488 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c67db6-29a9-4c3f-9dff-9bb856fd3da4 admin admin] PATH_INFO: `/v3/projects/9f801df18eb74b818c7ef4d2e10c576f` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:03:37.394715 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c67db6-29a9-4c3f-9dff-9bb856fd3da4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f801df18eb74b818c7ef4d2e10c576f)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:03:37.396737 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c67db6-29a9-4c3f-9dff-9bb856fd3da4 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:03:37.504056 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-80c67db6-29a9-4c3f-9dff-9bb856fd3da4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f801df18eb74b818c7ef4d2e10c576f', 'request_id': 'req-80c67db6-29a9-4c3f-9dff-9bb856fd3da4'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:03:37.509447 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-80c67db6-29a9-4c3f-9dff-9bb856fd3da4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f801df18eb74b818c7ef4d2e10c576f', 'request_id': 'req-80c67db6-29a9-4c3f-9dff-9bb856fd3da4'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:03:37.583820 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-80c67db6-29a9-4c3f-9dff-9bb856fd3da4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f801df18eb74b818c7ef4d2e10c576f', 'request_id': 'req-80c67db6-29a9-4c3f-9dff-9bb856fd3da4'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:03:37.595437 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-80c67db6-29a9-4c3f-9dff-9bb856fd3da4 admin admin] The token cache is being invalidate because project 9f801df18eb74b818c7ef4d2e10c576f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 22:03:37.596531 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-80c67db6-29a9-4c3f-9dff-9bb856fd3da4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:03:37.597198 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-80c67db6-29a9-4c3f-9dff-9bb856fd3da4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:03:37.598764 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4353/8681] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 22:03:37 2022] DELETE /identity/v3/projects/9f801df18eb74b818c7ef4d2e10c576f => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 22:03:37.602744 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433bb6b2-3e20-4ad1-8ef5-1115badc2a51 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:03:37.604178 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-433bb6b2-3e20-4ad1-8ef5-1115badc2a51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:03:37.617317 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433bb6b2-3e20-4ad1-8ef5-1115badc2a51 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:03:37.674170 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7a0b58-7016-43b5-8439-552e894002e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:03:37.675158 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a0b58-7016-43b5-8439-552e894002e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:03:37.675447 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a0b58-7016-43b5-8439-552e894002e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:03:37.675762 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a0b58-7016-43b5-8439-552e894002e0 admin admin] PATH_INFO: `/v3/users/13a9f1f9ff4748b79e17d59182a56761` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:03:37.676978 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7a0b58-7016-43b5-8439-552e894002e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13a9f1f9ff4748b79e17d59182a56761)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:03:37.678904 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7a0b58-7016-43b5-8439-552e894002e0 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:03:37.820307 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dc7a0b58-7016-43b5-8439-552e894002e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13a9f1f9ff4748b79e17d59182a56761'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:03:37.826924 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dc7a0b58-7016-43b5-8439-552e894002e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13a9f1f9ff4748b79e17d59182a56761'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:03:37.827638 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dc7a0b58-7016-43b5-8439-552e894002e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13a9f1f9ff4748b79e17d59182a56761'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:03:37.880603 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dc7a0b58-7016-43b5-8439-552e894002e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13a9f1f9ff4748b79e17d59182a56761'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:03:37.892921 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dc7a0b58-7016-43b5-8439-552e894002e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13a9f1f9ff4748b79e17d59182a56761'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:03:37.899148 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4329/8682] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 22:03:37 2022] DELETE /identity/v3/users/13a9f1f9ff4748b79e17d59182a56761 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 22:03:38.139751 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c67db6-29a9-4c3f-9dff-9bb856fd3da4 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:03:38.141336 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-80c67db6-29a9-4c3f-9dff-9bb856fd3da4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:03:38.157266 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c67db6-29a9-4c3f-9dff-9bb856fd3da4 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:03:38.214346 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17611a2-9aab-43fd-9da8-c811e84b7358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:03:38.215237 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17611a2-9aab-43fd-9da8-c811e84b7358 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:03:38.215555 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17611a2-9aab-43fd-9da8-c811e84b7358 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:03:38.215841 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17611a2-9aab-43fd-9da8-c811e84b7358 admin admin] PATH_INFO: `/v3/projects/321c9cab4b514acbbf4f85e413b9e4ae` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:03:38.217027 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17611a2-9aab-43fd-9da8-c811e84b7358 admin admin] RBAC: Authorizing `identity:delete_project(project_id=321c9cab4b514acbbf4f85e413b9e4ae)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:03:38.218975 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17611a2-9aab-43fd-9da8-c811e84b7358 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:03:38.320667 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e17611a2-9aab-43fd-9da8-c811e84b7358 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '321c9cab4b514acbbf4f85e413b9e4ae', 'request_id': 'req-e17611a2-9aab-43fd-9da8-c811e84b7358'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:03:38.325911 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e17611a2-9aab-43fd-9da8-c811e84b7358 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '321c9cab4b514acbbf4f85e413b9e4ae', 'request_id': 'req-e17611a2-9aab-43fd-9da8-c811e84b7358'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:03:38.383618 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e17611a2-9aab-43fd-9da8-c811e84b7358 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '321c9cab4b514acbbf4f85e413b9e4ae', 'request_id': 'req-e17611a2-9aab-43fd-9da8-c811e84b7358'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:03:38.394840 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e17611a2-9aab-43fd-9da8-c811e84b7358 admin admin] The token cache is being invalidate because project 321c9cab4b514acbbf4f85e413b9e4ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 22:03:38.395127 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e17611a2-9aab-43fd-9da8-c811e84b7358 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:03:38.395779 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e17611a2-9aab-43fd-9da8-c811e84b7358 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:03:38.397574 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4354/8683] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 22:03:38 2022] DELETE /identity/v3/projects/321c9cab4b514acbbf4f85e413b9e4ae => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 22:03:48.620346 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceac783-cfb7-49dd-9c30-33d3d333c9f9 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:03:48.620981 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceac783-cfb7-49dd-9c30-33d3d333c9f9 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:03:48.620981 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceac783-cfb7-49dd-9c30-33d3d333c9f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:03:48.640356 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-3ceac783-cfb7-49dd-9c30-33d3d333c9f9 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:03:48.641605 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-3ceac783-cfb7-49dd-9c30-33d3d333c9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:03:48.699884 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4330/8684] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 22:03:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:03:48.710808 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df481e-5f22-4172-98e4-e35bb01ed4c7 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:03:48.711322 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df481e-5f22-4172-98e4-e35bb01ed4c7 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:03:48.711431 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df481e-5f22-4172-98e4-e35bb01ed4c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:03:48.730149 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-27df481e-5f22-4172-98e4-e35bb01ed4c7 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:03:48.731351 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-27df481e-5f22-4172-98e4-e35bb01ed4c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:03:48.739375 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4355/8685] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 22:03:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:03:48.744039 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceac783-cfb7-49dd-9c30-33d3d333c9f9 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:03:48.753709 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceac783-cfb7-49dd-9c30-33d3d333c9f9 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:03:48.758197 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e03b3e0-37db-431c-930f-4266a680f303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:03:48.758844 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e03b3e0-37db-431c-930f-4266a680f303 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:03:48.759122 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e03b3e0-37db-431c-930f-4266a680f303 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:03:48.759395 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e03b3e0-37db-431c-930f-4266a680f303 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:03:48.760134 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e03b3e0-37db-431c-930f-4266a680f303 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 22:03:48.760434 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e03b3e0-37db-431c-930f-4266a680f303 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:03:48.762029 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e03b3e0-37db-431c-930f-4266a680f303 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:03:48.773839 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4331/8686] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 22:03:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 22:03:48.789386 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27df481e-5f22-4172-98e4-e35bb01ed4c7 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:03:48.798740 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27df481e-5f22-4172-98e4-e35bb01ed4c7 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:03:48.803712 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb7bbbd-f239-4953-885e-5a3995ed8a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:03:48.804371 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb7bbbd-f239-4953-885e-5a3995ed8a00 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:03:48.804726 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb7bbbd-f239-4953-885e-5a3995ed8a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:03:48.805013 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb7bbbd-f239-4953-885e-5a3995ed8a00 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:03:48.805704 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb7bbbd-f239-4953-885e-5a3995ed8a00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:03:48.807644 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb7bbbd-f239-4953-885e-5a3995ed8a00 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:03:48.940367 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4356/8687] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 22:03:48 2022] POST /identity/v3/projects => generated 393 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 22:03:48.950551 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e03b3e0-37db-431c-930f-4266a680f303 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:03:48.961557 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e03b3e0-37db-431c-930f-4266a680f303 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:03:49.014914 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaad179-2ab9-42db-a7a1-995238babb0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:03:49.015621 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaad179-2ab9-42db-a7a1-995238babb0b admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:03:49.015896 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaad179-2ab9-42db-a7a1-995238babb0b admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:03:49.016182 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaad179-2ab9-42db-a7a1-995238babb0b admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:03:49.016869 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaad179-2ab9-42db-a7a1-995238babb0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:03:49.019391 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaad179-2ab9-42db-a7a1-995238babb0b admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:03:49.097883 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4332/8688] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 22:03:48 2022] POST /identity/v3/users => generated 297 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 22:03:49.101944 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb7bbbd-f239-4953-885e-5a3995ed8a00 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:03:49.112784 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb7bbbd-f239-4953-885e-5a3995ed8a00 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:03:49.117464 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410f8730-b99f-48d5-91f0-540ef0a09ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:03:49.118112 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f8730-b99f-48d5-91f0-540ef0a09ae4 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:03:49.118391 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f8730-b99f-48d5-91f0-540ef0a09ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:03:49.118662 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f8730-b99f-48d5-91f0-540ef0a09ae4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:03:49.119370 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410f8730-b99f-48d5-91f0-540ef0a09ae4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:03:49.120983 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410f8730-b99f-48d5-91f0-540ef0a09ae4 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:03:49.131384 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4357/8689] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 22:03:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 22:03:49.135378 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaad179-2ab9-42db-a7a1-995238babb0b admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:03:49.145893 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaad179-2ab9-42db-a7a1-995238babb0b admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:03:49.150704 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d976ca3-4d93-46ab-b5c2-6dec4cf0395e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:03:49.151365 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d976ca3-4d93-46ab-b5c2-6dec4cf0395e admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:03:49.151708 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d976ca3-4d93-46ab-b5c2-6dec4cf0395e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:03:49.151989 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d976ca3-4d93-46ab-b5c2-6dec4cf0395e admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:03:49.152707 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d976ca3-4d93-46ab-b5c2-6dec4cf0395e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:03:49.154311 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d976ca3-4d93-46ab-b5c2-6dec4cf0395e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:03:49.165173 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4333/8690] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 22:03:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 22:03:49.169122 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410f8730-b99f-48d5-91f0-540ef0a09ae4 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:03:49.179612 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410f8730-b99f-48d5-91f0-540ef0a09ae4 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:03:49.184275 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac4af35-534f-476b-ba7d-bfa50f8067c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:03:49.185084 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4af35-534f-476b-ba7d-bfa50f8067c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:03:49.185368 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4af35-534f-476b-ba7d-bfa50f8067c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:03:49.185642 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4af35-534f-476b-ba7d-bfa50f8067c6 admin admin] PATH_INFO: `/v3/projects/fda412b109db40e2b861ef03652db7f4/users/82caa36fc4a3474caea54e96899d0193/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:03:49.200225 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac4af35-534f-476b-ba7d-bfa50f8067c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fda412b109db40e2b861ef03652db7f4, user_id=82caa36fc4a3474caea54e96899d0193, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:03:49.202979 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac4af35-534f-476b-ba7d-bfa50f8067c6 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:03:49.279433 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4358/8691] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 22:03:49 2022] PUT /identity/v3/projects/fda412b109db40e2b861ef03652db7f4/users/82caa36fc4a3474caea54e96899d0193/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 22:03:49.291648 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc41f6fe-5698-45e7-83d3-410b104fc9f4 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:03:49.291939 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc41f6fe-5698-45e7-83d3-410b104fc9f4 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:03:49.292218 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc41f6fe-5698-45e7-83d3-410b104fc9f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:03:49.319231 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-cc41f6fe-5698-45e7-83d3-410b104fc9f4 None None] MFA Rules not processed for user `82caa36fc4a3474caea54e96899d0193`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:03:49.320457 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-cc41f6fe-5698-45e7-83d3-410b104fc9f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:03:49.383279 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4334/8692] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 22:03:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:03:49.387896 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac4af35-534f-476b-ba7d-bfa50f8067c6 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:03:49.451257 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac4af35-534f-476b-ba7d-bfa50f8067c6 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:03:49.456846 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bfce48-22fd-4077-834d-04ad6b674fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:03:49.457498 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bfce48-22fd-4077-834d-04ad6b674fbc admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:03:49.457784 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bfce48-22fd-4077-834d-04ad6b674fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:03:49.458063 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bfce48-22fd-4077-834d-04ad6b674fbc admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:03:49.458738 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bfce48-22fd-4077-834d-04ad6b674fbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:03:49.460664 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bfce48-22fd-4077-834d-04ad6b674fbc admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:03:49.579064 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4359/8693] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 22:03:49 2022] POST /identity/v3/projects => generated 393 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 22:03:49.584067 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc41f6fe-5698-45e7-83d3-410b104fc9f4 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:03:49.594677 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc41f6fe-5698-45e7-83d3-410b104fc9f4 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:03:49.649061 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0acc5e-f89f-4e5a-9e72-de8d6fe5e5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:03:49.649790 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0acc5e-f89f-4e5a-9e72-de8d6fe5e5f8 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:03:49.649991 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0acc5e-f89f-4e5a-9e72-de8d6fe5e5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:03:49.650263 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0acc5e-f89f-4e5a-9e72-de8d6fe5e5f8 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:03:49.650943 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0acc5e-f89f-4e5a-9e72-de8d6fe5e5f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:03:49.652886 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0acc5e-f89f-4e5a-9e72-de8d6fe5e5f8 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:03:49.743121 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4335/8694] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 22:03:49 2022] POST /identity/v3/users => generated 303 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 22:03:49.747255 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bfce48-22fd-4077-834d-04ad6b674fbc admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:03:49.758480 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bfce48-22fd-4077-834d-04ad6b674fbc admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:03:49.763175 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2e2941-0e12-4563-9e57-6cb199d5e7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:03:49.763856 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2e2941-0e12-4563-9e57-6cb199d5e7f1 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:03:49.769053 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2e2941-0e12-4563-9e57-6cb199d5e7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:03:49.769053 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2e2941-0e12-4563-9e57-6cb199d5e7f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:03:49.769053 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2e2941-0e12-4563-9e57-6cb199d5e7f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:03:49.769053 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2e2941-0e12-4563-9e57-6cb199d5e7f1 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:03:49.779002 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4360/8695] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 22:03:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 22:03:49.783699 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0acc5e-f89f-4e5a-9e72-de8d6fe5e5f8 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:03:49.794246 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0acc5e-f89f-4e5a-9e72-de8d6fe5e5f8 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:03:49.798880 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37067af7-59a1-49a6-b906-688585b01bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:03:49.799824 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37067af7-59a1-49a6-b906-688585b01bfd admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:03:49.800102 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37067af7-59a1-49a6-b906-688585b01bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:03:49.800373 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37067af7-59a1-49a6-b906-688585b01bfd admin admin] PATH_INFO: `/v3/projects/9bf3acbbe0574df19e22452dabf68f0f/users/3dcfc0c990cf43ca92bf65d12775c757/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:03:49.815289 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37067af7-59a1-49a6-b906-688585b01bfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bf3acbbe0574df19e22452dabf68f0f, user_id=3dcfc0c990cf43ca92bf65d12775c757, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:03:49.818078 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37067af7-59a1-49a6-b906-688585b01bfd admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:03:49.920974 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4336/8696] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 22:03:49 2022] PUT /identity/v3/projects/9bf3acbbe0574df19e22452dabf68f0f/users/3dcfc0c990cf43ca92bf65d12775c757/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 22:03:49.924940 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2e2941-0e12-4563-9e57-6cb199d5e7f1 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:03:49.934954 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2e2941-0e12-4563-9e57-6cb199d5e7f1 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:03:49.992069 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4257d1be-374f-4805-8788-a22a8341b55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:03:49.992736 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257d1be-374f-4805-8788-a22a8341b55d admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:03:49.993019 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257d1be-374f-4805-8788-a22a8341b55d admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:03:49.993345 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257d1be-374f-4805-8788-a22a8341b55d admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:03:49.994009 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4257d1be-374f-4805-8788-a22a8341b55d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:03:49.995697 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4257d1be-374f-4805-8788-a22a8341b55d admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:03:50.005814 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4361/8697] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 22:03:49 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 22:03:50.009902 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37067af7-59a1-49a6-b906-688585b01bfd admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:03:50.020717 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37067af7-59a1-49a6-b906-688585b01bfd admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:03:50.025308 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8925aaf3-a2ad-4afa-874d-6f54f424d351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:03:50.026182 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8925aaf3-a2ad-4afa-874d-6f54f424d351 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:03:50.026462 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8925aaf3-a2ad-4afa-874d-6f54f424d351 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:03:50.026738 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8925aaf3-a2ad-4afa-874d-6f54f424d351 admin admin] PATH_INFO: `/v3/projects/9bf3acbbe0574df19e22452dabf68f0f/users/3dcfc0c990cf43ca92bf65d12775c757/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:03:50.028725 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8925aaf3-a2ad-4afa-874d-6f54f424d351 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bf3acbbe0574df19e22452dabf68f0f, user_id=3dcfc0c990cf43ca92bf65d12775c757, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:03:50.031373 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8925aaf3-a2ad-4afa-874d-6f54f424d351 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:03:50.042323 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4337/8698] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 22:03:50 2022] PUT /identity/v3/projects/9bf3acbbe0574df19e22452dabf68f0f/users/3dcfc0c990cf43ca92bf65d12775c757/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 22:03:50.054375 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0971f-8169-4d72-9101-ce287ed55580 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:03:50.054676 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0971f-8169-4d72-9101-ce287ed55580 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:03:50.054939 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0971f-8169-4d72-9101-ce287ed55580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:03:50.081592 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-bef0971f-8169-4d72-9101-ce287ed55580 None None] MFA Rules not processed for user `3dcfc0c990cf43ca92bf65d12775c757`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:03:50.082803 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-bef0971f-8169-4d72-9101-ce287ed55580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:03:50.150653 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4362/8699] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 22:03:50 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 22:03:50.162723 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9c39a-7462-467e-8890-cdff762258a3 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:03:50.163031 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9c39a-7462-467e-8890-cdff762258a3 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:03:50.163311 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9c39a-7462-467e-8890-cdff762258a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:03:50.181513 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-6ca9c39a-7462-467e-8890-cdff762258a3 None None] MFA Rules not processed for user `82caa36fc4a3474caea54e96899d0193`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:03:50.182718 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-6ca9c39a-7462-467e-8890-cdff762258a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:03:50.236043 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4338/8700] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 22:03:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:03:50.271959 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef0971f-8169-4d72-9101-ce287ed55580 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:03:50.273373 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-bef0971f-8169-4d72-9101-ce287ed55580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:03:50.365484 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef0971f-8169-4d72-9101-ce287ed55580 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:03:50.371043 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3add8ec-1531-44ce-95a4-332edfe41a11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:03:50.371717 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3add8ec-1531-44ce-95a4-332edfe41a11 service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:03:50.371999 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3add8ec-1531-44ce-95a4-332edfe41a11 service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:03:50.372274 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3add8ec-1531-44ce-95a4-332edfe41a11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:03:50.380661 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3add8ec-1531-44ce-95a4-332edfe41a11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:03:50.382236 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3add8ec-1531-44ce-95a4-332edfe41a11 service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:03:50.390856 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4363/8701] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:03:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:03:50.921594 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1143164-8f01-4561-8a04-d30106985b14 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:03:50.922112 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1143164-8f01-4561-8a04-d30106985b14 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:03:50.922314 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1143164-8f01-4561-8a04-d30106985b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:03:50.945331 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-a1143164-8f01-4561-8a04-d30106985b14 None None] MFA Rules not processed for user `0812ae67e44d483baf2dbb1a5332a1d7`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:03:50.946513 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-a1143164-8f01-4561-8a04-d30106985b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:03:51.012834 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4339/8702] 10.222.0.52 () {58 vars in 1018 bytes} [Sat May 14 22:03:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:03:51.024972 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3add8ec-1531-44ce-95a4-332edfe41a11 service nova] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:03:51.026360 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b3add8ec-1531-44ce-95a4-332edfe41a11 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:03:51.044471 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3add8ec-1531-44ce-95a4-332edfe41a11 service nova] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:03:51.050097 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e45a7bb-1785-4828-8473-dd5f3928353e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:03:51.051144 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e45a7bb-1785-4828-8473-dd5f3928353e service placement] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:03:51.051706 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e45a7bb-1785-4828-8473-dd5f3928353e service placement] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:03:51.052140 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e45a7bb-1785-4828-8473-dd5f3928353e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:03:51.062821 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e45a7bb-1785-4828-8473-dd5f3928353e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:03:51.065396 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e45a7bb-1785-4828-8473-dd5f3928353e service placement] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:03:51.075542 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4364/8703] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:03:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:03:54.096294 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1143164-8f01-4561-8a04-d30106985b14 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:03:54.097994 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-a1143164-8f01-4561-8a04-d30106985b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:03:54.157731 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1143164-8f01-4561-8a04-d30106985b14 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:03:54.162074 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46ee944-7d81-475e-a0f7-84211f7ae807 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:03:54.162721 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ee944-7d81-475e-a0f7-84211f7ae807 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:03:54.163007 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ee944-7d81-475e-a0f7-84211f7ae807 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:03:54.163287 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ee944-7d81-475e-a0f7-84211f7ae807 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:03:54.165124 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-a46ee944-7d81-475e-a0f7-84211f7ae807 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:03:54.178092 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46ee944-7d81-475e-a0f7-84211f7ae807 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:03:54.179569 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46ee944-7d81-475e-a0f7-84211f7ae807 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:03:54.190908 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4340/8704] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:03:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:03:59.778759 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e45a7bb-1785-4828-8473-dd5f3928353e service placement] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:03:59.801526 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e45a7bb-1785-4828-8473-dd5f3928353e service placement] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:03:59.805997 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e0794b-0518-45ee-b8a2-a7933a58e86e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:03:59.806646 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0794b-0518-45ee-b8a2-a7933a58e86e service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:03:59.806927 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0794b-0518-45ee-b8a2-a7933a58e86e service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:03:59.807199 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0794b-0518-45ee-b8a2-a7933a58e86e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:03:59.809107 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-61e0794b-0518-45ee-b8a2-a7933a58e86e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:03:59.825972 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e0794b-0518-45ee-b8a2-a7933a58e86e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:03:59.827685 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e0794b-0518-45ee-b8a2-a7933a58e86e service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:03:59.844351 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4365/8705] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:03:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:04:01.586013 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46ee944-7d81-475e-a0f7-84211f7ae807 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:04:01.601522 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46ee944-7d81-475e-a0f7-84211f7ae807 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:04:01.607018 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe41f845-e2d6-4d20-ba22-da9f3608ea43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:04:01.607685 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe41f845-e2d6-4d20-ba22-da9f3608ea43 service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:04:01.607973 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe41f845-e2d6-4d20-ba22-da9f3608ea43 service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:04:01.608250 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe41f845-e2d6-4d20-ba22-da9f3608ea43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:04:01.617012 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe41f845-e2d6-4d20-ba22-da9f3608ea43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:04:01.618642 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe41f845-e2d6-4d20-ba22-da9f3608ea43 service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:04:01.628254 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4341/8706] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:04:01 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:04:01.642388 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2b421-13b3-46e9-9799-c925a854cfcd None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:04:01.642923 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2b421-13b3-46e9-9799-c925a854cfcd None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:04:01.642923 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2b421-13b3-46e9-9799-c925a854cfcd None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:04:01.644330 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4366/8707] 10.222.0.52 () {54 vars in 912 bytes} [Sat May 14 22:04:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 22:04:01.649362 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe41f845-e2d6-4d20-ba22-da9f3608ea43 service nova] Authenticating service token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 14 22:04:01.663922 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe41f845-e2d6-4d20-ba22-da9f3608ea43 service nova] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:04:01.671933 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe41f845-e2d6-4d20-ba22-da9f3608ea43 service nova] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:04:01.677054 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0d4247-922f-4e48-85aa-0b409ae09614 tempest-ServersAdminNegativeTestJSON-1012860469 tempest-ServersAdminNegativeTestJSON-1012860469-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dcfc0c990cf43ca92bf65d12775c757', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf3acbbe0574df19e22452dabf68f0f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:04:01.677882 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d4247-922f-4e48-85aa-0b409ae09614 tempest-ServersAdminNegativeTestJSON-1012860469 tempest-ServersAdminNegativeTestJSON-1012860469-project-admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:04:01.678165 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d4247-922f-4e48-85aa-0b409ae09614 tempest-ServersAdminNegativeTestJSON-1012860469 tempest-ServersAdminNegativeTestJSON-1012860469-project-admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:04:01.678441 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d4247-922f-4e48-85aa-0b409ae09614 tempest-ServersAdminNegativeTestJSON-1012860469 tempest-ServersAdminNegativeTestJSON-1012860469-project-admin] PATH_INFO: `/v3/projects/9bf3acbbe0574df19e22452dabf68f0f` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:04:01.679646 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0d4247-922f-4e48-85aa-0b409ae09614 tempest-ServersAdminNegativeTestJSON-1012860469 tempest-ServersAdminNegativeTestJSON-1012860469-project-admin] RBAC: Authorizing `identity:get_project(project_id=9bf3acbbe0574df19e22452dabf68f0f)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:04:01.681411 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0d4247-922f-4e48-85aa-0b409ae09614 tempest-ServersAdminNegativeTestJSON-1012860469 tempest-ServersAdminNegativeTestJSON-1012860469-project-admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:04:01.683048 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4342/8708] 10.222.0.52 () {58 vars in 1443 bytes} [Sat May 14 22:04:01 2022] GET /identity/v3/projects/9bf3acbbe0574df19e22452dabf68f0f => generated 393 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 22:04:01.889768 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e2b421-13b3-46e9-9799-c925a854cfcd None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:04:01.900587 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e2b421-13b3-46e9-9799-c925a854cfcd None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:04:01.904050 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d0a5c2-d4ad-4532-8a8c-25eb7fdf766d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:04:01.904673 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d0a5c2-d4ad-4532-8a8c-25eb7fdf766d service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:04:01.904954 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d0a5c2-d4ad-4532-8a8c-25eb7fdf766d service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:04:01.905229 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d0a5c2-d4ad-4532-8a8c-25eb7fdf766d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:04:01.907240 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-26d0a5c2-d4ad-4532-8a8c-25eb7fdf766d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:04:01.919842 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d0a5c2-d4ad-4532-8a8c-25eb7fdf766d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:04:01.921262 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d0a5c2-d4ad-4532-8a8c-25eb7fdf766d service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:04:01.933112 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4367/8709] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:04:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:04:02.126166 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119daf1f-6d6d-4542-af5c-ebe36d374c81 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:04:02.126457 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119daf1f-6d6d-4542-af5c-ebe36d374c81 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:04:02.126760 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119daf1f-6d6d-4542-af5c-ebe36d374c81 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:04:02.128768 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4343/8710] 10.222.0.52 () {54 vars in 912 bytes} [Sat May 14 22:04:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 22:04:02.134061 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d0a5c2-d4ad-4532-8a8c-25eb7fdf766d service neutron] Authenticating service token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 14 22:04:02.150050 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d0a5c2-d4ad-4532-8a8c-25eb7fdf766d service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:04:02.159671 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d0a5c2-d4ad-4532-8a8c-25eb7fdf766d service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:04:02.164208 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b4bc54-b955-4523-84c6-ef901af55826 tempest-ServersAdminNegativeTestJSON-1012860469 tempest-ServersAdminNegativeTestJSON-1012860469-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dcfc0c990cf43ca92bf65d12775c757', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf3acbbe0574df19e22452dabf68f0f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:04:02.165066 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4bc54-b955-4523-84c6-ef901af55826 tempest-ServersAdminNegativeTestJSON-1012860469 tempest-ServersAdminNegativeTestJSON-1012860469-project-admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:04:02.165356 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4bc54-b955-4523-84c6-ef901af55826 tempest-ServersAdminNegativeTestJSON-1012860469 tempest-ServersAdminNegativeTestJSON-1012860469-project-admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:04:02.165639 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4bc54-b955-4523-84c6-ef901af55826 tempest-ServersAdminNegativeTestJSON-1012860469 tempest-ServersAdminNegativeTestJSON-1012860469-project-admin] PATH_INFO: `/v3/projects/9bf3acbbe0574df19e22452dabf68f0f` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:04:02.167227 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b4bc54-b955-4523-84c6-ef901af55826 tempest-ServersAdminNegativeTestJSON-1012860469 tempest-ServersAdminNegativeTestJSON-1012860469-project-admin] RBAC: Authorizing `identity:get_project(project_id=9bf3acbbe0574df19e22452dabf68f0f)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:04:02.168723 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b4bc54-b955-4523-84c6-ef901af55826 tempest-ServersAdminNegativeTestJSON-1012860469 tempest-ServersAdminNegativeTestJSON-1012860469-project-admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:04:02.170465 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4368/8711] 10.222.0.52 () {58 vars in 1443 bytes} [Sat May 14 22:04:02 2022] GET /identity/v3/projects/9bf3acbbe0574df19e22452dabf68f0f => generated 393 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 22:04:06.241626 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119daf1f-6d6d-4542-af5c-ebe36d374c81 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:04:06.312466 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119daf1f-6d6d-4542-af5c-ebe36d374c81 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:04:06.318061 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446d9803-26ca-46b2-8b3a-21ad3863fb87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:04:06.318919 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d9803-26ca-46b2-8b3a-21ad3863fb87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:04:06.319203 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d9803-26ca-46b2-8b3a-21ad3863fb87 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:04:06.319495 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d9803-26ca-46b2-8b3a-21ad3863fb87 admin admin] PATH_INFO: `/v3/users/82caa36fc4a3474caea54e96899d0193` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:04:06.320715 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446d9803-26ca-46b2-8b3a-21ad3863fb87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82caa36fc4a3474caea54e96899d0193)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:04:06.322648 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446d9803-26ca-46b2-8b3a-21ad3863fb87 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:04:06.453869 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-446d9803-26ca-46b2-8b3a-21ad3863fb87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82caa36fc4a3474caea54e96899d0193'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:04:06.461513 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-446d9803-26ca-46b2-8b3a-21ad3863fb87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82caa36fc4a3474caea54e96899d0193'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:04:06.462208 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-446d9803-26ca-46b2-8b3a-21ad3863fb87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82caa36fc4a3474caea54e96899d0193'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:04:06.504994 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-446d9803-26ca-46b2-8b3a-21ad3863fb87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82caa36fc4a3474caea54e96899d0193'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:04:06.517087 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-446d9803-26ca-46b2-8b3a-21ad3863fb87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82caa36fc4a3474caea54e96899d0193'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:04:06.525279 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4344/8712] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 22:04:06 2022] DELETE /identity/v3/users/82caa36fc4a3474caea54e96899d0193 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 22:04:06.529849 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ebde6f-c1a0-4377-b6b9-2325a40ed7eb None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:04:06.530423 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ebde6f-c1a0-4377-b6b9-2325a40ed7eb None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:04:06.530423 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ebde6f-c1a0-4377-b6b9-2325a40ed7eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:04:06.569765 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-54ebde6f-c1a0-4377-b6b9-2325a40ed7eb None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:04:06.571014 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-54ebde6f-c1a0-4377-b6b9-2325a40ed7eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:04:06.626770 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4369/8713] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 22:04:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:04:06.637206 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446d9803-26ca-46b2-8b3a-21ad3863fb87 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:04:06.639455 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-446d9803-26ca-46b2-8b3a-21ad3863fb87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:04:06.695826 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446d9803-26ca-46b2-8b3a-21ad3863fb87 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:04:06.699521 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51733c38-a001-4ff9-b0cb-0ed93ec768b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:04:06.700169 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51733c38-a001-4ff9-b0cb-0ed93ec768b3 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:04:06.700455 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51733c38-a001-4ff9-b0cb-0ed93ec768b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:04:06.700736 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51733c38-a001-4ff9-b0cb-0ed93ec768b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:04:06.709962 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51733c38-a001-4ff9-b0cb-0ed93ec768b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:04:06.711392 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51733c38-a001-4ff9-b0cb-0ed93ec768b3 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:04:06.720916 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4345/8714] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:04:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:04:06.991675 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ebde6f-c1a0-4377-b6b9-2325a40ed7eb None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:04:06.993227 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-54ebde6f-c1a0-4377-b6b9-2325a40ed7eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:04:07.005754 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ebde6f-c1a0-4377-b6b9-2325a40ed7eb None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:04:07.010542 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d52bb0-0269-4807-be40-e47fb98953c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:04:07.011519 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d52bb0-0269-4807-be40-e47fb98953c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:04:07.011880 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d52bb0-0269-4807-be40-e47fb98953c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:04:07.012229 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d52bb0-0269-4807-be40-e47fb98953c9 admin admin] PATH_INFO: `/v3/projects/fda412b109db40e2b861ef03652db7f4` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:04:07.013508 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d52bb0-0269-4807-be40-e47fb98953c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fda412b109db40e2b861ef03652db7f4)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:04:07.015969 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d52bb0-0269-4807-be40-e47fb98953c9 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:04:07.109681 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-45d52bb0-0269-4807-be40-e47fb98953c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fda412b109db40e2b861ef03652db7f4', 'request_id': 'req-45d52bb0-0269-4807-be40-e47fb98953c9'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:04:07.117768 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-45d52bb0-0269-4807-be40-e47fb98953c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fda412b109db40e2b861ef03652db7f4', 'request_id': 'req-45d52bb0-0269-4807-be40-e47fb98953c9'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:04:07.183608 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-45d52bb0-0269-4807-be40-e47fb98953c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fda412b109db40e2b861ef03652db7f4', 'request_id': 'req-45d52bb0-0269-4807-be40-e47fb98953c9'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:04:07.196383 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-45d52bb0-0269-4807-be40-e47fb98953c9 admin admin] The token cache is being invalidate because project fda412b109db40e2b861ef03652db7f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 22:04:07.196673 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-45d52bb0-0269-4807-be40-e47fb98953c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:04:07.197305 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-45d52bb0-0269-4807-be40-e47fb98953c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:04:07.198884 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4370/8715] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 22:04:06 2022] DELETE /identity/v3/projects/fda412b109db40e2b861ef03652db7f4 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 22:04:07.202951 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51733c38-a001-4ff9-b0cb-0ed93ec768b3 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:04:07.213685 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51733c38-a001-4ff9-b0cb-0ed93ec768b3 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:04:07.273173 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df02d1be-b0f2-40b4-94e8-5758a423fc50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:04:07.274487 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df02d1be-b0f2-40b4-94e8-5758a423fc50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:04:07.274778 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df02d1be-b0f2-40b4-94e8-5758a423fc50 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:04:07.275056 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df02d1be-b0f2-40b4-94e8-5758a423fc50 admin admin] PATH_INFO: `/v3/users/3dcfc0c990cf43ca92bf65d12775c757` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:04:07.277015 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df02d1be-b0f2-40b4-94e8-5758a423fc50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dcfc0c990cf43ca92bf65d12775c757)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:04:07.279053 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df02d1be-b0f2-40b4-94e8-5758a423fc50 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:04:07.505156 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-df02d1be-b0f2-40b4-94e8-5758a423fc50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dcfc0c990cf43ca92bf65d12775c757'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:04:07.516305 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-df02d1be-b0f2-40b4-94e8-5758a423fc50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dcfc0c990cf43ca92bf65d12775c757'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:04:07.517028 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-df02d1be-b0f2-40b4-94e8-5758a423fc50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dcfc0c990cf43ca92bf65d12775c757'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:04:07.595430 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-df02d1be-b0f2-40b4-94e8-5758a423fc50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dcfc0c990cf43ca92bf65d12775c757'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:04:07.610350 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-df02d1be-b0f2-40b4-94e8-5758a423fc50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dcfc0c990cf43ca92bf65d12775c757'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:04:07.620402 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4346/8716] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 22:04:07 2022] DELETE /identity/v3/users/3dcfc0c990cf43ca92bf65d12775c757 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 22:04:08.087453 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d52bb0-0269-4807-be40-e47fb98953c9 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:04:08.089019 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-45d52bb0-0269-4807-be40-e47fb98953c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:04:08.102906 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d52bb0-0269-4807-be40-e47fb98953c9 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:04:08.164113 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b77dfa1-8f16-4771-814f-3fddf3ee5b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:04:08.164985 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77dfa1-8f16-4771-814f-3fddf3ee5b2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:04:08.165271 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77dfa1-8f16-4771-814f-3fddf3ee5b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:04:08.165552 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77dfa1-8f16-4771-814f-3fddf3ee5b2b admin admin] PATH_INFO: `/v3/projects/9bf3acbbe0574df19e22452dabf68f0f` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:04:08.166721 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b77dfa1-8f16-4771-814f-3fddf3ee5b2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bf3acbbe0574df19e22452dabf68f0f)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:04:08.168707 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b77dfa1-8f16-4771-814f-3fddf3ee5b2b admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:04:08.262909 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8b77dfa1-8f16-4771-814f-3fddf3ee5b2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bf3acbbe0574df19e22452dabf68f0f', 'request_id': 'req-8b77dfa1-8f16-4771-814f-3fddf3ee5b2b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:04:08.268190 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8b77dfa1-8f16-4771-814f-3fddf3ee5b2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bf3acbbe0574df19e22452dabf68f0f', 'request_id': 'req-8b77dfa1-8f16-4771-814f-3fddf3ee5b2b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:04:08.325774 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8b77dfa1-8f16-4771-814f-3fddf3ee5b2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bf3acbbe0574df19e22452dabf68f0f', 'request_id': 'req-8b77dfa1-8f16-4771-814f-3fddf3ee5b2b'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:04:08.338177 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8b77dfa1-8f16-4771-814f-3fddf3ee5b2b admin admin] The token cache is being invalidate because project 9bf3acbbe0574df19e22452dabf68f0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 22:04:08.338468 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8b77dfa1-8f16-4771-814f-3fddf3ee5b2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:04:08.339119 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-8b77dfa1-8f16-4771-814f-3fddf3ee5b2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:04:08.340716 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4371/8717] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 22:04:08 2022] DELETE /identity/v3/projects/9bf3acbbe0574df19e22452dabf68f0f => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 22:04:08.346952 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d3832a-a97c-41de-8484-c14cdfac9864 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:04:08.348029 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d3832a-a97c-41de-8484-c14cdfac9864 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:04:08.348175 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d3832a-a97c-41de-8484-c14cdfac9864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:04:08.395962 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-e8d3832a-a97c-41de-8484-c14cdfac9864 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:04:08.397180 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e8d3832a-a97c-41de-8484-c14cdfac9864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:04:08.456215 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4347/8718] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 22:04:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:04:08.464558 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f4372-1f60-4c2a-8719-9b0740d59368 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:04:08.464853 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f4372-1f60-4c2a-8719-9b0740d59368 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:04:08.465134 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f4372-1f60-4c2a-8719-9b0740d59368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:04:08.484285 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-319f4372-1f60-4c2a-8719-9b0740d59368 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:04:08.485502 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-319f4372-1f60-4c2a-8719-9b0740d59368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:04:08.494175 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4372/8719] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 22:04:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:04:08.498438 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d3832a-a97c-41de-8484-c14cdfac9864 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:04:08.508251 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d3832a-a97c-41de-8484-c14cdfac9864 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:04:08.512828 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ed8c3-be8f-4c20-85b8-c39b46b75261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:04:08.513478 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ed8c3-be8f-4c20-85b8-c39b46b75261 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:04:08.513759 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ed8c3-be8f-4c20-85b8-c39b46b75261 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:04:08.514033 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ed8c3-be8f-4c20-85b8-c39b46b75261 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:04:08.514740 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794ed8c3-be8f-4c20-85b8-c39b46b75261 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 22:04:08.515043 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794ed8c3-be8f-4c20-85b8-c39b46b75261 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:04:08.516669 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794ed8c3-be8f-4c20-85b8-c39b46b75261 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:04:08.528305 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4348/8720] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 22:04:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 22:04:08.533026 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319f4372-1f60-4c2a-8719-9b0740d59368 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:04:08.543170 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319f4372-1f60-4c2a-8719-9b0740d59368 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:04:08.547949 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d668d-4e64-42c0-8e54-1867af827deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:04:08.558344 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d668d-4e64-42c0-8e54-1867af827deb admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:04:08.558344 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d668d-4e64-42c0-8e54-1867af827deb admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:04:08.558344 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d668d-4e64-42c0-8e54-1867af827deb admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:04:08.558344 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9d668d-4e64-42c0-8e54-1867af827deb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:04:08.558344 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9d668d-4e64-42c0-8e54-1867af827deb admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:04:08.636760 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4373/8721] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 22:04:08 2022] POST /identity/v3/projects => generated 377 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 22:04:08.641006 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ed8c3-be8f-4c20-85b8-c39b46b75261 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:04:08.651595 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ed8c3-be8f-4c20-85b8-c39b46b75261 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:04:08.706210 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8563670-28ce-4210-baeb-bfcf7e5930eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:04:08.707583 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8563670-28ce-4210-baeb-bfcf7e5930eb admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:04:08.707867 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8563670-28ce-4210-baeb-bfcf7e5930eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:04:08.708141 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8563670-28ce-4210-baeb-bfcf7e5930eb admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:04:08.708829 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8563670-28ce-4210-baeb-bfcf7e5930eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:04:08.710749 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8563670-28ce-4210-baeb-bfcf7e5930eb admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:04:08.795089 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4349/8722] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 22:04:08 2022] POST /identity/v3/users => generated 289 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 22:04:08.799491 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d668d-4e64-42c0-8e54-1867af827deb admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:04:08.810440 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d668d-4e64-42c0-8e54-1867af827deb admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:04:08.815055 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c569012a-cfd7-475d-a6e4-b01ecc5b5a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:04:08.815803 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c569012a-cfd7-475d-a6e4-b01ecc5b5a57 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:04:08.817176 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c569012a-cfd7-475d-a6e4-b01ecc5b5a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:04:08.817416 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c569012a-cfd7-475d-a6e4-b01ecc5b5a57 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:04:08.818134 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c569012a-cfd7-475d-a6e4-b01ecc5b5a57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:04:08.819757 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c569012a-cfd7-475d-a6e4-b01ecc5b5a57 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:04:08.830069 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4374/8723] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 22:04:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 22:04:08.834179 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8563670-28ce-4210-baeb-bfcf7e5930eb admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:04:08.844292 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8563670-28ce-4210-baeb-bfcf7e5930eb admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:04:08.849430 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c8d7d1-c94e-4e8e-81b6-12572b8f3718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:04:08.850457 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8d7d1-c94e-4e8e-81b6-12572b8f3718 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:04:08.850457 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8d7d1-c94e-4e8e-81b6-12572b8f3718 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:04:08.850685 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8d7d1-c94e-4e8e-81b6-12572b8f3718 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:04:08.851413 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c8d7d1-c94e-4e8e-81b6-12572b8f3718 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:04:08.853124 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c8d7d1-c94e-4e8e-81b6-12572b8f3718 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:04:08.864282 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4350/8724] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 22:04:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 22:04:08.868674 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c569012a-cfd7-475d-a6e4-b01ecc5b5a57 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:04:08.879868 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c569012a-cfd7-475d-a6e4-b01ecc5b5a57 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:04:08.884155 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70074f82-ba9f-4cf6-ba2b-a0e015c1f906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:04:08.885085 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70074f82-ba9f-4cf6-ba2b-a0e015c1f906 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:04:08.885360 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70074f82-ba9f-4cf6-ba2b-a0e015c1f906 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:04:08.885633 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70074f82-ba9f-4cf6-ba2b-a0e015c1f906 admin admin] PATH_INFO: `/v3/projects/3c99987d1aff4bdab1f5c51729d01452/users/920f7adb7bf84781928e6fcfe82dad0c/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:04:08.900224 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70074f82-ba9f-4cf6-ba2b-a0e015c1f906 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c99987d1aff4bdab1f5c51729d01452, user_id=920f7adb7bf84781928e6fcfe82dad0c, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:04:08.902826 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70074f82-ba9f-4cf6-ba2b-a0e015c1f906 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:04:08.972500 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4375/8725] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 22:04:08 2022] PUT /identity/v3/projects/3c99987d1aff4bdab1f5c51729d01452/users/920f7adb7bf84781928e6fcfe82dad0c/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 22:04:08.977587 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ed4f6-aade-4286-8139-a0c502380247 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:04:08.982332 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ed4f6-aade-4286-8139-a0c502380247 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:04:08.982332 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ed4f6-aade-4286-8139-a0c502380247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:04:08.996246 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-459ed4f6-aade-4286-8139-a0c502380247 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:04:08.997462 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-459ed4f6-aade-4286-8139-a0c502380247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:04:09.055769 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4351/8726] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 22:04:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:04:09.065471 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70074f82-ba9f-4cf6-ba2b-a0e015c1f906 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:04:09.067823 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-70074f82-ba9f-4cf6-ba2b-a0e015c1f906 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:04:09.125608 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70074f82-ba9f-4cf6-ba2b-a0e015c1f906 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:04:09.130075 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a8a4f-d835-4ee7-8899-f3c00d4fb347 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:04:09.130757 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a8a4f-d835-4ee7-8899-f3c00d4fb347 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:04:09.131041 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a8a4f-d835-4ee7-8899-f3c00d4fb347 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:04:09.131325 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a8a4f-d835-4ee7-8899-f3c00d4fb347 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:04:09.140546 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912a8a4f-d835-4ee7-8899-f3c00d4fb347 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:04:09.141978 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912a8a4f-d835-4ee7-8899-f3c00d4fb347 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:04:09.151810 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4376/8727] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:04:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:04:10.698836 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16349f-d9f1-4767-8e7c-4fa162e13261 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:04:10.699386 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16349f-d9f1-4767-8e7c-4fa162e13261 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:04:10.699386 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16349f-d9f1-4767-8e7c-4fa162e13261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:04:10.728014 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-ad16349f-d9f1-4767-8e7c-4fa162e13261 None None] MFA Rules not processed for user `920f7adb7bf84781928e6fcfe82dad0c`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:04:10.729239 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-ad16349f-d9f1-4767-8e7c-4fa162e13261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:04:10.794747 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4352/8728] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 22:04:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:04:10.806583 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28d7a5-c466-47cb-9456-37f79aab55c1 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:04:10.807207 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28d7a5-c466-47cb-9456-37f79aab55c1 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:04:10.807207 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28d7a5-c466-47cb-9456-37f79aab55c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:04:10.826151 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-0b28d7a5-c466-47cb-9456-37f79aab55c1 None None] MFA Rules not processed for user `920f7adb7bf84781928e6fcfe82dad0c`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:04:10.827354 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-0b28d7a5-c466-47cb-9456-37f79aab55c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:04:10.835459 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4377/8729] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 22:04:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:04:10.846749 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad16349f-d9f1-4767-8e7c-4fa162e13261 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:04:10.848237 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-ad16349f-d9f1-4767-8e7c-4fa162e13261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:04:10.924490 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad16349f-d9f1-4767-8e7c-4fa162e13261 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:04:10.930683 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9f735-8fed-4dd0-bd64-14ce94d22749 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:04:10.931718 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9f735-8fed-4dd0-bd64-14ce94d22749 service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:04:10.932006 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9f735-8fed-4dd0-bd64-14ce94d22749 service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:04:10.932280 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9f735-8fed-4dd0-bd64-14ce94d22749 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:04:10.940459 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e9f735-8fed-4dd0-bd64-14ce94d22749 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:04:10.942039 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e9f735-8fed-4dd0-bd64-14ce94d22749 service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:04:10.950993 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4353/8730] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:04:10 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:04:22.546485 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b28d7a5-c466-47cb-9456-37f79aab55c1 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:04:22.547913 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-0b28d7a5-c466-47cb-9456-37f79aab55c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:04:22.560267 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b28d7a5-c466-47cb-9456-37f79aab55c1 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:04:22.563850 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb58cbf9-cf7a-4392-bb1e-6c0c6861d17f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:04:22.564489 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb58cbf9-cf7a-4392-bb1e-6c0c6861d17f service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:04:22.564778 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb58cbf9-cf7a-4392-bb1e-6c0c6861d17f service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:04:22.565072 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb58cbf9-cf7a-4392-bb1e-6c0c6861d17f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:04:22.566752 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-fb58cbf9-cf7a-4392-bb1e-6c0c6861d17f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:04:22.580046 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb58cbf9-cf7a-4392-bb1e-6c0c6861d17f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:04:22.581543 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb58cbf9-cf7a-4392-bb1e-6c0c6861d17f service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:04:22.592594 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4378/8731] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:04:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:04:22.733878 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b67d23-9ca3-4956-9300-2ad2954bac5d None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:04:22.734447 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b67d23-9ca3-4956-9300-2ad2954bac5d None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:04:22.734447 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b67d23-9ca3-4956-9300-2ad2954bac5d None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:04:22.735772 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4354/8732] 10.222.0.52 () {54 vars in 921 bytes} [Sat May 14 22:04:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 22:04:22.740984 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbdb1b7-2463-4f15-8bd1-8f95e8abb4b4 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:04:22.741356 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbdb1b7-2463-4f15-8bd1-8f95e8abb4b4 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:04:22.741657 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbdb1b7-2463-4f15-8bd1-8f95e8abb4b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:04:22.760638 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-adbdb1b7-2463-4f15-8bd1-8f95e8abb4b4 None None] MFA Rules not processed for user `0812ae67e44d483baf2dbb1a5332a1d7`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:04:22.761832 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-adbdb1b7-2463-4f15-8bd1-8f95e8abb4b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:04:22.824254 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4379/8733] 10.222.0.52 () {58 vars in 1018 bytes} [Sat May 14 22:04:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:04:22.845082 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b67d23-9ca3-4956-9300-2ad2954bac5d None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:04:22.846742 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-30b67d23-9ca3-4956-9300-2ad2954bac5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:04:22.866100 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b67d23-9ca3-4956-9300-2ad2954bac5d None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:04:22.871026 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e6320-1856-41c8-b6c2-1f81570644c2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:04:22.871690 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e6320-1856-41c8-b6c2-1f81570644c2 service placement] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:04:22.871970 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e6320-1856-41c8-b6c2-1f81570644c2 service placement] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:04:22.872241 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e6320-1856-41c8-b6c2-1f81570644c2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:04:22.880296 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392e6320-1856-41c8-b6c2-1f81570644c2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:04:22.882418 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392e6320-1856-41c8-b6c2-1f81570644c2 service placement] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:04:22.891964 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4355/8734] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:04:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:04:23.181349 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbdb1b7-2463-4f15-8bd1-8f95e8abb4b4 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:04:23.190800 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbdb1b7-2463-4f15-8bd1-8f95e8abb4b4 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:04:23.194467 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b243c5cb-f0a7-485f-adab-30fe73f835e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:04:23.195109 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b243c5cb-f0a7-485f-adab-30fe73f835e6 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:04:23.195396 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b243c5cb-f0a7-485f-adab-30fe73f835e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:04:23.195706 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b243c5cb-f0a7-485f-adab-30fe73f835e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:04:23.197483 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b243c5cb-f0a7-485f-adab-30fe73f835e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:04:23.214037 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b243c5cb-f0a7-485f-adab-30fe73f835e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:04:23.215460 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b243c5cb-f0a7-485f-adab-30fe73f835e6 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:04:23.229985 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4380/8735] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:04:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:04:52.542029 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e6320-1856-41c8-b6c2-1f81570644c2 service placement] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:04:52.551468 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e6320-1856-41c8-b6c2-1f81570644c2 service placement] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:04:52.555328 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add5ba9-5642-42f6-b8b4-4da9fb4c12d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:04:52.556022 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add5ba9-5642-42f6-b8b4-4da9fb4c12d1 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:04:52.556308 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add5ba9-5642-42f6-b8b4-4da9fb4c12d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:04:52.556582 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add5ba9-5642-42f6-b8b4-4da9fb4c12d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:04:52.558390 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-9add5ba9-5642-42f6-b8b4-4da9fb4c12d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:04:52.571040 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9add5ba9-5642-42f6-b8b4-4da9fb4c12d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:04:52.572487 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9add5ba9-5642-42f6-b8b4-4da9fb4c12d1 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:04:52.582928 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4356/8736] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:04:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:04:53.020244 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b243c5cb-f0a7-485f-adab-30fe73f835e6 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:04:53.034944 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b243c5cb-f0a7-485f-adab-30fe73f835e6 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:04:53.041014 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d66942-9fed-4239-b3e9-923ff53edb48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:04:53.041652 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d66942-9fed-4239-b3e9-923ff53edb48 service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:04:53.041933 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d66942-9fed-4239-b3e9-923ff53edb48 service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:04:53.042210 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d66942-9fed-4239-b3e9-923ff53edb48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:04:53.044013 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-09d66942-9fed-4239-b3e9-923ff53edb48 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:04:53.059519 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d66942-9fed-4239-b3e9-923ff53edb48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:04:53.061134 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d66942-9fed-4239-b3e9-923ff53edb48 service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:04:53.076144 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4381/8737] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:04:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:05:03.577213 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add5ba9-5642-42f6-b8b4-4da9fb4c12d1 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:05:03.589899 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add5ba9-5642-42f6-b8b4-4da9fb4c12d1 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:05:03.594597 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab596321-2658-4c46-ab2d-4932280f148f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:05:03.595462 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab596321-2658-4c46-ab2d-4932280f148f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:05:03.595770 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab596321-2658-4c46-ab2d-4932280f148f admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:05:03.596047 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab596321-2658-4c46-ab2d-4932280f148f admin admin] PATH_INFO: `/v3/users/920f7adb7bf84781928e6fcfe82dad0c` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:05:03.597240 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab596321-2658-4c46-ab2d-4932280f148f admin admin] RBAC: Authorizing `identity:delete_user(user_id=920f7adb7bf84781928e6fcfe82dad0c)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:05:03.599186 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab596321-2658-4c46-ab2d-4932280f148f admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:05:03.732955 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ab596321-2658-4c46-ab2d-4932280f148f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '920f7adb7bf84781928e6fcfe82dad0c'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:05:03.739748 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ab596321-2658-4c46-ab2d-4932280f148f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '920f7adb7bf84781928e6fcfe82dad0c'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:05:03.740478 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ab596321-2658-4c46-ab2d-4932280f148f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '920f7adb7bf84781928e6fcfe82dad0c'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:05:03.787986 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ab596321-2658-4c46-ab2d-4932280f148f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '920f7adb7bf84781928e6fcfe82dad0c'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:05:03.800175 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-ab596321-2658-4c46-ab2d-4932280f148f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '920f7adb7bf84781928e6fcfe82dad0c'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:05:03.806417 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4357/8738] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 22:05:03 2022] DELETE /identity/v3/users/920f7adb7bf84781928e6fcfe82dad0c => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 22:05:04.018145 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d66942-9fed-4239-b3e9-923ff53edb48 service nova] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:05:04.030067 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d66942-9fed-4239-b3e9-923ff53edb48 service nova] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:05:04.086135 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6e2c11-7c3f-452c-8f11-25c4167f342a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:05:04.087020 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e2c11-7c3f-452c-8f11-25c4167f342a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:05:04.087308 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e2c11-7c3f-452c-8f11-25c4167f342a admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:05:04.087624 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e2c11-7c3f-452c-8f11-25c4167f342a admin admin] PATH_INFO: `/v3/projects/3c99987d1aff4bdab1f5c51729d01452` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:05:04.088837 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6e2c11-7c3f-452c-8f11-25c4167f342a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c99987d1aff4bdab1f5c51729d01452)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:05:04.090749 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6e2c11-7c3f-452c-8f11-25c4167f342a admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:05:04.187461 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5e6e2c11-7c3f-452c-8f11-25c4167f342a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c99987d1aff4bdab1f5c51729d01452', 'request_id': 'req-5e6e2c11-7c3f-452c-8f11-25c4167f342a'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:05:04.193124 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5e6e2c11-7c3f-452c-8f11-25c4167f342a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c99987d1aff4bdab1f5c51729d01452', 'request_id': 'req-5e6e2c11-7c3f-452c-8f11-25c4167f342a'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:05:04.267847 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5e6e2c11-7c3f-452c-8f11-25c4167f342a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c99987d1aff4bdab1f5c51729d01452', 'request_id': 'req-5e6e2c11-7c3f-452c-8f11-25c4167f342a'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:05:04.279514 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5e6e2c11-7c3f-452c-8f11-25c4167f342a admin admin] The token cache is being invalidate because project 3c99987d1aff4bdab1f5c51729d01452 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 22:05:04.285449 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5e6e2c11-7c3f-452c-8f11-25c4167f342a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:05:04.285449 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-5e6e2c11-7c3f-452c-8f11-25c4167f342a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:05:04.285449 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4382/8739] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 22:05:04 2022] DELETE /identity/v3/projects/3c99987d1aff4bdab1f5c51729d01452 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 22:05:04.287264 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27cfb86-cccd-48ba-bb9a-39746b1ecb9c None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:05:04.287723 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27cfb86-cccd-48ba-bb9a-39746b1ecb9c None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:05:04.287723 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27cfb86-cccd-48ba-bb9a-39746b1ecb9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:05:04.305744 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-e27cfb86-cccd-48ba-bb9a-39746b1ecb9c None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:05:04.306946 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e27cfb86-cccd-48ba-bb9a-39746b1ecb9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:05:04.363973 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4358/8740] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 22:05:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:05:04.372889 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a3608-8a7e-472f-a5dc-0501911ac8cf None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:05:04.373182 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a3608-8a7e-472f-a5dc-0501911ac8cf None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:05:04.373464 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a3608-8a7e-472f-a5dc-0501911ac8cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:05:04.392322 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-3a9a3608-8a7e-472f-a5dc-0501911ac8cf None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:05:04.393516 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-3a9a3608-8a7e-472f-a5dc-0501911ac8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:05:04.401595 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4383/8741] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 22:05:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:05:04.405733 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27cfb86-cccd-48ba-bb9a-39746b1ecb9c None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:05:04.415703 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27cfb86-cccd-48ba-bb9a-39746b1ecb9c None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:05:04.420257 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104b0ad3-0568-4d6e-904e-0674c07c9ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:05:04.420914 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104b0ad3-0568-4d6e-904e-0674c07c9ea1 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:05:04.421199 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104b0ad3-0568-4d6e-904e-0674c07c9ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:05:04.421497 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104b0ad3-0568-4d6e-904e-0674c07c9ea1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:05:04.422191 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104b0ad3-0568-4d6e-904e-0674c07c9ea1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 22:05:04.422497 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104b0ad3-0568-4d6e-904e-0674c07c9ea1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:05:04.424149 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104b0ad3-0568-4d6e-904e-0674c07c9ea1 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:05:04.436477 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4359/8742] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 22:05:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 22:05:04.440612 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9a3608-8a7e-472f-a5dc-0501911ac8cf None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:05:04.450365 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9a3608-8a7e-472f-a5dc-0501911ac8cf None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:05:04.454991 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95a63d0-26f4-4790-9966-fb1685e7d816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:05:04.455662 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a63d0-26f4-4790-9966-fb1685e7d816 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:05:04.455945 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a63d0-26f4-4790-9966-fb1685e7d816 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:05:04.456217 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a63d0-26f4-4790-9966-fb1685e7d816 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:05:04.456924 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95a63d0-26f4-4790-9966-fb1685e7d816 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:05:04.458833 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95a63d0-26f4-4790-9966-fb1685e7d816 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:05:04.555649 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4384/8743] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 22:05:04 2022] POST /identity/v3/projects => generated 383 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 22:05:04.559843 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104b0ad3-0568-4d6e-904e-0674c07c9ea1 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:05:04.570290 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104b0ad3-0568-4d6e-904e-0674c07c9ea1 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:05:04.626458 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5251b1f7-d987-43b1-80ec-32dc1061f5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:05:04.627124 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5251b1f7-d987-43b1-80ec-32dc1061f5f2 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:05:04.627322 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5251b1f7-d987-43b1-80ec-32dc1061f5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:05:04.627637 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5251b1f7-d987-43b1-80ec-32dc1061f5f2 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:05:04.628317 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5251b1f7-d987-43b1-80ec-32dc1061f5f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:05:04.630254 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5251b1f7-d987-43b1-80ec-32dc1061f5f2 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:05:04.708416 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4360/8744] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 22:05:04 2022] POST /identity/v3/users => generated 292 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 22:05:04.712337 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95a63d0-26f4-4790-9966-fb1685e7d816 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:05:04.723001 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95a63d0-26f4-4790-9966-fb1685e7d816 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:05:04.728344 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bb7fb8-11e4-4e3f-83b7-28e2e67ad07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:05:04.730862 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bb7fb8-11e4-4e3f-83b7-28e2e67ad07d admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:05:04.730862 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bb7fb8-11e4-4e3f-83b7-28e2e67ad07d admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:05:04.730862 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bb7fb8-11e4-4e3f-83b7-28e2e67ad07d admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:05:04.730862 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bb7fb8-11e4-4e3f-83b7-28e2e67ad07d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:05:04.731975 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bb7fb8-11e4-4e3f-83b7-28e2e67ad07d admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:05:04.743074 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4385/8745] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 22:05:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 22:05:04.747003 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5251b1f7-d987-43b1-80ec-32dc1061f5f2 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:05:04.756979 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5251b1f7-d987-43b1-80ec-32dc1061f5f2 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:05:04.761612 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a823d4ec-f772-47c2-930f-9fb124e0a5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:05:04.765270 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823d4ec-f772-47c2-930f-9fb124e0a5e1 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:05:04.765270 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823d4ec-f772-47c2-930f-9fb124e0a5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:05:04.765270 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823d4ec-f772-47c2-930f-9fb124e0a5e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:05:04.765270 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a823d4ec-f772-47c2-930f-9fb124e0a5e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:05:04.765270 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a823d4ec-f772-47c2-930f-9fb124e0a5e1 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:05:04.775573 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4361/8746] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 22:05:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 22:05:04.779627 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bb7fb8-11e4-4e3f-83b7-28e2e67ad07d admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:05:04.790976 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bb7fb8-11e4-4e3f-83b7-28e2e67ad07d admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:05:04.796045 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044997f2-2828-4dda-8bb6-a066fc6f6339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:05:04.796948 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044997f2-2828-4dda-8bb6-a066fc6f6339 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:05:04.797227 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044997f2-2828-4dda-8bb6-a066fc6f6339 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:05:04.797498 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044997f2-2828-4dda-8bb6-a066fc6f6339 admin admin] PATH_INFO: `/v3/projects/9092d803ae1249baa50f6717607e8621/users/ae4941f6dd4844a1b441ff43114b3f3e/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:05:04.812762 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044997f2-2828-4dda-8bb6-a066fc6f6339 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9092d803ae1249baa50f6717607e8621, user_id=ae4941f6dd4844a1b441ff43114b3f3e, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:05:04.815409 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044997f2-2828-4dda-8bb6-a066fc6f6339 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:05:04.879429 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4386/8747] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 22:05:04 2022] PUT /identity/v3/projects/9092d803ae1249baa50f6717607e8621/users/ae4941f6dd4844a1b441ff43114b3f3e/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 22:05:04.884691 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcfa5fd-88d8-425c-9a54-17756e68f0bc None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:05:04.884986 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcfa5fd-88d8-425c-9a54-17756e68f0bc None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:05:04.885269 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcfa5fd-88d8-425c-9a54-17756e68f0bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:05:04.903581 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-ddcfa5fd-88d8-425c-9a54-17756e68f0bc None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:05:04.904789 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-ddcfa5fd-88d8-425c-9a54-17756e68f0bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:05:04.967744 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4362/8748] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 22:05:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:05:04.978615 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044997f2-2828-4dda-8bb6-a066fc6f6339 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:05:04.980552 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-044997f2-2828-4dda-8bb6-a066fc6f6339 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:05:05.044763 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044997f2-2828-4dda-8bb6-a066fc6f6339 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:05:05.048443 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d747e-bd9b-490f-827d-bb74f6e5f6e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:05:05.049140 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d747e-bd9b-490f-827d-bb74f6e5f6e8 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:05:05.049409 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d747e-bd9b-490f-827d-bb74f6e5f6e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:05:05.049684 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d747e-bd9b-490f-827d-bb74f6e5f6e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:05:05.058590 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6d747e-bd9b-490f-827d-bb74f6e5f6e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:05:05.060055 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6d747e-bd9b-490f-827d-bb74f6e5f6e8 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:05:05.069857 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4387/8749] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:05:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:05:06.194432 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467795f-4927-4967-8c26-1c05c71f3208 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:05:06.195035 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467795f-4927-4967-8c26-1c05c71f3208 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:05:06.195035 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467795f-4927-4967-8c26-1c05c71f3208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:05:06.222952 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-b467795f-4927-4967-8c26-1c05c71f3208 None None] MFA Rules not processed for user `ae4941f6dd4844a1b441ff43114b3f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:05:06.224194 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b467795f-4927-4967-8c26-1c05c71f3208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:05:06.290658 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4363/8750] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 22:05:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:05:06.300885 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057d47a-ccea-4dbf-878e-9f6069b7f983 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:05:06.301406 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057d47a-ccea-4dbf-878e-9f6069b7f983 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:05:06.301531 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057d47a-ccea-4dbf-878e-9f6069b7f983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:05:06.319347 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-5057d47a-ccea-4dbf-878e-9f6069b7f983 None None] MFA Rules not processed for user `ae4941f6dd4844a1b441ff43114b3f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:05:06.321101 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-5057d47a-ccea-4dbf-878e-9f6069b7f983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:05:06.328249 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4388/8751] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 22:05:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:05:06.340440 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b467795f-4927-4967-8c26-1c05c71f3208 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:05:06.341829 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b467795f-4927-4967-8c26-1c05c71f3208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:05:06.416744 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b467795f-4927-4967-8c26-1c05c71f3208 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:05:06.422591 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbda181-5d4a-4b51-a912-d7c5624cd1bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:05:06.423241 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbda181-5d4a-4b51-a912-d7c5624cd1bd service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:05:06.423602 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbda181-5d4a-4b51-a912-d7c5624cd1bd service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:05:06.423884 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbda181-5d4a-4b51-a912-d7c5624cd1bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:05:06.432946 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbda181-5d4a-4b51-a912-d7c5624cd1bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:05:06.434544 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbda181-5d4a-4b51-a912-d7c5624cd1bd service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:05:06.443561 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4364/8752] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:05:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:05:07.089657 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5057d47a-ccea-4dbf-878e-9f6069b7f983 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:05:07.091079 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-5057d47a-ccea-4dbf-878e-9f6069b7f983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:05:07.181236 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5057d47a-ccea-4dbf-878e-9f6069b7f983 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:05:07.186127 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f284e0f-c81b-48ba-a62f-0b7a93b870a4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:05:07.186771 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f284e0f-c81b-48ba-a62f-0b7a93b870a4 service placement] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:05:07.187047 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f284e0f-c81b-48ba-a62f-0b7a93b870a4 service placement] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:05:07.187314 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f284e0f-c81b-48ba-a62f-0b7a93b870a4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:05:07.189064 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-3f284e0f-c81b-48ba-a62f-0b7a93b870a4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:05:07.200974 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f284e0f-c81b-48ba-a62f-0b7a93b870a4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:05:07.202555 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f284e0f-c81b-48ba-a62f-0b7a93b870a4 service placement] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:05:07.212526 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4389/8753] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:05:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:05:08.566829 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbda181-5d4a-4b51-a912-d7c5624cd1bd service nova] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:05:08.568576 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-7dbda181-5d4a-4b51-a912-d7c5624cd1bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:05:08.591877 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbda181-5d4a-4b51-a912-d7c5624cd1bd service nova] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:05:08.598159 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585e7115-dff9-4aae-8dc1-46f02b253aa3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:05:08.598159 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e7115-dff9-4aae-8dc1-46f02b253aa3 service placement] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:05:08.598159 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e7115-dff9-4aae-8dc1-46f02b253aa3 service placement] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:05:08.599569 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e7115-dff9-4aae-8dc1-46f02b253aa3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:05:08.602516 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-585e7115-dff9-4aae-8dc1-46f02b253aa3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:05:08.618876 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585e7115-dff9-4aae-8dc1-46f02b253aa3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:05:08.620543 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585e7115-dff9-4aae-8dc1-46f02b253aa3 service placement] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:05:08.635139 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4365/8754] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:05:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:05:09.332163 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f284e0f-c81b-48ba-a62f-0b7a93b870a4 service placement] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:05:09.346181 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f284e0f-c81b-48ba-a62f-0b7a93b870a4 service placement] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:05:09.352270 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00048358-e8a5-4251-84fc-38c260428485 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:05:09.352922 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00048358-e8a5-4251-84fc-38c260428485 service placement] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:05:09.353207 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00048358-e8a5-4251-84fc-38c260428485 service placement] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:05:09.353485 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00048358-e8a5-4251-84fc-38c260428485 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:05:09.355305 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-00048358-e8a5-4251-84fc-38c260428485 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:05:09.370900 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00048358-e8a5-4251-84fc-38c260428485 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:05:09.372693 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00048358-e8a5-4251-84fc-38c260428485 service placement] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:05:09.386038 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4390/8755] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:05:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:05:19.914003 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6724b8-f4ca-460d-8b64-541f8b40bf3c None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:05:19.914557 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6724b8-f4ca-460d-8b64-541f8b40bf3c None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:05:19.914557 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6724b8-f4ca-460d-8b64-541f8b40bf3c None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:05:19.915990 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4366/8756] 10.222.0.52 () {54 vars in 921 bytes} [Sat May 14 22:05:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 22:05:19.920968 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9084fe-3606-4488-b17e-08e9ad586b21 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:05:19.921512 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9084fe-3606-4488-b17e-08e9ad586b21 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:05:19.921752 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9084fe-3606-4488-b17e-08e9ad586b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:05:19.940585 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-9d9084fe-3606-4488-b17e-08e9ad586b21 None None] MFA Rules not processed for user `0812ae67e44d483baf2dbb1a5332a1d7`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:05:19.941795 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-9d9084fe-3606-4488-b17e-08e9ad586b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:05:19.951813 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4391/8757] 10.222.0.52 () {58 vars in 1018 bytes} [Sat May 14 22:05:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:05:19.971220 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6724b8-f4ca-460d-8b64-541f8b40bf3c None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:05:19.987805 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6724b8-f4ca-460d-8b64-541f8b40bf3c None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:05:19.993271 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3595daf1-541c-4b8a-92b9-91624cdc0842 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:05:19.993904 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3595daf1-541c-4b8a-92b9-91624cdc0842 service placement] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:05:19.994191 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3595daf1-541c-4b8a-92b9-91624cdc0842 service placement] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:05:19.994471 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3595daf1-541c-4b8a-92b9-91624cdc0842 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:05:20.002745 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3595daf1-541c-4b8a-92b9-91624cdc0842 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:05:20.004364 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3595daf1-541c-4b8a-92b9-91624cdc0842 service placement] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:05:20.014356 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4367/8758] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:05:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:05:47.051407 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5242264-8e9d-4989-84a2-00d53a061f53 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:05:47.051917 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5242264-8e9d-4989-84a2-00d53a061f53 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:05:47.051917 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5242264-8e9d-4989-84a2-00d53a061f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:05:47.070326 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-a5242264-8e9d-4989-84a2-00d53a061f53 None None] MFA Rules not processed for user `ae4941f6dd4844a1b441ff43114b3f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:05:47.071667 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-a5242264-8e9d-4989-84a2-00d53a061f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:05:47.079418 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4392/8759] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 22:05:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:05:58.946705 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7390fb-abd6-42be-8cf1-2c409016b47c None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:05:58.947151 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7390fb-abd6-42be-8cf1-2c409016b47c None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:05:58.947274 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7390fb-abd6-42be-8cf1-2c409016b47c None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:05:58.948701 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4368/8760] 10.222.0.52 () {54 vars in 921 bytes} [Sat May 14 22:05:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 22:05:58.953618 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cec93a-2d5e-4943-a121-2e32cd9cce9c None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:05:58.954011 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cec93a-2d5e-4943-a121-2e32cd9cce9c None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:05:58.954197 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cec93a-2d5e-4943-a121-2e32cd9cce9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:05:58.972531 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-32cec93a-2d5e-4943-a121-2e32cd9cce9c None None] MFA Rules not processed for user `0812ae67e44d483baf2dbb1a5332a1d7`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:05:58.973721 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-32cec93a-2d5e-4943-a121-2e32cd9cce9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:05:58.983276 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4393/8761] 10.222.0.52 () {58 vars in 1018 bytes} [Sat May 14 22:05:58 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:05:59.003369 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7390fb-abd6-42be-8cf1-2c409016b47c None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:05:59.019355 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7390fb-abd6-42be-8cf1-2c409016b47c None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:05:59.024340 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78326601-402f-43d2-928f-6b4b685e6e72 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:05:59.024972 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78326601-402f-43d2-928f-6b4b685e6e72 service placement] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:05:59.025255 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78326601-402f-43d2-928f-6b4b685e6e72 service placement] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:05:59.025535 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78326601-402f-43d2-928f-6b4b685e6e72 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:05:59.034867 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78326601-402f-43d2-928f-6b4b685e6e72 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:05:59.036480 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78326601-402f-43d2-928f-6b4b685e6e72 service placement] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:05:59.047023 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4369/8762] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:05:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:06:39.998364 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cec93a-2d5e-4943-a121-2e32cd9cce9c None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:06:40.010225 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cec93a-2d5e-4943-a121-2e32cd9cce9c None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:06:40.015260 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c24db1-424a-4562-8ee1-cc30074329b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:06:40.016338 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c24db1-424a-4562-8ee1-cc30074329b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:06:40.017291 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c24db1-424a-4562-8ee1-cc30074329b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:06:40.017594 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c24db1-424a-4562-8ee1-cc30074329b2 admin admin] PATH_INFO: `/v3/users/ae4941f6dd4844a1b441ff43114b3f3e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:06:40.018815 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c24db1-424a-4562-8ee1-cc30074329b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae4941f6dd4844a1b441ff43114b3f3e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:06:40.020804 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c24db1-424a-4562-8ee1-cc30074329b2 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:06:40.143882 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-32c24db1-424a-4562-8ee1-cc30074329b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae4941f6dd4844a1b441ff43114b3f3e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:06:40.155646 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-32c24db1-424a-4562-8ee1-cc30074329b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae4941f6dd4844a1b441ff43114b3f3e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:06:40.162679 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-32c24db1-424a-4562-8ee1-cc30074329b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae4941f6dd4844a1b441ff43114b3f3e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:06:40.266400 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-32c24db1-424a-4562-8ee1-cc30074329b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae4941f6dd4844a1b441ff43114b3f3e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:06:40.267673 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-32c24db1-424a-4562-8ee1-cc30074329b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae4941f6dd4844a1b441ff43114b3f3e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:06:40.274173 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4394/8763] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 22:06:39 2022] DELETE /identity/v3/users/ae4941f6dd4844a1b441ff43114b3f3e => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 22:06:40.513926 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78326601-402f-43d2-928f-6b4b685e6e72 service placement] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:06:40.527885 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78326601-402f-43d2-928f-6b4b685e6e72 service placement] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:06:40.590776 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab85935-46d2-4916-bf38-fe7ca3ed7b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:06:40.591676 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab85935-46d2-4916-bf38-fe7ca3ed7b2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:06:40.591964 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab85935-46d2-4916-bf38-fe7ca3ed7b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:06:40.592240 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab85935-46d2-4916-bf38-fe7ca3ed7b2d admin admin] PATH_INFO: `/v3/projects/9092d803ae1249baa50f6717607e8621` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:06:40.593428 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab85935-46d2-4916-bf38-fe7ca3ed7b2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9092d803ae1249baa50f6717607e8621)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:06:40.595361 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab85935-46d2-4916-bf38-fe7ca3ed7b2d admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:06:40.700897 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dab85935-46d2-4916-bf38-fe7ca3ed7b2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9092d803ae1249baa50f6717607e8621', 'request_id': 'req-dab85935-46d2-4916-bf38-fe7ca3ed7b2d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:06:40.707181 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dab85935-46d2-4916-bf38-fe7ca3ed7b2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9092d803ae1249baa50f6717607e8621', 'request_id': 'req-dab85935-46d2-4916-bf38-fe7ca3ed7b2d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:06:40.713775 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dab85935-46d2-4916-bf38-fe7ca3ed7b2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9092d803ae1249baa50f6717607e8621', 'request_id': 'req-dab85935-46d2-4916-bf38-fe7ca3ed7b2d'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:06:40.802535 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dab85935-46d2-4916-bf38-fe7ca3ed7b2d admin admin] The token cache is being invalidate because project 9092d803ae1249baa50f6717607e8621 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 22:06:40.802750 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dab85935-46d2-4916-bf38-fe7ca3ed7b2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:06:40.803410 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-dab85935-46d2-4916-bf38-fe7ca3ed7b2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:06:40.805033 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4370/8764] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 22:06:40 2022] DELETE /identity/v3/projects/9092d803ae1249baa50f6717607e8621 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 22:06:40.810291 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e00f1-5d80-4aa9-9b0b-83dd60a7ed8a None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:06:40.810581 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e00f1-5d80-4aa9-9b0b-83dd60a7ed8a None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:06:40.810861 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e00f1-5d80-4aa9-9b0b-83dd60a7ed8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:06:40.829512 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-763e00f1-5d80-4aa9-9b0b-83dd60a7ed8a None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:06:40.832243 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-763e00f1-5d80-4aa9-9b0b-83dd60a7ed8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:06:40.892076 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4395/8765] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 22:06:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:06:40.900457 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba2e3d-6464-47c1-a4c5-a40e5972cf33 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:06:40.900753 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba2e3d-6464-47c1-a4c5-a40e5972cf33 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:06:40.901036 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba2e3d-6464-47c1-a4c5-a40e5972cf33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:06:40.920072 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-39ba2e3d-6464-47c1-a4c5-a40e5972cf33 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:06:40.921379 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-39ba2e3d-6464-47c1-a4c5-a40e5972cf33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:06:40.930925 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4371/8766] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 22:06:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:06:40.934883 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763e00f1-5d80-4aa9-9b0b-83dd60a7ed8a None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:06:40.945335 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763e00f1-5d80-4aa9-9b0b-83dd60a7ed8a None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:06:40.950133 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac21c77b-16ac-451c-a798-0ff7f49c5be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:06:40.950789 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21c77b-16ac-451c-a798-0ff7f49c5be5 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:06:40.951071 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21c77b-16ac-451c-a798-0ff7f49c5be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:06:40.951348 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21c77b-16ac-451c-a798-0ff7f49c5be5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:06:40.952095 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac21c77b-16ac-451c-a798-0ff7f49c5be5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 22:06:40.952400 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac21c77b-16ac-451c-a798-0ff7f49c5be5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:06:40.954017 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac21c77b-16ac-451c-a798-0ff7f49c5be5 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:06:40.965452 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4396/8767] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 22:06:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 22:06:40.969598 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ba2e3d-6464-47c1-a4c5-a40e5972cf33 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:06:40.979345 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ba2e3d-6464-47c1-a4c5-a40e5972cf33 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:06:40.983994 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33058389-479a-41bd-b969-4af5b4613d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:06:40.984632 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33058389-479a-41bd-b969-4af5b4613d1a admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:06:40.984915 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33058389-479a-41bd-b969-4af5b4613d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:06:40.985191 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33058389-479a-41bd-b969-4af5b4613d1a admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:06:40.985873 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33058389-479a-41bd-b969-4af5b4613d1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:06:40.988726 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33058389-479a-41bd-b969-4af5b4613d1a admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:06:41.067392 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4372/8768] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 22:06:40 2022] POST /identity/v3/projects => generated 379 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 22:06:41.071535 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac21c77b-16ac-451c-a798-0ff7f49c5be5 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:06:41.082402 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac21c77b-16ac-451c-a798-0ff7f49c5be5 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:06:41.138206 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e517add-8ce1-48e6-a8c2-5c50fb65f29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:06:41.138878 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e517add-8ce1-48e6-a8c2-5c50fb65f29e admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:06:41.139163 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e517add-8ce1-48e6-a8c2-5c50fb65f29e admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:06:41.139441 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e517add-8ce1-48e6-a8c2-5c50fb65f29e admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:06:41.140158 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e517add-8ce1-48e6-a8c2-5c50fb65f29e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:06:41.142127 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e517add-8ce1-48e6-a8c2-5c50fb65f29e admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:06:41.231397 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4397/8769] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 22:06:41 2022] POST /identity/v3/users => generated 290 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 22:06:41.235637 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33058389-479a-41bd-b969-4af5b4613d1a admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:06:41.246204 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33058389-479a-41bd-b969-4af5b4613d1a admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:06:41.251047 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e72b64b-4a70-4430-9b3e-08c6f8344715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:06:41.251726 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72b64b-4a70-4430-9b3e-08c6f8344715 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:06:41.252010 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72b64b-4a70-4430-9b3e-08c6f8344715 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:06:41.252972 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72b64b-4a70-4430-9b3e-08c6f8344715 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:06:41.253750 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e72b64b-4a70-4430-9b3e-08c6f8344715 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:06:41.255336 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e72b64b-4a70-4430-9b3e-08c6f8344715 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:06:41.267299 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4373/8770] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 22:06:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 22:06:41.271984 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e517add-8ce1-48e6-a8c2-5c50fb65f29e admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:06:41.281981 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e517add-8ce1-48e6-a8c2-5c50fb65f29e admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:06:41.287102 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b6a64-3e96-492a-921d-32d9387600db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:06:41.287818 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b6a64-3e96-492a-921d-32d9387600db admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:06:41.288100 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b6a64-3e96-492a-921d-32d9387600db admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:06:41.288375 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b6a64-3e96-492a-921d-32d9387600db admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:06:41.289083 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0b6a64-3e96-492a-921d-32d9387600db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:06:41.290728 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0b6a64-3e96-492a-921d-32d9387600db admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:06:41.301014 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4398/8771] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 22:06:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 22:06:41.304995 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e72b64b-4a70-4430-9b3e-08c6f8344715 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:06:41.315904 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e72b64b-4a70-4430-9b3e-08c6f8344715 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:06:41.320858 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab8e0d3-0828-457a-b4f4-a2f07b8229e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:06:41.321683 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab8e0d3-0828-457a-b4f4-a2f07b8229e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:06:41.321990 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab8e0d3-0828-457a-b4f4-a2f07b8229e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:06:41.322265 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab8e0d3-0828-457a-b4f4-a2f07b8229e3 admin admin] PATH_INFO: `/v3/projects/5b7eff5698214fe982348f81c276dc6a/users/58d7a44fb4b64d5d98bdda07c1638f20/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:06:41.337565 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab8e0d3-0828-457a-b4f4-a2f07b8229e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b7eff5698214fe982348f81c276dc6a, user_id=58d7a44fb4b64d5d98bdda07c1638f20, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:06:41.340337 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab8e0d3-0828-457a-b4f4-a2f07b8229e3 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:06:41.391823 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4374/8772] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 22:06:41 2022] PUT /identity/v3/projects/5b7eff5698214fe982348f81c276dc6a/users/58d7a44fb4b64d5d98bdda07c1638f20/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 22:06:41.397317 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597439b-57ee-48fb-9200-f9aaef34092c None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:06:41.397606 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597439b-57ee-48fb-9200-f9aaef34092c None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:06:41.397886 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597439b-57ee-48fb-9200-f9aaef34092c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:06:41.416849 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-2597439b-57ee-48fb-9200-f9aaef34092c None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:06:41.418072 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-2597439b-57ee-48fb-9200-f9aaef34092c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:06:41.475896 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4399/8773] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 22:06:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:06:41.485682 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab8e0d3-0828-457a-b4f4-a2f07b8229e3 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:06:41.488068 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-fab8e0d3-0828-457a-b4f4-a2f07b8229e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:06:41.542907 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab8e0d3-0828-457a-b4f4-a2f07b8229e3 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:06:41.546666 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89703b87-df52-42b7-abb0-efffafe55f2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:06:41.547299 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89703b87-df52-42b7-abb0-efffafe55f2c service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:06:41.547616 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89703b87-df52-42b7-abb0-efffafe55f2c service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:06:41.547894 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89703b87-df52-42b7-abb0-efffafe55f2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:06:41.557345 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89703b87-df52-42b7-abb0-efffafe55f2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:06:41.558806 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89703b87-df52-42b7-abb0-efffafe55f2c service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:06:41.568491 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4375/8774] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:06:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:06:46.340176 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb753ad1-c39e-4d83-9b95-869722796365 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:06:46.340699 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb753ad1-c39e-4d83-9b95-869722796365 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:06:46.340793 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb753ad1-c39e-4d83-9b95-869722796365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:06:46.367470 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-bb753ad1-c39e-4d83-9b95-869722796365 None None] MFA Rules not processed for user `58d7a44fb4b64d5d98bdda07c1638f20`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:06:46.368721 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-bb753ad1-c39e-4d83-9b95-869722796365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:06:46.437749 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4400/8775] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 22:06:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:06:46.453100 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89703b87-df52-42b7-abb0-efffafe55f2c service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:06:46.454566 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-89703b87-df52-42b7-abb0-efffafe55f2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:06:46.534297 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89703b87-df52-42b7-abb0-efffafe55f2c service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:06:46.540136 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f273eeb-cd3e-418d-b6de-b22925b85119 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:06:46.541804 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f273eeb-cd3e-418d-b6de-b22925b85119 service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:06:46.541804 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f273eeb-cd3e-418d-b6de-b22925b85119 service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:06:46.541804 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f273eeb-cd3e-418d-b6de-b22925b85119 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:06:46.551249 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f273eeb-cd3e-418d-b6de-b22925b85119 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:06:46.552925 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f273eeb-cd3e-418d-b6de-b22925b85119 service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:06:46.562746 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4376/8776] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:06:46 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:06:48.719763 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7b221c-57fe-4acc-8294-f17c1fd7c7f9 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:06:48.720276 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7b221c-57fe-4acc-8294-f17c1fd7c7f9 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:06:48.720518 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7b221c-57fe-4acc-8294-f17c1fd7c7f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:06:48.739163 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-5b7b221c-57fe-4acc-8294-f17c1fd7c7f9 None None] MFA Rules not processed for user `58d7a44fb4b64d5d98bdda07c1638f20`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:06:48.740558 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-5b7b221c-57fe-4acc-8294-f17c1fd7c7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:06:48.749669 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4401/8777] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 22:06:48 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:07:03.768710 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1dca5-de14-4c80-ad70-411e58b65bc0 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:07:03.769272 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1dca5-de14-4c80-ad70-411e58b65bc0 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:07:03.769272 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1dca5-de14-4c80-ad70-411e58b65bc0 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:07:03.770706 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4377/8778] 10.222.0.52 () {54 vars in 921 bytes} [Sat May 14 22:07:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 14 22:07:03.775459 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd9c7d-676f-4b97-958e-04324a9a5f0f None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:07:03.775860 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd9c7d-676f-4b97-958e-04324a9a5f0f None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:07:03.776157 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd9c7d-676f-4b97-958e-04324a9a5f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:07:03.797425 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-bbfd9c7d-676f-4b97-958e-04324a9a5f0f None None] MFA Rules not processed for user `0812ae67e44d483baf2dbb1a5332a1d7`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:07:03.799363 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-bbfd9c7d-676f-4b97-958e-04324a9a5f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:07:03.861331 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4402/8779] 10.222.0.52 () {58 vars in 1018 bytes} [Sat May 14 22:07:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:07:03.881018 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee1dca5-de14-4c80-ad70-411e58b65bc0 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:07:03.882733 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-dee1dca5-de14-4c80-ad70-411e58b65bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:07:03.901519 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee1dca5-de14-4c80-ad70-411e58b65bc0 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:07:03.906484 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e5cabd-8d7b-4134-b04f-71f52ebb9c6c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:07:03.907128 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e5cabd-8d7b-4134-b04f-71f52ebb9c6c service placement] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:07:03.907444 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e5cabd-8d7b-4134-b04f-71f52ebb9c6c service placement] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:07:03.908401 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e5cabd-8d7b-4134-b04f-71f52ebb9c6c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:07:03.917547 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e5cabd-8d7b-4134-b04f-71f52ebb9c6c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:07:03.919137 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e5cabd-8d7b-4134-b04f-71f52ebb9c6c service placement] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:07:03.930446 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4378/8780] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:07:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 22:07:13.326128 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee9c0b-3a2d-4632-bf1f-03c321ad48d9 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:07:13.326700 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee9c0b-3a2d-4632-bf1f-03c321ad48d9 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:07:13.326700 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee9c0b-3a2d-4632-bf1f-03c321ad48d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:07:13.346053 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-ffee9c0b-3a2d-4632-bf1f-03c321ad48d9 None None] MFA Rules not processed for user `0812ae67e44d483baf2dbb1a5332a1d7`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:07:13.347428 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ffee9c0b-3a2d-4632-bf1f-03c321ad48d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:07:13.356088 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4403/8781] 10.222.0.48 () {58 vars in 1015 bytes} [Sat May 14 22:07:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:07:13.368256 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e5cabd-8d7b-4134-b04f-71f52ebb9c6c service placement] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:07:13.369630 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-83e5cabd-8d7b-4134-b04f-71f52ebb9c6c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:07:13.385964 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e5cabd-8d7b-4134-b04f-71f52ebb9c6c service placement] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:07:13.391036 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a669da-c482-4cc5-8e53-93dadca7e659 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:07:13.391865 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a669da-c482-4cc5-8e53-93dadca7e659 service placement] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:07:13.392669 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a669da-c482-4cc5-8e53-93dadca7e659 service placement] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:07:13.393279 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a669da-c482-4cc5-8e53-93dadca7e659 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:07:13.401702 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a669da-c482-4cc5-8e53-93dadca7e659 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:07:13.403280 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a669da-c482-4cc5-8e53-93dadca7e659 service placement] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:07:13.414237 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4379/8782] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:07:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:07:44.396617 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f308adf-a22e-43f6-a70b-8eda9648e6a2 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:07:44.397110 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f308adf-a22e-43f6-a70b-8eda9648e6a2 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:07:44.397215 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f308adf-a22e-43f6-a70b-8eda9648e6a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:07:44.418250 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-5f308adf-a22e-43f6-a70b-8eda9648e6a2 None None] MFA Rules not processed for user `0812ae67e44d483baf2dbb1a5332a1d7`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:07:44.419506 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-5f308adf-a22e-43f6-a70b-8eda9648e6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:07:44.428705 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4404/8783] 10.222.0.36 () {58 vars in 1015 bytes} [Sat May 14 22:07:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:07:44.440580 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd3d1f7-4082-4cc6-a691-ad99492dabff None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:07:44.441026 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd3d1f7-4082-4cc6-a691-ad99492dabff None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:07:44.441121 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd3d1f7-4082-4cc6-a691-ad99492dabff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:07:44.461356 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-2cd3d1f7-4082-4cc6-a691-ad99492dabff None None] MFA Rules not processed for user `0812ae67e44d483baf2dbb1a5332a1d7`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:07:44.462597 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-2cd3d1f7-4082-4cc6-a691-ad99492dabff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:07:44.471507 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4380/8784] 10.222.0.52 () {58 vars in 1057 bytes} [Sat May 14 22:07:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 22:07:44.482999 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f308adf-a22e-43f6-a70b-8eda9648e6a2 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:07:44.493545 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f308adf-a22e-43f6-a70b-8eda9648e6a2 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:07:44.498555 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e61f42-5672-4dd6-a3d3-4bdda1a31c8a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:07:44.499196 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e61f42-5672-4dd6-a3d3-4bdda1a31c8a service placement] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:07:44.499521 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e61f42-5672-4dd6-a3d3-4bdda1a31c8a service placement] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:07:44.499883 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e61f42-5672-4dd6-a3d3-4bdda1a31c8a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:07:44.509196 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e61f42-5672-4dd6-a3d3-4bdda1a31c8a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:07:44.510782 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e61f42-5672-4dd6-a3d3-4bdda1a31c8a service placement] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:07:44.521345 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4405/8785] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:07:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 22:07:49.849590 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6063d52c-a7a0-40da-bac3-10c587577898 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:07:49.850075 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6063d52c-a7a0-40da-bac3-10c587577898 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:07:49.850169 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6063d52c-a7a0-40da-bac3-10c587577898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:07:49.867988 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-6063d52c-a7a0-40da-bac3-10c587577898 None None] MFA Rules not processed for user `58d7a44fb4b64d5d98bdda07c1638f20`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:07:49.869183 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-6063d52c-a7a0-40da-bac3-10c587577898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:07:49.876118 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4381/8786] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 22:07:49 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:08:17.816997 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e61f42-5672-4dd6-a3d3-4bdda1a31c8a service placement] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:08:17.818504 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-41e61f42-5672-4dd6-a3d3-4bdda1a31c8a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:08:17.830203 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e61f42-5672-4dd6-a3d3-4bdda1a31c8a service placement] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:08:17.833832 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff51bbe-9122-4fe0-9fe3-4689bb596bbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:08:17.834459 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff51bbe-9122-4fe0-9fe3-4689bb596bbc service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:08:17.834739 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff51bbe-9122-4fe0-9fe3-4689bb596bbc service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:08:17.835011 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff51bbe-9122-4fe0-9fe3-4689bb596bbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:08:17.836728 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-1ff51bbe-9122-4fe0-9fe3-4689bb596bbc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:08:17.852277 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff51bbe-9122-4fe0-9fe3-4689bb596bbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:08:17.853724 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff51bbe-9122-4fe0-9fe3-4689bb596bbc service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:08:17.868203 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4406/8787] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:08:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 22:08:29.019360 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a11281-640e-4645-8848-76f7f18a5594 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:08:29.019932 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a11281-640e-4645-8848-76f7f18a5594 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:08:29.019932 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a11281-640e-4645-8848-76f7f18a5594 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:08:29.021250 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4382/8788] 10.222.0.52 () {54 vars in 921 bytes} [Sat May 14 22:08:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 22:08:29.026055 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a687c-fc2d-4a3c-bebc-f304d5a00b0f None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:08:29.026464 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a687c-fc2d-4a3c-bebc-f304d5a00b0f None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:08:29.026610 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a687c-fc2d-4a3c-bebc-f304d5a00b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:08:29.056139 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-663a687c-fc2d-4a3c-bebc-f304d5a00b0f None None] MFA Rules not processed for user `0812ae67e44d483baf2dbb1a5332a1d7`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:08:29.057333 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-663a687c-fc2d-4a3c-bebc-f304d5a00b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:08:29.066388 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4407/8789] 10.222.0.52 () {58 vars in 1018 bytes} [Sat May 14 22:08:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:08:29.086061 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a11281-640e-4645-8848-76f7f18a5594 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:08:29.099798 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a11281-640e-4645-8848-76f7f18a5594 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:08:29.104789 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d920bac2-72e7-4808-ba7d-c205e07b4278 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:08:29.105421 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d920bac2-72e7-4808-ba7d-c205e07b4278 service placement] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:08:29.105707 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d920bac2-72e7-4808-ba7d-c205e07b4278 service placement] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:08:29.105994 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d920bac2-72e7-4808-ba7d-c205e07b4278 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:08:29.114961 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d920bac2-72e7-4808-ba7d-c205e07b4278 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:08:29.116583 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d920bac2-72e7-4808-ba7d-c205e07b4278 service placement] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:08:29.126184 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4383/8790] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:08:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:08:47.931871 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2263573-14db-4ad7-b80c-bb1e83ff28b4 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:08:47.938408 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2263573-14db-4ad7-b80c-bb1e83ff28b4 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:08:47.938408 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2263573-14db-4ad7-b80c-bb1e83ff28b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:08:47.951372 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-a2263573-14db-4ad7-b80c-bb1e83ff28b4 None None] MFA Rules not processed for user `58d7a44fb4b64d5d98bdda07c1638f20`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:08:47.952726 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-a2263573-14db-4ad7-b80c-bb1e83ff28b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:08:47.960475 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4408/8791] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 22:08:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:08:53.773927 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d920bac2-72e7-4808-ba7d-c205e07b4278 service placement] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:08:53.793471 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d920bac2-72e7-4808-ba7d-c205e07b4278 service placement] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:08:53.797161 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f94637-9dab-44fc-9c47-728cd135f079 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:08:53.797789 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f94637-9dab-44fc-9c47-728cd135f079 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:08:53.798076 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f94637-9dab-44fc-9c47-728cd135f079 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:08:53.798355 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f94637-9dab-44fc-9c47-728cd135f079 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:08:53.800838 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-32f94637-9dab-44fc-9c47-728cd135f079 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:08:53.813193 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f94637-9dab-44fc-9c47-728cd135f079 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:08:53.814646 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f94637-9dab-44fc-9c47-728cd135f079 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:08:53.825658 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4384/8792] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:08:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:09:01.269928 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c00b5a-58f5-4ad7-a8f4-1af1c1e5991f None None] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:09:01.270862 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c00b5a-58f5-4ad7-a8f4-1af1c1e5991f None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:09:01.272051 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c00b5a-58f5-4ad7-a8f4-1af1c1e5991f None None] PATH_INFO: `/` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:09:01.274994 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4409/8793] 10.222.0.52 () {54 vars in 921 bytes} [Sat May 14 22:09:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 22:09:01.279935 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e463dd-49b1-4409-b2e9-8bb413bed7ad None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:09:01.280870 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e463dd-49b1-4409-b2e9-8bb413bed7ad None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:09:01.281205 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e463dd-49b1-4409-b2e9-8bb413bed7ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:09:01.302489 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-96e463dd-49b1-4409-b2e9-8bb413bed7ad None None] MFA Rules not processed for user `0812ae67e44d483baf2dbb1a5332a1d7`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:09:01.304151 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-96e463dd-49b1-4409-b2e9-8bb413bed7ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:09:01.314008 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4385/8794] 10.222.0.52 () {58 vars in 1018 bytes} [Sat May 14 22:09:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:09:01.336112 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f857a-3336-41e2-be61-c506d3487522 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:09:01.336587 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f857a-3336-41e2-be61-c506d3487522 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:09:01.336894 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f857a-3336-41e2-be61-c506d3487522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:09:01.356957 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-816f857a-3336-41e2-be61-c506d3487522 None None] MFA Rules not processed for user `0812ae67e44d483baf2dbb1a5332a1d7`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:09:01.358475 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-816f857a-3336-41e2-be61-c506d3487522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:09:01.368732 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4410/8795] 10.222.0.52 () {58 vars in 1057 bytes} [Sat May 14 22:09:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:09:01.375071 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e463dd-49b1-4409-b2e9-8bb413bed7ad None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:09:01.387062 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e463dd-49b1-4409-b2e9-8bb413bed7ad None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:09:01.392914 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45fe83-3147-4202-89cd-1c4c075d951f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:09:01.393861 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45fe83-3147-4202-89cd-1c4c075d951f service placement] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:09:01.394299 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45fe83-3147-4202-89cd-1c4c075d951f service placement] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:09:01.394732 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45fe83-3147-4202-89cd-1c4c075d951f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:09:01.404857 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd45fe83-3147-4202-89cd-1c4c075d951f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:09:01.406756 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd45fe83-3147-4202-89cd-1c4c075d951f service placement] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:09:01.418896 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4386/8796] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:09:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:09:01.755530 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f857a-3336-41e2-be61-c506d3487522 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:09:01.765559 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f857a-3336-41e2-be61-c506d3487522 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:09:01.771495 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a074be6-c65d-4dfc-82cd-89d1a95d1fc4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:09:01.772198 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a074be6-c65d-4dfc-82cd-89d1a95d1fc4 service placement] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:09:01.772494 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a074be6-c65d-4dfc-82cd-89d1a95d1fc4 service placement] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:09:01.772773 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a074be6-c65d-4dfc-82cd-89d1a95d1fc4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:09:01.774646 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-9a074be6-c65d-4dfc-82cd-89d1a95d1fc4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:09:01.786971 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a074be6-c65d-4dfc-82cd-89d1a95d1fc4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:09:01.788673 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a074be6-c65d-4dfc-82cd-89d1a95d1fc4 service placement] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:09:01.799225 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4411/8797] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:09:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:09:27.486098 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45fe83-3147-4202-89cd-1c4c075d951f service placement] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:09:27.501299 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45fe83-3147-4202-89cd-1c4c075d951f service placement] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:09:27.507348 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13725844-a8b9-444f-8846-ce5bd14ef5c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:09:27.508024 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13725844-a8b9-444f-8846-ce5bd14ef5c3 service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:09:27.508363 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13725844-a8b9-444f-8846-ce5bd14ef5c3 service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:09:27.508643 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13725844-a8b9-444f-8846-ce5bd14ef5c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:09:27.510383 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-13725844-a8b9-444f-8846-ce5bd14ef5c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:09:27.525964 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13725844-a8b9-444f-8846-ce5bd14ef5c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:09:27.527569 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13725844-a8b9-444f-8846-ce5bd14ef5c3 service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:09:27.541952 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4387/8798] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:09:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:09:36.330193 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0629b6b3-498d-4903-89ac-275933c5aa94 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:09:36.331410 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0629b6b3-498d-4903-89ac-275933c5aa94 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:09:36.331410 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0629b6b3-498d-4903-89ac-275933c5aa94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:09:36.368244 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-0629b6b3-498d-4903-89ac-275933c5aa94 None None] MFA Rules not processed for user `0f1b0e2b025d4eceaa90e1616d0a9db8`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:09:36.369441 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-0629b6b3-498d-4903-89ac-275933c5aa94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:09:36.379647 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4412/8799] 10.222.0.52 () {58 vars in 1058 bytes} [Sat May 14 22:09:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 22:09:37.534526 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ada06b-cf1e-4f76-90ee-324e38e30a67 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:09:37.535278 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ada06b-cf1e-4f76-90ee-324e38e30a67 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:09:37.535373 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ada06b-cf1e-4f76-90ee-324e38e30a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:09:37.555253 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-98ada06b-cf1e-4f76-90ee-324e38e30a67 None None] MFA Rules not processed for user `58d7a44fb4b64d5d98bdda07c1638f20`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:09:37.555253 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-98ada06b-cf1e-4f76-90ee-324e38e30a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:09:37.560817 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4388/8800] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 22:09:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:09:37.862007 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0629b6b3-498d-4903-89ac-275933c5aa94 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:09:37.871269 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0629b6b3-498d-4903-89ac-275933c5aa94 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:09:37.875770 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e25becd-599f-4979-b0e5-90e12bfd1b04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:09:37.875770 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25becd-599f-4979-b0e5-90e12bfd1b04 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:09:37.875770 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25becd-599f-4979-b0e5-90e12bfd1b04 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:09:37.876033 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25becd-599f-4979-b0e5-90e12bfd1b04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:09:37.877805 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-0e25becd-599f-4979-b0e5-90e12bfd1b04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:09:37.889935 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e25becd-599f-4979-b0e5-90e12bfd1b04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:09:37.891350 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e25becd-599f-4979-b0e5-90e12bfd1b04 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:09:37.902465 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4413/8801] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:09:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:09:39.383852 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e39782-f1a8-470e-ba13-d3bc798880ca None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:09:39.384452 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e39782-f1a8-470e-ba13-d3bc798880ca None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:09:39.384543 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e39782-f1a8-470e-ba13-d3bc798880ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:09:39.403291 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-c9e39782-f1a8-470e-ba13-d3bc798880ca None None] MFA Rules not processed for user `0f1b0e2b025d4eceaa90e1616d0a9db8`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:09:39.404478 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c9e39782-f1a8-470e-ba13-d3bc798880ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:09:39.415352 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4389/8802] 10.222.0.52 () {58 vars in 1009 bytes} [Sat May 14 22:09:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:09:39.426313 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e25becd-599f-4979-b0e5-90e12bfd1b04 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:09:39.435083 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e25becd-599f-4979-b0e5-90e12bfd1b04 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:09:39.438873 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c33750-2fec-47ed-8578-e4d1aaf728f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:09:39.439540 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c33750-2fec-47ed-8578-e4d1aaf728f1 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:09:39.439853 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c33750-2fec-47ed-8578-e4d1aaf728f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:09:39.440186 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c33750-2fec-47ed-8578-e4d1aaf728f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:09:39.450288 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c33750-2fec-47ed-8578-e4d1aaf728f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:09:39.451747 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c33750-2fec-47ed-8578-e4d1aaf728f1 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:09:39.463402 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4414/8803] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:09:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:09:49.241375 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e39782-f1a8-470e-ba13-d3bc798880ca None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:09:49.252756 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e39782-f1a8-470e-ba13-d3bc798880ca None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:09:49.258415 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cca97b-29db-4789-9e82-4598cbd633f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:09:49.259192 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cca97b-29db-4789-9e82-4598cbd633f4 service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:09:49.259512 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cca97b-29db-4789-9e82-4598cbd633f4 service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:09:49.259792 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cca97b-29db-4789-9e82-4598cbd633f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:09:49.261921 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-94cca97b-29db-4789-9e82-4598cbd633f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:09:49.280175 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cca97b-29db-4789-9e82-4598cbd633f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:09:49.282415 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cca97b-29db-4789-9e82-4598cbd633f4 service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:09:49.297427 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4390/8804] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:09:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:09:49.364805 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07971a-4724-4c88-8946-6ee38e4729c8 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:09:49.365371 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07971a-4724-4c88-8946-6ee38e4729c8 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:09:49.365574 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07971a-4724-4c88-8946-6ee38e4729c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:09:49.407935 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-ad07971a-4724-4c88-8946-6ee38e4729c8 None None] MFA Rules not processed for user `99ed32a6d699453bb7e088540e8fc980`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:09:49.409747 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ad07971a-4724-4c88-8946-6ee38e4729c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:09:49.416996 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4415/8805] 10.222.0.48 () {58 vars in 1015 bytes} [Sat May 14 22:09:49 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:09:49.429851 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cca97b-29db-4789-9e82-4598cbd633f4 service nova] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:09:49.440710 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cca97b-29db-4789-9e82-4598cbd633f4 service nova] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:09:49.444926 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668a65dd-87f0-4d1b-a457-5c3e591e6192 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:09:49.445528 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a65dd-87f0-4d1b-a457-5c3e591e6192 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:09:49.445817 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a65dd-87f0-4d1b-a457-5c3e591e6192 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:09:49.446100 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a65dd-87f0-4d1b-a457-5c3e591e6192 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:09:49.454209 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668a65dd-87f0-4d1b-a457-5c3e591e6192 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:09:49.456286 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668a65dd-87f0-4d1b-a457-5c3e591e6192 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:09:49.465436 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4391/8806] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:09:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:09:55.466819 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad07971a-4724-4c88-8946-6ee38e4729c8 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:09:55.477066 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad07971a-4724-4c88-8946-6ee38e4729c8 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:09:55.482176 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04e734f-d33d-40a6-bb98-aa96e6df88e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:09:55.482936 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e734f-d33d-40a6-bb98-aa96e6df88e9 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:09:55.483294 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e734f-d33d-40a6-bb98-aa96e6df88e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:09:55.483676 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e734f-d33d-40a6-bb98-aa96e6df88e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:09:55.485637 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d04e734f-d33d-40a6-bb98-aa96e6df88e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:09:55.500564 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04e734f-d33d-40a6-bb98-aa96e6df88e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:09:55.502346 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04e734f-d33d-40a6-bb98-aa96e6df88e9 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:09:55.514118 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4416/8807] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:09:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:09:55.657794 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3039b6e6-d117-46f3-87b3-c2a35d9cdef0 None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:09:55.658333 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3039b6e6-d117-46f3-87b3-c2a35d9cdef0 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:09:55.659094 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3039b6e6-d117-46f3-87b3-c2a35d9cdef0 None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:09:55.660954 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4392/8808] 10.222.0.52 () {54 vars in 921 bytes} [Sat May 14 22:09:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 22:09:55.666158 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd559353-e3c7-4d61-9f08-0ec59b62f6fb None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:09:55.666513 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd559353-e3c7-4d61-9f08-0ec59b62f6fb None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:09:55.671373 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd559353-e3c7-4d61-9f08-0ec59b62f6fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:09:55.707472 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-fd559353-e3c7-4d61-9f08-0ec59b62f6fb None None] MFA Rules not processed for user `0812ae67e44d483baf2dbb1a5332a1d7`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:09:55.708743 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-fd559353-e3c7-4d61-9f08-0ec59b62f6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:09:55.728669 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4417/8809] 10.222.0.52 () {58 vars in 1018 bytes} [Sat May 14 22:09:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:09:55.752248 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3039b6e6-d117-46f3-87b3-c2a35d9cdef0 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:09:55.767269 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3039b6e6-d117-46f3-87b3-c2a35d9cdef0 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:09:55.772587 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600caf79-f94b-47cd-92c9-40320f582e9c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:09:55.773306 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600caf79-f94b-47cd-92c9-40320f582e9c service placement] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:09:55.773660 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600caf79-f94b-47cd-92c9-40320f582e9c service placement] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:09:55.774031 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600caf79-f94b-47cd-92c9-40320f582e9c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:09:55.782746 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600caf79-f94b-47cd-92c9-40320f582e9c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:09:55.784538 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600caf79-f94b-47cd-92c9-40320f582e9c service placement] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:09:55.794928 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4393/8810] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:09:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:09:56.100175 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd559353-e3c7-4d61-9f08-0ec59b62f6fb None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:09:56.109686 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd559353-e3c7-4d61-9f08-0ec59b62f6fb None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:09:56.113325 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fd6c8b-2170-43ee-99f8-53b086df351c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:09:56.113971 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd6c8b-2170-43ee-99f8-53b086df351c service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:09:56.114258 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd6c8b-2170-43ee-99f8-53b086df351c service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:09:56.114541 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd6c8b-2170-43ee-99f8-53b086df351c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:09:56.116340 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-58fd6c8b-2170-43ee-99f8-53b086df351c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:09:56.132997 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fd6c8b-2170-43ee-99f8-53b086df351c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:09:56.134466 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fd6c8b-2170-43ee-99f8-53b086df351c service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:09:56.148568 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4418/8811] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:09:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:10:16.616830 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24b2936-9885-432a-87f2-cb5a8664b6a6 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:10:16.617374 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24b2936-9885-432a-87f2-cb5a8664b6a6 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:10:16.617374 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24b2936-9885-432a-87f2-cb5a8664b6a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:10:16.635200 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-e24b2936-9885-432a-87f2-cb5a8664b6a6 None None] MFA Rules not processed for user `99ed32a6d699453bb7e088540e8fc980`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:10:16.643192 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e24b2936-9885-432a-87f2-cb5a8664b6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:10:16.643192 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4394/8812] 10.222.0.36 () {58 vars in 1015 bytes} [Sat May 14 22:10:16 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 22:10:16.654532 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fd6c8b-2170-43ee-99f8-53b086df351c service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:10:16.664947 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fd6c8b-2170-43ee-99f8-53b086df351c service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:10:16.668825 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6d26a5-0380-455b-a181-0e21efedc130 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:10:16.669467 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d26a5-0380-455b-a181-0e21efedc130 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:10:16.669753 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d26a5-0380-455b-a181-0e21efedc130 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:10:16.670034 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d26a5-0380-455b-a181-0e21efedc130 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:10:16.677995 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6d26a5-0380-455b-a181-0e21efedc130 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:10:16.679410 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6d26a5-0380-455b-a181-0e21efedc130 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:10:16.687186 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4419/8813] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:10:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:10:17.193802 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31e13d4-e82a-4158-8cc1-98ee2be3892a None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:10:17.194176 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31e13d4-e82a-4158-8cc1-98ee2be3892a None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:10:17.194384 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31e13d4-e82a-4158-8cc1-98ee2be3892a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:10:17.212760 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-b31e13d4-e82a-4158-8cc1-98ee2be3892a None None] MFA Rules not processed for user `0f1b0e2b025d4eceaa90e1616d0a9db8`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:10:17.214091 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b31e13d4-e82a-4158-8cc1-98ee2be3892a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:10:17.225180 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4395/8814] 10.222.0.52 () {58 vars in 1018 bytes} [Sat May 14 22:10:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:10:17.237611 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6d26a5-0380-455b-a181-0e21efedc130 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:10:17.250249 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6d26a5-0380-455b-a181-0e21efedc130 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:10:17.255965 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705714b6-7cfb-45a6-a811-c0d61b63ab9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:10:17.256626 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705714b6-7cfb-45a6-a811-c0d61b63ab9b service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:10:17.256911 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705714b6-7cfb-45a6-a811-c0d61b63ab9b service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:10:17.257189 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705714b6-7cfb-45a6-a811-c0d61b63ab9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:10:17.265793 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705714b6-7cfb-45a6-a811-c0d61b63ab9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:10:17.267369 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705714b6-7cfb-45a6-a811-c0d61b63ab9b service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:10:17.277912 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4420/8815] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:10:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:10:25.824506 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb45511-0b7b-4b1f-996d-a9564f674bb4 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:10:25.828216 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb45511-0b7b-4b1f-996d-a9564f674bb4 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:10:25.828216 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb45511-0b7b-4b1f-996d-a9564f674bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:10:25.844301 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-8fb45511-0b7b-4b1f-996d-a9564f674bb4 None None] MFA Rules not processed for user `0f1b0e2b025d4eceaa90e1616d0a9db8`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:10:25.845625 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8fb45511-0b7b-4b1f-996d-a9564f674bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:10:25.855155 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4396/8816] 10.222.0.52 () {58 vars in 1018 bytes} [Sat May 14 22:10:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:10:25.952961 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705714b6-7cfb-45a6-a811-c0d61b63ab9b service nova] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:10:25.964962 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705714b6-7cfb-45a6-a811-c0d61b63ab9b service nova] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:10:25.970557 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499a618a-c630-4084-aa4c-8cc9234af2c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:10:25.971402 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a618a-c630-4084-aa4c-8cc9234af2c5 service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:10:25.971718 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a618a-c630-4084-aa4c-8cc9234af2c5 service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:10:25.972000 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a618a-c630-4084-aa4c-8cc9234af2c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:10:25.980925 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499a618a-c630-4084-aa4c-8cc9234af2c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:10:25.982514 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499a618a-c630-4084-aa4c-8cc9234af2c5 service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:10:25.993446 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4421/8817] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:10:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:10:48.224080 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb45511-0b7b-4b1f-996d-a9564f674bb4 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:10:48.235935 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb45511-0b7b-4b1f-996d-a9564f674bb4 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:10:48.241620 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c9046f-518b-47cd-9010-ab7d1e478231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:10:48.242495 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c9046f-518b-47cd-9010-ab7d1e478231 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:10:48.242781 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c9046f-518b-47cd-9010-ab7d1e478231 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:10:48.243058 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c9046f-518b-47cd-9010-ab7d1e478231 admin admin] PATH_INFO: `/v3/users/58d7a44fb4b64d5d98bdda07c1638f20` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:10:48.244373 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c9046f-518b-47cd-9010-ab7d1e478231 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58d7a44fb4b64d5d98bdda07c1638f20)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:10:48.246316 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c9046f-518b-47cd-9010-ab7d1e478231 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:10:48.407153 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-85c9046f-518b-47cd-9010-ab7d1e478231 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58d7a44fb4b64d5d98bdda07c1638f20'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:10:48.414967 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-85c9046f-518b-47cd-9010-ab7d1e478231 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58d7a44fb4b64d5d98bdda07c1638f20'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:10:48.415680 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-85c9046f-518b-47cd-9010-ab7d1e478231 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58d7a44fb4b64d5d98bdda07c1638f20'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:10:48.474201 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-85c9046f-518b-47cd-9010-ab7d1e478231 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58d7a44fb4b64d5d98bdda07c1638f20'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:10:48.485954 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-85c9046f-518b-47cd-9010-ab7d1e478231 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58d7a44fb4b64d5d98bdda07c1638f20'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:10:48.492923 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4397/8818] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 22:10:48 2022] DELETE /identity/v3/users/58d7a44fb4b64d5d98bdda07c1638f20 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 22:10:48.739031 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499a618a-c630-4084-aa4c-8cc9234af2c5 service nova] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:10:48.749882 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499a618a-c630-4084-aa4c-8cc9234af2c5 service nova] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:10:48.806513 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3820ce5-c2cd-4d1e-8bd5-68b02a70eab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:10:48.807374 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3820ce5-c2cd-4d1e-8bd5-68b02a70eab7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:10:48.807687 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3820ce5-c2cd-4d1e-8bd5-68b02a70eab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:10:48.807968 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3820ce5-c2cd-4d1e-8bd5-68b02a70eab7 admin admin] PATH_INFO: `/v3/projects/5b7eff5698214fe982348f81c276dc6a` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:10:48.809146 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3820ce5-c2cd-4d1e-8bd5-68b02a70eab7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b7eff5698214fe982348f81c276dc6a)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:10:48.811063 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3820ce5-c2cd-4d1e-8bd5-68b02a70eab7 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:10:48.954828 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f3820ce5-c2cd-4d1e-8bd5-68b02a70eab7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b7eff5698214fe982348f81c276dc6a', 'request_id': 'req-f3820ce5-c2cd-4d1e-8bd5-68b02a70eab7'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:10:48.960986 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f3820ce5-c2cd-4d1e-8bd5-68b02a70eab7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b7eff5698214fe982348f81c276dc6a', 'request_id': 'req-f3820ce5-c2cd-4d1e-8bd5-68b02a70eab7'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:10:49.045500 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f3820ce5-c2cd-4d1e-8bd5-68b02a70eab7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b7eff5698214fe982348f81c276dc6a', 'request_id': 'req-f3820ce5-c2cd-4d1e-8bd5-68b02a70eab7'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:10:49.057560 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f3820ce5-c2cd-4d1e-8bd5-68b02a70eab7 admin admin] The token cache is being invalidate because project 5b7eff5698214fe982348f81c276dc6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 22:10:49.057844 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f3820ce5-c2cd-4d1e-8bd5-68b02a70eab7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:10:49.058512 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-f3820ce5-c2cd-4d1e-8bd5-68b02a70eab7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:10:49.060099 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4422/8819] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 22:10:48 2022] DELETE /identity/v3/projects/5b7eff5698214fe982348f81c276dc6a => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 22:10:49.065037 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0460061-1f33-4fbb-b5c5-f315c60504ab None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:10:49.065858 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0460061-1f33-4fbb-b5c5-f315c60504ab None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:10:49.066165 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0460061-1f33-4fbb-b5c5-f315c60504ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:10:49.084176 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-c0460061-1f33-4fbb-b5c5-f315c60504ab None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:10:49.085444 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c0460061-1f33-4fbb-b5c5-f315c60504ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:10:49.142125 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4398/8820] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 22:10:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:10:49.150987 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4ec7b3-31b3-4283-b846-f353fde5dd7f None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:10:49.151279 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4ec7b3-31b3-4283-b846-f353fde5dd7f None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:10:49.151590 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4ec7b3-31b3-4283-b846-f353fde5dd7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:10:49.169709 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-1d4ec7b3-31b3-4283-b846-f353fde5dd7f None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:10:49.170981 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-1d4ec7b3-31b3-4283-b846-f353fde5dd7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:10:49.179126 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4423/8821] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 22:10:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 22:10:49.184282 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0460061-1f33-4fbb-b5c5-f315c60504ab None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:10:49.194722 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0460061-1f33-4fbb-b5c5-f315c60504ab None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:10:49.199401 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f1e1b-f88f-497e-9aa4-37ac05b6ab33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:10:49.200079 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f1e1b-f88f-497e-9aa4-37ac05b6ab33 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:10:49.200363 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f1e1b-f88f-497e-9aa4-37ac05b6ab33 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:10:49.200639 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f1e1b-f88f-497e-9aa4-37ac05b6ab33 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:10:49.201382 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f1e1b-f88f-497e-9aa4-37ac05b6ab33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 22:10:49.201686 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f1e1b-f88f-497e-9aa4-37ac05b6ab33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:10:49.203285 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f1e1b-f88f-497e-9aa4-37ac05b6ab33 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:10:49.215685 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4399/8822] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 22:10:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 22:10:49.219789 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4ec7b3-31b3-4283-b846-f353fde5dd7f None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:10:49.231551 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4ec7b3-31b3-4283-b846-f353fde5dd7f None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:10:49.236662 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da7dc9d-79bb-48ea-8fed-8d73d1733e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:10:49.237619 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da7dc9d-79bb-48ea-8fed-8d73d1733e7f admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:10:49.237619 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da7dc9d-79bb-48ea-8fed-8d73d1733e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:10:49.239016 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da7dc9d-79bb-48ea-8fed-8d73d1733e7f admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:10:49.239016 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da7dc9d-79bb-48ea-8fed-8d73d1733e7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:10:49.240676 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da7dc9d-79bb-48ea-8fed-8d73d1733e7f admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:10:49.316584 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4424/8823] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 22:10:49 2022] POST /identity/v3/projects => generated 383 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 22:10:49.321014 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f1e1b-f88f-497e-9aa4-37ac05b6ab33 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:10:49.331754 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f1e1b-f88f-497e-9aa4-37ac05b6ab33 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:10:49.389249 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a02409-e53c-430b-9080-091473e741c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:10:49.389917 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a02409-e53c-430b-9080-091473e741c9 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:10:49.390202 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a02409-e53c-430b-9080-091473e741c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:10:49.390479 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a02409-e53c-430b-9080-091473e741c9 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:10:49.391155 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a02409-e53c-430b-9080-091473e741c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:10:49.393106 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a02409-e53c-430b-9080-091473e741c9 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:10:49.461586 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4400/8824] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 22:10:49 2022] POST /identity/v3/users => generated 292 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 22:10:49.465570 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da7dc9d-79bb-48ea-8fed-8d73d1733e7f admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:10:49.476761 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da7dc9d-79bb-48ea-8fed-8d73d1733e7f admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:10:49.481407 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f08c22-0b7e-48ff-9749-7a7b7e567110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:10:49.482060 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f08c22-0b7e-48ff-9749-7a7b7e567110 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:10:49.482339 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f08c22-0b7e-48ff-9749-7a7b7e567110 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:10:49.482609 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f08c22-0b7e-48ff-9749-7a7b7e567110 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:10:49.483350 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f08c22-0b7e-48ff-9749-7a7b7e567110 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:10:49.484967 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f08c22-0b7e-48ff-9749-7a7b7e567110 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:10:49.495256 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4425/8825] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 22:10:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 22:10:49.499264 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a02409-e53c-430b-9080-091473e741c9 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:10:49.510104 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a02409-e53c-430b-9080-091473e741c9 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:10:49.515207 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7652aa-2be9-4590-abd2-82157fe40ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:10:49.515951 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7652aa-2be9-4590-abd2-82157fe40ef6 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:10:49.516238 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7652aa-2be9-4590-abd2-82157fe40ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:10:49.516512 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7652aa-2be9-4590-abd2-82157fe40ef6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:10:49.517227 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7652aa-2be9-4590-abd2-82157fe40ef6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:10:49.518905 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7652aa-2be9-4590-abd2-82157fe40ef6 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:10:49.529866 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4401/8826] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 22:10:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 22:10:49.533891 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f08c22-0b7e-48ff-9749-7a7b7e567110 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:10:49.545092 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f08c22-0b7e-48ff-9749-7a7b7e567110 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:10:49.550615 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4967a8a6-0e3f-4544-8ada-c1bb9b14ff11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:10:49.551557 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967a8a6-0e3f-4544-8ada-c1bb9b14ff11 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:10:49.551848 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967a8a6-0e3f-4544-8ada-c1bb9b14ff11 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:10:49.552127 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967a8a6-0e3f-4544-8ada-c1bb9b14ff11 admin admin] PATH_INFO: `/v3/projects/cbd3e2d31b0341d2b7131a387bfa33f2/users/463dbb858c1a48b9b97114f048713624/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:10:49.569789 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4967a8a6-0e3f-4544-8ada-c1bb9b14ff11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbd3e2d31b0341d2b7131a387bfa33f2, user_id=463dbb858c1a48b9b97114f048713624, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:10:49.572465 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4967a8a6-0e3f-4544-8ada-c1bb9b14ff11 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:10:49.657385 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4426/8827] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 22:10:49 2022] PUT /identity/v3/projects/cbd3e2d31b0341d2b7131a387bfa33f2/users/463dbb858c1a48b9b97114f048713624/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 22:10:49.663420 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90347880-5627-483a-a2ac-4e80b9421c20 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:10:49.667116 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90347880-5627-483a-a2ac-4e80b9421c20 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:10:49.667116 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90347880-5627-483a-a2ac-4e80b9421c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:10:49.683249 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-90347880-5627-483a-a2ac-4e80b9421c20 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:10:49.684495 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-90347880-5627-483a-a2ac-4e80b9421c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:10:49.741384 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4402/8828] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 22:10:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 22:10:49.750893 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4967a8a6-0e3f-4544-8ada-c1bb9b14ff11 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:10:49.752615 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-4967a8a6-0e3f-4544-8ada-c1bb9b14ff11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:10:49.810708 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4967a8a6-0e3f-4544-8ada-c1bb9b14ff11 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:10:49.814404 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bae8b7-306a-4492-a72a-0a92069726de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:10:49.815047 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bae8b7-306a-4492-a72a-0a92069726de service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:10:49.815431 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bae8b7-306a-4492-a72a-0a92069726de service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:10:49.815831 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bae8b7-306a-4492-a72a-0a92069726de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:10:49.825049 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bae8b7-306a-4492-a72a-0a92069726de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:10:49.826413 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bae8b7-306a-4492-a72a-0a92069726de service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:10:49.836092 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4427/8829] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:10:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:10:50.931713 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27efdb2-0ab0-4ff9-9ab8-53a79c29aac8 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:10:50.932178 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27efdb2-0ab0-4ff9-9ab8-53a79c29aac8 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:10:50.932280 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27efdb2-0ab0-4ff9-9ab8-53a79c29aac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:10:50.961380 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-b27efdb2-0ab0-4ff9-9ab8-53a79c29aac8 None None] MFA Rules not processed for user `463dbb858c1a48b9b97114f048713624`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:10:50.962616 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b27efdb2-0ab0-4ff9-9ab8-53a79c29aac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:10:51.028279 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4403/8830] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 22:10:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:10:51.038800 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f858eb-3e08-4f21-b64e-013951ad5fdb None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:10:51.039307 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f858eb-3e08-4f21-b64e-013951ad5fdb None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:10:51.039403 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f858eb-3e08-4f21-b64e-013951ad5fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:10:51.056192 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-d3f858eb-3e08-4f21-b64e-013951ad5fdb None None] MFA Rules not processed for user `463dbb858c1a48b9b97114f048713624`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:10:51.057394 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d3f858eb-3e08-4f21-b64e-013951ad5fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:10:51.064294 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4428/8831] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 22:10:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:10:51.075613 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27efdb2-0ab0-4ff9-9ab8-53a79c29aac8 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:10:51.077022 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b27efdb2-0ab0-4ff9-9ab8-53a79c29aac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:10:51.149203 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27efdb2-0ab0-4ff9-9ab8-53a79c29aac8 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:10:51.154584 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895395e2-8150-4171-9074-c4891d9f86c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:10:51.155227 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895395e2-8150-4171-9074-c4891d9f86c7 service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:10:51.155539 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895395e2-8150-4171-9074-c4891d9f86c7 service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:10:51.155817 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895395e2-8150-4171-9074-c4891d9f86c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:10:51.164655 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895395e2-8150-4171-9074-c4891d9f86c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:10:51.166228 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895395e2-8150-4171-9074-c4891d9f86c7 service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:10:51.175564 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4404/8832] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:10:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:10:51.401099 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5ba54-d495-4fb4-884d-0587922028e8 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:10:51.401394 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5ba54-d495-4fb4-884d-0587922028e8 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:10:51.401679 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5ba54-d495-4fb4-884d-0587922028e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:10:51.419959 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-8ea5ba54-d495-4fb4-884d-0587922028e8 None None] MFA Rules not processed for user `99ed32a6d699453bb7e088540e8fc980`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:10:51.421151 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-8ea5ba54-d495-4fb4-884d-0587922028e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:10:51.428152 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4429/8833] 10.222.0.52 () {58 vars in 1009 bytes} [Sat May 14 22:10:51 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:10:51.439683 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895395e2-8150-4171-9074-c4891d9f86c7 service nova] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:10:51.449566 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895395e2-8150-4171-9074-c4891d9f86c7 service nova] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:10:51.453146 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7feb58-7c13-428c-8974-f9986ca09cb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:10:51.453778 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7feb58-7c13-428c-8974-f9986ca09cb2 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:10:51.454063 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7feb58-7c13-428c-8974-f9986ca09cb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:10:51.454345 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7feb58-7c13-428c-8974-f9986ca09cb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:10:51.462079 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7feb58-7c13-428c-8974-f9986ca09cb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:10:51.463525 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7feb58-7c13-428c-8974-f9986ca09cb2 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:10:51.471469 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4405/8834] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:10:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:10:51.858758 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea5ba54-d495-4fb4-884d-0587922028e8 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:10:51.860176 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-8ea5ba54-d495-4fb4-884d-0587922028e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:10:51.931250 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea5ba54-d495-4fb4-884d-0587922028e8 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:10:51.935886 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c2b089-4f14-414f-ae7a-76fe26f77d08 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:10:51.936526 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c2b089-4f14-414f-ae7a-76fe26f77d08 service placement] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:10:51.936806 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c2b089-4f14-414f-ae7a-76fe26f77d08 service placement] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:10:51.937080 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c2b089-4f14-414f-ae7a-76fe26f77d08 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:10:51.938815 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d4c2b089-4f14-414f-ae7a-76fe26f77d08 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:10:51.949889 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c2b089-4f14-414f-ae7a-76fe26f77d08 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:10:51.951390 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c2b089-4f14-414f-ae7a-76fe26f77d08 service placement] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:10:51.960955 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4430/8835] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:10:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:11:01.202977 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea093a-1b30-4e86-9372-cf1b331a046f None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:11:01.203786 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea093a-1b30-4e86-9372-cf1b331a046f None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:11:01.203996 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea093a-1b30-4e86-9372-cf1b331a046f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:11:01.223913 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-e5ea093a-1b30-4e86-9372-cf1b331a046f None None] MFA Rules not processed for user `463dbb858c1a48b9b97114f048713624`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:11:01.225157 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e5ea093a-1b30-4e86-9372-cf1b331a046f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:11:01.232023 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4406/8836] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 22:11:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:11:21.669734 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c2b089-4f14-414f-ae7a-76fe26f77d08 service placement] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:11:21.683281 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c2b089-4f14-414f-ae7a-76fe26f77d08 service placement] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:11:21.687947 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85484b22-169c-4667-8027-813262507bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:11:21.688802 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85484b22-169c-4667-8027-813262507bb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:11:21.689117 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85484b22-169c-4667-8027-813262507bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:11:21.689349 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85484b22-169c-4667-8027-813262507bb6 admin admin] PATH_INFO: `/v3/users/463dbb858c1a48b9b97114f048713624` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:11:21.690519 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85484b22-169c-4667-8027-813262507bb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=463dbb858c1a48b9b97114f048713624)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:11:21.693141 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85484b22-169c-4667-8027-813262507bb6 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:11:21.876583 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-85484b22-169c-4667-8027-813262507bb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '463dbb858c1a48b9b97114f048713624'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:11:21.888244 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-85484b22-169c-4667-8027-813262507bb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '463dbb858c1a48b9b97114f048713624'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:11:21.895463 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-85484b22-169c-4667-8027-813262507bb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '463dbb858c1a48b9b97114f048713624'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:11:21.953957 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-85484b22-169c-4667-8027-813262507bb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '463dbb858c1a48b9b97114f048713624'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:11:21.954579 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-85484b22-169c-4667-8027-813262507bb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '463dbb858c1a48b9b97114f048713624'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:11:21.961031 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4431/8837] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 22:11:21 2022] DELETE /identity/v3/users/463dbb858c1a48b9b97114f048713624 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 22:11:22.207103 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ea093a-1b30-4e86-9372-cf1b331a046f None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:11:22.221224 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ea093a-1b30-4e86-9372-cf1b331a046f None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:11:22.276793 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4bd869-f46e-4726-bb08-d55bff5e2618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:11:22.277647 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4bd869-f46e-4726-bb08-d55bff5e2618 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:11:22.277933 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4bd869-f46e-4726-bb08-d55bff5e2618 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:11:22.278211 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4bd869-f46e-4726-bb08-d55bff5e2618 admin admin] PATH_INFO: `/v3/projects/cbd3e2d31b0341d2b7131a387bfa33f2` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:11:22.279499 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4bd869-f46e-4726-bb08-d55bff5e2618 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbd3e2d31b0341d2b7131a387bfa33f2)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:11:22.281660 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4bd869-f46e-4726-bb08-d55bff5e2618 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:11:22.381930 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-cc4bd869-f46e-4726-bb08-d55bff5e2618 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbd3e2d31b0341d2b7131a387bfa33f2', 'request_id': 'req-cc4bd869-f46e-4726-bb08-d55bff5e2618'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:11:22.387297 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-cc4bd869-f46e-4726-bb08-d55bff5e2618 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbd3e2d31b0341d2b7131a387bfa33f2', 'request_id': 'req-cc4bd869-f46e-4726-bb08-d55bff5e2618'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:11:22.393637 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-cc4bd869-f46e-4726-bb08-d55bff5e2618 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbd3e2d31b0341d2b7131a387bfa33f2', 'request_id': 'req-cc4bd869-f46e-4726-bb08-d55bff5e2618'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:11:22.477161 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-cc4bd869-f46e-4726-bb08-d55bff5e2618 admin admin] The token cache is being invalidate because project cbd3e2d31b0341d2b7131a387bfa33f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 22:11:22.477396 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-cc4bd869-f46e-4726-bb08-d55bff5e2618 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:11:22.478037 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-cc4bd869-f46e-4726-bb08-d55bff5e2618 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:11:22.479647 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4407/8838] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 22:11:22 2022] DELETE /identity/v3/projects/cbd3e2d31b0341d2b7131a387bfa33f2 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 22:11:22.484783 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4cfb87-4283-408f-8110-7cc277d151f5 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:11:22.486638 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4cfb87-4283-408f-8110-7cc277d151f5 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:11:22.486638 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4cfb87-4283-408f-8110-7cc277d151f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:11:22.505762 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-8f4cfb87-4283-408f-8110-7cc277d151f5 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:11:22.506981 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-8f4cfb87-4283-408f-8110-7cc277d151f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:11:22.565015 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4432/8839] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 22:11:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:11:22.573715 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648eec17-b13e-4222-914a-e8ef71298734 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:11:22.574009 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648eec17-b13e-4222-914a-e8ef71298734 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:11:22.574294 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648eec17-b13e-4222-914a-e8ef71298734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:11:22.592544 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-648eec17-b13e-4222-914a-e8ef71298734 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:11:22.593740 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-648eec17-b13e-4222-914a-e8ef71298734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:11:22.602632 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4408/8840] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 22:11:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:11:22.606659 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4cfb87-4283-408f-8110-7cc277d151f5 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:11:22.616944 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4cfb87-4283-408f-8110-7cc277d151f5 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:11:22.621442 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ca651e-13bd-4c17-a318-4e85b1087cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:11:22.622089 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca651e-13bd-4c17-a318-4e85b1087cb3 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:11:22.622367 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca651e-13bd-4c17-a318-4e85b1087cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:11:22.622668 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca651e-13bd-4c17-a318-4e85b1087cb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:11:22.623384 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ca651e-13bd-4c17-a318-4e85b1087cb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 22:11:22.623720 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ca651e-13bd-4c17-a318-4e85b1087cb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:11:22.625309 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ca651e-13bd-4c17-a318-4e85b1087cb3 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:11:22.636576 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4433/8841] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 22:11:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 22:11:22.640627 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648eec17-b13e-4222-914a-e8ef71298734 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:11:22.650127 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648eec17-b13e-4222-914a-e8ef71298734 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:11:22.654856 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938a0626-39ff-4fb2-9de6-aee95becb8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:11:22.655551 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938a0626-39ff-4fb2-9de6-aee95becb8a9 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:11:22.655836 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938a0626-39ff-4fb2-9de6-aee95becb8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:11:22.656113 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938a0626-39ff-4fb2-9de6-aee95becb8a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:11:22.656813 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938a0626-39ff-4fb2-9de6-aee95becb8a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:11:22.658718 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938a0626-39ff-4fb2-9de6-aee95becb8a9 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:11:22.732345 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4409/8842] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 22:11:22 2022] POST /identity/v3/projects => generated 369 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 22:11:22.736544 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ca651e-13bd-4c17-a318-4e85b1087cb3 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:11:22.747841 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ca651e-13bd-4c17-a318-4e85b1087cb3 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:11:22.803945 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6cea66-4540-4abd-8d7d-978da03eba67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:11:22.804672 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6cea66-4540-4abd-8d7d-978da03eba67 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:11:22.804958 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6cea66-4540-4abd-8d7d-978da03eba67 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:11:22.805238 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6cea66-4540-4abd-8d7d-978da03eba67 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:11:22.805919 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6cea66-4540-4abd-8d7d-978da03eba67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:11:22.807966 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6cea66-4540-4abd-8d7d-978da03eba67 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:11:22.874421 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4434/8843] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 22:11:22 2022] POST /identity/v3/users => generated 285 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 22:11:22.878649 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938a0626-39ff-4fb2-9de6-aee95becb8a9 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:11:22.889005 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938a0626-39ff-4fb2-9de6-aee95becb8a9 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:11:22.893694 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab200dc-f68a-4b0c-a5ad-9b3c4eef4fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:11:22.894342 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab200dc-f68a-4b0c-a5ad-9b3c4eef4fc1 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:11:22.894622 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab200dc-f68a-4b0c-a5ad-9b3c4eef4fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:11:22.894946 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab200dc-f68a-4b0c-a5ad-9b3c4eef4fc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:11:22.895711 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab200dc-f68a-4b0c-a5ad-9b3c4eef4fc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:11:22.897306 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab200dc-f68a-4b0c-a5ad-9b3c4eef4fc1 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:11:22.908908 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4410/8844] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 22:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 22:11:22.913565 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6cea66-4540-4abd-8d7d-978da03eba67 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:11:22.924449 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6cea66-4540-4abd-8d7d-978da03eba67 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:11:22.930145 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6093e509-3a99-4ebf-bc68-f4fa88fe39f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:11:22.930827 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093e509-3a99-4ebf-bc68-f4fa88fe39f9 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:11:22.931113 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093e509-3a99-4ebf-bc68-f4fa88fe39f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:11:22.931391 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093e509-3a99-4ebf-bc68-f4fa88fe39f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:11:22.932214 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6093e509-3a99-4ebf-bc68-f4fa88fe39f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:11:22.933823 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6093e509-3a99-4ebf-bc68-f4fa88fe39f9 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:11:22.944705 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4435/8845] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 22:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 22:11:22.948997 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab200dc-f68a-4b0c-a5ad-9b3c4eef4fc1 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:11:22.959465 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab200dc-f68a-4b0c-a5ad-9b3c4eef4fc1 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:11:22.964026 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26b93fa-7794-4c68-9bf3-7e179351f368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:11:22.964886 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b93fa-7794-4c68-9bf3-7e179351f368 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:11:22.965168 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b93fa-7794-4c68-9bf3-7e179351f368 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:11:22.965440 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b93fa-7794-4c68-9bf3-7e179351f368 admin admin] PATH_INFO: `/v3/projects/b607b5f0135a4c3bbced32a418b18a48/users/5ccaf03aa3d545e5abcc333629eb4de8/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:11:22.979754 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26b93fa-7794-4c68-9bf3-7e179351f368 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b607b5f0135a4c3bbced32a418b18a48, user_id=5ccaf03aa3d545e5abcc333629eb4de8, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:11:22.982476 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26b93fa-7794-4c68-9bf3-7e179351f368 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:11:23.056863 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4411/8846] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 22:11:22 2022] PUT /identity/v3/projects/b607b5f0135a4c3bbced32a418b18a48/users/5ccaf03aa3d545e5abcc333629eb4de8/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 22:11:23.118013 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc760d0-4a39-4ca1-8a59-fae8eb41f309 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:11:23.118307 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc760d0-4a39-4ca1-8a59-fae8eb41f309 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:11:23.118592 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc760d0-4a39-4ca1-8a59-fae8eb41f309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:11:23.150525 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-6fc760d0-4a39-4ca1-8a59-fae8eb41f309 None None] MFA Rules not processed for user `5ccaf03aa3d545e5abcc333629eb4de8`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:11:23.151818 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-6fc760d0-4a39-4ca1-8a59-fae8eb41f309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:11:23.215230 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4436/8847] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 22:11:23 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:11:23.225841 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26b93fa-7794-4c68-9bf3-7e179351f368 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:11:23.227679 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b26b93fa-7794-4c68-9bf3-7e179351f368 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:11:23.283521 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26b93fa-7794-4c68-9bf3-7e179351f368 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:11:23.288767 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3654983-5e42-4517-970d-ead373d5e7d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:11:23.289409 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3654983-5e42-4517-970d-ead373d5e7d1 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:11:23.289726 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3654983-5e42-4517-970d-ead373d5e7d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:11:23.290004 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3654983-5e42-4517-970d-ead373d5e7d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:11:23.298416 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3654983-5e42-4517-970d-ead373d5e7d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:11:23.299894 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3654983-5e42-4517-970d-ead373d5e7d1 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:11:23.309266 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4412/8848] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:11:23 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:11:40.599339 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc760d0-4a39-4ca1-8a59-fae8eb41f309 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:11:40.663467 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc760d0-4a39-4ca1-8a59-fae8eb41f309 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:11:40.667938 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90965676-367a-4e86-bfa9-fd38aa70caa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:11:40.668802 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90965676-367a-4e86-bfa9-fd38aa70caa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:11:40.669080 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90965676-367a-4e86-bfa9-fd38aa70caa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:11:40.669356 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90965676-367a-4e86-bfa9-fd38aa70caa8 admin admin] PATH_INFO: `/v3/users/5ccaf03aa3d545e5abcc333629eb4de8` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:11:40.670521 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90965676-367a-4e86-bfa9-fd38aa70caa8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ccaf03aa3d545e5abcc333629eb4de8)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:11:40.672467 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90965676-367a-4e86-bfa9-fd38aa70caa8 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:11:40.875566 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-90965676-367a-4e86-bfa9-fd38aa70caa8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ccaf03aa3d545e5abcc333629eb4de8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:11:40.887455 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-90965676-367a-4e86-bfa9-fd38aa70caa8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ccaf03aa3d545e5abcc333629eb4de8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:11:40.894148 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-90965676-367a-4e86-bfa9-fd38aa70caa8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ccaf03aa3d545e5abcc333629eb4de8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:11:41.033621 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-90965676-367a-4e86-bfa9-fd38aa70caa8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ccaf03aa3d545e5abcc333629eb4de8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:11:41.034249 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-90965676-367a-4e86-bfa9-fd38aa70caa8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ccaf03aa3d545e5abcc333629eb4de8'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:11:41.041313 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4437/8849] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 22:11:40 2022] DELETE /identity/v3/users/5ccaf03aa3d545e5abcc333629eb4de8 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 22:11:41.046112 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a5a054-3259-44b4-a7a9-45916ae65fb0 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:11:41.046601 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a5a054-3259-44b4-a7a9-45916ae65fb0 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:11:41.046701 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a5a054-3259-44b4-a7a9-45916ae65fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:11:41.064281 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-26a5a054-3259-44b4-a7a9-45916ae65fb0 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:11:41.065481 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-26a5a054-3259-44b4-a7a9-45916ae65fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:11:41.123537 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4413/8850] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 22:11:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:11:41.134127 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90965676-367a-4e86-bfa9-fd38aa70caa8 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:11:41.135634 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-90965676-367a-4e86-bfa9-fd38aa70caa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:11:41.191907 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90965676-367a-4e86-bfa9-fd38aa70caa8 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:11:41.195724 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64f322c-b966-42b1-86b2-2073f60c2445 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:11:41.196372 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f322c-b966-42b1-86b2-2073f60c2445 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:11:41.196660 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f322c-b966-42b1-86b2-2073f60c2445 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:11:41.196937 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f322c-b966-42b1-86b2-2073f60c2445 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:11:41.205917 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64f322c-b966-42b1-86b2-2073f60c2445 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:11:41.207349 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64f322c-b966-42b1-86b2-2073f60c2445 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:11:41.217301 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4438/8851] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:11:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:11:41.456809 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a5a054-3259-44b4-a7a9-45916ae65fb0 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:11:41.458894 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-26a5a054-3259-44b4-a7a9-45916ae65fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:11:41.470867 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a5a054-3259-44b4-a7a9-45916ae65fb0 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:11:41.476376 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d37e821-2893-4850-a14e-50c394b4f769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:11:41.477217 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37e821-2893-4850-a14e-50c394b4f769 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:11:41.477602 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37e821-2893-4850-a14e-50c394b4f769 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:11:41.477813 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37e821-2893-4850-a14e-50c394b4f769 admin admin] PATH_INFO: `/v3/projects/b607b5f0135a4c3bbced32a418b18a48` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:11:41.479094 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d37e821-2893-4850-a14e-50c394b4f769 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b607b5f0135a4c3bbced32a418b18a48)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:11:41.481122 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d37e821-2893-4850-a14e-50c394b4f769 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:11:41.602571 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4d37e821-2893-4850-a14e-50c394b4f769 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b607b5f0135a4c3bbced32a418b18a48', 'request_id': 'req-4d37e821-2893-4850-a14e-50c394b4f769'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:11:41.607816 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4d37e821-2893-4850-a14e-50c394b4f769 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b607b5f0135a4c3bbced32a418b18a48', 'request_id': 'req-4d37e821-2893-4850-a14e-50c394b4f769'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:11:41.614975 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4d37e821-2893-4850-a14e-50c394b4f769 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b607b5f0135a4c3bbced32a418b18a48', 'request_id': 'req-4d37e821-2893-4850-a14e-50c394b4f769'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:11:41.684366 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4d37e821-2893-4850-a14e-50c394b4f769 admin admin] The token cache is being invalidate because project b607b5f0135a4c3bbced32a418b18a48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 22:11:41.684653 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4d37e821-2893-4850-a14e-50c394b4f769 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:11:41.685453 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-4d37e821-2893-4850-a14e-50c394b4f769 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:11:41.687099 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4414/8852] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 22:11:41 2022] DELETE /identity/v3/projects/b607b5f0135a4c3bbced32a418b18a48 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 22:11:41.692446 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e9c312-c443-4db5-a223-ca8255928ab1 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:11:41.693657 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e9c312-c443-4db5-a223-ca8255928ab1 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:11:41.693657 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e9c312-c443-4db5-a223-ca8255928ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:11:41.710940 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-45e9c312-c443-4db5-a223-ca8255928ab1 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:11:41.712173 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-45e9c312-c443-4db5-a223-ca8255928ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:11:41.771039 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4439/8853] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 22:11:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:11:41.778907 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf2bd4-8866-4b6a-bb30-86ae69b28d66 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:11:41.779198 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf2bd4-8866-4b6a-bb30-86ae69b28d66 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:11:41.779507 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf2bd4-8866-4b6a-bb30-86ae69b28d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:11:41.797852 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-cddf2bd4-8866-4b6a-bb30-86ae69b28d66 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:11:41.799060 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-cddf2bd4-8866-4b6a-bb30-86ae69b28d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:11:41.807570 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4415/8854] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 22:11:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:11:41.811626 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e9c312-c443-4db5-a223-ca8255928ab1 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:11:41.821459 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e9c312-c443-4db5-a223-ca8255928ab1 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:11:41.826068 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308004df-48df-45f6-a936-8db298136a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:11:41.826711 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308004df-48df-45f6-a936-8db298136a19 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:11:41.826990 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308004df-48df-45f6-a936-8db298136a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:11:41.827264 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308004df-48df-45f6-a936-8db298136a19 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:11:41.828011 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308004df-48df-45f6-a936-8db298136a19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 22:11:41.828322 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308004df-48df-45f6-a936-8db298136a19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:11:41.829941 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308004df-48df-45f6-a936-8db298136a19 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:11:41.841889 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4440/8855] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 22:11:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 22:11:41.846113 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddf2bd4-8866-4b6a-bb30-86ae69b28d66 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:11:41.856218 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddf2bd4-8866-4b6a-bb30-86ae69b28d66 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:11:41.861079 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b355e552-5f2e-4d7c-964d-b31e9c9f8650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:11:41.861727 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b355e552-5f2e-4d7c-964d-b31e9c9f8650 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:11:41.862012 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b355e552-5f2e-4d7c-964d-b31e9c9f8650 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:11:41.862287 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b355e552-5f2e-4d7c-964d-b31e9c9f8650 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:11:41.862979 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b355e552-5f2e-4d7c-964d-b31e9c9f8650 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:11:41.865018 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b355e552-5f2e-4d7c-964d-b31e9c9f8650 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:11:41.929437 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4416/8856] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 22:11:41 2022] POST /identity/v3/projects => generated 375 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 22:11:41.930719 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308004df-48df-45f6-a936-8db298136a19 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:11:41.941167 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308004df-48df-45f6-a936-8db298136a19 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:11:41.996695 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c819c6dc-aac2-4f18-a0f7-339b7a334d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:11:41.997287 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819c6dc-aac2-4f18-a0f7-339b7a334d6d admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:11:41.997582 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819c6dc-aac2-4f18-a0f7-339b7a334d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:11:41.997855 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819c6dc-aac2-4f18-a0f7-339b7a334d6d admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:11:41.998544 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c819c6dc-aac2-4f18-a0f7-339b7a334d6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:11:42.000547 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c819c6dc-aac2-4f18-a0f7-339b7a334d6d admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:11:42.068926 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4441/8857] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 22:11:41 2022] POST /identity/v3/users => generated 288 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 22:11:42.073006 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b355e552-5f2e-4d7c-964d-b31e9c9f8650 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:11:42.084057 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b355e552-5f2e-4d7c-964d-b31e9c9f8650 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:11:42.088657 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6be5f1-ad28-4029-9b32-c063a1413355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:11:42.089307 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6be5f1-ad28-4029-9b32-c063a1413355 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:11:42.089588 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6be5f1-ad28-4029-9b32-c063a1413355 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:11:42.089883 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6be5f1-ad28-4029-9b32-c063a1413355 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:11:42.090588 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6be5f1-ad28-4029-9b32-c063a1413355 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:11:42.092223 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6be5f1-ad28-4029-9b32-c063a1413355 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:11:42.102400 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4417/8858] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 22:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 22:11:42.106144 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c819c6dc-aac2-4f18-a0f7-339b7a334d6d admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:11:42.116723 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c819c6dc-aac2-4f18-a0f7-339b7a334d6d admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:11:42.121729 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57152148-29a8-4948-8d8c-35c9bc41522c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:11:42.122401 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57152148-29a8-4948-8d8c-35c9bc41522c admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:11:42.122682 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57152148-29a8-4948-8d8c-35c9bc41522c admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:11:42.122955 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57152148-29a8-4948-8d8c-35c9bc41522c admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:11:42.123708 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57152148-29a8-4948-8d8c-35c9bc41522c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:11:42.125323 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57152148-29a8-4948-8d8c-35c9bc41522c admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:11:42.138065 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4442/8859] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 22:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 22:11:42.142188 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6be5f1-ad28-4029-9b32-c063a1413355 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:11:42.153018 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6be5f1-ad28-4029-9b32-c063a1413355 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:11:42.157672 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ed235-f23f-4bab-b403-1f8599932595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:11:42.158538 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ed235-f23f-4bab-b403-1f8599932595 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:11:42.158823 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ed235-f23f-4bab-b403-1f8599932595 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:11:42.159100 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ed235-f23f-4bab-b403-1f8599932595 admin admin] PATH_INFO: `/v3/projects/38fffeb99e874697a310d3fef990608a/users/0213ecf8e0ce44d883ef63a61ca28c70/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:11:42.173539 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70ed235-f23f-4bab-b403-1f8599932595 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38fffeb99e874697a310d3fef990608a, user_id=0213ecf8e0ce44d883ef63a61ca28c70, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:11:42.176253 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70ed235-f23f-4bab-b403-1f8599932595 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:11:42.262796 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4418/8860] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 22:11:42 2022] PUT /identity/v3/projects/38fffeb99e874697a310d3fef990608a/users/0213ecf8e0ce44d883ef63a61ca28c70/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 22:11:42.273537 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a0ad64-8d1d-4684-9f1d-bff376dc5cf8 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:11:42.273825 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a0ad64-8d1d-4684-9f1d-bff376dc5cf8 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:11:42.274107 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a0ad64-8d1d-4684-9f1d-bff376dc5cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:11:42.300750 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-76a0ad64-8d1d-4684-9f1d-bff376dc5cf8 None None] MFA Rules not processed for user `0213ecf8e0ce44d883ef63a61ca28c70`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:11:42.302014 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-76a0ad64-8d1d-4684-9f1d-bff376dc5cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:11:42.366856 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4443/8861] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 22:11:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:11:42.376764 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ed235-f23f-4bab-b403-1f8599932595 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:11:42.378454 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b70ed235-f23f-4bab-b403-1f8599932595 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:11:42.436634 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ed235-f23f-4bab-b403-1f8599932595 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:11:42.440353 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f8a180-aaa7-41e4-aad6-b601ae70533d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:11:42.440996 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f8a180-aaa7-41e4-aad6-b601ae70533d service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:11:42.441277 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f8a180-aaa7-41e4-aad6-b601ae70533d service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:11:42.441553 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f8a180-aaa7-41e4-aad6-b601ae70533d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:11:42.450906 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f8a180-aaa7-41e4-aad6-b601ae70533d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:11:42.452374 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f8a180-aaa7-41e4-aad6-b601ae70533d service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:11:42.461293 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4419/8862] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:11:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:11:48.925115 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a0ad64-8d1d-4684-9f1d-bff376dc5cf8 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:11:48.986545 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a0ad64-8d1d-4684-9f1d-bff376dc5cf8 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:11:48.991617 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6270db-30b4-444e-b178-1011c713d6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:11:48.992509 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6270db-30b4-444e-b178-1011c713d6fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:11:48.992788 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6270db-30b4-444e-b178-1011c713d6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:11:48.993061 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6270db-30b4-444e-b178-1011c713d6fb admin admin] PATH_INFO: `/v3/users/0213ecf8e0ce44d883ef63a61ca28c70` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:11:48.994252 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6270db-30b4-444e-b178-1011c713d6fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=0213ecf8e0ce44d883ef63a61ca28c70)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:11:48.996222 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6270db-30b4-444e-b178-1011c713d6fb admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:11:49.177852 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-7c6270db-30b4-444e-b178-1011c713d6fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0213ecf8e0ce44d883ef63a61ca28c70'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:11:49.189214 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-7c6270db-30b4-444e-b178-1011c713d6fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0213ecf8e0ce44d883ef63a61ca28c70'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:11:49.195841 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-7c6270db-30b4-444e-b178-1011c713d6fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0213ecf8e0ce44d883ef63a61ca28c70'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:11:49.290520 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-7c6270db-30b4-444e-b178-1011c713d6fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0213ecf8e0ce44d883ef63a61ca28c70'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:11:49.291170 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-7c6270db-30b4-444e-b178-1011c713d6fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0213ecf8e0ce44d883ef63a61ca28c70'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:11:49.297638 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4444/8863] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 22:11:48 2022] DELETE /identity/v3/users/0213ecf8e0ce44d883ef63a61ca28c70 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 22:11:49.302426 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d51fb2-cf5e-40e3-8539-128f5ca536f9 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:11:49.302913 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d51fb2-cf5e-40e3-8539-128f5ca536f9 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:11:49.303047 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d51fb2-cf5e-40e3-8539-128f5ca536f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:11:49.320743 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-27d51fb2-cf5e-40e3-8539-128f5ca536f9 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:11:49.322023 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-27d51fb2-cf5e-40e3-8539-128f5ca536f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:11:49.380031 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4420/8864] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 22:11:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:11:49.389602 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6270db-30b4-444e-b178-1011c713d6fb admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:11:49.390998 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-7c6270db-30b4-444e-b178-1011c713d6fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:11:49.446842 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6270db-30b4-444e-b178-1011c713d6fb admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:11:49.450354 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6df3162-3ec0-4341-a731-2a5c3f11b614 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:11:49.450991 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df3162-3ec0-4341-a731-2a5c3f11b614 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:11:49.451274 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df3162-3ec0-4341-a731-2a5c3f11b614 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:11:49.451582 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df3162-3ec0-4341-a731-2a5c3f11b614 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:11:49.461019 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6df3162-3ec0-4341-a731-2a5c3f11b614 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:11:49.462439 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6df3162-3ec0-4341-a731-2a5c3f11b614 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:11:49.471829 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4445/8865] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:11:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:11:49.726333 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d51fb2-cf5e-40e3-8539-128f5ca536f9 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:11:49.727857 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-27d51fb2-cf5e-40e3-8539-128f5ca536f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:11:49.739794 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d51fb2-cf5e-40e3-8539-128f5ca536f9 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:11:49.744472 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d5eeb6-e334-4294-a102-ebb2d28f46d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:11:49.745409 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d5eeb6-e334-4294-a102-ebb2d28f46d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:11:49.745757 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d5eeb6-e334-4294-a102-ebb2d28f46d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:11:49.746121 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d5eeb6-e334-4294-a102-ebb2d28f46d2 admin admin] PATH_INFO: `/v3/projects/38fffeb99e874697a310d3fef990608a` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:11:49.747363 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d5eeb6-e334-4294-a102-ebb2d28f46d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38fffeb99e874697a310d3fef990608a)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:11:49.749363 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d5eeb6-e334-4294-a102-ebb2d28f46d2 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:11:49.850883 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a1d5eeb6-e334-4294-a102-ebb2d28f46d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38fffeb99e874697a310d3fef990608a', 'request_id': 'req-a1d5eeb6-e334-4294-a102-ebb2d28f46d2'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:11:49.856119 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a1d5eeb6-e334-4294-a102-ebb2d28f46d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38fffeb99e874697a310d3fef990608a', 'request_id': 'req-a1d5eeb6-e334-4294-a102-ebb2d28f46d2'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:11:49.862353 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a1d5eeb6-e334-4294-a102-ebb2d28f46d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38fffeb99e874697a310d3fef990608a', 'request_id': 'req-a1d5eeb6-e334-4294-a102-ebb2d28f46d2'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:11:49.947902 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a1d5eeb6-e334-4294-a102-ebb2d28f46d2 admin admin] The token cache is being invalidate because project 38fffeb99e874697a310d3fef990608a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 22:11:49.948189 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a1d5eeb6-e334-4294-a102-ebb2d28f46d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:11:49.948815 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-a1d5eeb6-e334-4294-a102-ebb2d28f46d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:11:49.950547 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4421/8866] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 22:11:49 2022] DELETE /identity/v3/projects/38fffeb99e874697a310d3fef990608a => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 22:11:49.956468 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6839644f-3e72-4e54-882d-d21d94e4342a None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:11:49.957699 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6839644f-3e72-4e54-882d-d21d94e4342a None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:11:49.957699 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6839644f-3e72-4e54-882d-d21d94e4342a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:11:49.975327 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-6839644f-3e72-4e54-882d-d21d94e4342a None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:11:49.976932 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-6839644f-3e72-4e54-882d-d21d94e4342a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:11:50.035309 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4446/8867] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 22:11:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 22:11:50.043430 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ce873-3419-45ae-badd-10a80a0d8ada None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:11:50.043750 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ce873-3419-45ae-badd-10a80a0d8ada None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:11:50.044029 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ce873-3419-45ae-badd-10a80a0d8ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:11:50.062496 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-aa2ce873-3419-45ae-badd-10a80a0d8ada None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:11:50.063715 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-aa2ce873-3419-45ae-badd-10a80a0d8ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:11:50.072233 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4422/8868] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 22:11:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:11:50.076365 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6839644f-3e72-4e54-882d-d21d94e4342a None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:11:50.085966 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6839644f-3e72-4e54-882d-d21d94e4342a None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:11:50.090523 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1325d873-3a5a-4fb1-bdda-441b2c307f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:11:50.091173 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325d873-3a5a-4fb1-bdda-441b2c307f75 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:11:50.091451 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325d873-3a5a-4fb1-bdda-441b2c307f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:11:50.091755 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325d873-3a5a-4fb1-bdda-441b2c307f75 admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:11:50.092467 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1325d873-3a5a-4fb1-bdda-441b2c307f75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 22:11:50.092771 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1325d873-3a5a-4fb1-bdda-441b2c307f75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:11:50.094359 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1325d873-3a5a-4fb1-bdda-441b2c307f75 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:11:50.105574 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4447/8869] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 22:11:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 22:11:50.109892 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2ce873-3419-45ae-badd-10a80a0d8ada None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:11:50.119833 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2ce873-3419-45ae-badd-10a80a0d8ada None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:11:50.124524 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff33652-1bb2-49bd-b14d-b3491bd382b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:11:50.125173 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff33652-1bb2-49bd-b14d-b3491bd382b0 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:11:50.125461 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff33652-1bb2-49bd-b14d-b3491bd382b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:11:50.125746 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff33652-1bb2-49bd-b14d-b3491bd382b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:11:50.126425 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff33652-1bb2-49bd-b14d-b3491bd382b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:11:50.128400 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff33652-1bb2-49bd-b14d-b3491bd382b0 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:11:50.298066 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4423/8870] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 22:11:50 2022] POST /identity/v3/projects => generated 383 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 22:11:50.303353 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1325d873-3a5a-4fb1-bdda-441b2c307f75 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:11:50.313949 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1325d873-3a5a-4fb1-bdda-441b2c307f75 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:11:50.368625 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a82a1-fad6-4ffb-b6ef-ec60576de804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:11:50.369283 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a82a1-fad6-4ffb-b6ef-ec60576de804 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:11:50.369563 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a82a1-fad6-4ffb-b6ef-ec60576de804 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:11:50.369834 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a82a1-fad6-4ffb-b6ef-ec60576de804 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:11:50.370512 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647a82a1-fad6-4ffb-b6ef-ec60576de804 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:11:50.372452 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647a82a1-fad6-4ffb-b6ef-ec60576de804 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:11:50.482991 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4448/8871] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 22:11:50 2022] POST /identity/v3/users => generated 292 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 22:11:50.487075 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff33652-1bb2-49bd-b14d-b3491bd382b0 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:11:50.498195 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff33652-1bb2-49bd-b14d-b3491bd382b0 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:11:50.502826 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5338e6e-b017-4e7e-8fe3-df62dacb975e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:11:50.503505 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5338e6e-b017-4e7e-8fe3-df62dacb975e admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:11:50.503793 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5338e6e-b017-4e7e-8fe3-df62dacb975e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:11:50.504071 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5338e6e-b017-4e7e-8fe3-df62dacb975e admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:11:50.504839 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5338e6e-b017-4e7e-8fe3-df62dacb975e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:11:50.506765 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5338e6e-b017-4e7e-8fe3-df62dacb975e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:11:50.518184 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4424/8872] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 22:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 22:11:50.522311 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a82a1-fad6-4ffb-b6ef-ec60576de804 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:11:50.532485 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a82a1-fad6-4ffb-b6ef-ec60576de804 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:11:50.537898 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea19f03-f89e-438b-8224-75701d2b37f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:11:50.538553 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea19f03-f89e-438b-8224-75701d2b37f9 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:11:50.538841 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea19f03-f89e-438b-8224-75701d2b37f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:11:50.539123 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea19f03-f89e-438b-8224-75701d2b37f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:11:50.539941 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea19f03-f89e-438b-8224-75701d2b37f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:11:50.541546 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea19f03-f89e-438b-8224-75701d2b37f9 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:11:50.552243 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4449/8873] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 22:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 22:11:50.556705 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5338e6e-b017-4e7e-8fe3-df62dacb975e admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:11:50.566510 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5338e6e-b017-4e7e-8fe3-df62dacb975e admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:11:50.571195 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dd9f26-1b2c-410e-9ff5-bf179c713222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:11:50.572107 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd9f26-1b2c-410e-9ff5-bf179c713222 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:11:50.572390 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd9f26-1b2c-410e-9ff5-bf179c713222 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:11:50.572663 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd9f26-1b2c-410e-9ff5-bf179c713222 admin admin] PATH_INFO: `/v3/projects/86b19a25559c4ce7a8a6ee7c86fcab56/users/db572732af5342faacfc59e0841f68bf/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:11:50.586809 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dd9f26-1b2c-410e-9ff5-bf179c713222 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86b19a25559c4ce7a8a6ee7c86fcab56, user_id=db572732af5342faacfc59e0841f68bf, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:11:50.589503 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dd9f26-1b2c-410e-9ff5-bf179c713222 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:11:50.694767 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4425/8874] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 22:11:50 2022] PUT /identity/v3/projects/86b19a25559c4ce7a8a6ee7c86fcab56/users/db572732af5342faacfc59e0841f68bf/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 22:11:50.699946 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc19e8-ab1b-439e-bce9-381dfb2409e3 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:11:50.700238 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc19e8-ab1b-439e-bce9-381dfb2409e3 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:11:50.700520 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc19e8-ab1b-439e-bce9-381dfb2409e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:11:50.718905 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-63fc19e8-ab1b-439e-bce9-381dfb2409e3 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:11:50.720612 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-63fc19e8-ab1b-439e-bce9-381dfb2409e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:11:50.778138 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4450/8875] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 22:11:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:11:50.788842 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dd9f26-1b2c-410e-9ff5-bf179c713222 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:11:50.790646 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-74dd9f26-1b2c-410e-9ff5-bf179c713222 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:11:50.846260 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dd9f26-1b2c-410e-9ff5-bf179c713222 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:11:50.850494 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e74531e-f40a-4784-ab85-0b2c9ba880ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:11:50.851190 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74531e-f40a-4784-ab85-0b2c9ba880ca service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:11:50.851495 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74531e-f40a-4784-ab85-0b2c9ba880ca service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:11:50.851779 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74531e-f40a-4784-ab85-0b2c9ba880ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:11:50.860822 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e74531e-f40a-4784-ab85-0b2c9ba880ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:11:50.862270 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e74531e-f40a-4784-ab85-0b2c9ba880ca service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:11:50.871922 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4426/8876] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:11:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:11:56.251171 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638aa49-9cb8-48a5-81c2-d1af2db871d6 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:11:56.251686 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638aa49-9cb8-48a5-81c2-d1af2db871d6 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:11:56.252419 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638aa49-9cb8-48a5-81c2-d1af2db871d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:11:56.280055 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-7638aa49-9cb8-48a5-81c2-d1af2db871d6 None None] MFA Rules not processed for user `db572732af5342faacfc59e0841f68bf`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:11:56.281299 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-7638aa49-9cb8-48a5-81c2-d1af2db871d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:11:56.350857 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4451/8877] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 22:11:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:11:56.355549 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e74531e-f40a-4784-ab85-0b2c9ba880ca service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:11:56.365751 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e74531e-f40a-4784-ab85-0b2c9ba880ca service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:11:56.370459 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d481c3d4-1058-413a-b8f7-3427cfa4b733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:11:56.371119 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d481c3d4-1058-413a-b8f7-3427cfa4b733 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:11:56.371407 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d481c3d4-1058-413a-b8f7-3427cfa4b733 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:11:56.371739 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d481c3d4-1058-413a-b8f7-3427cfa4b733 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:11:56.372427 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d481c3d4-1058-413a-b8f7-3427cfa4b733 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:11:56.374341 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d481c3d4-1058-413a-b8f7-3427cfa4b733 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:11:56.445026 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4427/8878] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 22:11:56 2022] POST /identity/v3/projects => generated 383 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 22:11:56.449158 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7638aa49-9cb8-48a5-81c2-d1af2db871d6 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:11:56.461070 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7638aa49-9cb8-48a5-81c2-d1af2db871d6 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:11:56.517244 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e5061f-946f-4e24-93ca-1b061d2e157b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:11:56.517925 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5061f-946f-4e24-93ca-1b061d2e157b admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:11:56.518209 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5061f-946f-4e24-93ca-1b061d2e157b admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:11:56.518489 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5061f-946f-4e24-93ca-1b061d2e157b admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:11:56.519184 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e5061f-946f-4e24-93ca-1b061d2e157b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:11:56.521994 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e5061f-946f-4e24-93ca-1b061d2e157b admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:11:56.593462 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4452/8879] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 22:11:56 2022] POST /identity/v3/users => generated 298 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 22:11:56.597297 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d481c3d4-1058-413a-b8f7-3427cfa4b733 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:11:56.607818 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d481c3d4-1058-413a-b8f7-3427cfa4b733 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:11:56.612402 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f514e-5fbe-414d-9d79-f92a028f5dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:11:56.613054 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f514e-5fbe-414d-9d79-f92a028f5dca admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:11:56.613334 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f514e-5fbe-414d-9d79-f92a028f5dca admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:11:56.613605 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f514e-5fbe-414d-9d79-f92a028f5dca admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:11:56.614458 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048f514e-5fbe-414d-9d79-f92a028f5dca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:11:56.616094 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048f514e-5fbe-414d-9d79-f92a028f5dca admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:11:56.626593 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4428/8880] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 22:11:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 22:11:56.631583 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e5061f-946f-4e24-93ca-1b061d2e157b admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:11:56.641687 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e5061f-946f-4e24-93ca-1b061d2e157b admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:11:56.647150 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf1d2c6-885b-4096-b1d1-17f927f445e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:11:56.648086 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf1d2c6-885b-4096-b1d1-17f927f445e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:11:56.648363 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf1d2c6-885b-4096-b1d1-17f927f445e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:11:56.648634 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf1d2c6-885b-4096-b1d1-17f927f445e3 admin admin] PATH_INFO: `/v3/projects/e601c99d735f4ab1b5a0d9bac1b1b602/users/e7db0499024c4914b52f07f1390c86b8/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:11:56.663454 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf1d2c6-885b-4096-b1d1-17f927f445e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e601c99d735f4ab1b5a0d9bac1b1b602, user_id=e7db0499024c4914b52f07f1390c86b8, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:11:56.666131 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf1d2c6-885b-4096-b1d1-17f927f445e3 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:11:56.730473 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4453/8881] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 22:11:56 2022] PUT /identity/v3/projects/e601c99d735f4ab1b5a0d9bac1b1b602/users/e7db0499024c4914b52f07f1390c86b8/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 22:11:56.734642 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f514e-5fbe-414d-9d79-f92a028f5dca admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:11:56.745802 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f514e-5fbe-414d-9d79-f92a028f5dca admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:11:56.803379 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80de798-c187-4f70-9d99-eb21fe8dbf71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:11:56.804136 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80de798-c187-4f70-9d99-eb21fe8dbf71 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:11:56.804423 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80de798-c187-4f70-9d99-eb21fe8dbf71 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:11:56.804704 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80de798-c187-4f70-9d99-eb21fe8dbf71 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:11:56.805428 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80de798-c187-4f70-9d99-eb21fe8dbf71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:11:56.807051 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80de798-c187-4f70-9d99-eb21fe8dbf71 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:11:56.818201 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4429/8882] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 22:11:56 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 22:11:56.822551 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf1d2c6-885b-4096-b1d1-17f927f445e3 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:11:56.833350 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf1d2c6-885b-4096-b1d1-17f927f445e3 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:11:56.838086 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce291b4d-8544-4760-b59b-90cf6dfe4949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:11:56.838964 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce291b4d-8544-4760-b59b-90cf6dfe4949 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:11:56.839242 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce291b4d-8544-4760-b59b-90cf6dfe4949 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:11:56.839547 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce291b4d-8544-4760-b59b-90cf6dfe4949 admin admin] PATH_INFO: `/v3/projects/e601c99d735f4ab1b5a0d9bac1b1b602/users/e7db0499024c4914b52f07f1390c86b8/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:11:56.841535 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce291b4d-8544-4760-b59b-90cf6dfe4949 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e601c99d735f4ab1b5a0d9bac1b1b602, user_id=e7db0499024c4914b52f07f1390c86b8, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:11:56.844336 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce291b4d-8544-4760-b59b-90cf6dfe4949 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:11:56.855609 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4454/8883] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 22:11:56 2022] PUT /identity/v3/projects/e601c99d735f4ab1b5a0d9bac1b1b602/users/e7db0499024c4914b52f07f1390c86b8/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 22:12:02.485119 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e351ce7-6820-48b9-9867-b4e529cf6e1e None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:12:02.485609 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e351ce7-6820-48b9-9867-b4e529cf6e1e None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:12:02.485716 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e351ce7-6820-48b9-9867-b4e529cf6e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:12:02.518828 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-0e351ce7-6820-48b9-9867-b4e529cf6e1e None None] MFA Rules not processed for user `e7db0499024c4914b52f07f1390c86b8`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:12:02.520168 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-0e351ce7-6820-48b9-9867-b4e529cf6e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:12:02.593680 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4430/8884] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 22:12:02 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:12:02.621193 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6600d65c-bdd3-4def-826b-1c7abaf3b534 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:12:02.621601 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6600d65c-bdd3-4def-826b-1c7abaf3b534 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:12:02.621755 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6600d65c-bdd3-4def-826b-1c7abaf3b534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:12:02.673029 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-6600d65c-bdd3-4def-826b-1c7abaf3b534 None None] MFA Rules not processed for user `7b5cb86f190f4fcfb06d66cb8f14643f`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:12:02.674236 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-6600d65c-bdd3-4def-826b-1c7abaf3b534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:12:02.740280 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4455/8885] 10.222.0.52 () {58 vars in 1059 bytes} [Sat May 14 22:12:02 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:12:02.746303 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e351ce7-6820-48b9-9867-b4e529cf6e1e None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:12:02.755884 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e351ce7-6820-48b9-9867-b4e529cf6e1e None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:12:02.759428 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615f4955-f773-4f31-ba6e-224de8f60e15 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b5cb86f190f4fcfb06d66cb8f14643f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:12:02.760104 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f4955-f773-4f31-ba6e-224de8f60e15 service glance] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:12:02.760383 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f4955-f773-4f31-ba6e-224de8f60e15 service glance] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:12:02.760657 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f4955-f773-4f31-ba6e-224de8f60e15 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:12:02.817474 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615f4955-f773-4f31-ba6e-224de8f60e15 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:12:02.818941 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615f4955-f773-4f31-ba6e-224de8f60e15 service glance] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:12:02.828201 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4431/8886] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:12:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:12:03.133421 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46f476-59c2-46c8-9db3-f58bc61454fb None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:12:03.133801 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46f476-59c2-46c8-9db3-f58bc61454fb None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:12:03.134234 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46f476-59c2-46c8-9db3-f58bc61454fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:12:03.193737 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-6e46f476-59c2-46c8-9db3-f58bc61454fb None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:12:03.194967 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-6e46f476-59c2-46c8-9db3-f58bc61454fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:12:03.262085 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4456/8887] 10.222.0.52 () {58 vars in 1009 bytes} [Sat May 14 22:12:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:12:03.453983 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6005e6d-3740-4843-b7b0-ca3ff5135a54 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:12:03.457315 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6005e6d-3740-4843-b7b0-ca3ff5135a54 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:12:03.457315 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6005e6d-3740-4843-b7b0-ca3ff5135a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:12:03.513476 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-b6005e6d-3740-4843-b7b0-ca3ff5135a54 None None] MFA Rules not processed for user `c781fe7f4a014f0d8b5e7385b20b348c`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:12:03.515222 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b6005e6d-3740-4843-b7b0-ca3ff5135a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:12:03.597604 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4432/8888] 10.222.0.52 () {58 vars in 1039 bytes} [Sat May 14 22:12:03 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:12:03.604428 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e46f476-59c2-46c8-9db3-f58bc61454fb None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:12:03.619226 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e46f476-59c2-46c8-9db3-f58bc61454fb None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:12:03.627039 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cbbae8-c599-49d5-99ad-e994defa66e0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:12:03.628670 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cbbae8-c599-49d5-99ad-e994defa66e0 service swift] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:12:03.628968 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cbbae8-c599-49d5-99ad-e994defa66e0 service swift] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:12:03.629845 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cbbae8-c599-49d5-99ad-e994defa66e0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:12:03.638926 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cbbae8-c599-49d5-99ad-e994defa66e0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:12:03.640681 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cbbae8-c599-49d5-99ad-e994defa66e0 service swift] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:12:03.649135 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4457/8889] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 22:12:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 22:12:13.311704 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc3c0c7-981a-44fd-8f03-275ee527803b None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:12:13.312316 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc3c0c7-981a-44fd-8f03-275ee527803b None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:12:13.312316 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc3c0c7-981a-44fd-8f03-275ee527803b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:12:13.330067 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-dbc3c0c7-981a-44fd-8f03-275ee527803b None None] MFA Rules not processed for user `db572732af5342faacfc59e0841f68bf`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:12:13.331297 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-dbc3c0c7-981a-44fd-8f03-275ee527803b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:12:13.339465 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4433/8890] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 22:12:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:12:16.297920 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cbbae8-c599-49d5-99ad-e994defa66e0 service swift] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:12:16.299604 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-30cbbae8-c599-49d5-99ad-e994defa66e0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:12:16.370356 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cbbae8-c599-49d5-99ad-e994defa66e0 service swift] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:12:16.376357 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d7dd25-0991-471c-8c40-fe0481cba9e0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:12:16.377148 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7dd25-0991-471c-8c40-fe0481cba9e0 service placement] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:12:16.377481 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7dd25-0991-471c-8c40-fe0481cba9e0 service placement] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:12:16.377893 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7dd25-0991-471c-8c40-fe0481cba9e0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:12:16.380394 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-36d7dd25-0991-471c-8c40-fe0481cba9e0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:12:16.394214 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d7dd25-0991-471c-8c40-fe0481cba9e0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:12:16.395936 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d7dd25-0991-471c-8c40-fe0481cba9e0 service placement] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:12:16.407354 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4458/8891] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:12:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:12:16.781059 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e130d-9fb5-4330-9909-992ba4999cac None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:12:16.781566 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e130d-9fb5-4330-9909-992ba4999cac None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:12:16.781658 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e130d-9fb5-4330-9909-992ba4999cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:12:16.802156 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-358e130d-9fb5-4330-9909-992ba4999cac None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:12:16.804331 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-358e130d-9fb5-4330-9909-992ba4999cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:12:16.812727 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4434/8892] 10.222.0.52 () {58 vars in 1009 bytes} [Sat May 14 22:12:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:12:16.825117 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d7dd25-0991-471c-8c40-fe0481cba9e0 service placement] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:12:16.836770 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d7dd25-0991-471c-8c40-fe0481cba9e0 service placement] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:12:16.841836 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30615450-4e1e-473e-a96b-1b3a1f466df0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:12:16.842473 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30615450-4e1e-473e-a96b-1b3a1f466df0 service swift] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:12:16.842755 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30615450-4e1e-473e-a96b-1b3a1f466df0 service swift] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:12:16.843026 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30615450-4e1e-473e-a96b-1b3a1f466df0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:12:16.852247 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30615450-4e1e-473e-a96b-1b3a1f466df0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:12:16.853836 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30615450-4e1e-473e-a96b-1b3a1f466df0 service swift] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:12:16.862302 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4459/8893] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 22:12:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 22:12:40.792237 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358e130d-9fb5-4330-9909-992ba4999cac None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:12:40.844410 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358e130d-9fb5-4330-9909-992ba4999cac None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:12:40.847986 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10939c78-39fb-43f1-b717-6b83c282b35a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:12:40.848632 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10939c78-39fb-43f1-b717-6b83c282b35a service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:12:40.848917 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10939c78-39fb-43f1-b717-6b83c282b35a service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:12:40.849193 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10939c78-39fb-43f1-b717-6b83c282b35a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:12:40.858718 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10939c78-39fb-43f1-b717-6b83c282b35a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:12:40.860212 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10939c78-39fb-43f1-b717-6b83c282b35a service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:12:40.870096 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4435/8894] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:12:40 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:13:19.770293 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30615450-4e1e-473e-a96b-1b3a1f466df0 service swift] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:13:19.771763 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-30615450-4e1e-473e-a96b-1b3a1f466df0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:13:19.838098 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30615450-4e1e-473e-a96b-1b3a1f466df0 service swift] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:13:19.845129 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ca1723-b0e5-40ad-84f0-b04840eb93c7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:13:19.845786 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ca1723-b0e5-40ad-84f0-b04840eb93c7 service placement] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:13:19.846070 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ca1723-b0e5-40ad-84f0-b04840eb93c7 service placement] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:13:19.846349 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ca1723-b0e5-40ad-84f0-b04840eb93c7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:13:19.848172 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-13ca1723-b0e5-40ad-84f0-b04840eb93c7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:13:19.860220 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ca1723-b0e5-40ad-84f0-b04840eb93c7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:13:19.862807 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ca1723-b0e5-40ad-84f0-b04840eb93c7 service placement] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:13:19.872777 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4460/8895] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:13:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:14:00.674171 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a907c-ab34-4608-81f3-50f2d6819852 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:14:00.674731 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a907c-ab34-4608-81f3-50f2d6819852 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:14:00.675029 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a907c-ab34-4608-81f3-50f2d6819852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:14:00.709148 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-0f2a907c-ab34-4608-81f3-50f2d6819852 None None] MFA Rules not processed for user `0f1b0e2b025d4eceaa90e1616d0a9db8`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:14:00.710382 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-0f2a907c-ab34-4608-81f3-50f2d6819852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:14:00.812420 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4436/8896] 10.222.0.52 () {58 vars in 1018 bytes} [Sat May 14 22:14:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:14:00.993530 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ca1723-b0e5-40ad-84f0-b04840eb93c7 service placement] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:14:00.995125 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-13ca1723-b0e5-40ad-84f0-b04840eb93c7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:14:01.012875 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ca1723-b0e5-40ad-84f0-b04840eb93c7 service placement] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:14:01.018765 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af9c79-52fe-4e75-82bc-02f5fae31ebb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:14:01.019444 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af9c79-52fe-4e75-82bc-02f5fae31ebb service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:14:01.019885 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af9c79-52fe-4e75-82bc-02f5fae31ebb service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:14:01.020175 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af9c79-52fe-4e75-82bc-02f5fae31ebb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:14:01.031392 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af9c79-52fe-4e75-82bc-02f5fae31ebb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:14:01.032947 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af9c79-52fe-4e75-82bc-02f5fae31ebb service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:14:01.045745 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4461/8897] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:14:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:14:10.585226 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026ae53-13a4-4b83-96c0-a883002400a5 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:14:10.585705 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026ae53-13a4-4b83-96c0-a883002400a5 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:14:10.585810 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026ae53-13a4-4b83-96c0-a883002400a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:14:10.604205 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-3026ae53-13a4-4b83-96c0-a883002400a5 None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:14:10.605408 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-3026ae53-13a4-4b83-96c0-a883002400a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:14:10.612733 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4437/8898] 10.222.0.52 () {58 vars in 967 bytes} [Sat May 14 22:14:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:14:10.657912 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af9c79-52fe-4e75-82bc-02f5fae31ebb service nova] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:14:10.669298 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af9c79-52fe-4e75-82bc-02f5fae31ebb service nova] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:14:10.674878 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deff26b-b11c-4cec-b419-492e3d42f005 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:14:10.675584 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deff26b-b11c-4cec-b419-492e3d42f005 service swift] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:14:10.675876 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deff26b-b11c-4cec-b419-492e3d42f005 service swift] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:14:10.676523 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deff26b-b11c-4cec-b419-492e3d42f005 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:14:10.692166 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deff26b-b11c-4cec-b419-492e3d42f005 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:14:10.694302 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deff26b-b11c-4cec-b419-492e3d42f005 service swift] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:14:10.704910 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4462/8899] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 22:14:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 22:14:19.466640 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3026ae53-13a4-4b83-96c0-a883002400a5 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:14:19.549130 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3026ae53-13a4-4b83-96c0-a883002400a5 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:14:19.553800 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dabb20-a38e-4de4-a372-2bdfad0ff22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:14:19.554666 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dabb20-a38e-4de4-a372-2bdfad0ff22b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:14:19.554953 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dabb20-a38e-4de4-a372-2bdfad0ff22b admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:14:19.555233 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dabb20-a38e-4de4-a372-2bdfad0ff22b admin admin] PATH_INFO: `/v3/users/db572732af5342faacfc59e0841f68bf` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:14:19.556470 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dabb20-a38e-4de4-a372-2bdfad0ff22b admin admin] RBAC: Authorizing `identity:delete_user(user_id=db572732af5342faacfc59e0841f68bf)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:14:19.558447 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dabb20-a38e-4de4-a372-2bdfad0ff22b admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:14:19.728568 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-41dabb20-a38e-4de4-a372-2bdfad0ff22b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db572732af5342faacfc59e0841f68bf'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:14:19.736200 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-41dabb20-a38e-4de4-a372-2bdfad0ff22b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db572732af5342faacfc59e0841f68bf'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:14:19.736804 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-41dabb20-a38e-4de4-a372-2bdfad0ff22b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db572732af5342faacfc59e0841f68bf'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:14:19.800401 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-41dabb20-a38e-4de4-a372-2bdfad0ff22b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db572732af5342faacfc59e0841f68bf'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:14:19.812662 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-41dabb20-a38e-4de4-a372-2bdfad0ff22b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db572732af5342faacfc59e0841f68bf'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:14:19.818537 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4438/8900] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 22:14:19 2022] DELETE /identity/v3/users/db572732af5342faacfc59e0841f68bf => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 22:14:20.059168 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deff26b-b11c-4cec-b419-492e3d42f005 service swift] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:14:20.072577 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deff26b-b11c-4cec-b419-492e3d42f005 service swift] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:14:20.130456 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f5ce59-acf7-4345-bc75-f4427d041a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:14:20.131341 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5ce59-acf7-4345-bc75-f4427d041a3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:14:20.131635 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5ce59-acf7-4345-bc75-f4427d041a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:14:20.131915 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5ce59-acf7-4345-bc75-f4427d041a3c admin admin] PATH_INFO: `/v3/projects/86b19a25559c4ce7a8a6ee7c86fcab56` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:14:20.133096 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f5ce59-acf7-4345-bc75-f4427d041a3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=86b19a25559c4ce7a8a6ee7c86fcab56)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:14:20.135050 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f5ce59-acf7-4345-bc75-f4427d041a3c admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:14:20.251323 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a4f5ce59-acf7-4345-bc75-f4427d041a3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86b19a25559c4ce7a8a6ee7c86fcab56', 'request_id': 'req-a4f5ce59-acf7-4345-bc75-f4427d041a3c'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:14:20.257173 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a4f5ce59-acf7-4345-bc75-f4427d041a3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86b19a25559c4ce7a8a6ee7c86fcab56', 'request_id': 'req-a4f5ce59-acf7-4345-bc75-f4427d041a3c'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:14:20.326072 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a4f5ce59-acf7-4345-bc75-f4427d041a3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86b19a25559c4ce7a8a6ee7c86fcab56', 'request_id': 'req-a4f5ce59-acf7-4345-bc75-f4427d041a3c'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:14:20.355711 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a4f5ce59-acf7-4345-bc75-f4427d041a3c admin admin] The token cache is being invalidate because project 86b19a25559c4ce7a8a6ee7c86fcab56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 22:14:20.355999 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a4f5ce59-acf7-4345-bc75-f4427d041a3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:14:20.356643 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-a4f5ce59-acf7-4345-bc75-f4427d041a3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:14:20.358301 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4463/8901] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 22:14:20 2022] DELETE /identity/v3/projects/86b19a25559c4ce7a8a6ee7c86fcab56 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 22:14:20.362730 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dabb20-a38e-4de4-a372-2bdfad0ff22b admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:14:20.364200 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-41dabb20-a38e-4de4-a372-2bdfad0ff22b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:14:20.378285 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dabb20-a38e-4de4-a372-2bdfad0ff22b admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:14:20.432624 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c273ec-9039-475c-92f0-972501651ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:14:20.433474 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c273ec-9039-475c-92f0-972501651ba8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:14:20.433753 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c273ec-9039-475c-92f0-972501651ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:14:20.434022 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c273ec-9039-475c-92f0-972501651ba8 admin admin] PATH_INFO: `/v3/users/e7db0499024c4914b52f07f1390c86b8` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:14:20.435194 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c273ec-9039-475c-92f0-972501651ba8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7db0499024c4914b52f07f1390c86b8)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:14:20.437794 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c273ec-9039-475c-92f0-972501651ba8 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:14:20.616026 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b1c273ec-9039-475c-92f0-972501651ba8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7db0499024c4914b52f07f1390c86b8'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:14:20.622686 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b1c273ec-9039-475c-92f0-972501651ba8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7db0499024c4914b52f07f1390c86b8'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:14:20.624350 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b1c273ec-9039-475c-92f0-972501651ba8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7db0499024c4914b52f07f1390c86b8'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:14:20.682769 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b1c273ec-9039-475c-92f0-972501651ba8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7db0499024c4914b52f07f1390c86b8'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:14:20.695702 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b1c273ec-9039-475c-92f0-972501651ba8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7db0499024c4914b52f07f1390c86b8'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:14:20.702599 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4439/8902] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 22:14:20 2022] DELETE /identity/v3/users/e7db0499024c4914b52f07f1390c86b8 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 22:14:20.945301 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f5ce59-acf7-4345-bc75-f4427d041a3c admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:14:20.946800 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-a4f5ce59-acf7-4345-bc75-f4427d041a3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:14:20.960404 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f5ce59-acf7-4345-bc75-f4427d041a3c admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:14:21.015587 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff77c71-3989-424d-b1a2-2c6eb3ae7dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:14:21.018594 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff77c71-3989-424d-b1a2-2c6eb3ae7dd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:14:21.018594 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff77c71-3989-424d-b1a2-2c6eb3ae7dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:14:21.018594 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff77c71-3989-424d-b1a2-2c6eb3ae7dd3 admin admin] PATH_INFO: `/v3/projects/e601c99d735f4ab1b5a0d9bac1b1b602` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:14:21.018594 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff77c71-3989-424d-b1a2-2c6eb3ae7dd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e601c99d735f4ab1b5a0d9bac1b1b602)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:14:21.020026 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff77c71-3989-424d-b1a2-2c6eb3ae7dd3 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:14:21.128038 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-7ff77c71-3989-424d-b1a2-2c6eb3ae7dd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e601c99d735f4ab1b5a0d9bac1b1b602', 'request_id': 'req-7ff77c71-3989-424d-b1a2-2c6eb3ae7dd3'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:14:21.133220 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-7ff77c71-3989-424d-b1a2-2c6eb3ae7dd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e601c99d735f4ab1b5a0d9bac1b1b602', 'request_id': 'req-7ff77c71-3989-424d-b1a2-2c6eb3ae7dd3'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:14:21.200499 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-7ff77c71-3989-424d-b1a2-2c6eb3ae7dd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e601c99d735f4ab1b5a0d9bac1b1b602', 'request_id': 'req-7ff77c71-3989-424d-b1a2-2c6eb3ae7dd3'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:14:21.212843 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-7ff77c71-3989-424d-b1a2-2c6eb3ae7dd3 admin admin] The token cache is being invalidate because project e601c99d735f4ab1b5a0d9bac1b1b602 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 22:14:21.213125 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-7ff77c71-3989-424d-b1a2-2c6eb3ae7dd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:14:21.219289 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-7ff77c71-3989-424d-b1a2-2c6eb3ae7dd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:14:21.219289 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4464/8903] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 22:14:20 2022] DELETE /identity/v3/projects/e601c99d735f4ab1b5a0d9bac1b1b602 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 22:14:21.220669 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a618f-b105-48b6-8c2c-47f154909a6d None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:14:21.220961 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a618f-b105-48b6-8c2c-47f154909a6d None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:14:21.221235 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a618f-b105-48b6-8c2c-47f154909a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:14:21.276322 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-467a618f-b105-48b6-8c2c-47f154909a6d None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:14:21.277509 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-467a618f-b105-48b6-8c2c-47f154909a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:14:21.334907 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4440/8904] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 22:14:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:14:21.342825 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f83ad-c3ec-492c-ac2b-2b555422dbe6 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:14:21.343115 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f83ad-c3ec-492c-ac2b-2b555422dbe6 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:14:21.343425 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f83ad-c3ec-492c-ac2b-2b555422dbe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:14:21.361399 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-b13f83ad-c3ec-492c-ac2b-2b555422dbe6 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:14:21.362589 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b13f83ad-c3ec-492c-ac2b-2b555422dbe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:14:21.370511 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4465/8905] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 22:14:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:14:21.375295 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467a618f-b105-48b6-8c2c-47f154909a6d None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:14:21.384947 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467a618f-b105-48b6-8c2c-47f154909a6d None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:14:21.390130 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e133e6-b67e-46b5-8419-fa728d36c300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:14:21.391247 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e133e6-b67e-46b5-8419-fa728d36c300 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:14:21.391656 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e133e6-b67e-46b5-8419-fa728d36c300 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:14:21.391950 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e133e6-b67e-46b5-8419-fa728d36c300 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:14:21.392667 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e133e6-b67e-46b5-8419-fa728d36c300 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 22:14:21.392975 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e133e6-b67e-46b5-8419-fa728d36c300 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:14:21.394589 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e133e6-b67e-46b5-8419-fa728d36c300 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:14:21.407131 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4441/8906] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 22:14:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 22:14:21.411746 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f83ad-c3ec-492c-ac2b-2b555422dbe6 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:14:21.421550 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f83ad-c3ec-492c-ac2b-2b555422dbe6 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:14:21.426397 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975b50b9-288c-4f73-b0cb-7c6c147a42b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:14:21.427047 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b50b9-288c-4f73-b0cb-7c6c147a42b4 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:14:21.427328 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b50b9-288c-4f73-b0cb-7c6c147a42b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:14:21.427639 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b50b9-288c-4f73-b0cb-7c6c147a42b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:14:21.428319 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975b50b9-288c-4f73-b0cb-7c6c147a42b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:14:21.430216 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975b50b9-288c-4f73-b0cb-7c6c147a42b4 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:14:21.535436 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4466/8907] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 22:14:21 2022] POST /identity/v3/projects => generated 393 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 22:14:21.541018 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e133e6-b67e-46b5-8419-fa728d36c300 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:14:21.551454 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e133e6-b67e-46b5-8419-fa728d36c300 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:14:21.607745 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d34d51-237a-4531-9b0c-9c0c1c6e2d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:14:21.609030 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d34d51-237a-4531-9b0c-9c0c1c6e2d35 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:14:21.609314 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d34d51-237a-4531-9b0c-9c0c1c6e2d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:14:21.609593 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d34d51-237a-4531-9b0c-9c0c1c6e2d35 admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:14:21.610284 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d34d51-237a-4531-9b0c-9c0c1c6e2d35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:14:21.612242 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d34d51-237a-4531-9b0c-9c0c1c6e2d35 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:14:21.706357 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4442/8908] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 22:14:21 2022] POST /identity/v3/users => generated 297 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 22:14:21.712857 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975b50b9-288c-4f73-b0cb-7c6c147a42b4 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:14:21.726303 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975b50b9-288c-4f73-b0cb-7c6c147a42b4 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:14:21.733488 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8290b299-1d69-4377-9cbd-5daba8b9f11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:14:21.734470 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8290b299-1d69-4377-9cbd-5daba8b9f11c admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:14:21.734897 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8290b299-1d69-4377-9cbd-5daba8b9f11c admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:14:21.735315 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8290b299-1d69-4377-9cbd-5daba8b9f11c admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:14:21.736491 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8290b299-1d69-4377-9cbd-5daba8b9f11c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:14:21.739039 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8290b299-1d69-4377-9cbd-5daba8b9f11c admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:14:21.754414 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4467/8909] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 22:14:21 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 22:14:21.758726 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d34d51-237a-4531-9b0c-9c0c1c6e2d35 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:14:21.769228 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d34d51-237a-4531-9b0c-9c0c1c6e2d35 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:14:21.773856 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f053c4-363d-426c-828d-78f57517ff34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:14:21.774506 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f053c4-363d-426c-828d-78f57517ff34 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:14:21.774792 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f053c4-363d-426c-828d-78f57517ff34 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:14:21.775070 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f053c4-363d-426c-828d-78f57517ff34 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:14:21.775851 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f053c4-363d-426c-828d-78f57517ff34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:14:21.777451 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f053c4-363d-426c-828d-78f57517ff34 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:14:21.787726 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4443/8910] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 22:14:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 22:14:21.791685 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8290b299-1d69-4377-9cbd-5daba8b9f11c admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:14:21.802054 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8290b299-1d69-4377-9cbd-5daba8b9f11c admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:14:21.806660 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7822af35-6579-4d74-b69b-b2d51e9ffc39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:14:21.807562 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7822af35-6579-4d74-b69b-b2d51e9ffc39 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:14:21.807843 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7822af35-6579-4d74-b69b-b2d51e9ffc39 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:14:21.808121 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7822af35-6579-4d74-b69b-b2d51e9ffc39 admin admin] PATH_INFO: `/v3/projects/2b433c6a39b149acb9537d5d8d32a845/users/2866128bc30b4a5fbbb05702047de69e/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:14:21.822903 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7822af35-6579-4d74-b69b-b2d51e9ffc39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b433c6a39b149acb9537d5d8d32a845, user_id=2866128bc30b4a5fbbb05702047de69e, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:14:21.825607 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7822af35-6579-4d74-b69b-b2d51e9ffc39 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:14:21.917216 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4468/8911] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 22:14:21 2022] PUT /identity/v3/projects/2b433c6a39b149acb9537d5d8d32a845/users/2866128bc30b4a5fbbb05702047de69e/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 22:14:21.929433 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e67cc-e540-44be-a40f-711d3181af00 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:14:21.929722 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e67cc-e540-44be-a40f-711d3181af00 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:14:21.930002 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e67cc-e540-44be-a40f-711d3181af00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:14:21.955996 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-0e9e67cc-e540-44be-a40f-711d3181af00 None None] MFA Rules not processed for user `2866128bc30b4a5fbbb05702047de69e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:14:21.957201 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-0e9e67cc-e540-44be-a40f-711d3181af00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:14:22.020320 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4444/8912] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 22:14:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:14:22.025086 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7822af35-6579-4d74-b69b-b2d51e9ffc39 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:14:22.096683 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7822af35-6579-4d74-b69b-b2d51e9ffc39 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:14:22.101292 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87028429-e49b-471a-bb69-6b182c44521e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:14:22.101952 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87028429-e49b-471a-bb69-6b182c44521e admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:14:22.102241 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87028429-e49b-471a-bb69-6b182c44521e admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:14:22.102522 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87028429-e49b-471a-bb69-6b182c44521e admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:14:22.103207 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87028429-e49b-471a-bb69-6b182c44521e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:14:22.105149 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87028429-e49b-471a-bb69-6b182c44521e admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:14:22.227488 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4469/8913] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 22:14:22 2022] POST /identity/v3/projects => generated 393 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 22:14:22.231617 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9e67cc-e540-44be-a40f-711d3181af00 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:14:22.242317 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9e67cc-e540-44be-a40f-711d3181af00 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:14:22.296943 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1324b4b4-6a5b-4ea2-9c1c-39aee5fa165b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:14:22.297610 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1324b4b4-6a5b-4ea2-9c1c-39aee5fa165b admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:14:22.297896 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1324b4b4-6a5b-4ea2-9c1c-39aee5fa165b admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:14:22.298169 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1324b4b4-6a5b-4ea2-9c1c-39aee5fa165b admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:14:22.298846 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1324b4b4-6a5b-4ea2-9c1c-39aee5fa165b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:14:22.300806 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1324b4b4-6a5b-4ea2-9c1c-39aee5fa165b admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:14:22.413362 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4445/8914] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 22:14:22 2022] POST /identity/v3/users => generated 303 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 22:14:22.417267 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87028429-e49b-471a-bb69-6b182c44521e admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:14:22.428388 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87028429-e49b-471a-bb69-6b182c44521e admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:14:22.433000 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5725e4-bd05-445a-8660-a0b4643ea4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:14:22.433687 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5725e4-bd05-445a-8660-a0b4643ea4cc admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:14:22.433974 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5725e4-bd05-445a-8660-a0b4643ea4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:14:22.434259 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5725e4-bd05-445a-8660-a0b4643ea4cc admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:14:22.434987 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5725e4-bd05-445a-8660-a0b4643ea4cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:14:22.437470 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5725e4-bd05-445a-8660-a0b4643ea4cc admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:14:22.448009 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4470/8915] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 22:14:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 22:14:22.452332 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1324b4b4-6a5b-4ea2-9c1c-39aee5fa165b admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:14:22.462366 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1324b4b4-6a5b-4ea2-9c1c-39aee5fa165b admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:14:22.466947 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0576776-de9e-4141-aa69-e9c663266ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:14:22.467853 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0576776-de9e-4141-aa69-e9c663266ed9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:14:22.468136 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0576776-de9e-4141-aa69-e9c663266ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:14:22.468415 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0576776-de9e-4141-aa69-e9c663266ed9 admin admin] PATH_INFO: `/v3/projects/228c473ad3fb47458c64b6a376ac3303/users/c4cc6cd31ea847c2ba1b303aaeab521f/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:14:22.482732 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0576776-de9e-4141-aa69-e9c663266ed9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=228c473ad3fb47458c64b6a376ac3303, user_id=c4cc6cd31ea847c2ba1b303aaeab521f, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:14:22.485938 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0576776-de9e-4141-aa69-e9c663266ed9 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:14:22.556901 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4446/8916] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 22:14:22 2022] PUT /identity/v3/projects/228c473ad3fb47458c64b6a376ac3303/users/c4cc6cd31ea847c2ba1b303aaeab521f/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 22:14:22.560802 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5725e4-bd05-445a-8660-a0b4643ea4cc admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:14:22.571810 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5725e4-bd05-445a-8660-a0b4643ea4cc admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:14:22.628025 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b4fecf-83fe-4271-a0e8-eaa22e4be437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:14:22.628686 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b4fecf-83fe-4271-a0e8-eaa22e4be437 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:14:22.628971 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b4fecf-83fe-4271-a0e8-eaa22e4be437 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:14:22.629251 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b4fecf-83fe-4271-a0e8-eaa22e4be437 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:14:22.630114 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b4fecf-83fe-4271-a0e8-eaa22e4be437 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:14:22.631749 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b4fecf-83fe-4271-a0e8-eaa22e4be437 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:14:22.641721 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4471/8917] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 22:14:22 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 22:14:22.645910 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0576776-de9e-4141-aa69-e9c663266ed9 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:14:22.656881 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0576776-de9e-4141-aa69-e9c663266ed9 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:14:22.661519 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51e54bf-2593-4ddb-acf8-47bbdf42a41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:14:22.662650 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e54bf-2593-4ddb-acf8-47bbdf42a41d admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:14:22.662938 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e54bf-2593-4ddb-acf8-47bbdf42a41d admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:14:22.663215 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e54bf-2593-4ddb-acf8-47bbdf42a41d admin admin] PATH_INFO: `/v3/projects/228c473ad3fb47458c64b6a376ac3303/users/c4cc6cd31ea847c2ba1b303aaeab521f/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:14:22.665304 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51e54bf-2593-4ddb-acf8-47bbdf42a41d admin admin] RBAC: Authorizing `identity:create_grant(project_id=228c473ad3fb47458c64b6a376ac3303, user_id=c4cc6cd31ea847c2ba1b303aaeab521f, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:14:22.667967 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51e54bf-2593-4ddb-acf8-47bbdf42a41d admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:14:22.678488 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4447/8918] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 22:14:22 2022] PUT /identity/v3/projects/228c473ad3fb47458c64b6a376ac3303/users/c4cc6cd31ea847c2ba1b303aaeab521f/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 22:14:22.688090 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474c6950-9280-4a84-a260-2a0ed0856ecc None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:14:22.688379 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474c6950-9280-4a84-a260-2a0ed0856ecc None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:14:22.688659 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474c6950-9280-4a84-a260-2a0ed0856ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:14:22.714580 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-474c6950-9280-4a84-a260-2a0ed0856ecc None None] MFA Rules not processed for user `c4cc6cd31ea847c2ba1b303aaeab521f`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:14:22.715851 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-474c6950-9280-4a84-a260-2a0ed0856ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:14:22.783017 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4472/8919] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 22:14:22 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:14:22.798297 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51e54bf-2593-4ddb-acf8-47bbdf42a41d admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:14:22.800652 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e51e54bf-2593-4ddb-acf8-47bbdf42a41d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:14:22.872988 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51e54bf-2593-4ddb-acf8-47bbdf42a41d admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:14:22.879260 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a7c26f-af6f-4176-8d77-568bd852dc7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:14:22.879938 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a7c26f-af6f-4176-8d77-568bd852dc7c service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:14:22.880221 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a7c26f-af6f-4176-8d77-568bd852dc7c service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:14:22.880496 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a7c26f-af6f-4176-8d77-568bd852dc7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:14:22.935736 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a7c26f-af6f-4176-8d77-568bd852dc7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:14:22.937495 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a7c26f-af6f-4176-8d77-568bd852dc7c service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:14:22.946384 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4448/8920] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:14:22 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:14:28.024045 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474c6950-9280-4a84-a260-2a0ed0856ecc None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:14:28.025501 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-474c6950-9280-4a84-a260-2a0ed0856ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:14:28.105011 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474c6950-9280-4a84-a260-2a0ed0856ecc None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:14:28.109573 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21d2eaf-9cd2-4718-8253-a74b2c6cccc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:14:28.110242 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d2eaf-9cd2-4718-8253-a74b2c6cccc2 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:14:28.110529 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d2eaf-9cd2-4718-8253-a74b2c6cccc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:14:28.110810 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d2eaf-9cd2-4718-8253-a74b2c6cccc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:14:28.120565 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21d2eaf-9cd2-4718-8253-a74b2c6cccc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:14:28.122007 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21d2eaf-9cd2-4718-8253-a74b2c6cccc2 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:14:28.133043 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4473/8921] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:14:28 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:14:31.305182 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c35db-294c-46ce-9cff-3d20c2251507 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:14:31.305712 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c35db-294c-46ce-9cff-3d20c2251507 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:14:31.305811 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c35db-294c-46ce-9cff-3d20c2251507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:14:31.324794 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-4c0c35db-294c-46ce-9cff-3d20c2251507 None None] MFA Rules not processed for user `2866128bc30b4a5fbbb05702047de69e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:14:31.326263 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-4c0c35db-294c-46ce-9cff-3d20c2251507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:14:31.338336 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4449/8922] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 22:14:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:14:32.218464 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21d2eaf-9cd2-4718-8253-a74b2c6cccc2 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:14:32.220017 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-a21d2eaf-9cd2-4718-8253-a74b2c6cccc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:14:32.299806 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21d2eaf-9cd2-4718-8253-a74b2c6cccc2 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:14:32.308187 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00113e1-fb6c-473d-9476-417515d1d709 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:14:32.309138 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00113e1-fb6c-473d-9476-417515d1d709 service placement] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:14:32.309427 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00113e1-fb6c-473d-9476-417515d1d709 service placement] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:14:32.309711 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00113e1-fb6c-473d-9476-417515d1d709 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:14:32.311731 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e00113e1-fb6c-473d-9476-417515d1d709 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:14:32.323849 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00113e1-fb6c-473d-9476-417515d1d709 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:14:32.325466 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00113e1-fb6c-473d-9476-417515d1d709 service placement] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:14:32.338013 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4474/8923] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:14:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:14:39.201470 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c35db-294c-46ce-9cff-3d20c2251507 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:14:39.203075 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-4c0c35db-294c-46ce-9cff-3d20c2251507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:14:39.214782 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c35db-294c-46ce-9cff-3d20c2251507 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:14:39.219032 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a78a270-a4e9-47b9-9a73-424fdac5fabf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:14:39.219706 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78a270-a4e9-47b9-9a73-424fdac5fabf service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:14:39.219991 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78a270-a4e9-47b9-9a73-424fdac5fabf service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:14:39.220267 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78a270-a4e9-47b9-9a73-424fdac5fabf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:14:39.221976 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-7a78a270-a4e9-47b9-9a73-424fdac5fabf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:14:39.235543 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a78a270-a4e9-47b9-9a73-424fdac5fabf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:14:39.236991 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a78a270-a4e9-47b9-9a73-424fdac5fabf service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:14:39.247956 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4450/8924] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:14:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:15:02.060174 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00113e1-fb6c-473d-9476-417515d1d709 service placement] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:15:02.070146 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00113e1-fb6c-473d-9476-417515d1d709 service placement] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:15:02.073756 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936eff52-1a1e-447f-ae69-c7d39f9f4f34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:15:02.077992 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936eff52-1a1e-447f-ae69-c7d39f9f4f34 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:15:02.077992 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936eff52-1a1e-447f-ae69-c7d39f9f4f34 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:15:02.077992 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936eff52-1a1e-447f-ae69-c7d39f9f4f34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:15:02.077992 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-936eff52-1a1e-447f-ae69-c7d39f9f4f34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:15:02.087065 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936eff52-1a1e-447f-ae69-c7d39f9f4f34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:15:02.088482 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936eff52-1a1e-447f-ae69-c7d39f9f4f34 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:15:02.096650 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4475/8925] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:15:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:15:21.871772 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a78a270-a4e9-47b9-9a73-424fdac5fabf service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:15:21.884870 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a78a270-a4e9-47b9-9a73-424fdac5fabf service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:15:21.890828 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56367eae-e5e2-4fc8-a26f-3e95b8083f06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:15:21.891516 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56367eae-e5e2-4fc8-a26f-3e95b8083f06 service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:15:21.892516 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56367eae-e5e2-4fc8-a26f-3e95b8083f06 service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:15:21.892864 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56367eae-e5e2-4fc8-a26f-3e95b8083f06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:15:21.894743 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-56367eae-e5e2-4fc8-a26f-3e95b8083f06 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:15:21.909006 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56367eae-e5e2-4fc8-a26f-3e95b8083f06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:15:21.910618 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56367eae-e5e2-4fc8-a26f-3e95b8083f06 service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:15:21.922616 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4451/8926] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:15:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:15:37.776467 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241659f-9ac6-4137-8c05-8d651d70282c None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:15:37.776974 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241659f-9ac6-4137-8c05-8d651d70282c None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:15:37.777197 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241659f-9ac6-4137-8c05-8d651d70282c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:15:37.803080 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-2241659f-9ac6-4137-8c05-8d651d70282c None None] MFA Rules not processed for user `2866128bc30b4a5fbbb05702047de69e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:15:37.804580 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-2241659f-9ac6-4137-8c05-8d651d70282c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:15:37.814050 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4476/8927] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 22:15:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:15:48.968492 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56367eae-e5e2-4fc8-a26f-3e95b8083f06 service nova] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:15:48.980308 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56367eae-e5e2-4fc8-a26f-3e95b8083f06 service nova] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:15:48.986189 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccdc82f-b155-47c2-be76-60b07bc4fc99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:15:48.986837 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccdc82f-b155-47c2-be76-60b07bc4fc99 service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:15:48.987118 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccdc82f-b155-47c2-be76-60b07bc4fc99 service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:15:48.987391 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccdc82f-b155-47c2-be76-60b07bc4fc99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:15:48.989246 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-9ccdc82f-b155-47c2-be76-60b07bc4fc99 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:15:49.001423 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccdc82f-b155-47c2-be76-60b07bc4fc99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:15:49.002992 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccdc82f-b155-47c2-be76-60b07bc4fc99 service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:15:49.013263 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4452/8928] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:15:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:17:21.531147 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73765322-09f6-4cb4-90f6-a456c5517079 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:17:21.531692 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73765322-09f6-4cb4-90f6-a456c5517079 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:17:21.532068 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73765322-09f6-4cb4-90f6-a456c5517079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:17:21.560643 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-73765322-09f6-4cb4-90f6-a456c5517079 None None] MFA Rules not processed for user `2866128bc30b4a5fbbb05702047de69e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:17:21.564005 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-73765322-09f6-4cb4-90f6-a456c5517079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:17:21.572620 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4477/8929] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 22:17:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:17:21.919855 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccdc82f-b155-47c2-be76-60b07bc4fc99 service nova] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:17:21.930286 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccdc82f-b155-47c2-be76-60b07bc4fc99 service nova] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:17:21.939304 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a225b04d-e88b-4c71-927f-c8bd47d308aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:17:21.945364 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a225b04d-e88b-4c71-927f-c8bd47d308aa service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:17:21.945777 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a225b04d-e88b-4c71-927f-c8bd47d308aa service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:17:21.946190 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a225b04d-e88b-4c71-927f-c8bd47d308aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:17:21.953460 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-a225b04d-e88b-4c71-927f-c8bd47d308aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:17:21.976387 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a225b04d-e88b-4c71-927f-c8bd47d308aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:17:21.977880 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a225b04d-e88b-4c71-927f-c8bd47d308aa service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:17:21.997473 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4453/8930] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:17:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:17:23.274466 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73765322-09f6-4cb4-90f6-a456c5517079 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:17:23.292031 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73765322-09f6-4cb4-90f6-a456c5517079 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:17:23.297178 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74162442-bb7b-46a7-9749-0267e4a5a319 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:17:23.297840 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74162442-bb7b-46a7-9749-0267e4a5a319 service placement] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:17:23.298121 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74162442-bb7b-46a7-9749-0267e4a5a319 service placement] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:17:23.298394 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74162442-bb7b-46a7-9749-0267e4a5a319 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:17:23.301118 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-74162442-bb7b-46a7-9749-0267e4a5a319 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:17:23.329806 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74162442-bb7b-46a7-9749-0267e4a5a319 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:17:23.333764 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74162442-bb7b-46a7-9749-0267e4a5a319 service placement] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:17:23.345601 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4478/8931] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:17:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:18:05.780850 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc85596-caeb-4a43-af2c-a2e2a197600e None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:18:05.786352 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc85596-caeb-4a43-af2c-a2e2a197600e None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:18:05.786352 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc85596-caeb-4a43-af2c-a2e2a197600e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:18:05.800682 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-7cc85596-caeb-4a43-af2c-a2e2a197600e None None] MFA Rules not processed for user `99ed32a6d699453bb7e088540e8fc980`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:18:05.802067 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-7cc85596-caeb-4a43-af2c-a2e2a197600e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:18:05.809389 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4454/8932] 10.222.0.52 () {58 vars in 1018 bytes} [Sat May 14 22:18:05 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:18:05.821935 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74162442-bb7b-46a7-9749-0267e4a5a319 service placement] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:18:05.831332 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74162442-bb7b-46a7-9749-0267e4a5a319 service placement] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:18:05.837333 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458d36cd-0e27-4b2c-8a16-41445003ddee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:18:05.837333 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d36cd-0e27-4b2c-8a16-41445003ddee service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:18:05.837333 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d36cd-0e27-4b2c-8a16-41445003ddee service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:18:05.837333 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d36cd-0e27-4b2c-8a16-41445003ddee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:18:05.843782 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458d36cd-0e27-4b2c-8a16-41445003ddee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:18:05.845601 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458d36cd-0e27-4b2c-8a16-41445003ddee service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:18:05.854106 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4479/8933] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:18:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:18:06.000495 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fceecf-fc66-44bd-9102-55a4f5af962b None None] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:18:06.000783 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fceecf-fc66-44bd-9102-55a4f5af962b None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:18:06.001066 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fceecf-fc66-44bd-9102-55a4f5af962b None None] PATH_INFO: `/` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:18:06.002445 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4455/8934] 10.222.0.52 () {54 vars in 921 bytes} [Sat May 14 22:18:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 22:18:06.007710 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc68db-77c2-4d4f-9065-8fd3987cd368 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:18:06.008007 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc68db-77c2-4d4f-9065-8fd3987cd368 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:18:06.008285 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc68db-77c2-4d4f-9065-8fd3987cd368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:18:06.025997 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-92cc68db-77c2-4d4f-9065-8fd3987cd368 None None] MFA Rules not processed for user `0812ae67e44d483baf2dbb1a5332a1d7`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:18:06.027224 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-92cc68db-77c2-4d4f-9065-8fd3987cd368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:18:06.036437 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4480/8935] 10.222.0.52 () {58 vars in 1018 bytes} [Sat May 14 22:18:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 22:18:06.057926 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fceecf-fc66-44bd-9102-55a4f5af962b None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:18:06.059726 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b7fceecf-fc66-44bd-9102-55a4f5af962b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:18:06.076636 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fceecf-fc66-44bd-9102-55a4f5af962b None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:18:06.081675 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6697080-5861-44a0-94d0-817ac1187e55 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:18:06.082317 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6697080-5861-44a0-94d0-817ac1187e55 service placement] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:18:06.082599 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6697080-5861-44a0-94d0-817ac1187e55 service placement] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:18:06.082872 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6697080-5861-44a0-94d0-817ac1187e55 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:18:06.091465 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6697080-5861-44a0-94d0-817ac1187e55 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:18:06.093029 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6697080-5861-44a0-94d0-817ac1187e55 service placement] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:18:06.103126 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4456/8936] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:18:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:18:07.392120 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a03c1-6cca-47b5-b00e-8ac3b005a08c None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:18:07.392542 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a03c1-6cca-47b5-b00e-8ac3b005a08c None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:18:07.392667 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a03c1-6cca-47b5-b00e-8ac3b005a08c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:18:07.411408 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-f94a03c1-6cca-47b5-b00e-8ac3b005a08c None None] MFA Rules not processed for user `0f1b0e2b025d4eceaa90e1616d0a9db8`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:18:07.412633 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-f94a03c1-6cca-47b5-b00e-8ac3b005a08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:18:07.422088 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4481/8937] 10.222.0.52 () {58 vars in 1018 bytes} [Sat May 14 22:18:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:18:07.432604 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6697080-5861-44a0-94d0-817ac1187e55 service placement] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:18:07.442478 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6697080-5861-44a0-94d0-817ac1187e55 service placement] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:18:07.446225 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f24ad96-3bbd-47be-99aa-5a3cacd71ceb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:18:07.446861 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24ad96-3bbd-47be-99aa-5a3cacd71ceb service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:18:07.447177 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24ad96-3bbd-47be-99aa-5a3cacd71ceb service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:18:07.447455 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24ad96-3bbd-47be-99aa-5a3cacd71ceb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:18:07.458157 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f24ad96-3bbd-47be-99aa-5a3cacd71ceb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:18:07.459618 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f24ad96-3bbd-47be-99aa-5a3cacd71ceb service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:18:07.470458 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4457/8938] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:18:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:18:07.530798 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94a03c1-6cca-47b5-b00e-8ac3b005a08c None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:18:07.542363 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94a03c1-6cca-47b5-b00e-8ac3b005a08c None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:18:07.547353 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd87a865-a071-427a-8ef6-c411de20aa7d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:18:07.548026 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd87a865-a071-427a-8ef6-c411de20aa7d service placement] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:18:07.548312 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd87a865-a071-427a-8ef6-c411de20aa7d service placement] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:18:07.548589 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd87a865-a071-427a-8ef6-c411de20aa7d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:18:07.550364 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-fd87a865-a071-427a-8ef6-c411de20aa7d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:18:07.561495 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd87a865-a071-427a-8ef6-c411de20aa7d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:18:07.563061 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd87a865-a071-427a-8ef6-c411de20aa7d service placement] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:18:07.573134 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4482/8939] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:18:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:18:21.716221 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f24ad96-3bbd-47be-99aa-5a3cacd71ceb service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:18:21.728208 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f24ad96-3bbd-47be-99aa-5a3cacd71ceb service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:18:21.733328 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d19247-e50a-4261-9257-4217e95a92d6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:18:21.733967 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d19247-e50a-4261-9257-4217e95a92d6 service placement] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:18:21.734255 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d19247-e50a-4261-9257-4217e95a92d6 service placement] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:18:21.734534 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d19247-e50a-4261-9257-4217e95a92d6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:18:21.736348 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-08d19247-e50a-4261-9257-4217e95a92d6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:18:21.748632 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d19247-e50a-4261-9257-4217e95a92d6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:18:21.750220 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d19247-e50a-4261-9257-4217e95a92d6 service placement] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:18:21.760729 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4458/8940] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:18:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:18:29.743292 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd87a865-a071-427a-8ef6-c411de20aa7d service placement] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:18:29.752823 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd87a865-a071-427a-8ef6-c411de20aa7d service placement] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:18:29.756473 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca55035f-6c22-4cec-9825-4e6c508ec538 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:18:29.757112 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca55035f-6c22-4cec-9825-4e6c508ec538 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:18:29.757403 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca55035f-6c22-4cec-9825-4e6c508ec538 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:18:29.757682 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca55035f-6c22-4cec-9825-4e6c508ec538 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:18:29.760010 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ca55035f-6c22-4cec-9825-4e6c508ec538 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:18:29.769342 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca55035f-6c22-4cec-9825-4e6c508ec538 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:18:29.770765 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca55035f-6c22-4cec-9825-4e6c508ec538 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:18:29.779218 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4483/8941] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:18:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:19:05.043316 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d19247-e50a-4261-9257-4217e95a92d6 service placement] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:19:05.059232 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d19247-e50a-4261-9257-4217e95a92d6 service placement] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:19:05.067420 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07979da1-5c20-4f1f-aec5-54f18000d9d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:19:05.067975 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07979da1-5c20-4f1f-aec5-54f18000d9d9 service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:19:05.068268 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07979da1-5c20-4f1f-aec5-54f18000d9d9 service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:19:05.068553 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07979da1-5c20-4f1f-aec5-54f18000d9d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:19:05.070658 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-07979da1-5c20-4f1f-aec5-54f18000d9d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:19:05.083596 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07979da1-5c20-4f1f-aec5-54f18000d9d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:19:05.085224 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07979da1-5c20-4f1f-aec5-54f18000d9d9 service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:19:05.096578 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4459/8942] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:19:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:19:19.957254 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3984a769-fd12-443b-91ea-14442f586886 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:19:19.958120 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3984a769-fd12-443b-91ea-14442f586886 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:19:19.958407 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3984a769-fd12-443b-91ea-14442f586886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:19:19.993595 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-3984a769-fd12-443b-91ea-14442f586886 None None] MFA Rules not processed for user `2866128bc30b4a5fbbb05702047de69e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:19:19.996003 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-3984a769-fd12-443b-91ea-14442f586886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:19:20.005421 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4484/8943] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 22:19:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:19:22.790246 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07979da1-5c20-4f1f-aec5-54f18000d9d9 service nova] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:19:22.810577 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07979da1-5c20-4f1f-aec5-54f18000d9d9 service nova] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:19:22.814645 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fbb643-8c2c-470a-9844-1a1f17e62211 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:19:22.815292 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fbb643-8c2c-470a-9844-1a1f17e62211 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:19:22.815614 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fbb643-8c2c-470a-9844-1a1f17e62211 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:19:22.815893 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fbb643-8c2c-470a-9844-1a1f17e62211 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:19:22.825724 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fbb643-8c2c-470a-9844-1a1f17e62211 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:19:22.827239 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fbb643-8c2c-470a-9844-1a1f17e62211 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:19:22.837354 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4460/8944] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:19:22 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:19:33.926682 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3984a769-fd12-443b-91ea-14442f586886 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:19:33.936358 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3984a769-fd12-443b-91ea-14442f586886 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:19:33.939868 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b9d3dd-ecc4-4ecd-9ce0-9e42c3171402 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:19:33.940501 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9d3dd-ecc4-4ecd-9ce0-9e42c3171402 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:19:33.940783 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9d3dd-ecc4-4ecd-9ce0-9e42c3171402 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:19:33.941058 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9d3dd-ecc4-4ecd-9ce0-9e42c3171402 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:19:33.951042 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b9d3dd-ecc4-4ecd-9ce0-9e42c3171402 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:19:33.952562 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b9d3dd-ecc4-4ecd-9ce0-9e42c3171402 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:19:33.962029 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4485/8945] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:19:33 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:20:08.718602 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fbb643-8c2c-470a-9844-1a1f17e62211 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:20:08.727368 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fbb643-8c2c-470a-9844-1a1f17e62211 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:20:08.732448 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88620e9f-a2e5-4084-bfc1-84613ec42ba0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:20:08.735242 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88620e9f-a2e5-4084-bfc1-84613ec42ba0 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:20:08.735242 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88620e9f-a2e5-4084-bfc1-84613ec42ba0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:20:08.735242 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88620e9f-a2e5-4084-bfc1-84613ec42ba0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:20:08.744435 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88620e9f-a2e5-4084-bfc1-84613ec42ba0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:20:08.745869 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88620e9f-a2e5-4084-bfc1-84613ec42ba0 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:20:08.757156 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4461/8946] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:20:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:21:01.135046 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b9d3dd-ecc4-4ecd-9ce0-9e42c3171402 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:21:01.148244 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b9d3dd-ecc4-4ecd-9ce0-9e42c3171402 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:21:01.155359 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f135eb7c-01b0-43af-866c-c113f9d0ee90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:21:01.156033 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135eb7c-01b0-43af-866c-c113f9d0ee90 service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:21:01.156318 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135eb7c-01b0-43af-866c-c113f9d0ee90 service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:21:01.156595 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135eb7c-01b0-43af-866c-c113f9d0ee90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:21:01.165992 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f135eb7c-01b0-43af-866c-c113f9d0ee90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:21:01.168691 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f135eb7c-01b0-43af-866c-c113f9d0ee90 service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:21:01.179735 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4486/8947] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:21:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:21:15.427299 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3708065d-5aff-4429-874c-bf64a2ea4eeb None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:21:15.427858 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3708065d-5aff-4429-874c-bf64a2ea4eeb None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:21:15.427972 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3708065d-5aff-4429-874c-bf64a2ea4eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:21:15.445968 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-3708065d-5aff-4429-874c-bf64a2ea4eeb None None] MFA Rules not processed for user `2866128bc30b4a5fbbb05702047de69e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:21:15.447176 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-3708065d-5aff-4429-874c-bf64a2ea4eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:21:15.456247 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4462/8948] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 22:21:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 22:21:19.125981 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f135eb7c-01b0-43af-866c-c113f9d0ee90 service nova] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:21:19.135878 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f135eb7c-01b0-43af-866c-c113f9d0ee90 service nova] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:21:19.139945 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9069ca-f449-4604-bcfc-5f6a3f6561b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:21:19.140680 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9069ca-f449-4604-bcfc-5f6a3f6561b6 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:21:19.141028 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9069ca-f449-4604-bcfc-5f6a3f6561b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:21:19.141372 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9069ca-f449-4604-bcfc-5f6a3f6561b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:21:19.150363 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9069ca-f449-4604-bcfc-5f6a3f6561b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:21:19.153177 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9069ca-f449-4604-bcfc-5f6a3f6561b6 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:21:19.161729 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4487/8949] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:21:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:21:26.675403 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3708065d-5aff-4429-874c-bf64a2ea4eeb None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:21:26.688603 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3708065d-5aff-4429-874c-bf64a2ea4eeb None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:21:26.694037 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e20b89-c84f-400d-9586-653b02c39888 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:21:26.694701 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e20b89-c84f-400d-9586-653b02c39888 service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:21:26.694983 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e20b89-c84f-400d-9586-653b02c39888 service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:21:26.695259 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e20b89-c84f-400d-9586-653b02c39888 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:21:26.705127 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e20b89-c84f-400d-9586-653b02c39888 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:21:26.706761 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e20b89-c84f-400d-9586-653b02c39888 service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:21:26.718682 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4463/8950] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:21:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 22:22:14.015623 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9069ca-f449-4604-bcfc-5f6a3f6561b6 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:22:14.083652 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9069ca-f449-4604-bcfc-5f6a3f6561b6 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:22:14.088515 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71514f3c-cb0e-4603-9e91-c1a535008d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:22:14.089394 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71514f3c-cb0e-4603-9e91-c1a535008d7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:22:14.089737 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71514f3c-cb0e-4603-9e91-c1a535008d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:22:14.090019 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71514f3c-cb0e-4603-9e91-c1a535008d7b admin admin] PATH_INFO: `/v3/users/2866128bc30b4a5fbbb05702047de69e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:22:14.091265 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71514f3c-cb0e-4603-9e91-c1a535008d7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2866128bc30b4a5fbbb05702047de69e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:22:14.103362 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71514f3c-cb0e-4603-9e91-c1a535008d7b admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:22:14.273691 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-71514f3c-cb0e-4603-9e91-c1a535008d7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2866128bc30b4a5fbbb05702047de69e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:22:14.285896 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-71514f3c-cb0e-4603-9e91-c1a535008d7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2866128bc30b4a5fbbb05702047de69e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:22:14.293546 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-71514f3c-cb0e-4603-9e91-c1a535008d7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2866128bc30b4a5fbbb05702047de69e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:22:14.357094 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-71514f3c-cb0e-4603-9e91-c1a535008d7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2866128bc30b4a5fbbb05702047de69e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:22:14.357753 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-71514f3c-cb0e-4603-9e91-c1a535008d7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2866128bc30b4a5fbbb05702047de69e'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:22:14.364005 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4488/8951] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 22:22:14 2022] DELETE /identity/v3/users/2866128bc30b4a5fbbb05702047de69e => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 22:22:14.371250 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09105fe6-88bc-40f2-a1aa-50d9b9668cd6 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:22:14.371250 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09105fe6-88bc-40f2-a1aa-50d9b9668cd6 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:22:14.371250 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09105fe6-88bc-40f2-a1aa-50d9b9668cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:22:14.386731 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-09105fe6-88bc-40f2-a1aa-50d9b9668cd6 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:22:14.387968 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-09105fe6-88bc-40f2-a1aa-50d9b9668cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:22:14.444845 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4464/8952] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 22:22:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:22:14.456228 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71514f3c-cb0e-4603-9e91-c1a535008d7b admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:22:14.457872 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-71514f3c-cb0e-4603-9e91-c1a535008d7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:22:14.516261 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71514f3c-cb0e-4603-9e91-c1a535008d7b admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:22:14.519823 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a656bb-c1c7-4061-9f92-5996ddbadd2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:22:14.520462 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a656bb-c1c7-4061-9f92-5996ddbadd2e service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:22:14.520743 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a656bb-c1c7-4061-9f92-5996ddbadd2e service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:22:14.521014 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a656bb-c1c7-4061-9f92-5996ddbadd2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:22:14.530761 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a656bb-c1c7-4061-9f92-5996ddbadd2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:22:14.532155 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a656bb-c1c7-4061-9f92-5996ddbadd2e service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:22:14.541718 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4489/8953] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:22:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:22:14.770710 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09105fe6-88bc-40f2-a1aa-50d9b9668cd6 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:22:14.772338 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-09105fe6-88bc-40f2-a1aa-50d9b9668cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:22:14.794178 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09105fe6-88bc-40f2-a1aa-50d9b9668cd6 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:22:14.799019 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6319763-feef-4d5b-837b-42faef2a3f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:22:14.799925 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6319763-feef-4d5b-837b-42faef2a3f18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:22:14.800437 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6319763-feef-4d5b-837b-42faef2a3f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:22:14.800599 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6319763-feef-4d5b-837b-42faef2a3f18 admin admin] PATH_INFO: `/v3/projects/2b433c6a39b149acb9537d5d8d32a845` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:22:14.801766 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6319763-feef-4d5b-837b-42faef2a3f18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b433c6a39b149acb9537d5d8d32a845)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:22:14.803770 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6319763-feef-4d5b-837b-42faef2a3f18 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:22:14.946417 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b6319763-feef-4d5b-837b-42faef2a3f18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b433c6a39b149acb9537d5d8d32a845', 'request_id': 'req-b6319763-feef-4d5b-837b-42faef2a3f18'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:22:14.952577 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b6319763-feef-4d5b-837b-42faef2a3f18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b433c6a39b149acb9537d5d8d32a845', 'request_id': 'req-b6319763-feef-4d5b-837b-42faef2a3f18'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:22:14.959014 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b6319763-feef-4d5b-837b-42faef2a3f18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b433c6a39b149acb9537d5d8d32a845', 'request_id': 'req-b6319763-feef-4d5b-837b-42faef2a3f18'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:22:15.081399 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b6319763-feef-4d5b-837b-42faef2a3f18 admin admin] The token cache is being invalidate because project 2b433c6a39b149acb9537d5d8d32a845 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 22:22:15.081645 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b6319763-feef-4d5b-837b-42faef2a3f18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:22:15.082279 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-b6319763-feef-4d5b-837b-42faef2a3f18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:22:15.083878 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4465/8954] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 22:22:14 2022] DELETE /identity/v3/projects/2b433c6a39b149acb9537d5d8d32a845 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 22:22:15.087923 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a656bb-c1c7-4061-9f92-5996ddbadd2e service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:22:15.097654 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a656bb-c1c7-4061-9f92-5996ddbadd2e service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:22:15.152182 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b84ec83-09b7-48aa-9575-1b16820b22cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:22:15.153034 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b84ec83-09b7-48aa-9575-1b16820b22cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:22:15.153317 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b84ec83-09b7-48aa-9575-1b16820b22cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:22:15.153591 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b84ec83-09b7-48aa-9575-1b16820b22cf admin admin] PATH_INFO: `/v3/users/c4cc6cd31ea847c2ba1b303aaeab521f` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:22:15.154766 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b84ec83-09b7-48aa-9575-1b16820b22cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4cc6cd31ea847c2ba1b303aaeab521f)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:22:15.156724 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b84ec83-09b7-48aa-9575-1b16820b22cf admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:22:15.364832 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0b84ec83-09b7-48aa-9575-1b16820b22cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4cc6cd31ea847c2ba1b303aaeab521f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:22:15.377004 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0b84ec83-09b7-48aa-9575-1b16820b22cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4cc6cd31ea847c2ba1b303aaeab521f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:22:15.383944 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0b84ec83-09b7-48aa-9575-1b16820b22cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4cc6cd31ea847c2ba1b303aaeab521f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:22:15.465356 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0b84ec83-09b7-48aa-9575-1b16820b22cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4cc6cd31ea847c2ba1b303aaeab521f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:22:15.465990 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-0b84ec83-09b7-48aa-9575-1b16820b22cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4cc6cd31ea847c2ba1b303aaeab521f'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:22:15.472135 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4490/8955] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 22:22:15 2022] DELETE /identity/v3/users/c4cc6cd31ea847c2ba1b303aaeab521f => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 22:22:15.883585 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6319763-feef-4d5b-837b-42faef2a3f18 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:22:15.885071 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b6319763-feef-4d5b-837b-42faef2a3f18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:22:15.898650 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6319763-feef-4d5b-837b-42faef2a3f18 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:22:15.957457 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fd0d56-5267-497f-ac53-32eabcbd5dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:22:15.958319 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd0d56-5267-497f-ac53-32eabcbd5dbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:22:15.958602 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd0d56-5267-497f-ac53-32eabcbd5dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:22:15.958877 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd0d56-5267-497f-ac53-32eabcbd5dbb admin admin] PATH_INFO: `/v3/projects/228c473ad3fb47458c64b6a376ac3303` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:22:15.960080 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fd0d56-5267-497f-ac53-32eabcbd5dbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=228c473ad3fb47458c64b6a376ac3303)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:22:15.961999 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fd0d56-5267-497f-ac53-32eabcbd5dbb admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:22:16.067171 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-77fd0d56-5267-497f-ac53-32eabcbd5dbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '228c473ad3fb47458c64b6a376ac3303', 'request_id': 'req-77fd0d56-5267-497f-ac53-32eabcbd5dbb'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:22:16.072693 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-77fd0d56-5267-497f-ac53-32eabcbd5dbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '228c473ad3fb47458c64b6a376ac3303', 'request_id': 'req-77fd0d56-5267-497f-ac53-32eabcbd5dbb'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:22:16.079434 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-77fd0d56-5267-497f-ac53-32eabcbd5dbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '228c473ad3fb47458c64b6a376ac3303', 'request_id': 'req-77fd0d56-5267-497f-ac53-32eabcbd5dbb'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:22:16.162017 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-77fd0d56-5267-497f-ac53-32eabcbd5dbb admin admin] The token cache is being invalidate because project 228c473ad3fb47458c64b6a376ac3303 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 22:22:16.162243 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-77fd0d56-5267-497f-ac53-32eabcbd5dbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:22:16.162896 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-77fd0d56-5267-497f-ac53-32eabcbd5dbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:22:16.164836 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4466/8956] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 22:22:15 2022] DELETE /identity/v3/projects/228c473ad3fb47458c64b6a376ac3303 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 22:22:16.171168 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a320e4-0d0e-4bdf-a9f6-92e171a2de23 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:22:16.171692 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a320e4-0d0e-4bdf-a9f6-92e171a2de23 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:22:16.171798 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a320e4-0d0e-4bdf-a9f6-92e171a2de23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:22:16.190291 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-e9a320e4-0d0e-4bdf-a9f6-92e171a2de23 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:22:16.192123 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e9a320e4-0d0e-4bdf-a9f6-92e171a2de23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:22:16.253891 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4491/8957] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 22:22:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:22:16.262596 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e713618-2d64-4a60-afb1-13bcc9c2c3b1 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:22:16.263021 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e713618-2d64-4a60-afb1-13bcc9c2c3b1 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:22:16.263326 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e713618-2d64-4a60-afb1-13bcc9c2c3b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:22:16.288357 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-3e713618-2d64-4a60-afb1-13bcc9c2c3b1 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:22:16.289762 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-3e713618-2d64-4a60-afb1-13bcc9c2c3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:22:16.298937 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4467/8958] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 22:22:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:22:16.303231 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a320e4-0d0e-4bdf-a9f6-92e171a2de23 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:22:16.314666 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a320e4-0d0e-4bdf-a9f6-92e171a2de23 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:22:16.319963 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d8198a-9c87-496d-99d9-c590b76b924d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:22:16.320630 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d8198a-9c87-496d-99d9-c590b76b924d admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:22:16.320917 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d8198a-9c87-496d-99d9-c590b76b924d admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:22:16.321197 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d8198a-9c87-496d-99d9-c590b76b924d admin admin] PATH_INFO: `/v3/domains` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:22:16.321956 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d8198a-9c87-496d-99d9-c590b76b924d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 22:22:16.322267 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d8198a-9c87-496d-99d9-c590b76b924d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:22:16.323941 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d8198a-9c87-496d-99d9-c590b76b924d admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:22:16.336066 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4492/8959] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 22:22:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 22:22:16.340948 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e713618-2d64-4a60-afb1-13bcc9c2c3b1 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:22:16.350116 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e713618-2d64-4a60-afb1-13bcc9c2c3b1 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:22:16.354731 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df21695-9b69-4285-b326-c2bc9e6b82d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:22:16.356452 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df21695-9b69-4285-b326-c2bc9e6b82d5 admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:22:16.356735 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df21695-9b69-4285-b326-c2bc9e6b82d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:22:16.357011 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df21695-9b69-4285-b326-c2bc9e6b82d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:22:16.357697 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df21695-9b69-4285-b326-c2bc9e6b82d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:22:16.359623 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df21695-9b69-4285-b326-c2bc9e6b82d5 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:22:16.456177 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4468/8960] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 22:22:16 2022] POST /identity/v3/projects => generated 371 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 22:22:16.460421 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d8198a-9c87-496d-99d9-c590b76b924d admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:22:16.471224 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d8198a-9c87-496d-99d9-c590b76b924d admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:22:16.530705 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eea77b-8b75-4fd3-8513-ae0fe3ed89e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:22:16.531392 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eea77b-8b75-4fd3-8513-ae0fe3ed89e8 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:22:16.531711 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eea77b-8b75-4fd3-8513-ae0fe3ed89e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:22:16.531991 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eea77b-8b75-4fd3-8513-ae0fe3ed89e8 admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:22:16.532682 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eea77b-8b75-4fd3-8513-ae0fe3ed89e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:22:16.534608 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eea77b-8b75-4fd3-8513-ae0fe3ed89e8 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:22:16.631543 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4493/8961] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 22:22:16 2022] POST /identity/v3/users => generated 286 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 22:22:16.636900 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df21695-9b69-4285-b326-c2bc9e6b82d5 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:22:16.648740 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df21695-9b69-4285-b326-c2bc9e6b82d5 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:22:16.654377 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28123e53-6ee0-4935-85d1-ebaa8204a35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:22:16.655509 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28123e53-6ee0-4935-85d1-ebaa8204a35f admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:22:16.655888 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28123e53-6ee0-4935-85d1-ebaa8204a35f admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:22:16.656169 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28123e53-6ee0-4935-85d1-ebaa8204a35f admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:22:16.656897 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28123e53-6ee0-4935-85d1-ebaa8204a35f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:22:16.658518 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28123e53-6ee0-4935-85d1-ebaa8204a35f admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:22:16.673486 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4469/8962] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 22:22:16 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 22:22:16.677577 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eea77b-8b75-4fd3-8513-ae0fe3ed89e8 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:22:16.689649 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eea77b-8b75-4fd3-8513-ae0fe3ed89e8 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:22:16.694380 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969dbf4b-735d-4758-b833-c5625ab9c9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:22:16.695167 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969dbf4b-735d-4758-b833-c5625ab9c9bb admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:22:16.695454 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969dbf4b-735d-4758-b833-c5625ab9c9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:22:16.695760 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969dbf4b-735d-4758-b833-c5625ab9c9bb admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:22:16.696474 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969dbf4b-735d-4758-b833-c5625ab9c9bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:22:16.698105 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969dbf4b-735d-4758-b833-c5625ab9c9bb admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:22:16.711090 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4494/8963] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 22:22:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 22:22:16.716051 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28123e53-6ee0-4935-85d1-ebaa8204a35f admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:22:16.726419 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28123e53-6ee0-4935-85d1-ebaa8204a35f admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:22:16.732059 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b42574d-1a73-44c9-9c0e-99cae2f8c89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:22:16.733600 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b42574d-1a73-44c9-9c0e-99cae2f8c89b admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:22:16.734095 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b42574d-1a73-44c9-9c0e-99cae2f8c89b admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:22:16.734591 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b42574d-1a73-44c9-9c0e-99cae2f8c89b admin admin] PATH_INFO: `/v3/projects/a339e577d4bb4a4d8bc280b4edab9ef8/users/b3ec4b155d344282909459de93091eee/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:22:16.750805 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b42574d-1a73-44c9-9c0e-99cae2f8c89b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a339e577d4bb4a4d8bc280b4edab9ef8, user_id=b3ec4b155d344282909459de93091eee, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:22:16.753687 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b42574d-1a73-44c9-9c0e-99cae2f8c89b admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:22:16.844364 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4470/8964] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 22:22:16 2022] PUT /identity/v3/projects/a339e577d4bb4a4d8bc280b4edab9ef8/users/b3ec4b155d344282909459de93091eee/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 22:22:16.849520 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7496a3c-f21d-4fe5-933b-e67966d0c8ab None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:22:16.849817 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7496a3c-f21d-4fe5-933b-e67966d0c8ab None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:22:16.850147 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7496a3c-f21d-4fe5-933b-e67966d0c8ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:22:16.873108 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-f7496a3c-f21d-4fe5-933b-e67966d0c8ab None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:22:16.874748 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-f7496a3c-f21d-4fe5-933b-e67966d0c8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:22:16.950226 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4495/8965] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 22:22:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:22:16.961175 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b42574d-1a73-44c9-9c0e-99cae2f8c89b admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:22:16.963379 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-5b42574d-1a73-44c9-9c0e-99cae2f8c89b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:22:17.037033 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b42574d-1a73-44c9-9c0e-99cae2f8c89b admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:22:17.041559 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557cfbda-b7b2-4c9d-9879-f3a9927a4cca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:22:17.042557 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557cfbda-b7b2-4c9d-9879-f3a9927a4cca service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:22:17.043023 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557cfbda-b7b2-4c9d-9879-f3a9927a4cca service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:22:17.043545 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557cfbda-b7b2-4c9d-9879-f3a9927a4cca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:22:17.059108 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557cfbda-b7b2-4c9d-9879-f3a9927a4cca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:22:17.061285 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557cfbda-b7b2-4c9d-9879-f3a9927a4cca service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:22:17.074642 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4471/8966] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:22:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:22:22.419826 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9f4e5-3373-4560-92fb-737a75121866 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:22:22.420389 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9f4e5-3373-4560-92fb-737a75121866 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:22:22.420389 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9f4e5-3373-4560-92fb-737a75121866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:22:22.449932 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-27d9f4e5-3373-4560-92fb-737a75121866 None None] MFA Rules not processed for user `b3ec4b155d344282909459de93091eee`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:22:22.451149 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-27d9f4e5-3373-4560-92fb-737a75121866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:22:22.524270 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4496/8967] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 22:22:22 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:22:22.528994 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557cfbda-b7b2-4c9d-9879-f3a9927a4cca service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:22:22.539248 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557cfbda-b7b2-4c9d-9879-f3a9927a4cca service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:22:22.544407 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a433931b-7c02-436d-8c91-af31d2ba4f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:22:22.545078 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a433931b-7c02-436d-8c91-af31d2ba4f6f admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:22:22.545363 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a433931b-7c02-436d-8c91-af31d2ba4f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:22:22.545643 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a433931b-7c02-436d-8c91-af31d2ba4f6f admin admin] PATH_INFO: `/v3/projects` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:22:22.546336 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a433931b-7c02-436d-8c91-af31d2ba4f6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:22:22.548418 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a433931b-7c02-436d-8c91-af31d2ba4f6f admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:22:22.648033 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4472/8968] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 22:22:22 2022] POST /identity/v3/projects => generated 373 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 22:22:22.649605 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d9f4e5-3373-4560-92fb-737a75121866 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:22:22.662899 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d9f4e5-3373-4560-92fb-737a75121866 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:22:22.733588 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e26f2-95bc-42d9-84c7-d35cdd3c211e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:22:22.734535 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e26f2-95bc-42d9-84c7-d35cdd3c211e admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:22:22.734912 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e26f2-95bc-42d9-84c7-d35cdd3c211e admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:22:22.735282 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e26f2-95bc-42d9-84c7-d35cdd3c211e admin admin] PATH_INFO: `/v3/users` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:22:22.736114 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249e26f2-95bc-42d9-84c7-d35cdd3c211e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:22:22.739934 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249e26f2-95bc-42d9-84c7-d35cdd3c211e admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:22:22.857305 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4497/8969] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 22:22:22 2022] POST /identity/v3/users => generated 293 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 22:22:22.859045 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a433931b-7c02-436d-8c91-af31d2ba4f6f admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:22:22.870329 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a433931b-7c02-436d-8c91-af31d2ba4f6f admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:22:22.875288 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a887ed2-44a1-4a5c-b3f3-0ba409f5955b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:22:22.876290 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a887ed2-44a1-4a5c-b3f3-0ba409f5955b admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:22:22.876524 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a887ed2-44a1-4a5c-b3f3-0ba409f5955b admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:22:22.876808 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a887ed2-44a1-4a5c-b3f3-0ba409f5955b admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:22:22.877546 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a887ed2-44a1-4a5c-b3f3-0ba409f5955b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:22:22.879280 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a887ed2-44a1-4a5c-b3f3-0ba409f5955b admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:22:22.892197 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4473/8970] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 22:22:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 22:22:22.896267 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e26f2-95bc-42d9-84c7-d35cdd3c211e admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:22:22.909102 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e26f2-95bc-42d9-84c7-d35cdd3c211e admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:22:22.914119 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e665957f-81b8-4918-93d3-f2641c4fea43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:22:22.919512 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e665957f-81b8-4918-93d3-f2641c4fea43 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:22:22.919512 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e665957f-81b8-4918-93d3-f2641c4fea43 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:22:22.919512 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e665957f-81b8-4918-93d3-f2641c4fea43 admin admin] PATH_INFO: `/v3/projects/b882e152e7c44beb81202604906c2add/users/5bf0142e77bf4336a8e44e0996b3873c/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:22:22.938930 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e665957f-81b8-4918-93d3-f2641c4fea43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b882e152e7c44beb81202604906c2add, user_id=5bf0142e77bf4336a8e44e0996b3873c, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:22:22.941844 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e665957f-81b8-4918-93d3-f2641c4fea43 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:22:23.004768 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4498/8971] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 22:22:22 2022] PUT /identity/v3/projects/b882e152e7c44beb81202604906c2add/users/5bf0142e77bf4336a8e44e0996b3873c/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 22:22:23.008606 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a887ed2-44a1-4a5c-b3f3-0ba409f5955b admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:22:23.019077 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a887ed2-44a1-4a5c-b3f3-0ba409f5955b admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:22:23.076466 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417bf3cf-39d3-49a4-8485-ea8fef3d5794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:22:23.077142 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417bf3cf-39d3-49a4-8485-ea8fef3d5794 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:22:23.077425 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417bf3cf-39d3-49a4-8485-ea8fef3d5794 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:22:23.077700 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417bf3cf-39d3-49a4-8485-ea8fef3d5794 admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:22:23.078422 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417bf3cf-39d3-49a4-8485-ea8fef3d5794 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:22:23.080063 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417bf3cf-39d3-49a4-8485-ea8fef3d5794 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:22:23.090978 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4474/8972] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 22:22:23 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 22:22:23.095196 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e665957f-81b8-4918-93d3-f2641c4fea43 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:22:23.106811 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e665957f-81b8-4918-93d3-f2641c4fea43 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:22:23.111427 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a461ebe-0006-4a76-9e61-b49225e4e4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:22:23.112350 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a461ebe-0006-4a76-9e61-b49225e4e4e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:22:23.112632 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a461ebe-0006-4a76-9e61-b49225e4e4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:22:23.112905 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a461ebe-0006-4a76-9e61-b49225e4e4e3 admin admin] PATH_INFO: `/v3/projects/b882e152e7c44beb81202604906c2add/users/5bf0142e77bf4336a8e44e0996b3873c/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:22:23.114918 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a461ebe-0006-4a76-9e61-b49225e4e4e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b882e152e7c44beb81202604906c2add, user_id=5bf0142e77bf4336a8e44e0996b3873c, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:22:23.117647 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a461ebe-0006-4a76-9e61-b49225e4e4e3 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:22:23.128925 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4499/8973] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 22:22:23 2022] PUT /identity/v3/projects/b882e152e7c44beb81202604906c2add/users/5bf0142e77bf4336a8e44e0996b3873c/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 22:22:28.283788 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417bf3cf-39d3-49a4-8485-ea8fef3d5794 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:22:28.285702 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-417bf3cf-39d3-49a4-8485-ea8fef3d5794 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:22:28.379444 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417bf3cf-39d3-49a4-8485-ea8fef3d5794 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:22:28.473830 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9496ec5-4bc9-4846-b686-d499682c919c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:22:28.474772 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9496ec5-4bc9-4846-b686-d499682c919c service placement] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:22:28.475233 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9496ec5-4bc9-4846-b686-d499682c919c service placement] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:22:28.475702 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9496ec5-4bc9-4846-b686-d499682c919c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:22:28.478412 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e9496ec5-4bc9-4846-b686-d499682c919c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:22:28.491265 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9496ec5-4bc9-4846-b686-d499682c919c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:22:28.492939 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9496ec5-4bc9-4846-b686-d499682c919c service placement] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:22:28.504445 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4475/8974] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:22:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:22:28.792731 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7623d49-ed77-4883-b063-c76e75083de4 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:22:28.793400 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7623d49-ed77-4883-b063-c76e75083de4 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:22:28.793400 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7623d49-ed77-4883-b063-c76e75083de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:22:28.839940 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-d7623d49-ed77-4883-b063-c76e75083de4 None None] MFA Rules not processed for user `5bf0142e77bf4336a8e44e0996b3873c`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:22:28.841179 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-d7623d49-ed77-4883-b063-c76e75083de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:22:28.919105 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4500/8975] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 22:22:28 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:22:28.941532 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9496ec5-4bc9-4846-b686-d499682c919c service placement] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:22:28.944246 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e9496ec5-4bc9-4846-b686-d499682c919c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:22:29.038004 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9496ec5-4bc9-4846-b686-d499682c919c service placement] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:22:29.043870 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c83243-2aa5-474b-91b7-577aef413445 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:22:29.044532 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c83243-2aa5-474b-91b7-577aef413445 service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:22:29.044820 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c83243-2aa5-474b-91b7-577aef413445 service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:22:29.045105 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c83243-2aa5-474b-91b7-577aef413445 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:22:29.106733 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c83243-2aa5-474b-91b7-577aef413445 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:22:29.108486 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c83243-2aa5-474b-91b7-577aef413445 service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:22:29.119178 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4476/8976] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:22:28 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:22:31.632059 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da722861-83da-4687-9eb2-ae3a1bc3b126 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:22:31.632594 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da722861-83da-4687-9eb2-ae3a1bc3b126 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:22:31.632677 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da722861-83da-4687-9eb2-ae3a1bc3b126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:22:31.652756 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-da722861-83da-4687-9eb2-ae3a1bc3b126 None None] MFA Rules not processed for user `b3ec4b155d344282909459de93091eee`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:22:31.654075 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-da722861-83da-4687-9eb2-ae3a1bc3b126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:22:31.661576 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4501/8977] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 22:22:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:22:32.025667 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c83243-2aa5-474b-91b7-577aef413445 service nova] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:22:32.027385 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-14c83243-2aa5-474b-91b7-577aef413445 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:22:32.098206 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c83243-2aa5-474b-91b7-577aef413445 service nova] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:22:32.105461 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332985bf-ea41-4880-b9c9-cd218f785b3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:22:32.106224 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332985bf-ea41-4880-b9c9-cd218f785b3e service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:22:32.106591 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332985bf-ea41-4880-b9c9-cd218f785b3e service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:22:32.107006 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332985bf-ea41-4880-b9c9-cd218f785b3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:22:32.109677 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-332985bf-ea41-4880-b9c9-cd218f785b3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:22:32.126183 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332985bf-ea41-4880-b9c9-cd218f785b3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:22:32.127718 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332985bf-ea41-4880-b9c9-cd218f785b3e service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:22:32.143840 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4477/8978] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:22:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 22:22:32.634191 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da722861-83da-4687-9eb2-ae3a1bc3b126 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:22:32.636744 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-da722861-83da-4687-9eb2-ae3a1bc3b126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:22:32.657205 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da722861-83da-4687-9eb2-ae3a1bc3b126 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:22:32.664800 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055d481a-b451-4b84-a72a-08b7cef62c9f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:22:32.665901 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055d481a-b451-4b84-a72a-08b7cef62c9f service placement] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:22:32.666335 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055d481a-b451-4b84-a72a-08b7cef62c9f service placement] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:22:32.667393 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055d481a-b451-4b84-a72a-08b7cef62c9f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:22:32.672129 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-055d481a-b451-4b84-a72a-08b7cef62c9f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:22:32.686246 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055d481a-b451-4b84-a72a-08b7cef62c9f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:22:32.687904 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055d481a-b451-4b84-a72a-08b7cef62c9f service placement] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:22:32.700806 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4502/8979] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:22:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:22:45.599932 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332985bf-ea41-4880-b9c9-cd218f785b3e service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:22:45.609202 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332985bf-ea41-4880-b9c9-cd218f785b3e service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:22:45.612834 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a94a9-c8f1-4e43-8476-059fe3636a2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:22:45.613465 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a94a9-c8f1-4e43-8476-059fe3636a2f service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:22:45.613747 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a94a9-c8f1-4e43-8476-059fe3636a2f service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:22:45.614021 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a94a9-c8f1-4e43-8476-059fe3636a2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:22:45.622833 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716a94a9-c8f1-4e43-8476-059fe3636a2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:22:45.624278 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716a94a9-c8f1-4e43-8476-059fe3636a2f service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:22:45.633496 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4478/8980] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:22:45 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:23:27.717099 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055d481a-b451-4b84-a72a-08b7cef62c9f service placement] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:23:27.756776 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055d481a-b451-4b84-a72a-08b7cef62c9f service placement] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:23:27.761830 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee53104c-7936-426f-94b7-d3eb3989f67a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:23:27.762473 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee53104c-7936-426f-94b7-d3eb3989f67a service placement] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:23:27.762752 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee53104c-7936-426f-94b7-d3eb3989f67a service placement] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:23:27.763028 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee53104c-7936-426f-94b7-d3eb3989f67a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:23:27.764793 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ee53104c-7936-426f-94b7-d3eb3989f67a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:23:27.796779 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee53104c-7936-426f-94b7-d3eb3989f67a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:23:27.799183 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee53104c-7936-426f-94b7-d3eb3989f67a service placement] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:23:27.809252 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4503/8981] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:23:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:24:56.675730 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c96fa-1f88-4e7d-8fd4-fd5f3c693719 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:24:56.677745 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c96fa-1f88-4e7d-8fd4-fd5f3c693719 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:24:56.677745 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c96fa-1f88-4e7d-8fd4-fd5f3c693719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:24:56.733865 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-749c96fa-1f88-4e7d-8fd4-fd5f3c693719 None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:24:56.735068 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-749c96fa-1f88-4e7d-8fd4-fd5f3c693719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:24:56.807567 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4479/8982] 10.222.0.52 () {58 vars in 1009 bytes} [Sat May 14 22:24:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:24:56.952606 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee53104c-7936-426f-94b7-d3eb3989f67a service placement] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:24:56.954016 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-ee53104c-7936-426f-94b7-d3eb3989f67a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:24:57.040730 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee53104c-7936-426f-94b7-d3eb3989f67a service placement] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:24:57.046741 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1c296b-1de1-4a1e-b248-79fe49c8d10c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:24:57.047401 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c296b-1de1-4a1e-b248-79fe49c8d10c service swift] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:24:57.047727 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c296b-1de1-4a1e-b248-79fe49c8d10c service swift] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:24:57.048013 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c296b-1de1-4a1e-b248-79fe49c8d10c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:24:57.056294 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1c296b-1de1-4a1e-b248-79fe49c8d10c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:24:57.057880 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1c296b-1de1-4a1e-b248-79fe49c8d10c service swift] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:24:57.066612 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4504/8983] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 22:24:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 22:25:09.458982 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749c96fa-1f88-4e7d-8fd4-fd5f3c693719 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:25:09.468777 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749c96fa-1f88-4e7d-8fd4-fd5f3c693719 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:25:09.472564 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a7e68d-c2b4-431a-b0f9-59afe0c2dcd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:25:09.473243 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7e68d-c2b4-431a-b0f9-59afe0c2dcd7 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:25:09.473529 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7e68d-c2b4-431a-b0f9-59afe0c2dcd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:25:09.473807 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7e68d-c2b4-431a-b0f9-59afe0c2dcd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:25:09.475625 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-74a7e68d-c2b4-431a-b0f9-59afe0c2dcd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:25:09.503339 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a7e68d-c2b4-431a-b0f9-59afe0c2dcd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:25:09.504850 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a7e68d-c2b4-431a-b0f9-59afe0c2dcd7 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:25:09.524909 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4480/8984] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:25:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:25:11.084696 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96507c85-9d50-4a4c-9613-db7f6afbeb29 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:25:11.085279 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96507c85-9d50-4a4c-9613-db7f6afbeb29 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:25:11.085279 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96507c85-9d50-4a4c-9613-db7f6afbeb29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:25:11.135369 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-96507c85-9d50-4a4c-9613-db7f6afbeb29 None None] MFA Rules not processed for user `0f1b0e2b025d4eceaa90e1616d0a9db8`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:25:11.136659 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-96507c85-9d50-4a4c-9613-db7f6afbeb29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:25:11.146519 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4505/8985] 10.222.0.52 () {58 vars in 1018 bytes} [Sat May 14 22:25:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:25:11.158292 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a7e68d-c2b4-431a-b0f9-59afe0c2dcd7 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:25:11.159862 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-74a7e68d-c2b4-431a-b0f9-59afe0c2dcd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:25:11.237395 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a7e68d-c2b4-431a-b0f9-59afe0c2dcd7 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:25:11.241520 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c09a1-8c44-464e-8e53-0bd7f1be45d0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b5cb86f190f4fcfb06d66cb8f14643f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:25:11.242161 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c09a1-8c44-464e-8e53-0bd7f1be45d0 service glance] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:25:11.242445 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c09a1-8c44-464e-8e53-0bd7f1be45d0 service glance] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:25:11.242736 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c09a1-8c44-464e-8e53-0bd7f1be45d0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:25:11.253458 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21c09a1-8c44-464e-8e53-0bd7f1be45d0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:25:11.254891 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21c09a1-8c44-464e-8e53-0bd7f1be45d0 service glance] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:25:11.265850 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4481/8986] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:25:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:25:11.421475 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96507c85-9d50-4a4c-9613-db7f6afbeb29 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:25:11.431040 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96507c85-9d50-4a4c-9613-db7f6afbeb29 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:25:11.434902 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04fa795-4aaa-439a-b984-7028615ebd4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:25:11.435815 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04fa795-4aaa-439a-b984-7028615ebd4e service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:25:11.436322 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04fa795-4aaa-439a-b984-7028615ebd4e service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:25:11.436605 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04fa795-4aaa-439a-b984-7028615ebd4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:25:11.438405 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-b04fa795-4aaa-439a-b984-7028615ebd4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:25:11.459774 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04fa795-4aaa-439a-b984-7028615ebd4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:25:11.461183 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04fa795-4aaa-439a-b984-7028615ebd4e service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:25:11.469892 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4506/8987] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:25:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:25:11.544697 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c09a1-8c44-464e-8e53-0bd7f1be45d0 service glance] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:25:11.554691 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c09a1-8c44-464e-8e53-0bd7f1be45d0 service glance] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:25:11.558798 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aefe77e-ff1a-42ce-8942-32d41b155364 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:25:11.559545 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aefe77e-ff1a-42ce-8942-32d41b155364 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:25:11.559907 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aefe77e-ff1a-42ce-8942-32d41b155364 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:25:11.560275 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aefe77e-ff1a-42ce-8942-32d41b155364 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:25:11.562886 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-0aefe77e-ff1a-42ce-8942-32d41b155364 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:25:11.577148 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aefe77e-ff1a-42ce-8942-32d41b155364 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:25:11.578596 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aefe77e-ff1a-42ce-8942-32d41b155364 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:25:11.590095 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4482/8988] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:25:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:25:11.649439 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04fa795-4aaa-439a-b984-7028615ebd4e service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:25:11.663679 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04fa795-4aaa-439a-b984-7028615ebd4e service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:25:11.669237 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d0631b-e9f8-4e31-ba70-7193782eba3c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:25:11.670652 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d0631b-e9f8-4e31-ba70-7193782eba3c service placement] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:25:11.670652 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d0631b-e9f8-4e31-ba70-7193782eba3c service placement] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:25:11.670652 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d0631b-e9f8-4e31-ba70-7193782eba3c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:25:11.672666 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-51d0631b-e9f8-4e31-ba70-7193782eba3c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:25:11.684606 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d0631b-e9f8-4e31-ba70-7193782eba3c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:25:11.686417 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d0631b-e9f8-4e31-ba70-7193782eba3c service placement] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:25:11.696644 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4507/8989] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:25:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:25:13.494123 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a28f0-01a8-48cd-8ebb-ffb37b744f86 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:25:13.494672 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a28f0-01a8-48cd-8ebb-ffb37b744f86 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:25:13.494810 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a28f0-01a8-48cd-8ebb-ffb37b744f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:25:13.513210 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-0f4a28f0-01a8-48cd-8ebb-ffb37b744f86 None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:25:13.515068 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-0f4a28f0-01a8-48cd-8ebb-ffb37b744f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:25:13.522383 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4483/8990] 10.222.0.52 () {58 vars in 1009 bytes} [Sat May 14 22:25:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:25:13.537791 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d0631b-e9f8-4e31-ba70-7193782eba3c service placement] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:25:13.549139 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d0631b-e9f8-4e31-ba70-7193782eba3c service placement] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:25:13.554081 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6936eedf-bdf8-4c80-a35c-03ce4da97fb4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:25:13.554713 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936eedf-bdf8-4c80-a35c-03ce4da97fb4 service swift] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:25:13.555023 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936eedf-bdf8-4c80-a35c-03ce4da97fb4 service swift] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:25:13.555298 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936eedf-bdf8-4c80-a35c-03ce4da97fb4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:25:13.564002 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6936eedf-bdf8-4c80-a35c-03ce4da97fb4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:25:13.565584 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6936eedf-bdf8-4c80-a35c-03ce4da97fb4 service swift] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:25:13.573489 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4508/8991] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 22:25:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 22:25:26.963194 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2f4eb-566a-474c-b394-4018dfbd5a6b None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:25:26.963759 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2f4eb-566a-474c-b394-4018dfbd5a6b None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:25:26.963759 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2f4eb-566a-474c-b394-4018dfbd5a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:25:26.981664 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-53a2f4eb-566a-474c-b394-4018dfbd5a6b None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:25:26.989611 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-53a2f4eb-566a-474c-b394-4018dfbd5a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:25:26.996767 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4484/8992] 10.222.0.52 () {58 vars in 967 bytes} [Sat May 14 22:25:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:25:27.010451 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6936eedf-bdf8-4c80-a35c-03ce4da97fb4 service swift] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:25:27.021127 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6936eedf-bdf8-4c80-a35c-03ce4da97fb4 service swift] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:25:27.026339 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ae5072-d84f-49ed-ba52-c462d5646391 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:25:27.026982 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae5072-d84f-49ed-ba52-c462d5646391 service swift] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:25:27.027270 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae5072-d84f-49ed-ba52-c462d5646391 service swift] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:25:27.027610 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae5072-d84f-49ed-ba52-c462d5646391 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:25:27.036693 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ae5072-d84f-49ed-ba52-c462d5646391 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:25:27.038343 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ae5072-d84f-49ed-ba52-c462d5646391 service swift] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:25:27.047430 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4509/8993] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 22:25:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 22:26:40.218303 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a2f4eb-566a-474c-b394-4018dfbd5a6b None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:26:40.231210 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a2f4eb-566a-474c-b394-4018dfbd5a6b None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:26:40.237709 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f42492-c97f-49cb-a54d-b7ab71c96402 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:26:40.238362 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f42492-c97f-49cb-a54d-b7ab71c96402 service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:26:40.238698 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f42492-c97f-49cb-a54d-b7ab71c96402 service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:26:40.238977 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f42492-c97f-49cb-a54d-b7ab71c96402 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:26:40.240915 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c0f42492-c97f-49cb-a54d-b7ab71c96402 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:26:40.254540 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f42492-c97f-49cb-a54d-b7ab71c96402 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:26:40.256320 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f42492-c97f-49cb-a54d-b7ab71c96402 service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:26:40.267370 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4485/8994] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:26:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:26:41.226646 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ae5072-d84f-49ed-ba52-c462d5646391 service swift] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:26:41.237045 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ae5072-d84f-49ed-ba52-c462d5646391 service swift] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:26:41.241404 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e8ba86-b0ab-4c51-b508-c00662dde990 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:26:41.242343 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e8ba86-b0ab-4c51-b508-c00662dde990 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:26:41.242627 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e8ba86-b0ab-4c51-b508-c00662dde990 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:26:41.242896 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e8ba86-b0ab-4c51-b508-c00662dde990 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:26:41.244842 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-16e8ba86-b0ab-4c51-b508-c00662dde990 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:26:41.255817 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e8ba86-b0ab-4c51-b508-c00662dde990 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:26:41.257222 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e8ba86-b0ab-4c51-b508-c00662dde990 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:26:41.264899 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4510/8995] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:26:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:26:46.238693 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54605cc-c447-49f2-9e91-fbf99d3d82b2 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:26:46.248890 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54605cc-c447-49f2-9e91-fbf99d3d82b2 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:26:46.248890 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54605cc-c447-49f2-9e91-fbf99d3d82b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:26:46.256986 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-c54605cc-c447-49f2-9e91-fbf99d3d82b2 None None] MFA Rules not processed for user `b3ec4b155d344282909459de93091eee`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:26:46.258180 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-c54605cc-c447-49f2-9e91-fbf99d3d82b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:26:46.265051 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4486/8996] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 22:26:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:26:53.766235 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e8ba86-b0ab-4c51-b508-c00662dde990 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:26:53.775712 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e8ba86-b0ab-4c51-b508-c00662dde990 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:26:53.779521 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe360af-8d19-4bc0-ae36-2b6ca997d1a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:26:53.780158 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe360af-8d19-4bc0-ae36-2b6ca997d1a7 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:26:53.780439 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe360af-8d19-4bc0-ae36-2b6ca997d1a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:26:53.780710 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe360af-8d19-4bc0-ae36-2b6ca997d1a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:26:53.782469 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-8fe360af-8d19-4bc0-ae36-2b6ca997d1a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:26:53.793165 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe360af-8d19-4bc0-ae36-2b6ca997d1a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:26:53.794622 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe360af-8d19-4bc0-ae36-2b6ca997d1a7 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:26:53.802597 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4511/8997] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:26:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:27:02.224736 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54605cc-c447-49f2-9e91-fbf99d3d82b2 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:27:02.237282 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54605cc-c447-49f2-9e91-fbf99d3d82b2 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:27:02.245514 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adafa40-1af6-4a38-9baa-d11fad9b755e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:27:02.245514 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adafa40-1af6-4a38-9baa-d11fad9b755e service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:27:02.245514 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adafa40-1af6-4a38-9baa-d11fad9b755e service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:27:02.245514 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adafa40-1af6-4a38-9baa-d11fad9b755e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:27:02.246749 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-0adafa40-1af6-4a38-9baa-d11fad9b755e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:27:02.259327 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adafa40-1af6-4a38-9baa-d11fad9b755e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:27:02.262983 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adafa40-1af6-4a38-9baa-d11fad9b755e service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:27:02.271735 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4487/8998] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:27:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:27:32.306804 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe360af-8d19-4bc0-ae36-2b6ca997d1a7 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:27:32.319154 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe360af-8d19-4bc0-ae36-2b6ca997d1a7 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:27:32.324357 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b1222-daf1-4d72-822a-8926645c0369 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:27:32.324995 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b1222-daf1-4d72-822a-8926645c0369 service placement] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:27:32.325876 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b1222-daf1-4d72-822a-8926645c0369 service placement] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:27:32.326234 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b1222-daf1-4d72-822a-8926645c0369 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:27:32.335121 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12b1222-daf1-4d72-822a-8926645c0369 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:27:32.338430 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12b1222-daf1-4d72-822a-8926645c0369 service placement] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:27:32.347544 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4512/8999] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:27:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:28:36.718812 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adafa40-1af6-4a38-9baa-d11fad9b755e service nova] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:28:36.729814 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adafa40-1af6-4a38-9baa-d11fad9b755e service nova] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:28:36.734805 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813ff560-bb6e-4bea-b8e5-d5dce7ed2a84 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:28:36.735441 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ff560-bb6e-4bea-b8e5-d5dce7ed2a84 service placement] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:28:36.735755 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ff560-bb6e-4bea-b8e5-d5dce7ed2a84 service placement] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:28:36.736029 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ff560-bb6e-4bea-b8e5-d5dce7ed2a84 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:28:36.745050 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813ff560-bb6e-4bea-b8e5-d5dce7ed2a84 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:28:36.746629 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813ff560-bb6e-4bea-b8e5-d5dce7ed2a84 service placement] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:28:36.757326 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4488/9000] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:28:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:30:22.027038 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b1222-daf1-4d72-822a-8926645c0369 service placement] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:30:22.039499 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b1222-daf1-4d72-822a-8926645c0369 service placement] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:30:22.046512 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bb4351-c525-4839-856b-e057c0237834 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:30:22.047162 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb4351-c525-4839-856b-e057c0237834 service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:30:22.047615 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb4351-c525-4839-856b-e057c0237834 service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:30:22.047903 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb4351-c525-4839-856b-e057c0237834 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:30:22.057142 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bb4351-c525-4839-856b-e057c0237834 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:30:22.058729 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bb4351-c525-4839-856b-e057c0237834 service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:30:22.067816 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4513/9001] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:30:22 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:30:24.521173 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813ff560-bb6e-4bea-b8e5-d5dce7ed2a84 service placement] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:30:24.541035 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813ff560-bb6e-4bea-b8e5-d5dce7ed2a84 service placement] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:30:24.545024 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918eae6-152c-4354-a1bc-856e823a8a65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:30:24.545666 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918eae6-152c-4354-a1bc-856e823a8a65 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:30:24.545945 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918eae6-152c-4354-a1bc-856e823a8a65 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:30:24.546221 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918eae6-152c-4354-a1bc-856e823a8a65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:30:24.562275 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3918eae6-152c-4354-a1bc-856e823a8a65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:30:24.566113 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3918eae6-152c-4354-a1bc-856e823a8a65 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:30:24.576357 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4489/9002] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:30:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:30:28.458161 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bb4351-c525-4839-856b-e057c0237834 service nova] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:30:28.468472 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bb4351-c525-4839-856b-e057c0237834 service nova] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:30:28.472008 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a82e0-9ee6-45d3-b297-df99b1caf2b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:30:28.472687 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a82e0-9ee6-45d3-b297-df99b1caf2b8 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:30:28.472965 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a82e0-9ee6-45d3-b297-df99b1caf2b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:30:28.473238 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a82e0-9ee6-45d3-b297-df99b1caf2b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:30:28.543327 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878a82e0-9ee6-45d3-b297-df99b1caf2b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:30:28.545069 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878a82e0-9ee6-45d3-b297-df99b1caf2b8 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:30:28.563903 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4514/9003] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:30:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:30:35.980328 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918eae6-152c-4354-a1bc-856e823a8a65 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:30:36.001759 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918eae6-152c-4354-a1bc-856e823a8a65 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:30:36.007294 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e348bb-b1a8-493f-acb6-c7b098a6c6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:30:36.008307 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e348bb-b1a8-493f-acb6-c7b098a6c6dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:30:36.008596 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e348bb-b1a8-493f-acb6-c7b098a6c6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:30:36.012158 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e348bb-b1a8-493f-acb6-c7b098a6c6dd admin admin] PATH_INFO: `/v3/users/b3ec4b155d344282909459de93091eee` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:30:36.012158 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e348bb-b1a8-493f-acb6-c7b098a6c6dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3ec4b155d344282909459de93091eee)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:30:36.012158 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e348bb-b1a8-493f-acb6-c7b098a6c6dd admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:30:36.138834 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-51e348bb-b1a8-493f-acb6-c7b098a6c6dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3ec4b155d344282909459de93091eee'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:30:36.145391 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-51e348bb-b1a8-493f-acb6-c7b098a6c6dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3ec4b155d344282909459de93091eee'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:30:36.146059 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-51e348bb-b1a8-493f-acb6-c7b098a6c6dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3ec4b155d344282909459de93091eee'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:30:36.199633 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-51e348bb-b1a8-493f-acb6-c7b098a6c6dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3ec4b155d344282909459de93091eee'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:30:36.211336 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-51e348bb-b1a8-493f-acb6-c7b098a6c6dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3ec4b155d344282909459de93091eee'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:30:36.217701 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4490/9004] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 22:30:35 2022] DELETE /identity/v3/users/b3ec4b155d344282909459de93091eee => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 22:30:36.470617 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a82e0-9ee6-45d3-b297-df99b1caf2b8 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:30:36.482959 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a82e0-9ee6-45d3-b297-df99b1caf2b8 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:30:36.540770 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc6ed6-912b-4bda-9d27-2d78d9ba1690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:30:36.541644 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc6ed6-912b-4bda-9d27-2d78d9ba1690 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:30:36.542029 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc6ed6-912b-4bda-9d27-2d78d9ba1690 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:30:36.542319 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc6ed6-912b-4bda-9d27-2d78d9ba1690 admin admin] PATH_INFO: `/v3/projects/a339e577d4bb4a4d8bc280b4edab9ef8` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:30:36.543524 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bc6ed6-912b-4bda-9d27-2d78d9ba1690 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a339e577d4bb4a4d8bc280b4edab9ef8)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:30:36.545788 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bc6ed6-912b-4bda-9d27-2d78d9ba1690 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:30:36.685498 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e3bc6ed6-912b-4bda-9d27-2d78d9ba1690 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a339e577d4bb4a4d8bc280b4edab9ef8', 'request_id': 'req-e3bc6ed6-912b-4bda-9d27-2d78d9ba1690'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:30:36.690777 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e3bc6ed6-912b-4bda-9d27-2d78d9ba1690 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a339e577d4bb4a4d8bc280b4edab9ef8', 'request_id': 'req-e3bc6ed6-912b-4bda-9d27-2d78d9ba1690'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:30:36.788483 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e3bc6ed6-912b-4bda-9d27-2d78d9ba1690 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a339e577d4bb4a4d8bc280b4edab9ef8', 'request_id': 'req-e3bc6ed6-912b-4bda-9d27-2d78d9ba1690'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:30:36.813567 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e3bc6ed6-912b-4bda-9d27-2d78d9ba1690 admin admin] The token cache is being invalidate because project a339e577d4bb4a4d8bc280b4edab9ef8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 22:30:36.813864 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e3bc6ed6-912b-4bda-9d27-2d78d9ba1690 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:30:36.814501 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-e3bc6ed6-912b-4bda-9d27-2d78d9ba1690 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:30:36.816212 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4515/9005] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 22:30:36 2022] DELETE /identity/v3/projects/a339e577d4bb4a4d8bc280b4edab9ef8 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 22:30:36.820270 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e348bb-b1a8-493f-acb6-c7b098a6c6dd admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:30:36.821675 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-51e348bb-b1a8-493f-acb6-c7b098a6c6dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:30:36.834694 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e348bb-b1a8-493f-acb6-c7b098a6c6dd admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:30:36.890423 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f9d0e-8bc2-49f1-bb96-597045c02948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:30:36.891287 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f9d0e-8bc2-49f1-bb96-597045c02948 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:30:36.891604 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f9d0e-8bc2-49f1-bb96-597045c02948 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:30:36.891879 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f9d0e-8bc2-49f1-bb96-597045c02948 admin admin] PATH_INFO: `/v3/users/5bf0142e77bf4336a8e44e0996b3873c` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:30:36.893060 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1f9d0e-8bc2-49f1-bb96-597045c02948 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bf0142e77bf4336a8e44e0996b3873c)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:30:36.894967 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1f9d0e-8bc2-49f1-bb96-597045c02948 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:30:37.087784 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-af1f9d0e-8bc2-49f1-bb96-597045c02948 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bf0142e77bf4336a8e44e0996b3873c'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:30:37.095296 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-af1f9d0e-8bc2-49f1-bb96-597045c02948 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bf0142e77bf4336a8e44e0996b3873c'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:30:37.096023 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-af1f9d0e-8bc2-49f1-bb96-597045c02948 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bf0142e77bf4336a8e44e0996b3873c'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:30:37.176931 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-af1f9d0e-8bc2-49f1-bb96-597045c02948 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bf0142e77bf4336a8e44e0996b3873c'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:30:37.189368 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-af1f9d0e-8bc2-49f1-bb96-597045c02948 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bf0142e77bf4336a8e44e0996b3873c'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:30:37.195337 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4491/9006] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 22:30:36 2022] DELETE /identity/v3/users/5bf0142e77bf4336a8e44e0996b3873c => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 22:30:37.425894 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc6ed6-912b-4bda-9d27-2d78d9ba1690 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:30:37.427435 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e3bc6ed6-912b-4bda-9d27-2d78d9ba1690 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:30:37.441206 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc6ed6-912b-4bda-9d27-2d78d9ba1690 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:30:37.498241 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3bb79a-9b13-4167-a786-4f174fcfc0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:30:37.499098 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3bb79a-9b13-4167-a786-4f174fcfc0ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:30:37.499413 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3bb79a-9b13-4167-a786-4f174fcfc0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:30:37.499725 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3bb79a-9b13-4167-a786-4f174fcfc0ae admin admin] PATH_INFO: `/v3/projects/b882e152e7c44beb81202604906c2add` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:30:37.500904 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3bb79a-9b13-4167-a786-4f174fcfc0ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=b882e152e7c44beb81202604906c2add)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:30:37.502867 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3bb79a-9b13-4167-a786-4f174fcfc0ae admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:30:37.616689 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2a3bb79a-9b13-4167-a786-4f174fcfc0ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b882e152e7c44beb81202604906c2add', 'request_id': 'req-2a3bb79a-9b13-4167-a786-4f174fcfc0ae'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:30:37.622343 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2a3bb79a-9b13-4167-a786-4f174fcfc0ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b882e152e7c44beb81202604906c2add', 'request_id': 'req-2a3bb79a-9b13-4167-a786-4f174fcfc0ae'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:30:37.689807 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2a3bb79a-9b13-4167-a786-4f174fcfc0ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b882e152e7c44beb81202604906c2add', 'request_id': 'req-2a3bb79a-9b13-4167-a786-4f174fcfc0ae'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:30:37.701575 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2a3bb79a-9b13-4167-a786-4f174fcfc0ae admin admin] The token cache is being invalidate because project b882e152e7c44beb81202604906c2add was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 22:30:37.701861 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2a3bb79a-9b13-4167-a786-4f174fcfc0ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:30:37.702497 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-2a3bb79a-9b13-4167-a786-4f174fcfc0ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:30:37.704085 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4516/9007] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 22:30:37 2022] DELETE /identity/v3/projects/b882e152e7c44beb81202604906c2add => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 22:30:37.709160 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468eb5e2-0a88-4dab-80d9-2b8ba086b6bc None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:30:37.709453 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468eb5e2-0a88-4dab-80d9-2b8ba086b6bc None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:30:37.709736 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468eb5e2-0a88-4dab-80d9-2b8ba086b6bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:30:37.756212 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-468eb5e2-0a88-4dab-80d9-2b8ba086b6bc None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:30:37.757439 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-468eb5e2-0a88-4dab-80d9-2b8ba086b6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:30:37.816867 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4492/9008] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 22:30:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:30:37.825636 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e8ab9-9a9c-4ad2-8221-5cb78034e5e4 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:30:37.825929 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e8ab9-9a9c-4ad2-8221-5cb78034e5e4 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:30:37.826211 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e8ab9-9a9c-4ad2-8221-5cb78034e5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:30:37.845039 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-603e8ab9-9a9c-4ad2-8221-5cb78034e5e4 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:30:37.849685 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-603e8ab9-9a9c-4ad2-8221-5cb78034e5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:30:37.855354 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4517/9009] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 22:30:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:30:37.859728 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468eb5e2-0a88-4dab-80d9-2b8ba086b6bc None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:30:37.869502 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468eb5e2-0a88-4dab-80d9-2b8ba086b6bc None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:30:37.874773 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ac1e19-546e-4b60-a931-2294b10fb436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:30:37.875454 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac1e19-546e-4b60-a931-2294b10fb436 admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:30:37.875764 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac1e19-546e-4b60-a931-2294b10fb436 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:30:37.876068 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac1e19-546e-4b60-a931-2294b10fb436 admin admin] PATH_INFO: `/v3/domains` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:30:37.876792 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ac1e19-546e-4b60-a931-2294b10fb436 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 22:30:37.877094 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ac1e19-546e-4b60-a931-2294b10fb436 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:30:37.878723 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ac1e19-546e-4b60-a931-2294b10fb436 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:30:37.890210 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4493/9010] 10.222.0.52 () {58 vars in 1152 bytes} [Sat May 14 22:30:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 22:30:37.894584 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603e8ab9-9a9c-4ad2-8221-5cb78034e5e4 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:30:37.904451 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603e8ab9-9a9c-4ad2-8221-5cb78034e5e4 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:30:37.909352 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7805d9c2-d7ec-44cf-81fc-362e93a549b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:30:37.910002 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7805d9c2-d7ec-44cf-81fc-362e93a549b1 admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:30:37.910282 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7805d9c2-d7ec-44cf-81fc-362e93a549b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:30:37.910555 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7805d9c2-d7ec-44cf-81fc-362e93a549b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:30:37.911268 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7805d9c2-d7ec-44cf-81fc-362e93a549b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:30:37.913251 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7805d9c2-d7ec-44cf-81fc-362e93a549b1 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:30:38.018764 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4518/9011] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 22:30:37 2022] POST /identity/v3/projects => generated 373 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 22:30:38.022791 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ac1e19-546e-4b60-a931-2294b10fb436 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:30:38.032831 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ac1e19-546e-4b60-a931-2294b10fb436 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:30:38.089549 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bf06d8-55a9-439c-b769-72d0e7030acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:30:38.090228 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf06d8-55a9-439c-b769-72d0e7030acc admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:30:38.090516 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf06d8-55a9-439c-b769-72d0e7030acc admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:30:38.090789 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf06d8-55a9-439c-b769-72d0e7030acc admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:30:38.091464 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bf06d8-55a9-439c-b769-72d0e7030acc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:30:38.093658 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bf06d8-55a9-439c-b769-72d0e7030acc admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:30:38.188819 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4494/9012] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 22:30:38 2022] POST /identity/v3/users => generated 287 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 22:30:38.192769 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7805d9c2-d7ec-44cf-81fc-362e93a549b1 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:30:38.203294 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7805d9c2-d7ec-44cf-81fc-362e93a549b1 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:30:38.207989 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5900a6ac-3cb6-43ad-b9ac-f24213020e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:30:38.208640 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5900a6ac-3cb6-43ad-b9ac-f24213020e2e admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:30:38.208924 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5900a6ac-3cb6-43ad-b9ac-f24213020e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:30:38.209199 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5900a6ac-3cb6-43ad-b9ac-f24213020e2e admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:30:38.209912 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5900a6ac-3cb6-43ad-b9ac-f24213020e2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:30:38.211545 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5900a6ac-3cb6-43ad-b9ac-f24213020e2e admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:30:38.222002 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4519/9013] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 22:30:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 22:30:38.225868 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bf06d8-55a9-439c-b769-72d0e7030acc admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:30:38.236584 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bf06d8-55a9-439c-b769-72d0e7030acc admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:30:38.241309 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9463e0-7345-42be-b1c9-dfbeed86105f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:30:38.241964 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9463e0-7345-42be-b1c9-dfbeed86105f admin admin] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:30:38.242252 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9463e0-7345-42be-b1c9-dfbeed86105f admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:30:38.242560 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9463e0-7345-42be-b1c9-dfbeed86105f admin admin] PATH_INFO: `/v3/roles` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:30:38.243288 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9463e0-7345-42be-b1c9-dfbeed86105f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:30:38.245148 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9463e0-7345-42be-b1c9-dfbeed86105f admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:30:38.255017 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4495/9014] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 22:30:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 22:30:38.259297 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5900a6ac-3cb6-43ad-b9ac-f24213020e2e admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:30:38.272304 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5900a6ac-3cb6-43ad-b9ac-f24213020e2e admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:30:38.274029 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab0f901-cf32-431e-aa88-ff1f023a1bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:30:38.274921 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0f901-cf32-431e-aa88-ff1f023a1bc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:30:38.275200 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0f901-cf32-431e-aa88-ff1f023a1bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:30:38.275495 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0f901-cf32-431e-aa88-ff1f023a1bc7 admin admin] PATH_INFO: `/v3/projects/d2345189dd994ee0adc9391fe9f6856a/users/ccf50d85a6f2498f872254d47d1e70de/roles/4f4cbb0efdc1410294a05a7ba44f9320` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:30:38.291568 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab0f901-cf32-431e-aa88-ff1f023a1bc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2345189dd994ee0adc9391fe9f6856a, user_id=ccf50d85a6f2498f872254d47d1e70de, role_id=4f4cbb0efdc1410294a05a7ba44f9320)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:30:38.295129 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab0f901-cf32-431e-aa88-ff1f023a1bc7 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:30:38.399965 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4520/9015] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 22:30:38 2022] PUT /identity/v3/projects/d2345189dd994ee0adc9391fe9f6856a/users/ccf50d85a6f2498f872254d47d1e70de/roles/4f4cbb0efdc1410294a05a7ba44f9320 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 22:30:38.405909 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de778fe8-f164-4119-8e34-f1f47a97b485 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:30:38.406203 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de778fe8-f164-4119-8e34-f1f47a97b485 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:30:38.406482 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de778fe8-f164-4119-8e34-f1f47a97b485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:30:38.425475 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-de778fe8-f164-4119-8e34-f1f47a97b485 None None] MFA Rules not processed for user `9e6b0e25d0144f868beb29eb9540ea7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:30:38.426653 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-de778fe8-f164-4119-8e34-f1f47a97b485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:30:38.486060 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4496/9016] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 22:30:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:30:38.495892 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab0f901-cf32-431e-aa88-ff1f023a1bc7 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:30:38.501749 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-6ab0f901-cf32-431e-aa88-ff1f023a1bc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:30:38.556936 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab0f901-cf32-431e-aa88-ff1f023a1bc7 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:30:38.560655 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523a53a0-0da4-4317-9eb7-b7d7ea2a975a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:30:38.561301 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a53a0-0da4-4317-9eb7-b7d7ea2a975a service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:30:38.561586 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a53a0-0da4-4317-9eb7-b7d7ea2a975a service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:30:38.561862 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a53a0-0da4-4317-9eb7-b7d7ea2a975a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:30:38.570966 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523a53a0-0da4-4317-9eb7-b7d7ea2a975a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:30:38.572418 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523a53a0-0da4-4317-9eb7-b7d7ea2a975a service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:30:38.583613 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4521/9017] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:30:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:30:44.321354 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3b57e-9650-4591-858d-07d3edb97d00 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:30:44.321812 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3b57e-9650-4591-858d-07d3edb97d00 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:30:44.321965 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3b57e-9650-4591-858d-07d3edb97d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:30:44.361972 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-92d3b57e-9650-4591-858d-07d3edb97d00 None None] MFA Rules not processed for user `ccf50d85a6f2498f872254d47d1e70de`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:30:44.363211 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-92d3b57e-9650-4591-858d-07d3edb97d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:30:44.464219 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4497/9018] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 22:30:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:30:44.467269 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523a53a0-0da4-4317-9eb7-b7d7ea2a975a service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:30:44.478292 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523a53a0-0da4-4317-9eb7-b7d7ea2a975a service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:30:44.483950 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f2bdd-e68e-42f0-958c-af9b5be100ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:30:44.484852 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f2bdd-e68e-42f0-958c-af9b5be100ad admin admin] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:30:44.485390 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f2bdd-e68e-42f0-958c-af9b5be100ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:30:44.485883 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f2bdd-e68e-42f0-958c-af9b5be100ad admin admin] PATH_INFO: `/v3/projects` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:30:44.486788 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656f2bdd-e68e-42f0-958c-af9b5be100ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:30:44.488754 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656f2bdd-e68e-42f0-958c-af9b5be100ad admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:30:44.603160 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4522/9019] 10.222.0.52 () {60 vars in 1152 bytes} [Sat May 14 22:30:44 2022] POST /identity/v3/projects => generated 371 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 22:30:44.608008 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d3b57e-9650-4591-858d-07d3edb97d00 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:30:44.620372 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d3b57e-9650-4591-858d-07d3edb97d00 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:30:44.684119 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3b866d-1b9a-4478-9fdb-16be6465a04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:30:44.685042 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b866d-1b9a-4478-9fdb-16be6465a04e admin admin] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:30:44.685332 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b866d-1b9a-4478-9fdb-16be6465a04e admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:30:44.685611 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b866d-1b9a-4478-9fdb-16be6465a04e admin admin] PATH_INFO: `/v3/users` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:30:44.686391 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3b866d-1b9a-4478-9fdb-16be6465a04e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:30:44.688443 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3b866d-1b9a-4478-9fdb-16be6465a04e admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:30:44.772118 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4498/9020] 10.222.0.52 () {60 vars in 1143 bytes} [Sat May 14 22:30:44 2022] POST /identity/v3/users => generated 292 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 22:30:44.777359 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f2bdd-e68e-42f0-958c-af9b5be100ad admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:30:44.787784 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f2bdd-e68e-42f0-958c-af9b5be100ad admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:30:44.793170 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae4965a-d98a-409a-a63a-cc6c853bdd55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:30:44.793850 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae4965a-d98a-409a-a63a-cc6c853bdd55 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:30:44.794134 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae4965a-d98a-409a-a63a-cc6c853bdd55 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:30:44.794665 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae4965a-d98a-409a-a63a-cc6c853bdd55 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:30:44.795392 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae4965a-d98a-409a-a63a-cc6c853bdd55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:30:44.797083 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae4965a-d98a-409a-a63a-cc6c853bdd55 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:30:44.809275 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4523/9021] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 22:30:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 22:30:44.813404 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3b866d-1b9a-4478-9fdb-16be6465a04e admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:30:44.824336 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3b866d-1b9a-4478-9fdb-16be6465a04e admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:30:44.830028 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94c10f0-79ed-43ca-bb1a-bad92a31ed6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:30:44.831085 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c10f0-79ed-43ca-bb1a-bad92a31ed6f admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:30:44.831574 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c10f0-79ed-43ca-bb1a-bad92a31ed6f admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:30:44.832331 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c10f0-79ed-43ca-bb1a-bad92a31ed6f admin admin] PATH_INFO: `/v3/projects/a1026b33b53344e09d4d6dbcc58412f5/users/b230950759064229b4d42fb81ee4783e/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:30:44.848144 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94c10f0-79ed-43ca-bb1a-bad92a31ed6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1026b33b53344e09d4d6dbcc58412f5, user_id=b230950759064229b4d42fb81ee4783e, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:30:44.850840 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94c10f0-79ed-43ca-bb1a-bad92a31ed6f admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:30:44.909537 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4499/9022] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 22:30:44 2022] PUT /identity/v3/projects/a1026b33b53344e09d4d6dbcc58412f5/users/b230950759064229b4d42fb81ee4783e/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 22:30:44.913767 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae4965a-d98a-409a-a63a-cc6c853bdd55 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:30:44.925467 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae4965a-d98a-409a-a63a-cc6c853bdd55 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:30:44.985510 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41922f43-abc7-4fb0-b44d-81962ebe2c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:30:44.986185 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41922f43-abc7-4fb0-b44d-81962ebe2c36 admin admin] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:30:44.986466 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41922f43-abc7-4fb0-b44d-81962ebe2c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:30:44.986740 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41922f43-abc7-4fb0-b44d-81962ebe2c36 admin admin] PATH_INFO: `/v3/roles` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:30:44.987460 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41922f43-abc7-4fb0-b44d-81962ebe2c36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:30:44.989126 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41922f43-abc7-4fb0-b44d-81962ebe2c36 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:30:44.999866 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4524/9023] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 22:30:44 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 22:30:45.004151 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94c10f0-79ed-43ca-bb1a-bad92a31ed6f admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:30:45.021296 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94c10f0-79ed-43ca-bb1a-bad92a31ed6f admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:30:45.026135 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f419d751-58ea-4554-a26b-8571518e8b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:30:45.027026 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419d751-58ea-4554-a26b-8571518e8b32 admin admin] REQUEST_METHOD: `PUT` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:30:45.027302 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419d751-58ea-4554-a26b-8571518e8b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:30:45.027672 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419d751-58ea-4554-a26b-8571518e8b32 admin admin] PATH_INFO: `/v3/projects/a1026b33b53344e09d4d6dbcc58412f5/users/b230950759064229b4d42fb81ee4783e/roles/24c463e2b4d44dd28cd2723a69a8ed2e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:30:45.029580 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f419d751-58ea-4554-a26b-8571518e8b32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1026b33b53344e09d4d6dbcc58412f5, user_id=b230950759064229b4d42fb81ee4783e, role_id=24c463e2b4d44dd28cd2723a69a8ed2e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:30:45.032274 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f419d751-58ea-4554-a26b-8571518e8b32 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:30:45.042539 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4500/9024] 10.222.0.52 () {60 vars in 1482 bytes} [Sat May 14 22:30:45 2022] PUT /identity/v3/projects/a1026b33b53344e09d4d6dbcc58412f5/users/b230950759064229b4d42fb81ee4783e/roles/24c463e2b4d44dd28cd2723a69a8ed2e => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 22:30:50.368562 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd6662-1811-4f87-ad47-1fb0993cdf91 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:30:50.370445 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd6662-1811-4f87-ad47-1fb0993cdf91 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:30:50.370948 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd6662-1811-4f87-ad47-1fb0993cdf91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:30:50.401367 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-09fd6662-1811-4f87-ad47-1fb0993cdf91 None None] MFA Rules not processed for user `b230950759064229b4d42fb81ee4783e`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:30:50.402591 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-09fd6662-1811-4f87-ad47-1fb0993cdf91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:30:50.473375 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4525/9025] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 22:30:50 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:30:50.488967 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f419d751-58ea-4554-a26b-8571518e8b32 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:30:50.490795 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-f419d751-58ea-4554-a26b-8571518e8b32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:30:50.569582 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f419d751-58ea-4554-a26b-8571518e8b32 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:30:50.583071 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd386e-b5d7-4fb1-a194-6d4f541c439e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:30:50.584048 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd386e-b5d7-4fb1-a194-6d4f541c439e service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:30:50.586882 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd386e-b5d7-4fb1-a194-6d4f541c439e service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:30:50.586882 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd386e-b5d7-4fb1-a194-6d4f541c439e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:30:50.663457 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fd386e-b5d7-4fb1-a194-6d4f541c439e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:30:50.665165 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fd386e-b5d7-4fb1-a194-6d4f541c439e service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:30:50.676333 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4501/9026] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:30:50 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:30:53.161017 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb515d21-a38c-4f3a-b1d2-dcc6b6a1a0b3 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:30:53.161518 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb515d21-a38c-4f3a-b1d2-dcc6b6a1a0b3 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:30:53.161623 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb515d21-a38c-4f3a-b1d2-dcc6b6a1a0b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:30:53.182184 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-eb515d21-a38c-4f3a-b1d2-dcc6b6a1a0b3 None None] MFA Rules not processed for user `ccf50d85a6f2498f872254d47d1e70de`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:30:53.182184 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-eb515d21-a38c-4f3a-b1d2-dcc6b6a1a0b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:30:53.188583 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4526/9027] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 22:30:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:30:53.504223 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd386e-b5d7-4fb1-a194-6d4f541c439e service nova] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:30:53.558813 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd386e-b5d7-4fb1-a194-6d4f541c439e service nova] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:30:53.562387 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb0abff-c5ad-44c4-9c42-75bbdd7b03c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:30:53.563023 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb0abff-c5ad-44c4-9c42-75bbdd7b03c4 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:30:53.563303 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb0abff-c5ad-44c4-9c42-75bbdd7b03c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:30:53.563608 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb0abff-c5ad-44c4-9c42-75bbdd7b03c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:30:53.565336 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-9cb0abff-c5ad-44c4-9c42-75bbdd7b03c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:30:53.574743 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb0abff-c5ad-44c4-9c42-75bbdd7b03c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:30:53.576200 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb0abff-c5ad-44c4-9c42-75bbdd7b03c4 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:30:53.584031 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4502/9028] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:30:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:30:53.991239 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb515d21-a38c-4f3a-b1d2-dcc6b6a1a0b3 None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:30:53.992808 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-eb515d21-a38c-4f3a-b1d2-dcc6b6a1a0b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:30:54.076892 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb515d21-a38c-4f3a-b1d2-dcc6b6a1a0b3 None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:30:54.082013 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f6a7d0-cc14-41cc-8f9e-66223ff179ef service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:30:54.082673 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6a7d0-cc14-41cc-8f9e-66223ff179ef service placement] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:30:54.082956 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6a7d0-cc14-41cc-8f9e-66223ff179ef service placement] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:30:54.083231 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6a7d0-cc14-41cc-8f9e-66223ff179ef service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:30:54.085179 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-51f6a7d0-cc14-41cc-8f9e-66223ff179ef service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:30:54.098524 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f6a7d0-cc14-41cc-8f9e-66223ff179ef service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:30:54.100307 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f6a7d0-cc14-41cc-8f9e-66223ff179ef service placement] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:30:54.111194 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4527/9029] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:30:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:31:06.017241 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb0abff-c5ad-44c4-9c42-75bbdd7b03c4 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:31:06.018808 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-9cb0abff-c5ad-44c4-9c42-75bbdd7b03c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:31:06.030284 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb0abff-c5ad-44c4-9c42-75bbdd7b03c4 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:31:06.034039 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c0b351-3c47-4aeb-a4e3-976d76c23b09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:31:06.034672 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c0b351-3c47-4aeb-a4e3-976d76c23b09 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:31:06.034951 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c0b351-3c47-4aeb-a4e3-976d76c23b09 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:31:06.035221 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c0b351-3c47-4aeb-a4e3-976d76c23b09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:31:06.045523 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c0b351-3c47-4aeb-a4e3-976d76c23b09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:31:06.046940 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c0b351-3c47-4aeb-a4e3-976d76c23b09 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:31:06.056430 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4503/9030] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:31:06 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:31:08.043462 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f6a7d0-cc14-41cc-8f9e-66223ff179ef service placement] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:31:08.056197 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f6a7d0-cc14-41cc-8f9e-66223ff179ef service placement] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:31:08.062876 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ef64c0-1451-4f26-9d01-88118d2c9702 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:31:08.063555 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ef64c0-1451-4f26-9d01-88118d2c9702 service nova] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:31:08.063839 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ef64c0-1451-4f26-9d01-88118d2c9702 service nova] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:31:08.064113 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ef64c0-1451-4f26-9d01-88118d2c9702 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:31:08.065968 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-25ef64c0-1451-4f26-9d01-88118d2c9702 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:31:08.080115 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ef64c0-1451-4f26-9d01-88118d2c9702 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:31:08.081756 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ef64c0-1451-4f26-9d01-88118d2c9702 service nova] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:31:08.094670 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4528/9031] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:31:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:32:17.098706 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c0b351-3c47-4aeb-a4e3-976d76c23b09 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:32:17.108084 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c0b351-3c47-4aeb-a4e3-976d76c23b09 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:32:17.111729 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6517dcdd-5bdf-44f8-8219-b44a0643e594 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:32:17.112364 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6517dcdd-5bdf-44f8-8219-b44a0643e594 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:32:17.112645 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6517dcdd-5bdf-44f8-8219-b44a0643e594 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:32:17.112921 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6517dcdd-5bdf-44f8-8219-b44a0643e594 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:32:17.114679 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-6517dcdd-5bdf-44f8-8219-b44a0643e594 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:32:17.124431 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6517dcdd-5bdf-44f8-8219-b44a0643e594 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:32:17.125790 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6517dcdd-5bdf-44f8-8219-b44a0643e594 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:32:17.133647 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4504/9032] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:32:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:32:35.250890 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ef64c0-1451-4f26-9d01-88118d2c9702 service nova] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:32:35.271450 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ef64c0-1451-4f26-9d01-88118d2c9702 service nova] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:32:35.277025 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f72faf-3df7-4d44-b97a-097ba00cca4a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:32:35.277660 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f72faf-3df7-4d44-b97a-097ba00cca4a service placement] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:32:35.277946 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f72faf-3df7-4d44-b97a-097ba00cca4a service placement] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:32:35.278228 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f72faf-3df7-4d44-b97a-097ba00cca4a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:32:35.280010 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-73f72faf-3df7-4d44-b97a-097ba00cca4a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:32:35.291191 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f72faf-3df7-4d44-b97a-097ba00cca4a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:32:35.293579 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f72faf-3df7-4d44-b97a-097ba00cca4a service placement] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:32:35.303631 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4529/9033] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:32:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:33:06.862610 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e29b7b-7c0a-4a57-af42-ce9e82e05eef None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:33:06.863195 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e29b7b-7c0a-4a57-af42-ce9e82e05eef None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:33:06.863195 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e29b7b-7c0a-4a57-af42-ce9e82e05eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:33:06.880341 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-36e29b7b-7c0a-4a57-af42-ce9e82e05eef None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:33:06.885866 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-36e29b7b-7c0a-4a57-af42-ce9e82e05eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:33:06.940099 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4505/9034] 10.222.0.52 () {58 vars in 1009 bytes} [Sat May 14 22:33:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:33:07.080170 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f72faf-3df7-4d44-b97a-097ba00cca4a service placement] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:33:07.081588 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-73f72faf-3df7-4d44-b97a-097ba00cca4a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:33:07.147839 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f72faf-3df7-4d44-b97a-097ba00cca4a service placement] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:33:07.152924 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82af8e50-a711-4515-8d5e-93d7426e219e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:33:07.153565 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af8e50-a711-4515-8d5e-93d7426e219e service swift] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:33:07.153853 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af8e50-a711-4515-8d5e-93d7426e219e service swift] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:33:07.154131 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af8e50-a711-4515-8d5e-93d7426e219e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:33:07.162042 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82af8e50-a711-4515-8d5e-93d7426e219e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:33:07.163650 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82af8e50-a711-4515-8d5e-93d7426e219e service swift] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:33:07.171889 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4530/9035] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 22:33:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 22:33:09.595687 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e29b7b-7c0a-4a57-af42-ce9e82e05eef None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:33:09.615526 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e29b7b-7c0a-4a57-af42-ce9e82e05eef None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:33:09.622390 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8527a59b-af48-449a-8226-6ae4c5d12b5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:33:09.628084 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527a59b-af48-449a-8226-6ae4c5d12b5f service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:33:09.628084 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527a59b-af48-449a-8226-6ae4c5d12b5f service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:33:09.628084 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527a59b-af48-449a-8226-6ae4c5d12b5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:33:09.628084 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-8527a59b-af48-449a-8226-6ae4c5d12b5f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:33:09.639403 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8527a59b-af48-449a-8226-6ae4c5d12b5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:33:09.641413 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8527a59b-af48-449a-8226-6ae4c5d12b5f service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:33:09.654099 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4506/9036] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:33:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:33:17.365621 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05afaa9b-3b14-4533-bdaf-bd391758ee61 None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:33:17.366146 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05afaa9b-3b14-4533-bdaf-bd391758ee61 None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:33:17.366146 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05afaa9b-3b14-4533-bdaf-bd391758ee61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:33:17.384560 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-05afaa9b-3b14-4533-bdaf-bd391758ee61 None None] MFA Rules not processed for user `ccf50d85a6f2498f872254d47d1e70de`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:33:17.385670 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-05afaa9b-3b14-4533-bdaf-bd391758ee61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:33:17.393186 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4531/9037] 10.222.0.52 () {58 vars in 957 bytes} [Sat May 14 22:33:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:33:20.266366 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8527a59b-af48-449a-8226-6ae4c5d12b5f service nova] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:33:20.278963 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8527a59b-af48-449a-8226-6ae4c5d12b5f service nova] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:33:20.285301 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8783060-ce1f-4631-a002-228b1a547caa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:33:20.285941 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8783060-ce1f-4631-a002-228b1a547caa service placement] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:33:20.286219 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8783060-ce1f-4631-a002-228b1a547caa service placement] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:33:20.286489 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8783060-ce1f-4631-a002-228b1a547caa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:33:20.288289 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-e8783060-ce1f-4631-a002-228b1a547caa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:33:20.301025 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8783060-ce1f-4631-a002-228b1a547caa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:33:20.302611 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8783060-ce1f-4631-a002-228b1a547caa service placement] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:33:20.313836 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4507/9038] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:33:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:33:23.800194 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c569d5-9a6f-4a1c-b3eb-f8692b1fde6b None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:33:23.800747 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c569d5-9a6f-4a1c-b3eb-f8692b1fde6b None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:33:23.800747 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c569d5-9a6f-4a1c-b3eb-f8692b1fde6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:33:23.819865 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-42c569d5-9a6f-4a1c-b3eb-f8692b1fde6b None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:33:23.821088 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-42c569d5-9a6f-4a1c-b3eb-f8692b1fde6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:33:23.829043 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4532/9039] 10.222.0.52 () {58 vars in 1009 bytes} [Sat May 14 22:33:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:33:23.841586 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8783060-ce1f-4631-a002-228b1a547caa service placement] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:33:23.852727 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8783060-ce1f-4631-a002-228b1a547caa service placement] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:33:23.858361 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38fae74-34c1-4e34-a5e8-cfa2c63f8634 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:33:23.862829 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38fae74-34c1-4e34-a5e8-cfa2c63f8634 service swift] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:33:23.862829 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38fae74-34c1-4e34-a5e8-cfa2c63f8634 service swift] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:33:23.862829 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38fae74-34c1-4e34-a5e8-cfa2c63f8634 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:33:23.868063 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38fae74-34c1-4e34-a5e8-cfa2c63f8634 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:33:23.869633 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38fae74-34c1-4e34-a5e8-cfa2c63f8634 service swift] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:33:23.878710 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4508/9040] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 22:33:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 22:33:29.134877 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c569d5-9a6f-4a1c-b3eb-f8692b1fde6b None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:33:29.155224 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c569d5-9a6f-4a1c-b3eb-f8692b1fde6b None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:33:29.158898 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cd4404-c25b-4bfe-90b0-d3e3c6a44f56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:33:29.159601 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd4404-c25b-4bfe-90b0-d3e3c6a44f56 service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:33:29.159885 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd4404-c25b-4bfe-90b0-d3e3c6a44f56 service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:33:29.160161 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd4404-c25b-4bfe-90b0-d3e3c6a44f56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:33:29.161944 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-94cd4404-c25b-4bfe-90b0-d3e3c6a44f56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:33:29.191193 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cd4404-c25b-4bfe-90b0-d3e3c6a44f56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:33:29.192613 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cd4404-c25b-4bfe-90b0-d3e3c6a44f56 service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:33:29.201087 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4533/9041] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:33:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:33:30.470383 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38fae74-34c1-4e34-a5e8-cfa2c63f8634 service swift] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:33:30.551791 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38fae74-34c1-4e34-a5e8-cfa2c63f8634 service swift] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:33:30.558720 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b211dba1-1a84-46e8-a359-f2c5211e99c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b0e2b025d4eceaa90e1616d0a9db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:33:30.559471 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b211dba1-1a84-46e8-a359-f2c5211e99c8 service nova] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:33:30.559878 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b211dba1-1a84-46e8-a359-f2c5211e99c8 service nova] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:33:30.560241 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b211dba1-1a84-46e8-a359-f2c5211e99c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:33:30.562163 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-b211dba1-1a84-46e8-a359-f2c5211e99c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:33:30.602986 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b211dba1-1a84-46e8-a359-f2c5211e99c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:33:30.605322 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b211dba1-1a84-46e8-a359-f2c5211e99c8 service nova] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:33:30.633023 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4509/9042] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:33:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:33:40.699603 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cd4404-c25b-4bfe-90b0-d3e3c6a44f56 service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:33:40.701388 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-94cd4404-c25b-4bfe-90b0-d3e3c6a44f56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:33:40.717009 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cd4404-c25b-4bfe-90b0-d3e3c6a44f56 service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:33:40.722168 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bb3006-94ab-49e9-a43f-e6b4327d08e9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:33:40.723210 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb3006-94ab-49e9-a43f-e6b4327d08e9 service placement] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:33:40.723536 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb3006-94ab-49e9-a43f-e6b4327d08e9 service placement] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:33:40.723822 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb3006-94ab-49e9-a43f-e6b4327d08e9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:33:40.725653 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-e7bb3006-94ab-49e9-a43f-e6b4327d08e9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:33:40.738354 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bb3006-94ab-49e9-a43f-e6b4327d08e9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:33:40.740006 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bb3006-94ab-49e9-a43f-e6b4327d08e9 service placement] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:33:40.750978 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4534/9043] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:33:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:35:15.935435 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ed6af-727c-4152-81c1-c0aa78158df1 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:35:15.936018 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ed6af-727c-4152-81c1-c0aa78158df1 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:35:15.936018 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ed6af-727c-4152-81c1-c0aa78158df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:35:15.998237 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-aa1ed6af-727c-4152-81c1-c0aa78158df1 None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:35:15.999521 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-aa1ed6af-727c-4152-81c1-c0aa78158df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:35:16.027765 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4510/9044] 10.222.0.52 () {58 vars in 1009 bytes} [Sat May 14 22:35:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:35:16.068903 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bb3006-94ab-49e9-a43f-e6b4327d08e9 service placement] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:35:16.089762 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bb3006-94ab-49e9-a43f-e6b4327d08e9 service placement] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:35:16.095205 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d59b64-edfe-474e-8763-50956d64e3f7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:35:16.097101 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d59b64-edfe-474e-8763-50956d64e3f7 service swift] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:35:16.097101 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d59b64-edfe-474e-8763-50956d64e3f7 service swift] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:35:16.097101 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d59b64-edfe-474e-8763-50956d64e3f7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:35:16.104880 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d59b64-edfe-474e-8763-50956d64e3f7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:35:16.106494 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d59b64-edfe-474e-8763-50956d64e3f7 service swift] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:35:16.114486 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4535/9045] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 22:35:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 22:35:25.991815 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4d378-3c84-48a5-8382-5057cdea3228 None None] REQUEST_METHOD: `POST` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:35:25.997098 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4d378-3c84-48a5-8382-5057cdea3228 None None] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:35:25.997098 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4d378-3c84-48a5-8382-5057cdea3228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:35:26.017860 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.auth.core [None req-9fe4d378-3c84-48a5-8382-5057cdea3228 None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:35:26.019084 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-9fe4d378-3c84-48a5-8382-5057cdea3228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:35:26.026964 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4511/9046] 10.222.0.52 () {58 vars in 967 bytes} [Sat May 14 22:35:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 22:35:26.040642 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d59b64-edfe-474e-8763-50956d64e3f7 service swift] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:35:26.052423 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d59b64-edfe-474e-8763-50956d64e3f7 service swift] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:35:26.058731 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31269b0e-74b6-4c87-9958-9609d9cb8d48 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:35:26.059391 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31269b0e-74b6-4c87-9958-9609d9cb8d48 service swift] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:35:26.059716 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31269b0e-74b6-4c87-9958-9609d9cb8d48 service swift] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:35:26.059998 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31269b0e-74b6-4c87-9958-9609d9cb8d48 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:35:26.069888 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31269b0e-74b6-4c87-9958-9609d9cb8d48 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:35:26.071546 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31269b0e-74b6-4c87-9958-9609d9cb8d48 service swift] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:35:26.079675 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4536/9047] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 22:35:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 14 22:35:28.420197 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe4d378-3c84-48a5-8382-5057cdea3228 None None] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:35:28.431272 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe4d378-3c84-48a5-8382-5057cdea3228 None None] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:35:28.435010 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddaadcb-c9b7-4a9a-b4ec-44d9063dc9b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:35:28.435604 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddaadcb-c9b7-4a9a-b4ec-44d9063dc9b8 service neutron] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:35:28.435887 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddaadcb-c9b7-4a9a-b4ec-44d9063dc9b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:35:28.436158 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddaadcb-c9b7-4a9a-b4ec-44d9063dc9b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:35:28.438004 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-bddaadcb-c9b7-4a9a-b4ec-44d9063dc9b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:35:28.469886 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddaadcb-c9b7-4a9a-b4ec-44d9063dc9b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:35:28.471435 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddaadcb-c9b7-4a9a-b4ec-44d9063dc9b8 service neutron] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:35:28.494366 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4512/9048] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:35:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:35:32.061718 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2579e1-0860-48d2-992d-4f646c969ede None None] REQUEST_METHOD: `POST` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:35:32.064168 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2579e1-0860-48d2-992d-4f646c969ede None None] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:35:32.064168 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2579e1-0860-48d2-992d-4f646c969ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:35:32.081333 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.auth.core [None req-4b2579e1-0860-48d2-992d-4f646c969ede None None] MFA Rules not processed for user `c31cffc526be4f8992c57ca5e4e2a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 22:35:32.082527 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-4b2579e1-0860-48d2-992d-4f646c969ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:35:32.090277 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4537/9049] 10.222.0.52 () {58 vars in 967 bytes} [Sat May 14 22:35:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 22:35:32.102915 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddaadcb-c9b7-4a9a-b4ec-44d9063dc9b8 service neutron] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:35:32.113965 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddaadcb-c9b7-4a9a-b4ec-44d9063dc9b8 service neutron] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:35:32.119009 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b0d512-74b4-4c4e-8479-774c8629597c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c781fe7f4a014f0d8b5e7385b20b348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:35:32.121442 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b0d512-74b4-4c4e-8479-774c8629597c service swift] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:35:32.121442 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b0d512-74b4-4c4e-8479-774c8629597c service swift] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:35:32.121442 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b0d512-74b4-4c4e-8479-774c8629597c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:35:32.128410 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b0d512-74b4-4c4e-8479-774c8629597c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:35:32.129987 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b0d512-74b4-4c4e-8479-774c8629597c service swift] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:35:32.137966 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4513/9050] 10.222.0.52 () {60 vars in 1384 bytes} [Sat May 14 22:35:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 22:35:38.477164 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2579e1-0860-48d2-992d-4f646c969ede None None] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:35:38.486730 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2579e1-0860-48d2-992d-4f646c969ede None None] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:35:38.491056 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a481ee3-1c0c-4307-9185-b42f71e109de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ed32a6d699453bb7e088540e8fc980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:35:38.493770 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a481ee3-1c0c-4307-9185-b42f71e109de service neutron] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:35:38.493770 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a481ee3-1c0c-4307-9185-b42f71e109de service neutron] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:35:38.493770 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a481ee3-1c0c-4307-9185-b42f71e109de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:35:38.552065 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a481ee3-1c0c-4307-9185-b42f71e109de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:35:38.553733 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a481ee3-1c0c-4307-9185-b42f71e109de service neutron] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:35:38.563527 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4538/9051] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:35:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:35:46.254950 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b0d512-74b4-4c4e-8479-774c8629597c service swift] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:35:46.266434 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b0d512-74b4-4c4e-8479-774c8629597c service swift] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:35:46.271175 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f40294-6cab-4f1e-9e16-5f37bcd3b4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:35:46.272121 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f40294-6cab-4f1e-9e16-5f37bcd3b4f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:35:46.272417 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f40294-6cab-4f1e-9e16-5f37bcd3b4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:35:46.272691 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f40294-6cab-4f1e-9e16-5f37bcd3b4f8 admin admin] PATH_INFO: `/v3/users/ccf50d85a6f2498f872254d47d1e70de` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:35:46.273885 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f40294-6cab-4f1e-9e16-5f37bcd3b4f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccf50d85a6f2498f872254d47d1e70de)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:35:46.275856 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f40294-6cab-4f1e-9e16-5f37bcd3b4f8 admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:35:46.466811 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f6f40294-6cab-4f1e-9e16-5f37bcd3b4f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccf50d85a6f2498f872254d47d1e70de'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:35:46.475862 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f6f40294-6cab-4f1e-9e16-5f37bcd3b4f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccf50d85a6f2498f872254d47d1e70de'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:35:46.476676 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f6f40294-6cab-4f1e-9e16-5f37bcd3b4f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccf50d85a6f2498f872254d47d1e70de'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:35:46.535963 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f6f40294-6cab-4f1e-9e16-5f37bcd3b4f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccf50d85a6f2498f872254d47d1e70de'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:35:46.549194 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-f6f40294-6cab-4f1e-9e16-5f37bcd3b4f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccf50d85a6f2498f872254d47d1e70de'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:35:46.555830 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4514/9052] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 22:35:46 2022] DELETE /identity/v3/users/ccf50d85a6f2498f872254d47d1e70de => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 22:35:46.809037 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a481ee3-1c0c-4307-9185-b42f71e109de service neutron] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:35:46.821903 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a481ee3-1c0c-4307-9185-b42f71e109de service neutron] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:35:46.889873 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7346c782-429b-4ff8-9510-cd40b4e6a02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:35:46.890746 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7346c782-429b-4ff8-9510-cd40b4e6a02c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:35:46.891032 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7346c782-429b-4ff8-9510-cd40b4e6a02c admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:35:46.891317 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7346c782-429b-4ff8-9510-cd40b4e6a02c admin admin] PATH_INFO: `/v3/projects/d2345189dd994ee0adc9391fe9f6856a` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:35:46.893357 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7346c782-429b-4ff8-9510-cd40b4e6a02c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2345189dd994ee0adc9391fe9f6856a)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:35:46.895929 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7346c782-429b-4ff8-9510-cd40b4e6a02c admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:35:47.001991 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-7346c782-429b-4ff8-9510-cd40b4e6a02c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2345189dd994ee0adc9391fe9f6856a', 'request_id': 'req-7346c782-429b-4ff8-9510-cd40b4e6a02c'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:35:47.008603 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-7346c782-429b-4ff8-9510-cd40b4e6a02c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2345189dd994ee0adc9391fe9f6856a', 'request_id': 'req-7346c782-429b-4ff8-9510-cd40b4e6a02c'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:35:47.083911 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-7346c782-429b-4ff8-9510-cd40b4e6a02c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2345189dd994ee0adc9391fe9f6856a', 'request_id': 'req-7346c782-429b-4ff8-9510-cd40b4e6a02c'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:35:47.095885 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-7346c782-429b-4ff8-9510-cd40b4e6a02c admin admin] The token cache is being invalidate because project d2345189dd994ee0adc9391fe9f6856a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 22:35:47.096176 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-7346c782-429b-4ff8-9510-cd40b4e6a02c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:35:47.096818 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-7346c782-429b-4ff8-9510-cd40b4e6a02c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:35:47.098380 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4539/9053] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 22:35:46 2022] DELETE /identity/v3/projects/d2345189dd994ee0adc9391fe9f6856a => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 22:35:47.102396 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f40294-6cab-4f1e-9e16-5f37bcd3b4f8 admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:35:47.103907 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-f6f40294-6cab-4f1e-9e16-5f37bcd3b4f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:35:47.117578 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f40294-6cab-4f1e-9e16-5f37bcd3b4f8 admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:35:47.178958 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297372d3-4a01-42af-8b29-0a0bde2dcf6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:35:47.179881 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297372d3-4a01-42af-8b29-0a0bde2dcf6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:35:47.180170 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297372d3-4a01-42af-8b29-0a0bde2dcf6a admin admin] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:35:47.180474 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297372d3-4a01-42af-8b29-0a0bde2dcf6a admin admin] PATH_INFO: `/v3/users/b230950759064229b4d42fb81ee4783e` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:35:47.181694 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297372d3-4a01-42af-8b29-0a0bde2dcf6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b230950759064229b4d42fb81ee4783e)` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:35:47.183689 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297372d3-4a01-42af-8b29-0a0bde2dcf6a admin admin] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:35:47.367032 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-297372d3-4a01-42af-8b29-0a0bde2dcf6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b230950759064229b4d42fb81ee4783e'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:35:47.373974 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-297372d3-4a01-42af-8b29-0a0bde2dcf6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b230950759064229b4d42fb81ee4783e'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:35:47.374668 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-297372d3-4a01-42af-8b29-0a0bde2dcf6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b230950759064229b4d42fb81ee4783e'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:35:47.475688 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-297372d3-4a01-42af-8b29-0a0bde2dcf6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b230950759064229b4d42fb81ee4783e'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:35:47.487802 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.notifications [None req-297372d3-4a01-42af-8b29-0a0bde2dcf6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b230950759064229b4d42fb81ee4783e'} {{(pid=91107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:35:47.494610 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4515/9054] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 22:35:47 2022] DELETE /identity/v3/users/b230950759064229b4d42fb81ee4783e => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 22:35:47.734035 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7346c782-429b-4ff8-9510-cd40b4e6a02c admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:35:47.735450 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-7346c782-429b-4ff8-9510-cd40b4e6a02c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:35:47.748346 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7346c782-429b-4ff8-9510-cd40b4e6a02c admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:35:47.806526 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e872b2c-1d72-44d2-b824-29504f5f4e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b0e25d0144f868beb29eb9540ea7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a027574eeb4536a94751bde54cf3b1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:35:47.807394 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e872b2c-1d72-44d2-b824-29504f5f4e61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:35:47.807713 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e872b2c-1d72-44d2-b824-29504f5f4e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:35:47.808005 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e872b2c-1d72-44d2-b824-29504f5f4e61 admin admin] PATH_INFO: `/v3/projects/a1026b33b53344e09d4d6dbcc58412f5` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:35:47.809186 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e872b2c-1d72-44d2-b824-29504f5f4e61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1026b33b53344e09d4d6dbcc58412f5)` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:35:47.811113 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e872b2c-1d72-44d2-b824-29504f5f4e61 admin admin] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:35:47.916047 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6e872b2c-1d72-44d2-b824-29504f5f4e61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1026b33b53344e09d4d6dbcc58412f5', 'request_id': 'req-6e872b2c-1d72-44d2-b824-29504f5f4e61'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:35:47.921623 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6e872b2c-1d72-44d2-b824-29504f5f4e61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1026b33b53344e09d4d6dbcc58412f5', 'request_id': 'req-6e872b2c-1d72-44d2-b824-29504f5f4e61'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:35:48.004545 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6e872b2c-1d72-44d2-b824-29504f5f4e61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1026b33b53344e09d4d6dbcc58412f5', 'request_id': 'req-6e872b2c-1d72-44d2-b824-29504f5f4e61'} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:35:48.016252 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6e872b2c-1d72-44d2-b824-29504f5f4e61 admin admin] The token cache is being invalidate because project a1026b33b53344e09d4d6dbcc58412f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 22:35:48.016539 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6e872b2c-1d72-44d2-b824-29504f5f4e61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:35:48.017175 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.notifications [None req-6e872b2c-1d72-44d2-b824-29504f5f4e61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 22:35:48.018729 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4540/9055] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 22:35:47 2022] DELETE /identity/v3/projects/a1026b33b53344e09d4d6dbcc58412f5 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 22:37:40.292464 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297372d3-4a01-42af-8b29-0a0bde2dcf6a admin admin] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:37:40.293867 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-297372d3-4a01-42af-8b29-0a0bde2dcf6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:37:40.360992 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297372d3-4a01-42af-8b29-0a0bde2dcf6a admin admin] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:37:40.420027 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda5b98a-680d-4f49-b9d8-4682edc89be6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:37:40.420672 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5b98a-680d-4f49-b9d8-4682edc89be6 service placement] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:37:40.420956 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5b98a-680d-4f49-b9d8-4682edc89be6 service placement] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:37:40.421232 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5b98a-680d-4f49-b9d8-4682edc89be6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:37:40.423264 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.fernet_utils [None req-bda5b98a-680d-4f49-b9d8-4682edc89be6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:37:40.434827 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda5b98a-680d-4f49-b9d8-4682edc89be6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:37:40.436441 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda5b98a-680d-4f49-b9d8-4682edc89be6 service placement] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:37:40.446315 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4516/9056] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:37:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:38:44.676863 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e872b2c-1d72-44d2-b824-29504f5f4e61 admin admin] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:38:44.678413 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-6e872b2c-1d72-44d2-b824-29504f5f4e61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:38:44.693216 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e872b2c-1d72-44d2-b824-29504f5f4e61 admin admin] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:38:44.698367 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c4b009-b1e8-4daa-819e-47cdc31f57aa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:38:44.699009 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c4b009-b1e8-4daa-819e-47cdc31f57aa service placement] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:38:44.699294 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c4b009-b1e8-4daa-819e-47cdc31f57aa service placement] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:38:44.699607 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c4b009-b1e8-4daa-819e-47cdc31f57aa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:38:44.701351 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-26c4b009-b1e8-4daa-819e-47cdc31f57aa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:38:44.712823 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c4b009-b1e8-4daa-819e-47cdc31f57aa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:38:44.714739 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c4b009-b1e8-4daa-819e-47cdc31f57aa service placement] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:38:44.724642 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4541/9057] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:38:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 22:42:47.258914 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda5b98a-680d-4f49-b9d8-4682edc89be6 service placement] Authenticating user token {{(pid=91107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:42:47.278491 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda5b98a-680d-4f49-b9d8-4682edc89be6 service placement] Validating token access rules against request {{(pid=91107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:42:47.283621 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c32e6-56a0-464a-a106-3c7e1ced43cc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:42:47.284258 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c32e6-56a0-464a-a106-3c7e1ced43cc service placement] REQUEST_METHOD: `GET` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:42:47.284542 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c32e6-56a0-464a-a106-3c7e1ced43cc service placement] SCRIPT_NAME: `/identity` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:42:47.284819 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c32e6-56a0-464a-a106-3c7e1ced43cc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:42:47.295258 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159c32e6-56a0-464a-a106-3c7e1ced43cc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:42:47.296871 ncdv-master-1 devstack@keystone.service[91107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159c32e6-56a0-464a-a106-3c7e1ced43cc service placement] RBAC: Authorization granted {{(pid=91107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:42:47.307657 ncdv-master-1 devstack@keystone.service[91107]: [pid: 91107|app: 0|req: 4517/9058] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:42:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 22:43:46.711195 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c4b009-b1e8-4daa-819e-47cdc31f57aa service placement] Authenticating user token {{(pid=91106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 22:43:46.712632 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.fernet_utils [None req-26c4b009-b1e8-4daa-819e-47cdc31f57aa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 22:43:46.793659 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c4b009-b1e8-4daa-819e-47cdc31f57aa service placement] Validating token access rules against request {{(pid=91106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 22:43:46.798864 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41488d5d-1050-4f3c-b7e9-1f03921308da service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0812ae67e44d483baf2dbb1a5332a1d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0911a024287e430ea6ee015389f0c440', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 22:43:46.799527 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41488d5d-1050-4f3c-b7e9-1f03921308da service placement] REQUEST_METHOD: `GET` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 22:43:46.799816 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41488d5d-1050-4f3c-b7e9-1f03921308da service placement] SCRIPT_NAME: `/identity` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 22:43:46.800096 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41488d5d-1050-4f3c-b7e9-1f03921308da service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 22:43:46.808937 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41488d5d-1050-4f3c-b7e9-1f03921308da service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 22:43:46.810554 ncdv-master-1 devstack@keystone.service[91106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41488d5d-1050-4f3c-b7e9-1f03921308da service placement] RBAC: Authorization granted {{(pid=91106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 22:43:46.821557 ncdv-master-1 devstack@keystone.service[91106]: [pid: 91106|app: 0|req: 4542/9059] 10.222.0.52 () {60 vars in 1365 bytes} [Sat May 14 22:43:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)